2024-04-26T21:52:12.335 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T21:52:12.335 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238 --owner scheduled_rishabh@teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/orig.config.yaml 2024-04-26T21:52:12.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T21:52:12.452 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238 branch: wip-rishabh-testing-20240426.111959 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} email: null first_in_suite: false job_id: '7675238' kernel: client: sha1: distro flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi137.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGUJte4IjKCSp79WRg53qH+xXMzRXyEOU3ySROqySBsDd2sUSOF1YfNiuAjsUyqtwB6g0GqUdRRuGq12BuWSKXw= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBClELUAj+m38LHQqzRyGhB3kmJYfMd6/DnA8QuuLR7Ook7xHYbXM7lDfrCLu2Usf/VjIx2SKNkXJSzJc0TAZUMw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T21:52:12.452 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T21:52:12.453 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T21:52:12.453 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T21:52:12.455 INFO:teuthology.task.internal:Checking packages... 2024-04-26T21:52:12.476 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T21:52:12.476 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T21:52:12.476 INFO:teuthology.packaging:ref: None 2024-04-26T21:52:12.476 INFO:teuthology.packaging:tag: None 2024-04-26T21:52:12.476 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T21:52:12.476 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:52:12.477 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T21:52:12.617 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306.gbc612ffb 2024-04-26T21:52:12.618 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T21:52:12.625 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T21:52:12.625 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T21:52:12.642 INFO:teuthology.task.internal:Saving configuration 2024-04-26T21:52:12.658 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T21:52:12.664 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T21:52:12.691 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:47:10.613682', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGUJte4IjKCSp79WRg53qH+xXMzRXyEOU3ySROqySBsDd2sUSOF1YfNiuAjsUyqtwB6g0GqUdRRuGq12BuWSKXw='} 2024-04-26T21:52:12.711 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:47:10.615109', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBClELUAj+m38LHQqzRyGhB3kmJYfMd6/DnA8QuuLR7Ook7xHYbXM7lDfrCLu2Usf/VjIx2SKNkXJSzJc0TAZUMw='} 2024-04-26T21:52:12.711 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T21:52:12.717 INFO:teuthology.task.internal:roles: ubuntu@smithi137.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-26T21:52:12.717 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-26T21:52:12.717 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T21:52:12.787 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb613873160>, signals=[15]) 2024-04-26T21:52:12.788 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T21:52:12.794 INFO:teuthology.task.internal:Opening connections... 2024-04-26T21:52:12.794 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T21:52:12.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:52:12.876 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T21:52:12.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:52:12.952 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T21:52:12.959 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-26T21:52:12.977 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-26T21:52:12.977 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-26T21:52:13.033 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T21:52:13.034 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T21:52:13.035 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-26T21:52:13.059 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-04-26T21:52:13.077 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-04-26T21:52:13.077 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-04-26T21:52:13.135 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-04-26T21:52:13.135 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-04-26T21:52:13.136 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-04-26T21:52:13.136 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-04-26T21:52:13.136 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-04-26T21:52:13.136 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-04-26T21:52:13.136 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T21:52:13.136 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-04-26T21:52:13.136 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-04-26T21:52:13.137 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T21:52:13.137 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-04-26T21:52:13.137 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T21:52:13.137 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T21:52:13.137 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T21:52:13.137 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-04-26T21:52:13.159 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T21:52:13.171 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T21:52:13.177 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T21:52:13.178 DEBUG:teuthology.orchestra.run.smithi137:> test '!' -e /home/ubuntu/cephtest 2024-04-26T21:52:13.180 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-04-26T21:52:13.197 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T21:52:13.203 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T21:52:13.203 DEBUG:teuthology.orchestra.run.smithi137:> test -z $(ls -A /var/lib/ceph) 2024-04-26T21:52:13.238 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-04-26T21:52:13.266 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T21:52:13.321 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T21:52:13.336 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T21:52:13.336 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-26T21:52:13.336 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-26T21:52:13.336 DEBUG:teuthology.orchestra.run.smithi137:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T21:52:13.337 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T21:52:13.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:52:13.353 DEBUG:teuthology.orchestra.run.smithi137:> uname -r 2024-04-26T21:52:13.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:52:13.355 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-04-26T21:52:13.411 INFO:teuthology.orchestra.run.smithi137.stdout:5.14.0-437.el9.x86_64 2024-04-26T21:52:13.411 INFO:teuthology.task.kernel:Running kernel on smithi137: 5.14.0-437.el9.x86_64 2024-04-26T21:52:13.412 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum install -y kernel 2024-04-26T21:52:13.413 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-437.el9.x86_64 2024-04-26T21:52:13.414 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-437.el9.x86_64 2024-04-26T21:52:13.414 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-04-26T21:52:15.570 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-26T21:52:16.554 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.0 MB 00:01 2024-04-26T21:52:17.297 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-26T21:52:18.700 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-26T21:52:21.747 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 6.2 MB 00:00 2024-04-26T21:52:22.948 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T21:52:23.715 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-26T21:52:24.698 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-04-26T21:52:25.735 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-26T21:52:25.848 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-04-26T21:52:30.907 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-26T21:52:30.933 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-04-26T21:52:32.756 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T21:52:32.756 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T21:52:32.814 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T21:52:32.814 INFO:teuthology.orchestra.run.smithi137.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T21:52:32.860 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T21:52:32.860 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-26T21:52:32.861 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T21:52:32.905 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-26T21:52:32.906 INFO:teuthology.orchestra.run.smithi137.stdout:Nothing to do. 2024-04-26T21:52:32.906 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-26T21:52:32.984 DEBUG:teuthology.orchestra.run.smithi170:> echo no | sudo yum reinstall kernel || true 2024-04-26T21:52:33.012 DEBUG:teuthology.orchestra.run.smithi137:> echo no | sudo yum reinstall kernel || true 2024-04-26T21:52:33.512 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 09:52:30 PM UTC. 2024-04-26T21:52:33.523 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 09:52:30 PM UTC. 2024-04-26T21:52:33.635 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-26T21:52:33.647 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T21:52:33.650 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-26T21:52:33.650 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-26T21:52:33.650 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-26T21:52:33.650 INFO:teuthology.orchestra.run.smithi137.stdout:Reinstalling: 2024-04-26T21:52:33.650 INFO:teuthology.orchestra.run.smithi137.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T21:52:33.650 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:52:33.650 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-26T21:52:33.650 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-26T21:52:33.651 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:52:33.651 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 255 k 2024-04-26T21:52:33.651 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 0 2024-04-26T21:52:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:Operation aborted. 2024-04-26T21:52:33.654 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T21:52:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-26T21:52:33.654 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T21:52:33.654 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalling: 2024-04-26T21:52:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T21:52:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:52:33.655 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T21:52:33.655 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T21:52:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:52:33.655 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 255 k 2024-04-26T21:52:33.655 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 0 2024-04-26T21:52:33.656 INFO:teuthology.orchestra.run.smithi170.stderr:Operation aborted. 2024-04-26T21:52:33.704 INFO:teuthology.orchestra.run.smithi137.stdout:Is this ok [y/N]: 2024-04-26T21:52:33.704 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum reinstall -y kernel || true 2024-04-26T21:52:33.718 INFO:teuthology.orchestra.run.smithi170.stdout:Is this ok [y/N]: 2024-04-26T21:52:33.719 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum reinstall -y kernel || true 2024-04-26T21:52:34.198 INFO:teuthology.orchestra.run.smithi137.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 09:52:30 PM UTC. 2024-04-26T21:52:34.209 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:04 ago on Fri 26 Apr 2024 09:52:30 PM UTC. 2024-04-26T21:52:34.317 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-26T21:52:34.317 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-26T21:52:34.317 INFO:teuthology.orchestra.run.smithi137.stdout: Package Architecture Version Repository Size 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout:Reinstalling: 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout:================================================================================ 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 255 k 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout:Installed size: 0 2024-04-26T21:52:34.318 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-26T21:52:34.325 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T21:52:34.325 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T21:52:34.325 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-26T21:52:34.326 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T21:52:34.326 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalling: 2024-04-26T21:52:34.326 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T21:52:34.326 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:52:34.326 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T21:52:34.326 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-26T21:52:34.326 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:52:34.327 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 255 k 2024-04-26T21:52:34.327 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 0 2024-04-26T21:52:34.327 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T21:52:34.618 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.5 MB/s | 255 kB 00:00 2024-04-26T21:52:34.618 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:52:34.618 INFO:teuthology.orchestra.run.smithi137.stdout:Total 850 kB/s | 255 kB 00:00 2024-04-26T21:52:34.636 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-26T21:52:34.769 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.5 MB/s | 255 kB 00:00 2024-04-26T21:52:34.769 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:52:34.769 INFO:teuthology.orchestra.run.smithi170.stdout:Total 576 kB/s | 255 kB 00:00 2024-04-26T21:52:34.785 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T21:52:34.810 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-26T21:52:34.811 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-26T21:52:34.816 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-26T21:52:34.816 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-26T21:52:34.938 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-26T21:52:34.960 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T21:52:34.960 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T21:52:34.965 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T21:52:34.966 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T21:52:35.010 INFO:teuthology.orchestra.run.smithi137.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T21:52:35.011 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T21:52:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T21:52:35.153 INFO:teuthology.orchestra.run.smithi170.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T21:52:35.153 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T21:52:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T21:52:35.728 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T21:52:35.806 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T21:52:35.806 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T21:52:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T21:52:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:52:36.417 INFO:teuthology.orchestra.run.smithi137.stdout:Reinstalled: 2024-04-26T21:52:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T21:52:36.417 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:52:36.417 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-26T21:52:36.520 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T21:52:36.520 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:52:36.520 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalled: 2024-04-26T21:52:36.521 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T21:52:36.521 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:52:36.521 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T21:52:36.571 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T21:52:36.617 INFO:teuthology.orchestra.run.smithi137.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T21:52:36.618 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T21:52:36.618 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T21:52:36.618 DEBUG:teuthology.parallel:result is None 2024-04-26T21:52:36.699 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T21:52:36.745 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T21:52:36.746 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T21:52:36.746 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T21:52:36.746 DEBUG:teuthology.parallel:result is None 2024-04-26T21:52:36.746 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T21:52:36.754 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T21:52:36.755 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T21:52:36.757 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T21:52:36.771 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T21:52:36.777 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T21:52:36.783 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T21:52:36.784 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T21:52:36.812 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T21:52:36.840 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T21:52:36.846 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T21:52:36.846 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T21:52:36.875 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T21:52:36.906 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:52:36.907 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:52:36.921 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:52:36.924 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T21:52:36.925 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T21:52:36.935 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T21:52:36.935 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T21:52:36.966 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T21:52:36.989 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T21:52:36.998 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T21:52:36.998 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T21:52:37.030 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T21:52:37.044 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:52:37.121 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:52:37.173 DEBUG:teuthology.orchestra.run.smithi137:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:52:37.249 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:52:37.292 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:52:37.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T21:52:37.355 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:52:37.397 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T21:52:37.442 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:52:37.523 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T21:52:37.561 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:52:37.561 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T21:52:37.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo service rsyslog restart 2024-04-26T21:52:37.626 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-04-26T21:52:37.656 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:52:37.696 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T21:52:38.020 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T21:52:38.030 INFO:teuthology.task.internal:Starting timer... 2024-04-26T21:52:38.030 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T21:52:38.039 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T21:52:38.051 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-26T21:52:38.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo service auditd rotate 2024-04-26T21:52:38.092 INFO:teuthology.orchestra.run.smithi137.stdout:Rotating logs: 2024-04-26T21:52:38.094 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-04-26T21:52:38.144 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-04-26T21:52:38.146 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T21:52:38.146 DEBUG:teuthology.orchestra.run.smithi137:> /usr/sbin/getenforce 2024-04-26T21:52:38.167 INFO:teuthology.orchestra.run.smithi137.stdout:Permissive 2024-04-26T21:52:38.168 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-04-26T21:52:38.192 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-04-26T21:52:38.192 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi137.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2024-04-26T21:52:38.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:52:38.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:52:38.231 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T21:52:38.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:52:38.255 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T21:52:38.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo /usr/sbin/setenforce permissive 2024-04-26T21:52:38.303 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-04-26T21:52:38.326 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T21:52:38.336 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T21:52:38.341 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T21:52:38.484 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T21:52:38.500 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T21:52:38.501 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi137.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T21:56:04.669 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi137.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-04-26T21:56:04.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-26T21:56:04.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:56:04.744 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-26T21:56:04.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-26T21:56:04.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T21:56:04.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T21:56:04.897 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-04-26T21:56:04.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-26T21:56:04.986 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T21:56:04.999 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T21:56:05.000 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T21:56:05.000 DEBUG:teuthology.orchestra.run.smithi137:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:56:05.002 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T21:56:05.003 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T21:56:05.026 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T21:56:05.039 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T21:56:05.055 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T21:56:05.061 INFO:teuthology.orchestra.run.smithi137.stderr:sudo: ntpd: command not found 2024-04-26T21:56:05.069 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T21:56:05.071 INFO:teuthology.orchestra.run.smithi137.stdout:506 Cannot talk to daemon 2024-04-26T21:56:05.084 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T21:56:05.093 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-04-26T21:56:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T21:56:05.103 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-04-26T21:56:05.116 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T21:56:05.129 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T21:56:05.155 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:56:05.159 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:56:05.159 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-04-26T21:56:05.159 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:56:05.159 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:56:05.159 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:56:05.159 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:56:05.190 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-04-26T21:56:05.194 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T21:56:05.195 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-04-26T21:56:05.195 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:56:05.195 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:56:05.195 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:56:05.195 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T21:56:05.195 INFO:teuthology.run_tasks:Running task install... 2024-04-26T21:56:05.203 DEBUG:teuthology.task.install:project ceph 2024-04-26T21:56:05.204 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T21:56:05.204 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T21:56:05.204 INFO:teuthology.task.install:Using flavor: default 2024-04-26T21:56:05.209 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T21:56:05.209 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T21:56:05.210 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T21:56:05.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:56:05.212 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'tag': None, 'wait_for_package': False} 2024-04-26T21:56:05.212 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:56:05.359 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T21:56:05.359 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T21:56:05.363 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/ 2024-04-26T21:56:05.363 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3306.gbc612ffb 2024-04-26T21:56:05.536 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T21:56:05.536 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:56:05.536 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T21:56:05.561 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T21:56:05.562 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T21:56:05.626 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T21:56:05.629 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T21:56:05.630 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:56:05.630 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T21:56:05.655 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T21:56:05.655 DEBUG:teuthology.orchestra.run.smithi137:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc612ffb9c1d5bc27536bc917a705262a36d4387/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T21:56:05.699 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T21:56:05.719 DEBUG:teuthology.orchestra.run.smithi137:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T21:56:05.762 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-04-26T21:56:05.764 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-04-26T21:56:05.793 DEBUG:teuthology.orchestra.run.smithi137:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T21:56:05.856 INFO:teuthology.orchestra.run.smithi137.stdout:check_obsoletes = 1 2024-04-26T21:56:05.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum clean all 2024-04-26T21:56:05.988 INFO:teuthology.orchestra.run.smithi170.stdout:48 files removed 2024-04-26T21:56:06.016 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T21:56:06.081 INFO:teuthology.orchestra.run.smithi137.stdout:48 files removed 2024-04-26T21:56:06.108 DEBUG:teuthology.orchestra.run.smithi137:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T21:56:06.830 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 150 kB/s | 84 kB 00:00 2024-04-26T21:56:07.155 INFO:teuthology.orchestra.run.smithi137.stdout:ceph packages for x86_64 106 kB/s | 84 kB 00:00 2024-04-26T21:56:07.431 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 21 kB/s | 12 kB 00:00 2024-04-26T21:56:07.746 INFO:teuthology.orchestra.run.smithi137.stdout:ceph noarch packages 21 kB/s | 12 kB 00:00 2024-04-26T21:56:08.024 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 3.4 kB/s | 1.9 kB 00:00 2024-04-26T21:56:08.239 INFO:teuthology.orchestra.run.smithi137.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-04-26T21:56:08.717 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-26T21:56:08.908 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-26T21:56:10.668 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-26T21:56:10.682 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-26T21:56:14.767 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-26T21:56:15.650 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.2 MB 00:01 2024-04-26T21:56:16.352 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-04-26T21:56:17.059 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-04-26T21:56:17.695 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-26T21:56:18.696 INFO:teuthology.orchestra.run.smithi137.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-26T21:56:22.703 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-26T21:56:23.835 INFO:teuthology.orchestra.run.smithi137.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-04-26T21:56:24.820 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T21:56:24.821 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T21:56:24.831 INFO:teuthology.orchestra.run.smithi170.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T21:56:24.832 INFO:teuthology.orchestra.run.smithi170.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T21:56:24.833 INFO:teuthology.orchestra.run.smithi170.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T21:56:24.834 INFO:teuthology.orchestra.run.smithi170.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T21:56:24.835 INFO:teuthology.orchestra.run.smithi170.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T21:56:24.837 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T21:56:24.838 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T21:56:24.898 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T21:56:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T21:56:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-04-26T21:56:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T21:56:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T21:56:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T21:56:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T21:56:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T21:56:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T21:56:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T21:56:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T21:56:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout:Install 148 Packages 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 4 Packages 2024-04-26T21:56:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:56:24.919 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 222 M 2024-04-26T21:56:24.919 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-26T21:56:25.471 INFO:teuthology.orchestra.run.smithi170.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-04-26T21:56:25.680 INFO:teuthology.orchestra.run.smithi170.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 4.2 MB/s | 889 kB 00:00 2024-04-26T21:56:25.747 INFO:teuthology.orchestra.run.smithi170.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 2.1 MB/s | 145 kB 00:00 2024-04-26T21:56:25.855 INFO:teuthology.orchestra.run.smithi170.stdout:(4/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 9.7 MB/s | 5.4 MB 00:00 2024-04-26T21:56:25.953 INFO:teuthology.orchestra.run.smithi137.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T21:56:25.953 INFO:teuthology.orchestra.run.smithi137.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T21:56:25.964 INFO:teuthology.orchestra.run.smithi137.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T21:56:25.964 INFO:teuthology.orchestra.run.smithi137.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T21:56:25.965 INFO:teuthology.orchestra.run.smithi137.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T21:56:25.966 INFO:teuthology.orchestra.run.smithi137.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T21:56:25.968 INFO:teuthology.orchestra.run.smithi137.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T21:56:25.970 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T21:56:25.971 INFO:teuthology.orchestra.run.smithi137.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T21:56:25.997 INFO:teuthology.orchestra.run.smithi170.stdout:(5/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 9.4 MB/s | 2.4 MB 00:00 2024-04-26T21:56:26.030 INFO:teuthology.orchestra.run.smithi137.stdout:Dependencies resolved. 2024-04-26T21:56:26.039 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-26T21:56:26.039 INFO:teuthology.orchestra.run.smithi137.stdout: Package Arch Version Repository Size 2024-04-26T21:56:26.039 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-26T21:56:26.039 INFO:teuthology.orchestra.run.smithi137.stdout:Installing: 2024-04-26T21:56:26.040 INFO:teuthology.orchestra.run.smithi137.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T21:56:26.040 INFO:teuthology.orchestra.run.smithi137.stdout: ceph x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 6.6 k 2024-04-26T21:56:26.040 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T21:56:26.040 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 889 k 2024-04-26T21:56:26.040 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 145 k 2024-04-26T21:56:26.040 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 1.5 M 2024-04-26T21:56:26.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 142 k 2024-04-26T21:56:26.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 3.5 M 2024-04-26T21:56:26.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 7.4 M 2024-04-26T21:56:26.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 49 k 2024-04-26T21:56:26.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 11 M 2024-04-26T21:56:26.041 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 49 M 2024-04-26T21:56:26.042 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 273 k 2024-04-26T21:56:26.042 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 762 k 2024-04-26T21:56:26.042 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 225 k 2024-04-26T21:56:26.042 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 27 k 2024-04-26T21:56:26.042 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 18 k 2024-04-26T21:56:26.042 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T21:56:26.043 INFO:teuthology.orchestra.run.smithi137.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T21:56:26.043 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T21:56:26.043 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 32 k 2024-04-26T21:56:26.043 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 747 k 2024-04-26T21:56:26.043 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 127 k 2024-04-26T21:56:26.043 INFO:teuthology.orchestra.run.smithi137.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T21:56:26.044 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T21:56:26.044 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T21:56:26.044 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T21:56:26.044 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T21:56:26.044 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T21:56:26.044 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 161 k 2024-04-26T21:56:26.044 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 321 k 2024-04-26T21:56:26.045 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 298 k 2024-04-26T21:56:26.045 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 99 k 2024-04-26T21:56:26.045 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 85 k 2024-04-26T21:56:26.045 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T21:56:26.045 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 171 k 2024-04-26T21:56:26.046 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T21:56:26.046 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrading: 2024-04-26T21:56:26.046 INFO:teuthology.orchestra.run.smithi137.stdout: librados2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.4 M 2024-04-26T21:56:26.046 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 3.1 M 2024-04-26T21:56:26.046 INFO:teuthology.orchestra.run.smithi137.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T21:56:26.046 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T21:56:26.046 INFO:teuthology.orchestra.run.smithi137.stdout:Installing dependencies: 2024-04-26T21:56:26.047 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T21:56:26.047 INFO:teuthology.orchestra.run.smithi137.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T21:56:26.047 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T21:56:26.047 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 21 M 2024-04-26T21:56:26.047 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 34 k 2024-04-26T21:56:26.047 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 2.4 M 2024-04-26T21:56:26.048 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 249 k 2024-04-26T21:56:26.048 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 4.7 M 2024-04-26T21:56:26.048 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 17 M 2024-04-26T21:56:26.048 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3306.gbc612ffb.el9 ceph-noarch 16 k 2024-04-26T21:56:26.048 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 25 k 2024-04-26T21:56:26.048 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T21:56:26.048 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T21:56:26.049 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T21:56:26.049 INFO:teuthology.orchestra.run.smithi137.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T21:56:26.049 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T21:56:26.049 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T21:56:26.049 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T21:56:26.049 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 163 k 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 501 k 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2 x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 5.4 M 2024-04-26T21:56:26.050 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T21:56:26.051 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 45 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common x86_64 2:19.0.0-3306.gbc612ffb.el9 ceph 135 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T21:56:26.052 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T21:56:26.053 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T21:56:26.054 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T21:56:26.055 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T21:56:26.056 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T21:56:26.057 INFO:teuthology.orchestra.run.smithi137.stdout:Installing weak dependencies: 2024-04-26T21:56:26.057 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T21:56:26.057 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:56:26.057 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction Summary 2024-04-26T21:56:26.057 INFO:teuthology.orchestra.run.smithi137.stdout:======================================================================================= 2024-04-26T21:56:26.057 INFO:teuthology.orchestra.run.smithi137.stdout:Install 148 Packages 2024-04-26T21:56:26.057 INFO:teuthology.orchestra.run.smithi137.stdout:Upgrade 4 Packages 2024-04-26T21:56:26.057 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:56:26.058 INFO:teuthology.orchestra.run.smithi170.stdout:(6/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-04-26T21:56:26.058 INFO:teuthology.orchestra.run.smithi137.stdout:Total download size: 222 M 2024-04-26T21:56:26.058 INFO:teuthology.orchestra.run.smithi137.stdout:Downloading Packages: 2024-04-26T21:56:26.481 INFO:teuthology.orchestra.run.smithi170.stdout:(7/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 9.7 MB/s | 4.7 MB 00:00 2024-04-26T21:56:27.003 INFO:teuthology.orchestra.run.smithi137.stdout:(1/152): ceph-19.0.0-3306.gbc612ffb.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-04-26T21:56:27.214 INFO:teuthology.orchestra.run.smithi170.stdout:(8/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x86 14 MB/s | 17 MB 00:01 2024-04-26T21:56:27.261 INFO:teuthology.orchestra.run.smithi137.stdout:(2/152): ceph-fuse-19.0.0-3306.gbc612ffb.el9.x8 3.4 MB/s | 889 kB 00:00 2024-04-26T21:56:27.306 INFO:teuthology.orchestra.run.smithi170.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 275 kB/s | 25 kB 00:00 2024-04-26T21:56:27.345 INFO:teuthology.orchestra.run.smithi137.stdout:(3/152): ceph-immutable-object-cache-19.0.0-330 1.7 MB/s | 145 kB 00:00 2024-04-26T21:56:27.648 INFO:teuthology.orchestra.run.smithi170.stdout:(10/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 9.1 MB/s | 11 MB 00:01 2024-04-26T21:56:27.748 INFO:teuthology.orchestra.run.smithi170.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 2.2 MB/s | 225 kB 00:00 2024-04-26T21:56:27.842 INFO:teuthology.orchestra.run.smithi170.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 295 kB/s | 27 kB 00:00 2024-04-26T21:56:27.970 INFO:teuthology.orchestra.run.smithi137.stdout:(4/152): ceph-mds-19.0.0-3306.gbc612ffb.el9.x86 3.8 MB/s | 2.4 MB 00:00 2024-04-26T21:56:27.980 INFO:teuthology.orchestra.run.smithi170.stdout:(13/152): libcephfs-devel-19.0.0-3306.gbc612ffb 227 kB/s | 32 kB 00:00 2024-04-26T21:56:28.251 INFO:teuthology.orchestra.run.smithi170.stdout:(14/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 2.7 MB/s | 747 kB 00:00 2024-04-26T21:56:28.329 INFO:teuthology.orchestra.run.smithi137.stdout:(5/152): ceph-mgr-19.0.0-3306.gbc612ffb.el9.x86 4.2 MB/s | 1.5 MB 00:00 2024-04-26T21:56:28.334 INFO:teuthology.orchestra.run.smithi170.stdout:(15/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 1.9 MB/s | 163 kB 00:00 2024-04-26T21:56:28.426 INFO:teuthology.orchestra.run.smithi170.stdout:(16/152): librados-devel-19.0.0-3306.gbc612ffb. 1.4 MB/s | 127 kB 00:00 2024-04-26T21:56:28.584 INFO:teuthology.orchestra.run.smithi170.stdout:(17/152): libradosstriper1-19.0.0-3306.gbc612ff 3.1 MB/s | 501 kB 00:00 2024-04-26T21:56:29.212 INFO:teuthology.orchestra.run.smithi137.stdout:(6/152): ceph-mon-19.0.0-3306.gbc612ffb.el9.x86 5.3 MB/s | 4.7 MB 00:00 2024-04-26T21:56:29.709 INFO:teuthology.orchestra.run.smithi170.stdout:(18/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 4.8 MB/s | 5.4 MB 00:01 2024-04-26T21:56:29.759 INFO:teuthology.orchestra.run.smithi170.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 909 kB/s | 45 kB 00:00 2024-04-26T21:56:29.771 INFO:teuthology.orchestra.run.smithi137.stdout:(7/152): ceph-common-19.0.0-3306.gbc612ffb.el9. 6.9 MB/s | 21 MB 00:03 2024-04-26T21:56:29.826 INFO:teuthology.orchestra.run.smithi170.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 2.0 MB/s | 135 kB 00:00 2024-04-26T21:56:29.846 INFO:teuthology.orchestra.run.smithi137.stdout:(8/152): ceph-base-19.0.0-3306.gbc612ffb.el9.x8 1.7 MB/s | 5.4 MB 00:03 2024-04-26T21:56:29.886 INFO:teuthology.orchestra.run.smithi170.stdout:(21/152): python3-cephfs-19.0.0-3306.gbc612ffb. 2.7 MB/s | 161 kB 00:00 2024-04-26T21:56:29.938 INFO:teuthology.orchestra.run.smithi137.stdout:(9/152): ceph-selinux-19.0.0-3306.gbc612ffb.el9 273 kB/s | 25 kB 00:00 2024-04-26T21:56:29.985 INFO:teuthology.orchestra.run.smithi170.stdout:(22/152): python3-rados-19.0.0-3306.gbc612ffb.e 3.1 MB/s | 321 kB 00:00 2024-04-26T21:56:30.086 INFO:teuthology.orchestra.run.smithi170.stdout:(23/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 2.9 MB/s | 298 kB 00:00 2024-04-26T21:56:30.186 INFO:teuthology.orchestra.run.smithi170.stdout:(24/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 995 kB/s | 99 kB 00:00 2024-04-26T21:56:30.286 INFO:teuthology.orchestra.run.smithi170.stdout:(25/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 853 kB/s | 85 kB 00:00 2024-04-26T21:56:30.978 INFO:teuthology.orchestra.run.smithi170.stdout:(26/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 4.5 MB/s | 3.1 MB 00:00 2024-04-26T21:56:31.061 INFO:teuthology.orchestra.run.smithi170.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 2.0 MB/s | 171 kB 00:00 2024-04-26T21:56:31.137 INFO:teuthology.orchestra.run.smithi170.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 456 kB/s | 34 kB 00:00 2024-04-26T21:56:31.206 INFO:teuthology.orchestra.run.smithi170.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 2.1 MB/s | 142 kB 00:00 2024-04-26T21:56:31.222 INFO:teuthology.orchestra.run.smithi137.stdout:(10/152): ceph-radosgw-19.0.0-3306.gbc612ffb.el 7.3 MB/s | 11 MB 00:01 2024-04-26T21:56:31.305 INFO:teuthology.orchestra.run.smithi137.stdout:(11/152): cephfs-mirror-19.0.0-3306.gbc612ffb.e 2.6 MB/s | 225 kB 00:00 2024-04-26T21:56:31.380 INFO:teuthology.orchestra.run.smithi137.stdout:(12/152): cephfs-shell-19.0.0-3306.gbc612ffb.el 360 kB/s | 27 kB 00:00 2024-04-26T21:56:31.456 INFO:teuthology.orchestra.run.smithi137.stdout:(13/152): libcephfs-devel-19.0.0-3306.gbc612ffb 423 kB/s | 32 kB 00:00 2024-04-26T21:56:31.631 INFO:teuthology.orchestra.run.smithi137.stdout:(14/152): libcephfs2-19.0.0-3306.gbc612ffb.el9. 4.2 MB/s | 747 kB 00:00 2024-04-26T21:56:31.754 INFO:teuthology.orchestra.run.smithi170.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 6.4 MB/s | 3.5 MB 00:00 2024-04-26T21:56:31.790 INFO:teuthology.orchestra.run.smithi137.stdout:(15/152): ceph-osd-19.0.0-3306.gbc612ffb.el9.x8 6.5 MB/s | 17 MB 00:02 2024-04-26T21:56:31.806 INFO:teuthology.orchestra.run.smithi137.stdout:(16/152): libcephsqlite-19.0.0-3306.gbc612ffb.e 931 kB/s | 163 kB 00:00 2024-04-26T21:56:31.857 INFO:teuthology.orchestra.run.smithi137.stdout:(17/152): librados-devel-19.0.0-3306.gbc612ffb. 1.9 MB/s | 127 kB 00:00 2024-04-26T21:56:31.940 INFO:teuthology.orchestra.run.smithi137.stdout:(18/152): libradosstriper1-19.0.0-3306.gbc612ff 3.7 MB/s | 501 kB 00:00 2024-04-26T21:56:32.024 INFO:teuthology.orchestra.run.smithi137.stdout:(19/152): python3-ceph-argparse-19.0.0-3306.gbc 542 kB/s | 45 kB 00:00 2024-04-26T21:56:32.108 INFO:teuthology.orchestra.run.smithi137.stdout:(20/152): python3-ceph-common-19.0.0-3306.gbc61 1.6 MB/s | 135 kB 00:00 2024-04-26T21:56:32.191 INFO:teuthology.orchestra.run.smithi137.stdout:(21/152): python3-cephfs-19.0.0-3306.gbc612ffb. 1.9 MB/s | 161 kB 00:00 2024-04-26T21:56:32.291 INFO:teuthology.orchestra.run.smithi137.stdout:(22/152): python3-rados-19.0.0-3306.gbc612ffb.e 3.1 MB/s | 321 kB 00:00 2024-04-26T21:56:32.383 INFO:teuthology.orchestra.run.smithi137.stdout:(23/152): python3-rbd-19.0.0-3306.gbc612ffb.el9 3.2 MB/s | 298 kB 00:00 2024-04-26T21:56:32.467 INFO:teuthology.orchestra.run.smithi137.stdout:(24/152): python3-rgw-19.0.0-3306.gbc612ffb.el9 1.2 MB/s | 99 kB 00:00 2024-04-26T21:56:32.542 INFO:teuthology.orchestra.run.smithi137.stdout:(25/152): rbd-fuse-19.0.0-3306.gbc612ffb.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-26T21:56:32.659 INFO:teuthology.orchestra.run.smithi137.stdout:(26/152): librgw2-19.0.0-3306.gbc612ffb.el9.x86 6.7 MB/s | 5.4 MB 00:00 2024-04-26T21:56:32.752 INFO:teuthology.orchestra.run.smithi137.stdout:(27/152): rbd-nbd-19.0.0-3306.gbc612ffb.el9.x86 1.8 MB/s | 171 kB 00:00 2024-04-26T21:56:32.827 INFO:teuthology.orchestra.run.smithi137.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3306.g 457 kB/s | 34 kB 00:00 2024-04-26T21:56:32.863 INFO:teuthology.orchestra.run.smithi170.stdout:(31/152): ceph-mgr-diskprediction-local-19.0.0- 6.7 MB/s | 7.4 MB 00:01 2024-04-26T21:56:32.885 INFO:teuthology.orchestra.run.smithi137.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3306.gbc612ff 2.4 MB/s | 142 kB 00:00 2024-04-26T21:56:32.936 INFO:teuthology.orchestra.run.smithi137.stdout:(30/152): rbd-mirror-19.0.0-3306.gbc612ffb.el9. 7.9 MB/s | 3.1 MB 00:00 2024-04-26T21:56:33.269 INFO:teuthology.orchestra.run.smithi137.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3306.gbc612 9.2 MB/s | 3.5 MB 00:00 2024-04-26T21:56:33.328 INFO:teuthology.orchestra.run.smithi137.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3306.gbc 4.2 MB/s | 249 kB 00:00 2024-04-26T21:56:33.346 INFO:teuthology.orchestra.run.smithi170.stdout:(32/152): ceph-test-19.0.0-3306.gbc612ffb.el9.x 8.1 MB/s | 49 MB 00:06 2024-04-26T21:56:33.372 INFO:teuthology.orchestra.run.smithi170.stdout:(33/152): ceph-mgr-modules-core-19.0.0-3306.gbc 489 kB/s | 249 kB 00:00 2024-04-26T21:56:33.387 INFO:teuthology.orchestra.run.smithi137.stdout:(33/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 848 kB/s | 49 kB 00:00 2024-04-26T21:56:33.388 INFO:teuthology.orchestra.run.smithi170.stdout:(34/152): ceph-mgr-rook-19.0.0-3306.gbc612ffb.e 1.2 MB/s | 49 kB 00:00 2024-04-26T21:56:33.406 INFO:teuthology.orchestra.run.smithi170.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3306.gb 491 kB/s | 16 kB 00:00 2024-04-26T21:56:33.445 INFO:teuthology.orchestra.run.smithi137.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3306.gb 282 kB/s | 16 kB 00:00 2024-04-26T21:56:33.489 INFO:teuthology.orchestra.run.smithi170.stdout:(36/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 2.7 MB/s | 273 kB 00:00 2024-04-26T21:56:33.529 INFO:teuthology.orchestra.run.smithi137.stdout:(35/152): ceph-volume-19.0.0-3306.gbc612ffb.el9 3.2 MB/s | 273 kB 00:00 2024-04-26T21:56:33.557 INFO:teuthology.orchestra.run.smithi170.stdout:(37/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 5.0 MB/s | 762 kB 00:00 2024-04-26T21:56:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 218 kB/s | 18 kB 00:00 2024-04-26T21:56:33.638 INFO:teuthology.orchestra.run.smithi137.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-04-26T21:56:33.671 INFO:teuthology.orchestra.run.smithi137.stdout:(37/152): cephadm-19.0.0-3306.gbc612ffb.el9.noa 5.2 MB/s | 762 kB 00:00 2024-04-26T21:56:33.697 INFO:teuthology.orchestra.run.smithi137.stdout:(38/152): cephfs-top-19.0.0-3306.gbc612ffb.el9. 312 kB/s | 18 kB 00:00 2024-04-26T21:56:33.715 INFO:teuthology.orchestra.run.smithi170.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-04-26T21:56:33.782 INFO:teuthology.orchestra.run.smithi170.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2024-04-26T21:56:33.824 INFO:teuthology.orchestra.run.smithi170.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-04-26T21:56:33.849 INFO:teuthology.orchestra.run.smithi170.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-04-26T21:56:33.899 INFO:teuthology.orchestra.run.smithi170.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-04-26T21:56:33.913 INFO:teuthology.orchestra.run.smithi137.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 332 kB/s | 80 kB 00:00 2024-04-26T21:56:33.941 INFO:teuthology.orchestra.run.smithi170.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-04-26T21:56:33.967 INFO:teuthology.orchestra.run.smithi170.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-26T21:56:33.992 INFO:teuthology.orchestra.run.smithi170.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-26T21:56:34.005 INFO:teuthology.orchestra.run.smithi137.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-04-26T21:56:34.017 INFO:teuthology.orchestra.run.smithi170.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-26T21:56:34.030 INFO:teuthology.orchestra.run.smithi137.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-04-26T21:56:34.081 INFO:teuthology.orchestra.run.smithi137.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-04-26T21:56:34.140 INFO:teuthology.orchestra.run.smithi137.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-04-26T21:56:34.165 INFO:teuthology.orchestra.run.smithi137.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-04-26T21:56:34.207 INFO:teuthology.orchestra.run.smithi137.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-26T21:56:34.226 INFO:teuthology.orchestra.run.smithi170.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-04-26T21:56:34.232 INFO:teuthology.orchestra.run.smithi137.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-26T21:56:34.274 INFO:teuthology.orchestra.run.smithi137.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-26T21:56:34.276 INFO:teuthology.orchestra.run.smithi170.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-04-26T21:56:34.301 INFO:teuthology.orchestra.run.smithi170.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-04-26T21:56:34.327 INFO:teuthology.orchestra.run.smithi170.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 427 kB/s | 21 kB 00:00 2024-04-26T21:56:34.377 INFO:teuthology.orchestra.run.smithi170.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 657 kB/s | 33 kB 00:00 2024-04-26T21:56:34.533 INFO:teuthology.orchestra.run.smithi137.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-04-26T21:56:34.544 INFO:teuthology.orchestra.run.smithi170.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 1.3 MB/s | 313 kB 00:00 2024-04-26T21:56:34.600 INFO:teuthology.orchestra.run.smithi137.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-26T21:56:34.628 INFO:teuthology.orchestra.run.smithi170.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 219 kB/s | 18 kB 00:00 2024-04-26T21:56:34.633 INFO:teuthology.orchestra.run.smithi137.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-04-26T21:56:34.650 INFO:teuthology.orchestra.run.smithi137.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 430 kB/s | 21 kB 00:00 2024-04-26T21:56:34.678 INFO:teuthology.orchestra.run.smithi170.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-26T21:56:34.700 INFO:teuthology.orchestra.run.smithi137.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-04-26T21:56:34.717 INFO:teuthology.orchestra.run.smithi137.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-04-26T21:56:34.767 INFO:teuthology.orchestra.run.smithi137.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-26T21:56:34.786 INFO:teuthology.orchestra.run.smithi170.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-26T21:56:34.818 INFO:teuthology.orchestra.run.smithi137.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-26T21:56:34.845 INFO:teuthology.orchestra.run.smithi170.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-04-26T21:56:34.868 INFO:teuthology.orchestra.run.smithi137.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-04-26T21:56:34.887 INFO:teuthology.orchestra.run.smithi170.stdout:(58/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-04-26T21:56:34.893 INFO:teuthology.orchestra.run.smithi137.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-04-26T21:56:34.919 INFO:teuthology.orchestra.run.smithi137.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-04-26T21:56:34.961 INFO:teuthology.orchestra.run.smithi137.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-04-26T21:56:34.986 INFO:teuthology.orchestra.run.smithi137.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-04-26T21:56:35.020 INFO:teuthology.orchestra.run.smithi137.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 433 kB/s | 25 kB 00:00 2024-04-26T21:56:35.045 INFO:teuthology.orchestra.run.smithi137.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-04-26T21:56:35.054 INFO:teuthology.orchestra.run.smithi170.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-04-26T21:56:35.087 INFO:teuthology.orchestra.run.smithi137.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-26T21:56:35.087 INFO:teuthology.orchestra.run.smithi170.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 2.8 MB/s | 582 kB 00:00 2024-04-26T21:56:35.112 INFO:teuthology.orchestra.run.smithi137.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-04-26T21:56:35.113 INFO:teuthology.orchestra.run.smithi170.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-04-26T21:56:35.138 INFO:teuthology.orchestra.run.smithi170.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-04-26T21:56:35.146 INFO:teuthology.orchestra.run.smithi137.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-04-26T21:56:35.222 INFO:teuthology.orchestra.run.smithi170.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-26T21:56:35.247 INFO:teuthology.orchestra.run.smithi170.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-04-26T21:56:35.271 INFO:teuthology.orchestra.run.smithi137.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-04-26T21:56:35.272 INFO:teuthology.orchestra.run.smithi170.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-04-26T21:56:35.363 INFO:teuthology.orchestra.run.smithi137.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-04-26T21:56:35.405 INFO:teuthology.orchestra.run.smithi137.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-26T21:56:35.447 INFO:teuthology.orchestra.run.smithi137.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-04-26T21:56:35.505 INFO:teuthology.orchestra.run.smithi137.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-04-26T21:56:35.614 INFO:teuthology.orchestra.run.smithi137.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-26T21:56:35.689 INFO:teuthology.orchestra.run.smithi137.stdout:(72/152): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-04-26T21:56:35.715 INFO:teuthology.orchestra.run.smithi137.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 875 kB/s | 87 kB 00:00 2024-04-26T21:56:35.815 INFO:teuthology.orchestra.run.smithi137.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-04-26T21:56:35.890 INFO:teuthology.orchestra.run.smithi137.stdout:(75/152): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2024-04-26T21:56:35.915 INFO:teuthology.orchestra.run.smithi137.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-04-26T21:56:35.958 INFO:teuthology.orchestra.run.smithi137.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 383 kB/s | 26 kB 00:00 2024-04-26T21:56:35.983 INFO:teuthology.orchestra.run.smithi137.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-04-26T21:56:36.016 INFO:teuthology.orchestra.run.smithi137.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-26T21:56:36.042 INFO:teuthology.orchestra.run.smithi137.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-04-26T21:56:36.109 INFO:teuthology.orchestra.run.smithi137.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-04-26T21:56:36.184 INFO:teuthology.orchestra.run.smithi137.stdout:(82/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 5.1 MB 00:00 2024-04-26T21:56:36.209 INFO:teuthology.orchestra.run.smithi137.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-04-26T21:56:36.243 INFO:teuthology.orchestra.run.smithi137.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-26T21:56:36.256 INFO:teuthology.orchestra.run.smithi170.stdout:(66/152): ceph-common-19.0.0-3306.gbc612ffb.el9 1.9 MB/s | 21 MB 00:10 2024-04-26T21:56:36.268 INFO:teuthology.orchestra.run.smithi137.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-04-26T21:56:36.310 INFO:teuthology.orchestra.run.smithi137.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-04-26T21:56:36.335 INFO:teuthology.orchestra.run.smithi137.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-26T21:56:36.377 INFO:teuthology.orchestra.run.smithi137.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-26T21:56:36.398 INFO:teuthology.orchestra.run.smithi170.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.1 MB/s | 4.7 MB 00:01 2024-04-26T21:56:36.402 INFO:teuthology.orchestra.run.smithi137.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 760 kB/s | 51 kB 00:00 2024-04-26T21:56:36.436 INFO:teuthology.orchestra.run.smithi137.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 913 kB/s | 54 kB 00:00 2024-04-26T21:56:36.503 INFO:teuthology.orchestra.run.smithi137.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 626 kB/s | 42 kB 00:00 2024-04-26T21:56:36.515 INFO:teuthology.orchestra.run.smithi170.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-04-26T21:56:36.562 INFO:teuthology.orchestra.run.smithi137.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-04-26T21:56:36.575 INFO:teuthology.orchestra.run.smithi170.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-26T21:56:36.609 INFO:teuthology.orchestra.run.smithi170.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 4.2 MB/s | 911 kB 00:00 2024-04-26T21:56:36.628 INFO:teuthology.orchestra.run.smithi137.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-26T21:56:36.696 INFO:teuthology.orchestra.run.smithi137.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 535 kB/s | 36 kB 00:00 2024-04-26T21:56:36.868 INFO:teuthology.orchestra.run.smithi170.stdout:(71/152): postgresql-13.14-1.el9.x86_64.rpm 2.6 MB/s | 1.6 MB 00:00 2024-04-26T21:56:36.888 INFO:teuthology.orchestra.run.smithi137.stdout:(95/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-04-26T21:56:36.913 INFO:teuthology.orchestra.run.smithi137.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 218 kB/s | 47 kB 00:00 2024-04-26T21:56:36.926 INFO:teuthology.orchestra.run.smithi170.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-26T21:56:36.955 INFO:teuthology.orchestra.run.smithi137.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-04-26T21:56:36.980 INFO:teuthology.orchestra.run.smithi137.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-04-26T21:56:37.006 INFO:teuthology.orchestra.run.smithi137.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-26T21:56:37.039 INFO:teuthology.orchestra.run.smithi137.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-26T21:56:37.043 INFO:teuthology.orchestra.run.smithi170.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 2.3 MB/s | 1.0 MB 00:00 2024-04-26T21:56:37.065 INFO:teuthology.orchestra.run.smithi137.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-04-26T21:56:37.123 INFO:teuthology.orchestra.run.smithi137.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-04-26T21:56:37.160 INFO:teuthology.orchestra.run.smithi170.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-04-26T21:56:37.240 INFO:teuthology.orchestra.run.smithi137.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-04-26T21:56:37.277 INFO:teuthology.orchestra.run.smithi170.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-04-26T21:56:37.327 INFO:teuthology.orchestra.run.smithi170.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-04-26T21:56:37.377 INFO:teuthology.orchestra.run.smithi170.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-04-26T21:56:37.461 INFO:teuthology.orchestra.run.smithi170.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-04-26T21:56:37.520 INFO:teuthology.orchestra.run.smithi170.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-04-26T21:56:37.724 INFO:teuthology.orchestra.run.smithi137.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 913 kB/s | 548 kB 00:00 2024-04-26T21:56:37.774 INFO:teuthology.orchestra.run.smithi137.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 579 kB/s | 309 kB 00:00 2024-04-26T21:56:37.824 INFO:teuthology.orchestra.run.smithi137.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-04-26T21:56:37.924 INFO:teuthology.orchestra.run.smithi137.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-04-26T21:56:37.945 INFO:teuthology.orchestra.run.smithi170.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 4.2 MB/s | 5.8 MB 00:01 2024-04-26T21:56:38.025 INFO:teuthology.orchestra.run.smithi137.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 487 kB/s | 49 kB 00:00 2024-04-26T21:56:38.062 INFO:teuthology.orchestra.run.smithi170.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-04-26T21:56:38.125 INFO:teuthology.orchestra.run.smithi137.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 674 kB/s | 67 kB 00:00 2024-04-26T21:56:38.145 INFO:teuthology.orchestra.run.smithi170.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-04-26T21:56:38.204 INFO:teuthology.orchestra.run.smithi170.stdout:(83/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-26T21:56:38.250 INFO:teuthology.orchestra.run.smithi137.stdout:(110/152): libarrow-9.0.0-11.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-04-26T21:56:38.254 INFO:teuthology.orchestra.run.smithi170.stdout:(84/152): python3-prettytable-0.7.2-27.el9.noar 849 kB/s | 42 kB 00:00 2024-04-26T21:56:38.275 INFO:teuthology.orchestra.run.smithi137.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-04-26T21:56:38.338 INFO:teuthology.orchestra.run.smithi170.stdout:(85/152): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-04-26T21:56:38.422 INFO:teuthology.orchestra.run.smithi170.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-04-26T21:56:38.647 INFO:teuthology.orchestra.run.smithi170.stdout:(87/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.2 MB/s | 279 kB 00:00 2024-04-26T21:56:38.739 INFO:teuthology.orchestra.run.smithi170.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 556 kB/s | 51 kB 00:00 2024-04-26T21:56:38.759 INFO:teuthology.orchestra.run.smithi137.stdout:(112/152): ceph-test-19.0.0-3306.gbc612ffb.el9. 5.6 MB/s | 49 MB 00:08 2024-04-26T21:56:38.789 INFO:teuthology.orchestra.run.smithi170.stdout:(89/152): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-26T21:56:38.792 INFO:teuthology.orchestra.run.smithi137.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.5 MB/s | 839 kB 00:00 2024-04-26T21:56:38.818 INFO:teuthology.orchestra.run.smithi137.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 1.0 MB/s | 548 kB 00:00 2024-04-26T21:56:38.843 INFO:teuthology.orchestra.run.smithi137.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 521 kB/s | 43 kB 00:00 2024-04-26T21:56:38.865 INFO:teuthology.orchestra.run.smithi170.stdout:(90/152): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-04-26T21:56:38.902 INFO:teuthology.orchestra.run.smithi137.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-04-26T21:56:38.915 INFO:teuthology.orchestra.run.smithi170.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 836 kB/s | 42 kB 00:00 2024-04-26T21:56:38.944 INFO:teuthology.orchestra.run.smithi137.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-26T21:56:38.965 INFO:teuthology.orchestra.run.smithi170.stdout:(92/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-04-26T21:56:39.027 INFO:teuthology.orchestra.run.smithi137.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-04-26T21:56:39.052 INFO:teuthology.orchestra.run.smithi137.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-04-26T21:56:39.078 INFO:teuthology.orchestra.run.smithi137.stdout:(120/152): python3-cachetools-4.2.4-1.el9.noarc 113 kB/s | 32 kB 00:00 2024-04-26T21:56:39.092 INFO:teuthology.orchestra.run.smithi170.stdout:(93/152): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-04-26T21:56:39.128 INFO:teuthology.orchestra.run.smithi137.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 351 kB/s | 35 kB 00:00 2024-04-26T21:56:39.153 INFO:teuthology.orchestra.run.smithi137.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-04-26T21:56:39.191 INFO:teuthology.orchestra.run.smithi170.stdout:(94/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-04-26T21:56:39.233 INFO:teuthology.orchestra.run.smithi170.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 256 kB/s | 36 kB 00:00 2024-04-26T21:56:39.253 INFO:teuthology.orchestra.run.smithi137.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-26T21:56:39.258 INFO:teuthology.orchestra.run.smithi170.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-04-26T21:56:39.281 INFO:teuthology.orchestra.run.smithi137.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 84 kB/s | 11 kB 00:00 2024-04-26T21:56:39.308 INFO:teuthology.orchestra.run.smithi170.stdout:(97/152): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-26T21:56:39.348 INFO:teuthology.orchestra.run.smithi137.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 188 kB/s | 18 kB 00:00 2024-04-26T21:56:39.367 INFO:teuthology.orchestra.run.smithi170.stdout:(98/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-26T21:56:39.373 INFO:teuthology.orchestra.run.smithi137.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-04-26T21:56:39.392 INFO:teuthology.orchestra.run.smithi170.stdout:(99/152): socat-1.7.4.1-5.el9.x86_64.rpm 1.9 MB/s | 305 kB 00:00 2024-04-26T21:56:39.409 INFO:teuthology.orchestra.run.smithi170.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-04-26T21:56:39.435 INFO:teuthology.orchestra.run.smithi170.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-04-26T21:56:39.448 INFO:teuthology.orchestra.run.smithi137.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-04-26T21:56:39.474 INFO:teuthology.orchestra.run.smithi137.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-04-26T21:56:39.518 INFO:teuthology.orchestra.run.smithi170.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-04-26T21:56:39.566 INFO:teuthology.orchestra.run.smithi137.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 506 kB/s | 46 kB 00:00 2024-04-26T21:56:39.641 INFO:teuthology.orchestra.run.smithi137.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-04-26T21:56:39.666 INFO:teuthology.orchestra.run.smithi137.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 786 kB/s | 79 kB 00:00 2024-04-26T21:56:39.708 INFO:teuthology.orchestra.run.smithi137.stdout:(132/152): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-04-26T21:56:39.727 INFO:teuthology.orchestra.run.smithi170.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-04-26T21:56:39.733 INFO:teuthology.orchestra.run.smithi137.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 626 kB/s | 58 kB 00:00 2024-04-26T21:56:39.767 INFO:teuthology.orchestra.run.smithi137.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-26T21:56:39.801 INFO:teuthology.orchestra.run.smithi137.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-04-26T21:56:39.834 INFO:teuthology.orchestra.run.smithi137.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 896 kB/s | 90 kB 00:00 2024-04-26T21:56:39.859 INFO:teuthology.orchestra.run.smithi137.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-04-26T21:56:39.893 INFO:teuthology.orchestra.run.smithi137.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-04-26T21:56:39.952 INFO:teuthology.orchestra.run.smithi137.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-04-26T21:56:39.977 INFO:teuthology.orchestra.run.smithi170.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-04-26T21:56:39.977 INFO:teuthology.orchestra.run.smithi137.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 504 kB/s | 59 kB 00:00 2024-04-26T21:56:40.002 INFO:teuthology.orchestra.run.smithi137.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-04-26T21:56:40.044 INFO:teuthology.orchestra.run.smithi137.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2024-04-26T21:56:40.061 INFO:teuthology.orchestra.run.smithi170.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-04-26T21:56:40.078 INFO:teuthology.orchestra.run.smithi137.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-26T21:56:40.103 INFO:teuthology.orchestra.run.smithi170.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 823 kB/s | 309 kB 00:00 2024-04-26T21:56:40.103 INFO:teuthology.orchestra.run.smithi137.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 891 kB/s | 90 kB 00:00 2024-04-26T21:56:40.153 INFO:teuthology.orchestra.run.smithi137.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-04-26T21:56:40.178 INFO:teuthology.orchestra.run.smithi137.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 198 kB/s | 20 kB 00:00 2024-04-26T21:56:40.186 INFO:teuthology.orchestra.run.smithi170.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-04-26T21:56:40.204 INFO:teuthology.orchestra.run.smithi137.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-26T21:56:40.270 INFO:teuthology.orchestra.run.smithi170.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 584 kB/s | 49 kB 00:00 2024-04-26T21:56:40.321 INFO:teuthology.orchestra.run.smithi137.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-26T21:56:40.387 INFO:teuthology.orchestra.run.smithi170.stdout:(109/152): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-04-26T21:56:40.412 INFO:teuthology.orchestra.run.smithi170.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 474 kB/s | 67 kB 00:00 2024-04-26T21:56:40.471 INFO:teuthology.orchestra.run.smithi170.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-26T21:56:40.504 INFO:teuthology.orchestra.run.smithi137.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 7.4 MB/s | 1.3 MB 00:00 2024-04-26T21:56:40.563 INFO:teuthology.orchestra.run.smithi137.stdout:(150/152): librados2-19.0.0-3306.gbc612ffb.el9. 8.8 MB/s | 3.4 MB 00:00 2024-04-26T21:56:40.571 INFO:teuthology.orchestra.run.smithi170.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.2 MB/s | 839 kB 00:00 2024-04-26T21:56:40.596 INFO:teuthology.orchestra.run.smithi170.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-26T21:56:40.655 INFO:teuthology.orchestra.run.smithi137.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-04-26T21:56:40.655 INFO:teuthology.orchestra.run.smithi170.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 519 kB/s | 43 kB 00:00 2024-04-26T21:56:40.680 INFO:teuthology.orchestra.run.smithi170.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 385 kB/s | 32 kB 00:00 2024-04-26T21:56:40.705 INFO:teuthology.orchestra.run.smithi137.stdout:(152/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 6.3 MB/s | 3.1 MB 00:00 2024-04-26T21:56:40.710 INFO:teuthology.orchestra.run.smithi137.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:56:40.710 INFO:teuthology.orchestra.run.smithi137.stdout:Total 15 MB/s | 222 MB 00:14 2024-04-26T21:56:40.739 INFO:teuthology.orchestra.run.smithi170.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-04-26T21:56:40.764 INFO:teuthology.orchestra.run.smithi170.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-26T21:56:40.823 INFO:teuthology.orchestra.run.smithi170.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-04-26T21:56:40.856 INFO:teuthology.orchestra.run.smithi170.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-26T21:56:40.907 INFO:teuthology.orchestra.run.smithi170.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 422 kB/s | 35 kB 00:00 2024-04-26T21:56:40.940 INFO:teuthology.orchestra.run.smithi170.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-04-26T21:56:41.024 INFO:teuthology.orchestra.run.smithi170.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-04-26T21:56:41.074 INFO:teuthology.orchestra.run.smithi170.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-04-26T21:56:41.108 INFO:teuthology.orchestra.run.smithi170.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 127 kB/s | 11 kB 00:00 2024-04-26T21:56:41.158 INFO:teuthology.orchestra.run.smithi170.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-04-26T21:56:41.192 INFO:teuthology.orchestra.run.smithi170.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 276 kB/s | 23 kB 00:00 2024-04-26T21:56:41.242 INFO:teuthology.orchestra.run.smithi170.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-04-26T21:56:41.276 INFO:teuthology.orchestra.run.smithi170.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-04-26T21:56:41.343 INFO:teuthology.orchestra.run.smithi170.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-04-26T21:56:41.368 INFO:teuthology.orchestra.run.smithi170.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-04-26T21:56:41.427 INFO:teuthology.orchestra.run.smithi170.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 946 kB/s | 79 kB 00:00 2024-04-26T21:56:41.452 INFO:teuthology.orchestra.run.smithi170.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 690 kB/s | 58 kB 00:00 2024-04-26T21:56:41.511 INFO:teuthology.orchestra.run.smithi170.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-26T21:56:41.536 INFO:teuthology.orchestra.run.smithi170.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-04-26T21:56:41.586 INFO:teuthology.orchestra.run.smithi170.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T21:56:41.611 INFO:teuthology.orchestra.run.smithi170.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 376 kB/s | 28 kB 00:00 2024-04-26T21:56:41.662 INFO:teuthology.orchestra.run.smithi170.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-26T21:56:41.695 INFO:teuthology.orchestra.run.smithi170.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-04-26T21:56:41.737 INFO:teuthology.orchestra.run.smithi170.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-04-26T21:56:41.771 INFO:teuthology.orchestra.run.smithi170.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-04-26T21:56:41.771 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction check 2024-04-26T21:56:41.813 INFO:teuthology.orchestra.run.smithi170.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 678 kB/s | 51 kB 00:00 2024-04-26T21:56:41.855 INFO:teuthology.orchestra.run.smithi170.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-26T21:56:41.897 INFO:teuthology.orchestra.run.smithi170.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-26T21:56:41.914 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction check succeeded. 2024-04-26T21:56:41.914 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction test 2024-04-26T21:56:41.947 INFO:teuthology.orchestra.run.smithi170.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-04-26T21:56:41.972 INFO:teuthology.orchestra.run.smithi170.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2024-04-26T21:56:42.031 INFO:teuthology.orchestra.run.smithi170.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-26T21:56:42.348 INFO:teuthology.orchestra.run.smithi170.stdout:(147/152): librados2-19.0.0-3306.gbc612ffb.el9. 11 MB/s | 3.4 MB 00:00 2024-04-26T21:56:42.566 INFO:teuthology.orchestra.run.smithi170.stdout:(148/152): librbd1-19.0.0-3306.gbc612ffb.el9.x8 15 MB/s | 3.1 MB 00:00 2024-04-26T21:56:42.674 INFO:teuthology.orchestra.run.smithi170.stdout:(149/152): thrift-0.15.0-2.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-04-26T21:56:42.740 INFO:teuthology.orchestra.run.smithi170.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 7.7 MB/s | 1.3 MB 00:00 2024-04-26T21:56:42.899 INFO:teuthology.orchestra.run.smithi170.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-04-26T21:56:43.083 INFO:teuthology.orchestra.run.smithi170.stdout:(152/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-04-26T21:56:43.085 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-26T21:56:43.085 INFO:teuthology.orchestra.run.smithi170.stdout:Total 12 MB/s | 222 MB 00:18 2024-04-26T21:56:43.665 INFO:teuthology.orchestra.run.smithi137.stdout:Transaction test succeeded. 2024-04-26T21:56:43.665 INFO:teuthology.orchestra.run.smithi137.stdout:Running transaction 2024-04-26T21:56:44.202 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-26T21:56:44.342 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-26T21:56:44.343 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-26T21:56:46.112 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-26T21:56:46.113 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-26T21:56:49.874 INFO:teuthology.orchestra.run.smithi137.stdout: Preparing : 1/1 2024-04-26T21:56:49.975 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T21:56:50.014 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T21:56:50.067 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T21:56:50.100 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T21:56:50.127 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T21:56:50.169 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T21:56:50.495 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T21:56:50.611 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:56:50.723 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:56:50.753 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:56:50.828 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:56:50.866 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T21:56:51.014 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T21:56:51.063 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T21:56:51.091 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:56:51.193 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:56:51.217 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T21:56:51.279 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T21:56:51.301 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T21:56:51.326 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T21:56:51.518 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T21:56:51.559 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T21:56:51.665 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T21:56:51.772 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T21:56:51.800 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T21:56:51.835 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T21:56:51.909 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T21:56:51.942 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T21:56:51.986 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T21:56:52.018 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T21:56:52.071 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T21:56:52.140 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T21:56:52.202 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T21:56:52.232 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T21:56:52.277 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T21:56:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-26T21:56:52.353 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T21:56:52.395 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T21:56:52.411 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T21:56:52.439 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T21:56:52.450 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T21:56:52.459 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T21:56:52.511 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T21:56:52.537 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T21:56:52.545 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T21:56:52.571 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T21:56:52.582 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T21:56:52.613 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T21:56:52.657 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T21:56:52.790 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T21:56:52.843 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T21:56:52.995 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T21:56:53.055 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:56:53.177 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:56:53.215 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:56:53.306 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:56:53.344 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T21:56:53.355 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T21:56:53.438 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T21:56:53.467 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T21:56:53.493 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T21:56:53.510 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T21:56:53.548 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T21:56:53.549 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T21:56:53.577 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:56:53.681 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:56:53.703 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T21:56:53.731 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T21:56:53.766 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 14/156 2024-04-26T21:56:53.787 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T21:56:53.811 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T21:56:53.955 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T21:56:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T21:56:53.995 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T21:56:54.009 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T21:56:54.063 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T21:56:54.103 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T21:56:54.136 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T21:56:54.168 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T21:56:54.199 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T21:56:54.206 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T21:56:54.237 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T21:56:54.252 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T21:56:54.272 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T21:56:54.287 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T21:56:54.330 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T21:56:54.345 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T21:56:54.373 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T21:56:54.379 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T21:56:54.424 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T21:56:54.455 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T21:56:54.483 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T21:56:54.507 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T21:56:54.553 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T21:56:54.561 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T21:56:54.583 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T21:56:54.614 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T21:56:54.624 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T21:56:54.644 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T21:56:54.688 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T21:56:54.718 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T21:56:54.750 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T21:56:54.763 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T21:56:54.790 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T21:56:54.799 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 31/156 2024-04-26T21:56:54.818 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T21:56:54.840 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T21:56:54.842 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 32/156 2024-04-26T21:56:54.870 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 33/156 2024-04-26T21:56:54.923 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T21:56:54.940 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T21:56:54.994 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T21:56:55.050 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T21:56:55.067 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T21:56:55.089 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T21:56:55.117 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T21:56:55.151 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T21:56:55.190 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T21:56:55.218 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T21:56:55.222 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T21:56:55.252 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T21:56:55.271 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T21:56:55.287 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T21:56:55.320 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T21:56:55.361 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T21:56:55.396 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T21:56:55.474 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T21:56:55.518 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T21:56:55.549 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T21:56:55.596 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T21:56:55.694 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T21:56:55.742 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T21:56:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T21:56:55.858 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T21:56:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T21:56:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T21:56:55.960 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 43/156 2024-04-26T21:56:56.001 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T21:56:56.152 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T21:56:56.204 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T21:56:56.257 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T21:56:56.323 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T21:56:56.355 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T21:56:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T21:56:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T21:56:56.467 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T21:56:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T21:56:56.515 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T21:56:56.516 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T21:56:56.548 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T21:56:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T21:56:56.646 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T21:56:56.698 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T21:56:56.702 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T21:56:56.784 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T21:56:56.806 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T21:56:56.834 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T21:56:56.836 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T21:56:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T21:56:56.971 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T21:56:57.003 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T21:56:57.011 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T21:56:57.040 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T21:56:57.042 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T21:56:57.069 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T21:56:57.093 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T21:56:57.117 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T21:56:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T21:56:57.293 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T21:56:57.343 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T21:56:57.370 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T21:56:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T21:56:57.443 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T21:56:57.475 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T21:56:57.505 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T21:56:57.540 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T21:56:57.573 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T21:56:57.614 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T21:56:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T21:56:57.758 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T21:56:57.870 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T21:56:57.933 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T21:56:57.981 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T21:56:58.011 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T21:56:58.068 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T21:56:58.172 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T21:56:58.220 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T21:56:58.937 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T21:56:58.993 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T21:56:59.026 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T21:56:59.085 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T21:56:59.124 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T21:56:59.160 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T21:56:59.176 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T21:56:59.238 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T21:56:59.256 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T21:56:59.305 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T21:56:59.336 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T21:56:59.514 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T21:56:59.543 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T21:56:59.615 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T21:56:59.620 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T21:56:59.651 INFO:teuthology.orchestra.run.smithi137.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T21:56:59.741 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T21:56:59.773 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T21:56:59.808 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T21:57:00.255 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T21:57:00.286 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T21:57:00.374 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T21:57:00.487 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T21:57:00.558 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T21:57:00.581 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T21:57:01.575 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T21:57:01.672 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T21:57:01.700 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T21:57:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T21:57:02.046 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T21:57:02.088 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T21:57:02.178 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 99/156 2024-04-26T21:57:02.209 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 100/156 2024-04-26T21:57:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T21:57:02.726 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T21:57:02.749 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T21:57:02.820 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 103/156 2024-04-26T21:57:02.823 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:57:02.851 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 104/156 2024-04-26T21:57:02.860 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:57:03.403 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:57:03.447 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T21:57:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T21:57:03.538 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T21:57:03.538 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T21:57:03.538 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:03.565 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T21:57:05.141 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:57:05.181 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:57:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 105/156 2024-04-26T21:57:05.777 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T21:57:05.869 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 106/156 2024-04-26T21:57:05.869 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T21:57:05.869 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T21:57:05.869 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:05.903 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T21:57:14.995 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T21:57:14.995 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /sys 2024-04-26T21:57:14.995 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /proc 2024-04-26T21:57:14.995 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /mnt 2024-04-26T21:57:14.995 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /var/tmp 2024-04-26T21:57:14.995 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /home 2024-04-26T21:57:14.996 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /root 2024-04-26T21:57:14.996 INFO:teuthology.orchestra.run.smithi137.stdout:skipping the directory /tmp 2024-04-26T21:57:14.996 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:15.161 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T21:57:15.175 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T21:57:15.176 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:15.176 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T21:57:15.176 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:16.664 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T21:57:16.689 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T21:57:16.690 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:16.690 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T21:57:16.690 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:57:16.691 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:57:16.691 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:16.914 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T21:57:16.937 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T21:57:16.937 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:16.937 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T21:57:16.937 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:57:16.937 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:57:16.937 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:17.382 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T21:57:17.385 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 107/156 2024-04-26T21:57:17.386 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-04-26T21:57:17.386 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-04-26T21:57:17.386 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-04-26T21:57:17.386 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-04-26T21:57:17.386 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-04-26T21:57:17.386 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-04-26T21:57:17.386 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-04-26T21:57:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:17.404 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T21:57:17.404 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:17.404 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T21:57:17.404 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:57:17.404 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:57:17.404 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:17.512 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T21:57:17.560 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T21:57:17.573 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T21:57:17.588 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 108/156 2024-04-26T21:57:17.588 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:17.588 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T21:57:17.588 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:17.615 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T21:57:17.799 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T21:57:17.840 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T21:57:17.909 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T21:57:17.998 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T21:57:18.136 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T21:57:18.174 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T21:57:18.206 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T21:57:18.233 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T21:57:18.636 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T21:57:18.665 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T21:57:18.697 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T21:57:18.767 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T21:57:18.797 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T21:57:19.093 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T21:57:19.118 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 109/156 2024-04-26T21:57:19.118 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:19.119 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T21:57:19.119 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:57:19.119 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T21:57:19.119 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:19.353 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T21:57:19.375 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 110/156 2024-04-26T21:57:19.375 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:19.375 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T21:57:19.375 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:57:19.375 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T21:57:19.375 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:19.821 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T21:57:19.833 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T21:57:19.842 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 111/156 2024-04-26T21:57:19.842 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:19.842 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T21:57:19.843 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:57:19.843 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T21:57:19.843 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:19.874 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T21:57:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T21:57:19.990 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T21:57:20.053 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T21:57:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T21:57:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T21:57:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T21:57:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T21:57:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T21:57:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T21:57:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T21:57:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T21:57:20.839 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T21:57:20.857 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T21:57:20.959 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T21:57:21.119 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T21:57:21.144 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T21:57:21.151 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T21:57:21.172 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 123/156 2024-04-26T21:57:21.174 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T21:57:21.174 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:21.174 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T21:57:21.174 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:57:21.174 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:57:21.174 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:21.204 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 124/156 2024-04-26T21:57:21.227 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T21:57:21.237 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T21:57:21.274 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 125/156 2024-04-26T21:57:21.303 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T21:57:21.335 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T21:57:21.382 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T21:57:22.305 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T21:57:22.329 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T21:57:22.341 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 126/156 2024-04-26T21:57:22.352 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T21:57:22.352 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:22.352 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T21:57:22.352 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:57:22.352 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:57:22.352 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:22.380 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T21:57:22.388 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T21:57:22.410 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T21:57:22.410 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:22.411 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T21:57:22.411 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:22.456 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T21:57:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T21:57:22.478 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:22.478 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T21:57:22.478 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:57:22.478 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:57:22.478 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:22.781 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T21:57:22.803 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T21:57:22.803 INFO:teuthology.orchestra.run.smithi137.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:22.803 INFO:teuthology.orchestra.run.smithi137.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T21:57:22.803 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:57:22.804 INFO:teuthology.orchestra.run.smithi137.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:57:22.804 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:23.342 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 127/156 2024-04-26T21:57:23.372 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T21:57:23.472 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 128/156 2024-04-26T21:57:23.633 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 129/156 2024-04-26T21:57:23.658 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T21:57:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 130/156 2024-04-26T21:57:23.680 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:23.680 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T21:57:23.680 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:57:23.680 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T21:57:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T21:57:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 131/156 2024-04-26T21:57:23.833 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 132/156 2024-04-26T21:57:23.881 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 133/156 2024-04-26T21:57:24.806 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T21:57:24.836 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T21:57:24.858 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 135/156 2024-04-26T21:57:24.858 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:24.858 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T21:57:24.858 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:57:24.858 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T21:57:24.858 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T21:57:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3306.gbc612 136/156 2024-04-26T21:57:24.925 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:24.925 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T21:57:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:24.970 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T21:57:24.992 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 137/156 2024-04-26T21:57:24.992 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:24.993 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T21:57:24.993 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:57:24.993 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T21:57:24.993 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:25.296 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T21:57:25.318 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 138/156 2024-04-26T21:57:25.318 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T21:57:25.318 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T21:57:25.318 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:57:25.318 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T21:57:25.318 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:27.377 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T21:57:27.418 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T21:57:27.459 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T21:57:27.491 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T21:57:27.518 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T21:57:27.699 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T21:57:27.756 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T21:57:27.786 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T21:57:28.365 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:57:28.400 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:57:28.420 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:57:29.246 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T21:57:29.330 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T21:57:29.362 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T21:57:29.444 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T21:57:29.484 INFO:teuthology.orchestra.run.smithi137.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T21:57:29.484 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T21:57:29.560 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T21:57:29.593 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T21:57:29.593 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T21:57:29.668 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T21:57:29.733 INFO:teuthology.orchestra.run.smithi137.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:57:29.900 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 139/156 2024-04-26T21:57:29.941 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 140/156 2024-04-26T21:57:29.982 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 141/156 2024-04-26T21:57:30.014 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T21:57:30.041 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T21:57:30.214 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 144/156 2024-04-26T21:57:30.254 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T21:57:30.284 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 146/156 2024-04-26T21:57:30.928 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:57:30.965 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:57:30.984 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T21:57:31.794 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 148/156 2024-04-26T21:57:31.887 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T21:57:31.927 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T21:57:32.009 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T21:57:32.058 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T21:57:32.058 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T21:57:32.150 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T21:57:32.175 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T21:57:32.175 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T21:57:32.263 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T21:57:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:57:35.592 INFO:teuthology.orchestra.run.smithi137.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:57:35.592 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T21:57:35.592 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T21:57:35.592 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T21:57:35.592 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T21:57:35.592 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T21:57:35.592 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T21:57:35.592 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T21:57:35.593 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T21:57:35.594 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T21:57:35.594 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T21:57:35.594 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T21:57:35.594 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T21:57:35.594 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T21:57:35.594 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T21:57:35.594 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T21:57:35.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T21:57:35.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T21:57:35.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T21:57:35.606 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T21:57:35.607 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T21:57:35.608 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T21:57:35.609 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T21:57:35.610 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T21:57:35.611 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T21:57:35.612 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T21:57:35.613 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T21:57:35.614 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T21:57:35.615 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T21:57:35.616 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T21:57:35.616 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T21:57:35.616 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T21:57:37.696 INFO:teuthology.orchestra.run.smithi137.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout:Upgraded: 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout:Installed: 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.697 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.698 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T21:57:37.699 INFO:teuthology.orchestra.run.smithi137.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.700 INFO:teuthology.orchestra.run.smithi137.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T21:57:37.701 INFO:teuthology.orchestra.run.smithi137.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.702 INFO:teuthology.orchestra.run.smithi137.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T21:57:37.703 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T21:57:37.704 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T21:57:37.705 INFO:teuthology.orchestra.run.smithi137.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T21:57:37.706 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T21:57:37.707 INFO:teuthology.orchestra.run.smithi137.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T21:57:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T21:57:37.708 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:37.708 INFO:teuthology.orchestra.run.smithi137.stdout:Complete! 2024-04-26T21:57:38.083 DEBUG:teuthology.parallel:result is None 2024-04-26T21:57:38.288 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:57:38.288 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 1/156 2024-04-26T21:57:38.288 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 3/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 4/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3306.gbc612 5/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 6/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 7/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 8/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 9/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 10/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 11/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 12/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 13/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 14/156 2024-04-26T21:57:38.289 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_ 15/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 16/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 17/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_6 18/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86 19/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 20/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el 21/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9. 22/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_6 23/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 24/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 25/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 26/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 27/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 28/156 2024-04-26T21:57:38.290 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 29/156 2024-04-26T21:57:38.302 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb. 30/156 2024-04-26T21:57:38.302 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noa 31/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.n 32/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc6 33/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el 34/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 35/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.e 36/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 37/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 38/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 39/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T21:57:38.303 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T21:57:38.304 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T21:57:38.305 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T21:57:38.306 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T21:57:38.307 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T21:57:38.308 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T21:57:38.309 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T21:57:38.310 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 149/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 151/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T21:57:38.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T21:57:38.312 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T21:57:38.312 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T21:57:40.509 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T21:57:40.509 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:40.509 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-04-26T21:57:40.509 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.509 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.509 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.510 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.511 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top-2:19.0.0-3306.gbc612ffb.el9.noarch 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T21:57:40.512 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T21:57:40.513 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T21:57:40.514 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T21:57:40.515 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T21:57:40.516 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T21:57:40.517 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T21:57:40.518 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T21:57:40.519 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.0.0-3306.gbc612ffb.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:40.520 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-26T21:57:40.886 DEBUG:teuthology.parallel:result is None 2024-04-26T21:57:40.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:57:41.109 DEBUG:teuthology.orchestra.run.smithi137:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T21:57:41.131 INFO:teuthology.orchestra.run.smithi137.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T21:57:41.131 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T21:57:41.131 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T21:57:41.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T21:57:41.350 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T21:57:41.371 INFO:teuthology.orchestra.run.smithi170.stdout:19.0.0-3306.gbc612ffb.el9 2024-04-26T21:57:41.371 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306.gbc612ffb.el9 2024-04-26T21:57:41.371 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306.gbc612ffb is installed. 2024-04-26T21:57:41.373 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T21:57:41.373 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:41.373 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T21:57:41.400 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:57:41.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T21:57:41.437 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T21:57:41.437 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:41.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T21:57:41.465 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T21:57:41.530 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:57:41.530 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T21:57:41.553 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T21:57:41.618 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T21:57:41.618 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:41.618 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T21:57:41.642 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T21:57:41.706 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:57:41.706 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T21:57:41.729 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T21:57:41.792 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T21:57:41.792 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:41.793 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T21:57:41.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T21:57:41.880 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:57:41.880 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T21:57:41.904 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T21:57:41.970 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T21:57:42.063 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T21:57:42.063 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 777 /var/log/ceph 2024-04-26T21:57:42.066 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2024-04-26T21:57:42.089 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T21:57:42.089 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T21:57:42.129 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T21:57:42.153 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T21:57:42.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T21:57:42.192 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T21:57:42.223 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T21:57:42.224 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T21:57:42.224 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T21:57:42.224 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:42.224 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T21:57:42.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T21:57:42.379 DEBUG:teuthology.orchestra.run.smithi137:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T21:57:42.415 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:57:42.415 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T21:57:42.430 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T21:57:42.539 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T21:57:42.583 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T21:57:42.583 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T21:57:42.583 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub}', 'email': None, 'first_in_suite': False, 'job_id': '7675238', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi137.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGUJte4IjKCSp79WRg53qH+xXMzRXyEOU3ySROqySBsDd2sUSOF1YfNiuAjsUyqtwB6g0GqUdRRuGq12BuWSKXw=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBClELUAj+m38LHQqzRyGhB3kmJYfMd6/DnA8QuuLR7Ook7xHYbXM7lDfrCLu2Usf/VjIx2SKNkXJSzJc0TAZUMw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T21:57:42.584 DEBUG:teuthology.orchestra.run.smithi137:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T21:57:42.586 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T21:57:42.632 DEBUG:teuthology.orchestra.run.smithi137:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T21:57:42.641 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T21:57:42.696 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:42.696 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T21:57:42.717 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T21:57:42.717 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_1 2024-04-26T21:57:42.771 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T21:57:42.771 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:57:42.771 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-26T21:57:42.771 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:57:42.771 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:57:42.771 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-26 21:57:30.108310914 +0000 2024-04-26T21:57:42.771 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-26 21:55:44.904105210 +0000 2024-04-26T21:57:42.771 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-26 21:55:44.904105210 +0000 2024-04-26T21:57:42.771 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-26 21:55:44.904105210 +0000 2024-04-26T21:57:42.772 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T21:57:42.833 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-26T21:57:42.833 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-26T21:57:42.833 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000238343 s, 2.1 MB/s 2024-04-26T21:57:42.834 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T21:57:42.891 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_2 2024-04-26T21:57:42.950 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T21:57:42.950 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:57:42.950 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T21:57:42.950 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:57:42.950 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:57:42.950 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-26 21:57:30.108310914 +0000 2024-04-26T21:57:42.950 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-26 21:55:45.246098273 +0000 2024-04-26T21:57:42.950 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-26 21:55:45.246098273 +0000 2024-04-26T21:57:42.951 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-26 21:55:45.246098273 +0000 2024-04-26T21:57:42.951 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T21:57:43.014 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-26T21:57:43.014 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-26T21:57:43.014 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000206089 s, 2.5 MB/s 2024-04-26T21:57:43.015 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T21:57:43.071 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_3 2024-04-26T21:57:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T21:57:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:57:43.127 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-26T21:57:43.127 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:57:43.127 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:57:43.127 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-26 21:57:30.108310914 +0000 2024-04-26T21:57:43.127 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-26 21:55:45.576091582 +0000 2024-04-26T21:57:43.127 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-26 21:55:45.576091582 +0000 2024-04-26T21:57:43.127 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-26 21:55:45.576091582 +0000 2024-04-26T21:57:43.128 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T21:57:43.190 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-26T21:57:43.190 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-26T21:57:43.190 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000196571 s, 2.6 MB/s 2024-04-26T21:57:43.191 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T21:57:43.247 DEBUG:teuthology.orchestra.run.smithi137:> stat /dev/vg_nvme/lv_4 2024-04-26T21:57:43.303 INFO:teuthology.orchestra.run.smithi137.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T21:57:43.303 INFO:teuthology.orchestra.run.smithi137.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:57:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-26T21:57:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:57:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:57:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:Access: 2024-04-26 21:57:30.109310896 +0000 2024-04-26T21:57:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:Modify: 2024-04-26 21:55:46.066081646 +0000 2024-04-26T21:57:43.303 INFO:teuthology.orchestra.run.smithi137.stdout:Change: 2024-04-26 21:55:46.066081646 +0000 2024-04-26T21:57:43.304 INFO:teuthology.orchestra.run.smithi137.stdout: Birth: 2024-04-26 21:55:46.066081646 +0000 2024-04-26T21:57:43.304 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T21:57:43.365 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records in 2024-04-26T21:57:43.366 INFO:teuthology.orchestra.run.smithi137.stderr:1+0 records out 2024-04-26T21:57:43.366 INFO:teuthology.orchestra.run.smithi137.stderr:512 bytes copied, 0.000177721 s, 2.9 MB/s 2024-04-26T21:57:43.367 DEBUG:teuthology.orchestra.run.smithi137:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T21:57:43.422 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:57:43.422 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:57:43.422 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T21:57:43.437 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T21:57:43.438 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-04-26T21:57:43.492 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T21:57:43.492 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:57:43.492 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-26T21:57:43.492 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:57:43.492 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:57:43.493 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 21:57:32.691151270 +0000 2024-04-26T21:57:43.493 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 21:55:44.894873828 +0000 2024-04-26T21:57:43.493 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 21:55:44.894873828 +0000 2024-04-26T21:57:43.493 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 21:55:44.894873828 +0000 2024-04-26T21:57:43.493 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T21:57:43.556 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T21:57:43.556 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T21:57:43.556 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000111703 s, 4.6 MB/s 2024-04-26T21:57:43.557 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T21:57:43.613 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-04-26T21:57:43.668 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T21:57:43.668 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:57:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T21:57:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:57:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:57:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 21:57:32.691151270 +0000 2024-04-26T21:57:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 21:55:45.233864813 +0000 2024-04-26T21:57:43.668 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 21:55:45.233864813 +0000 2024-04-26T21:57:43.669 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 21:55:45.233864813 +0000 2024-04-26T21:57:43.669 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T21:57:43.730 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T21:57:43.730 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T21:57:43.731 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.9996e-05 s, 5.7 MB/s 2024-04-26T21:57:43.731 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T21:57:43.787 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-04-26T21:57:43.842 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T21:57:43.842 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:57:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T21:57:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:57:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:57:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 21:57:32.691151270 +0000 2024-04-26T21:57:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 21:55:45.565855984 +0000 2024-04-26T21:57:43.842 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 21:55:45.565855984 +0000 2024-04-26T21:57:43.842 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 21:55:45.565855984 +0000 2024-04-26T21:57:43.842 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T21:57:43.903 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T21:57:43.903 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T21:57:43.903 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.7245e-05 s, 5.9 MB/s 2024-04-26T21:57:43.904 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T21:57:43.960 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-04-26T21:57:44.015 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T21:57:44.015 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T21:57:44.015 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-26T21:57:44.015 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T21:57:44.015 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T21:57:44.015 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-26 21:57:32.692151246 +0000 2024-04-26T21:57:44.015 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-26 21:55:45.893847260 +0000 2024-04-26T21:57:44.015 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-26 21:55:45.893847260 +0000 2024-04-26T21:57:44.016 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-26 21:55:45.893847260 +0000 2024-04-26T21:57:44.016 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T21:57:44.079 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-26T21:57:44.079 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-26T21:57:44.079 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000107922 s, 4.7 MB/s 2024-04-26T21:57:44.080 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T21:57:44.136 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:57:44.136 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T21:57:44.136 INFO:tasks.ceph:Generating config... 2024-04-26T21:57:44.138 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T21:57:44.138 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T21:57:44.138 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T21:57:44.138 INFO:tasks.ceph:[client] pid file = 2024-04-26T21:57:44.138 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T21:57:44.138 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T21:57:44.138 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-26T21:57:44.138 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T21:57:44.138 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T21:57:44.138 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T21:57:44.139 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T21:57:44.140 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T21:57:44.141 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T21:57:44.141 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T21:57:44.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T21:57:44.190 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T21:57:44.193 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T21:57:44.235 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T21:57:44.299 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.137'), ('mon.b', '172.21.15.170'), ('mon.c', '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]')] 2024-04-26T21:57:44.299 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T21:57:44.300 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:44.300 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T21:57:44.354 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.137 --add b 172.21.15.170 --addv c '[v2:172.21.15.170:3301,v1:172.21.15.170:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:57:44.439 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:57:44.440 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: generated fsid 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T21:57:44.440 INFO:teuthology.orchestra.run.smithi137.stdout:setting min_mon_release = quincy 2024-04-26T21:57:44.440 INFO:teuthology.orchestra.run.smithi137.stdout:epoch 0 2024-04-26T21:57:44.440 INFO:teuthology.orchestra.run.smithi137.stdout:fsid 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T21:57:44.440 INFO:teuthology.orchestra.run.smithi137.stdout:last_changed 2024-04-26T21:57:44.440296+0000 2024-04-26T21:57:44.440 INFO:teuthology.orchestra.run.smithi137.stdout:created 2024-04-26T21:57:44.440296+0000 2024-04-26T21:57:44.440 INFO:teuthology.orchestra.run.smithi137.stdout:min_mon_release 17 (quincy) 2024-04-26T21:57:44.440 INFO:teuthology.orchestra.run.smithi137.stdout:election_strategy: 1 2024-04-26T21:57:44.440 INFO:teuthology.orchestra.run.smithi137.stdout:0: [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] mon.a 2024-04-26T21:57:44.441 INFO:teuthology.orchestra.run.smithi137.stdout:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-04-26T21:57:44.441 INFO:teuthology.orchestra.run.smithi137.stdout:2: [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] mon.c 2024-04-26T21:57:44.441 INFO:teuthology.orchestra.run.smithi137.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T21:57:44.442 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T21:57:44.456 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 30fb29b0-57db-44cb-a9e0-8033deb0a091... 2024-04-26T21:57:44.457 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T21:57:44.499 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-26T21:57:44.537 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-26T21:57:44.538 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-26T21:57:44.539 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on skipped message = False 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-26T21:57:44.540 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-26T21:57:44.541 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T21:57:44.542 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T21:57:44.543 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.544 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T21:57:44.545 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T21:57:44.546 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T21:57:44.547 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-26T21:57:44.548 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-26T21:57:44.549 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-26T21:57:44.550 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on skipped message = False 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-26T21:57:44.551 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-26T21:57:44.552 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-26T21:57:44.553 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T21:57:44.554 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T21:57:44.555 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: mon down mkfs grace = 300 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T21:57:44.556 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2024-04-26T21:57:44.557 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2024-04-26T21:57:44.558 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T21:57:44.558 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2024-04-26T21:57:44.558 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = True 2024-04-26T21:57:44.558 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2024-04-26T21:57:44.558 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = True 2024-04-26T21:57:44.558 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T21:57:44.558 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T21:57:44.558 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T21:57:44.559 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T21:57:44.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T21:57:44.651 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T21:57:44.651 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:44.651 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T21:57:44.665 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:44.666 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T21:57:44.720 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T21:57:44.720 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:44.720 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T21:57:44.720 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T21:57:44.792 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:57:44.793 DEBUG:teuthology.orchestra.run.smithi137:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:57:44.847 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T21:57:44.847 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:57:44.847 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T21:57:44.847 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T21:57:44.880 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:57:44.880 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:57:44.935 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T21:57:44.936 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T21:57:44.936 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T21:57:44.983 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T21:57:44.986 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T21:57:45.045 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T21:57:45.049 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T21:57:45.049 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T21:57:45.097 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T21:57:45.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T21:57:45.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T21:57:45.211 INFO:teuthology.orchestra.run.smithi137.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T21:57:45.214 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T21:57:45.237 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T21:57:45.284 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T21:57:45.287 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T21:57:45.309 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T21:57:45.398 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T21:57:45.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T21:57:45.423 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T21:57:45.424 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T21:57:45.464 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T21:57:45.477 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-26T21:57:45.555 INFO:teuthology.orchestra.run.smithi137.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-26T21:57:45.567 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T21:57:45.606 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T21:57:45.618 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-26T21:57:45.696 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-26T21:57:45.707 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T21:57:45.707 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi137.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T21:57:45.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T21:57:45.730 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:57:45.731 INFO:tasks.ceph:role: osd.0 2024-04-26T21:57:45.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T21:57:45.731 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T21:57:45.801 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:57:45.801 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:57:45.801 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:57:45.801 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:57:45.801 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:57:45.802 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:57:45.802 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:57:45.802 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:57:45.802 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:57:45.802 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:57:46.299 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-26T21:57:46.301 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-26T21:57:46.301 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T21:57:46.437 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T21:57:46.469 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T21:57:46.534 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:57:46.534 INFO:tasks.ceph:role: osd.1 2024-04-26T21:57:46.534 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T21:57:46.534 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T21:57:46.606 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:57:46.606 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:57:46.606 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:57:46.606 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:57:46.606 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:57:46.607 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:57:46.607 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:57:46.607 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:57:46.607 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:57:46.607 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:57:47.065 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-26T21:57:47.067 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-26T21:57:47.067 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T21:57:47.151 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T21:57:47.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T21:57:47.242 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:57:47.242 INFO:tasks.ceph:role: osd.2 2024-04-26T21:57:47.242 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T21:57:47.243 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T21:57:47.313 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:57:47.314 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:57:47.314 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:57:47.314 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:57:47.314 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:57:47.314 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:57:47.314 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:57:47.314 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:57:47.314 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:57:47.314 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:57:47.795 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-26T21:57:47.797 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-26T21:57:47.797 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T21:57:47.946 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T21:57:47.984 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T21:57:48.048 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T21:57:48.048 INFO:tasks.ceph:role: osd.3 2024-04-26T21:57:48.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T21:57:48.048 DEBUG:teuthology.orchestra.run.smithi137:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T21:57:48.118 INFO:teuthology.orchestra.run.smithi137.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:57:48.118 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:57:48.119 INFO:teuthology.orchestra.run.smithi137.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:57:48.119 INFO:teuthology.orchestra.run.smithi137.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:57:48.119 INFO:teuthology.orchestra.run.smithi137.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:57:48.119 INFO:teuthology.orchestra.run.smithi137.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:57:48.119 INFO:teuthology.orchestra.run.smithi137.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:57:48.119 INFO:teuthology.orchestra.run.smithi137.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:57:48.119 INFO:teuthology.orchestra.run.smithi137.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:57:48.119 INFO:teuthology.orchestra.run.smithi137.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:57:48.634 INFO:teuthology.orchestra.run.smithi137.stdout:Discarding blocks...Done. 2024-04-26T21:57:48.636 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi137.front.sepia.ceph.com -o noatime 2024-04-26T21:57:48.637 DEBUG:teuthology.orchestra.run.smithi137:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T21:57:48.788 DEBUG:teuthology.orchestra.run.smithi137:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T21:57:48.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:57:48.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:48.920+0000 7f979f91f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T21:57:48.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:48.920+0000 7f979f91f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T21:57:48.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:48.920+0000 7f979f91f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T21:57:48.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:48.920+0000 7f979f91f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T21:57:48.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:48.920+0000 7f979f91f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T21:57:48.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:48.921+0000 7f979f91f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T21:57:51.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T21:57:51.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:57:51.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:51.899+0000 7f4b3e5ba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T21:57:51.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:51.899+0000 7f4b3e5ba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T21:57:51.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:51.899+0000 7f4b3e5ba640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T21:57:51.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:51.899+0000 7f4b3e5ba640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T21:57:51.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:51.899+0000 7f4b3e5ba640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T21:57:51.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:51.899+0000 7f4b3e5ba640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T21:57:54.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T21:57:54.775 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:57:54.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:54.862+0000 7f4a6e74e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T21:57:54.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:54.862+0000 7f4a6e74e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T21:57:54.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:54.862+0000 7f4a6e74e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T21:57:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:54.862+0000 7f4a6e74e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T21:57:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:54.862+0000 7f4a6e74e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T21:57:54.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:54.862+0000 7f4a6e74e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T21:57:57.721 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T21:57:57.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:57:57.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:57.837+0000 7f77db21a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T21:57:57.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:57.837+0000 7f77db21a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T21:57:57.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:57.837+0000 7f77db21a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T21:57:57.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:57.837+0000 7f77db21a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T21:57:57.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:57.837+0000 7f77db21a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T21:57:57.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:57:57.838+0000 7f77db21a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T21:58:00.682 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T21:58:00.710 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T21:58:00.739 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:58:00.739 INFO:tasks.ceph:role: osd.4 2024-04-26T21:58:00.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T21:58:00.739 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T21:58:00.805 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:58:00.805 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:58:00.805 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:58:00.805 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:58:00.806 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:58:00.806 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:58:00.806 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:58:00.806 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:58:00.806 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:58:00.806 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:58:00.838 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T21:58:00.840 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T21:58:00.840 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T21:58:00.914 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T21:58:00.983 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T21:58:01.048 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:58:01.048 INFO:tasks.ceph:role: osd.5 2024-04-26T21:58:01.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T21:58:01.048 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T21:58:01.112 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:58:01.112 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:58:01.112 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:58:01.112 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:58:01.112 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:58:01.113 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:58:01.113 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:58:01.113 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:58:01.113 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:58:01.113 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:58:01.145 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T21:58:01.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T21:58:01.147 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T21:58:01.219 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T21:58:01.288 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T21:58:01.351 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:58:01.351 INFO:tasks.ceph:role: osd.6 2024-04-26T21:58:01.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T21:58:01.351 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T21:58:01.437 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:58:01.437 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:58:01.437 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:58:01.437 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:58:01.438 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:58:01.438 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:58:01.438 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:58:01.438 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:58:01.438 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:58:01.438 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:58:01.470 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T21:58:01.472 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T21:58:01.472 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T21:58:01.499 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T21:58:01.567 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T21:58:01.631 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T21:58:01.631 INFO:tasks.ceph:role: osd.7 2024-04-26T21:58:01.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T21:58:01.631 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T21:58:01.694 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T21:58:01.694 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T21:58:01.694 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T21:58:01.694 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T21:58:01.694 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T21:58:01.695 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-26T21:58:01.695 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T21:58:01.695 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T21:58:01.695 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T21:58:01.695 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T21:58:01.726 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-26T21:58:01.728 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-26T21:58:01.728 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T21:58:01.796 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T21:58:01.863 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:58:01.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:01.958+0000 7fac6dd57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T21:58:01.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:01.958+0000 7fac6dd57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T21:58:01.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:01.958+0000 7fac6dd57640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T21:58:01.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:01.958+0000 7fac6dd57640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T21:58:01.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:01.958+0000 7fac6dd57640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T21:58:01.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:01.958+0000 7fac6dd57640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T21:58:04.797 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T21:58:04.825 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:58:04.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:04.914+0000 7f3a7e618640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T21:58:04.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:04.914+0000 7f3a7e618640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T21:58:04.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:04.914+0000 7f3a7e618640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T21:58:04.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:04.914+0000 7f3a7e618640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T21:58:04.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:04.914+0000 7f3a7e618640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T21:58:04.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:04.914+0000 7f3a7e618640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T21:58:07.757 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T21:58:07.785 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:58:07.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:07.872+0000 7f69d7e19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T21:58:07.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:07.872+0000 7f69d7e19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T21:58:07.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:07.872+0000 7f69d7e19640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T21:58:07.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:07.872+0000 7f69d7e19640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T21:58:07.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:07.872+0000 7f69d7e19640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T21:58:07.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:07.873+0000 7f69d7e19640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T21:58:10.712 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T21:58:10.740 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:58:10.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:10.827+0000 7ff445dbe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T21:58:10.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:10.827+0000 7ff445dbe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T21:58:10.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:10.827+0000 7ff445dbe640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T21:58:10.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:10.827+0000 7ff445dbe640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T21:58:10.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:10.827+0000 7ff445dbe640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T21:58:10.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:10.828+0000 7ff445dbe640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T21:58:12.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:58:12.588 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:58:13.670 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T21:58:13.699 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T21:58:13.699 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:13.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T21:58:13.727 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:13.728 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T21:58:13.796 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:13.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T21:58:13.872 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:13.873 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T21:58:13.918 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:13.918 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T21:58:13.987 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:13.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T21:58:14.056 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:14.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T21:58:14.126 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:14.126 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T21:58:14.155 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:14.156 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T21:58:14.227 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:14.227 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T21:58:14.295 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:14.295 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T21:58:14.361 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:14.361 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T21:58:14.427 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:14.427 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T21:58:14.492 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:14.492 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T21:58:14.556 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:14.557 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T21:58:14.575 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:14.575 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-26T21:58:14.632 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:14.632 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T21:58:14.647 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:14.648 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-26T21:58:14.702 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T21:58:14.702 DEBUG:teuthology.orchestra.run.smithi137:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T21:58:14.705 DEBUG:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.y] 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBYIyxmlrq3OhAA9Fd+zmECU9xK/pWp2Hg9kg== 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmKffkBRAAh7EvvT0pmNbLKtJsBH/25Q== 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmMbCsDBAANF98tMtCSOy4TVN7I498cw== 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.0] 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBcIyxmY2T8NhAAMyJ5OP3dhuqMymrlUG4q2A== 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.1] 2024-04-26T21:58:14.746 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBfIyxmNfGnNRAAp+tTaVBwfAMUsyqRSgoRvw== 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.2] 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBiIyxm3Q1yMxAAf7f6Me7uKYzM+Fp+2FCQsA== 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.3] 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBlIyxmFcj2MRAAL/yPxOwtgMnfbmr0YUZs6Q== 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr.x] 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmFBrPAhAAfrkQvzF5SSyb5iQ0zr0eww== 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmd5UHERAAykWO/C56qwLwimzH2f6mcA== 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmQ47KFxAAsreL970BTH5yQLOol942iQ== 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.4] 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBpIyxmaaAqORAAfowCddy0wT/LptWvqD4CDw== 2024-04-26T21:58:14.747 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.5] 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBsIyxmJaOFNhAAqjJAuU/SoVnjIAYCODWMnA== 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.6] 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBvIyxmRkINNBAAjfFLMQ9/XMLLU8ZAoUxvkQ== 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout:[osd.7] 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQByIyxmeF1gMRAAH0t727lSCZgkTgJ0ZXyA6g== 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ== 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout:[client.2] 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmUnswIRAA5nYDanYzHiEVk98/041RHA== 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout:[client.1] 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxms4U0JBAAMZ056L4EP1qzX2KVx8JiEg== 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout:[client.3] 2024-04-26T21:58:14.748 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmHOORKRAA6Agn7TqBPywtop3Eo8+yFQ== 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBYIyxmlrq3OhAA9Fd+zmECU9xK/pWp2Hg9kg== 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBZIyxmKffkBRAAh7EvvT0pmNbLKtJsBH/25Q== 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBZIyxmMbCsDBAANF98tMtCSOy4TVN7I498cw== 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBcIyxmY2T8NhAAMyJ5OP3dhuqMymrlUG4q2A== 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBfIyxmNfGnNRAAp+tTaVBwfAMUsyqRSgoRvw== 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBiIyxm3Q1yMxAAf7f6Me7uKYzM+Fp+2FCQsA== 2024-04-26T21:58:14.765 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBlIyxmFcj2MRAAL/yPxOwtgMnfbmr0YUZs6Q== 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBZIyxmFBrPAhAAfrkQvzF5SSyb5iQ0zr0eww== 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBZIyxmd5UHERAAykWO/C56qwLwimzH2f6mcA== 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBZIyxmQ47KFxAAsreL970BTH5yQLOol942iQ== 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.4] 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBpIyxmaaAqORAAfowCddy0wT/LptWvqD4CDw== 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.5] 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBsIyxmJaOFNhAAqjJAuU/SoVnjIAYCODWMnA== 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.6] 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBvIyxmRkINNBAAjfFLMQ9/XMLLU8ZAoUxvkQ== 2024-04-26T21:58:14.766 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.7] 2024-04-26T21:58:14.767 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQByIyxmeF1gMRAAH0t727lSCZgkTgJ0ZXyA6g== 2024-04-26T21:58:14.767 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-04-26T21:58:14.767 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ== 2024-04-26T21:58:14.767 INFO:teuthology.orchestra.run.smithi170.stdout:[client.2] 2024-04-26T21:58:14.767 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBZIyxmUnswIRAA5nYDanYzHiEVk98/041RHA== 2024-04-26T21:58:14.767 INFO:teuthology.orchestra.run.smithi170.stdout:[client.1] 2024-04-26T21:58:14.767 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBZIyxms4U0JBAAMZ056L4EP1qzX2KVx8JiEg== 2024-04-26T21:58:14.767 INFO:teuthology.orchestra.run.smithi170.stdout:[client.3] 2024-04-26T21:58:14.767 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBZIyxmHOORKRAA6Agn7TqBPywtop3Eo8+yFQ== 2024-04-26T21:58:14.768 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:58:14.793 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:58:14.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:58:14.859 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:58:14.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:58:14.916 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:58:14.968 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:14.970 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.018 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.021 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.069 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.071 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.119 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.121 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.169 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:58:15.171 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T21:58:15.219 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:58:15.222 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:58:15.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:58:15.276 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T21:58:15.328 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.330 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.378 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.381 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.432 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.480 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.482 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T21:58:15.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:58:15.533 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:58:15.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:58:15.586 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:58:15.638 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:58:15.640 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:58:15.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:58:15.694 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T21:58:15.746 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T21:58:15.746 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T21:58:15.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T21:58:15.863 DEBUG:teuthology.orchestra.run.smithi137:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T21:58:15.886 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T21:58:15.910 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T21:58:16.006 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T21:58:16.029 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T21:58:16.092 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T21:58:16.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T21:58:16.208 DEBUG:teuthology.orchestra.run.smithi137:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:58:16.210 DEBUG:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T21:58:16.263 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T21:58:16.263 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T21:58:16.264 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T21:58:16.266 INFO:tasks.ceph.mon.a:Started 2024-04-26T21:58:16.266 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T21:58:16.266 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T21:58:16.306 INFO:tasks.ceph.mon.b:Started 2024-04-26T21:58:16.306 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T21:58:16.306 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T21:58:16.308 INFO:tasks.ceph.mon.c:Started 2024-04-26T21:58:16.308 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T21:58:16.308 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T21:58:16.308 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T21:58:16.311 INFO:tasks.ceph.mgr.y:Started 2024-04-26T21:58:16.311 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T21:58:16.311 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T21:58:16.313 INFO:tasks.ceph.mgr.x:Started 2024-04-26T21:58:16.313 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T21:58:16.313 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T21:58:16.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.411+0000 7f2e958c4640 1 Processor -- start 2024-04-26T21:58:16.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.412+0000 7f2e958c4640 1 -- start start 2024-04-26T21:58:16.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.412+0000 7f2e958c4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 0x7f2e9009c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:16.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.412+0000 7f2e958c4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2e900b2420 0x7f2e900d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:16.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.412+0000 7f2e958c4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e900cee60 con 0x7f2e900d1770 2024-04-26T21:58:16.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.412+0000 7f2e958c4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2e900d1be0 con 0x7f2e900b2420 2024-04-26T21:58:16.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.412+0000 7f2e958c4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e900ce9d0 con 0x7f2e9015d340 2024-04-26T21:58:16.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8e7fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2e900b2420 0x7f2e900d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:16.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8effd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 0x7f2e9009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:16.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8e7fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2e900b2420 0x7f2e900d1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:59090/0 (socket says 172.21.15.137:59090) 2024-04-26T21:58:16.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8e7fc640 1 -- 172.21.15.137:0/3246351454 learned_addr learned my addr 172.21.15.137:0/3246351454 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:16.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8e7fc640 1 -- 172.21.15.137:0/3246351454 >> v2:172.21.15.170:3300/0 conn(0x7f2e900b2420 msgr2=0x7f2e900d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-26T21:58:16.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8effd640 1 -- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 msgr2=0x7f2e9009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T21:58:16.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8e7fc640 1 -- 172.21.15.137:0/3246351454 >> v2:172.21.15.170:3300/0 conn(0x7f2e900b2420 msgr2=0x7f2e900d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:58:16.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8effd640 1 -- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 msgr2=0x7f2e9009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T21:58:16.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8e7fc640 1 --2- 172.21.15.137:0/3246351454 >> v2:172.21.15.170:3300/0 conn(0x7f2e900b2420 0x7f2e900d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:58:16.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8effd640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 0x7f2e9009c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T21:58:16.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8e7fc640 1 --2- 172.21.15.137:0/3246351454 >> v2:172.21.15.170:3300/0 conn(0x7f2e900b2420 0x7f2e900d1230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:58:16.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.413+0000 7f2e8effd640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 0x7f2e9009c560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T21:58:16.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 370793378 0 0) 0x7f2e900cee60 con 0x7f2e900d1770 2024-04-26T21:58:16.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e78003520 con 0x7f2e900d1770 2024-04-26T21:58:16.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4170907234 0 0) 0x7f2e78003520 con 0x7f2e900d1770 2024-04-26T21:58:16.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 msgr2=0x7f2e9009c560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T21:58:16.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 0x7f2e9009c560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 >> v2:172.21.15.170:3300/0 conn(0x7f2e900b2420 msgr2=0x7f2e900d1230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T21:58:16.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 --2- 172.21.15.137:0/3246351454 >> v2:172.21.15.170:3300/0 conn(0x7f2e900b2420 0x7f2e900d1230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e900d0ff0 con 0x7f2e900d1770 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 <== mon.1 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f2e88001670 con 0x7f2e900d1770 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 >> v1:172.21.15.170:6789/0 conn(0x7f2e900d1770 legacy=0x7f2e900cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e780039b0 0x7f2e78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e78004800 0x7f2e78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 0x7f2e780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900d1be0 con 0x7f2e780039b0 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900ce9d0 con 0x7f2e78004800 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7800ba70 con 0x7f2e9015d340 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8effd640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e780039b0 0x7f2e78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.566+0000 7f2e8e7fc640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e78004800 0x7f2e78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.567+0000 7f2e8f7fe640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 0x7f2e780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.567+0000 7f2e8e7fc640 1 -- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 msgr2=0x7f2e780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.567+0000 7f2e8e7fc640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 0x7f2e780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.567+0000 7f2e8e7fc640 1 -- 172.21.15.137:0/3246351454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e780039b0 msgr2=0x7f2e78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:16.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.567+0000 7f2e8e7fc640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e780039b0 0x7f2e78003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.567+0000 7f2e8e7fc640 1 -- 172.21.15.137:0/3246351454 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e78003520 con 0x7f2e78004800 2024-04-26T21:58:16.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.567+0000 7f2e8effd640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e780039b0 0x7f2e78003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:16.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.567+0000 7f2e8f7fe640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e9015d340 0x7f2e780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:16.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.568+0000 7f2e8e7fc640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e78004800 0x7f2e78004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009100 tx=0x7f2e78005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cbc6221b4ac22f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:16.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.568+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84037070 con 0x7f2e78004800 2024-04-26T21:58:16.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.568+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8402ad00 con 0x7f2e78004800 2024-04-26T21:58:16.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.568+0000 7f2e8dffb640 1 -- 172.21.15.137:0/3246351454 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400f040 con 0x7f2e78004800 2024-04-26T21:58:16.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.569+0000 7f2e958c4640 1 -- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e78004800 msgr2=0x7f2e78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:16.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.569+0000 7f2e958c4640 1 --2- 172.21.15.137:0/3246351454 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e78004800 0x7f2e78004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009100 tx=0x7f2e78005830 comp rx=0 tx=0).stop 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.569+0000 7f2e8f7fe640 1 -- 172.21.15.137:0/3246351454 reap_dead start 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.569+0000 7f2e958c4640 1 -- 172.21.15.137:0/3246351454 shutdown_connections 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.569+0000 7f2e958c4640 1 -- 172.21.15.137:0/3246351454 >> 172.21.15.137:0/3246351454 conn(0x7f2e9009ba40 msgr2=0x7f2e9009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.569+0000 7f2e958c4640 1 -- 172.21.15.137:0/3246351454 shutdown_connections 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.569+0000 7f2e958c4640 1 -- 172.21.15.137:0/3246351454 wait complete. 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.570+0000 7f2e958c4640 1 Processor -- start 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e958c4640 1 -- start start 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e958c4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e78004800 0x7f2e9014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e958c4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e9009e190 0x7f2e9009e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e958c4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9015a470 0x7f2e9015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e958c4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900712b0 con 0x7f2e9015a470 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e958c4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900ce660 con 0x7f2e9009e190 2024-04-26T21:58:16.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e958c4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e9015d720 con 0x7f2e78004800 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e8f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9015a470 0x7f2e9015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e8e7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e9009e190 0x7f2e9009e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e8f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9015a470 0x7f2e9015a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46730/0 (socket says 172.21.15.137:46730) 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e8f7fe640 1 -- 172.21.15.137:0/2295117423 learned_addr learned my addr 172.21.15.137:0/2295117423 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.571+0000 7f2e8effd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e78004800 0x7f2e9014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e8effd640 1 -- 172.21.15.137:0/2295117423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e9009e190 msgr2=0x7f2e9009e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e8effd640 1 --2- 172.21.15.137:0/2295117423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e9009e190 0x7f2e9009e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e8effd640 1 -- 172.21.15.137:0/2295117423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9015a470 msgr2=0x7f2e9015a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e8effd640 1 --2- 172.21.15.137:0/2295117423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9015a470 0x7f2e9015a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e8effd640 1 -- 172.21.15.137:0/2295117423 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e90150dd0 con 0x7f2e78004800 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e8effd640 1 --2- 172.21.15.137:0/2295117423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e78004800 0x7f2e9014e380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000f4c0 tx=0x7f2e8000f8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:16.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e77fff640 1 -- 172.21.15.137:0/2295117423 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e800148a0 con 0x7f2e78004800 2024-04-26T21:58:16.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e77fff640 1 -- 172.21.15.137:0/2295117423 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8001a070 con 0x7f2e78004800 2024-04-26T21:58:16.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e77fff640 1 -- 172.21.15.137:0/2295117423 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80014c80 con 0x7f2e78004800 2024-04-26T21:58:16.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e958c4640 1 -- 172.21.15.137:0/2295117423 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e901510b0 con 0x7f2e78004800 2024-04-26T21:58:16.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e958c4640 1 -- 172.21.15.137:0/2295117423 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e90151670 con 0x7f2e78004800 2024-04-26T21:58:16.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e77fff640 1 -- 172.21.15.137:0/2295117423 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e80015470 con 0x7f2e78004800 2024-04-26T21:58:16.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.572+0000 7f2e77fff640 1 -- 172.21.15.137:0/2295117423 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2e8001f6c0 con 0x7f2e78004800 2024-04-26T21:58:16.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.573+0000 7f2e958c4640 1 -- 172.21.15.137:0/2295117423 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e900693d0 con 0x7f2e78004800 2024-04-26T21:58:16.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.576+0000 7f2e77fff640 1 -- 172.21.15.137:0/2295117423 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2e80024020 con 0x7f2e78004800 2024-04-26T21:58:16.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.657+0000 7f2e958c4640 1 -- 172.21.15.137:0/2295117423 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f2e900d0730 con 0x7f2e78004800 2024-04-26T21:58:16.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.660+0000 7f2e77fff640 1 -- 172.21.15.137:0/2295117423 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f2e80015940 con 0x7f2e78004800 2024-04-26T21:58:16.660 INFO:teuthology.orchestra.run.smithi137.stderr:adjusted tunables profile to default 2024-04-26T21:58:16.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.661+0000 7f2e958c4640 1 -- 172.21.15.137:0/2295117423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e78004800 msgr2=0x7f2e9014e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:16.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.661+0000 7f2e958c4640 1 --2- 172.21.15.137:0/2295117423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e78004800 0x7f2e9014e380 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000f4c0 tx=0x7f2e8000f8c0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.661+0000 7f2e958c4640 1 -- 172.21.15.137:0/2295117423 shutdown_connections 2024-04-26T21:58:16.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.661+0000 7f2e958c4640 1 --2- 172.21.15.137:0/2295117423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e9015a470 0x7f2e9015a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.661+0000 7f2e958c4640 1 --2- 172.21.15.137:0/2295117423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e9009e190 0x7f2e9009e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.661+0000 7f2e958c4640 1 --2- 172.21.15.137:0/2295117423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e78004800 0x7f2e9014e380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:16.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.661+0000 7f2e958c4640 1 -- 172.21.15.137:0/2295117423 >> 172.21.15.137:0/2295117423 conn(0x7f2e9009ba40 msgr2=0x7f2e900b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:16.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.662+0000 7f2e958c4640 1 -- 172.21.15.137:0/2295117423 shutdown_connections 2024-04-26T21:58:16.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:16.662+0000 7f2e958c4640 1 -- 172.21.15.137:0/2295117423 wait complete. 2024-04-26T21:58:16.672 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T21:58:16.672 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T21:58:16.673 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:16.673 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T21:58:16.692 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:16.692+0000 7f0257320040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T21:58:16.696 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:16.696 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T21:58:16.696 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:16.696+0000 7fd681fea040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T21:58:16.759 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:16.759 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T21:58:16.823 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:58:16.823 DEBUG:teuthology.orchestra.run.smithi137:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T21:58:16.846 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:16.846+0000 7f0257320040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:58:16.848 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:16.849+0000 7fd681fea040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:58:16.869 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:16.870 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T21:58:16.895 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:16.895 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T21:58:16.902 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:16.902+0000 7f0257320040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T21:58:16.904 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:16.905+0000 7fd681fea040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T21:58:16.927 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:16.927 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T21:58:16.991 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:58:16.992 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T21:58:17.055 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 65ef699d-600a-49a7-ac5c-fd7c381048c1 0 2024-04-26T21:58:17.150 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:17.150+0000 7f0257320040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T21:58:17.162 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:17.162+0000 7fd681fea040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T21:58:17.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.193+0000 7f8429e37640 1 Processor -- start 2024-04-26T21:58:17.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.194+0000 7f8429e37640 1 -- start start 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.194+0000 7f8429e37640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f84240b2420 0x7f842409c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.194+0000 7f8429e37640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84240cee60 con 0x7f842415d340 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.194+0000 7f8429e37640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84240d0ff0 con 0x7f84240d1940 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.194+0000 7f8429e37640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f84240ce9d0 con 0x7f84240b2420 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.194+0000 7f8422ffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f84240b2420 0x7f842409c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.194+0000 7f8422ffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f84240b2420 0x7f842409c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43794/0 (socket says 172.21.15.170:43794) 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.194+0000 7f8422ffd640 1 -- 172.21.15.170:0/2203413703 learned_addr learned my addr 172.21.15.170:0/2203413703 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.194+0000 7f8423fff640 1 --1- 172.21.15.170:0/2203413703 >> v1:172.21.15.170:6789/0 conn(0x7f84240d1940 0x7f84240702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:42414/0 (socket says 172.21.15.170:42414) 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.195+0000 7f8422ffd640 1 -- 172.21.15.170:0/2203413703 >> v1:172.21.15.170:6789/0 conn(0x7f84240d1940 legacy=0x7f84240702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.195+0000 7f8422ffd640 1 -- 172.21.15.170:0/2203413703 >> v1:172.21.15.137:6789/0 conn(0x7f842415d340 legacy=0x7f84240d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.195+0000 7f8422ffd640 1 -- 172.21.15.170:0/2203413703 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84240d0d10 con 0x7f84240b2420 2024-04-26T21:58:17.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.195+0000 7f84227fc640 1 -- 172.21.15.170:0/2203413703 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558560284 0 0) 0x7f84240d0ff0 con 0x7f84240d1940 2024-04-26T21:58:17.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.195+0000 7f8422ffd640 1 --2- 172.21.15.170:0/2203413703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240b2420 0x7f842409c560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8414009870 tx=0x7f841402a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fa0a590192a986e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:17.196 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:17.195+0000 7f0257320040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T21:58:17.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f84227fc640 1 -- 172.21.15.170:0/2203413703 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414037070 con 0x7f84240b2420 2024-04-26T21:58:17.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f84227fc640 1 -- 172.21.15.170:0/2203413703 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841402ae50 con 0x7f84240b2420 2024-04-26T21:58:17.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f84227fc640 1 -- 172.21.15.170:0/2203413703 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414032860 con 0x7f84240b2420 2024-04-26T21:58:17.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f8429e37640 1 -- 172.21.15.170:0/2203413703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240b2420 msgr2=0x7f842409c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f8429e37640 1 --2- 172.21.15.170:0/2203413703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240b2420 0x7f842409c560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8414009870 tx=0x7f841402a300 comp rx=0 tx=0).stop 2024-04-26T21:58:17.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f8429e37640 1 -- 172.21.15.170:0/2203413703 shutdown_connections 2024-04-26T21:58:17.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f8429e37640 1 --2- 172.21.15.170:0/2203413703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240b2420 0x7f842409c560 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f8429e37640 1 -- 172.21.15.170:0/2203413703 >> 172.21.15.170:0/2203413703 conn(0x7f842409ba40 msgr2=0x7f842409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:17.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f8429e37640 1 -- 172.21.15.170:0/2203413703 shutdown_connections 2024-04-26T21:58:17.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.196+0000 7f8429e37640 1 -- 172.21.15.170:0/2203413703 wait complete. 2024-04-26T21:58:17.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.197+0000 7f8429e37640 1 Processor -- start 2024-04-26T21:58:17.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f8429e37640 1 -- start start 2024-04-26T21:58:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f8429e37640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240d1940 0x7f842415b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f8429e37640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842415d340 0x7f84240b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f8429e37640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84241f41d0 0x7f84240b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f8429e37640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84240b2090 con 0x7f842415d340 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f8429e37640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f842415d720 con 0x7f84240d1940 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f8429e37640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f84240b2210 con 0x7f84241f41d0 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f84237fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240d1940 0x7f842415b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f84237fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240d1940 0x7f842415b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43802/0 (socket says 172.21.15.170:43802) 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.198+0000 7f84237fe640 1 -- 172.21.15.170:0/1492563412 learned_addr learned my addr 172.21.15.170:0/1492563412 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f8423fff640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84241f41d0 0x7f84240b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f8422ffd640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842415d340 0x7f84240b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f84237fe640 1 -- 172.21.15.170:0/1492563412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84241f41d0 msgr2=0x7f84240b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f84237fe640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84241f41d0 0x7f84240b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f84237fe640 1 -- 172.21.15.170:0/1492563412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842415d340 msgr2=0x7f84240b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f84237fe640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842415d340 0x7f84240b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f84237fe640 1 -- 172.21.15.170:0/1492563412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84240a0a40 con 0x7f84240d1940 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f8423fff640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84241f41d0 0x7f84240b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f84237fe640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240d1940 0x7f842415b850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c400 tx=0x7f840c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f841bfff640 1 -- 172.21.15.170:0/1492563412 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c017070 con 0x7f84240d1940 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f841bfff640 1 -- 172.21.15.170:0/1492563412 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0052d0 con 0x7f84240d1940 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f841bfff640 1 -- 172.21.15.170:0/1492563412 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c003830 con 0x7f84240d1940 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f8429e37640 1 -- 172.21.15.170:0/1492563412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84240a0d20 con 0x7f84240d1940 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f8429e37640 1 -- 172.21.15.170:0/1492563412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842409d110 con 0x7f84240d1940 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f841bfff640 1 -- 172.21.15.170:0/1492563412 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f840c01a070 con 0x7f84240d1940 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.199+0000 7f841bfff640 1 -- 172.21.15.170:0/1492563412 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f840c01c440 con 0x7f84240d1940 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.201+0000 7f8429e37640 1 -- 172.21.15.170:0/1492563412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84240693d0 con 0x7f84240d1940 2024-04-26T21:58:17.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.203+0000 7f841bfff640 1 -- 172.21.15.170:0/1492563412 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f840c021020 con 0x7f84240d1940 2024-04-26T21:58:17.217 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:17.217+0000 7fd681fea040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T21:58:17.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.291+0000 7f8429e37640 1 -- 172.21.15.170:0/1492563412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "65ef699d-600a-49a7-ac5c-fd7c381048c1", "id": 0} v 0) -- 0x7f84240713a0 con 0x7f84240d1940 2024-04-26T21:58:17.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.295+0000 7f841bfff640 1 -- 172.21.15.170:0/1492563412 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65ef699d-600a-49a7-ac5c-fd7c381048c1", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f840c011590 con 0x7f84240d1940 2024-04-26T21:58:17.294 INFO:teuthology.orchestra.run.smithi170.stdout:0 2024-04-26T21:58:17.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.295+0000 7f8429e37640 1 -- 172.21.15.170:0/1492563412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240d1940 msgr2=0x7f842415b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.295+0000 7f8429e37640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240d1940 0x7f842415b850 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c400 tx=0x7f840c00c8c0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.296+0000 7f8429e37640 1 -- 172.21.15.170:0/1492563412 shutdown_connections 2024-04-26T21:58:17.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.296+0000 7f8429e37640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f842415d340 0x7f84240b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.296+0000 7f8429e37640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84241f41d0 0x7f84240b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.296+0000 7f8429e37640 1 --2- 172.21.15.170:0/1492563412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84240d1940 0x7f842415b850 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.296+0000 7f8429e37640 1 -- 172.21.15.170:0/1492563412 >> 172.21.15.170:0/1492563412 conn(0x7f842409ba40 msgr2=0x7f84240c6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:17.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.296+0000 7f8429e37640 1 -- 172.21.15.170:0/1492563412 shutdown_connections 2024-04-26T21:58:17.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.296+0000 7f8429e37640 1 -- 172.21.15.170:0/1492563412 wait complete. 2024-04-26T21:58:17.309 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 27e82e3b-da0a-4301-96f5-da02d5a1c04b 1 2024-04-26T21:58:17.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.407+0000 7f09d1514640 1 Processor -- start 2024-04-26T21:58:17.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.407+0000 7f09d1514640 1 -- start start 2024-04-26T21:58:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.407+0000 7f09d1514640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc0d4f20 0x7f09cc0d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.407+0000 7f09d1514640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09cc0d58f0 con 0x7f09cc0d3820 2024-04-26T21:58:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.407+0000 7f09d1514640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09cc0d3c90 con 0x7f09cc15f680 2024-04-26T21:58:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.407+0000 7f09d1514640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f09cc15fa60 con 0x7f09cc0d4f20 2024-04-26T21:58:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.408+0000 7f09cb7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc0d4f20 0x7f09cc0d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.408+0000 7f09caffd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f09cc15f680 0x7f09cc163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:42428/0 (socket says 172.21.15.170:42428) 2024-04-26T21:58:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.408+0000 7f09caffd640 1 -- 172.21.15.170:0/2827713038 learned_addr learned my addr 172.21.15.170:0/2827713038 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T21:58:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.408+0000 7f09cb7fe640 1 -- 172.21.15.170:0/2827713038 >> v1:172.21.15.170:6789/0 conn(0x7f09cc15f680 legacy=0x7f09cc163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.408+0000 7f09cb7fe640 1 -- 172.21.15.170:0/2827713038 >> v1:172.21.15.137:6789/0 conn(0x7f09cc0d3820 legacy=0x7f09cc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.408+0000 7f09c9ffb640 1 -- 172.21.15.170:0/2827713038 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799413024 0 0) 0x7f09cc0d3c90 con 0x7f09cc15f680 2024-04-26T21:58:17.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.408+0000 7f09cb7fe640 1 -- 172.21.15.170:0/2827713038 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc0d3f50 con 0x7f09cc0d4f20 2024-04-26T21:58:17.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09cb7fe640 1 --2- 172.21.15.170:0/2827713038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc0d4f20 0x7f09cc0d53b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009dc0 tx=0x7f09c402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c622520cd5fb1d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:17.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09c9ffb640 1 -- 172.21.15.170:0/2827713038 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4007740 con 0x7f09cc0d4f20 2024-04-26T21:58:17.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09c9ffb640 1 -- 172.21.15.170:0/2827713038 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c40078e0 con 0x7f09cc0d4f20 2024-04-26T21:58:17.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09c9ffb640 1 -- 172.21.15.170:0/2827713038 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4007cb0 con 0x7f09cc0d4f20 2024-04-26T21:58:17.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09d1514640 1 -- 172.21.15.170:0/2827713038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc0d4f20 msgr2=0x7f09cc0d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09d1514640 1 --2- 172.21.15.170:0/2827713038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc0d4f20 0x7f09cc0d53b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f09c4009dc0 tx=0x7f09c402a6d0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09d1514640 1 -- 172.21.15.170:0/2827713038 shutdown_connections 2024-04-26T21:58:17.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09d1514640 1 --2- 172.21.15.170:0/2827713038 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc0d4f20 0x7f09cc0d53b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09d1514640 1 -- 172.21.15.170:0/2827713038 >> 172.21.15.170:0/2827713038 conn(0x7f09cc08eca0 msgr2=0x7f09cc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:17.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09d1514640 1 -- 172.21.15.170:0/2827713038 shutdown_connections 2024-04-26T21:58:17.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.409+0000 7f09d1514640 1 -- 172.21.15.170:0/2827713038 wait complete. 2024-04-26T21:58:17.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.411+0000 7f09d1514640 1 Processor -- start 2024-04-26T21:58:17.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.411+0000 7f09d1514640 1 -- start start 2024-04-26T21:58:17.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.412+0000 7f09d1514640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09cc0d3820 0x7f09cc0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.412+0000 7f09d1514640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc0d4f20 0x7f09cc157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.412+0000 7f09d1514640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc15f680 0x7f09cc0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.412+0000 7f09d1514640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc0b6280 con 0x7f09cc0d3820 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09d1514640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc0b5370 con 0x7f09cc0d4f20 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09d1514640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f09cc0cfd80 con 0x7f09cc15f680 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09cb7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc15f680 0x7f09cc0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09ca7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc0d4f20 0x7f09cc157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09cb7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc15f680 0x7f09cc0ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:60360/0 (socket says 172.21.15.170:60360) 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09ca7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc0d4f20 0x7f09cc157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43808/0 (socket says 172.21.15.170:43808) 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09cb7fe640 1 -- 172.21.15.170:0/1855101572 learned_addr learned my addr 172.21.15.170:0/1855101572 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09caffd640 1 --2- 172.21.15.170:0/1855101572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09cc0d3820 0x7f09cc0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09cb7fe640 1 -- 172.21.15.170:0/1855101572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc0d4f20 msgr2=0x7f09cc157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09cb7fe640 1 --2- 172.21.15.170:0/1855101572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc0d4f20 0x7f09cc157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09cb7fe640 1 -- 172.21.15.170:0/1855101572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09cc0d3820 msgr2=0x7f09cc0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09cb7fe640 1 --2- 172.21.15.170:0/1855101572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09cc0d3820 0x7f09cc0cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09cb7fe640 1 -- 172.21.15.170:0/1855101572 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09cc0cd290 con 0x7f09cc15f680 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09ca7fc640 1 --2- 172.21.15.170:0/1855101572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc0d4f20 0x7f09cc157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09cb7fe640 1 --2- 172.21.15.170:0/1855101572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc15f680 0x7f09cc0ccd50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f09c402acc0 tx=0x7f09c4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09b37fe640 1 -- 172.21.15.170:0/1855101572 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4040070 con 0x7f09cc15f680 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09b37fe640 1 -- 172.21.15.170:0/1855101572 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c4031bc0 con 0x7f09cc15f680 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09d1514640 1 -- 172.21.15.170:0/1855101572 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09cc0cd940 con 0x7f09cc15f680 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09b37fe640 1 -- 172.21.15.170:0/1855101572 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4045460 con 0x7f09cc15f680 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.413+0000 7f09d1514640 1 -- 172.21.15.170:0/1855101572 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09cc0cdf00 con 0x7f09cc15f680 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.414+0000 7f09b37fe640 1 -- 172.21.15.170:0/1855101572 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f09c4039040 con 0x7f09cc15f680 2024-04-26T21:58:17.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.414+0000 7f09b37fe640 1 -- 172.21.15.170:0/1855101572 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f09c403c7d0 con 0x7f09cc15f680 2024-04-26T21:58:17.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.414+0000 7f09d1514640 1 -- 172.21.15.170:0/1855101572 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09cc0d1150 con 0x7f09cc15f680 2024-04-26T21:58:17.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.416+0000 7f09b37fe640 1 -- 172.21.15.170:0/1855101572 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f09cc0d1150 con 0x7f09cc15f680 2024-04-26T21:58:17.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.488+0000 7f09d1514640 1 -- 172.21.15.170:0/1855101572 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "27e82e3b-da0a-4301-96f5-da02d5a1c04b", "id": 1} v 0) -- 0x7f09cc06a290 con 0x7f09cc15f680 2024-04-26T21:58:17.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.491+0000 7f09b37fe640 1 -- 172.21.15.170:0/1855101572 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27e82e3b-da0a-4301-96f5-da02d5a1c04b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f09c4053080 con 0x7f09cc15f680 2024-04-26T21:58:17.491 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T21:58:17.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.492+0000 7f09d1514640 1 -- 172.21.15.170:0/1855101572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc15f680 msgr2=0x7f09cc0ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.492+0000 7f09d1514640 1 --2- 172.21.15.170:0/1855101572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc15f680 0x7f09cc0ccd50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f09c402acc0 tx=0x7f09c4004a40 comp rx=0 tx=0).stop 2024-04-26T21:58:17.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.492+0000 7f09d1514640 1 -- 172.21.15.170:0/1855101572 shutdown_connections 2024-04-26T21:58:17.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.492+0000 7f09d1514640 1 --2- 172.21.15.170:0/1855101572 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09cc15f680 0x7f09cc0ccd50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.492+0000 7f09d1514640 1 --2- 172.21.15.170:0/1855101572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc0d4f20 0x7f09cc157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.492+0000 7f09d1514640 1 --2- 172.21.15.170:0/1855101572 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09cc0d3820 0x7f09cc0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.492+0000 7f09d1514640 1 -- 172.21.15.170:0/1855101572 >> 172.21.15.170:0/1855101572 conn(0x7f09cc08eca0 msgr2=0x7f09cc0d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:17.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.493+0000 7f09d1514640 1 -- 172.21.15.170:0/1855101572 shutdown_connections 2024-04-26T21:58:17.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.493+0000 7f09d1514640 1 -- 172.21.15.170:0/1855101572 wait complete. 2024-04-26T21:58:17.503 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 0e111cca-a9ca-47a8-9a6d-a886691535dd 2 2024-04-26T21:58:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.601+0000 7f82424da640 1 Processor -- start 2024-04-26T21:58:17.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.601+0000 7f82424da640 1 -- start start 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.602+0000 7f82424da640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f823c0735e0 0x7f823c0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.602+0000 7f82424da640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823c06f4d0 con 0x7f823c073150 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.602+0000 7f82424da640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823c06f7b0 con 0x7f823c159cf0 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.602+0000 7f82424da640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f823c06fa90 con 0x7f823c0735e0 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.602+0000 7f823bfff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f823c159cf0 0x7f823c070db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:42438/0 (socket says 172.21.15.170:42438) 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.602+0000 7f823bfff640 1 -- 172.21.15.170:0/428981975 learned_addr learned my addr 172.21.15.170:0/428981975 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.602+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913793201 0 0) 0x7f823c06f7b0 con 0x7f823c159cf0 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.602+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8224003520 con 0x7f823c159cf0 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.602+0000 7f8240a77640 1 --2- 172.21.15.170:0/428981975 >> v2:172.21.15.137:3300/0 conn(0x7f823c0735e0 0x7f823c0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4197513305 0 0) 0x7f8224003520 con 0x7f823c159cf0 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 >> v2:172.21.15.137:3300/0 conn(0x7f823c0735e0 msgr2=0x7f823c0b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:17.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 --2- 172.21.15.170:0/428981975 >> v2:172.21.15.137:3300/0 conn(0x7f823c0735e0 0x7f823c0b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 >> v1:172.21.15.137:6789/0 conn(0x7f823c073150 legacy=0x7f823c0b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c06fd70 con 0x7f823c159cf0 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 <== mon.1 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f8230001670 con 0x7f823c159cf0 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 >> v1:172.21.15.170:6789/0 conn(0x7f823c159cf0 legacy=0x7f823c070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82240039b0 0x7f8224003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8224004800 0x7f8224004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82240051c0 0x7f822400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f823c06fa90 con 0x7f8224004800 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f822400c160 con 0x7f82240039b0 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f822400c360 con 0x7f82240051c0 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823bfff640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82240039b0 0x7f8224003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823b7fe640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8224004800 0x7f8224004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f8240a77640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82240051c0 0x7f822400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823bfff640 1 -- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82240051c0 msgr2=0x7f822400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:17.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823bfff640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82240051c0 0x7f822400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823bfff640 1 -- 172.21.15.170:0/428981975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8224004800 msgr2=0x7f8224004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:17.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823bfff640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8224004800 0x7f8224004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f823bfff640 1 -- 172.21.15.170:0/428981975 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8224003520 con 0x7f82240039b0 2024-04-26T21:58:17.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.603+0000 7f8240a77640 1 -- 172.21.15.170:0/428981975 reap_dead start 2024-04-26T21:58:17.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.604+0000 7f823bfff640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82240039b0 0x7f8224003dd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f823000c240 tx=0x7f8224005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62fed1b502f9eb1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:17.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.604+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230007d10 con 0x7f82240039b0 2024-04-26T21:58:17.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.604+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8230005ad0 con 0x7f82240039b0 2024-04-26T21:58:17.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.604+0000 7f823affd640 1 -- 172.21.15.170:0/428981975 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230007070 con 0x7f82240039b0 2024-04-26T21:58:17.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.605+0000 7f82424da640 1 -- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82240039b0 msgr2=0x7f8224003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.605+0000 7f82424da640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82240039b0 0x7f8224003dd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f823000c240 tx=0x7f8224005830 comp rx=0 tx=0).stop 2024-04-26T21:58:17.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.605+0000 7f82424da640 1 -- 172.21.15.170:0/428981975 shutdown_connections 2024-04-26T21:58:17.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.605+0000 7f82424da640 1 --2- 172.21.15.170:0/428981975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82240039b0 0x7f8224003dd0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.605+0000 7f82424da640 1 -- 172.21.15.170:0/428981975 >> 172.21.15.170:0/428981975 conn(0x7f823c0d1e90 msgr2=0x7f823c0d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:17.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.605+0000 7f82424da640 1 -- 172.21.15.170:0/428981975 shutdown_connections 2024-04-26T21:58:17.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.605+0000 7f82424da640 1 -- 172.21.15.170:0/428981975 wait complete. 2024-04-26T21:58:17.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.607+0000 7f82424da640 1 Processor -- start 2024-04-26T21:58:17.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.607+0000 7f82424da640 1 -- start start 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f82424da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82240039b0 0x7f823c1f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f82424da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f823c13e710 0x7f823c1f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f82424da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f823c1f34c0 0x7f823c0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f82424da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0b6780 con 0x7f823c13e710 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f82424da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f823c15d6b0 con 0x7f823c1f34c0 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f82424da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f823c0b6900 con 0x7f82240039b0 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f8240a77640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f823c1f34c0 0x7f823c0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f8240a77640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f823c1f34c0 0x7f823c0b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43830/0 (socket says 172.21.15.170:43830) 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f8240a77640 1 -- 172.21.15.170:0/1937255226 learned_addr learned my addr 172.21.15.170:0/1937255226 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f823bfff640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82240039b0 0x7f823c1f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f823b7fe640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f823c13e710 0x7f823c1f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f8240a77640 1 -- 172.21.15.170:0/1937255226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82240039b0 msgr2=0x7f823c1f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f8240a77640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82240039b0 0x7f823c1f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f8240a77640 1 -- 172.21.15.170:0/1937255226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f823c13e710 msgr2=0x7f823c1f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f8240a77640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f823c13e710 0x7f823c1f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f8240a77640 1 -- 172.21.15.170:0/1937255226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c1f64e0 con 0x7f823c1f34c0 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.608+0000 7f823b7fe640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f823c13e710 0x7f823c1f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.609+0000 7f8240a77640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f823c1f34c0 0x7f823c0b4c70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f823c0746d0 tx=0x7f823400f580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.609+0000 7f8238ff9640 1 -- 172.21.15.170:0/1937255226 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823400fdb0 con 0x7f823c1f34c0 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.609+0000 7f8238ff9640 1 -- 172.21.15.170:0/1937255226 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823401d070 con 0x7f823c1f34c0 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.609+0000 7f82424da640 1 -- 172.21.15.170:0/1937255226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823c1f39d0 con 0x7f823c1f34c0 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.609+0000 7f8238ff9640 1 -- 172.21.15.170:0/1937255226 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234015670 con 0x7f823c1f34c0 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.609+0000 7f82424da640 1 -- 172.21.15.170:0/1937255226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823c1f6750 con 0x7f823c1f34c0 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.609+0000 7f8238ff9640 1 -- 172.21.15.170:0/1937255226 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8234015810 con 0x7f823c1f34c0 2024-04-26T21:58:17.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.609+0000 7f8238ff9640 1 -- 172.21.15.170:0/1937255226 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f82340213c0 con 0x7f823c1f34c0 2024-04-26T21:58:17.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.610+0000 7f82424da640 1 -- 172.21.15.170:0/1937255226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823c0693d0 con 0x7f823c1f34c0 2024-04-26T21:58:17.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.612+0000 7f8238ff9640 1 -- 172.21.15.170:0/1937255226 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8234027020 con 0x7f823c1f34c0 2024-04-26T21:58:17.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.685+0000 7f82424da640 1 -- 172.21.15.170:0/1937255226 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e111cca-a9ca-47a8-9a6d-a886691535dd", "id": 2} v 0) -- 0x7f823c158270 con 0x7f823c1f34c0 2024-04-26T21:58:17.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.690+0000 7f8238ff9640 1 -- 172.21.15.170:0/1937255226 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e111cca-a9ca-47a8-9a6d-a886691535dd", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8234010040 con 0x7f823c1f34c0 2024-04-26T21:58:17.690 INFO:teuthology.orchestra.run.smithi170.stdout:2 2024-04-26T21:58:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.691+0000 7f82424da640 1 -- 172.21.15.170:0/1937255226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f823c1f34c0 msgr2=0x7f823c0b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.691+0000 7f82424da640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f823c1f34c0 0x7f823c0b4c70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f823c0746d0 tx=0x7f823400f580 comp rx=0 tx=0).stop 2024-04-26T21:58:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.691+0000 7f82424da640 1 -- 172.21.15.170:0/1937255226 shutdown_connections 2024-04-26T21:58:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.691+0000 7f82424da640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f823c13e710 0x7f823c1f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.691+0000 7f82424da640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f823c1f34c0 0x7f823c0b4c70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.691+0000 7f82424da640 1 --2- 172.21.15.170:0/1937255226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82240039b0 0x7f823c1f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.691+0000 7f82424da640 1 -- 172.21.15.170:0/1937255226 >> 172.21.15.170:0/1937255226 conn(0x7f823c0d1e90 msgr2=0x7f823c0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.691+0000 7f82424da640 1 -- 172.21.15.170:0/1937255226 shutdown_connections 2024-04-26T21:58:17.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.691+0000 7f82424da640 1 -- 172.21.15.170:0/1937255226 wait complete. 2024-04-26T21:58:17.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 48e0641a-7b85-4745-a1e5-ee936170edc5 3 2024-04-26T21:58:17.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.799+0000 7f5ad7b1c640 1 Processor -- start 2024-04-26T21:58:17.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.799+0000 7f5ad7b1c640 1 -- start start 2024-04-26T21:58:17.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.800+0000 7f5ad7b1c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5ad00711a0 0x7f5ad00b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.800+0000 7f5ad7b1c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.800+0000 7f5ad7b1c640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad0071580 con 0x7f5ad015c550 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.800+0000 7f5ad7b1c640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad00b4fe0 con 0x7f5ad00711a0 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.800+0000 7f5ad7b1c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad015d070 con 0x7f5ad00b6730 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.800+0000 7f5ad60b9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.800+0000 7f5ad60b9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad015c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:60390/0 (socket says 172.21.15.170:60390) 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.800+0000 7f5ad60b9640 1 -- 172.21.15.170:0/1168472023 learned_addr learned my addr 172.21.15.170:0/1168472023 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.800+0000 7f5ad58b8640 1 --2- 172.21.15.170:0/1168472023 >> v2:172.21.15.137:3300/0 conn(0x7f5ad00711a0 0x7f5ad00b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.801+0000 7f5ad60b9640 1 -- 172.21.15.170:0/1168472023 >> v2:172.21.15.137:3300/0 conn(0x7f5ad00711a0 msgr2=0x7f5ad00b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.801+0000 7f5ad60b9640 1 --2- 172.21.15.170:0/1168472023 >> v2:172.21.15.137:3300/0 conn(0x7f5ad00711a0 0x7f5ad00b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.801+0000 7f5ad48b6640 1 -- 172.21.15.170:0/1168472023 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092153765 0 0) 0x7f5ad0071580 con 0x7f5ad015c550 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.801+0000 7f5ad60b9640 1 -- 172.21.15.170:0/1168472023 >> v1:172.21.15.137:6789/0 conn(0x7f5ad015c550 legacy=0x7f5ad00b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.801+0000 7f5ad60b9640 1 -- 172.21.15.170:0/1168472023 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad015d350 con 0x7f5ad00b6730 2024-04-26T21:58:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.801+0000 7f5ad60b9640 1 --2- 172.21.15.170:0/1168472023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad015c9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009e50 tx=0x7f5ac802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a01a9cc165eac434 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.801+0000 7f5ad48b6640 1 -- 172.21.15.170:0/1168472023 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8036070 con 0x7f5ad00b6730 2024-04-26T21:58:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.801+0000 7f5ad48b6640 1 -- 172.21.15.170:0/1168472023 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac8031600 con 0x7f5ad00b6730 2024-04-26T21:58:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.801+0000 7f5ad48b6640 1 -- 172.21.15.170:0/1168472023 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80319d0 con 0x7f5ad00b6730 2024-04-26T21:58:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.802+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1168472023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 msgr2=0x7f5ad015c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.802+0000 7f5ad7b1c640 1 --2- 172.21.15.170:0/1168472023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad015c9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009e50 tx=0x7f5ac802a710 comp rx=0 tx=0).stop 2024-04-26T21:58:17.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.802+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1168472023 shutdown_connections 2024-04-26T21:58:17.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.802+0000 7f5ad7b1c640 1 --2- 172.21.15.170:0/1168472023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad015c9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.802+0000 7f5ad7b1c640 1 --2- 172.21.15.170:0/1168472023 >> v2:172.21.15.137:3300/0 conn(0x7f5ad00711a0 0x7f5ad00b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.802+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1168472023 >> 172.21.15.170:0/1168472023 conn(0x7f5ad00b3b60 msgr2=0x7f5ad00b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:17.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.802+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1168472023 shutdown_connections 2024-04-26T21:58:17.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.802+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1168472023 wait complete. 2024-04-26T21:58:17.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.803+0000 7f5ad7b1c640 1 Processor -- start 2024-04-26T21:58:17.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.803+0000 7f5ad7b1c640 1 -- start start 2024-04-26T21:58:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad7b1c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad00711a0 0x7f5ad0145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad7b1c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad0157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad7b1c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ad015c550 0x7f5ad014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad7b1c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad0073350 con 0x7f5ad00711a0 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad7b1c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad00b5d00 con 0x7f5ad015c550 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad7b1c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad00734d0 con 0x7f5ad00b6730 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad50b7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad50b7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad0157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:60400/0 (socket says 172.21.15.170:60400) 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad50b7640 1 -- 172.21.15.170:0/1795989476 learned_addr learned my addr 172.21.15.170:0/1795989476 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad60b9640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ad015c550 0x7f5ad014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.804+0000 7f5ad58b8640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad00711a0 0x7f5ad0145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad50b7640 1 -- 172.21.15.170:0/1795989476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ad015c550 msgr2=0x7f5ad014db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad50b7640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ad015c550 0x7f5ad014db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad50b7640 1 -- 172.21.15.170:0/1795989476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad00711a0 msgr2=0x7f5ad0145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad50b7640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad00711a0 0x7f5ad0145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad50b7640 1 -- 172.21.15.170:0/1795989476 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad015abf0 con 0x7f5ad00b6730 2024-04-26T21:58:17.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad60b9640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ad015c550 0x7f5ad014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad58b8640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad00711a0 0x7f5ad0145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad50b7640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad0157560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c480 tx=0x7f5acc00c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ac67fc640 1 -- 172.21.15.170:0/1795989476 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0052d0 con 0x7f5ad00b6730 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ac67fc640 1 -- 172.21.15.170:0/1795989476 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5acc005490 con 0x7f5ad00b6730 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1795989476 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad015aed0 con 0x7f5ad00b6730 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ac67fc640 1 -- 172.21.15.170:0/1795989476 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc003880 con 0x7f5ad00b6730 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1795989476 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad015b490 con 0x7f5ad00b6730 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ac67fc640 1 -- 172.21.15.170:0/1795989476 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5acc003a20 con 0x7f5ad00b6730 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.805+0000 7f5ac67fc640 1 -- 172.21.15.170:0/1795989476 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5acc01b8e0 con 0x7f5ad00b6730 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.806+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1795989476 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad00693d0 con 0x7f5ad00b6730 2024-04-26T21:58:17.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.808+0000 7f5ac67fc640 1 -- 172.21.15.170:0/1795989476 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5acc01b450 con 0x7f5ad00b6730 2024-04-26T21:58:17.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.879+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1795989476 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "48e0641a-7b85-4745-a1e5-ee936170edc5", "id": 3} v 0) -- 0x7f5ad00d1b30 con 0x7f5ad00b6730 2024-04-26T21:58:17.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.885+0000 7f5ac67fc640 1 -- 172.21.15.170:0/1795989476 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48e0641a-7b85-4745-a1e5-ee936170edc5", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5acc01b6f0 con 0x7f5ad00b6730 2024-04-26T21:58:17.885 INFO:teuthology.orchestra.run.smithi170.stdout:3 2024-04-26T21:58:17.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.886+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1795989476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 msgr2=0x7f5ad0157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.886+0000 7f5ad7b1c640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad0157560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c480 tx=0x7f5acc00c940 comp rx=0 tx=0).stop 2024-04-26T21:58:17.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.886+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1795989476 shutdown_connections 2024-04-26T21:58:17.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.886+0000 7f5ad7b1c640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ad015c550 0x7f5ad014db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.886+0000 7f5ad7b1c640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ad00b6730 0x7f5ad0157560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.886+0000 7f5ad7b1c640 1 --2- 172.21.15.170:0/1795989476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ad00711a0 0x7f5ad0145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.886+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1795989476 >> 172.21.15.170:0/1795989476 conn(0x7f5ad00b3b60 msgr2=0x7f5ad006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:17.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.886+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1795989476 shutdown_connections 2024-04-26T21:58:17.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.886+0000 7f5ad7b1c640 1 -- 172.21.15.170:0/1795989476 wait complete. 2024-04-26T21:58:17.896 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new d6197a0b-dd65-4cf7-a92c-349926f710ea 4 2024-04-26T21:58:17.922 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:17.922+0000 7f0257320040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T21:58:17.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.994+0000 7fbfc759e640 1 Processor -- start 2024-04-26T21:58:17.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.994+0000 7fbfc759e640 1 -- start start 2024-04-26T21:58:17.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc759e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbfc806f180 0x7fbfc81601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:17.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc759e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc80702c0 con 0x7fbfc8159b50 2024-04-26T21:58:17.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc759e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfc806f740 con 0x7fbfc80b4770 2024-04-26T21:58:17.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc759e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbfc80cdd80 con 0x7fbfc806f180 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc6d9d640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fbfc80b4770 0x7fbfc80b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:42446/0 (socket says 172.21.15.170:42446) 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc6d9d640 1 -- 172.21.15.170:0/43916433 learned_addr learned my addr 172.21.15.170:0/43916433 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc5d9b640 1 --2- 172.21.15.170:0/43916433 >> v2:172.21.15.137:3300/0 conn(0x7fbfc806f180 0x7fbfc81601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc559a640 1 -- 172.21.15.170:0/43916433 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991567112 0 0) 0x7fbfc806f740 con 0x7fbfc80b4770 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc559a640 1 -- 172.21.15.170:0/43916433 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfb0003520 con 0x7fbfc80b4770 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc559a640 1 -- 172.21.15.170:0/43916433 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606034032 0 0) 0x7fbfc80702c0 con 0x7fbfc8159b50 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc559a640 1 -- 172.21.15.170:0/43916433 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfc806f740 con 0x7fbfc8159b50 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc5d9b640 1 -- 172.21.15.170:0/43916433 >> v1:172.21.15.170:6789/0 conn(0x7fbfc80b4770 legacy=0x7fbfc80b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc5d9b640 1 -- 172.21.15.170:0/43916433 >> v1:172.21.15.137:6789/0 conn(0x7fbfc8159b50 legacy=0x7fbfc815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.995+0000 7fbfc5d9b640 1 -- 172.21.15.170:0/43916433 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc806fa20 con 0x7fbfc806f180 2024-04-26T21:58:17.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.996+0000 7fbfc5d9b640 1 --2- 172.21.15.170:0/43916433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfc806f180 0x7fbfc81601c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80097a0 tx=0x7fbfb802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bc9e8677a802b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:17.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.996+0000 7fbfc559a640 1 -- 172.21.15.170:0/43916433 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8037070 con 0x7fbfc806f180 2024-04-26T21:58:17.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.996+0000 7fbfc559a640 1 -- 172.21.15.170:0/43916433 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb8032440 con 0x7fbfc806f180 2024-04-26T21:58:17.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.996+0000 7fbfc559a640 1 -- 172.21.15.170:0/43916433 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8032810 con 0x7fbfc806f180 2024-04-26T21:58:17.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.997+0000 7fbfc759e640 1 -- 172.21.15.170:0/43916433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfc806f180 msgr2=0x7fbfc81601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:17.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.997+0000 7fbfc759e640 1 --2- 172.21.15.170:0/43916433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfc806f180 0x7fbfc81601c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80097a0 tx=0x7fbfb802a1a0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.997+0000 7fbfc759e640 1 -- 172.21.15.170:0/43916433 shutdown_connections 2024-04-26T21:58:17.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.997+0000 7fbfc759e640 1 --2- 172.21.15.170:0/43916433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfc806f180 0x7fbfc81601c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:17.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.997+0000 7fbfc759e640 1 -- 172.21.15.170:0/43916433 >> 172.21.15.170:0/43916433 conn(0x7fbfc80d13f0 msgr2=0x7fbfc80d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:17.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.997+0000 7fbfc759e640 1 -- 172.21.15.170:0/43916433 shutdown_connections 2024-04-26T21:58:17.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.997+0000 7fbfc759e640 1 -- 172.21.15.170:0/43916433 wait complete. 2024-04-26T21:58:17.998 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:17.997+0000 7fd681fea040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T21:58:18.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.998+0000 7fbfc759e640 1 Processor -- start 2024-04-26T21:58:18.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.998+0000 7fbfc759e640 1 -- start start 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc759e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfc806f180 0x7fbfc8158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc759e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc80b4770 0x7fbfc80afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc759e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfc8159b50 0x7fbfc806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc759e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc806ffe0 con 0x7fbfc806f180 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc759e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc8159f30 con 0x7fbfc80b4770 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc759e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbfc806db10 con 0x7fbfc8159b50 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc5d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc80b4770 0x7fbfc80afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc6d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfc8159b50 0x7fbfc806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc5d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc80b4770 0x7fbfc80afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43844/0 (socket says 172.21.15.170:43844) 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc5d9b640 1 -- 172.21.15.170:0/4285112390 learned_addr learned my addr 172.21.15.170:0/4285112390 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:17.999+0000 7fbfc659c640 1 --2- 172.21.15.170:0/4285112390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfc806f180 0x7fbfc8158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfc6d9d640 1 -- 172.21.15.170:0/4285112390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc80b4770 msgr2=0x7fbfc80afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfc6d9d640 1 --2- 172.21.15.170:0/4285112390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc80b4770 0x7fbfc80afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfc6d9d640 1 -- 172.21.15.170:0/4285112390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfc806f180 msgr2=0x7fbfc8158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfc6d9d640 1 --2- 172.21.15.170:0/4285112390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfc806f180 0x7fbfc8158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfc6d9d640 1 -- 172.21.15.170:0/4285112390 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc80c6b80 con 0x7fbfc8159b50 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfc5d9b640 1 --2- 172.21.15.170:0/4285112390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc80b4770 0x7fbfc80afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfc6d9d640 1 --2- 172.21.15.170:0/4285112390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfc8159b50 0x7fbfc806c2a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000caa0 tx=0x7fbfc000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfb6ffd640 1 -- 172.21.15.170:0/4285112390 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0017070 con 0x7fbfc8159b50 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfb6ffd640 1 -- 172.21.15.170:0/4285112390 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc000ac00 con 0x7fbfc8159b50 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfb6ffd640 1 -- 172.21.15.170:0/4285112390 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0012400 con 0x7fbfc8159b50 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfc759e640 1 -- 172.21.15.170:0/4285112390 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc80c65c0 con 0x7fbfc8159b50 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfc759e640 1 -- 172.21.15.170:0/4285112390 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc80b0100 con 0x7fbfc8159b50 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfb6ffd640 1 -- 172.21.15.170:0/4285112390 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbfc001a070 con 0x7fbfc8159b50 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.000+0000 7fbfb6ffd640 1 -- 172.21.15.170:0/4285112390 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fbfc001cc70 con 0x7fbfc8159b50 2024-04-26T21:58:18.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.001+0000 7fbfc759e640 1 -- 172.21.15.170:0/4285112390 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc8050730 con 0x7fbfc8159b50 2024-04-26T21:58:18.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.003+0000 7fbfb6ffd640 1 -- 172.21.15.170:0/4285112390 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbfc80c6b80 con 0x7fbfc8159b50 2024-04-26T21:58:18.009 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:18.009+0000 7f0257320040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T21:58:18.051 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:18.052+0000 7f0257320040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T21:58:18.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.075+0000 7fbfc759e640 1 -- 172.21.15.170:0/4285112390 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d6197a0b-dd65-4cf7-a92c-349926f710ea", "id": 4} v 0) -- 0x7fbfc8073690 con 0x7fbfc8159b50 2024-04-26T21:58:18.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.081+0000 7fbfb6ffd640 1 -- 172.21.15.170:0/4285112390 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6197a0b-dd65-4cf7-a92c-349926f710ea", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fbfc001c760 con 0x7fbfc8159b50 2024-04-26T21:58:18.081 INFO:teuthology.orchestra.run.smithi170.stdout:4 2024-04-26T21:58:18.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.082+0000 7fbfc759e640 1 -- 172.21.15.170:0/4285112390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfc8159b50 msgr2=0x7fbfc806c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.082+0000 7fbfc759e640 1 --2- 172.21.15.170:0/4285112390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfc8159b50 0x7fbfc806c2a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbfc000caa0 tx=0x7fbfc000cf60 comp rx=0 tx=0).stop 2024-04-26T21:58:18.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.082+0000 7fbfc759e640 1 -- 172.21.15.170:0/4285112390 shutdown_connections 2024-04-26T21:58:18.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.082+0000 7fbfc759e640 1 --2- 172.21.15.170:0/4285112390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbfc8159b50 0x7fbfc806c2a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.082+0000 7fbfc759e640 1 --2- 172.21.15.170:0/4285112390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfc80b4770 0x7fbfc80afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.082+0000 7fbfc759e640 1 --2- 172.21.15.170:0/4285112390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbfc806f180 0x7fbfc8158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.082+0000 7fbfc759e640 1 -- 172.21.15.170:0/4285112390 >> 172.21.15.170:0/4285112390 conn(0x7fbfc80d13f0 msgr2=0x7fbfc815ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:18.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.082+0000 7fbfc759e640 1 -- 172.21.15.170:0/4285112390 shutdown_connections 2024-04-26T21:58:18.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.082+0000 7fbfc759e640 1 -- 172.21.15.170:0/4285112390 wait complete. 2024-04-26T21:58:18.089 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:18.089+0000 7fd681fea040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T21:58:18.092 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new d5fb8513-8360-4aa0-aafe-471789c708c3 5 2024-04-26T21:58:18.135 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:18.135+0000 7fd681fea040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.190+0000 7f297df5f640 1 Processor -- start 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.190+0000 7f297df5f640 1 -- start start 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.190+0000 7f297df5f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f297815c550 0x7f297815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.190+0000 7f297df5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29780b6020 0x7f29780b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.190+0000 7f297df5f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2978071580 con 0x7f29780711a0 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.190+0000 7f297df5f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f29780b4fe0 con 0x7f297815c550 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.190+0000 7f297df5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f297815d070 con 0x7f29780b6020 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2976ffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f297815c550 0x7f297815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2977fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29780b6020 0x7f29780b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2977fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29780b6020 0x7f29780b64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:60418/0 (socket says 172.21.15.170:60418) 2024-04-26T21:58:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2977fff640 1 -- 172.21.15.170:0/3592590733 learned_addr learned my addr 172.21.15.170:0/3592590733 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2976ffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f297815c550 0x7f297815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43860/0 (socket says 172.21.15.170:43860) 2024-04-26T21:58:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2977fff640 1 -- 172.21.15.170:0/3592590733 >> v2:172.21.15.170:3300/0 conn(0x7f297815c550 msgr2=0x7f297815c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2977fff640 1 --2- 172.21.15.170:0/3592590733 >> v2:172.21.15.170:3300/0 conn(0x7f297815c550 0x7f297815c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2977fff640 1 -- 172.21.15.170:0/3592590733 >> v1:172.21.15.170:6789/0 conn(0x7f29780711a0 legacy=0x7f29780b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2977fff640 1 -- 172.21.15.170:0/3592590733 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297815d350 con 0x7f29780b6020 2024-04-26T21:58:18.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.191+0000 7f2976ffd640 1 --2- 172.21.15.170:0/3592590733 >> v2:172.21.15.170:3300/0 conn(0x7f297815c550 0x7f297815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f2977fff640 1 --2- 172.21.15.170:0/3592590733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29780b6020 0x7f29780b64b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2970009e50 tx=0x7f297002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b90d0a292a2233c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:18.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f29767fc640 1 -- 172.21.15.170:0/3592590733 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970036070 con 0x7f29780b6020 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f29767fc640 1 -- 172.21.15.170:0/3592590733 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2970031600 con 0x7f29780b6020 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f29767fc640 1 -- 172.21.15.170:0/3592590733 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29700319d0 con 0x7f29780b6020 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f297df5f640 1 -- 172.21.15.170:0/3592590733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29780b6020 msgr2=0x7f29780b64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f297df5f640 1 --2- 172.21.15.170:0/3592590733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29780b6020 0x7f29780b64b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2970009e50 tx=0x7f297002a710 comp rx=0 tx=0).stop 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f297df5f640 1 -- 172.21.15.170:0/3592590733 shutdown_connections 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f297df5f640 1 --2- 172.21.15.170:0/3592590733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29780b6020 0x7f29780b64b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f297df5f640 1 --2- 172.21.15.170:0/3592590733 >> v2:172.21.15.170:3300/0 conn(0x7f297815c550 0x7f297815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f297df5f640 1 -- 172.21.15.170:0/3592590733 >> 172.21.15.170:0/3592590733 conn(0x7f29780b3b60 msgr2=0x7f29780b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f297df5f640 1 -- 172.21.15.170:0/3592590733 shutdown_connections 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.192+0000 7f297df5f640 1 -- 172.21.15.170:0/3592590733 wait complete. 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.193+0000 7f297df5f640 1 Processor -- start 2024-04-26T21:58:18.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.194+0000 7f297df5f640 1 -- start start 2024-04-26T21:58:18.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.194+0000 7f297df5f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29780711a0 0x7f29781f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.194+0000 7f297df5f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29780b6020 0x7f2978151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.194+0000 7f297df5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f297815c550 0x7f297814ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.194+0000 7f297df5f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29780734d0 con 0x7f29780b6020 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.194+0000 7f297df5f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2978073350 con 0x7f29780711a0 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.194+0000 7f297df5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f297806f460 con 0x7f297815c550 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.194+0000 7f29777fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29780711a0 0x7f29781f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.194+0000 7f2977fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f297815c550 0x7f297814ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2977fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f297815c550 0x7f297814ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:60424/0 (socket says 172.21.15.170:60424) 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2977fff640 1 -- 172.21.15.170:0/2697436439 learned_addr learned my addr 172.21.15.170:0/2697436439 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2976ffd640 1 --2- 172.21.15.170:0/2697436439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29780b6020 0x7f2978151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2977fff640 1 -- 172.21.15.170:0/2697436439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29780711a0 msgr2=0x7f29781f8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2977fff640 1 --2- 172.21.15.170:0/2697436439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29780711a0 0x7f29781f8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2977fff640 1 -- 172.21.15.170:0/2697436439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29780b6020 msgr2=0x7f2978151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2977fff640 1 --2- 172.21.15.170:0/2697436439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29780b6020 0x7f2978151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2977fff640 1 -- 172.21.15.170:0/2697436439 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29781523d0 con 0x7f297815c550 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2976ffd640 1 --2- 172.21.15.170:0/2697436439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29780b6020 0x7f2978151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f2977fff640 1 --2- 172.21.15.170:0/2697436439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f297815c550 0x7f297814ed60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2970009e50 tx=0x7f2970004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f295ffff640 1 -- 172.21.15.170:0/2697436439 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970036050 con 0x7f297815c550 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f295ffff640 1 -- 172.21.15.170:0/2697436439 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2970042070 con 0x7f297815c550 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f297df5f640 1 -- 172.21.15.170:0/2697436439 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29781f84b0 con 0x7f297815c550 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f295ffff640 1 -- 172.21.15.170:0/2697436439 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970009510 con 0x7f297815c550 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f297df5f640 1 -- 172.21.15.170:0/2697436439 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29781520c0 con 0x7f297815c550 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f295ffff640 1 -- 172.21.15.170:0/2697436439 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2970007bd0 con 0x7f297815c550 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.195+0000 7f295ffff640 1 -- 172.21.15.170:0/2697436439 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f297003d450 con 0x7f297815c550 2024-04-26T21:58:18.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.196+0000 7f297df5f640 1 -- 172.21.15.170:0/2697436439 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29780d1320 con 0x7f297815c550 2024-04-26T21:58:18.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.198+0000 7f295ffff640 1 -- 172.21.15.170:0/2697436439 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2970047460 con 0x7f297815c550 2024-04-26T21:58:18.226 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:18.226+0000 7f0257320040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T21:58:18.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.271+0000 7f297df5f640 1 -- 172.21.15.170:0/2697436439 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d5fb8513-8360-4aa0-aafe-471789c708c3", "id": 5} v 0) -- 0x7f29781526b0 con 0x7f297815c550 2024-04-26T21:58:18.272 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:18.273+0000 7f0257320040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T21:58:18.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.276+0000 7f295ffff640 1 -- 172.21.15.170:0/2697436439 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5fb8513-8360-4aa0-aafe-471789c708c3", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f2970047640 con 0x7f297815c550 2024-04-26T21:58:18.276 INFO:teuthology.orchestra.run.smithi170.stdout:5 2024-04-26T21:58:18.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.277+0000 7f297df5f640 1 -- 172.21.15.170:0/2697436439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f297815c550 msgr2=0x7f297814ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.277+0000 7f297df5f640 1 --2- 172.21.15.170:0/2697436439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f297815c550 0x7f297814ed60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2970009e50 tx=0x7f2970004a40 comp rx=0 tx=0).stop 2024-04-26T21:58:18.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.277+0000 7f297df5f640 1 -- 172.21.15.170:0/2697436439 shutdown_connections 2024-04-26T21:58:18.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.277+0000 7f297df5f640 1 --2- 172.21.15.170:0/2697436439 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29780b6020 0x7f2978151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.277+0000 7f297df5f640 1 --2- 172.21.15.170:0/2697436439 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f297815c550 0x7f297814ed60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.277+0000 7f297df5f640 1 --2- 172.21.15.170:0/2697436439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29780711a0 0x7f29781f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.277+0000 7f297df5f640 1 -- 172.21.15.170:0/2697436439 >> 172.21.15.170:0/2697436439 conn(0x7f29780b3b60 msgr2=0x7f29780b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:18.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.277+0000 7f297df5f640 1 -- 172.21.15.170:0/2697436439 shutdown_connections 2024-04-26T21:58:18.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.277+0000 7f297df5f640 1 -- 172.21.15.170:0/2697436439 wait complete. 2024-04-26T21:58:18.288 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 518fb394-0254-4274-90ef-52a4339aa194 6 2024-04-26T21:58:18.309 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:18.310+0000 7fd681fea040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T21:58:18.325 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:18.325+0000 7f0257320040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T21:58:18.360 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:18.360+0000 7fd681fea040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T21:58:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.406+0000 7f040eaea640 1 Processor -- start 2024-04-26T21:58:18.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.406+0000 7f040eaea640 1 -- start start 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f040eaea640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f040806d2b0 0x7f04081602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f040eaea640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0408070e80 0x7f040806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f040eaea640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f040806dbd0 con 0x7f0408162e20 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f040eaea640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f040806f970 con 0x7f040806d2b0 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f040eaea640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04080aea50 con 0x7f0408070e80 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f0407fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0408070e80 0x7f040806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f0407fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0408070e80 0x7f040806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:60434/0 (socket says 172.21.15.170:60434) 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f0407fff640 1 -- 172.21.15.170:0/3489071256 learned_addr learned my addr 172.21.15.170:0/3489071256 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f040c886640 1 --2- 172.21.15.170:0/3489071256 >> v2:172.21.15.137:3300/0 conn(0x7f040806d2b0 0x7f04081602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f0407fff640 1 -- 172.21.15.170:0/3489071256 >> v2:172.21.15.137:3300/0 conn(0x7f040806d2b0 msgr2=0x7f04081602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:18.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f0407fff640 1 --2- 172.21.15.170:0/3489071256 >> v2:172.21.15.137:3300/0 conn(0x7f040806d2b0 0x7f04081602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f0407fff640 1 -- 172.21.15.170:0/3489071256 >> v1:172.21.15.137:6789/0 conn(0x7f0408162e20 legacy=0x7f04081632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.407+0000 7f0407fff640 1 -- 172.21.15.170:0/3489071256 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04080aed30 con 0x7f0408070e80 2024-04-26T21:58:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.408+0000 7f0407fff640 1 --2- 172.21.15.170:0/3489071256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0408070e80 0x7f040806d690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009870 tx=0x7f03f402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9d8e0ab53abd1f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.408+0000 7f04077fe640 1 -- 172.21.15.170:0/3489071256 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4037070 con 0x7f0408070e80 2024-04-26T21:58:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.408+0000 7f04077fe640 1 -- 172.21.15.170:0/3489071256 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f4032440 con 0x7f0408070e80 2024-04-26T21:58:18.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.408+0000 7f04077fe640 1 -- 172.21.15.170:0/3489071256 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4032810 con 0x7f0408070e80 2024-04-26T21:58:18.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.409+0000 7f040eaea640 1 -- 172.21.15.170:0/3489071256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0408070e80 msgr2=0x7f040806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.409+0000 7f040eaea640 1 --2- 172.21.15.170:0/3489071256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0408070e80 0x7f040806d690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009870 tx=0x7f03f402a270 comp rx=0 tx=0).stop 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.409+0000 7f040eaea640 1 -- 172.21.15.170:0/3489071256 shutdown_connections 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.409+0000 7f040eaea640 1 --2- 172.21.15.170:0/3489071256 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0408070e80 0x7f040806d690 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.409+0000 7f040eaea640 1 --2- 172.21.15.170:0/3489071256 >> v2:172.21.15.137:3300/0 conn(0x7f040806d2b0 0x7f04081602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.409+0000 7f040eaea640 1 -- 172.21.15.170:0/3489071256 >> 172.21.15.170:0/3489071256 conn(0x7f0408072900 msgr2=0x7f0408072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.409+0000 7f040eaea640 1 -- 172.21.15.170:0/3489071256 shutdown_connections 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.409+0000 7f040eaea640 1 -- 172.21.15.170:0/3489071256 wait complete. 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.410+0000 7f040eaea640 1 Processor -- start 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.410+0000 7f040eaea640 1 -- start start 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040eaea640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040806d2b0 0x7f04081f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040eaea640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0408070e80 0x7f0408154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040eaea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408162e20 0x7f04081f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040eaea640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04080b1090 con 0x7f0408162e20 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040eaea640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f04080af2f0 con 0x7f0408070e80 2024-04-26T21:58:18.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040eaea640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f040815d170 con 0x7f040806d2b0 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040c886640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040806d2b0 0x7f04081f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f0407fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0408070e80 0x7f0408154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040c886640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040806d2b0 0x7f04081f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:60440/0 (socket says 172.21.15.170:60440) 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040c886640 1 -- 172.21.15.170:0/2089146715 learned_addr learned my addr 172.21.15.170:0/2089146715 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040d087640 1 --2- 172.21.15.170:0/2089146715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408162e20 0x7f04081f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040c886640 1 -- 172.21.15.170:0/2089146715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0408070e80 msgr2=0x7f0408154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040c886640 1 --2- 172.21.15.170:0/2089146715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0408070e80 0x7f0408154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040c886640 1 -- 172.21.15.170:0/2089146715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408162e20 msgr2=0x7f04081f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040c886640 1 --2- 172.21.15.170:0/2089146715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408162e20 0x7f04081f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f040c886640 1 -- 172.21.15.170:0/2089146715 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04080d14e0 con 0x7f040806d2b0 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.411+0000 7f0407fff640 1 --2- 172.21.15.170:0/2089146715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0408070e80 0x7f0408154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.412+0000 7f040c886640 1 --2- 172.21.15.170:0/2089146715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040806d2b0 0x7f04081f8660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00e9e0 tx=0x7f03fc00eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:18.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.412+0000 7f04057fa640 1 -- 172.21.15.170:0/2089146715 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc017070 con 0x7f040806d2b0 2024-04-26T21:58:18.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.412+0000 7f04057fa640 1 -- 172.21.15.170:0/2089146715 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03fc00c9d0 con 0x7f040806d2b0 2024-04-26T21:58:18.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.412+0000 7f040eaea640 1 -- 172.21.15.170:0/2089146715 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04081f8d60 con 0x7f040806d2b0 2024-04-26T21:58:18.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.412+0000 7f04057fa640 1 -- 172.21.15.170:0/2089146715 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00cdc0 con 0x7f040806d2b0 2024-04-26T21:58:18.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.412+0000 7f040eaea640 1 -- 172.21.15.170:0/2089146715 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f04081f9320 con 0x7f040806d2b0 2024-04-26T21:58:18.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.412+0000 7f04057fa640 1 -- 172.21.15.170:0/2089146715 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03fc01a070 con 0x7f040806d2b0 2024-04-26T21:58:18.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.412+0000 7f04057fa640 1 -- 172.21.15.170:0/2089146715 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f03fc01cb80 con 0x7f040806d2b0 2024-04-26T21:58:18.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.413+0000 7f040eaea640 1 -- 172.21.15.170:0/2089146715 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04080693d0 con 0x7f040806d2b0 2024-04-26T21:58:18.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.415+0000 7f04057fa640 1 -- 172.21.15.170:0/2089146715 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f03fc01ce20 con 0x7f040806d2b0 2024-04-26T21:58:18.417 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:18.417+0000 7fd681fea040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T21:58:18.437 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:18.437+0000 7f0257320040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:58:18.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.487+0000 7f040eaea640 1 -- 172.21.15.170:0/2089146715 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "518fb394-0254-4274-90ef-52a4339aa194", "id": 6} v 0) -- 0x7f04080739c0 con 0x7f040806d2b0 2024-04-26T21:58:18.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.492+0000 7f04057fa640 1 -- 172.21.15.170:0/2089146715 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "518fb394-0254-4274-90ef-52a4339aa194", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f03fc01c780 con 0x7f040806d2b0 2024-04-26T21:58:18.492 INFO:teuthology.orchestra.run.smithi170.stdout:6 2024-04-26T21:58:18.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.493+0000 7f040eaea640 1 -- 172.21.15.170:0/2089146715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040806d2b0 msgr2=0x7f04081f8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.493+0000 7f040eaea640 1 --2- 172.21.15.170:0/2089146715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040806d2b0 0x7f04081f8660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00e9e0 tx=0x7f03fc00eea0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.493+0000 7f040eaea640 1 -- 172.21.15.170:0/2089146715 shutdown_connections 2024-04-26T21:58:18.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.493+0000 7f040eaea640 1 --2- 172.21.15.170:0/2089146715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0408162e20 0x7f04081f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.493+0000 7f040eaea640 1 --2- 172.21.15.170:0/2089146715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0408070e80 0x7f0408154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.493+0000 7f040eaea640 1 --2- 172.21.15.170:0/2089146715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040806d2b0 0x7f04081f8660 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.493+0000 7f040eaea640 1 -- 172.21.15.170:0/2089146715 >> 172.21.15.170:0/2089146715 conn(0x7f0408072900 msgr2=0x7f04080b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:18.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.493+0000 7f040eaea640 1 -- 172.21.15.170:0/2089146715 shutdown_connections 2024-04-26T21:58:18.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.493+0000 7f040eaea640 1 -- 172.21.15.170:0/2089146715 wait complete. 2024-04-26T21:58:18.505 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd 7 2024-04-26T21:58:18.536 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:18.536+0000 7fd681fea040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T21:58:18.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.603+0000 7f6216847640 1 Processor -- start 2024-04-26T21:58:18.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.603+0000 7f6216847640 1 -- start start 2024-04-26T21:58:18.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f6216847640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6210147fb0 0x7f621006c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f6216847640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62100b6e90 0x7f621006c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f6216847640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6210148390 con 0x7f62101638b0 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f6216847640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6210163e20 con 0x7f62100b6e90 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f6216847640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f62100b59f0 con 0x7f6210147fb0 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f620ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6210147fb0 0x7f621006c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f620ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6210147fb0 0x7f621006c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:60454/0 (socket says 172.21.15.170:60454) 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f620ffff640 1 -- 172.21.15.170:0/1038114819 learned_addr learned my addr 172.21.15.170:0/1038114819 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f6214de4640 1 --2- 172.21.15.170:0/1038114819 >> v2:172.21.15.137:3300/0 conn(0x7f62100b6e90 0x7f621006c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f620ffff640 1 -- 172.21.15.170:0/1038114819 >> v2:172.21.15.137:3300/0 conn(0x7f62100b6e90 msgr2=0x7f621006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f620ffff640 1 --2- 172.21.15.170:0/1038114819 >> v2:172.21.15.137:3300/0 conn(0x7f62100b6e90 0x7f621006c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f620ffff640 1 -- 172.21.15.170:0/1038114819 >> v1:172.21.15.137:6789/0 conn(0x7f62101638b0 legacy=0x7f6210073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f620ffff640 1 -- 172.21.15.170:0/1038114819 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621006fe90 con 0x7f6210147fb0 2024-04-26T21:58:18.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.604+0000 7f6214de4640 1 --2- 172.21.15.170:0/1038114819 >> v2:172.21.15.137:3300/0 conn(0x7f62100b6e90 0x7f621006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.605+0000 7f620ffff640 1 --2- 172.21.15.170:0/1038114819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6210147fb0 0x7f621006c2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f62000098a0 tx=0x7f620002a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=228f7d91eabc674e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.605+0000 7f620effd640 1 -- 172.21.15.170:0/1038114819 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200037070 con 0x7f6210147fb0 2024-04-26T21:58:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.605+0000 7f620effd640 1 -- 172.21.15.170:0/1038114819 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6200032440 con 0x7f6210147fb0 2024-04-26T21:58:18.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.605+0000 7f620effd640 1 -- 172.21.15.170:0/1038114819 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200032810 con 0x7f6210147fb0 2024-04-26T21:58:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.606+0000 7f6216847640 1 -- 172.21.15.170:0/1038114819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6210147fb0 msgr2=0x7f621006c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.606+0000 7f6216847640 1 --2- 172.21.15.170:0/1038114819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6210147fb0 0x7f621006c2a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f62000098a0 tx=0x7f620002a200 comp rx=0 tx=0).stop 2024-04-26T21:58:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.606+0000 7f6216847640 1 -- 172.21.15.170:0/1038114819 shutdown_connections 2024-04-26T21:58:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.606+0000 7f6216847640 1 --2- 172.21.15.170:0/1038114819 >> v2:172.21.15.137:3300/0 conn(0x7f62100b6e90 0x7f621006c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.606+0000 7f6216847640 1 --2- 172.21.15.170:0/1038114819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6210147fb0 0x7f621006c2a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.606+0000 7f6216847640 1 -- 172.21.15.170:0/1038114819 >> 172.21.15.170:0/1038114819 conn(0x7f62100d1e90 msgr2=0x7f62100d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:18.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.606+0000 7f6216847640 1 -- 172.21.15.170:0/1038114819 shutdown_connections 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.606+0000 7f6216847640 1 -- 172.21.15.170:0/1038114819 wait complete. 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.607+0000 7f6216847640 1 Processor -- start 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.607+0000 7f6216847640 1 -- start start 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f6216847640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62100b6e90 0x7f6210133670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f6216847640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6210147fb0 0x7f62101eb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f6216847640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62101638b0 0x7f62101eb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f6216847640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6210148cd0 con 0x7f6210147fb0 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f6216847640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6210070450 con 0x7f62101638b0 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f6216847640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6210148e50 con 0x7f62100b6e90 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62100b6e90 0x7f6210133670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62100b6e90 0x7f6210133670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.170:60468/0 (socket says 172.21.15.170:60468) 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620ffff640 1 -- 172.21.15.170:0/2092239759 learned_addr learned my addr 172.21.15.170:0/2092239759 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f6214de4640 1 --2- 172.21.15.170:0/2092239759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62101638b0 0x7f62101eb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620f7fe640 1 --2- 172.21.15.170:0/2092239759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6210147fb0 0x7f62101eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620ffff640 1 -- 172.21.15.170:0/2092239759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62101638b0 msgr2=0x7f62101eb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620ffff640 1 --2- 172.21.15.170:0/2092239759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62101638b0 0x7f62101eb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620ffff640 1 -- 172.21.15.170:0/2092239759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6210147fb0 msgr2=0x7f62101eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620ffff640 1 --2- 172.21.15.170:0/2092239759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6210147fb0 0x7f62101eb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620ffff640 1 -- 172.21.15.170:0/2092239759 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100b27a0 con 0x7f62100b6e90 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620ffff640 1 --2- 172.21.15.170:0/2092239759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62100b6e90 0x7f6210133670 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6200000c00 tx=0x7f62000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620cff9640 1 -- 172.21.15.170:0/2092239759 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200041020 con 0x7f62100b6e90 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620cff9640 1 -- 172.21.15.170:0/2092239759 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62000306c0 con 0x7f62100b6e90 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f6216847640 1 -- 172.21.15.170:0/2092239759 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62101e8ce0 con 0x7f62100b6e90 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f620cff9640 1 -- 172.21.15.170:0/2092239759 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200037040 con 0x7f62100b6e90 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.608+0000 7f6216847640 1 -- 172.21.15.170:0/2092239759 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f62100cfb60 con 0x7f62100b6e90 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.609+0000 7f620cff9640 1 -- 172.21.15.170:0/2092239759 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6200044020 con 0x7f62100b6e90 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.609+0000 7f620cff9640 1 -- 172.21.15.170:0/2092239759 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f620003dc80 con 0x7f62100b6e90 2024-04-26T21:58:18.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.609+0000 7f6216847640 1 -- 172.21.15.170:0/2092239759 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62100693d0 con 0x7f62100b6e90 2024-04-26T21:58:18.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.611+0000 7f620cff9640 1 -- 172.21.15.170:0/2092239759 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f620004b030 con 0x7f62100b6e90 2024-04-26T21:58:18.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.683+0000 7f6216847640 1 -- 172.21.15.170:0/2092239759 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd", "id": 7} v 0) -- 0x7f6210069cc0 con 0x7f62100b6e90 2024-04-26T21:58:18.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.688+0000 7f620cff9640 1 -- 172.21.15.170:0/2092239759 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f62100b27a0 con 0x7f62100b6e90 2024-04-26T21:58:18.688 INFO:teuthology.orchestra.run.smithi170.stdout:7 2024-04-26T21:58:18.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.689+0000 7f6216847640 1 -- 172.21.15.170:0/2092239759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62100b6e90 msgr2=0x7f6210133670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.689+0000 7f6216847640 1 --2- 172.21.15.170:0/2092239759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62100b6e90 0x7f6210133670 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6200000c00 tx=0x7f62000046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.689+0000 7f6216847640 1 -- 172.21.15.170:0/2092239759 shutdown_connections 2024-04-26T21:58:18.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.689+0000 7f6216847640 1 --2- 172.21.15.170:0/2092239759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6210147fb0 0x7f62101eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.689+0000 7f6216847640 1 --2- 172.21.15.170:0/2092239759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62101638b0 0x7f62101eb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.689+0000 7f6216847640 1 --2- 172.21.15.170:0/2092239759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62100b6e90 0x7f6210133670 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.689+0000 7f6216847640 1 -- 172.21.15.170:0/2092239759 >> 172.21.15.170:0/2092239759 conn(0x7f62100d1e90 msgr2=0x7f62100b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:18.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.689+0000 7f6216847640 1 -- 172.21.15.170:0/2092239759 shutdown_connections 2024-04-26T21:58:18.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:58:18.689+0000 7f6216847640 1 -- 172.21.15.170:0/2092239759 wait complete. 2024-04-26T21:58:18.699 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T21:58:18.700 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T21:58:18.702 INFO:tasks.ceph.osd.0:Started 2024-04-26T21:58:18.702 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T21:58:18.702 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T21:58:18.706 INFO:tasks.ceph.osd.1:Started 2024-04-26T21:58:18.706 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T21:58:18.706 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T21:58:18.708 INFO:tasks.ceph.osd.2:Started 2024-04-26T21:58:18.708 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T21:58:18.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T21:58:18.710 INFO:tasks.ceph.osd.3:Started 2024-04-26T21:58:18.711 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T21:58:18.711 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T21:58:18.742 INFO:tasks.ceph.osd.4:Started 2024-04-26T21:58:18.742 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T21:58:18.742 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T21:58:18.744 INFO:tasks.ceph.osd.5:Started 2024-04-26T21:58:18.744 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T21:58:18.744 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T21:58:18.746 INFO:tasks.ceph.osd.6:Started 2024-04-26T21:58:18.746 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T21:58:18.747 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T21:58:18.749 INFO:tasks.ceph.osd.7:Started 2024-04-26T21:58:18.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:18.850 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:18.850+0000 7f0257320040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T21:58:18.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.859+0000 7f2a5ba62640 1 Processor -- start 2024-04-26T21:58:18.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.860+0000 7f2a5ba62640 1 -- start start 2024-04-26T21:58:18.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a5ba62640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2a54073a30 0x7f2a54073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a5ba62640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2a54154f70 0x7f2a541553c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a5ba62640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a5406ec90 con 0x7f2a540cff80 2024-04-26T21:58:18.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a5ba62640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5406fd30 con 0x7f2a54073a30 2024-04-26T21:58:18.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a5ba62640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5406ea30 con 0x7f2a54154f70 2024-04-26T21:58:18.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a58ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2a54073a30 0x7f2a54073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a58ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2a54073a30 0x7f2a54073eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46772/0 (socket says 172.21.15.137:46772) 2024-04-26T21:58:18.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a58ffd640 1 -- 172.21.15.137:0/2996071173 learned_addr learned my addr 172.21.15.137:0/2996071173 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:18.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a59fff640 1 --2- 172.21.15.137:0/2996071173 >> v2:172.21.15.170:3300/0 conn(0x7f2a54154f70 0x7f2a541553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a58ffd640 1 -- 172.21.15.137:0/2996071173 >> v2:172.21.15.170:3300/0 conn(0x7f2a54154f70 msgr2=0x7f2a541553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:18.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a58ffd640 1 --2- 172.21.15.137:0/2996071173 >> v2:172.21.15.170:3300/0 conn(0x7f2a54154f70 0x7f2a541553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a58ffd640 1 -- 172.21.15.137:0/2996071173 >> v1:172.21.15.170:6789/0 conn(0x7f2a540cff80 legacy=0x7f2a5406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.861+0000 7f2a58ffd640 1 -- 172.21.15.137:0/2996071173 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5406ef70 con 0x7f2a54073a30 2024-04-26T21:58:18.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.862+0000 7f2a58ffd640 1 --2- 172.21.15.137:0/2996071173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 0x7f2a54073eb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2a54074610 tx=0x7f2a5002b2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb8f51192e29083 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:18.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.862+0000 7f2a4bfff640 1 -- 172.21.15.137:0/2996071173 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a500089e0 con 0x7f2a54073a30 2024-04-26T21:58:18.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.862+0000 7f2a4bfff640 1 -- 172.21.15.137:0/2996071173 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a50008b80 con 0x7f2a54073a30 2024-04-26T21:58:18.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.862+0000 7f2a4bfff640 1 -- 172.21.15.137:0/2996071173 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5000a0d0 con 0x7f2a54073a30 2024-04-26T21:58:18.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.863+0000 7f2a5ba62640 1 -- 172.21.15.137:0/2996071173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 msgr2=0x7f2a54073eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.863+0000 7f2a5ba62640 1 --2- 172.21.15.137:0/2996071173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 0x7f2a54073eb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2a54074610 tx=0x7f2a5002b2a0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.863+0000 7f2a5ba62640 1 -- 172.21.15.137:0/2996071173 shutdown_connections 2024-04-26T21:58:18.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.863+0000 7f2a5ba62640 1 --2- 172.21.15.137:0/2996071173 >> v2:172.21.15.170:3300/0 conn(0x7f2a54154f70 0x7f2a541553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.863+0000 7f2a5ba62640 1 --2- 172.21.15.137:0/2996071173 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 0x7f2a54073eb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.863+0000 7f2a5ba62640 1 -- 172.21.15.137:0/2996071173 >> 172.21.15.137:0/2996071173 conn(0x7f2a540d0d30 msgr2=0x7f2a540d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:18.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.863+0000 7f2a5ba62640 1 -- 172.21.15.137:0/2996071173 shutdown_connections 2024-04-26T21:58:18.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.863+0000 7f2a5ba62640 1 -- 172.21.15.137:0/2996071173 wait complete. 2024-04-26T21:58:18.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.864+0000 7f2a5ba62640 1 Processor -- start 2024-04-26T21:58:18.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.864+0000 7f2a5ba62640 1 -- start start 2024-04-26T21:58:18.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a5ba62640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 0x7f2a541f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a5ba62640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a540cff80 0x7f2a540abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a5ba62640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a54154f70 0x7f2a540ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a5ba62640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5406f810 con 0x7f2a54073a30 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a5ba62640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5406f530 con 0x7f2a54154f70 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a5ba62640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2a540d0360 con 0x7f2a540cff80 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a597fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 0x7f2a541f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a597fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 0x7f2a541f3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46776/0 (socket says 172.21.15.137:46776) 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a597fe640 1 -- 172.21.15.137:0/892154105 learned_addr learned my addr 172.21.15.137:0/892154105 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a59fff640 1 --2- 172.21.15.137:0/892154105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a54154f70 0x7f2a540ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a58ffd640 1 --2- 172.21.15.137:0/892154105 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a540cff80 0x7f2a540abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a597fe640 1 -- 172.21.15.137:0/892154105 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a540cff80 msgr2=0x7f2a540abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a597fe640 1 --2- 172.21.15.137:0/892154105 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a540cff80 0x7f2a540abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a597fe640 1 -- 172.21.15.137:0/892154105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a54154f70 msgr2=0x7f2a540ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a597fe640 1 --2- 172.21.15.137:0/892154105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a54154f70 0x7f2a540ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a597fe640 1 -- 172.21.15.137:0/892154105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a541f4180 con 0x7f2a54073a30 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a597fe640 1 --2- 172.21.15.137:0/892154105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 0x7f2a541f3c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400e700 tx=0x7f2a4400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a49ffb640 1 -- 172.21.15.137:0/892154105 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a440052d0 con 0x7f2a54073a30 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a49ffb640 1 -- 172.21.15.137:0/892154105 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a44005470 con 0x7f2a54073a30 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a5ba62640 1 -- 172.21.15.137:0/892154105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a54156080 con 0x7f2a54073a30 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.865+0000 7f2a49ffb640 1 -- 172.21.15.137:0/892154105 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400cca0 con 0x7f2a54073a30 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.866+0000 7f2a5ba62640 1 -- 172.21.15.137:0/892154105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a54156640 con 0x7f2a54073a30 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.866+0000 7f2a49ffb640 1 -- 172.21.15.137:0/892154105 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2a440035f0 con 0x7f2a54073a30 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.866+0000 7f2a49ffb640 1 -- 172.21.15.137:0/892154105 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2a44003ac0 con 0x7f2a54073a30 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.866+0000 7f2a5ba62640 1 -- 172.21.15.137:0/892154105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a54159c60 con 0x7f2a54073a30 2024-04-26T21:58:18.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.869+0000 7f2a49ffb640 1 -- 172.21.15.137:0/892154105 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f2a54159c60 con 0x7f2a54073a30 2024-04-26T21:58:18.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.929+0000 7f2a5ba62640 1 -- 172.21.15.137:0/892154105 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a540d0ac0 con 0x7f2a54073a30 2024-04-26T21:58:18.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.930+0000 7f2a49ffb640 1 -- 172.21.15.137:0/892154105 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2a540d0ac0 con 0x7f2a54073a30 2024-04-26T21:58:18.930 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:18.930 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":10,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:18.685240+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:18.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.931+0000 7f2a5ba62640 1 -- 172.21.15.137:0/892154105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 msgr2=0x7f2a541f3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:18.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.931+0000 7f2a5ba62640 1 --2- 172.21.15.137:0/892154105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 0x7f2a541f3c40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400e700 tx=0x7f2a4400ebc0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.931+0000 7f2a5ba62640 1 -- 172.21.15.137:0/892154105 shutdown_connections 2024-04-26T21:58:18.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.931+0000 7f2a5ba62640 1 --2- 172.21.15.137:0/892154105 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a54154f70 0x7f2a540ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.931+0000 7f2a5ba62640 1 --2- 172.21.15.137:0/892154105 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2a540cff80 0x7f2a540abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.931+0000 7f2a5ba62640 1 --2- 172.21.15.137:0/892154105 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2a54073a30 0x7f2a541f3c40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:18.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.931+0000 7f2a5ba62640 1 -- 172.21.15.137:0/892154105 >> 172.21.15.137:0/892154105 conn(0x7f2a540d0d30 msgr2=0x7f2a54158840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:18.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.931+0000 7f2a5ba62640 1 -- 172.21.15.137:0/892154105 shutdown_connections 2024-04-26T21:58:18.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:18.931+0000 7f2a5ba62640 1 -- 172.21.15.137:0/892154105 wait complete. 2024-04-26T21:58:18.942 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T21:58:18.942 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T21:58:18.956 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:18.956+0000 7fd681fea040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T21:58:19.117 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:19.117+0000 7f0257320040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T21:58:19.169 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:19.169+0000 7f0257320040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T21:58:19.214 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:19.215+0000 7fd681fea040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T21:58:19.266 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:19.266+0000 7fd681fea040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T21:58:19.284 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:19.284+0000 7f0257320040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T21:58:19.303 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-04-26T21:58:19.303+0000 7f083b818640 -1 Falling back to public interface 2024-04-26T21:58:19.318 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-04-26T21:58:19.319+0000 7f97a6bfc640 -1 Falling back to public interface 2024-04-26T21:58:19.327 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-04-26T21:58:19.327+0000 7f8dd9e16640 -1 Falling back to public interface 2024-04-26T21:58:19.328 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-04-26T21:58:19.328+0000 7fd24a3da640 -1 Falling back to public interface 2024-04-26T21:58:19.340 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-26T21:58:19.340+0000 7f5405d53640 -1 Falling back to public interface 2024-04-26T21:58:19.345 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-26T21:58:19.345+0000 7fd32f8df640 -1 Falling back to public interface 2024-04-26T21:58:19.357 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-26T21:58:19.358+0000 7f733c618640 -1 Falling back to public interface 2024-04-26T21:58:19.374 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-26T21:58:19.374+0000 7f0216944640 -1 Falling back to public interface 2024-04-26T21:58:19.384 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:19.384+0000 7fd681fea040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T21:58:19.571 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:19.571+0000 7f0257320040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T21:58:19.621 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:19.621+0000 7f0257320040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T21:58:19.664 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:19.664+0000 7fd681fea040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T21:58:19.711 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:19.711+0000 7fd681fea040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T21:58:19.748 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:19.779 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:19.779+0000 7f0257320040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T21:58:19.838 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.838+0000 7fb927469640 1 Processor -- start 2024-04-26T21:58:19.838 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.838+0000 7fb927469640 1 -- start start 2024-04-26T21:58:19.840 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb927469640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb9200740c0 0x7fb9200b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:19.840 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb927469640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb920074540 0x7fb9200706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:19.840 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb927469640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb920073340 con 0x7fb92006c2b0 2024-04-26T21:58:19.840 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb927469640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb920073c30 con 0x7fb9200740c0 2024-04-26T21:58:19.840 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb927469640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb9200735e0 con 0x7fb920074540 2024-04-26T21:58:19.840 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb925a06640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb920074540 0x7fb9200706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:19.840 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb925205640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb92006c2b0 0x7fb92006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:55552/0 (socket says 172.21.15.137:55552) 2024-04-26T21:58:19.840 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb925205640 1 -- 172.21.15.137:0/1238846478 learned_addr learned my addr 172.21.15.137:0/1238846478 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:19.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb924a04640 1 --2- 172.21.15.137:0/1238846478 >> v2:172.21.15.170:3300/0 conn(0x7fb9200740c0 0x7fb9200b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:19.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb917fff640 1 -- 172.21.15.137:0/1238846478 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22704179 0 0) 0x7fb920073340 con 0x7fb92006c2b0 2024-04-26T21:58:19.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb917fff640 1 -- 172.21.15.137:0/1238846478 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb90c003520 con 0x7fb92006c2b0 2024-04-26T21:58:19.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.839+0000 7fb925a06640 1 -- 172.21.15.137:0/1238846478 >> v2:172.21.15.170:3300/0 conn(0x7fb9200740c0 msgr2=0x7fb9200b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:19.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.840+0000 7fb925a06640 1 --2- 172.21.15.137:0/1238846478 >> v2:172.21.15.170:3300/0 conn(0x7fb9200740c0 0x7fb9200b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:19.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.840+0000 7fb925a06640 1 -- 172.21.15.137:0/1238846478 >> v1:172.21.15.170:6789/0 conn(0x7fb92006c2b0 legacy=0x7fb92006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:19.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.840+0000 7fb925a06640 1 -- 172.21.15.137:0/1238846478 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9200738c0 con 0x7fb920074540 2024-04-26T21:58:19.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.840+0000 7fb925a06640 1 --2- 172.21.15.137:0/1238846478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb920074540 0x7fb9200706b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb918009d90 tx=0x7fb91802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=721853d2edeef145 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:19.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.840+0000 7fb917fff640 1 -- 172.21.15.137:0/1238846478 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918031600 con 0x7fb920074540 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.840+0000 7fb917fff640 1 -- 172.21.15.137:0/1238846478 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9180317a0 con 0x7fb920074540 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.840+0000 7fb917fff640 1 -- 172.21.15.137:0/1238846478 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918031b50 con 0x7fb920074540 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.841+0000 7fb927469640 1 -- 172.21.15.137:0/1238846478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb920074540 msgr2=0x7fb9200706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.841+0000 7fb927469640 1 --2- 172.21.15.137:0/1238846478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb920074540 0x7fb9200706b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb918009d90 tx=0x7fb91802a5d0 comp rx=0 tx=0).stop 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.841+0000 7fb927469640 1 -- 172.21.15.137:0/1238846478 shutdown_connections 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.841+0000 7fb927469640 1 --2- 172.21.15.137:0/1238846478 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb920074540 0x7fb9200706b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.841+0000 7fb927469640 1 --2- 172.21.15.137:0/1238846478 >> v2:172.21.15.170:3300/0 conn(0x7fb9200740c0 0x7fb9200b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.841+0000 7fb927469640 1 -- 172.21.15.137:0/1238846478 >> 172.21.15.137:0/1238846478 conn(0x7fb9200b3cb0 msgr2=0x7fb9200b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.841+0000 7fb927469640 1 -- 172.21.15.137:0/1238846478 shutdown_connections 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.841+0000 7fb927469640 1 -- 172.21.15.137:0/1238846478 wait complete. 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.842+0000 7fb927469640 1 Processor -- start 2024-04-26T21:58:19.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.842+0000 7fb927469640 1 -- start start 2024-04-26T21:58:19.846 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb927469640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006c2b0 0x7fb9200b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:19.846 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb927469640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200740c0 0x7fb9200b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:19.846 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb927469640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb920074540 0x7fb9200b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:19.846 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb927469640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200b5ee0 con 0x7fb9200740c0 2024-04-26T21:58:19.846 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb927469640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200b5d60 con 0x7fb920074540 2024-04-26T21:58:19.846 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb927469640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb920148da0 con 0x7fb92006c2b0 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb924a04640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200740c0 0x7fb9200b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb924a04640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200740c0 0x7fb9200b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46784/0 (socket says 172.21.15.137:46784) 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb924a04640 1 -- 172.21.15.137:0/1247468171 learned_addr learned my addr 172.21.15.137:0/1247468171 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb925205640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006c2b0 0x7fb9200b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb925a06640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb920074540 0x7fb9200b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb925205640 1 -- 172.21.15.137:0/1247468171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb920074540 msgr2=0x7fb9200b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb925205640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb920074540 0x7fb9200b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb925205640 1 -- 172.21.15.137:0/1247468171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200740c0 msgr2=0x7fb9200b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb925205640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200740c0 0x7fb9200b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb925205640 1 -- 172.21.15.137:0/1247468171 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9200b25f0 con 0x7fb92006c2b0 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.843+0000 7fb924a04640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200740c0 0x7fb9200b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.844+0000 7fb925205640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006c2b0 0x7fb9200b2f40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb91000c3c0 tx=0x7fb910001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.844+0000 7fb915ffb640 1 -- 172.21.15.137:0/1247468171 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910017070 con 0x7fb92006c2b0 2024-04-26T21:58:19.847 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.844+0000 7fb915ffb640 1 -- 172.21.15.137:0/1247468171 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb910005ce0 con 0x7fb92006c2b0 2024-04-26T21:58:19.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.844+0000 7fb927469640 1 -- 172.21.15.137:0/1247468171 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9200b0d70 con 0x7fb92006c2b0 2024-04-26T21:58:19.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.844+0000 7fb915ffb640 1 -- 172.21.15.137:0/1247468171 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910007310 con 0x7fb92006c2b0 2024-04-26T21:58:19.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.844+0000 7fb915ffb640 1 -- 172.21.15.137:0/1247468171 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb91001a070 con 0x7fb92006c2b0 2024-04-26T21:58:19.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.844+0000 7fb927469640 1 -- 172.21.15.137:0/1247468171 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9200b12f0 con 0x7fb92006c2b0 2024-04-26T21:58:19.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.844+0000 7fb915ffb640 1 -- 172.21.15.137:0/1247468171 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb9100074b0 con 0x7fb92006c2b0 2024-04-26T21:58:19.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.845+0000 7fb927469640 1 -- 172.21.15.137:0/1247468171 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb920076870 con 0x7fb92006c2b0 2024-04-26T21:58:19.848 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.847+0000 7fb915ffb640 1 -- 172.21.15.137:0/1247468171 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb9100076b0 con 0x7fb92006c2b0 2024-04-26T21:58:19.866 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:19.866+0000 7fd681fea040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T21:58:19.909 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.909+0000 7fb927469640 1 -- 172.21.15.137:0/1247468171 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9200b3a90 con 0x7fb92006c2b0 2024-04-26T21:58:19.909 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.910+0000 7fb915ffb640 1 -- 172.21.15.137:0/1247468171 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb910012400 con 0x7fb92006c2b0 2024-04-26T21:58:19.910 INFO:teuthology.misc.health.smithi137.stdout: 2024-04-26T21:58:19.910 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":10,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:18.685240+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:19.911 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.911+0000 7fb927469640 1 -- 172.21.15.137:0/1247468171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006c2b0 msgr2=0x7fb9200b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:19.911 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.911+0000 7fb927469640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006c2b0 0x7fb9200b2f40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb91000c3c0 tx=0x7fb910001e70 comp rx=0 tx=0).stop 2024-04-26T21:58:19.911 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.911+0000 7fb927469640 1 -- 172.21.15.137:0/1247468171 shutdown_connections 2024-04-26T21:58:19.911 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.911+0000 7fb927469640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200740c0 0x7fb9200b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:19.911 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.911+0000 7fb927469640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb920074540 0x7fb9200b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:19.911 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.911+0000 7fb927469640 1 --2- 172.21.15.137:0/1247468171 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006c2b0 0x7fb9200b2f40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:19.911 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.911+0000 7fb927469640 1 -- 172.21.15.137:0/1247468171 >> 172.21.15.137:0/1247468171 conn(0x7fb9200b3cb0 msgr2=0x7fb92015f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:19.911 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.911+0000 7fb927469640 1 -- 172.21.15.137:0/1247468171 shutdown_connections 2024-04-26T21:58:19.911 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:19.911+0000 7fb927469640 1 -- 172.21.15.137:0/1247468171 wait complete. 2024-04-26T21:58:19.920 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T21:58:19.923 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:19.923+0000 7f0257320040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T21:58:19.974 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:19.974+0000 7f0257320040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T21:58:20.004 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:20.004+0000 7fd681fea040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T21:58:20.043 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:20.043+0000 7f0257320040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T21:58:20.053 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:20.053+0000 7fd681fea040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T21:58:20.087 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:20.087+0000 7f0257320040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T21:58:20.122 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:20.123+0000 7fd681fea040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T21:58:20.169 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:20.169+0000 7fd681fea040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T21:58:20.566 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:20.566+0000 7f0257320040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T21:58:20.646 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:20.646+0000 7fd681fea040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T21:58:20.683 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:20.683+0000 7f0257320040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T21:58:20.767 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-26T21:58:20.767+0000 7fd681fea040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T21:58:21.698 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:21.698+0000 7f01f7495640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T21:58:21.698 INFO:tasks.ceph.mgr.y.smithi137.stderr:2024-04-26T21:58:21.698+0000 7f01f7495640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T21:58:22.765 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-04-26T21:58:22.765+0000 7f083b818640 -1 osd.1 0 log_to_monitors true 2024-04-26T21:58:22.806 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-26T21:58:22.805+0000 7f5405d53640 -1 osd.6 0 log_to_monitors true 2024-04-26T21:58:22.811 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-04-26T21:58:22.811+0000 7f97a6bfc640 -1 osd.3 0 log_to_monitors true 2024-04-26T21:58:22.830 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-26T21:58:22.830+0000 7fd32f8df640 -1 osd.5 0 log_to_monitors true 2024-04-26T21:58:22.858 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-04-26T21:58:22.858+0000 7f8dd9e16640 -1 osd.2 0 log_to_monitors true 2024-04-26T21:58:22.865 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-04-26T21:58:22.865+0000 7fd24a3da640 -1 osd.0 0 log_to_monitors true 2024-04-26T21:58:22.872 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-26T21:58:22.871+0000 7f733c618640 -1 osd.7 0 log_to_monitors true 2024-04-26T21:58:22.875 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-26T21:58:22.874+0000 7f0216944640 -1 osd.4 0 log_to_monitors true 2024-04-26T21:58:26.160 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-26T21:58:26.159+0000 7f7337f80640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T21:58:26.169 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-26T21:58:26.169+0000 7f5401ce9640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T21:58:26.171 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-26T21:58:26.171+0000 7f02130ee640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T21:58:26.172 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-26T21:58:26.172+0000 7f732fda0640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:58:26.182 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-26T21:58:26.182+0000 7f53f9b09640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:58:26.184 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-26T21:58:26.184+0000 7f020a6fa640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:58:26.194 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-26T21:58:26.193+0000 7fd32b875640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T21:58:26.206 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-26T21:58:26.206+0000 7fd323695640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:58:26.726 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:26.767 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-04-26T21:58:26.767+0000 7f97a2b92640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T21:58:26.773 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-04-26T21:58:26.774+0000 7fd246370640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T21:58:26.778 INFO:tasks.ceph.osd.3.smithi137.stderr:2024-04-26T21:58:26.778+0000 7f979a9b2640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:58:26.780 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-04-26T21:58:26.780+0000 7f8dd57e7640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T21:58:26.784 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-04-26T21:58:26.784+0000 7f08371e7640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T21:58:26.786 INFO:tasks.ceph.osd.0.smithi137.stderr:2024-04-26T21:58:26.786+0000 7fd23e190640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:58:26.792 INFO:tasks.ceph.osd.2.smithi137.stderr:2024-04-26T21:58:26.793+0000 7f8dcd607640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:58:26.798 INFO:tasks.ceph.osd.1.smithi137.stderr:2024-04-26T21:58:26.798+0000 7f082f007640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T21:58:26.835 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.835+0000 7f824aec8640 1 Processor -- start 2024-04-26T21:58:26.835 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.835+0000 7f824aec8640 1 -- start start 2024-04-26T21:58:26.836 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f824aec8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8244146550 0x7f8244073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:26.836 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f824aec8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f82440706b0 0x7f8244160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:26.836 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f824aec8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f82440b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f824aec8640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f82441611f0 con 0x7f82440706b0 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f824aec8640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8244070b40 con 0x7f8244146550 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f824aec8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f82440d08d0 con 0x7f82440b3ff0 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8243fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f82440706b0 0x7f8244160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8243fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f82440706b0 0x7f8244160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59634/0 (socket says 172.21.15.137:59634) 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8243fff640 1 -- 172.21.15.137:0/3987614229 learned_addr learned my addr 172.21.15.137:0/3987614229 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8249465640 1 --2- 172.21.15.137:0/3987614229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f82440b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8248c64640 1 --2- 172.21.15.137:0/3987614229 >> v2:172.21.15.170:3300/0 conn(0x7f8244146550 0x7f8244073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8243fff640 1 -- 172.21.15.137:0/3987614229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 msgr2=0x7f82440b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8243fff640 1 --2- 172.21.15.137:0/3987614229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f82440b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8243fff640 1 -- 172.21.15.137:0/3987614229 >> v2:172.21.15.170:3300/0 conn(0x7f8244146550 msgr2=0x7f8244073bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8243fff640 1 --2- 172.21.15.137:0/3987614229 >> v2:172.21.15.170:3300/0 conn(0x7f8244146550 0x7f8244073bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8243fff640 1 -- 172.21.15.137:0/3987614229 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8244161420 con 0x7f82440706b0 2024-04-26T21:58:26.837 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8249465640 1 --2- 172.21.15.137:0/3987614229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f82440b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:26.838 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.836+0000 7f8248c64640 1 --2- 172.21.15.137:0/3987614229 >> v2:172.21.15.170:3300/0 conn(0x7f8244146550 0x7f8244073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:26.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.837+0000 7f8243fff640 1 --2- 172.21.15.137:0/3987614229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 0x7f8244160cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8244068dd0 tx=0x7f823002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ddafe0cf187443 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:26.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.837+0000 7f82437fe640 1 -- 172.21.15.137:0/3987614229 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230037070 con 0x7f82440706b0 2024-04-26T21:58:26.841 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.837+0000 7f82437fe640 1 -- 172.21.15.137:0/3987614229 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8230032440 con 0x7f82440706b0 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.837+0000 7f82437fe640 1 -- 172.21.15.137:0/3987614229 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230032810 con 0x7f82440706b0 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.838+0000 7f824aec8640 1 -- 172.21.15.137:0/3987614229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 msgr2=0x7f8244160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.838+0000 7f824aec8640 1 --2- 172.21.15.137:0/3987614229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 0x7f8244160cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8244068dd0 tx=0x7f823002a1e0 comp rx=0 tx=0).stop 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.838+0000 7f824aec8640 1 -- 172.21.15.137:0/3987614229 shutdown_connections 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.838+0000 7f824aec8640 1 --2- 172.21.15.137:0/3987614229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f82440b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.838+0000 7f824aec8640 1 --2- 172.21.15.137:0/3987614229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 0x7f8244160cb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.838+0000 7f824aec8640 1 --2- 172.21.15.137:0/3987614229 >> v2:172.21.15.170:3300/0 conn(0x7f8244146550 0x7f8244073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.838+0000 7f824aec8640 1 -- 172.21.15.137:0/3987614229 >> 172.21.15.137:0/3987614229 conn(0x7f824406f610 msgr2=0x7f824406f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.838+0000 7f824aec8640 1 -- 172.21.15.137:0/3987614229 shutdown_connections 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.838+0000 7f824aec8640 1 -- 172.21.15.137:0/3987614229 wait complete. 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.839+0000 7f824aec8640 1 Processor -- start 2024-04-26T21:58:26.842 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.839+0000 7f824aec8640 1 -- start start 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f824aec8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 0x7f824415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f824aec8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f824413e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f824aec8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8244146550 0x7f824413eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f824aec8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f82440d0b70 con 0x7f82440706b0 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f824aec8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f82441619e0 con 0x7f8244146550 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f824aec8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f82440d1090 con 0x7f82440b3ff0 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8248c64640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 0x7f824415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8248c64640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 0x7f824415c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59646/0 (socket says 172.21.15.137:59646) 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8248c64640 1 -- 172.21.15.137:0/2107509241 learned_addr learned my addr 172.21.15.137:0/2107509241 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8249465640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8244146550 0x7f824413eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8243fff640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f824413e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:26.843 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8248c64640 1 -- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 msgr2=0x7f824413e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8248c64640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f824413e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8248c64640 1 -- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8244146550 msgr2=0x7f824413eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8248c64640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8244146550 0x7f824413eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8248c64640 1 -- 172.21.15.137:0/2107509241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824413f410 con 0x7f82440706b0 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8249465640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8244146550 0x7f824413eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8243fff640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f824413e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f8248c64640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 0x7f824415c8a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f823800c7f0 tx=0x7f823800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f82417fa640 1 -- 172.21.15.137:0/2107509241 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238015070 con 0x7f82440706b0 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f82417fa640 1 -- 172.21.15.137:0/2107509241 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8238007820 con 0x7f82440706b0 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824413cca0 con 0x7f82440706b0 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f82417fa640 1 -- 172.21.15.137:0/2107509241 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238007bd0 con 0x7f82440706b0 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.840+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824413d260 con 0x7f82440706b0 2024-04-26T21:58:26.844 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.841+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8244076870 con 0x7f82440706b0 2024-04-26T21:58:26.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.842+0000 7f82417fa640 1 -- 172.21.15.137:0/2107509241 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f8238018070 con 0x7f82440706b0 2024-04-26T21:58:26.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.842+0000 7f82417fa640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f822806c860 0x7f822806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:26.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.842+0000 7f8243fff640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f822806c860 0x7f822806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:26.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.842+0000 7f82417fa640 1 -- 172.21.15.137:0/2107509241 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f823808ad30 con 0x7f82440706b0 2024-04-26T21:58:26.845 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.843+0000 7f8243fff640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f822806c860 0x7f822806ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8230034000 tx=0x7f823002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:26.846 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:26.847+0000 7f82417fa640 1 -- 172.21.15.137:0/2107509241 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f823808f070 con 0x7f82440706b0 2024-04-26T21:58:27.022 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.022+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82440736f0 con 0x7f82440706b0 2024-04-26T21:58:27.022 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.023+0000 7f82417fa640 1 -- 172.21.15.137:0/2107509241 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f823805a060 con 0x7f82440706b0 2024-04-26T21:58:27.023 INFO:teuthology.misc.health.smithi137.stdout: 2024-04-26T21:58:27.023 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":12,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:24.698354+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.024+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f822806c860 msgr2=0x7f822806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.024+0000 7f824aec8640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f822806c860 0x7f822806ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8230034000 tx=0x7f823002e000 comp rx=0 tx=0).stop 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.024+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 msgr2=0x7f824415c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.024+0000 7f824aec8640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 0x7f824415c8a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f823800c7f0 tx=0x7f823800ccb0 comp rx=0 tx=0).stop 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.025+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 shutdown_connections 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.025+0000 7f824aec8640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f822806c860 0x7f822806ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.025+0000 7f824aec8640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8244146550 0x7f824413eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.025+0000 7f824aec8640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f82440b3ff0 0x7f824413e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.025+0000 7f824aec8640 1 --2- 172.21.15.137:0/2107509241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f82440706b0 0x7f824415c8a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.025+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 >> 172.21.15.137:0/2107509241 conn(0x7f824406f610 msgr2=0x7f82440d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.025+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 shutdown_connections 2024-04-26T21:58:27.025 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:27.025+0000 7f824aec8640 1 -- 172.21.15.137:0/2107509241 wait complete. 2024-04-26T21:58:27.034 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T21:58:33.840 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:33.939 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.939+0000 7ff2fba09640 1 Processor -- start 2024-04-26T21:58:33.940 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.940+0000 7ff2fba09640 1 -- start start 2024-04-26T21:58:33.943 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.940+0000 7ff2fba09640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40b50b0 0x7ff2f40b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:33.943 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.940+0000 7ff2fba09640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f40d4210 con 0x7ff2f40d21f0 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.940+0000 7ff2fba09640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f40d26b0 con 0x7ff2f415f590 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.940+0000 7ff2fba09640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f40d2990 con 0x7ff2f40b50b0 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2f8fa4640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff2f40d21f0 0x7ff2f40d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46920/0 (socket says 172.21.15.137:46920) 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2f8fa4640 1 -- 172.21.15.137:0/808289943 learned_addr learned my addr 172.21.15.137:0/808289943 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2f9fa6640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40b50b0 0x7ff2f40b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297670177 0 0) 0x7ff2f40d4210 con 0x7ff2f40d21f0 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2e0003520 con 0x7ff2f40d21f0 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279393093 0 0) 0x7ff2f40d26b0 con 0x7ff2f415f590 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f40d4210 con 0x7ff2f415f590 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3457380304 0 0) 0x7ff2e0003520 con 0x7ff2f40d21f0 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40b50b0 msgr2=0x7ff2f40b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40b50b0 0x7ff2f40b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:33.944 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 >> v1:172.21.15.170:6789/0 conn(0x7ff2f415f590 legacy=0x7ff2f40d3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f40d00f0 con 0x7ff2f40d21f0 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7ff2e4001670 con 0x7ff2f40d21f0 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 >> v1:172.21.15.137:6789/0 conn(0x7ff2f40d21f0 legacy=0x7ff2f40d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e0003b70 0x7ff2e0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40b50b0 0x7ff2e0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40d2990 con 0x7ff2e0004800 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e000bb50 con 0x7ff2e0003b70 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e000bd50 con 0x7ff2f40b50b0 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2f8fa4640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2f97a5640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e0003b70 0x7ff2e0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.941+0000 7ff2f9fa6640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40b50b0 0x7ff2e0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2f8fa4640 1 -- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40b50b0 msgr2=0x7ff2e0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2f8fa4640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40b50b0 0x7ff2e0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:33.945 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2f8fa4640 1 -- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e0003b70 msgr2=0x7ff2e0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2f8fa4640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e0003b70 0x7ff2e0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2f8fa4640 1 -- 172.21.15.137:0/808289943 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e0003520 con 0x7ff2e0004800 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2f9fa6640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40b50b0 0x7ff2e0005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2f8fa4640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2e0004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c0e0 tx=0x7ff2e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca5b56613ba422b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4007c00 con 0x7ff2e0004800 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e4005ad0 con 0x7ff2e0004800 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.942+0000 7ff2ebfff640 1 -- 172.21.15.137:0/808289943 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4007070 con 0x7ff2e0004800 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.943+0000 7ff2fba09640 1 -- 172.21.15.137:0/808289943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 msgr2=0x7ff2e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.943+0000 7ff2fba09640 1 --2- 172.21.15.137:0/808289943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2e0004c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c0e0 tx=0x7ff2e0005830 comp rx=0 tx=0).stop 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.943+0000 7ff2f9fa6640 1 -- 172.21.15.137:0/808289943 reap_dead start 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.943+0000 7ff2fba09640 1 -- 172.21.15.137:0/808289943 shutdown_connections 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.943+0000 7ff2fba09640 1 -- 172.21.15.137:0/808289943 >> 172.21.15.137:0/808289943 conn(0x7ff2f408eb90 msgr2=0x7ff2f409e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.943+0000 7ff2fba09640 1 -- 172.21.15.137:0/808289943 shutdown_connections 2024-04-26T21:58:33.946 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.943+0000 7ff2fba09640 1 -- 172.21.15.137:0/808289943 wait complete. 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.944+0000 7ff2fba09640 1 Processor -- start 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.944+0000 7ff2fba09640 1 -- start start 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2fba09640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2f41508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2fba09640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40cc250 0x7ff2f40ba770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2fba09640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f40b5b50 0x7ff2f40b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2fba09640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40d1000 con 0x7ff2e0004800 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2fba09640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f415f970 con 0x7ff2f40b5b50 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2fba09640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f40cfd50 con 0x7ff2f40cc250 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f97a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2f41508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:33.949 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f97a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2f41508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59690/0 (socket says 172.21.15.137:59690) 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f97a5640 1 -- 172.21.15.137:0/1076766351 learned_addr learned my addr 172.21.15.137:0/1076766351 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f9fa6640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f40b5b50 0x7ff2f40b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f8fa4640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40cc250 0x7ff2f40ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f97a5640 1 -- 172.21.15.137:0/1076766351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40cc250 msgr2=0x7ff2f40ba770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f97a5640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40cc250 0x7ff2f40ba770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f97a5640 1 -- 172.21.15.137:0/1076766351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f40b5b50 msgr2=0x7ff2f40b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f97a5640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f40b5b50 0x7ff2f40b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.945+0000 7ff2f97a5640 1 -- 172.21.15.137:0/1076766351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f40cc6d0 con 0x7ff2e0004800 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.946+0000 7ff2f97a5640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2f41508f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000f7d0 tx=0x7ff2f000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.946+0000 7ff2e9ffb640 1 -- 172.21.15.137:0/1076766351 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f001a070 con 0x7ff2e0004800 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.946+0000 7ff2e9ffb640 1 -- 172.21.15.137:0/1076766351 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f000fe80 con 0x7ff2e0004800 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.946+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f40b9650 con 0x7ff2e0004800 2024-04-26T21:58:33.950 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.946+0000 7ff2e9ffb640 1 -- 172.21.15.137:0/1076766351 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0007050 con 0x7ff2e0004800 2024-04-26T21:58:33.951 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.946+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f40b9c90 con 0x7ff2e0004800 2024-04-26T21:58:33.951 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.947+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f4076870 con 0x7ff2e0004800 2024-04-26T21:58:33.951 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.947+0000 7ff2e9ffb640 1 -- 172.21.15.137:0/1076766351 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2f001d070 con 0x7ff2e0004800 2024-04-26T21:58:33.951 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.948+0000 7ff2e9ffb640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:33.951 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.948+0000 7ff2e9ffb640 1 -- 172.21.15.137:0/1076766351 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff2f008af80 con 0x7ff2e0004800 2024-04-26T21:58:33.951 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.948+0000 7ff2f8fa4640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:33.951 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.948+0000 7ff2f8fa4640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c0e0 tx=0x7ff2e402d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:33.952 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:33.952+0000 7ff2e9ffb640 1 -- 172.21.15.137:0/1076766351 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff2f0059790 con 0x7ff2e0004800 2024-04-26T21:58:34.129 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.129+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2f40d6030 con 0x7ff2e0004800 2024-04-26T21:58:34.130 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.130+0000 7ff2e9ffb640 1 -- 172.21.15.137:0/1076766351 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12896 (secure 0 0 0) 0x7ff2f0059090 con 0x7ff2e0004800 2024-04-26T21:58:34.130 INFO:teuthology.misc.health.smithi137.stdout: 2024-04-26T21:58:34.130 INFO:teuthology.misc.health.smithi137.stdout:{"epoch":17,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:31.195924+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:34.132 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 msgr2=0x7ff2d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.132 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400c0e0 tx=0x7ff2e402d000 comp rx=0 tx=0).stop 2024-04-26T21:58:34.132 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 msgr2=0x7ff2f41508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.132 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2f41508f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff2f000f7d0 tx=0x7ff2f000fc90 comp rx=0 tx=0).stop 2024-04-26T21:58:34.132 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 shutdown_connections 2024-04-26T21:58:34.132 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.133 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f40b5b50 0x7ff2f40b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.133 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f40cc250 0x7ff2f40ba770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.133 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 --2- 172.21.15.137:0/1076766351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2e0004800 0x7ff2f41508f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.133 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 >> 172.21.15.137:0/1076766351 conn(0x7ff2f408eb90 msgr2=0x7ff2f40b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:34.133 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 shutdown_connections 2024-04-26T21:58:34.133 INFO:teuthology.misc.health.smithi137.stderr:2024-04-26T21:58:34.132+0000 7ff2fba09640 1 -- 172.21.15.137:0/1076766351 wait complete. 2024-04-26T21:58:34.142 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T21:58:34.142 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T21:58:34.142 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T21:58:34.143 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T21:58:34.145 INFO:tasks.ceph.mds.a:Started 2024-04-26T21:58:34.145 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T21:58:34.145 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T21:58:34.147 INFO:tasks.ceph.mds.c:Started 2024-04-26T21:58:34.147 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T21:58:34.147 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T21:58:34.150 INFO:tasks.ceph.mds.b:Started 2024-04-26T21:58:34.150 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T21:58:34.150 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T21:58:34.153 INFO:tasks.ceph.mds.d:Started 2024-04-26T21:58:34.153 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T21:58:34.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:34.218 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T21:58:34.218 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T21:58:34.234 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T21:58:34.235 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T21:58:34.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.257+0000 7f1813c6b640 1 Processor -- start 2024-04-26T21:58:34.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.257+0000 7f1813c6b640 1 -- start start 2024-04-26T21:58:34.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1813c6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c145a90 0x7f180c0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1813c6b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f180c0709f0 0x7f180c0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1813c6b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f180c0736c0 con 0x7f180c0b5830 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1813c6b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f180c0739a0 con 0x7f180c0709f0 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1813c6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f180c073c80 con 0x7f180c145a90 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1811206640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f180c0709f0 0x7f180c0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1811206640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f180c0709f0 0x7f180c0b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59736/0 (socket says 172.21.15.137:59736) 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1811206640 1 -- 172.21.15.137:0/4238242800 learned_addr learned my addr 172.21.15.137:0/4238242800 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1811a07640 1 --2- 172.21.15.137:0/4238242800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c145a90 0x7f180c0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1811206640 1 -- 172.21.15.137:0/4238242800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c145a90 msgr2=0x7f180c0730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1811206640 1 --2- 172.21.15.137:0/4238242800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c145a90 0x7f180c0730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1811206640 1 -- 172.21.15.137:0/4238242800 >> v1:172.21.15.170:6789/0 conn(0x7f180c0b5830 legacy=0x7f180c0d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:34.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1811206640 1 -- 172.21.15.137:0/4238242800 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c073f60 con 0x7f180c0709f0 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.258+0000 7f1811a07640 1 --2- 172.21.15.137:0/4238242800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c145a90 0x7f180c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1811206640 1 --2- 172.21.15.137:0/4238242800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0709f0 0x7f180c0b52f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00bb10 tx=0x7f17fc02c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6319ebece939e5c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1810a05640 1 -- 172.21.15.137:0/4238242800 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc032790 con 0x7f180c0709f0 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1810a05640 1 -- 172.21.15.137:0/4238242800 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc038070 con 0x7f180c0709f0 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1810a05640 1 -- 172.21.15.137:0/4238242800 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc032b50 con 0x7f180c0709f0 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1813c6b640 1 -- 172.21.15.137:0/4238242800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0709f0 msgr2=0x7f180c0b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1813c6b640 1 --2- 172.21.15.137:0/4238242800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0709f0 0x7f180c0b52f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00bb10 tx=0x7f17fc02c8d0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1813c6b640 1 -- 172.21.15.137:0/4238242800 shutdown_connections 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1813c6b640 1 --2- 172.21.15.137:0/4238242800 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0709f0 0x7f180c0b52f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1813c6b640 1 --2- 172.21.15.137:0/4238242800 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c145a90 0x7f180c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.259+0000 7f1813c6b640 1 -- 172.21.15.137:0/4238242800 >> 172.21.15.137:0/4238242800 conn(0x7f180c0b3b60 msgr2=0x7f180c0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.260+0000 7f1813c6b640 1 -- 172.21.15.137:0/4238242800 shutdown_connections 2024-04-26T21:58:34.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.260+0000 7f1813c6b640 1 -- 172.21.15.137:0/4238242800 wait complete. 2024-04-26T21:58:34.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1813c6b640 1 Processor -- start 2024-04-26T21:58:34.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1813c6b640 1 -- start start 2024-04-26T21:58:34.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1813c6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c0709f0 0x7f180c1408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1813c6b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0b5830 0x7f180c0ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1813c6b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f180c145a90 0x7f180c0aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1813c6b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f180c070fd0 con 0x7f180c0b5830 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1813c6b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f180c070e50 con 0x7f180c145a90 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1813c6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f180c0d07e0 con 0x7f180c0709f0 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1811206640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0b5830 0x7f180c0ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1811206640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0b5830 0x7f180c0ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59738/0 (socket says 172.21.15.137:59738) 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.261+0000 7f1811206640 1 -- 172.21.15.137:0/885533098 learned_addr learned my addr 172.21.15.137:0/885533098 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1812208640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f180c145a90 0x7f180c0aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1811a07640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c0709f0 0x7f180c1408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1811206640 1 -- 172.21.15.137:0/885533098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c0709f0 msgr2=0x7f180c1408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1811206640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c0709f0 0x7f180c1408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1811206640 1 -- 172.21.15.137:0/885533098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f180c145a90 msgr2=0x7f180c0aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1811206640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f180c145a90 0x7f180c0aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1811206640 1 -- 172.21.15.137:0/885533098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c15d820 con 0x7f180c0b5830 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1811a07640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c0709f0 0x7f180c1408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1811206640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0b5830 0x7f180c0ab380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00b2c0 tx=0x7f17fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f18027fc640 1 -- 172.21.15.137:0/885533098 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc033620 con 0x7f180c0b5830 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f18027fc640 1 -- 172.21.15.137:0/885533098 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17fc0337c0 con 0x7f180c0b5830 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180c15db00 con 0x7f180c0b5830 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f18027fc640 1 -- 172.21.15.137:0/885533098 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc033bb0 con 0x7f180c0b5830 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.262+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f180c15e0c0 con 0x7f180c0b5830 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.263+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f180c0693d0 con 0x7f180c0b5830 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.264+0000 7f18027fc640 1 -- 172.21.15.137:0/885533098 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17fc04d060 con 0x7f180c0b5830 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.264+0000 7f18027fc640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f17f006c8f0 0x7f17f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.264+0000 7f1811a07640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f17f006c8f0 0x7f17f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.264+0000 7f18027fc640 1 -- 172.21.15.137:0/885533098 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f17fc0ae550 con 0x7f180c0b5830 2024-04-26T21:58:34.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.264+0000 7f1811a07640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f17f006c8f0 0x7f17f006edb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f180c142270 tx=0x7f1808008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:34.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.268+0000 7f18027fc640 1 -- 172.21.15.137:0/885533098 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f17fc041070 con 0x7f180c0b5830 2024-04-26T21:58:34.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.443+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f180c15f8b0 con 0x7f180c0b5830 2024-04-26T21:58:34.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.444+0000 7f18027fc640 1 -- 172.21.15.137:0/885533098 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12896 (secure 0 0 0) 0x7f17fc07cd60 con 0x7f180c0b5830 2024-04-26T21:58:34.444 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:34.444 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:31.195924+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f17f006c8f0 msgr2=0x7f17f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f17f006c8f0 0x7f17f006edb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f180c142270 tx=0x7f1808008040 comp rx=0 tx=0).stop 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0b5830 msgr2=0x7f180c0ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0b5830 0x7f180c0ab380 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00b2c0 tx=0x7f17fc0046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 shutdown_connections 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f17f006c8f0 0x7f17f006edb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f180c0b5830 0x7f180c0ab380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f180c145a90 0x7f180c0aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 --2- 172.21.15.137:0/885533098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f180c0709f0 0x7f180c1408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 >> 172.21.15.137:0/885533098 conn(0x7f180c0b3b60 msgr2=0x7f180c0b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 shutdown_connections 2024-04-26T21:58:34.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.446+0000 7f1813c6b640 1 -- 172.21.15.137:0/885533098 wait complete. 2024-04-26T21:58:34.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:58:34.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:58:34.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.557+0000 7f8fcf812640 1 Processor -- start 2024-04-26T21:58:34.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.558+0000 7f8fcf812640 1 -- start start 2024-04-26T21:58:34.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.558+0000 7f8fcf812640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8fc80d0010 0x7f8fc806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.558+0000 7f8fcf812640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8fc80b33e0 0x7f8fc8163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.558+0000 7f8fcf812640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fc809c700 con 0x7f8fc80b3c20 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.558+0000 7f8fcf812640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc80b4480 con 0x7f8fc80d0010 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.558+0000 7f8fcf812640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8fc806e050 con 0x7f8fc80b33e0 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.559+0000 7f8fcd5ae640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8fc80d0010 0x7f8fc806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.559+0000 7f8fcd5ae640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8fc80d0010 0x7f8fc806db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59750/0 (socket says 172.21.15.137:59750) 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.559+0000 7f8fcd5ae640 1 -- 172.21.15.137:0/1495481624 learned_addr learned my addr 172.21.15.137:0/1495481624 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.559+0000 7f8fcddaf640 1 --2- 172.21.15.137:0/1495481624 >> v2:172.21.15.170:3300/0 conn(0x7f8fc80b33e0 0x7f8fc8163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.559+0000 7f8fcd5ae640 1 -- 172.21.15.137:0/1495481624 >> v2:172.21.15.170:3300/0 conn(0x7f8fc80b33e0 msgr2=0x7f8fc8163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.559+0000 7f8fcd5ae640 1 --2- 172.21.15.137:0/1495481624 >> v2:172.21.15.170:3300/0 conn(0x7f8fc80b33e0 0x7f8fc8163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.559+0000 7f8fcd5ae640 1 -- 172.21.15.137:0/1495481624 >> v1:172.21.15.170:6789/0 conn(0x7f8fc80b3c20 legacy=0x7f8fc80b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.559+0000 7f8fcd5ae640 1 -- 172.21.15.137:0/1495481624 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc80d1c50 con 0x7f8fc80d0010 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.559+0000 7f8fcd5ae640 1 --2- 172.21.15.137:0/1495481624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80d0010 0x7f8fc806db10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8073bb0 tx=0x7f8fc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54427aaa6026d7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fbffff640 1 -- 172.21.15.137:0/1495481624 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4037070 con 0x7f8fc80d0010 2024-04-26T21:58:34.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fbffff640 1 -- 172.21.15.137:0/1495481624 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc4032440 con 0x7f8fc80d0010 2024-04-26T21:58:34.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fbffff640 1 -- 172.21.15.137:0/1495481624 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4032810 con 0x7f8fc80d0010 2024-04-26T21:58:34.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fcf812640 1 -- 172.21.15.137:0/1495481624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80d0010 msgr2=0x7f8fc806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fcf812640 1 --2- 172.21.15.137:0/1495481624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80d0010 0x7f8fc806db10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8073bb0 tx=0x7f8fc402a270 comp rx=0 tx=0).stop 2024-04-26T21:58:34.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fcf812640 1 -- 172.21.15.137:0/1495481624 shutdown_connections 2024-04-26T21:58:34.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fcf812640 1 --2- 172.21.15.137:0/1495481624 >> v2:172.21.15.170:3300/0 conn(0x7f8fc80b33e0 0x7f8fc8163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fcf812640 1 --2- 172.21.15.137:0/1495481624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80d0010 0x7f8fc806db10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fcf812640 1 -- 172.21.15.137:0/1495481624 >> 172.21.15.137:0/1495481624 conn(0x7f8fc809ba40 msgr2=0x7f8fc809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:34.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fcf812640 1 -- 172.21.15.137:0/1495481624 shutdown_connections 2024-04-26T21:58:34.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.560+0000 7f8fcf812640 1 -- 172.21.15.137:0/1495481624 wait complete. 2024-04-26T21:58:34.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.561+0000 7f8fcf812640 1 Processor -- start 2024-04-26T21:58:34.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.561+0000 7f8fcf812640 1 -- start start 2024-04-26T21:58:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcf812640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80b33e0 0x7f8fc815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcf812640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fc80b3c20 0x7f8fc815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcf812640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fc80d0010 0x7f8fc8148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcf812640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc80b3990 con 0x7f8fc80b33e0 2024-04-26T21:58:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcf812640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc80b3810 con 0x7f8fc80d0010 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcf812640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc81637c0 con 0x7f8fc80b3c20 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcd5ae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80b33e0 0x7f8fc815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcd5ae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80b33e0 0x7f8fc815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59758/0 (socket says 172.21.15.137:59758) 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcd5ae640 1 -- 172.21.15.137:0/3352747947 learned_addr learned my addr 172.21.15.137:0/3352747947 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcddaf640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fc80d0010 0x7f8fc8148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fccdad640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fc80b3c20 0x7f8fc815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcd5ae640 1 -- 172.21.15.137:0/3352747947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fc80b3c20 msgr2=0x7f8fc815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcd5ae640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fc80b3c20 0x7f8fc815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcd5ae640 1 -- 172.21.15.137:0/3352747947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fc80d0010 msgr2=0x7f8fc8148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcd5ae640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fc80d0010 0x7f8fc8148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcd5ae640 1 -- 172.21.15.137:0/3352747947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc815c8f0 con 0x7f8fc80b33e0 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.562+0000 7f8fcddaf640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fc80d0010 0x7f8fc8148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.563+0000 7f8fcd5ae640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80b33e0 0x7f8fc815a5c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8fc402a2b0 tx=0x7f8fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.563+0000 7f8fbdffb640 1 -- 172.21.15.137:0/3352747947 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4037040 con 0x7f8fc80b33e0 2024-04-26T21:58:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.563+0000 7f8fbdffb640 1 -- 172.21.15.137:0/3352747947 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc4042070 con 0x7f8fc80b33e0 2024-04-26T21:58:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.563+0000 7f8fbdffb640 1 -- 172.21.15.137:0/3352747947 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4030880 con 0x7f8fc80b33e0 2024-04-26T21:58:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.563+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc815b1a0 con 0x7f8fc80b33e0 2024-04-26T21:58:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.563+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc815ba40 con 0x7f8fc80b33e0 2024-04-26T21:58:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.564+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc815b590 con 0x7f8fc80b33e0 2024-04-26T21:58:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.564+0000 7f8fbdffb640 1 -- 172.21.15.137:0/3352747947 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fc4030a20 con 0x7f8fc80b33e0 2024-04-26T21:58:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.565+0000 7f8fbdffb640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fac06c8f0 0x7f8fac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.565+0000 7f8fbdffb640 1 -- 172.21.15.137:0/3352747947 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8fc40abf90 con 0x7f8fc80b33e0 2024-04-26T21:58:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.565+0000 7f8fccdad640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fac06c8f0 0x7f8fac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.565+0000 7f8fccdad640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fac06c8f0 0x7f8fac06edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8163400 tx=0x7f8fb8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.569+0000 7f8fbdffb640 1 -- 172.21.15.137:0/3352747947 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8fc815c8f0 con 0x7f8fc80b33e0 2024-04-26T21:58:34.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.743+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8fc8068e00 con 0x7f8fc80b33e0 2024-04-26T21:58:34.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.744+0000 7f8fbdffb640 1 -- 172.21.15.137:0/3352747947 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f8fc407a7a0 con 0x7f8fc80b33e0 2024-04-26T21:58:34.744 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:58:34.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fac06c8f0 msgr2=0x7f8fac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fac06c8f0 0x7f8fac06edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8163400 tx=0x7f8fb8009040 comp rx=0 tx=0).stop 2024-04-26T21:58:34.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80b33e0 msgr2=0x7f8fc815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80b33e0 0x7f8fc815a5c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8fc402a2b0 tx=0x7f8fc40046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 shutdown_connections 2024-04-26T21:58:34.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fac06c8f0 0x7f8fac06edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fc80d0010 0x7f8fc8148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8fc80b3c20 0x7f8fc815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 --2- 172.21.15.137:0/3352747947 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fc80b33e0 0x7f8fc815a5c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 >> 172.21.15.137:0/3352747947 conn(0x7f8fc809ba40 msgr2=0x7f8fc80d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:34.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 shutdown_connections 2024-04-26T21:58:34.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.746+0000 7f8fcf812640 1 -- 172.21.15.137:0/3352747947 wait complete. 2024-04-26T21:58:34.757 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:58:34.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.853+0000 7fb014dbf640 1 Processor -- start 2024-04-26T21:58:34.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.853+0000 7fb014dbf640 1 -- start start 2024-04-26T21:58:34.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.854+0000 7fb014dbf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb0100d3ee0 0x7fb0100cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.854+0000 7fb014dbf640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0100d03a0 con 0x7fb01015f370 2024-04-26T21:58:34.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.854+0000 7fb014dbf640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0100d0680 con 0x7fb01015f750 2024-04-26T21:58:34.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.854+0000 7fb014dbf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb0100d0960 con 0x7fb0100d3ee0 2024-04-26T21:58:34.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.854+0000 7fb00dd9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb0100d3ee0 0x7fb0100cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.854+0000 7fb00e59c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb01015f370 0x7fb0100d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46938/0 (socket says 172.21.15.137:46938) 2024-04-26T21:58:34.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.854+0000 7fb00e59c640 1 -- 172.21.15.137:0/4065930813 learned_addr learned my addr 172.21.15.137:0/4065930813 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:34.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.855+0000 7fb00dd9b640 1 -- 172.21.15.137:0/4065930813 >> v1:172.21.15.170:6789/0 conn(0x7fb01015f750 legacy=0x7fb0100b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.855+0000 7fb00dd9b640 1 -- 172.21.15.137:0/4065930813 >> v1:172.21.15.137:6789/0 conn(0x7fb01015f370 legacy=0x7fb0100d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.855+0000 7fb00dd9b640 1 -- 172.21.15.137:0/4065930813 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0100d0c40 con 0x7fb0100d3ee0 2024-04-26T21:58:34.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.855+0000 7fb00dd9b640 1 --2- 172.21.15.137:0/4065930813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0100d3ee0 0x7fb0100cfd70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0040097d0 tx=0x7fb00402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb2379611f989ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:34.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.855+0000 7fb00d59a640 1 -- 172.21.15.137:0/4065930813 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004037070 con 0x7fb0100d3ee0 2024-04-26T21:58:34.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.855+0000 7fb00d59a640 1 -- 172.21.15.137:0/4065930813 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb004032440 con 0x7fb0100d3ee0 2024-04-26T21:58:34.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.855+0000 7fb00d59a640 1 -- 172.21.15.137:0/4065930813 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004032810 con 0x7fb0100d3ee0 2024-04-26T21:58:34.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.856+0000 7fb014dbf640 1 -- 172.21.15.137:0/4065930813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0100d3ee0 msgr2=0x7fb0100cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.856+0000 7fb014dbf640 1 --2- 172.21.15.137:0/4065930813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0100d3ee0 0x7fb0100cfd70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb0040097d0 tx=0x7fb00402a270 comp rx=0 tx=0).stop 2024-04-26T21:58:34.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.856+0000 7fb014dbf640 1 -- 172.21.15.137:0/4065930813 shutdown_connections 2024-04-26T21:58:34.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.856+0000 7fb014dbf640 1 --2- 172.21.15.137:0/4065930813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb0100d3ee0 0x7fb0100cfd70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.856+0000 7fb014dbf640 1 -- 172.21.15.137:0/4065930813 >> 172.21.15.137:0/4065930813 conn(0x7fb01008ec10 msgr2=0x7fb01009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:34.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.856+0000 7fb014dbf640 1 -- 172.21.15.137:0/4065930813 shutdown_connections 2024-04-26T21:58:34.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.856+0000 7fb014dbf640 1 -- 172.21.15.137:0/4065930813 wait complete. 2024-04-26T21:58:34.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.857+0000 7fb014dbf640 1 Processor -- start 2024-04-26T21:58:34.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.857+0000 7fb014dbf640 1 -- start start 2024-04-26T21:58:34.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb014dbf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0100d3ee0 0x7fb0100ba600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb014dbf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb01015f370 0x7fb0101504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb014dbf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb01015f750 0x7fb0100b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb014dbf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb0100b4950 con 0x7fb01015f750 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb014dbf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb0100b47d0 con 0x7fb01015f370 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb014dbf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb0100b4ad0 con 0x7fb0100d3ee0 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb00ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb01015f750 0x7fb0100b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb00ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb01015f750 0x7fb0100b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59774/0 (socket says 172.21.15.137:59774) 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb00ed9d640 1 -- 172.21.15.137:0/4058514832 learned_addr learned my addr 172.21.15.137:0/4058514832 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb00dd9b640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb01015f370 0x7fb0101504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb00e59c640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0100d3ee0 0x7fb0100ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb00ed9d640 1 -- 172.21.15.137:0/4058514832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0100d3ee0 msgr2=0x7fb0100ba600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb00ed9d640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0100d3ee0 0x7fb0100ba600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb00ed9d640 1 -- 172.21.15.137:0/4058514832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb01015f370 msgr2=0x7fb0101504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.858+0000 7fb00ed9d640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb01015f370 0x7fb0101504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.859+0000 7fb00ed9d640 1 -- 172.21.15.137:0/4058514832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb010150cd0 con 0x7fb01015f750 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.859+0000 7fb00dd9b640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb01015f370 0x7fb0101504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:34.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.859+0000 7fb00ed9d640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb01015f750 0x7fb0100b2fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c390 tx=0x7fb00800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:34.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.859+0000 7faffeffd640 1 -- 172.21.15.137:0/4058514832 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008017070 con 0x7fb01015f750 2024-04-26T21:58:34.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.859+0000 7faffeffd640 1 -- 172.21.15.137:0/4058514832 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0080052d0 con 0x7fb01015f750 2024-04-26T21:58:34.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.859+0000 7faffeffd640 1 -- 172.21.15.137:0/4058514832 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008003810 con 0x7fb01015f750 2024-04-26T21:58:34.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.859+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb010150fb0 con 0x7fb01015f750 2024-04-26T21:58:34.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.859+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0100b7df0 con 0x7fb01015f750 2024-04-26T21:58:34.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.860+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01006a290 con 0x7fb01015f750 2024-04-26T21:58:34.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.860+0000 7faffeffd640 1 -- 172.21.15.137:0/4058514832 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb00801a070 con 0x7fb01015f750 2024-04-26T21:58:34.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.860+0000 7faffeffd640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faff006c8f0 0x7faff006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:34.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.861+0000 7fb00e59c640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faff006c8f0 0x7faff006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:34.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.861+0000 7faffeffd640 1 -- 172.21.15.137:0/4058514832 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb00808ab20 con 0x7fb01015f750 2024-04-26T21:58:34.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.861+0000 7fb00e59c640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faff006c8f0 0x7faff006edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb000005c00 tx=0x7fb000009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:34.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:34.865+0000 7faffeffd640 1 -- 172.21.15.137:0/4058514832 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb0080592a0 con 0x7fb01015f750 2024-04-26T21:58:35.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.075+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb01009e780 con 0x7fb01015f750 2024-04-26T21:58:35.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.076+0000 7faffeffd640 1 -- 172.21.15.137:0/4058514832 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fb008058ba0 con 0x7fb01015f750 2024-04-26T21:58:35.076 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:35.076 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T21:58:35.076 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 2 2024-04-26T21:58:35.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faff006c8f0 msgr2=0x7faff006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:35.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faff006c8f0 0x7faff006edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb000005c00 tx=0x7fb000009040 comp rx=0 tx=0).stop 2024-04-26T21:58:35.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb01015f750 msgr2=0x7fb0100b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:35.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb01015f750 0x7fb0100b2fa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c390 tx=0x7fb00800c850 comp rx=0 tx=0).stop 2024-04-26T21:58:35.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 shutdown_connections 2024-04-26T21:58:35.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faff006c8f0 0x7faff006edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:35.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb01015f750 0x7fb0100b2fa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:35.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb01015f370 0x7fb0101504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:35.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 --2- 172.21.15.137:0/4058514832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb0100d3ee0 0x7fb0100ba600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:35.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 >> 172.21.15.137:0/4058514832 conn(0x7fb01008ec10 msgr2=0x7fb0100b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:35.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 shutdown_connections 2024-04-26T21:58:35.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:35.078+0000 7fb014dbf640 1 -- 172.21.15.137:0/4058514832 wait complete. 2024-04-26T21:58:37.090 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:58:37.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.198+0000 7f3e348dc640 1 Processor -- start 2024-04-26T21:58:37.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.198+0000 7f3e348dc640 1 -- start start 2024-04-26T21:58:37.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e348dc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3e300cf2e0 0x7f3e3006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e348dc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e3006e490 0x7f3e3015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e348dc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e300d1740 con 0x7f3e300d11b0 2024-04-26T21:58:37.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e348dc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3e300d1a20 con 0x7f3e3006e490 2024-04-26T21:58:37.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e348dc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3e300d1d00 con 0x7f3e300cf2e0 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e2ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e3006e490 0x7f3e3015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e2ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e3006e490 0x7f3e3015ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41538/0 (socket says 172.21.15.137:41538) 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e2ed9d640 1 -- 172.21.15.137:0/2068147123 learned_addr learned my addr 172.21.15.137:0/2068147123 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e2e59c640 1 --2- 172.21.15.137:0/2068147123 >> v2:172.21.15.170:3300/0 conn(0x7f3e300cf2e0 0x7f3e3006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e2ed9d640 1 -- 172.21.15.137:0/2068147123 >> v2:172.21.15.170:3300/0 conn(0x7f3e300cf2e0 msgr2=0x7f3e3006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e2ed9d640 1 --2- 172.21.15.137:0/2068147123 >> v2:172.21.15.170:3300/0 conn(0x7f3e300cf2e0 0x7f3e3006d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e2ed9d640 1 -- 172.21.15.137:0/2068147123 >> v1:172.21.15.170:6789/0 conn(0x7f3e300d11b0 legacy=0x7f3e3006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.199+0000 7f3e2ed9d640 1 -- 172.21.15.137:0/2068147123 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e300d1fe0 con 0x7f3e3006e490 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.200+0000 7f3e2ed9d640 1 --2- 172.21.15.137:0/2068147123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3006e490 0x7f3e3015ebe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009e50 tx=0x7f3e2802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c838cb8870950cd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:37.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.200+0000 7f3e2d59a640 1 -- 172.21.15.137:0/2068147123 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e28036070 con 0x7f3e3006e490 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.200+0000 7f3e2d59a640 1 -- 172.21.15.137:0/2068147123 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e28031600 con 0x7f3e3006e490 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.200+0000 7f3e2d59a640 1 -- 172.21.15.137:0/2068147123 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e280319d0 con 0x7f3e3006e490 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.201+0000 7f3e348dc640 1 -- 172.21.15.137:0/2068147123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3006e490 msgr2=0x7f3e3015ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.201+0000 7f3e348dc640 1 --2- 172.21.15.137:0/2068147123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3006e490 0x7f3e3015ebe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009e50 tx=0x7f3e2802a710 comp rx=0 tx=0).stop 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.201+0000 7f3e348dc640 1 -- 172.21.15.137:0/2068147123 shutdown_connections 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.201+0000 7f3e348dc640 1 --2- 172.21.15.137:0/2068147123 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3006e490 0x7f3e3015ebe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.201+0000 7f3e348dc640 1 --2- 172.21.15.137:0/2068147123 >> v2:172.21.15.170:3300/0 conn(0x7f3e300cf2e0 0x7f3e3006d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.201+0000 7f3e348dc640 1 -- 172.21.15.137:0/2068147123 >> 172.21.15.137:0/2068147123 conn(0x7f3e300b4a60 msgr2=0x7f3e300b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.201+0000 7f3e348dc640 1 -- 172.21.15.137:0/2068147123 shutdown_connections 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.201+0000 7f3e348dc640 1 -- 172.21.15.137:0/2068147123 wait complete. 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.202+0000 7f3e348dc640 1 Processor -- start 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.202+0000 7f3e348dc640 1 -- start start 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e348dc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3006e490 0x7f3e301f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e348dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e300cf2e0 0x7f3e3015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e348dc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e300d11b0 0x7f3e3015f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e348dc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e300cf6c0 con 0x7f3e300cf2e0 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e348dc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3006da10 con 0x7f3e300d11b0 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e348dc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3e300cf840 con 0x7f3e3006e490 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2dd9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e300cf2e0 0x7f3e3015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2dd9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e300cf2e0 0x7f3e3015be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41552/0 (socket says 172.21.15.137:41552) 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/4052443772 learned_addr learned my addr 172.21.15.137:0/4052443772 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2ed9d640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e300d11b0 0x7f3e3015f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2e59c640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3006e490 0x7f3e301f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/4052443772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3006e490 msgr2=0x7f3e301f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2dd9b640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3006e490 0x7f3e301f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/4052443772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e300d11b0 msgr2=0x7f3e3015f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2dd9b640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e300d11b0 0x7f3e3015f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/4052443772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3015c980 con 0x7f3e300cf2e0 2024-04-26T21:58:37.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e2dd9b640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e300cf2e0 0x7f3e3015be20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400b3f0 tx=0x7f3e2400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.203+0000 7f3e1effd640 1 -- 172.21.15.137:0/4052443772 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24015020 con 0x7f3e300cf2e0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.204+0000 7f3e1effd640 1 -- 172.21.15.137:0/4052443772 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e24011830 con 0x7f3e300cf2e0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.204+0000 7f3e1effd640 1 -- 172.21.15.137:0/4052443772 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24011c20 con 0x7f3e300cf2e0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.204+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e300b6820 con 0x7f3e300cf2e0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.204+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3015d950 con 0x7f3e300cf2e0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.205+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3006a290 con 0x7f3e300cf2e0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.205+0000 7f3e1effd640 1 -- 172.21.15.137:0/4052443772 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e24018020 con 0x7f3e300cf2e0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.205+0000 7f3e1effd640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.206+0000 7f3e1effd640 1 -- 172.21.15.137:0/4052443772 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3e2408b280 con 0x7f3e300cf2e0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.206+0000 7f3e2e59c640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.206+0000 7f3e2e59c640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000aa20 tx=0x7f3e20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:37.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.210+0000 7f3e1effd640 1 -- 172.21.15.137:0/4052443772 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3e2401f030 con 0x7f3e300cf2e0 2024-04-26T21:58:37.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.422+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e300b8ef0 con 0x7f3e300cf2e0 2024-04-26T21:58:37.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.423+0000 7f3e1effd640 1 -- 172.21.15.137:0/4052443772 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7f3e3015c980 con 0x7f3e300cf2e0 2024-04-26T21:58:37.423 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:37.423 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1319361701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1319361701},{"type":"v1","addr":"172.21.15.170:6833","nonce":1319361701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3941293249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3941293249},{"type":"v1","addr":"172.21.15.137:6837","nonce":3941293249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4305,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/268686042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":268686042},{"type":"v1","addr":"172.21.15.170:6835","nonce":268686042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T21:58:37.423 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 3 2024-04-26T21:58:37.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 msgr2=0x7f3e1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000aa20 tx=0x7f3e20008040 comp rx=0 tx=0).stop 2024-04-26T21:58:37.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e300cf2e0 msgr2=0x7f3e3015be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e300cf2e0 0x7f3e3015be20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400b3f0 tx=0x7f3e2400b8b0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 shutdown_connections 2024-04-26T21:58:37.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e300cf2e0 0x7f3e3015be20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e300d11b0 0x7f3e3015f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 --2- 172.21.15.137:0/4052443772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3006e490 0x7f3e301f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 >> 172.21.15.137:0/4052443772 conn(0x7f3e300b4a60 msgr2=0x7f3e30071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:37.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 shutdown_connections 2024-04-26T21:58:37.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.425+0000 7f3e348dc640 1 -- 172.21.15.137:0/4052443772 wait complete. 2024-04-26T21:58:37.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:37.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.532+0000 7f205fd46640 1 Processor -- start 2024-04-26T21:58:37.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.532+0000 7f205fd46640 1 -- start start 2024-04-26T21:58:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205fd46640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20580cf2e0 0x7f205806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205fd46640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f20580d11b0 0x7f205806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205fd46640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20580d1740 con 0x7f205806e2c0 2024-04-26T21:58:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205fd46640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f205806e710 con 0x7f20580cf2e0 2024-04-26T21:58:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205fd46640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f20580d1a20 con 0x7f20580d11b0 2024-04-26T21:58:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205dae2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20580cf2e0 0x7f205806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205dae2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20580cf2e0 0x7f205806d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41556/0 (socket says 172.21.15.137:41556) 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205dae2640 1 -- 172.21.15.137:0/2282894022 learned_addr learned my addr 172.21.15.137:0/2282894022 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205d2e1640 1 --2- 172.21.15.137:0/2282894022 >> v2:172.21.15.170:3300/0 conn(0x7f20580d11b0 0x7f205806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205dae2640 1 -- 172.21.15.137:0/2282894022 >> v2:172.21.15.170:3300/0 conn(0x7f20580d11b0 msgr2=0x7f205806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205dae2640 1 --2- 172.21.15.137:0/2282894022 >> v2:172.21.15.170:3300/0 conn(0x7f20580d11b0 0x7f205806dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205dae2640 1 -- 172.21.15.137:0/2282894022 >> v1:172.21.15.170:6789/0 conn(0x7f205806e2c0 legacy=0x7f205815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205dae2640 1 -- 172.21.15.137:0/2282894022 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20580d1d00 con 0x7f20580cf2e0 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.533+0000 7f205d2e1640 1 --2- 172.21.15.137:0/2282894022 >> v2:172.21.15.170:3300/0 conn(0x7f20580d11b0 0x7f205806dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.534+0000 7f205dae2640 1 --2- 172.21.15.137:0/2282894022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 0x7f205806d4d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2054009870 tx=0x7f205402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dadaf6ff4fd73a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.534+0000 7f205cae0640 1 -- 172.21.15.137:0/2282894022 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054037070 con 0x7f20580cf2e0 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.534+0000 7f205cae0640 1 -- 172.21.15.137:0/2282894022 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2054032440 con 0x7f20580cf2e0 2024-04-26T21:58:37.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.534+0000 7f205cae0640 1 -- 172.21.15.137:0/2282894022 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2054032810 con 0x7f20580cf2e0 2024-04-26T21:58:37.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.535+0000 7f205fd46640 1 -- 172.21.15.137:0/2282894022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 msgr2=0x7f205806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.535+0000 7f205fd46640 1 --2- 172.21.15.137:0/2282894022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 0x7f205806d4d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2054009870 tx=0x7f205402a270 comp rx=0 tx=0).stop 2024-04-26T21:58:37.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.535+0000 7f205fd46640 1 -- 172.21.15.137:0/2282894022 shutdown_connections 2024-04-26T21:58:37.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.535+0000 7f205fd46640 1 --2- 172.21.15.137:0/2282894022 >> v2:172.21.15.170:3300/0 conn(0x7f20580d11b0 0x7f205806dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.535+0000 7f205fd46640 1 --2- 172.21.15.137:0/2282894022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 0x7f205806d4d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.535+0000 7f205fd46640 1 -- 172.21.15.137:0/2282894022 >> 172.21.15.137:0/2282894022 conn(0x7f20580b4a60 msgr2=0x7f20580b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:37.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.535+0000 7f205fd46640 1 -- 172.21.15.137:0/2282894022 shutdown_connections 2024-04-26T21:58:37.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.535+0000 7f205fd46640 1 -- 172.21.15.137:0/2282894022 wait complete. 2024-04-26T21:58:37.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.536+0000 7f205fd46640 1 Processor -- start 2024-04-26T21:58:37.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.536+0000 7f205fd46640 1 -- start start 2024-04-26T21:58:37.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205fd46640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806e2c0 0x7f20581ea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205fd46640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 0x7f205814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205fd46640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20580d11b0 0x7f205815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205fd46640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f205806da10 con 0x7f20580cf2e0 2024-04-26T21:58:37.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205fd46640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f20580d22c0 con 0x7f20580d11b0 2024-04-26T21:58:37.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205fd46640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f20580cf6c0 con 0x7f205806e2c0 2024-04-26T21:58:37.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205d2e1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 0x7f205814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205d2e1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 0x7f205814f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41568/0 (socket says 172.21.15.137:41568) 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205d2e1640 1 -- 172.21.15.137:0/3599880961 learned_addr learned my addr 172.21.15.137:0/3599880961 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205d2e1640 1 -- 172.21.15.137:0/3599880961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806e2c0 msgr2=0x7f20581ea7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205d2e1640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806e2c0 0x7f20581ea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205d2e1640 1 -- 172.21.15.137:0/3599880961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20580d11b0 msgr2=0x7f205815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205d2e1640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20580d11b0 0x7f205815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205d2e1640 1 -- 172.21.15.137:0/3599880961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20581eacf0 con 0x7f20580cf2e0 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205d2e1640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 0x7f205814f230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f204800c7f0 tx=0x7f204800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f204e7fc640 1 -- 172.21.15.137:0/3599880961 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048015070 con 0x7f20580cf2e0 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f204e7fc640 1 -- 172.21.15.137:0/3599880961 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2048007820 con 0x7f20580cf2e0 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205814f770 con 0x7f20580cf2e0 2024-04-26T21:58:37.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f204e7fc640 1 -- 172.21.15.137:0/3599880961 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048007bd0 con 0x7f20580cf2e0 2024-04-26T21:58:37.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.537+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20581eb270 con 0x7f20580cf2e0 2024-04-26T21:58:37.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.538+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205806a290 con 0x7f20580cf2e0 2024-04-26T21:58:37.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.539+0000 7f204e7fc640 1 -- 172.21.15.137:0/3599880961 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2048018070 con 0x7f20580cf2e0 2024-04-26T21:58:37.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.539+0000 7f204e7fc640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203c06c8f0 0x7f203c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.539+0000 7f204e7fc640 1 -- 172.21.15.137:0/3599880961 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f204808b9a0 con 0x7f20580cf2e0 2024-04-26T21:58:37.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.539+0000 7f205dae2640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203c06c8f0 0x7f203c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.539+0000 7f205dae2640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203c06c8f0 0x7f203c06edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2054034000 tx=0x7f205402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:37.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.543+0000 7f204e7fc640 1 -- 172.21.15.137:0/3599880961 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f204805a090 con 0x7f20580cf2e0 2024-04-26T21:58:37.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.722+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f205809c5a0 con 0x7f20580cf2e0 2024-04-26T21:58:37.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.723+0000 7f204e7fc640 1 -- 172.21.15.137:0/3599880961 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12896 (secure 0 0 0) 0x7f2048059990 con 0x7f20580cf2e0 2024-04-26T21:58:37.723 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:37.723 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":17,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:31.195924+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:37.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203c06c8f0 msgr2=0x7f203c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203c06c8f0 0x7f203c06edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2054034000 tx=0x7f205402c000 comp rx=0 tx=0).stop 2024-04-26T21:58:37.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 msgr2=0x7f205814f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 0x7f205814f230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f204800c7f0 tx=0x7f204800ccb0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 shutdown_connections 2024-04-26T21:58:37.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203c06c8f0 0x7f203c06edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20580cf2e0 0x7f205814f230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20580d11b0 0x7f205815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 --2- 172.21.15.137:0/3599880961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806e2c0 0x7f20581ea7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 >> 172.21.15.137:0/3599880961 conn(0x7f20580b4a60 msgr2=0x7f20580cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:37.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 shutdown_connections 2024-04-26T21:58:37.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.725+0000 7f205fd46640 1 -- 172.21.15.137:0/3599880961 wait complete. 2024-04-26T21:58:37.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:58:37.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:58:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.836+0000 7f6af3ecc640 1 Processor -- start 2024-04-26T21:58:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.836+0000 7f6af3ecc640 1 -- start start 2024-04-26T21:58:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af3ecc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6aec15f490 0x7f6aec0d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af3ecc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6aec0d0ff0 0x7f6aec0d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af3ecc640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aec0d4240 con 0x7f6aec0d2120 2024-04-26T21:58:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af3ecc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6aec0d2570 con 0x7f6aec0d0ff0 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af3ecc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6aec0d31a0 con 0x7f6aec15f490 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af2469640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6aec0d2120 0x7f6aec0ba3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45952/0 (socket says 172.21.15.137:45952) 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af2469640 1 -- 172.21.15.137:0/242574149 learned_addr learned my addr 172.21.15.137:0/242574149 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af1467640 1 --2- 172.21.15.137:0/242574149 >> v2:172.21.15.170:3300/0 conn(0x7f6aec0d0ff0 0x7f6aec0d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af1c68640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6aec15f490 0x7f6aec0d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824178330 0 0) 0x7f6aec0d4240 con 0x7f6aec0d2120 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad8003520 con 0x7f6aec0d2120 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2657661297 0 0) 0x7f6ad8003520 con 0x7f6aec0d2120 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6aec15f490 msgr2=0x7f6aec0d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6aec15f490 0x7f6aec0d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 >> v2:172.21.15.170:3300/0 conn(0x7f6aec0d0ff0 msgr2=0x7f6aec0d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 --2- 172.21.15.137:0/242574149 >> v2:172.21.15.170:3300/0 conn(0x7f6aec0d0ff0 0x7f6aec0d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec0d3480 con 0x7f6aec0d2120 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6ae40019f0 con 0x7f6aec0d2120 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 >> v1:172.21.15.137:6789/0 conn(0x7f6aec0d2120 legacy=0x7f6aec0ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6aec15f490 0x7f6ad80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad8003f30 0x7f6ad8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad8004d40 0x7f6ad80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec0d2570 con 0x7f6ad8003f30 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec0d31a0 con 0x7f6ad8004d40 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad800b9c0 con 0x7f6aec15f490 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af1467640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad8003f30 0x7f6ad8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.837+0000 7f6af1c68640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6aec15f490 0x7f6ad80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.838+0000 7f6af2469640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad8004d40 0x7f6ad80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.838+0000 7f6af1467640 1 -- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6aec15f490 msgr2=0x7f6ad80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:37.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.838+0000 7f6af1467640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6aec15f490 0x7f6ad80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.838+0000 7f6af1467640 1 -- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad8004d40 msgr2=0x7f6ad80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.838+0000 7f6af1467640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad8004d40 0x7f6ad80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.838+0000 7f6af1467640 1 -- 172.21.15.137:0/242574149 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad8003520 con 0x7f6ad8003f30 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.838+0000 7f6af1467640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad8003f30 0x7f6ad8004800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009a90 tx=0x7f6ad8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4740b2e2b71b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc036070 con 0x7f6ad8003f30 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6adc031400 con 0x7f6ad8003f30 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af0c66640 1 -- 172.21.15.137:0/242574149 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc009690 con 0x7f6ad8003f30 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af3ecc640 1 -- 172.21.15.137:0/242574149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad8003f30 msgr2=0x7f6ad8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af3ecc640 1 --2- 172.21.15.137:0/242574149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ad8003f30 0x7f6ad8004800 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009a90 tx=0x7f6ad8005830 comp rx=0 tx=0).stop 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af2469640 1 -- 172.21.15.137:0/242574149 reap_dead start 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af3ecc640 1 -- 172.21.15.137:0/242574149 shutdown_connections 2024-04-26T21:58:37.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af3ecc640 1 -- 172.21.15.137:0/242574149 >> 172.21.15.137:0/242574149 conn(0x7f6aec09e530 msgr2=0x7f6aec0d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:37.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af3ecc640 1 -- 172.21.15.137:0/242574149 shutdown_connections 2024-04-26T21:58:37.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.839+0000 7f6af3ecc640 1 -- 172.21.15.137:0/242574149 wait complete. 2024-04-26T21:58:37.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.840+0000 7f6af3ecc640 1 Processor -- start 2024-04-26T21:58:37.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.840+0000 7f6af3ecc640 1 -- start start 2024-04-26T21:58:37.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af3ecc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad8003f30 0x7f6aec152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af3ecc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aec0cdae0 0x7f6aec0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af3ecc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec0b6700 0x7f6aec0b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af3ecc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec0d3d20 con 0x7f6aec0cdae0 2024-04-26T21:58:37.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af3ecc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec0d3a40 con 0x7f6aec0b6700 2024-04-26T21:58:37.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af3ecc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6aec15f870 con 0x7f6ad8003f30 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1467640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aec0cdae0 0x7f6aec0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1467640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aec0cdae0 0x7f6aec0cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41590/0 (socket says 172.21.15.137:41590) 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1467640 1 -- 172.21.15.137:0/2552202302 learned_addr learned my addr 172.21.15.137:0/2552202302 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1c68640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad8003f30 0x7f6aec152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af2469640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec0b6700 0x7f6aec0b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1467640 1 -- 172.21.15.137:0/2552202302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad8003f30 msgr2=0x7f6aec152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1467640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad8003f30 0x7f6aec152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1467640 1 -- 172.21.15.137:0/2552202302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec0b6700 msgr2=0x7f6aec0b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1467640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec0b6700 0x7f6aec0b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1467640 1 -- 172.21.15.137:0/2552202302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec0cf5d0 con 0x7f6aec0cdae0 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.841+0000 7f6af1c68640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad8003f30 0x7f6aec152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.842+0000 7f6af1467640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aec0cdae0 0x7f6aec0cdf40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009bb0 tx=0x7f6adc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.842+0000 7f6ae27fc640 1 -- 172.21.15.137:0/2552202302 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc040020 con 0x7f6aec0cdae0 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.842+0000 7f6ae27fc640 1 -- 172.21.15.137:0/2552202302 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6adc003c60 con 0x7f6aec0cdae0 2024-04-26T21:58:37.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.842+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aec152ba0 con 0x7f6aec0cdae0 2024-04-26T21:58:37.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.842+0000 7f6ae27fc640 1 -- 172.21.15.137:0/2552202302 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc036040 con 0x7f6aec0cdae0 2024-04-26T21:58:37.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.842+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aec0ce810 con 0x7f6aec0cdae0 2024-04-26T21:58:37.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.843+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aec06a290 con 0x7f6aec0cdae0 2024-04-26T21:58:37.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.843+0000 7f6ae27fc640 1 -- 172.21.15.137:0/2552202302 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6adc043020 con 0x7f6aec0cdae0 2024-04-26T21:58:37.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.844+0000 7f6ae27fc640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ad006c8f0 0x7f6ad006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:37.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.844+0000 7f6af1c68640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ad006c8f0 0x7f6ad006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:37.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.844+0000 7f6ae27fc640 1 -- 172.21.15.137:0/2552202302 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6adc0ab9d0 con 0x7f6aec0cdae0 2024-04-26T21:58:37.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.844+0000 7f6af1c68640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ad006c8f0 0x7f6ad006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009ae0 tx=0x7f6ae8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:37.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:37.848+0000 7f6ae27fc640 1 -- 172.21.15.137:0/2552202302 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6adc04a070 con 0x7f6aec0cdae0 2024-04-26T21:58:38.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.024+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6aec074760 con 0x7f6aec0cdae0 2024-04-26T21:58:38.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.024+0000 7f6ae27fc640 1 -- 172.21.15.137:0/2552202302 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f6aec152ba0 con 0x7f6aec0cdae0 2024-04-26T21:58:38.025 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:58:38.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ad006c8f0 msgr2=0x7f6ad006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ad006c8f0 0x7f6ad006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009ae0 tx=0x7f6ae8008040 comp rx=0 tx=0).stop 2024-04-26T21:58:38.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aec0cdae0 msgr2=0x7f6aec0cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aec0cdae0 0x7f6aec0cdf40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009bb0 tx=0x7f6adc004730 comp rx=0 tx=0).stop 2024-04-26T21:58:38.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 shutdown_connections 2024-04-26T21:58:38.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ad006c8f0 0x7f6ad006edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6aec0cdae0 0x7f6aec0cdf40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6aec0b6700 0x7f6aec0b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 --2- 172.21.15.137:0/2552202302 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad8003f30 0x7f6aec152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 >> 172.21.15.137:0/2552202302 conn(0x7f6aec09e530 msgr2=0x7f6aec15d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:38.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 shutdown_connections 2024-04-26T21:58:38.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.026+0000 7f6af3ecc640 1 -- 172.21.15.137:0/2552202302 wait complete. 2024-04-26T21:58:38.037 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T21:58:38.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.133+0000 7fad6a151640 1 Processor -- start 2024-04-26T21:58:38.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.134+0000 7fad6a151640 1 -- start start 2024-04-26T21:58:38.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.134+0000 7fad6a151640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad64073650 0x7fad640b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.134+0000 7fad6a151640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad640716a0 con 0x7fad640731c0 2024-04-26T21:58:38.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.134+0000 7fad6a151640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad64073ae0 con 0x7fad64153050 2024-04-26T21:58:38.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.134+0000 7fad6a151640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fad64070280 con 0x7fad64073650 2024-04-26T21:58:38.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.134+0000 7fad5bfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fad640731c0 0x7fad640b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45962/0 (socket says 172.21.15.137:45962) 2024-04-26T21:58:38.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.134+0000 7fad5bfff640 1 -- 172.21.15.137:0/1433252325 learned_addr learned my addr 172.21.15.137:0/1433252325 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:38.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad63fff640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad64073650 0x7fad640b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296105477 0 0) 0x7fad640716a0 con 0x7fad640731c0 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad50003520 con 0x7fad640731c0 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1165481990 0 0) 0x7fad50003520 con 0x7fad640731c0 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad64073650 msgr2=0x7fad640b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad64073650 0x7fad640b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 >> v1:172.21.15.170:6789/0 conn(0x7fad64153050 legacy=0x7fad64070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6406f670 con 0x7fad640731c0 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fad4c001690 con 0x7fad640731c0 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 >> v1:172.21.15.137:6789/0 conn(0x7fad640731c0 legacy=0x7fad640b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad500039e0 0x7fad50003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad50004390 0x7fad50004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad64073650 0x7fad500050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad64070280 con 0x7fad50004390 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fad5000b9c0 con 0x7fad500039e0 2024-04-26T21:58:38.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fad5000bbc0 con 0x7fad64073650 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad5bfff640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad50004390 0x7fad50004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad637fe640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad500039e0 0x7fad50003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad63fff640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad64073650 0x7fad500050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad5bfff640 1 -- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad64073650 msgr2=0x7fad500050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad5bfff640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad64073650 0x7fad500050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad5bfff640 1 -- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad500039e0 msgr2=0x7fad50003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad5bfff640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad500039e0 0x7fad50003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.135+0000 7fad5bfff640 1 -- 172.21.15.137:0/1433252325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad50003520 con 0x7fad50004390 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.136+0000 7fad5bfff640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad50004390 0x7fad50004860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad64071870 tx=0x7fad50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93be6b24a5e10924 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.136+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c007ce0 con 0x7fad50004390 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.136+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4c005ad0 con 0x7fad50004390 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.136+0000 7fad62ffd640 1 -- 172.21.15.137:0/1433252325 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c007070 con 0x7fad50004390 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.137+0000 7fad6a151640 1 -- 172.21.15.137:0/1433252325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad50004390 msgr2=0x7fad50004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.137+0000 7fad6a151640 1 --2- 172.21.15.137:0/1433252325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad50004390 0x7fad50004860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad64071870 tx=0x7fad50005830 comp rx=0 tx=0).stop 2024-04-26T21:58:38.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.137+0000 7fad63fff640 1 -- 172.21.15.137:0/1433252325 reap_dead start 2024-04-26T21:58:38.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.137+0000 7fad6a151640 1 -- 172.21.15.137:0/1433252325 shutdown_connections 2024-04-26T21:58:38.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.137+0000 7fad6a151640 1 -- 172.21.15.137:0/1433252325 >> 172.21.15.137:0/1433252325 conn(0x7fad640b3c40 msgr2=0x7fad640b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:38.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.137+0000 7fad6a151640 1 -- 172.21.15.137:0/1433252325 shutdown_connections 2024-04-26T21:58:38.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.137+0000 7fad6a151640 1 -- 172.21.15.137:0/1433252325 wait complete. 2024-04-26T21:58:38.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.138+0000 7fad6a151640 1 Processor -- start 2024-04-26T21:58:38.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.138+0000 7fad6a151640 1 -- start start 2024-04-26T21:58:38.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad6a151640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad50004390 0x7fad6414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad6a151640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad640cf780 0x7fad640cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad6a151640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad6415afa0 0x7fad6415b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad6a151640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad6406fc30 con 0x7fad6415afa0 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad6a151640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fad64153430 con 0x7fad640cf780 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad6a151640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fad6406ff10 con 0x7fad50004390 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad63fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad6415afa0 0x7fad6415b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad63fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad6415afa0 0x7fad6415b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41608/0 (socket says 172.21.15.137:41608) 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad63fff640 1 -- 172.21.15.137:0/2807179528 learned_addr learned my addr 172.21.15.137:0/2807179528 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad5bfff640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad640cf780 0x7fad640cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad637fe640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad50004390 0x7fad6414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad63fff640 1 -- 172.21.15.137:0/2807179528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad50004390 msgr2=0x7fad6414ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad63fff640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad50004390 0x7fad6414ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad63fff640 1 -- 172.21.15.137:0/2807179528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad640cf780 msgr2=0x7fad640cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad63fff640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad640cf780 0x7fad640cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad63fff640 1 -- 172.21.15.137:0/2807179528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad6414ef50 con 0x7fad6415afa0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad5bfff640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad640cf780 0x7fad640cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad63fff640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad6415afa0 0x7fad6415b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad6415fab0 tx=0x7fad5c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad60ff9640 1 -- 172.21.15.137:0/2807179528 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c015430 con 0x7fad6415afa0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad60ff9640 1 -- 172.21.15.137:0/2807179528 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad5c01d070 con 0x7fad6415afa0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad64156560 con 0x7fad6415afa0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad60ff9640 1 -- 172.21.15.137:0/2807179528 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad5c015810 con 0x7fad6415afa0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.139+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad641f6670 con 0x7fad6415afa0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.140+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad640693d0 con 0x7fad6415afa0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.141+0000 7fad60ff9640 1 -- 172.21.15.137:0/2807179528 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad5c0159b0 con 0x7fad6415afa0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.141+0000 7fad60ff9640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad4406c920 0x7fad4406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.141+0000 7fad60ff9640 1 -- 172.21.15.137:0/2807179528 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fad5c08c1b0 con 0x7fad6415afa0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.141+0000 7fad637fe640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad4406c920 0x7fad4406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.142+0000 7fad637fe640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad4406c920 0x7fad4406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad540035f0 tx=0x7fad54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:38.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.146+0000 7fad60ff9640 1 -- 172.21.15.137:0/2807179528 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fad6414ef50 con 0x7fad6415afa0 2024-04-26T21:58:38.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.324+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fad6415d280 con 0x7fad6415afa0 2024-04-26T21:58:38.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.324+0000 7fad60ff9640 1 -- 172.21.15.137:0/2807179528 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fad5c010040 con 0x7fad6415afa0 2024-04-26T21:58:38.325 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:38.325 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T21:58:38.325 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:58:38.325 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T21:58:38.325 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T21:58:38.325 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:58:38.325 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad4406c920 msgr2=0x7fad4406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad4406c920 0x7fad4406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fad540035f0 tx=0x7fad54009040 comp rx=0 tx=0).stop 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad6415afa0 msgr2=0x7fad6415b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad6415afa0 0x7fad6415b420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fad6415fab0 tx=0x7fad5c00f580 comp rx=0 tx=0).stop 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 shutdown_connections 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad4406c920 0x7fad4406ede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad6415afa0 0x7fad6415b420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad640cf780 0x7fad640cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 --2- 172.21.15.137:0/2807179528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad50004390 0x7fad6414ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.326+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 >> 172.21.15.137:0/2807179528 conn(0x7fad640b3c40 msgr2=0x7fad640b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:38.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.327+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 shutdown_connections 2024-04-26T21:58:38.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.327+0000 7fad6a151640 1 -- 172.21.15.137:0/2807179528 wait complete. 2024-04-26T21:58:38.337 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T21:58:38.337 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T21:58:38.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.437+0000 7fc783647640 1 Processor -- start 2024-04-26T21:58:38.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.437+0000 7fc783647640 1 -- start start 2024-04-26T21:58:38.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.438+0000 7fc783647640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc77c160410 0x7fc77c06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.438+0000 7fc783647640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77c160810 con 0x7fc77c06f760 2024-04-26T21:58:38.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.438+0000 7fc783647640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77c145c90 con 0x7fc77c1458b0 2024-04-26T21:58:38.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.438+0000 7fc783647640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc77c0d0790 con 0x7fc77c160410 2024-04-26T21:58:38.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.438+0000 7fc780be2640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc77c06f760 0x7fc77c15fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45966/0 (socket says 172.21.15.137:45966) 2024-04-26T21:58:38.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.438+0000 7fc780be2640 1 -- 172.21.15.137:0/152273416 learned_addr learned my addr 172.21.15.137:0/152273416 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201372146 0 0) 0x7fc77c160810 con 0x7fc77c06f760 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc768003520 con 0x7fc77c06f760 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc781be4640 1 --2- 172.21.15.137:0/152273416 >> v2:172.21.15.170:3300/0 conn(0x7fc77c160410 0x7fc77c06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 120324855 0 0) 0x7fc768003520 con 0x7fc77c06f760 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 >> v2:172.21.15.170:3300/0 conn(0x7fc77c160410 msgr2=0x7fc77c06fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 --2- 172.21.15.137:0/152273416 >> v2:172.21.15.170:3300/0 conn(0x7fc77c160410 0x7fc77c06fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 >> v1:172.21.15.170:6789/0 conn(0x7fc77c1458b0 legacy=0x7fc77c0d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c0d09c0 con 0x7fc77c06f760 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fc76c001670 con 0x7fc77c06f760 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 >> v1:172.21.15.137:6789/0 conn(0x7fc77c06f760 legacy=0x7fc77c15fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc768003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc768004800 0x7fc768004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7680051c0 0x7fc76800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc76800c090 con 0x7fc768003a00 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc76800c240 con 0x7fc7680051c0 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc76800c440 con 0x7fc768004800 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc7813e3640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc768003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc781be4640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7680051c0 0x7fc76800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc780be2640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc768004800 0x7fc768004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc7813e3640 1 -- 172.21.15.137:0/152273416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc768004800 msgr2=0x7fc768004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc7813e3640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc768004800 0x7fc768004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc7813e3640 1 -- 172.21.15.137:0/152273416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7680051c0 msgr2=0x7fc76800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:38.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc7813e3640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7680051c0 0x7fc76800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc781be4640 1 -- 172.21.15.137:0/152273416 reap_dead start 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.439+0000 7fc7813e3640 1 -- 172.21.15.137:0/152273416 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc768003520 con 0x7fc768003a00 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.440+0000 7fc7813e3640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc768003e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc778001e50 tx=0x7fc768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993c28cc144697b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.440+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778001a70 con 0x7fc768003a00 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.440+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77802ae40 con 0x7fc768003a00 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.440+0000 7fc773fff640 1 -- 172.21.15.137:0/152273416 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778003bb0 con 0x7fc768003a00 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.441+0000 7fc783647640 1 -- 172.21.15.137:0/152273416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 msgr2=0x7fc768003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.441+0000 7fc783647640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc768003e20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc778001e50 tx=0x7fc768005830 comp rx=0 tx=0).stop 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.441+0000 7fc783647640 1 -- 172.21.15.137:0/152273416 shutdown_connections 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.441+0000 7fc783647640 1 --2- 172.21.15.137:0/152273416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc768003e20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.441+0000 7fc783647640 1 -- 172.21.15.137:0/152273416 >> 172.21.15.137:0/152273416 conn(0x7fc77c0b7460 msgr2=0x7fc77c0b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:38.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.441+0000 7fc783647640 1 -- 172.21.15.137:0/152273416 shutdown_connections 2024-04-26T21:58:38.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.441+0000 7fc783647640 1 -- 172.21.15.137:0/152273416 wait complete. 2024-04-26T21:58:38.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.442+0000 7fc783647640 1 Processor -- start 2024-04-26T21:58:38.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.442+0000 7fc783647640 1 -- start start 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc783647640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc77c13d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc783647640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc77c16ac50 0x7fc77c16b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc783647640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc77c15cab0 0x7fc77c15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc783647640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c0d0f80 con 0x7fc768003a00 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc783647640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c160aa0 con 0x7fc77c16ac50 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc783647640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc77c0d1260 con 0x7fc77c15cab0 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc7813e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc77c13d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc7813e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc77c13d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41628/0 (socket says 172.21.15.137:41628) 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc7813e3640 1 -- 172.21.15.137:0/1579579751 learned_addr learned my addr 172.21.15.137:0/1579579751 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:38.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc780be2640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc77c16ac50 0x7fc77c16b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc7813e3640 1 -- 172.21.15.137:0/1579579751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc77c15cab0 msgr2=0x7fc77c15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc7813e3640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc77c15cab0 0x7fc77c15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc7813e3640 1 -- 172.21.15.137:0/1579579751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc77c16ac50 msgr2=0x7fc77c16b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc7813e3640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc77c16ac50 0x7fc77c16b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc7813e3640 1 -- 172.21.15.137:0/1579579751 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c1440f0 con 0x7fc768003a00 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc780be2640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc77c16ac50 0x7fc77c16b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc7813e3640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc77c13d020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc778001f70 tx=0x7fc7780014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc771ffb640 1 -- 172.21.15.137:0/1579579751 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778040030 con 0x7fc768003a00 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc771ffb640 1 -- 172.21.15.137:0/1579579751 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77802ac40 con 0x7fc768003a00 2024-04-26T21:58:38.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77c1443d0 con 0x7fc768003a00 2024-04-26T21:58:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.443+0000 7fc771ffb640 1 -- 172.21.15.137:0/1579579751 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778007db0 con 0x7fc768003a00 2024-04-26T21:58:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.444+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77c144990 con 0x7fc768003a00 2024-04-26T21:58:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.444+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc77c0693d0 con 0x7fc768003a00 2024-04-26T21:58:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.445+0000 7fc771ffb640 1 -- 172.21.15.137:0/1579579751 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc778043070 con 0x7fc768003a00 2024-04-26T21:58:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.445+0000 7fc771ffb640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc76006c8f0 0x7fc76006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.445+0000 7fc780be2640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc76006c8f0 0x7fc76006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.445+0000 7fc771ffb640 1 -- 172.21.15.137:0/1579579751 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc7780ab850 con 0x7fc768003a00 2024-04-26T21:58:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.446+0000 7fc780be2640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc76006c8f0 0x7fc76006edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc76c001050 tx=0x7fc76c001e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:38.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.450+0000 7fc771ffb640 1 -- 172.21.15.137:0/1579579751 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc77807a090 con 0x7fc768003a00 2024-04-26T21:58:38.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:38.625+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc77c074150 con 0x7fc768003a00 2024-04-26T21:58:39.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.236+0000 7fc771ffb640 1 -- 172.21.15.137:0/1579579751 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fc778044e40 con 0x7fc768003a00 2024-04-26T21:58:39.236 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc76006c8f0 msgr2=0x7fc76006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc76006c8f0 0x7fc76006edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc76c001050 tx=0x7fc76c001e30 comp rx=0 tx=0).stop 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 msgr2=0x7fc77c13d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc77c13d020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc778001f70 tx=0x7fc7780014a0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 shutdown_connections 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc76006c8f0 0x7fc76006edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc77c15cab0 0x7fc77c15cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc77c16ac50 0x7fc77c16b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 --2- 172.21.15.137:0/1579579751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc768003a00 0x7fc77c13d020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 >> 172.21.15.137:0/1579579751 conn(0x7fc77c0b7460 msgr2=0x7fc77c0b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 shutdown_connections 2024-04-26T21:58:39.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.238+0000 7fc783647640 1 -- 172.21.15.137:0/1579579751 wait complete. 2024-04-26T21:58:39.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T21:58:39.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.359+0000 7fa4fde20640 1 Processor -- start 2024-04-26T21:58:39.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.359+0000 7fa4fde20640 1 -- start start 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4fde20640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80d2170 0x7fa4f80d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4fde20640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa4f80b6050 0x7fa4f80cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4fde20640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f80d33d0 con 0x7fa4f8162a40 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4fde20640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f80b49a0 con 0x7fa4f80b6050 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4fde20640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f80d36b0 con 0x7fa4f80d2170 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4f7fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa4f80b6050 0x7fa4f80cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4f77fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa4f8162a40 0x7fa4f80d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45980/0 (socket says 172.21.15.137:45980) 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4f77fe640 1 -- 172.21.15.137:0/3618170349 learned_addr learned my addr 172.21.15.137:0/3618170349 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4f6ffd640 1 --2- 172.21.15.137:0/3618170349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80d2170 0x7fa4f80d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4f7fff640 1 -- 172.21.15.137:0/3618170349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80d2170 msgr2=0x7fa4f80d2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4f7fff640 1 --2- 172.21.15.137:0/3618170349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80d2170 0x7fa4f80d2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4f7fff640 1 -- 172.21.15.137:0/3618170349 >> v1:172.21.15.137:6789/0 conn(0x7fa4f8162a40 legacy=0x7fa4f80d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:39.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4f7fff640 1 -- 172.21.15.137:0/3618170349 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f80d3990 con 0x7fa4f80b6050 2024-04-26T21:58:39.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.360+0000 7fa4f67fc640 1 -- 172.21.15.137:0/3618170349 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494320655 0 0) 0x7fa4f80d33d0 con 0x7fa4f8162a40 2024-04-26T21:58:39.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.361+0000 7fa4f7fff640 1 --2- 172.21.15.137:0/3618170349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f80b6050 0x7fa4f80cffe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009d90 tx=0x7fa4f002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10444bc0268177d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:39.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.361+0000 7fa4f67fc640 1 -- 172.21.15.137:0/3618170349 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0007740 con 0x7fa4f80b6050 2024-04-26T21:58:39.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.361+0000 7fa4f67fc640 1 -- 172.21.15.137:0/3618170349 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f00078e0 con 0x7fa4f80b6050 2024-04-26T21:58:39.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.361+0000 7fa4f67fc640 1 -- 172.21.15.137:0/3618170349 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0007cb0 con 0x7fa4f80b6050 2024-04-26T21:58:39.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.362+0000 7fa4fde20640 1 -- 172.21.15.137:0/3618170349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f80b6050 msgr2=0x7fa4f80cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:39.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.362+0000 7fa4fde20640 1 --2- 172.21.15.137:0/3618170349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f80b6050 0x7fa4f80cffe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009d90 tx=0x7fa4f002a660 comp rx=0 tx=0).stop 2024-04-26T21:58:39.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.362+0000 7fa4fde20640 1 -- 172.21.15.137:0/3618170349 shutdown_connections 2024-04-26T21:58:39.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.362+0000 7fa4fde20640 1 --2- 172.21.15.137:0/3618170349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f80b6050 0x7fa4f80cffe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.362+0000 7fa4fde20640 1 --2- 172.21.15.137:0/3618170349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80d2170 0x7fa4f80d2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.362+0000 7fa4fde20640 1 -- 172.21.15.137:0/3618170349 >> 172.21.15.137:0/3618170349 conn(0x7fa4f809e560 msgr2=0x7fa4f80d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:39.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.362+0000 7fa4fde20640 1 -- 172.21.15.137:0/3618170349 shutdown_connections 2024-04-26T21:58:39.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.362+0000 7fa4fde20640 1 -- 172.21.15.137:0/3618170349 wait complete. 2024-04-26T21:58:39.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.363+0000 7fa4fde20640 1 Processor -- start 2024-04-26T21:58:39.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.363+0000 7fa4fde20640 1 -- start start 2024-04-26T21:58:39.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4fde20640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80b6050 0x7fa4f815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4fde20640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4f80d2170 0x7fa4f8159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4fde20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f8162a40 0x7fa4f80ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4fde20640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f8162e20 con 0x7fa4f8162a40 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4fde20640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f80d3f50 con 0x7fa4f80d2170 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4fde20640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f80b6630 con 0x7fa4f80b6050 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f8162a40 0x7fa4f80ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f8162a40 0x7fa4f80ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41640/0 (socket says 172.21.15.137:41640) 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f7fff640 1 -- 172.21.15.137:0/2278944593 learned_addr learned my addr 172.21.15.137:0/2278944593 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f77fe640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80b6050 0x7fa4f815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f7fff640 1 -- 172.21.15.137:0/2278944593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80b6050 msgr2=0x7fa4f815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f6ffd640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4f80d2170 0x7fa4f8159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f7fff640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80b6050 0x7fa4f815bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f7fff640 1 -- 172.21.15.137:0/2278944593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4f80d2170 msgr2=0x7fa4f8159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f7fff640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4f80d2170 0x7fa4f8159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f7fff640 1 -- 172.21.15.137:0/2278944593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f815a060 con 0x7fa4f8162a40 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4f7fff640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f8162a40 0x7fa4f80ca1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4f002ac50 tx=0x7fa4f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4dffff640 1 -- 172.21.15.137:0/2278944593 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f003f070 con 0x7fa4f8162a40 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4dffff640 1 -- 172.21.15.137:0/2278944593 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f0031bc0 con 0x7fa4f8162a40 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f80cab10 con 0x7fa4f8162a40 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.364+0000 7fa4dffff640 1 -- 172.21.15.137:0/2278944593 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f0044460 con 0x7fa4f8162a40 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.365+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f815b030 con 0x7fa4f8162a40 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.365+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f806e9f0 con 0x7fa4f8162a40 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.366+0000 7fa4dffff640 1 -- 172.21.15.137:0/2278944593 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4f0007790 con 0x7fa4f8162a40 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.366+0000 7fa4dffff640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4e406c8f0 0x7fa4e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.366+0000 7fa4dffff640 1 -- 172.21.15.137:0/2278944593 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fa4f00ad1f0 con 0x7fa4f8162a40 2024-04-26T21:58:39.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.366+0000 7fa4f77fe640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4e406c8f0 0x7fa4e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:39.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.367+0000 7fa4f77fe640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4e406c8f0 0x7fa4e406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8007fd0 tx=0x7fa4e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:39.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.371+0000 7fa4dffff640 1 -- 172.21.15.137:0/2278944593 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa4f806e9f0 con 0x7fa4f8162a40 2024-04-26T21:58:39.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:39.547+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa4f806a290 con 0x7fa4f8162a40 2024-04-26T21:58:40.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.238+0000 7fa4dffff640 1 -- 172.21.15.137:0/2278944593 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fa4f007b800 con 0x7fa4f8162a40 2024-04-26T21:58:40.239 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T21:58:40.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.241+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4e406c8f0 msgr2=0x7fa4e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:40.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.241+0000 7fa4fde20640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4e406c8f0 0x7fa4e406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8007fd0 tx=0x7fa4e8009040 comp rx=0 tx=0).stop 2024-04-26T21:58:40.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.242+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f8162a40 msgr2=0x7fa4f80ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:40.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.242+0000 7fa4fde20640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f8162a40 0x7fa4f80ca1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4f002ac50 tx=0x7fa4f0004a40 comp rx=0 tx=0).stop 2024-04-26T21:58:40.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.242+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 shutdown_connections 2024-04-26T21:58:40.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.242+0000 7fa4fde20640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4e406c8f0 0x7fa4e406edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:40.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.242+0000 7fa4fde20640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4f8162a40 0x7fa4f80ca1a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:40.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.242+0000 7fa4fde20640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4f80d2170 0x7fa4f8159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:40.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.242+0000 7fa4fde20640 1 --2- 172.21.15.137:0/2278944593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4f80b6050 0x7fa4f815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:40.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.242+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 >> 172.21.15.137:0/2278944593 conn(0x7fa4f809e560 msgr2=0x7fa4f806e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:40.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.243+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 shutdown_connections 2024-04-26T21:58:40.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.244+0000 7fa4fde20640 1 -- 172.21.15.137:0/2278944593 wait complete. 2024-04-26T21:58:40.270 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T21:58:40.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.374+0000 7f755eabd640 1 Processor -- start 2024-04-26T21:58:40.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.374+0000 7f755eabd640 1 -- start start 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f755eabd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580d3340 0x7f75580d37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f755eabd640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75580b6aa0 con 0x7f755815f5b0 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f755eabd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75580d3eb0 con 0x7f755815f990 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f755eabd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f75580d4190 con 0x7f75580d3340 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f755c859640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f755815f5b0 0x7f75580b5070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45984/0 (socket says 172.21.15.137:45984) 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f755c859640 1 -- 172.21.15.137:0/2928172070 learned_addr learned my addr 172.21.15.137:0/2928172070 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f755d05a640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580d3340 0x7f75580d37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3235335098 0 0) 0x7f75580b6aa0 con 0x7f755815f5b0 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7540003520 con 0x7f755815f5b0 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.375+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1309663931 0 0) 0x7f7540003520 con 0x7f755815f5b0 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580d3340 msgr2=0x7f75580d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580d3340 0x7f75580d37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:40.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 >> v1:172.21.15.170:6789/0 conn(0x7f755815f990 legacy=0x7f75580d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75580d0200 con 0x7f755815f5b0 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f7548001670 con 0x7f755815f5b0 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 >> v1:172.21.15.137:6789/0 conn(0x7f755815f5b0 legacy=0x7f75580b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75400039e0 0x7f7540003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540004390 0x7f7540004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580d3340 0x7f7540005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f75580d4190 con 0x7f7540004390 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f754000ba70 con 0x7f75400039e0 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f754000bc70 con 0x7f75580d3340 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f7557fff640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540004390 0x7f7540004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f755c859640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75400039e0 0x7f7540003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f755d05a640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580d3340 0x7f7540005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f7557fff640 1 -- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580d3340 msgr2=0x7f7540005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:40.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f7557fff640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580d3340 0x7f7540005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f7557fff640 1 -- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75400039e0 msgr2=0x7f7540003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f7557fff640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75400039e0 0x7f7540003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.376+0000 7f7557fff640 1 -- 172.21.15.137:0/2928172070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7540003520 con 0x7f7540004390 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f7557fff640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540004390 0x7f7540004860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f754c001860 tx=0x7f7540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e394b28d605d7f55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c037070 con 0x7f7540004390 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754c02abf0 con 0x7f7540004390 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f75577fe640 1 -- 172.21.15.137:0/2928172070 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c001430 con 0x7f7540004390 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f755eabd640 1 -- 172.21.15.137:0/2928172070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540004390 msgr2=0x7f7540004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f755eabd640 1 --2- 172.21.15.137:0/2928172070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540004390 0x7f7540004860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f754c001860 tx=0x7f7540005830 comp rx=0 tx=0).stop 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f755d05a640 1 -- 172.21.15.137:0/2928172070 reap_dead start 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f755eabd640 1 -- 172.21.15.137:0/2928172070 shutdown_connections 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f755eabd640 1 -- 172.21.15.137:0/2928172070 >> 172.21.15.137:0/2928172070 conn(0x7f755808ec40 msgr2=0x7f755809e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f755eabd640 1 -- 172.21.15.137:0/2928172070 shutdown_connections 2024-04-26T21:58:40.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.377+0000 7f755eabd640 1 -- 172.21.15.137:0/2928172070 wait complete. 2024-04-26T21:58:40.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.379+0000 7f755eabd640 1 Processor -- start 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.379+0000 7f755eabd640 1 -- start start 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.379+0000 7f755eabd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7540004390 0x7f75580ba080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.379+0000 7f755eabd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580ba5c0 0x7f755815fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.379+0000 7f755eabd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75581602b0 0x7f7558161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.379+0000 7f755eabd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f75580b5900 con 0x7f75581602b0 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.379+0000 7f755eabd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f75580b5780 con 0x7f7540004390 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.379+0000 7f755eabd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f75580d1110 con 0x7f75580ba5c0 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755d05a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75581602b0 0x7f7558161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755d05a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75581602b0 0x7f7558161d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41672/0 (socket says 172.21.15.137:41672) 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755d05a640 1 -- 172.21.15.137:0/2326130337 learned_addr learned my addr 172.21.15.137:0/2326130337 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f7557fff640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580ba5c0 0x7f755815fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:40.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755c859640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7540004390 0x7f75580ba080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755d05a640 1 -- 172.21.15.137:0/2326130337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580ba5c0 msgr2=0x7f755815fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755d05a640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580ba5c0 0x7f755815fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755d05a640 1 -- 172.21.15.137:0/2326130337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7540004390 msgr2=0x7f75580ba080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755d05a640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7540004390 0x7f75580ba080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755d05a640 1 -- 172.21.15.137:0/2326130337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75580cc990 con 0x7f75581602b0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755d05a640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75581602b0 0x7f7558161d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7550011c80 tx=0x7f755000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f75557fa640 1 -- 172.21.15.137:0/2326130337 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550015430 con 0x7f75581602b0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f75557fa640 1 -- 172.21.15.137:0/2326130337 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755001d070 con 0x7f75581602b0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75580ccc00 con 0x7f75581602b0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f75557fa640 1 -- 172.21.15.137:0/2326130337 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550015830 con 0x7f75581602b0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.380+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75580cd1c0 con 0x7f75581602b0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.381+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f755806a290 con 0x7f75581602b0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.382+0000 7f75557fa640 1 -- 172.21.15.137:0/2326130337 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75500159d0 con 0x7f75581602b0 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.382+0000 7f75557fa640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f754406c920 0x7f754406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:40.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.382+0000 7f75557fa640 1 -- 172.21.15.137:0/2326130337 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f755008c4a0 con 0x7f75581602b0 2024-04-26T21:58:40.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.382+0000 7f755c859640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f754406c920 0x7f754406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:40.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.383+0000 7f755c859640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f754406c920 0x7f754406ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7548001200 tx=0x7f7548009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:40.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.387+0000 7f75557fa640 1 -- 172.21.15.137:0/2326130337 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7550010040 con 0x7f75581602b0 2024-04-26T21:58:40.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:40.596+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f75580d60c0 con 0x7f75581602b0 2024-04-26T21:58:41.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.258+0000 7f75557fa640 1 -- 172.21.15.137:0/2326130337 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f755005a8a0 con 0x7f75581602b0 2024-04-26T21:58:41.261 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T21:58:41.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.264+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f754406c920 msgr2=0x7f754406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.264+0000 7f755eabd640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f754406c920 0x7f754406ede0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7548001200 tx=0x7f7548009040 comp rx=0 tx=0).stop 2024-04-26T21:58:41.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.264+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75581602b0 msgr2=0x7f7558161d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.264+0000 7f755eabd640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75581602b0 0x7f7558161d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7550011c80 tx=0x7f755000f580 comp rx=0 tx=0).stop 2024-04-26T21:58:41.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.267+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 shutdown_connections 2024-04-26T21:58:41.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.267+0000 7f755eabd640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f754406c920 0x7f754406ede0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.267+0000 7f755eabd640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75581602b0 0x7f7558161d20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.267+0000 7f755eabd640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75580ba5c0 0x7f755815fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.267+0000 7f755eabd640 1 --2- 172.21.15.137:0/2326130337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7540004390 0x7f75580ba080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.267+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 >> 172.21.15.137:0/2326130337 conn(0x7f755808ec40 msgr2=0x7f75580d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:41.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.270+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 shutdown_connections 2024-04-26T21:58:41.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.271+0000 7f755eabd640 1 -- 172.21.15.137:0/2326130337 wait complete. 2024-04-26T21:58:41.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:41.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.387+0000 7fba21324640 1 Processor -- start 2024-04-26T21:58:41.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.387+0000 7fba21324640 1 -- start start 2024-04-26T21:58:41.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.388+0000 7fba21324640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c06c9b0 0x7fba1c0d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.388+0000 7fba21324640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c0740f0 con 0x7fba1c073380 2024-04-26T21:58:41.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.388+0000 7fba21324640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba1c0d0a40 con 0x7fba1c140190 2024-04-26T21:58:41.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.388+0000 7fba21324640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fba1c0d0d20 con 0x7fba1c06c9b0 2024-04-26T21:58:41.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.388+0000 7fba1b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fba1c073380 0x7fba1c073810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45992/0 (socket says 172.21.15.137:45992) 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.388+0000 7fba1b7fe640 1 -- 172.21.15.137:0/3142035146 learned_addr learned my addr 172.21.15.137:0/3142035146 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.388+0000 7fba1a7fc640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c06c9b0 0x7fba1c0d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2161605292 0 0) 0x7fba1c0740f0 con 0x7fba1c073380 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba04003520 con 0x7fba1c073380 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415833114 0 0) 0x7fba1c0d0a40 con 0x7fba1c140190 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba1c0740f0 con 0x7fba1c140190 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 336673333 0 0) 0x7fba04003520 con 0x7fba1c073380 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c06c9b0 msgr2=0x7fba1c0d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c06c9b0 0x7fba1c0d1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 >> v1:172.21.15.170:6789/0 conn(0x7fba1c140190 legacy=0x7fba1c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c0d1000 con 0x7fba1c073380 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fba14001670 con 0x7fba1c073380 2024-04-26T21:58:41.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 >> v1:172.21.15.137:6789/0 conn(0x7fba1c073380 legacy=0x7fba1c073810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba04003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba04004800 0x7fba04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c06c9b0 0x7fba040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c0d0d20 con 0x7fba04003b70 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fba0400ba70 con 0x7fba04004800 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fba0400bc40 con 0x7fba1c06c9b0 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba1affd640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba04003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba1a7fc640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba04004800 0x7fba04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba1b7fe640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c06c9b0 0x7fba040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba1affd640 1 -- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c06c9b0 msgr2=0x7fba040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba1affd640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c06c9b0 0x7fba040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba1affd640 1 -- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba04004800 msgr2=0x7fba04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba1affd640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba04004800 0x7fba04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba1affd640 1 -- 172.21.15.137:0/3142035146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba04003520 con 0x7fba04003b70 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.389+0000 7fba1b7fe640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c06c9b0 0x7fba040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.390+0000 7fba1affd640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba04003f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001fd0 tx=0x7fba04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb210b00a049a9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.390+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c001bf0 con 0x7fba04003b70 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.390+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0c003b70 con 0x7fba04003b70 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.390+0000 7fba19ffb640 1 -- 172.21.15.137:0/3142035146 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0050d0 con 0x7fba04003b70 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.391+0000 7fba21324640 1 -- 172.21.15.137:0/3142035146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 msgr2=0x7fba04003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.391+0000 7fba21324640 1 --2- 172.21.15.137:0/3142035146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba04003f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001fd0 tx=0x7fba04005830 comp rx=0 tx=0).stop 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.391+0000 7fba1b7fe640 1 -- 172.21.15.137:0/3142035146 reap_dead start 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.391+0000 7fba21324640 1 -- 172.21.15.137:0/3142035146 shutdown_connections 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.391+0000 7fba21324640 1 -- 172.21.15.137:0/3142035146 >> 172.21.15.137:0/3142035146 conn(0x7fba1c0b3c40 msgr2=0x7fba1c0b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.391+0000 7fba21324640 1 -- 172.21.15.137:0/3142035146 shutdown_connections 2024-04-26T21:58:41.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.391+0000 7fba21324640 1 -- 172.21.15.137:0/3142035146 wait complete. 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.392+0000 7fba21324640 1 Processor -- start 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.392+0000 7fba21324640 1 -- start start 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba21324640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba1c13c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba21324640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba1c0704b0 0x7fba1c070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba21324640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c157d80 0x7fba1c158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba21324640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c0d1980 con 0x7fba04003b70 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba21324640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fba1c0d1800 con 0x7fba1c0704b0 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba21324640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fba1c0d1b00 con 0x7fba1c157d80 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba1c13c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba1c13c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41690/0 (socket says 172.21.15.137:41690) 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1affd640 1 -- 172.21.15.137:0/3285198422 learned_addr learned my addr 172.21.15.137:0/3285198422 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1a7fc640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba1c0704b0 0x7fba1c070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1b7fe640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c157d80 0x7fba1c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1affd640 1 -- 172.21.15.137:0/3285198422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c157d80 msgr2=0x7fba1c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1affd640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c157d80 0x7fba1c158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1affd640 1 -- 172.21.15.137:0/3285198422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba1c0704b0 msgr2=0x7fba1c070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1affd640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba1c0704b0 0x7fba1c070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1affd640 1 -- 172.21.15.137:0/3285198422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c158740 con 0x7fba04003b70 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1b7fe640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c157d80 0x7fba1c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba1affd640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba1c13c810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba0c033040 tx=0x7fba0c001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba037fe640 1 -- 172.21.15.137:0/3285198422 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c040070 con 0x7fba04003b70 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba037fe640 1 -- 172.21.15.137:0/3285198422 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0c003970 con 0x7fba04003b70 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba037fe640 1 -- 172.21.15.137:0/3285198422 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c001bf0 con 0x7fba04003b70 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1c1589d0 con 0x7fba04003b70 2024-04-26T21:58:41.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.393+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba1c158f90 con 0x7fba04003b70 2024-04-26T21:58:41.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.394+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba1c0693d0 con 0x7fba04003b70 2024-04-26T21:58:41.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.395+0000 7fba037fe640 1 -- 172.21.15.137:0/3285198422 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba0c043070 con 0x7fba04003b70 2024-04-26T21:58:41.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.395+0000 7fba037fe640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba0806c8f0 0x7fba0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.395+0000 7fba037fe640 1 -- 172.21.15.137:0/3285198422 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fba0c0ac600 con 0x7fba04003b70 2024-04-26T21:58:41.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.395+0000 7fba1a7fc640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba0806c8f0 0x7fba0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.396+0000 7fba1a7fc640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba0806c8f0 0x7fba0806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fba1c157030 tx=0x7fba10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:41.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.400+0000 7fba037fe640 1 -- 172.21.15.137:0/3285198422 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fba0c07aac0 con 0x7fba04003b70 2024-04-26T21:58:41.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.575+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba1c15fd50 con 0x7fba04003b70 2024-04-26T21:58:41.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.576+0000 7fba037fe640 1 -- 172.21.15.137:0/3285198422 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16630 (secure 0 0 0) 0x7fba0c07a3c0 con 0x7fba04003b70 2024-04-26T21:58:41.578 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:41.578 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:40.598787+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:41.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba0806c8f0 msgr2=0x7fba0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba0806c8f0 0x7fba0806edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fba1c157030 tx=0x7fba10008040 comp rx=0 tx=0).stop 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 msgr2=0x7fba1c13c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba1c13c810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fba0c033040 tx=0x7fba0c001650 comp rx=0 tx=0).stop 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 shutdown_connections 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba0806c8f0 0x7fba0806edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba1c157d80 0x7fba1c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba1c0704b0 0x7fba1c070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 --2- 172.21.15.137:0/3285198422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba04003b70 0x7fba1c13c810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 >> 172.21.15.137:0/3285198422 conn(0x7fba1c0b3c40 msgr2=0x7fba1c15bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 shutdown_connections 2024-04-26T21:58:41.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.579+0000 7fba21324640 1 -- 172.21.15.137:0/3285198422 wait complete. 2024-04-26T21:58:41.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:41.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.687+0000 7f16716f9640 1 Processor -- start 2024-04-26T21:58:41.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.687+0000 7f16716f9640 1 -- start start 2024-04-26T21:58:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f16716f9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c0d3ee0 0x7f166c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f16716f9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f166c15f750 0x7f166c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f16716f9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c0d03a0 con 0x7f166c15f370 2024-04-26T21:58:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f16716f9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f166c0b4d10 con 0x7f166c15f750 2024-04-26T21:58:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f16716f9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f166c0d0680 con 0x7f166c0d3ee0 2024-04-26T21:58:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166a7fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c0d3ee0 0x7f166c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166b7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f166c15f750 0x7f166c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166a7fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c0d3ee0 0x7f166c0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:60544/0 (socket says 172.21.15.137:60544) 2024-04-26T21:58:41.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166affd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f166c15f370 0x7f166c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:50496/0 (socket says 172.21.15.137:50496) 2024-04-26T21:58:41.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166a7fc640 1 -- 172.21.15.137:0/3890262499 learned_addr learned my addr 172.21.15.137:0/3890262499 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:41.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166b7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f166c15f750 0x7f166c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:51854/0 (socket says 172.21.15.137:51854) 2024-04-26T21:58:41.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166a7fc640 1 -- 172.21.15.137:0/3890262499 >> v2:172.21.15.170:3300/0 conn(0x7f166c15f750 msgr2=0x7f166c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:41.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166a7fc640 1 --2- 172.21.15.137:0/3890262499 >> v2:172.21.15.170:3300/0 conn(0x7f166c15f750 0x7f166c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166a7fc640 1 -- 172.21.15.137:0/3890262499 >> v1:172.21.15.170:6789/0 conn(0x7f166c15f370 legacy=0x7f166c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.688+0000 7f166a7fc640 1 -- 172.21.15.137:0/3890262499 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c0d0960 con 0x7f166c0d3ee0 2024-04-26T21:58:41.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.689+0000 7f166a7fc640 1 --2- 172.21.15.137:0/3890262499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c0d3ee0 0x7f166c0cfd70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1660009870 tx=0x7f166002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64619378f2ad3b30 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:41.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.689+0000 7f1669ffb640 1 -- 172.21.15.137:0/3890262499 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660037070 con 0x7f166c0d3ee0 2024-04-26T21:58:41.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.689+0000 7f1669ffb640 1 -- 172.21.15.137:0/3890262499 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1660032440 con 0x7f166c0d3ee0 2024-04-26T21:58:41.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.689+0000 7f1669ffb640 1 -- 172.21.15.137:0/3890262499 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660032810 con 0x7f166c0d3ee0 2024-04-26T21:58:41.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.690+0000 7f16716f9640 1 -- 172.21.15.137:0/3890262499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c0d3ee0 msgr2=0x7f166c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.690+0000 7f16716f9640 1 --2- 172.21.15.137:0/3890262499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c0d3ee0 0x7f166c0cfd70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1660009870 tx=0x7f166002a270 comp rx=0 tx=0).stop 2024-04-26T21:58:41.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.690+0000 7f16716f9640 1 -- 172.21.15.137:0/3890262499 shutdown_connections 2024-04-26T21:58:41.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.690+0000 7f16716f9640 1 --2- 172.21.15.137:0/3890262499 >> v2:172.21.15.170:3300/0 conn(0x7f166c15f750 0x7f166c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.690+0000 7f16716f9640 1 --2- 172.21.15.137:0/3890262499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c0d3ee0 0x7f166c0cfd70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.690+0000 7f16716f9640 1 -- 172.21.15.137:0/3890262499 >> 172.21.15.137:0/3890262499 conn(0x7f166c08ec10 msgr2=0x7f166c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:41.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.690+0000 7f16716f9640 1 -- 172.21.15.137:0/3890262499 shutdown_connections 2024-04-26T21:58:41.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.690+0000 7f16716f9640 1 -- 172.21.15.137:0/3890262499 wait complete. 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.691+0000 7f16716f9640 1 Processor -- start 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.691+0000 7f16716f9640 1 -- start start 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16716f9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0d3ee0 0x7f166c1f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16716f9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c15f370 0x7f166c0a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16716f9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f166c15f750 0x7f166c09f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16716f9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f166c0b51c0 con 0x7f166c15f750 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16716f9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f166c0d0f20 con 0x7f166c0d3ee0 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16716f9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f166c0b5340 con 0x7f166c15f370 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f166c15f750 0x7f166c09f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f166c15f750 0x7f166c09f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41696/0 (socket says 172.21.15.137:41696) 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166b7fe640 1 -- 172.21.15.137:0/4059742630 learned_addr learned my addr 172.21.15.137:0/4059742630 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:41.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166a7fc640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c15f370 0x7f166c0a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166affd640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0d3ee0 0x7f166c1f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166b7fe640 1 -- 172.21.15.137:0/4059742630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c15f370 msgr2=0x7f166c0a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166b7fe640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c15f370 0x7f166c0a2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166b7fe640 1 -- 172.21.15.137:0/4059742630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0d3ee0 msgr2=0x7f166c1f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166b7fe640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0d3ee0 0x7f166c1f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166b7fe640 1 -- 172.21.15.137:0/4059742630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c0a2f50 con 0x7f166c15f750 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166a7fc640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c15f370 0x7f166c0a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f166b7fe640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f166c15f750 0x7f166c09f840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f166400efc0 tx=0x7f166400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16537fe640 1 -- 172.21.15.137:0/4059742630 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664018020 con 0x7f166c15f750 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16537fe640 1 -- 172.21.15.137:0/4059742630 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1664014480 con 0x7f166c15f750 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c0ba250 con 0x7f166c15f750 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16537fe640 1 -- 172.21.15.137:0/4059742630 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1664014870 con 0x7f166c15f750 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.692+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c09f040 con 0x7f166c15f750 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.693+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c06a290 con 0x7f166c15f750 2024-04-26T21:58:41.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.694+0000 7f16537fe640 1 -- 172.21.15.137:0/4059742630 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1664005d10 con 0x7f166c15f750 2024-04-26T21:58:41.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.694+0000 7f16537fe640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f165806c8f0 0x7f165806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.694+0000 7f166affd640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f165806c8f0 0x7f165806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.694+0000 7f16537fe640 1 -- 172.21.15.137:0/4059742630 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f166408c3d0 con 0x7f166c15f750 2024-04-26T21:58:41.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.695+0000 7f166affd640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f165806c8f0 0x7f165806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f166c0a0400 tx=0x7f165c007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:41.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.699+0000 7f16537fe640 1 -- 172.21.15.137:0/4059742630 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1664022070 con 0x7f166c15f750 2024-04-26T21:58:41.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.877+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f166c0ba770 con 0x7f166c15f750 2024-04-26T21:58:41.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.878+0000 7f16537fe640 1 -- 172.21.15.137:0/4059742630 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16630 (secure 0 0 0) 0x7f1664010040 con 0x7f166c15f750 2024-04-26T21:58:41.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:41.880 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:40.598787+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:41.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f165806c8f0 msgr2=0x7f165806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f165806c8f0 0x7f165806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f166c0a0400 tx=0x7f165c007e80 comp rx=0 tx=0).stop 2024-04-26T21:58:41.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f166c15f750 msgr2=0x7f166c09f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f166c15f750 0x7f166c09f840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f166400efc0 tx=0x7f166400c490 comp rx=0 tx=0).stop 2024-04-26T21:58:41.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 shutdown_connections 2024-04-26T21:58:41.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f165806c8f0 0x7f165806edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f166c15f750 0x7f166c09f840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f166c15f370 0x7f166c0a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 --2- 172.21.15.137:0/4059742630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0d3ee0 0x7f166c1f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 >> 172.21.15.137:0/4059742630 conn(0x7f166c08ec10 msgr2=0x7f166c075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:41.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 shutdown_connections 2024-04-26T21:58:41.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.880+0000 7f16716f9640 1 -- 172.21.15.137:0/4059742630 wait complete. 2024-04-26T21:58:41.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T21:58:41.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.991+0000 7ff17fe93640 1 Processor -- start 2024-04-26T21:58:41.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.991+0000 7ff17fe93640 1 -- start start 2024-04-26T21:58:41.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17fe93640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff1780d0010 0x7ff17806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17fe93640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17809c700 con 0x7ff1780b3c20 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17fe93640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1780d1c50 con 0x7ff1780b33e0 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17fe93640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff1780b4480 con 0x7ff1780d0010 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17d42e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff1780b3c20 0x7ff1780b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45998/0 (socket says 172.21.15.137:45998) 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17d42e640 1 -- 172.21.15.137:0/1149578529 learned_addr learned my addr 172.21.15.137:0/1149578529 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17dc2f640 1 --2- 172.21.15.137:0/1149578529 >> v2:172.21.15.170:3300/0 conn(0x7ff1780d0010 0x7ff17806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17cc2d640 1 -- 172.21.15.137:0/1149578529 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481872514 0 0) 0x7ff17809c700 con 0x7ff1780b3c20 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17cc2d640 1 -- 172.21.15.137:0/1149578529 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff164003520 con 0x7ff1780b3c20 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17cc2d640 1 -- 172.21.15.137:0/1149578529 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1244392249 0 0) 0x7ff164003520 con 0x7ff1780b3c20 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17dc2f640 1 -- 172.21.15.137:0/1149578529 >> v1:172.21.15.170:6789/0 conn(0x7ff1780b33e0 legacy=0x7ff178163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17dc2f640 1 -- 172.21.15.137:0/1149578529 >> v1:172.21.15.137:6789/0 conn(0x7ff1780b3c20 legacy=0x7ff1780b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.992+0000 7ff17dc2f640 1 -- 172.21.15.137:0/1149578529 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1780d1f30 con 0x7ff1780d0010 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.993+0000 7ff17dc2f640 1 --2- 172.21.15.137:0/1149578529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1780d0010 0x7ff17806db10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1740097a0 tx=0x7ff17402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ea53fda6b72ac57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.993+0000 7ff17cc2d640 1 -- 172.21.15.137:0/1149578529 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174037070 con 0x7ff1780d0010 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.993+0000 7ff17cc2d640 1 -- 172.21.15.137:0/1149578529 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17402ac50 con 0x7ff1780d0010 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.993+0000 7ff17cc2d640 1 -- 172.21.15.137:0/1149578529 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168001670 con 0x7ff1780d0010 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.994+0000 7ff17fe93640 1 -- 172.21.15.137:0/1149578529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1780d0010 msgr2=0x7ff17806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.994+0000 7ff17fe93640 1 --2- 172.21.15.137:0/1149578529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1780d0010 0x7ff17806db10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1740097a0 tx=0x7ff17402a1c0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.994+0000 7ff17fe93640 1 -- 172.21.15.137:0/1149578529 shutdown_connections 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.994+0000 7ff17fe93640 1 --2- 172.21.15.137:0/1149578529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1780d0010 0x7ff17806db10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.994+0000 7ff17fe93640 1 -- 172.21.15.137:0/1149578529 >> 172.21.15.137:0/1149578529 conn(0x7ff17809ba40 msgr2=0x7ff17809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.994+0000 7ff17fe93640 1 -- 172.21.15.137:0/1149578529 shutdown_connections 2024-04-26T21:58:41.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.994+0000 7ff17fe93640 1 -- 172.21.15.137:0/1149578529 wait complete. 2024-04-26T21:58:41.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.995+0000 7ff17fe93640 1 Processor -- start 2024-04-26T21:58:41.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.995+0000 7ff17fe93640 1 -- start start 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17fe93640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1780b33e0 0x7ff1780b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17fe93640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1780b3c20 0x7ff1781f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17fe93640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1780d0010 0x7ff1780a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17fe93640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff17806e050 con 0x7ff1780b3c20 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17fe93640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff1780b3a20 con 0x7ff1780b33e0 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17fe93640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff178163990 con 0x7ff1780d0010 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17d42e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1780b3c20 0x7ff1781f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17d42e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1780b3c20 0x7ff1781f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41704/0 (socket says 172.21.15.137:41704) 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17d42e640 1 -- 172.21.15.137:0/1342035417 learned_addr learned my addr 172.21.15.137:0/1342035417 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17dc2f640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1780b33e0 0x7ff1780b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17e430640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1780d0010 0x7ff1780a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17d42e640 1 -- 172.21.15.137:0/1342035417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1780d0010 msgr2=0x7ff1780a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:41.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17d42e640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1780d0010 0x7ff1780a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17d42e640 1 -- 172.21.15.137:0/1342035417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1780b33e0 msgr2=0x7ff1780b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17d42e640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1780b33e0 0x7ff1780b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17d42e640 1 -- 172.21.15.137:0/1342035417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17814f740 con 0x7ff1780b3c20 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17d42e640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1780b3c20 0x7ff1781f4f60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c780 tx=0x7ff16800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff16e7fc640 1 -- 172.21.15.137:0/1342035417 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168017070 con 0x7ff1780b3c20 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff16e7fc640 1 -- 172.21.15.137:0/1342035417 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff168005ad0 con 0x7ff1780b3c20 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17814fa00 con 0x7ff1780b3c20 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff16e7fc640 1 -- 172.21.15.137:0/1342035417 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168007070 con 0x7ff1780b3c20 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.996+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17814ffc0 con 0x7ff1780b3c20 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.998+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff17806a290 con 0x7ff1780b3c20 2024-04-26T21:58:42.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.998+0000 7ff16e7fc640 1 -- 172.21.15.137:0/1342035417 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff16801a070 con 0x7ff1780b3c20 2024-04-26T21:58:42.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.998+0000 7ff16e7fc640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff15c06c8f0 0x7ff15c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.998+0000 7ff16e7fc640 1 -- 172.21.15.137:0/1342035417 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff16808b020 con 0x7ff1780b3c20 2024-04-26T21:58:42.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.998+0000 7ff17dc2f640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff15c06c8f0 0x7ff15c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:41.999+0000 7ff17dc2f640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff15c06c8f0 0x7ff15c06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff174034000 tx=0x7ff17402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:42.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.003+0000 7ff16e7fc640 1 -- 172.21.15.137:0/1342035417 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff1680594e0 con 0x7ff1780b3c20 2024-04-26T21:58:42.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.217+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff1780b8f10 con 0x7ff1780b3c20 2024-04-26T21:58:42.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.348+0000 7ff16e7fc640 1 -- 172.21.15.137:0/1342035417 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7ff168058de0 con 0x7ff1780b3c20 2024-04-26T21:58:42.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff15c06c8f0 msgr2=0x7ff15c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:42.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff15c06c8f0 0x7ff15c06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff174034000 tx=0x7ff17402e000 comp rx=0 tx=0).stop 2024-04-26T21:58:42.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1780b3c20 msgr2=0x7ff1781f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:42.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1780b3c20 0x7ff1781f4f60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff16800c780 tx=0x7ff16800cc40 comp rx=0 tx=0).stop 2024-04-26T21:58:42.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 shutdown_connections 2024-04-26T21:58:42.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff15c06c8f0 0x7ff15c06edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1780b3c20 0x7ff1781f4f60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1780d0010 0x7ff1780a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 --2- 172.21.15.137:0/1342035417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1780b33e0 0x7ff1780b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 >> 172.21.15.137:0/1342035417 conn(0x7ff17809ba40 msgr2=0x7ff17815e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:42.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 shutdown_connections 2024-04-26T21:58:42.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.350+0000 7ff17fe93640 1 -- 172.21.15.137:0/1342035417 wait complete. 2024-04-26T21:58:42.361 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T21:58:42.362 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T21:58:42.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.460+0000 7fd8d54c8640 1 Processor -- start 2024-04-26T21:58:42.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.460+0000 7fd8d54c8640 1 -- start start 2024-04-26T21:58:42.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8d54c8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd8d00d3820 0x7fd8d00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8d54c8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00b60b0 0x7fd8d00d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8d54c8640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d00d3c90 con 0x7fd8d015f680 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8d54c8640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d015fa60 con 0x7fd8d00d3820 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8d54c8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d00d3f50 con 0x7fd8d00b60b0 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8ceffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd8d015f680 0x7fd8d0163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46002/0 (socket says 172.21.15.137:46002) 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8ceffd640 1 -- 172.21.15.137:0/1759618642 learned_addr learned my addr 172.21.15.137:0/1759618642 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378601893 0 0) 0x7fd8d00d3c90 con 0x7fd8d015f680 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8b8003520 con 0x7fd8d015f680 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8ce7fc640 1 --2- 172.21.15.137:0/1759618642 >> v2:172.21.15.170:3300/0 conn(0x7fd8d00d3820 0x7fd8d00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cf7fe640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00b60b0 0x7fd8d00d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 849691085 0 0) 0x7fd8b8003520 con 0x7fd8d015f680 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00b60b0 msgr2=0x7fd8d00d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00b60b0 0x7fd8d00d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 >> v2:172.21.15.170:3300/0 conn(0x7fd8d00d3820 msgr2=0x7fd8d00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 --2- 172.21.15.137:0/1759618642 >> v2:172.21.15.170:3300/0 conn(0x7fd8d00d3820 0x7fd8d00b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d00b5090 con 0x7fd8d015f680 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fd8c0001a10 con 0x7fd8d015f680 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8ce7fc640 1 --2- 172.21.15.137:0/1759618642 >> v2:172.21.15.170:3300/0 conn(0x7fd8d00d3820 0x7fd8d00b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 >> v1:172.21.15.137:6789/0 conn(0x7fd8d015f680 legacy=0x7fd8d0163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.461+0000 7fd8cdffb640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b80039b0 0x7fd8b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cdffb640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00b60b0 0x7fd8b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cdffb640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8004d40 0x7fd8b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d015fa60 con 0x7fd8b8004d40 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d00d3f50 con 0x7fd8b80039b0 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b800b9f0 con 0x7fd8d00b60b0 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cf7fe640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8004d40 0x7fd8b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8ceffd640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b80039b0 0x7fd8b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8ce7fc640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00b60b0 0x7fd8b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cf7fe640 1 -- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00b60b0 msgr2=0x7fd8b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cf7fe640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00b60b0 0x7fd8b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cf7fe640 1 -- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b80039b0 msgr2=0x7fd8b8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cf7fe640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8b80039b0 0x7fd8b8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.462+0000 7fd8cf7fe640 1 -- 172.21.15.137:0/1759618642 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b8003520 con 0x7fd8b8004d40 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8cf7fe640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8004d40 0x7fd8b80051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009ac0 tx=0x7fd8b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9734bc24318776b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8036070 con 0x7fd8b8004d40 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c8031400 con 0x7fd8b8004d40 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8cdffb640 1 -- 172.21.15.137:0/1759618642 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8009690 con 0x7fd8b8004d40 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8d54c8640 1 -- 172.21.15.137:0/1759618642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8004d40 msgr2=0x7fd8b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8d54c8640 1 --2- 172.21.15.137:0/1759618642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8b8004d40 0x7fd8b80051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009ac0 tx=0x7fd8b8005830 comp rx=0 tx=0).stop 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8cf7fe640 1 -- 172.21.15.137:0/1759618642 reap_dead start 2024-04-26T21:58:42.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8d54c8640 1 -- 172.21.15.137:0/1759618642 shutdown_connections 2024-04-26T21:58:42.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8d54c8640 1 -- 172.21.15.137:0/1759618642 >> 172.21.15.137:0/1759618642 conn(0x7fd8d008eca0 msgr2=0x7fd8d009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:42.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8d54c8640 1 -- 172.21.15.137:0/1759618642 shutdown_connections 2024-04-26T21:58:42.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.463+0000 7fd8d54c8640 1 -- 172.21.15.137:0/1759618642 wait complete. 2024-04-26T21:58:42.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.464+0000 7fd8d54c8640 1 Processor -- start 2024-04-26T21:58:42.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8d54c8640 1 -- start start 2024-04-26T21:58:42.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8d54c8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00d04c0 0x7fd8d00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8d54c8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8d01f54c0 0x7fd8d00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8d54c8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d01f5940 0x7fd8d00cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8d54c8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d00d50a0 con 0x7fd8d01f54c0 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8d54c8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d00d4f20 con 0x7fd8d01f5940 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8d54c8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d00d5220 con 0x7fd8d00d04c0 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8ce7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8d01f54c0 0x7fd8d00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8ce7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8d01f54c0 0x7fd8d00ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41726/0 (socket says 172.21.15.137:41726) 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8ce7fc640 1 -- 172.21.15.137:0/3472778028 learned_addr learned my addr 172.21.15.137:0/3472778028 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.465+0000 7fd8ceffd640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00d04c0 0x7fd8d00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8cf7fe640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d01f5940 0x7fd8d00cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8ce7fc640 1 -- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00d04c0 msgr2=0x7fd8d00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8ce7fc640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00d04c0 0x7fd8d00d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8ce7fc640 1 -- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d01f5940 msgr2=0x7fd8d00cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8ce7fc640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d01f5940 0x7fd8d00cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8ce7fc640 1 -- 172.21.15.137:0/3472778028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d01f66a0 con 0x7fd8d01f54c0 2024-04-26T21:58:42.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8ceffd640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00d04c0 0x7fd8d00d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8cf7fe640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d01f5940 0x7fd8d00cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8ce7fc640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8d01f54c0 0x7fd8d00ce510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40116d0 tx=0x7fd8c4011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8b77fe640 1 -- 172.21.15.137:0/3472778028 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4019070 con 0x7fd8d01f54c0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8b77fe640 1 -- 172.21.15.137:0/3472778028 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c4004220 con 0x7fd8d01f54c0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8b77fe640 1 -- 172.21.15.137:0/3472778028 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400f040 con 0x7fd8d01f54c0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d01f5e00 con 0x7fd8d01f54c0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.466+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d01f63c0 con 0x7fd8d01f54c0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.467+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d006a290 con 0x7fd8d01f54c0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.467+0000 7fd8b77fe640 1 -- 172.21.15.137:0/3472778028 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8c400f760 con 0x7fd8d01f54c0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.468+0000 7fd8b77fe640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8bc06c920 0x7fd8bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.468+0000 7fd8ceffd640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8bc06c920 0x7fd8bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.468+0000 7fd8b77fe640 1 -- 172.21.15.137:0/3472778028 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd8c408be50 con 0x7fd8d01f54c0 2024-04-26T21:58:42.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.468+0000 7fd8ceffd640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8bc06c920 0x7fd8bc06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00c8d70 tx=0x7fd8c0006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:42.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.473+0000 7fd8b77fe640 1 -- 172.21.15.137:0/3472778028 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd8c405a280 con 0x7fd8d01f54c0 2024-04-26T21:58:42.643 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:58:42.646 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:58:42.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:42.689+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd8d00b4cd0 con 0x7fd8d01f54c0 2024-04-26T21:58:43.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.353+0000 7fd8b77fe640 1 -- 172.21.15.137:0/3472778028 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7fd8c4059b80 con 0x7fd8d01f54c0 2024-04-26T21:58:43.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8bc06c920 msgr2=0x7fd8bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8bc06c920 0x7fd8bc06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00c8d70 tx=0x7fd8c0006040 comp rx=0 tx=0).stop 2024-04-26T21:58:43.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8d01f54c0 msgr2=0x7fd8d00ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8d01f54c0 0x7fd8d00ce510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40116d0 tx=0x7fd8c4011b90 comp rx=0 tx=0).stop 2024-04-26T21:58:43.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 shutdown_connections 2024-04-26T21:58:43.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8bc06c920 0x7fd8bc06ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8d01f54c0 0x7fd8d00ce510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8d01f5940 0x7fd8d00cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 --2- 172.21.15.137:0/3472778028 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8d00d04c0 0x7fd8d00d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 >> 172.21.15.137:0/3472778028 conn(0x7fd8d008eca0 msgr2=0x7fd8d00b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:43.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 shutdown_connections 2024-04-26T21:58:43.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.355+0000 7fd8d54c8640 1 -- 172.21.15.137:0/3472778028 wait complete. 2024-04-26T21:58:43.366 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T21:58:43.367 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:58:43.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.463+0000 7f9446940640 1 Processor -- start 2024-04-26T21:58:43.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.463+0000 7f9446940640 1 -- start start 2024-04-26T21:58:43.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.464+0000 7f9446940640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f94400d11b0 0x7f944006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.464+0000 7f9446940640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94400d1740 con 0x7f94400cf2e0 2024-04-26T21:58:43.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.464+0000 7f9446940640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94400d1a20 con 0x7f944006e2c0 2024-04-26T21:58:43.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.464+0000 7f9446940640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f944006e710 con 0x7f94400d11b0 2024-04-26T21:58:43.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.464+0000 7f943ffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f94400cf2e0 0x7f944006d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46008/0 (socket says 172.21.15.137:46008) 2024-04-26T21:58:43.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.464+0000 7f943ffff640 1 -- 172.21.15.137:0/862689268 learned_addr learned my addr 172.21.15.137:0/862689268 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:43.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.464+0000 7f943f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f94400d11b0 0x7f944006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.465+0000 7f943f7fe640 1 -- 172.21.15.137:0/862689268 >> v1:172.21.15.170:6789/0 conn(0x7f944006e2c0 legacy=0x7f944015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:43.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.465+0000 7f943f7fe640 1 -- 172.21.15.137:0/862689268 >> v1:172.21.15.137:6789/0 conn(0x7f94400cf2e0 legacy=0x7f944006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.465+0000 7f943effd640 1 -- 172.21.15.137:0/862689268 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224947700 0 0) 0x7f94400d1740 con 0x7f94400cf2e0 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.465+0000 7f943f7fe640 1 -- 172.21.15.137:0/862689268 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94400d1d00 con 0x7f94400d11b0 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.465+0000 7f943f7fe640 1 --2- 172.21.15.137:0/862689268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94400d11b0 0x7f944006dd80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94340097d0 tx=0x7f943402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce11e69fba33ac78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.465+0000 7f943effd640 1 -- 172.21.15.137:0/862689268 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434037070 con 0x7f94400d11b0 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.466+0000 7f943effd640 1 -- 172.21.15.137:0/862689268 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9434032440 con 0x7f94400d11b0 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.466+0000 7f943effd640 1 -- 172.21.15.137:0/862689268 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9434032810 con 0x7f94400d11b0 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.466+0000 7f9446940640 1 -- 172.21.15.137:0/862689268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94400d11b0 msgr2=0x7f944006dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.466+0000 7f9446940640 1 --2- 172.21.15.137:0/862689268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94400d11b0 0x7f944006dd80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94340097d0 tx=0x7f943402a210 comp rx=0 tx=0).stop 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.466+0000 7f9446940640 1 -- 172.21.15.137:0/862689268 shutdown_connections 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.466+0000 7f9446940640 1 --2- 172.21.15.137:0/862689268 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94400d11b0 0x7f944006dd80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.466+0000 7f9446940640 1 -- 172.21.15.137:0/862689268 >> 172.21.15.137:0/862689268 conn(0x7f94400b4a60 msgr2=0x7f94400b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.466+0000 7f9446940640 1 -- 172.21.15.137:0/862689268 shutdown_connections 2024-04-26T21:58:43.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.466+0000 7f9446940640 1 -- 172.21.15.137:0/862689268 wait complete. 2024-04-26T21:58:43.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.467+0000 7f9446940640 1 Processor -- start 2024-04-26T21:58:43.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.467+0000 7f9446940640 1 -- start start 2024-04-26T21:58:43.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f9446940640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944006e2c0 0x7f94400b8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f9446940640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94400cf2e0 0x7f9440152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f9446940640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94400d11b0 0x7f94400cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f9446940640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f94400cf6c0 con 0x7f944006e2c0 2024-04-26T21:58:43.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f9446940640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f94400d22c0 con 0x7f94400d11b0 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f9446940640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f94400cf840 con 0x7f94400cf2e0 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944006e2c0 0x7f94400b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944006e2c0 0x7f94400b8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41740/0 (socket says 172.21.15.137:41740) 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943ffff640 1 -- 172.21.15.137:0/825239575 learned_addr learned my addr 172.21.15.137:0/825239575 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943ffff640 1 -- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94400cf2e0 msgr2=0x7f9440152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943f7fe640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94400cf2e0 0x7f9440152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f9444edd640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94400d11b0 0x7f94400cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943ffff640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94400cf2e0 0x7f9440152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943ffff640 1 -- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94400d11b0 msgr2=0x7f94400cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943ffff640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94400d11b0 0x7f94400cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943ffff640 1 -- 172.21.15.137:0/825239575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94400cb7f0 con 0x7f944006e2c0 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f943f7fe640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94400cf2e0 0x7f9440152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:43.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.468+0000 7f9444edd640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94400d11b0 0x7f94400cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:43.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.469+0000 7f943ffff640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944006e2c0 0x7f94400b8210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f943000c430 tx=0x7f943000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:43.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.469+0000 7f943cff9640 1 -- 172.21.15.137:0/825239575 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94300074e0 con 0x7f944006e2c0 2024-04-26T21:58:43.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.469+0000 7f943cff9640 1 -- 172.21.15.137:0/825239575 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94300047e0 con 0x7f944006e2c0 2024-04-26T21:58:43.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.469+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94400b6240 con 0x7f944006e2c0 2024-04-26T21:58:43.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.469+0000 7f943cff9640 1 -- 172.21.15.137:0/825239575 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9430004bd0 con 0x7f944006e2c0 2024-04-26T21:58:43.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.469+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94400b6800 con 0x7f944006e2c0 2024-04-26T21:58:43.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.470+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f944006a290 con 0x7f944006e2c0 2024-04-26T21:58:43.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.470+0000 7f943cff9640 1 -- 172.21.15.137:0/825239575 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9430011070 con 0x7f944006e2c0 2024-04-26T21:58:43.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.471+0000 7f943cff9640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f942c06c8f0 0x7f942c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.471+0000 7f943f7fe640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f942c06c8f0 0x7f942c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.471+0000 7f943cff9640 1 -- 172.21.15.137:0/825239575 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f943008b780 con 0x7f944006e2c0 2024-04-26T21:58:43.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.471+0000 7f943f7fe640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f942c06c8f0 0x7f942c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9434034000 tx=0x7f943402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:43.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.475+0000 7f943cff9640 1 -- 172.21.15.137:0/825239575 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f943000e280 con 0x7f944006e2c0 2024-04-26T21:58:43.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.685+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94400b8ef0 con 0x7f944006e2c0 2024-04-26T21:58:43.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.686+0000 7f943cff9640 1 -- 172.21.15.137:0/825239575 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f9430059bb0 con 0x7f944006e2c0 2024-04-26T21:58:43.687 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:43.687 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1319361701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1319361701},{"type":"v1","addr":"172.21.15.170:6833","nonce":1319361701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3941293249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3941293249},{"type":"v1","addr":"172.21.15.137:6837","nonce":3941293249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:58:40.598750+0000","modified":"2024-04-26T21:58:42.690405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/268686042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":268686042},{"type":"v1","addr":"172.21.15.170:6835","nonce":268686042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-26T21:58:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 7 2024-04-26T21:58:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f942c06c8f0 msgr2=0x7f942c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f942c06c8f0 0x7f942c06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9434034000 tx=0x7f943402e000 comp rx=0 tx=0).stop 2024-04-26T21:58:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944006e2c0 msgr2=0x7f94400b8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944006e2c0 0x7f94400b8210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f943000c430 tx=0x7f943000c8f0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 shutdown_connections 2024-04-26T21:58:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f942c06c8f0 0x7f942c06edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94400d11b0 0x7f94400cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94400cf2e0 0x7f9440152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 --2- 172.21.15.137:0/825239575 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f944006e2c0 0x7f94400b8210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 >> 172.21.15.137:0/825239575 conn(0x7f94400b4a60 msgr2=0x7f9440071af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:43.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 shutdown_connections 2024-04-26T21:58:43.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.688+0000 7f9446940640 1 -- 172.21.15.137:0/825239575 wait complete. 2024-04-26T21:58:43.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:43.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.796+0000 7f9b4eafc640 1 Processor -- start 2024-04-26T21:58:43.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.796+0000 7f9b4eafc640 1 -- start start 2024-04-26T21:58:43.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.797+0000 7f9b4eafc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9b4815d0c0 0x7f9b4815fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.797+0000 7f9b4eafc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9b48160200 0x7f9b4806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.797+0000 7f9b4eafc640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b48160780 con 0x7f9b4806f3c0 2024-04-26T21:58:43.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.797+0000 7f9b4eafc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9b48160a60 con 0x7f9b48160200 2024-04-26T21:58:43.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.797+0000 7f9b4eafc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9b480cff90 con 0x7f9b4815d0c0 2024-04-26T21:58:43.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.797+0000 7f9b47fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9b48160200 0x7f9b4806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.797+0000 7f9b4d099640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9b4806f3c0 0x7f9b48073100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46016/0 (socket says 172.21.15.137:46016) 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.797+0000 7f9b4d099640 1 -- 172.21.15.137:0/2394462013 learned_addr learned my addr 172.21.15.137:0/2394462013 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b4c898640 1 --2- 172.21.15.137:0/2394462013 >> v2:172.21.15.170:3300/0 conn(0x7f9b4815d0c0 0x7f9b4815fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b47fff640 1 -- 172.21.15.137:0/2394462013 >> v2:172.21.15.170:3300/0 conn(0x7f9b4815d0c0 msgr2=0x7f9b4815fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b47fff640 1 --2- 172.21.15.137:0/2394462013 >> v2:172.21.15.170:3300/0 conn(0x7f9b4815d0c0 0x7f9b4815fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b47fff640 1 -- 172.21.15.137:0/2394462013 >> v1:172.21.15.137:6789/0 conn(0x7f9b4806f3c0 legacy=0x7f9b48073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b47fff640 1 -- 172.21.15.137:0/2394462013 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b480d0270 con 0x7f9b48160200 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b477fe640 1 -- 172.21.15.137:0/2394462013 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966732652 0 0) 0x7f9b48160780 con 0x7f9b4806f3c0 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b47fff640 1 --2- 172.21.15.137:0/2394462013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 0x7f9b4806ee80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b4806e840 tx=0x7f9b3c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61743a7a25870179 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b477fe640 1 -- 172.21.15.137:0/2394462013 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c037070 con 0x7f9b48160200 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b477fe640 1 -- 172.21.15.137:0/2394462013 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3c032440 con 0x7f9b48160200 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.798+0000 7f9b477fe640 1 -- 172.21.15.137:0/2394462013 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c032810 con 0x7f9b48160200 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.799+0000 7f9b4eafc640 1 -- 172.21.15.137:0/2394462013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 msgr2=0x7f9b4806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.799+0000 7f9b4eafc640 1 --2- 172.21.15.137:0/2394462013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 0x7f9b4806ee80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9b4806e840 tx=0x7f9b3c02a1a0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.799+0000 7f9b4eafc640 1 -- 172.21.15.137:0/2394462013 shutdown_connections 2024-04-26T21:58:43.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.799+0000 7f9b4eafc640 1 --2- 172.21.15.137:0/2394462013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 0x7f9b4806ee80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.799+0000 7f9b4eafc640 1 --2- 172.21.15.137:0/2394462013 >> v2:172.21.15.170:3300/0 conn(0x7f9b4815d0c0 0x7f9b4815fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.799+0000 7f9b4eafc640 1 -- 172.21.15.137:0/2394462013 >> 172.21.15.137:0/2394462013 conn(0x7f9b480b3b10 msgr2=0x7f9b480b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:43.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.799+0000 7f9b4eafc640 1 -- 172.21.15.137:0/2394462013 shutdown_connections 2024-04-26T21:58:43.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.799+0000 7f9b4eafc640 1 -- 172.21.15.137:0/2394462013 wait complete. 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.800+0000 7f9b4eafc640 1 Processor -- start 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.800+0000 7f9b4eafc640 1 -- start start 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4eafc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b4806f3c0 0x7f9b4814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4eafc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b4815d0c0 0x7f9b48151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4eafc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 0x7f9b480aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4eafc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4815d620 con 0x7f9b48160200 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4eafc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4815d4a0 con 0x7f9b4815d0c0 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4eafc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9b480d17a0 con 0x7f9b4806f3c0 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4d099640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 0x7f9b480aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4d099640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 0x7f9b480aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41754/0 (socket says 172.21.15.137:41754) 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4d099640 1 -- 172.21.15.137:0/916372618 learned_addr learned my addr 172.21.15.137:0/916372618 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:43.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b47fff640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b4815d0c0 0x7f9b48151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4d099640 1 -- 172.21.15.137:0/916372618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b4806f3c0 msgr2=0x7f9b4814c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4d099640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b4806f3c0 0x7f9b4814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4d099640 1 -- 172.21.15.137:0/916372618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b4815d0c0 msgr2=0x7f9b48151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4d099640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b4815d0c0 0x7f9b48151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4d099640 1 -- 172.21.15.137:0/916372618 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b48147630 con 0x7f9b48160200 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.801+0000 7f9b4d099640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 0x7f9b480aedf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c7a0 tx=0x7f9b4000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.802+0000 7f9b457fa640 1 -- 172.21.15.137:0/916372618 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40018070 con 0x7f9b48160200 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.802+0000 7f9b457fa640 1 -- 172.21.15.137:0/916372618 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b4000a640 con 0x7f9b48160200 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.802+0000 7f9b457fa640 1 -- 172.21.15.137:0/916372618 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000aa70 con 0x7f9b48160200 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.802+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b48147910 con 0x7f9b48160200 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.802+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4814cc00 con 0x7f9b48160200 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.803+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b480693d0 con 0x7f9b48160200 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.803+0000 7f9b457fa640 1 -- 172.21.15.137:0/916372618 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b4001b070 con 0x7f9b48160200 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.803+0000 7f9b457fa640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9b3406c8f0 0x7f9b3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:43.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.803+0000 7f9b4c898640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9b3406c8f0 0x7f9b3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:43.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.804+0000 7f9b457fa640 1 -- 172.21.15.137:0/916372618 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9b4008b180 con 0x7f9b48160200 2024-04-26T21:58:43.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.804+0000 7f9b4c898640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9b3406c8f0 0x7f9b3406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9b380098f0 tx=0x7f9b38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:43.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.808+0000 7f9b457fa640 1 -- 172.21.15.137:0/916372618 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9b400595b0 con 0x7f9b48160200 2024-04-26T21:58:43.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.983+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b480cf450 con 0x7f9b48160200 2024-04-26T21:58:43.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.984+0000 7f9b457fa640 1 -- 172.21.15.137:0/916372618 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f9b40058eb0 con 0x7f9b48160200 2024-04-26T21:58:43.985 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:43.985 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.986+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9b3406c8f0 msgr2=0x7f9b3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.986+0000 7f9b4eafc640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9b3406c8f0 0x7f9b3406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9b380098f0 tx=0x7f9b38008040 comp rx=0 tx=0).stop 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.986+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 msgr2=0x7f9b480aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.986+0000 7f9b4eafc640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 0x7f9b480aedf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c7a0 tx=0x7f9b4000cc60 comp rx=0 tx=0).stop 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.987+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 shutdown_connections 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.987+0000 7f9b4eafc640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9b3406c8f0 0x7f9b3406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.987+0000 7f9b4eafc640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9b48160200 0x7f9b480aedf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.987+0000 7f9b4eafc640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b4815d0c0 0x7f9b48151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.987+0000 7f9b4eafc640 1 --2- 172.21.15.137:0/916372618 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9b4806f3c0 0x7f9b4814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.987+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 >> 172.21.15.137:0/916372618 conn(0x7f9b480b3b10 msgr2=0x7f9b48073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:43.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.987+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 shutdown_connections 2024-04-26T21:58:43.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:43.987+0000 7f9b4eafc640 1 -- 172.21.15.137:0/916372618 wait complete. 2024-04-26T21:58:43.998 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T21:58:43.998 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:58:44.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.095+0000 7f13f0609640 1 Processor -- start 2024-04-26T21:58:44.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.095+0000 7f13f0609640 1 -- start start 2024-04-26T21:58:44.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13f0609640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f13e815d380 0x7f13e80ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13f0609640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13e8160d50 0x7f13e81611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13f0609640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e80d0be0 con 0x7f13e80b56d0 2024-04-26T21:58:44.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13f0609640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f13e80d0ec0 con 0x7f13e815d380 2024-04-26T21:58:44.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13f0609640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f13e80d11a0 con 0x7f13e8160d50 2024-04-26T21:58:44.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13edba4640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f13e80b56d0 0x7f13e80d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46018/0 (socket says 172.21.15.137:46018) 2024-04-26T21:58:44.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13edba4640 1 -- 172.21.15.137:0/1803977253 learned_addr learned my addr 172.21.15.137:0/1803977253 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:44.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13eeba6640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13e8160d50 0x7f13e81611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ee3a5640 1 --2- 172.21.15.137:0/1803977253 >> v2:172.21.15.170:3300/0 conn(0x7f13e815d380 0x7f13e80ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458542810 0 0) 0x7f13e80d0be0 con 0x7f13e80b56d0 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d4003520 con 0x7f13e80b56d0 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 723138480 0 0) 0x7f13d4003520 con 0x7f13e80b56d0 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13e8160d50 msgr2=0x7f13e81611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13e8160d50 0x7f13e81611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 >> v2:172.21.15.170:3300/0 conn(0x7f13e815d380 msgr2=0x7f13e80ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 --2- 172.21.15.137:0/1803977253 >> v2:172.21.15.170:3300/0 conn(0x7f13e815d380 0x7f13e80ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e80d1480 con 0x7f13e80b56d0 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f13d8001670 con 0x7f13e80b56d0 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 >> v1:172.21.15.137:6789/0 conn(0x7f13e80b56d0 legacy=0x7f13e80d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13d40039b0 0x7f13d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d40043a0 0x7f13d4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13d4004f90 0x7f13d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13e80d0ec0 con 0x7f13d40043a0 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f13e80d11a0 con 0x7f13d4004f90 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f13d400bf30 con 0x7f13d40039b0 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13eeba6640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13e8160d50 0x7f13e81611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13ee3a5640 1 --2- 172.21.15.137:0/1803977253 >> v2:172.21.15.170:3300/0 conn(0x7f13e815d380 0x7f13e80ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.096+0000 7f13edba4640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d40043a0 0x7f13d4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13ee3a5640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13d40039b0 0x7f13d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13eeba6640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13d4004f90 0x7f13d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13edba4640 1 -- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13d40039b0 msgr2=0x7f13d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13edba4640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13d40039b0 0x7f13d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13edba4640 1 -- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13d4004f90 msgr2=0x7f13d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13edba4640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13d4004f90 0x7f13d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13edba4640 1 -- 172.21.15.137:0/1803977253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d4003520 con 0x7f13d40043a0 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13edba4640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d40043a0 0x7f13d4004880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007fd0 tx=0x7f13d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4778f2138cd7440c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:44.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8007d50 con 0x7f13d40043a0 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d8005af0 con 0x7f13d40043a0 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.097+0000 7f13ed3a3640 1 -- 172.21.15.137:0/1803977253 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8007070 con 0x7f13d40043a0 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.098+0000 7f13f0609640 1 -- 172.21.15.137:0/1803977253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d40043a0 msgr2=0x7f13d4004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.098+0000 7f13f0609640 1 --2- 172.21.15.137:0/1803977253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13d40043a0 0x7f13d4004880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f13d8007fd0 tx=0x7f13d4005830 comp rx=0 tx=0).stop 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.098+0000 7f13eeba6640 1 -- 172.21.15.137:0/1803977253 reap_dead start 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.098+0000 7f13f0609640 1 -- 172.21.15.137:0/1803977253 shutdown_connections 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.098+0000 7f13f0609640 1 -- 172.21.15.137:0/1803977253 >> 172.21.15.137:0/1803977253 conn(0x7f13e80b4a60 msgr2=0x7f13e80b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.098+0000 7f13f0609640 1 -- 172.21.15.137:0/1803977253 shutdown_connections 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.098+0000 7f13f0609640 1 -- 172.21.15.137:0/1803977253 wait complete. 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.099+0000 7f13f0609640 1 Processor -- start 2024-04-26T21:58:44.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.099+0000 7f13f0609640 1 -- start start 2024-04-26T21:58:44.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13f0609640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13d40043a0 0x7f13e815f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13f0609640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13e80b5cb0 0x7f13e80b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13f0609640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13e814d740 0x7f13e80b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13f0609640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13e81611e0 con 0x7f13e814d740 2024-04-26T21:58:44.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13f0609640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f13e80cedc0 con 0x7f13e80b5cb0 2024-04-26T21:58:44.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13f0609640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f13e8161360 con 0x7f13d40043a0 2024-04-26T21:58:44.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13eeba6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13e814d740 0x7f13e80b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13eeba6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13e814d740 0x7f13e80b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41770/0 (socket says 172.21.15.137:41770) 2024-04-26T21:58:44.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13eeba6640 1 -- 172.21.15.137:0/4239917261 learned_addr learned my addr 172.21.15.137:0/4239917261 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:44.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13edba4640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13e80b5cb0 0x7f13e80b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13ee3a5640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13d40043a0 0x7f13e815f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13eeba6640 1 -- 172.21.15.137:0/4239917261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13d40043a0 msgr2=0x7f13e815f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13eeba6640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13d40043a0 0x7f13e815f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13eeba6640 1 -- 172.21.15.137:0/4239917261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13e80b5cb0 msgr2=0x7f13e80b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13eeba6640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13e80b5cb0 0x7f13e80b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13eeba6640 1 -- 172.21.15.137:0/4239917261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e815f9f0 con 0x7f13e814d740 2024-04-26T21:58:44.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13edba4640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13e80b5cb0 0x7f13e80b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.100+0000 7f13eeba6640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13e814d740 0x7f13e80b6d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f13e8073ab0 tx=0x7f13e000f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.101+0000 7f13deffd640 1 -- 172.21.15.137:0/4239917261 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0003b90 con 0x7f13e814d740 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.101+0000 7f13deffd640 1 -- 172.21.15.137:0/4239917261 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e0003d30 con 0x7f13e814d740 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.101+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e815fcd0 con 0x7f13e814d740 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.101+0000 7f13deffd640 1 -- 172.21.15.137:0/4239917261 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0004270 con 0x7f13e814d740 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.101+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e806d980 con 0x7f13e814d740 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.101+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e806a290 con 0x7f13e814d740 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.102+0000 7f13deffd640 1 -- 172.21.15.137:0/4239917261 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13e0004410 con 0x7f13e814d740 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.102+0000 7f13deffd640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13cc06c920 0x7f13cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.102+0000 7f13ee3a5640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13cc06c920 0x7f13cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.102+0000 7f13deffd640 1 -- 172.21.15.137:0/4239917261 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f13e008c7a0 con 0x7f13e814d740 2024-04-26T21:58:44.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.103+0000 7f13ee3a5640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13cc06c920 0x7f13cc06ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009af0 tx=0x7f13e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:44.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.107+0000 7f13deffd640 1 -- 172.21.15.137:0/4239917261 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f13e0019070 con 0x7f13e814d740 2024-04-26T21:58:44.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.278+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13e815c600 con 0x7f13cc06c920 2024-04-26T21:58:44.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.284+0000 7f13deffd640 1 -- 172.21.15.137:0/4239917261 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237103 (secure 0 0 0) 0x7f13e815c600 con 0x7f13cc06c920 2024-04-26T21:58:44.286 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:44.288 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:58:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13cc06c920 msgr2=0x7f13cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13cc06c920 0x7f13cc06ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009af0 tx=0x7f13e4008040 comp rx=0 tx=0).stop 2024-04-26T21:58:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13e814d740 msgr2=0x7f13e80b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13e814d740 0x7f13e80b6d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f13e8073ab0 tx=0x7f13e000f870 comp rx=0 tx=0).stop 2024-04-26T21:58:44.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 shutdown_connections 2024-04-26T21:58:44.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13cc06c920 0x7f13cc06ede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13e814d740 0x7f13e80b6d10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13e80b5cb0 0x7f13e80b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 --2- 172.21.15.137:0/4239917261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13d40043a0 0x7f13e815f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.286+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 >> 172.21.15.137:0/4239917261 conn(0x7f13e80b4a60 msgr2=0x7f13e81592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:44.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.287+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 shutdown_connections 2024-04-26T21:58:44.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.287+0000 7f13f0609640 1 -- 172.21.15.137:0/4239917261 wait complete. 2024-04-26T21:58:44.297 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-26T21:58:42.694516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":235552,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739168,"statfs":{"total":773094113280,"available":772852908032,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000562"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T21:58:31.216895+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:58:31.216895+0000","last_peered":"2024-04-26T21:58:31.216895+0000","last_clean":"2024-04-26T21:58:31.216895+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:58:31.216895+0000","last_undegraded":"2024-04-26T21:58:31.216895+0000","last_fullsized":"2024-04-26T21:58:31.216895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:58:44.301 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:58:44.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.434+0000 7f7326c83640 1 Processor -- start 2024-04-26T21:58:44.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.434+0000 7f7326c83640 1 -- start start 2024-04-26T21:58:44.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.435+0000 7f7326c83640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7320160d50 0x7f73201611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.435+0000 7f7326c83640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73200d0be0 con 0x7f732015d380 2024-04-26T21:58:44.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.435+0000 7f7326c83640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73200d0ec0 con 0x7f73200b56d0 2024-04-26T21:58:44.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.435+0000 7f7326c83640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f73201616e0 con 0x7f7320160d50 2024-04-26T21:58:44.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.435+0000 7f7324a1f640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f732015d380 0x7f73200ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46034/0 (socket says 172.21.15.137:46034) 2024-04-26T21:58:44.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.435+0000 7f7324a1f640 1 -- 172.21.15.137:0/1675793299 learned_addr learned my addr 172.21.15.137:0/1675793299 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:44.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.435+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 956102616 0 0) 0x7f73200d0be0 con 0x7f732015d380 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.435+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7308003520 con 0x7f732015d380 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.435+0000 7f7325220640 1 --2- 172.21.15.137:0/1675793299 >> v2:172.21.15.170:3300/0 conn(0x7f7320160d50 0x7f73201611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1017908845 0 0) 0x7f7308003520 con 0x7f732015d380 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 >> v2:172.21.15.170:3300/0 conn(0x7f7320160d50 msgr2=0x7f73201611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 --2- 172.21.15.137:0/1675793299 >> v2:172.21.15.170:3300/0 conn(0x7f7320160d50 0x7f73201611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 >> v1:172.21.15.170:6789/0 conn(0x7f73200b56d0 legacy=0x7f73200d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73200d11a0 con 0x7f732015d380 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f7310001670 con 0x7f732015d380 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 >> v1:172.21.15.137:6789/0 conn(0x7f732015d380 legacy=0x7f73200ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f7308003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7308004800 0x7f7308004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73080051c0 0x7f730800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73201616e0 con 0x7f73080039b0 2024-04-26T21:58:44.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f730800c160 con 0x7f7308004800 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f730800c360 con 0x7f73080051c0 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f7324a1f640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f7308003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f731ffff640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7308004800 0x7f7308004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f7325220640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73080051c0 0x7f730800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f7324a1f640 1 -- 172.21.15.137:0/1675793299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73080051c0 msgr2=0x7f730800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f7324a1f640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73080051c0 0x7f730800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f7324a1f640 1 -- 172.21.15.137:0/1675793299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7308004800 msgr2=0x7f7308004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f7324a1f640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7308004800 0x7f7308004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f7325220640 1 -- 172.21.15.137:0/1675793299 reap_dead start 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.436+0000 7f7324a1f640 1 -- 172.21.15.137:0/1675793299 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7308003520 con 0x7f73080039b0 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f7324a1f640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f7308003dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f731000c210 tx=0x7f7308005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6122cd38e317784 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310007d30 con 0x7f73080039b0 2024-04-26T21:58:44.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7310005ad0 con 0x7f73080039b0 2024-04-26T21:58:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f731f7fe640 1 -- 172.21.15.137:0/1675793299 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310007070 con 0x7f73080039b0 2024-04-26T21:58:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f7326c83640 1 -- 172.21.15.137:0/1675793299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 msgr2=0x7f7308003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f7326c83640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f7308003dd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f731000c210 tx=0x7f7308005830 comp rx=0 tx=0).stop 2024-04-26T21:58:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f7326c83640 1 -- 172.21.15.137:0/1675793299 shutdown_connections 2024-04-26T21:58:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f7326c83640 1 --2- 172.21.15.137:0/1675793299 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f7308003dd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f7326c83640 1 -- 172.21.15.137:0/1675793299 >> 172.21.15.137:0/1675793299 conn(0x7f73200b4a60 msgr2=0x7f73200b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f7326c83640 1 -- 172.21.15.137:0/1675793299 shutdown_connections 2024-04-26T21:58:44.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.437+0000 7f7326c83640 1 -- 172.21.15.137:0/1675793299 wait complete. 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.439+0000 7f7326c83640 1 Processor -- start 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.439+0000 7f7326c83640 1 -- start start 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.439+0000 7f7326c83640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f732009f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.439+0000 7f7326c83640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732009fb60 0x7f732009d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.439+0000 7f7326c83640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732009dcb0 0x7f73201f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.439+0000 7f7326c83640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73201611a0 con 0x7f73080039b0 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.439+0000 7f7326c83640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f73200cedc0 con 0x7f732009fb60 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.439+0000 7f7326c83640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7320161320 con 0x7f732009dcb0 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.439+0000 7f7324a1f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f732009f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7324a1f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f732009f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41788/0 (socket says 172.21.15.137:41788) 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7324a1f640 1 -- 172.21.15.137:0/2243472184 learned_addr learned my addr 172.21.15.137:0/2243472184 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f731ffff640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732009fb60 0x7f732009d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7324a1f640 1 -- 172.21.15.137:0/2243472184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732009dcb0 msgr2=0x7f73201f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7324a1f640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732009dcb0 0x7f73201f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7324a1f640 1 -- 172.21.15.137:0/2243472184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732009fb60 msgr2=0x7f732009d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7324a1f640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732009fb60 0x7f732009d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7324a1f640 1 -- 172.21.15.137:0/2243472184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73200a00e0 con 0x7f73080039b0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7324a1f640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f732009f620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7310001200 tx=0x7f7310001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f731d7fa640 1 -- 172.21.15.137:0/2243472184 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310037040 con 0x7f73080039b0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f731d7fa640 1 -- 172.21.15.137:0/2243472184 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7310041070 con 0x7f73080039b0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73200a03c0 con 0x7f73080039b0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f731d7fa640 1 -- 172.21.15.137:0/2243472184 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73100047e0 con 0x7f73080039b0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.440+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73200a0980 con 0x7f73080039b0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.441+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732009e0d0 con 0x7f73080039b0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.442+0000 7f731d7fa640 1 -- 172.21.15.137:0/2243472184 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7310004980 con 0x7f73080039b0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.442+0000 7f731d7fa640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f730c06c8f0 0x7f730c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.442+0000 7f731ffff640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f730c06c8f0 0x7f730c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.442+0000 7f731d7fa640 1 -- 172.21.15.137:0/2243472184 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f73100ab4b0 con 0x7f73080039b0 2024-04-26T21:58:44.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.442+0000 7f731ffff640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f730c06c8f0 0x7f730c06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7314000c00 tx=0x7f7314009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:44.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.446+0000 7f731d7fa640 1 -- 172.21.15.137:0/2243472184 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7310044370 con 0x7f73080039b0 2024-04-26T21:58:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.617+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73200d1cb0 con 0x7f730c06c8f0 2024-04-26T21:58:44.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.622+0000 7f731d7fa640 1 -- 172.21.15.137:0/2243472184 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237103 (secure 0 0 0) 0x7f73200d1cb0 con 0x7f730c06c8f0 2024-04-26T21:58:44.624 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:44.625 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.624+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f730c06c8f0 msgr2=0x7f730c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f730c06c8f0 0x7f730c06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7314000c00 tx=0x7f7314009040 comp rx=0 tx=0).stop 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 msgr2=0x7f732009f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f732009f620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7310001200 tx=0x7f7310001a40 comp rx=0 tx=0).stop 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 shutdown_connections 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f730c06c8f0 0x7f730c06edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f732009dcb0 0x7f73201f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f732009fb60 0x7f732009d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 --2- 172.21.15.137:0/2243472184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73080039b0 0x7f732009f620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 >> 172.21.15.137:0/2243472184 conn(0x7f73200b4a60 msgr2=0x7f732015c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 shutdown_connections 2024-04-26T21:58:44.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.625+0000 7f7326c83640 1 -- 172.21.15.137:0/2243472184 wait complete. 2024-04-26T21:58:44.635 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-26T21:58:42.694516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":235552,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739168,"statfs":{"total":773094113280,"available":772852908032,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000562"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T21:58:31.216895+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:58:31.216895+0000","last_peered":"2024-04-26T21:58:31.216895+0000","last_clean":"2024-04-26T21:58:31.216895+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:58:31.216895+0000","last_undegraded":"2024-04-26T21:58:31.216895+0000","last_fullsized":"2024-04-26T21:58:31.216895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:40.237090+0000","last_change":"2024-04-26T21:58:40.237090+0000","last_active":"2024-04-26T21:58:40.237090+0000","last_peered":"2024-04-26T21:58:40.237090+0000","last_clean":"2024-04-26T21:58:40.237090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:40.237090+0000","last_undegraded":"2024-04-26T21:58:40.237090+0000","last_fullsized":"2024-04-26T21:58:40.237090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T21:58:39.232893+0000","last_change":"2024-04-26T21:58:39.232893+0000","last_active":"2024-04-26T21:58:39.232893+0000","last_peered":"2024-04-26T21:58:39.232893+0000","last_clean":"2024-04-26T21:58:39.232893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:58:39.232893+0000","last_undegraded":"2024-04-26T21:58:39.232893+0000","last_fullsized":"2024-04-26T21:58:39.232893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31352,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340488,"statfs":{"total":96636764160,"available":96604659712,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:58:44.639 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:58:44.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.773+0000 7febac2c4640 1 Processor -- start 2024-04-26T21:58:44.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.773+0000 7febac2c4640 1 -- start start 2024-04-26T21:58:44.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7febac2c4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feba40d11b0 0x7feba406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7febac2c4640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba40d1740 con 0x7feba406e2c0 2024-04-26T21:58:44.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7febac2c4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba40d1a20 con 0x7feba40cf2e0 2024-04-26T21:58:44.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7febac2c4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feba406e710 con 0x7feba40d11b0 2024-04-26T21:58:44.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7feba985f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feba40d11b0 0x7feba406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7febaa861640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7feba406e2c0 0x7feba415ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46038/0 (socket says 172.21.15.137:46038) 2024-04-26T21:58:44.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7febaa861640 1 -- 172.21.15.137:0/3536553272 learned_addr learned my addr 172.21.15.137:0/3536553272 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:44.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7feba985f640 1 -- 172.21.15.137:0/3536553272 >> v1:172.21.15.170:6789/0 conn(0x7feba40cf2e0 legacy=0x7feba406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:44.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7feba985f640 1 -- 172.21.15.137:0/3536553272 >> v1:172.21.15.137:6789/0 conn(0x7feba406e2c0 legacy=0x7feba415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.774+0000 7feba985f640 1 -- 172.21.15.137:0/3536553272 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba40d1d00 con 0x7feba40d11b0 2024-04-26T21:58:44.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.775+0000 7feba985f640 1 --2- 172.21.15.137:0/3536553272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 0x7feba406dd80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb940097d0 tx=0x7feb9402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f2a1013488c6c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:44.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.775+0000 7feba905e640 1 -- 172.21.15.137:0/3536553272 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94037070 con 0x7feba40d11b0 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.775+0000 7feba905e640 1 -- 172.21.15.137:0/3536553272 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb94032440 con 0x7feba40d11b0 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.775+0000 7feba905e640 1 -- 172.21.15.137:0/3536553272 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94032810 con 0x7feba40d11b0 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.775+0000 7febac2c4640 1 -- 172.21.15.137:0/3536553272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 msgr2=0x7feba406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.775+0000 7febac2c4640 1 --2- 172.21.15.137:0/3536553272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 0x7feba406dd80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb940097d0 tx=0x7feb9402a210 comp rx=0 tx=0).stop 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.775+0000 7febac2c4640 1 -- 172.21.15.137:0/3536553272 shutdown_connections 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.775+0000 7febac2c4640 1 --2- 172.21.15.137:0/3536553272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 0x7feba406dd80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.775+0000 7febac2c4640 1 -- 172.21.15.137:0/3536553272 >> 172.21.15.137:0/3536553272 conn(0x7feba40b4a60 msgr2=0x7feba40b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.776+0000 7febac2c4640 1 -- 172.21.15.137:0/3536553272 shutdown_connections 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.776+0000 7febac2c4640 1 -- 172.21.15.137:0/3536553272 wait complete. 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.777+0000 7febac2c4640 1 Processor -- start 2024-04-26T21:58:44.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.777+0000 7febac2c4640 1 -- start start 2024-04-26T21:58:44.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.777+0000 7febac2c4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feba406e2c0 0x7feba4160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.777+0000 7febac2c4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba40cf2e0 0x7feba409cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.777+0000 7febac2c4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 0x7feba40cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.777+0000 7febac2c4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feba40cf6c0 con 0x7feba40d11b0 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.777+0000 7febac2c4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feba40d22c0 con 0x7feba40cf2e0 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.777+0000 7febac2c4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feba40cf840 con 0x7feba406e2c0 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa861640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 0x7feba40cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa861640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 0x7feba40cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41808/0 (socket says 172.21.15.137:41808) 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa861640 1 -- 172.21.15.137:0/1035506139 learned_addr learned my addr 172.21.15.137:0/1035506139 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa060640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feba406e2c0 0x7feba4160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7feba985f640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba40cf2e0 0x7feba409cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa861640 1 -- 172.21.15.137:0/1035506139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feba406e2c0 msgr2=0x7feba4160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa861640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feba406e2c0 0x7feba4160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa861640 1 -- 172.21.15.137:0/1035506139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba40cf2e0 msgr2=0x7feba409cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa861640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba40cf2e0 0x7feba409cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa861640 1 -- 172.21.15.137:0/1035506139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba40cce00 con 0x7feba40d11b0 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa060640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feba406e2c0 0x7feba4160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febaa861640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 0x7feba40cc420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00cab0 tx=0x7feb9c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7feb9affd640 1 -- 172.21.15.137:0/1035506139 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c017070 con 0x7feba40d11b0 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7feb9affd640 1 -- 172.21.15.137:0/1035506139 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c00ac30 con 0x7feba40d11b0 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7feb9affd640 1 -- 172.21.15.137:0/1035506139 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c012400 con 0x7feba40d11b0 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba40cd140 con 0x7feba40d11b0 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.778+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba41ea170 con 0x7feba40d11b0 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.779+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba406a290 con 0x7feba40d11b0 2024-04-26T21:58:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.780+0000 7feb9affd640 1 -- 172.21.15.137:0/1035506139 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb9c01a070 con 0x7feba40d11b0 2024-04-26T21:58:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.780+0000 7feb9affd640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feb8806c8f0 0x7feb8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.780+0000 7febaa060640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feb8806c8f0 0x7feb8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.780+0000 7feb9affd640 1 -- 172.21.15.137:0/1035506139 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feb9c08b6f0 con 0x7feba40d11b0 2024-04-26T21:58:44.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.781+0000 7febaa060640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feb8806c8f0 0x7feb8806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feba000a830 tx=0x7feba0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:44.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.784+0000 7feb9affd640 1 -- 172.21.15.137:0/1035506139 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7feba40cd140 con 0x7feba40d11b0 2024-04-26T21:58:44.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.955+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feba40cd320 con 0x7feb8806c8f0 2024-04-26T21:58:44.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.961+0000 7feb9affd640 1 -- 172.21.15.137:0/1035506139 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7feba000adb0 con 0x7feb8806c8f0 2024-04-26T21:58:44.964 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:44.965 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:58:44.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feb8806c8f0 msgr2=0x7feb8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feb8806c8f0 0x7feb8806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feba000a830 tx=0x7feba0008040 comp rx=0 tx=0).stop 2024-04-26T21:58:44.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 msgr2=0x7feba40cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:44.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 0x7feba40cc420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00cab0 tx=0x7feb9c00cf70 comp rx=0 tx=0).stop 2024-04-26T21:58:44.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 shutdown_connections 2024-04-26T21:58:44.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feb8806c8f0 0x7feb8806edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feba40d11b0 0x7feba40cc420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feba40cf2e0 0x7feba409cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 --2- 172.21.15.137:0/1035506139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feba406e2c0 0x7feba4160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:44.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 >> 172.21.15.137:0/1035506139 conn(0x7feba40b4a60 msgr2=0x7feba4070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:44.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 shutdown_connections 2024-04-26T21:58:44.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:44.964+0000 7febac2c4640 1 -- 172.21.15.137:0/1035506139 wait complete. 2024-04-26T21:58:44.975 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-26T21:58:44.694793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235640,"kb_used_data":2836,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739080,"statfs":{"total":773094113280,"available":772852817920,"internally_reserved":0,"allocated":2904064,"data_stored":1746296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457042"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252025+0000","last_change":"2024-04-26T21:58:41.268747+0000","last_active":"2024-04-26T21:58:42.252025+0000","last_peered":"2024-04-26T21:58:42.252025+0000","last_clean":"2024-04-26T21:58:42.252025+0000","last_became_active":"2024-04-26T21:58:41.268428+0000","last_became_peered":"2024-04-26T21:58:41.268428+0000","last_unstale":"2024-04-26T21:58:42.252025+0000","last_undegraded":"2024-04-26T21:58:42.252025+0000","last_fullsized":"2024-04-26T21:58:42.252025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250604+0000","last_change":"2024-04-26T21:58:41.267888+0000","last_active":"2024-04-26T21:58:42.250604+0000","last_peered":"2024-04-26T21:58:42.250604+0000","last_clean":"2024-04-26T21:58:42.250604+0000","last_became_active":"2024-04-26T21:58:41.267511+0000","last_became_peered":"2024-04-26T21:58:41.267511+0000","last_unstale":"2024-04-26T21:58:42.250604+0000","last_undegraded":"2024-04-26T21:58:42.250604+0000","last_fullsized":"2024-04-26T21:58:42.250604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679497+0000","last_change":"2024-04-26T21:58:41.265150+0000","last_active":"2024-04-26T21:58:42.679497+0000","last_peered":"2024-04-26T21:58:42.679497+0000","last_clean":"2024-04-26T21:58:42.679497+0000","last_became_active":"2024-04-26T21:58:41.264882+0000","last_became_peered":"2024-04-26T21:58:41.264882+0000","last_unstale":"2024-04-26T21:58:42.679497+0000","last_undegraded":"2024-04-26T21:58:42.679497+0000","last_fullsized":"2024-04-26T21:58:42.679497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679252+0000","last_change":"2024-04-26T21:58:41.276698+0000","last_active":"2024-04-26T21:58:42.679252+0000","last_peered":"2024-04-26T21:58:42.679252+0000","last_clean":"2024-04-26T21:58:42.679252+0000","last_became_active":"2024-04-26T21:58:41.276439+0000","last_became_peered":"2024-04-26T21:58:41.276439+0000","last_unstale":"2024-04-26T21:58:42.679252+0000","last_undegraded":"2024-04-26T21:58:42.679252+0000","last_fullsized":"2024-04-26T21:58:42.679252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251967+0000","last_change":"2024-04-26T21:58:41.266844+0000","last_active":"2024-04-26T21:58:42.251967+0000","last_peered":"2024-04-26T21:58:42.251967+0000","last_clean":"2024-04-26T21:58:42.251967+0000","last_became_active":"2024-04-26T21:58:41.266576+0000","last_became_peered":"2024-04-26T21:58:41.266576+0000","last_unstale":"2024-04-26T21:58:42.251967+0000","last_undegraded":"2024-04-26T21:58:42.251967+0000","last_fullsized":"2024-04-26T21:58:42.251967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679113+0000","last_change":"2024-04-26T21:58:41.274496+0000","last_active":"2024-04-26T21:58:42.679113+0000","last_peered":"2024-04-26T21:58:42.679113+0000","last_clean":"2024-04-26T21:58:42.679113+0000","last_became_active":"2024-04-26T21:58:41.274206+0000","last_became_peered":"2024-04-26T21:58:41.274206+0000","last_unstale":"2024-04-26T21:58:42.679113+0000","last_undegraded":"2024-04-26T21:58:42.679113+0000","last_fullsized":"2024-04-26T21:58:42.679113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251060+0000","last_change":"2024-04-26T21:58:41.263323+0000","last_active":"2024-04-26T21:58:42.251060+0000","last_peered":"2024-04-26T21:58:42.251060+0000","last_clean":"2024-04-26T21:58:42.251060+0000","last_became_active":"2024-04-26T21:58:41.263054+0000","last_became_peered":"2024-04-26T21:58:41.263054+0000","last_unstale":"2024-04-26T21:58:42.251060+0000","last_undegraded":"2024-04-26T21:58:42.251060+0000","last_fullsized":"2024-04-26T21:58:42.251060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679251+0000","last_change":"2024-04-26T21:58:41.271464+0000","last_active":"2024-04-26T21:58:42.679251+0000","last_peered":"2024-04-26T21:58:42.679251+0000","last_clean":"2024-04-26T21:58:42.679251+0000","last_became_active":"2024-04-26T21:58:41.271196+0000","last_became_peered":"2024-04-26T21:58:41.271196+0000","last_unstale":"2024-04-26T21:58:42.679251+0000","last_undegraded":"2024-04-26T21:58:42.679251+0000","last_fullsized":"2024-04-26T21:58:42.679251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252031+0000","last_change":"2024-04-26T21:58:41.263814+0000","last_active":"2024-04-26T21:58:42.252031+0000","last_peered":"2024-04-26T21:58:42.252031+0000","last_clean":"2024-04-26T21:58:42.252031+0000","last_became_active":"2024-04-26T21:58:41.263511+0000","last_became_peered":"2024-04-26T21:58:41.263511+0000","last_unstale":"2024-04-26T21:58:42.252031+0000","last_undegraded":"2024-04-26T21:58:42.252031+0000","last_fullsized":"2024-04-26T21:58:42.252031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271753+0000","last_change":"2024-04-26T21:58:41.275685+0000","last_active":"2024-04-26T21:58:42.271753+0000","last_peered":"2024-04-26T21:58:42.271753+0000","last_clean":"2024-04-26T21:58:42.271753+0000","last_became_active":"2024-04-26T21:58:41.275415+0000","last_became_peered":"2024-04-26T21:58:41.275415+0000","last_unstale":"2024-04-26T21:58:42.271753+0000","last_undegraded":"2024-04-26T21:58:42.271753+0000","last_fullsized":"2024-04-26T21:58:42.271753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271661+0000","last_change":"2024-04-26T21:58:41.278076+0000","last_active":"2024-04-26T21:58:42.271661+0000","last_peered":"2024-04-26T21:58:42.271661+0000","last_clean":"2024-04-26T21:58:42.271661+0000","last_became_active":"2024-04-26T21:58:41.277772+0000","last_became_peered":"2024-04-26T21:58:41.277772+0000","last_unstale":"2024-04-26T21:58:42.271661+0000","last_undegraded":"2024-04-26T21:58:42.271661+0000","last_fullsized":"2024-04-26T21:58:42.271661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251676+0000","last_change":"2024-04-26T21:58:41.265624+0000","last_active":"2024-04-26T21:58:42.251676+0000","last_peered":"2024-04-26T21:58:42.251676+0000","last_clean":"2024-04-26T21:58:42.251676+0000","last_became_active":"2024-04-26T21:58:41.265100+0000","last_became_peered":"2024-04-26T21:58:41.265100+0000","last_unstale":"2024-04-26T21:58:42.251676+0000","last_undegraded":"2024-04-26T21:58:42.251676+0000","last_fullsized":"2024-04-26T21:58:42.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680143+0000","last_change":"2024-04-26T21:58:41.263878+0000","last_active":"2024-04-26T21:58:42.680143+0000","last_peered":"2024-04-26T21:58:42.680143+0000","last_clean":"2024-04-26T21:58:42.680143+0000","last_became_active":"2024-04-26T21:58:41.263324+0000","last_became_peered":"2024-04-26T21:58:41.263324+0000","last_unstale":"2024-04-26T21:58:42.680143+0000","last_undegraded":"2024-04-26T21:58:42.680143+0000","last_fullsized":"2024-04-26T21:58:42.680143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679040+0000","last_change":"2024-04-26T21:58:41.266911+0000","last_active":"2024-04-26T21:58:42.679040+0000","last_peered":"2024-04-26T21:58:42.679040+0000","last_clean":"2024-04-26T21:58:42.679040+0000","last_became_active":"2024-04-26T21:58:41.266650+0000","last_became_peered":"2024-04-26T21:58:41.266650+0000","last_unstale":"2024-04-26T21:58:42.679040+0000","last_undegraded":"2024-04-26T21:58:42.679040+0000","last_fullsized":"2024-04-26T21:58:42.679040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:41.402737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250485+0000","last_change":"2024-04-26T21:58:41.265835+0000","last_active":"2024-04-26T21:58:42.250485+0000","last_peered":"2024-04-26T21:58:42.250485+0000","last_clean":"2024-04-26T21:58:42.250485+0000","last_became_active":"2024-04-26T21:58:41.265546+0000","last_became_peered":"2024-04-26T21:58:41.265546+0000","last_unstale":"2024-04-26T21:58:42.250485+0000","last_undegraded":"2024-04-26T21:58:42.250485+0000","last_fullsized":"2024-04-26T21:58:42.250485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678981+0000","last_change":"2024-04-26T21:58:41.274315+0000","last_active":"2024-04-26T21:58:42.678981+0000","last_peered":"2024-04-26T21:58:42.678981+0000","last_clean":"2024-04-26T21:58:42.678981+0000","last_became_active":"2024-04-26T21:58:41.274000+0000","last_became_peered":"2024-04-26T21:58:41.274000+0000","last_unstale":"2024-04-26T21:58:42.678981+0000","last_undegraded":"2024-04-26T21:58:42.678981+0000","last_fullsized":"2024-04-26T21:58:42.678981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679611+0000","last_change":"2024-04-26T21:58:41.272052+0000","last_active":"2024-04-26T21:58:42.679611+0000","last_peered":"2024-04-26T21:58:42.679611+0000","last_clean":"2024-04-26T21:58:42.679611+0000","last_became_active":"2024-04-26T21:58:41.271775+0000","last_became_peered":"2024-04-26T21:58:41.271775+0000","last_unstale":"2024-04-26T21:58:42.679611+0000","last_undegraded":"2024-04-26T21:58:42.679611+0000","last_fullsized":"2024-04-26T21:58:42.679611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679120+0000","last_change":"2024-04-26T21:58:41.267754+0000","last_active":"2024-04-26T21:58:42.679120+0000","last_peered":"2024-04-26T21:58:42.679120+0000","last_clean":"2024-04-26T21:58:42.679120+0000","last_became_active":"2024-04-26T21:58:41.267414+0000","last_became_peered":"2024-04-26T21:58:41.267414+0000","last_unstale":"2024-04-26T21:58:42.679120+0000","last_undegraded":"2024-04-26T21:58:42.679120+0000","last_fullsized":"2024-04-26T21:58:42.679120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251919+0000","last_change":"2024-04-26T21:58:41.261004+0000","last_active":"2024-04-26T21:58:42.251919+0000","last_peered":"2024-04-26T21:58:42.251919+0000","last_clean":"2024-04-26T21:58:42.251919+0000","last_became_active":"2024-04-26T21:58:41.260578+0000","last_became_peered":"2024-04-26T21:58:41.260578+0000","last_unstale":"2024-04-26T21:58:42.251919+0000","last_undegraded":"2024-04-26T21:58:42.251919+0000","last_fullsized":"2024-04-26T21:58:42.251919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271701+0000","last_change":"2024-04-26T21:58:41.267436+0000","last_active":"2024-04-26T21:58:42.271701+0000","last_peered":"2024-04-26T21:58:42.271701+0000","last_clean":"2024-04-26T21:58:42.271701+0000","last_became_active":"2024-04-26T21:58:41.267151+0000","last_became_peered":"2024-04-26T21:58:41.267151+0000","last_unstale":"2024-04-26T21:58:42.271701+0000","last_undegraded":"2024-04-26T21:58:42.271701+0000","last_fullsized":"2024-04-26T21:58:42.271701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679858+0000","last_change":"2024-04-26T21:58:41.273673+0000","last_active":"2024-04-26T21:58:42.679858+0000","last_peered":"2024-04-26T21:58:42.679858+0000","last_clean":"2024-04-26T21:58:42.679858+0000","last_became_active":"2024-04-26T21:58:41.273384+0000","last_became_peered":"2024-04-26T21:58:41.273384+0000","last_unstale":"2024-04-26T21:58:42.679858+0000","last_undegraded":"2024-04-26T21:58:42.679858+0000","last_fullsized":"2024-04-26T21:58:42.679858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679139+0000","last_change":"2024-04-26T21:58:41.272126+0000","last_active":"2024-04-26T21:58:42.679139+0000","last_peered":"2024-04-26T21:58:42.679139+0000","last_clean":"2024-04-26T21:58:42.679139+0000","last_became_active":"2024-04-26T21:58:41.271816+0000","last_became_peered":"2024-04-26T21:58:41.271816+0000","last_unstale":"2024-04-26T21:58:42.679139+0000","last_undegraded":"2024-04-26T21:58:42.679139+0000","last_fullsized":"2024-04-26T21:58:42.679139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678912+0000","last_change":"2024-04-26T21:58:41.256372+0000","last_active":"2024-04-26T21:58:42.678912+0000","last_peered":"2024-04-26T21:58:42.678912+0000","last_clean":"2024-04-26T21:58:42.678912+0000","last_became_active":"2024-04-26T21:58:41.256119+0000","last_became_peered":"2024-04-26T21:58:41.256119+0000","last_unstale":"2024-04-26T21:58:42.678912+0000","last_undegraded":"2024-04-26T21:58:42.678912+0000","last_fullsized":"2024-04-26T21:58:42.678912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679089+0000","last_change":"2024-04-26T21:58:41.276385+0000","last_active":"2024-04-26T21:58:42.679089+0000","last_peered":"2024-04-26T21:58:42.679089+0000","last_clean":"2024-04-26T21:58:42.679089+0000","last_became_active":"2024-04-26T21:58:41.275917+0000","last_became_peered":"2024-04-26T21:58:41.275917+0000","last_unstale":"2024-04-26T21:58:42.679089+0000","last_undegraded":"2024-04-26T21:58:42.679089+0000","last_fullsized":"2024-04-26T21:58:42.679089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680416+0000","last_change":"2024-04-26T21:58:41.262076+0000","last_active":"2024-04-26T21:58:42.680416+0000","last_peered":"2024-04-26T21:58:42.680416+0000","last_clean":"2024-04-26T21:58:42.680416+0000","last_became_active":"2024-04-26T21:58:41.261726+0000","last_became_peered":"2024-04-26T21:58:41.261726+0000","last_unstale":"2024-04-26T21:58:42.680416+0000","last_undegraded":"2024-04-26T21:58:42.680416+0000","last_fullsized":"2024-04-26T21:58:42.680416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271762+0000","last_change":"2024-04-26T21:58:41.274846+0000","last_active":"2024-04-26T21:58:42.271762+0000","last_peered":"2024-04-26T21:58:42.271762+0000","last_clean":"2024-04-26T21:58:42.271762+0000","last_became_active":"2024-04-26T21:58:41.274526+0000","last_became_peered":"2024-04-26T21:58:41.274526+0000","last_unstale":"2024-04-26T21:58:42.271762+0000","last_undegraded":"2024-04-26T21:58:42.271762+0000","last_fullsized":"2024-04-26T21:58:42.271762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:41.265911+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:41.264263+0000","last_became_peered":"2024-04-26T21:58:41.264263+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680292+0000","last_change":"2024-04-26T21:58:41.257067+0000","last_active":"2024-04-26T21:58:42.680292+0000","last_peered":"2024-04-26T21:58:42.680292+0000","last_clean":"2024-04-26T21:58:42.680292+0000","last_became_active":"2024-04-26T21:58:41.256805+0000","last_became_peered":"2024-04-26T21:58:41.256805+0000","last_unstale":"2024-04-26T21:58:42.680292+0000","last_undegraded":"2024-04-26T21:58:42.680292+0000","last_fullsized":"2024-04-26T21:58:42.680292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679908+0000","last_change":"2024-04-26T21:58:41.266375+0000","last_active":"2024-04-26T21:58:42.679908+0000","last_peered":"2024-04-26T21:58:42.679908+0000","last_clean":"2024-04-26T21:58:42.679908+0000","last_became_active":"2024-04-26T21:58:41.265475+0000","last_became_peered":"2024-04-26T21:58:41.265475+0000","last_unstale":"2024-04-26T21:58:42.679908+0000","last_undegraded":"2024-04-26T21:58:42.679908+0000","last_fullsized":"2024-04-26T21:58:42.679908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679287+0000","last_change":"2024-04-26T21:58:41.277146+0000","last_active":"2024-04-26T21:58:42.679287+0000","last_peered":"2024-04-26T21:58:42.679287+0000","last_clean":"2024-04-26T21:58:42.679287+0000","last_became_active":"2024-04-26T21:58:41.276559+0000","last_became_peered":"2024-04-26T21:58:41.276559+0000","last_unstale":"2024-04-26T21:58:42.679287+0000","last_undegraded":"2024-04-26T21:58:42.679287+0000","last_fullsized":"2024-04-26T21:58:42.679287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678913+0000","last_change":"2024-04-26T21:58:41.276609+0000","last_active":"2024-04-26T21:58:42.678913+0000","last_peered":"2024-04-26T21:58:42.678913+0000","last_clean":"2024-04-26T21:58:42.678913+0000","last_became_active":"2024-04-26T21:58:41.276292+0000","last_became_peered":"2024-04-26T21:58:41.276292+0000","last_unstale":"2024-04-26T21:58:42.678913+0000","last_undegraded":"2024-04-26T21:58:42.678913+0000","last_fullsized":"2024-04-26T21:58:42.678913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271495+0000","last_change":"2024-04-26T21:58:41.270741+0000","last_active":"2024-04-26T21:58:42.271495+0000","last_peered":"2024-04-26T21:58:42.271495+0000","last_clean":"2024-04-26T21:58:42.271495+0000","last_became_active":"2024-04-26T21:58:41.270487+0000","last_became_peered":"2024-04-26T21:58:41.270487+0000","last_unstale":"2024-04-26T21:58:42.271495+0000","last_undegraded":"2024-04-26T21:58:42.271495+0000","last_fullsized":"2024-04-26T21:58:42.271495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250963+0000","last_change":"2024-04-26T21:58:41.266593+0000","last_active":"2024-04-26T21:58:42.250963+0000","last_peered":"2024-04-26T21:58:42.250963+0000","last_clean":"2024-04-26T21:58:42.250963+0000","last_became_active":"2024-04-26T21:58:41.264807+0000","last_became_peered":"2024-04-26T21:58:41.264807+0000","last_unstale":"2024-04-26T21:58:42.250963+0000","last_undegraded":"2024-04-26T21:58:42.250963+0000","last_fullsized":"2024-04-26T21:58:42.250963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:19.885646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680245+0000","last_change":"2024-04-26T21:58:40.261101+0000","last_active":"2024-04-26T21:58:42.680245+0000","last_peered":"2024-04-26T21:58:42.680245+0000","last_clean":"2024-04-26T21:58:42.680245+0000","last_became_active":"2024-04-26T21:58:40.260808+0000","last_became_peered":"2024-04-26T21:58:40.260808+0000","last_unstale":"2024-04-26T21:58:42.680245+0000","last_undegraded":"2024-04-26T21:58:42.680245+0000","last_fullsized":"2024-04-26T21:58:42.680245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679995+0000","last_change":"2024-04-26T21:58:41.266101+0000","last_active":"2024-04-26T21:58:42.679995+0000","last_peered":"2024-04-26T21:58:42.679995+0000","last_clean":"2024-04-26T21:58:42.679995+0000","last_became_active":"2024-04-26T21:58:41.265717+0000","last_became_peered":"2024-04-26T21:58:41.265717+0000","last_unstale":"2024-04-26T21:58:42.679995+0000","last_undegraded":"2024-04-26T21:58:42.679995+0000","last_fullsized":"2024-04-26T21:58:42.679995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271466+0000","last_change":"2024-04-26T21:58:40.258127+0000","last_active":"2024-04-26T21:58:42.271466+0000","last_peered":"2024-04-26T21:58:42.271466+0000","last_clean":"2024-04-26T21:58:42.271466+0000","last_became_active":"2024-04-26T21:58:40.257826+0000","last_became_peered":"2024-04-26T21:58:40.257826+0000","last_unstale":"2024-04-26T21:58:42.271466+0000","last_undegraded":"2024-04-26T21:58:42.271466+0000","last_fullsized":"2024-04-26T21:58:42.271466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679016+0000","last_change":"2024-04-26T21:58:40.260227+0000","last_active":"2024-04-26T21:58:42.679016+0000","last_peered":"2024-04-26T21:58:42.679016+0000","last_clean":"2024-04-26T21:58:42.679016+0000","last_became_active":"2024-04-26T21:58:40.259912+0000","last_became_peered":"2024-04-26T21:58:40.259912+0000","last_unstale":"2024-04-26T21:58:42.679016+0000","last_undegraded":"2024-04-26T21:58:42.679016+0000","last_fullsized":"2024-04-26T21:58:42.679016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679399+0000","last_change":"2024-04-26T21:58:41.270746+0000","last_active":"2024-04-26T21:58:42.679399+0000","last_peered":"2024-04-26T21:58:42.679399+0000","last_clean":"2024-04-26T21:58:42.679399+0000","last_became_active":"2024-04-26T21:58:41.270461+0000","last_became_peered":"2024-04-26T21:58:41.270461+0000","last_unstale":"2024-04-26T21:58:42.679399+0000","last_undegraded":"2024-04-26T21:58:42.679399+0000","last_fullsized":"2024-04-26T21:58:42.679399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679094+0000","last_change":"2024-04-26T21:58:40.251101+0000","last_active":"2024-04-26T21:58:42.679094+0000","last_peered":"2024-04-26T21:58:42.679094+0000","last_clean":"2024-04-26T21:58:42.679094+0000","last_became_active":"2024-04-26T21:58:40.250806+0000","last_became_peered":"2024-04-26T21:58:40.250806+0000","last_unstale":"2024-04-26T21:58:42.679094+0000","last_undegraded":"2024-04-26T21:58:42.679094+0000","last_fullsized":"2024-04-26T21:58:42.679094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250355+0000","last_change":"2024-04-26T21:58:41.264656+0000","last_active":"2024-04-26T21:58:42.250355+0000","last_peered":"2024-04-26T21:58:42.250355+0000","last_clean":"2024-04-26T21:58:42.250355+0000","last_became_active":"2024-04-26T21:58:41.264348+0000","last_became_peered":"2024-04-26T21:58:41.264348+0000","last_unstale":"2024-04-26T21:58:42.250355+0000","last_undegraded":"2024-04-26T21:58:42.250355+0000","last_fullsized":"2024-04-26T21:58:42.250355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271640+0000","last_change":"2024-04-26T21:58:40.258471+0000","last_active":"2024-04-26T21:58:42.271640+0000","last_peered":"2024-04-26T21:58:42.271640+0000","last_clean":"2024-04-26T21:58:42.271640+0000","last_became_active":"2024-04-26T21:58:40.258096+0000","last_became_peered":"2024-04-26T21:58:40.258096+0000","last_unstale":"2024-04-26T21:58:42.271640+0000","last_undegraded":"2024-04-26T21:58:42.271640+0000","last_fullsized":"2024-04-26T21:58:42.271640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679536+0000","last_change":"2024-04-26T21:58:41.273769+0000","last_active":"2024-04-26T21:58:42.679536+0000","last_peered":"2024-04-26T21:58:42.679536+0000","last_clean":"2024-04-26T21:58:42.679536+0000","last_became_active":"2024-04-26T21:58:41.271822+0000","last_became_peered":"2024-04-26T21:58:41.271822+0000","last_unstale":"2024-04-26T21:58:42.679536+0000","last_undegraded":"2024-04-26T21:58:42.679536+0000","last_fullsized":"2024-04-26T21:58:42.679536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679507+0000","last_change":"2024-04-26T21:58:40.258784+0000","last_active":"2024-04-26T21:58:42.679507+0000","last_peered":"2024-04-26T21:58:42.679507+0000","last_clean":"2024-04-26T21:58:42.679507+0000","last_became_active":"2024-04-26T21:58:40.258357+0000","last_became_peered":"2024-04-26T21:58:40.258357+0000","last_unstale":"2024-04-26T21:58:42.679507+0000","last_undegraded":"2024-04-26T21:58:42.679507+0000","last_fullsized":"2024-04-26T21:58:42.679507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679948+0000","last_change":"2024-04-26T21:58:41.279201+0000","last_active":"2024-04-26T21:58:42.679948+0000","last_peered":"2024-04-26T21:58:42.679948+0000","last_clean":"2024-04-26T21:58:42.679948+0000","last_became_active":"2024-04-26T21:58:41.278869+0000","last_became_peered":"2024-04-26T21:58:41.278869+0000","last_unstale":"2024-04-26T21:58:42.679948+0000","last_undegraded":"2024-04-26T21:58:42.679948+0000","last_fullsized":"2024-04-26T21:58:42.679948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:40.255154+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:40.254905+0000","last_became_peered":"2024-04-26T21:58:40.254905+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251689+0000","last_change":"2024-04-26T21:58:41.255887+0000","last_active":"2024-04-26T21:58:42.251689+0000","last_peered":"2024-04-26T21:58:42.251689+0000","last_clean":"2024-04-26T21:58:42.251689+0000","last_became_active":"2024-04-26T21:58:41.255557+0000","last_became_peered":"2024-04-26T21:58:41.255557+0000","last_unstale":"2024-04-26T21:58:42.251689+0000","last_undegraded":"2024-04-26T21:58:42.251689+0000","last_fullsized":"2024-04-26T21:58:42.251689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:52.499298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271704+0000","last_change":"2024-04-26T21:58:40.263413+0000","last_active":"2024-04-26T21:58:42.271704+0000","last_peered":"2024-04-26T21:58:42.271704+0000","last_clean":"2024-04-26T21:58:42.271704+0000","last_became_active":"2024-04-26T21:58:40.263104+0000","last_became_peered":"2024-04-26T21:58:40.263104+0000","last_unstale":"2024-04-26T21:58:42.271704+0000","last_undegraded":"2024-04-26T21:58:42.271704+0000","last_fullsized":"2024-04-26T21:58:42.271704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251648+0000","last_change":"2024-04-26T21:58:41.264209+0000","last_active":"2024-04-26T21:58:42.251648+0000","last_peered":"2024-04-26T21:58:42.251648+0000","last_clean":"2024-04-26T21:58:42.251648+0000","last_became_active":"2024-04-26T21:58:41.263961+0000","last_became_peered":"2024-04-26T21:58:41.263961+0000","last_unstale":"2024-04-26T21:58:42.251648+0000","last_undegraded":"2024-04-26T21:58:42.251648+0000","last_fullsized":"2024-04-26T21:58:42.251648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680014+0000","last_change":"2024-04-26T21:58:40.248876+0000","last_active":"2024-04-26T21:58:42.680014+0000","last_peered":"2024-04-26T21:58:42.680014+0000","last_clean":"2024-04-26T21:58:42.680014+0000","last_became_active":"2024-04-26T21:58:40.248573+0000","last_became_peered":"2024-04-26T21:58:40.248573+0000","last_unstale":"2024-04-26T21:58:42.680014+0000","last_undegraded":"2024-04-26T21:58:42.680014+0000","last_fullsized":"2024-04-26T21:58:42.680014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679175+0000","last_change":"2024-04-26T21:58:41.262092+0000","last_active":"2024-04-26T21:58:42.679175+0000","last_peered":"2024-04-26T21:58:42.679175+0000","last_clean":"2024-04-26T21:58:42.679175+0000","last_became_active":"2024-04-26T21:58:41.261788+0000","last_became_peered":"2024-04-26T21:58:41.261788+0000","last_unstale":"2024-04-26T21:58:42.679175+0000","last_undegraded":"2024-04-26T21:58:42.679175+0000","last_fullsized":"2024-04-26T21:58:42.679175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:28.345096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679243+0000","last_change":"2024-04-26T21:58:40.263316+0000","last_active":"2024-04-26T21:58:42.679243+0000","last_peered":"2024-04-26T21:58:42.679243+0000","last_clean":"2024-04-26T21:58:42.679243+0000","last_became_active":"2024-04-26T21:58:40.263027+0000","last_became_peered":"2024-04-26T21:58:40.263027+0000","last_unstale":"2024-04-26T21:58:42.679243+0000","last_undegraded":"2024-04-26T21:58:42.679243+0000","last_fullsized":"2024-04-26T21:58:42.679243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:41.253991+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:41.253696+0000","last_became_peered":"2024-04-26T21:58:41.253696+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271544+0000","last_change":"2024-04-26T21:58:40.261008+0000","last_active":"2024-04-26T21:58:42.271544+0000","last_peered":"2024-04-26T21:58:42.271544+0000","last_clean":"2024-04-26T21:58:42.271544+0000","last_became_active":"2024-04-26T21:58:40.260697+0000","last_became_peered":"2024-04-26T21:58:40.260697+0000","last_unstale":"2024-04-26T21:58:42.271544+0000","last_undegraded":"2024-04-26T21:58:42.271544+0000","last_fullsized":"2024-04-26T21:58:42.271544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271540+0000","last_change":"2024-04-26T21:58:41.271346+0000","last_active":"2024-04-26T21:58:42.271540+0000","last_peered":"2024-04-26T21:58:42.271540+0000","last_clean":"2024-04-26T21:58:42.271540+0000","last_became_active":"2024-04-26T21:58:41.271090+0000","last_became_peered":"2024-04-26T21:58:41.271090+0000","last_unstale":"2024-04-26T21:58:42.271540+0000","last_undegraded":"2024-04-26T21:58:42.271540+0000","last_fullsized":"2024-04-26T21:58:42.271540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678753+0000","last_change":"2024-04-26T21:58:40.253802+0000","last_active":"2024-04-26T21:58:42.678753+0000","last_peered":"2024-04-26T21:58:42.678753+0000","last_clean":"2024-04-26T21:58:42.678753+0000","last_became_active":"2024-04-26T21:58:40.253518+0000","last_became_peered":"2024-04-26T21:58:40.253518+0000","last_unstale":"2024-04-26T21:58:42.678753+0000","last_undegraded":"2024-04-26T21:58:42.678753+0000","last_fullsized":"2024-04-26T21:58:42.678753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251124+0000","last_change":"2024-04-26T21:58:41.254741+0000","last_active":"2024-04-26T21:58:42.251124+0000","last_peered":"2024-04-26T21:58:42.251124+0000","last_clean":"2024-04-26T21:58:42.251124+0000","last_became_active":"2024-04-26T21:58:41.253953+0000","last_became_peered":"2024-04-26T21:58:41.253953+0000","last_unstale":"2024-04-26T21:58:42.251124+0000","last_undegraded":"2024-04-26T21:58:42.251124+0000","last_fullsized":"2024-04-26T21:58:42.251124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251491+0000","last_change":"2024-04-26T21:58:40.253095+0000","last_active":"2024-04-26T21:58:42.251491+0000","last_peered":"2024-04-26T21:58:42.251491+0000","last_clean":"2024-04-26T21:58:42.251491+0000","last_became_active":"2024-04-26T21:58:40.252789+0000","last_became_peered":"2024-04-26T21:58:40.252789+0000","last_unstale":"2024-04-26T21:58:42.251491+0000","last_undegraded":"2024-04-26T21:58:42.251491+0000","last_fullsized":"2024-04-26T21:58:42.251491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:43.627280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251523+0000","last_change":"2024-04-26T21:58:41.256932+0000","last_active":"2024-04-26T21:58:42.251523+0000","last_peered":"2024-04-26T21:58:42.251523+0000","last_clean":"2024-04-26T21:58:42.251523+0000","last_became_active":"2024-04-26T21:58:41.256652+0000","last_became_peered":"2024-04-26T21:58:41.256652+0000","last_unstale":"2024-04-26T21:58:42.251523+0000","last_undegraded":"2024-04-26T21:58:42.251523+0000","last_fullsized":"2024-04-26T21:58:42.251523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679210+0000","last_change":"2024-04-26T21:58:40.263483+0000","last_active":"2024-04-26T21:58:42.679210+0000","last_peered":"2024-04-26T21:58:42.679210+0000","last_clean":"2024-04-26T21:58:42.679210+0000","last_became_active":"2024-04-26T21:58:40.263197+0000","last_became_peered":"2024-04-26T21:58:40.263197+0000","last_unstale":"2024-04-26T21:58:42.679210+0000","last_undegraded":"2024-04-26T21:58:42.679210+0000","last_fullsized":"2024-04-26T21:58:42.679210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252178+0000","last_change":"2024-04-26T21:58:41.257381+0000","last_active":"2024-04-26T21:58:42.252178+0000","last_peered":"2024-04-26T21:58:42.252178+0000","last_clean":"2024-04-26T21:58:42.252178+0000","last_became_active":"2024-04-26T21:58:41.256911+0000","last_became_peered":"2024-04-26T21:58:41.256911+0000","last_unstale":"2024-04-26T21:58:42.252178+0000","last_undegraded":"2024-04-26T21:58:42.252178+0000","last_fullsized":"2024-04-26T21:58:42.252178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250538+0000","last_change":"2024-04-26T21:58:40.255266+0000","last_active":"2024-04-26T21:58:42.250538+0000","last_peered":"2024-04-26T21:58:42.250538+0000","last_clean":"2024-04-26T21:58:42.250538+0000","last_became_active":"2024-04-26T21:58:40.254863+0000","last_became_peered":"2024-04-26T21:58:40.254863+0000","last_unstale":"2024-04-26T21:58:42.250538+0000","last_undegraded":"2024-04-26T21:58:42.250538+0000","last_fullsized":"2024-04-26T21:58:42.250538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679454+0000","last_change":"2024-04-26T21:58:41.277259+0000","last_active":"2024-04-26T21:58:42.679454+0000","last_peered":"2024-04-26T21:58:42.679454+0000","last_clean":"2024-04-26T21:58:42.679454+0000","last_became_active":"2024-04-26T21:58:41.276186+0000","last_became_peered":"2024-04-26T21:58:41.276186+0000","last_unstale":"2024-04-26T21:58:42.679454+0000","last_undegraded":"2024-04-26T21:58:42.679454+0000","last_fullsized":"2024-04-26T21:58:42.679454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678752+0000","last_change":"2024-04-26T21:58:40.258271+0000","last_active":"2024-04-26T21:58:42.678752+0000","last_peered":"2024-04-26T21:58:42.678752+0000","last_clean":"2024-04-26T21:58:42.678752+0000","last_became_active":"2024-04-26T21:58:40.257941+0000","last_became_peered":"2024-04-26T21:58:40.257941+0000","last_unstale":"2024-04-26T21:58:42.678752+0000","last_undegraded":"2024-04-26T21:58:42.678752+0000","last_fullsized":"2024-04-26T21:58:42.678752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252033+0000","last_change":"2024-04-26T21:58:41.270377+0000","last_active":"2024-04-26T21:58:42.252033+0000","last_peered":"2024-04-26T21:58:42.252033+0000","last_clean":"2024-04-26T21:58:42.252033+0000","last_became_active":"2024-04-26T21:58:41.270106+0000","last_became_peered":"2024-04-26T21:58:41.270106+0000","last_unstale":"2024-04-26T21:58:42.252033+0000","last_undegraded":"2024-04-26T21:58:42.252033+0000","last_fullsized":"2024-04-26T21:58:42.252033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250932+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:58:42.250932+0000","last_peered":"2024-04-26T21:58:42.250932+0000","last_clean":"2024-04-26T21:58:42.250932+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:58:42.250932+0000","last_undegraded":"2024-04-26T21:58:42.250932+0000","last_fullsized":"2024-04-26T21:58:42.250932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679020+0000","last_change":"2024-04-26T21:58:40.255645+0000","last_active":"2024-04-26T21:58:42.679020+0000","last_peered":"2024-04-26T21:58:42.679020+0000","last_clean":"2024-04-26T21:58:42.679020+0000","last_became_active":"2024-04-26T21:58:40.254847+0000","last_became_peered":"2024-04-26T21:58:40.254847+0000","last_unstale":"2024-04-26T21:58:42.679020+0000","last_undegraded":"2024-04-26T21:58:42.679020+0000","last_fullsized":"2024-04-26T21:58:42.679020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679864+0000","last_change":"2024-04-26T21:58:41.272174+0000","last_active":"2024-04-26T21:58:42.679864+0000","last_peered":"2024-04-26T21:58:42.679864+0000","last_clean":"2024-04-26T21:58:42.679864+0000","last_became_active":"2024-04-26T21:58:41.271879+0000","last_became_peered":"2024-04-26T21:58:41.271879+0000","last_unstale":"2024-04-26T21:58:42.679864+0000","last_undegraded":"2024-04-26T21:58:42.679864+0000","last_fullsized":"2024-04-26T21:58:42.679864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250883+0000","last_change":"2024-04-26T21:58:40.263425+0000","last_active":"2024-04-26T21:58:42.250883+0000","last_peered":"2024-04-26T21:58:42.250883+0000","last_clean":"2024-04-26T21:58:42.250883+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.250883+0000","last_undegraded":"2024-04-26T21:58:42.250883+0000","last_fullsized":"2024-04-26T21:58:42.250883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678995+0000","last_change":"2024-04-26T21:58:41.266358+0000","last_active":"2024-04-26T21:58:42.678995+0000","last_peered":"2024-04-26T21:58:42.678995+0000","last_clean":"2024-04-26T21:58:42.678995+0000","last_became_active":"2024-04-26T21:58:41.265803+0000","last_became_peered":"2024-04-26T21:58:41.265803+0000","last_unstale":"2024-04-26T21:58:42.678995+0000","last_undegraded":"2024-04-26T21:58:42.678995+0000","last_fullsized":"2024-04-26T21:58:42.678995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:39.448477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679090+0000","last_change":"2024-04-26T21:58:40.263478+0000","last_active":"2024-04-26T21:58:42.679090+0000","last_peered":"2024-04-26T21:58:42.679090+0000","last_clean":"2024-04-26T21:58:42.679090+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.679090+0000","last_undegraded":"2024-04-26T21:58:42.679090+0000","last_fullsized":"2024-04-26T21:58:42.679090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250423+0000","last_change":"2024-04-26T21:58:41.267643+0000","last_active":"2024-04-26T21:58:42.250423+0000","last_peered":"2024-04-26T21:58:42.250423+0000","last_clean":"2024-04-26T21:58:42.250423+0000","last_became_active":"2024-04-26T21:58:41.266985+0000","last_became_peered":"2024-04-26T21:58:41.266985+0000","last_unstale":"2024-04-26T21:58:42.250423+0000","last_undegraded":"2024-04-26T21:58:42.250423+0000","last_fullsized":"2024-04-26T21:58:42.250423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679346+0000","last_change":"2024-04-26T21:58:40.252288+0000","last_active":"2024-04-26T21:58:42.679346+0000","last_peered":"2024-04-26T21:58:42.679346+0000","last_clean":"2024-04-26T21:58:42.679346+0000","last_became_active":"2024-04-26T21:58:40.251940+0000","last_became_peered":"2024-04-26T21:58:40.251940+0000","last_unstale":"2024-04-26T21:58:42.679346+0000","last_undegraded":"2024-04-26T21:58:42.679346+0000","last_fullsized":"2024-04-26T21:58:42.679346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251381+0000","last_change":"2024-04-26T21:58:41.267485+0000","last_active":"2024-04-26T21:58:42.251381+0000","last_peered":"2024-04-26T21:58:42.251381+0000","last_clean":"2024-04-26T21:58:42.251381+0000","last_became_active":"2024-04-26T21:58:41.266964+0000","last_became_peered":"2024-04-26T21:58:41.266964+0000","last_unstale":"2024-04-26T21:58:42.251381+0000","last_undegraded":"2024-04-26T21:58:42.251381+0000","last_fullsized":"2024-04-26T21:58:42.251381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250575+0000","last_change":"2024-04-26T21:58:40.257116+0000","last_active":"2024-04-26T21:58:42.250575+0000","last_peered":"2024-04-26T21:58:42.250575+0000","last_clean":"2024-04-26T21:58:42.250575+0000","last_became_active":"2024-04-26T21:58:40.256843+0000","last_became_peered":"2024-04-26T21:58:40.256843+0000","last_unstale":"2024-04-26T21:58:42.250575+0000","last_undegraded":"2024-04-26T21:58:42.250575+0000","last_fullsized":"2024-04-26T21:58:42.250575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679465+0000","last_change":"2024-04-26T21:58:41.277155+0000","last_active":"2024-04-26T21:58:42.679465+0000","last_peered":"2024-04-26T21:58:42.679465+0000","last_clean":"2024-04-26T21:58:42.679465+0000","last_became_active":"2024-04-26T21:58:41.276120+0000","last_became_peered":"2024-04-26T21:58:41.276120+0000","last_unstale":"2024-04-26T21:58:42.679465+0000","last_undegraded":"2024-04-26T21:58:42.679465+0000","last_fullsized":"2024-04-26T21:58:42.679465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:40.265846+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:40.265527+0000","last_became_peered":"2024-04-26T21:58:40.265527+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:51.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250582+0000","last_change":"2024-04-26T21:58:41.263124+0000","last_active":"2024-04-26T21:58:42.250582+0000","last_peered":"2024-04-26T21:58:42.250582+0000","last_clean":"2024-04-26T21:58:42.250582+0000","last_became_active":"2024-04-26T21:58:41.262827+0000","last_became_peered":"2024-04-26T21:58:41.262827+0000","last_unstale":"2024-04-26T21:58:42.250582+0000","last_undegraded":"2024-04-26T21:58:42.250582+0000","last_fullsized":"2024-04-26T21:58:42.250582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271057+0000","last_change":"2024-04-26T21:58:40.256172+0000","last_active":"2024-04-26T21:58:42.271057+0000","last_peered":"2024-04-26T21:58:42.271057+0000","last_clean":"2024-04-26T21:58:42.271057+0000","last_became_active":"2024-04-26T21:58:40.255894+0000","last_became_peered":"2024-04-26T21:58:40.255894+0000","last_unstale":"2024-04-26T21:58:42.271057+0000","last_undegraded":"2024-04-26T21:58:42.271057+0000","last_fullsized":"2024-04-26T21:58:42.271057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680432+0000","last_change":"2024-04-26T21:58:41.259933+0000","last_active":"2024-04-26T21:58:42.680432+0000","last_peered":"2024-04-26T21:58:42.680432+0000","last_clean":"2024-04-26T21:58:42.680432+0000","last_became_active":"2024-04-26T21:58:41.259662+0000","last_became_peered":"2024-04-26T21:58:41.259662+0000","last_unstale":"2024-04-26T21:58:42.680432+0000","last_undegraded":"2024-04-26T21:58:42.680432+0000","last_fullsized":"2024-04-26T21:58:42.680432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271702+0000","last_change":"2024-04-26T21:58:40.260624+0000","last_active":"2024-04-26T21:58:42.271702+0000","last_peered":"2024-04-26T21:58:42.271702+0000","last_clean":"2024-04-26T21:58:42.271702+0000","last_became_active":"2024-04-26T21:58:40.260181+0000","last_became_peered":"2024-04-26T21:58:40.260181+0000","last_unstale":"2024-04-26T21:58:42.271702+0000","last_undegraded":"2024-04-26T21:58:42.271702+0000","last_fullsized":"2024-04-26T21:58:42.271702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679775+0000","last_change":"2024-04-26T21:58:41.266891+0000","last_active":"2024-04-26T21:58:42.679775+0000","last_peered":"2024-04-26T21:58:42.679775+0000","last_clean":"2024-04-26T21:58:42.679775+0000","last_became_active":"2024-04-26T21:58:41.266593+0000","last_became_peered":"2024-04-26T21:58:41.266593+0000","last_unstale":"2024-04-26T21:58:42.679775+0000","last_undegraded":"2024-04-26T21:58:42.679775+0000","last_fullsized":"2024-04-26T21:58:42.679775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250789+0000","last_change":"2024-04-26T21:58:40.265807+0000","last_active":"2024-04-26T21:58:42.250789+0000","last_peered":"2024-04-26T21:58:42.250789+0000","last_clean":"2024-04-26T21:58:42.250789+0000","last_became_active":"2024-04-26T21:58:40.265534+0000","last_became_peered":"2024-04-26T21:58:40.265534+0000","last_unstale":"2024-04-26T21:58:42.250789+0000","last_undegraded":"2024-04-26T21:58:42.250789+0000","last_fullsized":"2024-04-26T21:58:42.250789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250909+0000","last_change":"2024-04-26T21:58:41.266189+0000","last_active":"2024-04-26T21:58:42.250909+0000","last_peered":"2024-04-26T21:58:42.250909+0000","last_clean":"2024-04-26T21:58:42.250909+0000","last_became_active":"2024-04-26T21:58:41.265907+0000","last_became_peered":"2024-04-26T21:58:41.265907+0000","last_unstale":"2024-04-26T21:58:42.250909+0000","last_undegraded":"2024-04-26T21:58:42.250909+0000","last_fullsized":"2024-04-26T21:58:42.250909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:59.612605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250454+0000","last_change":"2024-04-26T21:58:40.258532+0000","last_active":"2024-04-26T21:58:42.250454+0000","last_peered":"2024-04-26T21:58:42.250454+0000","last_clean":"2024-04-26T21:58:42.250454+0000","last_became_active":"2024-04-26T21:58:40.258249+0000","last_became_peered":"2024-04-26T21:58:40.258249+0000","last_unstale":"2024-04-26T21:58:42.250454+0000","last_undegraded":"2024-04-26T21:58:42.250454+0000","last_fullsized":"2024-04-26T21:58:42.250454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679584+0000","last_change":"2024-04-26T21:58:41.268472+0000","last_active":"2024-04-26T21:58:42.679584+0000","last_peered":"2024-04-26T21:58:42.679584+0000","last_clean":"2024-04-26T21:58:42.679584+0000","last_became_active":"2024-04-26T21:58:41.268180+0000","last_became_peered":"2024-04-26T21:58:41.268180+0000","last_unstale":"2024-04-26T21:58:42.679584+0000","last_undegraded":"2024-04-26T21:58:42.679584+0000","last_fullsized":"2024-04-26T21:58:42.679584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250412+0000","last_change":"2024-04-26T21:58:40.256945+0000","last_active":"2024-04-26T21:58:42.250412+0000","last_peered":"2024-04-26T21:58:42.250412+0000","last_clean":"2024-04-26T21:58:42.250412+0000","last_became_active":"2024-04-26T21:58:40.256606+0000","last_became_peered":"2024-04-26T21:58:40.256606+0000","last_unstale":"2024-04-26T21:58:42.250412+0000","last_undegraded":"2024-04-26T21:58:42.250412+0000","last_fullsized":"2024-04-26T21:58:42.250412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680144+0000","last_change":"2024-04-26T21:58:41.271521+0000","last_active":"2024-04-26T21:58:42.680144+0000","last_peered":"2024-04-26T21:58:42.680144+0000","last_clean":"2024-04-26T21:58:42.680144+0000","last_became_active":"2024-04-26T21:58:41.270434+0000","last_became_peered":"2024-04-26T21:58:41.270434+0000","last_unstale":"2024-04-26T21:58:42.680144+0000","last_undegraded":"2024-04-26T21:58:42.680144+0000","last_fullsized":"2024-04-26T21:58:42.680144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252045+0000","last_change":"2024-04-26T21:58:40.259668+0000","last_active":"2024-04-26T21:58:42.252045+0000","last_peered":"2024-04-26T21:58:42.252045+0000","last_clean":"2024-04-26T21:58:42.252045+0000","last_became_active":"2024-04-26T21:58:40.259395+0000","last_became_peered":"2024-04-26T21:58:40.259395+0000","last_unstale":"2024-04-26T21:58:42.252045+0000","last_undegraded":"2024-04-26T21:58:42.252045+0000","last_fullsized":"2024-04-26T21:58:42.252045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271493+0000","last_change":"2024-04-26T21:58:41.270142+0000","last_active":"2024-04-26T21:58:42.271493+0000","last_peered":"2024-04-26T21:58:42.271493+0000","last_clean":"2024-04-26T21:58:42.271493+0000","last_became_active":"2024-04-26T21:58:41.269888+0000","last_became_peered":"2024-04-26T21:58:41.269888+0000","last_unstale":"2024-04-26T21:58:42.271493+0000","last_undegraded":"2024-04-26T21:58:42.271493+0000","last_fullsized":"2024-04-26T21:58:42.271493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679421+0000","last_change":"2024-04-26T21:58:41.270107+0000","last_active":"2024-04-26T21:58:42.679421+0000","last_peered":"2024-04-26T21:58:42.679421+0000","last_clean":"2024-04-26T21:58:42.679421+0000","last_became_active":"2024-04-26T21:58:41.267030+0000","last_became_peered":"2024-04-26T21:58:41.267030+0000","last_unstale":"2024-04-26T21:58:42.679421+0000","last_undegraded":"2024-04-26T21:58:42.679421+0000","last_fullsized":"2024-04-26T21:58:42.679421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251589+0000","last_change":"2024-04-26T21:58:40.258932+0000","last_active":"2024-04-26T21:58:42.251589+0000","last_peered":"2024-04-26T21:58:42.251589+0000","last_clean":"2024-04-26T21:58:42.251589+0000","last_became_active":"2024-04-26T21:58:40.258648+0000","last_became_peered":"2024-04-26T21:58:40.258648+0000","last_unstale":"2024-04-26T21:58:42.251589+0000","last_undegraded":"2024-04-26T21:58:42.251589+0000","last_fullsized":"2024-04-26T21:58:42.251589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679261+0000","last_change":"2024-04-26T21:58:41.269888+0000","last_active":"2024-04-26T21:58:42.679261+0000","last_peered":"2024-04-26T21:58:42.679261+0000","last_clean":"2024-04-26T21:58:42.679261+0000","last_became_active":"2024-04-26T21:58:41.269608+0000","last_became_peered":"2024-04-26T21:58:41.269608+0000","last_unstale":"2024-04-26T21:58:42.679261+0000","last_undegraded":"2024-04-26T21:58:42.679261+0000","last_fullsized":"2024-04-26T21:58:42.679261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251773+0000","last_change":"2024-04-26T21:58:40.261919+0000","last_active":"2024-04-26T21:58:42.251773+0000","last_peered":"2024-04-26T21:58:42.251773+0000","last_clean":"2024-04-26T21:58:42.251773+0000","last_became_active":"2024-04-26T21:58:40.261644+0000","last_became_peered":"2024-04-26T21:58:40.261644+0000","last_unstale":"2024-04-26T21:58:42.251773+0000","last_undegraded":"2024-04-26T21:58:42.251773+0000","last_fullsized":"2024-04-26T21:58:42.251773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679439+0000","last_change":"2024-04-26T21:58:41.279829+0000","last_active":"2024-04-26T21:58:42.679439+0000","last_peered":"2024-04-26T21:58:42.679439+0000","last_clean":"2024-04-26T21:58:42.679439+0000","last_became_active":"2024-04-26T21:58:41.279430+0000","last_became_peered":"2024-04-26T21:58:41.279430+0000","last_unstale":"2024-04-26T21:58:42.679439+0000","last_undegraded":"2024-04-26T21:58:42.679439+0000","last_fullsized":"2024-04-26T21:58:42.679439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680388+0000","last_change":"2024-04-26T21:58:40.265856+0000","last_active":"2024-04-26T21:58:42.680388+0000","last_peered":"2024-04-26T21:58:42.680388+0000","last_clean":"2024-04-26T21:58:42.680388+0000","last_became_active":"2024-04-26T21:58:40.265592+0000","last_became_peered":"2024-04-26T21:58:40.265592+0000","last_unstale":"2024-04-26T21:58:42.680388+0000","last_undegraded":"2024-04-26T21:58:42.680388+0000","last_fullsized":"2024-04-26T21:58:42.680388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680383+0000","last_change":"2024-04-26T21:58:41.267721+0000","last_active":"2024-04-26T21:58:42.680383+0000","last_peered":"2024-04-26T21:58:42.680383+0000","last_clean":"2024-04-26T21:58:42.680383+0000","last_became_active":"2024-04-26T21:58:41.267424+0000","last_became_peered":"2024-04-26T21:58:41.267424+0000","last_unstale":"2024-04-26T21:58:42.680383+0000","last_undegraded":"2024-04-26T21:58:42.680383+0000","last_fullsized":"2024-04-26T21:58:42.680383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680053+0000","last_change":"2024-04-26T21:58:40.251924+0000","last_active":"2024-04-26T21:58:42.680053+0000","last_peered":"2024-04-26T21:58:42.680053+0000","last_clean":"2024-04-26T21:58:42.680053+0000","last_became_active":"2024-04-26T21:58:40.251596+0000","last_became_peered":"2024-04-26T21:58:40.251596+0000","last_unstale":"2024-04-26T21:58:42.680053+0000","last_undegraded":"2024-04-26T21:58:42.680053+0000","last_fullsized":"2024-04-26T21:58:42.680053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:18:55.150047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:58:44.980 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T21:58:45.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.111+0000 7fc6a2247640 1 Processor -- start 2024-04-26T21:58:45.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.111+0000 7fc6a2247640 1 -- start start 2024-04-26T21:58:45.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.111+0000 7fc6a2247640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc69c15f6a0 0x7fc69c070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc6a2247640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c15fce0 con 0x7fc69c0b5530 2024-04-26T21:58:45.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc6a2247640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c15ffc0 con 0x7fc69c09ba40 2024-04-26T21:58:45.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc6a2247640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc69c0b59c0 con 0x7fc69c15f6a0 2024-04-26T21:58:45.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc69affd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc69c15f6a0 0x7fc69c070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc69bfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc69c0b5530 0x7fc69c0d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46048/0 (socket says 172.21.15.137:46048) 2024-04-26T21:58:45.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc69bfff640 1 -- 172.21.15.137:0/1557976604 learned_addr learned my addr 172.21.15.137:0/1557976604 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:45.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc69affd640 1 -- 172.21.15.137:0/1557976604 >> v1:172.21.15.170:6789/0 conn(0x7fc69c09ba40 legacy=0x7fc69c09be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc69affd640 1 -- 172.21.15.137:0/1557976604 >> v1:172.21.15.137:6789/0 conn(0x7fc69c0b5530 legacy=0x7fc69c0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc69affd640 1 -- 172.21.15.137:0/1557976604 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c1602a0 con 0x7fc69c15f6a0 2024-04-26T21:58:45.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.112+0000 7fc69a7fc640 1 -- 172.21.15.137:0/1557976604 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811641348 0 0) 0x7fc69c15fce0 con 0x7fc69c0b5530 2024-04-26T21:58:45.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc69affd640 1 --2- 172.21.15.137:0/1557976604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c15f6a0 0x7fc69c070570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6900097a0 tx=0x7fc69002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4493db1cfbde7a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:45.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc69a7fc640 1 -- 172.21.15.137:0/1557976604 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690037070 con 0x7fc69c15f6a0 2024-04-26T21:58:45.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc69a7fc640 1 -- 172.21.15.137:0/1557976604 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc690032440 con 0x7fc69c15f6a0 2024-04-26T21:58:45.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc69a7fc640 1 -- 172.21.15.137:0/1557976604 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc690032810 con 0x7fc69c15f6a0 2024-04-26T21:58:45.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc6a2247640 1 -- 172.21.15.137:0/1557976604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c15f6a0 msgr2=0x7fc69c070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc6a2247640 1 --2- 172.21.15.137:0/1557976604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c15f6a0 0x7fc69c070570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc6900097a0 tx=0x7fc69002a230 comp rx=0 tx=0).stop 2024-04-26T21:58:45.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc6a2247640 1 -- 172.21.15.137:0/1557976604 shutdown_connections 2024-04-26T21:58:45.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc6a2247640 1 --2- 172.21.15.137:0/1557976604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c15f6a0 0x7fc69c070570 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc6a2247640 1 -- 172.21.15.137:0/1557976604 >> 172.21.15.137:0/1557976604 conn(0x7fc69c0b4a10 msgr2=0x7fc69c0b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:45.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc6a2247640 1 -- 172.21.15.137:0/1557976604 shutdown_connections 2024-04-26T21:58:45.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.113+0000 7fc6a2247640 1 -- 172.21.15.137:0/1557976604 wait complete. 2024-04-26T21:58:45.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc6a2247640 1 Processor -- start 2024-04-26T21:58:45.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc6a2247640 1 -- start start 2024-04-26T21:58:45.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc6a2247640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c09ba40 0x7fc69c0b8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc6a2247640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc69c0b5530 0x7fc69c1492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc6a2247640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc69c15f6a0 0x7fc69c0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc6a2247640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c0d1ae0 con 0x7fc69c09ba40 2024-04-26T21:58:45.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc6a2247640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc69c0d1960 con 0x7fc69c0b5530 2024-04-26T21:58:45.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc6a2247640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc69c0d1c60 con 0x7fc69c15f6a0 2024-04-26T21:58:45.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c09ba40 0x7fc69c0b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc69b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c09ba40 0x7fc69c0b8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41818/0 (socket says 172.21.15.137:41818) 2024-04-26T21:58:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.115+0000 7fc69b7fe640 1 -- 172.21.15.137:0/3325392259 learned_addr learned my addr 172.21.15.137:0/3325392259 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc69bfff640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc69c15f6a0 0x7fc69c0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc69affd640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc69c0b5530 0x7fc69c1492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc69b7fe640 1 -- 172.21.15.137:0/3325392259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc69c15f6a0 msgr2=0x7fc69c0c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc69b7fe640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc69c15f6a0 0x7fc69c0c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc69b7fe640 1 -- 172.21.15.137:0/3325392259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc69c0b5530 msgr2=0x7fc69c1492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc69b7fe640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc69c0b5530 0x7fc69c1492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc69b7fe640 1 -- 172.21.15.137:0/3325392259 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c0c8f30 con 0x7fc69c09ba40 2024-04-26T21:58:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc69affd640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc69c0b5530 0x7fc69c1492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc69b7fe640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c09ba40 0x7fc69c0b8360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00c450 tx=0x7fc68c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc683fff640 1 -- 172.21.15.137:0/3325392259 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0052d0 con 0x7fc69c09ba40 2024-04-26T21:58:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc683fff640 1 -- 172.21.15.137:0/3325392259 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68c005470 con 0x7fc69c09ba40 2024-04-26T21:58:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc683fff640 1 -- 172.21.15.137:0/3325392259 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c012870 con 0x7fc69c09ba40 2024-04-26T21:58:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c0c9210 con 0x7fc69c09ba40 2024-04-26T21:58:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.116+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc69c0c6c80 con 0x7fc69c09ba40 2024-04-26T21:58:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.117+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69c06a290 con 0x7fc69c09ba40 2024-04-26T21:58:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.117+0000 7fc683fff640 1 -- 172.21.15.137:0/3325392259 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc68c012a10 con 0x7fc69c09ba40 2024-04-26T21:58:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.118+0000 7fc683fff640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc68806c8f0 0x7fc68806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.118+0000 7fc69affd640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc68806c8f0 0x7fc68806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.118+0000 7fc683fff640 1 -- 172.21.15.137:0/3325392259 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc68c08b790 con 0x7fc69c09ba40 2024-04-26T21:58:45.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.118+0000 7fc69affd640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc68806c8f0 0x7fc68806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc690034000 tx=0x7fc69002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:45.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.122+0000 7fc683fff640 1 -- 172.21.15.137:0/3325392259 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc68c059bb0 con 0x7fc69c09ba40 2024-04-26T21:58:45.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.368+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc69c15aed0 con 0x7fc69c09ba40 2024-04-26T21:58:45.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.369+0000 7fc683fff640 1 -- 172.21.15.137:0/3325392259 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1011 (secure 0 0 0) 0x7fc68c0594b0 con 0x7fc69c09ba40 2024-04-26T21:58:45.370 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:45.370 INFO:teuthology.orchestra.run.smithi137.stdout:{"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1714168707,"num_in_osds":8,"osd_in_since":1714168698,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":241295360,"bytes_avail":772852817920,"bytes_total":773094113280,"write_bytes_sec":2627,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4305}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T21:58:16.559572+0000","services":{}},"progress_events":{}} 2024-04-26T21:58:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc68806c8f0 msgr2=0x7fc68806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc68806c8f0 0x7fc68806edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc690034000 tx=0x7fc69002e000 comp rx=0 tx=0).stop 2024-04-26T21:58:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c09ba40 msgr2=0x7fc69c0b8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c09ba40 0x7fc69c0b8360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc68c00c450 tx=0x7fc68c00c910 comp rx=0 tx=0).stop 2024-04-26T21:58:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 shutdown_connections 2024-04-26T21:58:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc68806c8f0 0x7fc68806edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc69c15f6a0 0x7fc69c0c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc69c0b5530 0x7fc69c1492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 --2- 172.21.15.137:0/3325392259 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc69c09ba40 0x7fc69c0b8360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 >> 172.21.15.137:0/3325392259 conn(0x7fc69c0b4a10 msgr2=0x7fc69c06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 shutdown_connections 2024-04-26T21:58:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.371+0000 7fc6a2247640 1 -- 172.21.15.137:0/3325392259 wait complete. 2024-04-26T21:58:45.382 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T21:58:45.382 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:58:45.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.479+0000 7fac9137f640 1 Processor -- start 2024-04-26T21:58:45.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.479+0000 7fac9137f640 1 -- start start 2024-04-26T21:58:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.479+0000 7fac9137f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fac8c0d3ee0 0x7fac8c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.479+0000 7fac9137f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15f750 0x7fac8c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.479+0000 7fac9137f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c0d03a0 con 0x7fac8c15f370 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.479+0000 7fac9137f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fac8c0b4d10 con 0x7fac8c0d3ee0 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.479+0000 7fac9137f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fac8c0d0680 con 0x7fac8c15f750 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac8affd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fac8c15f370 0x7fac8c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:46064/0 (socket says 172.21.15.137:46064) 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac8affd640 1 -- 172.21.15.137:0/3695839751 learned_addr learned my addr 172.21.15.137:0/3695839751 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac8b7fe640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15f750 0x7fac8c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac8a7fc640 1 --2- 172.21.15.137:0/3695839751 >> v2:172.21.15.170:3300/0 conn(0x7fac8c0d3ee0 0x7fac8c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2247607134 0 0) 0x7fac8c0d03a0 con 0x7fac8c15f370 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac74003520 con 0x7fac8c15f370 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1486760283 0 0) 0x7fac74003520 con 0x7fac8c15f370 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15f750 msgr2=0x7fac8c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15f750 0x7fac8c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 >> v2:172.21.15.170:3300/0 conn(0x7fac8c0d3ee0 msgr2=0x7fac8c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 --2- 172.21.15.137:0/3695839751 >> v2:172.21.15.170:3300/0 conn(0x7fac8c0d3ee0 0x7fac8c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c0d0960 con 0x7fac8c15f370 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fac7c001670 con 0x7fac8c15f370 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 >> v1:172.21.15.137:6789/0 conn(0x7fac8c15f370 legacy=0x7fac8c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15f750 0x7fac740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac74003f30 0x7fac74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac74004d40 0x7fac740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c0b4d10 con 0x7fac74003f30 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c0d0680 con 0x7fac74004d40 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fac7400b9c0 con 0x7fac8c15f750 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac8a7fc640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac74003f30 0x7fac74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac8affd640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15f750 0x7fac740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.480+0000 7fac8b7fe640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac74004d40 0x7fac740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.481+0000 7fac8a7fc640 1 -- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15f750 msgr2=0x7fac740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:45.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.481+0000 7fac8a7fc640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15f750 0x7fac740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.481+0000 7fac8a7fc640 1 -- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac74004d40 msgr2=0x7fac740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.481+0000 7fac8a7fc640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac74004d40 0x7fac740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.481+0000 7fac8a7fc640 1 -- 172.21.15.137:0/3695839751 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac74003520 con 0x7fac74003f30 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.481+0000 7fac8a7fc640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac74003f30 0x7fac74004800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac8c08e680 tx=0x7fac74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ce5a5fa3e755fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.481+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80036070 con 0x7fac74003f30 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.481+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac80031400 con 0x7fac74003f30 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.481+0000 7fac89ffb640 1 -- 172.21.15.137:0/3695839751 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80009690 con 0x7fac74003f30 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.482+0000 7fac9137f640 1 -- 172.21.15.137:0/3695839751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac74003f30 msgr2=0x7fac74004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.482+0000 7fac9137f640 1 --2- 172.21.15.137:0/3695839751 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac74003f30 0x7fac74004800 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fac8c08e680 tx=0x7fac74005830 comp rx=0 tx=0).stop 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.482+0000 7fac8b7fe640 1 -- 172.21.15.137:0/3695839751 reap_dead start 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.482+0000 7fac9137f640 1 -- 172.21.15.137:0/3695839751 shutdown_connections 2024-04-26T21:58:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.482+0000 7fac9137f640 1 -- 172.21.15.137:0/3695839751 >> 172.21.15.137:0/3695839751 conn(0x7fac8c08ec10 msgr2=0x7fac8c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.482+0000 7fac9137f640 1 -- 172.21.15.137:0/3695839751 shutdown_connections 2024-04-26T21:58:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.482+0000 7fac9137f640 1 -- 172.21.15.137:0/3695839751 wait complete. 2024-04-26T21:58:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.483+0000 7fac9137f640 1 Processor -- start 2024-04-26T21:58:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.483+0000 7fac9137f640 1 -- start start 2024-04-26T21:58:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac9137f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac74003f30 0x7fac8c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac9137f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15b5e0 0x7fac8c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac9137f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac8c1e5e30 0x7fac8c1e62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac9137f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c0b47d0 con 0x7fac8c1e5e30 2024-04-26T21:58:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac9137f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c0d0f20 con 0x7fac74003f30 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac9137f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fac8c0b4950 con 0x7fac8c15b5e0 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac8c1e5e30 0x7fac8c1e62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac8c1e5e30 0x7fac8c1e62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41828/0 (socket says 172.21.15.137:41828) 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8b7fe640 1 -- 172.21.15.137:0/3797400728 learned_addr learned my addr 172.21.15.137:0/3797400728 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8a7fc640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15b5e0 0x7fac8c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8b7fe640 1 -- 172.21.15.137:0/3797400728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15b5e0 msgr2=0x7fac8c15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8affd640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac74003f30 0x7fac8c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8b7fe640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15b5e0 0x7fac8c15ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8b7fe640 1 -- 172.21.15.137:0/3797400728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac74003f30 msgr2=0x7fac8c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8b7fe640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac74003f30 0x7fac8c15ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8b7fe640 1 -- 172.21.15.137:0/3797400728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c0cec30 con 0x7fac8c1e5e30 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.484+0000 7fac8b7fe640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac8c1e5e30 0x7fac8c1e62b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0b7cf0 tx=0x7fac8400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.485+0000 7fac737fe640 1 -- 172.21.15.137:0/3797400728 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8400fde0 con 0x7fac8c1e5e30 2024-04-26T21:58:45.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.485+0000 7fac737fe640 1 -- 172.21.15.137:0/3797400728 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac84015430 con 0x7fac8c1e5e30 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.485+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c15c150 con 0x7fac8c1e5e30 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.485+0000 7fac737fe640 1 -- 172.21.15.137:0/3797400728 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84015820 con 0x7fac8c1e5e30 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.485+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8c15c710 con 0x7fac8c1e5e30 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.486+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8c1e67f0 con 0x7fac8c1e5e30 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.486+0000 7fac737fe640 1 -- 172.21.15.137:0/3797400728 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac840159c0 con 0x7fac8c1e5e30 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.487+0000 7fac737fe640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac7806c920 0x7fac7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.487+0000 7fac8affd640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac7806c920 0x7fac7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.487+0000 7fac737fe640 1 -- 172.21.15.137:0/3797400728 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fac8408c880 con 0x7fac8c1e5e30 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.487+0000 7fac8affd640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac7806c920 0x7fac7806ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac7c007fd0 tx=0x7fac7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.491+0000 7fac737fe640 1 -- 172.21.15.137:0/3797400728 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fac84019030 con 0x7fac8c1e5e30 2024-04-26T21:58:45.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.663+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac8c06a290 con 0x7fac7806c920 2024-04-26T21:58:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.669+0000 7fac737fe640 1 -- 172.21.15.137:0/3797400728 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251944 (secure 0 0 0) 0x7fac8c06a290 con 0x7fac7806c920 2024-04-26T21:58:45.672 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:45.673 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:58:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac7806c920 msgr2=0x7fac7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac7806c920 0x7fac7806ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac7c007fd0 tx=0x7fac7c009040 comp rx=0 tx=0).stop 2024-04-26T21:58:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac8c1e5e30 msgr2=0x7fac8c1e62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac8c1e5e30 0x7fac8c1e62b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0b7cf0 tx=0x7fac8400f580 comp rx=0 tx=0).stop 2024-04-26T21:58:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 shutdown_connections 2024-04-26T21:58:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac7806c920 0x7fac7806ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac8c1e5e30 0x7fac8c1e62b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac8c15b5e0 0x7fac8c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 --2- 172.21.15.137:0/3797400728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac74003f30 0x7fac8c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 >> 172.21.15.137:0/3797400728 conn(0x7fac8c08ec10 msgr2=0x7fac8c06df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 shutdown_connections 2024-04-26T21:58:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:45.672+0000 7fac9137f640 1 -- 172.21.15.137:0/3797400728 wait complete. 2024-04-26T21:58:45.683 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-26T21:58:44.694793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235640,"kb_used_data":2836,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739080,"statfs":{"total":773094113280,"available":772852817920,"internally_reserved":0,"allocated":2904064,"data_stored":1746296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.457042"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252025+0000","last_change":"2024-04-26T21:58:41.268747+0000","last_active":"2024-04-26T21:58:42.252025+0000","last_peered":"2024-04-26T21:58:42.252025+0000","last_clean":"2024-04-26T21:58:42.252025+0000","last_became_active":"2024-04-26T21:58:41.268428+0000","last_became_peered":"2024-04-26T21:58:41.268428+0000","last_unstale":"2024-04-26T21:58:42.252025+0000","last_undegraded":"2024-04-26T21:58:42.252025+0000","last_fullsized":"2024-04-26T21:58:42.252025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250604+0000","last_change":"2024-04-26T21:58:41.267888+0000","last_active":"2024-04-26T21:58:42.250604+0000","last_peered":"2024-04-26T21:58:42.250604+0000","last_clean":"2024-04-26T21:58:42.250604+0000","last_became_active":"2024-04-26T21:58:41.267511+0000","last_became_peered":"2024-04-26T21:58:41.267511+0000","last_unstale":"2024-04-26T21:58:42.250604+0000","last_undegraded":"2024-04-26T21:58:42.250604+0000","last_fullsized":"2024-04-26T21:58:42.250604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679497+0000","last_change":"2024-04-26T21:58:41.265150+0000","last_active":"2024-04-26T21:58:42.679497+0000","last_peered":"2024-04-26T21:58:42.679497+0000","last_clean":"2024-04-26T21:58:42.679497+0000","last_became_active":"2024-04-26T21:58:41.264882+0000","last_became_peered":"2024-04-26T21:58:41.264882+0000","last_unstale":"2024-04-26T21:58:42.679497+0000","last_undegraded":"2024-04-26T21:58:42.679497+0000","last_fullsized":"2024-04-26T21:58:42.679497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679252+0000","last_change":"2024-04-26T21:58:41.276698+0000","last_active":"2024-04-26T21:58:42.679252+0000","last_peered":"2024-04-26T21:58:42.679252+0000","last_clean":"2024-04-26T21:58:42.679252+0000","last_became_active":"2024-04-26T21:58:41.276439+0000","last_became_peered":"2024-04-26T21:58:41.276439+0000","last_unstale":"2024-04-26T21:58:42.679252+0000","last_undegraded":"2024-04-26T21:58:42.679252+0000","last_fullsized":"2024-04-26T21:58:42.679252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251967+0000","last_change":"2024-04-26T21:58:41.266844+0000","last_active":"2024-04-26T21:58:42.251967+0000","last_peered":"2024-04-26T21:58:42.251967+0000","last_clean":"2024-04-26T21:58:42.251967+0000","last_became_active":"2024-04-26T21:58:41.266576+0000","last_became_peered":"2024-04-26T21:58:41.266576+0000","last_unstale":"2024-04-26T21:58:42.251967+0000","last_undegraded":"2024-04-26T21:58:42.251967+0000","last_fullsized":"2024-04-26T21:58:42.251967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679113+0000","last_change":"2024-04-26T21:58:41.274496+0000","last_active":"2024-04-26T21:58:42.679113+0000","last_peered":"2024-04-26T21:58:42.679113+0000","last_clean":"2024-04-26T21:58:42.679113+0000","last_became_active":"2024-04-26T21:58:41.274206+0000","last_became_peered":"2024-04-26T21:58:41.274206+0000","last_unstale":"2024-04-26T21:58:42.679113+0000","last_undegraded":"2024-04-26T21:58:42.679113+0000","last_fullsized":"2024-04-26T21:58:42.679113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251060+0000","last_change":"2024-04-26T21:58:41.263323+0000","last_active":"2024-04-26T21:58:42.251060+0000","last_peered":"2024-04-26T21:58:42.251060+0000","last_clean":"2024-04-26T21:58:42.251060+0000","last_became_active":"2024-04-26T21:58:41.263054+0000","last_became_peered":"2024-04-26T21:58:41.263054+0000","last_unstale":"2024-04-26T21:58:42.251060+0000","last_undegraded":"2024-04-26T21:58:42.251060+0000","last_fullsized":"2024-04-26T21:58:42.251060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679251+0000","last_change":"2024-04-26T21:58:41.271464+0000","last_active":"2024-04-26T21:58:42.679251+0000","last_peered":"2024-04-26T21:58:42.679251+0000","last_clean":"2024-04-26T21:58:42.679251+0000","last_became_active":"2024-04-26T21:58:41.271196+0000","last_became_peered":"2024-04-26T21:58:41.271196+0000","last_unstale":"2024-04-26T21:58:42.679251+0000","last_undegraded":"2024-04-26T21:58:42.679251+0000","last_fullsized":"2024-04-26T21:58:42.679251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252031+0000","last_change":"2024-04-26T21:58:41.263814+0000","last_active":"2024-04-26T21:58:42.252031+0000","last_peered":"2024-04-26T21:58:42.252031+0000","last_clean":"2024-04-26T21:58:42.252031+0000","last_became_active":"2024-04-26T21:58:41.263511+0000","last_became_peered":"2024-04-26T21:58:41.263511+0000","last_unstale":"2024-04-26T21:58:42.252031+0000","last_undegraded":"2024-04-26T21:58:42.252031+0000","last_fullsized":"2024-04-26T21:58:42.252031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271753+0000","last_change":"2024-04-26T21:58:41.275685+0000","last_active":"2024-04-26T21:58:42.271753+0000","last_peered":"2024-04-26T21:58:42.271753+0000","last_clean":"2024-04-26T21:58:42.271753+0000","last_became_active":"2024-04-26T21:58:41.275415+0000","last_became_peered":"2024-04-26T21:58:41.275415+0000","last_unstale":"2024-04-26T21:58:42.271753+0000","last_undegraded":"2024-04-26T21:58:42.271753+0000","last_fullsized":"2024-04-26T21:58:42.271753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271661+0000","last_change":"2024-04-26T21:58:41.278076+0000","last_active":"2024-04-26T21:58:42.271661+0000","last_peered":"2024-04-26T21:58:42.271661+0000","last_clean":"2024-04-26T21:58:42.271661+0000","last_became_active":"2024-04-26T21:58:41.277772+0000","last_became_peered":"2024-04-26T21:58:41.277772+0000","last_unstale":"2024-04-26T21:58:42.271661+0000","last_undegraded":"2024-04-26T21:58:42.271661+0000","last_fullsized":"2024-04-26T21:58:42.271661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251676+0000","last_change":"2024-04-26T21:58:41.265624+0000","last_active":"2024-04-26T21:58:42.251676+0000","last_peered":"2024-04-26T21:58:42.251676+0000","last_clean":"2024-04-26T21:58:42.251676+0000","last_became_active":"2024-04-26T21:58:41.265100+0000","last_became_peered":"2024-04-26T21:58:41.265100+0000","last_unstale":"2024-04-26T21:58:42.251676+0000","last_undegraded":"2024-04-26T21:58:42.251676+0000","last_fullsized":"2024-04-26T21:58:42.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680143+0000","last_change":"2024-04-26T21:58:41.263878+0000","last_active":"2024-04-26T21:58:42.680143+0000","last_peered":"2024-04-26T21:58:42.680143+0000","last_clean":"2024-04-26T21:58:42.680143+0000","last_became_active":"2024-04-26T21:58:41.263324+0000","last_became_peered":"2024-04-26T21:58:41.263324+0000","last_unstale":"2024-04-26T21:58:42.680143+0000","last_undegraded":"2024-04-26T21:58:42.680143+0000","last_fullsized":"2024-04-26T21:58:42.680143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679040+0000","last_change":"2024-04-26T21:58:41.266911+0000","last_active":"2024-04-26T21:58:42.679040+0000","last_peered":"2024-04-26T21:58:42.679040+0000","last_clean":"2024-04-26T21:58:42.679040+0000","last_became_active":"2024-04-26T21:58:41.266650+0000","last_became_peered":"2024-04-26T21:58:41.266650+0000","last_unstale":"2024-04-26T21:58:42.679040+0000","last_undegraded":"2024-04-26T21:58:42.679040+0000","last_fullsized":"2024-04-26T21:58:42.679040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:41.402737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250485+0000","last_change":"2024-04-26T21:58:41.265835+0000","last_active":"2024-04-26T21:58:42.250485+0000","last_peered":"2024-04-26T21:58:42.250485+0000","last_clean":"2024-04-26T21:58:42.250485+0000","last_became_active":"2024-04-26T21:58:41.265546+0000","last_became_peered":"2024-04-26T21:58:41.265546+0000","last_unstale":"2024-04-26T21:58:42.250485+0000","last_undegraded":"2024-04-26T21:58:42.250485+0000","last_fullsized":"2024-04-26T21:58:42.250485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678981+0000","last_change":"2024-04-26T21:58:41.274315+0000","last_active":"2024-04-26T21:58:42.678981+0000","last_peered":"2024-04-26T21:58:42.678981+0000","last_clean":"2024-04-26T21:58:42.678981+0000","last_became_active":"2024-04-26T21:58:41.274000+0000","last_became_peered":"2024-04-26T21:58:41.274000+0000","last_unstale":"2024-04-26T21:58:42.678981+0000","last_undegraded":"2024-04-26T21:58:42.678981+0000","last_fullsized":"2024-04-26T21:58:42.678981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679611+0000","last_change":"2024-04-26T21:58:41.272052+0000","last_active":"2024-04-26T21:58:42.679611+0000","last_peered":"2024-04-26T21:58:42.679611+0000","last_clean":"2024-04-26T21:58:42.679611+0000","last_became_active":"2024-04-26T21:58:41.271775+0000","last_became_peered":"2024-04-26T21:58:41.271775+0000","last_unstale":"2024-04-26T21:58:42.679611+0000","last_undegraded":"2024-04-26T21:58:42.679611+0000","last_fullsized":"2024-04-26T21:58:42.679611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679120+0000","last_change":"2024-04-26T21:58:41.267754+0000","last_active":"2024-04-26T21:58:42.679120+0000","last_peered":"2024-04-26T21:58:42.679120+0000","last_clean":"2024-04-26T21:58:42.679120+0000","last_became_active":"2024-04-26T21:58:41.267414+0000","last_became_peered":"2024-04-26T21:58:41.267414+0000","last_unstale":"2024-04-26T21:58:42.679120+0000","last_undegraded":"2024-04-26T21:58:42.679120+0000","last_fullsized":"2024-04-26T21:58:42.679120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251919+0000","last_change":"2024-04-26T21:58:41.261004+0000","last_active":"2024-04-26T21:58:42.251919+0000","last_peered":"2024-04-26T21:58:42.251919+0000","last_clean":"2024-04-26T21:58:42.251919+0000","last_became_active":"2024-04-26T21:58:41.260578+0000","last_became_peered":"2024-04-26T21:58:41.260578+0000","last_unstale":"2024-04-26T21:58:42.251919+0000","last_undegraded":"2024-04-26T21:58:42.251919+0000","last_fullsized":"2024-04-26T21:58:42.251919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271701+0000","last_change":"2024-04-26T21:58:41.267436+0000","last_active":"2024-04-26T21:58:42.271701+0000","last_peered":"2024-04-26T21:58:42.271701+0000","last_clean":"2024-04-26T21:58:42.271701+0000","last_became_active":"2024-04-26T21:58:41.267151+0000","last_became_peered":"2024-04-26T21:58:41.267151+0000","last_unstale":"2024-04-26T21:58:42.271701+0000","last_undegraded":"2024-04-26T21:58:42.271701+0000","last_fullsized":"2024-04-26T21:58:42.271701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679858+0000","last_change":"2024-04-26T21:58:41.273673+0000","last_active":"2024-04-26T21:58:42.679858+0000","last_peered":"2024-04-26T21:58:42.679858+0000","last_clean":"2024-04-26T21:58:42.679858+0000","last_became_active":"2024-04-26T21:58:41.273384+0000","last_became_peered":"2024-04-26T21:58:41.273384+0000","last_unstale":"2024-04-26T21:58:42.679858+0000","last_undegraded":"2024-04-26T21:58:42.679858+0000","last_fullsized":"2024-04-26T21:58:42.679858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679139+0000","last_change":"2024-04-26T21:58:41.272126+0000","last_active":"2024-04-26T21:58:42.679139+0000","last_peered":"2024-04-26T21:58:42.679139+0000","last_clean":"2024-04-26T21:58:42.679139+0000","last_became_active":"2024-04-26T21:58:41.271816+0000","last_became_peered":"2024-04-26T21:58:41.271816+0000","last_unstale":"2024-04-26T21:58:42.679139+0000","last_undegraded":"2024-04-26T21:58:42.679139+0000","last_fullsized":"2024-04-26T21:58:42.679139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678912+0000","last_change":"2024-04-26T21:58:41.256372+0000","last_active":"2024-04-26T21:58:42.678912+0000","last_peered":"2024-04-26T21:58:42.678912+0000","last_clean":"2024-04-26T21:58:42.678912+0000","last_became_active":"2024-04-26T21:58:41.256119+0000","last_became_peered":"2024-04-26T21:58:41.256119+0000","last_unstale":"2024-04-26T21:58:42.678912+0000","last_undegraded":"2024-04-26T21:58:42.678912+0000","last_fullsized":"2024-04-26T21:58:42.678912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679089+0000","last_change":"2024-04-26T21:58:41.276385+0000","last_active":"2024-04-26T21:58:42.679089+0000","last_peered":"2024-04-26T21:58:42.679089+0000","last_clean":"2024-04-26T21:58:42.679089+0000","last_became_active":"2024-04-26T21:58:41.275917+0000","last_became_peered":"2024-04-26T21:58:41.275917+0000","last_unstale":"2024-04-26T21:58:42.679089+0000","last_undegraded":"2024-04-26T21:58:42.679089+0000","last_fullsized":"2024-04-26T21:58:42.679089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680416+0000","last_change":"2024-04-26T21:58:41.262076+0000","last_active":"2024-04-26T21:58:42.680416+0000","last_peered":"2024-04-26T21:58:42.680416+0000","last_clean":"2024-04-26T21:58:42.680416+0000","last_became_active":"2024-04-26T21:58:41.261726+0000","last_became_peered":"2024-04-26T21:58:41.261726+0000","last_unstale":"2024-04-26T21:58:42.680416+0000","last_undegraded":"2024-04-26T21:58:42.680416+0000","last_fullsized":"2024-04-26T21:58:42.680416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271762+0000","last_change":"2024-04-26T21:58:41.274846+0000","last_active":"2024-04-26T21:58:42.271762+0000","last_peered":"2024-04-26T21:58:42.271762+0000","last_clean":"2024-04-26T21:58:42.271762+0000","last_became_active":"2024-04-26T21:58:41.274526+0000","last_became_peered":"2024-04-26T21:58:41.274526+0000","last_unstale":"2024-04-26T21:58:42.271762+0000","last_undegraded":"2024-04-26T21:58:42.271762+0000","last_fullsized":"2024-04-26T21:58:42.271762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:41.265911+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:41.264263+0000","last_became_peered":"2024-04-26T21:58:41.264263+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680292+0000","last_change":"2024-04-26T21:58:41.257067+0000","last_active":"2024-04-26T21:58:42.680292+0000","last_peered":"2024-04-26T21:58:42.680292+0000","last_clean":"2024-04-26T21:58:42.680292+0000","last_became_active":"2024-04-26T21:58:41.256805+0000","last_became_peered":"2024-04-26T21:58:41.256805+0000","last_unstale":"2024-04-26T21:58:42.680292+0000","last_undegraded":"2024-04-26T21:58:42.680292+0000","last_fullsized":"2024-04-26T21:58:42.680292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679908+0000","last_change":"2024-04-26T21:58:41.266375+0000","last_active":"2024-04-26T21:58:42.679908+0000","last_peered":"2024-04-26T21:58:42.679908+0000","last_clean":"2024-04-26T21:58:42.679908+0000","last_became_active":"2024-04-26T21:58:41.265475+0000","last_became_peered":"2024-04-26T21:58:41.265475+0000","last_unstale":"2024-04-26T21:58:42.679908+0000","last_undegraded":"2024-04-26T21:58:42.679908+0000","last_fullsized":"2024-04-26T21:58:42.679908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679287+0000","last_change":"2024-04-26T21:58:41.277146+0000","last_active":"2024-04-26T21:58:42.679287+0000","last_peered":"2024-04-26T21:58:42.679287+0000","last_clean":"2024-04-26T21:58:42.679287+0000","last_became_active":"2024-04-26T21:58:41.276559+0000","last_became_peered":"2024-04-26T21:58:41.276559+0000","last_unstale":"2024-04-26T21:58:42.679287+0000","last_undegraded":"2024-04-26T21:58:42.679287+0000","last_fullsized":"2024-04-26T21:58:42.679287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678913+0000","last_change":"2024-04-26T21:58:41.276609+0000","last_active":"2024-04-26T21:58:42.678913+0000","last_peered":"2024-04-26T21:58:42.678913+0000","last_clean":"2024-04-26T21:58:42.678913+0000","last_became_active":"2024-04-26T21:58:41.276292+0000","last_became_peered":"2024-04-26T21:58:41.276292+0000","last_unstale":"2024-04-26T21:58:42.678913+0000","last_undegraded":"2024-04-26T21:58:42.678913+0000","last_fullsized":"2024-04-26T21:58:42.678913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271495+0000","last_change":"2024-04-26T21:58:41.270741+0000","last_active":"2024-04-26T21:58:42.271495+0000","last_peered":"2024-04-26T21:58:42.271495+0000","last_clean":"2024-04-26T21:58:42.271495+0000","last_became_active":"2024-04-26T21:58:41.270487+0000","last_became_peered":"2024-04-26T21:58:41.270487+0000","last_unstale":"2024-04-26T21:58:42.271495+0000","last_undegraded":"2024-04-26T21:58:42.271495+0000","last_fullsized":"2024-04-26T21:58:42.271495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250963+0000","last_change":"2024-04-26T21:58:41.266593+0000","last_active":"2024-04-26T21:58:42.250963+0000","last_peered":"2024-04-26T21:58:42.250963+0000","last_clean":"2024-04-26T21:58:42.250963+0000","last_became_active":"2024-04-26T21:58:41.264807+0000","last_became_peered":"2024-04-26T21:58:41.264807+0000","last_unstale":"2024-04-26T21:58:42.250963+0000","last_undegraded":"2024-04-26T21:58:42.250963+0000","last_fullsized":"2024-04-26T21:58:42.250963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:19.885646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680245+0000","last_change":"2024-04-26T21:58:40.261101+0000","last_active":"2024-04-26T21:58:42.680245+0000","last_peered":"2024-04-26T21:58:42.680245+0000","last_clean":"2024-04-26T21:58:42.680245+0000","last_became_active":"2024-04-26T21:58:40.260808+0000","last_became_peered":"2024-04-26T21:58:40.260808+0000","last_unstale":"2024-04-26T21:58:42.680245+0000","last_undegraded":"2024-04-26T21:58:42.680245+0000","last_fullsized":"2024-04-26T21:58:42.680245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679995+0000","last_change":"2024-04-26T21:58:41.266101+0000","last_active":"2024-04-26T21:58:42.679995+0000","last_peered":"2024-04-26T21:58:42.679995+0000","last_clean":"2024-04-26T21:58:42.679995+0000","last_became_active":"2024-04-26T21:58:41.265717+0000","last_became_peered":"2024-04-26T21:58:41.265717+0000","last_unstale":"2024-04-26T21:58:42.679995+0000","last_undegraded":"2024-04-26T21:58:42.679995+0000","last_fullsized":"2024-04-26T21:58:42.679995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271466+0000","last_change":"2024-04-26T21:58:40.258127+0000","last_active":"2024-04-26T21:58:42.271466+0000","last_peered":"2024-04-26T21:58:42.271466+0000","last_clean":"2024-04-26T21:58:42.271466+0000","last_became_active":"2024-04-26T21:58:40.257826+0000","last_became_peered":"2024-04-26T21:58:40.257826+0000","last_unstale":"2024-04-26T21:58:42.271466+0000","last_undegraded":"2024-04-26T21:58:42.271466+0000","last_fullsized":"2024-04-26T21:58:42.271466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679016+0000","last_change":"2024-04-26T21:58:40.260227+0000","last_active":"2024-04-26T21:58:42.679016+0000","last_peered":"2024-04-26T21:58:42.679016+0000","last_clean":"2024-04-26T21:58:42.679016+0000","last_became_active":"2024-04-26T21:58:40.259912+0000","last_became_peered":"2024-04-26T21:58:40.259912+0000","last_unstale":"2024-04-26T21:58:42.679016+0000","last_undegraded":"2024-04-26T21:58:42.679016+0000","last_fullsized":"2024-04-26T21:58:42.679016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679399+0000","last_change":"2024-04-26T21:58:41.270746+0000","last_active":"2024-04-26T21:58:42.679399+0000","last_peered":"2024-04-26T21:58:42.679399+0000","last_clean":"2024-04-26T21:58:42.679399+0000","last_became_active":"2024-04-26T21:58:41.270461+0000","last_became_peered":"2024-04-26T21:58:41.270461+0000","last_unstale":"2024-04-26T21:58:42.679399+0000","last_undegraded":"2024-04-26T21:58:42.679399+0000","last_fullsized":"2024-04-26T21:58:42.679399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679094+0000","last_change":"2024-04-26T21:58:40.251101+0000","last_active":"2024-04-26T21:58:42.679094+0000","last_peered":"2024-04-26T21:58:42.679094+0000","last_clean":"2024-04-26T21:58:42.679094+0000","last_became_active":"2024-04-26T21:58:40.250806+0000","last_became_peered":"2024-04-26T21:58:40.250806+0000","last_unstale":"2024-04-26T21:58:42.679094+0000","last_undegraded":"2024-04-26T21:58:42.679094+0000","last_fullsized":"2024-04-26T21:58:42.679094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250355+0000","last_change":"2024-04-26T21:58:41.264656+0000","last_active":"2024-04-26T21:58:42.250355+0000","last_peered":"2024-04-26T21:58:42.250355+0000","last_clean":"2024-04-26T21:58:42.250355+0000","last_became_active":"2024-04-26T21:58:41.264348+0000","last_became_peered":"2024-04-26T21:58:41.264348+0000","last_unstale":"2024-04-26T21:58:42.250355+0000","last_undegraded":"2024-04-26T21:58:42.250355+0000","last_fullsized":"2024-04-26T21:58:42.250355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271640+0000","last_change":"2024-04-26T21:58:40.258471+0000","last_active":"2024-04-26T21:58:42.271640+0000","last_peered":"2024-04-26T21:58:42.271640+0000","last_clean":"2024-04-26T21:58:42.271640+0000","last_became_active":"2024-04-26T21:58:40.258096+0000","last_became_peered":"2024-04-26T21:58:40.258096+0000","last_unstale":"2024-04-26T21:58:42.271640+0000","last_undegraded":"2024-04-26T21:58:42.271640+0000","last_fullsized":"2024-04-26T21:58:42.271640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679536+0000","last_change":"2024-04-26T21:58:41.273769+0000","last_active":"2024-04-26T21:58:42.679536+0000","last_peered":"2024-04-26T21:58:42.679536+0000","last_clean":"2024-04-26T21:58:42.679536+0000","last_became_active":"2024-04-26T21:58:41.271822+0000","last_became_peered":"2024-04-26T21:58:41.271822+0000","last_unstale":"2024-04-26T21:58:42.679536+0000","last_undegraded":"2024-04-26T21:58:42.679536+0000","last_fullsized":"2024-04-26T21:58:42.679536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679507+0000","last_change":"2024-04-26T21:58:40.258784+0000","last_active":"2024-04-26T21:58:42.679507+0000","last_peered":"2024-04-26T21:58:42.679507+0000","last_clean":"2024-04-26T21:58:42.679507+0000","last_became_active":"2024-04-26T21:58:40.258357+0000","last_became_peered":"2024-04-26T21:58:40.258357+0000","last_unstale":"2024-04-26T21:58:42.679507+0000","last_undegraded":"2024-04-26T21:58:42.679507+0000","last_fullsized":"2024-04-26T21:58:42.679507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679948+0000","last_change":"2024-04-26T21:58:41.279201+0000","last_active":"2024-04-26T21:58:42.679948+0000","last_peered":"2024-04-26T21:58:42.679948+0000","last_clean":"2024-04-26T21:58:42.679948+0000","last_became_active":"2024-04-26T21:58:41.278869+0000","last_became_peered":"2024-04-26T21:58:41.278869+0000","last_unstale":"2024-04-26T21:58:42.679948+0000","last_undegraded":"2024-04-26T21:58:42.679948+0000","last_fullsized":"2024-04-26T21:58:42.679948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:40.255154+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:40.254905+0000","last_became_peered":"2024-04-26T21:58:40.254905+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251689+0000","last_change":"2024-04-26T21:58:41.255887+0000","last_active":"2024-04-26T21:58:42.251689+0000","last_peered":"2024-04-26T21:58:42.251689+0000","last_clean":"2024-04-26T21:58:42.251689+0000","last_became_active":"2024-04-26T21:58:41.255557+0000","last_became_peered":"2024-04-26T21:58:41.255557+0000","last_unstale":"2024-04-26T21:58:42.251689+0000","last_undegraded":"2024-04-26T21:58:42.251689+0000","last_fullsized":"2024-04-26T21:58:42.251689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:52.499298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271704+0000","last_change":"2024-04-26T21:58:40.263413+0000","last_active":"2024-04-26T21:58:42.271704+0000","last_peered":"2024-04-26T21:58:42.271704+0000","last_clean":"2024-04-26T21:58:42.271704+0000","last_became_active":"2024-04-26T21:58:40.263104+0000","last_became_peered":"2024-04-26T21:58:40.263104+0000","last_unstale":"2024-04-26T21:58:42.271704+0000","last_undegraded":"2024-04-26T21:58:42.271704+0000","last_fullsized":"2024-04-26T21:58:42.271704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251648+0000","last_change":"2024-04-26T21:58:41.264209+0000","last_active":"2024-04-26T21:58:42.251648+0000","last_peered":"2024-04-26T21:58:42.251648+0000","last_clean":"2024-04-26T21:58:42.251648+0000","last_became_active":"2024-04-26T21:58:41.263961+0000","last_became_peered":"2024-04-26T21:58:41.263961+0000","last_unstale":"2024-04-26T21:58:42.251648+0000","last_undegraded":"2024-04-26T21:58:42.251648+0000","last_fullsized":"2024-04-26T21:58:42.251648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680014+0000","last_change":"2024-04-26T21:58:40.248876+0000","last_active":"2024-04-26T21:58:42.680014+0000","last_peered":"2024-04-26T21:58:42.680014+0000","last_clean":"2024-04-26T21:58:42.680014+0000","last_became_active":"2024-04-26T21:58:40.248573+0000","last_became_peered":"2024-04-26T21:58:40.248573+0000","last_unstale":"2024-04-26T21:58:42.680014+0000","last_undegraded":"2024-04-26T21:58:42.680014+0000","last_fullsized":"2024-04-26T21:58:42.680014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679175+0000","last_change":"2024-04-26T21:58:41.262092+0000","last_active":"2024-04-26T21:58:42.679175+0000","last_peered":"2024-04-26T21:58:42.679175+0000","last_clean":"2024-04-26T21:58:42.679175+0000","last_became_active":"2024-04-26T21:58:41.261788+0000","last_became_peered":"2024-04-26T21:58:41.261788+0000","last_unstale":"2024-04-26T21:58:42.679175+0000","last_undegraded":"2024-04-26T21:58:42.679175+0000","last_fullsized":"2024-04-26T21:58:42.679175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:28.345096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679243+0000","last_change":"2024-04-26T21:58:40.263316+0000","last_active":"2024-04-26T21:58:42.679243+0000","last_peered":"2024-04-26T21:58:42.679243+0000","last_clean":"2024-04-26T21:58:42.679243+0000","last_became_active":"2024-04-26T21:58:40.263027+0000","last_became_peered":"2024-04-26T21:58:40.263027+0000","last_unstale":"2024-04-26T21:58:42.679243+0000","last_undegraded":"2024-04-26T21:58:42.679243+0000","last_fullsized":"2024-04-26T21:58:42.679243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:41.253991+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:41.253696+0000","last_became_peered":"2024-04-26T21:58:41.253696+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271544+0000","last_change":"2024-04-26T21:58:40.261008+0000","last_active":"2024-04-26T21:58:42.271544+0000","last_peered":"2024-04-26T21:58:42.271544+0000","last_clean":"2024-04-26T21:58:42.271544+0000","last_became_active":"2024-04-26T21:58:40.260697+0000","last_became_peered":"2024-04-26T21:58:40.260697+0000","last_unstale":"2024-04-26T21:58:42.271544+0000","last_undegraded":"2024-04-26T21:58:42.271544+0000","last_fullsized":"2024-04-26T21:58:42.271544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271540+0000","last_change":"2024-04-26T21:58:41.271346+0000","last_active":"2024-04-26T21:58:42.271540+0000","last_peered":"2024-04-26T21:58:42.271540+0000","last_clean":"2024-04-26T21:58:42.271540+0000","last_became_active":"2024-04-26T21:58:41.271090+0000","last_became_peered":"2024-04-26T21:58:41.271090+0000","last_unstale":"2024-04-26T21:58:42.271540+0000","last_undegraded":"2024-04-26T21:58:42.271540+0000","last_fullsized":"2024-04-26T21:58:42.271540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678753+0000","last_change":"2024-04-26T21:58:40.253802+0000","last_active":"2024-04-26T21:58:42.678753+0000","last_peered":"2024-04-26T21:58:42.678753+0000","last_clean":"2024-04-26T21:58:42.678753+0000","last_became_active":"2024-04-26T21:58:40.253518+0000","last_became_peered":"2024-04-26T21:58:40.253518+0000","last_unstale":"2024-04-26T21:58:42.678753+0000","last_undegraded":"2024-04-26T21:58:42.678753+0000","last_fullsized":"2024-04-26T21:58:42.678753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251124+0000","last_change":"2024-04-26T21:58:41.254741+0000","last_active":"2024-04-26T21:58:42.251124+0000","last_peered":"2024-04-26T21:58:42.251124+0000","last_clean":"2024-04-26T21:58:42.251124+0000","last_became_active":"2024-04-26T21:58:41.253953+0000","last_became_peered":"2024-04-26T21:58:41.253953+0000","last_unstale":"2024-04-26T21:58:42.251124+0000","last_undegraded":"2024-04-26T21:58:42.251124+0000","last_fullsized":"2024-04-26T21:58:42.251124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251491+0000","last_change":"2024-04-26T21:58:40.253095+0000","last_active":"2024-04-26T21:58:42.251491+0000","last_peered":"2024-04-26T21:58:42.251491+0000","last_clean":"2024-04-26T21:58:42.251491+0000","last_became_active":"2024-04-26T21:58:40.252789+0000","last_became_peered":"2024-04-26T21:58:40.252789+0000","last_unstale":"2024-04-26T21:58:42.251491+0000","last_undegraded":"2024-04-26T21:58:42.251491+0000","last_fullsized":"2024-04-26T21:58:42.251491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:43.627280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251523+0000","last_change":"2024-04-26T21:58:41.256932+0000","last_active":"2024-04-26T21:58:42.251523+0000","last_peered":"2024-04-26T21:58:42.251523+0000","last_clean":"2024-04-26T21:58:42.251523+0000","last_became_active":"2024-04-26T21:58:41.256652+0000","last_became_peered":"2024-04-26T21:58:41.256652+0000","last_unstale":"2024-04-26T21:58:42.251523+0000","last_undegraded":"2024-04-26T21:58:42.251523+0000","last_fullsized":"2024-04-26T21:58:42.251523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679210+0000","last_change":"2024-04-26T21:58:40.263483+0000","last_active":"2024-04-26T21:58:42.679210+0000","last_peered":"2024-04-26T21:58:42.679210+0000","last_clean":"2024-04-26T21:58:42.679210+0000","last_became_active":"2024-04-26T21:58:40.263197+0000","last_became_peered":"2024-04-26T21:58:40.263197+0000","last_unstale":"2024-04-26T21:58:42.679210+0000","last_undegraded":"2024-04-26T21:58:42.679210+0000","last_fullsized":"2024-04-26T21:58:42.679210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252178+0000","last_change":"2024-04-26T21:58:41.257381+0000","last_active":"2024-04-26T21:58:42.252178+0000","last_peered":"2024-04-26T21:58:42.252178+0000","last_clean":"2024-04-26T21:58:42.252178+0000","last_became_active":"2024-04-26T21:58:41.256911+0000","last_became_peered":"2024-04-26T21:58:41.256911+0000","last_unstale":"2024-04-26T21:58:42.252178+0000","last_undegraded":"2024-04-26T21:58:42.252178+0000","last_fullsized":"2024-04-26T21:58:42.252178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250538+0000","last_change":"2024-04-26T21:58:40.255266+0000","last_active":"2024-04-26T21:58:42.250538+0000","last_peered":"2024-04-26T21:58:42.250538+0000","last_clean":"2024-04-26T21:58:42.250538+0000","last_became_active":"2024-04-26T21:58:40.254863+0000","last_became_peered":"2024-04-26T21:58:40.254863+0000","last_unstale":"2024-04-26T21:58:42.250538+0000","last_undegraded":"2024-04-26T21:58:42.250538+0000","last_fullsized":"2024-04-26T21:58:42.250538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679454+0000","last_change":"2024-04-26T21:58:41.277259+0000","last_active":"2024-04-26T21:58:42.679454+0000","last_peered":"2024-04-26T21:58:42.679454+0000","last_clean":"2024-04-26T21:58:42.679454+0000","last_became_active":"2024-04-26T21:58:41.276186+0000","last_became_peered":"2024-04-26T21:58:41.276186+0000","last_unstale":"2024-04-26T21:58:42.679454+0000","last_undegraded":"2024-04-26T21:58:42.679454+0000","last_fullsized":"2024-04-26T21:58:42.679454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678752+0000","last_change":"2024-04-26T21:58:40.258271+0000","last_active":"2024-04-26T21:58:42.678752+0000","last_peered":"2024-04-26T21:58:42.678752+0000","last_clean":"2024-04-26T21:58:42.678752+0000","last_became_active":"2024-04-26T21:58:40.257941+0000","last_became_peered":"2024-04-26T21:58:40.257941+0000","last_unstale":"2024-04-26T21:58:42.678752+0000","last_undegraded":"2024-04-26T21:58:42.678752+0000","last_fullsized":"2024-04-26T21:58:42.678752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252033+0000","last_change":"2024-04-26T21:58:41.270377+0000","last_active":"2024-04-26T21:58:42.252033+0000","last_peered":"2024-04-26T21:58:42.252033+0000","last_clean":"2024-04-26T21:58:42.252033+0000","last_became_active":"2024-04-26T21:58:41.270106+0000","last_became_peered":"2024-04-26T21:58:41.270106+0000","last_unstale":"2024-04-26T21:58:42.252033+0000","last_undegraded":"2024-04-26T21:58:42.252033+0000","last_fullsized":"2024-04-26T21:58:42.252033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250932+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:58:42.250932+0000","last_peered":"2024-04-26T21:58:42.250932+0000","last_clean":"2024-04-26T21:58:42.250932+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:58:42.250932+0000","last_undegraded":"2024-04-26T21:58:42.250932+0000","last_fullsized":"2024-04-26T21:58:42.250932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679020+0000","last_change":"2024-04-26T21:58:40.255645+0000","last_active":"2024-04-26T21:58:42.679020+0000","last_peered":"2024-04-26T21:58:42.679020+0000","last_clean":"2024-04-26T21:58:42.679020+0000","last_became_active":"2024-04-26T21:58:40.254847+0000","last_became_peered":"2024-04-26T21:58:40.254847+0000","last_unstale":"2024-04-26T21:58:42.679020+0000","last_undegraded":"2024-04-26T21:58:42.679020+0000","last_fullsized":"2024-04-26T21:58:42.679020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679864+0000","last_change":"2024-04-26T21:58:41.272174+0000","last_active":"2024-04-26T21:58:42.679864+0000","last_peered":"2024-04-26T21:58:42.679864+0000","last_clean":"2024-04-26T21:58:42.679864+0000","last_became_active":"2024-04-26T21:58:41.271879+0000","last_became_peered":"2024-04-26T21:58:41.271879+0000","last_unstale":"2024-04-26T21:58:42.679864+0000","last_undegraded":"2024-04-26T21:58:42.679864+0000","last_fullsized":"2024-04-26T21:58:42.679864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250883+0000","last_change":"2024-04-26T21:58:40.263425+0000","last_active":"2024-04-26T21:58:42.250883+0000","last_peered":"2024-04-26T21:58:42.250883+0000","last_clean":"2024-04-26T21:58:42.250883+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.250883+0000","last_undegraded":"2024-04-26T21:58:42.250883+0000","last_fullsized":"2024-04-26T21:58:42.250883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678995+0000","last_change":"2024-04-26T21:58:41.266358+0000","last_active":"2024-04-26T21:58:42.678995+0000","last_peered":"2024-04-26T21:58:42.678995+0000","last_clean":"2024-04-26T21:58:42.678995+0000","last_became_active":"2024-04-26T21:58:41.265803+0000","last_became_peered":"2024-04-26T21:58:41.265803+0000","last_unstale":"2024-04-26T21:58:42.678995+0000","last_undegraded":"2024-04-26T21:58:42.678995+0000","last_fullsized":"2024-04-26T21:58:42.678995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:39.448477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679090+0000","last_change":"2024-04-26T21:58:40.263478+0000","last_active":"2024-04-26T21:58:42.679090+0000","last_peered":"2024-04-26T21:58:42.679090+0000","last_clean":"2024-04-26T21:58:42.679090+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.679090+0000","last_undegraded":"2024-04-26T21:58:42.679090+0000","last_fullsized":"2024-04-26T21:58:42.679090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250423+0000","last_change":"2024-04-26T21:58:41.267643+0000","last_active":"2024-04-26T21:58:42.250423+0000","last_peered":"2024-04-26T21:58:42.250423+0000","last_clean":"2024-04-26T21:58:42.250423+0000","last_became_active":"2024-04-26T21:58:41.266985+0000","last_became_peered":"2024-04-26T21:58:41.266985+0000","last_unstale":"2024-04-26T21:58:42.250423+0000","last_undegraded":"2024-04-26T21:58:42.250423+0000","last_fullsized":"2024-04-26T21:58:42.250423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679346+0000","last_change":"2024-04-26T21:58:40.252288+0000","last_active":"2024-04-26T21:58:42.679346+0000","last_peered":"2024-04-26T21:58:42.679346+0000","last_clean":"2024-04-26T21:58:42.679346+0000","last_became_active":"2024-04-26T21:58:40.251940+0000","last_became_peered":"2024-04-26T21:58:40.251940+0000","last_unstale":"2024-04-26T21:58:42.679346+0000","last_undegraded":"2024-04-26T21:58:42.679346+0000","last_fullsized":"2024-04-26T21:58:42.679346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251381+0000","last_change":"2024-04-26T21:58:41.267485+0000","last_active":"2024-04-26T21:58:42.251381+0000","last_peered":"2024-04-26T21:58:42.251381+0000","last_clean":"2024-04-26T21:58:42.251381+0000","last_became_active":"2024-04-26T21:58:41.266964+0000","last_became_peered":"2024-04-26T21:58:41.266964+0000","last_unstale":"2024-04-26T21:58:42.251381+0000","last_undegraded":"2024-04-26T21:58:42.251381+0000","last_fullsized":"2024-04-26T21:58:42.251381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250575+0000","last_change":"2024-04-26T21:58:40.257116+0000","last_active":"2024-04-26T21:58:42.250575+0000","last_peered":"2024-04-26T21:58:42.250575+0000","last_clean":"2024-04-26T21:58:42.250575+0000","last_became_active":"2024-04-26T21:58:40.256843+0000","last_became_peered":"2024-04-26T21:58:40.256843+0000","last_unstale":"2024-04-26T21:58:42.250575+0000","last_undegraded":"2024-04-26T21:58:42.250575+0000","last_fullsized":"2024-04-26T21:58:42.250575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679465+0000","last_change":"2024-04-26T21:58:41.277155+0000","last_active":"2024-04-26T21:58:42.679465+0000","last_peered":"2024-04-26T21:58:42.679465+0000","last_clean":"2024-04-26T21:58:42.679465+0000","last_became_active":"2024-04-26T21:58:41.276120+0000","last_became_peered":"2024-04-26T21:58:41.276120+0000","last_unstale":"2024-04-26T21:58:42.679465+0000","last_undegraded":"2024-04-26T21:58:42.679465+0000","last_fullsized":"2024-04-26T21:58:42.679465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:40.265846+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:40.265527+0000","last_became_peered":"2024-04-26T21:58:40.265527+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:51.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250582+0000","last_change":"2024-04-26T21:58:41.263124+0000","last_active":"2024-04-26T21:58:42.250582+0000","last_peered":"2024-04-26T21:58:42.250582+0000","last_clean":"2024-04-26T21:58:42.250582+0000","last_became_active":"2024-04-26T21:58:41.262827+0000","last_became_peered":"2024-04-26T21:58:41.262827+0000","last_unstale":"2024-04-26T21:58:42.250582+0000","last_undegraded":"2024-04-26T21:58:42.250582+0000","last_fullsized":"2024-04-26T21:58:42.250582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271057+0000","last_change":"2024-04-26T21:58:40.256172+0000","last_active":"2024-04-26T21:58:42.271057+0000","last_peered":"2024-04-26T21:58:42.271057+0000","last_clean":"2024-04-26T21:58:42.271057+0000","last_became_active":"2024-04-26T21:58:40.255894+0000","last_became_peered":"2024-04-26T21:58:40.255894+0000","last_unstale":"2024-04-26T21:58:42.271057+0000","last_undegraded":"2024-04-26T21:58:42.271057+0000","last_fullsized":"2024-04-26T21:58:42.271057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680432+0000","last_change":"2024-04-26T21:58:41.259933+0000","last_active":"2024-04-26T21:58:42.680432+0000","last_peered":"2024-04-26T21:58:42.680432+0000","last_clean":"2024-04-26T21:58:42.680432+0000","last_became_active":"2024-04-26T21:58:41.259662+0000","last_became_peered":"2024-04-26T21:58:41.259662+0000","last_unstale":"2024-04-26T21:58:42.680432+0000","last_undegraded":"2024-04-26T21:58:42.680432+0000","last_fullsized":"2024-04-26T21:58:42.680432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271702+0000","last_change":"2024-04-26T21:58:40.260624+0000","last_active":"2024-04-26T21:58:42.271702+0000","last_peered":"2024-04-26T21:58:42.271702+0000","last_clean":"2024-04-26T21:58:42.271702+0000","last_became_active":"2024-04-26T21:58:40.260181+0000","last_became_peered":"2024-04-26T21:58:40.260181+0000","last_unstale":"2024-04-26T21:58:42.271702+0000","last_undegraded":"2024-04-26T21:58:42.271702+0000","last_fullsized":"2024-04-26T21:58:42.271702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679775+0000","last_change":"2024-04-26T21:58:41.266891+0000","last_active":"2024-04-26T21:58:42.679775+0000","last_peered":"2024-04-26T21:58:42.679775+0000","last_clean":"2024-04-26T21:58:42.679775+0000","last_became_active":"2024-04-26T21:58:41.266593+0000","last_became_peered":"2024-04-26T21:58:41.266593+0000","last_unstale":"2024-04-26T21:58:42.679775+0000","last_undegraded":"2024-04-26T21:58:42.679775+0000","last_fullsized":"2024-04-26T21:58:42.679775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250789+0000","last_change":"2024-04-26T21:58:40.265807+0000","last_active":"2024-04-26T21:58:42.250789+0000","last_peered":"2024-04-26T21:58:42.250789+0000","last_clean":"2024-04-26T21:58:42.250789+0000","last_became_active":"2024-04-26T21:58:40.265534+0000","last_became_peered":"2024-04-26T21:58:40.265534+0000","last_unstale":"2024-04-26T21:58:42.250789+0000","last_undegraded":"2024-04-26T21:58:42.250789+0000","last_fullsized":"2024-04-26T21:58:42.250789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250909+0000","last_change":"2024-04-26T21:58:41.266189+0000","last_active":"2024-04-26T21:58:42.250909+0000","last_peered":"2024-04-26T21:58:42.250909+0000","last_clean":"2024-04-26T21:58:42.250909+0000","last_became_active":"2024-04-26T21:58:41.265907+0000","last_became_peered":"2024-04-26T21:58:41.265907+0000","last_unstale":"2024-04-26T21:58:42.250909+0000","last_undegraded":"2024-04-26T21:58:42.250909+0000","last_fullsized":"2024-04-26T21:58:42.250909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:59.612605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250454+0000","last_change":"2024-04-26T21:58:40.258532+0000","last_active":"2024-04-26T21:58:42.250454+0000","last_peered":"2024-04-26T21:58:42.250454+0000","last_clean":"2024-04-26T21:58:42.250454+0000","last_became_active":"2024-04-26T21:58:40.258249+0000","last_became_peered":"2024-04-26T21:58:40.258249+0000","last_unstale":"2024-04-26T21:58:42.250454+0000","last_undegraded":"2024-04-26T21:58:42.250454+0000","last_fullsized":"2024-04-26T21:58:42.250454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679584+0000","last_change":"2024-04-26T21:58:41.268472+0000","last_active":"2024-04-26T21:58:42.679584+0000","last_peered":"2024-04-26T21:58:42.679584+0000","last_clean":"2024-04-26T21:58:42.679584+0000","last_became_active":"2024-04-26T21:58:41.268180+0000","last_became_peered":"2024-04-26T21:58:41.268180+0000","last_unstale":"2024-04-26T21:58:42.679584+0000","last_undegraded":"2024-04-26T21:58:42.679584+0000","last_fullsized":"2024-04-26T21:58:42.679584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250412+0000","last_change":"2024-04-26T21:58:40.256945+0000","last_active":"2024-04-26T21:58:42.250412+0000","last_peered":"2024-04-26T21:58:42.250412+0000","last_clean":"2024-04-26T21:58:42.250412+0000","last_became_active":"2024-04-26T21:58:40.256606+0000","last_became_peered":"2024-04-26T21:58:40.256606+0000","last_unstale":"2024-04-26T21:58:42.250412+0000","last_undegraded":"2024-04-26T21:58:42.250412+0000","last_fullsized":"2024-04-26T21:58:42.250412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680144+0000","last_change":"2024-04-26T21:58:41.271521+0000","last_active":"2024-04-26T21:58:42.680144+0000","last_peered":"2024-04-26T21:58:42.680144+0000","last_clean":"2024-04-26T21:58:42.680144+0000","last_became_active":"2024-04-26T21:58:41.270434+0000","last_became_peered":"2024-04-26T21:58:41.270434+0000","last_unstale":"2024-04-26T21:58:42.680144+0000","last_undegraded":"2024-04-26T21:58:42.680144+0000","last_fullsized":"2024-04-26T21:58:42.680144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252045+0000","last_change":"2024-04-26T21:58:40.259668+0000","last_active":"2024-04-26T21:58:42.252045+0000","last_peered":"2024-04-26T21:58:42.252045+0000","last_clean":"2024-04-26T21:58:42.252045+0000","last_became_active":"2024-04-26T21:58:40.259395+0000","last_became_peered":"2024-04-26T21:58:40.259395+0000","last_unstale":"2024-04-26T21:58:42.252045+0000","last_undegraded":"2024-04-26T21:58:42.252045+0000","last_fullsized":"2024-04-26T21:58:42.252045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271493+0000","last_change":"2024-04-26T21:58:41.270142+0000","last_active":"2024-04-26T21:58:42.271493+0000","last_peered":"2024-04-26T21:58:42.271493+0000","last_clean":"2024-04-26T21:58:42.271493+0000","last_became_active":"2024-04-26T21:58:41.269888+0000","last_became_peered":"2024-04-26T21:58:41.269888+0000","last_unstale":"2024-04-26T21:58:42.271493+0000","last_undegraded":"2024-04-26T21:58:42.271493+0000","last_fullsized":"2024-04-26T21:58:42.271493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679421+0000","last_change":"2024-04-26T21:58:41.270107+0000","last_active":"2024-04-26T21:58:42.679421+0000","last_peered":"2024-04-26T21:58:42.679421+0000","last_clean":"2024-04-26T21:58:42.679421+0000","last_became_active":"2024-04-26T21:58:41.267030+0000","last_became_peered":"2024-04-26T21:58:41.267030+0000","last_unstale":"2024-04-26T21:58:42.679421+0000","last_undegraded":"2024-04-26T21:58:42.679421+0000","last_fullsized":"2024-04-26T21:58:42.679421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251589+0000","last_change":"2024-04-26T21:58:40.258932+0000","last_active":"2024-04-26T21:58:42.251589+0000","last_peered":"2024-04-26T21:58:42.251589+0000","last_clean":"2024-04-26T21:58:42.251589+0000","last_became_active":"2024-04-26T21:58:40.258648+0000","last_became_peered":"2024-04-26T21:58:40.258648+0000","last_unstale":"2024-04-26T21:58:42.251589+0000","last_undegraded":"2024-04-26T21:58:42.251589+0000","last_fullsized":"2024-04-26T21:58:42.251589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679261+0000","last_change":"2024-04-26T21:58:41.269888+0000","last_active":"2024-04-26T21:58:42.679261+0000","last_peered":"2024-04-26T21:58:42.679261+0000","last_clean":"2024-04-26T21:58:42.679261+0000","last_became_active":"2024-04-26T21:58:41.269608+0000","last_became_peered":"2024-04-26T21:58:41.269608+0000","last_unstale":"2024-04-26T21:58:42.679261+0000","last_undegraded":"2024-04-26T21:58:42.679261+0000","last_fullsized":"2024-04-26T21:58:42.679261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251773+0000","last_change":"2024-04-26T21:58:40.261919+0000","last_active":"2024-04-26T21:58:42.251773+0000","last_peered":"2024-04-26T21:58:42.251773+0000","last_clean":"2024-04-26T21:58:42.251773+0000","last_became_active":"2024-04-26T21:58:40.261644+0000","last_became_peered":"2024-04-26T21:58:40.261644+0000","last_unstale":"2024-04-26T21:58:42.251773+0000","last_undegraded":"2024-04-26T21:58:42.251773+0000","last_fullsized":"2024-04-26T21:58:42.251773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679439+0000","last_change":"2024-04-26T21:58:41.279829+0000","last_active":"2024-04-26T21:58:42.679439+0000","last_peered":"2024-04-26T21:58:42.679439+0000","last_clean":"2024-04-26T21:58:42.679439+0000","last_became_active":"2024-04-26T21:58:41.279430+0000","last_became_peered":"2024-04-26T21:58:41.279430+0000","last_unstale":"2024-04-26T21:58:42.679439+0000","last_undegraded":"2024-04-26T21:58:42.679439+0000","last_fullsized":"2024-04-26T21:58:42.679439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680388+0000","last_change":"2024-04-26T21:58:40.265856+0000","last_active":"2024-04-26T21:58:42.680388+0000","last_peered":"2024-04-26T21:58:42.680388+0000","last_clean":"2024-04-26T21:58:42.680388+0000","last_became_active":"2024-04-26T21:58:40.265592+0000","last_became_peered":"2024-04-26T21:58:40.265592+0000","last_unstale":"2024-04-26T21:58:42.680388+0000","last_undegraded":"2024-04-26T21:58:42.680388+0000","last_fullsized":"2024-04-26T21:58:42.680388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680383+0000","last_change":"2024-04-26T21:58:41.267721+0000","last_active":"2024-04-26T21:58:42.680383+0000","last_peered":"2024-04-26T21:58:42.680383+0000","last_clean":"2024-04-26T21:58:42.680383+0000","last_became_active":"2024-04-26T21:58:41.267424+0000","last_became_peered":"2024-04-26T21:58:41.267424+0000","last_unstale":"2024-04-26T21:58:42.680383+0000","last_undegraded":"2024-04-26T21:58:42.680383+0000","last_fullsized":"2024-04-26T21:58:42.680383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680053+0000","last_change":"2024-04-26T21:58:40.251924+0000","last_active":"2024-04-26T21:58:42.680053+0000","last_peered":"2024-04-26T21:58:42.680053+0000","last_clean":"2024-04-26T21:58:42.680053+0000","last_became_active":"2024-04-26T21:58:40.251596+0000","last_became_peered":"2024-04-26T21:58:40.251596+0000","last_unstale":"2024-04-26T21:58:42.680053+0000","last_undegraded":"2024-04-26T21:58:42.680053+0000","last_fullsized":"2024-04-26T21:58:42.680053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:18:55.150047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:58:46.233 INFO:tasks.ceph.mds.b.smithi170.stderr:2024-04-26T21:58:46.233+0000 7fad03c24640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:58:48.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:58:48.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.798+0000 7f6d17f97640 1 Processor -- start 2024-04-26T21:58:48.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.798+0000 7f6d17f97640 1 -- start start 2024-04-26T21:58:48.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d17f97640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d100d1510 0x7f6d100d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:48.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d17f97640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d100ceef0 con 0x7f6d100d0b20 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d17f97640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d100cda60 con 0x7f6d1015d360 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d17f97640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6d1015d740 con 0x7f6d100d1510 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d15532640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6d100d0b20 0x7f6d100ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41986/0 (socket says 172.21.15.137:41986) 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d15532640 1 -- 172.21.15.137:0/1066747151 learned_addr learned my addr 172.21.15.137:0/1066747151 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d16534640 1 --2- 172.21.15.137:0/1066747151 >> v2:172.21.15.137:3300/0 conn(0x7f6d100d1510 0x7f6d100d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d14d31640 1 -- 172.21.15.137:0/1066747151 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 771798857 0 0) 0x7f6d100ceef0 con 0x7f6d100d0b20 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d14d31640 1 -- 172.21.15.137:0/1066747151 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cfc003520 con 0x7f6d100d0b20 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d16534640 1 -- 172.21.15.137:0/1066747151 >> v1:172.21.15.170:6789/0 conn(0x7f6d1015d360 legacy=0x7f6d1009c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d16534640 1 -- 172.21.15.137:0/1066747151 >> v1:172.21.15.137:6789/0 conn(0x7f6d100d0b20 legacy=0x7f6d100ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:48.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.799+0000 7f6d16534640 1 -- 172.21.15.137:0/1066747151 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d100d1100 con 0x7f6d100d1510 2024-04-26T21:58:48.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.800+0000 7f6d16534640 1 --2- 172.21.15.137:0/1066747151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d1510 0x7f6d100d19a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009d90 tx=0x7f6d0802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4461b4f9c3dd984 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:48.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.800+0000 7f6d14d31640 1 -- 172.21.15.137:0/1066747151 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08007740 con 0x7f6d100d1510 2024-04-26T21:58:48.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.800+0000 7f6d14d31640 1 -- 172.21.15.137:0/1066747151 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d080078e0 con 0x7f6d100d1510 2024-04-26T21:58:48.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.800+0000 7f6d14d31640 1 -- 172.21.15.137:0/1066747151 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08007c90 con 0x7f6d100d1510 2024-04-26T21:58:48.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.801+0000 7f6d17f97640 1 -- 172.21.15.137:0/1066747151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d1510 msgr2=0x7f6d100d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:48.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.801+0000 7f6d17f97640 1 --2- 172.21.15.137:0/1066747151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d1510 0x7f6d100d19a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6d08009d90 tx=0x7f6d0802a6f0 comp rx=0 tx=0).stop 2024-04-26T21:58:48.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.801+0000 7f6d17f97640 1 -- 172.21.15.137:0/1066747151 shutdown_connections 2024-04-26T21:58:48.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.801+0000 7f6d17f97640 1 --2- 172.21.15.137:0/1066747151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d1510 0x7f6d100d19a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:48.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.801+0000 7f6d17f97640 1 -- 172.21.15.137:0/1066747151 >> 172.21.15.137:0/1066747151 conn(0x7f6d100b4a40 msgr2=0x7f6d100b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:48.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.801+0000 7f6d17f97640 1 -- 172.21.15.137:0/1066747151 shutdown_connections 2024-04-26T21:58:48.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.801+0000 7f6d17f97640 1 -- 172.21.15.137:0/1066747151 wait complete. 2024-04-26T21:58:48.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.802+0000 7f6d17f97640 1 Processor -- start 2024-04-26T21:58:48.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.802+0000 7f6d17f97640 1 -- start start 2024-04-26T21:58:48.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d17f97640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d0b20 0x7f6d100b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d17f97640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d100d1510 0x7f6d100c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d17f97640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d1015d360 0x7f6d100c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d17f97640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10070310 con 0x7f6d100d0b20 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d17f97640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6d100cdfe0 con 0x7f6d100d1510 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d17f97640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6d10070490 con 0x7f6d1015d360 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15d33640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d0b20 0x7f6d100b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15d33640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d0b20 0x7f6d100b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60674/0 (socket says 172.21.15.137:60674) 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15d33640 1 -- 172.21.15.137:0/2621601053 learned_addr learned my addr 172.21.15.137:0/2621601053 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15532640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d100d1510 0x7f6d100c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d16534640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d1015d360 0x7f6d100c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15d33640 1 -- 172.21.15.137:0/2621601053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d1015d360 msgr2=0x7f6d100c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15d33640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d1015d360 0x7f6d100c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15d33640 1 -- 172.21.15.137:0/2621601053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d100d1510 msgr2=0x7f6d100c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:48.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15d33640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d100d1510 0x7f6d100c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:48.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15d33640 1 -- 172.21.15.137:0/2621601053 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d100c7690 con 0x7f6d100d0b20 2024-04-26T21:58:48.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d15d33640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d0b20 0x7f6d100b10d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00c3c0 tx=0x7f6d0c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:48.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d067fc640 1 -- 172.21.15.137:0/2621601053 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c0052d0 con 0x7f6d100d0b20 2024-04-26T21:58:48.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d067fc640 1 -- 172.21.15.137:0/2621601053 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c005490 con 0x7f6d100d0b20 2024-04-26T21:58:48.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1015e1a0 con 0x7f6d100d0b20 2024-04-26T21:58:48.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.803+0000 7f6d067fc640 1 -- 172.21.15.137:0/2621601053 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c007260 con 0x7f6d100d0b20 2024-04-26T21:58:48.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.804+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1015e760 con 0x7f6d100d0b20 2024-04-26T21:58:48.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.805+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d100693d0 con 0x7f6d100d0b20 2024-04-26T21:58:48.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.805+0000 7f6d067fc640 1 -- 172.21.15.137:0/2621601053 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d0c007400 con 0x7f6d100d0b20 2024-04-26T21:58:48.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.805+0000 7f6d067fc640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf406c8f0 0x7f6cf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:48.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.806+0000 7f6d15532640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf406c8f0 0x7f6cf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:48.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.806+0000 7f6d067fc640 1 -- 172.21.15.137:0/2621601053 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6d0c08afd0 con 0x7f6d100d0b20 2024-04-26T21:58:48.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.806+0000 7f6d15532640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf406c8f0 0x7f6cf406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d10151b30 tx=0x7f6d00007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.810+0000 7f6d067fc640 1 -- 172.21.15.137:0/2621601053 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6d0c058d20 con 0x7f6d100d0b20 2024-04-26T21:58:48.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.984+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d10074880 con 0x7f6cf406c8f0 2024-04-26T21:58:48.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.990+0000 7f6d067fc640 1 -- 172.21.15.137:0/2621601053 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f6d10074880 con 0x7f6cf406c8f0 2024-04-26T21:58:48.993 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:48.994 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:58:48.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf406c8f0 msgr2=0x7f6cf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:48.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf406c8f0 0x7f6cf406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6d10151b30 tx=0x7f6d00007d30 comp rx=0 tx=0).stop 2024-04-26T21:58:48.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d0b20 msgr2=0x7f6d100b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d0b20 0x7f6d100b10d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00c3c0 tx=0x7f6d0c00c880 comp rx=0 tx=0).stop 2024-04-26T21:58:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 shutdown_connections 2024-04-26T21:58:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf406c8f0 0x7f6cf406edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d1015d360 0x7f6d100c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d100d1510 0x7f6d100c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 --2- 172.21.15.137:0/2621601053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d100d0b20 0x7f6d100b10d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 >> 172.21.15.137:0/2621601053 conn(0x7f6d100b4a40 msgr2=0x7f6d100b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 shutdown_connections 2024-04-26T21:58:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:48.993+0000 7f6d17f97640 1 -- 172.21.15.137:0/2621601053 wait complete. 2024-04-26T21:58:49.004 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T21:58:48.695491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235752,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738968,"statfs":{"total":773094113280,"available":772852703232,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001263"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252025+0000","last_change":"2024-04-26T21:58:41.268747+0000","last_active":"2024-04-26T21:58:42.252025+0000","last_peered":"2024-04-26T21:58:42.252025+0000","last_clean":"2024-04-26T21:58:42.252025+0000","last_became_active":"2024-04-26T21:58:41.268428+0000","last_became_peered":"2024-04-26T21:58:41.268428+0000","last_unstale":"2024-04-26T21:58:42.252025+0000","last_undegraded":"2024-04-26T21:58:42.252025+0000","last_fullsized":"2024-04-26T21:58:42.252025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250604+0000","last_change":"2024-04-26T21:58:41.267888+0000","last_active":"2024-04-26T21:58:42.250604+0000","last_peered":"2024-04-26T21:58:42.250604+0000","last_clean":"2024-04-26T21:58:42.250604+0000","last_became_active":"2024-04-26T21:58:41.267511+0000","last_became_peered":"2024-04-26T21:58:41.267511+0000","last_unstale":"2024-04-26T21:58:42.250604+0000","last_undegraded":"2024-04-26T21:58:42.250604+0000","last_fullsized":"2024-04-26T21:58:42.250604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679497+0000","last_change":"2024-04-26T21:58:41.265150+0000","last_active":"2024-04-26T21:58:42.679497+0000","last_peered":"2024-04-26T21:58:42.679497+0000","last_clean":"2024-04-26T21:58:42.679497+0000","last_became_active":"2024-04-26T21:58:41.264882+0000","last_became_peered":"2024-04-26T21:58:41.264882+0000","last_unstale":"2024-04-26T21:58:42.679497+0000","last_undegraded":"2024-04-26T21:58:42.679497+0000","last_fullsized":"2024-04-26T21:58:42.679497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679252+0000","last_change":"2024-04-26T21:58:41.276698+0000","last_active":"2024-04-26T21:58:42.679252+0000","last_peered":"2024-04-26T21:58:42.679252+0000","last_clean":"2024-04-26T21:58:42.679252+0000","last_became_active":"2024-04-26T21:58:41.276439+0000","last_became_peered":"2024-04-26T21:58:41.276439+0000","last_unstale":"2024-04-26T21:58:42.679252+0000","last_undegraded":"2024-04-26T21:58:42.679252+0000","last_fullsized":"2024-04-26T21:58:42.679252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251967+0000","last_change":"2024-04-26T21:58:41.266844+0000","last_active":"2024-04-26T21:58:42.251967+0000","last_peered":"2024-04-26T21:58:42.251967+0000","last_clean":"2024-04-26T21:58:42.251967+0000","last_became_active":"2024-04-26T21:58:41.266576+0000","last_became_peered":"2024-04-26T21:58:41.266576+0000","last_unstale":"2024-04-26T21:58:42.251967+0000","last_undegraded":"2024-04-26T21:58:42.251967+0000","last_fullsized":"2024-04-26T21:58:42.251967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679113+0000","last_change":"2024-04-26T21:58:41.274496+0000","last_active":"2024-04-26T21:58:42.679113+0000","last_peered":"2024-04-26T21:58:42.679113+0000","last_clean":"2024-04-26T21:58:42.679113+0000","last_became_active":"2024-04-26T21:58:41.274206+0000","last_became_peered":"2024-04-26T21:58:41.274206+0000","last_unstale":"2024-04-26T21:58:42.679113+0000","last_undegraded":"2024-04-26T21:58:42.679113+0000","last_fullsized":"2024-04-26T21:58:42.679113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251060+0000","last_change":"2024-04-26T21:58:41.263323+0000","last_active":"2024-04-26T21:58:42.251060+0000","last_peered":"2024-04-26T21:58:42.251060+0000","last_clean":"2024-04-26T21:58:42.251060+0000","last_became_active":"2024-04-26T21:58:41.263054+0000","last_became_peered":"2024-04-26T21:58:41.263054+0000","last_unstale":"2024-04-26T21:58:42.251060+0000","last_undegraded":"2024-04-26T21:58:42.251060+0000","last_fullsized":"2024-04-26T21:58:42.251060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679251+0000","last_change":"2024-04-26T21:58:41.271464+0000","last_active":"2024-04-26T21:58:42.679251+0000","last_peered":"2024-04-26T21:58:42.679251+0000","last_clean":"2024-04-26T21:58:42.679251+0000","last_became_active":"2024-04-26T21:58:41.271196+0000","last_became_peered":"2024-04-26T21:58:41.271196+0000","last_unstale":"2024-04-26T21:58:42.679251+0000","last_undegraded":"2024-04-26T21:58:42.679251+0000","last_fullsized":"2024-04-26T21:58:42.679251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252031+0000","last_change":"2024-04-26T21:58:41.263814+0000","last_active":"2024-04-26T21:58:42.252031+0000","last_peered":"2024-04-26T21:58:42.252031+0000","last_clean":"2024-04-26T21:58:42.252031+0000","last_became_active":"2024-04-26T21:58:41.263511+0000","last_became_peered":"2024-04-26T21:58:41.263511+0000","last_unstale":"2024-04-26T21:58:42.252031+0000","last_undegraded":"2024-04-26T21:58:42.252031+0000","last_fullsized":"2024-04-26T21:58:42.252031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271753+0000","last_change":"2024-04-26T21:58:41.275685+0000","last_active":"2024-04-26T21:58:42.271753+0000","last_peered":"2024-04-26T21:58:42.271753+0000","last_clean":"2024-04-26T21:58:42.271753+0000","last_became_active":"2024-04-26T21:58:41.275415+0000","last_became_peered":"2024-04-26T21:58:41.275415+0000","last_unstale":"2024-04-26T21:58:42.271753+0000","last_undegraded":"2024-04-26T21:58:42.271753+0000","last_fullsized":"2024-04-26T21:58:42.271753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271661+0000","last_change":"2024-04-26T21:58:41.278076+0000","last_active":"2024-04-26T21:58:42.271661+0000","last_peered":"2024-04-26T21:58:42.271661+0000","last_clean":"2024-04-26T21:58:42.271661+0000","last_became_active":"2024-04-26T21:58:41.277772+0000","last_became_peered":"2024-04-26T21:58:41.277772+0000","last_unstale":"2024-04-26T21:58:42.271661+0000","last_undegraded":"2024-04-26T21:58:42.271661+0000","last_fullsized":"2024-04-26T21:58:42.271661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251676+0000","last_change":"2024-04-26T21:58:41.265624+0000","last_active":"2024-04-26T21:58:42.251676+0000","last_peered":"2024-04-26T21:58:42.251676+0000","last_clean":"2024-04-26T21:58:42.251676+0000","last_became_active":"2024-04-26T21:58:41.265100+0000","last_became_peered":"2024-04-26T21:58:41.265100+0000","last_unstale":"2024-04-26T21:58:42.251676+0000","last_undegraded":"2024-04-26T21:58:42.251676+0000","last_fullsized":"2024-04-26T21:58:42.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680143+0000","last_change":"2024-04-26T21:58:41.263878+0000","last_active":"2024-04-26T21:58:42.680143+0000","last_peered":"2024-04-26T21:58:42.680143+0000","last_clean":"2024-04-26T21:58:42.680143+0000","last_became_active":"2024-04-26T21:58:41.263324+0000","last_became_peered":"2024-04-26T21:58:41.263324+0000","last_unstale":"2024-04-26T21:58:42.680143+0000","last_undegraded":"2024-04-26T21:58:42.680143+0000","last_fullsized":"2024-04-26T21:58:42.680143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679040+0000","last_change":"2024-04-26T21:58:41.266911+0000","last_active":"2024-04-26T21:58:42.679040+0000","last_peered":"2024-04-26T21:58:42.679040+0000","last_clean":"2024-04-26T21:58:42.679040+0000","last_became_active":"2024-04-26T21:58:41.266650+0000","last_became_peered":"2024-04-26T21:58:41.266650+0000","last_unstale":"2024-04-26T21:58:42.679040+0000","last_undegraded":"2024-04-26T21:58:42.679040+0000","last_fullsized":"2024-04-26T21:58:42.679040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:41.402737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250485+0000","last_change":"2024-04-26T21:58:41.265835+0000","last_active":"2024-04-26T21:58:42.250485+0000","last_peered":"2024-04-26T21:58:42.250485+0000","last_clean":"2024-04-26T21:58:42.250485+0000","last_became_active":"2024-04-26T21:58:41.265546+0000","last_became_peered":"2024-04-26T21:58:41.265546+0000","last_unstale":"2024-04-26T21:58:42.250485+0000","last_undegraded":"2024-04-26T21:58:42.250485+0000","last_fullsized":"2024-04-26T21:58:42.250485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678981+0000","last_change":"2024-04-26T21:58:41.274315+0000","last_active":"2024-04-26T21:58:42.678981+0000","last_peered":"2024-04-26T21:58:42.678981+0000","last_clean":"2024-04-26T21:58:42.678981+0000","last_became_active":"2024-04-26T21:58:41.274000+0000","last_became_peered":"2024-04-26T21:58:41.274000+0000","last_unstale":"2024-04-26T21:58:42.678981+0000","last_undegraded":"2024-04-26T21:58:42.678981+0000","last_fullsized":"2024-04-26T21:58:42.678981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679611+0000","last_change":"2024-04-26T21:58:41.272052+0000","last_active":"2024-04-26T21:58:42.679611+0000","last_peered":"2024-04-26T21:58:42.679611+0000","last_clean":"2024-04-26T21:58:42.679611+0000","last_became_active":"2024-04-26T21:58:41.271775+0000","last_became_peered":"2024-04-26T21:58:41.271775+0000","last_unstale":"2024-04-26T21:58:42.679611+0000","last_undegraded":"2024-04-26T21:58:42.679611+0000","last_fullsized":"2024-04-26T21:58:42.679611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679120+0000","last_change":"2024-04-26T21:58:41.267754+0000","last_active":"2024-04-26T21:58:42.679120+0000","last_peered":"2024-04-26T21:58:42.679120+0000","last_clean":"2024-04-26T21:58:42.679120+0000","last_became_active":"2024-04-26T21:58:41.267414+0000","last_became_peered":"2024-04-26T21:58:41.267414+0000","last_unstale":"2024-04-26T21:58:42.679120+0000","last_undegraded":"2024-04-26T21:58:42.679120+0000","last_fullsized":"2024-04-26T21:58:42.679120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251919+0000","last_change":"2024-04-26T21:58:41.261004+0000","last_active":"2024-04-26T21:58:42.251919+0000","last_peered":"2024-04-26T21:58:42.251919+0000","last_clean":"2024-04-26T21:58:42.251919+0000","last_became_active":"2024-04-26T21:58:41.260578+0000","last_became_peered":"2024-04-26T21:58:41.260578+0000","last_unstale":"2024-04-26T21:58:42.251919+0000","last_undegraded":"2024-04-26T21:58:42.251919+0000","last_fullsized":"2024-04-26T21:58:42.251919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271701+0000","last_change":"2024-04-26T21:58:41.267436+0000","last_active":"2024-04-26T21:58:42.271701+0000","last_peered":"2024-04-26T21:58:42.271701+0000","last_clean":"2024-04-26T21:58:42.271701+0000","last_became_active":"2024-04-26T21:58:41.267151+0000","last_became_peered":"2024-04-26T21:58:41.267151+0000","last_unstale":"2024-04-26T21:58:42.271701+0000","last_undegraded":"2024-04-26T21:58:42.271701+0000","last_fullsized":"2024-04-26T21:58:42.271701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679858+0000","last_change":"2024-04-26T21:58:41.273673+0000","last_active":"2024-04-26T21:58:42.679858+0000","last_peered":"2024-04-26T21:58:42.679858+0000","last_clean":"2024-04-26T21:58:42.679858+0000","last_became_active":"2024-04-26T21:58:41.273384+0000","last_became_peered":"2024-04-26T21:58:41.273384+0000","last_unstale":"2024-04-26T21:58:42.679858+0000","last_undegraded":"2024-04-26T21:58:42.679858+0000","last_fullsized":"2024-04-26T21:58:42.679858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679139+0000","last_change":"2024-04-26T21:58:41.272126+0000","last_active":"2024-04-26T21:58:42.679139+0000","last_peered":"2024-04-26T21:58:42.679139+0000","last_clean":"2024-04-26T21:58:42.679139+0000","last_became_active":"2024-04-26T21:58:41.271816+0000","last_became_peered":"2024-04-26T21:58:41.271816+0000","last_unstale":"2024-04-26T21:58:42.679139+0000","last_undegraded":"2024-04-26T21:58:42.679139+0000","last_fullsized":"2024-04-26T21:58:42.679139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678912+0000","last_change":"2024-04-26T21:58:41.256372+0000","last_active":"2024-04-26T21:58:42.678912+0000","last_peered":"2024-04-26T21:58:42.678912+0000","last_clean":"2024-04-26T21:58:42.678912+0000","last_became_active":"2024-04-26T21:58:41.256119+0000","last_became_peered":"2024-04-26T21:58:41.256119+0000","last_unstale":"2024-04-26T21:58:42.678912+0000","last_undegraded":"2024-04-26T21:58:42.678912+0000","last_fullsized":"2024-04-26T21:58:42.678912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679089+0000","last_change":"2024-04-26T21:58:41.276385+0000","last_active":"2024-04-26T21:58:42.679089+0000","last_peered":"2024-04-26T21:58:42.679089+0000","last_clean":"2024-04-26T21:58:42.679089+0000","last_became_active":"2024-04-26T21:58:41.275917+0000","last_became_peered":"2024-04-26T21:58:41.275917+0000","last_unstale":"2024-04-26T21:58:42.679089+0000","last_undegraded":"2024-04-26T21:58:42.679089+0000","last_fullsized":"2024-04-26T21:58:42.679089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680416+0000","last_change":"2024-04-26T21:58:41.262076+0000","last_active":"2024-04-26T21:58:42.680416+0000","last_peered":"2024-04-26T21:58:42.680416+0000","last_clean":"2024-04-26T21:58:42.680416+0000","last_became_active":"2024-04-26T21:58:41.261726+0000","last_became_peered":"2024-04-26T21:58:41.261726+0000","last_unstale":"2024-04-26T21:58:42.680416+0000","last_undegraded":"2024-04-26T21:58:42.680416+0000","last_fullsized":"2024-04-26T21:58:42.680416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271762+0000","last_change":"2024-04-26T21:58:41.274846+0000","last_active":"2024-04-26T21:58:42.271762+0000","last_peered":"2024-04-26T21:58:42.271762+0000","last_clean":"2024-04-26T21:58:42.271762+0000","last_became_active":"2024-04-26T21:58:41.274526+0000","last_became_peered":"2024-04-26T21:58:41.274526+0000","last_unstale":"2024-04-26T21:58:42.271762+0000","last_undegraded":"2024-04-26T21:58:42.271762+0000","last_fullsized":"2024-04-26T21:58:42.271762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:41.265911+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:41.264263+0000","last_became_peered":"2024-04-26T21:58:41.264263+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680292+0000","last_change":"2024-04-26T21:58:41.257067+0000","last_active":"2024-04-26T21:58:42.680292+0000","last_peered":"2024-04-26T21:58:42.680292+0000","last_clean":"2024-04-26T21:58:42.680292+0000","last_became_active":"2024-04-26T21:58:41.256805+0000","last_became_peered":"2024-04-26T21:58:41.256805+0000","last_unstale":"2024-04-26T21:58:42.680292+0000","last_undegraded":"2024-04-26T21:58:42.680292+0000","last_fullsized":"2024-04-26T21:58:42.680292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679908+0000","last_change":"2024-04-26T21:58:41.266375+0000","last_active":"2024-04-26T21:58:42.679908+0000","last_peered":"2024-04-26T21:58:42.679908+0000","last_clean":"2024-04-26T21:58:42.679908+0000","last_became_active":"2024-04-26T21:58:41.265475+0000","last_became_peered":"2024-04-26T21:58:41.265475+0000","last_unstale":"2024-04-26T21:58:42.679908+0000","last_undegraded":"2024-04-26T21:58:42.679908+0000","last_fullsized":"2024-04-26T21:58:42.679908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679287+0000","last_change":"2024-04-26T21:58:41.277146+0000","last_active":"2024-04-26T21:58:42.679287+0000","last_peered":"2024-04-26T21:58:42.679287+0000","last_clean":"2024-04-26T21:58:42.679287+0000","last_became_active":"2024-04-26T21:58:41.276559+0000","last_became_peered":"2024-04-26T21:58:41.276559+0000","last_unstale":"2024-04-26T21:58:42.679287+0000","last_undegraded":"2024-04-26T21:58:42.679287+0000","last_fullsized":"2024-04-26T21:58:42.679287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678913+0000","last_change":"2024-04-26T21:58:41.276609+0000","last_active":"2024-04-26T21:58:42.678913+0000","last_peered":"2024-04-26T21:58:42.678913+0000","last_clean":"2024-04-26T21:58:42.678913+0000","last_became_active":"2024-04-26T21:58:41.276292+0000","last_became_peered":"2024-04-26T21:58:41.276292+0000","last_unstale":"2024-04-26T21:58:42.678913+0000","last_undegraded":"2024-04-26T21:58:42.678913+0000","last_fullsized":"2024-04-26T21:58:42.678913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271495+0000","last_change":"2024-04-26T21:58:41.270741+0000","last_active":"2024-04-26T21:58:42.271495+0000","last_peered":"2024-04-26T21:58:42.271495+0000","last_clean":"2024-04-26T21:58:42.271495+0000","last_became_active":"2024-04-26T21:58:41.270487+0000","last_became_peered":"2024-04-26T21:58:41.270487+0000","last_unstale":"2024-04-26T21:58:42.271495+0000","last_undegraded":"2024-04-26T21:58:42.271495+0000","last_fullsized":"2024-04-26T21:58:42.271495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250963+0000","last_change":"2024-04-26T21:58:41.266593+0000","last_active":"2024-04-26T21:58:42.250963+0000","last_peered":"2024-04-26T21:58:42.250963+0000","last_clean":"2024-04-26T21:58:42.250963+0000","last_became_active":"2024-04-26T21:58:41.264807+0000","last_became_peered":"2024-04-26T21:58:41.264807+0000","last_unstale":"2024-04-26T21:58:42.250963+0000","last_undegraded":"2024-04-26T21:58:42.250963+0000","last_fullsized":"2024-04-26T21:58:42.250963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:19.885646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680245+0000","last_change":"2024-04-26T21:58:40.261101+0000","last_active":"2024-04-26T21:58:42.680245+0000","last_peered":"2024-04-26T21:58:42.680245+0000","last_clean":"2024-04-26T21:58:42.680245+0000","last_became_active":"2024-04-26T21:58:40.260808+0000","last_became_peered":"2024-04-26T21:58:40.260808+0000","last_unstale":"2024-04-26T21:58:42.680245+0000","last_undegraded":"2024-04-26T21:58:42.680245+0000","last_fullsized":"2024-04-26T21:58:42.680245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679995+0000","last_change":"2024-04-26T21:58:41.266101+0000","last_active":"2024-04-26T21:58:42.679995+0000","last_peered":"2024-04-26T21:58:42.679995+0000","last_clean":"2024-04-26T21:58:42.679995+0000","last_became_active":"2024-04-26T21:58:41.265717+0000","last_became_peered":"2024-04-26T21:58:41.265717+0000","last_unstale":"2024-04-26T21:58:42.679995+0000","last_undegraded":"2024-04-26T21:58:42.679995+0000","last_fullsized":"2024-04-26T21:58:42.679995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271466+0000","last_change":"2024-04-26T21:58:40.258127+0000","last_active":"2024-04-26T21:58:42.271466+0000","last_peered":"2024-04-26T21:58:42.271466+0000","last_clean":"2024-04-26T21:58:42.271466+0000","last_became_active":"2024-04-26T21:58:40.257826+0000","last_became_peered":"2024-04-26T21:58:40.257826+0000","last_unstale":"2024-04-26T21:58:42.271466+0000","last_undegraded":"2024-04-26T21:58:42.271466+0000","last_fullsized":"2024-04-26T21:58:42.271466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679016+0000","last_change":"2024-04-26T21:58:40.260227+0000","last_active":"2024-04-26T21:58:42.679016+0000","last_peered":"2024-04-26T21:58:42.679016+0000","last_clean":"2024-04-26T21:58:42.679016+0000","last_became_active":"2024-04-26T21:58:40.259912+0000","last_became_peered":"2024-04-26T21:58:40.259912+0000","last_unstale":"2024-04-26T21:58:42.679016+0000","last_undegraded":"2024-04-26T21:58:42.679016+0000","last_fullsized":"2024-04-26T21:58:42.679016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679399+0000","last_change":"2024-04-26T21:58:41.270746+0000","last_active":"2024-04-26T21:58:42.679399+0000","last_peered":"2024-04-26T21:58:42.679399+0000","last_clean":"2024-04-26T21:58:42.679399+0000","last_became_active":"2024-04-26T21:58:41.270461+0000","last_became_peered":"2024-04-26T21:58:41.270461+0000","last_unstale":"2024-04-26T21:58:42.679399+0000","last_undegraded":"2024-04-26T21:58:42.679399+0000","last_fullsized":"2024-04-26T21:58:42.679399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679094+0000","last_change":"2024-04-26T21:58:40.251101+0000","last_active":"2024-04-26T21:58:42.679094+0000","last_peered":"2024-04-26T21:58:42.679094+0000","last_clean":"2024-04-26T21:58:42.679094+0000","last_became_active":"2024-04-26T21:58:40.250806+0000","last_became_peered":"2024-04-26T21:58:40.250806+0000","last_unstale":"2024-04-26T21:58:42.679094+0000","last_undegraded":"2024-04-26T21:58:42.679094+0000","last_fullsized":"2024-04-26T21:58:42.679094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250355+0000","last_change":"2024-04-26T21:58:41.264656+0000","last_active":"2024-04-26T21:58:42.250355+0000","last_peered":"2024-04-26T21:58:42.250355+0000","last_clean":"2024-04-26T21:58:42.250355+0000","last_became_active":"2024-04-26T21:58:41.264348+0000","last_became_peered":"2024-04-26T21:58:41.264348+0000","last_unstale":"2024-04-26T21:58:42.250355+0000","last_undegraded":"2024-04-26T21:58:42.250355+0000","last_fullsized":"2024-04-26T21:58:42.250355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271640+0000","last_change":"2024-04-26T21:58:40.258471+0000","last_active":"2024-04-26T21:58:42.271640+0000","last_peered":"2024-04-26T21:58:42.271640+0000","last_clean":"2024-04-26T21:58:42.271640+0000","last_became_active":"2024-04-26T21:58:40.258096+0000","last_became_peered":"2024-04-26T21:58:40.258096+0000","last_unstale":"2024-04-26T21:58:42.271640+0000","last_undegraded":"2024-04-26T21:58:42.271640+0000","last_fullsized":"2024-04-26T21:58:42.271640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679536+0000","last_change":"2024-04-26T21:58:41.273769+0000","last_active":"2024-04-26T21:58:42.679536+0000","last_peered":"2024-04-26T21:58:42.679536+0000","last_clean":"2024-04-26T21:58:42.679536+0000","last_became_active":"2024-04-26T21:58:41.271822+0000","last_became_peered":"2024-04-26T21:58:41.271822+0000","last_unstale":"2024-04-26T21:58:42.679536+0000","last_undegraded":"2024-04-26T21:58:42.679536+0000","last_fullsized":"2024-04-26T21:58:42.679536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679507+0000","last_change":"2024-04-26T21:58:40.258784+0000","last_active":"2024-04-26T21:58:42.679507+0000","last_peered":"2024-04-26T21:58:42.679507+0000","last_clean":"2024-04-26T21:58:42.679507+0000","last_became_active":"2024-04-26T21:58:40.258357+0000","last_became_peered":"2024-04-26T21:58:40.258357+0000","last_unstale":"2024-04-26T21:58:42.679507+0000","last_undegraded":"2024-04-26T21:58:42.679507+0000","last_fullsized":"2024-04-26T21:58:42.679507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679948+0000","last_change":"2024-04-26T21:58:41.279201+0000","last_active":"2024-04-26T21:58:42.679948+0000","last_peered":"2024-04-26T21:58:42.679948+0000","last_clean":"2024-04-26T21:58:42.679948+0000","last_became_active":"2024-04-26T21:58:41.278869+0000","last_became_peered":"2024-04-26T21:58:41.278869+0000","last_unstale":"2024-04-26T21:58:42.679948+0000","last_undegraded":"2024-04-26T21:58:42.679948+0000","last_fullsized":"2024-04-26T21:58:42.679948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:40.255154+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:40.254905+0000","last_became_peered":"2024-04-26T21:58:40.254905+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251689+0000","last_change":"2024-04-26T21:58:41.255887+0000","last_active":"2024-04-26T21:58:42.251689+0000","last_peered":"2024-04-26T21:58:42.251689+0000","last_clean":"2024-04-26T21:58:42.251689+0000","last_became_active":"2024-04-26T21:58:41.255557+0000","last_became_peered":"2024-04-26T21:58:41.255557+0000","last_unstale":"2024-04-26T21:58:42.251689+0000","last_undegraded":"2024-04-26T21:58:42.251689+0000","last_fullsized":"2024-04-26T21:58:42.251689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:52.499298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271704+0000","last_change":"2024-04-26T21:58:40.263413+0000","last_active":"2024-04-26T21:58:42.271704+0000","last_peered":"2024-04-26T21:58:42.271704+0000","last_clean":"2024-04-26T21:58:42.271704+0000","last_became_active":"2024-04-26T21:58:40.263104+0000","last_became_peered":"2024-04-26T21:58:40.263104+0000","last_unstale":"2024-04-26T21:58:42.271704+0000","last_undegraded":"2024-04-26T21:58:42.271704+0000","last_fullsized":"2024-04-26T21:58:42.271704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251648+0000","last_change":"2024-04-26T21:58:41.264209+0000","last_active":"2024-04-26T21:58:42.251648+0000","last_peered":"2024-04-26T21:58:42.251648+0000","last_clean":"2024-04-26T21:58:42.251648+0000","last_became_active":"2024-04-26T21:58:41.263961+0000","last_became_peered":"2024-04-26T21:58:41.263961+0000","last_unstale":"2024-04-26T21:58:42.251648+0000","last_undegraded":"2024-04-26T21:58:42.251648+0000","last_fullsized":"2024-04-26T21:58:42.251648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680014+0000","last_change":"2024-04-26T21:58:40.248876+0000","last_active":"2024-04-26T21:58:42.680014+0000","last_peered":"2024-04-26T21:58:42.680014+0000","last_clean":"2024-04-26T21:58:42.680014+0000","last_became_active":"2024-04-26T21:58:40.248573+0000","last_became_peered":"2024-04-26T21:58:40.248573+0000","last_unstale":"2024-04-26T21:58:42.680014+0000","last_undegraded":"2024-04-26T21:58:42.680014+0000","last_fullsized":"2024-04-26T21:58:42.680014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679175+0000","last_change":"2024-04-26T21:58:41.262092+0000","last_active":"2024-04-26T21:58:42.679175+0000","last_peered":"2024-04-26T21:58:42.679175+0000","last_clean":"2024-04-26T21:58:42.679175+0000","last_became_active":"2024-04-26T21:58:41.261788+0000","last_became_peered":"2024-04-26T21:58:41.261788+0000","last_unstale":"2024-04-26T21:58:42.679175+0000","last_undegraded":"2024-04-26T21:58:42.679175+0000","last_fullsized":"2024-04-26T21:58:42.679175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:28.345096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679243+0000","last_change":"2024-04-26T21:58:40.263316+0000","last_active":"2024-04-26T21:58:42.679243+0000","last_peered":"2024-04-26T21:58:42.679243+0000","last_clean":"2024-04-26T21:58:42.679243+0000","last_became_active":"2024-04-26T21:58:40.263027+0000","last_became_peered":"2024-04-26T21:58:40.263027+0000","last_unstale":"2024-04-26T21:58:42.679243+0000","last_undegraded":"2024-04-26T21:58:42.679243+0000","last_fullsized":"2024-04-26T21:58:42.679243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:41.253991+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:41.253696+0000","last_became_peered":"2024-04-26T21:58:41.253696+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271544+0000","last_change":"2024-04-26T21:58:40.261008+0000","last_active":"2024-04-26T21:58:42.271544+0000","last_peered":"2024-04-26T21:58:42.271544+0000","last_clean":"2024-04-26T21:58:42.271544+0000","last_became_active":"2024-04-26T21:58:40.260697+0000","last_became_peered":"2024-04-26T21:58:40.260697+0000","last_unstale":"2024-04-26T21:58:42.271544+0000","last_undegraded":"2024-04-26T21:58:42.271544+0000","last_fullsized":"2024-04-26T21:58:42.271544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271540+0000","last_change":"2024-04-26T21:58:41.271346+0000","last_active":"2024-04-26T21:58:42.271540+0000","last_peered":"2024-04-26T21:58:42.271540+0000","last_clean":"2024-04-26T21:58:42.271540+0000","last_became_active":"2024-04-26T21:58:41.271090+0000","last_became_peered":"2024-04-26T21:58:41.271090+0000","last_unstale":"2024-04-26T21:58:42.271540+0000","last_undegraded":"2024-04-26T21:58:42.271540+0000","last_fullsized":"2024-04-26T21:58:42.271540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678753+0000","last_change":"2024-04-26T21:58:40.253802+0000","last_active":"2024-04-26T21:58:42.678753+0000","last_peered":"2024-04-26T21:58:42.678753+0000","last_clean":"2024-04-26T21:58:42.678753+0000","last_became_active":"2024-04-26T21:58:40.253518+0000","last_became_peered":"2024-04-26T21:58:40.253518+0000","last_unstale":"2024-04-26T21:58:42.678753+0000","last_undegraded":"2024-04-26T21:58:42.678753+0000","last_fullsized":"2024-04-26T21:58:42.678753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251124+0000","last_change":"2024-04-26T21:58:41.254741+0000","last_active":"2024-04-26T21:58:42.251124+0000","last_peered":"2024-04-26T21:58:42.251124+0000","last_clean":"2024-04-26T21:58:42.251124+0000","last_became_active":"2024-04-26T21:58:41.253953+0000","last_became_peered":"2024-04-26T21:58:41.253953+0000","last_unstale":"2024-04-26T21:58:42.251124+0000","last_undegraded":"2024-04-26T21:58:42.251124+0000","last_fullsized":"2024-04-26T21:58:42.251124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251491+0000","last_change":"2024-04-26T21:58:40.253095+0000","last_active":"2024-04-26T21:58:42.251491+0000","last_peered":"2024-04-26T21:58:42.251491+0000","last_clean":"2024-04-26T21:58:42.251491+0000","last_became_active":"2024-04-26T21:58:40.252789+0000","last_became_peered":"2024-04-26T21:58:40.252789+0000","last_unstale":"2024-04-26T21:58:42.251491+0000","last_undegraded":"2024-04-26T21:58:42.251491+0000","last_fullsized":"2024-04-26T21:58:42.251491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:43.627280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251523+0000","last_change":"2024-04-26T21:58:41.256932+0000","last_active":"2024-04-26T21:58:42.251523+0000","last_peered":"2024-04-26T21:58:42.251523+0000","last_clean":"2024-04-26T21:58:42.251523+0000","last_became_active":"2024-04-26T21:58:41.256652+0000","last_became_peered":"2024-04-26T21:58:41.256652+0000","last_unstale":"2024-04-26T21:58:42.251523+0000","last_undegraded":"2024-04-26T21:58:42.251523+0000","last_fullsized":"2024-04-26T21:58:42.251523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679210+0000","last_change":"2024-04-26T21:58:40.263483+0000","last_active":"2024-04-26T21:58:42.679210+0000","last_peered":"2024-04-26T21:58:42.679210+0000","last_clean":"2024-04-26T21:58:42.679210+0000","last_became_active":"2024-04-26T21:58:40.263197+0000","last_became_peered":"2024-04-26T21:58:40.263197+0000","last_unstale":"2024-04-26T21:58:42.679210+0000","last_undegraded":"2024-04-26T21:58:42.679210+0000","last_fullsized":"2024-04-26T21:58:42.679210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252178+0000","last_change":"2024-04-26T21:58:41.257381+0000","last_active":"2024-04-26T21:58:42.252178+0000","last_peered":"2024-04-26T21:58:42.252178+0000","last_clean":"2024-04-26T21:58:42.252178+0000","last_became_active":"2024-04-26T21:58:41.256911+0000","last_became_peered":"2024-04-26T21:58:41.256911+0000","last_unstale":"2024-04-26T21:58:42.252178+0000","last_undegraded":"2024-04-26T21:58:42.252178+0000","last_fullsized":"2024-04-26T21:58:42.252178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250538+0000","last_change":"2024-04-26T21:58:40.255266+0000","last_active":"2024-04-26T21:58:42.250538+0000","last_peered":"2024-04-26T21:58:42.250538+0000","last_clean":"2024-04-26T21:58:42.250538+0000","last_became_active":"2024-04-26T21:58:40.254863+0000","last_became_peered":"2024-04-26T21:58:40.254863+0000","last_unstale":"2024-04-26T21:58:42.250538+0000","last_undegraded":"2024-04-26T21:58:42.250538+0000","last_fullsized":"2024-04-26T21:58:42.250538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679454+0000","last_change":"2024-04-26T21:58:41.277259+0000","last_active":"2024-04-26T21:58:42.679454+0000","last_peered":"2024-04-26T21:58:42.679454+0000","last_clean":"2024-04-26T21:58:42.679454+0000","last_became_active":"2024-04-26T21:58:41.276186+0000","last_became_peered":"2024-04-26T21:58:41.276186+0000","last_unstale":"2024-04-26T21:58:42.679454+0000","last_undegraded":"2024-04-26T21:58:42.679454+0000","last_fullsized":"2024-04-26T21:58:42.679454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678752+0000","last_change":"2024-04-26T21:58:40.258271+0000","last_active":"2024-04-26T21:58:42.678752+0000","last_peered":"2024-04-26T21:58:42.678752+0000","last_clean":"2024-04-26T21:58:42.678752+0000","last_became_active":"2024-04-26T21:58:40.257941+0000","last_became_peered":"2024-04-26T21:58:40.257941+0000","last_unstale":"2024-04-26T21:58:42.678752+0000","last_undegraded":"2024-04-26T21:58:42.678752+0000","last_fullsized":"2024-04-26T21:58:42.678752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252033+0000","last_change":"2024-04-26T21:58:41.270377+0000","last_active":"2024-04-26T21:58:42.252033+0000","last_peered":"2024-04-26T21:58:42.252033+0000","last_clean":"2024-04-26T21:58:42.252033+0000","last_became_active":"2024-04-26T21:58:41.270106+0000","last_became_peered":"2024-04-26T21:58:41.270106+0000","last_unstale":"2024-04-26T21:58:42.252033+0000","last_undegraded":"2024-04-26T21:58:42.252033+0000","last_fullsized":"2024-04-26T21:58:42.252033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250932+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:58:42.250932+0000","last_peered":"2024-04-26T21:58:42.250932+0000","last_clean":"2024-04-26T21:58:42.250932+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:58:42.250932+0000","last_undegraded":"2024-04-26T21:58:42.250932+0000","last_fullsized":"2024-04-26T21:58:42.250932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679020+0000","last_change":"2024-04-26T21:58:40.255645+0000","last_active":"2024-04-26T21:58:42.679020+0000","last_peered":"2024-04-26T21:58:42.679020+0000","last_clean":"2024-04-26T21:58:42.679020+0000","last_became_active":"2024-04-26T21:58:40.254847+0000","last_became_peered":"2024-04-26T21:58:40.254847+0000","last_unstale":"2024-04-26T21:58:42.679020+0000","last_undegraded":"2024-04-26T21:58:42.679020+0000","last_fullsized":"2024-04-26T21:58:42.679020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679864+0000","last_change":"2024-04-26T21:58:41.272174+0000","last_active":"2024-04-26T21:58:42.679864+0000","last_peered":"2024-04-26T21:58:42.679864+0000","last_clean":"2024-04-26T21:58:42.679864+0000","last_became_active":"2024-04-26T21:58:41.271879+0000","last_became_peered":"2024-04-26T21:58:41.271879+0000","last_unstale":"2024-04-26T21:58:42.679864+0000","last_undegraded":"2024-04-26T21:58:42.679864+0000","last_fullsized":"2024-04-26T21:58:42.679864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250883+0000","last_change":"2024-04-26T21:58:40.263425+0000","last_active":"2024-04-26T21:58:42.250883+0000","last_peered":"2024-04-26T21:58:42.250883+0000","last_clean":"2024-04-26T21:58:42.250883+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.250883+0000","last_undegraded":"2024-04-26T21:58:42.250883+0000","last_fullsized":"2024-04-26T21:58:42.250883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678995+0000","last_change":"2024-04-26T21:58:41.266358+0000","last_active":"2024-04-26T21:58:42.678995+0000","last_peered":"2024-04-26T21:58:42.678995+0000","last_clean":"2024-04-26T21:58:42.678995+0000","last_became_active":"2024-04-26T21:58:41.265803+0000","last_became_peered":"2024-04-26T21:58:41.265803+0000","last_unstale":"2024-04-26T21:58:42.678995+0000","last_undegraded":"2024-04-26T21:58:42.678995+0000","last_fullsized":"2024-04-26T21:58:42.678995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:39.448477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679090+0000","last_change":"2024-04-26T21:58:40.263478+0000","last_active":"2024-04-26T21:58:42.679090+0000","last_peered":"2024-04-26T21:58:42.679090+0000","last_clean":"2024-04-26T21:58:42.679090+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.679090+0000","last_undegraded":"2024-04-26T21:58:42.679090+0000","last_fullsized":"2024-04-26T21:58:42.679090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250423+0000","last_change":"2024-04-26T21:58:41.267643+0000","last_active":"2024-04-26T21:58:42.250423+0000","last_peered":"2024-04-26T21:58:42.250423+0000","last_clean":"2024-04-26T21:58:42.250423+0000","last_became_active":"2024-04-26T21:58:41.266985+0000","last_became_peered":"2024-04-26T21:58:41.266985+0000","last_unstale":"2024-04-26T21:58:42.250423+0000","last_undegraded":"2024-04-26T21:58:42.250423+0000","last_fullsized":"2024-04-26T21:58:42.250423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679346+0000","last_change":"2024-04-26T21:58:40.252288+0000","last_active":"2024-04-26T21:58:42.679346+0000","last_peered":"2024-04-26T21:58:42.679346+0000","last_clean":"2024-04-26T21:58:42.679346+0000","last_became_active":"2024-04-26T21:58:40.251940+0000","last_became_peered":"2024-04-26T21:58:40.251940+0000","last_unstale":"2024-04-26T21:58:42.679346+0000","last_undegraded":"2024-04-26T21:58:42.679346+0000","last_fullsized":"2024-04-26T21:58:42.679346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251381+0000","last_change":"2024-04-26T21:58:41.267485+0000","last_active":"2024-04-26T21:58:42.251381+0000","last_peered":"2024-04-26T21:58:42.251381+0000","last_clean":"2024-04-26T21:58:42.251381+0000","last_became_active":"2024-04-26T21:58:41.266964+0000","last_became_peered":"2024-04-26T21:58:41.266964+0000","last_unstale":"2024-04-26T21:58:42.251381+0000","last_undegraded":"2024-04-26T21:58:42.251381+0000","last_fullsized":"2024-04-26T21:58:42.251381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250575+0000","last_change":"2024-04-26T21:58:40.257116+0000","last_active":"2024-04-26T21:58:42.250575+0000","last_peered":"2024-04-26T21:58:42.250575+0000","last_clean":"2024-04-26T21:58:42.250575+0000","last_became_active":"2024-04-26T21:58:40.256843+0000","last_became_peered":"2024-04-26T21:58:40.256843+0000","last_unstale":"2024-04-26T21:58:42.250575+0000","last_undegraded":"2024-04-26T21:58:42.250575+0000","last_fullsized":"2024-04-26T21:58:42.250575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679465+0000","last_change":"2024-04-26T21:58:41.277155+0000","last_active":"2024-04-26T21:58:42.679465+0000","last_peered":"2024-04-26T21:58:42.679465+0000","last_clean":"2024-04-26T21:58:42.679465+0000","last_became_active":"2024-04-26T21:58:41.276120+0000","last_became_peered":"2024-04-26T21:58:41.276120+0000","last_unstale":"2024-04-26T21:58:42.679465+0000","last_undegraded":"2024-04-26T21:58:42.679465+0000","last_fullsized":"2024-04-26T21:58:42.679465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:40.265846+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:40.265527+0000","last_became_peered":"2024-04-26T21:58:40.265527+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:51.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250582+0000","last_change":"2024-04-26T21:58:41.263124+0000","last_active":"2024-04-26T21:58:42.250582+0000","last_peered":"2024-04-26T21:58:42.250582+0000","last_clean":"2024-04-26T21:58:42.250582+0000","last_became_active":"2024-04-26T21:58:41.262827+0000","last_became_peered":"2024-04-26T21:58:41.262827+0000","last_unstale":"2024-04-26T21:58:42.250582+0000","last_undegraded":"2024-04-26T21:58:42.250582+0000","last_fullsized":"2024-04-26T21:58:42.250582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271057+0000","last_change":"2024-04-26T21:58:40.256172+0000","last_active":"2024-04-26T21:58:42.271057+0000","last_peered":"2024-04-26T21:58:42.271057+0000","last_clean":"2024-04-26T21:58:42.271057+0000","last_became_active":"2024-04-26T21:58:40.255894+0000","last_became_peered":"2024-04-26T21:58:40.255894+0000","last_unstale":"2024-04-26T21:58:42.271057+0000","last_undegraded":"2024-04-26T21:58:42.271057+0000","last_fullsized":"2024-04-26T21:58:42.271057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680432+0000","last_change":"2024-04-26T21:58:41.259933+0000","last_active":"2024-04-26T21:58:42.680432+0000","last_peered":"2024-04-26T21:58:42.680432+0000","last_clean":"2024-04-26T21:58:42.680432+0000","last_became_active":"2024-04-26T21:58:41.259662+0000","last_became_peered":"2024-04-26T21:58:41.259662+0000","last_unstale":"2024-04-26T21:58:42.680432+0000","last_undegraded":"2024-04-26T21:58:42.680432+0000","last_fullsized":"2024-04-26T21:58:42.680432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271702+0000","last_change":"2024-04-26T21:58:40.260624+0000","last_active":"2024-04-26T21:58:42.271702+0000","last_peered":"2024-04-26T21:58:42.271702+0000","last_clean":"2024-04-26T21:58:42.271702+0000","last_became_active":"2024-04-26T21:58:40.260181+0000","last_became_peered":"2024-04-26T21:58:40.260181+0000","last_unstale":"2024-04-26T21:58:42.271702+0000","last_undegraded":"2024-04-26T21:58:42.271702+0000","last_fullsized":"2024-04-26T21:58:42.271702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679775+0000","last_change":"2024-04-26T21:58:41.266891+0000","last_active":"2024-04-26T21:58:42.679775+0000","last_peered":"2024-04-26T21:58:42.679775+0000","last_clean":"2024-04-26T21:58:42.679775+0000","last_became_active":"2024-04-26T21:58:41.266593+0000","last_became_peered":"2024-04-26T21:58:41.266593+0000","last_unstale":"2024-04-26T21:58:42.679775+0000","last_undegraded":"2024-04-26T21:58:42.679775+0000","last_fullsized":"2024-04-26T21:58:42.679775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250789+0000","last_change":"2024-04-26T21:58:40.265807+0000","last_active":"2024-04-26T21:58:42.250789+0000","last_peered":"2024-04-26T21:58:42.250789+0000","last_clean":"2024-04-26T21:58:42.250789+0000","last_became_active":"2024-04-26T21:58:40.265534+0000","last_became_peered":"2024-04-26T21:58:40.265534+0000","last_unstale":"2024-04-26T21:58:42.250789+0000","last_undegraded":"2024-04-26T21:58:42.250789+0000","last_fullsized":"2024-04-26T21:58:42.250789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250909+0000","last_change":"2024-04-26T21:58:41.266189+0000","last_active":"2024-04-26T21:58:42.250909+0000","last_peered":"2024-04-26T21:58:42.250909+0000","last_clean":"2024-04-26T21:58:42.250909+0000","last_became_active":"2024-04-26T21:58:41.265907+0000","last_became_peered":"2024-04-26T21:58:41.265907+0000","last_unstale":"2024-04-26T21:58:42.250909+0000","last_undegraded":"2024-04-26T21:58:42.250909+0000","last_fullsized":"2024-04-26T21:58:42.250909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:59.612605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250454+0000","last_change":"2024-04-26T21:58:40.258532+0000","last_active":"2024-04-26T21:58:42.250454+0000","last_peered":"2024-04-26T21:58:42.250454+0000","last_clean":"2024-04-26T21:58:42.250454+0000","last_became_active":"2024-04-26T21:58:40.258249+0000","last_became_peered":"2024-04-26T21:58:40.258249+0000","last_unstale":"2024-04-26T21:58:42.250454+0000","last_undegraded":"2024-04-26T21:58:42.250454+0000","last_fullsized":"2024-04-26T21:58:42.250454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679584+0000","last_change":"2024-04-26T21:58:41.268472+0000","last_active":"2024-04-26T21:58:42.679584+0000","last_peered":"2024-04-26T21:58:42.679584+0000","last_clean":"2024-04-26T21:58:42.679584+0000","last_became_active":"2024-04-26T21:58:41.268180+0000","last_became_peered":"2024-04-26T21:58:41.268180+0000","last_unstale":"2024-04-26T21:58:42.679584+0000","last_undegraded":"2024-04-26T21:58:42.679584+0000","last_fullsized":"2024-04-26T21:58:42.679584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250412+0000","last_change":"2024-04-26T21:58:40.256945+0000","last_active":"2024-04-26T21:58:42.250412+0000","last_peered":"2024-04-26T21:58:42.250412+0000","last_clean":"2024-04-26T21:58:42.250412+0000","last_became_active":"2024-04-26T21:58:40.256606+0000","last_became_peered":"2024-04-26T21:58:40.256606+0000","last_unstale":"2024-04-26T21:58:42.250412+0000","last_undegraded":"2024-04-26T21:58:42.250412+0000","last_fullsized":"2024-04-26T21:58:42.250412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680144+0000","last_change":"2024-04-26T21:58:41.271521+0000","last_active":"2024-04-26T21:58:42.680144+0000","last_peered":"2024-04-26T21:58:42.680144+0000","last_clean":"2024-04-26T21:58:42.680144+0000","last_became_active":"2024-04-26T21:58:41.270434+0000","last_became_peered":"2024-04-26T21:58:41.270434+0000","last_unstale":"2024-04-26T21:58:42.680144+0000","last_undegraded":"2024-04-26T21:58:42.680144+0000","last_fullsized":"2024-04-26T21:58:42.680144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252045+0000","last_change":"2024-04-26T21:58:40.259668+0000","last_active":"2024-04-26T21:58:42.252045+0000","last_peered":"2024-04-26T21:58:42.252045+0000","last_clean":"2024-04-26T21:58:42.252045+0000","last_became_active":"2024-04-26T21:58:40.259395+0000","last_became_peered":"2024-04-26T21:58:40.259395+0000","last_unstale":"2024-04-26T21:58:42.252045+0000","last_undegraded":"2024-04-26T21:58:42.252045+0000","last_fullsized":"2024-04-26T21:58:42.252045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271493+0000","last_change":"2024-04-26T21:58:41.270142+0000","last_active":"2024-04-26T21:58:42.271493+0000","last_peered":"2024-04-26T21:58:42.271493+0000","last_clean":"2024-04-26T21:58:42.271493+0000","last_became_active":"2024-04-26T21:58:41.269888+0000","last_became_peered":"2024-04-26T21:58:41.269888+0000","last_unstale":"2024-04-26T21:58:42.271493+0000","last_undegraded":"2024-04-26T21:58:42.271493+0000","last_fullsized":"2024-04-26T21:58:42.271493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679421+0000","last_change":"2024-04-26T21:58:41.270107+0000","last_active":"2024-04-26T21:58:42.679421+0000","last_peered":"2024-04-26T21:58:42.679421+0000","last_clean":"2024-04-26T21:58:42.679421+0000","last_became_active":"2024-04-26T21:58:41.267030+0000","last_became_peered":"2024-04-26T21:58:41.267030+0000","last_unstale":"2024-04-26T21:58:42.679421+0000","last_undegraded":"2024-04-26T21:58:42.679421+0000","last_fullsized":"2024-04-26T21:58:42.679421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251589+0000","last_change":"2024-04-26T21:58:40.258932+0000","last_active":"2024-04-26T21:58:42.251589+0000","last_peered":"2024-04-26T21:58:42.251589+0000","last_clean":"2024-04-26T21:58:42.251589+0000","last_became_active":"2024-04-26T21:58:40.258648+0000","last_became_peered":"2024-04-26T21:58:40.258648+0000","last_unstale":"2024-04-26T21:58:42.251589+0000","last_undegraded":"2024-04-26T21:58:42.251589+0000","last_fullsized":"2024-04-26T21:58:42.251589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679261+0000","last_change":"2024-04-26T21:58:41.269888+0000","last_active":"2024-04-26T21:58:42.679261+0000","last_peered":"2024-04-26T21:58:42.679261+0000","last_clean":"2024-04-26T21:58:42.679261+0000","last_became_active":"2024-04-26T21:58:41.269608+0000","last_became_peered":"2024-04-26T21:58:41.269608+0000","last_unstale":"2024-04-26T21:58:42.679261+0000","last_undegraded":"2024-04-26T21:58:42.679261+0000","last_fullsized":"2024-04-26T21:58:42.679261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251773+0000","last_change":"2024-04-26T21:58:40.261919+0000","last_active":"2024-04-26T21:58:42.251773+0000","last_peered":"2024-04-26T21:58:42.251773+0000","last_clean":"2024-04-26T21:58:42.251773+0000","last_became_active":"2024-04-26T21:58:40.261644+0000","last_became_peered":"2024-04-26T21:58:40.261644+0000","last_unstale":"2024-04-26T21:58:42.251773+0000","last_undegraded":"2024-04-26T21:58:42.251773+0000","last_fullsized":"2024-04-26T21:58:42.251773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679439+0000","last_change":"2024-04-26T21:58:41.279829+0000","last_active":"2024-04-26T21:58:42.679439+0000","last_peered":"2024-04-26T21:58:42.679439+0000","last_clean":"2024-04-26T21:58:42.679439+0000","last_became_active":"2024-04-26T21:58:41.279430+0000","last_became_peered":"2024-04-26T21:58:41.279430+0000","last_unstale":"2024-04-26T21:58:42.679439+0000","last_undegraded":"2024-04-26T21:58:42.679439+0000","last_fullsized":"2024-04-26T21:58:42.679439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680388+0000","last_change":"2024-04-26T21:58:40.265856+0000","last_active":"2024-04-26T21:58:42.680388+0000","last_peered":"2024-04-26T21:58:42.680388+0000","last_clean":"2024-04-26T21:58:42.680388+0000","last_became_active":"2024-04-26T21:58:40.265592+0000","last_became_peered":"2024-04-26T21:58:40.265592+0000","last_unstale":"2024-04-26T21:58:42.680388+0000","last_undegraded":"2024-04-26T21:58:42.680388+0000","last_fullsized":"2024-04-26T21:58:42.680388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680383+0000","last_change":"2024-04-26T21:58:41.267721+0000","last_active":"2024-04-26T21:58:42.680383+0000","last_peered":"2024-04-26T21:58:42.680383+0000","last_clean":"2024-04-26T21:58:42.680383+0000","last_became_active":"2024-04-26T21:58:41.267424+0000","last_became_peered":"2024-04-26T21:58:41.267424+0000","last_unstale":"2024-04-26T21:58:42.680383+0000","last_undegraded":"2024-04-26T21:58:42.680383+0000","last_fullsized":"2024-04-26T21:58:42.680383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680053+0000","last_change":"2024-04-26T21:58:40.251924+0000","last_active":"2024-04-26T21:58:42.680053+0000","last_peered":"2024-04-26T21:58:42.680053+0000","last_clean":"2024-04-26T21:58:42.680053+0000","last_became_active":"2024-04-26T21:58:40.251596+0000","last_became_peered":"2024-04-26T21:58:40.251596+0000","last_unstale":"2024-04-26T21:58:42.680053+0000","last_undegraded":"2024-04-26T21:58:42.680053+0000","last_fullsized":"2024-04-26T21:58:42.680053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:18:55.150047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:58:49.008 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T21:58:49.008 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T21:58:49.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T21:58:49.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T21:58:49.009 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T21:58:49.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.140+0000 7fa30c11c640 1 Processor -- start 2024-04-26T21:58:49.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.141+0000 7fa30c11c640 1 -- start start 2024-04-26T21:58:49.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.141+0000 7fa30c11c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa3040b4370 0x7fa3040b6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.141+0000 7fa30c11c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa3041603b0 0x7fa3040b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.141+0000 7fa30c11c640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa30415c660 con 0x7fa3040b6860 2024-04-26T21:58:49.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.141+0000 7fa30c11c640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa3040b6cd0 con 0x7fa3040b4370 2024-04-26T21:58:49.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.141+0000 7fa30c11c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa3041609b0 con 0x7fa3041603b0 2024-04-26T21:58:49.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa309eb8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa3040b4370 0x7fa3040b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa3096b7640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa3040b6860 0x7fa30415fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41990/0 (socket says 172.21.15.137:41990) 2024-04-26T21:58:49.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa3096b7640 1 -- 172.21.15.137:0/1816814298 learned_addr learned my addr 172.21.15.137:0/1816814298 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:49.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa30a6b9640 1 --2- 172.21.15.137:0/1816814298 >> v2:172.21.15.170:3300/0 conn(0x7fa3041603b0 0x7fa3040b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa309eb8640 1 -- 172.21.15.137:0/1816814298 >> v2:172.21.15.170:3300/0 conn(0x7fa3041603b0 msgr2=0x7fa3040b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:49.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa309eb8640 1 --2- 172.21.15.137:0/1816814298 >> v2:172.21.15.170:3300/0 conn(0x7fa3041603b0 0x7fa3040b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa309eb8640 1 -- 172.21.15.137:0/1816814298 >> v1:172.21.15.137:6789/0 conn(0x7fa3040b6860 legacy=0x7fa30415fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa309eb8640 1 -- 172.21.15.137:0/1816814298 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30415c930 con 0x7fa3040b4370 2024-04-26T21:58:49.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa308eb6640 1 -- 172.21.15.137:0/1816814298 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252357314 0 0) 0x7fa30415c660 con 0x7fa3040b6860 2024-04-26T21:58:49.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.142+0000 7fa309eb8640 1 --2- 172.21.15.137:0/1816814298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b4370 0x7fa3040b6320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3040d1f20 tx=0x7fa2f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f1ea00c0adeb98 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:49.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa308eb6640 1 -- 172.21.15.137:0/1816814298 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8037070 con 0x7fa3040b4370 2024-04-26T21:58:49.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa308eb6640 1 -- 172.21.15.137:0/1816814298 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f8032440 con 0x7fa3040b4370 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa308eb6640 1 -- 172.21.15.137:0/1816814298 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8032810 con 0x7fa3040b4370 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa30c11c640 1 -- 172.21.15.137:0/1816814298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b4370 msgr2=0x7fa3040b6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa30c11c640 1 --2- 172.21.15.137:0/1816814298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b4370 0x7fa3040b6320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3040d1f20 tx=0x7fa2f802a1a0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa30c11c640 1 -- 172.21.15.137:0/1816814298 shutdown_connections 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa30c11c640 1 --2- 172.21.15.137:0/1816814298 >> v2:172.21.15.170:3300/0 conn(0x7fa3041603b0 0x7fa3040b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa30c11c640 1 --2- 172.21.15.137:0/1816814298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b4370 0x7fa3040b6320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa30c11c640 1 -- 172.21.15.137:0/1816814298 >> 172.21.15.137:0/1816814298 conn(0x7fa30406d3b0 msgr2=0x7fa30406d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa30c11c640 1 -- 172.21.15.137:0/1816814298 shutdown_connections 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.143+0000 7fa30c11c640 1 -- 172.21.15.137:0/1816814298 wait complete. 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.144+0000 7fa30c11c640 1 Processor -- start 2024-04-26T21:58:49.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.144+0000 7fa30c11c640 1 -- start start 2024-04-26T21:58:49.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa30c11c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3040b4370 0x7fa3041521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa30c11c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b6860 0x7fa3041576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa30c11c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3041603b0 0x7fa3040c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa30c11c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3040b4750 con 0x7fa3040b6860 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa30c11c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa30415cef0 con 0x7fa3040b4370 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa30c11c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa3040b48d0 con 0x7fa3041603b0 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa3096b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b6860 0x7fa3041576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa3096b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b6860 0x7fa3041576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60704/0 (socket says 172.21.15.137:60704) 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa3096b7640 1 -- 172.21.15.137:0/3167970410 learned_addr learned my addr 172.21.15.137:0/3167970410 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa30a6b9640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3041603b0 0x7fa3040c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa309eb8640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3040b4370 0x7fa3041521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa3096b7640 1 -- 172.21.15.137:0/3167970410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3041603b0 msgr2=0x7fa3040c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa3096b7640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3041603b0 0x7fa3040c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa3096b7640 1 -- 172.21.15.137:0/3167970410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3040b4370 msgr2=0x7fa3041521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa3096b7640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3040b4370 0x7fa3041521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.145+0000 7fa3096b7640 1 -- 172.21.15.137:0/3167970410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa304158190 con 0x7fa3040b6860 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.146+0000 7fa3096b7640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b6860 0x7fa3041576f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c4a0 tx=0x7fa30000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.146+0000 7fa2f67fc640 1 -- 172.21.15.137:0/3167970410 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300018070 con 0x7fa3040b6860 2024-04-26T21:58:49.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.146+0000 7fa2f67fc640 1 -- 172.21.15.137:0/3167970410 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3000074e0 con 0x7fa3040b6860 2024-04-26T21:58:49.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.146+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa304158470 con 0x7fa3040b6860 2024-04-26T21:58:49.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.146+0000 7fa2f67fc640 1 -- 172.21.15.137:0/3167970410 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300004a20 con 0x7fa3040b6860 2024-04-26T21:58:49.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.146+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa304158a30 con 0x7fa3040b6860 2024-04-26T21:58:49.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.147+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3040693d0 con 0x7fa3040b6860 2024-04-26T21:58:49.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.147+0000 7fa2f67fc640 1 -- 172.21.15.137:0/3167970410 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa30001b070 con 0x7fa3040b6860 2024-04-26T21:58:49.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.148+0000 7fa2f67fc640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2e806c8f0 0x7fa2e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.148+0000 7fa2f67fc640 1 -- 172.21.15.137:0/3167970410 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa30008ae20 con 0x7fa3040b6860 2024-04-26T21:58:49.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.148+0000 7fa309eb8640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2e806c8f0 0x7fa2e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.148+0000 7fa309eb8640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2e806c8f0 0x7fa2e806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8034000 tx=0x7fa2f802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:49.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.152+0000 7fa2f67fc640 1 -- 172.21.15.137:0/3167970410 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa3000592e0 con 0x7fa3040b6860 2024-04-26T21:58:49.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.378+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa3040c71b0 con 0x7fa3040b6860 2024-04-26T21:58:49.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.381+0000 7fa2f67fc640 1 -- 172.21.15.137:0/3167970410 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174143 (secure 0 0 0) 0x7fa300058be0 con 0x7fa3040b6860 2024-04-26T21:58:49.383 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:49.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.383+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2e806c8f0 msgr2=0x7fa2e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.383+0000 7fa30c11c640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2e806c8f0 0x7fa2e806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8034000 tx=0x7fa2f802e000 comp rx=0 tx=0).stop 2024-04-26T21:58:49.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.383+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b6860 msgr2=0x7fa3041576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.383+0000 7fa30c11c640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b6860 0x7fa3041576f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c4a0 tx=0x7fa30000c960 comp rx=0 tx=0).stop 2024-04-26T21:58:49.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.383+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 shutdown_connections 2024-04-26T21:58:49.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.383+0000 7fa30c11c640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2e806c8f0 0x7fa2e806edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.383+0000 7fa30c11c640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3040b6860 0x7fa3041576f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.383+0000 7fa30c11c640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3041603b0 0x7fa3040c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.383+0000 7fa30c11c640 1 --2- 172.21.15.137:0/3167970410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3040b4370 0x7fa3041521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.384+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 >> 172.21.15.137:0/3167970410 conn(0x7fa30406d3b0 msgr2=0x7fa3040b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:49.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.384+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 shutdown_connections 2024-04-26T21:58:49.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.384+0000 7fa30c11c640 1 -- 172.21.15.137:0/3167970410 wait complete. 2024-04-26T21:58:49.394 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6832","nonce":3099367580},{"type":"v1","addr":"172.21.15.137:6833","nonce":3099367580}]},"active_addr":"172.21.15.137:6833/3099367580","active_change":"2024-04-26T21:58:20.686222+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1709397437}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":429571903}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":1108172021}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.137:0","nonce":4218273875}]}]} 2024-04-26T21:58:49.397 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T21:58:49.397 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T21:58:49.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.494+0000 7f75566cc640 1 Processor -- start 2024-04-26T21:58:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.494+0000 7f75566cc640 1 -- start start 2024-04-26T21:58:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f75566cc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 0x7f7550073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f75566cc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7550161850 0x7f75500740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f75566cc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f755015d6b0 0x7f755015db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f75566cc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f755015e5c0 con 0x7f7550161850 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f75566cc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f75501613c0 con 0x7f755015d6b0 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f75566cc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f755015e080 con 0x7f7550146980 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7550161850 0x7f75500740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7550161850 0x7f75500740f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60718/0 (socket says 172.21.15.137:60718) 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754f7fe640 1 -- 172.21.15.137:0/993445492 learned_addr learned my addr 172.21.15.137:0/993445492 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754ffff640 1 --2- 172.21.15.137:0/993445492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 0x7f7550073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f7554c69640 1 --2- 172.21.15.137:0/993445492 >> v2:172.21.15.170:3300/0 conn(0x7f755015d6b0 0x7f755015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754f7fe640 1 -- 172.21.15.137:0/993445492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 msgr2=0x7f7550073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754f7fe640 1 --2- 172.21.15.137:0/993445492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 0x7f7550073bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754f7fe640 1 -- 172.21.15.137:0/993445492 >> v2:172.21.15.170:3300/0 conn(0x7f755015d6b0 msgr2=0x7f755015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754f7fe640 1 --2- 172.21.15.137:0/993445492 >> v2:172.21.15.170:3300/0 conn(0x7f755015d6b0 0x7f755015db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754f7fe640 1 -- 172.21.15.137:0/993445492 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755015e2e0 con 0x7f7550161850 2024-04-26T21:58:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.495+0000 7f754ffff640 1 --2- 172.21.15.137:0/993445492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 0x7f7550073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.496+0000 7f754f7fe640 1 --2- 172.21.15.137:0/993445492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 0x7f75500740f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7550072130 tx=0x7f754402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f813956abb22c288 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.496+0000 7f754effd640 1 -- 172.21.15.137:0/993445492 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544037070 con 0x7f7550161850 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.496+0000 7f754effd640 1 -- 172.21.15.137:0/993445492 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7544032440 con 0x7f7550161850 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.496+0000 7f754effd640 1 -- 172.21.15.137:0/993445492 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544032810 con 0x7f7550161850 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.496+0000 7f75566cc640 1 -- 172.21.15.137:0/993445492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 msgr2=0x7f75500740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.496+0000 7f75566cc640 1 --2- 172.21.15.137:0/993445492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 0x7f75500740f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7550072130 tx=0x7f754402a1e0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.497+0000 7f75566cc640 1 -- 172.21.15.137:0/993445492 shutdown_connections 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.497+0000 7f75566cc640 1 --2- 172.21.15.137:0/993445492 >> v2:172.21.15.170:3300/0 conn(0x7f755015d6b0 0x7f755015db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.497+0000 7f75566cc640 1 --2- 172.21.15.137:0/993445492 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 0x7f75500740f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.497+0000 7f75566cc640 1 --2- 172.21.15.137:0/993445492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 0x7f7550073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.497+0000 7f75566cc640 1 -- 172.21.15.137:0/993445492 >> 172.21.15.137:0/993445492 conn(0x7f75500ce8b0 msgr2=0x7f75500cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:49.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.497+0000 7f75566cc640 1 -- 172.21.15.137:0/993445492 shutdown_connections 2024-04-26T21:58:49.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.497+0000 7f75566cc640 1 -- 172.21.15.137:0/993445492 wait complete. 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.498+0000 7f75566cc640 1 Processor -- start 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.498+0000 7f75566cc640 1 -- start start 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f75566cc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 0x7f755015cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f75566cc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f755015d6b0 0x7f7550140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f75566cc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 0x7f7550141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f75566cc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f75500b5120 con 0x7f7550161850 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f75566cc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7550161050 con 0x7f755015d6b0 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f75566cc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7550146d60 con 0x7f7550146980 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f7554c69640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 0x7f7550141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f7554c69640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 0x7f7550141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60722/0 (socket says 172.21.15.137:60722) 2024-04-26T21:58:49.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f7554c69640 1 -- 172.21.15.137:0/3778811057 learned_addr learned my addr 172.21.15.137:0/3778811057 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f754f7fe640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f755015d6b0 0x7f7550140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f754ffff640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 0x7f755015cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f7554c69640 1 -- 172.21.15.137:0/3778811057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 msgr2=0x7f755015cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f7554c69640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 0x7f755015cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f7554c69640 1 -- 172.21.15.137:0/3778811057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f755015d6b0 msgr2=0x7f7550140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f7554c69640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f755015d6b0 0x7f7550140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f7554c69640 1 -- 172.21.15.137:0/3778811057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75501f3110 con 0x7f7550161850 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f754f7fe640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f755015d6b0 0x7f7550140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f7554c69640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 0x7f7550141070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f754800cda0 tx=0x7f754800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f754cff9640 1 -- 172.21.15.137:0/3778811057 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548003b90 con 0x7f7550161850 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f754cff9640 1 -- 172.21.15.137:0/3778811057 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7548003d30 con 0x7f7550161850 2024-04-26T21:58:49.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75500b2630 con 0x7f7550161850 2024-04-26T21:58:49.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f754cff9640 1 -- 172.21.15.137:0/3778811057 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548004240 con 0x7f7550161850 2024-04-26T21:58:49.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.499+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75500b2bf0 con 0x7f7550161850 2024-04-26T21:58:49.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.500+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f755006a290 con 0x7f7550161850 2024-04-26T21:58:49.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.501+0000 7f754cff9640 1 -- 172.21.15.137:0/3778811057 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75480043e0 con 0x7f7550161850 2024-04-26T21:58:49.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.501+0000 7f754cff9640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f753c06c8f0 0x7f753c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.501+0000 7f754ffff640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f753c06c8f0 0x7f753c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.501+0000 7f754cff9640 1 -- 172.21.15.137:0/3778811057 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f754808c650 con 0x7f7550161850 2024-04-26T21:58:49.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.502+0000 7f754ffff640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f753c06c8f0 0x7f753c06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75500b3650 tx=0x7f7540008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:49.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.506+0000 7f754cff9640 1 -- 172.21.15.137:0/3778811057 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f754801d340 con 0x7f7550161850 2024-04-26T21:58:49.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.686+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7550073760 con 0x7f7550161850 2024-04-26T21:58:49.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.687+0000 7f754cff9640 1 -- 172.21.15.137:0/3778811057 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f754805aa80 con 0x7f7550161850 2024-04-26T21:58:49.687 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:49.688 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:49.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f753c06c8f0 msgr2=0x7f753c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f753c06c8f0 0x7f753c06edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75500b3650 tx=0x7f7540008040 comp rx=0 tx=0).stop 2024-04-26T21:58:49.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 msgr2=0x7f7550141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 0x7f7550141070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f754800cda0 tx=0x7f754800a660 comp rx=0 tx=0).stop 2024-04-26T21:58:49.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 shutdown_connections 2024-04-26T21:58:49.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f753c06c8f0 0x7f753c06edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7550161850 0x7f7550141070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f755015d6b0 0x7f7550140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 --2- 172.21.15.137:0/3778811057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7550146980 0x7f755015cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 >> 172.21.15.137:0/3778811057 conn(0x7f75500ce8b0 msgr2=0x7f755015e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:49.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 shutdown_connections 2024-04-26T21:58:49.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.689+0000 7f75566cc640 1 -- 172.21.15.137:0/3778811057 wait complete. 2024-04-26T21:58:49.700 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T21:58:49.700 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:49.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.796+0000 7f0b5efc1640 1 Processor -- start 2024-04-26T21:58:49.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.796+0000 7f0b5efc1640 1 -- start start 2024-04-26T21:58:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b5efc1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b5806e490 0x7f0b5815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b5efc1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b580d1740 con 0x7f0b580cf2e0 2024-04-26T21:58:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b5efc1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b580d1a20 con 0x7f0b580d11b0 2024-04-26T21:58:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b5efc1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b580d1d00 con 0x7f0b5806e490 2024-04-26T21:58:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b5cd5d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0b580cf2e0 0x7f0b5806d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41994/0 (socket says 172.21.15.137:41994) 2024-04-26T21:58:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b5cd5d640 1 -- 172.21.15.137:0/2279224443 learned_addr learned my addr 172.21.15.137:0/2279224443 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b5d55e640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b5806e490 0x7f0b5815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4255714732 0 0) 0x7f0b580d1740 con 0x7f0b580cf2e0 2024-04-26T21:58:49.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b40003520 con 0x7f0b580cf2e0 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 690584726 0 0) 0x7f0b40003520 con 0x7f0b580cf2e0 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b5806e490 msgr2=0x7f0b5815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b577fe640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b5806e490 0x7f0b5815ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.797+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 >> v1:172.21.15.170:6789/0 conn(0x7f0b580d11b0 legacy=0x7f0b5806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b580d1fe0 con 0x7f0b580cf2e0 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f0b48001670 con 0x7f0b580cf2e0 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 >> v1:172.21.15.137:6789/0 conn(0x7f0b580cf2e0 legacy=0x7f0b5806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b577fe640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b5806e490 0x7f0b400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b577fe640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b40003f20 0x7f0b40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b577fe640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b40004d40 0x7f0b400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b580d1d00 con 0x7f0b40004d40 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4000ba20 con 0x7f0b40003f20 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4000bc20 con 0x7f0b5806e490 2024-04-26T21:58:49.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b5d55e640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b40004d40 0x7f0b400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b5cd5d640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b5806e490 0x7f0b400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b57fff640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b40003f20 0x7f0b40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b5d55e640 1 -- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b5806e490 msgr2=0x7f0b400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b5d55e640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b5806e490 0x7f0b400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b5d55e640 1 -- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b40003f20 msgr2=0x7f0b40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b5d55e640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b40003f20 0x7f0b40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b5d55e640 1 -- 172.21.15.137:0/2279224443 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b40003520 con 0x7f0b40004d40 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.798+0000 7f0b57fff640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b40003f20 0x7f0b40004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b5d55e640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b40004d40 0x7f0b400051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b5806e8a0 tx=0x7f0b40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1bdd76226475e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50037070 con 0x7f0b40004d40 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b50032600 con 0x7f0b40004d40 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b577fe640 1 -- 172.21.15.137:0/2279224443 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50009c10 con 0x7f0b40004d40 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2279224443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b40004d40 msgr2=0x7f0b400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b5efc1640 1 --2- 172.21.15.137:0/2279224443 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b40004d40 0x7f0b400051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b5806e8a0 tx=0x7f0b40005830 comp rx=0 tx=0).stop 2024-04-26T21:58:49.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b5d55e640 1 -- 172.21.15.137:0/2279224443 reap_dead start 2024-04-26T21:58:49.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2279224443 shutdown_connections 2024-04-26T21:58:49.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2279224443 >> 172.21.15.137:0/2279224443 conn(0x7f0b580b4a60 msgr2=0x7f0b580b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:49.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2279224443 shutdown_connections 2024-04-26T21:58:49.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.799+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2279224443 wait complete. 2024-04-26T21:58:49.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.800+0000 7f0b5efc1640 1 Processor -- start 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.801+0000 7f0b5efc1640 1 -- start start 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.801+0000 7f0b5efc1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b58157300 0x7f0b581617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.801+0000 7f0b5efc1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b58161260 0x7f0b580cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.801+0000 7f0b5efc1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5809e9d0 0x7f0b5809ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.801+0000 7f0b5efc1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b580cf840 con 0x7f0b5809e9d0 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.801+0000 7f0b5efc1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b580cf6c0 con 0x7f0b58157300 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.801+0000 7f0b5efc1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b580ce660 con 0x7f0b58161260 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.801+0000 7f0b5d55e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5809e9d0 0x7f0b5809ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5d55e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5809e9d0 0x7f0b5809ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60738/0 (socket says 172.21.15.137:60738) 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5d55e640 1 -- 172.21.15.137:0/2831613724 learned_addr learned my addr 172.21.15.137:0/2831613724 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5cd5d640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b58157300 0x7f0b581617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b57fff640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b58161260 0x7f0b580cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5d55e640 1 -- 172.21.15.137:0/2831613724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b58161260 msgr2=0x7f0b580cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5d55e640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b58161260 0x7f0b580cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5d55e640 1 -- 172.21.15.137:0/2831613724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b58157300 msgr2=0x7f0b581617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5d55e640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b58157300 0x7f0b581617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5d55e640 1 -- 172.21.15.137:0/2831613724 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b580cd2e0 con 0x7f0b5809e9d0 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b57fff640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b58161260 0x7f0b580cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5d55e640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5809e9d0 0x7f0b5809ee50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b50002230 tx=0x7f0b50009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b557fa640 1 -- 172.21.15.137:0/2831613724 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50037070 con 0x7f0b5809e9d0 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b557fa640 1 -- 172.21.15.137:0/2831613724 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b50042070 con 0x7f0b5809e9d0 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b580cd5c0 con 0x7f0b5809e9d0 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b557fa640 1 -- 172.21.15.137:0/2831613724 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50009c10 con 0x7f0b5809e9d0 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.802+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b580caf40 con 0x7f0b5809e9d0 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.803+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5806a290 con 0x7f0b5809e9d0 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.803+0000 7f0b557fa640 1 -- 172.21.15.137:0/2831613724 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b50031aa0 con 0x7f0b5809e9d0 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.804+0000 7f0b557fa640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b4406c920 0x7f0b4406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:49.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.804+0000 7f0b5cd5d640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b4406c920 0x7f0b4406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.804+0000 7f0b557fa640 1 -- 172.21.15.137:0/2831613724 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b500ac380 con 0x7f0b5809e9d0 2024-04-26T21:58:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.804+0000 7f0b5cd5d640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b4406c920 0x7f0b4406ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b48000c00 tx=0x7f0b48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:49.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.808+0000 7f0b557fa640 1 -- 172.21.15.137:0/2831613724 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0b5007a720 con 0x7f0b5809e9d0 2024-04-26T21:58:49.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.987+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b580b8ef0 con 0x7f0b5809e9d0 2024-04-26T21:58:49.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.988+0000 7f0b557fa640 1 -- 172.21.15.137:0/2831613724 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f0b5007a020 con 0x7f0b5809e9d0 2024-04-26T21:58:49.988 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:49.988 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b4406c920 msgr2=0x7f0b4406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b4406c920 0x7f0b4406ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b48000c00 tx=0x7f0b48009040 comp rx=0 tx=0).stop 2024-04-26T21:58:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5809e9d0 msgr2=0x7f0b5809ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5809e9d0 0x7f0b5809ee50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b50002230 tx=0x7f0b50009750 comp rx=0 tx=0).stop 2024-04-26T21:58:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 shutdown_connections 2024-04-26T21:58:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b4406c920 0x7f0b4406ede0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b5809e9d0 0x7f0b5809ee50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b58161260 0x7f0b580cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 --2- 172.21.15.137:0/2831613724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b58157300 0x7f0b581617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:49.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 >> 172.21.15.137:0/2831613724 conn(0x7f0b580b4a60 msgr2=0x7f0b580c76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:49.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 shutdown_connections 2024-04-26T21:58:49.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:49.990+0000 7f0b5efc1640 1 -- 172.21.15.137:0/2831613724 wait complete. 2024-04-26T21:58:50.002 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T21:58:50.002 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T21:58:50.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T21:58:50.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T21:58:50.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T21:58:50.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T21:58:50.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T21:58:50.005 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T21:58:50.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.168+0000 7f7692d34640 1 Processor -- start 2024-04-26T21:58:50.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.168+0000 7f7692d34640 1 -- start start 2024-04-26T21:58:50.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.169+0000 7f7692d34640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c1520d0 0x7f768c0ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.169+0000 7f7692d34640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f768c15f490 0x7f768c0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.169+0000 7f7692d34640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f768c0b4ed0 con 0x7f768c0b5f70 2024-04-26T21:58:50.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.169+0000 7f7692d34640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f768c0b51b0 con 0x7f768c15f490 2024-04-26T21:58:50.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.169+0000 7f7692d34640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f768c0b5490 con 0x7f768c1520d0 2024-04-26T21:58:50.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.170+0000 7f7692533640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f768c15f490 0x7f768c0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.170+0000 7f7692533640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f768c15f490 0x7f768c0aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54238/0 (socket says 172.21.15.137:54238) 2024-04-26T21:58:50.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.170+0000 7f7692533640 1 -- 172.21.15.137:0/3132643444 learned_addr learned my addr 172.21.15.137:0/3132643444 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.170+0000 7f7691d32640 1 --2- 172.21.15.137:0/3132643444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c1520d0 0x7f768c0ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.171+0000 7f7690d30640 1 -- 172.21.15.137:0/3132643444 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289725407 0 0) 0x7f768c0b4ed0 con 0x7f768c0b5f70 2024-04-26T21:58:50.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.171+0000 7ffa5546d640 1 Processor -- start 2024-04-26T21:58:50.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.171+0000 7f7690d30640 1 -- 172.21.15.137:0/3132643444 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7678003520 con 0x7f768c0b5f70 2024-04-26T21:58:50.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.171+0000 7f7691d32640 1 -- 172.21.15.137:0/3132643444 >> v2:172.21.15.170:3300/0 conn(0x7f768c15f490 msgr2=0x7f768c0aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.171+0000 7f7691d32640 1 --2- 172.21.15.137:0/3132643444 >> v2:172.21.15.170:3300/0 conn(0x7f768c15f490 0x7f768c0aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.171+0000 7f7691d32640 1 -- 172.21.15.137:0/3132643444 >> v1:172.21.15.170:6789/0 conn(0x7f768c0b5f70 legacy=0x7f768c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.171+0000 7f7691d32640 1 -- 172.21.15.137:0/3132643444 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768c0b5770 con 0x7f768c1520d0 2024-04-26T21:58:50.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.171+0000 7f7692533640 1 --2- 172.21.15.137:0/3132643444 >> v2:172.21.15.170:3300/0 conn(0x7f768c15f490 0x7f768c0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:50.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.172+0000 7ffa5546d640 1 -- start start 2024-04-26T21:58:50.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.172+0000 7f8e28edc640 1 Processor -- start 2024-04-26T21:58:50.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.172+0000 7f8e28edc640 1 -- start start 2024-04-26T21:58:50.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.172+0000 7fc87521d640 1 Processor -- start 2024-04-26T21:58:50.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7fc87521d640 1 -- start start 2024-04-26T21:58:50.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.172+0000 7f7691d32640 1 --2- 172.21.15.137:0/3132643444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c1520d0 0x7f768c0ae940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f768400bfa0 tx=0x7f768402a690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2afe01b2684b847f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7f7690d30640 1 -- 172.21.15.137:0/3132643444 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7684036070 con 0x7f768c1520d0 2024-04-26T21:58:50.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7f7690d30640 1 -- 172.21.15.137:0/3132643444 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7684009540 con 0x7f768c1520d0 2024-04-26T21:58:50.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7f7690d30640 1 -- 172.21.15.137:0/3132643444 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7684009910 con 0x7f768c1520d0 2024-04-26T21:58:50.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7ffa5546d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffa50163860 0x7ffa50163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7ffa5546d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffa500b46a0 0x7ffa500b8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7ffa5546d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa501682f0 con 0x7ffa500b8eb0 2024-04-26T21:58:50.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7ffa5546d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ffa501680a0 con 0x7ffa50163860 2024-04-26T21:58:50.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7ffa5546d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ffa501685d0 con 0x7ffa500b46a0 2024-04-26T21:58:50.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7f5ef5883640 1 Processor -- start 2024-04-26T21:58:50.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7ffa467fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffa500b46a0 0x7ffa500b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7ffa467fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffa500b46a0 0x7ffa500b8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54246/0 (socket says 172.21.15.137:54246) 2024-04-26T21:58:50.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f5ef5883640 1 -- start start 2024-04-26T21:58:50.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7f8e28edc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8e24166e80 0x7f8e240d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.173+0000 7f8e28edc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8e240d0220 0x7f8e240b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e28edc640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e240d06c0 con 0x7f8e240cfd70 2024-04-26T21:58:50.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7ffa467fc640 1 -- 172.21.15.137:0/177348444 learned_addr learned my addr 172.21.15.137:0/177348444 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e28edc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8e240d09a0 con 0x7f8e240d0220 2024-04-26T21:58:50.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e28edc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8e240d0c80 con 0x7f8e24166e80 2024-04-26T21:58:50.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e2259c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8e24166e80 0x7f8e240d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e2259c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8e24166e80 0x7f8e240d3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54256/0 (socket says 172.21.15.137:54256) 2024-04-26T21:58:50.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e2259c640 1 -- 172.21.15.137:0/1210755966 learned_addr learned my addr 172.21.15.137:0/1210755966 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7ffa467fc640 1 -- 172.21.15.137:0/177348444 >> v2:172.21.15.137:3300/0 conn(0x7ffa50163860 msgr2=0x7ffa50163c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7ffa467fc640 1 --2- 172.21.15.137:0/177348444 >> v2:172.21.15.137:3300/0 conn(0x7ffa50163860 0x7ffa50163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7ffa467fc640 1 -- 172.21.15.137:0/177348444 >> v1:172.21.15.137:6789/0 conn(0x7ffa500b8eb0 legacy=0x7ffa500b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7fc87521d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc87015f750 0x7fc8700b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7ffa467fc640 1 -- 172.21.15.137:0/177348444 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa500b8170 con 0x7ffa500b46a0 2024-04-26T21:58:50.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7fc87521d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8700d3320 0x7fc8700d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f239d678640 1 Processor -- start 2024-04-26T21:58:50.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7fc87521d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8700d4060 con 0x7fc8700d51a0 2024-04-26T21:58:50.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7fc86f59e640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc8700d51a0 0x7fc8700d04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56362/0 (socket says 172.21.15.137:56362) 2024-04-26T21:58:50.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7fc86f59e640 1 -- 172.21.15.137:0/3150887602 learned_addr learned my addr 172.21.15.137:0/3150887602 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:50.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f7692d34640 1 -- 172.21.15.137:0/3132643444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c1520d0 msgr2=0x7f768c0ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f7692d34640 1 --2- 172.21.15.137:0/3132643444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c1520d0 0x7f768c0ae940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f768400bfa0 tx=0x7f768402a690 comp rx=0 tx=0).stop 2024-04-26T21:58:50.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f7692d34640 1 -- 172.21.15.137:0/3132643444 shutdown_connections 2024-04-26T21:58:50.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f7692d34640 1 --2- 172.21.15.137:0/3132643444 >> v2:172.21.15.170:3300/0 conn(0x7f768c15f490 0x7f768c0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f7692d34640 1 --2- 172.21.15.137:0/3132643444 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c1520d0 0x7f768c0ae940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f7692d34640 1 -- 172.21.15.137:0/3132643444 >> 172.21.15.137:0/3132643444 conn(0x7f768c0b2990 msgr2=0x7f768c0b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7fc86e59c640 1 --2- 172.21.15.137:0/3150887602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8700d3320 0x7fc8700d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7fc86ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc87015f750 0x7fc8700b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f5ef5883640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5ef00d17f0 0x7f5ef00add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fc86dd9b640 1 -- 172.21.15.137:0/3150887602 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1741140901 0 0) 0x7fc8700d4060 con 0x7fc8700d51a0 2024-04-26T21:58:50.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fc87521d640 1 -- 172.21.15.137:0/3150887602 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc8700d0030 con 0x7fc87015f750 2024-04-26T21:58:50.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fc87521d640 1 -- 172.21.15.137:0/3150887602 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8700d2440 con 0x7fc8700d3320 2024-04-26T21:58:50.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f5ef5883640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef01639b0 con 0x7f5ef0070080 2024-04-26T21:58:50.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e22d9d640 1 --2- 172.21.15.137:0/1210755966 >> v2:172.21.15.137:3300/0 conn(0x7f8e240d0220 0x7f8e240b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e2259c640 1 -- 172.21.15.137:0/1210755966 >> v2:172.21.15.137:3300/0 conn(0x7f8e240d0220 msgr2=0x7f8e240b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e2259c640 1 --2- 172.21.15.137:0/1210755966 >> v2:172.21.15.137:3300/0 conn(0x7f8e240d0220 0x7f8e240b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e2259c640 1 -- 172.21.15.137:0/1210755966 >> v1:172.21.15.137:6789/0 conn(0x7f8e240cfd70 legacy=0x7f8e240d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f8e2259c640 1 -- 172.21.15.137:0/1210755966 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240d0f60 con 0x7f8e24166e80 2024-04-26T21:58:50.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f5ef5883640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef0073900 con 0x7f5ef01635d0 2024-04-26T21:58:50.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f5ef5883640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5ef00724c0 con 0x7f5ef00d17f0 2024-04-26T21:58:50.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f5eee7fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5ef0070080 0x7f5ef00d10e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42028/0 (socket says 172.21.15.137:42028) 2024-04-26T21:58:50.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fc86dd9b640 1 -- 172.21.15.137:0/3150887602 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc858003520 con 0x7fc8700d51a0 2024-04-26T21:58:50.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f5eee7fc640 1 -- 172.21.15.137:0/3836381319 learned_addr learned my addr 172.21.15.137:0/3836381319 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:50.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f5eef7fe640 1 --2- 172.21.15.137:0/3836381319 >> v2:172.21.15.137:3300/0 conn(0x7f5ef00d17f0 0x7f5ef00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7ffa467fc640 1 --2- 172.21.15.137:0/177348444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 0x7ffa500b8970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffa5009e8f0 tx=0x7ffa4002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e4f0b02559f8c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.174+0000 7f239d678640 1 -- start start 2024-04-26T21:58:50.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fe4b4625640 1 Processor -- start 2024-04-26T21:58:50.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f5eedffb640 1 -- 172.21.15.137:0/3836381319 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932436815 0 0) 0x7f5ef01639b0 con 0x7f5ef0070080 2024-04-26T21:58:50.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f8e2259c640 1 --2- 172.21.15.137:0/1210755966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e24166e80 0x7f8e240d3ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e240d2d10 tx=0x7f8e1402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ef8cc58647d0e90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f8e2159a640 1 -- 172.21.15.137:0/1210755966 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14037070 con 0x7f8e24166e80 2024-04-26T21:58:50.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f8e2159a640 1 -- 172.21.15.137:0/1210755966 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e14032440 con 0x7f8e24166e80 2024-04-26T21:58:50.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f8e2159a640 1 -- 172.21.15.137:0/1210755966 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14032810 con 0x7f8e24166e80 2024-04-26T21:58:50.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7ffa4e7fc640 1 -- 172.21.15.137:0/177348444 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40037070 con 0x7ffa500b46a0 2024-04-26T21:58:50.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7ffa4e7fc640 1 -- 172.21.15.137:0/177348444 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4002ae20 con 0x7ffa500b46a0 2024-04-26T21:58:50.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7ffa4e7fc640 1 -- 172.21.15.137:0/177348444 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40032660 con 0x7ffa500b46a0 2024-04-26T21:58:50.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fc86e59c640 1 -- 172.21.15.137:0/3150887602 >> v2:172.21.15.137:3300/0 conn(0x7fc87015f750 msgr2=0x7fc8700b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fc86e59c640 1 --2- 172.21.15.137:0/3150887602 >> v2:172.21.15.137:3300/0 conn(0x7fc87015f750 0x7fc8700b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fc86e59c640 1 -- 172.21.15.137:0/3150887602 >> v1:172.21.15.170:6789/0 conn(0x7fc8700d51a0 legacy=0x7fc8700d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fc86e59c640 1 -- 172.21.15.137:0/3150887602 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8700d2720 con 0x7fc8700d3320 2024-04-26T21:58:50.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f5eedffb640 1 -- 172.21.15.137:0/3836381319 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ed8003520 con 0x7f5ef0070080 2024-04-26T21:58:50.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f5eef7fe640 1 -- 172.21.15.137:0/3836381319 >> v1:172.21.15.170:6789/0 conn(0x7f5ef01635d0 legacy=0x7f5ef00731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f5eef7fe640 1 -- 172.21.15.137:0/3836381319 >> v1:172.21.15.137:6789/0 conn(0x7f5ef0070080 legacy=0x7f5ef00d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f5eef7fe640 1 -- 172.21.15.137:0/3836381319 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef00b5d70 con 0x7f5ef00d17f0 2024-04-26T21:58:50.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f7692d34640 1 -- 172.21.15.137:0/3132643444 shutdown_connections 2024-04-26T21:58:50.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7f7692d34640 1 -- 172.21.15.137:0/3132643444 wait complete. 2024-04-26T21:58:50.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.175+0000 7fe4b4625640 1 -- start start 2024-04-26T21:58:50.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f239d678640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f23900e02d0 0x7f23900e3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f239d678640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23900e4510 con 0x7f23900e4100 2024-04-26T21:58:50.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f239d678640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2390056590 con 0x7f23900dfef0 2024-04-26T21:58:50.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f239d678640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f23900094b0 con 0x7f23900e02d0 2024-04-26T21:58:50.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f2397fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f23900dfef0 0x7f23900085d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56380/0 (socket says 172.21.15.137:56380) 2024-04-26T21:58:50.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f2397fff640 1 -- 172.21.15.137:0/3817375047 learned_addr learned my addr 172.21.15.137:0/3817375047 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:50.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f23977fe640 1 --2- 172.21.15.137:0/3817375047 >> v2:172.21.15.137:3300/0 conn(0x7f23900e02d0 0x7f23900e3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f2396ffd640 1 -- 172.21.15.137:0/3817375047 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657254413 0 0) 0x7f2390056590 con 0x7f23900dfef0 2024-04-26T21:58:50.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.176+0000 7f2396ffd640 1 -- 172.21.15.137:0/3817375047 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2388003520 con 0x7f23900dfef0 2024-04-26T21:58:50.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f23977fe640 1 -- 172.21.15.137:0/3817375047 >> v1:172.21.15.170:6789/0 conn(0x7f23900dfef0 legacy=0x7f23900085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f2396ffd640 1 -- 172.21.15.137:0/3817375047 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2135015291 0 0) 0x7f2388003520 con 0x7f23900dfef0 2024-04-26T21:58:50.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f23977fe640 1 -- 172.21.15.137:0/3817375047 >> v1:172.21.15.137:6789/0 conn(0x7f23900e4100 legacy=0x7f2390006ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f23977fe640 1 -- 172.21.15.137:0/3817375047 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2390056870 con 0x7f23900e02d0 2024-04-26T21:58:50.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7ffa5546d640 1 -- 172.21.15.137:0/177348444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 msgr2=0x7ffa500b8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7ffa5546d640 1 --2- 172.21.15.137:0/177348444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 0x7ffa500b8970 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffa5009e8f0 tx=0x7ffa4002a110 comp rx=0 tx=0).stop 2024-04-26T21:58:50.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f8e28edc640 1 -- 172.21.15.137:0/1210755966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e24166e80 msgr2=0x7f8e240d3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f8e28edc640 1 --2- 172.21.15.137:0/1210755966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e24166e80 0x7f8e240d3ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e240d2d10 tx=0x7f8e1402a230 comp rx=0 tx=0).stop 2024-04-26T21:58:50.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7fc86e59c640 1 --2- 172.21.15.137:0/3150887602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8700d3320 0x7fc8700d3b20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc8640097a0 tx=0x7fc86402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5d4e104feb16226 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7fe4b4625640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ac0d1210 0x7fe4ac0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7fe4b4625640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe4ac0b6530 0x7fe4ac06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7ffa5546d640 1 -- 172.21.15.137:0/177348444 shutdown_connections 2024-04-26T21:58:50.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7ffa5546d640 1 --2- 172.21.15.137:0/177348444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 0x7ffa500b8970 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7ffa5546d640 1 --2- 172.21.15.137:0/177348444 >> v2:172.21.15.137:3300/0 conn(0x7ffa50163860 0x7ffa50163c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f5eef7fe640 1 --2- 172.21.15.137:0/3836381319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ef00d17f0 0x7f5ef00add70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40097a0 tx=0x7f5ee402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11b60aa3463b1ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7ffa5546d640 1 -- 172.21.15.137:0/177348444 >> 172.21.15.137:0/177348444 conn(0x7ffa500d1c90 msgr2=0x7ffa500d20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f7692d34640 1 Processor -- start 2024-04-26T21:58:50.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7fe4b4625640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac0b6b90 con 0x7fe4ac06d2b0 2024-04-26T21:58:50.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f8e28edc640 1 -- 172.21.15.137:0/1210755966 shutdown_connections 2024-04-26T21:58:50.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f8e28edc640 1 --2- 172.21.15.137:0/1210755966 >> v2:172.21.15.137:3300/0 conn(0x7f8e240d0220 0x7f8e240b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f8e28edc640 1 --2- 172.21.15.137:0/1210755966 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e24166e80 0x7f8e240d3ec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f8e28edc640 1 -- 172.21.15.137:0/1210755966 >> 172.21.15.137:0/1210755966 conn(0x7f8e2408ec10 msgr2=0x7f8e2409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7ffa5546d640 1 -- 172.21.15.137:0/177348444 shutdown_connections 2024-04-26T21:58:50.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7ffa5546d640 1 -- 172.21.15.137:0/177348444 wait complete. 2024-04-26T21:58:50.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7fe4b2bc2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe4ac0b6530 0x7fe4ac06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7fe4b1bc0640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe4ac06d2b0 0x7fe4ac0b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56384/0 (socket says 172.21.15.137:56384) 2024-04-26T21:58:50.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7fe4b1bc0640 1 -- 172.21.15.137:0/1833295731 learned_addr learned my addr 172.21.15.137:0/1833295731 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:50.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7fe4b4625640 1 -- 172.21.15.137:0/1833295731 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe4ac06dc30 con 0x7fe4ac0b6530 2024-04-26T21:58:50.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7fe4b4625640 1 -- 172.21.15.137:0/1833295731 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ac0b4790 con 0x7fe4ac0d1210 2024-04-26T21:58:50.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f6c151d5640 1 Processor -- start 2024-04-26T21:58:50.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f6c151d5640 1 -- start start 2024-04-26T21:58:50.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7fc86dd9b640 1 -- 172.21.15.137:0/3150887602 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc864037070 con 0x7fc8700d3320 2024-04-26T21:58:50.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7fc86dd9b640 1 -- 172.21.15.137:0/3150887602 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc864032440 con 0x7fc8700d3320 2024-04-26T21:58:50.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7fc86dd9b640 1 -- 172.21.15.137:0/3150887602 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc864032810 con 0x7fc8700d3320 2024-04-26T21:58:50.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7f5eedffb640 1 -- 172.21.15.137:0/3836381319 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4037070 con 0x7f5ef00d17f0 2024-04-26T21:58:50.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7f5eedffb640 1 -- 172.21.15.137:0/3836381319 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee4032440 con 0x7f5ef00d17f0 2024-04-26T21:58:50.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7f5eedffb640 1 -- 172.21.15.137:0/3836381319 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee402ae60 con 0x7f5ef00d17f0 2024-04-26T21:58:50.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7f23977fe640 1 --2- 172.21.15.137:0/3817375047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23900e02d0 0x7f23900e3bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2384009720 tx=0x7f238402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5da2ddbb6c8640 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.177+0000 7f7692d34640 1 -- start start 2024-04-26T21:58:50.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7f8e28edc640 1 -- 172.21.15.137:0/1210755966 shutdown_connections 2024-04-26T21:58:50.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7f2396ffd640 1 -- 172.21.15.137:0/3817375047 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384037070 con 0x7f23900e02d0 2024-04-26T21:58:50.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7f2396ffd640 1 -- 172.21.15.137:0/3817375047 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238402ac90 con 0x7f23900e02d0 2024-04-26T21:58:50.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7f2396ffd640 1 -- 172.21.15.137:0/3817375047 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c001670 con 0x7f23900e02d0 2024-04-26T21:58:50.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7fe4b2bc2640 1 -- 172.21.15.137:0/1833295731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ac0d1210 msgr2=0x7fe4ac0b5550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T21:58:50.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7fe4b2bc2640 1 --2- 172.21.15.137:0/1833295731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ac0d1210 0x7fe4ac0b5550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7fe4b2bc2640 1 -- 172.21.15.137:0/1833295731 >> v1:172.21.15.170:6789/0 conn(0x7fe4ac06d2b0 legacy=0x7fe4ac0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.178+0000 7fe4b2bc2640 1 -- 172.21.15.137:0/1833295731 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac0b4a70 con 0x7fe4ac0b6530 2024-04-26T21:58:50.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c151d5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6c080eb050 0x7f6c080552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7fc87521d640 1 -- 172.21.15.137:0/3150887602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8700d3320 msgr2=0x7fc8700d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f5ef5883640 1 -- 172.21.15.137:0/3836381319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ef00d17f0 msgr2=0x7f5ef00add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f5ef5883640 1 --2- 172.21.15.137:0/3836381319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ef00d17f0 0x7f5ef00add70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40097a0 tx=0x7f5ee402a110 comp rx=0 tx=0).stop 2024-04-26T21:58:50.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7fc87521d640 1 --2- 172.21.15.137:0/3150887602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8700d3320 0x7fc8700d3b20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc8640097a0 tx=0x7fc86402a180 comp rx=0 tx=0).stop 2024-04-26T21:58:50.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7692d34640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c0b5f70 0x7f768c1f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c151d5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb430 0x7f6c080eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c151d5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c080387d0 con 0x7f6c080e7a60 2024-04-26T21:58:50.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c151d5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6c08057e20 con 0x7f6c080eb050 2024-04-26T21:58:50.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c151d5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c08057990 con 0x7f6c080eb430 2024-04-26T21:58:50.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f8e28edc640 1 -- 172.21.15.137:0/1210755966 wait complete. 2024-04-26T21:58:50.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f5ef5883640 1 -- 172.21.15.137:0/3836381319 shutdown_connections 2024-04-26T21:58:50.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f5ef5883640 1 --2- 172.21.15.137:0/3836381319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ef00d17f0 0x7f5ef00add70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f5ef5883640 1 -- 172.21.15.137:0/3836381319 >> 172.21.15.137:0/3836381319 conn(0x7f5ef006c6f0 msgr2=0x7f5ef006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7692d34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f768c1520d0 0x7f768c06ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f5ef5883640 1 -- 172.21.15.137:0/3836381319 shutdown_connections 2024-04-26T21:58:50.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c0ffff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6c080eb050 0x7f6c080552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c0ffff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6c080eb050 0x7f6c080552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54272/0 (socket says 172.21.15.137:54272) 2024-04-26T21:58:50.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c0ffff640 1 -- 172.21.15.137:0/675562926 learned_addr learned my addr 172.21.15.137:0/675562926 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7fe4b2bc2640 1 --2- 172.21.15.137:0/1833295731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 0x7fe4ac06d6f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009c80 tx=0x7fe4a402b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eeb083c15286ce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f5ef5883640 1 -- 172.21.15.137:0/3836381319 wait complete. 2024-04-26T21:58:50.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7fe4b13bf640 1 -- 172.21.15.137:0/1833295731 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4007740 con 0x7fe4ac0b6530 2024-04-26T21:58:50.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f239d678640 1 -- 172.21.15.137:0/3817375047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23900e02d0 msgr2=0x7f23900e3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f239d678640 1 --2- 172.21.15.137:0/3817375047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23900e02d0 0x7f23900e3bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2384009720 tx=0x7f238402a180 comp rx=0 tx=0).stop 2024-04-26T21:58:50.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7692d34640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c15f490 0x7f768c09ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7691531640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f768c1520d0 0x7f768c06ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7691531640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f768c1520d0 0x7f768c06ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60796/0 (socket says 172.21.15.137:60796) 2024-04-26T21:58:50.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7691531640 1 -- 172.21.15.137:0/2823013044 learned_addr learned my addr 172.21.15.137:0/2823013044 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7692d34640 1 -- 172.21.15.137:0/2823013044 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f768c0b4c70 con 0x7f768c1520d0 2024-04-26T21:58:50.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7692d34640 1 -- 172.21.15.137:0/2823013044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f768c0b4af0 con 0x7f768c0b5f70 2024-04-26T21:58:50.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7692d34640 1 -- 172.21.15.137:0/2823013044 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f768c1524b0 con 0x7f768c15f490 2024-04-26T21:58:50.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f239d678640 1 -- 172.21.15.137:0/3817375047 shutdown_connections 2024-04-26T21:58:50.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f239d678640 1 --2- 172.21.15.137:0/3817375047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23900e02d0 0x7f23900e3bc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f239d678640 1 -- 172.21.15.137:0/3817375047 >> 172.21.15.137:0/3817375047 conn(0x7f239001ef40 msgr2=0x7f2390055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c0f7fe640 1 --2- 172.21.15.137:0/675562926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb430 0x7f6c080eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c0ffff640 1 -- 172.21.15.137:0/675562926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb430 msgr2=0x7f6c080eb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c0ffff640 1 --2- 172.21.15.137:0/675562926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb430 0x7f6c080eb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c0ffff640 1 -- 172.21.15.137:0/675562926 >> v1:172.21.15.170:6789/0 conn(0x7f6c080e7a60 legacy=0x7f6c080e7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f6c0ffff640 1 -- 172.21.15.137:0/675562926 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c08056d80 con 0x7f6c080eb050 2024-04-26T21:58:50.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.179+0000 7f7691d32640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c0b5f70 0x7f768c1f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7ffa5546d640 1 Processor -- start 2024-04-26T21:58:50.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7ffa5546d640 1 -- start start 2024-04-26T21:58:50.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f239d678640 1 -- 172.21.15.137:0/3817375047 shutdown_connections 2024-04-26T21:58:50.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f239d678640 1 -- 172.21.15.137:0/3817375047 wait complete. 2024-04-26T21:58:50.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f7692533640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c15f490 0x7f768c09ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7fe4b13bf640 1 -- 172.21.15.137:0/1833295731 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a40078e0 con 0x7fe4ac0b6530 2024-04-26T21:58:50.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7fe4b13bf640 1 -- 172.21.15.137:0/1833295731 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4007cb0 con 0x7fe4ac0b6530 2024-04-26T21:58:50.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f6c0ffff640 1 --2- 172.21.15.137:0/675562926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c080eb050 0x7f6c080552f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6c10050be0 tx=0x7f6c100a6fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff16661732bb6116 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f7691531640 1 -- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c15f490 msgr2=0x7f768c09ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f7691531640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c15f490 0x7f768c09ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f7691531640 1 -- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c0b5f70 msgr2=0x7f768c1f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f7691531640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f768c0b5f70 0x7f768c1f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f7691531640 1 -- 172.21.15.137:0/2823013044 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768c09e6a0 con 0x7f768c1520d0 2024-04-26T21:58:50.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f7692533640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f768c15f490 0x7f768c09ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:50.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.180+0000 7f6c0effd640 1 -- 172.21.15.137:0/675562926 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c100b4070 con 0x7f6c080eb050 2024-04-26T21:58:50.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f6c0effd640 1 -- 172.21.15.137:0/675562926 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c100a7dc0 con 0x7f6c080eb050 2024-04-26T21:58:50.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f6c0effd640 1 -- 172.21.15.137:0/675562926 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c100af640 con 0x7f6c080eb050 2024-04-26T21:58:50.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f7691531640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f768c1520d0 0x7f768c06ddc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f768800c490 tx=0x7f768800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f5ef5883640 1 Processor -- start 2024-04-26T21:58:50.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fe4b4625640 1 -- 172.21.15.137:0/1833295731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 msgr2=0x7fe4ac06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fe4b4625640 1 --2- 172.21.15.137:0/1833295731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 0x7fe4ac06d6f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009c80 tx=0x7fe4a402b680 comp rx=0 tx=0).stop 2024-04-26T21:58:50.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fc87521d640 1 -- 172.21.15.137:0/3150887602 shutdown_connections 2024-04-26T21:58:50.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fc87521d640 1 --2- 172.21.15.137:0/3150887602 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8700d3320 0x7fc8700d3b20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fc87521d640 1 --2- 172.21.15.137:0/3150887602 >> v2:172.21.15.137:3300/0 conn(0x7fc87015f750 0x7fc8700b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fc87521d640 1 -- 172.21.15.137:0/3150887602 >> 172.21.15.137:0/3150887602 conn(0x7fc87008ec20 msgr2=0x7fc87009e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f76827fc640 1 -- 172.21.15.137:0/2823013044 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880052d0 con 0x7f768c1520d0 2024-04-26T21:58:50.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fe4b4625640 1 -- 172.21.15.137:0/1833295731 shutdown_connections 2024-04-26T21:58:50.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fe4b4625640 1 --2- 172.21.15.137:0/1833295731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 0x7fe4ac06d6f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f8e28edc640 1 Processor -- start 2024-04-26T21:58:50.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fe4b4625640 1 --2- 172.21.15.137:0/1833295731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ac0d1210 0x7fe4ac0b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fe4b4625640 1 -- 172.21.15.137:0/1833295731 >> 172.21.15.137:0/1833295731 conn(0x7fe4ac072900 msgr2=0x7fe4ac072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f239d678640 1 Processor -- start 2024-04-26T21:58:50.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f7692d34640 1 -- 172.21.15.137:0/2823013044 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768c09e980 con 0x7f768c1520d0 2024-04-26T21:58:50.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f7692d34640 1 -- 172.21.15.137:0/2823013044 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768c1fd350 con 0x7f768c1520d0 2024-04-26T21:58:50.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f76827fc640 1 -- 172.21.15.137:0/2823013044 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7688005470 con 0x7f768c1520d0 2024-04-26T21:58:50.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f76827fc640 1 -- 172.21.15.137:0/2823013044 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880128f0 con 0x7f768c1520d0 2024-04-26T21:58:50.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fe4b4625640 1 -- 172.21.15.137:0/1833295731 shutdown_connections 2024-04-26T21:58:50.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7fe4b4625640 1 -- 172.21.15.137:0/1833295731 wait complete. 2024-04-26T21:58:50.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7ffa5546d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 0x7ffa501606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7ffa5546d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa500b8eb0 0x7ffa501f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f5ef5883640 1 -- start start 2024-04-26T21:58:50.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f6c151d5640 1 -- 172.21.15.137:0/675562926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c080eb050 msgr2=0x7f6c080552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f6c151d5640 1 --2- 172.21.15.137:0/675562926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c080eb050 0x7f6c080552f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6c10050be0 tx=0x7f6c100a6fb0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7ffa4effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 0x7ffa501606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7ffa4effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 0x7ffa501606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54298/0 (socket says 172.21.15.137:54298) 2024-04-26T21:58:50.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7ffa4effd640 1 -- 172.21.15.137:0/3464652593 learned_addr learned my addr 172.21.15.137:0/3464652593 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7ffa467fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa500b8eb0 0x7ffa501f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7ffa5546d640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffa50163860 0x7ffa501edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f8e28edc640 1 -- start start 2024-04-26T21:58:50.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f8e28edc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e240cfd70 0x7f8e240ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f8e28edc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e240d0220 0x7f8e24164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f8e28edc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e24166e80 0x7f8e24164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f5ef5883640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ef0070080 0x7f5ef0150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f5ef5883640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ef00d17f0 0x7f5ef00afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f6c151d5640 1 -- 172.21.15.137:0/675562926 shutdown_connections 2024-04-26T21:58:50.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f8e28edc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240d5790 con 0x7f8e240d0220 2024-04-26T21:58:50.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f8e28edc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240d5610 con 0x7f8e240cfd70 2024-04-26T21:58:50.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f8e28edc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8e240d5910 con 0x7f8e24166e80 2024-04-26T21:58:50.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f6c151d5640 1 --2- 172.21.15.137:0/675562926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb430 0x7f6c080eb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f6c151d5640 1 --2- 172.21.15.137:0/675562926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c080eb050 0x7f6c080552f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f6c151d5640 1 -- 172.21.15.137:0/675562926 >> 172.21.15.137:0/675562926 conn(0x7f6c080559d0 msgr2=0x7f6c08055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffa500b84e0 con 0x7ffa500b8eb0 2024-04-26T21:58:50.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffa500d3400 con 0x7ffa500b46a0 2024-04-26T21:58:50.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f6c151d5640 1 -- 172.21.15.137:0/675562926 shutdown_connections 2024-04-26T21:58:50.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f6c151d5640 1 -- 172.21.15.137:0/675562926 wait complete. 2024-04-26T21:58:50.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.182+0000 7f8e21d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e240d0220 0x7f8e24164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7fc87521d640 1 -- 172.21.15.137:0/3150887602 shutdown_connections 2024-04-26T21:58:50.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e22d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e24166e80 0x7f8e24164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e21d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e240d0220 0x7f8e24164650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60810/0 (socket says 172.21.15.137:60810) 2024-04-26T21:58:50.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e21d9b640 1 -- 172.21.15.137:0/2647708778 learned_addr learned my addr 172.21.15.137:0/2647708778 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f5ef5883640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ef01635d0 0x7f5ef0165990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f5ef5883640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0072cd0 con 0x7f5ef00d17f0 2024-04-26T21:58:50.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e22d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e24166e80 0x7f8e24164b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40060/0 (socket says 172.21.15.137:40060) 2024-04-26T21:58:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f5ef5883640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef00729f0 con 0x7f5ef01635d0 2024-04-26T21:58:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f5ef5883640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef00b59b0 con 0x7f5ef0070080 2024-04-26T21:58:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffa500b73a0 con 0x7ffa50163860 2024-04-26T21:58:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.181+0000 7f239d678640 1 -- start start 2024-04-26T21:58:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239d678640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23900dfef0 0x7f239004c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239d678640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23900e4100 0x7f23900ed650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239d678640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23900d6d50 0x7f23900d4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239d678640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2390056b50 con 0x7f23900d6d50 2024-04-26T21:58:50.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239d678640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2390009140 con 0x7f23900dfef0 2024-04-26T21:58:50.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239d678640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f23900e4910 con 0x7f23900e4100 2024-04-26T21:58:50.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7ffa4f7fe640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffa50163860 0x7ffa501edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f2397fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23900dfef0 0x7f239004c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239ce77640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23900d6d50 0x7f23900d4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f2397fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23900dfef0 0x7f239004c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54302/0 (socket says 172.21.15.137:54302) 2024-04-26T21:58:50.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7fc87521d640 1 -- 172.21.15.137:0/3150887602 wait complete. 2024-04-26T21:58:50.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f2397fff640 1 -- 172.21.15.137:0/34481215 learned_addr learned my addr 172.21.15.137:0/34481215 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f5eeeffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ef0070080 0x7f5ef0150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f5eeeffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ef0070080 0x7f5ef0150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40078/0 (socket says 172.21.15.137:40078) 2024-04-26T21:58:50.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f5eeeffd640 1 -- 172.21.15.137:0/2254746873 learned_addr learned my addr 172.21.15.137:0/2254746873 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7fe4b4625640 1 Processor -- start 2024-04-26T21:58:50.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f23977fe640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23900e4100 0x7f23900ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239ce77640 1 -- 172.21.15.137:0/34481215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23900e4100 msgr2=0x7f23900ed650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239ce77640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23900e4100 0x7f23900ed650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239ce77640 1 -- 172.21.15.137:0/34481215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23900dfef0 msgr2=0x7f239004c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239ce77640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23900dfef0 0x7f239004c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7fe4b4625640 1 -- start start 2024-04-26T21:58:50.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f239ce77640 1 -- 172.21.15.137:0/34481215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2390033bf0 con 0x7f23900d6d50 2024-04-26T21:58:50.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f23977fe640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23900e4100 0x7f23900ed650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:50.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7ffa4effd640 1 -- 172.21.15.137:0/3464652593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffa50163860 msgr2=0x7ffa501edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7ffa4effd640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffa50163860 0x7ffa501edf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7ffa4effd640 1 -- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa500b8eb0 msgr2=0x7ffa501f0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7ffa4effd640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa500b8eb0 0x7ffa501f0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7ffa4effd640 1 -- 172.21.15.137:0/3464652593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa500cd6c0 con 0x7ffa500b46a0 2024-04-26T21:58:50.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f5eeeffd640 1 -- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ef01635d0 msgr2=0x7f5ef0165990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:58:50.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f5eeeffd640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ef01635d0 0x7f5ef0165990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f5eeeffd640 1 -- 172.21.15.137:0/2254746873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ef00d17f0 msgr2=0x7f5ef00afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f5eeeffd640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ef00d17f0 0x7f5ef00afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f5eeeffd640 1 -- 172.21.15.137:0/2254746873 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef0151480 con 0x7f5ef0070080 2024-04-26T21:58:50.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f76827fc640 1 -- 172.21.15.137:0/2823013044 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7688012a90 con 0x7f768c1520d0 2024-04-26T21:58:50.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f239ce77640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23900d6d50 0x7f23900d4ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2398052070 tx=0x7f2398069eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7ffa467fc640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffa500b8eb0 0x7ffa501f0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:50.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f5eeeffd640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ef0070080 0x7f5ef0150f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800c760 tx=0x7f5ee800cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f2394ff9640 1 -- 172.21.15.137:0/34481215 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398072b10 con 0x7f23900d6d50 2024-04-26T21:58:50.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f2394ff9640 1 -- 172.21.15.137:0/34481215 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2398072cf0 con 0x7f23900d6d50 2024-04-26T21:58:50.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f7692d34640 1 -- 172.21.15.137:0/2823013044 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7674001030 con 0x7f768c1520d0 2024-04-26T21:58:50.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e2259c640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e240cfd70 0x7f8e240ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e21d9b640 1 -- 172.21.15.137:0/2647708778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e24166e80 msgr2=0x7f8e24164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e21d9b640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e24166e80 0x7f8e24164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e21d9b640 1 -- 172.21.15.137:0/2647708778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e240cfd70 msgr2=0x7f8e240ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e21d9b640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e240cfd70 0x7f8e240ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.183+0000 7f8e21d9b640 1 -- 172.21.15.137:0/2647708778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240cd5f0 con 0x7f8e240d0220 2024-04-26T21:58:50.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f8e21d9b640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e240d0220 0x7f8e24164650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c410 tx=0x7f8e1800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f8e12ffd640 1 -- 172.21.15.137:0/2647708778 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18017070 con 0x7f8e240d0220 2024-04-26T21:58:50.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f8e12ffd640 1 -- 172.21.15.137:0/2647708778 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e180035f0 con 0x7f8e240d0220 2024-04-26T21:58:50.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f8e12ffd640 1 -- 172.21.15.137:0/2647708778 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18003a20 con 0x7f8e240d0220 2024-04-26T21:58:50.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e240cb910 con 0x7f8e240d0220 2024-04-26T21:58:50.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e240ccb10 con 0x7f8e240d0220 2024-04-26T21:58:50.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7ffa4effd640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 0x7ffa501606f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800b410 tx=0x7ffa3800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7fe4b4625640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ac06d2b0 0x7fe4ac14d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7ffa47fff640 1 -- 172.21.15.137:0/3464652593 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38015020 con 0x7ffa500b46a0 2024-04-26T21:58:50.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7f76827fc640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f767006c9c0 0x7f767006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7ffa47fff640 1 -- 172.21.15.137:0/3464652593 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa38011850 con 0x7ffa500b46a0 2024-04-26T21:58:50.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa501ed6a0 con 0x7ffa500b46a0 2024-04-26T21:58:50.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7f76827fc640 1 -- 172.21.15.137:0/2823013044 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f768808b790 con 0x7f768c1520d0 2024-04-26T21:58:50.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7f239d678640 1 -- 172.21.15.137:0/34481215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2390033ed0 con 0x7f23900d6d50 2024-04-26T21:58:50.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7f239d678640 1 -- 172.21.15.137:0/34481215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23900d71e0 con 0x7f23900d6d50 2024-04-26T21:58:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7f2394ff9640 1 -- 172.21.15.137:0/34481215 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398074280 con 0x7f23900d6d50 2024-04-26T21:58:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7ffa47fff640 1 -- 172.21.15.137:0/3464652593 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38011c40 con 0x7ffa500b46a0 2024-04-26T21:58:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7fc87521d640 1 Processor -- start 2024-04-26T21:58:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7fc87521d640 1 -- start start 2024-04-26T21:58:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7f76827fc640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f7670074bc0 0x7f7670076fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f76827fc640 1 -- 172.21.15.137:0/2823013044 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7688004ec0 con 0x7f7670074bc0 2024-04-26T21:58:50.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f76827fc640 1 -- 172.21.15.137:0/2823013044 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7688092050 con 0x7f768c1520d0 2024-04-26T21:58:50.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa50160c30 con 0x7ffa500b46a0 2024-04-26T21:58:50.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f7691d32640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f767006c9c0 0x7f767006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f5ed7fff640 1 -- 172.21.15.137:0/2254746873 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8016020 con 0x7f5ef0070080 2024-04-26T21:58:50.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f5ed7fff640 1 -- 172.21.15.137:0/2254746873 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee8006d50 con 0x7f5ef0070080 2024-04-26T21:58:50.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f5ed7fff640 1 -- 172.21.15.137:0/2254746873 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8003bb0 con 0x7f5ef0070080 2024-04-26T21:58:50.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f7692533640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f7670074bc0 0x7f7670076fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.184+0000 7f6c151d5640 1 Processor -- start 2024-04-26T21:58:50.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f7691d32640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f767006c9c0 0x7f767006ee80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7684033000 tx=0x7f768400b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e2415fd10 con 0x7f8e240d0220 2024-04-26T21:58:50.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.185+0000 7f6c151d5640 1 -- start start 2024-04-26T21:58:50.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f6c151d5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c080e7a60 0x7f6c081804c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c151d5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb050 0x7f6c080cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c151d5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c080eb430 0x7f6c080d6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c151d5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c08057620 con 0x7f6c080e7a60 2024-04-26T21:58:50.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c151d5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6c08057340 con 0x7f6c080eb430 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c151d5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c080e1e00 con 0x7f6c080eb050 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c0f7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb050 0x7f6c080cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c0f7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb050 0x7f6c080cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40104/0 (socket says 172.21.15.137:40104) 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c0f7fe640 1 -- 172.21.15.137:0/1733440573 learned_addr learned my addr 172.21.15.137:0/1733440573 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c0f7fe640 1 -- 172.21.15.137:0/1733440573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c080eb430 msgr2=0x7f6c080d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c0f7fe640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c080eb430 0x7f6c080d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c0f7fe640 1 -- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c080e7a60 msgr2=0x7f6c081804c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c0f7fe640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c080e7a60 0x7f6c081804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f6c0f7fe640 1 -- 172.21.15.137:0/1733440573 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c08050fb0 con 0x7f6c080eb050 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa500693d0 con 0x7ffa500b46a0 2024-04-26T21:58:50.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7ffa47fff640 1 -- 172.21.15.137:0/3464652593 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa38018020 con 0x7ffa500b46a0 2024-04-26T21:58:50.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.186+0000 7f239d678640 1 -- 172.21.15.137:0/34481215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2378001030 con 0x7f23900d6d50 2024-04-26T21:58:50.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc87521d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8700d3320 0x7fc8701627d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc87521d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8700d51a0 0x7fc87015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc87521d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc87015f750 0x7fc8700ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc87521d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8700d57b0 con 0x7fc8700d51a0 2024-04-26T21:58:50.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc87521d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc8700d5630 con 0x7fc8700d3320 2024-04-26T21:58:50.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc87521d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8700d5930 con 0x7fc87015f750 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc86f59e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc87015f750 0x7fc8700ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc86f59e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc87015f750 0x7fc8700ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40120/0 (socket says 172.21.15.137:40120) 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc86f59e640 1 -- 172.21.15.137:0/3623071918 learned_addr learned my addr 172.21.15.137:0/3623071918 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fc86e59c640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8700d51a0 0x7fc87015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fc86f59e640 1 -- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8700d3320 msgr2=0x7fc8701627d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fc86f59e640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8700d3320 0x7fc8701627d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fc86f59e640 1 -- 172.21.15.137:0/3623071918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8700d51a0 msgr2=0x7fc87015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fc86f59e640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8700d51a0 0x7fc87015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fc86f59e640 1 -- 172.21.15.137:0/3623071918 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8700cc3f0 con 0x7fc87015f750 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef00b0460 con 0x7f5ef0070080 2024-04-26T21:58:50.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef00b0a20 con 0x7f5ef0070080 2024-04-26T21:58:50.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7f7692533640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f7670074bc0 0x7f7670076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fe4b4625640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 0x7fe4ac0aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fe4b4625640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ac0d1210 0x7fe4ac0cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fe4b4625640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac068090 con 0x7fe4ac06d2b0 2024-04-26T21:58:50.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fe4b4625640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac0b5030 con 0x7fe4ac0b6530 2024-04-26T21:58:50.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.187+0000 7fe4b4625640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ac068210 con 0x7fe4ac0d1210 2024-04-26T21:58:50.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b1bc0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 0x7fe4ac0aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b1bc0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 0x7fe4ac0aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54344/0 (socket says 172.21.15.137:54344) 2024-04-26T21:58:50.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b1bc0640 1 -- 172.21.15.137:0/4128664995 learned_addr learned my addr 172.21.15.137:0/4128664995 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b2bc2640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ac0d1210 0x7fe4ac0cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7ffa47fff640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffa3006c940 0x7ffa3006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b23c1640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ac06d2b0 0x7fe4ac14d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fc86f59e640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc87015f750 0x7fc8700ce770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc86800caa0 tx=0x7fc86800cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b1bc0640 1 -- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ac0d1210 msgr2=0x7fe4ac0cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b1bc0640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ac0d1210 0x7fe4ac0cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b1bc0640 1 -- 172.21.15.137:0/4128664995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ac06d2b0 msgr2=0x7fe4ac14d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b1bc0640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ac06d2b0 0x7fe4ac14d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7f8e12ffd640 1 -- 172.21.15.137:0/2647708778 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e1801a070 con 0x7f8e240d0220 2024-04-26T21:58:50.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fe4b1bc0640 1 -- 172.21.15.137:0/4128664995 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac0aae10 con 0x7fe4ac0b6530 2024-04-26T21:58:50.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7ffa47fff640 1 -- 172.21.15.137:0/3464652593 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffa3808b810 con 0x7ffa500b46a0 2024-04-26T21:58:50.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7ffa467fc640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffa3006c940 0x7ffa3006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7f6c0f7fe640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb050 0x7f6c080cc010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c7f0 tx=0x7f6bfc00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ef006a290 con 0x7f5ef0070080 2024-04-26T21:58:50.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7ffa47fff640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7ffa30074b60 0x7ffa30076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fc8577fe640 1 -- 172.21.15.137:0/3623071918 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868017070 con 0x7fc87015f750 2024-04-26T21:58:50.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7ffa47fff640 1 -- 172.21.15.137:0/3464652593 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa38007e50 con 0x7ffa30074b60 2024-04-26T21:58:50.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7ffa47fff640 1 -- 172.21.15.137:0/3464652593 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffa380902c0 con 0x7ffa500b46a0 2024-04-26T21:58:50.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7f6c0cff9640 1 -- 172.21.15.137:0/1733440573 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc015070 con 0x7f6c080eb050 2024-04-26T21:58:50.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7fc8577fe640 1 -- 172.21.15.137:0/3623071918 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86800ac00 con 0x7fc87015f750 2024-04-26T21:58:50.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.188+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c08051290 con 0x7f6c080eb050 2024-04-26T21:58:50.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f6c0cff9640 1 -- 172.21.15.137:0/1733440573 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bfc004220 con 0x7f6c080eb050 2024-04-26T21:58:50.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f6c0cff9640 1 -- 172.21.15.137:0/1733440573 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc007620 con 0x7f6c080eb050 2024-04-26T21:58:50.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c0804dae0 con 0x7f6c080eb050 2024-04-26T21:58:50.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8700cc6d0 con 0x7fc87015f750 2024-04-26T21:58:50.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f2394ff9640 1 -- 172.21.15.137:0/34481215 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2398074420 con 0x7f23900d6d50 2024-04-26T21:58:50.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f8e12ffd640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e0406c9c0 0x7f8e0406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7fe4b1bc0640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 0x7fe4ac0aa4a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800e990 tx=0x7fe4a800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7fe49effd640 1 -- 172.21.15.137:0/4128664995 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80073a0 con 0x7fe4ac0b6530 2024-04-26T21:58:50.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7fe49effd640 1 -- 172.21.15.137:0/4128664995 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8016020 con 0x7fe4ac0b6530 2024-04-26T21:58:50.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f8e12ffd640 1 -- 172.21.15.137:0/2647708778 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8e1808b7e0 con 0x7f8e240d0220 2024-04-26T21:58:50.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7fe49effd640 1 -- 172.21.15.137:0/4128664995 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a80047e0 con 0x7fe4ac0b6530 2024-04-26T21:58:50.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f8e12ffd640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f8e04074be0 0x7f8e04077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f8e2259c640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e0406c9c0 0x7f8e0406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f8e12ffd640 1 -- 172.21.15.137:0/2647708778 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e040776b0 con 0x7f8e04074be0 2024-04-26T21:58:50.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f8e12ffd640 1 -- 172.21.15.137:0/2647708778 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8e1808bbd0 con 0x7f8e240d0220 2024-04-26T21:58:50.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f2394ff9640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f238806cc20 0x7f238806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f2394ff9640 1 -- 172.21.15.137:0/34481215 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2398108c20 con 0x7f23900d6d50 2024-04-26T21:58:50.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7f76827fc640 1 -- 172.21.15.137:0/2823013044 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7688004ec0 con 0x7f7670074bc0 2024-04-26T21:58:50.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7ffa467fc640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffa3006c940 0x7ffa3006ee00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa40034000 tx=0x7ffa4002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6bf0001030 con 0x7f6c080eb050 2024-04-26T21:58:50.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ac0ab0f0 con 0x7fe4ac0b6530 2024-04-26T21:58:50.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7f2394ff9640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f2388074e40 0x7f2388077260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7f2394ff9640 1 -- 172.21.15.137:0/34481215 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2398068ef0 con 0x7f2388074e40 2024-04-26T21:58:50.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7f2394ff9640 1 -- 172.21.15.137:0/34481215 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2398108fd0 con 0x7f23900d6d50 2024-04-26T21:58:50.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.189+0000 7fc8577fe640 1 -- 172.21.15.137:0/3623071918 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868012400 con 0x7fc87015f750 2024-04-26T21:58:50.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8700ccc90 con 0x7fc87015f750 2024-04-26T21:58:50.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ac0ab6b0 con 0x7fe4ac0b6530 2024-04-26T21:58:50.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7f8e2259c640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e0406c9c0 0x7f8e0406ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e14034000 tx=0x7f8e1402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7f2397fff640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f238806cc20 0x7f238806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7f5ed7fff640 1 -- 172.21.15.137:0/2254746873 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ee800a850 con 0x7f5ef0070080 2024-04-26T21:58:50.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7f23977fe640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f2388074e40 0x7f2388077260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.190+0000 7f23977fe640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f2388074e40 0x7f2388077260 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7f5ed7fff640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5edc06c9c0 0x7f5edc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7f2397fff640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f238806cc20 0x7f238806f0e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f238c001eb0 tx=0x7f238c001750 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc87015a680 con 0x7fc87015f750 2024-04-26T21:58:50.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7f5ed7fff640 1 -- 172.21.15.137:0/2254746873 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5ee808b890 con 0x7f5ef0070080 2024-04-26T21:58:50.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7f5ed7fff640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7f5edc074be0 0x7f5edc077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7f5ed7fff640 1 -- 172.21.15.137:0/2254746873 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5edc0776b0 con 0x7f5edc074be0 2024-04-26T21:58:50.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7f5ed7fff640 1 -- 172.21.15.137:0/2254746873 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5ee808bc80 con 0x7f5ef0070080 2024-04-26T21:58:50.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7f5eee7fc640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5edc06c9c0 0x7f5edc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7f5eef7fe640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7f5edc074be0 0x7f5edc077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7f8e22d9d640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f8e04074be0 0x7f8e04077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.191+0000 7ffa4f7fe640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7ffa30074b60 0x7ffa30076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7f2394ff9640 1 -- 172.21.15.137:0/34481215 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2398068ef0 con 0x7f2388074e40 2024-04-26T21:58:50.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4ac0693d0 con 0x7fe4ac0b6530 2024-04-26T21:58:50.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7f6c0cff9640 1 -- 172.21.15.137:0/1733440573 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6bfc0079d0 con 0x7f6c080eb050 2024-04-26T21:58:50.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7f5eee7fc640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5edc06c9c0 0x7f5edc06ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00b1f40 tx=0x7f5ee0007930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7f5eef7fe640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7f5edc074be0 0x7f5edc077000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7f8e22d9d640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f8e04074be0 0x7f8e04077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7fe49effd640 1 -- 172.21.15.137:0/4128664995 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe4a8004980 con 0x7fe4ac0b6530 2024-04-26T21:58:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7f6c0cff9640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf406c9f0 0x7f6bf406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7ffa4f7fe640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7ffa30074b60 0x7ffa30076f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7fe49effd640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe490070d50 0x7fe490073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7f6c0cff9640 1 -- 172.21.15.137:0/1733440573 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6bfc08ba80 con 0x7f6c080eb050 2024-04-26T21:58:50.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.192+0000 7f6c0ffff640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf406c9f0 0x7f6bf406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7f6c0cff9640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7f6bf4074c70 0x7f6bf4077090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7f6c0cff9640 1 -- 172.21.15.137:0/1733440573 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6bfc01ce50 con 0x7f6bf4074c70 2024-04-26T21:58:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7f6c0cff9640 1 -- 172.21.15.137:0/1733440573 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6bfc08de60 con 0x7f6c080eb050 2024-04-26T21:58:50.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7fe49effd640 1 -- 172.21.15.137:0/4128664995 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe4a808b8b0 con 0x7fe4ac0b6530 2024-04-26T21:58:50.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7fe49effd640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7fe490078f70 0x7fe49007b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7fe4b23c1640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe490070d50 0x7fe490073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7fe49effd640 1 -- 172.21.15.137:0/4128664995 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe49007ba40 con 0x7fe490078f70 2024-04-26T21:58:50.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7fe49effd640 1 -- 172.21.15.137:0/4128664995 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe4a80902c0 con 0x7fe4ac0b6530 2024-04-26T21:58:50.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7fc8577fe640 1 -- 172.21.15.137:0/3623071918 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc86801a070 con 0x7fc87015f750 2024-04-26T21:58:50.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7f8e12ffd640 1 -- 172.21.15.137:0/2647708778 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e040776b0 con 0x7f8e04074be0 2024-04-26T21:58:50.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7f6c149d4640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7f6bf4074c70 0x7f6bf4077090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7f5ed7fff640 1 -- 172.21.15.137:0/2254746873 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5edc0776b0 con 0x7f5edc074be0 2024-04-26T21:58:50.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.193+0000 7f6c0ffff640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf406c9f0 0x7f6bf406eeb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c08008620 tx=0x7f6c100a9000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fc8577fe640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc85c06c9c0 0x7fc85c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fe4b2bc2640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7fe490078f70 0x7fe49007b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7ffa47fff640 1 -- 172.21.15.137:0/3464652593 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa38007e50 con 0x7ffa30074b60 2024-04-26T21:58:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fc8577fe640 1 -- 172.21.15.137:0/3623071918 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc86808bd80 con 0x7fc87015f750 2024-04-26T21:58:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fc8577fe640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7fc85c074be0 0x7fc85c077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fc86ed9d640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc85c06c9c0 0x7fc85c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fc8577fe640 1 -- 172.21.15.137:0/3623071918 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc85c0776b0 con 0x7fc85c074be0 2024-04-26T21:58:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fc8577fe640 1 -- 172.21.15.137:0/3623071918 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc86808c170 con 0x7fc87015f750 2024-04-26T21:58:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fe4b23c1640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe490070d50 0x7fe490073210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0006fd0 tx=0x7fe4a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fc86ed9d640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc85c06c9c0 0x7fc85c06ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8600099d0 tx=0x7fc860009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7f6c149d4640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7f6bf4074c70 0x7f6bf4077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.194+0000 7fe4b2bc2640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7fe490078f70 0x7fe49007b390 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.195+0000 7fc86e59c640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7fc85c074be0 0x7fc85c077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.195+0000 7f6c0cff9640 1 -- 172.21.15.137:0/1733440573 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6bfc01ce50 con 0x7f6bf4074c70 2024-04-26T21:58:50.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.195+0000 7fc86e59c640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7fc85c074be0 0x7fc85c077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.195+0000 7fe49effd640 1 -- 172.21.15.137:0/4128664995 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe49007ba40 con 0x7fe490078f70 2024-04-26T21:58:50.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.196+0000 7fc8577fe640 1 -- 172.21.15.137:0/3623071918 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc85c0776b0 con 0x7fc85c074be0 2024-04-26T21:58:50.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.220+0000 7f7692d34640 1 -- 172.21.15.137:0/2823013044 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7674002dd0 con 0x7f7670074bc0 2024-04-26T21:58:50.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.221+0000 7f76827fc640 1 -- 172.21.15.137:0/2823013044 <== osd.6 v2:172.21.15.170:6800/3855301024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7674002dd0 con 0x7f7670074bc0 2024-04-26T21:58:50.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.222+0000 7f766ffff640 1 -- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f7670074bc0 msgr2=0x7f7670076fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.222+0000 7f766ffff640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f7670074bc0 0x7f7670076fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.222+0000 7f766ffff640 1 -- 172.21.15.137:0/2823013044 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f767006c9c0 msgr2=0x7f767006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.222+0000 7f766ffff640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f767006c9c0 0x7f767006ee80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7684033000 tx=0x7f768400b000 comp rx=0 tx=0).stop 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.222+0000 7f766ffff640 1 -- 172.21.15.137:0/2823013044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f768c1520d0 msgr2=0x7f768c06ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.222+0000 7f766ffff640 1 --2- 172.21.15.137:0/2823013044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f768c1520d0 0x7f768c06ddc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f768800c490 tx=0x7f768800c950 comp rx=0 tx=0).stop 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.222+0000 7f7692533640 1 -- 172.21.15.137:0/2823013044 reap_dead start 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.223+0000 7f766ffff640 1 -- 172.21.15.137:0/2823013044 shutdown_connections 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.223+0000 7f766ffff640 1 -- 172.21.15.137:0/2823013044 >> 172.21.15.137:0/2823013044 conn(0x7f768c0b2990 msgr2=0x7f768c15bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.223+0000 7f766ffff640 1 -- 172.21.15.137:0/2823013044 shutdown_connections 2024-04-26T21:58:50.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.223+0000 7f766ffff640 1 -- 172.21.15.137:0/2823013044 wait complete. 2024-04-26T21:58:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.224+0000 7f239d678640 1 -- 172.21.15.137:0/34481215 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2378002d50 con 0x7f2388074e40 2024-04-26T21:58:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.225+0000 7f2394ff9640 1 -- 172.21.15.137:0/34481215 <== osd.3 v2:172.21.15.137:6808/492121506 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2378002d50 con 0x7f2388074e40 2024-04-26T21:58:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.225+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8e2406a290 con 0x7f8e04074be0 2024-04-26T21:58:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f23827fc640 1 -- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f2388074e40 msgr2=0x7f2388077260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f23827fc640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f2388074e40 0x7f2388077260 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f8e12ffd640 1 -- 172.21.15.137:0/2647708778 <== osd.0 v2:172.21.15.137:6820/109358669 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8e2406a290 con 0x7f8e04074be0 2024-04-26T21:58:50.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f23827fc640 1 -- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f238806cc20 msgr2=0x7f238806f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f23827fc640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f238806cc20 0x7f238806f0e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f238c001eb0 tx=0x7f238c001750 comp rx=0 tx=0).stop 2024-04-26T21:58:50.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f23827fc640 1 -- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23900d6d50 msgr2=0x7f23900d4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f23827fc640 1 --2- 172.21.15.137:0/34481215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23900d6d50 0x7f23900d4ff0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2398052070 tx=0x7f2398069eb0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ef0071fb0 con 0x7f5edc074be0 2024-04-26T21:58:50.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f239ce77640 1 -- 172.21.15.137:0/34481215 reap_dead start 2024-04-26T21:58:50.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f23827fc640 1 -- 172.21.15.137:0/34481215 shutdown_connections 2024-04-26T21:58:50.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f23827fc640 1 -- 172.21.15.137:0/34481215 >> 172.21.15.137:0/34481215 conn(0x7f239001ef40 msgr2=0x7f23900539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f8e04074be0 msgr2=0x7f8e04077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e28edc640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f8e04074be0 0x7f8e04077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.226+0000 7f23827fc640 1 -- 172.21.15.137:0/34481215 shutdown_connections 2024-04-26T21:58:50.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f23827fc640 1 -- 172.21.15.137:0/34481215 wait complete. 2024-04-26T21:58:50.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f5ed7fff640 1 -- 172.21.15.137:0/2254746873 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ef0071fb0 con 0x7f5edc074be0 2024-04-26T21:58:50.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e0406c9c0 msgr2=0x7f8e0406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e28edc640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e0406c9c0 0x7f8e0406ee80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e14034000 tx=0x7f8e1402e000 comp rx=0 tx=0).stop 2024-04-26T21:58:50.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e240d0220 msgr2=0x7f8e24164650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e28edc640 1 --2- 172.21.15.137:0/2647708778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e240d0220 0x7f8e24164650 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c410 tx=0x7f8e1800c8d0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e22d9d640 1 -- 172.21.15.137:0/2647708778 reap_dead start 2024-04-26T21:58:50.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc8700693d0 con 0x7fc85c074be0 2024-04-26T21:58:50.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 shutdown_connections 2024-04-26T21:58:50.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 >> 172.21.15.137:0/2647708778 conn(0x7f8e2408ec10 msgr2=0x7f8e240b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 shutdown_connections 2024-04-26T21:58:50.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7f5edc074be0 msgr2=0x7f5edc077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f5ef5883640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7f5edc074be0 0x7f5edc077000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f8e28edc640 1 -- 172.21.15.137:0/2647708778 wait complete. 2024-04-26T21:58:50.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5edc06c9c0 msgr2=0x7f5edc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7fc8577fe640 1 -- 172.21.15.137:0/3623071918 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc8700693d0 con 0x7fc85c074be0 2024-04-26T21:58:50.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe4ac0ce290 con 0x7fe490078f70 2024-04-26T21:58:50.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f5ef5883640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5edc06c9c0 0x7f5edc06ee80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00b1f40 tx=0x7f5ee0007930 comp rx=0 tx=0).stop 2024-04-26T21:58:50.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ef0070080 msgr2=0x7f5ef0150f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f5ef5883640 1 --2- 172.21.15.137:0/2254746873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ef0070080 0x7f5ef0150f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800c760 tx=0x7f5ee800cc20 comp rx=0 tx=0).stop 2024-04-26T21:58:50.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6bf0002dd0 con 0x7f6bf4074c70 2024-04-26T21:58:50.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.227+0000 7f5eef7fe640 1 -- 172.21.15.137:0/2254746873 reap_dead start 2024-04-26T21:58:50.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 shutdown_connections 2024-04-26T21:58:50.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 >> 172.21.15.137:0/2254746873 conn(0x7f5ef006c6f0 msgr2=0x7f5ef00ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7fc85c074be0 msgr2=0x7fc85c077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fc87521d640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7fc85c074be0 0x7fc85c077000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 shutdown_connections 2024-04-26T21:58:50.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7f5ef5883640 1 -- 172.21.15.137:0/2254746873 wait complete. 2024-04-26T21:58:50.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc85c06c9c0 msgr2=0x7fc85c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fc87521d640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc85c06c9c0 0x7fc85c06ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8600099d0 tx=0x7fc860009190 comp rx=0 tx=0).stop 2024-04-26T21:58:50.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc87015f750 msgr2=0x7fc8700ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fc87521d640 1 --2- 172.21.15.137:0/3623071918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc87015f750 0x7fc8700ce770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc86800caa0 tx=0x7fc86800cf60 comp rx=0 tx=0).stop 2024-04-26T21:58:50.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fe49effd640 1 -- 172.21.15.137:0/4128664995 <== osd.7 v2:172.21.15.170:6816/3085321649 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe4ac0ce290 con 0x7fe490078f70 2024-04-26T21:58:50.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fc86f59e640 1 -- 172.21.15.137:0/3623071918 reap_dead start 2024-04-26T21:58:50.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7f6c0cff9640 1 -- 172.21.15.137:0/1733440573 <== osd.1 v2:172.21.15.137:6800/757189714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6bf0002dd0 con 0x7f6bf4074c70 2024-04-26T21:58:50.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffa501edbc0 con 0x7ffa30074b60 2024-04-26T21:58:50.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7fe490078f70 msgr2=0x7fe49007b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b4625640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7fe490078f70 0x7fe49007b390 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7f6bf4074c70 msgr2=0x7f6bf4077090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 shutdown_connections 2024-04-26T21:58:50.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.228+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 >> 172.21.15.137:0/3623071918 conn(0x7fc87008ec20 msgr2=0x7fc8700b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe490070d50 msgr2=0x7fe490073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b4625640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe490070d50 0x7fe490073210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0006fd0 tx=0x7fe4a0008040 comp rx=0 tx=0).stop 2024-04-26T21:58:50.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7f6c151d5640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7f6bf4074c70 0x7f6bf4077090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf406c9f0 msgr2=0x7f6bf406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7f6c151d5640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf406c9f0 0x7f6bf406eeb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c08008620 tx=0x7f6c100a9000 comp rx=0 tx=0).stop 2024-04-26T21:58:50.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 shutdown_connections 2024-04-26T21:58:50.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 msgr2=0x7fe4ac0aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b4625640 1 --2- 172.21.15.137:0/4128664995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4ac0b6530 0x7fe4ac0aa4a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4a800e990 tx=0x7fe4a800ee50 comp rx=0 tx=0).stop 2024-04-26T21:58:50.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b2bc2640 1 -- 172.21.15.137:0/4128664995 reap_dead start 2024-04-26T21:58:50.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb050 msgr2=0x7f6c080cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7f6c151d5640 1 --2- 172.21.15.137:0/1733440573 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c080eb050 0x7f6c080cc010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c7f0 tx=0x7f6bfc00ccb0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 shutdown_connections 2024-04-26T21:58:50.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 >> 172.21.15.137:0/4128664995 conn(0x7fe4ac072900 msgr2=0x7fe4ac075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7f6c149d4640 1 -- 172.21.15.137:0/1733440573 reap_dead start 2024-04-26T21:58:50.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fc87521d640 1 -- 172.21.15.137:0/3623071918 wait complete. 2024-04-26T21:58:50.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 shutdown_connections 2024-04-26T21:58:50.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.229+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 shutdown_connections 2024-04-26T21:58:50.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 >> 172.21.15.137:0/1733440573 conn(0x7f6c080559d0 msgr2=0x7f6c080e9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7fe4b4625640 1 -- 172.21.15.137:0/4128664995 wait complete. 2024-04-26T21:58:50.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7ffa47fff640 1 -- 172.21.15.137:0/3464652593 <== osd.2 v2:172.21.15.137:6816/1304816807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ffa501edbc0 con 0x7ffa30074b60 2024-04-26T21:58:50.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 shutdown_connections 2024-04-26T21:58:50.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7f6c151d5640 1 -- 172.21.15.137:0/1733440573 wait complete. 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7ffa30074b60 msgr2=0x7ffa30076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7ffa5546d640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7ffa30074b60 0x7ffa30076f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffa3006c940 msgr2=0x7ffa3006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7ffa5546d640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffa3006c940 0x7ffa3006ee00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ffa40034000 tx=0x7ffa4002e000 comp rx=0 tx=0).stop 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 msgr2=0x7ffa501606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7ffa5546d640 1 --2- 172.21.15.137:0/3464652593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffa500b46a0 0x7ffa501606f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800b410 tx=0x7ffa3800b8d0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.230+0000 7ffa4f7fe640 1 -- 172.21.15.137:0/3464652593 reap_dead start 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.231+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 shutdown_connections 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.231+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 >> 172.21.15.137:0/3464652593 conn(0x7ffa500d1c90 msgr2=0x7ffa5006d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.231+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 shutdown_connections 2024-04-26T21:58:50.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.231+0000 7ffa5546d640 1 -- 172.21.15.137:0/3464652593 wait complete. 2024-04-26T21:58:50.288 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T21:58:50.289 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T21:58:50.289 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T21:58:50.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T21:58:50.290 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T21:58:50.291 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T21:58:50.291 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T21:58:50.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T21:58:50.292 INFO:teuthology.orchestra.run.smithi137.stdout:55834574856 2024-04-26T21:58:50.293 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T21:58:50.293 INFO:teuthology.orchestra.run.smithi137.stdout:55834574856 2024-04-26T21:58:50.294 INFO:teuthology.orchestra.run.smithi137.stdout:55834574856 2024-04-26T21:58:50.294 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T21:58:50.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T21:58:50.295 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T21:58:50.296 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T21:58:50.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.495+0000 7f7bd850a640 1 Processor -- start 2024-04-26T21:58:50.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.495+0000 7f7bd850a640 1 -- start start 2024-04-26T21:58:50.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.496+0000 7f0f28e66640 1 Processor -- start 2024-04-26T21:58:50.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.496+0000 7f0f28e66640 1 -- start start 2024-04-26T21:58:50.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.496+0000 7f7bd850a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7bd00c5f20 0x7f7bd0167cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.496+0000 7f7bd850a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.496+0000 7f7bd850a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd00c6840 con 0x7f7bd00cd5a0 2024-04-26T21:58:50.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.496+0000 7f7bd850a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd0070520 con 0x7f7bd00c5f20 2024-04-26T21:58:50.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.496+0000 7f7bd850a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd0070800 con 0x7f7bd00b2310 2024-04-26T21:58:50.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7fc89719d640 1 Processor -- start 2024-04-26T21:58:50.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f0f28e66640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0f1c049070 0x7f0f1c03b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f0f28e66640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c009570 con 0x7f0f1c009190 2024-04-26T21:58:50.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f0f28e66640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c035970 con 0x7f0f1c048c40 2024-04-26T21:58:50.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f0f28e66640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0f1c035c30 con 0x7f0f1c049070 2024-04-26T21:58:50.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd62a6640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7bd00c5f20 0x7f7bd0167cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd6aa7640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f7bd00cd5a0 0x7f7bd009c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56402/0 (socket says 172.21.15.137:56402) 2024-04-26T21:58:50.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd6aa7640 1 -- 172.21.15.137:0/1086267828 learned_addr learned my addr 172.21.15.137:0/1086267828 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:50.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd5aa5640 1 --2- 172.21.15.137:0/1086267828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7ff196b5f640 1 Processor -- start 2024-04-26T21:58:50.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7f0f22ffd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f0f1c048c40 0x7f0f1c03aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56408/0 (socket says 172.21.15.137:56408) 2024-04-26T21:58:50.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7f0f22ffd640 1 -- 172.21.15.137:0/3412748486 learned_addr learned my addr 172.21.15.137:0/3412748486 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:50.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd52a4640 1 -- 172.21.15.137:0/1086267828 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2767478447 0 0) 0x7f7bd00c6840 con 0x7f7bd00cd5a0 2024-04-26T21:58:50.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd52a4640 1 -- 172.21.15.137:0/1086267828 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bbc003520 con 0x7f7bd00cd5a0 2024-04-26T21:58:50.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd5aa5640 1 -- 172.21.15.137:0/1086267828 >> v2:172.21.15.170:3300/0 conn(0x7f7bd00c5f20 msgr2=0x7f7bd0167cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd5aa5640 1 --2- 172.21.15.137:0/1086267828 >> v2:172.21.15.170:3300/0 conn(0x7f7bd00c5f20 0x7f7bd0167cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd5aa5640 1 -- 172.21.15.137:0/1086267828 >> v1:172.21.15.170:6789/0 conn(0x7f7bd00cd5a0 legacy=0x7f7bd009c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.497+0000 7f7bd5aa5640 1 -- 172.21.15.137:0/1086267828 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd009bb50 con 0x7f7bd00b2310 2024-04-26T21:58:50.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7f2eb2dad640 1 Processor -- start 2024-04-26T21:58:50.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7f0f23fff640 1 --2- 172.21.15.137:0/3412748486 >> v2:172.21.15.170:3300/0 conn(0x7f0f1c049070 0x7f0f1c03b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158777776 0 0) 0x7f0f1c035970 con 0x7f0f1c048c40 2024-04-26T21:58:50.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f14003520 con 0x7f0f1c048c40 2024-04-26T21:58:50.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7fc89719d640 1 -- start start 2024-04-26T21:58:50.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2699729868 0 0) 0x7f0f14003520 con 0x7f0f1c048c40 2024-04-26T21:58:50.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 >> v2:172.21.15.170:3300/0 conn(0x7f0f1c049070 msgr2=0x7f0f1c03b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7f2eb2dad640 1 -- start start 2024-04-26T21:58:50.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 --2- 172.21.15.137:0/3412748486 >> v2:172.21.15.170:3300/0 conn(0x7f0f1c049070 0x7f0f1c03b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 >> v1:172.21.15.137:6789/0 conn(0x7f0f1c009190 legacy=0x7f0f1c052f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c035f10 con 0x7f0f1c048c40 2024-04-26T21:58:50.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 <== mon.1 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f0f2406b630 con 0x7f0f1c048c40 2024-04-26T21:58:50.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 >> v1:172.21.15.170:6789/0 conn(0x7f0f1c048c40 legacy=0x7f0f1c03aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f140039b0 0x7f0f14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.498+0000 7ff196b5f640 1 -- start start 2024-04-26T21:58:50.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140043c0 0x7f0f140048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 0x7f0f1400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c035c30 con 0x7f0f14005050 2024-04-26T21:58:50.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1400bfb0 con 0x7f0f140043c0 2024-04-26T21:58:50.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1400c1b0 con 0x7f0f140039b0 2024-04-26T21:58:50.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f23fff640 1 --2- 172.21.15.137:0/3412748486 >> v2:172.21.15.170:3300/0 conn(0x7f0f1c049070 0x7f0f1c03b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:50.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7ff196b5f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff188005e90 0x7ff1880062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f22ffd640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140043c0 0x7f0f140048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f23fff640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 0x7f0f1400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7ff196b5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff188006810 0x7ff188006ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7ff196b5f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff188053720 con 0x7ff1880ead00 2024-04-26T21:58:50.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7ff196b5f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff188054330 con 0x7ff188005e90 2024-04-26T21:58:50.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7ff196b5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff188053a00 con 0x7ff188006810 2024-04-26T21:58:50.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7ff1950fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff188006810 0x7ff188006ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7fb209a09640 1 Processor -- start 2024-04-26T21:58:50.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7fb209a09640 1 -- start start 2024-04-26T21:58:50.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7ff1950fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff188006810 0x7ff188006ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40134/0 (socket says 172.21.15.137:40134) 2024-04-26T21:58:50.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7ff1950fc640 1 -- 172.21.15.137:0/3098588072 learned_addr learned my addr 172.21.15.137:0/3098588072 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f2eb2dad640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2ea404b3c0 0x7f2ea4034020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f2eb2dad640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ea4006a50 0x7f2ea4006e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f2eb2dad640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea4054c10 con 0x7f2ea404f4d0 2024-04-26T21:58:50.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f2eb2dad640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea40062e0 con 0x7f2ea4006a50 2024-04-26T21:58:50.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f2eb2dad640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea4053a50 con 0x7f2ea404b3c0 2024-04-26T21:58:50.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f7bd5aa5640 1 --2- 172.21.15.137:0/1086267828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd00c6300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0097a0 tx=0x7f7bcc02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ae7fe845e4eb33c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.499+0000 7f0f237fe640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f140039b0 0x7f0f14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f7bd52a4640 1 -- 172.21.15.137:0/1086267828 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc037070 con 0x7f7bd00b2310 2024-04-26T21:58:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc89719d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc8880e3160 0x7fc8880e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc89719d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc88803c0a0 0x7fc888058050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7ff18ffff640 1 --2- 172.21.15.137:0/3098588072 >> v2:172.21.15.170:3300/0 conn(0x7ff188005e90 0x7ff1880062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f2eb1dab640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2ea404b3c0 0x7f2ea4034020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7ff18f7fe640 1 -- 172.21.15.137:0/3098588072 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377716477 0 0) 0x7ff188053720 con 0x7ff1880ead00 2024-04-26T21:58:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f2eb1dab640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2ea404b3c0 0x7f2ea4034020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54394/0 (socket says 172.21.15.137:54394) 2024-04-26T21:58:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc89719d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc888058590 con 0x7fc888053cb0 2024-04-26T21:58:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc89719d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc888007b70 con 0x7fc8880e3160 2024-04-26T21:58:50.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc89719d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc888058810 con 0x7fc88803c0a0 2024-04-26T21:58:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f2eb1dab640 1 -- 172.21.15.137:0/527319334 learned_addr learned my addr 172.21.15.137:0/527319334 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f2eb25ac640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ea4006a50 0x7f2ea4006e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f2eb15aa640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2ea404f4d0 0x7f2ea404f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56422/0 (socket says 172.21.15.137:56422) 2024-04-26T21:58:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc88ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc88803c0a0 0x7fc888058050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc88ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc88803c0a0 0x7fc888058050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40140/0 (socket says 172.21.15.137:40140) 2024-04-26T21:58:50.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc88ffff640 1 -- 172.21.15.137:0/306620904 learned_addr learned my addr 172.21.15.137:0/306620904 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7ff18f7fe640 1 -- 172.21.15.137:0/3098588072 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff180003520 con 0x7ff1880ead00 2024-04-26T21:58:50.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f7bd52a4640 1 -- 172.21.15.137:0/1086267828 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bcc02ae40 con 0x7f7bd00b2310 2024-04-26T21:58:50.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7ff18ffff640 1 -- 172.21.15.137:0/3098588072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff188006810 msgr2=0x7ff188006ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f0f23fff640 1 -- 172.21.15.137:0/3412748486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f140039b0 msgr2=0x7f0f14003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f0f23fff640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f140039b0 0x7f0f14003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f0f23fff640 1 -- 172.21.15.137:0/3412748486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140043c0 msgr2=0x7f0f140048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f0f23fff640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140043c0 0x7f0f140048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f0f23fff640 1 -- 172.21.15.137:0/3412748486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c035f10 con 0x7f0f14005050 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f0f22ffd640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f140043c0 0x7f0f140048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7f0f23fff640 1 -- 172.21.15.137:0/3412748486 reap_dead start 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb209a09640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb2040d5b50 0x7fb2040b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb202ffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb2040b60c0 0x7fb2040d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42054/0 (socket says 172.21.15.137:42054) 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb209a09640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2040d0980 con 0x7fb2040b60c0 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb1fa7fc640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb2040d2080 0x7fb2040b80f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56430/0 (socket says 172.21.15.137:56430) 2024-04-26T21:58:50.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb1fa7fc640 1 -- 172.21.15.137:0/272830360 learned_addr learned my addr 172.21.15.137:0/272830360 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb2037fe640 1 --2- 172.21.15.137:0/272830360 >> v2:172.21.15.170:3300/0 conn(0x7fb2040d5b50 0x7fb2040b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb209a09640 1 -- 172.21.15.137:0/272830360 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2040d0c60 con 0x7fb2040d2080 2024-04-26T21:58:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb209a09640 1 -- 172.21.15.137:0/272830360 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb2040d0720 con 0x7fb2040d5b50 2024-04-26T21:58:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb2027fc640 1 -- 172.21.15.137:0/272830360 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475752273 0 0) 0x7fb2040d0c60 con 0x7fb2040d2080 2024-04-26T21:58:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7fb2027fc640 1 -- 172.21.15.137:0/272830360 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f0003520 con 0x7fb2040d2080 2024-04-26T21:58:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7fb2037fe640 1 -- 172.21.15.137:0/272830360 >> v1:172.21.15.170:6789/0 conn(0x7fb2040d2080 legacy=0x7fb2040b80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7fb2037fe640 1 -- 172.21.15.137:0/272830360 >> v1:172.21.15.137:6789/0 conn(0x7fb2040b60c0 legacy=0x7fb2040d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc88ffff640 1 -- 172.21.15.137:0/306620904 >> v2:172.21.15.170:3300/0 conn(0x7fc8880e3160 msgr2=0x7fc8880e7780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T21:58:50.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc88ffff640 1 --2- 172.21.15.137:0/306620904 >> v2:172.21.15.170:3300/0 conn(0x7fc8880e3160 0x7fc8880e7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc88ffff640 1 -- 172.21.15.137:0/306620904 >> v1:172.21.15.137:6789/0 conn(0x7fc888053cb0 legacy=0x7fc888054120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7fc88ffff640 1 -- 172.21.15.137:0/306620904 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc888058af0 con 0x7fc88803c0a0 2024-04-26T21:58:50.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7ff18f7fe640 1 -- 172.21.15.137:0/3098588072 <== mon.1 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 759092563 0 0) 0x7ff180003520 con 0x7ff1880ead00 2024-04-26T21:58:50.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7ff18ffff640 1 --2- 172.21.15.137:0/3098588072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff188006810 0x7ff188006ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7ff18ffff640 1 -- 172.21.15.137:0/3098588072 >> v1:172.21.15.170:6789/0 conn(0x7ff1880ead00 legacy=0x7ff18804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7ff18ffff640 1 -- 172.21.15.137:0/3098588072 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff188053ce0 con 0x7ff188005e90 2024-04-26T21:58:50.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7f7bd52a4640 1 -- 172.21.15.137:0/1086267828 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc032660 con 0x7f7bd00b2310 2024-04-26T21:58:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f7bd850a640 1 -- 172.21.15.137:0/1086267828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 msgr2=0x7f7bd00c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f7bd850a640 1 --2- 172.21.15.137:0/1086267828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd00c6300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0097a0 tx=0x7f7bcc02a0f0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f2eb1dab640 1 -- 172.21.15.137:0/527319334 >> v2:172.21.15.137:3300/0 conn(0x7f2ea4006a50 msgr2=0x7f2ea4006e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f2eb1dab640 1 --2- 172.21.15.137:0/527319334 >> v2:172.21.15.137:3300/0 conn(0x7f2ea4006a50 0x7f2ea4006e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.500+0000 7f2eb1dab640 1 -- 172.21.15.137:0/527319334 >> v1:172.21.15.170:6789/0 conn(0x7f2ea404f4d0 legacy=0x7f2ea404f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7f2eb1dab640 1 -- 172.21.15.137:0/527319334 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea4053d30 con 0x7f2ea404b3c0 2024-04-26T21:58:50.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.501+0000 7f2eb25ac640 1 --2- 172.21.15.137:0/527319334 >> v2:172.21.15.137:3300/0 conn(0x7f2ea4006a50 0x7f2ea4006e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:50.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f0f23fff640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 0x7f0f1400b9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f100098a0 tx=0x7f0f14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c066ff2a526761d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7fb2037fe640 1 -- 172.21.15.137:0/272830360 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2040d0f40 con 0x7fb2040d5b50 2024-04-26T21:58:50.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f2eb1dab640 1 --2- 172.21.15.137:0/527319334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 0x7f2ea4034020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4006460 tx=0x7f2eac0a70f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f348f99eaaeb8c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7fc88ffff640 1 --2- 172.21.15.137:0/306620904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc88803c0a0 0x7fc888058050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009870 tx=0x7fc87c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bdc7e03e238d763 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7ff18ffff640 1 --2- 172.21.15.137:0/3098588072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188005e90 0x7ff1880062d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097a0 tx=0x7ff17c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=533ab0ac176071b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10037070 con 0x7f0f14005050 2024-04-26T21:58:50.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1002ab50 con 0x7f0f14005050 2024-04-26T21:58:50.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f0f227fc640 1 -- 172.21.15.137:0/3412748486 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2406a290 con 0x7f0f14005050 2024-04-26T21:58:50.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f2eb0da9640 1 -- 172.21.15.137:0/527319334 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0b4070 con 0x7f2ea404b3c0 2024-04-26T21:58:50.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f7bd850a640 1 -- 172.21.15.137:0/1086267828 shutdown_connections 2024-04-26T21:58:50.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f7bd850a640 1 --2- 172.21.15.137:0/1086267828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd00c6300 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7ff18f7fe640 1 -- 172.21.15.137:0/3098588072 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c037070 con 0x7ff188005e90 2024-04-26T21:58:50.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f2eb0da9640 1 -- 172.21.15.137:0/527319334 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eac0af440 con 0x7f2ea404b3c0 2024-04-26T21:58:50.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f2eb0da9640 1 -- 172.21.15.137:0/527319334 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0b4070 con 0x7f2ea404b3c0 2024-04-26T21:58:50.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f7bd850a640 1 --2- 172.21.15.137:0/1086267828 >> v2:172.21.15.170:3300/0 conn(0x7f7bd00c5f20 0x7f7bd0167cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f7bd850a640 1 -- 172.21.15.137:0/1086267828 >> 172.21.15.137:0/1086267828 conn(0x7f7bd00b4a40 msgr2=0x7f7bd00b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7ff18f7fe640 1 -- 172.21.15.137:0/3098588072 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17c02aba0 con 0x7ff188005e90 2024-04-26T21:58:50.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f34dd48f640 1 Processor -- start 2024-04-26T21:58:50.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.502+0000 7f34dd48f640 1 -- start start 2024-04-26T21:58:50.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f7bd850a640 1 -- 172.21.15.137:0/1086267828 shutdown_connections 2024-04-26T21:58:50.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7fc88f7fe640 1 -- 172.21.15.137:0/306620904 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c037070 con 0x7fc88803c0a0 2024-04-26T21:58:50.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f59b759e640 1 Processor -- start 2024-04-26T21:58:50.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f0f28e66640 1 -- 172.21.15.137:0/3412748486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 msgr2=0x7f0f1400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f0f28e66640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 0x7f0f1400b9c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f100098a0 tx=0x7f0f14005830 comp rx=0 tx=0).stop 2024-04-26T21:58:50.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f0f28e66640 1 -- 172.21.15.137:0/3412748486 shutdown_connections 2024-04-26T21:58:50.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f0f28e66640 1 --2- 172.21.15.137:0/3412748486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 0x7f0f1400b9c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f0f28e66640 1 -- 172.21.15.137:0/3412748486 >> 172.21.15.137:0/3412748486 conn(0x7f0f1c01ef40 msgr2=0x7f0f1c055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7fb2037fe640 1 --2- 172.21.15.137:0/272830360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040d5b50 0x7fb2040b64a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009d90 tx=0x7fb1fc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eede67c35b66d02b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7fb2027fc640 1 -- 172.21.15.137:0/272830360 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc007740 con 0x7fb2040d5b50 2024-04-26T21:58:50.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7fb2027fc640 1 -- 172.21.15.137:0/272830360 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1fc0078e0 con 0x7fb2040d5b50 2024-04-26T21:58:50.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7fb2027fc640 1 -- 172.21.15.137:0/272830360 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc007cb0 con 0x7fb2040d5b50 2024-04-26T21:58:50.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7fc88f7fe640 1 -- 172.21.15.137:0/306620904 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c032440 con 0x7fc88803c0a0 2024-04-26T21:58:50.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7fc88f7fe640 1 -- 172.21.15.137:0/306620904 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c032810 con 0x7fc88803c0a0 2024-04-26T21:58:50.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7ff196b5f640 1 -- 172.21.15.137:0/3098588072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188005e90 msgr2=0x7ff1880062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7ff196b5f640 1 --2- 172.21.15.137:0/3098588072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188005e90 0x7ff1880062d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097a0 tx=0x7ff17c02a110 comp rx=0 tx=0).stop 2024-04-26T21:58:50.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7ff196b5f640 1 -- 172.21.15.137:0/3098588072 shutdown_connections 2024-04-26T21:58:50.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7ff196b5f640 1 --2- 172.21.15.137:0/3098588072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff188006810 0x7ff188006ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7ff196b5f640 1 --2- 172.21.15.137:0/3098588072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188005e90 0x7ff1880062d0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097a0 tx=0x7ff17c02a110 comp rx=0 tx=0).stop 2024-04-26T21:58:50.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7ff196b5f640 1 -- 172.21.15.137:0/3098588072 >> 172.21.15.137:0/3098588072 conn(0x7ff188009fb0 msgr2=0x7ff18800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f34dd48f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f34d80d5bf0 0x7f34d80d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f34dd48f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d80d0ca0 con 0x7f34d815f740 2024-04-26T21:58:50.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f34dd48f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d80d0f40 con 0x7f34d80cfcd0 2024-04-26T21:58:50.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f34dd48f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f34d80b7f50 con 0x7f34d80d5bf0 2024-04-26T21:58:50.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f34d7fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f34d815f740 0x7f34d80d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42070/0 (socket says 172.21.15.137:42070) 2024-04-26T21:58:50.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f34d7fff640 1 -- 172.21.15.137:0/3062072745 learned_addr learned my addr 172.21.15.137:0/3062072745 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:50.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f34d77fe640 1 --2- 172.21.15.137:0/3062072745 >> v2:172.21.15.170:3300/0 conn(0x7f34d80d5bf0 0x7f34d80d1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f2eb2dad640 1 -- 172.21.15.137:0/527319334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 msgr2=0x7f2ea4034020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f2eb2dad640 1 --2- 172.21.15.137:0/527319334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 0x7f2ea4034020 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4006460 tx=0x7f2eac0a70f0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f2eb2dad640 1 -- 172.21.15.137:0/527319334 shutdown_connections 2024-04-26T21:58:50.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f2eb2dad640 1 --2- 172.21.15.137:0/527319334 >> v2:172.21.15.137:3300/0 conn(0x7f2ea4006a50 0x7f2ea4006e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f2eb2dad640 1 --2- 172.21.15.137:0/527319334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 0x7f2ea4034020 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f2eb2dad640 1 -- 172.21.15.137:0/527319334 >> 172.21.15.137:0/527319334 conn(0x7f2ea400a400 msgr2=0x7f2ea400a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f59b759e640 1 -- start start 2024-04-26T21:58:50.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f0f28e66640 1 -- 172.21.15.137:0/3412748486 shutdown_connections 2024-04-26T21:58:50.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7ff196b5f640 1 -- 172.21.15.137:0/3098588072 shutdown_connections 2024-04-26T21:58:50.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7ff196b5f640 1 -- 172.21.15.137:0/3098588072 wait complete. 2024-04-26T21:58:50.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f0f28e66640 1 -- 172.21.15.137:0/3412748486 wait complete. 2024-04-26T21:58:50.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7fc89719d640 1 -- 172.21.15.137:0/306620904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc88803c0a0 msgr2=0x7fc888058050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7fc89719d640 1 --2- 172.21.15.137:0/306620904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc88803c0a0 0x7fc888058050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009870 tx=0x7fc87c02a230 comp rx=0 tx=0).stop 2024-04-26T21:58:50.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7fc89719d640 1 -- 172.21.15.137:0/306620904 shutdown_connections 2024-04-26T21:58:50.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7fc89719d640 1 --2- 172.21.15.137:0/306620904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc88803c0a0 0x7fc888058050 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7fc89719d640 1 --2- 172.21.15.137:0/306620904 >> v2:172.21.15.170:3300/0 conn(0x7fc8880e3160 0x7fc8880e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7fc89719d640 1 -- 172.21.15.137:0/306620904 >> 172.21.15.137:0/306620904 conn(0x7fc888058ee0 msgr2=0x7fc8880592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f34d6ffd640 1 -- 172.21.15.137:0/3062072745 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2041193918 0 0) 0x7f34d80d0ca0 con 0x7f34d815f740 2024-04-26T21:58:50.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f34d6ffd640 1 -- 172.21.15.137:0/3062072745 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c0003520 con 0x7f34d815f740 2024-04-26T21:58:50.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.503+0000 7f7bd850a640 1 -- 172.21.15.137:0/1086267828 wait complete. 2024-04-26T21:58:50.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f2eb2dad640 1 -- 172.21.15.137:0/527319334 shutdown_connections 2024-04-26T21:58:50.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f59b759e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f59b806c9b0 0x7f59b806f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b759e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b815ec50 con 0x7f59b815e870 2024-04-26T21:58:50.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b759e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b80cb7e0 con 0x7f59b80d0b10 2024-04-26T21:58:50.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b759e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f59b806fb80 con 0x7f59b806c9b0 2024-04-26T21:58:50.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f59b6d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f59b806c9b0 0x7f59b806f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f59b659c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f59b815e870 0x7f59b806fd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42074/0 (socket says 172.21.15.137:42074) 2024-04-26T21:58:50.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b659c640 1 -- 172.21.15.137:0/2184681146 learned_addr learned my addr 172.21.15.137:0/2184681146 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:50.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f34d77fe640 1 -- 172.21.15.137:0/3062072745 >> v1:172.21.15.170:6789/0 conn(0x7f34d80cfcd0 legacy=0x7f34d80b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:50.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f34d77fe640 1 -- 172.21.15.137:0/3062072745 >> v1:172.21.15.137:6789/0 conn(0x7f34d815f740 legacy=0x7f34d80d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.504+0000 7f34d77fe640 1 -- 172.21.15.137:0/3062072745 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d80b81a0 con 0x7f34d80d5bf0 2024-04-26T21:58:50.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7fb209a09640 1 -- 172.21.15.137:0/272830360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040d5b50 msgr2=0x7fb2040b64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7fb209a09640 1 --2- 172.21.15.137:0/272830360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040d5b50 0x7fb2040b64a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009d90 tx=0x7fb1fc02a660 comp rx=0 tx=0).stop 2024-04-26T21:58:50.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7fc89719d640 1 -- 172.21.15.137:0/306620904 shutdown_connections 2024-04-26T21:58:50.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7fc89719d640 1 -- 172.21.15.137:0/306620904 wait complete. 2024-04-26T21:58:50.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b559a640 1 -- 172.21.15.137:0/2184681146 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141757922 0 0) 0x7f59b815ec50 con 0x7f59b815e870 2024-04-26T21:58:50.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b559a640 1 -- 172.21.15.137:0/2184681146 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a0003520 con 0x7f59b815e870 2024-04-26T21:58:50.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b6d9d640 1 -- 172.21.15.137:0/2184681146 >> v1:172.21.15.170:6789/0 conn(0x7f59b80d0b10 legacy=0x7f59b806c2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T21:58:50.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f2eb2dad640 1 -- 172.21.15.137:0/527319334 wait complete. 2024-04-26T21:58:50.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b559a640 1 -- 172.21.15.137:0/2184681146 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1307448418 0 0) 0x7f59a0003520 con 0x7f59b815e870 2024-04-26T21:58:50.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b6d9d640 1 -- 172.21.15.137:0/2184681146 >> v1:172.21.15.137:6789/0 conn(0x7f59b815e870 legacy=0x7f59b806fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f34d77fe640 1 --2- 172.21.15.137:0/3062072745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d80d5bf0 0x7f34d80d1e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097a0 tx=0x7f34cc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f728cdef53399d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f7bd850a640 1 Processor -- start 2024-04-26T21:58:50.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f59b6d9d640 1 -- 172.21.15.137:0/2184681146 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b80cbac0 con 0x7f59b806c9b0 2024-04-26T21:58:50.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f0f28e66640 1 Processor -- start 2024-04-26T21:58:50.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7ff196b5f640 1 Processor -- start 2024-04-26T21:58:50.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7f0f28e66640 1 -- start start 2024-04-26T21:58:50.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7fb209a09640 1 -- 172.21.15.137:0/272830360 shutdown_connections 2024-04-26T21:58:50.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7fb209a09640 1 --2- 172.21.15.137:0/272830360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040d5b50 0x7fb2040b64a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7fb209a09640 1 -- 172.21.15.137:0/272830360 >> 172.21.15.137:0/272830360 conn(0x7fb2040d5030 msgr2=0x7fb2040d5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7ff196b5f640 1 -- start start 2024-04-26T21:58:50.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.505+0000 7f7bd850a640 1 -- start start 2024-04-26T21:58:50.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7fb209a09640 1 -- 172.21.15.137:0/272830360 shutdown_connections 2024-04-26T21:58:50.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f0f28e66640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 0x7f0f1c033240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f0f28e66640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f1c0e4570 0x7f0f1c185650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f0f28e66640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f1c03ac90 0x7f0f1c03b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7fb209a09640 1 -- 172.21.15.137:0/272830360 wait complete. 2024-04-26T21:58:50.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7fc89719d640 1 Processor -- start 2024-04-26T21:58:50.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7fc89719d640 1 -- start start 2024-04-26T21:58:50.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd850a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd850a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bd00c5f20 0x7f7bd00cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd850a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bd00cd5a0 0x7f7bd0160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd62a6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd62a6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd006ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40144/0 (socket says 172.21.15.137:40144) 2024-04-26T21:58:50.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd5aa5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bd00c5f20 0x7f7bd00cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd5aa5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bd00c5f20 0x7f7bd00cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60890/0 (socket says 172.21.15.137:60890) 2024-04-26T21:58:50.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f2eb2dad640 1 Processor -- start 2024-04-26T21:58:50.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f2eb2dad640 1 -- start start 2024-04-26T21:58:50.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f59b6d9d640 1 --2- 172.21.15.137:0/2184681146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b806c9b0 0x7f59b806f640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009d90 tx=0x7f59b002a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5e258fa07360a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f59b559a640 1 -- 172.21.15.137:0/2184681146 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8001670 con 0x7f59b806c9b0 2024-04-26T21:58:50.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f59b559a640 1 -- 172.21.15.137:0/2184681146 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b0007540 con 0x7f59b806c9b0 2024-04-26T21:58:50.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f59b559a640 1 -- 172.21.15.137:0/2184681146 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0007910 con 0x7f59b806c9b0 2024-04-26T21:58:50.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f0f28e66640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c0367b0 con 0x7f0f14005050 2024-04-26T21:58:50.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f0f28e66640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c0364d0 con 0x7f0f1c03ac90 2024-04-26T21:58:50.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f0f28e66640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f1c0540a0 con 0x7f0f1c0e4570 2024-04-26T21:58:50.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd850a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd01649e0 con 0x7f7bd00c5f20 2024-04-26T21:58:50.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd850a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0070ae0 con 0x7f7bd00cd5a0 2024-04-26T21:58:50.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd850a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd0164b60 con 0x7f7bd00b2310 2024-04-26T21:58:50.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f7bd62a6640 1 -- 172.21.15.137:0/1261785005 learned_addr learned my addr 172.21.15.137:0/1261785005 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f0f23fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f1c03ac90 0x7f0f1c03b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f0f23fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f1c03ac90 0x7f0f1c03b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54436/0 (socket says 172.21.15.137:54436) 2024-04-26T21:58:50.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f0f23fff640 1 -- 172.21.15.137:0/1206916 learned_addr learned my addr 172.21.15.137:0/1206916 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7ff196b5f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188006810 0x7ff18804f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7ff196b5f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1880ead00 0x7ff188046270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7ff196b5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1880467b0 0x7ff18817c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7ff196b5f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff1880547c0 con 0x7ff1880ead00 2024-04-26T21:58:50.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7ff196b5f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff1880501a0 con 0x7ff188006810 2024-04-26T21:58:50.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7ff196b5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff188054940 con 0x7ff1880467b0 2024-04-26T21:58:50.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7ff1948fb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188006810 0x7ff18804f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f0f23fff640 1 -- 172.21.15.137:0/1206916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f1c0e4570 msgr2=0x7f0f1c185650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f7bd62a6640 1 -- 172.21.15.137:0/1261785005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bd00cd5a0 msgr2=0x7f7bd0160fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:58:50.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f7bd62a6640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bd00cd5a0 0x7f7bd0160fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f7bd62a6640 1 -- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bd00c5f20 msgr2=0x7f7bd00cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7f34d6ffd640 1 -- 172.21.15.137:0/3062072745 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc037070 con 0x7f34d80d5bf0 2024-04-26T21:58:50.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7f34d6ffd640 1 -- 172.21.15.137:0/3062072745 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc032440 con 0x7f34d80d5bf0 2024-04-26T21:58:50.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.506+0000 7f34d6ffd640 1 -- 172.21.15.137:0/3062072745 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc032810 con 0x7f34d80d5bf0 2024-04-26T21:58:50.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f34dd48f640 1 -- 172.21.15.137:0/3062072745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d80d5bf0 msgr2=0x7f34d80d1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f34dd48f640 1 --2- 172.21.15.137:0/3062072745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d80d5bf0 0x7f34d80d1e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097a0 tx=0x7f34cc02a270 comp rx=0 tx=0).stop 2024-04-26T21:58:50.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f34dd48f640 1 -- 172.21.15.137:0/3062072745 shutdown_connections 2024-04-26T21:58:50.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f34dd48f640 1 --2- 172.21.15.137:0/3062072745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d80d5bf0 0x7f34d80d1e50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f34dd48f640 1 -- 172.21.15.137:0/3062072745 >> 172.21.15.137:0/3062072745 conn(0x7f34d80d5100 msgr2=0x7f34d80d54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f34dd48f640 1 -- 172.21.15.137:0/3062072745 shutdown_connections 2024-04-26T21:58:50.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.507+0000 7f34dd48f640 1 -- 172.21.15.137:0/3062072745 wait complete. 2024-04-26T21:58:50.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f59b759e640 1 -- 172.21.15.137:0/2184681146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b806c9b0 msgr2=0x7f59b806f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f7bd62a6640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bd00c5f20 0x7f7bd00cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f7bd62a6640 1 -- 172.21.15.137:0/1261785005 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd01631a0 con 0x7f7bd00b2310 2024-04-26T21:58:50.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7ff1948fb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188006810 0x7ff18804f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54424/0 (socket says 172.21.15.137:54424) 2024-04-26T21:58:50.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7ff1948fb640 1 -- 172.21.15.137:0/4208240921 learned_addr learned my addr 172.21.15.137:0/4208240921 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f0f23fff640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f1c0e4570 0x7f0f1c185650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f0f23fff640 1 -- 172.21.15.137:0/1206916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 msgr2=0x7f0f1c033240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f0f23fff640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 0x7f0f1c033240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f0f23fff640 1 -- 172.21.15.137:0/1206916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c0e49f0 con 0x7f0f1c03ac90 2024-04-26T21:58:50.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f7bd5aa5640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bd00c5f20 0x7f7bd00cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:50.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f59b759e640 1 --2- 172.21.15.137:0/2184681146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b806c9b0 0x7f59b806f640 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009d90 tx=0x7f59b002a5b0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7fb209a09640 1 Processor -- start 2024-04-26T21:58:50.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7fc89719d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc88803c0a0 0x7fc8880d67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f2eb2dad640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea4006a50 0x7f2ea40e8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f0f23fff640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f1c03ac90 0x7f0f1c03b110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f1002a840 tx=0x7f0f10004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7f2eb2dad640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 0x7f2ea40df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fb209a09640 1 -- start start 2024-04-26T21:58:50.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.508+0000 7fc89719d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc888053cb0 0x7fc8880d7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc89719d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8880e3160 0x7fc88804ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc89719d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8880e3540 con 0x7fc88803c0a0 2024-04-26T21:58:50.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc89719d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc888006640 con 0x7fc888053cb0 2024-04-26T21:58:50.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc89719d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc888006b60 con 0x7fc8880e3160 2024-04-26T21:58:50.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc894f39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc88803c0a0 0x7fc8880d67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb2dad640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea404f4d0 0x7f2ea40e6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f0f0ffff640 1 -- 172.21.15.137:0/1206916 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10037040 con 0x7f0f1c03ac90 2024-04-26T21:58:50.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc894f39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc88803c0a0 0x7fc8880d67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60902/0 (socket says 172.21.15.137:60902) 2024-04-26T21:58:50.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc894f39640 1 -- 172.21.15.137:0/2439075782 learned_addr learned my addr 172.21.15.137:0/2439075782 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f59b759e640 1 -- 172.21.15.137:0/2184681146 shutdown_connections 2024-04-26T21:58:50.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc88ffff640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc888053cb0 0x7fc8880d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f59b759e640 1 --2- 172.21.15.137:0/2184681146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b806c9b0 0x7f59b806f640 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7ff1948fb640 1 -- 172.21.15.137:0/4208240921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1880467b0 msgr2=0x7ff18817c2e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:58:50.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7ff1948fb640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1880467b0 0x7ff18817c2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7ff1948fb640 1 -- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1880ead00 msgr2=0x7ff188046270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f59b759e640 1 -- 172.21.15.137:0/2184681146 >> 172.21.15.137:0/2184681146 conn(0x7f59b80d10f0 msgr2=0x7f59b80d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb15aa640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 0x7f2ea40df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb15aa640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 0x7f2ea40df4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54472/0 (socket says 172.21.15.137:54472) 2024-04-26T21:58:50.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc89573a640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8880e3160 0x7fc88804ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f0f0ffff640 1 -- 172.21.15.137:0/1206916 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f10043070 con 0x7f0f1c03ac90 2024-04-26T21:58:50.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f0f0ffff640 1 -- 172.21.15.137:0/1206916 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000f040 con 0x7f0f1c03ac90 2024-04-26T21:58:50.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f0f28e66640 1 -- 172.21.15.137:0/1206916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c033940 con 0x7f0f1c03ac90 2024-04-26T21:58:50.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb15aa640 1 -- 172.21.15.137:0/3673672613 learned_addr learned my addr 172.21.15.137:0/3673672613 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb25ac640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea404f4d0 0x7f2ea40e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f59b759e640 1 -- 172.21.15.137:0/2184681146 shutdown_connections 2024-04-26T21:58:50.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4050060 con 0x7f2ea4006a50 2024-04-26T21:58:50.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea404b7a0 con 0x7f2ea404b3c0 2024-04-26T21:58:50.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea4054830 con 0x7f2ea404f4d0 2024-04-26T21:58:50.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f0f28e66640 1 -- 172.21.15.137:0/1206916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c033f00 con 0x7f0f1c03ac90 2024-04-26T21:58:50.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc88ffff640 1 -- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8880e3160 msgr2=0x7fc88804ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc88ffff640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8880e3160 0x7fc88804ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc88ffff640 1 -- 172.21.15.137:0/2439075782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc88803c0a0 msgr2=0x7fc8880d67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc88ffff640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc88803c0a0 0x7fc8880d67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc88ffff640 1 -- 172.21.15.137:0/2439075782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88804d2d0 con 0x7fc888053cb0 2024-04-26T21:58:50.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7fc89573a640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8880e3160 0x7fc88804ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:50.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7ff18ffff640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1880ead00 0x7ff188046270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7ff1948fb640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1880ead00 0x7ff188046270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7ff1948fb640 1 -- 172.21.15.137:0/4208240921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18817de80 con 0x7ff188006810 2024-04-26T21:58:50.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7ff18ffff640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1880ead00 0x7ff188046270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:50.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f34dd48f640 1 Processor -- start 2024-04-26T21:58:50.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f59b759e640 1 -- 172.21.15.137:0/2184681146 wait complete. 2024-04-26T21:58:50.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb25ac640 1 -- 172.21.15.137:0/3673672613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 msgr2=0x7f2ea40df4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb25ac640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 0x7f2ea40df4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb25ac640 1 -- 172.21.15.137:0/3673672613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea4006a50 msgr2=0x7f2ea40e8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb25ac640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea4006a50 0x7f2ea40e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.509+0000 7f2eb25ac640 1 -- 172.21.15.137:0/3673672613 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea404dfb0 con 0x7f2ea404f4d0 2024-04-26T21:58:50.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7ff1948fb640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188006810 0x7ff18804f7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff18400c750 tx=0x7ff18400cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb209a09640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040b60c0 0x7fb2041f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb209a09640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2040d2080 0x7fb20415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb209a09640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2040d5b50 0x7fb2040cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7f2eb25ac640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea404f4d0 0x7f2ea40e6510 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e880 tx=0x7f2ea800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb209a09640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb2040c8060 con 0x7fb2040d2080 2024-04-26T21:58:50.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb209a09640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2040c87b0 con 0x7fb2040b60c0 2024-04-26T21:58:50.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb209a09640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb2040c81e0 con 0x7fb2040d5b50 2024-04-26T21:58:50.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7f34dd48f640 1 -- start start 2024-04-26T21:58:50.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7ff18d7fa640 1 -- 172.21.15.137:0/4208240921 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184016020 con 0x7ff188006810 2024-04-26T21:58:50.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7f7bd62a6640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd006ef70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000e8a0 tx=0x7f7bc000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb202ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040b60c0 0x7fb2041f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb2037fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2040d5b50 0x7fb2040cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb202ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040b60c0 0x7fb2041f95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54478/0 (socket says 172.21.15.137:54478) 2024-04-26T21:58:50.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb2037fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2040d5b50 0x7fb2040cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40176/0 (socket says 172.21.15.137:40176) 2024-04-26T21:58:50.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb202ffd640 1 -- 172.21.15.137:0/1205116847 learned_addr learned my addr 172.21.15.137:0/1205116847 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7ff18d7fa640 1 -- 172.21.15.137:0/4208240921 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff18400a850 con 0x7ff188006810 2024-04-26T21:58:50.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fb1fa7fc640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2040d2080 0x7fb20415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7fc88ffff640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc888053cb0 0x7fc8880d7560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc87c031000 tx=0x7fc87c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fb2037fe640 1 -- 172.21.15.137:0/1205116847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040b60c0 msgr2=0x7fb2041f95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fb2037fe640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040b60c0 0x7fb2041f95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fb2037fe640 1 -- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2040d2080 msgr2=0x7fb20415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f0f28e66640 1 -- 172.21.15.137:0/1206916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1c0057e0 con 0x7f0f1c03ac90 2024-04-26T21:58:50.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7ff18d7fa640 1 -- 172.21.15.137:0/4208240921 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18400ac20 con 0x7ff188006810 2024-04-26T21:58:50.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fb2037fe640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2040d2080 0x7fb20415cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fb2037fe640 1 -- 172.21.15.137:0/1205116847 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20415d0d0 con 0x7fb2040d5b50 2024-04-26T21:58:50.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fb1fa7fc640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2040d2080 0x7fb20415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:50.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fc88d7fa640 1 -- 172.21.15.137:0/2439075782 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c041070 con 0x7fc888053cb0 2024-04-26T21:58:50.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fc88d7fa640 1 -- 172.21.15.137:0/2439075782 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c03c950 con 0x7fc888053cb0 2024-04-26T21:58:50.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fc89719d640 1 -- 172.21.15.137:0/2439075782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88804d5b0 con 0x7fc888053cb0 2024-04-26T21:58:50.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fc89719d640 1 -- 172.21.15.137:0/2439075782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8880d6cf0 con 0x7fc888053cb0 2024-04-26T21:58:50.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7f2ea27fc640 1 -- 172.21.15.137:0/3673672613 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8017070 con 0x7f2ea404f4d0 2024-04-26T21:58:50.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f59b759e640 1 Processor -- start 2024-04-26T21:58:50.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fc88d7fa640 1 -- 172.21.15.137:0/2439075782 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c037040 con 0x7fc888053cb0 2024-04-26T21:58:50.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f59b759e640 1 -- start start 2024-04-26T21:58:50.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f7bc6ffd640 1 -- 172.21.15.137:0/1261785005 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0017070 con 0x7f7bd00b2310 2024-04-26T21:58:50.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd00cc6b0 con 0x7f7bd00b2310 2024-04-26T21:58:50.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd00ccc70 con 0x7f7bd00b2310 2024-04-26T21:58:50.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f7bc6ffd640 1 -- 172.21.15.137:0/1261785005 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc000c940 con 0x7f7bd00b2310 2024-04-26T21:58:50.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f7bc6ffd640 1 -- 172.21.15.137:0/1261785005 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000cd30 con 0x7f7bd00b2310 2024-04-26T21:58:50.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7fb2037fe640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2040d5b50 0x7fb2040cb650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc031000 tx=0x7fb1fc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.510+0000 7f2ea27fc640 1 -- 172.21.15.137:0/3673672613 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea8004020 con 0x7f2ea404f4d0 2024-04-26T21:58:50.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f2ea27fc640 1 -- 172.21.15.137:0/3673672613 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8004410 con 0x7f2ea404f4d0 2024-04-26T21:58:50.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea40e8d90 con 0x7f2ea404f4d0 2024-04-26T21:58:50.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7f34dd48f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d80cfcd0 0x7f34d8071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.511+0000 7f0f0ffff640 1 -- 172.21.15.137:0/1206916 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f1003d640 con 0x7f0f1c03ac90 2024-04-26T21:58:50.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7f0f0ffff640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0806c9f0 0x7f0f0806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7f0f0ffff640 1 -- 172.21.15.137:0/1206916 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f100abe60 con 0x7f0f1c03ac90 2024-04-26T21:58:50.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7f0f237fe640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0806c9f0 0x7f0f0806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7ff196b5f640 1 -- 172.21.15.137:0/4208240921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18817d300 con 0x7ff188006810 2024-04-26T21:58:50.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7ff196b5f640 1 -- 172.21.15.137:0/4208240921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18817d8c0 con 0x7ff188006810 2024-04-26T21:58:50.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7fb200ff9640 1 -- 172.21.15.137:0/1205116847 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc03f070 con 0x7fb2040d5b50 2024-04-26T21:58:50.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f0f237fe640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0806c9f0 0x7f0f0806eeb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c003e80 tx=0x7f0f18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7fb200ff9640 1 -- 172.21.15.137:0/1205116847 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1fc031b40 con 0x7fb2040d5b50 2024-04-26T21:58:50.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7fb200ff9640 1 -- 172.21.15.137:0/1205116847 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc044460 con 0x7fb2040d5b50 2024-04-26T21:58:50.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20415f5a0 con 0x7fb2040d5b50 2024-04-26T21:58:50.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20415fb60 con 0x7fb2040d5b50 2024-04-26T21:58:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb8005290 con 0x7f7bd00b2310 2024-04-26T21:58:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f59b759e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59b806c9b0 0x7f59b8152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f59b759e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59b80d0b10 0x7f59b814a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f59b759e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b815e870 0x7f59b814a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f59b659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59b806c9b0 0x7f59b8152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f59b659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59b806c9b0 0x7f59b8152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54484/0 (socket says 172.21.15.137:54484) 2024-04-26T21:58:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f59b5d9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59b80d0b10 0x7f59b814a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f59b5d9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59b80d0b10 0x7f59b814a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40192/0 (socket says 172.21.15.137:40192) 2024-04-26T21:58:50.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7ff196b5f640 1 -- 172.21.15.137:0/4208240921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff188005390 con 0x7ff188006810 2024-04-26T21:58:50.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f34d7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d80cfcd0 0x7f34d8071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.512+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea40e9350 con 0x7f2ea404f4d0 2024-04-26T21:58:50.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f34d7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d80cfcd0 0x7f34d8071fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60930/0 (socket says 172.21.15.137:60930) 2024-04-26T21:58:50.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f34d7fff640 1 -- 172.21.15.137:0/2680721213 learned_addr learned my addr 172.21.15.137:0/2680721213 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f34dd48f640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d80d5bf0 0x7f34d8170880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.513+0000 7f34dd48f640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d815f740 0x7f34d806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34d77fe640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d80d5bf0 0x7f34d8170880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7fc87affd640 1 -- 172.21.15.137:0/2439075782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc868005290 con 0x7fc888053cb0 2024-04-26T21:58:50.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f7bc6ffd640 1 -- 172.21.15.137:0/1261785005 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7bc001a070 con 0x7f7bd00b2310 2024-04-26T21:58:50.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34dcc8e640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d815f740 0x7f34d806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34d815fca0 con 0x7f34d80cfcd0 2024-04-26T21:58:50.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f34d815fb20 con 0x7f34d80d5bf0 2024-04-26T21:58:50.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f34d80d2390 con 0x7f34d815f740 2024-04-26T21:58:50.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7fc88d7fa640 1 -- 172.21.15.137:0/2439075782 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc87c044070 con 0x7fc888053cb0 2024-04-26T21:58:50.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2040cbf30 con 0x7fb2040d5b50 2024-04-26T21:58:50.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f59b759e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f59b806f120 con 0x7f59b815e870 2024-04-26T21:58:50.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f59b759e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f59b806eed0 con 0x7f59b806c9b0 2024-04-26T21:58:50.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f59b759e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f59b806a290 con 0x7f59b80d0b10 2024-04-26T21:58:50.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f59b6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b815e870 0x7f59b814a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f59b6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b815e870 0x7f59b814a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60936/0 (socket says 172.21.15.137:60936) 2024-04-26T21:58:50.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f59b659c640 1 -- 172.21.15.137:0/4139290141 learned_addr learned my addr 172.21.15.137:0/4139290141 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:50.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f7bc6ffd640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7bb406c9c0 0x7f7bb406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7fc88d7fa640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc87406c970 0x7fc87406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34dcc8e640 1 -- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d80d5bf0 msgr2=0x7f34d8170880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34dcc8e640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d80d5bf0 0x7f34d8170880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34dcc8e640 1 -- 172.21.15.137:0/2680721213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d80cfcd0 msgr2=0x7f34d8071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34dcc8e640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d80cfcd0 0x7f34d8071fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.514+0000 7f34dcc8e640 1 -- 172.21.15.137:0/2680721213 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d8070080 con 0x7f34d815f740 2024-04-26T21:58:50.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7fb200ff9640 1 -- 172.21.15.137:0/1205116847 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1fc03b410 con 0x7fb2040d5b50 2024-04-26T21:58:50.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f34dcc8e640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d815f740 0x7f34d806fb40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34d000c7b0 tx=0x7f34d000cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f7bd5aa5640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7bb406c9c0 0x7f7bb406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f59b659c640 1 -- 172.21.15.137:0/4139290141 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59b80d0b10 msgr2=0x7f59b814a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f59b659c640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59b80d0b10 0x7f59b814a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f59b659c640 1 -- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b815e870 msgr2=0x7f59b814a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f59b659c640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b815e870 0x7f59b814a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f59b659c640 1 -- 172.21.15.137:0/4139290141 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b80b51d0 con 0x7f59b806c9b0 2024-04-26T21:58:50.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f59b6d9d640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b815e870 0x7f59b814a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:50.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f2ea27fc640 1 -- 172.21.15.137:0/3673672613 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ea8005990 con 0x7f2ea404f4d0 2024-04-26T21:58:50.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7fc894f39640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc87406c970 0x7fc87406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f59b659c640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59b806c9b0 0x7f59b8152230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59a8001eb0 tx=0x7f59a800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f7bc6ffd640 1 -- 172.21.15.137:0/1261785005 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7bc008b940 con 0x7f7bd00b2310 2024-04-26T21:58:50.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f7bd5aa5640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7bb406c9c0 0x7f7bb406ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc034000 tx=0x7f7bcc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f2ea27fc640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e9006c9c0 0x7f2e9006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f2ea27fc640 1 -- 172.21.15.137:0/3673672613 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ea808b160 con 0x7f2ea404f4d0 2024-04-26T21:58:50.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7fb200ff9640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1e406c940 0x7fb1e406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f2eb1dab640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e9006c9c0 0x7f2e9006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7fc894f39640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc87406c970 0x7fc87406ee30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc88817c830 tx=0x7fc8840090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea40057e0 con 0x7f2ea404f4d0 2024-04-26T21:58:50.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.515+0000 7fb200ff9640 1 -- 172.21.15.137:0/1205116847 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb1fc0ad150 con 0x7fb2040d5b50 2024-04-26T21:58:50.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.516+0000 7fb202ffd640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1e406c940 0x7fb1e406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.516+0000 7f2eb1dab640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e9006c9c0 0x7f2e9006ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4008990 tx=0x7f2eac0a9000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.516+0000 7fb202ffd640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1e406c940 0x7fb1e406ee00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4005ef0 tx=0x7fb1f4007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.517+0000 7f59a6ffd640 1 -- 172.21.15.137:0/4139290141 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a80058d0 con 0x7f59b806c9b0 2024-04-26T21:58:50.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.517+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b814ac10 con 0x7f59b806c9b0 2024-04-26T21:58:50.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.517+0000 7fc88d7fa640 1 -- 172.21.15.137:0/2439075782 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc87c0786f0 con 0x7fc888053cb0 2024-04-26T21:58:50.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.517+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b80b4410 con 0x7f59b806c9b0 2024-04-26T21:58:50.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.517+0000 7f0f0ffff640 1 -- 172.21.15.137:0/1206916 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f1007a270 con 0x7f0f1c03ac90 2024-04-26T21:58:50.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.518+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b809f320 con 0x7f59b806c9b0 2024-04-26T21:58:50.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.518+0000 7ff18d7fa640 1 -- 172.21.15.137:0/4208240921 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff184019020 con 0x7ff188006810 2024-04-26T21:58:50.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.519+0000 7ff18d7fa640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff17406c940 0x7ff17406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.519+0000 7ff18ffff640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff17406c940 0x7ff17406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.519+0000 7f34d4ff9640 1 -- 172.21.15.137:0/2680721213 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d0016020 con 0x7f34d815f740 2024-04-26T21:58:50.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.519+0000 7ff18ffff640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff17406c940 0x7ff17406ee00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff17c034000 tx=0x7ff17c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.519+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d80726a0 con 0x7f34d815f740 2024-04-26T21:58:50.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.519+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d8072c60 con 0x7f34d815f740 2024-04-26T21:58:50.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.520+0000 7f7bc6ffd640 1 -- 172.21.15.137:0/1261785005 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7bc0059700 con 0x7f7bd00b2310 2024-04-26T21:58:50.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.521+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d80a3110 con 0x7f34d815f740 2024-04-26T21:58:50.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.522+0000 7f59a6ffd640 1 -- 172.21.15.137:0/4139290141 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a8005a70 con 0x7f59b806c9b0 2024-04-26T21:58:50.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.522+0000 7f59a6ffd640 1 -- 172.21.15.137:0/4139290141 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8005e20 con 0x7f59b806c9b0 2024-04-26T21:58:50.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.522+0000 7ff18d7fa640 1 -- 172.21.15.137:0/4208240921 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff184058020 con 0x7ff188006810 2024-04-26T21:58:50.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.522+0000 7fc88d7fa640 1 -- 172.21.15.137:0/2439075782 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc888058590 con 0x7fc888053cb0 2024-04-26T21:58:50.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.524+0000 7f59a6ffd640 1 -- 172.21.15.137:0/4139290141 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59a8007070 con 0x7f59b806c9b0 2024-04-26T21:58:50.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.524+0000 7f59a6ffd640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f599806c8f0 0x7f599806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.524+0000 7f2ea27fc640 1 -- 172.21.15.137:0/3673672613 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2ea8058fb0 con 0x7f2ea404f4d0 2024-04-26T21:58:50.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.524+0000 7f59b5d9b640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f599806c8f0 0x7f599806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.525+0000 7f59b5d9b640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f599806c8f0 0x7f599806edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f59b80b0650 tx=0x7f59ac0090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.526+0000 7f59a6ffd640 1 -- 172.21.15.137:0/4139290141 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f59a805ff60 con 0x7f59b806c9b0 2024-04-26T21:58:50.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.527+0000 7ff18d7fa640 1 -- 172.21.15.137:0/4208240921 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff184020020 con 0x7ff188006810 2024-04-26T21:58:50.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.528+0000 7f34d4ff9640 1 -- 172.21.15.137:0/2680721213 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d000aa50 con 0x7f34d815f740 2024-04-26T21:58:50.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.528+0000 7f34d4ff9640 1 -- 172.21.15.137:0/2680721213 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d000ce60 con 0x7f34d815f740 2024-04-26T21:58:50.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.528+0000 7fb200ff9640 1 -- 172.21.15.137:0/1205116847 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb1fc07b5f0 con 0x7fb2040d5b50 2024-04-26T21:58:50.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.530+0000 7f34d4ff9640 1 -- 172.21.15.137:0/2680721213 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34d0019020 con 0x7f34d815f740 2024-04-26T21:58:50.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.531+0000 7f34d4ff9640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34c406c8f0 0x7f34c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:50.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.531+0000 7f34d4ff9640 1 -- 172.21.15.137:0/2680721213 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f34d008bdb0 con 0x7f34d815f740 2024-04-26T21:58:50.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.531+0000 7f34d7fff640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34c406c8f0 0x7f34c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:50.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.532+0000 7f59a6ffd640 1 -- 172.21.15.137:0/4139290141 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f59a80625c0 con 0x7f59b806c9b0 2024-04-26T21:58:50.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.532+0000 7f34d7fff640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34c406c8f0 0x7f34c406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34c8005880 tx=0x7f34c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:50.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.534+0000 7f34d4ff9640 1 -- 172.21.15.137:0/2680721213 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f34d0020030 con 0x7f34d815f740 2024-04-26T21:58:50.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.938+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7bb8005580 con 0x7f7bd00b2310 2024-04-26T21:58:50.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.938+0000 7f7bc6ffd640 1 -- 172.21.15.137:0/1261785005 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7bc005da00 con 0x7f7bd00b2310 2024-04-26T21:58:50.939 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T21:58:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.940+0000 7fc87affd640 1 -- 172.21.15.137:0/2439075782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc868005580 con 0x7fc888053cb0 2024-04-26T21:58:50.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.941+0000 7fc88d7fa640 1 -- 172.21.15.137:0/2439075782 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc87c07a650 con 0x7fc888053cb0 2024-04-26T21:58:50.941 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T21:58:50.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7bb406c9c0 msgr2=0x7f7bb406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f7bd850a640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7bb406c9c0 0x7f7bb406ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc034000 tx=0x7f7bcc02e000 comp rx=0 tx=0).stop 2024-04-26T21:58:50.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f0f28e66640 1 -- 172.21.15.137:0/1206916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0f1c035970 con 0x7f0f1c03ac90 2024-04-26T21:58:50.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 msgr2=0x7f7bd006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f7bd850a640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd006ef70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000e8a0 tx=0x7f7bc000ed60 comp rx=0 tx=0).stop 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 shutdown_connections 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f7bd850a640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7bb406c9c0 0x7f7bb406ee80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f7bd850a640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7bd00c5f20 0x7f7bd00cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f7bd850a640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bd00cd5a0 0x7f7bd0160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.942+0000 7f7bd850a640 1 --2- 172.21.15.137:0/1261785005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7bd00b2310 0x7f7bd006ef70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.943+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 >> 172.21.15.137:0/1261785005 conn(0x7f7bd00b4a40 msgr2=0x7f7bd00cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.943+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 shutdown_connections 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.943+0000 7f7bd850a640 1 -- 172.21.15.137:0/1261785005 wait complete. 2024-04-26T21:58:50.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.943+0000 7f0f0ffff640 1 -- 172.21.15.137:0/1206916 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0f10079b70 con 0x7f0f1c03ac90 2024-04-26T21:58:50.945 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T21:58:50.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.944+0000 7fc87affd640 1 -- 172.21.15.137:0/2439075782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc87406c970 msgr2=0x7fc87406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.944+0000 7fc87affd640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc87406c970 0x7fc87406ee30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc88817c830 tx=0x7fc8840090e0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.944+0000 7fc87affd640 1 -- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc888053cb0 msgr2=0x7fc8880d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.945+0000 7fc87affd640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc888053cb0 0x7fc8880d7560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc87c031000 tx=0x7fc87c0046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.945+0000 7fc87affd640 1 -- 172.21.15.137:0/2439075782 shutdown_connections 2024-04-26T21:58:50.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.945+0000 7fc87affd640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc87406c970 0x7fc87406ee30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.945+0000 7fc87affd640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8880e3160 0x7fc88804ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.945+0000 7fc87affd640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc888053cb0 0x7fc8880d7560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.945+0000 7fc87affd640 1 --2- 172.21.15.137:0/2439075782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc88803c0a0 0x7fc8880d67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.945+0000 7fc87affd640 1 -- 172.21.15.137:0/2439075782 >> 172.21.15.137:0/2439075782 conn(0x7fc888058ee0 msgr2=0x7fc888006fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.945+0000 7fc87affd640 1 -- 172.21.15.137:0/2439075782 shutdown_connections 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.945+0000 7fc87affd640 1 -- 172.21.15.137:0/2439075782 wait complete. 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.946+0000 7f0f0dffb640 1 -- 172.21.15.137:0/1206916 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0806c9f0 msgr2=0x7f0f0806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.946+0000 7f0f0dffb640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0806c9f0 0x7f0f0806eeb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c003e80 tx=0x7f0f18009040 comp rx=0 tx=0).stop 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.946+0000 7f0f0dffb640 1 -- 172.21.15.137:0/1206916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f1c03ac90 msgr2=0x7f0f1c03b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.946+0000 7f0f0dffb640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f1c03ac90 0x7f0f1c03b110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f1002a840 tx=0x7f0f10004730 comp rx=0 tx=0).stop 2024-04-26T21:58:50.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.946+0000 7ff196b5f640 1 -- 172.21.15.137:0/4208240921 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff188039b60 con 0x7ff188006810 2024-04-26T21:58:50.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.947+0000 7f0f0dffb640 1 -- 172.21.15.137:0/1206916 shutdown_connections 2024-04-26T21:58:50.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.947+0000 7f0f0dffb640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0806c9f0 0x7f0f0806eeb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.947+0000 7f0f0dffb640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f1c03ac90 0x7f0f1c03b110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.947+0000 7f0f0dffb640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f1c0e4570 0x7f0f1c185650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.947+0000 7f0f0dffb640 1 --2- 172.21.15.137:0/1206916 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f14005050 0x7f0f1c033240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.947+0000 7f0f0dffb640 1 -- 172.21.15.137:0/1206916 >> 172.21.15.137:0/1206916 conn(0x7f0f1c01ef40 msgr2=0x7f0f1c0e7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.947+0000 7ff18d7fa640 1 -- 172.21.15.137:0/4208240921 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff18405a680 con 0x7ff188006810 2024-04-26T21:58:50.949 INFO:teuthology.orchestra.run.smithi137.stdout:55834574853 2024-04-26T21:58:50.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.947+0000 7f0f0dffb640 1 -- 172.21.15.137:0/1206916 shutdown_connections 2024-04-26T21:58:50.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.947+0000 7f0f0dffb640 1 -- 172.21.15.137:0/1206916 wait complete. 2024-04-26T21:58:50.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.950+0000 7ff17affd640 1 -- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff17406c940 msgr2=0x7ff17406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.950+0000 7ff17affd640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff17406c940 0x7ff17406ee00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff17c034000 tx=0x7ff17c02e000 comp rx=0 tx=0).stop 2024-04-26T21:58:50.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.950+0000 7ff17affd640 1 -- 172.21.15.137:0/4208240921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188006810 msgr2=0x7ff18804f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.951+0000 7ff17affd640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188006810 0x7ff18804f7c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff18400c750 tx=0x7ff18400cc10 comp rx=0 tx=0).stop 2024-04-26T21:58:50.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.951+0000 7ff17affd640 1 -- 172.21.15.137:0/4208240921 shutdown_connections 2024-04-26T21:58:50.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.951+0000 7ff17affd640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff17406c940 0x7ff17406ee00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.951+0000 7ff17affd640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff1880ead00 0x7ff188046270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.951+0000 7ff17affd640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1880467b0 0x7ff18817c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.951+0000 7ff17affd640 1 --2- 172.21.15.137:0/4208240921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff188006810 0x7ff18804f7c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.951+0000 7ff17affd640 1 -- 172.21.15.137:0/4208240921 >> 172.21.15.137:0/4208240921 conn(0x7ff188009fb0 msgr2=0x7ff188049e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.951+0000 7ff17affd640 1 -- 172.21.15.137:0/4208240921 shutdown_connections 2024-04-26T21:58:50.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.951+0000 7ff17affd640 1 -- 172.21.15.137:0/4208240921 wait complete. 2024-04-26T21:58:50.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.952+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f59b80507a0 con 0x7f59b806c9b0 2024-04-26T21:58:50.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.952+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb2040693d0 con 0x7fb2040d5b50 2024-04-26T21:58:50.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.952+0000 7f59a6ffd640 1 -- 172.21.15.137:0/4139290141 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f59a8061ec0 con 0x7f59b806c9b0 2024-04-26T21:58:50.953 INFO:teuthology.orchestra.run.smithi137.stdout:55834574853 2024-04-26T21:58:50.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.953+0000 7fb200ff9640 1 -- 172.21.15.137:0/1205116847 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb1fc07aef0 con 0x7fb2040d5b50 2024-04-26T21:58:50.954 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T21:58:50.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.954+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2ea4037040 con 0x7f2ea404f4d0 2024-04-26T21:58:50.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.956+0000 7f2ea27fc640 1 -- 172.21.15.137:0/3673672613 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ea805d2b0 con 0x7f2ea404f4d0 2024-04-26T21:58:50.956 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T21:58:50.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.956+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f599806c8f0 msgr2=0x7f599806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.956+0000 7f59b759e640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f599806c8f0 0x7f599806edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f59b80b0650 tx=0x7f59ac0090e0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.957+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59b806c9b0 msgr2=0x7f59b8152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.957+0000 7f59b759e640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59b806c9b0 0x7f59b8152230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59a8001eb0 tx=0x7f59a800a430 comp rx=0 tx=0).stop 2024-04-26T21:58:50.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.957+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 shutdown_connections 2024-04-26T21:58:50.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.957+0000 7f59b759e640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f599806c8f0 0x7f599806edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.957+0000 7f59b759e640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59b815e870 0x7f59b814a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.957+0000 7f59b759e640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59b80d0b10 0x7f59b814a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.957+0000 7f59b759e640 1 --2- 172.21.15.137:0/4139290141 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59b806c9b0 0x7f59b8152230 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.957+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 >> 172.21.15.137:0/4139290141 conn(0x7f59b80d10f0 msgr2=0x7f59b80b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.958+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 shutdown_connections 2024-04-26T21:58:50.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.958+0000 7f59b759e640 1 -- 172.21.15.137:0/4139290141 wait complete. 2024-04-26T21:58:50.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.958+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f34d80507a0 con 0x7f34d815f740 2024-04-26T21:58:50.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.958+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1e406c940 msgr2=0x7fb1e406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.959+0000 7fb209a09640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1e406c940 0x7fb1e406ee00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4005ef0 tx=0x7fb1f4007d70 comp rx=0 tx=0).stop 2024-04-26T21:58:50.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.959+0000 7f34d4ff9640 1 -- 172.21.15.137:0/2680721213 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f34d0059b70 con 0x7f34d815f740 2024-04-26T21:58:50.960 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T21:58:50.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.959+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2040d5b50 msgr2=0x7fb2040cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.959+0000 7fb209a09640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2040d5b50 0x7fb2040cb650 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc031000 tx=0x7fb1fc004a40 comp rx=0 tx=0).stop 2024-04-26T21:58:50.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.959+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 shutdown_connections 2024-04-26T21:58:50.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7fb209a09640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1e406c940 0x7fb1e406ee00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7fb209a09640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2040d2080 0x7fb20415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7fb209a09640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2040d5b50 0x7fb2040cb650 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7fb209a09640 1 --2- 172.21.15.137:0/1205116847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2040b60c0 0x7fb2041f95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 >> 172.21.15.137:0/1205116847 conn(0x7fb2040d5030 msgr2=0x7fb2041635d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 shutdown_connections 2024-04-26T21:58:50.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7fb209a09640 1 -- 172.21.15.137:0/1205116847 wait complete. 2024-04-26T21:58:50.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e9006c9c0 msgr2=0x7f2e9006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7f2eb2dad640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e9006c9c0 0x7f2e9006ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4008990 tx=0x7f2eac0a9000 comp rx=0 tx=0).stop 2024-04-26T21:58:50.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea404f4d0 msgr2=0x7f2ea40e6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7f2eb2dad640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea404f4d0 0x7f2ea40e6510 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800e880 tx=0x7f2ea800ed40 comp rx=0 tx=0).stop 2024-04-26T21:58:50.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 shutdown_connections 2024-04-26T21:58:50.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7f2eb2dad640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e9006c9c0 0x7f2e9006ee80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7f2eb2dad640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea404f4d0 0x7f2ea40e6510 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.960+0000 7f2eb2dad640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea404b3c0 0x7f2ea40df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.961+0000 7f2eb2dad640 1 --2- 172.21.15.137:0/3673672613 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea4006a50 0x7f2ea40e8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.961+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 >> 172.21.15.137:0/3673672613 conn(0x7f2ea400a400 msgr2=0x7f2ea4004cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.961+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 shutdown_connections 2024-04-26T21:58:50.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.961+0000 7f2eb2dad640 1 -- 172.21.15.137:0/3673672613 wait complete. 2024-04-26T21:58:50.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34c406c8f0 msgr2=0x7f34c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34c406c8f0 0x7f34c406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34c8005880 tx=0x7f34c8009040 comp rx=0 tx=0).stop 2024-04-26T21:58:50.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d815f740 msgr2=0x7f34d806fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:50.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d815f740 0x7f34d806fb40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f34d000c7b0 tx=0x7f34d000cc70 comp rx=0 tx=0).stop 2024-04-26T21:58:50.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 shutdown_connections 2024-04-26T21:58:50.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34c406c8f0 0x7f34c406edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d815f740 0x7f34d806fb40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d80d5bf0 0x7f34d8170880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 --2- 172.21.15.137:0/2680721213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d80cfcd0 0x7f34d8071fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:50.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.963+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 >> 172.21.15.137:0/2680721213 conn(0x7f34d80d5100 msgr2=0x7f34d80b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:50.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.964+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 shutdown_connections 2024-04-26T21:58:50.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:50.964+0000 7f34dd48f640 1 -- 172.21.15.137:0/2680721213 wait complete. 2024-04-26T21:58:50.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2024-04-26T21:58:50.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-04-26T21:58:50.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-04-26T21:58:50.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-04-26T21:58:50.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-26T21:58:50.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-04-26T21:58:50.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-04-26T21:58:50.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-04-26T21:58:51.969 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T21:58:51.972 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T21:58:51.973 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T21:58:51.978 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T21:58:51.979 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T21:58:51.981 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T21:58:51.981 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T21:58:51.981 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T21:58:52.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.127+0000 7f0b8d578640 1 Processor -- start 2024-04-26T21:58:52.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.127+0000 7f0b8d578640 1 -- start start 2024-04-26T21:58:52.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.127+0000 7faa1f0e4640 1 Processor -- start 2024-04-26T21:58:52.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.128+0000 7faa1f0e4640 1 -- start start 2024-04-26T21:58:52.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.128+0000 7f0b8d578640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80056cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.128+0000 7f0b8d578640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b8003d010 con 0x7f0b8004ac50 2024-04-26T21:58:52.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7f0b8d578640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b8000abe0 con 0x7f0b80001e30 2024-04-26T21:58:52.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7f0b8d578640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b80058250 con 0x7f0b8003c240 2024-04-26T21:58:52.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7f0b86ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80056cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7f0b86ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80056cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40202/0 (socket says 172.21.15.137:40202) 2024-04-26T21:58:52.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7f0b86ffd640 1 -- 172.21.15.137:0/1319743479 learned_addr learned my addr 172.21.15.137:0/1319743479 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7faa1f0e4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faa1004b3c0 0x7faa10034020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7faa1f0e4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa10006ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7faa1f0e4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa10054c10 con 0x7faa1004f4d0 2024-04-26T21:58:52.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7faa1f0e4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7faa100062e0 con 0x7faa1004b3c0 2024-04-26T21:58:52.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7faa1f0e4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faa10053a50 con 0x7faa10006a50 2024-04-26T21:58:52.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.128+0000 7fc608122640 1 Processor -- start 2024-04-26T21:58:52.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7fc608122640 1 -- start start 2024-04-26T21:58:52.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7f0b86ffd640 1 -- 172.21.15.137:0/1319743479 >> v1:172.21.15.170:6789/0 conn(0x7f0b80001e30 legacy=0x7f0b80055ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7faa1d8e1640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7faa1004f4d0 0x7faa1004f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56450/0 (socket says 172.21.15.137:56450) 2024-04-26T21:58:52.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7faa1d8e1640 1 -- 172.21.15.137:0/2696824699 learned_addr learned my addr 172.21.15.137:0/2696824699 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:52.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7f0b86ffd640 1 -- 172.21.15.137:0/1319743479 >> v1:172.21.15.137:6789/0 conn(0x7f0b8004ac50 legacy=0x7f0b8003c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.129+0000 7faa1e8e3640 1 --2- 172.21.15.137:0/2696824699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa10006ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.130+0000 7f0b86ffd640 1 -- 172.21.15.137:0/1319743479 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8003cd30 con 0x7f0b8003c240 2024-04-26T21:58:52.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.130+0000 7faa1e0e2640 1 --2- 172.21.15.137:0/2696824699 >> v2:172.21.15.170:3300/0 conn(0x7faa1004b3c0 0x7faa10034020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.130+0000 7fc608122640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc6000b16e0 0x7fc60015e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.130+0000 7fc608122640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6000b2c40 con 0x7fc60015f7b0 2024-04-26T21:58:52.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.130+0000 7fc608122640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6000b1ba0 con 0x7fc60006a290 2024-04-26T21:58:52.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.130+0000 7fc608122640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc6000b27b0 con 0x7fc6000b16e0 2024-04-26T21:58:52.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7fc6056bd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc60006a290 0x7fc60015f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56462/0 (socket says 172.21.15.137:56462) 2024-04-26T21:58:52.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7fc6056bd640 1 -- 172.21.15.137:0/3654553134 learned_addr learned my addr 172.21.15.137:0/3654553134 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:52.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7faa1e8e3640 1 -- 172.21.15.137:0/2696824699 >> v2:172.21.15.170:3300/0 conn(0x7faa1004b3c0 msgr2=0x7faa10034020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7faa1e8e3640 1 --2- 172.21.15.137:0/2696824699 >> v2:172.21.15.170:3300/0 conn(0x7faa1004b3c0 0x7faa10034020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7faa1e8e3640 1 -- 172.21.15.137:0/2696824699 >> v1:172.21.15.170:6789/0 conn(0x7faa1004f4d0 legacy=0x7faa1004f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7faa1e8e3640 1 -- 172.21.15.137:0/2696824699 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa10053d30 con 0x7faa10006a50 2024-04-26T21:58:52.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7f0b86ffd640 1 --2- 172.21.15.137:0/1319743479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80056cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b88063ef0 tx=0x7f0b880a6e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7f2473006a226c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7f0b85ffb640 1 -- 172.21.15.137:0/1319743479 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b880b4070 con 0x7f0b8003c240 2024-04-26T21:58:52.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7f0b85ffb640 1 -- 172.21.15.137:0/1319743479 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b880a7c50 con 0x7f0b8003c240 2024-04-26T21:58:52.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.131+0000 7f0b85ffb640 1 -- 172.21.15.137:0/1319743479 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b880af640 con 0x7f0b8003c240 2024-04-26T21:58:52.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266574921 0 0) 0x7fc6000b2c40 con 0x7fc60015f7b0 2024-04-26T21:58:52.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5ec003520 con 0x7fc60015f7b0 2024-04-26T21:58:52.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7faa1e8e3640 1 --2- 172.21.15.137:0/2696824699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa10006ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa18051470 tx=0x7faa180a6f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d8b2ef94347adc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679546309 0 0) 0x7fc6000b1ba0 con 0x7fc60006a290 2024-04-26T21:58:52.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6000b2c40 con 0x7fc60006a290 2024-04-26T21:58:52.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3646438401 0 0) 0x7fc5ec003520 con 0x7fc60015f7b0 2024-04-26T21:58:52.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 >> v2:172.21.15.170:3300/0 conn(0x7fc6000b16e0 msgr2=0x7fc60015e800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T21:58:52.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7fc604ebc640 1 --2- 172.21.15.137:0/3654553134 >> v2:172.21.15.170:3300/0 conn(0x7fc6000b16e0 0x7fc60015e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 >> v1:172.21.15.170:6789/0 conn(0x7fc60006a290 legacy=0x7fc60015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7faa1d0e0640 1 -- 172.21.15.137:0/2696824699 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa180b4070 con 0x7faa10006a50 2024-04-26T21:58:52.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6000b1e80 con 0x7fc60015f7b0 2024-04-26T21:58:52.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7faa1d0e0640 1 -- 172.21.15.137:0/2696824699 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa180a7db0 con 0x7faa10006a50 2024-04-26T21:58:52.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7faa1d0e0640 1 -- 172.21.15.137:0/2696824699 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa180af660 con 0x7faa10006a50 2024-04-26T21:58:52.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7f0b8d578640 1 -- 172.21.15.137:0/1319743479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 msgr2=0x7f0b80056cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7f0b8d578640 1 --2- 172.21.15.137:0/1319743479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80056cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0b88063ef0 tx=0x7f0b880a6e80 comp rx=0 tx=0).stop 2024-04-26T21:58:52.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fc5f0001520 con 0x7fc60015f7b0 2024-04-26T21:58:52.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7f0b8d578640 1 -- 172.21.15.137:0/1319743479 shutdown_connections 2024-04-26T21:58:52.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7f0b8d578640 1 --2- 172.21.15.137:0/1319743479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80056cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 >> v1:172.21.15.137:6789/0 conn(0x7fc60015f7b0 legacy=0x7fc6000ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.132+0000 7f0b8d578640 1 -- 172.21.15.137:0/1319743479 >> 172.21.15.137:0/1319743479 conn(0x7f0b80020860 msgr2=0x7f0b80057590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7f0b8d578640 1 -- 172.21.15.137:0/1319743479 shutdown_connections 2024-04-26T21:58:52.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7fc604ebc640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5ec003c40 0x7fc5ec004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7f0b8d578640 1 -- 172.21.15.137:0/1319743479 wait complete. 2024-04-26T21:58:52.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7faa1f0e4640 1 -- 172.21.15.137:0/2696824699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 msgr2=0x7faa10006ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7faa1f0e4640 1 --2- 172.21.15.137:0/2696824699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa10006ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa18051470 tx=0x7faa180a6f60 comp rx=0 tx=0).stop 2024-04-26T21:58:52.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7fc604ebc640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5ec004800 0x7fc5ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7faa1f0e4640 1 -- 172.21.15.137:0/2696824699 shutdown_connections 2024-04-26T21:58:52.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7faa1f0e4640 1 --2- 172.21.15.137:0/2696824699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa10006ec0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7faa1f0e4640 1 --2- 172.21.15.137:0/2696824699 >> v2:172.21.15.170:3300/0 conn(0x7faa1004b3c0 0x7faa10034020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.133+0000 7faa1f0e4640 1 -- 172.21.15.137:0/2696824699 >> 172.21.15.137:0/2696824699 conn(0x7faa1000a400 msgr2=0x7faa1000a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.134+0000 7faa1f0e4640 1 -- 172.21.15.137:0/2696824699 shutdown_connections 2024-04-26T21:58:52.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.134+0000 7fc604ebc640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5ec005410 0x7fc5ec00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.134+0000 7fc6056bd640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5ec004800 0x7fc5ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.134+0000 7fc6066bf640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5ec005410 0x7fc5ec00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.134+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6000b27b0 con 0x7fc5ec005410 2024-04-26T21:58:52.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.134+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec00c3a0 con 0x7fc5ec004800 2024-04-26T21:58:52.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.134+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc5ec00c5a0 con 0x7fc5ec003c40 2024-04-26T21:58:52.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.134+0000 7faa1f0e4640 1 -- 172.21.15.137:0/2696824699 wait complete. 2024-04-26T21:58:52.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.135+0000 7faa1f0e4640 1 Processor -- start 2024-04-26T21:58:52.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.136+0000 7f0b8d578640 1 Processor -- start 2024-04-26T21:58:52.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.136+0000 7f0b8d578640 1 -- start start 2024-04-26T21:58:52.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.135+0000 7fc6066bf640 1 -- 172.21.15.137:0/3654553134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5ec003c40 msgr2=0x7fc5ec004020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T21:58:52.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.135+0000 7fc6066bf640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc5ec003c40 0x7fc5ec004020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.135+0000 7fc6066bf640 1 -- 172.21.15.137:0/3654553134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5ec004800 msgr2=0x7fc5ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.135+0000 7fc6066bf640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5ec004800 0x7fc5ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.135+0000 7fc6066bf640 1 -- 172.21.15.137:0/3654553134 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec003520 con 0x7fc5ec005410 2024-04-26T21:58:52.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7fc6066bf640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5ec005410 0x7fc5ec00bac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0001d60 tx=0x7fc5ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd7bddd3285fb36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7fc6066bf640 1 -- 172.21.15.137:0/3654553134 reap_dead start 2024-04-26T21:58:52.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.136+0000 7faa1f0e4640 1 -- start start 2024-04-26T21:58:52.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000c0e0 con 0x7fc5ec005410 2024-04-26T21:58:52.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7fc604ebc640 1 -- 172.21.15.137:0/3654553134 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f002b840 con 0x7fc5ec005410 2024-04-26T21:58:52.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7f0b8d578640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80001e30 0x7f0b8016a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7faa1f0e4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa1017ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7faa1f0e4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1004b3c0 0x7faa1004bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7faa1f0e4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1004f4d0 0x7faa100e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7faa1f0e4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa10050060 con 0x7faa1004f4d0 2024-04-26T21:58:52.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7faa1f0e4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faa1004b7a0 con 0x7faa1004b3c0 2024-04-26T21:58:52.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7faa1f0e4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faa10054830 con 0x7faa10006a50 2024-04-26T21:58:52.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7f0b8d578640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80181660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.137+0000 7faa1e0e2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa1017ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7f0b86ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80001e30 0x7f0b8016a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7f0b86ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80001e30 0x7f0b8016a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60956/0 (socket says 172.21.15.137:60956) 2024-04-26T21:58:52.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7f0b86ffd640 1 -- 172.21.15.137:0/329377657 learned_addr learned my addr 172.21.15.137:0/329377657 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7faa1e8e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1004f4d0 0x7faa100e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7f0b8d578640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b8004ac50 0x7f0b8000d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7faa1e0e2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa1017ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40224/0 (socket says 172.21.15.137:40224) 2024-04-26T21:58:52.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80036d90 con 0x7f0b80001e30 2024-04-26T21:58:52.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7faa1e0e2640 1 -- 172.21.15.137:0/2844562287 learned_addr learned my addr 172.21.15.137:0/2844562287 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7f0b87fff640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b8004ac50 0x7f0b8000d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7f0b867fc640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80181660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b80036c10 con 0x7f0b8004ac50 2024-04-26T21:58:52.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7fc608122640 1 -- 172.21.15.137:0/3654553134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5ec005410 msgr2=0x7fc5ec00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7fc608122640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5ec005410 0x7fc5ec00bac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0001d60 tx=0x7fc5ec005830 comp rx=0 tx=0).stop 2024-04-26T21:58:52.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7fc608122640 1 -- 172.21.15.137:0/3654553134 shutdown_connections 2024-04-26T21:58:52.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7fc608122640 1 --2- 172.21.15.137:0/3654553134 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc5ec005410 0x7fc5ec00bac0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7fc608122640 1 -- 172.21.15.137:0/3654553134 >> 172.21.15.137:0/3654553134 conn(0x7fc6000b68a0 msgr2=0x7fc600073950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b80057200 con 0x7f0b8003c240 2024-04-26T21:58:52.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7fc608122640 1 -- 172.21.15.137:0/3654553134 shutdown_connections 2024-04-26T21:58:52.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.138+0000 7faa1e0e2640 1 -- 172.21.15.137:0/2844562287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1004b3c0 msgr2=0x7faa1004bf50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:58:52.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7faa1e0e2640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1004b3c0 0x7faa1004bf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7faa1e0e2640 1 -- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1004f4d0 msgr2=0x7faa100e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7faa1e0e2640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1004f4d0 0x7faa100e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7faa1e0e2640 1 -- 172.21.15.137:0/2844562287 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1004c660 con 0x7faa10006a50 2024-04-26T21:58:52.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7faa1e8e3640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1004f4d0 0x7faa100e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:52.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7fc608122640 1 -- 172.21.15.137:0/3654553134 wait complete. 2024-04-26T21:58:52.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7f0b867fc640 1 -- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b8004ac50 msgr2=0x7f0b8000d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7faa1e0e2640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa1017ca70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa0800c7f0 tx=0x7faa0800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7f0b867fc640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b8004ac50 0x7f0b8000d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.139+0000 7f0b867fc640 1 -- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80001e30 msgr2=0x7f0b8016a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b867fc640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80001e30 0x7f0b8016a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b867fc640 1 -- 172.21.15.137:0/329377657 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b80051b30 con 0x7f0b8003c240 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b86ffd640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80001e30 0x7f0b8016a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b87fff640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b8004ac50 0x7f0b8000d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b867fc640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80181660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c410 tx=0x7f0b7800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b6f7fe640 1 -- 172.21.15.137:0/329377657 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78007020 con 0x7f0b8003c240 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b6f7fe640 1 -- 172.21.15.137:0/329377657 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b780071c0 con 0x7f0b8003c240 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b6f7fe640 1 -- 172.21.15.137:0/329377657 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b780075b0 con 0x7f0b8003c240 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7faa0effd640 1 -- 172.21.15.137:0/2844562287 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08015070 con 0x7faa10006a50 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7faa1f0e4640 1 -- 172.21.15.137:0/2844562287 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1004c940 con 0x7faa10006a50 2024-04-26T21:58:52.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7faa1f0e4640 1 -- 172.21.15.137:0/2844562287 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1004cf00 con 0x7faa10006a50 2024-04-26T21:58:52.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.141+0000 7fc608122640 1 Processor -- start 2024-04-26T21:58:52.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.141+0000 7fc608122640 1 -- start start 2024-04-26T21:58:52.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b80051db0 con 0x7f0b8003c240 2024-04-26T21:58:52.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.140+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b80052370 con 0x7f0b8003c240 2024-04-26T21:58:52.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.141+0000 7faa0effd640 1 -- 172.21.15.137:0/2844562287 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa08004220 con 0x7faa10006a50 2024-04-26T21:58:52.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.141+0000 7faa0effd640 1 -- 172.21.15.137:0/2844562287 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08015070 con 0x7faa10006a50 2024-04-26T21:58:52.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.142+0000 7faa1f0e4640 1 -- 172.21.15.137:0/2844562287 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa00005290 con 0x7faa10006a50 2024-04-26T21:58:52.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.142+0000 7fc608122640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600150530 0x7fc60006f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.143+0000 7fc608122640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc60016e950 0x7fc6001fc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.143+0000 7fc605ebe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600150530 0x7fc60006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.143+0000 7fc605ebe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600150530 0x7fc60006f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54538/0 (socket says 172.21.15.137:54538) 2024-04-26T21:58:52.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.143+0000 7fc605ebe640 1 -- 172.21.15.137:0/4210911799 learned_addr learned my addr 172.21.15.137:0/4210911799 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.143+0000 7fc608122640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc600150910 0x7fc6001fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.143+0000 7fc6056bd640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc60016e950 0x7fc6001fc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.144+0000 7fc6066bf640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc600150910 0x7fc6001fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.144+0000 7fc608122640 1 -- 172.21.15.137:0/4210911799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6000cd6c0 con 0x7fc600150910 2024-04-26T21:58:52.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.144+0000 7fc608122640 1 -- 172.21.15.137:0/4210911799 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc6000b2440 con 0x7fc600150530 2024-04-26T21:58:52.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.144+0000 7fc608122640 1 -- 172.21.15.137:0/4210911799 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc6000cd840 con 0x7fc60016e950 2024-04-26T21:58:52.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.144+0000 7faa0effd640 1 -- 172.21.15.137:0/2844562287 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa08038790 con 0x7faa10006a50 2024-04-26T21:58:52.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.144+0000 7faa0effd640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9fc06caf0 0x7fa9fc06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.144+0000 7f0b6f7fe640 1 -- 172.21.15.137:0/329377657 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b78019020 con 0x7f0b8003c240 2024-04-26T21:58:52.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.144+0000 7f0b6f7fe640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c8f0 0x7f0b7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7faa1d8e1640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9fc06caf0 0x7fa9fc06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7faa0effd640 1 -- 172.21.15.137:0/2844562287 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faa08057860 con 0x7faa10006a50 2024-04-26T21:58:52.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7fc6066bf640 1 -- 172.21.15.137:0/4210911799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc60016e950 msgr2=0x7fc6001fc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7f0b6f7fe640 1 -- 172.21.15.137:0/329377657 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b78056fa0 con 0x7f0b8003c240 2024-04-26T21:58:52.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7fc6066bf640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc60016e950 0x7fc6001fc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7f0b86ffd640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c8f0 0x7f0b7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7fc6066bf640 1 -- 172.21.15.137:0/4210911799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600150530 msgr2=0x7fc60006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7fc6066bf640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600150530 0x7fc60006f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7fc6066bf640 1 -- 172.21.15.137:0/4210911799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60016eec0 con 0x7fc600150910 2024-04-26T21:58:52.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b80007100 con 0x7f0b8003c240 2024-04-26T21:58:52.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.145+0000 7fc6066bf640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc600150910 0x7fc6001fce30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc600073300 tx=0x7fc5f002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.146+0000 7fc5f67fc640 1 -- 172.21.15.137:0/4210911799 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0042070 con 0x7fc600150910 2024-04-26T21:58:52.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.146+0000 7fc5f67fc640 1 -- 172.21.15.137:0/4210911799 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f002b800 con 0x7fc600150910 2024-04-26T21:58:52.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.146+0000 7faa1d8e1640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9fc06caf0 0x7fa9fc06efb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa100ea2d0 tx=0x7faa14007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.146+0000 7f0b86ffd640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c8f0 0x7f0b7406edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b88051470 tx=0x7f0b880ab000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.146+0000 7fc5f67fc640 1 -- 172.21.15.137:0/4210911799 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0005270 con 0x7fc600150910 2024-04-26T21:58:52.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.146+0000 7fc608122640 1 -- 172.21.15.137:0/4210911799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60014a250 con 0x7fc600150910 2024-04-26T21:58:52.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.146+0000 7fc608122640 1 -- 172.21.15.137:0/4210911799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60014d790 con 0x7fc600150910 2024-04-26T21:58:52.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.147+0000 7fc608122640 1 -- 172.21.15.137:0/4210911799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6000693d0 con 0x7fc600150910 2024-04-26T21:58:52.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.148+0000 7fc5f67fc640 1 -- 172.21.15.137:0/4210911799 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5f00336f0 con 0x7fc600150910 2024-04-26T21:58:52.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.148+0000 7fc5f67fc640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc5e406c940 0x7fc5e406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.149+0000 7fc5f67fc640 1 -- 172.21.15.137:0/4210911799 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc5f00ab190 con 0x7fc600150910 2024-04-26T21:58:52.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.148+0000 7faa0effd640 1 -- 172.21.15.137:0/2844562287 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faa080597c0 con 0x7faa10006a50 2024-04-26T21:58:52.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.149+0000 7fc605ebe640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc5e406c940 0x7fc5e406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.150+0000 7fc605ebe640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc5e406c940 0x7fc5e406ee00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc006fd0 tx=0x7fc5fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.153+0000 7f0b6f7fe640 1 -- 172.21.15.137:0/329377657 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0b80051b30 con 0x7f0b8003c240 2024-04-26T21:58:52.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.154+0000 7fc5f67fc640 1 -- 172.21.15.137:0/4210911799 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc5f0079730 con 0x7fc600150910 2024-04-26T21:58:52.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.188+0000 7f0c20989640 1 Processor -- start 2024-04-26T21:58:52.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.188+0000 7f0c20989640 1 -- start start 2024-04-26T21:58:52.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.188+0000 7f58a9312640 1 Processor -- start 2024-04-26T21:58:52.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.189+0000 7f58a9312640 1 -- start start 2024-04-26T21:58:52.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f0c20989640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0c1c0d1210 0x7f0c1c0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f0c20989640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1c0b6b90 con 0x7f0c1c06d9c0 2024-04-26T21:58:52.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f0c20989640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1c0b4790 con 0x7f0c1c068090 2024-04-26T21:58:52.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f0c20989640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0c1c0b4a70 con 0x7f0c1c0d1210 2024-04-26T21:58:52.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a9312640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f58a4163610 0x7f58a406fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a9312640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f58a41639f0 0x7f58a40cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f7923316640 1 Processor -- start 2024-04-26T21:58:52.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.189+0000 7fc33da20640 1 Processor -- start 2024-04-26T21:58:52.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.189+0000 7fc33da20640 1 -- start start 2024-04-26T21:58:52.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a9312640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a40d0410 0x7f58a406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a9312640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f58a4071b30 con 0x7f58a41639f0 2024-04-26T21:58:52.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a9312640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f58a4164370 con 0x7f58a4163610 2024-04-26T21:58:52.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a9312640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f58a4164650 con 0x7f58a40d0410 2024-04-26T21:58:52.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a27fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f58a41639f0 0x7f58a40cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a27fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f58a41639f0 0x7f58a40cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60988/0 (socket says 172.21.15.137:60988) 2024-04-26T21:58:52.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a27fc640 1 -- 172.21.15.137:0/1411780235 learned_addr learned my addr 172.21.15.137:0/1411780235 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f58a2ffd640 1 --2- 172.21.15.137:0/1411780235 >> v2:172.21.15.170:3300/0 conn(0x7f58a4163610 0x7f58a406fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f7923316640 1 -- start start 2024-04-26T21:58:52.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f0c1ad9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0c1c06d9c0 0x7f0c1c0b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42100/0 (socket says 172.21.15.137:42100) 2024-04-26T21:58:52.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.190+0000 7f0c1ad9d640 1 -- 172.21.15.137:0/2292500917 learned_addr learned my addr 172.21.15.137:0/2292500917 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:52.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7fc33da20640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc338166cf0 0x7fc3380b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f58a37fe640 1 --2- 172.21.15.137:0/1411780235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a40d0410 0x7f58a406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f58a27fc640 1 -- 172.21.15.137:0/1411780235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a40d0410 msgr2=0x7f58a406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f58a27fc640 1 --2- 172.21.15.137:0/1411780235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a40d0410 0x7f58a406c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7fc33da20640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc3380b0f00 0x7fc33806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f58a27fc640 1 -- 172.21.15.137:0/1411780235 >> v2:172.21.15.170:3300/0 conn(0x7f58a4163610 msgr2=0x7f58a406fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f58a27fc640 1 --2- 172.21.15.137:0/1411780235 >> v2:172.21.15.170:3300/0 conn(0x7f58a4163610 0x7f58a406fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f58a27fc640 1 -- 172.21.15.137:0/1411780235 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a4164930 con 0x7f58a41639f0 2024-04-26T21:58:52.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7fc33da20640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7fc33da20640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc338164b80 con 0x7fc3380b0f00 2024-04-26T21:58:52.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7fc33da20640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc33806dc20 con 0x7fc338166cf0 2024-04-26T21:58:52.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7fc33da20640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc3380683c0 con 0x7fc33806d7f0 2024-04-26T21:58:52.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f0c1a59c640 1 --2- 172.21.15.137:0/2292500917 >> v2:172.21.15.137:3300/0 conn(0x7f0c1c0d1210 0x7f0c1c0b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7fc3377fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7fc3377fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40242/0 (socket says 172.21.15.137:40242) 2024-04-26T21:58:52.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7fc3377fe640 1 -- 172.21.15.137:0/1785719747 learned_addr learned my addr 172.21.15.137:0/1785719747 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7fc3377fe640 1 -- 172.21.15.137:0/1785719747 >> v2:172.21.15.170:3300/0 conn(0x7fc338166cf0 msgr2=0x7fc3380b09c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T21:58:52.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7fc3377fe640 1 --2- 172.21.15.137:0/1785719747 >> v2:172.21.15.170:3300/0 conn(0x7fc338166cf0 0x7fc3380b09c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7fc3377fe640 1 -- 172.21.15.137:0/1785719747 >> v2:172.21.15.137:3300/0 conn(0x7fc3380b0f00 msgr2=0x7fc33806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7fc3377fe640 1 --2- 172.21.15.137:0/1785719747 >> v2:172.21.15.137:3300/0 conn(0x7fc3380b0f00 0x7fc33806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7fc3377fe640 1 -- 172.21.15.137:0/1785719747 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc338163cb0 con 0x7fc33806d7f0 2024-04-26T21:58:52.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7f7923316640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f79140df800 0x7f7914055d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7f7923316640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7914050150 con 0x7f791403a0a0 2024-04-26T21:58:52.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f7922b15640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f791403a0a0 0x7f791403a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42116/0 (socket says 172.21.15.137:42116) 2024-04-26T21:58:52.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f7922b15640 1 -- 172.21.15.137:0/2417014612 learned_addr learned my addr 172.21.15.137:0/2417014612 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:52.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7f0c1a59c640 1 -- 172.21.15.137:0/2292500917 >> v1:172.21.15.170:6789/0 conn(0x7f0c1c068090 legacy=0x7f0c1c06d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T21:58:52.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f7923316640 1 -- 172.21.15.137:0/2417014612 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7914006c30 con 0x7f79140366a0 2024-04-26T21:58:52.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f7923316640 1 -- 172.21.15.137:0/2417014612 --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7914006f10 con 0x7f79140df800 2024-04-26T21:58:52.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f8bc7664640 1 Processor -- start 2024-04-26T21:58:52.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7f0c1a59c640 1 -- 172.21.15.137:0/2292500917 >> v1:172.21.15.137:6789/0 conn(0x7f0c1c06d9c0 legacy=0x7f0c1c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.192+0000 7f0c1a59c640 1 -- 172.21.15.137:0/2292500917 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1c0b4d50 con 0x7f0c1c0d1210 2024-04-26T21:58:52.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.191+0000 7f8bc7664640 1 -- start start 2024-04-26T21:58:52.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f8bc7664640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc015c5f0 0x7f8bc013f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7fc3377fe640 1 --2- 172.21.15.137:0/1785719747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381672a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc338073a60 tx=0x7fc32c02a1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ddb114ddb2e9ce2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f8bc7664640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc013fe00 con 0x7f8bc015fb70 2024-04-26T21:58:52.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f8bc7664640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc0070910 con 0x7f8bc00731c0 2024-04-26T21:58:52.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f8bc7664640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc0160050 con 0x7f8bc015c5f0 2024-04-26T21:58:52.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f8bc4bff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8bc015fb70 0x7f8bc00cde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42122/0 (socket says 172.21.15.137:42122) 2024-04-26T21:58:52.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f8bc4bff640 1 -- 172.21.15.137:0/373966844 learned_addr learned my addr 172.21.15.137:0/373966844 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:52.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f0c1a59c640 1 --2- 172.21.15.137:0/2292500917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c0d1210 0x7f0c1c0b5550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0097a0 tx=0x7f0c0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852a2b93927f6746 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f7922314640 1 --2- 172.21.15.137:0/2417014612 >> v2:172.21.15.137:3300/0 conn(0x7f79140df800 0x7f7914055d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2389019165 0 0) 0x7f7914050150 con 0x7f791403a0a0 2024-04-26T21:58:52.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7fc335ffb640 1 -- 172.21.15.137:0/1785719747 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c037070 con 0x7fc33806d7f0 2024-04-26T21:58:52.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f8bc5400640 1 --2- 172.21.15.137:0/373966844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc015c5f0 0x7f8bc013f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7908003520 con 0x7f791403a0a0 2024-04-26T21:58:52.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7fc335ffb640 1 -- 172.21.15.137:0/1785719747 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c032440 con 0x7fc33806d7f0 2024-04-26T21:58:52.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.193+0000 7f58a27fc640 1 --2- 172.21.15.137:0/1411780235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a41639f0 0x7f58a40cfed0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58a40760b0 tx=0x7f589c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdb63e4598b2ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f0c1959a640 1 -- 172.21.15.137:0/2292500917 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c037070 con 0x7f0c1c0d1210 2024-04-26T21:58:52.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f8bb7fff640 1 -- 172.21.15.137:0/373966844 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351723545 0 0) 0x7f8bc013fe00 con 0x7f8bc015fb70 2024-04-26T21:58:52.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f8bb7fff640 1 -- 172.21.15.137:0/373966844 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bac003520 con 0x7f8bc015fb70 2024-04-26T21:58:52.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f0c1959a640 1 -- 172.21.15.137:0/2292500917 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c0c032440 con 0x7f0c1c0d1210 2024-04-26T21:58:52.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f0c1959a640 1 -- 172.21.15.137:0/2292500917 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c032810 con 0x7f0c1c0d1210 2024-04-26T21:58:52.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f8bc5400640 1 -- 172.21.15.137:0/373966844 >> v1:172.21.15.170:6789/0 conn(0x7f8bc00731c0 legacy=0x7f8bc0141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f8bc5400640 1 -- 172.21.15.137:0/373966844 >> v1:172.21.15.137:6789/0 conn(0x7f8bc015fb70 legacy=0x7f8bc00cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f8bc5400640 1 -- 172.21.15.137:0/373966844 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc0160330 con 0x7f8bc015c5f0 2024-04-26T21:58:52.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1197618530 0 0) 0x7f7908003520 con 0x7f791403a0a0 2024-04-26T21:58:52.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 >> v2:172.21.15.137:3300/0 conn(0x7f79140df800 msgr2=0x7f7914055d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 --2- 172.21.15.137:0/2417014612 >> v2:172.21.15.137:3300/0 conn(0x7f79140df800 0x7f7914055d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 >> v1:172.21.15.170:6789/0 conn(0x7f79140366a0 legacy=0x7f791404fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79140071f0 con 0x7f791403a0a0 2024-04-26T21:58:52.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f7918001670 con 0x7f791403a0a0 2024-04-26T21:58:52.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 >> v1:172.21.15.137:6789/0 conn(0x7f791403a0a0 legacy=0x7f791403a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908003a00 0x7f7908003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f58a1ffb640 1 -- 172.21.15.137:0/1411780235 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c036070 con 0x7f58a41639f0 2024-04-26T21:58:52.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f58a1ffb640 1 -- 172.21.15.137:0/1411780235 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c031600 con 0x7f58a41639f0 2024-04-26T21:58:52.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f58a1ffb640 1 -- 172.21.15.137:0/1411780235 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c0319d0 con 0x7f58a41639f0 2024-04-26T21:58:52.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7908004800 0x7f7908004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7f7921312640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7908005230 0x7f790800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.194+0000 7fc33da20640 1 -- 172.21.15.137:0/1785719747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 msgr2=0x7fc3381672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7fc33da20640 1 --2- 172.21.15.137:0/1785719747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381672a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc338073a60 tx=0x7fc32c02a1f0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7914006f10 con 0x7f7908004800 2024-04-26T21:58:52.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f790800c180 con 0x7f7908005230 2024-04-26T21:58:52.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f790800c380 con 0x7f7908003a00 2024-04-26T21:58:52.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7922b15640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7908005230 0x7f790800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7fc33da20640 1 -- 172.21.15.137:0/1785719747 shutdown_connections 2024-04-26T21:58:52.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7fc33da20640 1 --2- 172.21.15.137:0/1785719747 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381672a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7fc33da20640 1 --2- 172.21.15.137:0/1785719747 >> v2:172.21.15.137:3300/0 conn(0x7fc3380b0f00 0x7fc33806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7fc33da20640 1 --2- 172.21.15.137:0/1785719747 >> v2:172.21.15.170:3300/0 conn(0x7fc338166cf0 0x7fc3380b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7fc33da20640 1 -- 172.21.15.137:0/1785719747 >> 172.21.15.137:0/1785719747 conn(0x7fc338072900 msgr2=0x7fc338072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f0c20989640 1 -- 172.21.15.137:0/2292500917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c0d1210 msgr2=0x7f0c1c0b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f0c20989640 1 --2- 172.21.15.137:0/2292500917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c0d1210 0x7f0c1c0b5550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0097a0 tx=0x7f0c0c02a1e0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f8bc5400640 1 --2- 172.21.15.137:0/373966844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc015c5f0 0x7f8bc013f720 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0097d0 tx=0x7f8bbc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92a583a516379d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7921b13640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7908004800 0x7f7908004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f0c20989640 1 -- 172.21.15.137:0/2292500917 shutdown_connections 2024-04-26T21:58:52.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f0c20989640 1 --2- 172.21.15.137:0/2292500917 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c0d1210 0x7f0c1c0b5550 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f0c20989640 1 -- 172.21.15.137:0/2292500917 >> 172.21.15.137:0/2292500917 conn(0x7f0c1c072900 msgr2=0x7f0c1c072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f8bb7fff640 1 -- 172.21.15.137:0/373966844 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc037070 con 0x7f8bc015c5f0 2024-04-26T21:58:52.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f8bb7fff640 1 -- 172.21.15.137:0/373966844 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc032440 con 0x7f8bc015c5f0 2024-04-26T21:58:52.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f8bb7fff640 1 -- 172.21.15.137:0/373966844 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc032810 con 0x7f8bc015c5f0 2024-04-26T21:58:52.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f58a9312640 1 -- 172.21.15.137:0/1411780235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a41639f0 msgr2=0x7f58a40cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f58a9312640 1 --2- 172.21.15.137:0/1411780235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a41639f0 0x7f58a40cfed0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58a40760b0 tx=0x7f589c02a6a0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7922b15640 1 -- 172.21.15.137:0/2417014612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908003a00 msgr2=0x7f7908003e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T21:58:52.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7922b15640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908003a00 0x7f7908003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7922b15640 1 -- 172.21.15.137:0/2417014612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7908004800 msgr2=0x7f7908004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7922b15640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7908004800 0x7f7908004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7f7922b15640 1 -- 172.21.15.137:0/2417014612 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7908003520 con 0x7f7908005230 2024-04-26T21:58:52.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.195+0000 7fc33da20640 1 -- 172.21.15.137:0/1785719747 shutdown_connections 2024-04-26T21:58:52.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7fc33da20640 1 -- 172.21.15.137:0/1785719747 wait complete. 2024-04-26T21:58:52.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f0c20989640 1 -- 172.21.15.137:0/2292500917 shutdown_connections 2024-04-26T21:58:52.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f58a9312640 1 -- 172.21.15.137:0/1411780235 shutdown_connections 2024-04-26T21:58:52.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f58a9312640 1 --2- 172.21.15.137:0/1411780235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a40d0410 0x7f58a406c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f58a9312640 1 --2- 172.21.15.137:0/1411780235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a41639f0 0x7f58a40cfed0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f58a9312640 1 --2- 172.21.15.137:0/1411780235 >> v2:172.21.15.170:3300/0 conn(0x7f58a4163610 0x7f58a406fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f58a9312640 1 -- 172.21.15.137:0/1411780235 >> 172.21.15.137:0/1411780235 conn(0x7f58a40d1e30 msgr2=0x7f58a40d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f58a9312640 1 -- 172.21.15.137:0/1411780235 shutdown_connections 2024-04-26T21:58:52.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f8bc7664640 1 -- 172.21.15.137:0/373966844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc015c5f0 msgr2=0x7f8bc013f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f7922b15640 1 -- 172.21.15.137:0/2417014612 reap_dead start 2024-04-26T21:58:52.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f8bc7664640 1 --2- 172.21.15.137:0/373966844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc015c5f0 0x7f8bc013f720 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0097d0 tx=0x7f8bbc02a1c0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f8bc7664640 1 -- 172.21.15.137:0/373966844 shutdown_connections 2024-04-26T21:58:52.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f8bc7664640 1 --2- 172.21.15.137:0/373966844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc015c5f0 0x7f8bc013f720 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc0097d0 tx=0x7f8bbc02a1c0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f8bc7664640 1 -- 172.21.15.137:0/373966844 >> 172.21.15.137:0/373966844 conn(0x7f8bc00d1e30 msgr2=0x7f8bc00d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f0c20989640 1 -- 172.21.15.137:0/2292500917 wait complete. 2024-04-26T21:58:52.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.196+0000 7f58a9312640 1 -- 172.21.15.137:0/1411780235 wait complete. 2024-04-26T21:58:52.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.197+0000 7f7922b15640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7908005230 0x7f790800b9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f791800c110 tx=0x7f7908005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76fca47dad35872 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.197+0000 7f8bc7664640 1 -- 172.21.15.137:0/373966844 shutdown_connections 2024-04-26T21:58:52.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.197+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918036020 con 0x7f7908005230 2024-04-26T21:58:52.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.197+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7918005af0 con 0x7f7908005230 2024-04-26T21:58:52.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.197+0000 7f7921312640 1 -- 172.21.15.137:0/2417014612 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918007c40 con 0x7f7908005230 2024-04-26T21:58:52.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.198+0000 7fc33da20640 1 Processor -- start 2024-04-26T21:58:52.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.198+0000 7fc33da20640 1 -- start start 2024-04-26T21:58:52.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.198+0000 7f0c20989640 1 Processor -- start 2024-04-26T21:58:52.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.197+0000 7f8bc7664640 1 -- 172.21.15.137:0/373966844 wait complete. 2024-04-26T21:58:52.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.198+0000 7f0c20989640 1 -- start start 2024-04-26T21:58:52.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f7923316640 1 -- 172.21.15.137:0/2417014612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7908005230 msgr2=0x7f790800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f7923316640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7908005230 0x7f790800b9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f791800c110 tx=0x7f7908005830 comp rx=0 tx=0).stop 2024-04-26T21:58:52.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.198+0000 7f58a9312640 1 Processor -- start 2024-04-26T21:58:52.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.198+0000 7f58a9312640 1 -- start start 2024-04-26T21:58:52.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f8bc7664640 1 Processor -- start 2024-04-26T21:58:52.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f7923316640 1 -- 172.21.15.137:0/2417014612 shutdown_connections 2024-04-26T21:58:52.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f7923316640 1 --2- 172.21.15.137:0/2417014612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7908005230 0x7f790800b9c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f7923316640 1 -- 172.21.15.137:0/2417014612 >> 172.21.15.137:0/2417014612 conn(0x7f791401e6c0 msgr2=0x7f79140553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f58a9312640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a40d0410 0x7f58a4157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7fc33da20640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381edda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7fc33da20640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3380b0f00 0x7fc3381ec400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f0c20989640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c068090 0x7f0c1c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f0c20989640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c1c06d9c0 0x7f0c1c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f0c20989640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c1c0d1210 0x7f0c1c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f0c20989640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c068650 con 0x7f0c1c068090 2024-04-26T21:58:52.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f0c20989640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c0684d0 con 0x7f0c1c0d1210 2024-04-26T21:58:52.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f0c20989640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1c0b6530 con 0x7f0c1c06d9c0 2024-04-26T21:58:52.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f7923316640 1 -- 172.21.15.137:0/2417014612 shutdown_connections 2024-04-26T21:58:52.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f7923316640 1 -- 172.21.15.137:0/2417014612 wait complete. 2024-04-26T21:58:52.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7fc33da20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc338166cf0 0x7fc33815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a40d0410 0x7f58a4157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a40d0410 0x7f58a4157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32798/0 (socket says 172.21.15.137:32798) 2024-04-26T21:58:52.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a2ffd640 1 -- 172.21.15.137:0/3773730531 learned_addr learned my addr 172.21.15.137:0/3773730531 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a9312640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a4163610 0x7f58a41490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f0c1a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c068090 0x7f0c1c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7fc33da20640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc338164530 con 0x7fc338166cf0 2024-04-26T21:58:52.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7fc3377fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc338166cf0 0x7fc33815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a9312640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58a41639f0 0x7f58a415f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7fc3377fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc338166cf0 0x7fc33815bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32814/0 (socket says 172.21.15.137:32814) 2024-04-26T21:58:52.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7fc3377fe640 1 -- 172.21.15.137:0/2632632412 learned_addr learned my addr 172.21.15.137:0/2632632412 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a27fc640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a4163610 0x7f58a41490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f0c1a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c068090 0x7f0c1c15fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32806/0 (socket says 172.21.15.137:32806) 2024-04-26T21:58:52.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f0c1a59c640 1 -- 172.21.15.137:0/1001029975 learned_addr learned my addr 172.21.15.137:0/1001029975 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc338164250 con 0x7fc3380b0f00 2024-04-26T21:58:52.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc338164810 con 0x7fc33806d7f0 2024-04-26T21:58:52.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f0c19d9b640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c1c06d9c0 0x7f0c1c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a37fe640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58a41639f0 0x7f58a415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f58a4163e80 con 0x7f58a40d0410 2024-04-26T21:58:52.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f58a4167340 con 0x7f58a41639f0 2024-04-26T21:58:52.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f58a4164000 con 0x7f58a4163610 2024-04-26T21:58:52.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7fc3367fc640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3380b0f00 0x7fc3381ec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.199+0000 7f8bc7664640 1 -- start start 2024-04-26T21:58:52.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7fc336ffd640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f8bc7664640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc00731c0 0x7f8bc013de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f8bc7664640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bc015fb70 0x7f8bc015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f8bc7664640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bc006caa0 0x7f8bc015f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f8bc7664640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc0141780 con 0x7f8bc015fb70 2024-04-26T21:58:52.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f8bc7664640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc01608f0 con 0x7f8bc006caa0 2024-04-26T21:58:52.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.200+0000 7f8bc7664640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8bc00ce550 con 0x7f8bc00731c0 2024-04-26T21:58:52.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f8bc5400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc00731c0 0x7f8bc013de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f8bc5c01640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bc006caa0 0x7f8bc015f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f8bc5400640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc00731c0 0x7f8bc013de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40304/0 (socket says 172.21.15.137:40304) 2024-04-26T21:58:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f8bc5400640 1 -- 172.21.15.137:0/1217027333 learned_addr learned my addr 172.21.15.137:0/1217027333 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f0c1a59c640 1 -- 172.21.15.137:0/1001029975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c1c06d9c0 msgr2=0x7f0c1c15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f0c1a59c640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c1c06d9c0 0x7f0c1c15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f0c1a59c640 1 -- 172.21.15.137:0/1001029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c1c0d1210 msgr2=0x7f0c1c15def0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T21:58:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f0c1a59c640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c1c0d1210 0x7f0c1c15def0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f0c1a59c640 1 -- 172.21.15.137:0/1001029975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1c147e30 con 0x7f0c1c068090 2024-04-26T21:58:52.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7fc3367fc640 1 -- 172.21.15.137:0/2632632412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 msgr2=0x7fc3381edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f0c1a59c640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c068090 0x7f0c1c15fd00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0098c0 tx=0x7f0c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7fc3367fc640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381edda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f58a37fe640 1 -- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a4163610 msgr2=0x7f58a41490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f8bc4bff640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bc015fb70 0x7f8bc015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7fc3367fc640 1 -- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc338166cf0 msgr2=0x7fc33815bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7fc3367fc640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc338166cf0 0x7fc33815bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7fc3367fc640 1 -- 172.21.15.137:0/2632632412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3381ecd00 con 0x7fc3380b0f00 2024-04-26T21:58:52.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f58a37fe640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a4163610 0x7f58a41490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7fc3377fe640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc338166cf0 0x7fc33815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:52.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f58a37fe640 1 -- 172.21.15.137:0/3773730531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a40d0410 msgr2=0x7f58a4157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f58a37fe640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a40d0410 0x7f58a4157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.201+0000 7f58a37fe640 1 -- 172.21.15.137:0/3773730531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a41fa350 con 0x7f58a41639f0 2024-04-26T21:58:52.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f0c0affd640 1 -- 172.21.15.137:0/1001029975 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c042020 con 0x7f0c1c068090 2024-04-26T21:58:52.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7fc3367fc640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3380b0f00 0x7fc3381ec400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc32800b3f0 tx=0x7fc32800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f8bc4bff640 1 -- 172.21.15.137:0/1217027333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc00731c0 msgr2=0x7f8bc013de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f8bc4bff640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc00731c0 0x7f8bc013de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f8bc4bff640 1 -- 172.21.15.137:0/1217027333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bc006caa0 msgr2=0x7f8bc015f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f8bc4bff640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bc006caa0 0x7f8bc015f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f8bc4bff640 1 -- 172.21.15.137:0/1217027333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc013a880 con 0x7f8bc015fb70 2024-04-26T21:58:52.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f7923316640 1 Processor -- start 2024-04-26T21:58:52.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f7923316640 1 -- start start 2024-04-26T21:58:52.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f58a37fe640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58a41639f0 0x7f58a415f490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f589800c590 tx=0x7f589800ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f8bc4bff640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bc015fb70 0x7f8bc015eb80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000c3c0 tx=0x7f8bb0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f8bb5ffb640 1 -- 172.21.15.137:0/1217027333 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0017070 con 0x7f8bc015fb70 2024-04-26T21:58:52.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7923316640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908005230 0x7f79140e2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7923316640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79140e0770 0x7f79140cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1c1480d0 con 0x7f0c1c068090 2024-04-26T21:58:52.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c1c148690 con 0x7f0c1c068090 2024-04-26T21:58:52.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f0c0affd640 1 -- 172.21.15.137:0/1001029975 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c0c030b70 con 0x7f0c1c068090 2024-04-26T21:58:52.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f0c0affd640 1 -- 172.21.15.137:0/1001029975 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c037040 con 0x7f0c1c068090 2024-04-26T21:58:52.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7922314640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908005230 0x7f79140e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7922314640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908005230 0x7f79140e2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40308/0 (socket says 172.21.15.137:40308) 2024-04-26T21:58:52.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7923316640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914033ec0 0x7f7914034370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7921b13640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79140e0770 0x7f79140cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7921b13640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79140e0770 0x7f79140cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32838/0 (socket says 172.21.15.137:32838) 2024-04-26T21:58:52.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7923316640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79140dfbe0 con 0x7f79140e0770 2024-04-26T21:58:52.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.202+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc013ab60 con 0x7f8bc015fb70 2024-04-26T21:58:52.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc013b120 con 0x7f8bc015fb70 2024-04-26T21:58:52.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f8bb5ffb640 1 -- 172.21.15.137:0/1217027333 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb0005ce0 con 0x7f8bc015fb70 2024-04-26T21:58:52.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7923316640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7914036b10 con 0x7f7914033ec0 2024-04-26T21:58:52.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7922314640 1 -- 172.21.15.137:0/679213424 learned_addr learned my addr 172.21.15.137:0/679213424 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.203+0000 7f7923316640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7914055d10 con 0x7f7908005230 2024-04-26T21:58:52.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c00005290 con 0x7f0c1c068090 2024-04-26T21:58:52.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f7922b15640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914033ec0 0x7f7914034370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f7921b13640 1 -- 172.21.15.137:0/679213424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908005230 msgr2=0x7f79140e2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f7921b13640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908005230 0x7f79140e2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f7921b13640 1 -- 172.21.15.137:0/679213424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914033ec0 msgr2=0x7f7914034370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f7921b13640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914033ec0 0x7f7914034370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f7921b13640 1 -- 172.21.15.137:0/679213424 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79140e0c70 con 0x7f79140e0770 2024-04-26T21:58:52.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f7922b15640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914033ec0 0x7f7914034370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:52.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f7922314640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908005230 0x7f79140e2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:52.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f7921b13640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79140e0770 0x7f79140cdf30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f790c00f520 tx=0x7f790c00f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.204+0000 7f8bb5ffb640 1 -- 172.21.15.137:0/1217027333 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00072f0 con 0x7f8bc015fb70 2024-04-26T21:58:52.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.205+0000 7f588b7fe640 1 -- 172.21.15.137:0/3773730531 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898015070 con 0x7f58a41639f0 2024-04-26T21:58:52.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.205+0000 7f588b7fe640 1 -- 172.21.15.137:0/3773730531 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5898004220 con 0x7f58a41639f0 2024-04-26T21:58:52.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.205+0000 7f7912ffd640 1 -- 172.21.15.137:0/679213424 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c014680 con 0x7f79140e0770 2024-04-26T21:58:52.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.205+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a41fa630 con 0x7f58a41639f0 2024-04-26T21:58:52.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.205+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a41fabf0 con 0x7f58a41639f0 2024-04-26T21:58:52.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.205+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79140e0f50 con 0x7f79140e0770 2024-04-26T21:58:52.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.205+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79140e1510 con 0x7f79140e0770 2024-04-26T21:58:52.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.205+0000 7f8bb5ffb640 1 -- 172.21.15.137:0/1217027333 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8bb001a070 con 0x7f8bc015fb70 2024-04-26T21:58:52.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.205+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba0005290 con 0x7f8bc015fb70 2024-04-26T21:58:52.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7f8bb5ffb640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8ba406c8f0 0x7f8ba406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7f8bb5ffb640 1 -- 172.21.15.137:0/1217027333 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8bb008ae10 con 0x7f8bc015fb70 2024-04-26T21:58:52.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.207+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79140057e0 con 0x7f79140e0770 2024-04-26T21:58:52.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7fc31ffff640 1 -- 172.21.15.137:0/2632632412 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328015020 con 0x7fc3380b0f00 2024-04-26T21:58:52.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7fc31ffff640 1 -- 172.21.15.137:0/2632632412 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc328011830 con 0x7fc3380b0f00 2024-04-26T21:58:52.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3381ecfe0 con 0x7fc3380b0f00 2024-04-26T21:58:52.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3381ed5a0 con 0x7fc3380b0f00 2024-04-26T21:58:52.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.207+0000 7fc31ffff640 1 -- 172.21.15.137:0/2632632412 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328011c20 con 0x7fc3380b0f00 2024-04-26T21:58:52.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7f588b7fe640 1 -- 172.21.15.137:0/3773730531 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5898003610 con 0x7f58a41639f0 2024-04-26T21:58:52.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7f0c0affd640 1 -- 172.21.15.137:0/1001029975 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c0c045020 con 0x7f0c1c068090 2024-04-26T21:58:52.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7f0c0affd640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0bfc06c9c0 0x7f0bfc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7f0c19d9b640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0bfc06c9c0 0x7f0bfc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.206+0000 7f0c0affd640 1 -- 172.21.15.137:0/1001029975 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0c0c0acd90 con 0x7f0c1c068090 2024-04-26T21:58:52.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.207+0000 7f0c19d9b640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0bfc06c9c0 0x7f0bfc06ee80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c15d1e0 tx=0x7f0c140094f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.207+0000 7f8bc5400640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8ba406c8f0 0x7f8ba406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.208+0000 7f8bc5400640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8ba406c8f0 0x7f8ba406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc02a200 tx=0x7f8bbc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.208+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc318005290 con 0x7fc3380b0f00 2024-04-26T21:58:52.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.208+0000 7fc31ffff640 1 -- 172.21.15.137:0/2632632412 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc328018020 con 0x7fc3380b0f00 2024-04-26T21:58:52.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.208+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5884005290 con 0x7f58a41639f0 2024-04-26T21:58:52.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.209+0000 7fc31ffff640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc32406c9c0 0x7fc32406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.209+0000 7fc336ffd640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc32406c9c0 0x7fc32406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.209+0000 7fc31ffff640 1 -- 172.21.15.137:0/2632632412 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc32808b940 con 0x7fc3380b0f00 2024-04-26T21:58:52.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.209+0000 7f588b7fe640 1 -- 172.21.15.137:0/3773730531 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f58980037b0 con 0x7f58a41639f0 2024-04-26T21:58:52.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.210+0000 7fc336ffd640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc32406c9c0 0x7fc32406ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc330009fd0 tx=0x7fc33000d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.210+0000 7f588b7fe640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f589006c9f0 0x7f589006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.210+0000 7f58a2ffd640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f589006c9f0 0x7f589006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.210+0000 7f588b7fe640 1 -- 172.21.15.137:0/3773730531 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f589808b7f0 con 0x7f58a41639f0 2024-04-26T21:58:52.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.210+0000 7f58a2ffd640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f589006c9f0 0x7f589006eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58a41620b0 tx=0x7f5894009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.212+0000 7f0c0affd640 1 -- 172.21.15.137:0/1001029975 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0c0c04c070 con 0x7f0c1c068090 2024-04-26T21:58:52.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.212+0000 7f7912ffd640 1 -- 172.21.15.137:0/679213424 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c019070 con 0x7f79140e0770 2024-04-26T21:58:52.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.213+0000 7f7912ffd640 1 -- 172.21.15.137:0/679213424 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c014a20 con 0x7f79140e0770 2024-04-26T21:58:52.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.214+0000 7fc31ffff640 1 -- 172.21.15.137:0/2632632412 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc32801f020 con 0x7fc3380b0f00 2024-04-26T21:58:52.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.218+0000 7f588b7fe640 1 -- 172.21.15.137:0/3773730531 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f58980595c0 con 0x7f58a41639f0 2024-04-26T21:58:52.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.222+0000 7f7912ffd640 1 -- 172.21.15.137:0/679213424 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f790c014bc0 con 0x7f79140e0770 2024-04-26T21:58:52.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.222+0000 7f8bb5ffb640 1 -- 172.21.15.137:0/1217027333 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8bb0058be0 con 0x7f8bc015fb70 2024-04-26T21:58:52.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.223+0000 7f7912ffd640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f790006c920 0x7f790006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.223+0000 7f7912ffd640 1 -- 172.21.15.137:0/679213424 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f790c08bf40 con 0x7f79140e0770 2024-04-26T21:58:52.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.223+0000 7f7922314640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f790006c920 0x7f790006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.224+0000 7f7922314640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f790006c920 0x7f790006ede0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f791c051930 tx=0x7f791c08f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.232+0000 7f7912ffd640 1 -- 172.21.15.137:0/679213424 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f790c023020 con 0x7f79140e0770 2024-04-26T21:58:52.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.555+0000 7fc608122640 1 -- 172.21.15.137:0/4210911799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc600068560 con 0x7fc600150910 2024-04-26T21:58:52.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.556+0000 7fc5f67fc640 1 -- 172.21.15.137:0/4210911799 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc5f0079030 con 0x7fc600150910 2024-04-26T21:58:52.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.556+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0b80037950 con 0x7f0b8003c240 2024-04-26T21:58:52.556 INFO:teuthology.orchestra.run.smithi137.stdout:55834574856 2024-04-26T21:58:52.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.557+0000 7f0b6f7fe640 1 -- 172.21.15.137:0/329377657 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b78059600 con 0x7f0b8003c240 2024-04-26T21:58:52.557 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.559+0000 7fc5e3fff640 1 -- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc5e406c940 msgr2=0x7fc5e406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.559+0000 7fc5e3fff640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc5e406c940 0x7fc5e406ee00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc006fd0 tx=0x7fc5fc008040 comp rx=0 tx=0).stop 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.559+0000 7fc5e3fff640 1 -- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc600150910 msgr2=0x7fc6001fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.559+0000 7fc5e3fff640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc600150910 0x7fc6001fce30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc600073300 tx=0x7fc5f002d070 comp rx=0 tx=0).stop 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.560+0000 7fc5e3fff640 1 -- 172.21.15.137:0/4210911799 shutdown_connections 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.560+0000 7fc5e3fff640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc5e406c940 0x7fc5e406ee00 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc006fd0 tx=0x7fc5fc008040 comp rx=0 tx=0).stop 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.560+0000 7fc5e3fff640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc600150910 0x7fc6001fce30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.560+0000 7fc5e3fff640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc60016e950 0x7fc6001fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.560+0000 7fc5e3fff640 1 --2- 172.21.15.137:0/4210911799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc600150530 0x7fc60006f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.560+0000 7fc5e3fff640 1 -- 172.21.15.137:0/4210911799 >> 172.21.15.137:0/4210911799 conn(0x7fc6000b68a0 msgr2=0x7fc600159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.560+0000 7fc5e3fff640 1 -- 172.21.15.137:0/4210911799 shutdown_connections 2024-04-26T21:58:52.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.560+0000 7fc5e3fff640 1 -- 172.21.15.137:0/4210911799 wait complete. 2024-04-26T21:58:52.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.560+0000 7faa1f0e4640 1 -- 172.21.15.137:0/2844562287 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7faa00005850 con 0x7faa10006a50 2024-04-26T21:58:52.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.561+0000 7faa0effd640 1 -- 172.21.15.137:0/2844562287 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa0805dac0 con 0x7faa10006a50 2024-04-26T21:58:52.561 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T21:58:52.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.562+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c8f0 msgr2=0x7f0b7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.563+0000 7f0b8d578640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c8f0 0x7f0b7406edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0b88051470 tx=0x7f0b880ab000 comp rx=0 tx=0).stop 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.563+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 msgr2=0x7f0b80181660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.563+0000 7f0b8d578640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80181660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c410 tx=0x7f0b7800c8d0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.563+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 shutdown_connections 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.563+0000 7f0b8d578640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c8f0 0x7f0b7406edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.563+0000 7f0b8d578640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b8004ac50 0x7f0b8000d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.563+0000 7f0b8d578640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b8003c240 0x7f0b80181660 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.563+0000 7f0b8d578640 1 --2- 172.21.15.137:0/329377657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b80001e30 0x7f0b8016a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.563+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 >> 172.21.15.137:0/329377657 conn(0x7f0b80020860 msgr2=0x7f0b8003c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.564+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 shutdown_connections 2024-04-26T21:58:52.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.564+0000 7f0b8d578640 1 -- 172.21.15.137:0/329377657 wait complete. 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 -- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9fc06caf0 msgr2=0x7fa9fc06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9fc06caf0 0x7fa9fc06efb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faa100ea2d0 tx=0x7faa14007a40 comp rx=0 tx=0).stop 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 -- 172.21.15.137:0/2844562287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 msgr2=0x7faa1017ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa1017ca70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa0800c7f0 tx=0x7faa0800ccb0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 -- 172.21.15.137:0/2844562287 shutdown_connections 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9fc06caf0 0x7fa9fc06efb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa1004f4d0 0x7faa100e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa1004b3c0 0x7faa1004bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 --2- 172.21.15.137:0/2844562287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa10006a50 0x7faa1017ca70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 -- 172.21.15.137:0/2844562287 >> 172.21.15.137:0/2844562287 conn(0x7faa1000a400 msgr2=0x7faa10036270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 -- 172.21.15.137:0/2844562287 shutdown_connections 2024-04-26T21:58:52.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.565+0000 7faa0cff9640 1 -- 172.21.15.137:0/2844562287 wait complete. 2024-04-26T21:58:52.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-04-26T21:58:52.580 DEBUG:teuthology.parallel:result is None 2024-04-26T21:58:52.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-04-26T21:58:52.583 DEBUG:teuthology.parallel:result is None 2024-04-26T21:58:52.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-26T21:58:52.585 DEBUG:teuthology.parallel:result is None 2024-04-26T21:58:52.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.601+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0c00005850 con 0x7f0c1c068090 2024-04-26T21:58:52.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.602+0000 7f0c0affd640 1 -- 172.21.15.137:0/1001029975 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0c0c07b230 con 0x7f0c1c068090 2024-04-26T21:58:52.602 INFO:teuthology.orchestra.run.smithi137.stdout:55834574856 2024-04-26T21:58:52.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5884005580 con 0x7f58a41639f0 2024-04-26T21:58:52.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0bfc06c9c0 msgr2=0x7f0bfc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f588b7fe640 1 -- 172.21.15.137:0/3773730531 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f589805d8c0 con 0x7f58a41639f0 2024-04-26T21:58:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f0c20989640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0bfc06c9c0 0x7f0bfc06ee80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c15d1e0 tx=0x7f0c140094f0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c068090 msgr2=0x7f0c1c15fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f0c20989640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c068090 0x7f0c1c15fd00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0098c0 tx=0x7f0c0c0046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 shutdown_connections 2024-04-26T21:58:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f0c20989640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0bfc06c9c0 0x7f0bfc06ee80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f0c20989640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c1c0d1210 0x7f0c1c15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f0c20989640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c1c06d9c0 0x7f0c1c15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.604+0000 7f0c20989640 1 --2- 172.21.15.137:0/1001029975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c1c068090 0x7f0c1c15fd00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.605+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 >> 172.21.15.137:0/1001029975 conn(0x7f0c1c072900 msgr2=0x7f0c1c06fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.606 INFO:teuthology.orchestra.run.smithi137.stdout:55834574856 2024-04-26T21:58:52.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.605+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 shutdown_connections 2024-04-26T21:58:52.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.605+0000 7f0c20989640 1 -- 172.21.15.137:0/1001029975 wait complete. 2024-04-26T21:58:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f589006c9f0 msgr2=0x7f589006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f589006c9f0 0x7f589006eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58a41620b0 tx=0x7f5894009190 comp rx=0 tx=0).stop 2024-04-26T21:58:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58a41639f0 msgr2=0x7f58a415f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58a41639f0 0x7f58a415f490 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f589800c590 tx=0x7f589800ca50 comp rx=0 tx=0).stop 2024-04-26T21:58:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 shutdown_connections 2024-04-26T21:58:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f589006c9f0 0x7f589006eeb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58a41639f0 0x7f58a415f490 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f58a4163610 0x7f58a41490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 --2- 172.21.15.137:0/3773730531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f58a40d0410 0x7f58a4157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 >> 172.21.15.137:0/3773730531 conn(0x7f58a40d1e30 msgr2=0x7f58a40cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 shutdown_connections 2024-04-26T21:58:52.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.607+0000 7f58a9312640 1 -- 172.21.15.137:0/3773730531 wait complete. 2024-04-26T21:58:52.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.608+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f79140dd7a0 con 0x7f79140e0770 2024-04-26T21:58:52.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.609+0000 7f7912ffd640 1 -- 172.21.15.137:0/679213424 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f790c05a2c0 con 0x7f79140e0770 2024-04-26T21:58:52.609 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T21:58:52.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f790006c920 msgr2=0x7f790006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f790006c920 0x7f790006ede0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f791c051930 tx=0x7f791c08f040 comp rx=0 tx=0).stop 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79140e0770 msgr2=0x7f79140cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79140e0770 0x7f79140cdf30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f790c00f520 tx=0x7f790c00f9e0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 shutdown_connections 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f790006c920 0x7f790006ede0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79140e0770 0x7f79140cdf30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914033ec0 0x7f7914034370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 --2- 172.21.15.137:0/679213424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7908005230 0x7f79140e2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 >> 172.21.15.137:0/679213424 conn(0x7f791401e6c0 msgr2=0x7f79140541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 shutdown_connections 2024-04-26T21:58:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.611+0000 7f7923316640 1 -- 172.21.15.137:0/679213424 wait complete. 2024-04-26T21:58:52.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-04-26T21:58:52.618 DEBUG:teuthology.parallel:result is None 2024-04-26T21:58:52.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-04-26T21:58:52.623 DEBUG:teuthology.parallel:result is None 2024-04-26T21:58:52.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-04-26T21:58:52.626 DEBUG:teuthology.parallel:result is None 2024-04-26T21:58:52.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.644+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc318005580 con 0x7fc3380b0f00 2024-04-26T21:58:52.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.644+0000 7fc31ffff640 1 -- 172.21.15.137:0/2632632412 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc328059de0 con 0x7fc3380b0f00 2024-04-26T21:58:52.644 INFO:teuthology.orchestra.run.smithi137.stdout:55834574855 2024-04-26T21:58:52.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.645+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8ba0005580 con 0x7f8bc015fb70 2024-04-26T21:58:52.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.645+0000 7f8bb5ffb640 1 -- 172.21.15.137:0/1217027333 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8bb005cee0 con 0x7f8bc015fb70 2024-04-26T21:58:52.645 INFO:teuthology.orchestra.run.smithi137.stdout:55834574854 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc32406c9c0 msgr2=0x7fc32406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc32406c9c0 0x7fc32406ee80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc330009fd0 tx=0x7fc33000d040 comp rx=0 tx=0).stop 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3380b0f00 msgr2=0x7fc3381ec400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3380b0f00 0x7fc3381ec400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc32800b3f0 tx=0x7fc32800b8b0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 shutdown_connections 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc32406c9c0 0x7fc32406ee80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc338166cf0 0x7fc33815bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc3380b0f00 0x7fc3381ec400 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 --2- 172.21.15.137:0/2632632412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc33806d7f0 0x7fc3381edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 >> 172.21.15.137:0/2632632412 conn(0x7fc338072900 msgr2=0x7fc3381616b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 shutdown_connections 2024-04-26T21:58:52.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.647+0000 7fc33da20640 1 -- 172.21.15.137:0/2632632412 wait complete. 2024-04-26T21:58:52.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8ba406c8f0 msgr2=0x7f8ba406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8ba406c8f0 0x7f8ba406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc02a200 tx=0x7f8bbc02e000 comp rx=0 tx=0).stop 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bc015fb70 msgr2=0x7f8bc015eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bc015fb70 0x7f8bc015eb80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000c3c0 tx=0x7f8bb0001e70 comp rx=0 tx=0).stop 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 shutdown_connections 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8ba406c8f0 0x7f8ba406edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bc015fb70 0x7f8bc015eb80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bc006caa0 0x7f8bc015f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 --2- 172.21.15.137:0/1217027333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bc00731c0 0x7f8bc013de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 >> 172.21.15.137:0/1217027333 conn(0x7f8bc00d1e30 msgr2=0x7f8bc00d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 shutdown_connections 2024-04-26T21:58:52.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.648+0000 7f8bc7664640 1 -- 172.21.15.137:0/1217027333 wait complete. 2024-04-26T21:58:52.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-04-26T21:58:52.662 DEBUG:teuthology.parallel:result is None 2024-04-26T21:58:52.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-04-26T21:58:52.663 DEBUG:teuthology.parallel:result is None 2024-04-26T21:58:52.663 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T21:58:52.663 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:58:52.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.798+0000 7f4a24339640 1 Processor -- start 2024-04-26T21:58:52.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.798+0000 7f4a24339640 1 -- start start 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a24339640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c160640 0x7f4a1c1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a24339640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4a1c163be0 0x7f4a1c0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a24339640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a1c0cfa80 con 0x7f4a1c148a30 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a24339640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4a1c0745e0 con 0x7f4a1c163be0 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a24339640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1c0cfd60 con 0x7f4a1c160640 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a220d5640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4a1c148a30 0x7f4a1c073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42130/0 (socket says 172.21.15.137:42130) 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a220d5640 1 -- 172.21.15.137:0/3153202554 learned_addr learned my addr 172.21.15.137:0/3153202554 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a218d4640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c160640 0x7f4a1c1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a228d6640 1 --2- 172.21.15.137:0/3153202554 >> v2:172.21.15.170:3300/0 conn(0x7f4a1c163be0 0x7f4a1c0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690645107 0 0) 0x7f4a1c0cfa80 con 0x7f4a1c148a30 2024-04-26T21:58:52.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.799+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a08003520 con 0x7f4a1c148a30 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 82220001 0 0) 0x7f4a08003520 con 0x7f4a1c148a30 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c160640 msgr2=0x7f4a1c1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c160640 0x7f4a1c1636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 >> v2:172.21.15.170:3300/0 conn(0x7f4a1c163be0 msgr2=0x7f4a1c0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 --2- 172.21.15.137:0/3153202554 >> v2:172.21.15.170:3300/0 conn(0x7f4a1c163be0 0x7f4a1c0b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c0d0040 con 0x7f4a1c148a30 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f4a180019f0 con 0x7f4a1c148a30 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a228d6640 1 --2- 172.21.15.137:0/3153202554 >> v2:172.21.15.170:3300/0 conn(0x7f4a1c163be0 0x7f4a1c0b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 >> v1:172.21.15.137:6789/0 conn(0x7f4a1c148a30 legacy=0x7f4a1c073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a080039b0 0x7f4a08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c160640 0x7f4a08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a08004d40 0x7f4a080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c0745e0 con 0x7f4a080039b0 2024-04-26T21:58:52.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c0cfd60 con 0x7f4a08004d40 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0800b9c0 con 0x7f4a1c160640 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a220d5640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a080039b0 0x7f4a08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a218d4640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c160640 0x7f4a08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a228d6640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a08004d40 0x7f4a080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a220d5640 1 -- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c160640 msgr2=0x7f4a08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a220d5640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c160640 0x7f4a08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a220d5640 1 -- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a08004d40 msgr2=0x7f4a080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a220d5640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a08004d40 0x7f4a080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.800+0000 7f4a220d5640 1 -- 172.21.15.137:0/3153202554 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a08003520 con 0x7f4a080039b0 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a220d5640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a080039b0 0x7f4a08003dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800a870 tx=0x7f4a08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02de9270b97afe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800a4c0 con 0x7f4a080039b0 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1802f070 con 0x7f4a080039b0 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a210d3640 1 -- 172.21.15.137:0/3153202554 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1802bcc0 con 0x7f4a080039b0 2024-04-26T21:58:52.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a24339640 1 -- 172.21.15.137:0/3153202554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a080039b0 msgr2=0x7f4a08003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a24339640 1 --2- 172.21.15.137:0/3153202554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a080039b0 0x7f4a08003dd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800a870 tx=0x7f4a08005830 comp rx=0 tx=0).stop 2024-04-26T21:58:52.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a228d6640 1 -- 172.21.15.137:0/3153202554 reap_dead start 2024-04-26T21:58:52.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a24339640 1 -- 172.21.15.137:0/3153202554 shutdown_connections 2024-04-26T21:58:52.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a24339640 1 -- 172.21.15.137:0/3153202554 >> 172.21.15.137:0/3153202554 conn(0x7f4a1c0ce8b0 msgr2=0x7f4a1c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.801+0000 7f4a24339640 1 -- 172.21.15.137:0/3153202554 shutdown_connections 2024-04-26T21:58:52.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.802+0000 7f4a24339640 1 -- 172.21.15.137:0/3153202554 wait complete. 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a24339640 1 Processor -- start 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a24339640 1 -- start start 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a24339640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a080039b0 0x7f4a1c1f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a24339640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c0b6e00 0x7f4a1c15ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a24339640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c06f330 0x7f4a1c06f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a24339640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c148e10 con 0x7f4a1c06f330 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a24339640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c163180 con 0x7f4a080039b0 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a24339640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1c148f90 con 0x7f4a1c0b6e00 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a228d6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c06f330 0x7f4a1c06f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a228d6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c06f330 0x7f4a1c06f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32852/0 (socket says 172.21.15.137:32852) 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.803+0000 7f4a228d6640 1 -- 172.21.15.137:0/3065085865 learned_addr learned my addr 172.21.15.137:0/3065085865 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a220d5640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a080039b0 0x7f4a1c1f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a218d4640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c0b6e00 0x7f4a1c15ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a228d6640 1 -- 172.21.15.137:0/3065085865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c0b6e00 msgr2=0x7f4a1c15ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a228d6640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c0b6e00 0x7f4a1c15ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a228d6640 1 -- 172.21.15.137:0/3065085865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a080039b0 msgr2=0x7f4a1c1f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a228d6640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a080039b0 0x7f4a1c1f8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a228d6640 1 -- 172.21.15.137:0/3065085865 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c0b3d70 con 0x7f4a1c06f330 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a218d4640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c0b6e00 0x7f4a1c15ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a228d6640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c06f330 0x7f4a1c06f7b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a140118d0 tx=0x7f4a14011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a12ffd640 1 -- 172.21.15.137:0/3065085865 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400fa70 con 0x7f4a1c06f330 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a12ffd640 1 -- 172.21.15.137:0/3065085865 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1400fc10 con 0x7f4a1c06f330 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c1f6130 con 0x7f4a1c06f330 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a12ffd640 1 -- 172.21.15.137:0/3065085865 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400fe00 con 0x7f4a1c06f330 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.804+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1f8e30 con 0x7f4a1c06f330 2024-04-26T21:58:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.805+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1c070780 con 0x7f4a1c06f330 2024-04-26T21:58:52.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.805+0000 7f4a12ffd640 1 -- 172.21.15.137:0/3065085865 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a1401e020 con 0x7f4a1c06f330 2024-04-26T21:58:52.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.806+0000 7f4a12ffd640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4a0006c8f0 0x7f4a0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:52.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.806+0000 7f4a12ffd640 1 -- 172.21.15.137:0/3065085865 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a1408b550 con 0x7f4a1c06f330 2024-04-26T21:58:52.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.806+0000 7f4a220d5640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4a0006c8f0 0x7f4a0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:52.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.806+0000 7f4a220d5640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4a0006c8f0 0x7f4a0006edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4a18033000 tx=0x7f4a18007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:52.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.810+0000 7f4a12ffd640 1 -- 172.21.15.137:0/3065085865 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4a1c070780 con 0x7f4a1c06f330 2024-04-26T21:58:52.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.980+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a1c06a290 con 0x7f4a0006c8f0 2024-04-26T21:58:52.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.986+0000 7f4a12ffd640 1 -- 172.21.15.137:0/3065085865 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f4a1c06a290 con 0x7f4a0006c8f0 2024-04-26T21:58:52.988 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:52.990 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:58:52.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4a0006c8f0 msgr2=0x7f4a0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4a0006c8f0 0x7f4a0006edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4a18033000 tx=0x7f4a18007000 comp rx=0 tx=0).stop 2024-04-26T21:58:52.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c06f330 msgr2=0x7f4a1c06f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:52.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c06f330 0x7f4a1c06f7b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a140118d0 tx=0x7f4a14011d90 comp rx=0 tx=0).stop 2024-04-26T21:58:52.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 shutdown_connections 2024-04-26T21:58:52.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4a0006c8f0 0x7f4a0006edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4a1c06f330 0x7f4a1c06f7b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4a1c0b6e00 0x7f4a1c15ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 --2- 172.21.15.137:0/3065085865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a080039b0 0x7f4a1c1f8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:52.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 >> 172.21.15.137:0/3065085865 conn(0x7f4a1c0ce8b0 msgr2=0x7f4a1c147d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:52.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 shutdown_connections 2024-04-26T21:58:52.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:52.989+0000 7f4a24339640 1 -- 172.21.15.137:0/3065085865 wait complete. 2024-04-26T21:58:53.000 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-26T21:58:52.696487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235752,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738968,"statfs":{"total":773094113280,"available":772852703232,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.447157"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252025+0000","last_change":"2024-04-26T21:58:41.268747+0000","last_active":"2024-04-26T21:58:42.252025+0000","last_peered":"2024-04-26T21:58:42.252025+0000","last_clean":"2024-04-26T21:58:42.252025+0000","last_became_active":"2024-04-26T21:58:41.268428+0000","last_became_peered":"2024-04-26T21:58:41.268428+0000","last_unstale":"2024-04-26T21:58:42.252025+0000","last_undegraded":"2024-04-26T21:58:42.252025+0000","last_fullsized":"2024-04-26T21:58:42.252025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250604+0000","last_change":"2024-04-26T21:58:41.267888+0000","last_active":"2024-04-26T21:58:42.250604+0000","last_peered":"2024-04-26T21:58:42.250604+0000","last_clean":"2024-04-26T21:58:42.250604+0000","last_became_active":"2024-04-26T21:58:41.267511+0000","last_became_peered":"2024-04-26T21:58:41.267511+0000","last_unstale":"2024-04-26T21:58:42.250604+0000","last_undegraded":"2024-04-26T21:58:42.250604+0000","last_fullsized":"2024-04-26T21:58:42.250604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679497+0000","last_change":"2024-04-26T21:58:41.265150+0000","last_active":"2024-04-26T21:58:42.679497+0000","last_peered":"2024-04-26T21:58:42.679497+0000","last_clean":"2024-04-26T21:58:42.679497+0000","last_became_active":"2024-04-26T21:58:41.264882+0000","last_became_peered":"2024-04-26T21:58:41.264882+0000","last_unstale":"2024-04-26T21:58:42.679497+0000","last_undegraded":"2024-04-26T21:58:42.679497+0000","last_fullsized":"2024-04-26T21:58:42.679497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679252+0000","last_change":"2024-04-26T21:58:41.276698+0000","last_active":"2024-04-26T21:58:42.679252+0000","last_peered":"2024-04-26T21:58:42.679252+0000","last_clean":"2024-04-26T21:58:42.679252+0000","last_became_active":"2024-04-26T21:58:41.276439+0000","last_became_peered":"2024-04-26T21:58:41.276439+0000","last_unstale":"2024-04-26T21:58:42.679252+0000","last_undegraded":"2024-04-26T21:58:42.679252+0000","last_fullsized":"2024-04-26T21:58:42.679252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251967+0000","last_change":"2024-04-26T21:58:41.266844+0000","last_active":"2024-04-26T21:58:42.251967+0000","last_peered":"2024-04-26T21:58:42.251967+0000","last_clean":"2024-04-26T21:58:42.251967+0000","last_became_active":"2024-04-26T21:58:41.266576+0000","last_became_peered":"2024-04-26T21:58:41.266576+0000","last_unstale":"2024-04-26T21:58:42.251967+0000","last_undegraded":"2024-04-26T21:58:42.251967+0000","last_fullsized":"2024-04-26T21:58:42.251967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679113+0000","last_change":"2024-04-26T21:58:41.274496+0000","last_active":"2024-04-26T21:58:42.679113+0000","last_peered":"2024-04-26T21:58:42.679113+0000","last_clean":"2024-04-26T21:58:42.679113+0000","last_became_active":"2024-04-26T21:58:41.274206+0000","last_became_peered":"2024-04-26T21:58:41.274206+0000","last_unstale":"2024-04-26T21:58:42.679113+0000","last_undegraded":"2024-04-26T21:58:42.679113+0000","last_fullsized":"2024-04-26T21:58:42.679113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251060+0000","last_change":"2024-04-26T21:58:41.263323+0000","last_active":"2024-04-26T21:58:42.251060+0000","last_peered":"2024-04-26T21:58:42.251060+0000","last_clean":"2024-04-26T21:58:42.251060+0000","last_became_active":"2024-04-26T21:58:41.263054+0000","last_became_peered":"2024-04-26T21:58:41.263054+0000","last_unstale":"2024-04-26T21:58:42.251060+0000","last_undegraded":"2024-04-26T21:58:42.251060+0000","last_fullsized":"2024-04-26T21:58:42.251060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679251+0000","last_change":"2024-04-26T21:58:41.271464+0000","last_active":"2024-04-26T21:58:42.679251+0000","last_peered":"2024-04-26T21:58:42.679251+0000","last_clean":"2024-04-26T21:58:42.679251+0000","last_became_active":"2024-04-26T21:58:41.271196+0000","last_became_peered":"2024-04-26T21:58:41.271196+0000","last_unstale":"2024-04-26T21:58:42.679251+0000","last_undegraded":"2024-04-26T21:58:42.679251+0000","last_fullsized":"2024-04-26T21:58:42.679251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252031+0000","last_change":"2024-04-26T21:58:41.263814+0000","last_active":"2024-04-26T21:58:42.252031+0000","last_peered":"2024-04-26T21:58:42.252031+0000","last_clean":"2024-04-26T21:58:42.252031+0000","last_became_active":"2024-04-26T21:58:41.263511+0000","last_became_peered":"2024-04-26T21:58:41.263511+0000","last_unstale":"2024-04-26T21:58:42.252031+0000","last_undegraded":"2024-04-26T21:58:42.252031+0000","last_fullsized":"2024-04-26T21:58:42.252031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271753+0000","last_change":"2024-04-26T21:58:41.275685+0000","last_active":"2024-04-26T21:58:42.271753+0000","last_peered":"2024-04-26T21:58:42.271753+0000","last_clean":"2024-04-26T21:58:42.271753+0000","last_became_active":"2024-04-26T21:58:41.275415+0000","last_became_peered":"2024-04-26T21:58:41.275415+0000","last_unstale":"2024-04-26T21:58:42.271753+0000","last_undegraded":"2024-04-26T21:58:42.271753+0000","last_fullsized":"2024-04-26T21:58:42.271753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271661+0000","last_change":"2024-04-26T21:58:41.278076+0000","last_active":"2024-04-26T21:58:42.271661+0000","last_peered":"2024-04-26T21:58:42.271661+0000","last_clean":"2024-04-26T21:58:42.271661+0000","last_became_active":"2024-04-26T21:58:41.277772+0000","last_became_peered":"2024-04-26T21:58:41.277772+0000","last_unstale":"2024-04-26T21:58:42.271661+0000","last_undegraded":"2024-04-26T21:58:42.271661+0000","last_fullsized":"2024-04-26T21:58:42.271661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251676+0000","last_change":"2024-04-26T21:58:41.265624+0000","last_active":"2024-04-26T21:58:42.251676+0000","last_peered":"2024-04-26T21:58:42.251676+0000","last_clean":"2024-04-26T21:58:42.251676+0000","last_became_active":"2024-04-26T21:58:41.265100+0000","last_became_peered":"2024-04-26T21:58:41.265100+0000","last_unstale":"2024-04-26T21:58:42.251676+0000","last_undegraded":"2024-04-26T21:58:42.251676+0000","last_fullsized":"2024-04-26T21:58:42.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680143+0000","last_change":"2024-04-26T21:58:41.263878+0000","last_active":"2024-04-26T21:58:42.680143+0000","last_peered":"2024-04-26T21:58:42.680143+0000","last_clean":"2024-04-26T21:58:42.680143+0000","last_became_active":"2024-04-26T21:58:41.263324+0000","last_became_peered":"2024-04-26T21:58:41.263324+0000","last_unstale":"2024-04-26T21:58:42.680143+0000","last_undegraded":"2024-04-26T21:58:42.680143+0000","last_fullsized":"2024-04-26T21:58:42.680143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679040+0000","last_change":"2024-04-26T21:58:41.266911+0000","last_active":"2024-04-26T21:58:42.679040+0000","last_peered":"2024-04-26T21:58:42.679040+0000","last_clean":"2024-04-26T21:58:42.679040+0000","last_became_active":"2024-04-26T21:58:41.266650+0000","last_became_peered":"2024-04-26T21:58:41.266650+0000","last_unstale":"2024-04-26T21:58:42.679040+0000","last_undegraded":"2024-04-26T21:58:42.679040+0000","last_fullsized":"2024-04-26T21:58:42.679040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:41.402737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250485+0000","last_change":"2024-04-26T21:58:41.265835+0000","last_active":"2024-04-26T21:58:42.250485+0000","last_peered":"2024-04-26T21:58:42.250485+0000","last_clean":"2024-04-26T21:58:42.250485+0000","last_became_active":"2024-04-26T21:58:41.265546+0000","last_became_peered":"2024-04-26T21:58:41.265546+0000","last_unstale":"2024-04-26T21:58:42.250485+0000","last_undegraded":"2024-04-26T21:58:42.250485+0000","last_fullsized":"2024-04-26T21:58:42.250485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678981+0000","last_change":"2024-04-26T21:58:41.274315+0000","last_active":"2024-04-26T21:58:42.678981+0000","last_peered":"2024-04-26T21:58:42.678981+0000","last_clean":"2024-04-26T21:58:42.678981+0000","last_became_active":"2024-04-26T21:58:41.274000+0000","last_became_peered":"2024-04-26T21:58:41.274000+0000","last_unstale":"2024-04-26T21:58:42.678981+0000","last_undegraded":"2024-04-26T21:58:42.678981+0000","last_fullsized":"2024-04-26T21:58:42.678981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679611+0000","last_change":"2024-04-26T21:58:41.272052+0000","last_active":"2024-04-26T21:58:42.679611+0000","last_peered":"2024-04-26T21:58:42.679611+0000","last_clean":"2024-04-26T21:58:42.679611+0000","last_became_active":"2024-04-26T21:58:41.271775+0000","last_became_peered":"2024-04-26T21:58:41.271775+0000","last_unstale":"2024-04-26T21:58:42.679611+0000","last_undegraded":"2024-04-26T21:58:42.679611+0000","last_fullsized":"2024-04-26T21:58:42.679611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679120+0000","last_change":"2024-04-26T21:58:41.267754+0000","last_active":"2024-04-26T21:58:42.679120+0000","last_peered":"2024-04-26T21:58:42.679120+0000","last_clean":"2024-04-26T21:58:42.679120+0000","last_became_active":"2024-04-26T21:58:41.267414+0000","last_became_peered":"2024-04-26T21:58:41.267414+0000","last_unstale":"2024-04-26T21:58:42.679120+0000","last_undegraded":"2024-04-26T21:58:42.679120+0000","last_fullsized":"2024-04-26T21:58:42.679120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251919+0000","last_change":"2024-04-26T21:58:41.261004+0000","last_active":"2024-04-26T21:58:42.251919+0000","last_peered":"2024-04-26T21:58:42.251919+0000","last_clean":"2024-04-26T21:58:42.251919+0000","last_became_active":"2024-04-26T21:58:41.260578+0000","last_became_peered":"2024-04-26T21:58:41.260578+0000","last_unstale":"2024-04-26T21:58:42.251919+0000","last_undegraded":"2024-04-26T21:58:42.251919+0000","last_fullsized":"2024-04-26T21:58:42.251919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271701+0000","last_change":"2024-04-26T21:58:41.267436+0000","last_active":"2024-04-26T21:58:42.271701+0000","last_peered":"2024-04-26T21:58:42.271701+0000","last_clean":"2024-04-26T21:58:42.271701+0000","last_became_active":"2024-04-26T21:58:41.267151+0000","last_became_peered":"2024-04-26T21:58:41.267151+0000","last_unstale":"2024-04-26T21:58:42.271701+0000","last_undegraded":"2024-04-26T21:58:42.271701+0000","last_fullsized":"2024-04-26T21:58:42.271701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679858+0000","last_change":"2024-04-26T21:58:41.273673+0000","last_active":"2024-04-26T21:58:42.679858+0000","last_peered":"2024-04-26T21:58:42.679858+0000","last_clean":"2024-04-26T21:58:42.679858+0000","last_became_active":"2024-04-26T21:58:41.273384+0000","last_became_peered":"2024-04-26T21:58:41.273384+0000","last_unstale":"2024-04-26T21:58:42.679858+0000","last_undegraded":"2024-04-26T21:58:42.679858+0000","last_fullsized":"2024-04-26T21:58:42.679858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679139+0000","last_change":"2024-04-26T21:58:41.272126+0000","last_active":"2024-04-26T21:58:42.679139+0000","last_peered":"2024-04-26T21:58:42.679139+0000","last_clean":"2024-04-26T21:58:42.679139+0000","last_became_active":"2024-04-26T21:58:41.271816+0000","last_became_peered":"2024-04-26T21:58:41.271816+0000","last_unstale":"2024-04-26T21:58:42.679139+0000","last_undegraded":"2024-04-26T21:58:42.679139+0000","last_fullsized":"2024-04-26T21:58:42.679139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678912+0000","last_change":"2024-04-26T21:58:41.256372+0000","last_active":"2024-04-26T21:58:42.678912+0000","last_peered":"2024-04-26T21:58:42.678912+0000","last_clean":"2024-04-26T21:58:42.678912+0000","last_became_active":"2024-04-26T21:58:41.256119+0000","last_became_peered":"2024-04-26T21:58:41.256119+0000","last_unstale":"2024-04-26T21:58:42.678912+0000","last_undegraded":"2024-04-26T21:58:42.678912+0000","last_fullsized":"2024-04-26T21:58:42.678912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679089+0000","last_change":"2024-04-26T21:58:41.276385+0000","last_active":"2024-04-26T21:58:42.679089+0000","last_peered":"2024-04-26T21:58:42.679089+0000","last_clean":"2024-04-26T21:58:42.679089+0000","last_became_active":"2024-04-26T21:58:41.275917+0000","last_became_peered":"2024-04-26T21:58:41.275917+0000","last_unstale":"2024-04-26T21:58:42.679089+0000","last_undegraded":"2024-04-26T21:58:42.679089+0000","last_fullsized":"2024-04-26T21:58:42.679089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680416+0000","last_change":"2024-04-26T21:58:41.262076+0000","last_active":"2024-04-26T21:58:42.680416+0000","last_peered":"2024-04-26T21:58:42.680416+0000","last_clean":"2024-04-26T21:58:42.680416+0000","last_became_active":"2024-04-26T21:58:41.261726+0000","last_became_peered":"2024-04-26T21:58:41.261726+0000","last_unstale":"2024-04-26T21:58:42.680416+0000","last_undegraded":"2024-04-26T21:58:42.680416+0000","last_fullsized":"2024-04-26T21:58:42.680416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271762+0000","last_change":"2024-04-26T21:58:41.274846+0000","last_active":"2024-04-26T21:58:42.271762+0000","last_peered":"2024-04-26T21:58:42.271762+0000","last_clean":"2024-04-26T21:58:42.271762+0000","last_became_active":"2024-04-26T21:58:41.274526+0000","last_became_peered":"2024-04-26T21:58:41.274526+0000","last_unstale":"2024-04-26T21:58:42.271762+0000","last_undegraded":"2024-04-26T21:58:42.271762+0000","last_fullsized":"2024-04-26T21:58:42.271762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:41.265911+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:41.264263+0000","last_became_peered":"2024-04-26T21:58:41.264263+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680292+0000","last_change":"2024-04-26T21:58:41.257067+0000","last_active":"2024-04-26T21:58:42.680292+0000","last_peered":"2024-04-26T21:58:42.680292+0000","last_clean":"2024-04-26T21:58:42.680292+0000","last_became_active":"2024-04-26T21:58:41.256805+0000","last_became_peered":"2024-04-26T21:58:41.256805+0000","last_unstale":"2024-04-26T21:58:42.680292+0000","last_undegraded":"2024-04-26T21:58:42.680292+0000","last_fullsized":"2024-04-26T21:58:42.680292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679908+0000","last_change":"2024-04-26T21:58:41.266375+0000","last_active":"2024-04-26T21:58:42.679908+0000","last_peered":"2024-04-26T21:58:42.679908+0000","last_clean":"2024-04-26T21:58:42.679908+0000","last_became_active":"2024-04-26T21:58:41.265475+0000","last_became_peered":"2024-04-26T21:58:41.265475+0000","last_unstale":"2024-04-26T21:58:42.679908+0000","last_undegraded":"2024-04-26T21:58:42.679908+0000","last_fullsized":"2024-04-26T21:58:42.679908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679287+0000","last_change":"2024-04-26T21:58:41.277146+0000","last_active":"2024-04-26T21:58:42.679287+0000","last_peered":"2024-04-26T21:58:42.679287+0000","last_clean":"2024-04-26T21:58:42.679287+0000","last_became_active":"2024-04-26T21:58:41.276559+0000","last_became_peered":"2024-04-26T21:58:41.276559+0000","last_unstale":"2024-04-26T21:58:42.679287+0000","last_undegraded":"2024-04-26T21:58:42.679287+0000","last_fullsized":"2024-04-26T21:58:42.679287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678913+0000","last_change":"2024-04-26T21:58:41.276609+0000","last_active":"2024-04-26T21:58:42.678913+0000","last_peered":"2024-04-26T21:58:42.678913+0000","last_clean":"2024-04-26T21:58:42.678913+0000","last_became_active":"2024-04-26T21:58:41.276292+0000","last_became_peered":"2024-04-26T21:58:41.276292+0000","last_unstale":"2024-04-26T21:58:42.678913+0000","last_undegraded":"2024-04-26T21:58:42.678913+0000","last_fullsized":"2024-04-26T21:58:42.678913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271495+0000","last_change":"2024-04-26T21:58:41.270741+0000","last_active":"2024-04-26T21:58:42.271495+0000","last_peered":"2024-04-26T21:58:42.271495+0000","last_clean":"2024-04-26T21:58:42.271495+0000","last_became_active":"2024-04-26T21:58:41.270487+0000","last_became_peered":"2024-04-26T21:58:41.270487+0000","last_unstale":"2024-04-26T21:58:42.271495+0000","last_undegraded":"2024-04-26T21:58:42.271495+0000","last_fullsized":"2024-04-26T21:58:42.271495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250963+0000","last_change":"2024-04-26T21:58:41.266593+0000","last_active":"2024-04-26T21:58:42.250963+0000","last_peered":"2024-04-26T21:58:42.250963+0000","last_clean":"2024-04-26T21:58:42.250963+0000","last_became_active":"2024-04-26T21:58:41.264807+0000","last_became_peered":"2024-04-26T21:58:41.264807+0000","last_unstale":"2024-04-26T21:58:42.250963+0000","last_undegraded":"2024-04-26T21:58:42.250963+0000","last_fullsized":"2024-04-26T21:58:42.250963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:19.885646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680245+0000","last_change":"2024-04-26T21:58:40.261101+0000","last_active":"2024-04-26T21:58:42.680245+0000","last_peered":"2024-04-26T21:58:42.680245+0000","last_clean":"2024-04-26T21:58:42.680245+0000","last_became_active":"2024-04-26T21:58:40.260808+0000","last_became_peered":"2024-04-26T21:58:40.260808+0000","last_unstale":"2024-04-26T21:58:42.680245+0000","last_undegraded":"2024-04-26T21:58:42.680245+0000","last_fullsized":"2024-04-26T21:58:42.680245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679995+0000","last_change":"2024-04-26T21:58:41.266101+0000","last_active":"2024-04-26T21:58:42.679995+0000","last_peered":"2024-04-26T21:58:42.679995+0000","last_clean":"2024-04-26T21:58:42.679995+0000","last_became_active":"2024-04-26T21:58:41.265717+0000","last_became_peered":"2024-04-26T21:58:41.265717+0000","last_unstale":"2024-04-26T21:58:42.679995+0000","last_undegraded":"2024-04-26T21:58:42.679995+0000","last_fullsized":"2024-04-26T21:58:42.679995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271466+0000","last_change":"2024-04-26T21:58:40.258127+0000","last_active":"2024-04-26T21:58:42.271466+0000","last_peered":"2024-04-26T21:58:42.271466+0000","last_clean":"2024-04-26T21:58:42.271466+0000","last_became_active":"2024-04-26T21:58:40.257826+0000","last_became_peered":"2024-04-26T21:58:40.257826+0000","last_unstale":"2024-04-26T21:58:42.271466+0000","last_undegraded":"2024-04-26T21:58:42.271466+0000","last_fullsized":"2024-04-26T21:58:42.271466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679016+0000","last_change":"2024-04-26T21:58:40.260227+0000","last_active":"2024-04-26T21:58:42.679016+0000","last_peered":"2024-04-26T21:58:42.679016+0000","last_clean":"2024-04-26T21:58:42.679016+0000","last_became_active":"2024-04-26T21:58:40.259912+0000","last_became_peered":"2024-04-26T21:58:40.259912+0000","last_unstale":"2024-04-26T21:58:42.679016+0000","last_undegraded":"2024-04-26T21:58:42.679016+0000","last_fullsized":"2024-04-26T21:58:42.679016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679399+0000","last_change":"2024-04-26T21:58:41.270746+0000","last_active":"2024-04-26T21:58:42.679399+0000","last_peered":"2024-04-26T21:58:42.679399+0000","last_clean":"2024-04-26T21:58:42.679399+0000","last_became_active":"2024-04-26T21:58:41.270461+0000","last_became_peered":"2024-04-26T21:58:41.270461+0000","last_unstale":"2024-04-26T21:58:42.679399+0000","last_undegraded":"2024-04-26T21:58:42.679399+0000","last_fullsized":"2024-04-26T21:58:42.679399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679094+0000","last_change":"2024-04-26T21:58:40.251101+0000","last_active":"2024-04-26T21:58:42.679094+0000","last_peered":"2024-04-26T21:58:42.679094+0000","last_clean":"2024-04-26T21:58:42.679094+0000","last_became_active":"2024-04-26T21:58:40.250806+0000","last_became_peered":"2024-04-26T21:58:40.250806+0000","last_unstale":"2024-04-26T21:58:42.679094+0000","last_undegraded":"2024-04-26T21:58:42.679094+0000","last_fullsized":"2024-04-26T21:58:42.679094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250355+0000","last_change":"2024-04-26T21:58:41.264656+0000","last_active":"2024-04-26T21:58:42.250355+0000","last_peered":"2024-04-26T21:58:42.250355+0000","last_clean":"2024-04-26T21:58:42.250355+0000","last_became_active":"2024-04-26T21:58:41.264348+0000","last_became_peered":"2024-04-26T21:58:41.264348+0000","last_unstale":"2024-04-26T21:58:42.250355+0000","last_undegraded":"2024-04-26T21:58:42.250355+0000","last_fullsized":"2024-04-26T21:58:42.250355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271640+0000","last_change":"2024-04-26T21:58:40.258471+0000","last_active":"2024-04-26T21:58:42.271640+0000","last_peered":"2024-04-26T21:58:42.271640+0000","last_clean":"2024-04-26T21:58:42.271640+0000","last_became_active":"2024-04-26T21:58:40.258096+0000","last_became_peered":"2024-04-26T21:58:40.258096+0000","last_unstale":"2024-04-26T21:58:42.271640+0000","last_undegraded":"2024-04-26T21:58:42.271640+0000","last_fullsized":"2024-04-26T21:58:42.271640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679536+0000","last_change":"2024-04-26T21:58:41.273769+0000","last_active":"2024-04-26T21:58:42.679536+0000","last_peered":"2024-04-26T21:58:42.679536+0000","last_clean":"2024-04-26T21:58:42.679536+0000","last_became_active":"2024-04-26T21:58:41.271822+0000","last_became_peered":"2024-04-26T21:58:41.271822+0000","last_unstale":"2024-04-26T21:58:42.679536+0000","last_undegraded":"2024-04-26T21:58:42.679536+0000","last_fullsized":"2024-04-26T21:58:42.679536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679507+0000","last_change":"2024-04-26T21:58:40.258784+0000","last_active":"2024-04-26T21:58:42.679507+0000","last_peered":"2024-04-26T21:58:42.679507+0000","last_clean":"2024-04-26T21:58:42.679507+0000","last_became_active":"2024-04-26T21:58:40.258357+0000","last_became_peered":"2024-04-26T21:58:40.258357+0000","last_unstale":"2024-04-26T21:58:42.679507+0000","last_undegraded":"2024-04-26T21:58:42.679507+0000","last_fullsized":"2024-04-26T21:58:42.679507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679948+0000","last_change":"2024-04-26T21:58:41.279201+0000","last_active":"2024-04-26T21:58:42.679948+0000","last_peered":"2024-04-26T21:58:42.679948+0000","last_clean":"2024-04-26T21:58:42.679948+0000","last_became_active":"2024-04-26T21:58:41.278869+0000","last_became_peered":"2024-04-26T21:58:41.278869+0000","last_unstale":"2024-04-26T21:58:42.679948+0000","last_undegraded":"2024-04-26T21:58:42.679948+0000","last_fullsized":"2024-04-26T21:58:42.679948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:40.255154+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:40.254905+0000","last_became_peered":"2024-04-26T21:58:40.254905+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251689+0000","last_change":"2024-04-26T21:58:41.255887+0000","last_active":"2024-04-26T21:58:42.251689+0000","last_peered":"2024-04-26T21:58:42.251689+0000","last_clean":"2024-04-26T21:58:42.251689+0000","last_became_active":"2024-04-26T21:58:41.255557+0000","last_became_peered":"2024-04-26T21:58:41.255557+0000","last_unstale":"2024-04-26T21:58:42.251689+0000","last_undegraded":"2024-04-26T21:58:42.251689+0000","last_fullsized":"2024-04-26T21:58:42.251689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:52.499298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271704+0000","last_change":"2024-04-26T21:58:40.263413+0000","last_active":"2024-04-26T21:58:42.271704+0000","last_peered":"2024-04-26T21:58:42.271704+0000","last_clean":"2024-04-26T21:58:42.271704+0000","last_became_active":"2024-04-26T21:58:40.263104+0000","last_became_peered":"2024-04-26T21:58:40.263104+0000","last_unstale":"2024-04-26T21:58:42.271704+0000","last_undegraded":"2024-04-26T21:58:42.271704+0000","last_fullsized":"2024-04-26T21:58:42.271704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251648+0000","last_change":"2024-04-26T21:58:41.264209+0000","last_active":"2024-04-26T21:58:42.251648+0000","last_peered":"2024-04-26T21:58:42.251648+0000","last_clean":"2024-04-26T21:58:42.251648+0000","last_became_active":"2024-04-26T21:58:41.263961+0000","last_became_peered":"2024-04-26T21:58:41.263961+0000","last_unstale":"2024-04-26T21:58:42.251648+0000","last_undegraded":"2024-04-26T21:58:42.251648+0000","last_fullsized":"2024-04-26T21:58:42.251648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680014+0000","last_change":"2024-04-26T21:58:40.248876+0000","last_active":"2024-04-26T21:58:42.680014+0000","last_peered":"2024-04-26T21:58:42.680014+0000","last_clean":"2024-04-26T21:58:42.680014+0000","last_became_active":"2024-04-26T21:58:40.248573+0000","last_became_peered":"2024-04-26T21:58:40.248573+0000","last_unstale":"2024-04-26T21:58:42.680014+0000","last_undegraded":"2024-04-26T21:58:42.680014+0000","last_fullsized":"2024-04-26T21:58:42.680014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679175+0000","last_change":"2024-04-26T21:58:41.262092+0000","last_active":"2024-04-26T21:58:42.679175+0000","last_peered":"2024-04-26T21:58:42.679175+0000","last_clean":"2024-04-26T21:58:42.679175+0000","last_became_active":"2024-04-26T21:58:41.261788+0000","last_became_peered":"2024-04-26T21:58:41.261788+0000","last_unstale":"2024-04-26T21:58:42.679175+0000","last_undegraded":"2024-04-26T21:58:42.679175+0000","last_fullsized":"2024-04-26T21:58:42.679175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:28.345096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679243+0000","last_change":"2024-04-26T21:58:40.263316+0000","last_active":"2024-04-26T21:58:42.679243+0000","last_peered":"2024-04-26T21:58:42.679243+0000","last_clean":"2024-04-26T21:58:42.679243+0000","last_became_active":"2024-04-26T21:58:40.263027+0000","last_became_peered":"2024-04-26T21:58:40.263027+0000","last_unstale":"2024-04-26T21:58:42.679243+0000","last_undegraded":"2024-04-26T21:58:42.679243+0000","last_fullsized":"2024-04-26T21:58:42.679243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:41.253991+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:41.253696+0000","last_became_peered":"2024-04-26T21:58:41.253696+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271544+0000","last_change":"2024-04-26T21:58:40.261008+0000","last_active":"2024-04-26T21:58:42.271544+0000","last_peered":"2024-04-26T21:58:42.271544+0000","last_clean":"2024-04-26T21:58:42.271544+0000","last_became_active":"2024-04-26T21:58:40.260697+0000","last_became_peered":"2024-04-26T21:58:40.260697+0000","last_unstale":"2024-04-26T21:58:42.271544+0000","last_undegraded":"2024-04-26T21:58:42.271544+0000","last_fullsized":"2024-04-26T21:58:42.271544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271540+0000","last_change":"2024-04-26T21:58:41.271346+0000","last_active":"2024-04-26T21:58:42.271540+0000","last_peered":"2024-04-26T21:58:42.271540+0000","last_clean":"2024-04-26T21:58:42.271540+0000","last_became_active":"2024-04-26T21:58:41.271090+0000","last_became_peered":"2024-04-26T21:58:41.271090+0000","last_unstale":"2024-04-26T21:58:42.271540+0000","last_undegraded":"2024-04-26T21:58:42.271540+0000","last_fullsized":"2024-04-26T21:58:42.271540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678753+0000","last_change":"2024-04-26T21:58:40.253802+0000","last_active":"2024-04-26T21:58:42.678753+0000","last_peered":"2024-04-26T21:58:42.678753+0000","last_clean":"2024-04-26T21:58:42.678753+0000","last_became_active":"2024-04-26T21:58:40.253518+0000","last_became_peered":"2024-04-26T21:58:40.253518+0000","last_unstale":"2024-04-26T21:58:42.678753+0000","last_undegraded":"2024-04-26T21:58:42.678753+0000","last_fullsized":"2024-04-26T21:58:42.678753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251124+0000","last_change":"2024-04-26T21:58:41.254741+0000","last_active":"2024-04-26T21:58:42.251124+0000","last_peered":"2024-04-26T21:58:42.251124+0000","last_clean":"2024-04-26T21:58:42.251124+0000","last_became_active":"2024-04-26T21:58:41.253953+0000","last_became_peered":"2024-04-26T21:58:41.253953+0000","last_unstale":"2024-04-26T21:58:42.251124+0000","last_undegraded":"2024-04-26T21:58:42.251124+0000","last_fullsized":"2024-04-26T21:58:42.251124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251491+0000","last_change":"2024-04-26T21:58:40.253095+0000","last_active":"2024-04-26T21:58:42.251491+0000","last_peered":"2024-04-26T21:58:42.251491+0000","last_clean":"2024-04-26T21:58:42.251491+0000","last_became_active":"2024-04-26T21:58:40.252789+0000","last_became_peered":"2024-04-26T21:58:40.252789+0000","last_unstale":"2024-04-26T21:58:42.251491+0000","last_undegraded":"2024-04-26T21:58:42.251491+0000","last_fullsized":"2024-04-26T21:58:42.251491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:43.627280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251523+0000","last_change":"2024-04-26T21:58:41.256932+0000","last_active":"2024-04-26T21:58:42.251523+0000","last_peered":"2024-04-26T21:58:42.251523+0000","last_clean":"2024-04-26T21:58:42.251523+0000","last_became_active":"2024-04-26T21:58:41.256652+0000","last_became_peered":"2024-04-26T21:58:41.256652+0000","last_unstale":"2024-04-26T21:58:42.251523+0000","last_undegraded":"2024-04-26T21:58:42.251523+0000","last_fullsized":"2024-04-26T21:58:42.251523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679210+0000","last_change":"2024-04-26T21:58:40.263483+0000","last_active":"2024-04-26T21:58:42.679210+0000","last_peered":"2024-04-26T21:58:42.679210+0000","last_clean":"2024-04-26T21:58:42.679210+0000","last_became_active":"2024-04-26T21:58:40.263197+0000","last_became_peered":"2024-04-26T21:58:40.263197+0000","last_unstale":"2024-04-26T21:58:42.679210+0000","last_undegraded":"2024-04-26T21:58:42.679210+0000","last_fullsized":"2024-04-26T21:58:42.679210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252178+0000","last_change":"2024-04-26T21:58:41.257381+0000","last_active":"2024-04-26T21:58:42.252178+0000","last_peered":"2024-04-26T21:58:42.252178+0000","last_clean":"2024-04-26T21:58:42.252178+0000","last_became_active":"2024-04-26T21:58:41.256911+0000","last_became_peered":"2024-04-26T21:58:41.256911+0000","last_unstale":"2024-04-26T21:58:42.252178+0000","last_undegraded":"2024-04-26T21:58:42.252178+0000","last_fullsized":"2024-04-26T21:58:42.252178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250538+0000","last_change":"2024-04-26T21:58:40.255266+0000","last_active":"2024-04-26T21:58:42.250538+0000","last_peered":"2024-04-26T21:58:42.250538+0000","last_clean":"2024-04-26T21:58:42.250538+0000","last_became_active":"2024-04-26T21:58:40.254863+0000","last_became_peered":"2024-04-26T21:58:40.254863+0000","last_unstale":"2024-04-26T21:58:42.250538+0000","last_undegraded":"2024-04-26T21:58:42.250538+0000","last_fullsized":"2024-04-26T21:58:42.250538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679454+0000","last_change":"2024-04-26T21:58:41.277259+0000","last_active":"2024-04-26T21:58:42.679454+0000","last_peered":"2024-04-26T21:58:42.679454+0000","last_clean":"2024-04-26T21:58:42.679454+0000","last_became_active":"2024-04-26T21:58:41.276186+0000","last_became_peered":"2024-04-26T21:58:41.276186+0000","last_unstale":"2024-04-26T21:58:42.679454+0000","last_undegraded":"2024-04-26T21:58:42.679454+0000","last_fullsized":"2024-04-26T21:58:42.679454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678752+0000","last_change":"2024-04-26T21:58:40.258271+0000","last_active":"2024-04-26T21:58:42.678752+0000","last_peered":"2024-04-26T21:58:42.678752+0000","last_clean":"2024-04-26T21:58:42.678752+0000","last_became_active":"2024-04-26T21:58:40.257941+0000","last_became_peered":"2024-04-26T21:58:40.257941+0000","last_unstale":"2024-04-26T21:58:42.678752+0000","last_undegraded":"2024-04-26T21:58:42.678752+0000","last_fullsized":"2024-04-26T21:58:42.678752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252033+0000","last_change":"2024-04-26T21:58:41.270377+0000","last_active":"2024-04-26T21:58:42.252033+0000","last_peered":"2024-04-26T21:58:42.252033+0000","last_clean":"2024-04-26T21:58:42.252033+0000","last_became_active":"2024-04-26T21:58:41.270106+0000","last_became_peered":"2024-04-26T21:58:41.270106+0000","last_unstale":"2024-04-26T21:58:42.252033+0000","last_undegraded":"2024-04-26T21:58:42.252033+0000","last_fullsized":"2024-04-26T21:58:42.252033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250932+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:58:42.250932+0000","last_peered":"2024-04-26T21:58:42.250932+0000","last_clean":"2024-04-26T21:58:42.250932+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:58:42.250932+0000","last_undegraded":"2024-04-26T21:58:42.250932+0000","last_fullsized":"2024-04-26T21:58:42.250932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679020+0000","last_change":"2024-04-26T21:58:40.255645+0000","last_active":"2024-04-26T21:58:42.679020+0000","last_peered":"2024-04-26T21:58:42.679020+0000","last_clean":"2024-04-26T21:58:42.679020+0000","last_became_active":"2024-04-26T21:58:40.254847+0000","last_became_peered":"2024-04-26T21:58:40.254847+0000","last_unstale":"2024-04-26T21:58:42.679020+0000","last_undegraded":"2024-04-26T21:58:42.679020+0000","last_fullsized":"2024-04-26T21:58:42.679020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679864+0000","last_change":"2024-04-26T21:58:41.272174+0000","last_active":"2024-04-26T21:58:42.679864+0000","last_peered":"2024-04-26T21:58:42.679864+0000","last_clean":"2024-04-26T21:58:42.679864+0000","last_became_active":"2024-04-26T21:58:41.271879+0000","last_became_peered":"2024-04-26T21:58:41.271879+0000","last_unstale":"2024-04-26T21:58:42.679864+0000","last_undegraded":"2024-04-26T21:58:42.679864+0000","last_fullsized":"2024-04-26T21:58:42.679864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250883+0000","last_change":"2024-04-26T21:58:40.263425+0000","last_active":"2024-04-26T21:58:42.250883+0000","last_peered":"2024-04-26T21:58:42.250883+0000","last_clean":"2024-04-26T21:58:42.250883+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.250883+0000","last_undegraded":"2024-04-26T21:58:42.250883+0000","last_fullsized":"2024-04-26T21:58:42.250883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678995+0000","last_change":"2024-04-26T21:58:41.266358+0000","last_active":"2024-04-26T21:58:42.678995+0000","last_peered":"2024-04-26T21:58:42.678995+0000","last_clean":"2024-04-26T21:58:42.678995+0000","last_became_active":"2024-04-26T21:58:41.265803+0000","last_became_peered":"2024-04-26T21:58:41.265803+0000","last_unstale":"2024-04-26T21:58:42.678995+0000","last_undegraded":"2024-04-26T21:58:42.678995+0000","last_fullsized":"2024-04-26T21:58:42.678995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:39.448477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679090+0000","last_change":"2024-04-26T21:58:40.263478+0000","last_active":"2024-04-26T21:58:42.679090+0000","last_peered":"2024-04-26T21:58:42.679090+0000","last_clean":"2024-04-26T21:58:42.679090+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.679090+0000","last_undegraded":"2024-04-26T21:58:42.679090+0000","last_fullsized":"2024-04-26T21:58:42.679090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250423+0000","last_change":"2024-04-26T21:58:41.267643+0000","last_active":"2024-04-26T21:58:42.250423+0000","last_peered":"2024-04-26T21:58:42.250423+0000","last_clean":"2024-04-26T21:58:42.250423+0000","last_became_active":"2024-04-26T21:58:41.266985+0000","last_became_peered":"2024-04-26T21:58:41.266985+0000","last_unstale":"2024-04-26T21:58:42.250423+0000","last_undegraded":"2024-04-26T21:58:42.250423+0000","last_fullsized":"2024-04-26T21:58:42.250423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679346+0000","last_change":"2024-04-26T21:58:40.252288+0000","last_active":"2024-04-26T21:58:42.679346+0000","last_peered":"2024-04-26T21:58:42.679346+0000","last_clean":"2024-04-26T21:58:42.679346+0000","last_became_active":"2024-04-26T21:58:40.251940+0000","last_became_peered":"2024-04-26T21:58:40.251940+0000","last_unstale":"2024-04-26T21:58:42.679346+0000","last_undegraded":"2024-04-26T21:58:42.679346+0000","last_fullsized":"2024-04-26T21:58:42.679346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251381+0000","last_change":"2024-04-26T21:58:41.267485+0000","last_active":"2024-04-26T21:58:42.251381+0000","last_peered":"2024-04-26T21:58:42.251381+0000","last_clean":"2024-04-26T21:58:42.251381+0000","last_became_active":"2024-04-26T21:58:41.266964+0000","last_became_peered":"2024-04-26T21:58:41.266964+0000","last_unstale":"2024-04-26T21:58:42.251381+0000","last_undegraded":"2024-04-26T21:58:42.251381+0000","last_fullsized":"2024-04-26T21:58:42.251381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250575+0000","last_change":"2024-04-26T21:58:40.257116+0000","last_active":"2024-04-26T21:58:42.250575+0000","last_peered":"2024-04-26T21:58:42.250575+0000","last_clean":"2024-04-26T21:58:42.250575+0000","last_became_active":"2024-04-26T21:58:40.256843+0000","last_became_peered":"2024-04-26T21:58:40.256843+0000","last_unstale":"2024-04-26T21:58:42.250575+0000","last_undegraded":"2024-04-26T21:58:42.250575+0000","last_fullsized":"2024-04-26T21:58:42.250575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679465+0000","last_change":"2024-04-26T21:58:41.277155+0000","last_active":"2024-04-26T21:58:42.679465+0000","last_peered":"2024-04-26T21:58:42.679465+0000","last_clean":"2024-04-26T21:58:42.679465+0000","last_became_active":"2024-04-26T21:58:41.276120+0000","last_became_peered":"2024-04-26T21:58:41.276120+0000","last_unstale":"2024-04-26T21:58:42.679465+0000","last_undegraded":"2024-04-26T21:58:42.679465+0000","last_fullsized":"2024-04-26T21:58:42.679465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:40.265846+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:40.265527+0000","last_became_peered":"2024-04-26T21:58:40.265527+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:51.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250582+0000","last_change":"2024-04-26T21:58:41.263124+0000","last_active":"2024-04-26T21:58:42.250582+0000","last_peered":"2024-04-26T21:58:42.250582+0000","last_clean":"2024-04-26T21:58:42.250582+0000","last_became_active":"2024-04-26T21:58:41.262827+0000","last_became_peered":"2024-04-26T21:58:41.262827+0000","last_unstale":"2024-04-26T21:58:42.250582+0000","last_undegraded":"2024-04-26T21:58:42.250582+0000","last_fullsized":"2024-04-26T21:58:42.250582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271057+0000","last_change":"2024-04-26T21:58:40.256172+0000","last_active":"2024-04-26T21:58:42.271057+0000","last_peered":"2024-04-26T21:58:42.271057+0000","last_clean":"2024-04-26T21:58:42.271057+0000","last_became_active":"2024-04-26T21:58:40.255894+0000","last_became_peered":"2024-04-26T21:58:40.255894+0000","last_unstale":"2024-04-26T21:58:42.271057+0000","last_undegraded":"2024-04-26T21:58:42.271057+0000","last_fullsized":"2024-04-26T21:58:42.271057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680432+0000","last_change":"2024-04-26T21:58:41.259933+0000","last_active":"2024-04-26T21:58:42.680432+0000","last_peered":"2024-04-26T21:58:42.680432+0000","last_clean":"2024-04-26T21:58:42.680432+0000","last_became_active":"2024-04-26T21:58:41.259662+0000","last_became_peered":"2024-04-26T21:58:41.259662+0000","last_unstale":"2024-04-26T21:58:42.680432+0000","last_undegraded":"2024-04-26T21:58:42.680432+0000","last_fullsized":"2024-04-26T21:58:42.680432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271702+0000","last_change":"2024-04-26T21:58:40.260624+0000","last_active":"2024-04-26T21:58:42.271702+0000","last_peered":"2024-04-26T21:58:42.271702+0000","last_clean":"2024-04-26T21:58:42.271702+0000","last_became_active":"2024-04-26T21:58:40.260181+0000","last_became_peered":"2024-04-26T21:58:40.260181+0000","last_unstale":"2024-04-26T21:58:42.271702+0000","last_undegraded":"2024-04-26T21:58:42.271702+0000","last_fullsized":"2024-04-26T21:58:42.271702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679775+0000","last_change":"2024-04-26T21:58:41.266891+0000","last_active":"2024-04-26T21:58:42.679775+0000","last_peered":"2024-04-26T21:58:42.679775+0000","last_clean":"2024-04-26T21:58:42.679775+0000","last_became_active":"2024-04-26T21:58:41.266593+0000","last_became_peered":"2024-04-26T21:58:41.266593+0000","last_unstale":"2024-04-26T21:58:42.679775+0000","last_undegraded":"2024-04-26T21:58:42.679775+0000","last_fullsized":"2024-04-26T21:58:42.679775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250789+0000","last_change":"2024-04-26T21:58:40.265807+0000","last_active":"2024-04-26T21:58:42.250789+0000","last_peered":"2024-04-26T21:58:42.250789+0000","last_clean":"2024-04-26T21:58:42.250789+0000","last_became_active":"2024-04-26T21:58:40.265534+0000","last_became_peered":"2024-04-26T21:58:40.265534+0000","last_unstale":"2024-04-26T21:58:42.250789+0000","last_undegraded":"2024-04-26T21:58:42.250789+0000","last_fullsized":"2024-04-26T21:58:42.250789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250909+0000","last_change":"2024-04-26T21:58:41.266189+0000","last_active":"2024-04-26T21:58:42.250909+0000","last_peered":"2024-04-26T21:58:42.250909+0000","last_clean":"2024-04-26T21:58:42.250909+0000","last_became_active":"2024-04-26T21:58:41.265907+0000","last_became_peered":"2024-04-26T21:58:41.265907+0000","last_unstale":"2024-04-26T21:58:42.250909+0000","last_undegraded":"2024-04-26T21:58:42.250909+0000","last_fullsized":"2024-04-26T21:58:42.250909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:59.612605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250454+0000","last_change":"2024-04-26T21:58:40.258532+0000","last_active":"2024-04-26T21:58:42.250454+0000","last_peered":"2024-04-26T21:58:42.250454+0000","last_clean":"2024-04-26T21:58:42.250454+0000","last_became_active":"2024-04-26T21:58:40.258249+0000","last_became_peered":"2024-04-26T21:58:40.258249+0000","last_unstale":"2024-04-26T21:58:42.250454+0000","last_undegraded":"2024-04-26T21:58:42.250454+0000","last_fullsized":"2024-04-26T21:58:42.250454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679584+0000","last_change":"2024-04-26T21:58:41.268472+0000","last_active":"2024-04-26T21:58:42.679584+0000","last_peered":"2024-04-26T21:58:42.679584+0000","last_clean":"2024-04-26T21:58:42.679584+0000","last_became_active":"2024-04-26T21:58:41.268180+0000","last_became_peered":"2024-04-26T21:58:41.268180+0000","last_unstale":"2024-04-26T21:58:42.679584+0000","last_undegraded":"2024-04-26T21:58:42.679584+0000","last_fullsized":"2024-04-26T21:58:42.679584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250412+0000","last_change":"2024-04-26T21:58:40.256945+0000","last_active":"2024-04-26T21:58:42.250412+0000","last_peered":"2024-04-26T21:58:42.250412+0000","last_clean":"2024-04-26T21:58:42.250412+0000","last_became_active":"2024-04-26T21:58:40.256606+0000","last_became_peered":"2024-04-26T21:58:40.256606+0000","last_unstale":"2024-04-26T21:58:42.250412+0000","last_undegraded":"2024-04-26T21:58:42.250412+0000","last_fullsized":"2024-04-26T21:58:42.250412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680144+0000","last_change":"2024-04-26T21:58:41.271521+0000","last_active":"2024-04-26T21:58:42.680144+0000","last_peered":"2024-04-26T21:58:42.680144+0000","last_clean":"2024-04-26T21:58:42.680144+0000","last_became_active":"2024-04-26T21:58:41.270434+0000","last_became_peered":"2024-04-26T21:58:41.270434+0000","last_unstale":"2024-04-26T21:58:42.680144+0000","last_undegraded":"2024-04-26T21:58:42.680144+0000","last_fullsized":"2024-04-26T21:58:42.680144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252045+0000","last_change":"2024-04-26T21:58:40.259668+0000","last_active":"2024-04-26T21:58:42.252045+0000","last_peered":"2024-04-26T21:58:42.252045+0000","last_clean":"2024-04-26T21:58:42.252045+0000","last_became_active":"2024-04-26T21:58:40.259395+0000","last_became_peered":"2024-04-26T21:58:40.259395+0000","last_unstale":"2024-04-26T21:58:42.252045+0000","last_undegraded":"2024-04-26T21:58:42.252045+0000","last_fullsized":"2024-04-26T21:58:42.252045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271493+0000","last_change":"2024-04-26T21:58:41.270142+0000","last_active":"2024-04-26T21:58:42.271493+0000","last_peered":"2024-04-26T21:58:42.271493+0000","last_clean":"2024-04-26T21:58:42.271493+0000","last_became_active":"2024-04-26T21:58:41.269888+0000","last_became_peered":"2024-04-26T21:58:41.269888+0000","last_unstale":"2024-04-26T21:58:42.271493+0000","last_undegraded":"2024-04-26T21:58:42.271493+0000","last_fullsized":"2024-04-26T21:58:42.271493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679421+0000","last_change":"2024-04-26T21:58:41.270107+0000","last_active":"2024-04-26T21:58:42.679421+0000","last_peered":"2024-04-26T21:58:42.679421+0000","last_clean":"2024-04-26T21:58:42.679421+0000","last_became_active":"2024-04-26T21:58:41.267030+0000","last_became_peered":"2024-04-26T21:58:41.267030+0000","last_unstale":"2024-04-26T21:58:42.679421+0000","last_undegraded":"2024-04-26T21:58:42.679421+0000","last_fullsized":"2024-04-26T21:58:42.679421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251589+0000","last_change":"2024-04-26T21:58:40.258932+0000","last_active":"2024-04-26T21:58:42.251589+0000","last_peered":"2024-04-26T21:58:42.251589+0000","last_clean":"2024-04-26T21:58:42.251589+0000","last_became_active":"2024-04-26T21:58:40.258648+0000","last_became_peered":"2024-04-26T21:58:40.258648+0000","last_unstale":"2024-04-26T21:58:42.251589+0000","last_undegraded":"2024-04-26T21:58:42.251589+0000","last_fullsized":"2024-04-26T21:58:42.251589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679261+0000","last_change":"2024-04-26T21:58:41.269888+0000","last_active":"2024-04-26T21:58:42.679261+0000","last_peered":"2024-04-26T21:58:42.679261+0000","last_clean":"2024-04-26T21:58:42.679261+0000","last_became_active":"2024-04-26T21:58:41.269608+0000","last_became_peered":"2024-04-26T21:58:41.269608+0000","last_unstale":"2024-04-26T21:58:42.679261+0000","last_undegraded":"2024-04-26T21:58:42.679261+0000","last_fullsized":"2024-04-26T21:58:42.679261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251773+0000","last_change":"2024-04-26T21:58:40.261919+0000","last_active":"2024-04-26T21:58:42.251773+0000","last_peered":"2024-04-26T21:58:42.251773+0000","last_clean":"2024-04-26T21:58:42.251773+0000","last_became_active":"2024-04-26T21:58:40.261644+0000","last_became_peered":"2024-04-26T21:58:40.261644+0000","last_unstale":"2024-04-26T21:58:42.251773+0000","last_undegraded":"2024-04-26T21:58:42.251773+0000","last_fullsized":"2024-04-26T21:58:42.251773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679439+0000","last_change":"2024-04-26T21:58:41.279829+0000","last_active":"2024-04-26T21:58:42.679439+0000","last_peered":"2024-04-26T21:58:42.679439+0000","last_clean":"2024-04-26T21:58:42.679439+0000","last_became_active":"2024-04-26T21:58:41.279430+0000","last_became_peered":"2024-04-26T21:58:41.279430+0000","last_unstale":"2024-04-26T21:58:42.679439+0000","last_undegraded":"2024-04-26T21:58:42.679439+0000","last_fullsized":"2024-04-26T21:58:42.679439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680388+0000","last_change":"2024-04-26T21:58:40.265856+0000","last_active":"2024-04-26T21:58:42.680388+0000","last_peered":"2024-04-26T21:58:42.680388+0000","last_clean":"2024-04-26T21:58:42.680388+0000","last_became_active":"2024-04-26T21:58:40.265592+0000","last_became_peered":"2024-04-26T21:58:40.265592+0000","last_unstale":"2024-04-26T21:58:42.680388+0000","last_undegraded":"2024-04-26T21:58:42.680388+0000","last_fullsized":"2024-04-26T21:58:42.680388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680383+0000","last_change":"2024-04-26T21:58:41.267721+0000","last_active":"2024-04-26T21:58:42.680383+0000","last_peered":"2024-04-26T21:58:42.680383+0000","last_clean":"2024-04-26T21:58:42.680383+0000","last_became_active":"2024-04-26T21:58:41.267424+0000","last_became_peered":"2024-04-26T21:58:41.267424+0000","last_unstale":"2024-04-26T21:58:42.680383+0000","last_undegraded":"2024-04-26T21:58:42.680383+0000","last_fullsized":"2024-04-26T21:58:42.680383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680053+0000","last_change":"2024-04-26T21:58:40.251924+0000","last_active":"2024-04-26T21:58:42.680053+0000","last_peered":"2024-04-26T21:58:42.680053+0000","last_clean":"2024-04-26T21:58:42.680053+0000","last_became_active":"2024-04-26T21:58:40.251596+0000","last_became_peered":"2024-04-26T21:58:40.251596+0000","last_unstale":"2024-04-26T21:58:42.680053+0000","last_undegraded":"2024-04-26T21:58:42.680053+0000","last_fullsized":"2024-04-26T21:58:42.680053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:18:55.150047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:58:53.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:58:53.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.137+0000 7f53ecab1640 1 Processor -- start 2024-04-26T21:58:53.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.137+0000 7f53ecab1640 1 -- start start 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.137+0000 7f53ecab1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53e815d3b0 0x7f53e80735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.137+0000 7f53ecab1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 0x7f53e806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.137+0000 7f53ecab1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53e80b6b80 con 0x7f53e806c7e0 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.137+0000 7f53ecab1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f53e80aedf0 con 0x7f53e815d3b0 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.137+0000 7f53ecab1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f53e806cc40 con 0x7f53e8073b10 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.138+0000 7f53e659c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53e815d3b0 0x7f53e80735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.138+0000 7f53e659c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53e815d3b0 0x7f53e80735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32854/0 (socket says 172.21.15.137:32854) 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.138+0000 7f53e659c640 1 -- 172.21.15.137:0/1603985493 learned_addr learned my addr 172.21.15.137:0/1603985493 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.138+0000 7f53dffff640 1 --2- 172.21.15.137:0/1603985493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 0x7f53e806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.138+0000 7f53e659c640 1 -- 172.21.15.137:0/1603985493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 msgr2=0x7f53e806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.138+0000 7f53e659c640 1 --2- 172.21.15.137:0/1603985493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 0x7f53e806c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.138+0000 7f53e659c640 1 -- 172.21.15.137:0/1603985493 >> v1:172.21.15.170:6789/0 conn(0x7f53e806c7e0 legacy=0x7f53e8160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.138+0000 7f53e659c640 1 -- 172.21.15.137:0/1603985493 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e80b6e60 con 0x7f53e815d3b0 2024-04-26T21:58:53.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53e659c640 1 --2- 172.21.15.137:0/1603985493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 0x7f53e80735d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009870 tx=0x7f53d802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ef0a8e8b83c404 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:53.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53e5d9b640 1 -- 172.21.15.137:0/1603985493 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d8037070 con 0x7f53e815d3b0 2024-04-26T21:58:53.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53e5d9b640 1 -- 172.21.15.137:0/1603985493 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d8032440 con 0x7f53e815d3b0 2024-04-26T21:58:53.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53e5d9b640 1 -- 172.21.15.137:0/1603985493 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d8032810 con 0x7f53e815d3b0 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53ecab1640 1 -- 172.21.15.137:0/1603985493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 msgr2=0x7f53e80735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53ecab1640 1 --2- 172.21.15.137:0/1603985493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 0x7f53e80735d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009870 tx=0x7f53d802a1c0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53ecab1640 1 -- 172.21.15.137:0/1603985493 shutdown_connections 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53ecab1640 1 --2- 172.21.15.137:0/1603985493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 0x7f53e806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53ecab1640 1 --2- 172.21.15.137:0/1603985493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 0x7f53e80735d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53ecab1640 1 -- 172.21.15.137:0/1603985493 >> 172.21.15.137:0/1603985493 conn(0x7f53e80b3b10 msgr2=0x7f53e80b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53ecab1640 1 -- 172.21.15.137:0/1603985493 shutdown_connections 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.139+0000 7f53ecab1640 1 -- 172.21.15.137:0/1603985493 wait complete. 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53ecab1640 1 Processor -- start 2024-04-26T21:58:53.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53ecab1640 1 -- start start 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53ecab1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e806c7e0 0x7f53e8151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53ecab1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 0x7f53e815f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53ecab1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 0x7f53e80b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53ecab1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80d0170 con 0x7f53e815d3b0 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53ecab1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80b6930 con 0x7f53e806c7e0 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53ecab1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f53e815d790 con 0x7f53e8073b10 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 0x7f53e80b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53e6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 0x7f53e80b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32862/0 (socket says 172.21.15.137:32862) 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53e6d9d640 1 -- 172.21.15.137:0/4216149786 learned_addr learned my addr 172.21.15.137:0/4216149786 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53e659c640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e806c7e0 0x7f53e8151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.141+0000 7f53dffff640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 0x7f53e815f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53e6d9d640 1 -- 172.21.15.137:0/4216149786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 msgr2=0x7f53e815f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53e6d9d640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 0x7f53e815f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53e6d9d640 1 -- 172.21.15.137:0/4216149786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e806c7e0 msgr2=0x7f53e8151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53e6d9d640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e806c7e0 0x7f53e8151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53e6d9d640 1 -- 172.21.15.137:0/4216149786 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e8153480 con 0x7f53e815d3b0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53e6d9d640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 0x7f53e80b1df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f53e000c7a0 tx=0x7f53e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53deffd640 1 -- 172.21.15.137:0/4216149786 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0003b70 con 0x7f53e815d3b0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53deffd640 1 -- 172.21.15.137:0/4216149786 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e0003d30 con 0x7f53e815d3b0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e8160080 con 0x7f53e815d3b0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53deffd640 1 -- 172.21.15.137:0/4216149786 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e000aa90 con 0x7f53e815d3b0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.142+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e8153a00 con 0x7f53e815d3b0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.143+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e80693d0 con 0x7f53e815d3b0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.144+0000 7f53deffd640 1 -- 172.21.15.137:0/4216149786 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53e000ac30 con 0x7f53e815d3b0 2024-04-26T21:58:53.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.144+0000 7f53deffd640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f53c806c920 0x7f53c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.144+0000 7f53deffd640 1 -- 172.21.15.137:0/4216149786 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f53e008b850 con 0x7f53e815d3b0 2024-04-26T21:58:53.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.144+0000 7f53e659c640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f53c806c920 0x7f53c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.144+0000 7f53e659c640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f53c806c920 0x7f53c806ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f53d8034000 tx=0x7f53d802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:53.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.148+0000 7f53deffd640 1 -- 172.21.15.137:0/4216149786 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f53e00596c0 con 0x7f53e815d3b0 2024-04-26T21:58:53.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.320+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53e8158f70 con 0x7f53c806c920 2024-04-26T21:58:53.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.326+0000 7f53deffd640 1 -- 172.21.15.137:0/4216149786 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f53e8158f70 con 0x7f53c806c920 2024-04-26T21:58:53.328 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:53.329 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.328+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f53c806c920 msgr2=0x7f53c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.328+0000 7f53ecab1640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f53c806c920 0x7f53c806ede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f53d8034000 tx=0x7f53d802e000 comp rx=0 tx=0).stop 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 msgr2=0x7f53e80b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 0x7f53e80b1df0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f53e000c7a0 tx=0x7f53e000cc60 comp rx=0 tx=0).stop 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 shutdown_connections 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f53c806c920 0x7f53c806ede0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53e815d3b0 0x7f53e80b1df0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53e8073b10 0x7f53e815f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 --2- 172.21.15.137:0/4216149786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53e806c7e0 0x7f53e8151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 >> 172.21.15.137:0/4216149786 conn(0x7f53e80b3b10 msgr2=0x7f53e815c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 shutdown_connections 2024-04-26T21:58:53.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.329+0000 7f53ecab1640 1 -- 172.21.15.137:0/4216149786 wait complete. 2024-04-26T21:58:53.340 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-26T21:58:52.696487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235752,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738968,"statfs":{"total":773094113280,"available":772852703232,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.447157"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252025+0000","last_change":"2024-04-26T21:58:41.268747+0000","last_active":"2024-04-26T21:58:42.252025+0000","last_peered":"2024-04-26T21:58:42.252025+0000","last_clean":"2024-04-26T21:58:42.252025+0000","last_became_active":"2024-04-26T21:58:41.268428+0000","last_became_peered":"2024-04-26T21:58:41.268428+0000","last_unstale":"2024-04-26T21:58:42.252025+0000","last_undegraded":"2024-04-26T21:58:42.252025+0000","last_fullsized":"2024-04-26T21:58:42.252025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250604+0000","last_change":"2024-04-26T21:58:41.267888+0000","last_active":"2024-04-26T21:58:42.250604+0000","last_peered":"2024-04-26T21:58:42.250604+0000","last_clean":"2024-04-26T21:58:42.250604+0000","last_became_active":"2024-04-26T21:58:41.267511+0000","last_became_peered":"2024-04-26T21:58:41.267511+0000","last_unstale":"2024-04-26T21:58:42.250604+0000","last_undegraded":"2024-04-26T21:58:42.250604+0000","last_fullsized":"2024-04-26T21:58:42.250604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679497+0000","last_change":"2024-04-26T21:58:41.265150+0000","last_active":"2024-04-26T21:58:42.679497+0000","last_peered":"2024-04-26T21:58:42.679497+0000","last_clean":"2024-04-26T21:58:42.679497+0000","last_became_active":"2024-04-26T21:58:41.264882+0000","last_became_peered":"2024-04-26T21:58:41.264882+0000","last_unstale":"2024-04-26T21:58:42.679497+0000","last_undegraded":"2024-04-26T21:58:42.679497+0000","last_fullsized":"2024-04-26T21:58:42.679497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679252+0000","last_change":"2024-04-26T21:58:41.276698+0000","last_active":"2024-04-26T21:58:42.679252+0000","last_peered":"2024-04-26T21:58:42.679252+0000","last_clean":"2024-04-26T21:58:42.679252+0000","last_became_active":"2024-04-26T21:58:41.276439+0000","last_became_peered":"2024-04-26T21:58:41.276439+0000","last_unstale":"2024-04-26T21:58:42.679252+0000","last_undegraded":"2024-04-26T21:58:42.679252+0000","last_fullsized":"2024-04-26T21:58:42.679252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251967+0000","last_change":"2024-04-26T21:58:41.266844+0000","last_active":"2024-04-26T21:58:42.251967+0000","last_peered":"2024-04-26T21:58:42.251967+0000","last_clean":"2024-04-26T21:58:42.251967+0000","last_became_active":"2024-04-26T21:58:41.266576+0000","last_became_peered":"2024-04-26T21:58:41.266576+0000","last_unstale":"2024-04-26T21:58:42.251967+0000","last_undegraded":"2024-04-26T21:58:42.251967+0000","last_fullsized":"2024-04-26T21:58:42.251967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679113+0000","last_change":"2024-04-26T21:58:41.274496+0000","last_active":"2024-04-26T21:58:42.679113+0000","last_peered":"2024-04-26T21:58:42.679113+0000","last_clean":"2024-04-26T21:58:42.679113+0000","last_became_active":"2024-04-26T21:58:41.274206+0000","last_became_peered":"2024-04-26T21:58:41.274206+0000","last_unstale":"2024-04-26T21:58:42.679113+0000","last_undegraded":"2024-04-26T21:58:42.679113+0000","last_fullsized":"2024-04-26T21:58:42.679113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251060+0000","last_change":"2024-04-26T21:58:41.263323+0000","last_active":"2024-04-26T21:58:42.251060+0000","last_peered":"2024-04-26T21:58:42.251060+0000","last_clean":"2024-04-26T21:58:42.251060+0000","last_became_active":"2024-04-26T21:58:41.263054+0000","last_became_peered":"2024-04-26T21:58:41.263054+0000","last_unstale":"2024-04-26T21:58:42.251060+0000","last_undegraded":"2024-04-26T21:58:42.251060+0000","last_fullsized":"2024-04-26T21:58:42.251060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679251+0000","last_change":"2024-04-26T21:58:41.271464+0000","last_active":"2024-04-26T21:58:42.679251+0000","last_peered":"2024-04-26T21:58:42.679251+0000","last_clean":"2024-04-26T21:58:42.679251+0000","last_became_active":"2024-04-26T21:58:41.271196+0000","last_became_peered":"2024-04-26T21:58:41.271196+0000","last_unstale":"2024-04-26T21:58:42.679251+0000","last_undegraded":"2024-04-26T21:58:42.679251+0000","last_fullsized":"2024-04-26T21:58:42.679251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252031+0000","last_change":"2024-04-26T21:58:41.263814+0000","last_active":"2024-04-26T21:58:42.252031+0000","last_peered":"2024-04-26T21:58:42.252031+0000","last_clean":"2024-04-26T21:58:42.252031+0000","last_became_active":"2024-04-26T21:58:41.263511+0000","last_became_peered":"2024-04-26T21:58:41.263511+0000","last_unstale":"2024-04-26T21:58:42.252031+0000","last_undegraded":"2024-04-26T21:58:42.252031+0000","last_fullsized":"2024-04-26T21:58:42.252031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271753+0000","last_change":"2024-04-26T21:58:41.275685+0000","last_active":"2024-04-26T21:58:42.271753+0000","last_peered":"2024-04-26T21:58:42.271753+0000","last_clean":"2024-04-26T21:58:42.271753+0000","last_became_active":"2024-04-26T21:58:41.275415+0000","last_became_peered":"2024-04-26T21:58:41.275415+0000","last_unstale":"2024-04-26T21:58:42.271753+0000","last_undegraded":"2024-04-26T21:58:42.271753+0000","last_fullsized":"2024-04-26T21:58:42.271753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271661+0000","last_change":"2024-04-26T21:58:41.278076+0000","last_active":"2024-04-26T21:58:42.271661+0000","last_peered":"2024-04-26T21:58:42.271661+0000","last_clean":"2024-04-26T21:58:42.271661+0000","last_became_active":"2024-04-26T21:58:41.277772+0000","last_became_peered":"2024-04-26T21:58:41.277772+0000","last_unstale":"2024-04-26T21:58:42.271661+0000","last_undegraded":"2024-04-26T21:58:42.271661+0000","last_fullsized":"2024-04-26T21:58:42.271661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251676+0000","last_change":"2024-04-26T21:58:41.265624+0000","last_active":"2024-04-26T21:58:42.251676+0000","last_peered":"2024-04-26T21:58:42.251676+0000","last_clean":"2024-04-26T21:58:42.251676+0000","last_became_active":"2024-04-26T21:58:41.265100+0000","last_became_peered":"2024-04-26T21:58:41.265100+0000","last_unstale":"2024-04-26T21:58:42.251676+0000","last_undegraded":"2024-04-26T21:58:42.251676+0000","last_fullsized":"2024-04-26T21:58:42.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680143+0000","last_change":"2024-04-26T21:58:41.263878+0000","last_active":"2024-04-26T21:58:42.680143+0000","last_peered":"2024-04-26T21:58:42.680143+0000","last_clean":"2024-04-26T21:58:42.680143+0000","last_became_active":"2024-04-26T21:58:41.263324+0000","last_became_peered":"2024-04-26T21:58:41.263324+0000","last_unstale":"2024-04-26T21:58:42.680143+0000","last_undegraded":"2024-04-26T21:58:42.680143+0000","last_fullsized":"2024-04-26T21:58:42.680143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679040+0000","last_change":"2024-04-26T21:58:41.266911+0000","last_active":"2024-04-26T21:58:42.679040+0000","last_peered":"2024-04-26T21:58:42.679040+0000","last_clean":"2024-04-26T21:58:42.679040+0000","last_became_active":"2024-04-26T21:58:41.266650+0000","last_became_peered":"2024-04-26T21:58:41.266650+0000","last_unstale":"2024-04-26T21:58:42.679040+0000","last_undegraded":"2024-04-26T21:58:42.679040+0000","last_fullsized":"2024-04-26T21:58:42.679040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:41.402737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250485+0000","last_change":"2024-04-26T21:58:41.265835+0000","last_active":"2024-04-26T21:58:42.250485+0000","last_peered":"2024-04-26T21:58:42.250485+0000","last_clean":"2024-04-26T21:58:42.250485+0000","last_became_active":"2024-04-26T21:58:41.265546+0000","last_became_peered":"2024-04-26T21:58:41.265546+0000","last_unstale":"2024-04-26T21:58:42.250485+0000","last_undegraded":"2024-04-26T21:58:42.250485+0000","last_fullsized":"2024-04-26T21:58:42.250485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678981+0000","last_change":"2024-04-26T21:58:41.274315+0000","last_active":"2024-04-26T21:58:42.678981+0000","last_peered":"2024-04-26T21:58:42.678981+0000","last_clean":"2024-04-26T21:58:42.678981+0000","last_became_active":"2024-04-26T21:58:41.274000+0000","last_became_peered":"2024-04-26T21:58:41.274000+0000","last_unstale":"2024-04-26T21:58:42.678981+0000","last_undegraded":"2024-04-26T21:58:42.678981+0000","last_fullsized":"2024-04-26T21:58:42.678981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679611+0000","last_change":"2024-04-26T21:58:41.272052+0000","last_active":"2024-04-26T21:58:42.679611+0000","last_peered":"2024-04-26T21:58:42.679611+0000","last_clean":"2024-04-26T21:58:42.679611+0000","last_became_active":"2024-04-26T21:58:41.271775+0000","last_became_peered":"2024-04-26T21:58:41.271775+0000","last_unstale":"2024-04-26T21:58:42.679611+0000","last_undegraded":"2024-04-26T21:58:42.679611+0000","last_fullsized":"2024-04-26T21:58:42.679611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679120+0000","last_change":"2024-04-26T21:58:41.267754+0000","last_active":"2024-04-26T21:58:42.679120+0000","last_peered":"2024-04-26T21:58:42.679120+0000","last_clean":"2024-04-26T21:58:42.679120+0000","last_became_active":"2024-04-26T21:58:41.267414+0000","last_became_peered":"2024-04-26T21:58:41.267414+0000","last_unstale":"2024-04-26T21:58:42.679120+0000","last_undegraded":"2024-04-26T21:58:42.679120+0000","last_fullsized":"2024-04-26T21:58:42.679120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:59.911503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251919+0000","last_change":"2024-04-26T21:58:41.261004+0000","last_active":"2024-04-26T21:58:42.251919+0000","last_peered":"2024-04-26T21:58:42.251919+0000","last_clean":"2024-04-26T21:58:42.251919+0000","last_became_active":"2024-04-26T21:58:41.260578+0000","last_became_peered":"2024-04-26T21:58:41.260578+0000","last_unstale":"2024-04-26T21:58:42.251919+0000","last_undegraded":"2024-04-26T21:58:42.251919+0000","last_fullsized":"2024-04-26T21:58:42.251919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271701+0000","last_change":"2024-04-26T21:58:41.267436+0000","last_active":"2024-04-26T21:58:42.271701+0000","last_peered":"2024-04-26T21:58:42.271701+0000","last_clean":"2024-04-26T21:58:42.271701+0000","last_became_active":"2024-04-26T21:58:41.267151+0000","last_became_peered":"2024-04-26T21:58:41.267151+0000","last_unstale":"2024-04-26T21:58:42.271701+0000","last_undegraded":"2024-04-26T21:58:42.271701+0000","last_fullsized":"2024-04-26T21:58:42.271701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679858+0000","last_change":"2024-04-26T21:58:41.273673+0000","last_active":"2024-04-26T21:58:42.679858+0000","last_peered":"2024-04-26T21:58:42.679858+0000","last_clean":"2024-04-26T21:58:42.679858+0000","last_became_active":"2024-04-26T21:58:41.273384+0000","last_became_peered":"2024-04-26T21:58:41.273384+0000","last_unstale":"2024-04-26T21:58:42.679858+0000","last_undegraded":"2024-04-26T21:58:42.679858+0000","last_fullsized":"2024-04-26T21:58:42.679858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679139+0000","last_change":"2024-04-26T21:58:41.272126+0000","last_active":"2024-04-26T21:58:42.679139+0000","last_peered":"2024-04-26T21:58:42.679139+0000","last_clean":"2024-04-26T21:58:42.679139+0000","last_became_active":"2024-04-26T21:58:41.271816+0000","last_became_peered":"2024-04-26T21:58:41.271816+0000","last_unstale":"2024-04-26T21:58:42.679139+0000","last_undegraded":"2024-04-26T21:58:42.679139+0000","last_fullsized":"2024-04-26T21:58:42.679139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678912+0000","last_change":"2024-04-26T21:58:41.256372+0000","last_active":"2024-04-26T21:58:42.678912+0000","last_peered":"2024-04-26T21:58:42.678912+0000","last_clean":"2024-04-26T21:58:42.678912+0000","last_became_active":"2024-04-26T21:58:41.256119+0000","last_became_peered":"2024-04-26T21:58:41.256119+0000","last_unstale":"2024-04-26T21:58:42.678912+0000","last_undegraded":"2024-04-26T21:58:42.678912+0000","last_fullsized":"2024-04-26T21:58:42.678912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679089+0000","last_change":"2024-04-26T21:58:41.276385+0000","last_active":"2024-04-26T21:58:42.679089+0000","last_peered":"2024-04-26T21:58:42.679089+0000","last_clean":"2024-04-26T21:58:42.679089+0000","last_became_active":"2024-04-26T21:58:41.275917+0000","last_became_peered":"2024-04-26T21:58:41.275917+0000","last_unstale":"2024-04-26T21:58:42.679089+0000","last_undegraded":"2024-04-26T21:58:42.679089+0000","last_fullsized":"2024-04-26T21:58:42.679089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680416+0000","last_change":"2024-04-26T21:58:41.262076+0000","last_active":"2024-04-26T21:58:42.680416+0000","last_peered":"2024-04-26T21:58:42.680416+0000","last_clean":"2024-04-26T21:58:42.680416+0000","last_became_active":"2024-04-26T21:58:41.261726+0000","last_became_peered":"2024-04-26T21:58:41.261726+0000","last_unstale":"2024-04-26T21:58:42.680416+0000","last_undegraded":"2024-04-26T21:58:42.680416+0000","last_fullsized":"2024-04-26T21:58:42.680416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271762+0000","last_change":"2024-04-26T21:58:41.274846+0000","last_active":"2024-04-26T21:58:42.271762+0000","last_peered":"2024-04-26T21:58:42.271762+0000","last_clean":"2024-04-26T21:58:42.271762+0000","last_became_active":"2024-04-26T21:58:41.274526+0000","last_became_peered":"2024-04-26T21:58:41.274526+0000","last_unstale":"2024-04-26T21:58:42.271762+0000","last_undegraded":"2024-04-26T21:58:42.271762+0000","last_fullsized":"2024-04-26T21:58:42.271762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:41.265911+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:41.264263+0000","last_became_peered":"2024-04-26T21:58:41.264263+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680292+0000","last_change":"2024-04-26T21:58:41.257067+0000","last_active":"2024-04-26T21:58:42.680292+0000","last_peered":"2024-04-26T21:58:42.680292+0000","last_clean":"2024-04-26T21:58:42.680292+0000","last_became_active":"2024-04-26T21:58:41.256805+0000","last_became_peered":"2024-04-26T21:58:41.256805+0000","last_unstale":"2024-04-26T21:58:42.680292+0000","last_undegraded":"2024-04-26T21:58:42.680292+0000","last_fullsized":"2024-04-26T21:58:42.680292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679908+0000","last_change":"2024-04-26T21:58:41.266375+0000","last_active":"2024-04-26T21:58:42.679908+0000","last_peered":"2024-04-26T21:58:42.679908+0000","last_clean":"2024-04-26T21:58:42.679908+0000","last_became_active":"2024-04-26T21:58:41.265475+0000","last_became_peered":"2024-04-26T21:58:41.265475+0000","last_unstale":"2024-04-26T21:58:42.679908+0000","last_undegraded":"2024-04-26T21:58:42.679908+0000","last_fullsized":"2024-04-26T21:58:42.679908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679287+0000","last_change":"2024-04-26T21:58:41.277146+0000","last_active":"2024-04-26T21:58:42.679287+0000","last_peered":"2024-04-26T21:58:42.679287+0000","last_clean":"2024-04-26T21:58:42.679287+0000","last_became_active":"2024-04-26T21:58:41.276559+0000","last_became_peered":"2024-04-26T21:58:41.276559+0000","last_unstale":"2024-04-26T21:58:42.679287+0000","last_undegraded":"2024-04-26T21:58:42.679287+0000","last_fullsized":"2024-04-26T21:58:42.679287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:22.834379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678913+0000","last_change":"2024-04-26T21:58:41.276609+0000","last_active":"2024-04-26T21:58:42.678913+0000","last_peered":"2024-04-26T21:58:42.678913+0000","last_clean":"2024-04-26T21:58:42.678913+0000","last_became_active":"2024-04-26T21:58:41.276292+0000","last_became_peered":"2024-04-26T21:58:41.276292+0000","last_unstale":"2024-04-26T21:58:42.678913+0000","last_undegraded":"2024-04-26T21:58:42.678913+0000","last_fullsized":"2024-04-26T21:58:42.678913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271495+0000","last_change":"2024-04-26T21:58:41.270741+0000","last_active":"2024-04-26T21:58:42.271495+0000","last_peered":"2024-04-26T21:58:42.271495+0000","last_clean":"2024-04-26T21:58:42.271495+0000","last_became_active":"2024-04-26T21:58:41.270487+0000","last_became_peered":"2024-04-26T21:58:41.270487+0000","last_unstale":"2024-04-26T21:58:42.271495+0000","last_undegraded":"2024-04-26T21:58:42.271495+0000","last_fullsized":"2024-04-26T21:58:42.271495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250963+0000","last_change":"2024-04-26T21:58:41.266593+0000","last_active":"2024-04-26T21:58:42.250963+0000","last_peered":"2024-04-26T21:58:42.250963+0000","last_clean":"2024-04-26T21:58:42.250963+0000","last_became_active":"2024-04-26T21:58:41.264807+0000","last_became_peered":"2024-04-26T21:58:41.264807+0000","last_unstale":"2024-04-26T21:58:42.250963+0000","last_undegraded":"2024-04-26T21:58:42.250963+0000","last_fullsized":"2024-04-26T21:58:42.250963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:19.885646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680245+0000","last_change":"2024-04-26T21:58:40.261101+0000","last_active":"2024-04-26T21:58:42.680245+0000","last_peered":"2024-04-26T21:58:42.680245+0000","last_clean":"2024-04-26T21:58:42.680245+0000","last_became_active":"2024-04-26T21:58:40.260808+0000","last_became_peered":"2024-04-26T21:58:40.260808+0000","last_unstale":"2024-04-26T21:58:42.680245+0000","last_undegraded":"2024-04-26T21:58:42.680245+0000","last_fullsized":"2024-04-26T21:58:42.680245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679995+0000","last_change":"2024-04-26T21:58:41.266101+0000","last_active":"2024-04-26T21:58:42.679995+0000","last_peered":"2024-04-26T21:58:42.679995+0000","last_clean":"2024-04-26T21:58:42.679995+0000","last_became_active":"2024-04-26T21:58:41.265717+0000","last_became_peered":"2024-04-26T21:58:41.265717+0000","last_unstale":"2024-04-26T21:58:42.679995+0000","last_undegraded":"2024-04-26T21:58:42.679995+0000","last_fullsized":"2024-04-26T21:58:42.679995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271466+0000","last_change":"2024-04-26T21:58:40.258127+0000","last_active":"2024-04-26T21:58:42.271466+0000","last_peered":"2024-04-26T21:58:42.271466+0000","last_clean":"2024-04-26T21:58:42.271466+0000","last_became_active":"2024-04-26T21:58:40.257826+0000","last_became_peered":"2024-04-26T21:58:40.257826+0000","last_unstale":"2024-04-26T21:58:42.271466+0000","last_undegraded":"2024-04-26T21:58:42.271466+0000","last_fullsized":"2024-04-26T21:58:42.271466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679016+0000","last_change":"2024-04-26T21:58:40.260227+0000","last_active":"2024-04-26T21:58:42.679016+0000","last_peered":"2024-04-26T21:58:42.679016+0000","last_clean":"2024-04-26T21:58:42.679016+0000","last_became_active":"2024-04-26T21:58:40.259912+0000","last_became_peered":"2024-04-26T21:58:40.259912+0000","last_unstale":"2024-04-26T21:58:42.679016+0000","last_undegraded":"2024-04-26T21:58:42.679016+0000","last_fullsized":"2024-04-26T21:58:42.679016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679399+0000","last_change":"2024-04-26T21:58:41.270746+0000","last_active":"2024-04-26T21:58:42.679399+0000","last_peered":"2024-04-26T21:58:42.679399+0000","last_clean":"2024-04-26T21:58:42.679399+0000","last_became_active":"2024-04-26T21:58:41.270461+0000","last_became_peered":"2024-04-26T21:58:41.270461+0000","last_unstale":"2024-04-26T21:58:42.679399+0000","last_undegraded":"2024-04-26T21:58:42.679399+0000","last_fullsized":"2024-04-26T21:58:42.679399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679094+0000","last_change":"2024-04-26T21:58:40.251101+0000","last_active":"2024-04-26T21:58:42.679094+0000","last_peered":"2024-04-26T21:58:42.679094+0000","last_clean":"2024-04-26T21:58:42.679094+0000","last_became_active":"2024-04-26T21:58:40.250806+0000","last_became_peered":"2024-04-26T21:58:40.250806+0000","last_unstale":"2024-04-26T21:58:42.679094+0000","last_undegraded":"2024-04-26T21:58:42.679094+0000","last_fullsized":"2024-04-26T21:58:42.679094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250355+0000","last_change":"2024-04-26T21:58:41.264656+0000","last_active":"2024-04-26T21:58:42.250355+0000","last_peered":"2024-04-26T21:58:42.250355+0000","last_clean":"2024-04-26T21:58:42.250355+0000","last_became_active":"2024-04-26T21:58:41.264348+0000","last_became_peered":"2024-04-26T21:58:41.264348+0000","last_unstale":"2024-04-26T21:58:42.250355+0000","last_undegraded":"2024-04-26T21:58:42.250355+0000","last_fullsized":"2024-04-26T21:58:42.250355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271640+0000","last_change":"2024-04-26T21:58:40.258471+0000","last_active":"2024-04-26T21:58:42.271640+0000","last_peered":"2024-04-26T21:58:42.271640+0000","last_clean":"2024-04-26T21:58:42.271640+0000","last_became_active":"2024-04-26T21:58:40.258096+0000","last_became_peered":"2024-04-26T21:58:40.258096+0000","last_unstale":"2024-04-26T21:58:42.271640+0000","last_undegraded":"2024-04-26T21:58:42.271640+0000","last_fullsized":"2024-04-26T21:58:42.271640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679536+0000","last_change":"2024-04-26T21:58:41.273769+0000","last_active":"2024-04-26T21:58:42.679536+0000","last_peered":"2024-04-26T21:58:42.679536+0000","last_clean":"2024-04-26T21:58:42.679536+0000","last_became_active":"2024-04-26T21:58:41.271822+0000","last_became_peered":"2024-04-26T21:58:41.271822+0000","last_unstale":"2024-04-26T21:58:42.679536+0000","last_undegraded":"2024-04-26T21:58:42.679536+0000","last_fullsized":"2024-04-26T21:58:42.679536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679507+0000","last_change":"2024-04-26T21:58:40.258784+0000","last_active":"2024-04-26T21:58:42.679507+0000","last_peered":"2024-04-26T21:58:42.679507+0000","last_clean":"2024-04-26T21:58:42.679507+0000","last_became_active":"2024-04-26T21:58:40.258357+0000","last_became_peered":"2024-04-26T21:58:40.258357+0000","last_unstale":"2024-04-26T21:58:42.679507+0000","last_undegraded":"2024-04-26T21:58:42.679507+0000","last_fullsized":"2024-04-26T21:58:42.679507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679948+0000","last_change":"2024-04-26T21:58:41.279201+0000","last_active":"2024-04-26T21:58:42.679948+0000","last_peered":"2024-04-26T21:58:42.679948+0000","last_clean":"2024-04-26T21:58:42.679948+0000","last_became_active":"2024-04-26T21:58:41.278869+0000","last_became_peered":"2024-04-26T21:58:41.278869+0000","last_unstale":"2024-04-26T21:58:42.679948+0000","last_undegraded":"2024-04-26T21:58:42.679948+0000","last_fullsized":"2024-04-26T21:58:42.679948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250408+0000","last_change":"2024-04-26T21:58:40.255154+0000","last_active":"2024-04-26T21:58:42.250408+0000","last_peered":"2024-04-26T21:58:42.250408+0000","last_clean":"2024-04-26T21:58:42.250408+0000","last_became_active":"2024-04-26T21:58:40.254905+0000","last_became_peered":"2024-04-26T21:58:40.254905+0000","last_unstale":"2024-04-26T21:58:42.250408+0000","last_undegraded":"2024-04-26T21:58:42.250408+0000","last_fullsized":"2024-04-26T21:58:42.250408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251689+0000","last_change":"2024-04-26T21:58:41.255887+0000","last_active":"2024-04-26T21:58:42.251689+0000","last_peered":"2024-04-26T21:58:42.251689+0000","last_clean":"2024-04-26T21:58:42.251689+0000","last_became_active":"2024-04-26T21:58:41.255557+0000","last_became_peered":"2024-04-26T21:58:41.255557+0000","last_unstale":"2024-04-26T21:58:42.251689+0000","last_undegraded":"2024-04-26T21:58:42.251689+0000","last_fullsized":"2024-04-26T21:58:42.251689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:52.499298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271704+0000","last_change":"2024-04-26T21:58:40.263413+0000","last_active":"2024-04-26T21:58:42.271704+0000","last_peered":"2024-04-26T21:58:42.271704+0000","last_clean":"2024-04-26T21:58:42.271704+0000","last_became_active":"2024-04-26T21:58:40.263104+0000","last_became_peered":"2024-04-26T21:58:40.263104+0000","last_unstale":"2024-04-26T21:58:42.271704+0000","last_undegraded":"2024-04-26T21:58:42.271704+0000","last_fullsized":"2024-04-26T21:58:42.271704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251648+0000","last_change":"2024-04-26T21:58:41.264209+0000","last_active":"2024-04-26T21:58:42.251648+0000","last_peered":"2024-04-26T21:58:42.251648+0000","last_clean":"2024-04-26T21:58:42.251648+0000","last_became_active":"2024-04-26T21:58:41.263961+0000","last_became_peered":"2024-04-26T21:58:41.263961+0000","last_unstale":"2024-04-26T21:58:42.251648+0000","last_undegraded":"2024-04-26T21:58:42.251648+0000","last_fullsized":"2024-04-26T21:58:42.251648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:42.160856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680014+0000","last_change":"2024-04-26T21:58:40.248876+0000","last_active":"2024-04-26T21:58:42.680014+0000","last_peered":"2024-04-26T21:58:42.680014+0000","last_clean":"2024-04-26T21:58:42.680014+0000","last_became_active":"2024-04-26T21:58:40.248573+0000","last_became_peered":"2024-04-26T21:58:40.248573+0000","last_unstale":"2024-04-26T21:58:42.680014+0000","last_undegraded":"2024-04-26T21:58:42.680014+0000","last_fullsized":"2024-04-26T21:58:42.680014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679175+0000","last_change":"2024-04-26T21:58:41.262092+0000","last_active":"2024-04-26T21:58:42.679175+0000","last_peered":"2024-04-26T21:58:42.679175+0000","last_clean":"2024-04-26T21:58:42.679175+0000","last_became_active":"2024-04-26T21:58:41.261788+0000","last_became_peered":"2024-04-26T21:58:41.261788+0000","last_unstale":"2024-04-26T21:58:42.679175+0000","last_undegraded":"2024-04-26T21:58:42.679175+0000","last_fullsized":"2024-04-26T21:58:42.679175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:26:28.345096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679243+0000","last_change":"2024-04-26T21:58:40.263316+0000","last_active":"2024-04-26T21:58:42.679243+0000","last_peered":"2024-04-26T21:58:42.679243+0000","last_clean":"2024-04-26T21:58:42.679243+0000","last_became_active":"2024-04-26T21:58:40.263027+0000","last_became_peered":"2024-04-26T21:58:40.263027+0000","last_unstale":"2024-04-26T21:58:42.679243+0000","last_undegraded":"2024-04-26T21:58:42.679243+0000","last_fullsized":"2024-04-26T21:58:42.679243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:41.253991+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:41.253696+0000","last_became_peered":"2024-04-26T21:58:41.253696+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:31:39.145572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271544+0000","last_change":"2024-04-26T21:58:40.261008+0000","last_active":"2024-04-26T21:58:42.271544+0000","last_peered":"2024-04-26T21:58:42.271544+0000","last_clean":"2024-04-26T21:58:42.271544+0000","last_became_active":"2024-04-26T21:58:40.260697+0000","last_became_peered":"2024-04-26T21:58:40.260697+0000","last_unstale":"2024-04-26T21:58:42.271544+0000","last_undegraded":"2024-04-26T21:58:42.271544+0000","last_fullsized":"2024-04-26T21:58:42.271544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271540+0000","last_change":"2024-04-26T21:58:41.271346+0000","last_active":"2024-04-26T21:58:42.271540+0000","last_peered":"2024-04-26T21:58:42.271540+0000","last_clean":"2024-04-26T21:58:42.271540+0000","last_became_active":"2024-04-26T21:58:41.271090+0000","last_became_peered":"2024-04-26T21:58:41.271090+0000","last_unstale":"2024-04-26T21:58:42.271540+0000","last_undegraded":"2024-04-26T21:58:42.271540+0000","last_fullsized":"2024-04-26T21:58:42.271540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678753+0000","last_change":"2024-04-26T21:58:40.253802+0000","last_active":"2024-04-26T21:58:42.678753+0000","last_peered":"2024-04-26T21:58:42.678753+0000","last_clean":"2024-04-26T21:58:42.678753+0000","last_became_active":"2024-04-26T21:58:40.253518+0000","last_became_peered":"2024-04-26T21:58:40.253518+0000","last_unstale":"2024-04-26T21:58:42.678753+0000","last_undegraded":"2024-04-26T21:58:42.678753+0000","last_fullsized":"2024-04-26T21:58:42.678753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251124+0000","last_change":"2024-04-26T21:58:41.254741+0000","last_active":"2024-04-26T21:58:42.251124+0000","last_peered":"2024-04-26T21:58:42.251124+0000","last_clean":"2024-04-26T21:58:42.251124+0000","last_became_active":"2024-04-26T21:58:41.253953+0000","last_became_peered":"2024-04-26T21:58:41.253953+0000","last_unstale":"2024-04-26T21:58:42.251124+0000","last_undegraded":"2024-04-26T21:58:42.251124+0000","last_fullsized":"2024-04-26T21:58:42.251124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:54:56.108427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251491+0000","last_change":"2024-04-26T21:58:40.253095+0000","last_active":"2024-04-26T21:58:42.251491+0000","last_peered":"2024-04-26T21:58:42.251491+0000","last_clean":"2024-04-26T21:58:42.251491+0000","last_became_active":"2024-04-26T21:58:40.252789+0000","last_became_peered":"2024-04-26T21:58:40.252789+0000","last_unstale":"2024-04-26T21:58:42.251491+0000","last_undegraded":"2024-04-26T21:58:42.251491+0000","last_fullsized":"2024-04-26T21:58:42.251491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:04:43.627280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251523+0000","last_change":"2024-04-26T21:58:41.256932+0000","last_active":"2024-04-26T21:58:42.251523+0000","last_peered":"2024-04-26T21:58:42.251523+0000","last_clean":"2024-04-26T21:58:42.251523+0000","last_became_active":"2024-04-26T21:58:41.256652+0000","last_became_peered":"2024-04-26T21:58:41.256652+0000","last_unstale":"2024-04-26T21:58:42.251523+0000","last_undegraded":"2024-04-26T21:58:42.251523+0000","last_fullsized":"2024-04-26T21:58:42.251523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679210+0000","last_change":"2024-04-26T21:58:40.263483+0000","last_active":"2024-04-26T21:58:42.679210+0000","last_peered":"2024-04-26T21:58:42.679210+0000","last_clean":"2024-04-26T21:58:42.679210+0000","last_became_active":"2024-04-26T21:58:40.263197+0000","last_became_peered":"2024-04-26T21:58:40.263197+0000","last_unstale":"2024-04-26T21:58:42.679210+0000","last_undegraded":"2024-04-26T21:58:42.679210+0000","last_fullsized":"2024-04-26T21:58:42.679210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252178+0000","last_change":"2024-04-26T21:58:41.257381+0000","last_active":"2024-04-26T21:58:42.252178+0000","last_peered":"2024-04-26T21:58:42.252178+0000","last_clean":"2024-04-26T21:58:42.252178+0000","last_became_active":"2024-04-26T21:58:41.256911+0000","last_became_peered":"2024-04-26T21:58:41.256911+0000","last_unstale":"2024-04-26T21:58:42.252178+0000","last_undegraded":"2024-04-26T21:58:42.252178+0000","last_fullsized":"2024-04-26T21:58:42.252178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:32.377341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250538+0000","last_change":"2024-04-26T21:58:40.255266+0000","last_active":"2024-04-26T21:58:42.250538+0000","last_peered":"2024-04-26T21:58:42.250538+0000","last_clean":"2024-04-26T21:58:42.250538+0000","last_became_active":"2024-04-26T21:58:40.254863+0000","last_became_peered":"2024-04-26T21:58:40.254863+0000","last_unstale":"2024-04-26T21:58:42.250538+0000","last_undegraded":"2024-04-26T21:58:42.250538+0000","last_fullsized":"2024-04-26T21:58:42.250538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679454+0000","last_change":"2024-04-26T21:58:41.277259+0000","last_active":"2024-04-26T21:58:42.679454+0000","last_peered":"2024-04-26T21:58:42.679454+0000","last_clean":"2024-04-26T21:58:42.679454+0000","last_became_active":"2024-04-26T21:58:41.276186+0000","last_became_peered":"2024-04-26T21:58:41.276186+0000","last_unstale":"2024-04-26T21:58:42.679454+0000","last_undegraded":"2024-04-26T21:58:42.679454+0000","last_fullsized":"2024-04-26T21:58:42.679454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:16.460206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678752+0000","last_change":"2024-04-26T21:58:40.258271+0000","last_active":"2024-04-26T21:58:42.678752+0000","last_peered":"2024-04-26T21:58:42.678752+0000","last_clean":"2024-04-26T21:58:42.678752+0000","last_became_active":"2024-04-26T21:58:40.257941+0000","last_became_peered":"2024-04-26T21:58:40.257941+0000","last_unstale":"2024-04-26T21:58:42.678752+0000","last_undegraded":"2024-04-26T21:58:42.678752+0000","last_fullsized":"2024-04-26T21:58:42.678752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:32.230983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252033+0000","last_change":"2024-04-26T21:58:41.270377+0000","last_active":"2024-04-26T21:58:42.252033+0000","last_peered":"2024-04-26T21:58:42.252033+0000","last_clean":"2024-04-26T21:58:42.252033+0000","last_became_active":"2024-04-26T21:58:41.270106+0000","last_became_peered":"2024-04-26T21:58:41.270106+0000","last_unstale":"2024-04-26T21:58:42.252033+0000","last_undegraded":"2024-04-26T21:58:42.252033+0000","last_fullsized":"2024-04-26T21:58:42.252033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250932+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:58:42.250932+0000","last_peered":"2024-04-26T21:58:42.250932+0000","last_clean":"2024-04-26T21:58:42.250932+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:58:42.250932+0000","last_undegraded":"2024-04-26T21:58:42.250932+0000","last_fullsized":"2024-04-26T21:58:42.250932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679020+0000","last_change":"2024-04-26T21:58:40.255645+0000","last_active":"2024-04-26T21:58:42.679020+0000","last_peered":"2024-04-26T21:58:42.679020+0000","last_clean":"2024-04-26T21:58:42.679020+0000","last_became_active":"2024-04-26T21:58:40.254847+0000","last_became_peered":"2024-04-26T21:58:40.254847+0000","last_unstale":"2024-04-26T21:58:42.679020+0000","last_undegraded":"2024-04-26T21:58:42.679020+0000","last_fullsized":"2024-04-26T21:58:42.679020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679864+0000","last_change":"2024-04-26T21:58:41.272174+0000","last_active":"2024-04-26T21:58:42.679864+0000","last_peered":"2024-04-26T21:58:42.679864+0000","last_clean":"2024-04-26T21:58:42.679864+0000","last_became_active":"2024-04-26T21:58:41.271879+0000","last_became_peered":"2024-04-26T21:58:41.271879+0000","last_unstale":"2024-04-26T21:58:42.679864+0000","last_undegraded":"2024-04-26T21:58:42.679864+0000","last_fullsized":"2024-04-26T21:58:42.679864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:15.481933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250883+0000","last_change":"2024-04-26T21:58:40.263425+0000","last_active":"2024-04-26T21:58:42.250883+0000","last_peered":"2024-04-26T21:58:42.250883+0000","last_clean":"2024-04-26T21:58:42.250883+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.250883+0000","last_undegraded":"2024-04-26T21:58:42.250883+0000","last_fullsized":"2024-04-26T21:58:42.250883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.678995+0000","last_change":"2024-04-26T21:58:41.266358+0000","last_active":"2024-04-26T21:58:42.678995+0000","last_peered":"2024-04-26T21:58:42.678995+0000","last_clean":"2024-04-26T21:58:42.678995+0000","last_became_active":"2024-04-26T21:58:41.265803+0000","last_became_peered":"2024-04-26T21:58:41.265803+0000","last_unstale":"2024-04-26T21:58:42.678995+0000","last_undegraded":"2024-04-26T21:58:42.678995+0000","last_fullsized":"2024-04-26T21:58:42.678995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:39.448477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679090+0000","last_change":"2024-04-26T21:58:40.263478+0000","last_active":"2024-04-26T21:58:42.679090+0000","last_peered":"2024-04-26T21:58:42.679090+0000","last_clean":"2024-04-26T21:58:42.679090+0000","last_became_active":"2024-04-26T21:58:40.263149+0000","last_became_peered":"2024-04-26T21:58:40.263149+0000","last_unstale":"2024-04-26T21:58:42.679090+0000","last_undegraded":"2024-04-26T21:58:42.679090+0000","last_fullsized":"2024-04-26T21:58:42.679090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250423+0000","last_change":"2024-04-26T21:58:41.267643+0000","last_active":"2024-04-26T21:58:42.250423+0000","last_peered":"2024-04-26T21:58:42.250423+0000","last_clean":"2024-04-26T21:58:42.250423+0000","last_became_active":"2024-04-26T21:58:41.266985+0000","last_became_peered":"2024-04-26T21:58:41.266985+0000","last_unstale":"2024-04-26T21:58:42.250423+0000","last_undegraded":"2024-04-26T21:58:42.250423+0000","last_fullsized":"2024-04-26T21:58:42.250423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679346+0000","last_change":"2024-04-26T21:58:40.252288+0000","last_active":"2024-04-26T21:58:42.679346+0000","last_peered":"2024-04-26T21:58:42.679346+0000","last_clean":"2024-04-26T21:58:42.679346+0000","last_became_active":"2024-04-26T21:58:40.251940+0000","last_became_peered":"2024-04-26T21:58:40.251940+0000","last_unstale":"2024-04-26T21:58:42.679346+0000","last_undegraded":"2024-04-26T21:58:42.679346+0000","last_fullsized":"2024-04-26T21:58:42.679346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251381+0000","last_change":"2024-04-26T21:58:41.267485+0000","last_active":"2024-04-26T21:58:42.251381+0000","last_peered":"2024-04-26T21:58:42.251381+0000","last_clean":"2024-04-26T21:58:42.251381+0000","last_became_active":"2024-04-26T21:58:41.266964+0000","last_became_peered":"2024-04-26T21:58:41.266964+0000","last_unstale":"2024-04-26T21:58:42.251381+0000","last_undegraded":"2024-04-26T21:58:42.251381+0000","last_fullsized":"2024-04-26T21:58:42.251381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:05.793985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250575+0000","last_change":"2024-04-26T21:58:40.257116+0000","last_active":"2024-04-26T21:58:42.250575+0000","last_peered":"2024-04-26T21:58:42.250575+0000","last_clean":"2024-04-26T21:58:42.250575+0000","last_became_active":"2024-04-26T21:58:40.256843+0000","last_became_peered":"2024-04-26T21:58:40.256843+0000","last_unstale":"2024-04-26T21:58:42.250575+0000","last_undegraded":"2024-04-26T21:58:42.250575+0000","last_fullsized":"2024-04-26T21:58:42.250575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:59:58.372003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679465+0000","last_change":"2024-04-26T21:58:41.277155+0000","last_active":"2024-04-26T21:58:42.679465+0000","last_peered":"2024-04-26T21:58:42.679465+0000","last_clean":"2024-04-26T21:58:42.679465+0000","last_became_active":"2024-04-26T21:58:41.276120+0000","last_became_peered":"2024-04-26T21:58:41.276120+0000","last_unstale":"2024-04-26T21:58:42.679465+0000","last_undegraded":"2024-04-26T21:58:42.679465+0000","last_fullsized":"2024-04-26T21:58:42.679465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:03.104172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252042+0000","last_change":"2024-04-26T21:58:40.265846+0000","last_active":"2024-04-26T21:58:42.252042+0000","last_peered":"2024-04-26T21:58:42.252042+0000","last_clean":"2024-04-26T21:58:42.252042+0000","last_became_active":"2024-04-26T21:58:40.265527+0000","last_became_peered":"2024-04-26T21:58:40.265527+0000","last_unstale":"2024-04-26T21:58:42.252042+0000","last_undegraded":"2024-04-26T21:58:42.252042+0000","last_fullsized":"2024-04-26T21:58:42.252042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:12:51.495101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250582+0000","last_change":"2024-04-26T21:58:41.263124+0000","last_active":"2024-04-26T21:58:42.250582+0000","last_peered":"2024-04-26T21:58:42.250582+0000","last_clean":"2024-04-26T21:58:42.250582+0000","last_became_active":"2024-04-26T21:58:41.262827+0000","last_became_peered":"2024-04-26T21:58:41.262827+0000","last_unstale":"2024-04-26T21:58:42.250582+0000","last_undegraded":"2024-04-26T21:58:42.250582+0000","last_fullsized":"2024-04-26T21:58:42.250582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:20:04.056640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271057+0000","last_change":"2024-04-26T21:58:40.256172+0000","last_active":"2024-04-26T21:58:42.271057+0000","last_peered":"2024-04-26T21:58:42.271057+0000","last_clean":"2024-04-26T21:58:42.271057+0000","last_became_active":"2024-04-26T21:58:40.255894+0000","last_became_peered":"2024-04-26T21:58:40.255894+0000","last_unstale":"2024-04-26T21:58:42.271057+0000","last_undegraded":"2024-04-26T21:58:42.271057+0000","last_fullsized":"2024-04-26T21:58:42.271057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680432+0000","last_change":"2024-04-26T21:58:41.259933+0000","last_active":"2024-04-26T21:58:42.680432+0000","last_peered":"2024-04-26T21:58:42.680432+0000","last_clean":"2024-04-26T21:58:42.680432+0000","last_became_active":"2024-04-26T21:58:41.259662+0000","last_became_peered":"2024-04-26T21:58:41.259662+0000","last_unstale":"2024-04-26T21:58:42.680432+0000","last_undegraded":"2024-04-26T21:58:42.680432+0000","last_fullsized":"2024-04-26T21:58:42.680432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271702+0000","last_change":"2024-04-26T21:58:40.260624+0000","last_active":"2024-04-26T21:58:42.271702+0000","last_peered":"2024-04-26T21:58:42.271702+0000","last_clean":"2024-04-26T21:58:42.271702+0000","last_became_active":"2024-04-26T21:58:40.260181+0000","last_became_peered":"2024-04-26T21:58:40.260181+0000","last_unstale":"2024-04-26T21:58:42.271702+0000","last_undegraded":"2024-04-26T21:58:42.271702+0000","last_fullsized":"2024-04-26T21:58:42.271702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679775+0000","last_change":"2024-04-26T21:58:41.266891+0000","last_active":"2024-04-26T21:58:42.679775+0000","last_peered":"2024-04-26T21:58:42.679775+0000","last_clean":"2024-04-26T21:58:42.679775+0000","last_became_active":"2024-04-26T21:58:41.266593+0000","last_became_peered":"2024-04-26T21:58:41.266593+0000","last_unstale":"2024-04-26T21:58:42.679775+0000","last_undegraded":"2024-04-26T21:58:42.679775+0000","last_fullsized":"2024-04-26T21:58:42.679775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:08.023900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250789+0000","last_change":"2024-04-26T21:58:40.265807+0000","last_active":"2024-04-26T21:58:42.250789+0000","last_peered":"2024-04-26T21:58:42.250789+0000","last_clean":"2024-04-26T21:58:42.250789+0000","last_became_active":"2024-04-26T21:58:40.265534+0000","last_became_peered":"2024-04-26T21:58:40.265534+0000","last_unstale":"2024-04-26T21:58:42.250789+0000","last_undegraded":"2024-04-26T21:58:42.250789+0000","last_fullsized":"2024-04-26T21:58:42.250789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:28.311991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250909+0000","last_change":"2024-04-26T21:58:41.266189+0000","last_active":"2024-04-26T21:58:42.250909+0000","last_peered":"2024-04-26T21:58:42.250909+0000","last_clean":"2024-04-26T21:58:42.250909+0000","last_became_active":"2024-04-26T21:58:41.265907+0000","last_became_peered":"2024-04-26T21:58:41.265907+0000","last_unstale":"2024-04-26T21:58:42.250909+0000","last_undegraded":"2024-04-26T21:58:42.250909+0000","last_fullsized":"2024-04-26T21:58:42.250909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:59.612605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250454+0000","last_change":"2024-04-26T21:58:40.258532+0000","last_active":"2024-04-26T21:58:42.250454+0000","last_peered":"2024-04-26T21:58:42.250454+0000","last_clean":"2024-04-26T21:58:42.250454+0000","last_became_active":"2024-04-26T21:58:40.258249+0000","last_became_peered":"2024-04-26T21:58:40.258249+0000","last_unstale":"2024-04-26T21:58:42.250454+0000","last_undegraded":"2024-04-26T21:58:42.250454+0000","last_fullsized":"2024-04-26T21:58:42.250454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:33:58.608408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679584+0000","last_change":"2024-04-26T21:58:41.268472+0000","last_active":"2024-04-26T21:58:42.679584+0000","last_peered":"2024-04-26T21:58:42.679584+0000","last_clean":"2024-04-26T21:58:42.679584+0000","last_became_active":"2024-04-26T21:58:41.268180+0000","last_became_peered":"2024-04-26T21:58:41.268180+0000","last_unstale":"2024-04-26T21:58:42.679584+0000","last_undegraded":"2024-04-26T21:58:42.679584+0000","last_fullsized":"2024-04-26T21:58:42.679584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:01.399414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.250412+0000","last_change":"2024-04-26T21:58:40.256945+0000","last_active":"2024-04-26T21:58:42.250412+0000","last_peered":"2024-04-26T21:58:42.250412+0000","last_clean":"2024-04-26T21:58:42.250412+0000","last_became_active":"2024-04-26T21:58:40.256606+0000","last_became_peered":"2024-04-26T21:58:40.256606+0000","last_unstale":"2024-04-26T21:58:42.250412+0000","last_undegraded":"2024-04-26T21:58:42.250412+0000","last_fullsized":"2024-04-26T21:58:42.250412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680144+0000","last_change":"2024-04-26T21:58:41.271521+0000","last_active":"2024-04-26T21:58:42.680144+0000","last_peered":"2024-04-26T21:58:42.680144+0000","last_clean":"2024-04-26T21:58:42.680144+0000","last_became_active":"2024-04-26T21:58:41.270434+0000","last_became_peered":"2024-04-26T21:58:41.270434+0000","last_unstale":"2024-04-26T21:58:42.680144+0000","last_undegraded":"2024-04-26T21:58:42.680144+0000","last_fullsized":"2024-04-26T21:58:42.680144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:07.983256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.252045+0000","last_change":"2024-04-26T21:58:40.259668+0000","last_active":"2024-04-26T21:58:42.252045+0000","last_peered":"2024-04-26T21:58:42.252045+0000","last_clean":"2024-04-26T21:58:42.252045+0000","last_became_active":"2024-04-26T21:58:40.259395+0000","last_became_peered":"2024-04-26T21:58:40.259395+0000","last_unstale":"2024-04-26T21:58:42.252045+0000","last_undegraded":"2024-04-26T21:58:42.252045+0000","last_fullsized":"2024-04-26T21:58:42.252045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:09:04.789788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.271493+0000","last_change":"2024-04-26T21:58:41.270142+0000","last_active":"2024-04-26T21:58:42.271493+0000","last_peered":"2024-04-26T21:58:42.271493+0000","last_clean":"2024-04-26T21:58:42.271493+0000","last_became_active":"2024-04-26T21:58:41.269888+0000","last_became_peered":"2024-04-26T21:58:41.269888+0000","last_unstale":"2024-04-26T21:58:42.271493+0000","last_undegraded":"2024-04-26T21:58:42.271493+0000","last_fullsized":"2024-04-26T21:58:42.271493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:14.674651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679421+0000","last_change":"2024-04-26T21:58:41.270107+0000","last_active":"2024-04-26T21:58:42.679421+0000","last_peered":"2024-04-26T21:58:42.679421+0000","last_clean":"2024-04-26T21:58:42.679421+0000","last_became_active":"2024-04-26T21:58:41.267030+0000","last_became_peered":"2024-04-26T21:58:41.267030+0000","last_unstale":"2024-04-26T21:58:42.679421+0000","last_undegraded":"2024-04-26T21:58:42.679421+0000","last_fullsized":"2024-04-26T21:58:42.679421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:25:34.751184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251589+0000","last_change":"2024-04-26T21:58:40.258932+0000","last_active":"2024-04-26T21:58:42.251589+0000","last_peered":"2024-04-26T21:58:42.251589+0000","last_clean":"2024-04-26T21:58:42.251589+0000","last_became_active":"2024-04-26T21:58:40.258648+0000","last_became_peered":"2024-04-26T21:58:40.258648+0000","last_unstale":"2024-04-26T21:58:42.251589+0000","last_undegraded":"2024-04-26T21:58:42.251589+0000","last_fullsized":"2024-04-26T21:58:42.251589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:18.881449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679261+0000","last_change":"2024-04-26T21:58:41.269888+0000","last_active":"2024-04-26T21:58:42.679261+0000","last_peered":"2024-04-26T21:58:42.679261+0000","last_clean":"2024-04-26T21:58:42.679261+0000","last_became_active":"2024-04-26T21:58:41.269608+0000","last_became_peered":"2024-04-26T21:58:41.269608+0000","last_unstale":"2024-04-26T21:58:42.679261+0000","last_undegraded":"2024-04-26T21:58:42.679261+0000","last_fullsized":"2024-04-26T21:58:42.679261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:10.863058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.251773+0000","last_change":"2024-04-26T21:58:40.261919+0000","last_active":"2024-04-26T21:58:42.251773+0000","last_peered":"2024-04-26T21:58:42.251773+0000","last_clean":"2024-04-26T21:58:42.251773+0000","last_became_active":"2024-04-26T21:58:40.261644+0000","last_became_peered":"2024-04-26T21:58:40.261644+0000","last_unstale":"2024-04-26T21:58:42.251773+0000","last_undegraded":"2024-04-26T21:58:42.251773+0000","last_fullsized":"2024-04-26T21:58:42.251773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:26:58.907306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.679439+0000","last_change":"2024-04-26T21:58:41.279829+0000","last_active":"2024-04-26T21:58:42.679439+0000","last_peered":"2024-04-26T21:58:42.679439+0000","last_clean":"2024-04-26T21:58:42.679439+0000","last_became_active":"2024-04-26T21:58:41.279430+0000","last_became_peered":"2024-04-26T21:58:41.279430+0000","last_unstale":"2024-04-26T21:58:42.679439+0000","last_undegraded":"2024-04-26T21:58:42.679439+0000","last_fullsized":"2024-04-26T21:58:42.679439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:48.866696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680388+0000","last_change":"2024-04-26T21:58:40.265856+0000","last_active":"2024-04-26T21:58:42.680388+0000","last_peered":"2024-04-26T21:58:42.680388+0000","last_clean":"2024-04-26T21:58:42.680388+0000","last_became_active":"2024-04-26T21:58:40.265592+0000","last_became_peered":"2024-04-26T21:58:40.265592+0000","last_unstale":"2024-04-26T21:58:42.680388+0000","last_undegraded":"2024-04-26T21:58:42.680388+0000","last_fullsized":"2024-04-26T21:58:42.680388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:41.249404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680383+0000","last_change":"2024-04-26T21:58:41.267721+0000","last_active":"2024-04-26T21:58:42.680383+0000","last_peered":"2024-04-26T21:58:42.680383+0000","last_clean":"2024-04-26T21:58:42.680383+0000","last_became_active":"2024-04-26T21:58:41.267424+0000","last_became_peered":"2024-04-26T21:58:41.267424+0000","last_unstale":"2024-04-26T21:58:42.680383+0000","last_undegraded":"2024-04-26T21:58:42.680383+0000","last_fullsized":"2024-04-26T21:58:42.680383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:40.237090+0000","last_clean_scrub_stamp":"2024-04-26T21:58:40.237090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:29.005534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T21:58:42.680053+0000","last_change":"2024-04-26T21:58:40.251924+0000","last_active":"2024-04-26T21:58:42.680053+0000","last_peered":"2024-04-26T21:58:42.680053+0000","last_clean":"2024-04-26T21:58:42.680053+0000","last_became_active":"2024-04-26T21:58:40.251596+0000","last_became_peered":"2024-04-26T21:58:40.251596+0000","last_unstale":"2024-04-26T21:58:42.680053+0000","last_undegraded":"2024-04-26T21:58:42.680053+0000","last_fullsized":"2024-04-26T21:58:42.680053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:39.232893+0000","last_clean_scrub_stamp":"2024-04-26T21:58:39.232893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:18:55.150047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:58:53.343 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T21:58:53.343 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T21:58:53.343 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T21:58:53.344 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T21:58:53.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.475+0000 7f397cb4e640 1 Processor -- start 2024-04-26T21:58:53.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.475+0000 7f397cb4e640 1 -- start start 2024-04-26T21:58:53.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.476+0000 7f397cb4e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f397815f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.476+0000 7f397cb4e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f39780b5530 0x7f39780d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.476+0000 7f397cb4e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f397815fce0 con 0x7f3978070570 2024-04-26T21:58:53.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.476+0000 7f397cb4e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f39780b59c0 con 0x7f39780b5530 2024-04-26T21:58:53.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.476+0000 7f397cb4e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3978160610 con 0x7f397809ba40 2024-04-26T21:58:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.476+0000 7f3976d9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f39780b5530 0x7f39780d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.476+0000 7f397659c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f397815f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.476+0000 7f3975d9b640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f3978070570 0x7f397809be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:56520/0 (socket says 172.21.15.137:56520) 2024-04-26T21:58:53.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.476+0000 7f3975d9b640 1 -- 172.21.15.137:0/789454227 learned_addr learned my addr 172.21.15.137:0/789454227 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.477+0000 7f3976d9d640 1 -- 172.21.15.137:0/789454227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 msgr2=0x7f397815f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.477+0000 7f3976d9d640 1 --2- 172.21.15.137:0/789454227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f397815f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.477+0000 7f3976d9d640 1 -- 172.21.15.137:0/789454227 >> v1:172.21.15.170:6789/0 conn(0x7f3978070570 legacy=0x7f397809be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.477+0000 7f3976d9d640 1 -- 172.21.15.137:0/789454227 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397815ffc0 con 0x7f39780b5530 2024-04-26T21:58:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.477+0000 7f3976d9d640 1 --2- 172.21.15.137:0/789454227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39780b5530 0x7f39780d1040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39700097d0 tx=0x7f397002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dccf64d7f4ac51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.477+0000 7f397559a640 1 -- 172.21.15.137:0/789454227 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970037070 con 0x7f39780b5530 2024-04-26T21:58:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397559a640 1 -- 172.21.15.137:0/789454227 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3970032440 con 0x7f39780b5530 2024-04-26T21:58:53.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397559a640 1 -- 172.21.15.137:0/789454227 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970032810 con 0x7f39780b5530 2024-04-26T21:58:53.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397cb4e640 1 -- 172.21.15.137:0/789454227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39780b5530 msgr2=0x7f39780d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397cb4e640 1 --2- 172.21.15.137:0/789454227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39780b5530 0x7f39780d1040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f39700097d0 tx=0x7f397002a1c0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397cb4e640 1 -- 172.21.15.137:0/789454227 shutdown_connections 2024-04-26T21:58:53.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397cb4e640 1 --2- 172.21.15.137:0/789454227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39780b5530 0x7f39780d1040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397cb4e640 1 --2- 172.21.15.137:0/789454227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f397815f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397cb4e640 1 -- 172.21.15.137:0/789454227 >> 172.21.15.137:0/789454227 conn(0x7f39780b4a10 msgr2=0x7f39780b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:53.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397cb4e640 1 -- 172.21.15.137:0/789454227 shutdown_connections 2024-04-26T21:58:53.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.478+0000 7f397cb4e640 1 -- 172.21.15.137:0/789454227 wait complete. 2024-04-26T21:58:53.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.479+0000 7f397cb4e640 1 Processor -- start 2024-04-26T21:58:53.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f397cb4e640 1 -- start start 2024-04-26T21:58:53.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f397cb4e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3978070570 0x7f3978159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f397cb4e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f39780cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f397cb4e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39780b5530 0x7f397806dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f397cb4e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f39780d1580 con 0x7f39780b5530 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f397cb4e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39780709b0 con 0x7f3978070570 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f397cb4e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39780d1700 con 0x7f397809ba40 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f397659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3978070570 0x7f3978159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f3976d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39780b5530 0x7f397806dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f3975d9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f39780cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f3976d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39780b5530 0x7f397806dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32864/0 (socket says 172.21.15.137:32864) 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f397659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3978070570 0x7f3978159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54650/0 (socket says 172.21.15.137:54650) 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f3975d9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f39780cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:40366/0 (socket says 172.21.15.137:40366) 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.480+0000 7f3976d9d640 1 -- 172.21.15.137:0/36365417 learned_addr learned my addr 172.21.15.137:0/36365417 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3976d9d640 1 -- 172.21.15.137:0/36365417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 msgr2=0x7f39780cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3976d9d640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f39780cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3976d9d640 1 -- 172.21.15.137:0/36365417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3978070570 msgr2=0x7f3978159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3976d9d640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3978070570 0x7f3978159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3976d9d640 1 -- 172.21.15.137:0/36365417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39780cded0 con 0x7f39780b5530 2024-04-26T21:58:53.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3975d9b640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f39780cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:58:53.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3976d9d640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39780b5530 0x7f397806dd60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f397002a7b0 tx=0x7f39700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:53.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3966ffd640 1 -- 172.21.15.137:0/36365417 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970037040 con 0x7f39780b5530 2024-04-26T21:58:53.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3966ffd640 1 -- 172.21.15.137:0/36365417 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3970042070 con 0x7f39780b5530 2024-04-26T21:58:53.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39780ce1b0 con 0x7f39780b5530 2024-04-26T21:58:53.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f3966ffd640 1 -- 172.21.15.137:0/36365417 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397003b930 con 0x7f39780b5530 2024-04-26T21:58:53.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.481+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39780ce770 con 0x7f39780b5530 2024-04-26T21:58:53.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.482+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f397806a290 con 0x7f39780b5530 2024-04-26T21:58:53.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.483+0000 7f3966ffd640 1 -- 172.21.15.137:0/36365417 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f397003bad0 con 0x7f39780b5530 2024-04-26T21:58:53.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.483+0000 7f3966ffd640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c920 0x7f395806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.483+0000 7f3966ffd640 1 -- 172.21.15.137:0/36365417 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f39700ac260 con 0x7f39780b5530 2024-04-26T21:58:53.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.483+0000 7f397659c640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c920 0x7f395806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.483+0000 7f397659c640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c920 0x7f395806ede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39680113e0 tx=0x7f396800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:53.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.487+0000 7f3966ffd640 1 -- 172.21.15.137:0/36365417 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f397007a040 con 0x7f39780b5530 2024-04-26T21:58:53.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.700+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3978071ad0 con 0x7f39780b5530 2024-04-26T21:58:53.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.701+0000 7f3966ffd640 1 -- 172.21.15.137:0/36365417 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f397007e340 con 0x7f39780b5530 2024-04-26T21:58:53.701 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:53.701 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.702+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c920 msgr2=0x7f395806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.702+0000 7f397cb4e640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c920 0x7f395806ede0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39680113e0 tx=0x7f396800b040 comp rx=0 tx=0).stop 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.702+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39780b5530 msgr2=0x7f397806dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.702+0000 7f397cb4e640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39780b5530 0x7f397806dd60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f397002a7b0 tx=0x7f39700046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.702+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 shutdown_connections 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.703+0000 7f397cb4e640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c920 0x7f395806ede0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.703+0000 7f397cb4e640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39780b5530 0x7f397806dd60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.703+0000 7f397cb4e640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f397809ba40 0x7f39780cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.703+0000 7f397cb4e640 1 --2- 172.21.15.137:0/36365417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3978070570 0x7f3978159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.703+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 >> 172.21.15.137:0/36365417 conn(0x7f39780b4a10 msgr2=0x7f397815c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.703+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 shutdown_connections 2024-04-26T21:58:53.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.703+0000 7f397cb4e640 1 -- 172.21.15.137:0/36365417 wait complete. 2024-04-26T21:58:53.713 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T21:58:53.714 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:53.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.810+0000 7f705d4f1640 1 Processor -- start 2024-04-26T21:58:53.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.810+0000 7f705d4f1640 1 -- start start 2024-04-26T21:58:53.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f705d4f1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f705815f720 0x7f70580b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f705d4f1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f70580d5610 0x7f70580d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f705d4f1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70580b2510 con 0x7f705815f340 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f705d4f1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f70580b27f0 con 0x7f705815f720 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f705d4f1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f70580b2ad0 con 0x7f70580d5610 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f70567fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f705815f720 0x7f70580b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f7056ffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f705815f340 0x7f70580d4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42136/0 (socket says 172.21.15.137:42136) 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f7056ffd640 1 -- 172.21.15.137:0/849573027 learned_addr learned my addr 172.21.15.137:0/849573027 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f70577fe640 1 --2- 172.21.15.137:0/849573027 >> v2:172.21.15.170:3300/0 conn(0x7f70580d5610 0x7f70580d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f7055ffb640 1 -- 172.21.15.137:0/849573027 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787892012 0 0) 0x7f70580b2510 con 0x7f705815f340 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f7055ffb640 1 -- 172.21.15.137:0/849573027 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7040003520 con 0x7f705815f340 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f70567fc640 1 -- 172.21.15.137:0/849573027 >> v2:172.21.15.170:3300/0 conn(0x7f70580d5610 msgr2=0x7f70580d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f70567fc640 1 --2- 172.21.15.137:0/849573027 >> v2:172.21.15.170:3300/0 conn(0x7f70580d5610 0x7f70580d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f70567fc640 1 -- 172.21.15.137:0/849573027 >> v1:172.21.15.137:6789/0 conn(0x7f705815f340 legacy=0x7f70580d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.811+0000 7f70567fc640 1 -- 172.21.15.137:0/849573027 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70580b2db0 con 0x7f705815f720 2024-04-26T21:58:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.812+0000 7f70567fc640 1 --2- 172.21.15.137:0/849573027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f720 0x7f70580b1e80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f70580d4c20 tx=0x7f704c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe5dffcf214040f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.812+0000 7f7055ffb640 1 -- 172.21.15.137:0/849573027 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c037070 con 0x7f705815f720 2024-04-26T21:58:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.812+0000 7f7055ffb640 1 -- 172.21.15.137:0/849573027 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f704c032440 con 0x7f705815f720 2024-04-26T21:58:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.812+0000 7f7055ffb640 1 -- 172.21.15.137:0/849573027 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c02ae60 con 0x7f705815f720 2024-04-26T21:58:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.813+0000 7f705d4f1640 1 -- 172.21.15.137:0/849573027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f720 msgr2=0x7f70580b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.813+0000 7f705d4f1640 1 --2- 172.21.15.137:0/849573027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f720 0x7f70580b1e80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f70580d4c20 tx=0x7f704c02a110 comp rx=0 tx=0).stop 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.813+0000 7f705d4f1640 1 -- 172.21.15.137:0/849573027 shutdown_connections 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.813+0000 7f705d4f1640 1 --2- 172.21.15.137:0/849573027 >> v2:172.21.15.170:3300/0 conn(0x7f70580d5610 0x7f70580d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.813+0000 7f705d4f1640 1 --2- 172.21.15.137:0/849573027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f720 0x7f70580b1e80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.813+0000 7f705d4f1640 1 -- 172.21.15.137:0/849573027 >> 172.21.15.137:0/849573027 conn(0x7f705808ec70 msgr2=0x7f705809e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.813+0000 7f705d4f1640 1 -- 172.21.15.137:0/849573027 shutdown_connections 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.813+0000 7f705d4f1640 1 -- 172.21.15.137:0/849573027 wait complete. 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.814+0000 7f705d4f1640 1 Processor -- start 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.814+0000 7f705d4f1640 1 -- start start 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f705d4f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70580d5610 0x7f705815b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f705d4f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f340 0x7f70580ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f705d4f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f705815f720 0x7f705806e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f705d4f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f70580b3940 con 0x7f705815f340 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f705d4f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f70580b37c0 con 0x7f70580d5610 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f705d4f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f70580b3ac0 con 0x7f705815f720 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f70567fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f340 0x7f70580ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f70567fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f340 0x7f70580ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32894/0 (socket says 172.21.15.137:32894) 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f70567fc640 1 -- 172.21.15.137:0/2611490778 learned_addr learned my addr 172.21.15.137:0/2611490778 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f7056ffd640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70580d5610 0x7f705815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f70567fc640 1 -- 172.21.15.137:0/2611490778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f705815f720 msgr2=0x7f705806e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f70567fc640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f705815f720 0x7f705806e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f70567fc640 1 -- 172.21.15.137:0/2611490778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70580d5610 msgr2=0x7f705815b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f70567fc640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70580d5610 0x7f705815b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:53.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f70567fc640 1 -- 172.21.15.137:0/2611490778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70580cbae0 con 0x7f705815f340 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f70567fc640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f340 0x7f70580ca7e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f704c000c00 tx=0x7f704c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f703f7fe640 1 -- 172.21.15.137:0/2611490778 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c041020 con 0x7f705815f340 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f703f7fe640 1 -- 172.21.15.137:0/2611490778 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f704c03d700 con 0x7f705815f340 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f703f7fe640 1 -- 172.21.15.137:0/2611490778 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c037040 con 0x7f705815f340 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70581f8a10 con 0x7f705815f340 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.815+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70581f8fd0 con 0x7f705815f340 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.816+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f705815b580 con 0x7f705815f340 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.817+0000 7f703f7fe640 1 -- 172.21.15.137:0/2611490778 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f704c044020 con 0x7f705815f340 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.817+0000 7f703f7fe640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f704406c8f0 0x7f704406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:53.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.817+0000 7f703f7fe640 1 -- 172.21.15.137:0/2611490778 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f704c0ac2b0 con 0x7f705815f340 2024-04-26T21:58:53.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.817+0000 7f7056ffd640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f704406c8f0 0x7f704406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:53.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.818+0000 7f7056ffd640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f704406c8f0 0x7f704406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f70480012e0 tx=0x7f7048009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:53.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.822+0000 7f703f7fe640 1 -- 172.21.15.137:0/2611490778 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f704c04b030 con 0x7f705815f340 2024-04-26T21:58:53.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.998+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70580d3020 con 0x7f705815f340 2024-04-26T21:58:53.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:53.999+0000 7f703f7fe640 1 -- 172.21.15.137:0/2611490778 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f70580cbae0 con 0x7f705815f340 2024-04-26T21:58:53.999 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:53.999 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:54.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f704406c8f0 msgr2=0x7f704406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f704406c8f0 0x7f704406edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f70480012e0 tx=0x7f7048009040 comp rx=0 tx=0).stop 2024-04-26T21:58:54.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f340 msgr2=0x7f70580ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f340 0x7f70580ca7e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f704c000c00 tx=0x7f704c0046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 shutdown_connections 2024-04-26T21:58:54.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f704406c8f0 0x7f704406edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f705815f340 0x7f70580ca7e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f705815f720 0x7f705806e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 --2- 172.21.15.137:0/2611490778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70580d5610 0x7f705815b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 >> 172.21.15.137:0/2611490778 conn(0x7f705808ec70 msgr2=0x7f70580d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:54.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 shutdown_connections 2024-04-26T21:58:54.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.001+0000 7f705d4f1640 1 -- 172.21.15.137:0/2611490778 wait complete. 2024-04-26T21:58:54.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:58:54.012 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:58:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.112+0000 7f07e43af640 1 Processor -- start 2024-04-26T21:58:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.112+0000 7f07e43af640 1 -- start start 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e43af640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f07dc15d1f0 0x7f07dc070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e43af640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07dc0d1300 0x7f07dc0d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e43af640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07dc06e2c0 con 0x7f07dc073090 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e43af640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f07dc06da60 con 0x7f07dc0d1300 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e43af640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f07dc0d17c0 con 0x7f07dc15d1f0 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e194a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07dc0d1300 0x7f07dc0d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e194a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f07dc0d1300 0x7f07dc0d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32896/0 (socket says 172.21.15.137:32896) 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e194a640 1 -- 172.21.15.137:0/2959251074 learned_addr learned my addr 172.21.15.137:0/2959251074 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e214b640 1 --2- 172.21.15.137:0/2959251074 >> v2:172.21.15.170:3300/0 conn(0x7f07dc15d1f0 0x7f07dc070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e194a640 1 -- 172.21.15.137:0/2959251074 >> v2:172.21.15.170:3300/0 conn(0x7f07dc15d1f0 msgr2=0x7f07dc070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e194a640 1 --2- 172.21.15.137:0/2959251074 >> v2:172.21.15.170:3300/0 conn(0x7f07dc15d1f0 0x7f07dc070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e194a640 1 -- 172.21.15.137:0/2959251074 >> v1:172.21.15.170:6789/0 conn(0x7f07dc073090 legacy=0x7f07dc0734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e194a640 1 -- 172.21.15.137:0/2959251074 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc06dd00 con 0x7f07dc0d1300 2024-04-26T21:58:54.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.113+0000 7f07e214b640 1 --2- 172.21.15.137:0/2959251074 >> v2:172.21.15.170:3300/0 conn(0x7f07dc15d1f0 0x7f07dc070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:54.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e194a640 1 --2- 172.21.15.137:0/2959251074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 0x7f07dc0d0750 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f07dc074510 tx=0x7f07cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9d96b79fb0245b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:54.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e1149640 1 -- 172.21.15.137:0/2959251074 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc037070 con 0x7f07dc0d1300 2024-04-26T21:58:54.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e1149640 1 -- 172.21.15.137:0/2959251074 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07cc032440 con 0x7f07dc0d1300 2024-04-26T21:58:54.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e1149640 1 -- 172.21.15.137:0/2959251074 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc032810 con 0x7f07dc0d1300 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e43af640 1 -- 172.21.15.137:0/2959251074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 msgr2=0x7f07dc0d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e43af640 1 --2- 172.21.15.137:0/2959251074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 0x7f07dc0d0750 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f07dc074510 tx=0x7f07cc02a270 comp rx=0 tx=0).stop 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e43af640 1 -- 172.21.15.137:0/2959251074 shutdown_connections 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e43af640 1 --2- 172.21.15.137:0/2959251074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 0x7f07dc0d0750 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e43af640 1 --2- 172.21.15.137:0/2959251074 >> v2:172.21.15.170:3300/0 conn(0x7f07dc15d1f0 0x7f07dc070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e43af640 1 -- 172.21.15.137:0/2959251074 >> 172.21.15.137:0/2959251074 conn(0x7f07dc0d1e40 msgr2=0x7f07dc0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.114+0000 7f07e43af640 1 -- 172.21.15.137:0/2959251074 shutdown_connections 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.115+0000 7f07e43af640 1 -- 172.21.15.137:0/2959251074 wait complete. 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e43af640 1 Processor -- start 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e43af640 1 -- start start 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e43af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07dc073090 0x7f07dc0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e43af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 0x7f07dc0ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e43af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07dc15d1f0 0x7f07dc0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e43af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc0b1470 con 0x7f07dc0d1300 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e43af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f07dc15d5d0 con 0x7f07dc15d1f0 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e43af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f07dc160dd0 con 0x7f07dc073090 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e194a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 0x7f07dc0ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e194a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 0x7f07dc0ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32910/0 (socket says 172.21.15.137:32910) 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e194a640 1 -- 172.21.15.137:0/4110519006 learned_addr learned my addr 172.21.15.137:0/4110519006 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e214b640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07dc073090 0x7f07dc0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.116+0000 7f07e294c640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07dc15d1f0 0x7f07dc0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07e194a640 1 -- 172.21.15.137:0/4110519006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07dc073090 msgr2=0x7f07dc0c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07e194a640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07dc073090 0x7f07dc0c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07e194a640 1 -- 172.21.15.137:0/4110519006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07dc15d1f0 msgr2=0x7f07dc0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07e194a640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07dc15d1f0 0x7f07dc0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07e194a640 1 -- 172.21.15.137:0/4110519006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07dc0c7370 con 0x7f07dc0d1300 2024-04-26T21:58:54.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07e194a640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 0x7f07dc0ca270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f07cc02a2b0 tx=0x7f07cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:54.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07d2ffd640 1 -- 172.21.15.137:0/4110519006 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc041020 con 0x7f07dc0d1300 2024-04-26T21:58:54.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07d2ffd640 1 -- 172.21.15.137:0/4110519006 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07cc0306c0 con 0x7f07dc0d1300 2024-04-26T21:58:54.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07dc0c7650 con 0x7f07dc0d1300 2024-04-26T21:58:54.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07d2ffd640 1 -- 172.21.15.137:0/4110519006 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07cc037040 con 0x7f07dc0d1300 2024-04-26T21:58:54.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.117+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07dc0c7ef0 con 0x7f07dc0d1300 2024-04-26T21:58:54.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.118+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07dc0c7820 con 0x7f07dc0d1300 2024-04-26T21:58:54.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.118+0000 7f07d2ffd640 1 -- 172.21.15.137:0/4110519006 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f07cc044020 con 0x7f07dc0d1300 2024-04-26T21:58:54.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.119+0000 7f07d2ffd640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f07c006c8f0 0x7f07c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.119+0000 7f07d2ffd640 1 -- 172.21.15.137:0/4110519006 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f07cc0ac150 con 0x7f07dc0d1300 2024-04-26T21:58:54.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.119+0000 7f07e214b640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f07c006c8f0 0x7f07c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.119+0000 7f07e214b640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f07c006c8f0 0x7f07c006edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07d8006fd0 tx=0x7f07d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:54.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.123+0000 7f07d2ffd640 1 -- 172.21.15.137:0/4110519006 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f07cc04b030 con 0x7f07dc0d1300 2024-04-26T21:58:54.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.296+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f07dc0693d0 con 0x7f07dc0d1300 2024-04-26T21:58:54.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.297+0000 7f07d2ffd640 1 -- 172.21.15.137:0/4110519006 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f07cc079fc0 con 0x7f07dc0d1300 2024-04-26T21:58:54.297 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:58:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f07c006c8f0 msgr2=0x7f07c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f07c006c8f0 0x7f07c006edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f07d8006fd0 tx=0x7f07d8008040 comp rx=0 tx=0).stop 2024-04-26T21:58:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 msgr2=0x7f07dc0ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 0x7f07dc0ca270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f07cc02a2b0 tx=0x7f07cc0046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 shutdown_connections 2024-04-26T21:58:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f07c006c8f0 0x7f07c006edb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07dc0d1300 0x7f07dc0ca270 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07dc15d1f0 0x7f07dc0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 --2- 172.21.15.137:0/4110519006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07dc073090 0x7f07dc0c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 >> 172.21.15.137:0/4110519006 conn(0x7f07dc0d1e40 msgr2=0x7f07dc15c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:54.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 shutdown_connections 2024-04-26T21:58:54.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.299+0000 7f07e43af640 1 -- 172.21.15.137:0/4110519006 wait complete. 2024-04-26T21:58:54.309 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:58:54.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.410+0000 7fbcdc9ec640 1 Processor -- start 2024-04-26T21:58:54.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.410+0000 7fbcdc9ec640 1 -- start start 2024-04-26T21:58:54.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcdc9ec640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbcd815f2b0 0x7fbcd806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcdc9ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd80706a0 0x7fbcd806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcdc9ec640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd8070b30 con 0x7fbcd806c7e0 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcdc9ec640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbcd80af610 con 0x7fbcd815f2b0 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcdc9ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd80700b0 con 0x7fbcd80706a0 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcd659c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbcd815f2b0 0x7fbcd806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcd659c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbcd815f2b0 0x7fbcd806fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32912/0 (socket says 172.21.15.137:32912) 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcd659c640 1 -- 172.21.15.137:0/2225520675 learned_addr learned my addr 172.21.15.137:0/2225520675 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbccffff640 1 --2- 172.21.15.137:0/2225520675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd80706a0 0x7fbcd806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcd659c640 1 -- 172.21.15.137:0/2225520675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd80706a0 msgr2=0x7fbcd806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcd659c640 1 --2- 172.21.15.137:0/2225520675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd80706a0 0x7fbcd806c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcd659c640 1 -- 172.21.15.137:0/2225520675 >> v1:172.21.15.170:6789/0 conn(0x7fbcd806c7e0 legacy=0x7fbcd8162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.411+0000 7fbcd659c640 1 -- 172.21.15.137:0/2225520675 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd8070e10 con 0x7fbcd815f2b0 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcd659c640 1 --2- 172.21.15.137:0/2225520675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 0x7fbcd806fb70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009870 tx=0x7fbcc802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ccdaef17425cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcd5d9b640 1 -- 172.21.15.137:0/2225520675 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8037070 con 0x7fbcd815f2b0 2024-04-26T21:58:54.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcd5d9b640 1 -- 172.21.15.137:0/2225520675 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc8032440 con 0x7fbcd815f2b0 2024-04-26T21:58:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcd5d9b640 1 -- 172.21.15.137:0/2225520675 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8032810 con 0x7fbcd815f2b0 2024-04-26T21:58:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/2225520675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 msgr2=0x7fbcd806fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcdc9ec640 1 --2- 172.21.15.137:0/2225520675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 0x7fbcd806fb70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009870 tx=0x7fbcc802a210 comp rx=0 tx=0).stop 2024-04-26T21:58:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/2225520675 shutdown_connections 2024-04-26T21:58:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcdc9ec640 1 --2- 172.21.15.137:0/2225520675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd80706a0 0x7fbcd806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcdc9ec640 1 --2- 172.21.15.137:0/2225520675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 0x7fbcd806fb70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.412+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/2225520675 >> 172.21.15.137:0/2225520675 conn(0x7fbcd806f050 msgr2=0x7fbcd806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.413+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/2225520675 shutdown_connections 2024-04-26T21:58:54.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.413+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/2225520675 wait complete. 2024-04-26T21:58:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.414+0000 7fbcdc9ec640 1 Processor -- start 2024-04-26T21:58:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.414+0000 7fbcdc9ec640 1 -- start start 2024-04-26T21:58:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcdc9ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcd806c7e0 0x7fbcd81503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcdc9ec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 0x7fbcd8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcdc9ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd8157200 0x7fbcd8150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcdc9ec640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd80713d0 con 0x7fbcd815f2b0 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcdc9ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd806cc30 con 0x7fbcd806c7e0 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcdc9ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd80b4f40 con 0x7fbcd8157200 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbccffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 0x7fbcd8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbccffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 0x7fbcd8156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32920/0 (socket says 172.21.15.137:32920) 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbccffff640 1 -- 172.21.15.137:0/898221253 learned_addr learned my addr 172.21.15.137:0/898221253 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcd659c640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcd806c7e0 0x7fbcd81503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcd6d9d640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd8157200 0x7fbcd8150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbccffff640 1 -- 172.21.15.137:0/898221253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd8157200 msgr2=0x7fbcd8150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbccffff640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd8157200 0x7fbcd8150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbccffff640 1 -- 172.21.15.137:0/898221253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcd806c7e0 msgr2=0x7fbcd81503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbccffff640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcd806c7e0 0x7fbcd81503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbccffff640 1 -- 172.21.15.137:0/898221253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd8155c20 con 0x7fbcd815f2b0 2024-04-26T21:58:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcd659c640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcd806c7e0 0x7fbcd81503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbccffff640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 0x7fbcd8156cc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000c7f0 tx=0x7fbcc000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcceffd640 1 -- 172.21.15.137:0/898221253 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0015070 con 0x7fbcd815f2b0 2024-04-26T21:58:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcceffd640 1 -- 172.21.15.137:0/898221253 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc0004240 con 0x7fbcd815f2b0 2024-04-26T21:58:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcceffd640 1 -- 172.21.15.137:0/898221253 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0007620 con 0x7fbcd815f2b0 2024-04-26T21:58:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd8155f00 con 0x7fbcd815f2b0 2024-04-26T21:58:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.415+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd81564c0 con 0x7fbcd815f2b0 2024-04-26T21:58:54.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.416+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd806a290 con 0x7fbcd815f2b0 2024-04-26T21:58:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.417+0000 7fbcceffd640 1 -- 172.21.15.137:0/898221253 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbcc00079d0 con 0x7fbcd815f2b0 2024-04-26T21:58:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.417+0000 7fbcceffd640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.417+0000 7fbcceffd640 1 -- 172.21.15.137:0/898221253 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbcc008bfe0 con 0x7fbcd815f2b0 2024-04-26T21:58:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.417+0000 7fbcd659c640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.418+0000 7fbcd659c640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8034000 tx=0x7fbcc802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:54.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.421+0000 7fbcceffd640 1 -- 172.21.15.137:0/898221253 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbcc005a410 con 0x7fbcd815f2b0 2024-04-26T21:58:54.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.595+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbcd80d1970 con 0x7fbcd815f2b0 2024-04-26T21:58:54.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.595+0000 7fbcceffd640 1 -- 172.21.15.137:0/898221253 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fbcc0059d10 con 0x7fbcd815f2b0 2024-04-26T21:58:54.595 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:58:54.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 msgr2=0x7fbcb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8034000 tx=0x7fbcc802e000 comp rx=0 tx=0).stop 2024-04-26T21:58:54.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 msgr2=0x7fbcd8156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 0x7fbcd8156cc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000c7f0 tx=0x7fbcc000ccb0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 shutdown_connections 2024-04-26T21:58:54.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcd815f2b0 0x7fbcd8156cc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcd8157200 0x7fbcd8150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 --2- 172.21.15.137:0/898221253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcd806c7e0 0x7fbcd81503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 >> 172.21.15.137:0/898221253 conn(0x7fbcd806f050 msgr2=0x7fbcd8073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:54.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 shutdown_connections 2024-04-26T21:58:54.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.597+0000 7fbcdc9ec640 1 -- 172.21.15.137:0/898221253 wait complete. 2024-04-26T21:58:54.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:58:54.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.707+0000 7f29f8940640 1 Processor -- start 2024-04-26T21:58:54.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.707+0000 7f29f8940640 1 -- start start 2024-04-26T21:58:54.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f8940640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f415f680 0x7f29f40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f8940640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f40d3f50 con 0x7f29f4163aa0 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f8940640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f40b5090 con 0x7f29f40d4f20 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f8940640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f29f415fa60 con 0x7f29f415f680 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29ebfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f29f4163aa0 0x7f29f40b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42142/0 (socket says 172.21.15.137:42142) 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29ebfff640 1 -- 172.21.15.137:0/3401111457 learned_addr learned my addr 172.21.15.137:0/3401111457 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f259c640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f415f680 0x7f29f40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129606235 0 0) 0x7f29f40d3f50 con 0x7f29f4163aa0 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e0003520 con 0x7f29f4163aa0 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 375438918 0 0) 0x7f29e0003520 con 0x7f29f4163aa0 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f415f680 msgr2=0x7f29f40d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f415f680 0x7f29f40d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 >> v1:172.21.15.170:6789/0 conn(0x7f29f40d4f20 legacy=0x7f29f40d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f40b5370 con 0x7f29f4163aa0 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f29dc001670 con 0x7f29f4163aa0 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 >> v1:172.21.15.137:6789/0 conn(0x7f29f4163aa0 legacy=0x7f29f40b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f415f680 0x7f29e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29e0003f60 0x7f29e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29e0004d40 0x7f29e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29f415fa60 con 0x7f29e0004d40 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f29e000baa0 con 0x7f29e0003f60 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f29e000bca0 con 0x7f29f415f680 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f2d9d640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29e0004d40 0x7f29e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29ebfff640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29e0003f60 0x7f29e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.708+0000 7f29f259c640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f415f680 0x7f29e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.709+0000 7f29f2d9d640 1 -- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f415f680 msgr2=0x7f29e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.709+0000 7f29f2d9d640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f415f680 0x7f29e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.709+0000 7f29f2d9d640 1 -- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29e0003f60 msgr2=0x7f29e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.709+0000 7f29f2d9d640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29e0003f60 0x7f29e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.709+0000 7f29f2d9d640 1 -- 172.21.15.137:0/3401111457 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e0003520 con 0x7f29e0004d40 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.709+0000 7f29f2d9d640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29e0004d40 0x7f29e00051c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001e20 tx=0x7f29e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea88e8b9dae4d5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.709+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec001a70 con 0x7f29e0004d40 2024-04-26T21:58:54.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.709+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec02ae40 con 0x7f29e0004d40 2024-04-26T21:58:54.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.710+0000 7f29f1d9b640 1 -- 172.21.15.137:0/3401111457 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec003bb0 con 0x7f29e0004d40 2024-04-26T21:58:54.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.710+0000 7f29f8940640 1 -- 172.21.15.137:0/3401111457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29e0004d40 msgr2=0x7f29e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.710+0000 7f29f8940640 1 --2- 172.21.15.137:0/3401111457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29e0004d40 0x7f29e00051c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f29ec001e20 tx=0x7f29e0005830 comp rx=0 tx=0).stop 2024-04-26T21:58:54.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.710+0000 7f29f2d9d640 1 -- 172.21.15.137:0/3401111457 reap_dead start 2024-04-26T21:58:54.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.710+0000 7f29f8940640 1 -- 172.21.15.137:0/3401111457 shutdown_connections 2024-04-26T21:58:54.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.710+0000 7f29f8940640 1 -- 172.21.15.137:0/3401111457 >> 172.21.15.137:0/3401111457 conn(0x7f29f408eca0 msgr2=0x7f29f409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:54.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.710+0000 7f29f8940640 1 -- 172.21.15.137:0/3401111457 shutdown_connections 2024-04-26T21:58:54.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.710+0000 7f29f8940640 1 -- 172.21.15.137:0/3401111457 wait complete. 2024-04-26T21:58:54.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.711+0000 7f29f8940640 1 Processor -- start 2024-04-26T21:58:54.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.711+0000 7f29f8940640 1 -- start start 2024-04-26T21:58:54.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f8940640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4153070 0x7f29f40b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f8940640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29f415fbe0 0x7f29f40d2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f8940640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f40d0dd0 0x7f29f40d1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f8940640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f29f40d3820 con 0x7f29f4153070 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f8940640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4163f00 con 0x7f29f415fbe0 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f8940640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f29f40d39a0 con 0x7f29f40d0dd0 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4153070 0x7f29f40b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4153070 0x7f29f40b7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32940/0 (socket says 172.21.15.137:32940) 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f259c640 1 -- 172.21.15.137:0/2192340139 learned_addr learned my addr 172.21.15.137:0/2192340139 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f2d9d640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f40d0dd0 0x7f29f40d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29ebfff640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29f415fbe0 0x7f29f40d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f259c640 1 -- 172.21.15.137:0/2192340139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f40d0dd0 msgr2=0x7f29f40d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f259c640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f40d0dd0 0x7f29f40d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f259c640 1 -- 172.21.15.137:0/2192340139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29f415fbe0 msgr2=0x7f29f40d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f259c640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29f415fbe0 0x7f29f40d2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29f259c640 1 -- 172.21.15.137:0/2192340139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f41600f0 con 0x7f29f4153070 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.712+0000 7f29ebfff640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29f415fbe0 0x7f29f40d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.713+0000 7f29f259c640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4153070 0x7f29f40b7e50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29e40119a0 tx=0x7f29e4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.713+0000 7f29eaffd640 1 -- 172.21.15.137:0/2192340139 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e400faf0 con 0x7f29f4153070 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.713+0000 7f29eaffd640 1 -- 172.21.15.137:0/2192340139 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e400fc90 con 0x7f29f4153070 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.713+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f41603d0 con 0x7f29f4153070 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.713+0000 7f29eaffd640 1 -- 172.21.15.137:0/2192340139 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4014440 con 0x7f29f4153070 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.713+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f40cd5a0 con 0x7f29f4153070 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.714+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f406a290 con 0x7f29f4153070 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.714+0000 7f29eaffd640 1 -- 172.21.15.137:0/2192340139 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f29e4012040 con 0x7f29f4153070 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.714+0000 7f29eaffd640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f29d406c8f0 0x7f29d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.715+0000 7f29ebfff640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f29d406c8f0 0x7f29d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.715+0000 7f29eaffd640 1 -- 172.21.15.137:0/2192340139 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f29e408c0f0 con 0x7f29f4153070 2024-04-26T21:58:54.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.715+0000 7f29ebfff640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f29d406c8f0 0x7f29d406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f29dc007fd0 tx=0x7f29dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:54.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.719+0000 7f29eaffd640 1 -- 172.21.15.137:0/2192340139 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f29e4019030 con 0x7f29f4153070 2024-04-26T21:58:54.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.892+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f29f4153c60 con 0x7f29f4153070 2024-04-26T21:58:54.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.893+0000 7f29eaffd640 1 -- 172.21.15.137:0/2192340139 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f29e405a5b0 con 0x7f29f4153070 2024-04-26T21:58:54.893 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:58:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f29d406c8f0 msgr2=0x7f29d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f29d406c8f0 0x7f29d406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f29dc007fd0 tx=0x7f29dc009040 comp rx=0 tx=0).stop 2024-04-26T21:58:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4153070 msgr2=0x7f29f40b7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4153070 0x7f29f40b7e50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f29e40119a0 tx=0x7f29e4011e60 comp rx=0 tx=0).stop 2024-04-26T21:58:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 shutdown_connections 2024-04-26T21:58:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f29d406c8f0 0x7f29d406edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f29f40d0dd0 0x7f29f40d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f29f415fbe0 0x7f29f40d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 --2- 172.21.15.137:0/2192340139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f29f4153070 0x7f29f40b7e50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 >> 172.21.15.137:0/2192340139 conn(0x7f29f408eca0 msgr2=0x7f29f4162ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 shutdown_connections 2024-04-26T21:58:54.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:54.895+0000 7f29f8940640 1 -- 172.21.15.137:0/2192340139 wait complete. 2024-04-26T21:58:54.906 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:58:55.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.002+0000 7faf8210a640 1 Processor -- start 2024-04-26T21:58:55.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.002+0000 7faf8210a640 1 -- start start 2024-04-26T21:58:55.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf8210a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faf7c0cf2e0 0x7faf7c06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf8210a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faf7c0d11b0 0x7faf7c06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf8210a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 0x7faf7c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf8210a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faf7c06e750 con 0x7faf7c0cf2e0 2024-04-26T21:58:55.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf8210a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7faf7c0d1740 con 0x7faf7c0d11b0 2024-04-26T21:58:55.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf8210a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faf7c0d1a20 con 0x7faf7c06e2c0 2024-04-26T21:58:55.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faf7c0cf2e0 0x7faf7c06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faf7c0cf2e0 0x7faf7c06d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32942/0 (socket says 172.21.15.137:32942) 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7b7fe640 1 -- 172.21.15.137:0/1476738128 learned_addr learned my addr 172.21.15.137:0/1476738128 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7bfff640 1 --2- 172.21.15.137:0/1476738128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 0x7faf7c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7affd640 1 --2- 172.21.15.137:0/1476738128 >> v2:172.21.15.170:3300/0 conn(0x7faf7c0d11b0 0x7faf7c06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7b7fe640 1 -- 172.21.15.137:0/1476738128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 msgr2=0x7faf7c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7b7fe640 1 --2- 172.21.15.137:0/1476738128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 0x7faf7c15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7b7fe640 1 -- 172.21.15.137:0/1476738128 >> v2:172.21.15.170:3300/0 conn(0x7faf7c0d11b0 msgr2=0x7faf7c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7b7fe640 1 --2- 172.21.15.137:0/1476738128 >> v2:172.21.15.170:3300/0 conn(0x7faf7c0d11b0 0x7faf7c06dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7b7fe640 1 -- 172.21.15.137:0/1476738128 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c0d1d00 con 0x7faf7c0cf2e0 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.003+0000 7faf7affd640 1 --2- 172.21.15.137:0/1476738128 >> v2:172.21.15.170:3300/0 conn(0x7faf7c0d11b0 0x7faf7c06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.004+0000 7faf7b7fe640 1 --2- 172.21.15.137:0/1476738128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0cf2e0 0x7faf7c06d4d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009870 tx=0x7faf6c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56fa72f14d627e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.004+0000 7faf7a7fc640 1 -- 172.21.15.137:0/1476738128 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c037070 con 0x7faf7c0cf2e0 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.004+0000 7faf7a7fc640 1 -- 172.21.15.137:0/1476738128 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf6c032440 con 0x7faf7c0cf2e0 2024-04-26T21:58:55.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.004+0000 7faf7a7fc640 1 -- 172.21.15.137:0/1476738128 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c032810 con 0x7faf7c0cf2e0 2024-04-26T21:58:55.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.005+0000 7faf8210a640 1 -- 172.21.15.137:0/1476738128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0cf2e0 msgr2=0x7faf7c06d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.005+0000 7faf8210a640 1 --2- 172.21.15.137:0/1476738128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0cf2e0 0x7faf7c06d4d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf6c009870 tx=0x7faf6c02a210 comp rx=0 tx=0).stop 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.005+0000 7faf8210a640 1 -- 172.21.15.137:0/1476738128 shutdown_connections 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.005+0000 7faf8210a640 1 --2- 172.21.15.137:0/1476738128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 0x7faf7c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.005+0000 7faf8210a640 1 --2- 172.21.15.137:0/1476738128 >> v2:172.21.15.170:3300/0 conn(0x7faf7c0d11b0 0x7faf7c06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.005+0000 7faf8210a640 1 --2- 172.21.15.137:0/1476738128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0cf2e0 0x7faf7c06d4d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.005+0000 7faf8210a640 1 -- 172.21.15.137:0/1476738128 >> 172.21.15.137:0/1476738128 conn(0x7faf7c0b4a60 msgr2=0x7faf7c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.005+0000 7faf8210a640 1 -- 172.21.15.137:0/1476738128 shutdown_connections 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.005+0000 7faf8210a640 1 -- 172.21.15.137:0/1476738128 wait complete. 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.006+0000 7faf8210a640 1 Processor -- start 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.006+0000 7faf8210a640 1 -- start start 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf8210a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 0x7faf7c1520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf8210a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c0cf2e0 0x7faf7c15eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf8210a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0d11b0 0x7faf7c0a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf8210a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c06da10 con 0x7faf7c0d11b0 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf8210a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faf7c0d22c0 con 0x7faf7c0cf2e0 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf8210a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faf7c0cf6c0 con 0x7faf7c06e2c0 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0d11b0 0x7faf7c0a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0d11b0 0x7faf7c0a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32946/0 (socket says 172.21.15.137:32946) 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7bfff640 1 -- 172.21.15.137:0/3208167863 learned_addr learned my addr 172.21.15.137:0/3208167863 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7affd640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c0cf2e0 0x7faf7c15eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7b7fe640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 0x7faf7c1520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7bfff640 1 -- 172.21.15.137:0/3208167863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 msgr2=0x7faf7c1520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7bfff640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 0x7faf7c1520c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7bfff640 1 -- 172.21.15.137:0/3208167863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c0cf2e0 msgr2=0x7faf7c15eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7bfff640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c0cf2e0 0x7faf7c15eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7bfff640 1 -- 172.21.15.137:0/3208167863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7c15f060 con 0x7faf7c0d11b0 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7affd640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c0cf2e0 0x7faf7c15eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:55.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf7bfff640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0d11b0 0x7faf7c0a0670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf74007e70 tx=0x7faf7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf63fff640 1 -- 172.21.15.137:0/3208167863 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74014620 con 0x7faf7c0d11b0 2024-04-26T21:58:55.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf63fff640 1 -- 172.21.15.137:0/3208167863 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf74019070 con 0x7faf7c0d11b0 2024-04-26T21:58:55.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.007+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7c15da80 con 0x7faf7c0d11b0 2024-04-26T21:58:55.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.008+0000 7faf63fff640 1 -- 172.21.15.137:0/3208167863 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74014a20 con 0x7faf7c0d11b0 2024-04-26T21:58:55.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.008+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf7c15e040 con 0x7faf7c0d11b0 2024-04-26T21:58:55.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.008+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7c06a290 con 0x7faf7c0d11b0 2024-04-26T21:58:55.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.009+0000 7faf63fff640 1 -- 172.21.15.137:0/3208167863 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf74014bc0 con 0x7faf7c0d11b0 2024-04-26T21:58:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.009+0000 7faf63fff640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf6806c8f0 0x7faf6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.009+0000 7faf7b7fe640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf6806c8f0 0x7faf6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.009+0000 7faf63fff640 1 -- 172.21.15.137:0/3208167863 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faf7408c450 con 0x7faf7c0d11b0 2024-04-26T21:58:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.010+0000 7faf7b7fe640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf6806c8f0 0x7faf6806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf6c034000 tx=0x7faf6c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.014+0000 7faf63fff640 1 -- 172.21.15.137:0/3208167863 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faf7405a880 con 0x7faf7c0d11b0 2024-04-26T21:58:55.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.227+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf7c0c9b90 con 0x7faf7c0d11b0 2024-04-26T21:58:55.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.227+0000 7faf63fff640 1 -- 172.21.15.137:0/3208167863 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7faf7405a180 con 0x7faf7c0d11b0 2024-04-26T21:58:55.228 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:55.228 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1319361701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1319361701},{"type":"v1","addr":"172.21.15.170:6833","nonce":1319361701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3941293249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3941293249},{"type":"v1","addr":"172.21.15.137:6837","nonce":3941293249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:58:40.598750+0000","modified":"2024-04-26T21:58:42.690405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/268686042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":268686042},{"type":"v1","addr":"172.21.15.170:6835","nonce":268686042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-26T21:58:55.229 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 7 2024-04-26T21:58:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf6806c8f0 msgr2=0x7faf6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf6806c8f0 0x7faf6806edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf6c034000 tx=0x7faf6c02e000 comp rx=0 tx=0).stop 2024-04-26T21:58:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0d11b0 msgr2=0x7faf7c0a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0d11b0 0x7faf7c0a0670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7faf74007e70 tx=0x7faf7400e4b0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 shutdown_connections 2024-04-26T21:58:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf6806c8f0 0x7faf6806edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf7c0d11b0 0x7faf7c0a0670 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf7c0cf2e0 0x7faf7c15eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 --2- 172.21.15.137:0/3208167863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf7c06e2c0 0x7faf7c1520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.229+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 >> 172.21.15.137:0/3208167863 conn(0x7faf7c0b4a60 msgr2=0x7faf7c0b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.230+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 shutdown_connections 2024-04-26T21:58:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.230+0000 7faf8210a640 1 -- 172.21.15.137:0/3208167863 wait complete. 2024-04-26T21:58:55.242 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.339+0000 7fc45139d640 1 Processor -- start 2024-04-26T21:58:55.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.339+0000 7fc45139d640 1 -- start start 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.340+0000 7fc45139d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c15f340 0x7fc44c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.340+0000 7fc45139d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44c0b2510 con 0x7fc44c15f720 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.340+0000 7fc45139d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44c0b27f0 con 0x7fc44c0d5610 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.340+0000 7fc45139d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc44c0b2ad0 con 0x7fc44c15f340 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.340+0000 7fc44a7fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc44c15f720 0x7fc44c0d4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42148/0 (socket says 172.21.15.137:42148) 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.340+0000 7fc44a7fc640 1 -- 172.21.15.137:0/3313521206 learned_addr learned my addr 172.21.15.137:0/3313521206 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.340+0000 7fc44affd640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c15f340 0x7fc44c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.340+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984230769 0 0) 0x7fc44c0b2510 con 0x7fc44c15f720 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.340+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc434003520 con 0x7fc44c15f720 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1203718810 0 0) 0x7fc434003520 con 0x7fc44c15f720 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c15f340 msgr2=0x7fc44c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c15f340 0x7fc44c0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 >> v1:172.21.15.170:6789/0 conn(0x7fc44c0d5610 legacy=0x7fc44c0b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c0b2db0 con 0x7fc44c15f720 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fc440001670 con 0x7fc44c15f720 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 >> v1:172.21.15.137:6789/0 conn(0x7fc44c15f720 legacy=0x7fc44c0d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c15f340 0x7fc4340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434003f60 0x7fc434004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434004d40 0x7fc4340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c0b2ad0 con 0x7fc434003f60 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc43400bb50 con 0x7fc434004d40 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc43400bd50 con 0x7fc44c15f340 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc44a7fc640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434003f60 0x7fc434004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc44affd640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c15f340 0x7fc4340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc44b7fe640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434004d40 0x7fc4340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc44a7fc640 1 -- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c15f340 msgr2=0x7fc4340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc44a7fc640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c15f340 0x7fc4340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc44a7fc640 1 -- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434004d40 msgr2=0x7fc4340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc44a7fc640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434004d40 0x7fc4340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc44a7fc640 1 -- 172.21.15.137:0/3313521206 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc434003520 con 0x7fc434003f60 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.341+0000 7fc44b7fe640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434004d40 0x7fc4340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc44a7fc640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434003f60 0x7fc434004800 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c240 tx=0x7fc434005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff76ffd5bd680d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440007d10 con 0x7fc434003f60 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc440005ad0 con 0x7fc434003f60 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc449ffb640 1 -- 172.21.15.137:0/3313521206 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440007070 con 0x7fc434003f60 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc45139d640 1 -- 172.21.15.137:0/3313521206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434003f60 msgr2=0x7fc434004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc45139d640 1 --2- 172.21.15.137:0/3313521206 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc434003f60 0x7fc434004800 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c240 tx=0x7fc434005830 comp rx=0 tx=0).stop 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc44b7fe640 1 -- 172.21.15.137:0/3313521206 reap_dead start 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc45139d640 1 -- 172.21.15.137:0/3313521206 shutdown_connections 2024-04-26T21:58:55.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc45139d640 1 -- 172.21.15.137:0/3313521206 >> 172.21.15.137:0/3313521206 conn(0x7fc44c08ec70 msgr2=0x7fc44c09e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc45139d640 1 -- 172.21.15.137:0/3313521206 shutdown_connections 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.342+0000 7fc45139d640 1 -- 172.21.15.137:0/3313521206 wait complete. 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc45139d640 1 Processor -- start 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc45139d640 1 -- start start 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc45139d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434003f60 0x7fc44c1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc45139d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc44c0ce9f0 0x7fc44c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc45139d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c0cee50 0x7fc44c0cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc45139d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c0b2250 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc45139d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c0b20d0 con 0x7fc434003f60 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc45139d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc44c0d3d40 con 0x7fc44c0cee50 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc44a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc44c0ce9f0 0x7fc44c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc44a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc44c0ce9f0 0x7fc44c0cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:32958/0 (socket says 172.21.15.137:32958) 2024-04-26T21:58:55.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc44a7fc640 1 -- 172.21.15.137:0/3368366665 learned_addr learned my addr 172.21.15.137:0/3368366665 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.344+0000 7fc44affd640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434003f60 0x7fc44c1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc44b7fe640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c0cee50 0x7fc44c0cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc44a7fc640 1 -- 172.21.15.137:0/3368366665 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c0cee50 msgr2=0x7fc44c0cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc44a7fc640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c0cee50 0x7fc44c0cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc44a7fc640 1 -- 172.21.15.137:0/3368366665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434003f60 msgr2=0x7fc44c1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc44a7fc640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434003f60 0x7fc44c1554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc44a7fc640 1 -- 172.21.15.137:0/3368366665 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c0cced0 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc44a7fc640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc44c0ce9f0 0x7fc44c0cada0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c330 tx=0x7fc44c0b26e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc4337fe640 1 -- 172.21.15.137:0/3368366665 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440007d10 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc4337fe640 1 -- 172.21.15.137:0/3368366665 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc440000ed0 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c0cd170 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc4337fe640 1 -- 172.21.15.137:0/3368366665 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440007290 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.345+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c0cd730 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.346+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c0684f0 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.346+0000 7fc4337fe640 1 -- 172.21.15.137:0/3368366665 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc440007430 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.347+0000 7fc4337fe640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc43806c8f0 0x7fc43806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.347+0000 7fc4337fe640 1 -- 172.21.15.137:0/3368366665 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc4400ac130 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.347+0000 7fc44affd640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc43806c8f0 0x7fc43806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.347+0000 7fc44affd640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc43806c8f0 0x7fc43806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc43c014510 tx=0x7fc43c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.351+0000 7fc4337fe640 1 -- 172.21.15.137:0/3368366665 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc44c0684f0 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.530+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc44c06a290 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.531+0000 7fc4337fe640 1 -- 172.21.15.137:0/3368366665 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fc44004c020 con 0x7fc44c0ce9f0 2024-04-26T21:58:55.531 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:55.531 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:55.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc43806c8f0 msgr2=0x7fc43806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc43806c8f0 0x7fc43806edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc43c014510 tx=0x7fc43c00b040 comp rx=0 tx=0).stop 2024-04-26T21:58:55.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc44c0ce9f0 msgr2=0x7fc44c0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc44c0ce9f0 0x7fc44c0cada0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c330 tx=0x7fc44c0b26e0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 shutdown_connections 2024-04-26T21:58:55.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc43806c8f0 0x7fc43806edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc44c0ce9f0 0x7fc44c0cada0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc44c0cee50 0x7fc44c0cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 --2- 172.21.15.137:0/3368366665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc434003f60 0x7fc44c1554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 >> 172.21.15.137:0/3368366665 conn(0x7fc44c08ec70 msgr2=0x7fc44c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 shutdown_connections 2024-04-26T21:58:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.533+0000 7fc45139d640 1 -- 172.21.15.137:0/3368366665 wait complete. 2024-04-26T21:58:55.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:58:55.544 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:58:55.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.643+0000 7fc0229c6640 1 Processor -- start 2024-04-26T21:58:55.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.643+0000 7fc0229c6640 1 -- start start 2024-04-26T21:58:55.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.644+0000 7fc0229c6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c0b2000 0x7fc01c06ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.644+0000 7fc0229c6640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc01c09c790 con 0x7fc01c0d1170 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.644+0000 7fc0229c6640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc01c163ec0 con 0x7fc01c1631f0 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.644+0000 7fc0229c6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc01c0d1600 con 0x7fc01c0b2000 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.644+0000 7fc020f63640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc01c0d1170 0x7fc01c0b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39474/0 (socket says 172.21.15.137:39474) 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.644+0000 7fc020f63640 1 -- 172.21.15.137:0/477998012 learned_addr learned my addr 172.21.15.137:0/477998012 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.644+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341507336 0 0) 0x7fc01c09c790 con 0x7fc01c0d1170 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.644+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc004003520 con 0x7fc01c0d1170 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.644+0000 7fc01b7fe640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c0b2000 0x7fc01c06ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2482069799 0 0) 0x7fc004003520 con 0x7fc01c0d1170 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c0b2000 msgr2=0x7fc01c06ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c0b2000 0x7fc01c06ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 >> v1:172.21.15.170:6789/0 conn(0x7fc01c1631f0 legacy=0x7fc01c1635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01c0d1a40 con 0x7fc01c0d1170 2024-04-26T21:58:55.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fc0140019f0 con 0x7fc01c0d1170 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 >> v1:172.21.15.137:6789/0 conn(0x7fc01c0d1170 legacy=0x7fc01c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0040039e0 0x7fc004003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc004004800 0x7fc004004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c0b2000 0x7fc004005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc00400bac0 con 0x7fc004004800 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc00400bc70 con 0x7fc0040039e0 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc00400be70 con 0x7fc01c0b2000 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01b7fe640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc004004800 0x7fc004004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc020f63640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c0b2000 0x7fc004005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01bfff640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0040039e0 0x7fc004003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01b7fe640 1 -- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c0b2000 msgr2=0x7fc004005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01b7fe640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc01c0b2000 0x7fc004005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01b7fe640 1 -- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0040039e0 msgr2=0x7fc004003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01b7fe640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0040039e0 0x7fc004003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.645+0000 7fc01b7fe640 1 -- 172.21.15.137:0/477998012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc004003520 con 0x7fc004004800 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc01b7fe640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc004004800 0x7fc004004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc010009ac0 tx=0x7fc004005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71854af185e2faff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc010036070 con 0x7fc004004800 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc010031400 con 0x7fc004004800 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc01affd640 1 -- 172.21.15.137:0/477998012 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc010009690 con 0x7fc004004800 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc0229c6640 1 -- 172.21.15.137:0/477998012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc004004800 msgr2=0x7fc004004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc0229c6640 1 --2- 172.21.15.137:0/477998012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc004004800 0x7fc004004c80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc010009ac0 tx=0x7fc004005830 comp rx=0 tx=0).stop 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc020f63640 1 -- 172.21.15.137:0/477998012 reap_dead start 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc0229c6640 1 -- 172.21.15.137:0/477998012 shutdown_connections 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc0229c6640 1 -- 172.21.15.137:0/477998012 >> 172.21.15.137:0/477998012 conn(0x7fc01c09ba40 msgr2=0x7fc01c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:55.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc0229c6640 1 -- 172.21.15.137:0/477998012 shutdown_connections 2024-04-26T21:58:55.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.646+0000 7fc0229c6640 1 -- 172.21.15.137:0/477998012 wait complete. 2024-04-26T21:58:55.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.647+0000 7fc0229c6640 1 Processor -- start 2024-04-26T21:58:55.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc0229c6640 1 -- start start 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc0229c6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc004004800 0x7fc01c1f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc0229c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc01c155890 0x7fc01c161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc0229c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc01c1540a0 0x7fc01c154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc0229c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c0d0230 con 0x7fc01c1540a0 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc0229c6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc01c0d2000 con 0x7fc01c155890 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc0229c6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc01c156be0 con 0x7fc004004800 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc020f63640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc01c1540a0 0x7fc01c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc020f63640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc01c1540a0 0x7fc01c154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48244/0 (socket says 172.21.15.137:48244) 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.648+0000 7fc020f63640 1 -- 172.21.15.137:0/140439975 learned_addr learned my addr 172.21.15.137:0/140439975 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc01b7fe640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc01c155890 0x7fc01c161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc01bfff640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc004004800 0x7fc01c1f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc020f63640 1 -- 172.21.15.137:0/140439975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc004004800 msgr2=0x7fc01c1f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc020f63640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc004004800 0x7fc01c1f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc020f63640 1 -- 172.21.15.137:0/140439975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc01c155890 msgr2=0x7fc01c161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc020f63640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc01c155890 0x7fc01c161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc020f63640 1 -- 172.21.15.137:0/140439975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01c159810 con 0x7fc01c1540a0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc01b7fe640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc01c155890 0x7fc01c161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc020f63640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc01c1540a0 0x7fc01c154550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc01c163150 tx=0x7fc01400a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc018ff9640 1 -- 172.21.15.137:0/140439975 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01400ad30 con 0x7fc01c1540a0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc018ff9640 1 -- 172.21.15.137:0/140439975 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc014019070 con 0x7fc01c1540a0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc01c159af0 con 0x7fc01c1540a0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc018ff9640 1 -- 172.21.15.137:0/140439975 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014013630 con 0x7fc01c1540a0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.649+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc01c156ea0 con 0x7fc01c1540a0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.650+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc01c06a290 con 0x7fc01c1540a0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.651+0000 7fc018ff9640 1 -- 172.21.15.137:0/140439975 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc0140137d0 con 0x7fc01c1540a0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.651+0000 7fc018ff9640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc00806c920 0x7fc00806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.651+0000 7fc01bfff640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc00806c920 0x7fc00806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.651+0000 7fc018ff9640 1 -- 172.21.15.137:0/140439975 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc01408c260 con 0x7fc01c1540a0 2024-04-26T21:58:55.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.651+0000 7fc01bfff640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc00806c920 0x7fc00806ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc00c005590 tx=0x7fc00c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.655+0000 7fc018ff9640 1 -- 172.21.15.137:0/140439975 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc01405a750 con 0x7fc01c1540a0 2024-04-26T21:58:55.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.829+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc01c157070 con 0x7fc01c1540a0 2024-04-26T21:58:55.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.829+0000 7fc018ff9640 1 -- 172.21.15.137:0/140439975 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fc01405a050 con 0x7fc01c1540a0 2024-04-26T21:58:55.830 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:58:55.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc00806c920 msgr2=0x7fc00806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc00806c920 0x7fc00806ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc00c005590 tx=0x7fc00c009040 comp rx=0 tx=0).stop 2024-04-26T21:58:55.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc01c1540a0 msgr2=0x7fc01c154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc01c1540a0 0x7fc01c154550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc01c163150 tx=0x7fc01400a730 comp rx=0 tx=0).stop 2024-04-26T21:58:55.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 shutdown_connections 2024-04-26T21:58:55.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc00806c920 0x7fc00806ede0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc01c1540a0 0x7fc01c154550 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc01c155890 0x7fc01c161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 --2- 172.21.15.137:0/140439975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc004004800 0x7fc01c1f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 >> 172.21.15.137:0/140439975 conn(0x7fc01c09ba40 msgr2=0x7fc01c15ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:55.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 shutdown_connections 2024-04-26T21:58:55.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.831+0000 7fc0229c6640 1 -- 172.21.15.137:0/140439975 wait complete. 2024-04-26T21:58:55.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:58:55.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.942+0000 7fdc3627b640 1 Processor -- start 2024-04-26T21:58:55.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.942+0000 7fdc3627b640 1 -- start start 2024-04-26T21:58:55.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.942+0000 7fdc3627b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdc3015f550 0x7fdc300b6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.942+0000 7fdc3627b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc300b0570 0x7fdc300af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.942+0000 7fdc3627b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdc300afc30 0x7fdc300b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.942+0000 7fdc3627b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdc30072ee0 con 0x7fdc3015f550 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.942+0000 7fdc3627b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdc300aec50 con 0x7fdc300afc30 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.942+0000 7fdc3627b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdc30072c00 con 0x7fdc300b0570 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.942+0000 7fdc2ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdc3015f550 0x7fdc300b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdc3015f550 0x7fdc300b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48258/0 (socket says 172.21.15.137:48258) 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2ffff640 1 -- 172.21.15.137:0/235815419 learned_addr learned my addr 172.21.15.137:0/235815419 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc34818640 1 --2- 172.21.15.137:0/235815419 >> v2:172.21.15.170:3300/0 conn(0x7fdc300afc30 0x7fdc300b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2f7fe640 1 --2- 172.21.15.137:0/235815419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc300b0570 0x7fdc300af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2ffff640 1 -- 172.21.15.137:0/235815419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc300b0570 msgr2=0x7fdc300af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2ffff640 1 --2- 172.21.15.137:0/235815419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc300b0570 0x7fdc300af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2ffff640 1 -- 172.21.15.137:0/235815419 >> v2:172.21.15.170:3300/0 conn(0x7fdc300afc30 msgr2=0x7fdc300b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2ffff640 1 --2- 172.21.15.137:0/235815419 >> v2:172.21.15.170:3300/0 conn(0x7fdc300afc30 0x7fdc300b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2ffff640 1 -- 172.21.15.137:0/235815419 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc300aeef0 con 0x7fdc3015f550 2024-04-26T21:58:55.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2f7fe640 1 --2- 172.21.15.137:0/235815419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc300b0570 0x7fdc300af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:55.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.943+0000 7fdc2ffff640 1 --2- 172.21.15.137:0/235815419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc3015f550 0x7fdc300b6170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc300d2210 tx=0x7fdc2002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b1c7005c3b9249 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc2effd640 1 -- 172.21.15.137:0/235815419 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20037070 con 0x7fdc3015f550 2024-04-26T21:58:55.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc2effd640 1 -- 172.21.15.137:0/235815419 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc20032440 con 0x7fdc3015f550 2024-04-26T21:58:55.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc2effd640 1 -- 172.21.15.137:0/235815419 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20032810 con 0x7fdc3015f550 2024-04-26T21:58:55.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc3627b640 1 -- 172.21.15.137:0/235815419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc3015f550 msgr2=0x7fdc300b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc3627b640 1 --2- 172.21.15.137:0/235815419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc3015f550 0x7fdc300b6170 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc300d2210 tx=0x7fdc2002a1e0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc3627b640 1 -- 172.21.15.137:0/235815419 shutdown_connections 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc3627b640 1 --2- 172.21.15.137:0/235815419 >> v2:172.21.15.170:3300/0 conn(0x7fdc300afc30 0x7fdc300b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc3627b640 1 --2- 172.21.15.137:0/235815419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc300b0570 0x7fdc300af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc3627b640 1 --2- 172.21.15.137:0/235815419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc3015f550 0x7fdc300b6170 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc3627b640 1 -- 172.21.15.137:0/235815419 >> 172.21.15.137:0/235815419 conn(0x7fdc300b6800 msgr2=0x7fdc30073930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc3627b640 1 -- 172.21.15.137:0/235815419 shutdown_connections 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.944+0000 7fdc3627b640 1 -- 172.21.15.137:0/235815419 wait complete. 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.945+0000 7fdc3627b640 1 Processor -- start 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc3627b640 1 -- start start 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc3627b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc300afc30 0x7fdc301e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc3627b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc300b0570 0x7fdc30140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc3627b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc3015f550 0x7fdc30140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc3627b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdc300b4600 con 0x7fdc300afc30 2024-04-26T21:58:55.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc3627b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdc30074260 con 0x7fdc300b0570 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc3627b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdc300b4780 con 0x7fdc3015f550 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc2ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc300afc30 0x7fdc301e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc2ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc300afc30 0x7fdc301e7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48264/0 (socket says 172.21.15.137:48264) 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc2ffff640 1 -- 172.21.15.137:0/2305489590 learned_addr learned my addr 172.21.15.137:0/2305489590 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc34818640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc3015f550 0x7fdc30140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc2f7fe640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc300b0570 0x7fdc30140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.946+0000 7fdc2ffff640 1 -- 172.21.15.137:0/2305489590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc3015f550 msgr2=0x7fdc30140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc2ffff640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc3015f550 0x7fdc30140ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc2ffff640 1 -- 172.21.15.137:0/2305489590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc300b0570 msgr2=0x7fdc30140660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc2ffff640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc300b0570 0x7fdc30140660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc2ffff640 1 -- 172.21.15.137:0/2305489590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3013e820 con 0x7fdc300afc30 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc2ffff640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc300afc30 0x7fdc301e7e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc2002a220 tx=0x7fdc200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc2cff9640 1 -- 172.21.15.137:0/2305489590 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20041020 con 0x7fdc300afc30 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc2cff9640 1 -- 172.21.15.137:0/2305489590 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc200306c0 con 0x7fdc300afc30 2024-04-26T21:58:55.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc3013eb00 con 0x7fdc300afc30 2024-04-26T21:58:55.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc2cff9640 1 -- 172.21.15.137:0/2305489590 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20037040 con 0x7fdc300afc30 2024-04-26T21:58:55.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.947+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc3013f0c0 con 0x7fdc300afc30 2024-04-26T21:58:55.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.948+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc300693d0 con 0x7fdc300afc30 2024-04-26T21:58:55.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.948+0000 7fdc2cff9640 1 -- 172.21.15.137:0/2305489590 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdc20044020 con 0x7fdc300afc30 2024-04-26T21:58:55.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.949+0000 7fdc2cff9640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdc1c06c8f0 0x7fdc1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:55.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.949+0000 7fdc2cff9640 1 -- 172.21.15.137:0/2305489590 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdc200ac3a0 con 0x7fdc300afc30 2024-04-26T21:58:55.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.949+0000 7fdc2f7fe640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdc1c06c8f0 0x7fdc1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:55.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.949+0000 7fdc2f7fe640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdc1c06c8f0 0x7fdc1c06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc30155b20 tx=0x7fdc24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:55.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:55.953+0000 7fdc2cff9640 1 -- 172.21.15.137:0/2305489590 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdc2004b030 con 0x7fdc300afc30 2024-04-26T21:58:56.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.128+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdc30155c90 con 0x7fdc300afc30 2024-04-26T21:58:56.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.129+0000 7fdc2cff9640 1 -- 172.21.15.137:0/2305489590 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fdc2007a7d0 con 0x7fdc300afc30 2024-04-26T21:58:56.129 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:58:56.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdc1c06c8f0 msgr2=0x7fdc1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdc1c06c8f0 0x7fdc1c06edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdc30155b20 tx=0x7fdc24008040 comp rx=0 tx=0).stop 2024-04-26T21:58:56.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc300afc30 msgr2=0x7fdc301e7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc300afc30 0x7fdc301e7e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc2002a220 tx=0x7fdc200046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 shutdown_connections 2024-04-26T21:58:56.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdc1c06c8f0 0x7fdc1c06edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc3015f550 0x7fdc30140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc300b0570 0x7fdc30140660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 --2- 172.21.15.137:0/2305489590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc300afc30 0x7fdc301e7e20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 >> 172.21.15.137:0/2305489590 conn(0x7fdc300b6800 msgr2=0x7fdc3006fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:56.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 shutdown_connections 2024-04-26T21:58:56.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.131+0000 7fdc3627b640 1 -- 172.21.15.137:0/2305489590 wait complete. 2024-04-26T21:58:56.142 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:58:56.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.241+0000 7fdb36f33640 1 Processor -- start 2024-04-26T21:58:56.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.242+0000 7fdb36f33640 1 -- start start 2024-04-26T21:58:56.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.242+0000 7fdb36f33640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdb300d14d0 0x7fdb30073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.242+0000 7fdb36f33640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb300cfec0 con 0x7fdb300cd940 2024-04-26T21:58:56.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.242+0000 7fdb36f33640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb300d01a0 con 0x7fdb300d0c80 2024-04-26T21:58:56.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.242+0000 7fdb36f33640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdb300d07f0 con 0x7fdb300d14d0 2024-04-26T21:58:56.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.242+0000 7fdb34ccf640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdb300cd940 0x7fdb30070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39484/0 (socket says 172.21.15.137:39484) 2024-04-26T21:58:56.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.242+0000 7fdb34ccf640 1 -- 172.21.15.137:0/1636567045 learned_addr learned my addr 172.21.15.137:0/1636567045 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:56.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.242+0000 7fdb2ffff640 1 --2- 172.21.15.137:0/1636567045 >> v2:172.21.15.170:3300/0 conn(0x7fdb300d14d0 0x7fdb30073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.243+0000 7fdb2f7fe640 1 -- 172.21.15.137:0/1636567045 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208029652 0 0) 0x7fdb300cfec0 con 0x7fdb300cd940 2024-04-26T21:58:56.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.243+0000 7fdb2f7fe640 1 -- 172.21.15.137:0/1636567045 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb20003520 con 0x7fdb300cd940 2024-04-26T21:58:56.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.243+0000 7fdb2ffff640 1 -- 172.21.15.137:0/1636567045 >> v1:172.21.15.170:6789/0 conn(0x7fdb300d0c80 legacy=0x7fdb3006f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.243+0000 7fdb2ffff640 1 -- 172.21.15.137:0/1636567045 >> v1:172.21.15.137:6789/0 conn(0x7fdb300cd940 legacy=0x7fdb30070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.243+0000 7fdb2ffff640 1 -- 172.21.15.137:0/1636567045 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb300d0480 con 0x7fdb300d14d0 2024-04-26T21:58:56.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.243+0000 7fdb2ffff640 1 --2- 172.21.15.137:0/1636567045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb300d14d0 0x7fdb30073090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0097a0 tx=0x7fdb1c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d4c81e05e942e92 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:56.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb2f7fe640 1 -- 172.21.15.137:0/1636567045 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c037070 con 0x7fdb300d14d0 2024-04-26T21:58:56.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb2f7fe640 1 -- 172.21.15.137:0/1636567045 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c032440 con 0x7fdb300d14d0 2024-04-26T21:58:56.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb2f7fe640 1 -- 172.21.15.137:0/1636567045 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0327f0 con 0x7fdb300d14d0 2024-04-26T21:58:56.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb36f33640 1 -- 172.21.15.137:0/1636567045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb300d14d0 msgr2=0x7fdb30073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb36f33640 1 --2- 172.21.15.137:0/1636567045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb300d14d0 0x7fdb30073090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0097a0 tx=0x7fdb1c02a230 comp rx=0 tx=0).stop 2024-04-26T21:58:56.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb36f33640 1 -- 172.21.15.137:0/1636567045 shutdown_connections 2024-04-26T21:58:56.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb36f33640 1 --2- 172.21.15.137:0/1636567045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb300d14d0 0x7fdb30073090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb36f33640 1 -- 172.21.15.137:0/1636567045 >> 172.21.15.137:0/1636567045 conn(0x7fdb300d1e40 msgr2=0x7fdb300d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:56.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb36f33640 1 -- 172.21.15.137:0/1636567045 shutdown_connections 2024-04-26T21:58:56.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.244+0000 7fdb36f33640 1 -- 172.21.15.137:0/1636567045 wait complete. 2024-04-26T21:58:56.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.245+0000 7fdb36f33640 1 Processor -- start 2024-04-26T21:58:56.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.245+0000 7fdb36f33640 1 -- start start 2024-04-26T21:58:56.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.246+0000 7fdb36f33640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb300cd940 0x7fdb300b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.246+0000 7fdb36f33640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb300d0c80 0x7fdb300b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.246+0000 7fdb36f33640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb300d14d0 0x7fdb300af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.246+0000 7fdb36f33640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb30073750 con 0x7fdb300d0c80 2024-04-26T21:58:56.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.246+0000 7fdb36f33640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdb300735d0 con 0x7fdb300d14d0 2024-04-26T21:58:56.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.246+0000 7fdb36f33640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdb300738d0 con 0x7fdb300cd940 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.246+0000 7fdb2ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb300d0c80 0x7fdb300b10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.246+0000 7fdb2ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb300d0c80 0x7fdb300b10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48274/0 (socket says 172.21.15.137:48274) 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.246+0000 7fdb2ffff640 1 -- 172.21.15.137:0/1187497970 learned_addr learned my addr 172.21.15.137:0/1187497970 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb34ccf640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb300cd940 0x7fdb300b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb2ffff640 1 -- 172.21.15.137:0/1187497970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb300cd940 msgr2=0x7fdb300b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb354d0640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb300d14d0 0x7fdb300af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb2ffff640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb300cd940 0x7fdb300b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb2ffff640 1 -- 172.21.15.137:0/1187497970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb300d14d0 msgr2=0x7fdb300af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb2ffff640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb300d14d0 0x7fdb300af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb2ffff640 1 -- 172.21.15.137:0/1187497970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb300b19c0 con 0x7fdb300d0c80 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb34ccf640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb300cd940 0x7fdb300b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb2ffff640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb300d0c80 0x7fdb300b10c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0097a0 tx=0x7fdb1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb2d7fa640 1 -- 172.21.15.137:0/1187497970 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c037050 con 0x7fdb300d0c80 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb2d7fa640 1 -- 172.21.15.137:0/1187497970 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c043070 con 0x7fdb300d0c80 2024-04-26T21:58:56.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb300b1ca0 con 0x7fdb300d0c80 2024-04-26T21:58:56.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb2d7fa640 1 -- 172.21.15.137:0/1187497970 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c032810 con 0x7fdb300d0c80 2024-04-26T21:58:56.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.247+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb300b2260 con 0x7fdb300d0c80 2024-04-26T21:58:56.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.248+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb300693d0 con 0x7fdb300d0c80 2024-04-26T21:58:56.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.248+0000 7fdb2d7fa640 1 -- 172.21.15.137:0/1187497970 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb1c0329b0 con 0x7fdb300d0c80 2024-04-26T21:58:56.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.249+0000 7fdb2d7fa640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb1406c8f0 0x7fdb1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.249+0000 7fdb2d7fa640 1 -- 172.21.15.137:0/1187497970 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdb1c0ac660 con 0x7fdb300d0c80 2024-04-26T21:58:56.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.249+0000 7fdb34ccf640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb1406c8f0 0x7fdb1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.249+0000 7fdb34ccf640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb1406c8f0 0x7fdb1406edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb240011e0 tx=0x7fdb24009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:56.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.253+0000 7fdb2d7fa640 1 -- 172.21.15.137:0/1187497970 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdb1c07abb0 con 0x7fdb300d0c80 2024-04-26T21:58:56.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.430+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdb300b38e0 con 0x7fdb300d0c80 2024-04-26T21:58:56.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.431+0000 7fdb2d7fa640 1 -- 172.21.15.137:0/1187497970 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fdb1c07a4b0 con 0x7fdb300d0c80 2024-04-26T21:58:56.431 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:58:56.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb1406c8f0 msgr2=0x7fdb1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb1406c8f0 0x7fdb1406edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb240011e0 tx=0x7fdb24009040 comp rx=0 tx=0).stop 2024-04-26T21:58:56.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb300d0c80 msgr2=0x7fdb300b10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb300d0c80 0x7fdb300b10c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0097a0 tx=0x7fdb1c0046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 shutdown_connections 2024-04-26T21:58:56.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb1406c8f0 0x7fdb1406edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb300d0c80 0x7fdb300b10c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb300d14d0 0x7fdb300af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 --2- 172.21.15.137:0/1187497970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb300cd940 0x7fdb300b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 >> 172.21.15.137:0/1187497970 conn(0x7fdb300d1e40 msgr2=0x7fdb301610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:56.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 shutdown_connections 2024-04-26T21:58:56.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.433+0000 7fdb36f33640 1 -- 172.21.15.137:0/1187497970 wait complete. 2024-04-26T21:58:56.447 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:58:56.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.543+0000 7f9fac46d640 1 Processor -- start 2024-04-26T21:58:56.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.543+0000 7f9fac46d640 1 -- start start 2024-04-26T21:58:56.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.544+0000 7f9fac46d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa40d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.544+0000 7f9fac46d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9fa40d1980 0x7f9fa40ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.544+0000 7f9fac46d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa40b4f40 con 0x7f9fa40cee00 2024-04-26T21:58:56.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.544+0000 7f9fac46d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa40cf270 con 0x7f9fa40d1980 2024-04-26T21:58:56.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.544+0000 7f9fac46d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa4145d20 con 0x7f9fa4145940 2024-04-26T21:58:56.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.545+0000 7f9faa209640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa40d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.545+0000 7f9fa9a08640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9fa40d1980 0x7f9fa40ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.545+0000 7f9faa209640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa40d1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:52408/0 (socket says 172.21.15.137:52408) 2024-04-26T21:58:56.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.545+0000 7f9faa209640 1 -- 172.21.15.137:0/3624598712 learned_addr learned my addr 172.21.15.137:0/3624598712 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:56.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.545+0000 7f9faa209640 1 -- 172.21.15.137:0/3624598712 >> v2:172.21.15.170:3300/0 conn(0x7f9fa40d1980 msgr2=0x7f9fa40ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:56.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.545+0000 7f9faa209640 1 --2- 172.21.15.137:0/3624598712 >> v2:172.21.15.170:3300/0 conn(0x7f9fa40d1980 0x7f9fa40ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.545+0000 7f9faa209640 1 -- 172.21.15.137:0/3624598712 >> v1:172.21.15.170:6789/0 conn(0x7f9fa40cee00 legacy=0x7f9fa415faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.545+0000 7f9faa209640 1 -- 172.21.15.137:0/3624598712 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa4070a10 con 0x7f9fa4145940 2024-04-26T21:58:56.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9faa209640 1 --2- 172.21.15.137:0/3624598712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa40d1440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009870 tx=0x7f9f9402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff23bbd60976e75a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:56.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fa9207640 1 -- 172.21.15.137:0/3624598712 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94037070 con 0x7f9fa4145940 2024-04-26T21:58:56.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fa9207640 1 -- 172.21.15.137:0/3624598712 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f94032440 con 0x7f9fa4145940 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fa9207640 1 -- 172.21.15.137:0/3624598712 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94032810 con 0x7f9fa4145940 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fac46d640 1 -- 172.21.15.137:0/3624598712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 msgr2=0x7f9fa40d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fac46d640 1 --2- 172.21.15.137:0/3624598712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa40d1440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009870 tx=0x7f9f9402a270 comp rx=0 tx=0).stop 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fac46d640 1 -- 172.21.15.137:0/3624598712 shutdown_connections 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fac46d640 1 --2- 172.21.15.137:0/3624598712 >> v2:172.21.15.170:3300/0 conn(0x7f9fa40d1980 0x7f9fa40ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fac46d640 1 --2- 172.21.15.137:0/3624598712 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa40d1440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fac46d640 1 -- 172.21.15.137:0/3624598712 >> 172.21.15.137:0/3624598712 conn(0x7f9fa406f070 msgr2=0x7f9fa406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.546+0000 7f9fac46d640 1 -- 172.21.15.137:0/3624598712 shutdown_connections 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.547+0000 7f9fac46d640 1 -- 172.21.15.137:0/3624598712 wait complete. 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9fac46d640 1 Processor -- start 2024-04-26T21:58:56.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9fac46d640 1 -- start start 2024-04-26T21:58:56.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9fac46d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa40cee00 0x7f9fa4139e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9fac46d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa40d1980 0x7f9fa413ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9fac46d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa415c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9fac46d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa40712b0 con 0x7f9fa40cee00 2024-04-26T21:58:56.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9fac46d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4070fd0 con 0x7f9fa40d1980 2024-04-26T21:58:56.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9fac46d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa40706c0 con 0x7f9fa4145940 2024-04-26T21:58:56.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9faa209640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa40cee00 0x7f9fa4139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9faa209640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa40cee00 0x7f9fa4139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48280/0 (socket says 172.21.15.137:48280) 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9faa209640 1 -- 172.21.15.137:0/3309698753 learned_addr learned my addr 172.21.15.137:0/3309698753 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9fa9a08640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa40d1980 0x7f9fa413ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.548+0000 7f9faaa0a640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9faa209640 1 -- 172.21.15.137:0/3309698753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 msgr2=0x7f9fa415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9faa209640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9faa209640 1 -- 172.21.15.137:0/3309698753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa40d1980 msgr2=0x7f9fa413ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9faa209640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa40d1980 0x7f9fa413ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9faa209640 1 -- 172.21.15.137:0/3309698753 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa413b090 con 0x7f9fa40cee00 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9faa209640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa40cee00 0x7f9fa4139e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f9402a2b0 tx=0x7f9f940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9f9affd640 1 -- 172.21.15.137:0/3309698753 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f9403f070 con 0x7f9fa40cee00 2024-04-26T21:58:56.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9f9affd640 1 -- 172.21.15.137:0/3309698753 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f94030870 con 0x7f9fa40cee00 2024-04-26T21:58:56.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa413b370 con 0x7f9fa40cee00 2024-04-26T21:58:56.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9f9affd640 1 -- 172.21.15.137:0/3309698753 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94037040 con 0x7f9fa40cee00 2024-04-26T21:58:56.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.549+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa413b930 con 0x7f9fa40cee00 2024-04-26T21:58:56.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.550+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa40693d0 con 0x7f9fa40cee00 2024-04-26T21:58:56.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.550+0000 7f9f9affd640 1 -- 172.21.15.137:0/3309698753 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f94030c60 con 0x7f9fa40cee00 2024-04-26T21:58:56.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.551+0000 7f9f9affd640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f8806c8f0 0x7f9f8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.551+0000 7f9f9affd640 1 -- 172.21.15.137:0/3309698753 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f940adb00 con 0x7f9fa40cee00 2024-04-26T21:58:56.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.551+0000 7f9fa9a08640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f8806c8f0 0x7f9f8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.551+0000 7f9fa9a08640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f8806c8f0 0x7f9f8806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9fa41f5470 tx=0x7f9fa0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:56.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.555+0000 7f9f9affd640 1 -- 172.21.15.137:0/3309698753 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9f9407b8e0 con 0x7f9fa40cee00 2024-04-26T21:58:56.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.768+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fa40744f0 con 0x7f9fa40cee00 2024-04-26T21:58:56.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.769+0000 7f9f9affd640 1 -- 172.21.15.137:0/3309698753 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f9f9407fbe0 con 0x7f9fa40cee00 2024-04-26T21:58:56.769 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:56.769 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1319361701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1319361701},{"type":"v1","addr":"172.21.15.170:6833","nonce":1319361701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3941293249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3941293249},{"type":"v1","addr":"172.21.15.137:6837","nonce":3941293249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:58:40.598750+0000","modified":"2024-04-26T21:58:42.690405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/268686042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":268686042},{"type":"v1","addr":"172.21.15.170:6835","nonce":268686042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-26T21:58:56.769 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 7 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f8806c8f0 msgr2=0x7f9f8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f8806c8f0 0x7f9f8806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9fa41f5470 tx=0x7f9fa0009190 comp rx=0 tx=0).stop 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa40cee00 msgr2=0x7f9fa4139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa40cee00 0x7f9fa4139e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f9402a2b0 tx=0x7f9f940046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 shutdown_connections 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f8806c8f0 0x7f9f8806edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fa4145940 0x7f9fa415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fa40d1980 0x7f9fa413ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 --2- 172.21.15.137:0/3309698753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fa40cee00 0x7f9fa4139e10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 >> 172.21.15.137:0/3309698753 conn(0x7f9fa406f070 msgr2=0x7f9fa40b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 shutdown_connections 2024-04-26T21:58:56.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.771+0000 7f9fac46d640 1 -- 172.21.15.137:0/3309698753 wait complete. 2024-04-26T21:58:56.782 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:58:56.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.878+0000 7fa242386640 1 Processor -- start 2024-04-26T21:58:56.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa242386640 1 -- start start 2024-04-26T21:58:56.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa242386640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 0x7fa23c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa242386640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa23c15f750 0x7fa23c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa242386640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa23c0d37d0 0x7fa23c0d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa242386640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0b4d10 con 0x7fa23c15f750 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa242386640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0d4120 con 0x7fa23c0d37d0 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa242386640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa23c0d03a0 con 0x7fa23c15f370 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa23b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa23c15f750 0x7fa23c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa23b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa23c15f750 0x7fa23c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48288/0 (socket says 172.21.15.137:48288) 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.879+0000 7fa23b7fe640 1 -- 172.21.15.137:0/794671228 learned_addr learned my addr 172.21.15.137:0/794671228 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.880+0000 7fa23bfff640 1 --2- 172.21.15.137:0/794671228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 0x7fa23c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.880+0000 7fa240923640 1 --2- 172.21.15.137:0/794671228 >> v2:172.21.15.170:3300/0 conn(0x7fa23c0d37d0 0x7fa23c0d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.880+0000 7fa23b7fe640 1 -- 172.21.15.137:0/794671228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 msgr2=0x7fa23c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.880+0000 7fa23b7fe640 1 --2- 172.21.15.137:0/794671228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 0x7fa23c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.880+0000 7fa23b7fe640 1 -- 172.21.15.137:0/794671228 >> v2:172.21.15.170:3300/0 conn(0x7fa23c0d37d0 msgr2=0x7fa23c0d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.880+0000 7fa23b7fe640 1 --2- 172.21.15.137:0/794671228 >> v2:172.21.15.170:3300/0 conn(0x7fa23c0d37d0 0x7fa23c0d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.880+0000 7fa23b7fe640 1 -- 172.21.15.137:0/794671228 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c0d0680 con 0x7fa23c15f750 2024-04-26T21:58:56.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.880+0000 7fa23b7fe640 1 --2- 172.21.15.137:0/794671228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 0x7fa23c0b47d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0d02b0 tx=0x7fa23002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1f9bcf2bdfa0a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:56.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa23affd640 1 -- 172.21.15.137:0/794671228 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230037070 con 0x7fa23c15f750 2024-04-26T21:58:56.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa23affd640 1 -- 172.21.15.137:0/794671228 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa230032440 con 0x7fa23c15f750 2024-04-26T21:58:56.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa23affd640 1 -- 172.21.15.137:0/794671228 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230032810 con 0x7fa23c15f750 2024-04-26T21:58:56.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa242386640 1 -- 172.21.15.137:0/794671228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 msgr2=0x7fa23c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa242386640 1 --2- 172.21.15.137:0/794671228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 0x7fa23c0b47d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0d02b0 tx=0x7fa23002a140 comp rx=0 tx=0).stop 2024-04-26T21:58:56.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa242386640 1 -- 172.21.15.137:0/794671228 shutdown_connections 2024-04-26T21:58:56.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa242386640 1 --2- 172.21.15.137:0/794671228 >> v2:172.21.15.170:3300/0 conn(0x7fa23c0d37d0 0x7fa23c0d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa242386640 1 --2- 172.21.15.137:0/794671228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 0x7fa23c0b47d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa242386640 1 --2- 172.21.15.137:0/794671228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 0x7fa23c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa242386640 1 -- 172.21.15.137:0/794671228 >> 172.21.15.137:0/794671228 conn(0x7fa23c08ec10 msgr2=0x7fa23c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa242386640 1 -- 172.21.15.137:0/794671228 shutdown_connections 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.881+0000 7fa242386640 1 -- 172.21.15.137:0/794671228 wait complete. 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.882+0000 7fa242386640 1 Processor -- start 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.882+0000 7fa242386640 1 -- start start 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa242386640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa23c0d37d0 0x7fa23c0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa242386640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 0x7fa23c1f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa242386640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 0x7fa23c0b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa242386640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c0d0f20 con 0x7fa23c15f750 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa242386640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c0d0c40 con 0x7fa23c0d37d0 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa242386640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa23c0d1bd0 con 0x7fa23c15f370 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa240923640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 0x7fa23c0b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa240923640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 0x7fa23c0b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48300/0 (socket says 172.21.15.137:48300) 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa240923640 1 -- 172.21.15.137:0/4258085255 learned_addr learned my addr 172.21.15.137:0/4258085255 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa23b7fe640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 0x7fa23c1f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa23bfff640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa23c0d37d0 0x7fa23c0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa240923640 1 -- 172.21.15.137:0/4258085255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 msgr2=0x7fa23c1f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.883+0000 7fa240923640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 0x7fa23c1f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa240923640 1 -- 172.21.15.137:0/4258085255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa23c0d37d0 msgr2=0x7fa23c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa240923640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa23c0d37d0 0x7fa23c0ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa240923640 1 -- 172.21.15.137:0/4258085255 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c1f4c60 con 0x7fa23c15f750 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa23bfff640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa23c0d37d0 0x7fa23c0ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa240923640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 0x7fa23c0b8890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa23400eed0 tx=0x7fa23400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa238ff9640 1 -- 172.21.15.137:0/4258085255 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234018020 con 0x7fa23c15f750 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa238ff9640 1 -- 172.21.15.137:0/4258085255 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa234014400 con 0x7fa23c15f750 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa23c0b90e0 con 0x7fa23c15f750 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa238ff9640 1 -- 172.21.15.137:0/4258085255 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2340147f0 con 0x7fa23c15f750 2024-04-26T21:58:56.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.884+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa23c0cc2c0 con 0x7fa23c15f750 2024-04-26T21:58:56.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.885+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23c06a290 con 0x7fa23c15f750 2024-04-26T21:58:56.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.885+0000 7fa238ff9640 1 -- 172.21.15.137:0/4258085255 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa234005d10 con 0x7fa23c15f750 2024-04-26T21:58:56.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.886+0000 7fa238ff9640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22806c8f0 0x7fa22806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:56.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.886+0000 7fa238ff9640 1 -- 172.21.15.137:0/4258085255 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa23408c1f0 con 0x7fa23c15f750 2024-04-26T21:58:56.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.886+0000 7fa23bfff640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22806c8f0 0x7fa22806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:56.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.886+0000 7fa23bfff640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22806c8f0 0x7fa22806edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009ac0 tx=0x7fa22c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:56.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:56.890+0000 7fa238ff9640 1 -- 172.21.15.137:0/4258085255 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa234022070 con 0x7fa23c15f750 2024-04-26T21:58:57.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.064+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa23c0d5fd0 con 0x7fa23c15f750 2024-04-26T21:58:57.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.066+0000 7fa238ff9640 1 -- 172.21.15.137:0/4258085255 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fa23405a620 con 0x7fa23c15f750 2024-04-26T21:58:57.066 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:57.066 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.067+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22806c8f0 msgr2=0x7fa22806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.067+0000 7fa242386640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22806c8f0 0x7fa22806edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009ac0 tx=0x7fa22c008040 comp rx=0 tx=0).stop 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.067+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 msgr2=0x7fa23c0b8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.067+0000 7fa242386640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 0x7fa23c0b8890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa23400eed0 tx=0x7fa23400b480 comp rx=0 tx=0).stop 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.068+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 shutdown_connections 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.068+0000 7fa242386640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22806c8f0 0x7fa22806edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.068+0000 7fa242386640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa23c15f750 0x7fa23c0b8890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.068+0000 7fa242386640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa23c15f370 0x7fa23c1f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.068+0000 7fa242386640 1 --2- 172.21.15.137:0/4258085255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa23c0d37d0 0x7fa23c0ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.068+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 >> 172.21.15.137:0/4258085255 conn(0x7fa23c08ec10 msgr2=0x7fa23c0d4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:57.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.068+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 shutdown_connections 2024-04-26T21:58:57.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.068+0000 7fa242386640 1 -- 172.21.15.137:0/4258085255 wait complete. 2024-04-26T21:58:57.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:58:57.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.176+0000 7f6077c6d640 1 Processor -- start 2024-04-26T21:58:57.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.176+0000 7f6077c6d640 1 -- start start 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6077c6d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6070070530 0x7f60700709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6077c6d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f60700d1ad0 0x7f60700d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6077c6d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6070163960 con 0x7f6070145900 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6077c6d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f60700b4e60 con 0x7f6070070530 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6077c6d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f60700d1640 con 0x7f60700d1ad0 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6075208640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6070070530 0x7f60700709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6075208640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6070070530 0x7f60700709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48306/0 (socket says 172.21.15.137:48306) 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6075208640 1 -- 172.21.15.137:0/4208555909 learned_addr learned my addr 172.21.15.137:0/4208555909 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f607620a640 1 --2- 172.21.15.137:0/4208555909 >> v2:172.21.15.170:3300/0 conn(0x7f60700d1ad0 0x7f60700d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6075208640 1 -- 172.21.15.137:0/4208555909 >> v2:172.21.15.170:3300/0 conn(0x7f60700d1ad0 msgr2=0x7f60700d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6075208640 1 --2- 172.21.15.137:0/4208555909 >> v2:172.21.15.170:3300/0 conn(0x7f60700d1ad0 0x7f60700d1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6075208640 1 -- 172.21.15.137:0/4208555909 >> v1:172.21.15.170:6789/0 conn(0x7f6070145900 legacy=0x7f6070162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.177+0000 7f6075208640 1 -- 172.21.15.137:0/4208555909 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6070163c40 con 0x7f6070070530 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6075208640 1 --2- 172.21.15.137:0/4208555909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 0x7f60700709c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f60700d15b0 tx=0x7f606002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfb15249c66cd8c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6074a07640 1 -- 172.21.15.137:0/4208555909 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060037070 con 0x7f6070070530 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6074a07640 1 -- 172.21.15.137:0/4208555909 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6060032440 con 0x7f6070070530 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6074a07640 1 -- 172.21.15.137:0/4208555909 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6060032810 con 0x7f6070070530 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6077c6d640 1 -- 172.21.15.137:0/4208555909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 msgr2=0x7f60700709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6077c6d640 1 --2- 172.21.15.137:0/4208555909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 0x7f60700709c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f60700d15b0 tx=0x7f606002a270 comp rx=0 tx=0).stop 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6077c6d640 1 -- 172.21.15.137:0/4208555909 shutdown_connections 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6077c6d640 1 --2- 172.21.15.137:0/4208555909 >> v2:172.21.15.170:3300/0 conn(0x7f60700d1ad0 0x7f60700d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6077c6d640 1 --2- 172.21.15.137:0/4208555909 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 0x7f60700709c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.178+0000 7f6077c6d640 1 -- 172.21.15.137:0/4208555909 >> 172.21.15.137:0/4208555909 conn(0x7f60700b3b60 msgr2=0x7f60700b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.179+0000 7f6077c6d640 1 -- 172.21.15.137:0/4208555909 shutdown_connections 2024-04-26T21:58:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.179+0000 7f6077c6d640 1 -- 172.21.15.137:0/4208555909 wait complete. 2024-04-26T21:58:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6077c6d640 1 Processor -- start 2024-04-26T21:58:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6077c6d640 1 -- start start 2024-04-26T21:58:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6077c6d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 0x7f60700cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6077c6d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60700d1ad0 0x7f6070150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6077c6d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6070145900 0x7f6070150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6077c6d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6070145ce0 con 0x7f6070070530 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6077c6d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f60700d0fc0 con 0x7f6070145900 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6077c6d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f60701635f0 con 0x7f60700d1ad0 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6075a09640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 0x7f60700cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6075a09640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 0x7f60700cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48320/0 (socket says 172.21.15.137:48320) 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.180+0000 7f6075a09640 1 -- 172.21.15.137:0/3234262390 learned_addr learned my addr 172.21.15.137:0/3234262390 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f6075208640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60700d1ad0 0x7f6070150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f607620a640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6070145900 0x7f6070150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f6075a09640 1 -- 172.21.15.137:0/3234262390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60700d1ad0 msgr2=0x7f6070150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f6075a09640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60700d1ad0 0x7f6070150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f6075a09640 1 -- 172.21.15.137:0/3234262390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6070145900 msgr2=0x7f6070150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f6075a09640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6070145900 0x7f6070150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f6075a09640 1 -- 172.21.15.137:0/3234262390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60701612a0 con 0x7f6070070530 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f6075a09640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 0x7f60700cea00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f606c00c440 tx=0x7f606c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f60667fc640 1 -- 172.21.15.137:0/3234262390 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c017070 con 0x7f6070070530 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f60667fc640 1 -- 172.21.15.137:0/3234262390 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f606c0052d0 con 0x7f6070070530 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607014e990 con 0x7f6070070530 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f60667fc640 1 -- 172.21.15.137:0/3234262390 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c003830 con 0x7f6070070530 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.181+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60700cef40 con 0x7f6070070530 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.182+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60700693d0 con 0x7f6070070530 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.182+0000 7f60667fc640 1 -- 172.21.15.137:0/3234262390 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f606c01a070 con 0x7f6070070530 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.183+0000 7f60667fc640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f605406c920 0x7f605406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.183+0000 7f60667fc640 1 -- 172.21.15.137:0/3234262390 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f606c08ae90 con 0x7f6070070530 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.183+0000 7f6075208640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f605406c920 0x7f605406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.183+0000 7f6075208640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f605406c920 0x7f605406ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6060034000 tx=0x7f606002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.187+0000 7f60667fc640 1 -- 172.21.15.137:0/3234262390 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f606c0592c0 con 0x7f6070070530 2024-04-26T21:58:57.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.403+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6070073220 con 0x7f6070070530 2024-04-26T21:58:57.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.404+0000 7f60667fc640 1 -- 172.21.15.137:0/3234262390 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f606c058bc0 con 0x7f6070070530 2024-04-26T21:58:57.404 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:58:57.404 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1319361701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1319361701},{"type":"v1","addr":"172.21.15.170:6833","nonce":1319361701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3941293249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3941293249},{"type":"v1","addr":"172.21.15.137:6837","nonce":3941293249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:58:40.598750+0000","modified":"2024-04-26T21:58:42.690405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/268686042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":268686042},{"type":"v1","addr":"172.21.15.170:6835","nonce":268686042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-26T21:58:57.404 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 7 2024-04-26T21:58:57.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f605406c920 msgr2=0x7f605406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f605406c920 0x7f605406ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6060034000 tx=0x7f606002e000 comp rx=0 tx=0).stop 2024-04-26T21:58:57.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 msgr2=0x7f60700cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 0x7f60700cea00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f606c00c440 tx=0x7f606c00c900 comp rx=0 tx=0).stop 2024-04-26T21:58:57.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 shutdown_connections 2024-04-26T21:58:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f605406c920 0x7f605406ede0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6070145900 0x7f6070150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60700d1ad0 0x7f6070150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 --2- 172.21.15.137:0/3234262390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6070070530 0x7f60700cea00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 >> 172.21.15.137:0/3234262390 conn(0x7f60700b3b60 msgr2=0x7f60700b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 shutdown_connections 2024-04-26T21:58:57.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.406+0000 7f6077c6d640 1 -- 172.21.15.137:0/3234262390 wait complete. 2024-04-26T21:58:57.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:58:40.598750+0000', 'modified': '2024-04-26T21:58:42.690405+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4305}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4305': {'gid': 4305, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6835/268686042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6834', 'nonce': 268686042}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 268686042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4305, 'qdb_cluster': [4305]} 2024-04-26T21:58:57.820 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T21:58:57.820 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T21:58:57.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.919+0000 7f9de2445640 1 Processor -- start 2024-04-26T21:58:57.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.919+0000 7f9de2445640 1 -- start start 2024-04-26T21:58:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9de2445640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ddc0730e0 0x7f9ddc0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9de2445640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ddc0736c0 con 0x7f9ddc0b5830 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9de2445640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ddc0739a0 con 0x7f9ddc145a90 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9de2445640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc073c80 con 0x7f9ddc0730e0 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9de09e2640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9ddc0b5830 0x7f9ddc0d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39496/0 (socket says 172.21.15.137:39496) 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9de09e2640 1 -- 172.21.15.137:0/2654628060 learned_addr learned my addr 172.21.15.137:0/2654628060 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420901830 0 0) 0x7f9ddc0736c0 con 0x7f9ddc0b5830 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dc4003520 con 0x7f9ddc0b5830 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ddc0730e0 0x7f9ddc0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1600439820 0 0) 0x7f9dc4003520 con 0x7f9ddc0b5830 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ddc0730e0 msgr2=0x7f9ddc0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9ddaffd640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ddc0730e0 0x7f9ddc0b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 >> v1:172.21.15.170:6789/0 conn(0x7f9ddc145a90 legacy=0x7f9ddc0709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc073f60 con 0x7f9ddc0b5830 2024-04-26T21:58:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.920+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f9dd40019f0 con 0x7f9ddc0b5830 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 >> v1:172.21.15.137:6789/0 conn(0x7f9ddc0b5830 legacy=0x7f9ddc0d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddaffd640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9dc40039e0 0x7f9dc4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddaffd640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc4004340 0x7f9dc4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddaffd640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ddc0730e0 0x7f9dc4004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc073c80 con 0x7f9dc4004340 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc400ffd0 con 0x7f9dc40039e0 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc4010150 con 0x7f9ddc0730e0 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc4004340 0x7f9dc4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9dc40039e0 0x7f9dc4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9de09e2640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ddc0730e0 0x7f9dc4004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddb7fe640 1 -- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ddc0730e0 msgr2=0x7f9dc4004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ddc0730e0 0x7f9dc4004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddb7fe640 1 -- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9dc40039e0 msgr2=0x7f9dc4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9dc40039e0 0x7f9dc4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.921+0000 7f9ddb7fe640 1 -- 172.21.15.137:0/2654628060 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc4003520 con 0x7f9dc4004340 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc4004340 0x7f9dc4004800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009ac0 tx=0x7f9dc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635623724b0b4317 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0036070 con 0x7f9dc4004340 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd0031400 con 0x7f9dc4004340 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9ddaffd640 1 -- 172.21.15.137:0/2654628060 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0009690 con 0x7f9dc4004340 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9de2445640 1 -- 172.21.15.137:0/2654628060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc4004340 msgr2=0x7f9dc4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9de2445640 1 --2- 172.21.15.137:0/2654628060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dc4004340 0x7f9dc4004800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009ac0 tx=0x7f9dc4005830 comp rx=0 tx=0).stop 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9de09e2640 1 -- 172.21.15.137:0/2654628060 reap_dead start 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9de2445640 1 -- 172.21.15.137:0/2654628060 shutdown_connections 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9de2445640 1 -- 172.21.15.137:0/2654628060 >> 172.21.15.137:0/2654628060 conn(0x7f9ddc0b3b60 msgr2=0x7f9ddc0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9de2445640 1 -- 172.21.15.137:0/2654628060 shutdown_connections 2024-04-26T21:58:57.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.922+0000 7f9de2445640 1 -- 172.21.15.137:0/2654628060 wait complete. 2024-04-26T21:58:57.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.923+0000 7f9de2445640 1 Processor -- start 2024-04-26T21:58:57.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de2445640 1 -- start start 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de2445640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc4004340 0x7f9ddc0c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de2445640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ddc15c2d0 0x7f9ddc15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de2445640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0cad00 0x7f9ddc0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de2445640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0d0960 con 0x7f9ddc0cad00 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de2445640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0d07e0 con 0x7f9ddc15c2d0 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de2445640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc0b52f0 con 0x7f9dc4004340 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de09e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0cad00 0x7f9ddc0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de09e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0cad00 0x7f9ddc0c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48338/0 (socket says 172.21.15.137:48338) 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9de09e2640 1 -- 172.21.15.137:0/60607962 learned_addr learned my addr 172.21.15.137:0/60607962 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ddc15c2d0 0x7f9ddc15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.924+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc4004340 0x7f9ddc0c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9de09e2640 1 -- 172.21.15.137:0/60607962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc4004340 msgr2=0x7f9ddc0c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9de09e2640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc4004340 0x7f9ddc0c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9de09e2640 1 -- 172.21.15.137:0/60607962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ddc15c2d0 msgr2=0x7f9ddc15ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9de09e2640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ddc15c2d0 0x7f9ddc15ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9de09e2640 1 -- 172.21.15.137:0/60607962 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ddc15c7d0 con 0x7f9ddc0cad00 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9de09e2640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0cad00 0x7f9ddc0c8900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0ce860 tx=0x7f9dd4007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9dd8ff9640 1 -- 172.21.15.137:0/60607962 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd400ac60 con 0x7f9ddc0cad00 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9dd8ff9640 1 -- 172.21.15.137:0/60607962 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd4018070 con 0x7f9ddc0cad00 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9de2445640 1 -- 172.21.15.137:0/60607962 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc15cab0 con 0x7f9ddc0cad00 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9dd8ff9640 1 -- 172.21.15.137:0/60607962 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4013630 con 0x7f9ddc0cad00 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.925+0000 7f9de2445640 1 -- 172.21.15.137:0/60607962 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc15d070 con 0x7f9ddc0cad00 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.926+0000 7f9dd8ff9640 1 -- 172.21.15.137:0/60607962 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9dd40137d0 con 0x7f9ddc0cad00 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.927+0000 7f9dd8ff9640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9dc806c920 0x7f9dc806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.927+0000 7f9dd8ff9640 1 -- 172.21.15.137:0/60607962 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9dd408c060 con 0x7f9ddc0cad00 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.927+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9dc806c920 0x7f9dc806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.927+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9dc806c920 0x7f9dc806ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0017e0 tx=0x7f9dcc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.928+0000 7f9de523a740 1 Processor -- start 2024-04-26T21:58:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.928+0000 7f9de523a740 1 -- start start 2024-04-26T21:58:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.928+0000 7f9de523a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 0x55da17bea820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.928+0000 7f9de523a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 0x55da17c08230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.928+0000 7f9de523a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bc0120 0x55da17c063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.928+0000 7f9de523a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55da17b24740 con 0x55da17bc0120 2024-04-26T21:58:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.928+0000 7f9de523a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55da17ac03a0 con 0x55da17bea440 2024-04-26T21:58:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.928+0000 7f9de523a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55da17b20700 con 0x55da17c07ce0 2024-04-26T21:58:57.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.928+0000 7f9de09e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bc0120 0x55da17c063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9de09e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bc0120 0x55da17c063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48340/0 (socket says 172.21.15.137:48340) 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9de09e2640 1 -- 172.21.15.137:0/1895517462 learned_addr learned my addr 172.21.15.137:0/1895517462 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 0x55da17bea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 0x55da17c08230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9de09e2640 1 -- 172.21.15.137:0/1895517462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 msgr2=0x55da17c08230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9de09e2640 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 0x55da17c08230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9de09e2640 1 -- 172.21.15.137:0/1895517462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 msgr2=0x55da17bea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9de09e2640 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 0x55da17bea820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9de09e2640 1 -- 172.21.15.137:0/1895517462 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da17adc750 con 0x55da17bc0120 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 0x55da17bea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:57.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9de09e2640 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bc0120 0x55da17c063a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9dd408a5b0 tx=0x7f9dd40598a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa2bbf22b3b440 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9dc1ffb640 1 -- 172.21.15.137:0/1895517462 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4062970 con 0x55da17bc0120 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9dc1ffb640 1 -- 172.21.15.137:0/1895517462 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd4058140 con 0x55da17bc0120 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.929+0000 7f9dc1ffb640 1 -- 172.21.15.137:0/1895517462 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4072080 con 0x55da17bc0120 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 -- 172.21.15.137:0/1895517462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bc0120 msgr2=0x55da17c063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bc0120 0x55da17c063a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9dd408a5b0 tx=0x7f9dd40598a0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 -- 172.21.15.137:0/1895517462 shutdown_connections 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bc0120 0x55da17c063a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 0x55da17c08230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 --2- 172.21.15.137:0/1895517462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 0x55da17bea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 -- 172.21.15.137:0/1895517462 >> 172.21.15.137:0/1895517462 conn(0x55da17bbca50 msgr2=0x55da17c05250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:57.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 -- 172.21.15.137:0/1895517462 shutdown_connections 2024-04-26T21:58:57.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 -- 172.21.15.137:0/1895517462 wait complete. 2024-04-26T21:58:57.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 -- start start 2024-04-26T21:58:57.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.930+0000 7f9de523a740 1 Processor -- start 2024-04-26T21:58:57.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9de523a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bea440 0x55da17be6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9de523a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 0x55da17bfe490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9de523a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 0x55da17bb9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9de523a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55da17bc0ec0 con 0x55da17bea440 2024-04-26T21:58:57.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9de523a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55da17aabfe0 con 0x55da17bfe9d0 2024-04-26T21:58:57.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9de523a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55da17bba980 con 0x55da17c07ce0 2024-04-26T21:58:57.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9ddbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bea440 0x55da17be6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9de523a740 10 client.0 _ll_register_callbacks cb 0x55da17ac2150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9ddbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bea440 0x55da17be6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48352/0 (socket says 172.21.15.137:48352) 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9ddbfff640 1 -- 172.21.15.137:0/192438182 learned_addr learned my addr 172.21.15.137:0/192438182 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 0x55da17bfe490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.931+0000 7f9de09e2640 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 0x55da17bb9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9ddbfff640 1 -- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 msgr2=0x55da17bfe490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 0x55da17bfe490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9ddbfff640 1 -- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 msgr2=0x55da17bb9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 0x55da17bb9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9ddbfff640 1 -- 172.21.15.137:0/192438182 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da178362d0 con 0x55da17bea440 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de09e2640 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 0x55da17bb9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bea440 0x55da17be6dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc015770 tx=0x7f9dcc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cad8cf0b94b86bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9dbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9dbaffd640 1 -- 172.21.15.137:0/192438182 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc026070 con 0x55da17bea440 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9dbaffd640 1 -- 172.21.15.137:0/192438182 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9dcc022600 con 0x55da17bea440 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de523a740 1 -- 172.21.15.137:0/192438182 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dd4058140 con 0x55da17bea440 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9dbaffd640 1 -- 172.21.15.137:0/192438182 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f9dcc031050 con 0x55da17bea440 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de523a740 10 client.4686 fetch_fsmap learned FSMap version 7 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de523a740 1 -- 172.21.15.137:0/192438182 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55da179006b0 con 0x55da17bea440 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9dbaffd640 1 -- 172.21.15.137:0/192438182 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd4058140 con 0x55da17bea440 2024-04-26T21:58:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9dbaffd640 1 -- 172.21.15.137:0/192438182 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7f9dcc034020 con 0x55da17bea440 2024-04-26T21:58:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de523a740 10 client.4686 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T21:58:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de523a740 10 client.4686 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T21:58:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de523a740 20 client.4686 populate_metadata read hostname 'smithi137' 2024-04-26T21:58:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de523a740 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] conn(0x55da17bfce20 0x55da17bec840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de523a740 4 client.4686 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T21:58:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.932+0000 7f9de523a740 1 -- 172.21.15.137:0/192438182 --> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da17b32350 con 0x55da17bfce20 2024-04-26T21:58:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.933+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] conn(0x55da17bfce20 0x55da17bec840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.933+0000 7f9dbaffd640 10 client.4686 ms_handle_connect on v2:172.21.15.170:6834/268686042 2024-04-26T21:58:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.933+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] conn(0x55da17bfce20 0x55da17bec840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5277a50b100bb15e server_cookie=bea934e9b2ffda67 in_seq=0 out_seq=0 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9dbaffd640 1 -- 172.21.15.137:0/192438182 <== mds.0 v2:172.21.15.170:6834/268686042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55da17b32350 con 0x55da17bfce20 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9dbaffd640 10 client.4686 handle_command_reply: tid=0 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 client.4686 shutdown 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 -- 172.21.15.137:0/192438182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bea440 msgr2=0x55da17be6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bea440 0x55da17be6dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc015770 tx=0x7f9dcc001120 comp rx=0 tx=0).stop 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 -- 172.21.15.137:0/192438182 shutdown_connections 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] conn(0x55da17bfce20 0x55da17bec840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 0x55da17bb9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17c07ce0 0x55da17bfe490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9dbaffd640 0 client.4686 ms_handle_reset on v2:172.21.15.170:6834/268686042 2024-04-26T21:58:57.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 --2- 172.21.15.137:0/192438182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17bea440 0x55da17be6dc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 -- 172.21.15.137:0/192438182 >> 172.21.15.137:0/192438182 conn(0x55da17bc0120 msgr2=0x55da17be9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:57.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 -- 172.21.15.137:0/192438182 shutdown_connections 2024-04-26T21:58:57.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 1 -- 172.21.15.137:0/192438182 wait complete. 2024-04-26T21:58:57.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.934+0000 7f9de523a740 20 client.4686 trim_cache size 0 max 16384 2024-04-26T21:58:57.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.952+0000 7f9de523a740 1 Processor -- start 2024-04-26T21:58:57.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.952+0000 7f9de523a740 1 -- start start 2024-04-26T21:58:57.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de523a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bea440 0x55da17bbf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de523a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 0x55da17bbf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de523a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17beca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de523a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc1fd930 con 0x55da17c07ce0 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de523a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc1fc980 con 0x55da17bfe9d0 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de523a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9ddc1f4a70 con 0x55da17bea440 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de09e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17beca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de09e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17beca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48362/0 (socket says 172.21.15.137:48362) 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de09e2640 1 -- 172.21.15.137:0/3677111658 learned_addr learned my addr 172.21.15.137:0/3677111658 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/3677111658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 0x55da17bbf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/3677111658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bea440 0x55da17bbf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de09e2640 1 -- 172.21.15.137:0/3677111658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bea440 msgr2=0x55da17bbf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de09e2640 1 --2- 172.21.15.137:0/3677111658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bea440 0x55da17bbf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de09e2640 1 -- 172.21.15.137:0/3677111658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 msgr2=0x55da17bbf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de09e2640 1 --2- 172.21.15.137:0/3677111658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 0x55da17bbf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de09e2640 1 -- 172.21.15.137:0/3677111658 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da17bea9a0 con 0x55da17c07ce0 2024-04-26T21:58:57.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9de09e2640 1 --2- 172.21.15.137:0/3677111658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17beca00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4001f80 tx=0x7f9dd4060000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e74fb3e6a7d8db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9dc17fa640 1 -- 172.21.15.137:0/3677111658 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4062970 con 0x55da17c07ce0 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9dc17fa640 1 -- 172.21.15.137:0/3677111658 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd408a070 con 0x55da17c07ce0 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.953+0000 7f9dc17fa640 1 -- 172.21.15.137:0/3677111658 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4058140 con 0x55da17c07ce0 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 -- 172.21.15.137:0/3677111658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 msgr2=0x55da17beca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 --2- 172.21.15.137:0/3677111658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17beca00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4001f80 tx=0x7f9dd4060000 comp rx=0 tx=0).stop 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 -- 172.21.15.137:0/3677111658 shutdown_connections 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 --2- 172.21.15.137:0/3677111658 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17beca00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 --2- 172.21.15.137:0/3677111658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bfe9d0 0x55da17bbf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 --2- 172.21.15.137:0/3677111658 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bea440 0x55da17bbf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 -- 172.21.15.137:0/3677111658 >> 172.21.15.137:0/3677111658 conn(0x55da17bc0120 msgr2=0x55da17be5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 -- 172.21.15.137:0/3677111658 shutdown_connections 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 -- 172.21.15.137:0/3677111658 wait complete. 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.954+0000 7f9de523a740 1 -- start start 2024-04-26T21:58:57.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de523a740 1 Processor -- start 2024-04-26T21:58:57.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de523a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 0x55da17be9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de523a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bfe9d0 0x55da17bfabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de523a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17bfb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de523a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55da17c169c0 con 0x55da17c07ce0 2024-04-26T21:58:57.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de523a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc1fc4f0 con 0x55da17bea440 2024-04-26T21:58:57.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de523a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55da17bfcca0 con 0x55da17bfe9d0 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de523a740 10 client.0 _ll_register_callbacks cb 0x7f9dcc012f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de09e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17bfb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de09e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17bfb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48364/0 (socket says 172.21.15.137:48364) 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.955+0000 7f9de09e2640 1 -- 172.21.15.137:0/3819394770 learned_addr learned my addr 172.21.15.137:0/3819394770 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9ddb7fe640 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bfe9d0 0x55da17bfabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 0x55da17be9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de09e2640 1 -- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bfe9d0 msgr2=0x55da17bfabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de09e2640 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bfe9d0 0x55da17bfabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de09e2640 1 -- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 msgr2=0x55da17be9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de09e2640 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 0x55da17be9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de09e2640 1 -- 172.21.15.137:0/3819394770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da17bebe40 con 0x55da17c07ce0 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de09e2640 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17bfb120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400a2f0 tx=0x7f9dd4001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519ed971613149a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9dbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9dbaffd640 1 -- 172.21.15.137:0/3819394770 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4058140 con 0x55da17c07ce0 2024-04-26T21:58:57.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9dbaffd640 1 -- 172.21.15.137:0/3819394770 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9dd4072120 con 0x55da17c07ce0 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de523a740 1 -- 172.21.15.137:0/3819394770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dd408a070 con 0x55da17c07ce0 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9dbaffd640 1 -- 172.21.15.137:0/3819394770 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f9dd4072320 con 0x55da17c07ce0 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de523a740 10 client.4692 fetch_fsmap learned FSMap version 7 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de523a740 1 -- 172.21.15.137:0/3819394770 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55da17c28ff0 con 0x55da17c07ce0 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9dbaffd640 1 -- 172.21.15.137:0/3819394770 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd408a070 con 0x55da17c07ce0 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9dbaffd640 1 -- 172.21.15.137:0/3819394770 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7f9dd4060370 con 0x55da17c07ce0 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de523a740 10 client.4692 fetch_fsmap finished waiting for FSMap version 7 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de523a740 10 client.4692 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de523a740 20 client.4692 populate_metadata read hostname 'smithi137' 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de523a740 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] conn(0x55da17c7fdc0 0x55da17c801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de523a740 4 client.4692 mds_command: new command op to 4305 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.956+0000 7f9de523a740 1 -- 172.21.15.137:0/3819394770 --> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] -- command(tid 0: {"prefix": "status"}) -- 0x55da17b2c1c0 con 0x55da17c7fdc0 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] conn(0x55da17c7fdc0 0x55da17c801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:57.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9dbaffd640 10 client.4692 ms_handle_connect on v2:172.21.15.170:6834/268686042 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9ddbfff640 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] conn(0x55da17c7fdc0 0x55da17c801a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda2da8b86ec54b7 server_cookie=333044d07f2b4d93 in_seq=0 out_seq=0 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9dbaffd640 1 -- 172.21.15.137:0/3819394770 <== mds.0 v2:172.21.15.170:6834/268686042 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55da17b2c1c0 con 0x55da17c7fdc0 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9dbaffd640 10 client.4692 handle_command_reply: tid=0 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 client.4692 shutdown 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 -- 172.21.15.137:0/3819394770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 msgr2=0x55da17bfb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17bfb120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400a2f0 tx=0x7f9dd4001f10 comp rx=0 tx=0).stop 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 -- 172.21.15.137:0/3819394770 shutdown_connections 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:6834/268686042,v1:172.21.15.170:6835/268686042] conn(0x55da17c7fdc0 0x55da17c801a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55da17c07ce0 0x55da17bfb120 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55da17bfe9d0 0x55da17bfabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9dbaffd640 0 client.4692 ms_handle_reset on v2:172.21.15.170:6834/268686042 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 --2- 172.21.15.137:0/3819394770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55da17bea440 0x55da17be9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 -- 172.21.15.137:0/3819394770 >> 172.21.15.137:0/3819394770 conn(0x55da17bc0120 msgr2=0x55da17c293b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 -- 172.21.15.137:0/3819394770 shutdown_connections 2024-04-26T21:58:57.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.957+0000 7f9de523a740 1 -- 172.21.15.137:0/3819394770 wait complete. 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de523a740 20 client.4692 trim_cache size 0 max 16384 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4305, 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 16.698782016999999, 2024-04-26T21:58:57.964 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 7, 2024-04-26T21:58:57.965 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 21, 2024-04-26T21:58:57.965 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 21, 2024-04-26T21:58:57.965 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 23.719936948000001 2024-04-26T21:58:57.965 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T21:58:57.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 -- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9dc806c920 msgr2=0x7f9dc806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9dc806c920 0x7f9dc806ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0017e0 tx=0x7f9dcc009040 comp rx=0 tx=0).stop 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 -- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0cad00 msgr2=0x7f9ddc0c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0cad00 0x7f9ddc0c8900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0ce860 tx=0x7f9dd4007bd0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 -- 172.21.15.137:0/60607962 shutdown_connections 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9dc806c920 0x7f9dc806ede0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ddc0cad00 0x7f9ddc0c8900 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ddc15c2d0 0x7f9ddc15ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 --2- 172.21.15.137:0/60607962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dc4004340 0x7f9ddc0c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 -- 172.21.15.137:0/60607962 >> 172.21.15.137:0/60607962 conn(0x7f9ddc0b3b60 msgr2=0x7f9ddc0b6720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 -- 172.21.15.137:0/60607962 shutdown_connections 2024-04-26T21:58:57.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:57.958+0000 7f9de2445640 1 -- 172.21.15.137:0/60607962 wait complete. 2024-04-26T21:58:57.969 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T21:58:57.980 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T21:58:57.980 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T21:58:57.981 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T21:58:57.981 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T21:58:58.004 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T21:58:58.004 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-26T21:58:58.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.004 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T21:58:58.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.020 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-26T21:58:58.084 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-26T21:58:58.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:58:58.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.086 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T21:58:58.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-26T21:58:58.204 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-26T21:58:58.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:58:58.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.206 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T21:58:58.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.225 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-04-26T21:58:58.297 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2024-04-26T21:58:58.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:58:58.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.299 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T21:58:58.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.357 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-04-26T21:58:58.426 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2024-04-26T21:58:58.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:58:58.427 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-26T21:58:58.428 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:58:58.428 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:58:58.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:58:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.526+0000 7fe590a2a640 1 Processor -- start 2024-04-26T21:58:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.526+0000 7fe590a2a640 1 -- start start 2024-04-26T21:58:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.527+0000 7fe590a2a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe58c0b44e0 0x7fe58c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.527+0000 7fe590a2a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe58c06d2b0 0x7fe58c06d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.527+0000 7fe590a2a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe58c0b4a10 con 0x7fe58c15f1e0 2024-04-26T21:58:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.527+0000 7fe590a2a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe58c06eeb0 con 0x7fe58c0b44e0 2024-04-26T21:58:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.527+0000 7fe590a2a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe58c0b4cf0 con 0x7fe58c06d2b0 2024-04-26T21:58:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.527+0000 7fe583fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe58c0b44e0 0x7fe58c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.527+0000 7fe583fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe58c0b44e0 0x7fe58c06e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48366/0 (socket says 172.21.15.137:48366) 2024-04-26T21:58:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.527+0000 7fe583fff640 1 -- 172.21.15.137:0/1091481063 learned_addr learned my addr 172.21.15.137:0/1091481063 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.528+0000 7fe583fff640 1 -- 172.21.15.137:0/1091481063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe58c06d2b0 msgr2=0x7fe58c06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:58.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.528+0000 7fe583fff640 1 --2- 172.21.15.137:0/1091481063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe58c06d2b0 0x7fe58c06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.528+0000 7fe583fff640 1 -- 172.21.15.137:0/1091481063 >> v1:172.21.15.170:6789/0 conn(0x7fe58c15f1e0 legacy=0x7fe58c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:58:58.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.528+0000 7fe583fff640 1 -- 172.21.15.137:0/1091481063 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c0b4fd0 con 0x7fe58c0b44e0 2024-04-26T21:58:58.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.528+0000 7fe583fff640 1 --2- 172.21.15.137:0/1091481063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 0x7fe58c06e970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe574009870 tx=0x7fe57402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe55803cc589d25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:58.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.528+0000 7fe589d9b640 1 -- 172.21.15.137:0/1091481063 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574037070 con 0x7fe58c0b44e0 2024-04-26T21:58:58.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe589d9b640 1 -- 172.21.15.137:0/1091481063 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe574032440 con 0x7fe58c0b44e0 2024-04-26T21:58:58.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe589d9b640 1 -- 172.21.15.137:0/1091481063 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574032810 con 0x7fe58c0b44e0 2024-04-26T21:58:58.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe590a2a640 1 -- 172.21.15.137:0/1091481063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 msgr2=0x7fe58c06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:58.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe590a2a640 1 --2- 172.21.15.137:0/1091481063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 0x7fe58c06e970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe574009870 tx=0x7fe57402a210 comp rx=0 tx=0).stop 2024-04-26T21:58:58.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe590a2a640 1 -- 172.21.15.137:0/1091481063 shutdown_connections 2024-04-26T21:58:58.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe590a2a640 1 --2- 172.21.15.137:0/1091481063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe58c06d2b0 0x7fe58c06d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe590a2a640 1 --2- 172.21.15.137:0/1091481063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 0x7fe58c06e970 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe590a2a640 1 -- 172.21.15.137:0/1091481063 >> 172.21.15.137:0/1091481063 conn(0x7fe58c0728a0 msgr2=0x7fe58c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:58.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe590a2a640 1 -- 172.21.15.137:0/1091481063 shutdown_connections 2024-04-26T21:58:58.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.529+0000 7fe590a2a640 1 -- 172.21.15.137:0/1091481063 wait complete. 2024-04-26T21:58:58.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.530+0000 7fe590a2a640 1 Processor -- start 2024-04-26T21:58:58.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.530+0000 7fe590a2a640 1 -- start start 2024-04-26T21:58:58.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe590a2a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe58c06d2b0 0x7fe58c1e9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:58.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe590a2a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 0x7fe58c146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:58.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe590a2a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe58c15f1e0 0x7fe58c15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:58.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe590a2a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c15f5c0 con 0x7fe58c0b44e0 2024-04-26T21:58:58.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe590a2a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c0b5590 con 0x7fe58c15f1e0 2024-04-26T21:58:58.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe590a2a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe58c15d7e0 con 0x7fe58c06d2b0 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe583fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 0x7fe58c146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe583fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 0x7fe58c146050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48376/0 (socket says 172.21.15.137:48376) 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe583fff640 1 -- 172.21.15.137:0/1121602875 learned_addr learned my addr 172.21.15.137:0/1121602875 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe583fff640 1 -- 172.21.15.137:0/1121602875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe58c06d2b0 msgr2=0x7fe58c1e9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe583fff640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe58c06d2b0 0x7fe58c1e9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe583fff640 1 -- 172.21.15.137:0/1121602875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe58c15f1e0 msgr2=0x7fe58c15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe58ad9d640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe58c15f1e0 0x7fe58c15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe583fff640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe58c15f1e0 0x7fe58c15a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.531+0000 7fe583fff640 1 -- 172.21.15.137:0/1121602875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c15d500 con 0x7fe58c0b44e0 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.532+0000 7fe583fff640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 0x7fe58c146050 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe574009870 tx=0x7fe5740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.532+0000 7fe582ffd640 1 -- 172.21.15.137:0/1121602875 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574041070 con 0x7fe58c0b44e0 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.532+0000 7fe582ffd640 1 -- 172.21.15.137:0/1121602875 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57403c870 con 0x7fe58c0b44e0 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.532+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58c1e8e30 con 0x7fe58c0b44e0 2024-04-26T21:58:58.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.532+0000 7fe582ffd640 1 -- 172.21.15.137:0/1121602875 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574037040 con 0x7fe58c0b44e0 2024-04-26T21:58:58.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.532+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58c15ad80 con 0x7fe58c0b44e0 2024-04-26T21:58:58.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.533+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe58c06a290 con 0x7fe58c0b44e0 2024-04-26T21:58:58.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.533+0000 7fe582ffd640 1 -- 172.21.15.137:0/1121602875 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe574044070 con 0x7fe58c0b44e0 2024-04-26T21:58:58.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.534+0000 7fe582ffd640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe56c06c920 0x7fe56c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:58:58.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.534+0000 7fe58a59c640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe56c06c920 0x7fe56c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:58:58.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.534+0000 7fe582ffd640 1 -- 172.21.15.137:0/1121602875 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe5740ac680 con 0x7fe58c0b44e0 2024-04-26T21:58:58.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.534+0000 7fe58a59c640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe56c06c920 0x7fe56c06ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009650 tx=0x7fe57c006ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:58:58.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.538+0000 7fe582ffd640 1 -- 172.21.15.137:0/1121602875 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe57407aa20 con 0x7fe58c0b44e0 2024-04-26T21:58:58.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.750+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe58c070c00 con 0x7fe58c0b44e0 2024-04-26T21:58:58.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.750+0000 7fe582ffd640 1 -- 172.21.15.137:0/1121602875 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fe57407a320 con 0x7fe58c0b44e0 2024-04-26T21:58:58.751 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe56c06c920 msgr2=0x7fe56c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe56c06c920 0x7fe56c06ede0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009650 tx=0x7fe57c006ba0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 msgr2=0x7fe58c146050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 0x7fe58c146050 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe574009870 tx=0x7fe5740046c0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 shutdown_connections 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe56c06c920 0x7fe56c06ede0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe58c0b44e0 0x7fe58c146050 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe58c15f1e0 0x7fe58c15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 --2- 172.21.15.137:0/1121602875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe58c06d2b0 0x7fe58c1e9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 >> 172.21.15.137:0/1121602875 conn(0x7fe58c0728a0 msgr2=0x7fe58c162de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 shutdown_connections 2024-04-26T21:58:58.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58.752+0000 7fe590a2a640 1 -- 172.21.15.137:0/1121602875 wait complete. 2024-04-26T21:58:58.763 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:58:58.763 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:58:58.763 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T21:58:58.763 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T21:58:58.763 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:58:58.763 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:58:58.764 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:58:58.764 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:58:58.764 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:58:58.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.764 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T21:58:58.778 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T21:58:58.779 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:58:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:58:58.780 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:58:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:58:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T21:58:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42768sec preferred_lft 42768sec 2024-04-26T21:58:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T21:58:58.780 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:58:58.780 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:58:58.780 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:58:58.781 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:58:58.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:58:58.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr flush dev ceph-brx 2024-04-26T21:58:58.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set ceph-brx up 2024-04-26T21:58:58.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:58:58.781 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:58:58.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:58:58.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:58:58.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.960 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:58:58.983 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T21:58:58.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:58.984 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T21:58:59.055 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T21:58:59.055 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:58:59.055 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:58:59.055 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:58:59.055 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:58:59.056 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:58:59.056 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:58:59.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:58:59.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:58:59.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:58:59.056 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:58:59.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:58:59.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:58:59.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:59.299 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T21:58:59.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:59.314 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-04-26T21:58:59.368 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:58:59.368 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:58:59.368 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:58:59.369 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T21:58:59.369 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:58:59.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:58:59.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:58:59.485 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T21:58:59.485 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:58:59.485 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:58:59.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T21:58:59.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:58:59.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T21:58:59.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T21:58:59.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T21:58:59.486 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:58:59.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:58:59.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:58:59.605 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:58:59.605 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:58:59.605 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T21:58:59.605 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:58:59.605 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:58:59.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:58:59.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:58:59.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:58:59.679 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T21:58:59.693 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:58:59.693 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:58:59.694 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:58:59.748 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T21:58:59.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:59.749 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:58:59.836 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:58:59.836 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:58:59.935 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:58:59.935 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:58:59.935 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T21:58:59.935 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T21:58:59.935 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T21:58:59.936 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T21:58:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T21:58:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T21:58:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T21:58:59.936 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T21:58:59.938 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T21:58:59.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:58:59.938 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:58:59.968 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:00.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:00.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:00.069 INFO:teuthology.orchestra.run.smithi137.stdout:client4701 2024-04-26T21:59:00.069 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:00.069 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:00.084 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:00.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:00.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:00.185 INFO:teuthology.orchestra.run.smithi137.stdout:client4701 2024-04-26T21:59:00.186 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:00.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:00.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:00.248 INFO:teuthology.orchestra.run.smithi137.stdout:client4701 2024-04-26T21:59:00.248 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/30fb29b0-57db-44cb-a9e0-8033deb0a091.client4701/status') 2024-04-26T21:59:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:00.310 INFO:teuthology.orchestra.run.smithi137.stdout:instance: client.4701 (3)192.168.0.1:0/3881738033 2024-04-26T21:59:00.310 INFO:teuthology.orchestra.run.smithi137.stdout:blocklisted: false 2024-04-26T21:59:00.310 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records in 2024-04-26T21:59:00.310 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records out 2024-04-26T21:59:00.311 INFO:teuthology.orchestra.run.smithi137.stderr:69 bytes copied, 2.2403e-05 s, 3.1 MB/s 2024-04-26T21:59:00.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:00.317 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-04-26T21:59:00.318 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:59:00.318 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T21:59:00.318 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.416+0000 7f94305b4640 1 Processor -- start 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.416+0000 7f94305b4640 1 -- start start 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f94305b4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94280b61a0 0x7f9428160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f94305b4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f94280b3de0 0x7f94280720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f94305b4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94280b4530 con 0x7f9428145980 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f94305b4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f94280b5140 con 0x7f94280b3de0 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f94305b4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f94280b4810 con 0x7f94280b61a0 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f942eb51640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f94280b3de0 0x7f94280720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f942eb51640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f94280b3de0 0x7f94280720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48392/0 (socket says 172.21.15.137:48392) 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f942eb51640 1 -- 172.21.15.137:0/424338761 learned_addr learned my addr 172.21.15.137:0/424338761 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:00.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f942db4f640 1 --2- 172.21.15.137:0/424338761 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94280b61a0 0x7f9428160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:00.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f942eb51640 1 -- 172.21.15.137:0/424338761 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94280b61a0 msgr2=0x7f9428160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:00.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f942eb51640 1 --2- 172.21.15.137:0/424338761 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94280b61a0 0x7f9428160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f942eb51640 1 -- 172.21.15.137:0/424338761 >> v1:172.21.15.170:6789/0 conn(0x7f9428145980 legacy=0x7f94280b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:00.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f942eb51640 1 -- 172.21.15.137:0/424338761 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94280b4af0 con 0x7f94280b3de0 2024-04-26T21:59:00.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.417+0000 7f942db4f640 1 --2- 172.21.15.137:0/424338761 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94280b61a0 0x7f9428160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:00.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.418+0000 7f942eb51640 1 --2- 172.21.15.137:0/424338761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b3de0 0x7f94280720d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f942000d150 tx=0x7f942002c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8378266efc683b7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:00.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.418+0000 7f942d34e640 1 -- 172.21.15.137:0/424338761 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9420039070 con 0x7f94280b3de0 2024-04-26T21:59:00.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.418+0000 7f942d34e640 1 -- 172.21.15.137:0/424338761 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9420009600 con 0x7f94280b3de0 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.418+0000 7f942d34e640 1 -- 172.21.15.137:0/424338761 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94200099d0 con 0x7f94280b3de0 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.419+0000 7f94305b4640 1 -- 172.21.15.137:0/424338761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b3de0 msgr2=0x7f94280720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.419+0000 7f94305b4640 1 --2- 172.21.15.137:0/424338761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b3de0 0x7f94280720d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f942000d150 tx=0x7f942002c840 comp rx=0 tx=0).stop 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.419+0000 7f94305b4640 1 -- 172.21.15.137:0/424338761 shutdown_connections 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.419+0000 7f94305b4640 1 --2- 172.21.15.137:0/424338761 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b3de0 0x7f94280720d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.419+0000 7f94305b4640 1 --2- 172.21.15.137:0/424338761 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94280b61a0 0x7f9428160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.419+0000 7f94305b4640 1 -- 172.21.15.137:0/424338761 >> 172.21.15.137:0/424338761 conn(0x7f94280d0d30 msgr2=0x7f94280d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.419+0000 7f94305b4640 1 -- 172.21.15.137:0/424338761 shutdown_connections 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.419+0000 7f94305b4640 1 -- 172.21.15.137:0/424338761 wait complete. 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.420+0000 7f94305b4640 1 Processor -- start 2024-04-26T21:59:00.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.420+0000 7f94305b4640 1 -- start start 2024-04-26T21:59:00.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f94305b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94280b3de0 0x7f942815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f94305b4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b61a0 0x7f942813dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f94305b4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9428145980 0x7f942813e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f94305b4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9428072610 con 0x7f94280b61a0 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f94305b4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f94280b4240 con 0x7f94280b3de0 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f94305b4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9428072790 con 0x7f9428145980 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942db4f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b61a0 0x7f942813dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942db4f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b61a0 0x7f942813dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48398/0 (socket says 172.21.15.137:48398) 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942db4f640 1 -- 172.21.15.137:0/208736195 learned_addr learned my addr 172.21.15.137:0/208736195 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942eb51640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9428145980 0x7f942813e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942e350640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94280b3de0 0x7f942815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942db4f640 1 -- 172.21.15.137:0/208736195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9428145980 msgr2=0x7f942813e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942db4f640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9428145980 0x7f942813e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942db4f640 1 -- 172.21.15.137:0/208736195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94280b3de0 msgr2=0x7f942815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942db4f640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94280b3de0 0x7f942815a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942db4f640 1 -- 172.21.15.137:0/208736195 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94280b1790 con 0x7f94280b61a0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.421+0000 7f942e350640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94280b3de0 0x7f942815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.422+0000 7f942db4f640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b61a0 0x7f942813dc50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f942400c7f0 tx=0x7f942400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.422+0000 7f941effd640 1 -- 172.21.15.137:0/208736195 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424015070 con 0x7f94280b61a0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.422+0000 7f941effd640 1 -- 172.21.15.137:0/208736195 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9424007a30 con 0x7f94280b61a0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.422+0000 7f941effd640 1 -- 172.21.15.137:0/208736195 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424007e00 con 0x7f94280b61a0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.422+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94280b09d0 con 0x7f94280b61a0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.422+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94280b0f90 con 0x7f94280b61a0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.423+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942806a290 con 0x7f94280b61a0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.423+0000 7f941effd640 1 -- 172.21.15.137:0/208736195 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9424018070 con 0x7f94280b61a0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.424+0000 7f941effd640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f940c06c8f0 0x7f940c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.424+0000 7f941effd640 1 -- 172.21.15.137:0/208736195 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f942408bac0 con 0x7f94280b61a0 2024-04-26T21:59:00.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.424+0000 7f942e350640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f940c06c8f0 0x7f940c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:00.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.424+0000 7f942e350640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f940c06c8f0 0x7f940c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f941800a830 tx=0x7f9418008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:00.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.428+0000 7f941effd640 1 -- 172.21.15.137:0/208736195 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9424059ef0 con 0x7f94280b61a0 2024-04-26T21:59:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.650+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9428073cc0 con 0x7f94280b61a0 2024-04-26T21:59:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.650+0000 7f941effd640 1 -- 172.21.15.137:0/208736195 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f94240597f0 con 0x7f94280b61a0 2024-04-26T21:59:00.650 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f940c06c8f0 msgr2=0x7f940c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f940c06c8f0 0x7f940c06edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f941800a830 tx=0x7f9418008040 comp rx=0 tx=0).stop 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b61a0 msgr2=0x7f942813dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b61a0 0x7f942813dc50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f942400c7f0 tx=0x7f942400cbf0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 shutdown_connections 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f940c06c8f0 0x7f940c06edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94280b61a0 0x7f942813dc50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9428145980 0x7f942813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 --2- 172.21.15.137:0/208736195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94280b3de0 0x7f942815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.652+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 >> 172.21.15.137:0/208736195 conn(0x7f94280d0d30 msgr2=0x7f942815b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.653+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 shutdown_connections 2024-04-26T21:59:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00.653+0000 7f94305b4640 1 -- 172.21.15.137:0/208736195 wait complete. 2024-04-26T21:59:00.664 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:59:00.664 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:59:00.664 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T21:59:00.664 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-26T21:59:00.664 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T21:59:00.665 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:59:00.665 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:59:00.665 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:59:00.665 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-26T21:59:00.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:00.665 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T21:59:00.679 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T21:59:00.680 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42766sec preferred_lft 42766sec 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:00.681 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T21:59:00.682 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:59:00.682 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link tentative 2024-04-26T21:59:00.682 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:00.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:00.682 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:59:00.743 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T21:59:00.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:00.745 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T21:59:00.800 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T21:59:00.800 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:59:00.800 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:59:00.800 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:59:00.800 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:59:00.801 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:00.801 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:59:00.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:59:00.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:59:00.801 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:59:00.801 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:59:00.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:00.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:00.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:00.927 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T21:59:00.941 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T21:59:00.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:00.941 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list-id 2024-04-26T21:59:00.996 INFO:teuthology.orchestra.run.smithi137.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-26T21:59:00.996 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:00.996 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:59:00.996 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:59:00.997 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-26T21:59:00.997 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:59:01.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:01.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:01.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:01.112 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T21:59:01.134 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 16:03:e2:44:cf:d7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::1403:e2ff:fe44:cfd7/64 scope link 2024-04-26T21:59:01.135 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:01.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:01.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 16:03:e2:44:cf:d7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:01.200 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::1403:e2ff:fe44:cfd7/64 scope link 2024-04-26T21:59:01.201 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:01.201 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-26T21:59:01.202 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:01.202 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:59:01.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-26T21:59:01.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T21:59:01.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-26T21:59:01.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-26T21:59:01.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-26T21:59:01.202 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:59:01.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:01.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:01.350 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:01.350 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:59:01.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.1 up 2024-04-26T21:59:01.350 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T21:59:01.350 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:59:01.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:01.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:01.424 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:59:01.424 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-26T21:59:01.439 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-26T21:59:01.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:59:01.439 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-26T21:59:01.495 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-04-26T21:59:01.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:01.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:01.577 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:01.577 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:59:01.585 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:01.585 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:59:01.585 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T21:59:01.585 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 2@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T21:59:01.585 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T21:59:01.586 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-26T21:59:01.586 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T21:59:01.586 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T21:59:01.586 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T21:59:01.586 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T21:59:01.587 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T21:59:01.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:01.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-26T21:59:01.652 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:01.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:01.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:01.747 INFO:teuthology.orchestra.run.smithi137.stdout:client4594 2024-04-26T21:59:01.748 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:01.748 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:01.763 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:01.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:01.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:01.858 INFO:teuthology.orchestra.run.smithi137.stdout:client4594 2024-04-26T21:59:01.859 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:01.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:01.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:01.914 INFO:teuthology.orchestra.run.smithi137.stdout:client4594 2024-04-26T21:59:01.914 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/30fb29b0-57db-44cb-a9e0-8033deb0a091.client4594/status') 2024-04-26T21:59:01.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:01.971 INFO:teuthology.orchestra.run.smithi137.stdout:instance: client.4594 (3)172.21.15.137:0/2190454807 2024-04-26T21:59:01.971 INFO:teuthology.orchestra.run.smithi137.stdout:blocklisted: false 2024-04-26T21:59:01.971 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records in 2024-04-26T21:59:01.971 INFO:teuthology.orchestra.run.smithi137.stderr:0+1 records out 2024-04-26T21:59:01.971 INFO:teuthology.orchestra.run.smithi137.stderr:71 bytes copied, 3.7677e-05 s, 1.9 MB/s 2024-04-26T21:59:01.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:01.978 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-04-26T21:59:01.978 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:59:01.978 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T21:59:01.978 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:59:02.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.075+0000 7f52b57da640 1 Processor -- start 2024-04-26T21:59:02.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.075+0000 7f52b57da640 1 -- start start 2024-04-26T21:59:02.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52b57da640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f52b015b4e0 0x7f52b0071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:02.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52b57da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b8c0 0x7f52b00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:02.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52b57da640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52b00733e0 con 0x7f52b0073820 2024-04-26T21:59:02.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52b57da640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f52b00ce230 con 0x7f52b015b4e0 2024-04-26T21:59:02.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52b57da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f52b0072f00 con 0x7f52b015b8c0 2024-04-26T21:59:02.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52aeffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f52b015b4e0 0x7f52b0071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52af7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f52b0073820 0x7f52b006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39506/0 (socket says 172.21.15.137:39506) 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52af7fe640 1 -- 172.21.15.137:0/4209986677 learned_addr learned my addr 172.21.15.137:0/4209986677 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52a7fff640 1 --2- 172.21.15.137:0/4209986677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b8c0 0x7f52b00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52aeffd640 1 -- 172.21.15.137:0/4209986677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b8c0 msgr2=0x7f52b00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52aeffd640 1 --2- 172.21.15.137:0/4209986677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b8c0 0x7f52b00cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52aeffd640 1 -- 172.21.15.137:0/4209986677 >> v1:172.21.15.137:6789/0 conn(0x7f52b0073820 legacy=0x7f52b006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52ae7fc640 1 -- 172.21.15.137:0/4209986677 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194989479 0 0) 0x7f52b00733e0 con 0x7f52b0073820 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52aeffd640 1 -- 172.21.15.137:0/4209986677 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b0072660 con 0x7f52b015b4e0 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.076+0000 7f52a7fff640 1 --2- 172.21.15.137:0/4209986677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b8c0 0x7f52b00cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.077+0000 7f52aeffd640 1 --2- 172.21.15.137:0/4209986677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b015b4e0 0x7f52b0071fd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52a000ba40 tx=0x7f52a002c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5b0e9314c810e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:02.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.077+0000 7f52ae7fc640 1 -- 172.21.15.137:0/4209986677 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a003a070 con 0x7f52b015b4e0 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.077+0000 7f52ae7fc640 1 -- 172.21.15.137:0/4209986677 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a0032480 con 0x7f52b015b4e0 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.077+0000 7f52ae7fc640 1 -- 172.21.15.137:0/4209986677 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0032850 con 0x7f52b015b4e0 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.078+0000 7f52b57da640 1 -- 172.21.15.137:0/4209986677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b015b4e0 msgr2=0x7f52b0071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.078+0000 7f52b57da640 1 --2- 172.21.15.137:0/4209986677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b015b4e0 0x7f52b0071fd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f52a000ba40 tx=0x7f52a002c620 comp rx=0 tx=0).stop 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.078+0000 7f52b57da640 1 -- 172.21.15.137:0/4209986677 shutdown_connections 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.078+0000 7f52b57da640 1 --2- 172.21.15.137:0/4209986677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b8c0 0x7f52b00cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.078+0000 7f52b57da640 1 --2- 172.21.15.137:0/4209986677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b015b4e0 0x7f52b0071fd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.078+0000 7f52b57da640 1 -- 172.21.15.137:0/4209986677 >> 172.21.15.137:0/4209986677 conn(0x7f52b00d0d30 msgr2=0x7f52b00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.078+0000 7f52b57da640 1 -- 172.21.15.137:0/4209986677 shutdown_connections 2024-04-26T21:59:02.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.078+0000 7f52b57da640 1 -- 172.21.15.137:0/4209986677 wait complete. 2024-04-26T21:59:02.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.079+0000 7f52b57da640 1 Processor -- start 2024-04-26T21:59:02.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.079+0000 7f52b57da640 1 -- start start 2024-04-26T21:59:02.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.079+0000 7f52b57da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b0073820 0x7f52b01f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:02.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.079+0000 7f52b57da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b4e0 0x7f52b014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:02.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.079+0000 7f52b57da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b015b8c0 0x7f52b01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.079+0000 7f52b57da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52b00b3e80 con 0x7f52b0073820 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.079+0000 7f52b57da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0072c20 con 0x7f52b015b8c0 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.079+0000 7f52b57da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f52b006f2c0 con 0x7f52b015b4e0 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52aeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b0073820 0x7f52b01f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52aeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b0073820 0x7f52b01f06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48426/0 (socket says 172.21.15.137:48426) 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52aeffd640 1 -- 172.21.15.137:0/2545177175 learned_addr learned my addr 172.21.15.137:0/2545177175 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52aeffd640 1 -- 172.21.15.137:0/2545177175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b4e0 msgr2=0x7f52b014e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52aeffd640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b4e0 0x7f52b014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52aeffd640 1 -- 172.21.15.137:0/2545177175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b015b8c0 msgr2=0x7f52b01594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52aeffd640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b015b8c0 0x7f52b01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52aeffd640 1 -- 172.21.15.137:0/2545177175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b0158b70 con 0x7f52b0073820 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52aeffd640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b0073820 0x7f52b01f06d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f52a000ba40 tx=0x7f52a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52a77fe640 1 -- 172.21.15.137:0/2545177175 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a003a040 con 0x7f52b0073820 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52a77fe640 1 -- 172.21.15.137:0/2545177175 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a0004030 con 0x7f52b0073820 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52a77fe640 1 -- 172.21.15.137:0/2545177175 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0006d10 con 0x7f52b0073820 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b015bf30 con 0x7f52b0073820 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.080+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b015c4f0 con 0x7f52b0073820 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.081+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b006a290 con 0x7f52b0073820 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.082+0000 7f52a77fe640 1 -- 172.21.15.137:0/2545177175 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52a0035840 con 0x7f52b0073820 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.082+0000 7f52a77fe640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f529006c8f0 0x7f529006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.082+0000 7f52a77fe640 1 -- 172.21.15.137:0/2545177175 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f52a00af440 con 0x7f52b0073820 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.082+0000 7f52a7fff640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f529006c8f0 0x7f529006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:02.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.083+0000 7f52a7fff640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f529006c8f0 0x7f529006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5298006fd0 tx=0x7f5298008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:02.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.087+0000 7f52a77fe640 1 -- 172.21.15.137:0/2545177175 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f52a007da20 con 0x7f52b0073820 2024-04-26T21:59:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.299+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f52b01f0c10 con 0x7f52b0073820 2024-04-26T21:59:02.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.299+0000 7f52a77fe640 1 -- 172.21.15.137:0/2545177175 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f52a007d320 con 0x7f52b0073820 2024-04-26T21:59:02.300 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T21:59:02.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f529006c8f0 msgr2=0x7f529006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f529006c8f0 0x7f529006edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5298006fd0 tx=0x7f5298008040 comp rx=0 tx=0).stop 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b0073820 msgr2=0x7f52b01f06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b0073820 0x7f52b01f06d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f52a000ba40 tx=0x7f52a00046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 shutdown_connections 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f529006c8f0 0x7f529006edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52b015b8c0 0x7f52b01594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52b015b4e0 0x7f52b014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 --2- 172.21.15.137:0/2545177175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52b0073820 0x7f52b01f06d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 >> 172.21.15.137:0/2545177175 conn(0x7f52b00d0d30 msgr2=0x7f52b0150910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 shutdown_connections 2024-04-26T21:59:02.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:02.301+0000 7f52b57da640 1 -- 172.21.15.137:0/2545177175 wait complete. 2024-04-26T21:59:02.312 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:59:02.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:59:02.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-04-26T21:59:02.312 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T21:59:02.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T21:59:02.312 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:59:02.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:59:02.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:59:02.313 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T21:59:02.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:02.313 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-04-26T21:59:02.331 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:59:02.331 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:59:02.331 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:59:02.331 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:02.331 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T21:59:02.331 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:02.331 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:02.331 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42759sec preferred_lft 42759sec 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::7225:15b2:ef24:c3ba/64 scope link noprefixroute 2024-04-26T21:59:02.332 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:02.332 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T21:59:02.333 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:02.333 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T21:59:02.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add name ceph-brx type bridge 2024-04-26T21:59:02.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr flush dev ceph-brx 2024-04-26T21:59:02.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set ceph-brx up 2024-04-26T21:59:02.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T21:59:02.333 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T21:59:02.427 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:02.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:02.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:02.610 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:59:02.634 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T21:59:02.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:02.636 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-04-26T21:59:02.700 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-04-26T21:59:02.700 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:59:02.700 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:59:02.700 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:59:02.700 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:59:02.701 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:02.701 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T21:59:02.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:59:02.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:59:02.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:59:02.701 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T21:59:02.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:02.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:02.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:02.968 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T21:59:02.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:02.983 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2024-04-26T21:59:03.038 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:03.038 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T21:59:03.038 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:59:03.038 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T21:59:03.038 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T21:59:03.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:03.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:03.155 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T21:59:03.155 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:03.156 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T21:59:03.156 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T21:59:03.156 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T21:59:03.156 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T21:59:03.156 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T21:59:03.156 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T21:59:03.156 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T21:59:03.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:03.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:03.274 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:03.274 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T21:59:03.274 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2024-04-26T21:59:03.275 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T21:59:03.275 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T21:59:03.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:03.342 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:03.349 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:59:03.349 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T21:59:03.363 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T21:59:03.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:59:03.363 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T21:59:03.418 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-26T21:59:03.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:03.418 DEBUG:teuthology.orchestra.run.smithi170:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:03.509 INFO:teuthology.orchestra.run.smithi170.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:03.509 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:59:03.624 INFO:teuthology.orchestra.run.smithi170.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:03.624 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:59:03.624 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T21:59:03.624 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: trying mount with new device syntax: 1@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T21:59:03.624 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T21:59:03.625 INFO:teuthology.orchestra.run.smithi170.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-26T21:59:03.625 INFO:teuthology.orchestra.run.smithi170.stdout: You just mounted a file system that supports labels which does not 2024-04-26T21:59:03.625 INFO:teuthology.orchestra.run.smithi170.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T21:59:03.625 INFO:teuthology.orchestra.run.smithi170.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T21:59:03.625 INFO:teuthology.orchestra.run.smithi170.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T21:59:03.627 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T21:59:03.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:03.627 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T21:59:03.650 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:03.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:03.740 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:03.746 INFO:teuthology.orchestra.run.smithi170.stdout:client4719 2024-04-26T21:59:03.746 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:03.746 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:03.761 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:03.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:03.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:03.856 INFO:teuthology.orchestra.run.smithi170.stdout:client4719 2024-04-26T21:59:03.856 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:03.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:03.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:03.911 INFO:teuthology.orchestra.run.smithi170.stdout:client4719 2024-04-26T21:59:03.911 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/30fb29b0-57db-44cb-a9e0-8033deb0a091.client4719/status') 2024-04-26T21:59:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:03.968 INFO:teuthology.orchestra.run.smithi170.stdout:instance: client.4719 (3)172.21.15.170:0/2323014803 2024-04-26T21:59:03.968 INFO:teuthology.orchestra.run.smithi170.stdout:blocklisted: false 2024-04-26T21:59:03.968 INFO:teuthology.orchestra.run.smithi170.stderr:0+1 records in 2024-04-26T21:59:03.968 INFO:teuthology.orchestra.run.smithi170.stderr:0+1 records out 2024-04-26T21:59:03.968 INFO:teuthology.orchestra.run.smithi170.stderr:71 bytes copied, 2.8098e-05 s, 2.5 MB/s 2024-04-26T21:59:03.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:03.975 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-04-26T21:59:03.975 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T21:59:03.975 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T21:59:03.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:59:04.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.085+0000 7f3f96738640 1 Processor -- start 2024-04-26T21:59:04.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.085+0000 7f3f96738640 1 -- start start 2024-04-26T21:59:04.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f96738640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f900b56d0 0x7f3f900d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:04.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f96738640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3f90160d50 0x7f3f901611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:04.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f96738640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f900d0be0 con 0x7f3f9015d380 2024-04-26T21:59:04.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f96738640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3f901616e0 con 0x7f3f900b56d0 2024-04-26T21:59:04.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f96738640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3f900d0ec0 con 0x7f3f90160d50 2024-04-26T21:59:04.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f8f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f900b56d0 0x7f3f900d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f8f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f900b56d0 0x7f3f900d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48434/0 (socket says 172.21.15.137:48434) 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f8f7fe640 1 -- 172.21.15.137:0/3685462764 learned_addr learned my addr 172.21.15.137:0/3685462764 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f94cd5640 1 --2- 172.21.15.137:0/3685462764 >> v2:172.21.15.170:3300/0 conn(0x7f3f90160d50 0x7f3f901611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f8f7fe640 1 -- 172.21.15.137:0/3685462764 >> v2:172.21.15.170:3300/0 conn(0x7f3f90160d50 msgr2=0x7f3f901611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f8f7fe640 1 --2- 172.21.15.137:0/3685462764 >> v2:172.21.15.170:3300/0 conn(0x7f3f90160d50 0x7f3f901611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f8f7fe640 1 -- 172.21.15.137:0/3685462764 >> v1:172.21.15.170:6789/0 conn(0x7f3f9015d380 legacy=0x7f3f900ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.086+0000 7f3f8f7fe640 1 -- 172.21.15.137:0/3685462764 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f900d11a0 con 0x7f3f900b56d0 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.087+0000 7f3f8f7fe640 1 --2- 172.21.15.137:0/3685462764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 0x7f3f900d19a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f900c9fd0 tx=0x7f3f8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a2dd96a0796322 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.087+0000 7f3f8effd640 1 -- 172.21.15.137:0/3685462764 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84037070 con 0x7f3f900b56d0 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.087+0000 7f3f8effd640 1 -- 172.21.15.137:0/3685462764 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f84032440 con 0x7f3f900b56d0 2024-04-26T21:59:04.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.087+0000 7f3f8effd640 1 -- 172.21.15.137:0/3685462764 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84032810 con 0x7f3f900b56d0 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.088+0000 7f3f96738640 1 -- 172.21.15.137:0/3685462764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 msgr2=0x7f3f900d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.088+0000 7f3f96738640 1 --2- 172.21.15.137:0/3685462764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 0x7f3f900d19a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f900c9fd0 tx=0x7f3f8402a270 comp rx=0 tx=0).stop 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.088+0000 7f3f96738640 1 -- 172.21.15.137:0/3685462764 shutdown_connections 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.088+0000 7f3f96738640 1 --2- 172.21.15.137:0/3685462764 >> v2:172.21.15.170:3300/0 conn(0x7f3f90160d50 0x7f3f901611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.088+0000 7f3f96738640 1 --2- 172.21.15.137:0/3685462764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 0x7f3f900d19a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.088+0000 7f3f96738640 1 -- 172.21.15.137:0/3685462764 >> 172.21.15.137:0/3685462764 conn(0x7f3f900b4a60 msgr2=0x7f3f900b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.088+0000 7f3f96738640 1 -- 172.21.15.137:0/3685462764 shutdown_connections 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.088+0000 7f3f96738640 1 -- 172.21.15.137:0/3685462764 wait complete. 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.089+0000 7f3f96738640 1 Processor -- start 2024-04-26T21:59:04.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.089+0000 7f3f96738640 1 -- start start 2024-04-26T21:59:04.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f96738640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 0x7f3f9015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:04.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f96738640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9015d380 0x7f3f9014f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:04.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f96738640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f90160d50 0x7f3f900b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:04.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f96738640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f900cedc0 con 0x7f3f900b56d0 2024-04-26T21:59:04.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f96738640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f900d1ee0 con 0x7f3f90160d50 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f96738640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3f900b5dc0 con 0x7f3f9015d380 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 0x7f3f9015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 0x7f3f9015d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:48442/0 (socket says 172.21.15.137:48442) 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f8ffff640 1 -- 172.21.15.137:0/2020310645 learned_addr learned my addr 172.21.15.137:0/2020310645 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f94cd5640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f90160d50 0x7f3f900b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f8f7fe640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9015d380 0x7f3f9014f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f8ffff640 1 -- 172.21.15.137:0/2020310645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9015d380 msgr2=0x7f3f9014f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f8ffff640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9015d380 0x7f3f9014f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f8ffff640 1 -- 172.21.15.137:0/2020310645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f90160d50 msgr2=0x7f3f900b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f8ffff640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f90160d50 0x7f3f900b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.090+0000 7f3f8ffff640 1 -- 172.21.15.137:0/2020310645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9014f910 con 0x7f3f900b56d0 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.091+0000 7f3f8ffff640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 0x7f3f9015d760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c430 tx=0x7f3f8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:04.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.091+0000 7f3f8cff9640 1 -- 172.21.15.137:0/2020310645 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f800052d0 con 0x7f3f900b56d0 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.091+0000 7f3f8cff9640 1 -- 172.21.15.137:0/2020310645 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f80005490 con 0x7f3f900b56d0 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.091+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f900ca4d0 con 0x7f3f900b56d0 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.091+0000 7f3f8cff9640 1 -- 172.21.15.137:0/2020310645 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80007260 con 0x7f3f900b56d0 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.091+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f900caa90 con 0x7f3f900b56d0 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.092+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f9006a290 con 0x7f3f900b56d0 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.092+0000 7f3f8cff9640 1 -- 172.21.15.137:0/2020310645 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f80007400 con 0x7f3f900b56d0 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.093+0000 7f3f8cff9640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f7c06c8f0 0x7f3f7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.093+0000 7f3f8cff9640 1 -- 172.21.15.137:0/2020310645 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3f8008af70 con 0x7f3f900b56d0 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.093+0000 7f3f8f7fe640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f7c06c8f0 0x7f3f7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:04.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.093+0000 7f3f8f7fe640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f7c06c8f0 0x7f3f7c06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f84034000 tx=0x7f3f8402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:04.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.097+0000 7f3f8cff9640 1 -- 172.21.15.137:0/2020310645 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3f9014f910 con 0x7f3f900b56d0 2024-04-26T21:59:04.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.312+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3f90070e70 con 0x7f3f900b56d0 2024-04-26T21:59:04.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.312+0000 7f3f8cff9640 1 -- 172.21.15.137:0/2020310645 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f3f80058de0 con 0x7f3f900b56d0 2024-04-26T21:59:04.313 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f7c06c8f0 msgr2=0x7f3f7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f7c06c8f0 0x7f3f7c06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f84034000 tx=0x7f3f8402e000 comp rx=0 tx=0).stop 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 msgr2=0x7f3f9015d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 0x7f3f9015d760 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c430 tx=0x7f3f8000c8f0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 shutdown_connections 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f7c06c8f0 0x7f3f7c06edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f90160d50 0x7f3f900b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9015d380 0x7f3f9014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 --2- 172.21.15.137:0/2020310645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f900b56d0 0x7f3f9015d760 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.314+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 >> 172.21.15.137:0/2020310645 conn(0x7f3f900b4a60 msgr2=0x7f3f90071390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:04.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.315+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 shutdown_connections 2024-04-26T21:59:04.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:04.315+0000 7f3f96738640 1 -- 172.21.15.137:0/2020310645 wait complete. 2024-04-26T21:59:04.325 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T21:59:04.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:59:04.326 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-04-26T21:59:04.326 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-26T21:59:04.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T21:59:04.326 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T21:59:04.326 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T21:59:04.326 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:59:04.326 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-26T21:59:04.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:04.326 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-04-26T21:59:04.342 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:59:04.342 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:59:04.342 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:59:04.342 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.342 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T21:59:04.342 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.343 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:04.343 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:04.343 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-04-26T21:59:04.343 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:04.343 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:04.343 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-04-26T21:59:04.343 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:04.343 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42757sec preferred_lft 42757sec 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::7225:15b2:ef24:c3ba/64 scope link noprefixroute 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 2e:9d:04:7d:8b:f9 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::c8b9:d0ff:feba:44e9/64 scope link tentative 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T21:59:04.344 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 2e:9d:04:7d:8b:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T21:59:04.345 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::2c9d:4ff:fe7d:8bf9/64 scope link tentative 2024-04-26T21:59:04.345 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:04.345 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:59:04.405 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-26T21:59:04.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:04.407 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-04-26T21:59:04.463 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-04-26T21:59:04.463 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:59:04.463 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:59:04.463 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:59:04.464 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:59:04.464 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:04.464 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T21:59:04.464 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:59:04.464 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:59:04.464 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:59:04.464 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T21:59:04.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:04.583 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:04.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:04.589 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T21:59:04.604 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T21:59:04.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:04.605 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2024-04-26T21:59:04.659 INFO:teuthology.orchestra.run.smithi170.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-26T21:59:04.659 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:04.659 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T21:59:04.659 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T21:59:04.659 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-26T21:59:04.659 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T21:59:04.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:04.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:04.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:04.775 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 9a:fb:e9:9e:6b:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.798 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::98fb:e9ff:fe9e:6b03/64 scope link 2024-04-26T21:59:04.799 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:04.800 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T21:59:04.863 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:59:04.863 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 9a:fb:e9:9e:6b:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::98fb:e9ff:fe9e:6b03/64 scope link 2024-04-26T21:59:04.864 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:04.865 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-26T21:59:04.865 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:04.866 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T21:59:04.866 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-26T21:59:04.866 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T21:59:04.866 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-26T21:59:04.866 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-26T21:59:04.866 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-26T21:59:04.866 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T21:59:04.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:05.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:05.012 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:05.012 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-04-26T21:59:05.012 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.1 up 2024-04-26T21:59:05.012 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T21:59:05.012 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-04-26T21:59:05.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:05.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:05.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:59:05.091 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-26T21:59:05.105 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-26T21:59:05.106 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:59:05.106 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-26T21:59:05.159 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-04-26T21:59:05.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:05.160 DEBUG:teuthology.orchestra.run.smithi170:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:05.240 INFO:teuthology.orchestra.run.smithi170.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:05.241 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:59:05.248 INFO:teuthology.orchestra.run.smithi170.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:05.248 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:59:05.248 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T21:59:05.248 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: trying mount with new device syntax: 3@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T21:59:05.248 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T21:59:05.248 INFO:teuthology.orchestra.run.smithi170.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-26T21:59:05.248 INFO:teuthology.orchestra.run.smithi170.stdout: You just mounted a file system that supports labels which does not 2024-04-26T21:59:05.249 INFO:teuthology.orchestra.run.smithi170.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T21:59:05.249 INFO:teuthology.orchestra.run.smithi170.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T21:59:05.249 INFO:teuthology.orchestra.run.smithi170.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T21:59:05.250 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T21:59:05.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:05.251 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-26T21:59:05.318 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:05.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:05.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:05.414 INFO:teuthology.orchestra.run.smithi170.stdout:client4728 2024-04-26T21:59:05.415 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:05.415 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:05.430 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:05.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:05.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:05.527 INFO:teuthology.orchestra.run.smithi170.stdout:client4728 2024-04-26T21:59:05.528 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:05.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:05.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:05.583 INFO:teuthology.orchestra.run.smithi170.stdout:client4728 2024-04-26T21:59:05.584 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/30fb29b0-57db-44cb-a9e0-8033deb0a091.client4728/status') 2024-04-26T21:59:05.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:05.640 INFO:teuthology.orchestra.run.smithi170.stdout:instance: client.4728 (3)172.21.15.170:0/4151833744 2024-04-26T21:59:05.640 INFO:teuthology.orchestra.run.smithi170.stdout:blocklisted: false 2024-04-26T21:59:05.640 INFO:teuthology.orchestra.run.smithi170.stderr:0+1 records in 2024-04-26T21:59:05.641 INFO:teuthology.orchestra.run.smithi170.stderr:0+1 records out 2024-04-26T21:59:05.641 INFO:teuthology.orchestra.run.smithi170.stderr:71 bytes copied, 2.1552e-05 s, 3.3 MB/s 2024-04-26T21:59:05.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-26T21:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:05.648 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-26T21:59:05.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:05.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.776+0000 7f3d28d67640 1 Processor -- start 2024-04-26T21:59:05.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.776+0000 7f3d28d67640 1 -- start start 2024-04-26T21:59:05.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.777+0000 7f3d28d67640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240d3ee0 0x7f3d240cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:05.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.777+0000 7f3d28d67640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d240d03a0 con 0x7f3d2415f370 2024-04-26T21:59:05.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.777+0000 7f3d28d67640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d240d0680 con 0x7f3d2415f750 2024-04-26T21:59:05.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.777+0000 7f3d28d67640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3d240d0960 con 0x7f3d240d3ee0 2024-04-26T21:59:05.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2259c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3d2415f370 0x7f3d240d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48390/0 (socket says 172.21.15.137:48390) 2024-04-26T21:59:05.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2259c640 1 -- 172.21.15.137:0/1991496139 learned_addr learned my addr 172.21.15.137:0/1991496139 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:05.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707298834 0 0) 0x7f3d240d03a0 con 0x7f3d2415f370 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d21d9b640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240d3ee0 0x7f3d240cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d0c003520 con 0x7f3d2415f370 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2778663950 0 0) 0x7f3d0c003520 con 0x7f3d2415f370 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240d3ee0 msgr2=0x7f3d240cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240d3ee0 0x7f3d240cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 >> v1:172.21.15.170:6789/0 conn(0x7f3d2415f750 legacy=0x7f3d240b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d240d0c40 con 0x7f3d2415f370 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f3d140019f0 con 0x7f3d2415f370 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 >> v1:172.21.15.137:6789/0 conn(0x7f3d2415f370 legacy=0x7f3d240d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240d3ee0 0x7f3d0c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 0x7f3d0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0c004d40 0x7f3d0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240d0960 con 0x7f3d0c004d40 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c00baa0 con 0x7f3d0c003f60 2024-04-26T21:59:05.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0c00bca0 con 0x7f3d240d3ee0 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d21d9b640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 0x7f3d0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d22d9d640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0c004d40 0x7f3d0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.778+0000 7f3d2259c640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240d3ee0 0x7f3d0c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.779+0000 7f3d21d9b640 1 -- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240d3ee0 msgr2=0x7f3d0c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.779+0000 7f3d21d9b640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240d3ee0 0x7f3d0c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.779+0000 7f3d21d9b640 1 -- 172.21.15.137:0/1991496139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0c004d40 msgr2=0x7f3d0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.779+0000 7f3d21d9b640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0c004d40 0x7f3d0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.779+0000 7f3d21d9b640 1 -- 172.21.15.137:0/1991496139 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0c003520 con 0x7f3d0c003f60 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.779+0000 7f3d22d9d640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d0c004d40 0x7f3d0c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.779+0000 7f3d21d9b640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 0x7f3d0c004800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009ac0 tx=0x7f3d0c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9479a7c72c07b85d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18036070 con 0x7f3d0c003f60 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d18031400 con 0x7f3d0c003f60 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d2159a640 1 -- 172.21.15.137:0/1991496139 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18009690 con 0x7f3d0c003f60 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d28d67640 1 -- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 msgr2=0x7f3d0c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:05.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d28d67640 1 --2- 172.21.15.137:0/1991496139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 0x7f3d0c004800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d18009ac0 tx=0x7f3d0c005830 comp rx=0 tx=0).stop 2024-04-26T21:59:05.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d22d9d640 1 -- 172.21.15.137:0/1991496139 reap_dead start 2024-04-26T21:59:05.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d28d67640 1 -- 172.21.15.137:0/1991496139 shutdown_connections 2024-04-26T21:59:05.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d28d67640 1 -- 172.21.15.137:0/1991496139 >> 172.21.15.137:0/1991496139 conn(0x7f3d2408ec10 msgr2=0x7f3d2409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:05.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d28d67640 1 -- 172.21.15.137:0/1991496139 shutdown_connections 2024-04-26T21:59:05.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.780+0000 7f3d28d67640 1 -- 172.21.15.137:0/1991496139 wait complete. 2024-04-26T21:59:05.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d28d67640 1 Processor -- start 2024-04-26T21:59:05.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d28d67640 1 -- start start 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d28d67640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 0x7f3d240c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d28d67640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d240ba560 0x7f3d240caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d28d67640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240cd310 0x7f3d240cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d28d67640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240cfef0 con 0x7f3d240ba560 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d28d67640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3d240cfd70 con 0x7f3d0c003f60 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d28d67640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3d240d0070 con 0x7f3d240cd310 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d21d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d240ba560 0x7f3d240caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d21d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d240ba560 0x7f3d240caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49766/0 (socket says 172.21.15.137:49766) 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d2259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 0x7f3d240c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d21d9b640 1 -- 172.21.15.137:0/2583866196 learned_addr learned my addr 172.21.15.137:0/2583866196 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.782+0000 7f3d22d9d640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240cd310 0x7f3d240cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d21d9b640 1 -- 172.21.15.137:0/2583866196 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240cd310 msgr2=0x7f3d240cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d21d9b640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240cd310 0x7f3d240cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d21d9b640 1 -- 172.21.15.137:0/2583866196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 msgr2=0x7f3d240c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:05.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d21d9b640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 0x7f3d240c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d21d9b640 1 -- 172.21.15.137:0/2583866196 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d240ce3c0 con 0x7f3d240ba560 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d2259c640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 0x7f3d240c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d21d9b640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d240ba560 0x7f3d240caa20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3d18034040 tx=0x7f3d18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d12ffd640 1 -- 172.21.15.137:0/2583866196 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18040020 con 0x7f3d240ba560 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d12ffd640 1 -- 172.21.15.137:0/2583866196 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d18003c60 con 0x7f3d240ba560 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d240cec20 con 0x7f3d240ba560 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d12ffd640 1 -- 172.21.15.137:0/2583866196 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18036040 con 0x7f3d240ba560 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.783+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d240ce940 con 0x7f3d240ba560 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.784+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d2406a290 con 0x7f3d240ba560 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.785+0000 7f3d12ffd640 1 -- 172.21.15.137:0/2583866196 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d18043020 con 0x7f3d240ba560 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.785+0000 7f3d12ffd640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d0406c920 0x7f3d0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.785+0000 7f3d12ffd640 1 -- 172.21.15.137:0/2583866196 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3d180abbe0 con 0x7f3d240ba560 2024-04-26T21:59:05.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.785+0000 7f3d2259c640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d0406c920 0x7f3d0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:05.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.785+0000 7f3d2259c640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d0406c920 0x7f3d0406ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d14001b60 tx=0x7f3d14006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:05.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.790+0000 7f3d12ffd640 1 -- 172.21.15.137:0/2583866196 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3d1804a070 con 0x7f3d240ba560 2024-04-26T21:59:05.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.972+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d240b7f20 con 0x7f3d240ba560 2024-04-26T21:59:05.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.973+0000 7f3d12ffd640 1 -- 172.21.15.137:0/2583866196 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f3d180044e0 con 0x7f3d240ba560 2024-04-26T21:59:05.973 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:05.974 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:05.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.975+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d0406c920 msgr2=0x7f3d0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:05.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.975+0000 7f3d28d67640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d0406c920 0x7f3d0406ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d14001b60 tx=0x7f3d14006040 comp rx=0 tx=0).stop 2024-04-26T21:59:05.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.975+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d240ba560 msgr2=0x7f3d240caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:05.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.975+0000 7f3d28d67640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d240ba560 0x7f3d240caa20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3d18034040 tx=0x7f3d18004730 comp rx=0 tx=0).stop 2024-04-26T21:59:05.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.976+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 shutdown_connections 2024-04-26T21:59:05.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.976+0000 7f3d28d67640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d0406c920 0x7f3d0406ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:05.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.976+0000 7f3d28d67640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d240ba560 0x7f3d240caa20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:05.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.976+0000 7f3d28d67640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d240cd310 0x7f3d240cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:05.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.976+0000 7f3d28d67640 1 --2- 172.21.15.137:0/2583866196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d0c003f60 0x7f3d240c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:05.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.976+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 >> 172.21.15.137:0/2583866196 conn(0x7f3d2408ec10 msgr2=0x7f3d240d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:05.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.976+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 shutdown_connections 2024-04-26T21:59:05.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:05.976+0000 7f3d28d67640 1 -- 172.21.15.137:0/2583866196 wait complete. 2024-04-26T21:59:05.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:05.988 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:06.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.088+0000 7f69a237f640 1 Processor -- start 2024-04-26T21:59:06.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.088+0000 7f69a237f640 1 -- start start 2024-04-26T21:59:06.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.089+0000 7f69a237f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 0x7f699c06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.089+0000 7f69a237f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f699c06c9b0 0x7f699c0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.089+0000 7f69a237f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f699c070b30 con 0x7f699c0706a0 2024-04-26T21:59:06.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.089+0000 7f69a237f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f699c0af610 con 0x7f699c06c9b0 2024-04-26T21:59:06.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.089+0000 7f69a237f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f699c0700b0 con 0x7f699c15f2b0 2024-04-26T21:59:06.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.089+0000 7f69a091c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f699c06c9b0 0x7f699c0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.089+0000 7f699b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f699c0706a0 0x7f699c06c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48396/0 (socket says 172.21.15.137:48396) 2024-04-26T21:59:06.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.089+0000 7f699b7fe640 1 -- 172.21.15.137:0/3429353319 learned_addr learned my addr 172.21.15.137:0/3429353319 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:06.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.090+0000 7f699bfff640 1 --2- 172.21.15.137:0/3429353319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 0x7f699c06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.090+0000 7f69a091c640 1 -- 172.21.15.137:0/3429353319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 msgr2=0x7f699c06fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:06.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.090+0000 7f69a091c640 1 --2- 172.21.15.137:0/3429353319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 0x7f699c06fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.090+0000 7f69a091c640 1 -- 172.21.15.137:0/3429353319 >> v1:172.21.15.137:6789/0 conn(0x7f699c0706a0 legacy=0x7f699c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.090+0000 7f699affd640 1 -- 172.21.15.137:0/3429353319 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263811178 0 0) 0x7f699c070b30 con 0x7f699c0706a0 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.090+0000 7f69a091c640 1 -- 172.21.15.137:0/3429353319 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c070e10 con 0x7f699c06c9b0 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.090+0000 7f699bfff640 1 --2- 172.21.15.137:0/3429353319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 0x7f699c06fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.090+0000 7f69a091c640 1 --2- 172.21.15.137:0/3429353319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c06c9b0 0x7f699c0afa80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6994009d90 tx=0x7f699402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e612cedf214fa798 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.090+0000 7f699affd640 1 -- 172.21.15.137:0/3429353319 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994007740 con 0x7f699c06c9b0 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f699affd640 1 -- 172.21.15.137:0/3429353319 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69940078e0 con 0x7f699c06c9b0 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f699affd640 1 -- 172.21.15.137:0/3429353319 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994007cb0 con 0x7f699c06c9b0 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f69a237f640 1 -- 172.21.15.137:0/3429353319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c06c9b0 msgr2=0x7f699c0afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f69a237f640 1 --2- 172.21.15.137:0/3429353319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c06c9b0 0x7f699c0afa80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6994009d90 tx=0x7f699402a660 comp rx=0 tx=0).stop 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f69a237f640 1 -- 172.21.15.137:0/3429353319 shutdown_connections 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f69a237f640 1 --2- 172.21.15.137:0/3429353319 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c06c9b0 0x7f699c0afa80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f69a237f640 1 --2- 172.21.15.137:0/3429353319 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 0x7f699c06fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f69a237f640 1 -- 172.21.15.137:0/3429353319 >> 172.21.15.137:0/3429353319 conn(0x7f699c06f050 msgr2=0x7f699c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:06.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f69a237f640 1 -- 172.21.15.137:0/3429353319 shutdown_connections 2024-04-26T21:59:06.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.091+0000 7f69a237f640 1 -- 172.21.15.137:0/3429353319 wait complete. 2024-04-26T21:59:06.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.092+0000 7f69a237f640 1 Processor -- start 2024-04-26T21:59:06.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.092+0000 7f69a237f640 1 -- start start 2024-04-26T21:59:06.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f69a237f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f699c06c9b0 0x7f699c1f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f69a237f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 0x7f699c073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f69a237f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c073640 0x7f699c161810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f69a237f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f699c0b4f40 con 0x7f699c073640 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f69a237f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f699c0713d0 con 0x7f699c06c9b0 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f69a237f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f699c0b1890 con 0x7f699c15f2b0 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f69a091c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c073640 0x7f699c161810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f69a091c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c073640 0x7f699c161810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49786/0 (socket says 172.21.15.137:49786) 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f69a091c640 1 -- 172.21.15.137:0/503293528 learned_addr learned my addr 172.21.15.137:0/503293528 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f699bfff640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f699c06c9b0 0x7f699c1f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.093+0000 7f699b7fe640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 0x7f699c073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f69a091c640 1 -- 172.21.15.137:0/503293528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 msgr2=0x7f699c073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f69a091c640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 0x7f699c073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f69a091c640 1 -- 172.21.15.137:0/503293528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f699c06c9b0 msgr2=0x7f699c1f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f69a091c640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f699c06c9b0 0x7f699c1f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f69a091c640 1 -- 172.21.15.137:0/503293528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c1f4980 con 0x7f699c073640 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f69a091c640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c073640 0x7f699c161810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f699402ac50 tx=0x7f6994004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f6998ff9640 1 -- 172.21.15.137:0/503293528 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994040070 con 0x7f699c073640 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f6998ff9640 1 -- 172.21.15.137:0/503293528 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6994031c90 con 0x7f699c073640 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f6998ff9640 1 -- 172.21.15.137:0/503293528 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6994045680 con 0x7f699c073640 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699c162480 con 0x7f699c073640 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.094+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699c159f30 con 0x7f699c073640 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.095+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f699c06a290 con 0x7f699c073640 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.095+0000 7f6998ff9640 1 -- 172.21.15.137:0/503293528 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6994039040 con 0x7f699c073640 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.096+0000 7f6998ff9640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f698806c8f0 0x7f698806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.096+0000 7f6998ff9640 1 -- 172.21.15.137:0/503293528 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f69940ad410 con 0x7f699c073640 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.096+0000 7f699bfff640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f698806c8f0 0x7f698806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.096+0000 7f699bfff640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f698806c8f0 0x7f698806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f698c00aac0 tx=0x7f698c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.100+0000 7f6998ff9640 1 -- 172.21.15.137:0/503293528 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f699407b2b0 con 0x7f699c073640 2024-04-26T21:59:06.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.274+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f699c06fe10 con 0x7f699c073640 2024-04-26T21:59:06.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.274+0000 7f6998ff9640 1 -- 172.21.15.137:0/503293528 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f699407f5b0 con 0x7f699c073640 2024-04-26T21:59:06.274 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:06.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f698806c8f0 msgr2=0x7f698806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f698806c8f0 0x7f698806edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f698c00aac0 tx=0x7f698c008040 comp rx=0 tx=0).stop 2024-04-26T21:59:06.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c073640 msgr2=0x7f699c161810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c073640 0x7f699c161810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f699402ac50 tx=0x7f6994004a40 comp rx=0 tx=0).stop 2024-04-26T21:59:06.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 shutdown_connections 2024-04-26T21:59:06.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f698806c8f0 0x7f698806edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f699c073640 0x7f699c161810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f699c15f2b0 0x7f699c073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 --2- 172.21.15.137:0/503293528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f699c06c9b0 0x7f699c1f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 >> 172.21.15.137:0/503293528 conn(0x7f699c06f050 msgr2=0x7f699c0b68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:06.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 shutdown_connections 2024-04-26T21:59:06.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.276+0000 7f69a237f640 1 -- 172.21.15.137:0/503293528 wait complete. 2024-04-26T21:59:06.287 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:06.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.387+0000 7fcd8da85640 1 Processor -- start 2024-04-26T21:59:06.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.387+0000 7fcd8da85640 1 -- start start 2024-04-26T21:59:06.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd8da85640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd8815f490 0x7fcd880d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd8da85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd880d0ff0 0x7fcd880d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd8da85640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcd880d2120 0x7fcd880ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd8da85640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcd880d2570 con 0x7fcd8815f490 2024-04-26T21:59:06.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd8da85640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcd880d4240 con 0x7fcd880d2120 2024-04-26T21:59:06.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd8da85640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcd880d31a0 con 0x7fcd880d0ff0 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd877fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd8815f490 0x7fcd880d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd877fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcd8815f490 0x7fcd880d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49802/0 (socket says 172.21.15.137:49802) 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd877fe640 1 -- 172.21.15.137:0/820451296 learned_addr learned my addr 172.21.15.137:0/820451296 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd86ffd640 1 --2- 172.21.15.137:0/820451296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd880d0ff0 0x7fcd880d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd877fe640 1 -- 172.21.15.137:0/820451296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd880d0ff0 msgr2=0x7fcd880d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd877fe640 1 --2- 172.21.15.137:0/820451296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd880d0ff0 0x7fcd880d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd87fff640 1 --2- 172.21.15.137:0/820451296 >> v2:172.21.15.170:3300/0 conn(0x7fcd880d2120 0x7fcd880ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd877fe640 1 -- 172.21.15.137:0/820451296 >> v2:172.21.15.170:3300/0 conn(0x7fcd880d2120 msgr2=0x7fcd880ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd877fe640 1 --2- 172.21.15.137:0/820451296 >> v2:172.21.15.170:3300/0 conn(0x7fcd880d2120 0x7fcd880ba3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd877fe640 1 -- 172.21.15.137:0/820451296 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880d3480 con 0x7fcd8815f490 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd86ffd640 1 --2- 172.21.15.137:0/820451296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd880d0ff0 0x7fcd880d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.388+0000 7fcd87fff640 1 --2- 172.21.15.137:0/820451296 >> v2:172.21.15.170:3300/0 conn(0x7fcd880d2120 0x7fcd880ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.389+0000 7fcd877fe640 1 --2- 172.21.15.137:0/820451296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd8815f490 0x7fcd880d0ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcd8808d6f0 tx=0x7fcd7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c125dfa838a9f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.389+0000 7fcd867fc640 1 -- 172.21.15.137:0/820451296 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78037070 con 0x7fcd8815f490 2024-04-26T21:59:06.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.389+0000 7fcd867fc640 1 -- 172.21.15.137:0/820451296 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd78032440 con 0x7fcd8815f490 2024-04-26T21:59:06.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.389+0000 7fcd867fc640 1 -- 172.21.15.137:0/820451296 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78032810 con 0x7fcd8815f490 2024-04-26T21:59:06.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.390+0000 7fcd8da85640 1 -- 172.21.15.137:0/820451296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd8815f490 msgr2=0x7fcd880d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.390+0000 7fcd8da85640 1 --2- 172.21.15.137:0/820451296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd8815f490 0x7fcd880d0ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcd8808d6f0 tx=0x7fcd7802a1e0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.390+0000 7fcd8da85640 1 -- 172.21.15.137:0/820451296 shutdown_connections 2024-04-26T21:59:06.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.390+0000 7fcd8da85640 1 --2- 172.21.15.137:0/820451296 >> v2:172.21.15.170:3300/0 conn(0x7fcd880d2120 0x7fcd880ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.390+0000 7fcd8da85640 1 --2- 172.21.15.137:0/820451296 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd880d0ff0 0x7fcd880d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.390+0000 7fcd8da85640 1 --2- 172.21.15.137:0/820451296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd8815f490 0x7fcd880d0ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.390+0000 7fcd8da85640 1 -- 172.21.15.137:0/820451296 >> 172.21.15.137:0/820451296 conn(0x7fcd8809e530 msgr2=0x7fcd880d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:06.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.390+0000 7fcd8da85640 1 -- 172.21.15.137:0/820451296 shutdown_connections 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.390+0000 7fcd8da85640 1 -- 172.21.15.137:0/820451296 wait complete. 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.391+0000 7fcd8da85640 1 Processor -- start 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.391+0000 7fcd8da85640 1 -- start start 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd8da85640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd880d0ff0 0x7fcd880cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd8da85640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd880d2120 0x7fcd880c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd8da85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd8815f490 0x7fcd880cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd8da85640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880d3d20 con 0x7fcd880d0ff0 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd8da85640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880d3a40 con 0x7fcd880d2120 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd8da85640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8815f870 con 0x7fcd8815f490 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd877fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd880d0ff0 0x7fcd880cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd877fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd880d0ff0 0x7fcd880cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49814/0 (socket says 172.21.15.137:49814) 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd877fe640 1 -- 172.21.15.137:0/2895241615 learned_addr learned my addr 172.21.15.137:0/2895241615 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd877fe640 1 -- 172.21.15.137:0/2895241615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd8815f490 msgr2=0x7fcd880cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd877fe640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd8815f490 0x7fcd880cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd877fe640 1 -- 172.21.15.137:0/2895241615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd880d2120 msgr2=0x7fcd880c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd877fe640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd880d2120 0x7fcd880c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd877fe640 1 -- 172.21.15.137:0/2895241615 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd88161ae0 con 0x7fcd880d0ff0 2024-04-26T21:59:06.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.392+0000 7fcd877fe640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd880d0ff0 0x7fcd880cf170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcd7802a220 tx=0x7fcd780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.393+0000 7fcd6ffff640 1 -- 172.21.15.137:0/2895241615 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78037040 con 0x7fcd880d0ff0 2024-04-26T21:59:06.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.393+0000 7fcd6ffff640 1 -- 172.21.15.137:0/2895241615 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd78042070 con 0x7fcd880d0ff0 2024-04-26T21:59:06.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.393+0000 7fcd6ffff640 1 -- 172.21.15.137:0/2895241615 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78030bb0 con 0x7fcd880d0ff0 2024-04-26T21:59:06.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.393+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd88161dc0 con 0x7fcd880d0ff0 2024-04-26T21:59:06.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.393+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd88162380 con 0x7fcd880d0ff0 2024-04-26T21:59:06.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.394+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd8806a290 con 0x7fcd880d0ff0 2024-04-26T21:59:06.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.394+0000 7fcd6ffff640 1 -- 172.21.15.137:0/2895241615 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd78047460 con 0x7fcd880d0ff0 2024-04-26T21:59:06.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.394+0000 7fcd6ffff640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcd7406c8f0 0x7fcd7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.395+0000 7fcd6ffff640 1 -- 172.21.15.137:0/2895241615 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcd780ac790 con 0x7fcd880d0ff0 2024-04-26T21:59:06.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.395+0000 7fcd86ffd640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcd7406c8f0 0x7fcd7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.395+0000 7fcd86ffd640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcd7406c8f0 0x7fcd7406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c006fd0 tx=0x7fcd7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.399+0000 7fcd6ffff640 1 -- 172.21.15.137:0/2895241615 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcd78045360 con 0x7fcd880d0ff0 2024-04-26T21:59:06.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.575+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcd880d5900 con 0x7fcd880d0ff0 2024-04-26T21:59:06.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.575+0000 7fcd6ffff640 1 -- 172.21.15.137:0/2895241615 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fcd7807abd0 con 0x7fcd880d0ff0 2024-04-26T21:59:06.576 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcd7406c8f0 msgr2=0x7fcd7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcd7406c8f0 0x7fcd7406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c006fd0 tx=0x7fcd7c008040 comp rx=0 tx=0).stop 2024-04-26T21:59:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd880d0ff0 msgr2=0x7fcd880cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd880d0ff0 0x7fcd880cf170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcd7802a220 tx=0x7fcd780046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 shutdown_connections 2024-04-26T21:59:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcd7406c8f0 0x7fcd7406edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcd8815f490 0x7fcd880cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd880d2120 0x7fcd880c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 --2- 172.21.15.137:0/2895241615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcd880d0ff0 0x7fcd880cf170 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.577+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 >> 172.21.15.137:0/2895241615 conn(0x7fcd8809e530 msgr2=0x7fcd880cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:06.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.578+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 shutdown_connections 2024-04-26T21:59:06.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.578+0000 7fcd8da85640 1 -- 172.21.15.137:0/2895241615 wait complete. 2024-04-26T21:59:06.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.689+0000 7f35fd36a640 1 Processor -- start 2024-04-26T21:59:06.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.689+0000 7f35fd36a640 1 -- start start 2024-04-26T21:59:06.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.689+0000 7f35fd36a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f35f815f680 0x7f35f80d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35fd36a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35f80d4f20 0x7f35f80d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35fd36a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f80d58f0 con 0x7f35f8163aa0 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35fd36a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f35f815fa60 con 0x7f35f815f680 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35fd36a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f35f80d3f50 con 0x7f35f80d4f20 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35f6ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f35f815f680 0x7f35f80d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35effff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f35f8163aa0 0x7f35f80b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48412/0 (socket says 172.21.15.137:48412) 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35effff640 1 -- 172.21.15.137:0/1598595121 learned_addr learned my addr 172.21.15.137:0/1598595121 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35f77fe640 1 --2- 172.21.15.137:0/1598595121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35f80d4f20 0x7f35f80d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35f6ffd640 1 -- 172.21.15.137:0/1598595121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35f80d4f20 msgr2=0x7f35f80d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35f6ffd640 1 --2- 172.21.15.137:0/1598595121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35f80d4f20 0x7f35f80d53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35f6ffd640 1 -- 172.21.15.137:0/1598595121 >> v1:172.21.15.137:6789/0 conn(0x7f35f8163aa0 legacy=0x7f35f80b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35f67fc640 1 -- 172.21.15.137:0/1598595121 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076883988 0 0) 0x7f35f80d58f0 con 0x7f35f8163aa0 2024-04-26T21:59:06.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.690+0000 7f35f6ffd640 1 -- 172.21.15.137:0/1598595121 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f80b5090 con 0x7f35f815f680 2024-04-26T21:59:06.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35f6ffd640 1 --2- 172.21.15.137:0/1598595121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f815f680 0x7f35f80d3820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35e80097a0 tx=0x7f35e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10198439b63e47a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35f67fc640 1 -- 172.21.15.137:0/1598595121 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8037070 con 0x7f35f815f680 2024-04-26T21:59:06.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35f67fc640 1 -- 172.21.15.137:0/1598595121 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e8032440 con 0x7f35f815f680 2024-04-26T21:59:06.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35f67fc640 1 -- 172.21.15.137:0/1598595121 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8032810 con 0x7f35f815f680 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35fd36a640 1 -- 172.21.15.137:0/1598595121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f815f680 msgr2=0x7f35f80d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35fd36a640 1 --2- 172.21.15.137:0/1598595121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f815f680 0x7f35f80d3820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f35e80097a0 tx=0x7f35e802a180 comp rx=0 tx=0).stop 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35fd36a640 1 -- 172.21.15.137:0/1598595121 shutdown_connections 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35fd36a640 1 --2- 172.21.15.137:0/1598595121 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35f80d4f20 0x7f35f80d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35fd36a640 1 --2- 172.21.15.137:0/1598595121 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f815f680 0x7f35f80d3820 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.691+0000 7f35fd36a640 1 -- 172.21.15.137:0/1598595121 >> 172.21.15.137:0/1598595121 conn(0x7f35f808eca0 msgr2=0x7f35f809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.692+0000 7f35fd36a640 1 -- 172.21.15.137:0/1598595121 shutdown_connections 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.692+0000 7f35fd36a640 1 -- 172.21.15.137:0/1598595121 wait complete. 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.693+0000 7f35fd36a640 1 Processor -- start 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.693+0000 7f35fd36a640 1 -- start start 2024-04-26T21:59:06.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.693+0000 7f35fd36a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f80d4f20 0x7f35f8161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.693+0000 7f35fd36a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35f815f680 0x7f35f8162540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.693+0000 7f35fd36a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35f8163aa0 0x7f35f81525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.693+0000 7f35fd36a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f35f8163f30 con 0x7f35f80d4f20 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.693+0000 7f35fd36a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f35f80b6280 con 0x7f35f815f680 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.693+0000 7f35fd36a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f35f80cfd80 con 0x7f35f8163aa0 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.693+0000 7f35f6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f80d4f20 0x7f35f8161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35f6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f80d4f20 0x7f35f8161170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49838/0 (socket says 172.21.15.137:49838) 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35f6ffd640 1 -- 172.21.15.137:0/2043121285 learned_addr learned my addr 172.21.15.137:0/2043121285 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35f6ffd640 1 -- 172.21.15.137:0/2043121285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35f8163aa0 msgr2=0x7f35f81525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35f6ffd640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35f8163aa0 0x7f35f81525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35f6ffd640 1 -- 172.21.15.137:0/2043121285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35f815f680 msgr2=0x7f35f8162540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35f6ffd640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35f815f680 0x7f35f8162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35f6ffd640 1 -- 172.21.15.137:0/2043121285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f80cd9e0 con 0x7f35f80d4f20 2024-04-26T21:59:06.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35f6ffd640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f80d4f20 0x7f35f8161170 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f35e8035040 tx=0x7f35e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35ef7fe640 1 -- 172.21.15.137:0/2043121285 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8037040 con 0x7f35f80d4f20 2024-04-26T21:59:06.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35ef7fe640 1 -- 172.21.15.137:0/2043121285 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35e8030770 con 0x7f35f80d4f20 2024-04-26T21:59:06.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f80cdcc0 con 0x7f35f80d4f20 2024-04-26T21:59:06.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35ef7fe640 1 -- 172.21.15.137:0/2043121285 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8030b80 con 0x7f35f80d4f20 2024-04-26T21:59:06.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.694+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f8160970 con 0x7f35f80d4f20 2024-04-26T21:59:06.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.695+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f806a290 con 0x7f35f80d4f20 2024-04-26T21:59:06.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.695+0000 7f35ef7fe640 1 -- 172.21.15.137:0/2043121285 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35e8044020 con 0x7f35f80d4f20 2024-04-26T21:59:06.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.696+0000 7f35ef7fe640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f35d806c920 0x7f35d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.696+0000 7f35ef7fe640 1 -- 172.21.15.137:0/2043121285 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f35e80ac020 con 0x7f35f80d4f20 2024-04-26T21:59:06.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.696+0000 7f35effff640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f35d806c920 0x7f35d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.696+0000 7f35effff640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f35d806c920 0x7f35d806ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35e0007fd0 tx=0x7f35e0007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.700+0000 7f35ef7fe640 1 -- 172.21.15.137:0/2043121285 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f35e8032e20 con 0x7f35f80d4f20 2024-04-26T21:59:06.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.874+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f35f80b4cd0 con 0x7f35f80d4f20 2024-04-26T21:59:06.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.874+0000 7f35ef7fe640 1 -- 172.21.15.137:0/2043121285 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f35e807a450 con 0x7f35f80d4f20 2024-04-26T21:59:06.874 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:06.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f35d806c920 msgr2=0x7f35d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f35d806c920 0x7f35d806ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35e0007fd0 tx=0x7f35e0007960 comp rx=0 tx=0).stop 2024-04-26T21:59:06.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f80d4f20 msgr2=0x7f35f8161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f80d4f20 0x7f35f8161170 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f35e8035040 tx=0x7f35e80046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 shutdown_connections 2024-04-26T21:59:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f35d806c920 0x7f35d806ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35f8163aa0 0x7f35f81525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35f815f680 0x7f35f8162540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 --2- 172.21.15.137:0/2043121285 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35f80d4f20 0x7f35f8161170 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 >> 172.21.15.137:0/2043121285 conn(0x7f35f808eca0 msgr2=0x7f35f80d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 shutdown_connections 2024-04-26T21:59:06.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.876+0000 7f35fd36a640 1 -- 172.21.15.137:0/2043121285 wait complete. 2024-04-26T21:59:06.887 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:06.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.985+0000 7f05c17af640 1 Processor -- start 2024-04-26T21:59:06.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.985+0000 7f05c17af640 1 -- start start 2024-04-26T21:59:06.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05c17af640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f05bc15f370 0x7f05bc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05c17af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc15f750 0x7f05bc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05c17af640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc0d03a0 con 0x7f05bc0d37d0 2024-04-26T21:59:06.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05c17af640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f05bc0b4d10 con 0x7f05bc15f370 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05c17af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f05bc0d0680 con 0x7f05bc15f750 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05ba7fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc15f750 0x7f05bc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05baffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f05bc15f370 0x7f05bc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05ba7fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc15f750 0x7f05bc0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:59292/0 (socket says 172.21.15.137:59292) 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05ba7fc640 1 -- 172.21.15.137:0/1963423119 learned_addr learned my addr 172.21.15.137:0/1963423119 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05b9ffb640 1 -- 172.21.15.137:0/1963423119 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451961652 0 0) 0x7f05bc0d03a0 con 0x7f05bc0d37d0 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.986+0000 7f05b9ffb640 1 -- 172.21.15.137:0/1963423119 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a4003520 con 0x7f05bc0d37d0 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.987+0000 7f05ba7fc640 1 -- 172.21.15.137:0/1963423119 >> v2:172.21.15.170:3300/0 conn(0x7f05bc15f370 msgr2=0x7f05bc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.987+0000 7f05ba7fc640 1 --2- 172.21.15.137:0/1963423119 >> v2:172.21.15.170:3300/0 conn(0x7f05bc15f370 0x7f05bc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.987+0000 7f05ba7fc640 1 -- 172.21.15.137:0/1963423119 >> v1:172.21.15.170:6789/0 conn(0x7f05bc0d37d0 legacy=0x7f05bc0d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.987+0000 7f05ba7fc640 1 -- 172.21.15.137:0/1963423119 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc0d0960 con 0x7f05bc15f750 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.987+0000 7f05baffd640 1 --2- 172.21.15.137:0/1963423119 >> v2:172.21.15.170:3300/0 conn(0x7f05bc15f370 0x7f05bc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.987+0000 7f05ba7fc640 1 --2- 172.21.15.137:0/1963423119 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc15f750 0x7f05bc0b47d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009870 tx=0x7f05b002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8aa36f39b55db35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.987+0000 7f05b9ffb640 1 -- 172.21.15.137:0/1963423119 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0037070 con 0x7f05bc15f750 2024-04-26T21:59:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05b9ffb640 1 -- 172.21.15.137:0/1963423119 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0032440 con 0x7f05bc15f750 2024-04-26T21:59:06.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05b9ffb640 1 -- 172.21.15.137:0/1963423119 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b00327f0 con 0x7f05bc15f750 2024-04-26T21:59:06.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05c17af640 1 -- 172.21.15.137:0/1963423119 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc15f750 msgr2=0x7f05bc0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05c17af640 1 --2- 172.21.15.137:0/1963423119 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc15f750 0x7f05bc0b47d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009870 tx=0x7f05b002a1c0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05c17af640 1 -- 172.21.15.137:0/1963423119 shutdown_connections 2024-04-26T21:59:06.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05c17af640 1 --2- 172.21.15.137:0/1963423119 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc15f750 0x7f05bc0b47d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05c17af640 1 --2- 172.21.15.137:0/1963423119 >> v2:172.21.15.170:3300/0 conn(0x7f05bc15f370 0x7f05bc0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05c17af640 1 -- 172.21.15.137:0/1963423119 >> 172.21.15.137:0/1963423119 conn(0x7f05bc08ec10 msgr2=0x7f05bc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:06.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05c17af640 1 -- 172.21.15.137:0/1963423119 shutdown_connections 2024-04-26T21:59:06.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.988+0000 7f05c17af640 1 -- 172.21.15.137:0/1963423119 wait complete. 2024-04-26T21:59:06.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.989+0000 7f05c17af640 1 Processor -- start 2024-04-26T21:59:06.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.989+0000 7f05c17af640 1 -- start start 2024-04-26T21:59:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05c17af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc0d37d0 0x7f05bc15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05c17af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05bc15f370 0x7f05bc1e5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05c17af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05bc15f750 0x7f05bc1e6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05c17af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc0b51c0 con 0x7f05bc15f370 2024-04-26T21:59:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05c17af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc0d0f20 con 0x7f05bc15f750 2024-04-26T21:59:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05c17af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f05bc0b5340 con 0x7f05bc0d37d0 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05ba7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05bc15f370 0x7f05bc1e5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05ba7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05bc15f370 0x7f05bc1e5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49846/0 (socket says 172.21.15.137:49846) 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05ba7fc640 1 -- 172.21.15.137:0/3991522619 learned_addr learned my addr 172.21.15.137:0/3991522619 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05baffd640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc0d37d0 0x7f05bc15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.990+0000 7f05bb7fe640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05bc15f750 0x7f05bc1e6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05ba7fc640 1 -- 172.21.15.137:0/3991522619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc0d37d0 msgr2=0x7f05bc15c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05ba7fc640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc0d37d0 0x7f05bc15c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05ba7fc640 1 -- 172.21.15.137:0/3991522619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05bc15f750 msgr2=0x7f05bc1e6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05ba7fc640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05bc15f750 0x7f05bc1e6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05ba7fc640 1 -- 172.21.15.137:0/3991522619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc0cc4d0 con 0x7f05bc15f370 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05ba7fc640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05bc15f370 0x7f05bc1e5c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f05b00090b0 tx=0x7f05b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05a37fe640 1 -- 172.21.15.137:0/3991522619 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0037040 con 0x7f05bc15f370 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05a37fe640 1 -- 172.21.15.137:0/3991522619 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b0042070 con 0x7f05bc15f370 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc0cc7b0 con 0x7f05bc15f370 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05a37fe640 1 -- 172.21.15.137:0/3991522619 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0003e40 con 0x7f05bc15f370 2024-04-26T21:59:06.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.991+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05bc0ccd70 con 0x7f05bc15f370 2024-04-26T21:59:06.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.992+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05bc1f9070 con 0x7f05bc15f370 2024-04-26T21:59:06.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.992+0000 7f05a37fe640 1 -- 172.21.15.137:0/3991522619 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05b002ad10 con 0x7f05bc15f370 2024-04-26T21:59:06.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.993+0000 7f05a37fe640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05a806c8f0 0x7f05a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:06.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.993+0000 7f05a37fe640 1 -- 172.21.15.137:0/3991522619 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f05b00ac000 con 0x7f05bc15f370 2024-04-26T21:59:06.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.993+0000 7f05baffd640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05a806c8f0 0x7f05a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:06.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.993+0000 7f05baffd640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05a806c8f0 0x7f05a806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f05bc1f8100 tx=0x7f05ac00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:06.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:06.997+0000 7f05a37fe640 1 -- 172.21.15.137:0/3991522619 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f05b0079d60 con 0x7f05bc15f370 2024-04-26T21:59:07.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.173+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05bc06a290 con 0x7f05bc15f370 2024-04-26T21:59:07.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.174+0000 7f05a37fe640 1 -- 172.21.15.137:0/3991522619 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f05b007e060 con 0x7f05bc15f370 2024-04-26T21:59:07.175 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:07.175 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.176+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05a806c8f0 msgr2=0x7f05a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.176+0000 7f05c17af640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05a806c8f0 0x7f05a806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f05bc1f8100 tx=0x7f05ac00b040 comp rx=0 tx=0).stop 2024-04-26T21:59:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.176+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05bc15f370 msgr2=0x7f05bc1e5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.176+0000 7f05c17af640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05bc15f370 0x7f05bc1e5c00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f05b00090b0 tx=0x7f05b00046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.176+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 shutdown_connections 2024-04-26T21:59:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.177+0000 7f05c17af640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05a806c8f0 0x7f05a806edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.177+0000 7f05c17af640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05bc15f370 0x7f05bc1e5c00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.177+0000 7f05c17af640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05bc15f750 0x7f05bc1e6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.177+0000 7f05c17af640 1 --2- 172.21.15.137:0/3991522619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05bc0d37d0 0x7f05bc15c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.177+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 >> 172.21.15.137:0/3991522619 conn(0x7f05bc08ec10 msgr2=0x7f05bc075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.177+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 shutdown_connections 2024-04-26T21:59:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.177+0000 7f05c17af640 1 -- 172.21.15.137:0/3991522619 wait complete. 2024-04-26T21:59:07.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:07.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:07.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.288+0000 7f73af0b0640 1 Processor -- start 2024-04-26T21:59:07.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.288+0000 7f73af0b0640 1 -- start start 2024-04-26T21:59:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73af0b0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f73a80b3c20 0x7f73a806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73af0b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b33e0 0x7f73a8163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73af0b0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a809c700 con 0x7f73a80d0010 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73af0b0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f73a80b4480 con 0x7f73a80b3c20 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73af0b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f73a806e050 con 0x7f73a80b33e0 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73a7fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f73a80b3c20 0x7f73a806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73ace4c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f73a80d0010 0x7f73a80b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48424/0 (socket says 172.21.15.137:48424) 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73ace4c640 1 -- 172.21.15.137:0/1028723817 learned_addr learned my addr 172.21.15.137:0/1028723817 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73ad64d640 1 --2- 172.21.15.137:0/1028723817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b33e0 0x7f73a8163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73a7fff640 1 -- 172.21.15.137:0/1028723817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b33e0 msgr2=0x7f73a8163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73a7fff640 1 --2- 172.21.15.137:0/1028723817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b33e0 0x7f73a8163280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73a7fff640 1 -- 172.21.15.137:0/1028723817 >> v1:172.21.15.137:6789/0 conn(0x7f73a80d0010 legacy=0x7f73a80b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73a77fe640 1 -- 172.21.15.137:0/1028723817 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195507681 0 0) 0x7f73a809c700 con 0x7f73a80d0010 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73a7fff640 1 -- 172.21.15.137:0/1028723817 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a80d1c50 con 0x7f73a80b3c20 2024-04-26T21:59:07.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.289+0000 7f73ad64d640 1 --2- 172.21.15.137:0/1028723817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b33e0 0x7f73a8163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.290+0000 7f73a7fff640 1 --2- 172.21.15.137:0/1028723817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80b3c20 0x7f73a806db10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f73940097a0 tx=0x7f739402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e47cb8d7df6ef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.290+0000 7f73a77fe640 1 -- 172.21.15.137:0/1028723817 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394037070 con 0x7f73a80b3c20 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.290+0000 7f73a77fe640 1 -- 172.21.15.137:0/1028723817 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7394032440 con 0x7f73a80b3c20 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.290+0000 7f73a77fe640 1 -- 172.21.15.137:0/1028723817 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394032810 con 0x7f73a80b3c20 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.290+0000 7f73af0b0640 1 -- 172.21.15.137:0/1028723817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80b3c20 msgr2=0x7f73a806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.291+0000 7f73af0b0640 1 --2- 172.21.15.137:0/1028723817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80b3c20 0x7f73a806db10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f73940097a0 tx=0x7f739402a180 comp rx=0 tx=0).stop 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.291+0000 7f73af0b0640 1 -- 172.21.15.137:0/1028723817 shutdown_connections 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.291+0000 7f73af0b0640 1 --2- 172.21.15.137:0/1028723817 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b33e0 0x7f73a8163280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.291+0000 7f73af0b0640 1 --2- 172.21.15.137:0/1028723817 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80b3c20 0x7f73a806db10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.291+0000 7f73af0b0640 1 -- 172.21.15.137:0/1028723817 >> 172.21.15.137:0/1028723817 conn(0x7f73a809ba40 msgr2=0x7f73a809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.291+0000 7f73af0b0640 1 -- 172.21.15.137:0/1028723817 shutdown_connections 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.291+0000 7f73af0b0640 1 -- 172.21.15.137:0/1028723817 wait complete. 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.292+0000 7f73af0b0640 1 Processor -- start 2024-04-26T21:59:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.292+0000 7f73af0b0640 1 -- start start 2024-04-26T21:59:07.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73af0b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a80b33e0 0x7f73a81565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73af0b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b3c20 0x7f73a815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73af0b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80d0010 0x7f73a815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73af0b0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73a80b39d0 con 0x7f73a80d0010 2024-04-26T21:59:07.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73af0b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f73a80b3850 con 0x7f73a80b33e0 2024-04-26T21:59:07.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73af0b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f73a81637c0 con 0x7f73a80b3c20 2024-04-26T21:59:07.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73ad64d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80d0010 0x7f73a815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73ad64d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80d0010 0x7f73a815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49856/0 (socket says 172.21.15.137:49856) 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73ad64d640 1 -- 172.21.15.137:0/1536566543 learned_addr learned my addr 172.21.15.137:0/1536566543 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73ad64d640 1 -- 172.21.15.137:0/1536566543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b3c20 msgr2=0x7f73a815bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73ad64d640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b3c20 0x7f73a815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73ad64d640 1 -- 172.21.15.137:0/1536566543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a80b33e0 msgr2=0x7f73a81565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73ad64d640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a80b33e0 0x7f73a81565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73ad64d640 1 -- 172.21.15.137:0/1536566543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a815a470 con 0x7f73a80d0010 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73ad64d640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80d0010 0x7f73a815c070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009fd0 tx=0x7f73a000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73a57fa640 1 -- 172.21.15.137:0/1536566543 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a001a070 con 0x7f73a80d0010 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73a57fa640 1 -- 172.21.15.137:0/1536566543 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a0003bb0 con 0x7f73a80d0010 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73a57fa640 1 -- 172.21.15.137:0/1536566543 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a0004030 con 0x7f73a80d0010 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a815a750 con 0x7f73a80d0010 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.293+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a815ad10 con 0x7f73a80d0010 2024-04-26T21:59:07.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.294+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a806a290 con 0x7f73a80d0010 2024-04-26T21:59:07.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.295+0000 7f73a57fa640 1 -- 172.21.15.137:0/1536566543 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f73a001d070 con 0x7f73a80d0010 2024-04-26T21:59:07.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.295+0000 7f73a57fa640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f738c06c8f0 0x7f738c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.295+0000 7f73a57fa640 1 -- 172.21.15.137:0/1536566543 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f73a008bf10 con 0x7f73a80d0010 2024-04-26T21:59:07.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.295+0000 7f73ace4c640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f738c06c8f0 0x7f738c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.296+0000 7f73ace4c640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f738c06c8f0 0x7f738c06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f739c007fd0 tx=0x7f739c007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:07.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.300+0000 7f73a57fa640 1 -- 172.21.15.137:0/1536566543 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f73a0010070 con 0x7f73a80d0010 2024-04-26T21:59:07.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.476+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f73a8068e00 con 0x7f73a80d0010 2024-04-26T21:59:07.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.476+0000 7f73a57fa640 1 -- 172.21.15.137:0/1536566543 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f73a005a2c0 con 0x7f73a80d0010 2024-04-26T21:59:07.477 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:07.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.478+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f738c06c8f0 msgr2=0x7f738c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.478+0000 7f73af0b0640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f738c06c8f0 0x7f738c06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f739c007fd0 tx=0x7f739c007960 comp rx=0 tx=0).stop 2024-04-26T21:59:07.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.478+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80d0010 msgr2=0x7f73a815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.478+0000 7f73af0b0640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80d0010 0x7f73a815c070 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009fd0 tx=0x7f73a000d560 comp rx=0 tx=0).stop 2024-04-26T21:59:07.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.479+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 shutdown_connections 2024-04-26T21:59:07.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.479+0000 7f73af0b0640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f738c06c8f0 0x7f738c06edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.479+0000 7f73af0b0640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73a80d0010 0x7f73a815c070 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.479+0000 7f73af0b0640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f73a80b3c20 0x7f73a815bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.479+0000 7f73af0b0640 1 --2- 172.21.15.137:0/1536566543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73a80b33e0 0x7f73a81565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.479+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 >> 172.21.15.137:0/1536566543 conn(0x7f73a809ba40 msgr2=0x7f73a8075550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:07.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.479+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 shutdown_connections 2024-04-26T21:59:07.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.479+0000 7f73af0b0640 1 -- 172.21.15.137:0/1536566543 wait complete. 2024-04-26T21:59:07.490 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:07.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.590+0000 7f0f8a8c4640 1 Processor -- start 2024-04-26T21:59:07.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.590+0000 7f0f8a8c4640 1 -- start start 2024-04-26T21:59:07.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f8a8c4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0f8415f5b0 0x7f0f840b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f8a8c4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0f840b55b0 0x7f0f840d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f8a8c4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f840b6aa0 con 0x7f0f8415f990 2024-04-26T21:59:07.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f8a8c4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0f840d3eb0 con 0x7f0f840b55b0 2024-04-26T21:59:07.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f8a8c4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0f840d4190 con 0x7f0f8415f5b0 2024-04-26T21:59:07.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f88e61640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0f840b55b0 0x7f0f840d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f88e61640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0f840b55b0 0x7f0f840d3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49864/0 (socket says 172.21.15.137:49864) 2024-04-26T21:59:07.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f88e61640 1 -- 172.21.15.137:0/1407214812 learned_addr learned my addr 172.21.15.137:0/1407214812 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f88e61640 1 -- 172.21.15.137:0/1407214812 >> v2:172.21.15.170:3300/0 conn(0x7f0f8415f5b0 msgr2=0x7f0f840b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f88e61640 1 --2- 172.21.15.137:0/1407214812 >> v2:172.21.15.170:3300/0 conn(0x7f0f8415f5b0 0x7f0f840b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f88e61640 1 -- 172.21.15.137:0/1407214812 >> v1:172.21.15.170:6789/0 conn(0x7f0f8415f990 legacy=0x7f0f840d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.591+0000 7f0f88e61640 1 -- 172.21.15.137:0/1407214812 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f840d0200 con 0x7f0f840b55b0 2024-04-26T21:59:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.592+0000 7f0f88e61640 1 --2- 172.21.15.137:0/1407214812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f840b55b0 0x7f0f840d3340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f8408f0f0 tx=0x7f0f7c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bb6798d83257eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.592+0000 7f0f82ffd640 1 -- 172.21.15.137:0/1407214812 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c036070 con 0x7f0f840b55b0 2024-04-26T21:59:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.592+0000 7f0f82ffd640 1 -- 172.21.15.137:0/1407214812 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c031600 con 0x7f0f840b55b0 2024-04-26T21:59:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.592+0000 7f0f82ffd640 1 -- 172.21.15.137:0/1407214812 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0319d0 con 0x7f0f840b55b0 2024-04-26T21:59:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.593+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/1407214812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f840b55b0 msgr2=0x7f0f840d3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.593+0000 7f0f8a8c4640 1 --2- 172.21.15.137:0/1407214812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f840b55b0 0x7f0f840d3340 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f8408f0f0 tx=0x7f0f7c02a660 comp rx=0 tx=0).stop 2024-04-26T21:59:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.593+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/1407214812 shutdown_connections 2024-04-26T21:59:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.593+0000 7f0f8a8c4640 1 --2- 172.21.15.137:0/1407214812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f840b55b0 0x7f0f840d3340 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.593+0000 7f0f8a8c4640 1 --2- 172.21.15.137:0/1407214812 >> v2:172.21.15.170:3300/0 conn(0x7f0f8415f5b0 0x7f0f840b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.593+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/1407214812 >> 172.21.15.137:0/1407214812 conn(0x7f0f8408ec40 msgr2=0x7f0f8409e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:07.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.593+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/1407214812 shutdown_connections 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.593+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/1407214812 wait complete. 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.594+0000 7f0f8a8c4640 1 Processor -- start 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.594+0000 7f0f8a8c4640 1 -- start start 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f8a8c4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f840b55b0 0x7f0f840ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f8a8c4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8415f5b0 0x7f0f8414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f8a8c4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f8415f990 0x7f0f840b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f8a8c4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f840d1290 con 0x7f0f8415f5b0 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f8a8c4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f840d1110 con 0x7f0f8415f990 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f8a8c4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f840d3880 con 0x7f0f840b55b0 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f837fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8415f5b0 0x7f0f8414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f837fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8415f5b0 0x7f0f8414a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49866/0 (socket says 172.21.15.137:49866) 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f837fe640 1 -- 172.21.15.137:0/2329597309 learned_addr learned my addr 172.21.15.137:0/2329597309 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f88e61640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f8415f990 0x7f0f840b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f83fff640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f840b55b0 0x7f0f840ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f837fe640 1 -- 172.21.15.137:0/2329597309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f840b55b0 msgr2=0x7f0f840ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f837fe640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f840b55b0 0x7f0f840ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f837fe640 1 -- 172.21.15.137:0/2329597309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f8415f990 msgr2=0x7f0f840b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f837fe640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f8415f990 0x7f0f840b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f837fe640 1 -- 172.21.15.137:0/2329597309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f840cb1d0 con 0x7f0f8415f5b0 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f88e61640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f8415f990 0x7f0f840b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f837fe640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8415f5b0 0x7f0f8414a5b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800b410 tx=0x7f0f7800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f80ff9640 1 -- 172.21.15.137:0/2329597309 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78015020 con 0x7f0f8415f5b0 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f80ff9640 1 -- 172.21.15.137:0/2329597309 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f78011830 con 0x7f0f8415f5b0 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f840cb4b0 con 0x7f0f8415f5b0 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f80ff9640 1 -- 172.21.15.137:0/2329597309 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f78011c20 con 0x7f0f8415f5b0 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.595+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f840caeb0 con 0x7f0f8415f5b0 2024-04-26T21:59:07.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.596+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8406a290 con 0x7f0f8415f5b0 2024-04-26T21:59:07.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.597+0000 7f0f80ff9640 1 -- 172.21.15.137:0/2329597309 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f78018020 con 0x7f0f8415f5b0 2024-04-26T21:59:07.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.597+0000 7f0f80ff9640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f7006c8f0 0x7f0f7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.597+0000 7f0f80ff9640 1 -- 172.21.15.137:0/2329597309 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f7808bad0 con 0x7f0f8415f5b0 2024-04-26T21:59:07.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.597+0000 7f0f83fff640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f7006c8f0 0x7f0f7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.597+0000 7f0f83fff640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f7006c8f0 0x7f0f7006edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400a810 tx=0x7f0f74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:07.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.601+0000 7f0f80ff9640 1 -- 172.21.15.137:0/2329597309 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f7801f020 con 0x7f0f8415f5b0 2024-04-26T21:59:07.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.776+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0f840d27f0 con 0x7f0f8415f5b0 2024-04-26T21:59:07.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.776+0000 7f0f80ff9640 1 -- 172.21.15.137:0/2329597309 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f0f780172c0 con 0x7f0f8415f5b0 2024-04-26T21:59:07.777 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f7006c8f0 msgr2=0x7f0f7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f7006c8f0 0x7f0f7006edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400a810 tx=0x7f0f74008040 comp rx=0 tx=0).stop 2024-04-26T21:59:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8415f5b0 msgr2=0x7f0f8414a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8415f5b0 0x7f0f8414a5b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800b410 tx=0x7f0f7800b8d0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 shutdown_connections 2024-04-26T21:59:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f7006c8f0 0x7f0f7006edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8415f5b0 0x7f0f8414a5b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f8415f990 0x7f0f840b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 --2- 172.21.15.137:0/2329597309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f840b55b0 0x7f0f840ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.778+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 >> 172.21.15.137:0/2329597309 conn(0x7f0f8408ec40 msgr2=0x7f0f8406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.779+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 shutdown_connections 2024-04-26T21:59:07.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.779+0000 7f0f8a8c4640 1 -- 172.21.15.137:0/2329597309 wait complete. 2024-04-26T21:59:07.789 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:07.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.889+0000 7fedcff03640 1 Processor -- start 2024-04-26T21:59:07.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.890+0000 7fedcff03640 1 -- start start 2024-04-26T21:59:07.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedcff03640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fedc806ea30 0x7fedc80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedcff03640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc809c790 con 0x7fedc81631f0 2024-04-26T21:59:07.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedcff03640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc8163ec0 con 0x7fedc80b2000 2024-04-26T21:59:07.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedcff03640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fedc806eec0 con 0x7fedc806ea30 2024-04-26T21:59:07.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedce4a0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fedc806ea30 0x7fedc80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedcdc9f640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fedc81631f0 0x7fedc81635d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48434/0 (socket says 172.21.15.137:48434) 2024-04-26T21:59:07.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedcdc9f640 1 -- 172.21.15.137:0/1143827788 learned_addr learned my addr 172.21.15.137:0/1143827788 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:07.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedce4a0640 1 -- 172.21.15.137:0/1143827788 >> v1:172.21.15.170:6789/0 conn(0x7fedc80b2000 legacy=0x7fedc80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedce4a0640 1 -- 172.21.15.137:0/1143827788 >> v1:172.21.15.137:6789/0 conn(0x7fedc81631f0 legacy=0x7fedc81635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedce4a0640 1 -- 172.21.15.137:0/1143827788 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc80d1a40 con 0x7fedc806ea30 2024-04-26T21:59:07.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.891+0000 7fedccc9d640 1 -- 172.21.15.137:0/1143827788 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499234017 0 0) 0x7fedc809c790 con 0x7fedc81631f0 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedce4a0640 1 --2- 172.21.15.137:0/1143827788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc806ea30 0x7fedc80d1170 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009d90 tx=0x7fedc002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efba892bc0254ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedccc9d640 1 -- 172.21.15.137:0/1143827788 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0007740 con 0x7fedc806ea30 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedccc9d640 1 -- 172.21.15.137:0/1143827788 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc00078e0 con 0x7fedc806ea30 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedccc9d640 1 -- 172.21.15.137:0/1143827788 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0007cb0 con 0x7fedc806ea30 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedcff03640 1 -- 172.21.15.137:0/1143827788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc806ea30 msgr2=0x7fedc80d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedcff03640 1 --2- 172.21.15.137:0/1143827788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc806ea30 0x7fedc80d1170 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009d90 tx=0x7fedc002a660 comp rx=0 tx=0).stop 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedcff03640 1 -- 172.21.15.137:0/1143827788 shutdown_connections 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedcff03640 1 --2- 172.21.15.137:0/1143827788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc806ea30 0x7fedc80d1170 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedcff03640 1 -- 172.21.15.137:0/1143827788 >> 172.21.15.137:0/1143827788 conn(0x7fedc809ba40 msgr2=0x7fedc809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedcff03640 1 -- 172.21.15.137:0/1143827788 shutdown_connections 2024-04-26T21:59:07.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.892+0000 7fedcff03640 1 -- 172.21.15.137:0/1143827788 wait complete. 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.893+0000 7fedcff03640 1 Processor -- start 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedcff03640 1 -- start start 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedcff03640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedc806ea30 0x7fedc8156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedcff03640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc80b2000 0x7fedc81e8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedcff03640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc81631f0 0x7fedc815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedcff03640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fedc80d0230 con 0x7fedc81631f0 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedcff03640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fedc80d2000 con 0x7fedc80b2000 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedcff03640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fedc8146c10 con 0x7fedc806ea30 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedce4a0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc81631f0 0x7fedc815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedce4a0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc81631f0 0x7fedc815a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49890/0 (socket says 172.21.15.137:49890) 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedce4a0640 1 -- 172.21.15.137:0/1093811249 learned_addr learned my addr 172.21.15.137:0/1093811249 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:07.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedcdc9f640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedc806ea30 0x7fedc8156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.894+0000 7fedcd49e640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc80b2000 0x7fedc81e8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedce4a0640 1 -- 172.21.15.137:0/1093811249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedc806ea30 msgr2=0x7fedc8156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedce4a0640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedc806ea30 0x7fedc8156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedce4a0640 1 -- 172.21.15.137:0/1093811249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc80b2000 msgr2=0x7fedc81e8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedce4a0640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc80b2000 0x7fedc81e8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedce4a0640 1 -- 172.21.15.137:0/1093811249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc8147100 con 0x7fedc81631f0 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedcd49e640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc80b2000 0x7fedc81e8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedce4a0640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc81631f0 0x7fedc815a3f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009eb0 tx=0x7fedc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedbe7fc640 1 -- 172.21.15.137:0/1093811249 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0040070 con 0x7fedc81631f0 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedbe7fc640 1 -- 172.21.15.137:0/1093811249 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc0031c90 con 0x7fedc81631f0 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc81e9680 con 0x7fedc81631f0 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedbe7fc640 1 -- 172.21.15.137:0/1093811249 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0045680 con 0x7fedc81631f0 2024-04-26T21:59:07.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.895+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc81e9c40 con 0x7fedc81631f0 2024-04-26T21:59:07.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.896+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc81472d0 con 0x7fedc81631f0 2024-04-26T21:59:07.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.896+0000 7fedbe7fc640 1 -- 172.21.15.137:0/1093811249 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fedc0039040 con 0x7fedc81631f0 2024-04-26T21:59:07.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.897+0000 7fedbe7fc640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedac06c8f0 0x7fedac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:07.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.897+0000 7fedbe7fc640 1 -- 172.21.15.137:0/1093811249 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fedc00ad480 con 0x7fedc81631f0 2024-04-26T21:59:07.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.897+0000 7fedcdc9f640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedac06c8f0 0x7fedac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:07.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.897+0000 7fedcdc9f640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedac06c8f0 0x7fedac06edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fedb8000f60 tx=0x7fedb8007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:07.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:07.901+0000 7fedbe7fc640 1 -- 172.21.15.137:0/1093811249 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fedc007ba00 con 0x7fedc81631f0 2024-04-26T21:59:08.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.075+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fedc806a290 con 0x7fedc81631f0 2024-04-26T21:59:08.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.076+0000 7fedbe7fc640 1 -- 172.21.15.137:0/1093811249 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fedc007b300 con 0x7fedc81631f0 2024-04-26T21:59:08.076 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:08.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedac06c8f0 msgr2=0x7fedac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedac06c8f0 0x7fedac06edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fedb8000f60 tx=0x7fedb8007e40 comp rx=0 tx=0).stop 2024-04-26T21:59:08.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc81631f0 msgr2=0x7fedc815a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc81631f0 0x7fedc815a3f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009eb0 tx=0x7fedc0004a40 comp rx=0 tx=0).stop 2024-04-26T21:59:08.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 shutdown_connections 2024-04-26T21:59:08.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedac06c8f0 0x7fedac06edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedc81631f0 0x7fedc815a3f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc80b2000 0x7fedc81e8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 --2- 172.21.15.137:0/1093811249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fedc806ea30 0x7fedc8156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 >> 172.21.15.137:0/1093811249 conn(0x7fedc809ba40 msgr2=0x7fedc80b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:08.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 shutdown_connections 2024-04-26T21:59:08.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.078+0000 7fedcff03640 1 -- 172.21.15.137:0/1093811249 wait complete. 2024-04-26T21:59:08.089 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:08.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.185+0000 7fabb32f2640 1 Processor -- start 2024-04-26T21:59:08.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.185+0000 7fabb32f2640 1 -- start start 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb32f2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fabac0cf2e0 0x7fabac06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb32f2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 0x7fabac06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb32f2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabac0d1740 con 0x7fabac06e2c0 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb32f2640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fabac06e750 con 0x7fabac0cf2e0 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb32f2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fabac0d1a20 con 0x7fabac0d11b0 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb108e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fabac0cf2e0 0x7fabac06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb188f640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fabac06e2c0 0x7fabac15ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48438/0 (socket says 172.21.15.137:48438) 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb188f640 1 -- 172.21.15.137:0/1722267108 learned_addr learned my addr 172.21.15.137:0/1722267108 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb088d640 1 --2- 172.21.15.137:0/1722267108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 0x7fabac06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb108e640 1 -- 172.21.15.137:0/1722267108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 msgr2=0x7fabac06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb108e640 1 --2- 172.21.15.137:0/1722267108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 0x7fabac06dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb108e640 1 -- 172.21.15.137:0/1722267108 >> v1:172.21.15.137:6789/0 conn(0x7fabac06e2c0 legacy=0x7fabac15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7faba3fff640 1 -- 172.21.15.137:0/1722267108 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057877282 0 0) 0x7fabac0d1740 con 0x7fabac06e2c0 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.186+0000 7fabb108e640 1 -- 172.21.15.137:0/1722267108 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac0d1d00 con 0x7fabac0cf2e0 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.187+0000 7fabb088d640 1 --2- 172.21.15.137:0/1722267108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 0x7fabac06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.187+0000 7fabb108e640 1 --2- 172.21.15.137:0/1722267108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 0x7fabac06d4d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faba8009d90 tx=0x7faba802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4505dfec754a0d43 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.187+0000 7faba3fff640 1 -- 172.21.15.137:0/1722267108 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8007740 con 0x7fabac0cf2e0 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.187+0000 7faba3fff640 1 -- 172.21.15.137:0/1722267108 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba80078e0 con 0x7fabac0cf2e0 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.187+0000 7faba3fff640 1 -- 172.21.15.137:0/1722267108 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8007cb0 con 0x7fabac0cf2e0 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.188+0000 7fabb32f2640 1 -- 172.21.15.137:0/1722267108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 msgr2=0x7fabac06d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.188+0000 7fabb32f2640 1 --2- 172.21.15.137:0/1722267108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 0x7fabac06d4d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faba8009d90 tx=0x7faba802a660 comp rx=0 tx=0).stop 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.188+0000 7fabb32f2640 1 -- 172.21.15.137:0/1722267108 shutdown_connections 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.188+0000 7fabb32f2640 1 --2- 172.21.15.137:0/1722267108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 0x7fabac06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.188+0000 7fabb32f2640 1 --2- 172.21.15.137:0/1722267108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 0x7fabac06d4d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.188+0000 7fabb32f2640 1 -- 172.21.15.137:0/1722267108 >> 172.21.15.137:0/1722267108 conn(0x7fabac0b4a60 msgr2=0x7fabac0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.188+0000 7fabb32f2640 1 -- 172.21.15.137:0/1722267108 shutdown_connections 2024-04-26T21:59:08.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.188+0000 7fabb32f2640 1 -- 172.21.15.137:0/1722267108 wait complete. 2024-04-26T21:59:08.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.189+0000 7fabb32f2640 1 Processor -- start 2024-04-26T21:59:08.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.189+0000 7fabb32f2640 1 -- start start 2024-04-26T21:59:08.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb32f2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabac06e2c0 0x7fabac0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb32f2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 0x7fabac09df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb32f2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 0x7fabac160570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb32f2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabac06da10 con 0x7fabac0cf2e0 2024-04-26T21:59:08.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb32f2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fabac0d22c0 con 0x7fabac06e2c0 2024-04-26T21:59:08.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb32f2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fabac0cf6c0 con 0x7fabac0d11b0 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb088d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 0x7fabac09df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb088d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 0x7fabac09df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49906/0 (socket says 172.21.15.137:49906) 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb088d640 1 -- 172.21.15.137:0/39519432 learned_addr learned my addr 172.21.15.137:0/39519432 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb188f640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 0x7fabac160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb088d640 1 -- 172.21.15.137:0/39519432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 msgr2=0x7fabac160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb108e640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabac06e2c0 0x7fabac0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb088d640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 0x7fabac160570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb088d640 1 -- 172.21.15.137:0/39519432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabac06e2c0 msgr2=0x7fabac0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb088d640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabac06e2c0 0x7fabac0716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb088d640 1 -- 172.21.15.137:0/39519432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac0b0270 con 0x7fabac0cf2e0 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7fabb088d640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 0x7fabac09df70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00d800 tx=0x7fab9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7faba1ffb640 1 -- 172.21.15.137:0/39519432 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c004030 con 0x7fabac0cf2e0 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.190+0000 7faba1ffb640 1 -- 172.21.15.137:0/39519432 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c0041d0 con 0x7fabac0cf2e0 2024-04-26T21:59:08.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.191+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabac0b0550 con 0x7fabac0cf2e0 2024-04-26T21:59:08.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.191+0000 7faba1ffb640 1 -- 172.21.15.137:0/39519432 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00b6c0 con 0x7fabac0cf2e0 2024-04-26T21:59:08.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.191+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabac0b0b10 con 0x7fabac0cf2e0 2024-04-26T21:59:08.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.192+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabac06a290 con 0x7fabac0cf2e0 2024-04-26T21:59:08.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.192+0000 7faba1ffb640 1 -- 172.21.15.137:0/39519432 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab9c00b860 con 0x7fabac0cf2e0 2024-04-26T21:59:08.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.192+0000 7faba1ffb640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab9006c8f0 0x7fab9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.192+0000 7faba1ffb640 1 -- 172.21.15.137:0/39519432 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fab9c08bdd0 con 0x7fabac0cf2e0 2024-04-26T21:59:08.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.192+0000 7fabb108e640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab9006c8f0 0x7fab9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.193+0000 7fabb108e640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab9006c8f0 0x7fab9006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faba8034000 tx=0x7faba802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:08.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.197+0000 7faba1ffb640 1 -- 172.21.15.137:0/39519432 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fab9c05a290 con 0x7fabac0cf2e0 2024-04-26T21:59:08.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.375+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabac0b8ef0 con 0x7fabac0cf2e0 2024-04-26T21:59:08.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.376+0000 7faba1ffb640 1 -- 172.21.15.137:0/39519432 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fab9c08d020 con 0x7fabac0cf2e0 2024-04-26T21:59:08.376 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:08.377 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab9006c8f0 msgr2=0x7fab9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab9006c8f0 0x7fab9006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faba8034000 tx=0x7faba802f000 comp rx=0 tx=0).stop 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 msgr2=0x7fabac09df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 0x7fabac09df70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00d800 tx=0x7fab9c00dcc0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 shutdown_connections 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab9006c8f0 0x7fab9006edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabac0cf2e0 0x7fabac09df70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabac0d11b0 0x7fabac160570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 --2- 172.21.15.137:0/39519432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabac06e2c0 0x7fabac0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 >> 172.21.15.137:0/39519432 conn(0x7fabac0b4a60 msgr2=0x7fabac161600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 shutdown_connections 2024-04-26T21:59:08.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.378+0000 7fabb32f2640 1 -- 172.21.15.137:0/39519432 wait complete. 2024-04-26T21:59:08.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:08.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:08.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.489+0000 7f4cc0e93640 1 Processor -- start 2024-04-26T21:59:08.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.489+0000 7f4cc0e93640 1 -- start start 2024-04-26T21:59:08.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cc0e93640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4cbc15f2b0 0x7f4cbc06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cc0e93640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc06c9b0 0x7f4cbc0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cc0e93640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cbc070b30 con 0x7f4cbc0706a0 2024-04-26T21:59:08.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cc0e93640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4cbc0af610 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cc0e93640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4cbc0700b0 con 0x7f4cbc06c9b0 2024-04-26T21:59:08.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cba59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4cbc15f2b0 0x7f4cbc06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cb3fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4cbc0706a0 0x7f4cbc06c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48442/0 (socket says 172.21.15.137:48442) 2024-04-26T21:59:08.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cb3fff640 1 -- 172.21.15.137:0/2712502295 learned_addr learned my addr 172.21.15.137:0/2712502295 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cbad9d640 1 --2- 172.21.15.137:0/2712502295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc06c9b0 0x7f4cbc0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cba59c640 1 -- 172.21.15.137:0/2712502295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc06c9b0 msgr2=0x7f4cbc0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cba59c640 1 --2- 172.21.15.137:0/2712502295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc06c9b0 0x7f4cbc0afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cba59c640 1 -- 172.21.15.137:0/2712502295 >> v1:172.21.15.137:6789/0 conn(0x7f4cbc0706a0 legacy=0x7f4cbc06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cb9d9b640 1 -- 172.21.15.137:0/2712502295 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3178141280 0 0) 0x7f4cbc070b30 con 0x7f4cbc0706a0 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.490+0000 7f4cba59c640 1 -- 172.21.15.137:0/2712502295 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc070e10 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.491+0000 7f4cba59c640 1 --2- 172.21.15.137:0/2712502295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 0x7f4cbc06fb70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0097a0 tx=0x7f4cac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fafaadd2d6492e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.491+0000 7f4cb9d9b640 1 -- 172.21.15.137:0/2712502295 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac037070 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.491+0000 7f4cb9d9b640 1 -- 172.21.15.137:0/2712502295 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cac032440 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.491+0000 7f4cb9d9b640 1 -- 172.21.15.137:0/2712502295 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac032810 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.492+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2712502295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 msgr2=0x7f4cbc06fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.492+0000 7f4cc0e93640 1 --2- 172.21.15.137:0/2712502295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 0x7f4cbc06fb70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0097a0 tx=0x7f4cac02a180 comp rx=0 tx=0).stop 2024-04-26T21:59:08.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.492+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2712502295 shutdown_connections 2024-04-26T21:59:08.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.492+0000 7f4cc0e93640 1 --2- 172.21.15.137:0/2712502295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc06c9b0 0x7f4cbc0afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.492+0000 7f4cc0e93640 1 --2- 172.21.15.137:0/2712502295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 0x7f4cbc06fb70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.492+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2712502295 >> 172.21.15.137:0/2712502295 conn(0x7f4cbc06f050 msgr2=0x7f4cbc06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:08.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.492+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2712502295 shutdown_connections 2024-04-26T21:59:08.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.492+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2712502295 wait complete. 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.493+0000 7f4cc0e93640 1 Processor -- start 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.493+0000 7f4cc0e93640 1 -- start start 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cc0e93640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cbc06c9b0 0x7f4cbc1621d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cc0e93640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 0x7f4cbc155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cc0e93640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc155ec0 0x7f4cbc1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cc0e93640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0b4f40 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cc0e93640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0713d0 con 0x7f4cbc06c9b0 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cc0e93640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4cbc0b1890 con 0x7f4cbc155ec0 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 0x7f4cbc155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 0x7f4cbc155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49914/0 (socket says 172.21.15.137:49914) 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb3fff640 1 -- 172.21.15.137:0/2650343229 learned_addr learned my addr 172.21.15.137:0/2650343229 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cbad9d640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc155ec0 0x7f4cbc1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cba59c640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cbc06c9b0 0x7f4cbc1621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb3fff640 1 -- 172.21.15.137:0/2650343229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc155ec0 msgr2=0x7f4cbc1509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb3fff640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc155ec0 0x7f4cbc1509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb3fff640 1 -- 172.21.15.137:0/2650343229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cbc06c9b0 msgr2=0x7f4cbc1621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb3fff640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cbc06c9b0 0x7f4cbc1621d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb3fff640 1 -- 172.21.15.137:0/2650343229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc162710 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cba59c640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cbc06c9b0 0x7f4cbc1621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb3fff640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 0x7f4cbc155980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400c4d0 tx=0x7f4ca400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb2ffd640 1 -- 172.21.15.137:0/2650343229 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4018070 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb2ffd640 1 -- 172.21.15.137:0/2650343229 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca4007500 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cb2ffd640 1 -- 172.21.15.137:0/2650343229 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4004a20 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.494+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc156400 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.495+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc160060 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.496+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc06a290 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.496+0000 7f4cb2ffd640 1 -- 172.21.15.137:0/2650343229 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ca401b070 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.496+0000 7f4cb2ffd640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c9c06c920 0x7f4c9c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.496+0000 7f4cb2ffd640 1 -- 172.21.15.137:0/2650343229 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4ca408acf0 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.496+0000 7f4cba59c640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c9c06c920 0x7f4c9c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.497+0000 7f4cba59c640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c9c06c920 0x7f4c9c06ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4cac034000 tx=0x7f4cac02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:08.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.501+0000 7f4cb2ffd640 1 -- 172.21.15.137:0/2650343229 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4ca408f070 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.677+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cbc073990 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.677+0000 7f4cb2ffd640 1 -- 172.21.15.137:0/2650343229 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f4ca4058ad0 con 0x7f4cbc15f2b0 2024-04-26T21:59:08.677 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:08.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c9c06c920 msgr2=0x7f4c9c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c9c06c920 0x7f4c9c06ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4cac034000 tx=0x7f4cac02e000 comp rx=0 tx=0).stop 2024-04-26T21:59:08.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 msgr2=0x7f4cbc155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 0x7f4cbc155980 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400c4d0 tx=0x7f4ca400c990 comp rx=0 tx=0).stop 2024-04-26T21:59:08.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 shutdown_connections 2024-04-26T21:59:08.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c9c06c920 0x7f4c9c06ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4cbc15f2b0 0x7f4cbc155980 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4cbc155ec0 0x7f4cbc1509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 --2- 172.21.15.137:0/2650343229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cbc06c9b0 0x7f4cbc1621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 >> 172.21.15.137:0/2650343229 conn(0x7f4cbc06f050 msgr2=0x7f4cbc073cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:08.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 shutdown_connections 2024-04-26T21:59:08.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.679+0000 7f4cc0e93640 1 -- 172.21.15.137:0/2650343229 wait complete. 2024-04-26T21:59:08.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:08.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.790+0000 7f2e7346d640 1 Processor -- start 2024-04-26T21:59:08.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.790+0000 7f2e7346d640 1 -- start start 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e7346d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e6c15f490 0x7f2e6c0d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e7346d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e6c0d0ff0 0x7f2e6c0d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e7346d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2e6c0d2120 0x7f2e6c0ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e7346d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6c0d2570 con 0x7f2e6c15f490 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e7346d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6c0d4240 con 0x7f2e6c0d2120 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e7346d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6c0d31a0 con 0x7f2e6c0d0ff0 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e71209640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e6c15f490 0x7f2e6c0d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e71209640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e6c15f490 0x7f2e6c0d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49924/0 (socket says 172.21.15.137:49924) 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e71209640 1 -- 172.21.15.137:0/2325012022 learned_addr learned my addr 172.21.15.137:0/2325012022 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e71a0a640 1 --2- 172.21.15.137:0/2325012022 >> v2:172.21.15.170:3300/0 conn(0x7f2e6c0d2120 0x7f2e6c0ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e70a08640 1 --2- 172.21.15.137:0/2325012022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e6c0d0ff0 0x7f2e6c0d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e71209640 1 -- 172.21.15.137:0/2325012022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e6c0d0ff0 msgr2=0x7f2e6c0d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e71209640 1 --2- 172.21.15.137:0/2325012022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e6c0d0ff0 0x7f2e6c0d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e71209640 1 -- 172.21.15.137:0/2325012022 >> v2:172.21.15.170:3300/0 conn(0x7f2e6c0d2120 msgr2=0x7f2e6c0ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e71209640 1 --2- 172.21.15.137:0/2325012022 >> v2:172.21.15.170:3300/0 conn(0x7f2e6c0d2120 0x7f2e6c0ba3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.791+0000 7f2e71209640 1 -- 172.21.15.137:0/2325012022 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c0d3480 con 0x7f2e6c15f490 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.792+0000 7f2e71209640 1 --2- 172.21.15.137:0/2325012022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 0x7f2e6c0d0ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c08d6f0 tx=0x7f2e6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd99ffbb1c64b4f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.792+0000 7f2e63fff640 1 -- 172.21.15.137:0/2325012022 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68037070 con 0x7f2e6c15f490 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.792+0000 7f2e63fff640 1 -- 172.21.15.137:0/2325012022 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e68032440 con 0x7f2e6c15f490 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.792+0000 7f2e63fff640 1 -- 172.21.15.137:0/2325012022 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68032810 con 0x7f2e6c15f490 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.792+0000 7f2e7346d640 1 -- 172.21.15.137:0/2325012022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 msgr2=0x7f2e6c0d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.792+0000 7f2e7346d640 1 --2- 172.21.15.137:0/2325012022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 0x7f2e6c0d0ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c08d6f0 tx=0x7f2e6802a1e0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.792+0000 7f2e7346d640 1 -- 172.21.15.137:0/2325012022 shutdown_connections 2024-04-26T21:59:08.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.793+0000 7f2e7346d640 1 --2- 172.21.15.137:0/2325012022 >> v2:172.21.15.170:3300/0 conn(0x7f2e6c0d2120 0x7f2e6c0ba3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.793+0000 7f2e7346d640 1 --2- 172.21.15.137:0/2325012022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e6c0d0ff0 0x7f2e6c0d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.793+0000 7f2e7346d640 1 --2- 172.21.15.137:0/2325012022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 0x7f2e6c0d0ab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.793+0000 7f2e7346d640 1 -- 172.21.15.137:0/2325012022 >> 172.21.15.137:0/2325012022 conn(0x7f2e6c09e530 msgr2=0x7f2e6c0d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.793+0000 7f2e7346d640 1 -- 172.21.15.137:0/2325012022 shutdown_connections 2024-04-26T21:59:08.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.793+0000 7f2e7346d640 1 -- 172.21.15.137:0/2325012022 wait complete. 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e7346d640 1 Processor -- start 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e7346d640 1 -- start start 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e7346d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e6c0d0ff0 0x7f2e6c14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e7346d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e6c0d2120 0x7f2e6c0b9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e7346d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 0x7f2e6c1eae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e7346d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c0d3d20 con 0x7f2e6c15f490 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e7346d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6c0d3a40 con 0x7f2e6c0d2120 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e7346d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6c15f870 con 0x7f2e6c0d0ff0 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e71a0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 0x7f2e6c1eae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e71a0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 0x7f2e6c1eae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49934/0 (socket says 172.21.15.137:49934) 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.794+0000 7f2e71a0a640 1 -- 172.21.15.137:0/1554391012 learned_addr learned my addr 172.21.15.137:0/1554391012 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e71a0a640 1 -- 172.21.15.137:0/1554391012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e6c0d0ff0 msgr2=0x7f2e6c14f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e71a0a640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e6c0d0ff0 0x7f2e6c14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e71a0a640 1 -- 172.21.15.137:0/1554391012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e6c0d2120 msgr2=0x7f2e6c0b9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e70a08640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e6c0d2120 0x7f2e6c0b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e71a0a640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e6c0d2120 0x7f2e6c0b9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e71a0a640 1 -- 172.21.15.137:0/1554391012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6c0b9970 con 0x7f2e6c15f490 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e71a0a640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 0x7f2e6c1eae50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2e64007e90 tx=0x7f2e6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e61ffb640 1 -- 172.21.15.137:0/1554391012 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64014420 con 0x7f2e6c15f490 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e61ffb640 1 -- 172.21.15.137:0/1554391012 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e64019070 con 0x7f2e6c15f490 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6c0ba130 con 0x7f2e6c15f490 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e61ffb640 1 -- 172.21.15.137:0/1554391012 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64014800 con 0x7f2e6c15f490 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.795+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6c0ba6f0 con 0x7f2e6c15f490 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.796+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6c06a290 con 0x7f2e6c15f490 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.796+0000 7f2e61ffb640 1 -- 172.21.15.137:0/1554391012 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e640149a0 con 0x7f2e6c15f490 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.797+0000 7f2e61ffb640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e5006c8f0 0x7f2e5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.797+0000 7f2e61ffb640 1 -- 172.21.15.137:0/1554391012 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2e6408c2a0 con 0x7f2e6c15f490 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.797+0000 7f2e71209640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e5006c8f0 0x7f2e5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.797+0000 7f2e71209640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e5006c8f0 0x7f2e5006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e68034000 tx=0x7f2e6802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:08.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.801+0000 7f2e61ffb640 1 -- 172.21.15.137:0/1554391012 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2e6405a760 con 0x7f2e6c15f490 2024-04-26T21:59:08.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.975+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2e6c075430 con 0x7f2e6c15f490 2024-04-26T21:59:08.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.976+0000 7f2e61ffb640 1 -- 172.21.15.137:0/1554391012 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f2e6405a060 con 0x7f2e6c15f490 2024-04-26T21:59:08.976 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:08.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e5006c8f0 msgr2=0x7f2e5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e5006c8f0 0x7f2e5006edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e68034000 tx=0x7f2e6802c000 comp rx=0 tx=0).stop 2024-04-26T21:59:08.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 msgr2=0x7f2e6c1eae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 0x7f2e6c1eae50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2e64007e90 tx=0x7f2e6400e4b0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 shutdown_connections 2024-04-26T21:59:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e5006c8f0 0x7f2e5006edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e6c15f490 0x7f2e6c1eae50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e6c0d2120 0x7f2e6c0b9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 --2- 172.21.15.137:0/1554391012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e6c0d0ff0 0x7f2e6c14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 >> 172.21.15.137:0/1554391012 conn(0x7f2e6c09e530 msgr2=0x7f2e6c15e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 shutdown_connections 2024-04-26T21:59:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:08.978+0000 7f2e7346d640 1 -- 172.21.15.137:0/1554391012 wait complete. 2024-04-26T21:59:08.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:09.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.090+0000 7f0f883bf640 1 Processor -- start 2024-04-26T21:59:09.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.090+0000 7f0f883bf640 1 -- start start 2024-04-26T21:59:09.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f883bf640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0f800706a0 0x7f0f8006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f883bf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0f8006c9b0 0x7f0f800afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f883bf640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f80070b30 con 0x7f0f8015f2b0 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f883bf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0f800af610 con 0x7f0f8006c9b0 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f883bf640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0f800700b0 con 0x7f0f800706a0 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f8695c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0f8006c9b0 0x7f0f800afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f8695c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0f8006c9b0 0x7f0f800afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49938/0 (socket says 172.21.15.137:49938) 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f8695c640 1 -- 172.21.15.137:0/3667985675 learned_addr learned my addr 172.21.15.137:0/3667985675 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f8595a640 1 --2- 172.21.15.137:0/3667985675 >> v2:172.21.15.170:3300/0 conn(0x7f0f800706a0 0x7f0f8006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f8695c640 1 -- 172.21.15.137:0/3667985675 >> v2:172.21.15.170:3300/0 conn(0x7f0f800706a0 msgr2=0x7f0f8006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f8695c640 1 --2- 172.21.15.137:0/3667985675 >> v2:172.21.15.170:3300/0 conn(0x7f0f800706a0 0x7f0f8006fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f8695c640 1 -- 172.21.15.137:0/3667985675 >> v1:172.21.15.170:6789/0 conn(0x7f0f8015f2b0 legacy=0x7f0f8006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.091+0000 7f0f8695c640 1 -- 172.21.15.137:0/3667985675 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f80070e10 con 0x7f0f8006c9b0 2024-04-26T21:59:09.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.092+0000 7f0f8695c640 1 --2- 172.21.15.137:0/3667985675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8006c9b0 0x7f0f800afa80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f8006cec0 tx=0x7f0f7c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138762feeccb7065 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.092+0000 7f0f85159640 1 -- 172.21.15.137:0/3667985675 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c037070 con 0x7f0f8006c9b0 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.092+0000 7f0f85159640 1 -- 172.21.15.137:0/3667985675 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f7c032440 con 0x7f0f8006c9b0 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.092+0000 7f0f85159640 1 -- 172.21.15.137:0/3667985675 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c032810 con 0x7f0f8006c9b0 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.092+0000 7f0f883bf640 1 -- 172.21.15.137:0/3667985675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8006c9b0 msgr2=0x7f0f800afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.092+0000 7f0f883bf640 1 --2- 172.21.15.137:0/3667985675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8006c9b0 0x7f0f800afa80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0f8006cec0 tx=0x7f0f7c02a230 comp rx=0 tx=0).stop 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.093+0000 7f0f883bf640 1 -- 172.21.15.137:0/3667985675 shutdown_connections 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.093+0000 7f0f883bf640 1 --2- 172.21.15.137:0/3667985675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8006c9b0 0x7f0f800afa80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.093+0000 7f0f883bf640 1 --2- 172.21.15.137:0/3667985675 >> v2:172.21.15.170:3300/0 conn(0x7f0f800706a0 0x7f0f8006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.093+0000 7f0f883bf640 1 -- 172.21.15.137:0/3667985675 >> 172.21.15.137:0/3667985675 conn(0x7f0f8006f050 msgr2=0x7f0f8006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:09.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.093+0000 7f0f883bf640 1 -- 172.21.15.137:0/3667985675 shutdown_connections 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.093+0000 7f0f883bf640 1 -- 172.21.15.137:0/3667985675 wait complete. 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f883bf640 1 Processor -- start 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f883bf640 1 -- start start 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f883bf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f8006c9b0 0x7f0f80144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f883bf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8015f2b0 0x7f0f8015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f883bf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f801f62a0 0x7f0f80073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f883bf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f800b4f40 con 0x7f0f8015f2b0 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f883bf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f800713d0 con 0x7f0f801f62a0 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f883bf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f800b1890 con 0x7f0f8006c9b0 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f8595a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8015f2b0 0x7f0f8015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.094+0000 7f0f8595a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8015f2b0 0x7f0f8015c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49946/0 (socket says 172.21.15.137:49946) 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8595a640 1 -- 172.21.15.137:0/3073181389 learned_addr learned my addr 172.21.15.137:0/3073181389 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8695c640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f801f62a0 0x7f0f80073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8615b640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f8006c9b0 0x7f0f80144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8595a640 1 -- 172.21.15.137:0/3073181389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f8006c9b0 msgr2=0x7f0f80144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8595a640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f8006c9b0 0x7f0f80144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8595a640 1 -- 172.21.15.137:0/3073181389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f801f62a0 msgr2=0x7f0f80073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8595a640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f801f62a0 0x7f0f80073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8595a640 1 -- 172.21.15.137:0/3073181389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8015ab70 con 0x7f0f8015f2b0 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8615b640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f8006c9b0 0x7f0f80144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f8595a640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8015f2b0 0x7f0f8015c910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000c7f0 tx=0x7f0f7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f76ffd640 1 -- 172.21.15.137:0/3073181389 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70015070 con 0x7f0f8015f2b0 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f76ffd640 1 -- 172.21.15.137:0/3073181389 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f70004240 con 0x7f0f8015f2b0 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f8015ae50 con 0x7f0f8015f2b0 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f76ffd640 1 -- 172.21.15.137:0/3073181389 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f70007620 con 0x7f0f8015f2b0 2024-04-26T21:59:09.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.095+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f8015b130 con 0x7f0f8015f2b0 2024-04-26T21:59:09.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.096+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f8006a290 con 0x7f0f8015f2b0 2024-04-26T21:59:09.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.097+0000 7f0f76ffd640 1 -- 172.21.15.137:0/3073181389 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f700079d0 con 0x7f0f8015f2b0 2024-04-26T21:59:09.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.097+0000 7f0f76ffd640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6406c8f0 0x7f0f6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.097+0000 7f0f76ffd640 1 -- 172.21.15.137:0/3073181389 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f7008baf0 con 0x7f0f8015f2b0 2024-04-26T21:59:09.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.097+0000 7f0f8615b640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6406c8f0 0x7f0f6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.097+0000 7f0f8615b640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6406c8f0 0x7f0f6406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f80073ce0 tx=0x7f0f78009590 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.101+0000 7f0f76ffd640 1 -- 172.21.15.137:0/3073181389 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f70059960 con 0x7f0f8015f2b0 2024-04-26T21:59:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.280+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0f80158d50 con 0x7f0f8015f2b0 2024-04-26T21:59:09.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.280+0000 7f0f76ffd640 1 -- 172.21.15.137:0/3073181389 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f0f7005dc60 con 0x7f0f8015f2b0 2024-04-26T21:59:09.280 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:09.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6406c8f0 msgr2=0x7f0f6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6406c8f0 0x7f0f6406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f80073ce0 tx=0x7f0f78009590 comp rx=0 tx=0).stop 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8015f2b0 msgr2=0x7f0f8015c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8015f2b0 0x7f0f8015c910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000c7f0 tx=0x7f0f7000ccb0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 shutdown_connections 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6406c8f0 0x7f0f6406edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f8015f2b0 0x7f0f8015c910 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f801f62a0 0x7f0f80073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 --2- 172.21.15.137:0/3073181389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f8006c9b0 0x7f0f80144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 >> 172.21.15.137:0/3073181389 conn(0x7f0f8006f050 msgr2=0x7f0f800afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 shutdown_connections 2024-04-26T21:59:09.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.282+0000 7f0f883bf640 1 -- 172.21.15.137:0/3073181389 wait complete. 2024-04-26T21:59:09.293 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:09.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.390+0000 7fc7224b0640 1 Processor -- start 2024-04-26T21:59:09.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.390+0000 7fc7224b0640 1 -- start start 2024-04-26T21:59:09.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc7224b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 0x7fc71c0ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc7224b0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc71c160d50 0x7fc71c1611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc7224b0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71c0d0be0 con 0x7fc71c0b56d0 2024-04-26T21:59:09.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc7224b0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc71c0d0ec0 con 0x7fc71c160d50 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc7224b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c0d11a0 con 0x7fc71c15d380 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc71bfff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 0x7fc71c0ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc720a4d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc71c160d50 0x7fc71c1611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc720a4d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc71c160d50 0x7fc71c1611e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:60010/0 (socket says 172.21.15.137:60010) 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc71b7fe640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc71c0b56d0 0x7fc71c0d19a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:53078/0 (socket says 172.21.15.137:53078) 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc71bfff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 0x7fc71c0ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:59390/0 (socket says 172.21.15.137:59390) 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc720a4d640 1 -- 172.21.15.137:0/2507763002 learned_addr learned my addr 172.21.15.137:0/2507763002 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc720a4d640 1 -- 172.21.15.137:0/2507763002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 msgr2=0x7fc71c0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc720a4d640 1 --2- 172.21.15.137:0/2507763002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 0x7fc71c0ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc720a4d640 1 -- 172.21.15.137:0/2507763002 >> v1:172.21.15.170:6789/0 conn(0x7fc71c0b56d0 legacy=0x7fc71c0d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.391+0000 7fc720a4d640 1 -- 172.21.15.137:0/2507763002 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c0d1480 con 0x7fc71c160d50 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.392+0000 7fc720a4d640 1 --2- 172.21.15.137:0/2507763002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc71c160d50 0x7fc71c1611e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc714009e50 tx=0x7fc71402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=214fea1a05e59efc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.392+0000 7fc71affd640 1 -- 172.21.15.137:0/2507763002 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714036070 con 0x7fc71c160d50 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.392+0000 7fc71affd640 1 -- 172.21.15.137:0/2507763002 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714031600 con 0x7fc71c160d50 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.392+0000 7fc71affd640 1 -- 172.21.15.137:0/2507763002 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7140319d0 con 0x7fc71c160d50 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.393+0000 7fc7224b0640 1 -- 172.21.15.137:0/2507763002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc71c160d50 msgr2=0x7fc71c1611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.393+0000 7fc7224b0640 1 --2- 172.21.15.137:0/2507763002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc71c160d50 0x7fc71c1611e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc714009e50 tx=0x7fc71402a680 comp rx=0 tx=0).stop 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.393+0000 7fc7224b0640 1 -- 172.21.15.137:0/2507763002 shutdown_connections 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.393+0000 7fc7224b0640 1 --2- 172.21.15.137:0/2507763002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc71c160d50 0x7fc71c1611e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.393+0000 7fc7224b0640 1 --2- 172.21.15.137:0/2507763002 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 0x7fc71c0ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.393+0000 7fc7224b0640 1 -- 172.21.15.137:0/2507763002 >> 172.21.15.137:0/2507763002 conn(0x7fc71c0b4a60 msgr2=0x7fc71c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.393+0000 7fc7224b0640 1 -- 172.21.15.137:0/2507763002 shutdown_connections 2024-04-26T21:59:09.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.393+0000 7fc7224b0640 1 -- 172.21.15.137:0/2507763002 wait complete. 2024-04-26T21:59:09.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.394+0000 7fc7224b0640 1 Processor -- start 2024-04-26T21:59:09.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.394+0000 7fc7224b0640 1 -- start start 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc7224b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc71c0b56d0 0x7fc71c148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc7224b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 0x7fc71c15f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc7224b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71c160d50 0x7fc71c0cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc7224b0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0b5dc0 con 0x7fc71c160d50 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc7224b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c0cedc0 con 0x7fc71c0b56d0 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc7224b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c0b5f40 con 0x7fc71c15d380 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc720a4d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71c160d50 0x7fc71c0cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc720a4d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71c160d50 0x7fc71c0cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49960/0 (socket says 172.21.15.137:49960) 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc720a4d640 1 -- 172.21.15.137:0/3872632878 learned_addr learned my addr 172.21.15.137:0/3872632878 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc71bfff640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc71c0b56d0 0x7fc71c148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc71b7fe640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 0x7fc71c15f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc720a4d640 1 -- 172.21.15.137:0/3872632878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 msgr2=0x7fc71c15f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc720a4d640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 0x7fc71c15f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc720a4d640 1 -- 172.21.15.137:0/3872632878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc71c0b56d0 msgr2=0x7fc71c148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc720a4d640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc71c0b56d0 0x7fc71c148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.395+0000 7fc720a4d640 1 -- 172.21.15.137:0/3872632878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c148ac0 con 0x7fc71c160d50 2024-04-26T21:59:09.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.396+0000 7fc720a4d640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71c160d50 0x7fc71c0cb360 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc714009e50 tx=0x7fc714004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.396+0000 7fc718ff9640 1 -- 172.21.15.137:0/3872632878 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714041020 con 0x7fc71c160d50 2024-04-26T21:59:09.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.396+0000 7fc718ff9640 1 -- 172.21.15.137:0/3872632878 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714007820 con 0x7fc71c160d50 2024-04-26T21:59:09.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.396+0000 7fc718ff9640 1 -- 172.21.15.137:0/3872632878 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714036040 con 0x7fc71c160d50 2024-04-26T21:59:09.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.396+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c149240 con 0x7fc71c160d50 2024-04-26T21:59:09.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.396+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c149800 con 0x7fc71c160d50 2024-04-26T21:59:09.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.397+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71c06cdd0 con 0x7fc71c160d50 2024-04-26T21:59:09.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.397+0000 7fc718ff9640 1 -- 172.21.15.137:0/3872632878 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc714044020 con 0x7fc71c160d50 2024-04-26T21:59:09.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.398+0000 7fc718ff9640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc70806c8f0 0x7fc70806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.398+0000 7fc718ff9640 1 -- 172.21.15.137:0/3872632878 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc7140ac810 con 0x7fc71c160d50 2024-04-26T21:59:09.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.398+0000 7fc71bfff640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc70806c8f0 0x7fc70806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.398+0000 7fc71bfff640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc70806c8f0 0x7fc70806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009a10 tx=0x7fc70c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.402+0000 7fc718ff9640 1 -- 172.21.15.137:0/3872632878 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc71c06cdd0 con 0x7fc71c160d50 2024-04-26T21:59:09.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.577+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc71c06a290 con 0x7fc71c160d50 2024-04-26T21:59:09.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.580+0000 7fc718ff9640 1 -- 172.21.15.137:0/3872632878 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fc71404b030 con 0x7fc71c160d50 2024-04-26T21:59:09.580 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:09.580 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:09.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc70806c8f0 msgr2=0x7fc70806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc70806c8f0 0x7fc70806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009a10 tx=0x7fc70c008040 comp rx=0 tx=0).stop 2024-04-26T21:59:09.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71c160d50 msgr2=0x7fc71c0cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71c160d50 0x7fc71c0cb360 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc714009e50 tx=0x7fc714004a40 comp rx=0 tx=0).stop 2024-04-26T21:59:09.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 shutdown_connections 2024-04-26T21:59:09.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc70806c8f0 0x7fc70806edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc71c160d50 0x7fc71c0cb360 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc71c15d380 0x7fc71c15f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 --2- 172.21.15.137:0/3872632878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc71c0b56d0 0x7fc71c148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 >> 172.21.15.137:0/3872632878 conn(0x7fc71c0b4a60 msgr2=0x7fc71c161160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:09.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 shutdown_connections 2024-04-26T21:59:09.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.582+0000 7fc7224b0640 1 -- 172.21.15.137:0/3872632878 wait complete. 2024-04-26T21:59:09.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:09.594 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:09.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.694+0000 7f566e540640 1 Processor -- start 2024-04-26T21:59:09.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.694+0000 7f566e540640 1 -- start start 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566e540640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f566806f340 0x7f56680b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566e540640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f56680d0300 0x7f566806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566e540640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56680b3e50 0x7f56680720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566e540640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f566806fc60 con 0x7f56680b3e50 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566e540640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f56680b46a0 con 0x7f56680d0300 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566e540640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56680b5db0 con 0x7f566806f340 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566cadd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56680b3e50 0x7f56680720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566cadd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f56680b3e50 0x7f56680720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49966/0 (socket says 172.21.15.137:49966) 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566cadd640 1 -- 172.21.15.137:0/3808601034 learned_addr learned my addr 172.21.15.137:0/3808601034 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:09.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f56677fe640 1 --2- 172.21.15.137:0/3808601034 >> v2:172.21.15.170:3300/0 conn(0x7f56680d0300 0x7f566806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f5667fff640 1 --2- 172.21.15.137:0/3808601034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f566806f340 0x7f56680b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566cadd640 1 -- 172.21.15.137:0/3808601034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f566806f340 msgr2=0x7f56680b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566cadd640 1 --2- 172.21.15.137:0/3808601034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f566806f340 0x7f56680b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566cadd640 1 -- 172.21.15.137:0/3808601034 >> v2:172.21.15.170:3300/0 conn(0x7f56680d0300 msgr2=0x7f566806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566cadd640 1 --2- 172.21.15.137:0/3808601034 >> v2:172.21.15.170:3300/0 conn(0x7f56680d0300 0x7f566806f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.695+0000 7f566cadd640 1 -- 172.21.15.137:0/3808601034 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56680b6090 con 0x7f56680b3e50 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566cadd640 1 --2- 172.21.15.137:0/3808601034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 0x7f56680720f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f56680b3c10 tx=0x7f566002c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5ca2d7a61d0e23 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f5666ffd640 1 -- 172.21.15.137:0/3808601034 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660009600 con 0x7f56680b3e50 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f5666ffd640 1 -- 172.21.15.137:0/3808601034 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56600097a0 con 0x7f56680b3e50 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f5666ffd640 1 -- 172.21.15.137:0/3808601034 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660009b70 con 0x7f56680b3e50 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566e540640 1 -- 172.21.15.137:0/3808601034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 msgr2=0x7f56680720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566e540640 1 --2- 172.21.15.137:0/3808601034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 0x7f56680720f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f56680b3c10 tx=0x7f566002c780 comp rx=0 tx=0).stop 2024-04-26T21:59:09.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566e540640 1 -- 172.21.15.137:0/3808601034 shutdown_connections 2024-04-26T21:59:09.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566e540640 1 --2- 172.21.15.137:0/3808601034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 0x7f56680720f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566e540640 1 --2- 172.21.15.137:0/3808601034 >> v2:172.21.15.170:3300/0 conn(0x7f56680d0300 0x7f566806f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566e540640 1 --2- 172.21.15.137:0/3808601034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f566806f340 0x7f56680b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566e540640 1 -- 172.21.15.137:0/3808601034 >> 172.21.15.137:0/3808601034 conn(0x7f56680cd8a0 msgr2=0x7f56680cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:09.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566e540640 1 -- 172.21.15.137:0/3808601034 shutdown_connections 2024-04-26T21:59:09.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.696+0000 7f566e540640 1 -- 172.21.15.137:0/3808601034 wait complete. 2024-04-26T21:59:09.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.698+0000 7f566e540640 1 Processor -- start 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.698+0000 7f566e540640 1 -- start start 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.698+0000 7f566e540640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f566806f340 0x7f566815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.698+0000 7f566e540640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 0x7f566815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.698+0000 7f566e540640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56680d0300 0x7f56680cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.698+0000 7f566e540640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f56680b42e0 con 0x7f56680b3e50 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.698+0000 7f566e540640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f56680b6650 con 0x7f566806f340 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.698+0000 7f566e540640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56680b4460 con 0x7f56680d0300 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f56677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 0x7f566815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f56677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 0x7f566815a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49982/0 (socket says 172.21.15.137:49982) 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f56677fe640 1 -- 172.21.15.137:0/158541988 learned_addr learned my addr 172.21.15.137:0/158541988 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f566cadd640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56680d0300 0x7f56680cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f5667fff640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f566806f340 0x7f566815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f56677fe640 1 -- 172.21.15.137:0/158541988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56680d0300 msgr2=0x7f56680cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f56677fe640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56680d0300 0x7f56680cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f56677fe640 1 -- 172.21.15.137:0/158541988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f566806f340 msgr2=0x7f566815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f56677fe640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f566806f340 0x7f566815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f56677fe640 1 -- 172.21.15.137:0/158541988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566815d220 con 0x7f56680b3e50 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f5667fff640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f566806f340 0x7f566815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f56677fe640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 0x7f566815a960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f565c00d830 tx=0x7f565c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f5664ff9640 1 -- 172.21.15.137:0/158541988 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c00b6c0 con 0x7f56680b3e50 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f5664ff9640 1 -- 172.21.15.137:0/158541988 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c019070 con 0x7f56680b3e50 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566815d4c0 con 0x7f56680b3e50 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f5664ff9640 1 -- 172.21.15.137:0/158541988 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c00ba80 con 0x7f56680b3e50 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.699+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f566815da80 con 0x7f56680b3e50 2024-04-26T21:59:09.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.700+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f566806a290 con 0x7f56680b3e50 2024-04-26T21:59:09.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.701+0000 7f5664ff9640 1 -- 172.21.15.137:0/158541988 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f565c01e460 con 0x7f56680b3e50 2024-04-26T21:59:09.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.701+0000 7f5664ff9640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565406c8f0 0x7f565406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.701+0000 7f5664ff9640 1 -- 172.21.15.137:0/158541988 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f565c08c050 con 0x7f56680b3e50 2024-04-26T21:59:09.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.701+0000 7f5667fff640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565406c8f0 0x7f565406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.701+0000 7f5667fff640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565406c8f0 0x7f565406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5658006fd0 tx=0x7f5658008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.705+0000 7f5664ff9640 1 -- 172.21.15.137:0/158541988 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f565c05a510 con 0x7f56680b3e50 2024-04-26T21:59:09.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.879+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5668142db0 con 0x7f56680b3e50 2024-04-26T21:59:09.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.879+0000 7f5664ff9640 1 -- 172.21.15.137:0/158541988 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f565c059e10 con 0x7f56680b3e50 2024-04-26T21:59:09.880 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565406c8f0 msgr2=0x7f565406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565406c8f0 0x7f565406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5658006fd0 tx=0x7f5658008040 comp rx=0 tx=0).stop 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 msgr2=0x7f566815a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 0x7f566815a960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f565c00d830 tx=0x7f565c00dcf0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 shutdown_connections 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565406c8f0 0x7f565406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56680b3e50 0x7f566815a960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56680d0300 0x7f56680cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 --2- 172.21.15.137:0/158541988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f566806f340 0x7f566815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 >> 172.21.15.137:0/158541988 conn(0x7f56680cd8a0 msgr2=0x7f5668145470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 shutdown_connections 2024-04-26T21:59:09.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.881+0000 7f566e540640 1 -- 172.21.15.137:0/158541988 wait complete. 2024-04-26T21:59:09.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:09.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.992+0000 7efdc3f46640 1 Processor -- start 2024-04-26T21:59:09.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.992+0000 7efdc3f46640 1 -- start start 2024-04-26T21:59:09.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.993+0000 7efdc3f46640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efdbc06db10 0x7efdbc16a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.993+0000 7efdc3f46640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc09c700 con 0x7efdbc0d0010 2024-04-26T21:59:09.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.993+0000 7efdc3f46640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc0d1c50 con 0x7efdbc0b3c20 2024-04-26T21:59:09.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.993+0000 7efdc3f46640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7efdbc0b4480 con 0x7efdbc06db10 2024-04-26T21:59:09.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.993+0000 7efdc1ce2640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7efdbc0d0010 0x7efdbc0b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48444/0 (socket says 172.21.15.137:48444) 2024-04-26T21:59:09.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.993+0000 7efdc1ce2640 1 -- 172.21.15.137:0/3704265286 learned_addr learned my addr 172.21.15.137:0/3704265286 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:09.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.993+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876610457 0 0) 0x7efdbc09c700 con 0x7efdbc0d0010 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.993+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda8003520 con 0x7efdbc0d0010 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.993+0000 7efdc24e3640 1 --2- 172.21.15.137:0/3704265286 >> v2:172.21.15.170:3300/0 conn(0x7efdbc06db10 0x7efdbc16a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2783038686 0 0) 0x7efda8003520 con 0x7efdbc0d0010 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 >> v2:172.21.15.170:3300/0 conn(0x7efdbc06db10 msgr2=0x7efdbc16a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 --2- 172.21.15.137:0/3704265286 >> v2:172.21.15.170:3300/0 conn(0x7efdbc06db10 0x7efdbc16a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 >> v1:172.21.15.170:6789/0 conn(0x7efdbc0b3c20 legacy=0x7efdbc0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc0d1f30 con 0x7efdbc0d0010 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7efdb8001670 con 0x7efdbc0d0010 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 >> v1:172.21.15.137:6789/0 conn(0x7efdbc0d0010 legacy=0x7efdbc0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80039b0 0x7efda8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efda8004800 0x7efda8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda80051c0 0x7efda800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc0b4480 con 0x7efda80051c0 2024-04-26T21:59:09.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efda800c060 con 0x7efda80039b0 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efda800c260 con 0x7efda8004800 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc24e3640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda80051c0 0x7efda800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc1ce2640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80039b0 0x7efda8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc14e1640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efda8004800 0x7efda8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc24e3640 1 -- 172.21.15.137:0/3704265286 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efda8004800 msgr2=0x7efda8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc24e3640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efda8004800 0x7efda8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc24e3640 1 -- 172.21.15.137:0/3704265286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80039b0 msgr2=0x7efda8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc24e3640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80039b0 0x7efda8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc24e3640 1 -- 172.21.15.137:0/3704265286 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda8003520 con 0x7efda80051c0 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.994+0000 7efdc14e1640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efda8004800 0x7efda8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc24e3640 1 -- 172.21.15.137:0/3704265286 reap_dead start 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc24e3640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda80051c0 0x7efda800b9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009fc0 tx=0x7efda8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2224bb76aac41fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4035020 con 0x7efda80051c0 2024-04-26T21:59:09.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb4003bd0 con 0x7efda80051c0 2024-04-26T21:59:09.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc0ce0640 1 -- 172.21.15.137:0/3704265286 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4009c10 con 0x7efda80051c0 2024-04-26T21:59:09.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc3f46640 1 -- 172.21.15.137:0/3704265286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda80051c0 msgr2=0x7efda800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:09.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc3f46640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda80051c0 0x7efda800b9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009fc0 tx=0x7efda8005830 comp rx=0 tx=0).stop 2024-04-26T21:59:09.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc3f46640 1 -- 172.21.15.137:0/3704265286 shutdown_connections 2024-04-26T21:59:09.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc3f46640 1 --2- 172.21.15.137:0/3704265286 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efda80051c0 0x7efda800b9c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:09.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.995+0000 7efdc3f46640 1 -- 172.21.15.137:0/3704265286 >> 172.21.15.137:0/3704265286 conn(0x7efdbc09ba40 msgr2=0x7efdbc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:09.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.996+0000 7efdc3f46640 1 -- 172.21.15.137:0/3704265286 shutdown_connections 2024-04-26T21:59:09.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.996+0000 7efdc3f46640 1 -- 172.21.15.137:0/3704265286 wait complete. 2024-04-26T21:59:10.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc3f46640 1 Processor -- start 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc3f46640 1 -- start start 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc3f46640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80051c0 0x7efdbc09fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc3f46640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdbc14df40 0x7efdbc14e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc3f46640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc15af60 0x7efdbc15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc3f46640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc0b2e50 con 0x7efdbc15af60 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc3f46640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc0b2cd0 con 0x7efda80051c0 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc3f46640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efdbc0b2fd0 con 0x7efdbc14df40 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc24e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc15af60 0x7efdbc15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc24e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc15af60 0x7efdbc15b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49996/0 (socket says 172.21.15.137:49996) 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.997+0000 7efdc24e3640 1 -- 172.21.15.137:0/3462277005 learned_addr learned my addr 172.21.15.137:0/3462277005 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:10.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc14e1640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdbc14df40 0x7efdbc14e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc1ce2640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80051c0 0x7efdbc09fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc24e3640 1 -- 172.21.15.137:0/3462277005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdbc14df40 msgr2=0x7efdbc14e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc24e3640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdbc14df40 0x7efdbc14e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc24e3640 1 -- 172.21.15.137:0/3462277005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80051c0 msgr2=0x7efdbc09fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc24e3640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80051c0 0x7efdbc09fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc24e3640 1 -- 172.21.15.137:0/3462277005 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc09cff0 con 0x7efdbc15af60 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc1ce2640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80051c0 0x7efdbc09fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc24e3640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc15af60 0x7efdbc15b3e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efdb402af10 tx=0x7efdb4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdb27fc640 1 -- 172.21.15.137:0/3462277005 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4035030 con 0x7efdbc15af60 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdb27fc640 1 -- 172.21.15.137:0/3462277005 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb4043070 con 0x7efdbc15af60 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdbc14e900 con 0x7efdbc15af60 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdb27fc640 1 -- 172.21.15.137:0/3462277005 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb402d070 con 0x7efdbc15af60 2024-04-26T21:59:10.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.998+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdbc09d540 con 0x7efdbc15af60 2024-04-26T21:59:10.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.999+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdbc06a290 con 0x7efdbc15af60 2024-04-26T21:59:10.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:09.999+0000 7efdb27fc640 1 -- 172.21.15.137:0/3462277005 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efdb4005d10 con 0x7efdbc15af60 2024-04-26T21:59:10.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.000+0000 7efdb27fc640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efda006c8f0 0x7efda006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.000+0000 7efdc1ce2640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efda006c8f0 0x7efda006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.000+0000 7efdb27fc640 1 -- 172.21.15.137:0/3462277005 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efdb40ac7d0 con 0x7efdbc15af60 2024-04-26T21:59:10.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.000+0000 7efdc1ce2640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efda006c8f0 0x7efda006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efdb8001eb0 tx=0x7efdb8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.004+0000 7efdb27fc640 1 -- 172.21.15.137:0/3462277005 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efdb407a590 con 0x7efdbc15af60 2024-04-26T21:59:10.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.177+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efdbc068e00 con 0x7efdbc15af60 2024-04-26T21:59:10.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.178+0000 7efdb27fc640 1 -- 172.21.15.137:0/3462277005 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7efdb407e890 con 0x7efdbc15af60 2024-04-26T21:59:10.178 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:10.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efda006c8f0 msgr2=0x7efda006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efda006c8f0 0x7efda006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efdb8001eb0 tx=0x7efdb8009040 comp rx=0 tx=0).stop 2024-04-26T21:59:10.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc15af60 msgr2=0x7efdbc15b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc15af60 0x7efdbc15b3e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efdb402af10 tx=0x7efdb4009750 comp rx=0 tx=0).stop 2024-04-26T21:59:10.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 shutdown_connections 2024-04-26T21:59:10.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efda006c8f0 0x7efda006edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efdbc15af60 0x7efdbc15b3e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efdbc14df40 0x7efdbc14e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 --2- 172.21.15.137:0/3462277005 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efda80051c0 0x7efdbc09fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 >> 172.21.15.137:0/3462277005 conn(0x7efdbc09ba40 msgr2=0x7efdbc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:10.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 shutdown_connections 2024-04-26T21:59:10.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.180+0000 7efdc3f46640 1 -- 172.21.15.137:0/3462277005 wait complete. 2024-04-26T21:59:10.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.291+0000 7feaeb4c5640 1 Processor -- start 2024-04-26T21:59:10.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.291+0000 7feaeb4c5640 1 -- start start 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feaeb4c5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feae40d0090 0x7feae40ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feaeb4c5640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae40d07e0 con 0x7feae4160950 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feaeb4c5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae40d2090 con 0x7feae40b1ef0 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feaeb4c5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7feae409c700 con 0x7feae40d0090 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feae9261640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7feae4160950 0x7feae40cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48460/0 (socket says 172.21.15.137:48460) 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feae9261640 1 -- 172.21.15.137:0/259849621 learned_addr learned my addr 172.21.15.137:0/259849621 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feae8a60640 1 --2- 172.21.15.137:0/259849621 >> v2:172.21.15.170:3300/0 conn(0x7feae40d0090 0x7feae40ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707334947 0 0) 0x7feae40d07e0 con 0x7feae4160950 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead0003520 con 0x7feae4160950 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 508723903 0 0) 0x7fead0003520 con 0x7feae4160950 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 >> v2:172.21.15.170:3300/0 conn(0x7feae40d0090 msgr2=0x7feae40ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 --2- 172.21.15.137:0/259849621 >> v2:172.21.15.170:3300/0 conn(0x7feae40d0090 0x7feae40ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 >> v1:172.21.15.170:6789/0 conn(0x7feae40b1ef0 legacy=0x7feae40ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae40d1a40 con 0x7feae4160950 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7feae0001670 con 0x7feae4160950 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 >> v1:172.21.15.137:6789/0 conn(0x7feae4160950 legacy=0x7feae40cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039b0 0x7fead0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fead0004800 0x7fead0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00051c0 0x7fead000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feae409c700 con 0x7fead00039b0 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fead000c060 con 0x7fead00051c0 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fead000c260 con 0x7fead0004800 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.292+0000 7feae9261640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039b0 0x7fead0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae8a60640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fead0004800 0x7fead0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae9a62640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00051c0 0x7fead000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae9261640 1 -- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fead0004800 msgr2=0x7fead0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:10.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae9261640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fead0004800 0x7fead0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae9261640 1 -- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00051c0 msgr2=0x7fead000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae9261640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00051c0 0x7fead000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae9261640 1 -- 172.21.15.137:0/259849621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead0003520 con 0x7fead00039b0 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae9a62640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00051c0 0x7fead000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae8a60640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fead0004800 0x7fead0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae9a62640 1 -- 172.21.15.137:0/259849621 reap_dead start 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feae9261640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039b0 0x7fead0003dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feae000c210 tx=0x7fead0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a854e3b199105faa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0007d30 con 0x7fead00039b0 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae0005ad0 con 0x7fead00039b0 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.293+0000 7feadbfff640 1 -- 172.21.15.137:0/259849621 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0007070 con 0x7fead00039b0 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.294+0000 7feaeb4c5640 1 -- 172.21.15.137:0/259849621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039b0 msgr2=0x7fead0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.294+0000 7feaeb4c5640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039b0 0x7fead0003dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7feae000c210 tx=0x7fead0005830 comp rx=0 tx=0).stop 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.294+0000 7feaeb4c5640 1 -- 172.21.15.137:0/259849621 shutdown_connections 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.294+0000 7feaeb4c5640 1 --2- 172.21.15.137:0/259849621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fead00039b0 0x7fead0003dd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.294+0000 7feaeb4c5640 1 -- 172.21.15.137:0/259849621 >> 172.21.15.137:0/259849621 conn(0x7feae409ba40 msgr2=0x7feae409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:10.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.294+0000 7feaeb4c5640 1 -- 172.21.15.137:0/259849621 shutdown_connections 2024-04-26T21:59:10.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.294+0000 7feaeb4c5640 1 -- 172.21.15.137:0/259849621 wait complete. 2024-04-26T21:59:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.295+0000 7feaeb4c5640 1 Processor -- start 2024-04-26T21:59:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.295+0000 7feaeb4c5640 1 -- start start 2024-04-26T21:59:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feaeb4c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00039b0 0x7feae40a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feaeb4c5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feae40c7f70 0x7feae40a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feaeb4c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feae41f1f30 0x7feae41f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feaeb4c5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feae40b28f0 con 0x7feae40c7f70 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feaeb4c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feae4160d30 con 0x7fead00039b0 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feaeb4c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feae40b2a70 con 0x7feae41f1f30 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae8a60640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feae40c7f70 0x7feae40a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae8a60640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feae40c7f70 0x7feae40a09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50014/0 (socket says 172.21.15.137:50014) 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae8a60640 1 -- 172.21.15.137:0/89999010 learned_addr learned my addr 172.21.15.137:0/89999010 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae9a62640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feae41f1f30 0x7feae41f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae9261640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00039b0 0x7feae40a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae8a60640 1 -- 172.21.15.137:0/89999010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feae41f1f30 msgr2=0x7feae41f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae8a60640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feae41f1f30 0x7feae41f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae8a60640 1 -- 172.21.15.137:0/89999010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00039b0 msgr2=0x7feae40a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae8a60640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00039b0 0x7feae40a0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae8a60640 1 -- 172.21.15.137:0/89999010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae40c8410 con 0x7feae40c7f70 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae9a62640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feae41f1f30 0x7feae41f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:10.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.296+0000 7feae8a60640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feae40c7f70 0x7feae40a09d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fead40114e0 tx=0x7fead40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.297+0000 7fead9ffb640 1 -- 172.21.15.137:0/89999010 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4015870 con 0x7feae40c7f70 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.297+0000 7fead9ffb640 1 -- 172.21.15.137:0/89999010 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead4015a10 con 0x7feae40c7f70 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.297+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae40c86f0 con 0x7feae40c7f70 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.297+0000 7fead9ffb640 1 -- 172.21.15.137:0/89999010 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4015e00 con 0x7feae40c7f70 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.297+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae40c8cb0 con 0x7feae40c7f70 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.298+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae406a290 con 0x7feae40c7f70 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.298+0000 7fead9ffb640 1 -- 172.21.15.137:0/89999010 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fead401d400 con 0x7feae40c7f70 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.299+0000 7fead9ffb640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feac806c920 0x7feac806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.299+0000 7fead9ffb640 1 -- 172.21.15.137:0/89999010 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fead408c350 con 0x7feae40c7f70 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.299+0000 7feae9261640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feac806c920 0x7feac806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.299+0000 7feae9261640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feac806c920 0x7feac806ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feae0033000 tx=0x7feae002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.303+0000 7fead9ffb640 1 -- 172.21.15.137:0/89999010 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fead4019030 con 0x7feae40c7f70 2024-04-26T21:59:10.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.479+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feae414be90 con 0x7feae40c7f70 2024-04-26T21:59:10.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.479+0000 7fead9ffb640 1 -- 172.21.15.137:0/89999010 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fead405a780 con 0x7feae40c7f70 2024-04-26T21:59:10.479 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:10.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feac806c920 msgr2=0x7feac806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feac806c920 0x7feac806ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feae0033000 tx=0x7feae002e000 comp rx=0 tx=0).stop 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feae40c7f70 msgr2=0x7feae40a09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feae40c7f70 0x7feae40a09d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fead40114e0 tx=0x7fead40119a0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 shutdown_connections 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7feac806c920 0x7feac806ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feae40c7f70 0x7feae40a09d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feae41f1f30 0x7feae41f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 --2- 172.21.15.137:0/89999010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fead00039b0 0x7feae40a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 >> 172.21.15.137:0/89999010 conn(0x7feae409ba40 msgr2=0x7feae40d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 shutdown_connections 2024-04-26T21:59:10.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.481+0000 7feaeb4c5640 1 -- 172.21.15.137:0/89999010 wait complete. 2024-04-26T21:59:10.526 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-26T21:59:10.526 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:10.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.624+0000 7f9c4ac15640 1 Processor -- start 2024-04-26T21:59:10.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.624+0000 7f9c4ac15640 1 -- start start 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c4ac15640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 0x7f9c4406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c4ac15640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9c440b44e0 0x7f9c440ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c4ac15640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9c4406d2b0 0x7f9c4406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c4ac15640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9c4406dc60 con 0x7f9c4406d2b0 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c4ac15640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9c4406eeb0 con 0x7f9c440b44e0 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c4ac15640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9c440b4a10 con 0x7f9c4415f1e0 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c491b2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9c4406d2b0 0x7f9c4406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c491b2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9c4406d2b0 0x7f9c4406d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50028/0 (socket says 172.21.15.137:50028) 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c491b2640 1 -- 172.21.15.137:0/3030613889 learned_addr learned my addr 172.21.15.137:0/3030613889 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c43fff640 1 --2- 172.21.15.137:0/3030613889 >> v2:172.21.15.170:3300/0 conn(0x7f9c440b44e0 0x7f9c440ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c491b2640 1 -- 172.21.15.137:0/3030613889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 msgr2=0x7f9c4406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:10.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c491b2640 1 --2- 172.21.15.137:0/3030613889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 0x7f9c4406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c491b2640 1 -- 172.21.15.137:0/3030613889 >> v2:172.21.15.170:3300/0 conn(0x7f9c440b44e0 msgr2=0x7f9c440ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:10.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c491b2640 1 --2- 172.21.15.137:0/3030613889 >> v2:172.21.15.170:3300/0 conn(0x7f9c440b44e0 0x7f9c440ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.625+0000 7f9c491b2640 1 -- 172.21.15.137:0/3030613889 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c440b4cf0 con 0x7f9c4406d2b0 2024-04-26T21:59:10.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.626+0000 7f9c491b2640 1 --2- 172.21.15.137:0/3030613889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 0x7f9c4406d720 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9c440741b0 tx=0x7f9c3c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94311a0df6891599 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.626+0000 7f9c437fe640 1 -- 172.21.15.137:0/3030613889 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c036070 con 0x7f9c4406d2b0 2024-04-26T21:59:10.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.626+0000 7f9c437fe640 1 -- 172.21.15.137:0/3030613889 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3c031600 con 0x7f9c4406d2b0 2024-04-26T21:59:10.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.626+0000 7f9c437fe640 1 -- 172.21.15.137:0/3030613889 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0319d0 con 0x7f9c4406d2b0 2024-04-26T21:59:10.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.627+0000 7f9c4ac15640 1 -- 172.21.15.137:0/3030613889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 msgr2=0x7f9c4406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.627+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/3030613889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 0x7f9c4406d720 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9c440741b0 tx=0x7f9c3c02a6a0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.627+0000 7f9c4ac15640 1 -- 172.21.15.137:0/3030613889 shutdown_connections 2024-04-26T21:59:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.627+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/3030613889 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 0x7f9c4406d720 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.627+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/3030613889 >> v2:172.21.15.170:3300/0 conn(0x7f9c440b44e0 0x7f9c440ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.627+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/3030613889 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 0x7f9c4406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.627+0000 7f9c4ac15640 1 -- 172.21.15.137:0/3030613889 >> 172.21.15.137:0/3030613889 conn(0x7f9c440728a0 msgr2=0x7f9c44072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.627+0000 7f9c4ac15640 1 -- 172.21.15.137:0/3030613889 shutdown_connections 2024-04-26T21:59:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.627+0000 7f9c4ac15640 1 -- 172.21.15.137:0/3030613889 wait complete. 2024-04-26T21:59:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.628+0000 7f9c4ac15640 1 Processor -- start 2024-04-26T21:59:10.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.628+0000 7f9c4ac15640 1 -- start start 2024-04-26T21:59:10.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c4ac15640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 0x7f9c44155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c4ac15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c440b44e0 0x7f9c441578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c4ac15640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 0x7f9c44157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c4ac15640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440b5590 con 0x7f9c4406d2b0 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c4ac15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440b52b0 con 0x7f9c440b44e0 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c4ac15640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9c440aedf0 con 0x7f9c4415f1e0 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c489b1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 0x7f9c44155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c489b1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 0x7f9c44155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50032/0 (socket says 172.21.15.137:50032) 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c489b1640 1 -- 172.21.15.137:0/1005265349 learned_addr learned my addr 172.21.15.137:0/1005265349 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c491b2640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 0x7f9c44157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c43fff640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c440b44e0 0x7f9c441578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c489b1640 1 -- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 msgr2=0x7f9c44157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c489b1640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 0x7f9c44157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c489b1640 1 -- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c440b44e0 msgr2=0x7f9c441578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c489b1640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c440b44e0 0x7f9c441578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c489b1640 1 -- 172.21.15.137:0/1005265349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4415d550 con 0x7f9c4406d2b0 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c491b2640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 0x7f9c44157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c43fff640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c440b44e0 0x7f9c441578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c489b1640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 0x7f9c44155cd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400b4d0 tx=0x7f9c3400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.629+0000 7f9c417fa640 1 -- 172.21.15.137:0/1005265349 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c34014070 con 0x7f9c4406d2b0 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.630+0000 7f9c417fa640 1 -- 172.21.15.137:0/1005265349 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c34010870 con 0x7f9c4406d2b0 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.630+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4415d830 con 0x7f9c4406d2b0 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.630+0000 7f9c417fa640 1 -- 172.21.15.137:0/1005265349 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c34010c60 con 0x7f9c4406d2b0 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.630+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4415ddf0 con 0x7f9c4406d2b0 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.631+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4406a290 con 0x7f9c4406d2b0 2024-04-26T21:59:10.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.631+0000 7f9c417fa640 1 -- 172.21.15.137:0/1005265349 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c34017070 con 0x7f9c4406d2b0 2024-04-26T21:59:10.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.631+0000 7f9c417fa640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c3006c8f0 0x7f9c3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.631+0000 7f9c417fa640 1 -- 172.21.15.137:0/1005265349 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9c3408b980 con 0x7f9c4406d2b0 2024-04-26T21:59:10.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.631+0000 7f9c43fff640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c3006c8f0 0x7f9c3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.632+0000 7f9c43fff640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c3006c8f0 0x7f9c3006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9c4406ca90 tx=0x7f9c38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.636+0000 7f9c417fa640 1 -- 172.21.15.137:0/1005265349 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9c34059db0 con 0x7f9c4406d2b0 2024-04-26T21:59:10.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.814+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c440d0bf0 con 0x7f9c4406d2b0 2024-04-26T21:59:10.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.815+0000 7f9c417fa640 1 -- 172.21.15.137:0/1005265349 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f9c340596b0 con 0x7f9c4406d2b0 2024-04-26T21:59:10.815 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:10.815 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c3006c8f0 msgr2=0x7f9c3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c3006c8f0 0x7f9c3006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9c4406ca90 tx=0x7f9c38008040 comp rx=0 tx=0).stop 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 msgr2=0x7f9c44155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 0x7f9c44155cd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400b4d0 tx=0x7f9c3400b990 comp rx=0 tx=0).stop 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 shutdown_connections 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c3006c8f0 0x7f9c3006edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9c4415f1e0 0x7f9c44157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c440b44e0 0x7f9c441578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 --2- 172.21.15.137:0/1005265349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c4406d2b0 0x7f9c44155cd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 >> 172.21.15.137:0/1005265349 conn(0x7f9c440728a0 msgr2=0x7f9c440708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 shutdown_connections 2024-04-26T21:59:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.817+0000 7f9c4ac15640 1 -- 172.21.15.137:0/1005265349 wait complete. 2024-04-26T21:59:10.829 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:10.829 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.933+0000 7f3de63c6640 1 Processor -- start 2024-04-26T21:59:10.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.933+0000 7f3de63c6640 1 -- start start 2024-04-26T21:59:10.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.933+0000 7f3de63c6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de0159cf0 0x7f3de0070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.933+0000 7f3de63c6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3de00712f0 0x7f3de0073150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.933+0000 7f3de63c6640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de006f4d0 con 0x7f3de0073690 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.933+0000 7f3de63c6640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3de006f7b0 con 0x7f3de00712f0 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.933+0000 7f3de63c6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3de006fa90 con 0x7f3de0159cf0 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.933+0000 7f3ddf7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3de00712f0 0x7f3de0073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.933+0000 7f3de4963640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3de0073690 0x7f3de015fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48472/0 (socket says 172.21.15.137:48472) 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.934+0000 7f3de4963640 1 -- 172.21.15.137:0/2816510720 learned_addr learned my addr 172.21.15.137:0/2816510720 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.934+0000 7f3ddffff640 1 --2- 172.21.15.137:0/2816510720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de0159cf0 0x7f3de0070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.934+0000 7f3ddf7fe640 1 -- 172.21.15.137:0/2816510720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de0159cf0 msgr2=0x7f3de0070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.934+0000 7f3ddf7fe640 1 --2- 172.21.15.137:0/2816510720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de0159cf0 0x7f3de0070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.934+0000 7f3ddf7fe640 1 -- 172.21.15.137:0/2816510720 >> v1:172.21.15.137:6789/0 conn(0x7f3de0073690 legacy=0x7f3de015fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.934+0000 7f3ddf7fe640 1 -- 172.21.15.137:0/2816510720 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de006fd70 con 0x7f3de00712f0 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.934+0000 7f3ddeffd640 1 -- 172.21.15.137:0/2816510720 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329844268 0 0) 0x7f3de006f4d0 con 0x7f3de0073690 2024-04-26T21:59:10.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.934+0000 7f3ddf7fe640 1 --2- 172.21.15.137:0/2816510720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de00712f0 0x7f3de0073150 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40097a0 tx=0x7f3dd402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdb3fe7ff16fef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3ddeffd640 1 -- 172.21.15.137:0/2816510720 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4037070 con 0x7f3de00712f0 2024-04-26T21:59:10.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3ddeffd640 1 -- 172.21.15.137:0/2816510720 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd402ae50 con 0x7f3de00712f0 2024-04-26T21:59:10.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3ddeffd640 1 -- 172.21.15.137:0/2816510720 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4032660 con 0x7f3de00712f0 2024-04-26T21:59:10.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3de63c6640 1 -- 172.21.15.137:0/2816510720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de00712f0 msgr2=0x7f3de0073150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3de63c6640 1 --2- 172.21.15.137:0/2816510720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de00712f0 0x7f3de0073150 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3dd40097a0 tx=0x7f3dd402a100 comp rx=0 tx=0).stop 2024-04-26T21:59:10.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3de63c6640 1 -- 172.21.15.137:0/2816510720 shutdown_connections 2024-04-26T21:59:10.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3de63c6640 1 --2- 172.21.15.137:0/2816510720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de00712f0 0x7f3de0073150 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3de63c6640 1 --2- 172.21.15.137:0/2816510720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de0159cf0 0x7f3de0070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3de63c6640 1 -- 172.21.15.137:0/2816510720 >> 172.21.15.137:0/2816510720 conn(0x7f3de00d1e90 msgr2=0x7f3de00d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:10.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3de63c6640 1 -- 172.21.15.137:0/2816510720 shutdown_connections 2024-04-26T21:59:10.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.935+0000 7f3de63c6640 1 -- 172.21.15.137:0/2816510720 wait complete. 2024-04-26T21:59:10.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.936+0000 7f3de63c6640 1 Processor -- start 2024-04-26T21:59:10.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de63c6640 1 -- start start 2024-04-26T21:59:10.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de63c6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de00712f0 0x7f3de0151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de63c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3de0073690 0x7f3de01563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de63c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de0159cf0 0x7f3de01568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de63c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3de00b6780 con 0x7f3de0159cf0 2024-04-26T21:59:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de63c6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3de015d6b0 con 0x7f3de0073690 2024-04-26T21:59:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de63c6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3de00b6900 con 0x7f3de00712f0 2024-04-26T21:59:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de4963640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de0159cf0 0x7f3de01568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de4963640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de0159cf0 0x7f3de01568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50052/0 (socket says 172.21.15.137:50052) 2024-04-26T21:59:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3de4963640 1 -- 172.21.15.137:0/3687841862 learned_addr learned my addr 172.21.15.137:0/3687841862 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.937+0000 7f3ddffff640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de00712f0 0x7f3de0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3ddf7fe640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3de0073690 0x7f3de01563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3de4963640 1 -- 172.21.15.137:0/3687841862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de00712f0 msgr2=0x7f3de0151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3de4963640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de00712f0 0x7f3de0151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3de4963640 1 -- 172.21.15.137:0/3687841862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3de0073690 msgr2=0x7f3de01563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3de4963640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3de0073690 0x7f3de01563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3de4963640 1 -- 172.21.15.137:0/3687841862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de00d1650 con 0x7f3de0159cf0 2024-04-26T21:59:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3de4963640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de0159cf0 0x7f3de01568f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800c7d0 tx=0x7f3dd800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3ddcff9640 1 -- 172.21.15.137:0/3687841862 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8018070 con 0x7f3de0159cf0 2024-04-26T21:59:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3ddcff9640 1 -- 172.21.15.137:0/3687841862 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd800a640 con 0x7f3de0159cf0 2024-04-26T21:59:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de00d1370 con 0x7f3de0159cf0 2024-04-26T21:59:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3ddcff9640 1 -- 172.21.15.137:0/3687841862 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd800aa70 con 0x7f3de0159cf0 2024-04-26T21:59:10.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.938+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de01f64d0 con 0x7f3de0159cf0 2024-04-26T21:59:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.939+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de00693d0 con 0x7f3de0159cf0 2024-04-26T21:59:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.939+0000 7f3ddcff9640 1 -- 172.21.15.137:0/3687841862 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3dd801b070 con 0x7f3de0159cf0 2024-04-26T21:59:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.940+0000 7f3ddcff9640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.940+0000 7f3ddcff9640 1 -- 172.21.15.137:0/3687841862 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3dd808afc0 con 0x7f3de0159cf0 2024-04-26T21:59:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.940+0000 7f3ddffff640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:10.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.940+0000 7f3ddffff640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000aa20 tx=0x7f3dd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:10.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:10.944+0000 7f3ddcff9640 1 -- 172.21.15.137:0/3687841862 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3dd8058e30 con 0x7f3de0159cf0 2024-04-26T21:59:11.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.118+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3de00b6440 con 0x7f3de0159cf0 2024-04-26T21:59:11.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.119+0000 7f3ddcff9640 1 -- 172.21.15.137:0/3687841862 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f3dd805d130 con 0x7f3de0159cf0 2024-04-26T21:59:11.119 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3dcc06c8f0 msgr2=0x7f3dcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000aa20 tx=0x7f3dd0008040 comp rx=0 tx=0).stop 2024-04-26T21:59:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de0159cf0 msgr2=0x7f3de01568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de0159cf0 0x7f3de01568f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800c7d0 tx=0x7f3dd800cc90 comp rx=0 tx=0).stop 2024-04-26T21:59:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 shutdown_connections 2024-04-26T21:59:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3dcc06c8f0 0x7f3dcc06edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3de0159cf0 0x7f3de01568f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3de0073690 0x7f3de01563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 --2- 172.21.15.137:0/3687841862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3de00712f0 0x7f3de0151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 >> 172.21.15.137:0/3687841862 conn(0x7f3de00d1e90 msgr2=0x7f3de006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 shutdown_connections 2024-04-26T21:59:11.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.121+0000 7f3de63c6640 1 -- 172.21.15.137:0/3687841862 wait complete. 2024-04-26T21:59:11.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:11.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.231+0000 7fbb099e7640 1 Processor -- start 2024-04-26T21:59:11.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.231+0000 7fbb099e7640 1 -- start start 2024-04-26T21:59:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.232+0000 7fbb099e7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbb0415d1f0 0x7fbb04070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.232+0000 7fbb099e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040737a0 0x7fbb040d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.232+0000 7fbb099e7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0406e2c0 con 0x7fbb040d1300 2024-04-26T21:59:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.232+0000 7fbb099e7640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbb0406da60 con 0x7fbb0415d1f0 2024-04-26T21:59:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.232+0000 7fbb099e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbb040d17c0 con 0x7fbb040737a0 2024-04-26T21:59:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.232+0000 7fbb02ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbb0415d1f0 0x7fbb04070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.232+0000 7fbb027fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbb040d1300 0x7fbb04073090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48484/0 (socket says 172.21.15.137:48484) 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.232+0000 7fbb027fc640 1 -- 172.21.15.137:0/3665001711 learned_addr learned my addr 172.21.15.137:0/3665001711 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.233+0000 7fbb02ffd640 1 -- 172.21.15.137:0/3665001711 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040737a0 msgr2=0x7fbb040d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.233+0000 7fbb037fe640 1 --2- 172.21.15.137:0/3665001711 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040737a0 0x7fbb040d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.233+0000 7fbb01ffb640 1 -- 172.21.15.137:0/3665001711 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202149833 0 0) 0x7fbb0406e2c0 con 0x7fbb040d1300 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.233+0000 7fbb02ffd640 1 --2- 172.21.15.137:0/3665001711 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040737a0 0x7fbb040d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.233+0000 7fbb02ffd640 1 -- 172.21.15.137:0/3665001711 >> v1:172.21.15.137:6789/0 conn(0x7fbb040d1300 legacy=0x7fbb04073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.233+0000 7fbb02ffd640 1 -- 172.21.15.137:0/3665001711 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0406dd00 con 0x7fbb0415d1f0 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.233+0000 7fbb037fe640 1 --2- 172.21.15.137:0/3665001711 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040737a0 0x7fbb040d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.233+0000 7fbb02ffd640 1 --2- 172.21.15.137:0/3665001711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb0415d1f0 0x7fbb04070ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009d90 tx=0x7fbaf402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1949999378dd3aba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.233+0000 7fbb01ffb640 1 -- 172.21.15.137:0/3665001711 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4007740 con 0x7fbb0415d1f0 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb01ffb640 1 -- 172.21.15.137:0/3665001711 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf40078e0 con 0x7fbb0415d1f0 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb01ffb640 1 -- 172.21.15.137:0/3665001711 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4007cb0 con 0x7fbb0415d1f0 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb099e7640 1 -- 172.21.15.137:0/3665001711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb0415d1f0 msgr2=0x7fbb04070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb099e7640 1 --2- 172.21.15.137:0/3665001711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb0415d1f0 0x7fbb04070ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009d90 tx=0x7fbaf402a660 comp rx=0 tx=0).stop 2024-04-26T21:59:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb099e7640 1 -- 172.21.15.137:0/3665001711 shutdown_connections 2024-04-26T21:59:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb099e7640 1 --2- 172.21.15.137:0/3665001711 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040737a0 0x7fbb040d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb099e7640 1 --2- 172.21.15.137:0/3665001711 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb0415d1f0 0x7fbb04070ae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb099e7640 1 -- 172.21.15.137:0/3665001711 >> 172.21.15.137:0/3665001711 conn(0x7fbb040d1e40 msgr2=0x7fbb040d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb099e7640 1 -- 172.21.15.137:0/3665001711 shutdown_connections 2024-04-26T21:59:11.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.234+0000 7fbb099e7640 1 -- 172.21.15.137:0/3665001711 wait complete. 2024-04-26T21:59:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.235+0000 7fbb099e7640 1 Processor -- start 2024-04-26T21:59:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.235+0000 7fbb099e7640 1 -- start start 2024-04-26T21:59:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb099e7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb040737a0 0x7fbb040c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb099e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040d1300 0x7fbb04154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb099e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb0415d1f0 0x7fbb040af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb099e7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbb040b1470 con 0x7fbb040737a0 2024-04-26T21:59:11.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb099e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0415d5d0 con 0x7fbb0415d1f0 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb099e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbb04160dd0 con 0x7fbb040d1300 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb02ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb040737a0 0x7fbb040c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb02ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb040737a0 0x7fbb040c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50080/0 (socket says 172.21.15.137:50080) 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb02ffd640 1 -- 172.21.15.137:0/2950308620 learned_addr learned my addr 172.21.15.137:0/2950308620 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb027fc640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040d1300 0x7fbb04154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb037fe640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb0415d1f0 0x7fbb040af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb02ffd640 1 -- 172.21.15.137:0/2950308620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040d1300 msgr2=0x7fbb04154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb02ffd640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040d1300 0x7fbb04154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb02ffd640 1 -- 172.21.15.137:0/2950308620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb0415d1f0 msgr2=0x7fbb040af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.236+0000 7fbb02ffd640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb0415d1f0 0x7fbb040af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.237+0000 7fbb02ffd640 1 -- 172.21.15.137:0/2950308620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb041f3ec0 con 0x7fbb040737a0 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.237+0000 7fbb02ffd640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb040737a0 0x7fbb040c9890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009d90 tx=0x7fbaf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.237+0000 7fbafbfff640 1 -- 172.21.15.137:0/2950308620 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf403f070 con 0x7fbb040737a0 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.237+0000 7fbafbfff640 1 -- 172.21.15.137:0/2950308620 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf4031c40 con 0x7fbb040737a0 2024-04-26T21:59:11.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.237+0000 7fbafbfff640 1 -- 172.21.15.137:0/2950308620 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4003990 con 0x7fbb040737a0 2024-04-26T21:59:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.237+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb040c9f90 con 0x7fbb040737a0 2024-04-26T21:59:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.237+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb041f3100 con 0x7fbb040737a0 2024-04-26T21:59:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.238+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb040693d0 con 0x7fbb040737a0 2024-04-26T21:59:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.238+0000 7fbafbfff640 1 -- 172.21.15.137:0/2950308620 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbaf4007790 con 0x7fbb040737a0 2024-04-26T21:59:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.239+0000 7fbafbfff640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbae406c8f0 0x7fbae406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.239+0000 7fbb027fc640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbae406c8f0 0x7fbae406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.239+0000 7fbafbfff640 1 -- 172.21.15.137:0/2950308620 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbaf40acd10 con 0x7fbb040737a0 2024-04-26T21:59:11.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.239+0000 7fbb027fc640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbae406c8f0 0x7fbae406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbaec007fd0 tx=0x7fbaec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:11.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.243+0000 7fbafbfff640 1 -- 172.21.15.137:0/2950308620 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbaf407b1d0 con 0x7fbb040737a0 2024-04-26T21:59:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.420+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbb040b7dc0 con 0x7fbb040737a0 2024-04-26T21:59:11.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.420+0000 7fbafbfff640 1 -- 172.21.15.137:0/2950308620 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fbaf407aad0 con 0x7fbb040737a0 2024-04-26T21:59:11.421 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.422+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbae406c8f0 msgr2=0x7fbae406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbae406c8f0 0x7fbae406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbaec007fd0 tx=0x7fbaec009040 comp rx=0 tx=0).stop 2024-04-26T21:59:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb040737a0 msgr2=0x7fbb040c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb040737a0 0x7fbb040c9890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009d90 tx=0x7fbaf4004a40 comp rx=0 tx=0).stop 2024-04-26T21:59:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 shutdown_connections 2024-04-26T21:59:11.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbae406c8f0 0x7fbae406edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb0415d1f0 0x7fbb040af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbb040d1300 0x7fbb04154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 --2- 172.21.15.137:0/2950308620 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbb040737a0 0x7fbb040c9890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 >> 172.21.15.137:0/2950308620 conn(0x7fbb040d1e40 msgr2=0x7fbb040d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 shutdown_connections 2024-04-26T21:59:11.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.423+0000 7fbb099e7640 1 -- 172.21.15.137:0/2950308620 wait complete. 2024-04-26T21:59:11.434 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:11.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.537+0000 7f91f0ccc640 1 Processor -- start 2024-04-26T21:59:11.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.537+0000 7f91f0ccc640 1 -- start start 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91f0ccc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f91ec0b4eb0 0x7f91ec0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91f0ccc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 0x7f91ec0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91f0ccc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ec15dca0 con 0x7f91ec143840 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91f0ccc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f91ec143c20 con 0x7f91ec0b4eb0 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91f0ccc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f91ec15df80 con 0x7f91ec0ceff0 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91e9d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f91ec0b4eb0 0x7f91ec0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91e9d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f91ec0b4eb0 0x7f91ec0b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50096/0 (socket says 172.21.15.137:50096) 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91e9d9b640 1 -- 172.21.15.137:0/2145546662 learned_addr learned my addr 172.21.15.137:0/2145546662 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91ead9d640 1 --2- 172.21.15.137:0/2145546662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 0x7f91ec0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91e9d9b640 1 -- 172.21.15.137:0/2145546662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 msgr2=0x7f91ec0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91e9d9b640 1 --2- 172.21.15.137:0/2145546662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 0x7f91ec0cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91e9d9b640 1 -- 172.21.15.137:0/2145546662 >> v1:172.21.15.170:6789/0 conn(0x7f91ec143840 legacy=0x7f91ec0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:11.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.538+0000 7f91e9d9b640 1 -- 172.21.15.137:0/2145546662 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ec15e260 con 0x7f91ec0b4eb0 2024-04-26T21:59:11.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.539+0000 7f91e9d9b640 1 --2- 172.21.15.137:0/2145546662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec0b4eb0 0x7f91ec0b5330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009870 tx=0x7f91e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e8b65dcc9a9c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.539+0000 7f91e959a640 1 -- 172.21.15.137:0/2145546662 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0037070 con 0x7f91ec0b4eb0 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.539+0000 7f91e959a640 1 -- 172.21.15.137:0/2145546662 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e0032440 con 0x7f91ec0b4eb0 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.539+0000 7f91e959a640 1 -- 172.21.15.137:0/2145546662 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0032810 con 0x7f91ec0b4eb0 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.540+0000 7f91f0ccc640 1 -- 172.21.15.137:0/2145546662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec0b4eb0 msgr2=0x7f91ec0b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.540+0000 7f91f0ccc640 1 --2- 172.21.15.137:0/2145546662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec0b4eb0 0x7f91ec0b5330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009870 tx=0x7f91e002a270 comp rx=0 tx=0).stop 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.540+0000 7f91f0ccc640 1 -- 172.21.15.137:0/2145546662 shutdown_connections 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.540+0000 7f91f0ccc640 1 --2- 172.21.15.137:0/2145546662 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 0x7f91ec0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.540+0000 7f91f0ccc640 1 --2- 172.21.15.137:0/2145546662 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec0b4eb0 0x7f91ec0b5330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.540+0000 7f91f0ccc640 1 -- 172.21.15.137:0/2145546662 >> 172.21.15.137:0/2145546662 conn(0x7f91ec0cd8a0 msgr2=0x7f91ec0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.540+0000 7f91f0ccc640 1 -- 172.21.15.137:0/2145546662 shutdown_connections 2024-04-26T21:59:11.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.540+0000 7f91f0ccc640 1 -- 172.21.15.137:0/2145546662 wait complete. 2024-04-26T21:59:11.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.541+0000 7f91f0ccc640 1 Processor -- start 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.541+0000 7f91f0ccc640 1 -- start start 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91f0ccc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91ec0b4eb0 0x7f91ec15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91f0ccc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 0x7f91ec1f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91f0ccc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec143840 0x7f91ec1f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91f0ccc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec15d8c0 con 0x7f91ec143840 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91f0ccc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f91ec0b46f0 con 0x7f91ec0b4eb0 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91f0ccc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f91ec15da40 con 0x7f91ec0ceff0 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91ead9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec143840 0x7f91ec1f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91ead9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec143840 0x7f91ec1f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50102/0 (socket says 172.21.15.137:50102) 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91ead9d640 1 -- 172.21.15.137:0/3837782449 learned_addr learned my addr 172.21.15.137:0/3837782449 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91ea59c640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91ec0b4eb0 0x7f91ec15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91e9d9b640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 0x7f91ec1f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91ead9d640 1 -- 172.21.15.137:0/3837782449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 msgr2=0x7f91ec1f3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91ead9d640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 0x7f91ec1f3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91ead9d640 1 -- 172.21.15.137:0/3837782449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91ec0b4eb0 msgr2=0x7f91ec15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91ead9d640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91ec0b4eb0 0x7f91ec15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.542+0000 7f91ead9d640 1 -- 172.21.15.137:0/3837782449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ec1f3e30 con 0x7f91ec143840 2024-04-26T21:59:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.543+0000 7f91ead9d640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec143840 0x7f91ec1f35a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f91e400d800 tx=0x7f91e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.543+0000 7f91daffd640 1 -- 172.21.15.137:0/3837782449 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e400b6c0 con 0x7f91ec143840 2024-04-26T21:59:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.543+0000 7f91daffd640 1 -- 172.21.15.137:0/3837782449 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e4019070 con 0x7f91ec143840 2024-04-26T21:59:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.543+0000 7f91daffd640 1 -- 172.21.15.137:0/3837782449 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e400bac0 con 0x7f91ec143840 2024-04-26T21:59:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.543+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ec1f43c0 con 0x7f91ec143840 2024-04-26T21:59:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.543+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ec1f4980 con 0x7f91ec143840 2024-04-26T21:59:11.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.544+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91ec06a290 con 0x7f91ec143840 2024-04-26T21:59:11.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.544+0000 7f91daffd640 1 -- 172.21.15.137:0/3837782449 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91e400bc60 con 0x7f91ec143840 2024-04-26T21:59:11.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.545+0000 7f91daffd640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91cc06c8f0 0x7f91cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.545+0000 7f91daffd640 1 -- 172.21.15.137:0/3837782449 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91e408be80 con 0x7f91ec143840 2024-04-26T21:59:11.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.545+0000 7f91ea59c640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91cc06c8f0 0x7f91cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.545+0000 7f91ea59c640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91cc06c8f0 0x7f91cc06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91dc001e70 tx=0x7f91dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:11.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.549+0000 7f91daffd640 1 -- 172.21.15.137:0/3837782449 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f91e4059c60 con 0x7f91ec143840 2024-04-26T21:59:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.724+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91ec1f3b40 con 0x7f91ec143840 2024-04-26T21:59:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.725+0000 7f91daffd640 1 -- 172.21.15.137:0/3837782449 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f91e405df60 con 0x7f91ec143840 2024-04-26T21:59:11.725 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91cc06c8f0 msgr2=0x7f91cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91cc06c8f0 0x7f91cc06edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91dc001e70 tx=0x7f91dc009040 comp rx=0 tx=0).stop 2024-04-26T21:59:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec143840 msgr2=0x7f91ec1f35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec143840 0x7f91ec1f35a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f91e400d800 tx=0x7f91e400dcc0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 shutdown_connections 2024-04-26T21:59:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91cc06c8f0 0x7f91cc06edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91ec143840 0x7f91ec1f35a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91ec0ceff0 0x7f91ec1f3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 --2- 172.21.15.137:0/3837782449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91ec0b4eb0 0x7f91ec15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 >> 172.21.15.137:0/3837782449 conn(0x7f91ec0cd8a0 msgr2=0x7f91ec15ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:11.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 shutdown_connections 2024-04-26T21:59:11.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.727+0000 7f91f0ccc640 1 -- 172.21.15.137:0/3837782449 wait complete. 2024-04-26T21:59:11.738 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-26T21:59:11.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.835+0000 7faf287af640 1 Processor -- start 2024-04-26T21:59:11.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.835+0000 7faf287af640 1 -- start start 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf287af640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faf200b28c0 0x7faf200cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf287af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf200b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf287af640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf200b0620 con 0x7faf200d1370 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf287af640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7faf20074070 con 0x7faf200b28c0 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf287af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faf20074350 con 0x7faf200d1750 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf26d4c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf200b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf25d4a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faf200b28c0 0x7faf200cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf26d4c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf200b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:59544/0 (socket says 172.21.15.137:59544) 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf26d4c640 1 -- 172.21.15.137:0/1523142547 learned_addr learned my addr 172.21.15.137:0/1523142547 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.836+0000 7faf2654b640 1 --1- 172.21.15.137:0/1523142547 >> v1:172.21.15.170:6789/0 conn(0x7faf200d1370 0x7faf200ae0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:53132/0 (socket says 172.21.15.137:53132) 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.837+0000 7faf26d4c640 1 -- 172.21.15.137:0/1523142547 >> v2:172.21.15.170:3300/0 conn(0x7faf200b28c0 msgr2=0x7faf200cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.837+0000 7faf26d4c640 1 --2- 172.21.15.137:0/1523142547 >> v2:172.21.15.170:3300/0 conn(0x7faf200b28c0 0x7faf200cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.837+0000 7faf26d4c640 1 -- 172.21.15.137:0/1523142547 >> v1:172.21.15.170:6789/0 conn(0x7faf200d1370 legacy=0x7faf200ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.837+0000 7faf26d4c640 1 -- 172.21.15.137:0/1523142547 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf20074630 con 0x7faf200d1750 2024-04-26T21:59:11.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.837+0000 7faf25549640 1 -- 172.21.15.137:0/1523142547 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294976091 0 0) 0x7faf200b0620 con 0x7faf200d1370 2024-04-26T21:59:11.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.837+0000 7faf25d4a640 1 --2- 172.21.15.137:0/1523142547 >> v2:172.21.15.170:3300/0 conn(0x7faf200b28c0 0x7faf200cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:11.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.837+0000 7faf26d4c640 1 --2- 172.21.15.137:0/1523142547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf200b0dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf18009870 tx=0x7faf1802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4290d3f55a8bcf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:11.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf25549640 1 -- 172.21.15.137:0/1523142547 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18037070 con 0x7faf200d1750 2024-04-26T21:59:11.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf25549640 1 -- 172.21.15.137:0/1523142547 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf18032440 con 0x7faf200d1750 2024-04-26T21:59:11.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf25549640 1 -- 172.21.15.137:0/1523142547 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18032810 con 0x7faf200d1750 2024-04-26T21:59:11.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf287af640 1 -- 172.21.15.137:0/1523142547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 msgr2=0x7faf200b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf287af640 1 --2- 172.21.15.137:0/1523142547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf200b0dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faf18009870 tx=0x7faf1802a270 comp rx=0 tx=0).stop 2024-04-26T21:59:11.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf287af640 1 -- 172.21.15.137:0/1523142547 shutdown_connections 2024-04-26T21:59:11.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf287af640 1 --2- 172.21.15.137:0/1523142547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf200b0dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf287af640 1 --2- 172.21.15.137:0/1523142547 >> v2:172.21.15.170:3300/0 conn(0x7faf200b28c0 0x7faf200cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf287af640 1 -- 172.21.15.137:0/1523142547 >> 172.21.15.137:0/1523142547 conn(0x7faf200b6800 msgr2=0x7faf200738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:11.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf287af640 1 -- 172.21.15.137:0/1523142547 shutdown_connections 2024-04-26T21:59:11.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.838+0000 7faf287af640 1 -- 172.21.15.137:0/1523142547 wait complete. 2024-04-26T21:59:11.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.839+0000 7faf287af640 1 Processor -- start 2024-04-26T21:59:11.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.839+0000 7faf287af640 1 -- start start 2024-04-26T21:59:11.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf287af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf200b28c0 0x7faf2015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf287af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf200d1370 0x7faf201f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf287af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf20159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf287af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf200b1310 con 0x7faf200b28c0 2024-04-26T21:59:11.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf287af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faf200d1e90 con 0x7faf200d1370 2024-04-26T21:59:11.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf287af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faf200b1490 con 0x7faf200d1750 2024-04-26T21:59:11.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf2654b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf200b28c0 0x7faf2015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf2654b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf200b28c0 0x7faf2015ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50112/0 (socket says 172.21.15.137:50112) 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf2654b640 1 -- 172.21.15.137:0/3046947125 learned_addr learned my addr 172.21.15.137:0/3046947125 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf26d4c640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf20159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.840+0000 7faf25d4a640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf200d1370 0x7faf201f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf2654b640 1 -- 172.21.15.137:0/3046947125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 msgr2=0x7faf20159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf2654b640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf20159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf2654b640 1 -- 172.21.15.137:0/3046947125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf200d1370 msgr2=0x7faf201f3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf2654b640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf200d1370 0x7faf201f3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf2654b640 1 -- 172.21.15.137:0/3046947125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf201e7580 con 0x7faf200b28c0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf2654b640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf200b28c0 0x7faf2015ba80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c890 tx=0x7faf1c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf16ffd640 1 -- 172.21.15.137:0/3046947125 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c018070 con 0x7faf200b28c0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf16ffd640 1 -- 172.21.15.137:0/3046947125 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c00a640 con 0x7faf200b28c0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf16ffd640 1 -- 172.21.15.137:0/3046947125 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00aa30 con 0x7faf200b28c0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf20157f60 con 0x7faf200b28c0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.841+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf20159150 con 0x7faf200b28c0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.842+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2006a290 con 0x7faf200b28c0 2024-04-26T21:59:11.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.842+0000 7faf16ffd640 1 -- 172.21.15.137:0/3046947125 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf1c00abd0 con 0x7faf200b28c0 2024-04-26T21:59:11.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.843+0000 7faf16ffd640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf0406c8f0 0x7faf0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:11.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.843+0000 7faf16ffd640 1 -- 172.21.15.137:0/3046947125 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faf1c08b070 con 0x7faf200b28c0 2024-04-26T21:59:11.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.843+0000 7faf25d4a640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf0406c8f0 0x7faf0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:11.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.843+0000 7faf25d4a640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf0406c8f0 0x7faf0406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf10009560 tx=0x7faf10009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:11.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:11.847+0000 7faf16ffd640 1 -- 172.21.15.137:0/3046947125 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faf20157f60 con 0x7faf200b28c0 2024-04-26T21:59:12.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.089+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7faf200730e0 con 0x7faf200b28c0 2024-04-26T21:59:12.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.585+0000 7faf16ffd640 1 -- 172.21.15.137:0/3046947125 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v52) ==== 145+0+0 (secure 0 0 0) 0x7faf1c058e60 con 0x7faf200b28c0 2024-04-26T21:59:12.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf0406c8f0 msgr2=0x7faf0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:12.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf0406c8f0 0x7faf0406edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faf10009560 tx=0x7faf10009190 comp rx=0 tx=0).stop 2024-04-26T21:59:12.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf200b28c0 msgr2=0x7faf2015ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:12.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf200b28c0 0x7faf2015ba80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c890 tx=0x7faf1c00cd50 comp rx=0 tx=0).stop 2024-04-26T21:59:12.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 shutdown_connections 2024-04-26T21:59:12.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf0406c8f0 0x7faf0406edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf200d1750 0x7faf20159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf200d1370 0x7faf201f3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 --2- 172.21.15.137:0/3046947125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf200b28c0 0x7faf2015ba80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 >> 172.21.15.137:0/3046947125 conn(0x7faf200b6800 msgr2=0x7faf200ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:12.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 shutdown_connections 2024-04-26T21:59:12.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.588+0000 7faf287af640 1 -- 172.21.15.137:0/3046947125 wait complete. 2024-04-26T21:59:12.600 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T21:59:12.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.700+0000 7fd3948c5640 1 Processor -- start 2024-04-26T21:59:12.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.700+0000 7fd3948c5640 1 -- start start 2024-04-26T21:59:12.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd3948c5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd39015f410 0x7fd3900d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:12.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd3948c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3900d2ed0 0x7fd3900d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:12.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd3948c5640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3900d0210 con 0x7fd3900d1750 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd3948c5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd3900d07d0 con 0x7fd39015f410 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd3948c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd3900b3310 con 0x7fd3900d2ed0 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd38dd9b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd3900d1750 0x7fd3900cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48496/0 (socket says 172.21.15.137:48496) 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd38dd9b640 1 -- 172.21.15.137:0/2188972452 learned_addr learned my addr 172.21.15.137:0/2188972452 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd38ed9d640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3900d2ed0 0x7fd3900d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd38e59c640 1 --2- 172.21.15.137:0/2188972452 >> v2:172.21.15.170:3300/0 conn(0x7fd39015f410 0x7fd3900d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.701+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117848643 0 0) 0x7fd3900d0210 con 0x7fd3900d1750 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd378003520 con 0x7fd3900d1750 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3085913569 0 0) 0x7fd378003520 con 0x7fd3900d1750 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3900d2ed0 msgr2=0x7fd3900d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3900d2ed0 0x7fd3900d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 >> v2:172.21.15.170:3300/0 conn(0x7fd39015f410 msgr2=0x7fd3900d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 --2- 172.21.15.137:0/2188972452 >> v2:172.21.15.170:3300/0 conn(0x7fd39015f410 0x7fd3900d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3900d04f0 con 0x7fd3900d1750 2024-04-26T21:59:12.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fd3840019f0 con 0x7fd3900d1750 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 >> v1:172.21.15.137:6789/0 conn(0x7fd3900d1750 legacy=0x7fd3900cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd378003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3900d2ed0 0x7fd378004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd378004d40 0x7fd3780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3900d07d0 con 0x7fd3780039b0 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd3900b3310 con 0x7fd378004d40 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd37800b9c0 con 0x7fd3900d2ed0 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38e59c640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd378003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38ed9d640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd378004d40 0x7fd3780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38dd9b640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3900d2ed0 0x7fd378004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38e59c640 1 -- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3900d2ed0 msgr2=0x7fd378004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38e59c640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3900d2ed0 0x7fd378004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38e59c640 1 -- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd378004d40 msgr2=0x7fd3780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:12.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38e59c640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd378004d40 0x7fd3780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38e59c640 1 -- 172.21.15.137:0/2188972452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd378003520 con 0x7fd3780039b0 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.702+0000 7fd38ed9d640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd378004d40 0x7fd3780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.703+0000 7fd38e59c640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd378003dd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd388009ac0 tx=0x7fd378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e73cda72fb69a38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.703+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388036070 con 0x7fd3780039b0 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.703+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd388031400 con 0x7fd3780039b0 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.703+0000 7fd38d59a640 1 -- 172.21.15.137:0/2188972452 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388009690 con 0x7fd3780039b0 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.704+0000 7fd3948c5640 1 -- 172.21.15.137:0/2188972452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 msgr2=0x7fd378003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.704+0000 7fd3948c5640 1 --2- 172.21.15.137:0/2188972452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd378003dd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd388009ac0 tx=0x7fd378005830 comp rx=0 tx=0).stop 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.704+0000 7fd38ed9d640 1 -- 172.21.15.137:0/2188972452 reap_dead start 2024-04-26T21:59:12.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.704+0000 7fd3948c5640 1 -- 172.21.15.137:0/2188972452 shutdown_connections 2024-04-26T21:59:12.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.704+0000 7fd3948c5640 1 -- 172.21.15.137:0/2188972452 >> 172.21.15.137:0/2188972452 conn(0x7fd39008cfd0 msgr2=0x7fd39009c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:12.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.704+0000 7fd3948c5640 1 -- 172.21.15.137:0/2188972452 shutdown_connections 2024-04-26T21:59:12.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.704+0000 7fd3948c5640 1 -- 172.21.15.137:0/2188972452 wait complete. 2024-04-26T21:59:12.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:59:12.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.705+0000 7fd3948c5640 1 Processor -- start 2024-04-26T21:59:12.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.705+0000 7fd3948c5640 1 -- start start 2024-04-26T21:59:12.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd3948c5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd3901512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:12.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd3948c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd39015e330 0x7fd3900cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:12.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd3948c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd39015e7b0 0x7fd3900cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:12.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd3948c5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd39015f7f0 con 0x7fd3780039b0 2024-04-26T21:59:12.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd3948c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd3900cfed0 con 0x7fd39015e7b0 2024-04-26T21:59:12.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd3948c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd39015d2b0 con 0x7fd39015e330 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd38e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd3901512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd38e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd3901512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50130/0 (socket says 172.21.15.137:50130) 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd38e59c640 1 -- 172.21.15.137:0/2820631047 learned_addr learned my addr 172.21.15.137:0/2820631047 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd38e59c640 1 -- 172.21.15.137:0/2820631047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd39015e330 msgr2=0x7fd3900cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd38e59c640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd39015e330 0x7fd3900cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd38e59c640 1 -- 172.21.15.137:0/2820631047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd39015e7b0 msgr2=0x7fd3900cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd38e59c640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd39015e7b0 0x7fd3900cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd38e59c640 1 -- 172.21.15.137:0/2820631047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39015d570 con 0x7fd3780039b0 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd38e59c640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd3901512c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd388009ac0 tx=0x7fd388004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd37effd640 1 -- 172.21.15.137:0/2820631047 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388040020 con 0x7fd3780039b0 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd37effd640 1 -- 172.21.15.137:0/2820631047 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd388003ac0 con 0x7fd3780039b0 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd37effd640 1 -- 172.21.15.137:0/2820631047 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388036040 con 0x7fd3780039b0 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39015d850 con 0x7fd3780039b0 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.706+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd390151800 con 0x7fd3780039b0 2024-04-26T21:59:12.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.707+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39006a290 con 0x7fd3780039b0 2024-04-26T21:59:12.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.708+0000 7fd37effd640 1 -- 172.21.15.137:0/2820631047 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd388043020 con 0x7fd3780039b0 2024-04-26T21:59:12.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.708+0000 7fd37effd640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd37006c8f0 0x7fd37006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:12.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.708+0000 7fd37effd640 1 -- 172.21.15.137:0/2820631047 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd3880abbd0 con 0x7fd3780039b0 2024-04-26T21:59:12.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.708+0000 7fd38dd9b640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd37006c8f0 0x7fd37006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:12.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.709+0000 7fd38dd9b640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd37006c8f0 0x7fd37006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3840013d0 tx=0x7fd3840014b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:12.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.712+0000 7fd37effd640 1 -- 172.21.15.137:0/2820631047 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd38804a070 con 0x7fd3780039b0 2024-04-26T21:59:12.715 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:59:12.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.891+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd3900d3e30 con 0x7fd3780039b0 2024-04-26T21:59:12.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.894+0000 7fd37effd640 1 -- 172.21.15.137:0/2820631047 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fd3880044e0 con 0x7fd3780039b0 2024-04-26T21:59:12.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd37006c8f0 msgr2=0x7fd37006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:12.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd37006c8f0 0x7fd37006edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3840013d0 tx=0x7fd3840014b0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 msgr2=0x7fd3901512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:12.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd3901512c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd388009ac0 tx=0x7fd388004730 comp rx=0 tx=0).stop 2024-04-26T21:59:12.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 shutdown_connections 2024-04-26T21:59:12.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd37006c8f0 0x7fd37006edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd39015e7b0 0x7fd3900cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd39015e330 0x7fd3900cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 --2- 172.21.15.137:0/2820631047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3780039b0 0x7fd3901512c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:12.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 >> 172.21.15.137:0/2820631047 conn(0x7fd39008cfd0 msgr2=0x7fd390070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:12.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 shutdown_connections 2024-04-26T21:59:12.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:12.896+0000 7fd3948c5640 1 -- 172.21.15.137:0/2820631047 wait complete. 2024-04-26T21:59:12.907 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T21:59:12.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T21:59:12.943 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T21:59:12.984 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T21:59:12.984 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:12.984 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:13.000 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:13.000 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:13.055 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:13.055 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:13.111 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:13.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.247+0000 7f0b1f669640 1 Processor -- start 2024-04-26T21:59:13.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.247+0000 7f0b1f669640 1 -- start start 2024-04-26T21:59:13.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1f669640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b18140350 0x7f0b180cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1f669640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0b18146790 0x7f0b180cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1f669640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b180d05b0 con 0x7f0b1813ff70 2024-04-26T21:59:13.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1f669640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0b180d0890 con 0x7f0b18146790 2024-04-26T21:59:13.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1f669640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1806e450 con 0x7f0b18140350 2024-04-26T21:59:13.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1d405640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f0b1813ff70 0x7f0b18146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:53142/0 (socket says 172.21.15.137:53142) 2024-04-26T21:59:13.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1d405640 1 -- 172.21.15.137:0/3754807063 learned_addr learned my addr 172.21.15.137:0/3754807063 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:13.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1dc06640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0b18146790 0x7f0b180cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1cc04640 1 --2- 172.21.15.137:0/3754807063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b18140350 0x7f0b180cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1dc06640 1 -- 172.21.15.137:0/3754807063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b18140350 msgr2=0x7f0b180cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:13.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1dc06640 1 --2- 172.21.15.137:0/3754807063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b18140350 0x7f0b180cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1dc06640 1 -- 172.21.15.137:0/3754807063 >> v1:172.21.15.170:6789/0 conn(0x7f0b1813ff70 legacy=0x7f0b18146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b0ffff640 1 -- 172.21.15.137:0/3754807063 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517080511 0 0) 0x7f0b180d05b0 con 0x7f0b1813ff70 2024-04-26T21:59:13.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.248+0000 7f0b1dc06640 1 -- 172.21.15.137:0/3754807063 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1806e730 con 0x7f0b18146790 2024-04-26T21:59:13.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.249+0000 7f0b1dc06640 1 --2- 172.21.15.137:0/3754807063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 0x7f0b180cfd50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009d90 tx=0x7f0b1002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7324986c02951192 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:13.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.249+0000 7f0b0ffff640 1 -- 172.21.15.137:0/3754807063 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10031600 con 0x7f0b18146790 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.249+0000 7f0b0ffff640 1 -- 172.21.15.137:0/3754807063 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b100317a0 con 0x7f0b18146790 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.249+0000 7f0b0ffff640 1 -- 172.21.15.137:0/3754807063 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10031b70 con 0x7f0b18146790 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.250+0000 7f0b1f669640 1 -- 172.21.15.137:0/3754807063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 msgr2=0x7f0b180cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.250+0000 7f0b1f669640 1 --2- 172.21.15.137:0/3754807063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 0x7f0b180cfd50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009d90 tx=0x7f0b1002a5d0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.250+0000 7f0b1f669640 1 -- 172.21.15.137:0/3754807063 shutdown_connections 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.250+0000 7f0b1f669640 1 --2- 172.21.15.137:0/3754807063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 0x7f0b180cfd50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.250+0000 7f0b1f669640 1 --2- 172.21.15.137:0/3754807063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b18140350 0x7f0b180cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.250+0000 7f0b1f669640 1 -- 172.21.15.137:0/3754807063 >> 172.21.15.137:0/3754807063 conn(0x7f0b180d0d30 msgr2=0x7f0b180d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.250+0000 7f0b1f669640 1 -- 172.21.15.137:0/3754807063 shutdown_connections 2024-04-26T21:59:13.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.250+0000 7f0b1f669640 1 -- 172.21.15.137:0/3754807063 wait complete. 2024-04-26T21:59:13.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.251+0000 7f0b1f669640 1 Processor -- start 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.251+0000 7f0b1f669640 1 -- start start 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1f669640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b1813ff70 0x7f0b1813d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1f669640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b18140350 0x7f0b1815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1f669640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 0x7f0b18139630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1f669640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1806edd0 con 0x7f0b18140350 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1f669640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1806ec50 con 0x7f0b18146790 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1f669640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1806ef50 con 0x7f0b1813ff70 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1cc04640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b18140350 0x7f0b1815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1cc04640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b18140350 0x7f0b1815ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50138/0 (socket says 172.21.15.137:50138) 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1cc04640 1 -- 172.21.15.137:0/754809284 learned_addr learned my addr 172.21.15.137:0/754809284 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1d405640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b1813ff70 0x7f0b1813d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1dc06640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 0x7f0b18139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1cc04640 1 -- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b1813ff70 msgr2=0x7f0b1813d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1cc04640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b1813ff70 0x7f0b1813d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1cc04640 1 -- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 msgr2=0x7f0b18139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1cc04640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 0x7f0b18139630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1cc04640 1 -- 172.21.15.137:0/754809284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1813daa0 con 0x7f0b18140350 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1d405640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b1813ff70 0x7f0b1813d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.252+0000 7f0b1dc06640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 0x7f0b18139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.253+0000 7f0b1cc04640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b18140350 0x7f0b1815ae50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800e9e0 tx=0x7f0b0800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.253+0000 7f0b0dffb640 1 -- 172.21.15.137:0/754809284 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b08017070 con 0x7f0b18140350 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.253+0000 7f0b0dffb640 1 -- 172.21.15.137:0/754809284 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0800c9d0 con 0x7f0b18140350 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.253+0000 7f0b0dffb640 1 -- 172.21.15.137:0/754809284 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0800cdc0 con 0x7f0b18140350 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.253+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b181451f0 con 0x7f0b18140350 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.253+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b180aede0 con 0x7f0b18140350 2024-04-26T21:59:13.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.254+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b1806a290 con 0x7f0b18140350 2024-04-26T21:59:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.254+0000 7f0b0dffb640 1 -- 172.21.15.137:0/754809284 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b0801a070 con 0x7f0b18140350 2024-04-26T21:59:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.255+0000 7f0b0dffb640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0afc06c8f0 0x7f0afc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.255+0000 7f0b1d405640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0afc06c8f0 0x7f0afc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.255+0000 7f0b0dffb640 1 -- 172.21.15.137:0/754809284 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b0808bb30 con 0x7f0b18140350 2024-04-26T21:59:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.255+0000 7f0b1d405640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0afc06c8f0 0x7f0afc06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b14000f60 tx=0x7f0b14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:13.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.259+0000 7f0b0dffb640 1 -- 172.21.15.137:0/754809284 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0b08059f60 con 0x7f0b18140350 2024-04-26T21:59:13.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.437+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b181616b0 con 0x7f0b18140350 2024-04-26T21:59:13.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.438+0000 7f0b0dffb640 1 -- 172.21.15.137:0/754809284 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f0b08059860 con 0x7f0b18140350 2024-04-26T21:59:13.438 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:13.438 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:13.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0afc06c8f0 msgr2=0x7f0afc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0afc06c8f0 0x7f0afc06edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b14000f60 tx=0x7f0b14009040 comp rx=0 tx=0).stop 2024-04-26T21:59:13.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b18140350 msgr2=0x7f0b1815ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b18140350 0x7f0b1815ae50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b0800e9e0 tx=0x7f0b0800eea0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 shutdown_connections 2024-04-26T21:59:13.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0afc06c8f0 0x7f0afc06edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b18140350 0x7f0b1815ae50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b18146790 0x7f0b18139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 --2- 172.21.15.137:0/754809284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b1813ff70 0x7f0b1813d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 >> 172.21.15.137:0/754809284 conn(0x7f0b180d0d30 msgr2=0x7f0b18160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:13.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 shutdown_connections 2024-04-26T21:59:13.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.440+0000 7f0b1f669640 1 -- 172.21.15.137:0/754809284 wait complete. 2024-04-26T21:59:13.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:13.452 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:13.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.551+0000 7f4dcd796640 1 Processor -- start 2024-04-26T21:59:13.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.551+0000 7f4dcd796640 1 -- start start 2024-04-26T21:59:13.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.552+0000 7f4dcd796640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4dc80cd940 0x7f4dc8070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.552+0000 7f4dcd796640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80737a0 0x7f4dc806f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.552+0000 7f4dcd796640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc80cfec0 con 0x7f4dc80d14d0 2024-04-26T21:59:13.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.552+0000 7f4dcd796640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc80d07f0 con 0x7f4dc80cd940 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.552+0000 7f4dcd796640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc80d01a0 con 0x7f4dc80737a0 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.552+0000 7f4dc6ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4dc80cd940 0x7f4dc8070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.552+0000 7f4dc67fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4dc80d14d0 0x7f4dc8073090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48504/0 (socket says 172.21.15.137:48504) 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.552+0000 7f4dc67fc640 1 -- 172.21.15.137:0/4213128651 learned_addr learned my addr 172.21.15.137:0/4213128651 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.552+0000 7f4dc77fe640 1 --2- 172.21.15.137:0/4213128651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80737a0 0x7f4dc806f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.553+0000 7f4dc6ffd640 1 -- 172.21.15.137:0/4213128651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80737a0 msgr2=0x7f4dc806f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.553+0000 7f4dc6ffd640 1 --2- 172.21.15.137:0/4213128651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80737a0 0x7f4dc806f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.553+0000 7f4dc6ffd640 1 -- 172.21.15.137:0/4213128651 >> v1:172.21.15.137:6789/0 conn(0x7f4dc80d14d0 legacy=0x7f4dc8073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.553+0000 7f4dc6ffd640 1 -- 172.21.15.137:0/4213128651 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc80d0480 con 0x7f4dc80cd940 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.553+0000 7f4dc77fe640 1 --2- 172.21.15.137:0/4213128651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80737a0 0x7f4dc806f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.553+0000 7f4dc6ffd640 1 --2- 172.21.15.137:0/4213128651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80cd940 0x7f4dc8070710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009d90 tx=0x7f4db802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66daff84cc105b8c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.553+0000 7f4dc5ffb640 1 -- 172.21.15.137:0/4213128651 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8007740 con 0x7f4dc80cd940 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.553+0000 7f4dc5ffb640 1 -- 172.21.15.137:0/4213128651 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db80078e0 con 0x7f4dc80cd940 2024-04-26T21:59:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.553+0000 7f4dc5ffb640 1 -- 172.21.15.137:0/4213128651 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8007cb0 con 0x7f4dc80cd940 2024-04-26T21:59:13.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.554+0000 7f4dcd796640 1 -- 172.21.15.137:0/4213128651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80cd940 msgr2=0x7f4dc8070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.554+0000 7f4dcd796640 1 --2- 172.21.15.137:0/4213128651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80cd940 0x7f4dc8070710 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009d90 tx=0x7f4db802a660 comp rx=0 tx=0).stop 2024-04-26T21:59:13.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.554+0000 7f4dcd796640 1 -- 172.21.15.137:0/4213128651 shutdown_connections 2024-04-26T21:59:13.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.554+0000 7f4dcd796640 1 --2- 172.21.15.137:0/4213128651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80737a0 0x7f4dc806f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.554+0000 7f4dcd796640 1 --2- 172.21.15.137:0/4213128651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80cd940 0x7f4dc8070710 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.554+0000 7f4dcd796640 1 -- 172.21.15.137:0/4213128651 >> 172.21.15.137:0/4213128651 conn(0x7f4dc80d1e40 msgr2=0x7f4dc80d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.554+0000 7f4dcd796640 1 -- 172.21.15.137:0/4213128651 shutdown_connections 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.554+0000 7f4dcd796640 1 -- 172.21.15.137:0/4213128651 wait complete. 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.555+0000 7f4dcd796640 1 Processor -- start 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.555+0000 7f4dcd796640 1 -- start start 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dcd796640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc80737a0 0x7f4dc80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dcd796640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80cd940 0x7f4dc815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dcd796640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80d14d0 0x7f4dc815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dcd796640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc80cdea0 con 0x7f4dc80d14d0 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dcd796640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc80cdd20 con 0x7f4dc80737a0 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dcd796640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc80d0c80 con 0x7f4dc80cd940 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80d14d0 0x7f4dc815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80d14d0 0x7f4dc815b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50144/0 (socket says 172.21.15.137:50144) 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc77fe640 1 -- 172.21.15.137:0/974744691 learned_addr learned my addr 172.21.15.137:0/974744691 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc67fc640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80cd940 0x7f4dc815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc6ffd640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc80737a0 0x7f4dc80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc77fe640 1 -- 172.21.15.137:0/974744691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80cd940 msgr2=0x7f4dc815aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc77fe640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80cd940 0x7f4dc815aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc77fe640 1 -- 172.21.15.137:0/974744691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc80737a0 msgr2=0x7f4dc80b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc77fe640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc80737a0 0x7f4dc80b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.556+0000 7f4dc77fe640 1 -- 172.21.15.137:0/974744691 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc8156bd0 con 0x7f4dc80d14d0 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.557+0000 7f4dc77fe640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80d14d0 0x7f4dc815b030 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c820 tx=0x7f4dc000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.557+0000 7f4daf7fe640 1 -- 172.21.15.137:0/974744691 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0015070 con 0x7f4dc80d14d0 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.557+0000 7f4daf7fe640 1 -- 172.21.15.137:0/974744691 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc0004240 con 0x7f4dc80d14d0 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.557+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc815b6d0 con 0x7f4dc80d14d0 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.557+0000 7f4daf7fe640 1 -- 172.21.15.137:0/974744691 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000ce10 con 0x7f4dc80d14d0 2024-04-26T21:59:13.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.557+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc815bc90 con 0x7f4dc80d14d0 2024-04-26T21:59:13.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.558+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc80693d0 con 0x7f4dc80d14d0 2024-04-26T21:59:13.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.558+0000 7f4daf7fe640 1 -- 172.21.15.137:0/974744691 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4dc0007830 con 0x7f4dc80d14d0 2024-04-26T21:59:13.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.559+0000 7f4daf7fe640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4db406c8f0 0x7f4db406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.559+0000 7f4dc6ffd640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4db406c8f0 0x7f4db406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.559+0000 7f4daf7fe640 1 -- 172.21.15.137:0/974744691 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4dc008bcd0 con 0x7f4dc80d14d0 2024-04-26T21:59:13.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.559+0000 7f4dc6ffd640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4db406c8f0 0x7f4db406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4db8034000 tx=0x7f4db802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:13.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.563+0000 7f4daf7fe640 1 -- 172.21.15.137:0/974744691 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4dc005a190 con 0x7f4dc80d14d0 2024-04-26T21:59:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.737+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4dc806dd20 con 0x7f4dc80d14d0 2024-04-26T21:59:13.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.737+0000 7f4daf7fe640 1 -- 172.21.15.137:0/974744691 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f4dc0059a90 con 0x7f4dc80d14d0 2024-04-26T21:59:13.738 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4db406c8f0 msgr2=0x7f4db406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4db406c8f0 0x7f4db406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4db8034000 tx=0x7f4db802f000 comp rx=0 tx=0).stop 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80d14d0 msgr2=0x7f4dc815b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80d14d0 0x7f4dc815b030 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4dc000c820 tx=0x7f4dc000cce0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 shutdown_connections 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4db406c8f0 0x7f4db406edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4dc80d14d0 0x7f4dc815b030 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4dc80cd940 0x7f4dc815aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 --2- 172.21.15.137:0/974744691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dc80737a0 0x7f4dc80b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 >> 172.21.15.137:0/974744691 conn(0x7f4dc80d1e40 msgr2=0x7f4dc8161e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 shutdown_connections 2024-04-26T21:59:13.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.739+0000 7f4dcd796640 1 -- 172.21.15.137:0/974744691 wait complete. 2024-04-26T21:59:13.751 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:13.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.850+0000 7feebb67e640 1 Processor -- start 2024-04-26T21:59:13.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.850+0000 7feebb67e640 1 -- start start 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feebb67e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feeb415f2b0 0x7feeb406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feebb67e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feeb40706a0 0x7feeb406c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feebb67e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeb406cbf0 con 0x7feeb406c7e0 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feebb67e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feeb40af610 con 0x7feeb40706a0 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feebb67e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7feeb40700b0 con 0x7feeb415f2b0 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeb8c19640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feeb40706a0 0x7feeb406c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeb9c1b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7feeb406c7e0 0x7feeb4162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48516/0 (socket says 172.21.15.137:48516) 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeb9c1b640 1 -- 172.21.15.137:0/1530447333 learned_addr learned my addr 172.21.15.137:0/1530447333 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeb941a640 1 --2- 172.21.15.137:0/1530447333 >> v2:172.21.15.170:3300/0 conn(0x7feeb415f2b0 0x7feeb406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeb8c19640 1 -- 172.21.15.137:0/1530447333 >> v2:172.21.15.170:3300/0 conn(0x7feeb415f2b0 msgr2=0x7feeb406fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeb8c19640 1 --2- 172.21.15.137:0/1530447333 >> v2:172.21.15.170:3300/0 conn(0x7feeb415f2b0 0x7feeb406fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeb8c19640 1 -- 172.21.15.137:0/1530447333 >> v1:172.21.15.137:6789/0 conn(0x7feeb406c7e0 legacy=0x7feeb4162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeabfff640 1 -- 172.21.15.137:0/1530447333 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706991907 0 0) 0x7feeac001490 con 0x7feeb406c7e0 2024-04-26T21:59:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeb8c19640 1 -- 172.21.15.137:0/1530447333 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb4070b30 con 0x7feeb40706a0 2024-04-26T21:59:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.851+0000 7feeb941a640 1 --2- 172.21.15.137:0/1530447333 >> v2:172.21.15.170:3300/0 conn(0x7feeb415f2b0 0x7feeb406fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feeb8c19640 1 --2- 172.21.15.137:0/1530447333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb40706a0 0x7feeb406c2a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feeb4074530 tx=0x7feea402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d857562b3a7b2ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feeabfff640 1 -- 172.21.15.137:0/1530447333 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4037070 con 0x7feeb40706a0 2024-04-26T21:59:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feeabfff640 1 -- 172.21.15.137:0/1530447333 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea4032440 con 0x7feeb40706a0 2024-04-26T21:59:13.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feeabfff640 1 -- 172.21.15.137:0/1530447333 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4032810 con 0x7feeb40706a0 2024-04-26T21:59:13.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feebb67e640 1 -- 172.21.15.137:0/1530447333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb40706a0 msgr2=0x7feeb406c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feebb67e640 1 --2- 172.21.15.137:0/1530447333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb40706a0 0x7feeb406c2a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feeb4074530 tx=0x7feea402a1a0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feebb67e640 1 -- 172.21.15.137:0/1530447333 shutdown_connections 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feebb67e640 1 --2- 172.21.15.137:0/1530447333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb40706a0 0x7feeb406c2a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feebb67e640 1 --2- 172.21.15.137:0/1530447333 >> v2:172.21.15.170:3300/0 conn(0x7feeb415f2b0 0x7feeb406fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.852+0000 7feebb67e640 1 -- 172.21.15.137:0/1530447333 >> 172.21.15.137:0/1530447333 conn(0x7feeb406f050 msgr2=0x7feeb406f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.853+0000 7feebb67e640 1 -- 172.21.15.137:0/1530447333 shutdown_connections 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.853+0000 7feebb67e640 1 -- 172.21.15.137:0/1530447333 wait complete. 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.854+0000 7feebb67e640 1 Processor -- start 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.854+0000 7feebb67e640 1 -- start start 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.854+0000 7feebb67e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeb406c7e0 0x7feeb415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.854+0000 7feebb67e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb415f2b0 0x7feeb4159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.854+0000 7feebb67e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb4159860 0x7feeb413f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.854+0000 7feebb67e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feeb40713d0 con 0x7feeb415f2b0 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.854+0000 7feebb67e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feeb40710f0 con 0x7feeb4159860 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.854+0000 7feebb67e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feeb40b4f40 con 0x7feeb406c7e0 2024-04-26T21:59:13.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb8c19640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb415f2b0 0x7feeb4159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb8c19640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb415f2b0 0x7feeb4159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50154/0 (socket says 172.21.15.137:50154) 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb8c19640 1 -- 172.21.15.137:0/1332218063 learned_addr learned my addr 172.21.15.137:0/1332218063 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb941a640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeb406c7e0 0x7feeb415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb9c1b640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb4159860 0x7feeb413f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb8c19640 1 -- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeb406c7e0 msgr2=0x7feeb415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb8c19640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeb406c7e0 0x7feeb415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb8c19640 1 -- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb4159860 msgr2=0x7feeb413f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb8c19640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb4159860 0x7feeb413f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb8c19640 1 -- 172.21.15.137:0/1332218063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb415bb00 con 0x7feeb415f2b0 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb941a640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeb406c7e0 0x7feeb415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb9c1b640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb4159860 0x7feeb413f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feeb8c19640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb415f2b0 0x7feeb4159320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feea4000c00 tx=0x7feea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:13.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feea9ffb640 1 -- 172.21.15.137:0/1332218063 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4037040 con 0x7feeb415f2b0 2024-04-26T21:59:13.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feea9ffb640 1 -- 172.21.15.137:0/1332218063 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea4042070 con 0x7feeb415f2b0 2024-04-26T21:59:13.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb415bde0 con 0x7feeb415f2b0 2024-04-26T21:59:13.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feea9ffb640 1 -- 172.21.15.137:0/1332218063 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4030a50 con 0x7feeb415f2b0 2024-04-26T21:59:13.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.855+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb415c3a0 con 0x7feeb415f2b0 2024-04-26T21:59:13.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.857+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb4069c80 con 0x7feeb415f2b0 2024-04-26T21:59:13.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.857+0000 7feea9ffb640 1 -- 172.21.15.137:0/1332218063 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feea4030bf0 con 0x7feeb415f2b0 2024-04-26T21:59:13.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.857+0000 7feea9ffb640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee9806c8f0 0x7fee9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:13.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.857+0000 7feea9ffb640 1 -- 172.21.15.137:0/1332218063 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feea40ac550 con 0x7feeb415f2b0 2024-04-26T21:59:13.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.857+0000 7feeb941a640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee9806c8f0 0x7fee9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:13.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.858+0000 7feeb941a640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee9806c8f0 0x7fee9806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feeb000a990 tx=0x7feeb0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:13.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:13.862+0000 7feea9ffb640 1 -- 172.21.15.137:0/1332218063 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7feeb4069c80 con 0x7feeb415f2b0 2024-04-26T21:59:14.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.037+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7feeb406a290 con 0x7feeb415f2b0 2024-04-26T21:59:14.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.037+0000 7feea9ffb640 1 -- 172.21.15.137:0/1332218063 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7feea407aa10 con 0x7feeb415f2b0 2024-04-26T21:59:14.037 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee9806c8f0 msgr2=0x7fee9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee9806c8f0 0x7fee9806edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feeb000a990 tx=0x7feeb0008040 comp rx=0 tx=0).stop 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb415f2b0 msgr2=0x7feeb4159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb415f2b0 0x7feeb4159320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feea4000c00 tx=0x7feea40046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 shutdown_connections 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee9806c8f0 0x7fee9806edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feeb415f2b0 0x7feeb4159320 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeb4159860 0x7feeb413f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 --2- 172.21.15.137:0/1332218063 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feeb406c7e0 0x7feeb415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 >> 172.21.15.137:0/1332218063 conn(0x7feeb406f050 msgr2=0x7feeb41634e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:14.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 shutdown_connections 2024-04-26T21:59:14.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.039+0000 7feebb67e640 1 -- 172.21.15.137:0/1332218063 wait complete. 2024-04-26T21:59:14.050 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:14.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.149+0000 7f48b35b4640 1 Processor -- start 2024-04-26T21:59:14.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.150+0000 7f48b35b4640 1 -- start start 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.150+0000 7f48b35b4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f48ac1631f0 0x7f48ac0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.150+0000 7f48b35b4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48ac0d1170 0x7f48ac1635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.150+0000 7f48b35b4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48ac09c790 con 0x7f48ac0b3300 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.150+0000 7f48b35b4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f48ac0d15f0 con 0x7f48ac0d1170 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.150+0000 7f48b35b4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f48ac163ec0 con 0x7f48ac1631f0 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.151+0000 7f48b0b4f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48ac0d1170 0x7f48ac1635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.151+0000 7f48b0b4f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48ac0d1170 0x7f48ac1635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50158/0 (socket says 172.21.15.137:50158) 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.151+0000 7f48b0b4f640 1 -- 172.21.15.137:0/364457963 learned_addr learned my addr 172.21.15.137:0/364457963 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.151+0000 7f48b1350640 1 --2- 172.21.15.137:0/364457963 >> v2:172.21.15.170:3300/0 conn(0x7f48ac1631f0 0x7f48ac0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.151+0000 7f48b0b4f640 1 -- 172.21.15.137:0/364457963 >> v2:172.21.15.170:3300/0 conn(0x7f48ac1631f0 msgr2=0x7f48ac0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.151+0000 7f48b0b4f640 1 --2- 172.21.15.137:0/364457963 >> v2:172.21.15.170:3300/0 conn(0x7f48ac1631f0 0x7f48ac0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.151+0000 7f48b0b4f640 1 -- 172.21.15.137:0/364457963 >> v1:172.21.15.170:6789/0 conn(0x7f48ac0b3300 legacy=0x7f48ac0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:14.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.151+0000 7f48b0b4f640 1 -- 172.21.15.137:0/364457963 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac0d1a40 con 0x7f48ac0d1170 2024-04-26T21:59:14.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48b0b4f640 1 --2- 172.21.15.137:0/364457963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac0d1170 0x7f48ac1635d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0d2ef0 tx=0x7f48a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8af3e0aefa7946 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:14.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48a3fff640 1 -- 172.21.15.137:0/364457963 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8037070 con 0x7f48ac0d1170 2024-04-26T21:59:14.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48a3fff640 1 -- 172.21.15.137:0/364457963 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a8032440 con 0x7f48ac0d1170 2024-04-26T21:59:14.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48a3fff640 1 -- 172.21.15.137:0/364457963 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8032810 con 0x7f48ac0d1170 2024-04-26T21:59:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48b35b4640 1 -- 172.21.15.137:0/364457963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac0d1170 msgr2=0x7f48ac1635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48b35b4640 1 --2- 172.21.15.137:0/364457963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac0d1170 0x7f48ac1635d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0d2ef0 tx=0x7f48a802a1e0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48b35b4640 1 -- 172.21.15.137:0/364457963 shutdown_connections 2024-04-26T21:59:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48b35b4640 1 --2- 172.21.15.137:0/364457963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac0d1170 0x7f48ac1635d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48b35b4640 1 --2- 172.21.15.137:0/364457963 >> v2:172.21.15.170:3300/0 conn(0x7f48ac1631f0 0x7f48ac0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48b35b4640 1 -- 172.21.15.137:0/364457963 >> 172.21.15.137:0/364457963 conn(0x7f48ac09ba40 msgr2=0x7f48ac09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48b35b4640 1 -- 172.21.15.137:0/364457963 shutdown_connections 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.152+0000 7f48b35b4640 1 -- 172.21.15.137:0/364457963 wait complete. 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.153+0000 7f48b35b4640 1 Processor -- start 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b35b4640 1 -- start start 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b35b4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48ac0b3300 0x7f48ac14cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b35b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48ac0d1170 0x7f48ac14c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b35b4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac1631f0 0x7f48ac15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b35b4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac0d0230 con 0x7f48ac1631f0 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b35b4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac0d2000 con 0x7f48ac0d1170 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b35b4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f48ac14c990 con 0x7f48ac0b3300 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b1b51640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac1631f0 0x7f48ac15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b1b51640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac1631f0 0x7f48ac15fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50162/0 (socket says 172.21.15.137:50162) 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b1b51640 1 -- 172.21.15.137:0/4253490781 learned_addr learned my addr 172.21.15.137:0/4253490781 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b0b4f640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48ac0d1170 0x7f48ac14c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.154+0000 7f48b1350640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48ac0b3300 0x7f48ac14cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48b1b51640 1 -- 172.21.15.137:0/4253490781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48ac0b3300 msgr2=0x7f48ac14cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48b1b51640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48ac0b3300 0x7f48ac14cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48b1b51640 1 -- 172.21.15.137:0/4253490781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48ac0d1170 msgr2=0x7f48ac14c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48b1b51640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48ac0d1170 0x7f48ac14c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48b1b51640 1 -- 172.21.15.137:0/4253490781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac1f8630 con 0x7f48ac1631f0 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48b1b51640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac1631f0 0x7f48ac15fa80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f48a400c7a0 tx=0x7f48a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48a1ffb640 1 -- 172.21.15.137:0/4253490781 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a4003b70 con 0x7f48ac1631f0 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48a1ffb640 1 -- 172.21.15.137:0/4253490781 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a4003d30 con 0x7f48ac1631f0 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48a1ffb640 1 -- 172.21.15.137:0/4253490781 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a400aa30 con 0x7f48ac1631f0 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac1f8910 con 0x7f48ac1631f0 2024-04-26T21:59:14.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.155+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac1f8ed0 con 0x7f48ac1631f0 2024-04-26T21:59:14.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.156+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ac1f92b0 con 0x7f48ac1631f0 2024-04-26T21:59:14.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.156+0000 7f48a1ffb640 1 -- 172.21.15.137:0/4253490781 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48a400abd0 con 0x7f48ac1631f0 2024-04-26T21:59:14.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.157+0000 7f48a1ffb640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f489006c8f0 0x7f489006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.157+0000 7f48a1ffb640 1 -- 172.21.15.137:0/4253490781 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f48a408ba30 con 0x7f48ac1631f0 2024-04-26T21:59:14.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.157+0000 7f48b1350640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f489006c8f0 0x7f489006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.157+0000 7f48b1350640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f489006c8f0 0x7f489006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f489c006fd0 tx=0x7f489c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:14.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.161+0000 7f48a1ffb640 1 -- 172.21.15.137:0/4253490781 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f48a4059e60 con 0x7f48ac1631f0 2024-04-26T21:59:14.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.335+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48ac06a290 con 0x7f48ac1631f0 2024-04-26T21:59:14.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.336+0000 7f48a1ffb640 1 -- 172.21.15.137:0/4253490781 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f48a4059760 con 0x7f48ac1631f0 2024-04-26T21:59:14.336 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:14.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f489006c8f0 msgr2=0x7f489006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f489006c8f0 0x7f489006edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f489c006fd0 tx=0x7f489c008040 comp rx=0 tx=0).stop 2024-04-26T21:59:14.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac1631f0 msgr2=0x7f48ac15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac1631f0 0x7f48ac15fa80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f48a400c7a0 tx=0x7f48a400cc60 comp rx=0 tx=0).stop 2024-04-26T21:59:14.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 shutdown_connections 2024-04-26T21:59:14.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f489006c8f0 0x7f489006edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48ac1631f0 0x7f48ac15fa80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48ac0d1170 0x7f48ac14c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 --2- 172.21.15.137:0/4253490781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48ac0b3300 0x7f48ac14cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 >> 172.21.15.137:0/4253490781 conn(0x7f48ac09ba40 msgr2=0x7f48ac162860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:14.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 shutdown_connections 2024-04-26T21:59:14.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.338+0000 7f48b35b4640 1 -- 172.21.15.137:0/4253490781 wait complete. 2024-04-26T21:59:14.349 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:59:14.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.446+0000 7fa081045640 1 Processor -- start 2024-04-26T21:59:14.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.446+0000 7fa081045640 1 -- start start 2024-04-26T21:59:14.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa081045640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa07c15f4a0 0x7fa07c0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa081045640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa07c0b6320 0x7fa07c0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa081045640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07c0aed90 con 0x7fa07c0afe30 2024-04-26T21:59:14.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa081045640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa07c15f880 con 0x7fa07c0b6320 2024-04-26T21:59:14.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa081045640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa07c0af9a0 con 0x7fa07c15f4a0 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa07b59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa07c0b6320 0x7fa07c0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa07a59c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa07c0afe30 0x7fa07c162f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48524/0 (socket says 172.21.15.137:48524) 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa07a59c640 1 -- 172.21.15.137:0/1208324401 learned_addr learned my addr 172.21.15.137:0/1208324401 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa07ad9d640 1 --2- 172.21.15.137:0/1208324401 >> v2:172.21.15.170:3300/0 conn(0x7fa07c15f4a0 0x7fa07c0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa07b59e640 1 -- 172.21.15.137:0/1208324401 >> v2:172.21.15.170:3300/0 conn(0x7fa07c15f4a0 msgr2=0x7fa07c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa07b59e640 1 --2- 172.21.15.137:0/1208324401 >> v2:172.21.15.170:3300/0 conn(0x7fa07c15f4a0 0x7fa07c0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa07b59e640 1 -- 172.21.15.137:0/1208324401 >> v1:172.21.15.137:6789/0 conn(0x7fa07c0afe30 legacy=0x7fa07c162f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa07b59e640 1 -- 172.21.15.137:0/1208324401 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c0af070 con 0x7fa07c0b6320 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa079d9b640 1 -- 172.21.15.137:0/1208324401 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078252882 0 0) 0x7fa07c0aed90 con 0x7fa07c0afe30 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.447+0000 7fa07ad9d640 1 --2- 172.21.15.137:0/1208324401 >> v2:172.21.15.170:3300/0 conn(0x7fa07c15f4a0 0x7fa07c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.448+0000 7fa07b59e640 1 --2- 172.21.15.137:0/1208324401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0b6320 0x7fa07c0b4600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa07c072980 tx=0x7fa07402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcb6af07487c44c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:14.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.448+0000 7fa079d9b640 1 -- 172.21.15.137:0/1208324401 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074007740 con 0x7fa07c0b6320 2024-04-26T21:59:14.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.448+0000 7fa079d9b640 1 -- 172.21.15.137:0/1208324401 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0740078e0 con 0x7fa07c0b6320 2024-04-26T21:59:14.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.448+0000 7fa079d9b640 1 -- 172.21.15.137:0/1208324401 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074007cb0 con 0x7fa07c0b6320 2024-04-26T21:59:14.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.449+0000 7fa081045640 1 -- 172.21.15.137:0/1208324401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0b6320 msgr2=0x7fa07c0b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.449+0000 7fa081045640 1 --2- 172.21.15.137:0/1208324401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0b6320 0x7fa07c0b4600 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa07c072980 tx=0x7fa07402a680 comp rx=0 tx=0).stop 2024-04-26T21:59:14.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.449+0000 7fa081045640 1 -- 172.21.15.137:0/1208324401 shutdown_connections 2024-04-26T21:59:14.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.449+0000 7fa081045640 1 --2- 172.21.15.137:0/1208324401 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0b6320 0x7fa07c0b4600 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.449+0000 7fa081045640 1 --2- 172.21.15.137:0/1208324401 >> v2:172.21.15.170:3300/0 conn(0x7fa07c15f4a0 0x7fa07c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.449+0000 7fa081045640 1 -- 172.21.15.137:0/1208324401 >> 172.21.15.137:0/1208324401 conn(0x7fa07c0b6800 msgr2=0x7fa07c0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.449+0000 7fa081045640 1 -- 172.21.15.137:0/1208324401 shutdown_connections 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.449+0000 7fa081045640 1 -- 172.21.15.137:0/1208324401 wait complete. 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.450+0000 7fa081045640 1 Processor -- start 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.450+0000 7fa081045640 1 -- start start 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa081045640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0afe30 0x7fa07c09eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa081045640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa07c0b6320 0x7fa07c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa081045640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa07c15f4a0 0x7fa07c15db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa081045640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c0aea80 con 0x7fa07c0afe30 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa081045640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c0af630 con 0x7fa07c15f4a0 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa081045640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa07c0b1480 con 0x7fa07c0b6320 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa07ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0afe30 0x7fa07c09eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa07ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0afe30 0x7fa07c09eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50190/0 (socket says 172.21.15.137:50190) 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa07ad9d640 1 -- 172.21.15.137:0/1193354342 learned_addr learned my addr 172.21.15.137:0/1193354342 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa07a59c640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa07c0b6320 0x7fa07c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.451+0000 7fa07b59e640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa07c15f4a0 0x7fa07c15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa07ad9d640 1 -- 172.21.15.137:0/1193354342 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa07c0b6320 msgr2=0x7fa07c15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa07ad9d640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa07c0b6320 0x7fa07c15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa07ad9d640 1 -- 172.21.15.137:0/1193354342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa07c15f4a0 msgr2=0x7fa07c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa07ad9d640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa07c15f4a0 0x7fa07c15db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa07ad9d640 1 -- 172.21.15.137:0/1193354342 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c14e330 con 0x7fa07c0afe30 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa07b59e640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa07c15f4a0 0x7fa07c15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa07ad9d640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0afe30 0x7fa07c09eb10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c7f0 tx=0x7fa06c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa0637fe640 1 -- 172.21.15.137:0/1193354342 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c015070 con 0x7fa07c0afe30 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa0637fe640 1 -- 172.21.15.137:0/1193354342 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa06c007820 con 0x7fa07c0afe30 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa0637fe640 1 -- 172.21.15.137:0/1193354342 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c007bd0 con 0x7fa07c0afe30 2024-04-26T21:59:14.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07c14e610 con 0x7fa07c0afe30 2024-04-26T21:59:14.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.452+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07c14ebd0 con 0x7fa07c0afe30 2024-04-26T21:59:14.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.453+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa07c06a290 con 0x7fa07c0afe30 2024-04-26T21:59:14.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.453+0000 7fa0637fe640 1 -- 172.21.15.137:0/1193354342 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa06c018070 con 0x7fa07c0afe30 2024-04-26T21:59:14.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.454+0000 7fa0637fe640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa06806c8f0 0x7fa06806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.454+0000 7fa0637fe640 1 -- 172.21.15.137:0/1193354342 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa06c08bb20 con 0x7fa07c0afe30 2024-04-26T21:59:14.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.454+0000 7fa07a59c640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa06806c8f0 0x7fa06806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.454+0000 7fa07a59c640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa06806c8f0 0x7fa06806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0b2720 tx=0x7fa070007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:14.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.458+0000 7fa0637fe640 1 -- 172.21.15.137:0/1193354342 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa06c059990 con 0x7fa07c0afe30 2024-04-26T21:59:14.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.645+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa07c0b41e0 con 0x7fa07c0afe30 2024-04-26T21:59:14.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.645+0000 7fa0637fe640 1 -- 172.21.15.137:0/1193354342 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fa06c05ee20 con 0x7fa07c0afe30 2024-04-26T21:59:14.646 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa06806c8f0 msgr2=0x7fa06806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa06806c8f0 0x7fa06806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0b2720 tx=0x7fa070007d50 comp rx=0 tx=0).stop 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0afe30 msgr2=0x7fa07c09eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0afe30 0x7fa07c09eb10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00c7f0 tx=0x7fa06c00ccb0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 shutdown_connections 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa06806c8f0 0x7fa06806edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa07c15f4a0 0x7fa07c15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa07c0b6320 0x7fa07c15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 --2- 172.21.15.137:0/1193354342 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa07c0afe30 0x7fa07c09eb10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.647+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 >> 172.21.15.137:0/1193354342 conn(0x7fa07c0b6800 msgr2=0x7fa07c0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:14.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.648+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 shutdown_connections 2024-04-26T21:59:14.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.648+0000 7fa081045640 1 -- 172.21.15.137:0/1193354342 wait complete. 2024-04-26T21:59:14.658 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T21:59:14.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:14.659 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-26T21:59:14.683 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T21:59:14.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:14.683 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T21:59:14.741 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:14.741 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:14.760 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:14.760 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:14.819 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:14.819 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:14.878 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:14.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.974+0000 7fb257e45640 1 Processor -- start 2024-04-26T21:59:14.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.974+0000 7fb257e45640 1 -- start start 2024-04-26T21:59:14.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.975+0000 7fb257e45640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb250070d20 0x7fb250071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.975+0000 7fb257e45640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb25009c400 0x7fb250162f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.975+0000 7fb257e45640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2500d14c0 con 0x7fb250070520 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.975+0000 7fb257e45640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb2500d1290 con 0x7fb250070d20 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.975+0000 7fb257e45640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb250071640 con 0x7fb25009c400 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.975+0000 7fb255be1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb250070d20 0x7fb250071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.975+0000 7fb255be1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb250070d20 0x7fb250071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50206/0 (socket says 172.21.15.137:50206) 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.975+0000 7fb255be1640 1 -- 172.21.15.137:0/2503078934 learned_addr learned my addr 172.21.15.137:0/2503078934 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.975+0000 7fb2563e2640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb250070520 0x7fb250163470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48530/0 (socket says 172.21.15.137:48530) 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.976+0000 7fb255be1640 1 -- 172.21.15.137:0/2503078934 >> v2:172.21.15.170:3300/0 conn(0x7fb25009c400 msgr2=0x7fb250162f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:14.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.976+0000 7fb2553e0640 1 --2- 172.21.15.137:0/2503078934 >> v2:172.21.15.170:3300/0 conn(0x7fb25009c400 0x7fb250162f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.976+0000 7fb255be1640 1 --2- 172.21.15.137:0/2503078934 >> v2:172.21.15.170:3300/0 conn(0x7fb25009c400 0x7fb250162f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.976+0000 7fb255be1640 1 -- 172.21.15.137:0/2503078934 >> v1:172.21.15.137:6789/0 conn(0x7fb250070520 legacy=0x7fb250163470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.976+0000 7fb255be1640 1 -- 172.21.15.137:0/2503078934 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2500ce5b0 con 0x7fb250070d20 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.976+0000 7fb2553e0640 1 --2- 172.21.15.137:0/2503078934 >> v2:172.21.15.170:3300/0 conn(0x7fb25009c400 0x7fb250162f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.976+0000 7fb255be1640 1 --2- 172.21.15.137:0/2503078934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070d20 0x7fb250071100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb2500d0cb0 tx=0x7fb24c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3951a00a567e60a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb254bdf640 1 -- 172.21.15.137:0/2503078934 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c036070 con 0x7fb250070d20 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb254bdf640 1 -- 172.21.15.137:0/2503078934 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c031600 con 0x7fb250070d20 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb254bdf640 1 -- 172.21.15.137:0/2503078934 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0319d0 con 0x7fb250070d20 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb257e45640 1 -- 172.21.15.137:0/2503078934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070d20 msgr2=0x7fb250071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb257e45640 1 --2- 172.21.15.137:0/2503078934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070d20 0x7fb250071100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb2500d0cb0 tx=0x7fb24c02a730 comp rx=0 tx=0).stop 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb257e45640 1 -- 172.21.15.137:0/2503078934 shutdown_connections 2024-04-26T21:59:14.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb257e45640 1 --2- 172.21.15.137:0/2503078934 >> v2:172.21.15.170:3300/0 conn(0x7fb25009c400 0x7fb250162f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb257e45640 1 --2- 172.21.15.137:0/2503078934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070d20 0x7fb250071100 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb257e45640 1 -- 172.21.15.137:0/2503078934 >> 172.21.15.137:0/2503078934 conn(0x7fb2500b4a40 msgr2=0x7fb2500b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:14.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb257e45640 1 -- 172.21.15.137:0/2503078934 shutdown_connections 2024-04-26T21:59:14.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.977+0000 7fb257e45640 1 -- 172.21.15.137:0/2503078934 wait complete. 2024-04-26T21:59:14.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.978+0000 7fb257e45640 1 Processor -- start 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.978+0000 7fb257e45640 1 -- start start 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb257e45640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070520 0x7fb250151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb257e45640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb250070d20 0x7fb25014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb257e45640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb25009c400 0x7fb2500cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb257e45640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb2500d1d20 con 0x7fb250070520 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb257e45640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2500d1a40 con 0x7fb25009c400 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb257e45640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb2500d2000 con 0x7fb250070d20 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb255be1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070520 0x7fb250151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb255be1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070520 0x7fb250151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50222/0 (socket says 172.21.15.137:50222) 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb255be1640 1 -- 172.21.15.137:0/1774241980 learned_addr learned my addr 172.21.15.137:0/1774241980 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb2563e2640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb25009c400 0x7fb2500cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb255be1640 1 -- 172.21.15.137:0/1774241980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb250070d20 msgr2=0x7fb25014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.979+0000 7fb255be1640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb250070d20 0x7fb25014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.980+0000 7fb255be1640 1 -- 172.21.15.137:0/1774241980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb25009c400 msgr2=0x7fb2500cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.980+0000 7fb255be1640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb25009c400 0x7fb2500cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.980+0000 7fb255be1640 1 -- 172.21.15.137:0/1774241980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2500cca20 con 0x7fb250070520 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.980+0000 7fb255be1640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070520 0x7fb250151240 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb24c034040 tx=0x7fb24c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.980+0000 7fb2467fc640 1 -- 172.21.15.137:0/1774241980 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c03f020 con 0x7fb250070520 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.980+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2500ccd00 con 0x7fb250070520 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.980+0000 7fb2467fc640 1 -- 172.21.15.137:0/1774241980 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c037040 con 0x7fb250070520 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.980+0000 7fb2467fc640 1 -- 172.21.15.137:0/1774241980 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c036070 con 0x7fb250070520 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.980+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2500c7bc0 con 0x7fb250070520 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.981+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2500693d0 con 0x7fb250070520 2024-04-26T21:59:14.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.981+0000 7fb2467fc640 1 -- 172.21.15.137:0/1774241980 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb24c042020 con 0x7fb250070520 2024-04-26T21:59:14.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.982+0000 7fb2467fc640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb23406c8f0 0x7fb23406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:14.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.982+0000 7fb2467fc640 1 -- 172.21.15.137:0/1774241980 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb24c0ac0a0 con 0x7fb250070520 2024-04-26T21:59:14.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.982+0000 7fb2553e0640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb23406c8f0 0x7fb23406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:14.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.982+0000 7fb2553e0640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb23406c8f0 0x7fb23406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb240006fd0 tx=0x7fb240008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:14.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:14.986+0000 7fb2467fc640 1 -- 172.21.15.137:0/1774241980 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb24c049030 con 0x7fb250070520 2024-04-26T21:59:15.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.161+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2500c7d90 con 0x7fb250070520 2024-04-26T21:59:15.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.162+0000 7fb2467fc640 1 -- 172.21.15.137:0/1774241980 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fb24c07a4e0 con 0x7fb250070520 2024-04-26T21:59:15.162 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:15.162 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:15.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb23406c8f0 msgr2=0x7fb23406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb23406c8f0 0x7fb23406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb240006fd0 tx=0x7fb240008040 comp rx=0 tx=0).stop 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070520 msgr2=0x7fb250151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070520 0x7fb250151240 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb24c034040 tx=0x7fb24c004a40 comp rx=0 tx=0).stop 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 shutdown_connections 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb23406c8f0 0x7fb23406edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb25009c400 0x7fb2500cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb250070d20 0x7fb25014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 --2- 172.21.15.137:0/1774241980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb250070520 0x7fb250151240 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 >> 172.21.15.137:0/1774241980 conn(0x7fb2500b4a40 msgr2=0x7fb2500d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 shutdown_connections 2024-04-26T21:59:15.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.164+0000 7fb257e45640 1 -- 172.21.15.137:0/1774241980 wait complete. 2024-04-26T21:59:15.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:15.176 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:15.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.276+0000 7f493aa2a640 1 Processor -- start 2024-04-26T21:59:15.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.276+0000 7f493aa2a640 1 -- start start 2024-04-26T21:59:15.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f493aa2a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4934143840 0x7f49340b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f493aa2a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f49340b4520 0x7f49340b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f493aa2a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493415dca0 con 0x7f49340b53f0 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f493aa2a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4934143c20 con 0x7f4934143840 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f493aa2a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f493415df80 con 0x7f49340b4520 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f4933fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4934143840 0x7f49340b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f4933fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4934143840 0x7f49340b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50232/0 (socket says 172.21.15.137:50232) 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f4933fff640 1 -- 172.21.15.137:0/2580804762 learned_addr learned my addr 172.21.15.137:0/2580804762 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f49337fe640 1 --2- 172.21.15.137:0/2580804762 >> v2:172.21.15.170:3300/0 conn(0x7f49340b4520 0x7f49340b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f4933fff640 1 -- 172.21.15.137:0/2580804762 >> v2:172.21.15.170:3300/0 conn(0x7f49340b4520 msgr2=0x7f49340b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f4933fff640 1 --2- 172.21.15.137:0/2580804762 >> v2:172.21.15.170:3300/0 conn(0x7f49340b4520 0x7f49340b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f4933fff640 1 -- 172.21.15.137:0/2580804762 >> v1:172.21.15.170:6789/0 conn(0x7f49340b53f0 legacy=0x7f4934160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.277+0000 7f4933fff640 1 -- 172.21.15.137:0/2580804762 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493415e260 con 0x7f4934143840 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f4933fff640 1 --2- 172.21.15.137:0/2580804762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4934143840 0x7f49340b3fe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f49340b0a90 tx=0x7f492402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7a3e0c151973a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f4932ffd640 1 -- 172.21.15.137:0/2580804762 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924037070 con 0x7f4934143840 2024-04-26T21:59:15.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f4932ffd640 1 -- 172.21.15.137:0/2580804762 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4924032440 con 0x7f4934143840 2024-04-26T21:59:15.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f4932ffd640 1 -- 172.21.15.137:0/2580804762 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924032810 con 0x7f4934143840 2024-04-26T21:59:15.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f493aa2a640 1 -- 172.21.15.137:0/2580804762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4934143840 msgr2=0x7f49340b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f493aa2a640 1 --2- 172.21.15.137:0/2580804762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4934143840 0x7f49340b3fe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f49340b0a90 tx=0x7f492402a270 comp rx=0 tx=0).stop 2024-04-26T21:59:15.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f493aa2a640 1 -- 172.21.15.137:0/2580804762 shutdown_connections 2024-04-26T21:59:15.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f493aa2a640 1 --2- 172.21.15.137:0/2580804762 >> v2:172.21.15.170:3300/0 conn(0x7f49340b4520 0x7f49340b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f493aa2a640 1 --2- 172.21.15.137:0/2580804762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4934143840 0x7f49340b3fe0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f493aa2a640 1 -- 172.21.15.137:0/2580804762 >> 172.21.15.137:0/2580804762 conn(0x7f49340cd8a0 msgr2=0x7f49340cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:15.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f493aa2a640 1 -- 172.21.15.137:0/2580804762 shutdown_connections 2024-04-26T21:59:15.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.278+0000 7f493aa2a640 1 -- 172.21.15.137:0/2580804762 wait complete. 2024-04-26T21:59:15.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.280+0000 7f493aa2a640 1 Processor -- start 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.280+0000 7f493aa2a640 1 -- start start 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.280+0000 7f493aa2a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49340b4520 0x7f493413ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.280+0000 7f493aa2a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49340b53f0 0x7f4934150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.280+0000 7f493aa2a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4934143840 0x7f493413d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.280+0000 7f493aa2a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f493415da40 con 0x7f49340b53f0 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.280+0000 7f493aa2a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f493415d8c0 con 0x7f4934143840 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.280+0000 7f493aa2a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f49340d0000 con 0x7f49340b4520 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.280+0000 7f49337fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49340b53f0 0x7f4934150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f49337fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49340b53f0 0x7f4934150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50238/0 (socket says 172.21.15.137:50238) 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f49337fe640 1 -- 172.21.15.137:0/2581866766 learned_addr learned my addr 172.21.15.137:0/2581866766 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f4933fff640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49340b4520 0x7f493413ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f4938fc7640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4934143840 0x7f493413d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f49337fe640 1 -- 172.21.15.137:0/2581866766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49340b4520 msgr2=0x7f493413ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f49337fe640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49340b4520 0x7f493413ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f49337fe640 1 -- 172.21.15.137:0/2581866766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4934143840 msgr2=0x7f493413d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f49337fe640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4934143840 0x7f493413d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f49337fe640 1 -- 172.21.15.137:0/2581866766 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493413c3b0 con 0x7f49340b53f0 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f4938fc7640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4934143840 0x7f493413d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f49337fe640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49340b53f0 0x7f4934150710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f492800d800 tx=0x7f492800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f4930ff9640 1 -- 172.21.15.137:0/2581866766 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800b6c0 con 0x7f49340b53f0 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f4930ff9640 1 -- 172.21.15.137:0/2581866766 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4928019070 con 0x7f49340b53f0 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493413c690 con 0x7f49340b53f0 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f4930ff9640 1 -- 172.21.15.137:0/2581866766 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800ba80 con 0x7f49340b53f0 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.281+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493413cc50 con 0x7f49340b53f0 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.282+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493406a290 con 0x7f49340b53f0 2024-04-26T21:59:15.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.283+0000 7f4930ff9640 1 -- 172.21.15.137:0/2581866766 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f492800bc20 con 0x7f49340b53f0 2024-04-26T21:59:15.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.283+0000 7f4930ff9640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f492006c8f0 0x7f492006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.283+0000 7f4930ff9640 1 -- 172.21.15.137:0/2581866766 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f492808bee0 con 0x7f49340b53f0 2024-04-26T21:59:15.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.283+0000 7f4933fff640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f492006c8f0 0x7f492006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.284+0000 7f4933fff640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f492006c8f0 0x7f492006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4924034000 tx=0x7f492402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:15.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.287+0000 7f4930ff9640 1 -- 172.21.15.137:0/2581866766 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f492805a3a0 con 0x7f49340b53f0 2024-04-26T21:59:15.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.462+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f49340ce420 con 0x7f49340b53f0 2024-04-26T21:59:15.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.462+0000 7f4930ff9640 1 -- 172.21.15.137:0/2581866766 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f4928059ca0 con 0x7f49340b53f0 2024-04-26T21:59:15.463 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:15.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f492006c8f0 msgr2=0x7f492006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f492006c8f0 0x7f492006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4924034000 tx=0x7f492402e000 comp rx=0 tx=0).stop 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49340b53f0 msgr2=0x7f4934150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49340b53f0 0x7f4934150710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f492800d800 tx=0x7f492800dcc0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 shutdown_connections 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f492006c8f0 0x7f492006edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49340b53f0 0x7f4934150710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4934143840 0x7f493413d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 --2- 172.21.15.137:0/2581866766 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49340b4520 0x7f493413ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 >> 172.21.15.137:0/2581866766 conn(0x7f49340cd8a0 msgr2=0x7f49340cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 shutdown_connections 2024-04-26T21:59:15.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.464+0000 7f493aa2a640 1 -- 172.21.15.137:0/2581866766 wait complete. 2024-04-26T21:59:15.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:15.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.575+0000 7f440f262640 1 Processor -- start 2024-04-26T21:59:15.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.575+0000 7f440f262640 1 -- start start 2024-04-26T21:59:15.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440f262640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f440815b930 0x7f440815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440f262640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 0x7f44080cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440f262640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440815c530 con 0x7f440815f4f0 2024-04-26T21:59:15.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440f262640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f440815c810 con 0x7f440815b930 2024-04-26T21:59:15.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440f262640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f440815caf0 con 0x7f4408074200 2024-04-26T21:59:15.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440cffe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f440815b930 0x7f440815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440cffe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f440815b930 0x7f440815bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54054/0 (socket says 172.21.15.137:54054) 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440cffe640 1 -- 172.21.15.137:0/1106086781 learned_addr learned my addr 172.21.15.137:0/1106086781 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440d7ff640 1 --2- 172.21.15.137:0/1106086781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 0x7f44080cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440cffe640 1 -- 172.21.15.137:0/1106086781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 msgr2=0x7f44080cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440cffe640 1 --2- 172.21.15.137:0/1106086781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 0x7f44080cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440cffe640 1 -- 172.21.15.137:0/1106086781 >> v1:172.21.15.170:6789/0 conn(0x7f440815f4f0 legacy=0x7f4408073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440cffe640 1 -- 172.21.15.137:0/1106086781 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440815cdd0 con 0x7f440815b930 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.576+0000 7f440d7ff640 1 --2- 172.21.15.137:0/1106086781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 0x7f44080cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.577+0000 7f440cffe640 1 --2- 172.21.15.137:0/1106086781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 0x7f440815bd10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00bb10 tx=0x7f43fc02c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da7d2ff937c6e7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.577+0000 7f44077fe640 1 -- 172.21.15.137:0/1106086781 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc032790 con 0x7f440815b930 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.577+0000 7f44077fe640 1 -- 172.21.15.137:0/1106086781 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc038070 con 0x7f440815b930 2024-04-26T21:59:15.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.577+0000 7f44077fe640 1 -- 172.21.15.137:0/1106086781 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc032b50 con 0x7f440815b930 2024-04-26T21:59:15.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.577+0000 7f440f262640 1 -- 172.21.15.137:0/1106086781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 msgr2=0x7f440815bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.577+0000 7f440f262640 1 --2- 172.21.15.137:0/1106086781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 0x7f440815bd10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00bb10 tx=0x7f43fc02c8d0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.578+0000 7f440f262640 1 -- 172.21.15.137:0/1106086781 shutdown_connections 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.578+0000 7f440f262640 1 --2- 172.21.15.137:0/1106086781 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 0x7f44080cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.578+0000 7f440f262640 1 --2- 172.21.15.137:0/1106086781 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 0x7f440815bd10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.578+0000 7f440f262640 1 -- 172.21.15.137:0/1106086781 >> 172.21.15.137:0/1106086781 conn(0x7f44080cd8a0 msgr2=0x7f44080cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.578+0000 7f440f262640 1 -- 172.21.15.137:0/1106086781 shutdown_connections 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.578+0000 7f440f262640 1 -- 172.21.15.137:0/1106086781 wait complete. 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.579+0000 7f440f262640 1 Processor -- start 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.579+0000 7f440f262640 1 -- start start 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440f262640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 0x7f44081f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440f262640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 0x7f44081e5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440f262640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f440815f4f0 0x7f4408155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440f262640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f440806fdd0 con 0x7f440815b930 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440f262640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f440815c250 con 0x7f440815f4f0 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440f262640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f440806f340 con 0x7f4408074200 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f4407fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 0x7f44081e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f4407fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 0x7f44081e5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54060/0 (socket says 172.21.15.137:54060) 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f4407fff640 1 -- 172.21.15.137:0/523846224 learned_addr learned my addr 172.21.15.137:0/523846224 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440cffe640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 0x7f44081f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f4407fff640 1 -- 172.21.15.137:0/523846224 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 msgr2=0x7f44081f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f4407fff640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 0x7f44081f3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f4407fff640 1 -- 172.21.15.137:0/523846224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f440815f4f0 msgr2=0x7f4408155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440d7ff640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f440815f4f0 0x7f4408155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f4407fff640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f440815f4f0 0x7f4408155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f4407fff640 1 -- 172.21.15.137:0/523846224 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44081f3fc0 con 0x7f440815b930 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f4407fff640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 0x7f44081e5210 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f43f400b3c0 tx=0x7f43f400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f44057fa640 1 -- 172.21.15.137:0/523846224 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4015020 con 0x7f440815b930 2024-04-26T21:59:15.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f44057fa640 1 -- 172.21.15.137:0/523846224 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f4011830 con 0x7f440815b930 2024-04-26T21:59:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44081e5c60 con 0x7f440815b930 2024-04-26T21:59:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f44057fa640 1 -- 172.21.15.137:0/523846224 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4011c40 con 0x7f440815b930 2024-04-26T21:59:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.580+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44081e6220 con 0x7f440815b930 2024-04-26T21:59:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.581+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440806a290 con 0x7f440815b930 2024-04-26T21:59:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.582+0000 7f44057fa640 1 -- 172.21.15.137:0/523846224 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43f4018020 con 0x7f440815b930 2024-04-26T21:59:15.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.582+0000 7f44057fa640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43ec06c8f0 0x7f43ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.582+0000 7f44057fa640 1 -- 172.21.15.137:0/523846224 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f43f408baa0 con 0x7f440815b930 2024-04-26T21:59:15.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.582+0000 7f440cffe640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43ec06c8f0 0x7f43ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.583+0000 7f440cffe640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43ec06c8f0 0x7f43ec06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43fc037000 tx=0x7f43fc032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:15.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.587+0000 7f44057fa640 1 -- 172.21.15.137:0/523846224 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f43f401f020 con 0x7f440815b930 2024-04-26T21:59:15.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.764+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f44080d0260 con 0x7f440815b930 2024-04-26T21:59:15.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.764+0000 7f44057fa640 1 -- 172.21.15.137:0/523846224 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f43f40172c0 con 0x7f440815b930 2024-04-26T21:59:15.764 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:15.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43ec06c8f0 msgr2=0x7f43ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43ec06c8f0 0x7f43ec06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f43fc037000 tx=0x7f43fc032000 comp rx=0 tx=0).stop 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 msgr2=0x7f44081e5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 0x7f44081e5210 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f43f400b3c0 tx=0x7f43f400b880 comp rx=0 tx=0).stop 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 shutdown_connections 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43ec06c8f0 0x7f43ec06edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f440815b930 0x7f44081e5210 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f440815f4f0 0x7f4408155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 --2- 172.21.15.137:0/523846224 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4408074200 0x7f44081f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 >> 172.21.15.137:0/523846224 conn(0x7f44080cd8a0 msgr2=0x7f44080cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 shutdown_connections 2024-04-26T21:59:15.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.766+0000 7f440f262640 1 -- 172.21.15.137:0/523846224 wait complete. 2024-04-26T21:59:15.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:15.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.877+0000 7f6a9e452640 1 Processor -- start 2024-04-26T21:59:15.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.877+0000 7f6a9e452640 1 -- start start 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.878+0000 7f6a9e452640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a98145580 0x7f6a9806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.878+0000 7f6a9e452640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a98071da0 con 0x7f6a98142a00 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.878+0000 7f6a9e452640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a98072060 con 0x7f6a98162ee0 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.878+0000 7f6a9e452640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6a981459f0 con 0x7f6a98145580 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.878+0000 7f6a977fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a98145580 0x7f6a9806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.878+0000 7f6a977fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a98145580 0x7f6a9806d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54070/0 (socket says 172.21.15.137:54070) 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.878+0000 7f6a977fe640 1 -- 172.21.15.137:0/2309863215 learned_addr learned my addr 172.21.15.137:0/2309863215 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.879+0000 7f6a977fe640 1 -- 172.21.15.137:0/2309863215 >> v1:172.21.15.170:6789/0 conn(0x7f6a98162ee0 legacy=0x7f6a981632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.879+0000 7f6a977fe640 1 -- 172.21.15.137:0/2309863215 >> v1:172.21.15.137:6789/0 conn(0x7f6a98142a00 legacy=0x7f6a98142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.879+0000 7f6a977fe640 1 -- 172.21.15.137:0/2309863215 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a98072340 con 0x7f6a98145580 2024-04-26T21:59:15.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.879+0000 7f6a977fe640 1 --2- 172.21.15.137:0/2309863215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 0x7f6a9806d3b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009870 tx=0x7f6a8c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d45f9cd851026a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:15.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.879+0000 7f6a96ffd640 1 -- 172.21.15.137:0/2309863215 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c037070 con 0x7f6a98145580 2024-04-26T21:59:15.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.879+0000 7f6a96ffd640 1 -- 172.21.15.137:0/2309863215 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c032440 con 0x7f6a98145580 2024-04-26T21:59:15.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.879+0000 7f6a96ffd640 1 -- 172.21.15.137:0/2309863215 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c032810 con 0x7f6a98145580 2024-04-26T21:59:15.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.880+0000 7f6a9e452640 1 -- 172.21.15.137:0/2309863215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 msgr2=0x7f6a9806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.880+0000 7f6a9e452640 1 --2- 172.21.15.137:0/2309863215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 0x7f6a9806d3b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009870 tx=0x7f6a8c02a2a0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.880+0000 7f6a9e452640 1 -- 172.21.15.137:0/2309863215 shutdown_connections 2024-04-26T21:59:15.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.880+0000 7f6a9e452640 1 --2- 172.21.15.137:0/2309863215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 0x7f6a9806d3b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.880+0000 7f6a9e452640 1 -- 172.21.15.137:0/2309863215 >> 172.21.15.137:0/2309863215 conn(0x7f6a980705b0 msgr2=0x7f6a980709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:15.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.880+0000 7f6a9e452640 1 -- 172.21.15.137:0/2309863215 shutdown_connections 2024-04-26T21:59:15.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.880+0000 7f6a9e452640 1 -- 172.21.15.137:0/2309863215 wait complete. 2024-04-26T21:59:15.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.881+0000 7f6a9e452640 1 Processor -- start 2024-04-26T21:59:15.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.881+0000 7f6a9e452640 1 -- start start 2024-04-26T21:59:15.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a9e452640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a98142a00 0x7f6a980c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a9e452640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 0x7f6a98141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a9e452640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a98162ee0 0x7f6a980b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a9e452640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9806d8f0 con 0x7f6a98145580 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a9e452640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a98072990 con 0x7f6a98142a00 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a9e452640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9806da70 con 0x7f6a98162ee0 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a977fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 0x7f6a98141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a977fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 0x7f6a98141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54086/0 (socket says 172.21.15.137:54086) 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a977fe640 1 -- 172.21.15.137:0/516420621 learned_addr learned my addr 172.21.15.137:0/516420621 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a97fff640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a98142a00 0x7f6a980c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a9c9ef640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a98162ee0 0x7f6a980b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a977fe640 1 -- 172.21.15.137:0/516420621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a98162ee0 msgr2=0x7f6a980b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a977fe640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a98162ee0 0x7f6a980b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a977fe640 1 -- 172.21.15.137:0/516420621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a98142a00 msgr2=0x7f6a980c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:15.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a977fe640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a98142a00 0x7f6a980c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a977fe640 1 -- 172.21.15.137:0/516420621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a980c86a0 con 0x7f6a98145580 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a97fff640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a98142a00 0x7f6a980c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.882+0000 7f6a977fe640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 0x7f6a98141ad0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009870 tx=0x7f6a8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.883+0000 7f6a94ff9640 1 -- 172.21.15.137:0/516420621 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c041020 con 0x7f6a98145580 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.883+0000 7f6a94ff9640 1 -- 172.21.15.137:0/516420621 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c030970 con 0x7f6a98145580 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.883+0000 7f6a94ff9640 1 -- 172.21.15.137:0/516420621 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c037040 con 0x7f6a98145580 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.883+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a980c8980 con 0x7f6a98145580 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.883+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a980c8f40 con 0x7f6a98145580 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.884+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9806a290 con 0x7f6a98145580 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.884+0000 7f6a94ff9640 1 -- 172.21.15.137:0/516420621 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a8c044020 con 0x7f6a98145580 2024-04-26T21:59:15.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.884+0000 7f6a94ff9640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a8406c8f0 0x7f6a8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:15.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.885+0000 7f6a94ff9640 1 -- 172.21.15.137:0/516420621 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6a8c0ac530 con 0x7f6a98145580 2024-04-26T21:59:15.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.885+0000 7f6a97fff640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a8406c8f0 0x7f6a8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:15.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.885+0000 7f6a97fff640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a8406c8f0 0x7f6a8406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a88006fd0 tx=0x7f6a88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:15.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:15.889+0000 7f6a94ff9640 1 -- 172.21.15.137:0/516420621 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6a9806a290 con 0x7f6a98145580 2024-04-26T21:59:16.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.066+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6a980693d0 con 0x7f6a98145580 2024-04-26T21:59:16.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.067+0000 7f6a94ff9640 1 -- 172.21.15.137:0/516420621 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f6a8c04b030 con 0x7f6a98145580 2024-04-26T21:59:16.067 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a8406c8f0 msgr2=0x7f6a8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a8406c8f0 0x7f6a8406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a88006fd0 tx=0x7f6a88008040 comp rx=0 tx=0).stop 2024-04-26T21:59:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 msgr2=0x7f6a98141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 0x7f6a98141ad0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009870 tx=0x7f6a8c0046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 shutdown_connections 2024-04-26T21:59:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a8406c8f0 0x7f6a8406edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a98145580 0x7f6a98141ad0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a98162ee0 0x7f6a980b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 --2- 172.21.15.137:0/516420621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a98142a00 0x7f6a980c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 >> 172.21.15.137:0/516420621 conn(0x7f6a980705b0 msgr2=0x7f6a981632c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:16.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 shutdown_connections 2024-04-26T21:59:16.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.069+0000 7f6a9e452640 1 -- 172.21.15.137:0/516420621 wait complete. 2024-04-26T21:59:16.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:59:16.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.177+0000 7fd34922c640 1 Processor -- start 2024-04-26T21:59:16.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.177+0000 7fd34922c640 1 -- start start 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.178+0000 7fd34922c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd34409c400 0x7fd3440cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.178+0000 7fd34922c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd344070520 0x7fd3440cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.178+0000 7fd34922c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3440d14c0 con 0x7fd344070d20 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.178+0000 7fd34922c640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd3440d1290 con 0x7fd34409c400 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.178+0000 7fd34922c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd3440d1760 con 0x7fd344070520 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.178+0000 7fd34259c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd34409c400 0x7fd3440cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.178+0000 7fd34259c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd34409c400 0x7fd3440cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54092/0 (socket says 172.21.15.137:54092) 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.178+0000 7fd34259c640 1 -- 172.21.15.137:0/1769125430 learned_addr learned my addr 172.21.15.137:0/1769125430 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.178+0000 7fd34359e640 1 --2- 172.21.15.137:0/1769125430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd344070520 0x7fd3440cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.179+0000 7fd34259c640 1 -- 172.21.15.137:0/1769125430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd344070520 msgr2=0x7fd3440cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.179+0000 7fd34259c640 1 --2- 172.21.15.137:0/1769125430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd344070520 0x7fd3440cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.179+0000 7fd34259c640 1 -- 172.21.15.137:0/1769125430 >> v1:172.21.15.170:6789/0 conn(0x7fd344070d20 legacy=0x7fd344071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.179+0000 7fd34259c640 1 -- 172.21.15.137:0/1769125430 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3440d1a40 con 0x7fd34409c400 2024-04-26T21:59:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.179+0000 7fd34259c640 1 --2- 172.21.15.137:0/1769125430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34409c400 0x7fd3440cd5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009870 tx=0x7fd32c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3837ff16e90284 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.179+0000 7fd341d9b640 1 -- 172.21.15.137:0/1769125430 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c037070 con 0x7fd34409c400 2024-04-26T21:59:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.179+0000 7fd341d9b640 1 -- 172.21.15.137:0/1769125430 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32c032440 con 0x7fd34409c400 2024-04-26T21:59:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.179+0000 7fd341d9b640 1 -- 172.21.15.137:0/1769125430 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c032810 con 0x7fd34409c400 2024-04-26T21:59:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.180+0000 7fd34922c640 1 -- 172.21.15.137:0/1769125430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34409c400 msgr2=0x7fd3440cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.180+0000 7fd34922c640 1 --2- 172.21.15.137:0/1769125430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34409c400 0x7fd3440cd5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009870 tx=0x7fd32c02a270 comp rx=0 tx=0).stop 2024-04-26T21:59:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.180+0000 7fd34922c640 1 -- 172.21.15.137:0/1769125430 shutdown_connections 2024-04-26T21:59:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.180+0000 7fd34922c640 1 --2- 172.21.15.137:0/1769125430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd344070520 0x7fd3440cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.180+0000 7fd34922c640 1 --2- 172.21.15.137:0/1769125430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34409c400 0x7fd3440cd5a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.180+0000 7fd34922c640 1 -- 172.21.15.137:0/1769125430 >> 172.21.15.137:0/1769125430 conn(0x7fd3440b4a40 msgr2=0x7fd3440b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:16.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.180+0000 7fd34922c640 1 -- 172.21.15.137:0/1769125430 shutdown_connections 2024-04-26T21:59:16.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.180+0000 7fd34922c640 1 -- 172.21.15.137:0/1769125430 wait complete. 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.181+0000 7fd34922c640 1 Processor -- start 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.181+0000 7fd34922c640 1 -- start start 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd34922c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd344070520 0x7fd3440c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd34922c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd344070d20 0x7fd3441e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd34922c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd34409c400 0x7fd3440b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd34922c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440cf350 con 0x7fd344070520 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd34922c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440d2000 con 0x7fd344070d20 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd34922c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd3440d2520 con 0x7fd34409c400 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd342d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd344070520 0x7fd3440c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd342d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd344070520 0x7fd3440c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54104/0 (socket says 172.21.15.137:54104) 2024-04-26T21:59:16.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd342d9d640 1 -- 172.21.15.137:0/535452390 learned_addr learned my addr 172.21.15.137:0/535452390 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd34259c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd344070d20 0x7fd3441e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd34359e640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd34409c400 0x7fd3440b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd342d9d640 1 -- 172.21.15.137:0/535452390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd34409c400 msgr2=0x7fd3440b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd342d9d640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd34409c400 0x7fd3440b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd342d9d640 1 -- 172.21.15.137:0/535452390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd344070d20 msgr2=0x7fd3441e8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.182+0000 7fd342d9d640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd344070d20 0x7fd3441e8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.183+0000 7fd342d9d640 1 -- 172.21.15.137:0/535452390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd344157b90 con 0x7fd344070520 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.183+0000 7fd34259c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd344070d20 0x7fd3441e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.183+0000 7fd342d9d640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd344070520 0x7fd3440c92b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00c730 tx=0x7fd33c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.183+0000 7fd33b7fe640 1 -- 172.21.15.137:0/535452390 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c016020 con 0x7fd344070520 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.183+0000 7fd33b7fe640 1 -- 172.21.15.137:0/535452390 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33c006d50 con 0x7fd344070520 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.183+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3440c8210 con 0x7fd344070520 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.183+0000 7fd33b7fe640 1 -- 172.21.15.137:0/535452390 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c003bb0 con 0x7fd344070520 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.183+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3440c8ab0 con 0x7fd344070520 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.184+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3440693d0 con 0x7fd344070520 2024-04-26T21:59:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.184+0000 7fd33b7fe640 1 -- 172.21.15.137:0/535452390 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd33c00a850 con 0x7fd344070520 2024-04-26T21:59:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.185+0000 7fd33b7fe640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd32406c8f0 0x7fd32406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.185+0000 7fd34259c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd32406c8f0 0x7fd32406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.185+0000 7fd33b7fe640 1 -- 172.21.15.137:0/535452390 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd33c08b7a0 con 0x7fd344070520 2024-04-26T21:59:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.185+0000 7fd34259c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd32406c8f0 0x7fd32406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd32c034000 tx=0x7fd32c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.189+0000 7fd33b7fe640 1 -- 172.21.15.137:0/535452390 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd33c020020 con 0x7fd344070520 2024-04-26T21:59:16.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.382+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd344074880 con 0x7fd344070520 2024-04-26T21:59:16.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.382+0000 7fd33b7fe640 1 -- 172.21.15.137:0/535452390 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fd33c019310 con 0x7fd344070520 2024-04-26T21:59:16.382 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T21:59:16.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd32406c8f0 msgr2=0x7fd32406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd32406c8f0 0x7fd32406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd32c034000 tx=0x7fd32c02e000 comp rx=0 tx=0).stop 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd344070520 msgr2=0x7fd3440c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd344070520 0x7fd3440c92b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00c730 tx=0x7fd33c00cbf0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 shutdown_connections 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd32406c8f0 0x7fd32406edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd34409c400 0x7fd3440b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd344070d20 0x7fd3441e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 --2- 172.21.15.137:0/535452390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd344070520 0x7fd3440c92b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 >> 172.21.15.137:0/535452390 conn(0x7fd3440b4a40 msgr2=0x7fd3440b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 shutdown_connections 2024-04-26T21:59:16.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.384+0000 7fd34922c640 1 -- 172.21.15.137:0/535452390 wait complete. 2024-04-26T21:59:16.395 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-26T21:59:16.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:16.396 DEBUG:teuthology.orchestra.run.smithi170:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-26T21:59:16.426 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T21:59:16.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:16.426 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T21:59:16.503 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:16.504 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:16.519 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:16.519 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:16.575 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:16.575 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:16.631 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:16.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.767+0000 7fdd0b767640 1 Processor -- start 2024-04-26T21:59:16.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.767+0000 7fdd0b767640 1 -- start start 2024-04-26T21:59:16.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.768+0000 7fdd0b767640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd04070d20 0x7fdd04071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.768+0000 7fdd0b767640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdd04070520 0x7fdd04163640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.768+0000 7fdd0b767640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd040d14c0 con 0x7fdd0409c400 2024-04-26T21:59:16.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.768+0000 7fdd0b767640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdd040d1290 con 0x7fdd04070520 2024-04-26T21:59:16.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.768+0000 7fdd0b767640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdd04071640 con 0x7fdd04070d20 2024-04-26T21:59:16.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.768+0000 7fdd08d02640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdd0409c400 0x7fdd04162f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50008/0 (socket says 172.21.15.137:50008) 2024-04-26T21:59:16.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.768+0000 7fdd08d02640 1 -- 172.21.15.137:0/1857005024 learned_addr learned my addr 172.21.15.137:0/1857005024 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:16.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333980575 0 0) 0x7fdd040d14c0 con 0x7fdd0409c400 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd09503640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd04070d20 0x7fdd04071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcf0003520 con 0x7fdd0409c400 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd09d04640 1 --2- 172.21.15.137:0/1857005024 >> v2:172.21.15.170:3300/0 conn(0x7fdd04070520 0x7fdd04163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2842179654 0 0) 0x7fdcf0003520 con 0x7fdd0409c400 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd04070d20 msgr2=0x7fdd04071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd04070d20 0x7fdd04071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 >> v2:172.21.15.170:3300/0 conn(0x7fdd04070520 msgr2=0x7fdd04163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 --2- 172.21.15.137:0/1857005024 >> v2:172.21.15.170:3300/0 conn(0x7fdd04070520 0x7fdd04163640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd040ce5b0 con 0x7fdd0409c400 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fdcf4001670 con 0x7fdd0409c400 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 >> v1:172.21.15.137:6789/0 conn(0x7fdd0409c400 legacy=0x7fdd04162f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcf00039b0 0x7fdcf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf0004800 0x7fdcf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf00051c0 0x7fdcf000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd04071640 con 0x7fdcf0004800 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf000bfb0 con 0x7fdcf00051c0 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf000c180 con 0x7fdcf00039b0 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd09503640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd04070d20 0x7fdd04071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd09d04640 1 --2- 172.21.15.137:0/1857005024 >> v2:172.21.15.170:3300/0 conn(0x7fdd04070520 0x7fdd04163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd08d02640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf0004800 0x7fdcf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd09d04640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf00051c0 0x7fdcf000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd09503640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcf00039b0 0x7fdcf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd08d02640 1 -- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcf00039b0 msgr2=0x7fdcf0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd08d02640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcf00039b0 0x7fdcf0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd08d02640 1 -- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf00051c0 msgr2=0x7fdcf000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd08d02640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf00051c0 0x7fdcf000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd08d02640 1 -- 172.21.15.137:0/1857005024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf0003520 con 0x7fdcf0004800 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd09503640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdcf00039b0 0x7fdcf0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.769+0000 7fdd09d04640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf00051c0 0x7fdcf000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.770+0000 7fdd08d02640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf0004800 0x7fdcf0004c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c240 tx=0x7fdcf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f5971e07556124 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.770+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4007d50 con 0x7fdcf0004800 2024-04-26T21:59:16.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.770+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf402e070 con 0x7fdcf0004800 2024-04-26T21:59:16.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.770+0000 7fdcfbfff640 1 -- 172.21.15.137:0/1857005024 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4005d70 con 0x7fdcf0004800 2024-04-26T21:59:16.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.771+0000 7fdd0b767640 1 -- 172.21.15.137:0/1857005024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf0004800 msgr2=0x7fdcf0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.771+0000 7fdd0b767640 1 --2- 172.21.15.137:0/1857005024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdcf0004800 0x7fdcf0004c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c240 tx=0x7fdcf0005830 comp rx=0 tx=0).stop 2024-04-26T21:59:16.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.771+0000 7fdd09d04640 1 -- 172.21.15.137:0/1857005024 reap_dead start 2024-04-26T21:59:16.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.771+0000 7fdd0b767640 1 -- 172.21.15.137:0/1857005024 shutdown_connections 2024-04-26T21:59:16.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.771+0000 7fdd0b767640 1 -- 172.21.15.137:0/1857005024 >> 172.21.15.137:0/1857005024 conn(0x7fdd040b4a40 msgr2=0x7fdd040b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:16.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.771+0000 7fdd0b767640 1 -- 172.21.15.137:0/1857005024 shutdown_connections 2024-04-26T21:59:16.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.771+0000 7fdd0b767640 1 -- 172.21.15.137:0/1857005024 wait complete. 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.772+0000 7fdd0b767640 1 Processor -- start 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.772+0000 7fdd0b767640 1 -- start start 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd0b767640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf0004800 0x7fdd04156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd0b767640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04157240 0x7fdd040b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd0b767640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd0415fe40 0x7fdd041602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd0b767640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040d1d20 con 0x7fdd04157240 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd0b767640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040d1a40 con 0x7fdcf0004800 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd0b767640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdd040d2000 con 0x7fdd0415fe40 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd08d02640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04157240 0x7fdd040b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd08d02640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04157240 0x7fdd040b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54118/0 (socket says 172.21.15.137:54118) 2024-04-26T21:59:16.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd08d02640 1 -- 172.21.15.137:0/1978395487 learned_addr learned my addr 172.21.15.137:0/1978395487 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd09503640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf0004800 0x7fdd04156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd08d02640 1 -- 172.21.15.137:0/1978395487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd0415fe40 msgr2=0x7fdd041602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd09d04640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd0415fe40 0x7fdd041602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd08d02640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd0415fe40 0x7fdd041602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd08d02640 1 -- 172.21.15.137:0/1978395487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf0004800 msgr2=0x7fdd04156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd08d02640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf0004800 0x7fdd04156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd08d02640 1 -- 172.21.15.137:0/1978395487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd041f8a80 con 0x7fdd04157240 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd09503640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf0004800 0x7fdd04156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd08d02640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04157240 0x7fdd040b1b30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c240 tx=0x7fdcf4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdcf9ffb640 1 -- 172.21.15.137:0/1978395487 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4041020 con 0x7fdd04157240 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdcf9ffb640 1 -- 172.21.15.137:0/1978395487 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf4007280 con 0x7fdd04157240 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdcf9ffb640 1 -- 172.21.15.137:0/1978395487 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4007d50 con 0x7fdd04157240 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.773+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd041f8d60 con 0x7fdd04157240 2024-04-26T21:59:16.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.774+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd041f9320 con 0x7fdd04157240 2024-04-26T21:59:16.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.774+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd040693d0 con 0x7fdd04157240 2024-04-26T21:59:16.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.775+0000 7fdcf9ffb640 1 -- 172.21.15.137:0/1978395487 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcf4044020 con 0x7fdd04157240 2024-04-26T21:59:16.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.775+0000 7fdcf9ffb640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdce806c8f0 0x7fdce806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:16.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.775+0000 7fdcf9ffb640 1 -- 172.21.15.137:0/1978395487 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdcf40abc30 con 0x7fdd04157240 2024-04-26T21:59:16.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.775+0000 7fdd09503640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdce806c8f0 0x7fdce806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:16.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.776+0000 7fdd09503640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdce806c8f0 0x7fdce806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdd04073820 tx=0x7fdd0000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:16.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.780+0000 7fdcf9ffb640 1 -- 172.21.15.137:0/1978395487 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdcf404b070 con 0x7fdd04157240 2024-04-26T21:59:16.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.954+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd04074880 con 0x7fdd04157240 2024-04-26T21:59:16.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.955+0000 7fdcf9ffb640 1 -- 172.21.15.137:0/1978395487 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7fdcf407a0f0 con 0x7fdd04157240 2024-04-26T21:59:16.955 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:16.955 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdce806c8f0 msgr2=0x7fdce806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdce806c8f0 0x7fdce806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdd04073820 tx=0x7fdd0000b040 comp rx=0 tx=0).stop 2024-04-26T21:59:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04157240 msgr2=0x7fdd040b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04157240 0x7fdd040b1b30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400c240 tx=0x7fdcf4001a40 comp rx=0 tx=0).stop 2024-04-26T21:59:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 shutdown_connections 2024-04-26T21:59:16.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdce806c8f0 0x7fdce806edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd04157240 0x7fdd040b1b30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd0415fe40 0x7fdd041602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 --2- 172.21.15.137:0/1978395487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdcf0004800 0x7fdd04156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:16.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 >> 172.21.15.137:0/1978395487 conn(0x7fdd040b4a40 msgr2=0x7fdd041612a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:16.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 shutdown_connections 2024-04-26T21:59:16.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:16.957+0000 7fdd0b767640 1 -- 172.21.15.137:0/1978395487 wait complete. 2024-04-26T21:59:16.968 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:16.968 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:17.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.068+0000 7f04435da640 1 Processor -- start 2024-04-26T21:59:17.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.068+0000 7f04435da640 1 -- start start 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f04435da640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f043c15f260 0x7f043c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f04435da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f043c0b4e00 0x7f043c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f04435da640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f043c15f640 con 0x7f043c070560 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f04435da640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f043c06c2a0 con 0x7f043c15f260 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f04435da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f043c06c580 con 0x7f043c0b4e00 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0440b75640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f043c070560 0x7f043c0b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50018/0 (socket says 172.21.15.137:50018) 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0440b75640 1 -- 172.21.15.137:0/390677118 learned_addr learned my addr 172.21.15.137:0/390677118 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297762259 0 0) 0x7f043c15f640 con 0x7f043c070560 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0428003520 con 0x7f043c070560 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0441b77640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f043c0b4e00 0x7f043c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0441376640 1 --2- 172.21.15.137:0/390677118 >> v2:172.21.15.170:3300/0 conn(0x7f043c15f260 0x7f043c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4030611412 0 0) 0x7f0428003520 con 0x7f043c070560 2024-04-26T21:59:17.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f043c0b4e00 msgr2=0x7f043c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f043c0b4e00 0x7f043c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 >> v2:172.21.15.170:3300/0 conn(0x7f043c15f260 msgr2=0x7f043c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 --2- 172.21.15.137:0/390677118 >> v2:172.21.15.170:3300/0 conn(0x7f043c15f260 0x7f043c06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c06c860 con 0x7f043c070560 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f042c001670 con 0x7f043c070560 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 >> v1:172.21.15.137:6789/0 conn(0x7f043c070560 legacy=0x7f043c0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04280039b0 0x7f0428003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0428004800 0x7f0428004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04280051c0 0x7f042800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f043c06c2a0 con 0x7f0428004800 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f043c06c580 con 0x7f04280051c0 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f042800c000 con 0x7f04280039b0 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0441b77640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f043c0b4e00 0x7f043c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:17.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.069+0000 7f0440b75640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0428004800 0x7f0428004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0441376640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04280039b0 0x7f0428003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0441b77640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04280051c0 0x7f042800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0440b75640 1 -- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04280039b0 msgr2=0x7f0428003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0440b75640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04280039b0 0x7f0428003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0440b75640 1 -- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04280051c0 msgr2=0x7f042800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0440b75640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04280051c0 0x7f042800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0440b75640 1 -- 172.21.15.137:0/390677118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0428003520 con 0x7f0428004800 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0441376640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04280039b0 0x7f0428003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0440b75640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0428004800 0x7f0428004c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c240 tx=0x7f0428005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64eb369908efc2fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c007d30 con 0x7f0428004800 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f042c0058d0 con 0x7f0428004800 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.070+0000 7f0433fff640 1 -- 172.21.15.137:0/390677118 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042c005d20 con 0x7f0428004800 2024-04-26T21:59:17.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.071+0000 7f04435da640 1 -- 172.21.15.137:0/390677118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0428004800 msgr2=0x7f0428004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.071+0000 7f04435da640 1 --2- 172.21.15.137:0/390677118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0428004800 0x7f0428004c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f042c00c240 tx=0x7f0428005830 comp rx=0 tx=0).stop 2024-04-26T21:59:17.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.071+0000 7f0441b77640 1 -- 172.21.15.137:0/390677118 reap_dead start 2024-04-26T21:59:17.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.071+0000 7f04435da640 1 -- 172.21.15.137:0/390677118 shutdown_connections 2024-04-26T21:59:17.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.071+0000 7f04435da640 1 -- 172.21.15.137:0/390677118 >> 172.21.15.137:0/390677118 conn(0x7f043c0d1660 msgr2=0x7f043c0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:17.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.071+0000 7f04435da640 1 -- 172.21.15.137:0/390677118 shutdown_connections 2024-04-26T21:59:17.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.071+0000 7f04435da640 1 -- 172.21.15.137:0/390677118 wait complete. 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.072+0000 7f04435da640 1 Processor -- start 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.072+0000 7f04435da640 1 -- start start 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f04435da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0428004800 0x7f043c161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f04435da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f043c159340 0x7f043c0d0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f04435da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f043c0d0c40 0x7f043c15f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f04435da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f043c06d100 con 0x7f043c0d0c40 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f04435da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f043c06ce20 con 0x7f043c159340 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f04435da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f043c06db60 con 0x7f0428004800 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441b77640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f043c0d0c40 0x7f043c15f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441b77640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f043c0d0c40 0x7f043c15f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54138/0 (socket says 172.21.15.137:54138) 2024-04-26T21:59:17.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441b77640 1 -- 172.21.15.137:0/3045704603 learned_addr learned my addr 172.21.15.137:0/3045704603 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0440b75640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f043c159340 0x7f043c0d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441376640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0428004800 0x7f043c161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441b77640 1 -- 172.21.15.137:0/3045704603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0428004800 msgr2=0x7f043c161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441b77640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0428004800 0x7f043c161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441b77640 1 -- 172.21.15.137:0/3045704603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f043c159340 msgr2=0x7f043c0d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441b77640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f043c159340 0x7f043c0d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441b77640 1 -- 172.21.15.137:0/3045704603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f043c0cfae0 con 0x7f043c0d0c40 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.073+0000 7f0441b77640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f043c0d0c40 0x7f043c15f880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f043c06e4d0 tx=0x7f0434007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.074+0000 7f0431ffb640 1 -- 172.21.15.137:0/3045704603 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434014410 con 0x7f043c0d0c40 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.074+0000 7f0431ffb640 1 -- 172.21.15.137:0/3045704603 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0434019070 con 0x7f043c0d0c40 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.074+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f043c1582a0 con 0x7f043c0d0c40 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.074+0000 7f0431ffb640 1 -- 172.21.15.137:0/3045704603 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04340147b0 con 0x7f043c0d0c40 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.074+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043c158860 con 0x7f043c0d0c40 2024-04-26T21:59:17.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.075+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043c06a290 con 0x7f043c0d0c40 2024-04-26T21:59:17.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.075+0000 7f0431ffb640 1 -- 172.21.15.137:0/3045704603 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0434014950 con 0x7f043c0d0c40 2024-04-26T21:59:17.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.075+0000 7f0431ffb640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f042006c8f0 0x7f042006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.075+0000 7f0431ffb640 1 -- 172.21.15.137:0/3045704603 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f043408c120 con 0x7f043c0d0c40 2024-04-26T21:59:17.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.075+0000 7f0441376640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f042006c8f0 0x7f042006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.076+0000 7f0441376640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f042006c8f0 0x7f042006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0438006fd0 tx=0x7f0438008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.080+0000 7f0431ffb640 1 -- 172.21.15.137:0/3045704603 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f043405a550 con 0x7f043c0d0c40 2024-04-26T21:59:17.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.253+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f043c15eaa0 con 0x7f043c0d0c40 2024-04-26T21:59:17.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.253+0000 7f0431ffb640 1 -- 172.21.15.137:0/3045704603 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f0434059e50 con 0x7f043c0d0c40 2024-04-26T21:59:17.254 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:17.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f042006c8f0 msgr2=0x7f042006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f042006c8f0 0x7f042006edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0438006fd0 tx=0x7f0438008040 comp rx=0 tx=0).stop 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f043c0d0c40 msgr2=0x7f043c15f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f043c0d0c40 0x7f043c15f880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f043c06e4d0 tx=0x7f0434007700 comp rx=0 tx=0).stop 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 shutdown_connections 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f042006c8f0 0x7f042006edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f043c0d0c40 0x7f043c15f880 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f043c159340 0x7f043c0d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 --2- 172.21.15.137:0/3045704603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0428004800 0x7f043c161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 >> 172.21.15.137:0/3045704603 conn(0x7f043c0d1660 msgr2=0x7f043c162ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 shutdown_connections 2024-04-26T21:59:17.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.255+0000 7f04435da640 1 -- 172.21.15.137:0/3045704603 wait complete. 2024-04-26T21:59:17.267 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:17.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.365+0000 7f9284d5f640 1 Processor -- start 2024-04-26T21:59:17.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.365+0000 7f9284d5f640 1 -- start start 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f9284d5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f928006f340 0x7f92800b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f9284d5f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92800d0300 0x7f928006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f9284d5f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f92800b3e50 0x7f92800720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f9284d5f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f928006fc60 con 0x7f92800d0300 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f9284d5f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f92800b46a0 con 0x7f92800b3e50 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f9284d5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f92800b5db0 con 0x7f928006f340 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927dd9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92800d0300 0x7f928006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927dd9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f92800d0300 0x7f928006f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54152/0 (socket says 172.21.15.137:54152) 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927dd9b640 1 -- 172.21.15.137:0/2556974862 learned_addr learned my addr 172.21.15.137:0/2556974862 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927dd9b640 1 -- 172.21.15.137:0/2556974862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f928006f340 msgr2=0x7f92800b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927e59c640 1 --2- 172.21.15.137:0/2556974862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f928006f340 0x7f92800b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927ed9d640 1 --2- 172.21.15.137:0/2556974862 >> v2:172.21.15.170:3300/0 conn(0x7f92800b3e50 0x7f92800720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927dd9b640 1 --2- 172.21.15.137:0/2556974862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f928006f340 0x7f92800b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927dd9b640 1 -- 172.21.15.137:0/2556974862 >> v2:172.21.15.170:3300/0 conn(0x7f92800b3e50 msgr2=0x7f92800720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927dd9b640 1 --2- 172.21.15.137:0/2556974862 >> v2:172.21.15.170:3300/0 conn(0x7f92800b3e50 0x7f92800720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927dd9b640 1 -- 172.21.15.137:0/2556974862 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92800b6090 con 0x7f92800d0300 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.366+0000 7f927e59c640 1 --2- 172.21.15.137:0/2556974862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f928006f340 0x7f92800b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.367+0000 7f927dd9b640 1 --2- 172.21.15.137:0/2556974862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92800d0300 0x7f928006f720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9280072080 tx=0x7f927402c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6daba3228b663f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.367+0000 7f927d59a640 1 -- 172.21.15.137:0/2556974862 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274038070 con 0x7f92800d0300 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.367+0000 7f927d59a640 1 -- 172.21.15.137:0/2556974862 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9274031710 con 0x7f92800d0300 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.367+0000 7f927d59a640 1 -- 172.21.15.137:0/2556974862 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274031ae0 con 0x7f92800d0300 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.368+0000 7f9284d5f640 1 -- 172.21.15.137:0/2556974862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92800d0300 msgr2=0x7f928006f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.368+0000 7f9284d5f640 1 --2- 172.21.15.137:0/2556974862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92800d0300 0x7f928006f720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9280072080 tx=0x7f927402c770 comp rx=0 tx=0).stop 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.368+0000 7f9284d5f640 1 -- 172.21.15.137:0/2556974862 shutdown_connections 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.368+0000 7f9284d5f640 1 --2- 172.21.15.137:0/2556974862 >> v2:172.21.15.170:3300/0 conn(0x7f92800b3e50 0x7f92800720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.368+0000 7f9284d5f640 1 --2- 172.21.15.137:0/2556974862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92800d0300 0x7f928006f720 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.368+0000 7f9284d5f640 1 --2- 172.21.15.137:0/2556974862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f928006f340 0x7f92800b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.368+0000 7f9284d5f640 1 -- 172.21.15.137:0/2556974862 >> 172.21.15.137:0/2556974862 conn(0x7f92800cd8a0 msgr2=0x7f92800cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.368+0000 7f9284d5f640 1 -- 172.21.15.137:0/2556974862 shutdown_connections 2024-04-26T21:59:17.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.368+0000 7f9284d5f640 1 -- 172.21.15.137:0/2556974862 wait complete. 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.369+0000 7f9284d5f640 1 Processor -- start 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.369+0000 7f9284d5f640 1 -- start start 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f9284d5f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f928006f340 0x7f9280139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f9284d5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92800b3e50 0x7f9280135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f9284d5f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92800d0300 0x7f92801f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f9284d5f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f92800b42e0 con 0x7f928006f340 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f9284d5f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f92800b6650 con 0x7f92800d0300 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f9284d5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f92800b4460 con 0x7f92800b3e50 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f927e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f928006f340 0x7f9280139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f927e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f928006f340 0x7f9280139c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54158/0 (socket says 172.21.15.137:54158) 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f927e59c640 1 -- 172.21.15.137:0/385032349 learned_addr learned my addr 172.21.15.137:0/385032349 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f927e59c640 1 -- 172.21.15.137:0/385032349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92800b3e50 msgr2=0x7f9280135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f927e59c640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92800b3e50 0x7f9280135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f927e59c640 1 -- 172.21.15.137:0/385032349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92800d0300 msgr2=0x7f92801f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f927e59c640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92800d0300 0x7f92801f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f927e59c640 1 -- 172.21.15.137:0/385032349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928013a1f0 con 0x7f928006f340 2024-04-26T21:59:17.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f927e59c640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f928006f340 0x7f9280139c10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f927800c7f0 tx=0x7f927800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f926effd640 1 -- 172.21.15.137:0/385032349 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278015070 con 0x7f928006f340 2024-04-26T21:59:17.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f926effd640 1 -- 172.21.15.137:0/385032349 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9278007820 con 0x7f928006f340 2024-04-26T21:59:17.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928013a4d0 con 0x7f928006f340 2024-04-26T21:59:17.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f926effd640 1 -- 172.21.15.137:0/385032349 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278007bd0 con 0x7f928006f340 2024-04-26T21:59:17.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.370+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928013ad70 con 0x7f928006f340 2024-04-26T21:59:17.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.371+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928006a290 con 0x7f928006f340 2024-04-26T21:59:17.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.372+0000 7f926effd640 1 -- 172.21.15.137:0/385032349 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9278018070 con 0x7f928006f340 2024-04-26T21:59:17.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.372+0000 7f926effd640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f926006c8f0 0x7f926006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.372+0000 7f926effd640 1 -- 172.21.15.137:0/385032349 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f927808bbd0 con 0x7f928006f340 2024-04-26T21:59:17.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.372+0000 7f927dd9b640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f926006c8f0 0x7f926006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.373+0000 7f927dd9b640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f926006c8f0 0x7f926006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9274035000 tx=0x7f927402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.376+0000 7f926effd640 1 -- 172.21.15.137:0/385032349 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f927805a090 con 0x7f928006f340 2024-04-26T21:59:17.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.554+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f928013a6a0 con 0x7f928006f340 2024-04-26T21:59:17.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.554+0000 7f926effd640 1 -- 172.21.15.137:0/385032349 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f9278059990 con 0x7f928006f340 2024-04-26T21:59:17.554 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f926006c8f0 msgr2=0x7f926006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f926006c8f0 0x7f926006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9274035000 tx=0x7f927402e000 comp rx=0 tx=0).stop 2024-04-26T21:59:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f928006f340 msgr2=0x7f9280139c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f928006f340 0x7f9280139c10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f927800c7f0 tx=0x7f927800ccb0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 shutdown_connections 2024-04-26T21:59:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f926006c8f0 0x7f926006edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92800d0300 0x7f92801f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92800b3e50 0x7f9280135cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 --2- 172.21.15.137:0/385032349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f928006f340 0x7f9280139c10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 >> 172.21.15.137:0/385032349 conn(0x7f92800cd8a0 msgr2=0x7f9280141c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 shutdown_connections 2024-04-26T21:59:17.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.556+0000 7f9284d5f640 1 -- 172.21.15.137:0/385032349 wait complete. 2024-04-26T21:59:17.567 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:17.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.668+0000 7fce78625640 1 Processor -- start 2024-04-26T21:59:17.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.668+0000 7fce78625640 1 -- start start 2024-04-26T21:59:17.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.668+0000 7fce78625640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700d0300 0x7fce700b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.668+0000 7fce78625640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fce700b3e50 0x7fce700720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.668+0000 7fce78625640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce700b46a0 con 0x7fce7006f340 2024-04-26T21:59:17.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.668+0000 7fce78625640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fce700b5db0 con 0x7fce700b3e50 2024-04-26T21:59:17.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.668+0000 7fce78625640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fce700b6090 con 0x7fce700d0300 2024-04-26T21:59:17.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce763c1640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fce7006f340 0x7fce7006f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50020/0 (socket says 172.21.15.137:50020) 2024-04-26T21:59:17.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce763c1640 1 -- 172.21.15.137:0/2708423284 learned_addr learned my addr 172.21.15.137:0/2708423284 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260952401 0 0) 0x7fce700b46a0 con 0x7fce7006f340 2024-04-26T21:59:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce5c003520 con 0x7fce7006f340 2024-04-26T21:59:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce76bc2640 1 --2- 172.21.15.137:0/2708423284 >> v2:172.21.15.170:3300/0 conn(0x7fce700b3e50 0x7fce700720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce75bc0640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700d0300 0x7fce700b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2090170043 0 0) 0x7fce5c003520 con 0x7fce7006f340 2024-04-26T21:59:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700d0300 msgr2=0x7fce700b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700d0300 0x7fce700b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 >> v2:172.21.15.170:3300/0 conn(0x7fce700b3e50 msgr2=0x7fce700720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 --2- 172.21.15.137:0/2708423284 >> v2:172.21.15.170:3300/0 conn(0x7fce700b3e50 0x7fce700720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce700b6370 con 0x7fce7006f340 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fce60001670 con 0x7fce7006f340 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 >> v1:172.21.15.137:6789/0 conn(0x7fce7006f340 legacy=0x7fce7006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce5c0039b0 0x7fce5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce5c004800 0x7fce5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700d0300 0x7fce5c005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce700b5db0 con 0x7fce5c0039b0 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fce700b6090 con 0x7fce5c004800 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c00bba0 con 0x7fce700d0300 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce763c1640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce5c0039b0 0x7fce5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce75bc0640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce5c004800 0x7fce5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.669+0000 7fce76bc2640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700d0300 0x7fce5c005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce763c1640 1 -- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700d0300 msgr2=0x7fce5c005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce763c1640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700d0300 0x7fce5c005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce763c1640 1 -- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce5c004800 msgr2=0x7fce5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce763c1640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce5c004800 0x7fce5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce763c1640 1 -- 172.21.15.137:0/2708423284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c003520 con 0x7fce5c0039b0 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce76bc2640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce700d0300 0x7fce5c005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce763c1640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce5c0039b0 0x7fce5c003dd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce6000c210 tx=0x7fce5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810b1c3bfcab2d41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60007d30 con 0x7fce5c0039b0 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60005af0 con 0x7fce5c0039b0 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.670+0000 7fce753bf640 1 -- 172.21.15.137:0/2708423284 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60007070 con 0x7fce5c0039b0 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.671+0000 7fce78625640 1 -- 172.21.15.137:0/2708423284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce5c0039b0 msgr2=0x7fce5c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.671+0000 7fce78625640 1 --2- 172.21.15.137:0/2708423284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce5c0039b0 0x7fce5c003dd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fce6000c210 tx=0x7fce5c005830 comp rx=0 tx=0).stop 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.671+0000 7fce76bc2640 1 -- 172.21.15.137:0/2708423284 reap_dead start 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.671+0000 7fce78625640 1 -- 172.21.15.137:0/2708423284 shutdown_connections 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.671+0000 7fce78625640 1 -- 172.21.15.137:0/2708423284 >> 172.21.15.137:0/2708423284 conn(0x7fce700cd8a0 msgr2=0x7fce700cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.671+0000 7fce78625640 1 -- 172.21.15.137:0/2708423284 shutdown_connections 2024-04-26T21:59:17.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.671+0000 7fce78625640 1 -- 172.21.15.137:0/2708423284 wait complete. 2024-04-26T21:59:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.672+0000 7fce78625640 1 Processor -- start 2024-04-26T21:59:17.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.672+0000 7fce78625640 1 -- start start 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce78625640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0039b0 0x7fce70139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce78625640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce7013a650 0x7fce7015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce78625640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce7013aad0 0x7fce7015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce78625640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce700b4460 con 0x7fce7013a650 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce78625640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fce700b42e0 con 0x7fce7013aad0 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce78625640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fce70142a30 con 0x7fce5c0039b0 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce75bc0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce7013a650 0x7fce7015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce75bc0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce7013a650 0x7fce7015e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54172/0 (socket says 172.21.15.137:54172) 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce75bc0640 1 -- 172.21.15.137:0/3369134433 learned_addr learned my addr 172.21.15.137:0/3369134433 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce76bc2640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce7013aad0 0x7fce7015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce75bc0640 1 -- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0039b0 msgr2=0x7fce70139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce763c1640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0039b0 0x7fce70139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce75bc0640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0039b0 0x7fce70139c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce75bc0640 1 -- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce7013aad0 msgr2=0x7fce7015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce75bc0640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce7013aad0 0x7fce7015eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce75bc0640 1 -- 172.21.15.137:0/3369134433 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7014e840 con 0x7fce7013a650 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce76bc2640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce7013aad0 0x7fce7015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.673+0000 7fce763c1640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0039b0 0x7fce70139c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.674+0000 7fce75bc0640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce7013a650 0x7fce7015e9a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00b820 tx=0x7fce6c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.674+0000 7fce66ffd640 1 -- 172.21.15.137:0/3369134433 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c018070 con 0x7fce7013a650 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.674+0000 7fce66ffd640 1 -- 172.21.15.137:0/3369134433 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c00be10 con 0x7fce7013a650 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.674+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce70138e50 con 0x7fce7013a650 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.674+0000 7fce66ffd640 1 -- 172.21.15.137:0/3369134433 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c010c60 con 0x7fce7013a650 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.674+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce70139410 con 0x7fce7013a650 2024-04-26T21:59:17.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.675+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce7006a290 con 0x7fce7013a650 2024-04-26T21:59:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.675+0000 7fce66ffd640 1 -- 172.21.15.137:0/3369134433 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce6c01b070 con 0x7fce7013a650 2024-04-26T21:59:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.676+0000 7fce66ffd640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce5406c920 0x7fce5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.676+0000 7fce763c1640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce5406c920 0x7fce5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.676+0000 7fce66ffd640 1 -- 172.21.15.137:0/3369134433 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce6c08bec0 con 0x7fce7013a650 2024-04-26T21:59:17.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.676+0000 7fce763c1640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce5406c920 0x7fce5406ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce60033000 tx=0x7fce6002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.680+0000 7fce66ffd640 1 -- 172.21.15.137:0/3369134433 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fce6c05a2f0 con 0x7fce7013a650 2024-04-26T21:59:17.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.856+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fce7015b050 con 0x7fce7013a650 2024-04-26T21:59:17.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.856+0000 7fce66ffd640 1 -- 172.21.15.137:0/3369134433 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fce6c059bf0 con 0x7fce7013a650 2024-04-26T21:59:17.856 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce5406c920 msgr2=0x7fce5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce5406c920 0x7fce5406ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce60033000 tx=0x7fce6002e000 comp rx=0 tx=0).stop 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce7013a650 msgr2=0x7fce7015e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce7013a650 0x7fce7015e9a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00b820 tx=0x7fce6c00bce0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 shutdown_connections 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce5406c920 0x7fce5406ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce7013a650 0x7fce7015e9a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce7013aad0 0x7fce7015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 --2- 172.21.15.137:0/3369134433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce5c0039b0 0x7fce70139c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 >> 172.21.15.137:0/3369134433 conn(0x7fce700cd8a0 msgr2=0x7fce7015a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 shutdown_connections 2024-04-26T21:59:17.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.858+0000 7fce78625640 1 -- 172.21.15.137:0/3369134433 wait complete. 2024-04-26T21:59:17.869 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:59:17.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.968+0000 7f51620b0640 1 Processor -- start 2024-04-26T21:59:17.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.968+0000 7f51620b0640 1 -- start start 2024-04-26T21:59:17.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f51620b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 0x7f515c0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f51620b0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f515c0b47f0 0x7f515c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f51620b0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f515c0b4d20 con 0x7f515c06f7e0 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f51620b0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f515c0b5000 con 0x7f515c0b47f0 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f51620b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f515c0b52e0 con 0x7f515c15f400 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f5152ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f515c0b47f0 0x7f515c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f5152ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f515c0b47f0 0x7f515c06d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54180/0 (socket says 172.21.15.137:54180) 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f5152ffd640 1 -- 172.21.15.137:0/3898326417 learned_addr learned my addr 172.21.15.137:0/3898326417 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f515b7fe640 1 --2- 172.21.15.137:0/3898326417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 0x7f515c0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f5152ffd640 1 -- 172.21.15.137:0/3898326417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 msgr2=0x7f515c0b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f5152ffd640 1 --2- 172.21.15.137:0/3898326417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 0x7f515c0b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f5152ffd640 1 -- 172.21.15.137:0/3898326417 >> v1:172.21.15.170:6789/0 conn(0x7f515c06f7e0 legacy=0x7f515c162e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:17.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.969+0000 7f5152ffd640 1 -- 172.21.15.137:0/3898326417 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515c0b55c0 con 0x7f515c0b47f0 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.970+0000 7f5152ffd640 1 --2- 172.21.15.137:0/3898326417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c0b47f0 0x7f515c06d2b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5144009870 tx=0x7f514402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f1a46dd4fe3958 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.970+0000 7f515affd640 1 -- 172.21.15.137:0/3898326417 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144037070 con 0x7f515c0b47f0 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.970+0000 7f515affd640 1 -- 172.21.15.137:0/3898326417 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5144032440 con 0x7f515c0b47f0 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.970+0000 7f515affd640 1 -- 172.21.15.137:0/3898326417 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5144032810 con 0x7f515c0b47f0 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.971+0000 7f51620b0640 1 -- 172.21.15.137:0/3898326417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c0b47f0 msgr2=0x7f515c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.971+0000 7f51620b0640 1 --2- 172.21.15.137:0/3898326417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c0b47f0 0x7f515c06d2b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5144009870 tx=0x7f514402a210 comp rx=0 tx=0).stop 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.971+0000 7f51620b0640 1 -- 172.21.15.137:0/3898326417 shutdown_connections 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.971+0000 7f51620b0640 1 --2- 172.21.15.137:0/3898326417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c0b47f0 0x7f515c06d2b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.971+0000 7f51620b0640 1 --2- 172.21.15.137:0/3898326417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 0x7f515c0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.971+0000 7f51620b0640 1 -- 172.21.15.137:0/3898326417 >> 172.21.15.137:0/3898326417 conn(0x7f515c072cf0 msgr2=0x7f515c073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.971+0000 7f51620b0640 1 -- 172.21.15.137:0/3898326417 shutdown_connections 2024-04-26T21:59:17.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.971+0000 7f51620b0640 1 -- 172.21.15.137:0/3898326417 wait complete. 2024-04-26T21:59:17.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.972+0000 7f51620b0640 1 Processor -- start 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.972+0000 7f51620b0640 1 -- start start 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f51620b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c06f7e0 0x7f515c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f51620b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f515c0b47f0 0x7f515c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f51620b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 0x7f515c0af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f51620b0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f515c06d970 con 0x7f515c06f7e0 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f51620b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f515c06d7f0 con 0x7f515c0b47f0 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f51620b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f515c06daf0 con 0x7f515c15f400 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c06f7e0 0x7f515c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c06f7e0 0x7f515c1590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54194/0 (socket says 172.21.15.137:54194) 2024-04-26T21:59:17.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515b7fe640 1 -- 172.21.15.137:0/3984721151 learned_addr learned my addr 172.21.15.137:0/3984721151 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f5152ffd640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f515c0b47f0 0x7f515c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515bfff640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 0x7f515c0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515b7fe640 1 -- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 msgr2=0x7f515c0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515b7fe640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 0x7f515c0af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515b7fe640 1 -- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f515c0b47f0 msgr2=0x7f515c0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515b7fe640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f515c0b47f0 0x7f515c0cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515b7fe640 1 -- 172.21.15.137:0/3984721151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515c0cfc50 con 0x7f515c06f7e0 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f5152ffd640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f515c0b47f0 0x7f515c0cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.973+0000 7f515bfff640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 0x7f515c0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.974+0000 7f515b7fe640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c06f7e0 0x7f515c1590f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f514c00c820 tx=0x7f514c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.974+0000 7f5158ff9640 1 -- 172.21.15.137:0/3984721151 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c015070 con 0x7f515c06f7e0 2024-04-26T21:59:17.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.974+0000 7f5158ff9640 1 -- 172.21.15.137:0/3984721151 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c004020 con 0x7f515c06f7e0 2024-04-26T21:59:17.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.974+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515c0cff30 con 0x7f515c06f7e0 2024-04-26T21:59:17.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.974+0000 7f5158ff9640 1 -- 172.21.15.137:0/3984721151 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c0043f0 con 0x7f515c06f7e0 2024-04-26T21:59:17.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.974+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515c0d0ae0 con 0x7f515c06f7e0 2024-04-26T21:59:17.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.975+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f515c0693d0 con 0x7f515c06f7e0 2024-04-26T21:59:17.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.975+0000 7f5158ff9640 1 -- 172.21.15.137:0/3984721151 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f514c007830 con 0x7f515c06f7e0 2024-04-26T21:59:17.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.976+0000 7f5158ff9640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f513c06c8f0 0x7f513c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:17.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.976+0000 7f5152ffd640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f513c06c8f0 0x7f513c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:17.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.976+0000 7f5158ff9640 1 -- 172.21.15.137:0/3984721151 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f514c08b8d0 con 0x7f515c06f7e0 2024-04-26T21:59:17.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.976+0000 7f5152ffd640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f513c06c8f0 0x7f513c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5144034000 tx=0x7f514402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:17.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:17.980+0000 7f5158ff9640 1 -- 172.21.15.137:0/3984721151 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f514c059d90 con 0x7f515c06f7e0 2024-04-26T21:59:18.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.165+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f515c15a9a0 con 0x7f515c06f7e0 2024-04-26T21:59:18.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.165+0000 7f5158ff9640 1 -- 172.21.15.137:0/3984721151 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f514c059690 con 0x7f515c06f7e0 2024-04-26T21:59:18.165 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T21:59:18.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f513c06c8f0 msgr2=0x7f513c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f513c06c8f0 0x7f513c06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5144034000 tx=0x7f514402e000 comp rx=0 tx=0).stop 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c06f7e0 msgr2=0x7f515c1590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c06f7e0 0x7f515c1590f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f514c00c820 tx=0x7f514c00cce0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 shutdown_connections 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f513c06c8f0 0x7f513c06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f515c15f400 0x7f515c0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f515c0b47f0 0x7f515c0cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 --2- 172.21.15.137:0/3984721151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f515c06f7e0 0x7f515c1590f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 >> 172.21.15.137:0/3984721151 conn(0x7f515c072cf0 msgr2=0x7f515c159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 shutdown_connections 2024-04-26T21:59:18.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.167+0000 7f51620b0640 1 -- 172.21.15.137:0/3984721151 wait complete. 2024-04-26T21:59:18.178 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-26T21:59:18.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:18.178 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-26T21:59:18.202 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T21:59:18.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:18.202 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-26T21:59:18.258 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:18.258 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:18.276 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:18.276 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:18.334 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:18.334 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:18.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.488+0000 7f95cc664640 1 Processor -- start 2024-04-26T21:59:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.488+0000 7f95cc664640 1 -- start start 2024-04-26T21:59:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95cc664640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f95c406c2a0 0x7f95c406c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95cc664640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c40b6b80 con 0x7f95c415d3b0 2024-04-26T21:59:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95cc664640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c40b6e60 con 0x7f95c40d0690 2024-04-26T21:59:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95cc664640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f95c40aedf0 con 0x7f95c406c2a0 2024-04-26T21:59:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95ca400640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f95c415d3b0 0x7f95c40735d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50024/0 (socket says 172.21.15.137:50024) 2024-04-26T21:59:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95ca400640 1 -- 172.21.15.137:0/2814201626 learned_addr learned my addr 172.21.15.137:0/2814201626 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c9bff640 1 --2- 172.21.15.137:0/2814201626 >> v2:172.21.15.170:3300/0 conn(0x7f95c406c2a0 0x7f95c406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635637987 0 0) 0x7f95c40b6b80 con 0x7f95c415d3b0 2024-04-26T21:59:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95ac003520 con 0x7f95c415d3b0 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 237155741 0 0) 0x7f95ac003520 con 0x7f95c415d3b0 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 >> v2:172.21.15.170:3300/0 conn(0x7f95c406c2a0 msgr2=0x7f95c406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c93fe640 1 --2- 172.21.15.137:0/2814201626 >> v2:172.21.15.170:3300/0 conn(0x7f95c406c2a0 0x7f95c406c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 >> v1:172.21.15.170:6789/0 conn(0x7f95c40d0690 legacy=0x7f95c40d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c40b7140 con 0x7f95c415d3b0 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f95bc0019f0 con 0x7f95c415d3b0 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c9bff640 1 --2- 172.21.15.137:0/2814201626 >> v2:172.21.15.170:3300/0 conn(0x7f95c406c2a0 0x7f95c406c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.489+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 >> v1:172.21.15.137:6789/0 conn(0x7f95c415d3b0 legacy=0x7f95c40735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95c93fe640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95ac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95c93fe640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95ac004800 0x7f95ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95c93fe640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95ac005210 0x7f95ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac00c130 con 0x7f95ac003a00 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac00c2e0 con 0x7f95ac005210 2024-04-26T21:59:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95ac00c4e0 con 0x7f95ac004800 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95ca400640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95ac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95cac01640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95ac005210 0x7f95ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95c9bff640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95ac004800 0x7f95ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95ca400640 1 -- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95ac004800 msgr2=0x7f95ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95ca400640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95ac004800 0x7f95ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95ca400640 1 -- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95ac005210 msgr2=0x7f95ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95ca400640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95ac005210 0x7f95ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95ca400640 1 -- 172.21.15.137:0/2814201626 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac003520 con 0x7f95ac003a00 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95cac01640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95ac005210 0x7f95ac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95cac01640 1 -- 172.21.15.137:0/2814201626 reap_dead start 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.490+0000 7f95c9bff640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95ac004800 0x7f95ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.491+0000 7f95ca400640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95ac003e20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00a760 tx=0x7f95ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3c840cf7128900 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.491+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00a3b0 con 0x7f95ac003a00 2024-04-26T21:59:18.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.491+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc02f070 con 0x7f95ac003a00 2024-04-26T21:59:18.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.491+0000 7f95c93fe640 1 -- 172.21.15.137:0/2814201626 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc02bc00 con 0x7f95ac003a00 2024-04-26T21:59:18.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.491+0000 7f95cc664640 1 -- 172.21.15.137:0/2814201626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 msgr2=0x7f95ac003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.491+0000 7f95cc664640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95ac003e20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00a760 tx=0x7f95ac005830 comp rx=0 tx=0).stop 2024-04-26T21:59:18.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.491+0000 7f95cc664640 1 -- 172.21.15.137:0/2814201626 shutdown_connections 2024-04-26T21:59:18.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.491+0000 7f95cc664640 1 --2- 172.21.15.137:0/2814201626 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95ac003e20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.491+0000 7f95cc664640 1 -- 172.21.15.137:0/2814201626 >> 172.21.15.137:0/2814201626 conn(0x7f95c40b3b10 msgr2=0x7f95c40b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:18.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.492+0000 7f95cc664640 1 -- 172.21.15.137:0/2814201626 shutdown_connections 2024-04-26T21:59:18.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.492+0000 7f95cc664640 1 -- 172.21.15.137:0/2814201626 wait complete. 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.493+0000 7f95cc664640 1 Processor -- start 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.493+0000 7f95cc664640 1 -- start start 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.493+0000 7f95cc664640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95c414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.493+0000 7f95cc664640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95c414eeb0 0x7f95c414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.493+0000 7f95cc664640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95c41493c0 0x7f95c4149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.493+0000 7f95cc664640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95c415d790 con 0x7f95ac003a00 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.493+0000 7f95cc664640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f95c40b6930 con 0x7f95c41493c0 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.493+0000 7f95cc664640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95c415d910 con 0x7f95c414eeb0 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.493+0000 7f95ca400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95c414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95ca400640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95c414b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54210/0 (socket says 172.21.15.137:54210) 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95ca400640 1 -- 172.21.15.137:0/51234354 learned_addr learned my addr 172.21.15.137:0/51234354 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95c9bff640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95c414eeb0 0x7f95c414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95cac01640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95c41493c0 0x7f95c4149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95ca400640 1 -- 172.21.15.137:0/51234354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95c414eeb0 msgr2=0x7f95c414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95ca400640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95c414eeb0 0x7f95c414f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95ca400640 1 -- 172.21.15.137:0/51234354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95c41493c0 msgr2=0x7f95c4149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95ca400640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95c41493c0 0x7f95c4149840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95ca400640 1 -- 172.21.15.137:0/51234354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c414f870 con 0x7f95ac003a00 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95ca400640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95c414b650 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00a880 tx=0x7f95bc02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95baffd640 1 -- 172.21.15.137:0/51234354 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00a3b0 con 0x7f95ac003a00 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95baffd640 1 -- 172.21.15.137:0/51234354 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc001250 con 0x7f95ac003a00 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c414a130 con 0x7f95ac003a00 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95baffd640 1 -- 172.21.15.137:0/51234354 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc004d60 con 0x7f95ac003a00 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.494+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c414a6f0 con 0x7f95ac003a00 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.495+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c40693d0 con 0x7f95ac003a00 2024-04-26T21:59:18.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.496+0000 7f95baffd640 1 -- 172.21.15.137:0/51234354 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95bc034470 con 0x7f95ac003a00 2024-04-26T21:59:18.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.496+0000 7f95baffd640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95b006c8f0 0x7f95b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.496+0000 7f95baffd640 1 -- 172.21.15.137:0/51234354 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f95bc0abee0 con 0x7f95ac003a00 2024-04-26T21:59:18.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.496+0000 7f95c9bff640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95b006c8f0 0x7f95b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.497+0000 7f95c9bff640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95b006c8f0 0x7f95b006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95c4149220 tx=0x7f95c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:18.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.500+0000 7f95baffd640 1 -- 172.21.15.137:0/51234354 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f95bc07a340 con 0x7f95ac003a00 2024-04-26T21:59:18.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.676+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95c40b4740 con 0x7f95ac003a00 2024-04-26T21:59:18.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.677+0000 7f95baffd640 1 -- 172.21.15.137:0/51234354 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f95bc079c40 con 0x7f95ac003a00 2024-04-26T21:59:18.678 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:18.678 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:18.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.679+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95b006c8f0 msgr2=0x7f95b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.679+0000 7f95cc664640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95b006c8f0 0x7f95b006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95c4149220 tx=0x7f95c0008040 comp rx=0 tx=0).stop 2024-04-26T21:59:18.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.679+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 msgr2=0x7f95c414b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.679+0000 7f95cc664640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95c414b650 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00a880 tx=0x7f95bc02d070 comp rx=0 tx=0).stop 2024-04-26T21:59:18.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.679+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 shutdown_connections 2024-04-26T21:59:18.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.679+0000 7f95cc664640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95b006c8f0 0x7f95b006edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.679+0000 7f95cc664640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95c41493c0 0x7f95c4149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.679+0000 7f95cc664640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95c414eeb0 0x7f95c414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.680+0000 7f95cc664640 1 --2- 172.21.15.137:0/51234354 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95ac003a00 0x7f95c414b650 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.680+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 >> 172.21.15.137:0/51234354 conn(0x7f95c40b3b10 msgr2=0x7f95c406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:18.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.680+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 shutdown_connections 2024-04-26T21:59:18.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.680+0000 7f95cc664640 1 -- 172.21.15.137:0/51234354 wait complete. 2024-04-26T21:59:18.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:18.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:18.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.791+0000 7faa077f0640 1 Processor -- start 2024-04-26T21:59:18.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.791+0000 7faa077f0640 1 -- start start 2024-04-26T21:59:18.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.792+0000 7faa077f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa0006f340 0x7faa000b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.792+0000 7faa077f0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faa000d0300 0x7faa0006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.792+0000 7faa077f0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0006fc60 con 0x7faa000b3e50 2024-04-26T21:59:18.795 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.792+0000 7faa077f0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7faa000b46a0 con 0x7faa000d0300 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.792+0000 7faa077f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faa000b5db0 con 0x7faa0006f340 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.792+0000 7faa05d8d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7faa000b3e50 0x7faa000720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50036/0 (socket says 172.21.15.137:50036) 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.792+0000 7faa05d8d640 1 -- 172.21.15.137:0/2287912794 learned_addr learned my addr 172.21.15.137:0/2287912794 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720295398 0 0) 0x7faa0006fc60 con 0x7faa000b3e50 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9ec003520 con 0x7faa000b3e50 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa04d8b640 1 --2- 172.21.15.137:0/2287912794 >> v2:172.21.15.170:3300/0 conn(0x7faa000d0300 0x7faa0006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa0558c640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa0006f340 0x7faa000b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 344001242 0 0) 0x7fa9ec003520 con 0x7faa000b3e50 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa0006f340 msgr2=0x7faa000b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa0006f340 0x7faa000b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 >> v2:172.21.15.170:3300/0 conn(0x7faa000d0300 msgr2=0x7faa0006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 --2- 172.21.15.137:0/2287912794 >> v2:172.21.15.170:3300/0 conn(0x7faa000d0300 0x7faa0006f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa000b6090 con 0x7faa000b3e50 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fa9f8001670 con 0x7faa000b3e50 2024-04-26T21:59:18.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 >> v1:172.21.15.137:6789/0 conn(0x7faa000b3e50 legacy=0x7faa000720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7fa9ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9ec004800 0x7fa9ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa0006f340 0x7fa9ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa000b46a0 con 0x7fa9ec0039b0 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faa000b5db0 con 0x7fa9ec004800 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa9ec00ba40 con 0x7faa0006f340 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa0558c640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7fa9ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa04d8b640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9ec004800 0x7fa9ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa05d8d640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa0006f340 0x7fa9ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa0558c640 1 -- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa0006f340 msgr2=0x7fa9ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa0558c640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa0006f340 0x7fa9ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa0558c640 1 -- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9ec004800 msgr2=0x7fa9ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:18.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa0558c640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9ec004800 0x7fa9ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa0558c640 1 -- 172.21.15.137:0/2287912794 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec003520 con 0x7fa9ec0039b0 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.793+0000 7faa05d8d640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa0006f340 0x7fa9ec0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.794+0000 7faa0558c640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7fa9ec003dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009fc0 tx=0x7fa9ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22087df8aeeb398a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.794+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc009c10 con 0x7fa9ec0039b0 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.794+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc036070 con 0x7fa9ec0039b0 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.794+0000 7fa9f7fff640 1 -- 172.21.15.137:0/2287912794 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc031880 con 0x7fa9ec0039b0 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.795+0000 7faa077f0640 1 -- 172.21.15.137:0/2287912794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 msgr2=0x7fa9ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.795+0000 7faa077f0640 1 --2- 172.21.15.137:0/2287912794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7fa9ec003dd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009fc0 tx=0x7fa9ec005830 comp rx=0 tx=0).stop 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.795+0000 7faa05d8d640 1 -- 172.21.15.137:0/2287912794 reap_dead start 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.795+0000 7faa077f0640 1 -- 172.21.15.137:0/2287912794 shutdown_connections 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.795+0000 7faa077f0640 1 -- 172.21.15.137:0/2287912794 >> 172.21.15.137:0/2287912794 conn(0x7faa000cd8a0 msgr2=0x7faa000cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:18.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.795+0000 7faa077f0640 1 -- 172.21.15.137:0/2287912794 shutdown_connections 2024-04-26T21:59:18.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.795+0000 7faa077f0640 1 -- 172.21.15.137:0/2287912794 wait complete. 2024-04-26T21:59:18.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.796+0000 7faa077f0640 1 Processor -- start 2024-04-26T21:59:18.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.796+0000 7faa077f0640 1 -- start start 2024-04-26T21:59:18.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa077f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7faa00150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa077f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa001511e0 0x7faa00155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa077f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa00155d70 0x7faa0015d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa077f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa000b42e0 con 0x7fa9ec0039b0 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa077f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faa000b6650 con 0x7faa00155d70 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa077f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faa000b4460 con 0x7faa001511e0 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa0558c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7faa00150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa0558c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7faa00150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54236/0 (socket says 172.21.15.137:54236) 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa0558c640 1 -- 172.21.15.137:0/1801519309 learned_addr learned my addr 172.21.15.137:0/1801519309 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa05d8d640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa00155d70 0x7faa0015d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa0558c640 1 -- 172.21.15.137:0/1801519309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa001511e0 msgr2=0x7faa00155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa0558c640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa001511e0 0x7faa00155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa0558c640 1 -- 172.21.15.137:0/1801519309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa00155d70 msgr2=0x7faa0015d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa0558c640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa00155d70 0x7faa0015d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa0558c640 1 -- 172.21.15.137:0/1801519309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa001517f0 con 0x7fa9ec0039b0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa05d8d640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa00155d70 0x7faa0015d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa0558c640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7faa00150ca0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc02aee0 tx=0x7fa9fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7fa9f5ffb640 1 -- 172.21.15.137:0/1801519309 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc009c10 con 0x7fa9ec0039b0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7fa9f5ffb640 1 -- 172.21.15.137:0/1801519309 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc003990 con 0x7fa9ec0039b0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7fa9f5ffb640 1 -- 172.21.15.137:0/1801519309 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc003d60 con 0x7fa9ec0039b0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.797+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0015c6e0 con 0x7fa9ec0039b0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.798+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0015cca0 con 0x7fa9ec0039b0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.799+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0006a290 con 0x7fa9ec0039b0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.799+0000 7fa9f5ffb640 1 -- 172.21.15.137:0/1801519309 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9fc005d10 con 0x7fa9ec0039b0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.799+0000 7fa9f5ffb640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9e406c8f0 0x7fa9e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.799+0000 7fa9f5ffb640 1 -- 172.21.15.137:0/1801519309 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa9fc0acef0 con 0x7fa9ec0039b0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.799+0000 7faa04d8b640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9e406c8f0 0x7fa9e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:18.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.800+0000 7faa04d8b640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9e406c8f0 0x7fa9e406edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0006e80 tx=0x7fa9f0006df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:18.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.804+0000 7fa9f5ffb640 1 -- 172.21.15.137:0/1801519309 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa9fc07b320 con 0x7fa9ec0039b0 2024-04-26T21:59:18.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.981+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa00156150 con 0x7fa9ec0039b0 2024-04-26T21:59:18.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.981+0000 7fa9f5ffb640 1 -- 172.21.15.137:0/1801519309 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fa9fc07ac20 con 0x7fa9ec0039b0 2024-04-26T21:59:18.981 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9e406c8f0 msgr2=0x7fa9e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9e406c8f0 0x7fa9e406edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0006e80 tx=0x7fa9f0006df0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 msgr2=0x7faa00150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7faa00150ca0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc02aee0 tx=0x7fa9fc009750 comp rx=0 tx=0).stop 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 shutdown_connections 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa9e406c8f0 0x7fa9e406edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa00155d70 0x7faa0015d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa001511e0 0x7faa00155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 --2- 172.21.15.137:0/1801519309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9ec0039b0 0x7faa00150ca0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 >> 172.21.15.137:0/1801519309 conn(0x7faa000cd8a0 msgr2=0x7faa000cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.983+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 shutdown_connections 2024-04-26T21:59:18.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:18.984+0000 7faa077f0640 1 -- 172.21.15.137:0/1801519309 wait complete. 2024-04-26T21:59:18.995 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:19.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.093+0000 7f61a0215640 1 Processor -- start 2024-04-26T21:59:19.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.093+0000 7f61a0215640 1 -- start start 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.094+0000 7f61a0215640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f619815f680 0x7f61980d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.094+0000 7f61a0215640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61980d4f20 0x7f61980d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.094+0000 7f61a0215640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61980d58f0 con 0x7f6198163aa0 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.094+0000 7f61a0215640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f619815fa60 con 0x7f619815f680 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.094+0000 7f61a0215640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f61980d3f50 con 0x7f61980d4f20 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.094+0000 7f619dfb1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f619815f680 0x7f61980d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.094+0000 7f619d7b0640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6198163aa0 0x7f61980b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50052/0 (socket says 172.21.15.137:50052) 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.094+0000 7f619d7b0640 1 -- 172.21.15.137:0/2124577257 learned_addr learned my addr 172.21.15.137:0/2124577257 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.095+0000 7f619e7b2640 1 --2- 172.21.15.137:0/2124577257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61980d4f20 0x7f61980d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.095+0000 7f619dfb1640 1 -- 172.21.15.137:0/2124577257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61980d4f20 msgr2=0x7f61980d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:19.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.095+0000 7f619dfb1640 1 --2- 172.21.15.137:0/2124577257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61980d4f20 0x7f61980d53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.095+0000 7f619dfb1640 1 -- 172.21.15.137:0/2124577257 >> v1:172.21.15.137:6789/0 conn(0x7f6198163aa0 legacy=0x7f61980b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.095+0000 7f619cfaf640 1 -- 172.21.15.137:0/2124577257 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159442810 0 0) 0x7f61980d58f0 con 0x7f6198163aa0 2024-04-26T21:59:19.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.095+0000 7f619dfb1640 1 -- 172.21.15.137:0/2124577257 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61980b5090 con 0x7f619815f680 2024-04-26T21:59:19.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.095+0000 7f619dfb1640 1 --2- 172.21.15.137:0/2124577257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f619815f680 0x7f61980d3820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6194009d90 tx=0x7f619402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f74201b4401256e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:19.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f619cfaf640 1 -- 172.21.15.137:0/2124577257 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194007740 con 0x7f619815f680 2024-04-26T21:59:19.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f619cfaf640 1 -- 172.21.15.137:0/2124577257 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61940078e0 con 0x7f619815f680 2024-04-26T21:59:19.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f619cfaf640 1 -- 172.21.15.137:0/2124577257 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194007cb0 con 0x7f619815f680 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f61a0215640 1 -- 172.21.15.137:0/2124577257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f619815f680 msgr2=0x7f61980d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f61a0215640 1 --2- 172.21.15.137:0/2124577257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f619815f680 0x7f61980d3820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6194009d90 tx=0x7f619402a660 comp rx=0 tx=0).stop 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f61a0215640 1 -- 172.21.15.137:0/2124577257 shutdown_connections 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f61a0215640 1 --2- 172.21.15.137:0/2124577257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61980d4f20 0x7f61980d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f61a0215640 1 --2- 172.21.15.137:0/2124577257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f619815f680 0x7f61980d3820 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f61a0215640 1 -- 172.21.15.137:0/2124577257 >> 172.21.15.137:0/2124577257 conn(0x7f619808eca0 msgr2=0x7f619809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f61a0215640 1 -- 172.21.15.137:0/2124577257 shutdown_connections 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.096+0000 7f61a0215640 1 -- 172.21.15.137:0/2124577257 wait complete. 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.097+0000 7f61a0215640 1 Processor -- start 2024-04-26T21:59:19.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.097+0000 7f61a0215640 1 -- start start 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f61a0215640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61980d4f20 0x7f61980cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f61a0215640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619815f680 0x7f6198156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f61a0215640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6198163aa0 0x7f61981622c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f61a0215640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6198163f30 con 0x7f61980d4f20 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f61a0215640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f61980b6280 con 0x7f619815f680 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f61a0215640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f61980cfd80 con 0x7f6198163aa0 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f619dfb1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61980d4f20 0x7f61980cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f619dfb1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61980d4f20 0x7f61980cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54268/0 (socket says 172.21.15.137:54268) 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f619dfb1640 1 -- 172.21.15.137:0/2631205217 learned_addr learned my addr 172.21.15.137:0/2631205217 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:19.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f619e7b2640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6198163aa0 0x7f61981622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f619d7b0640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619815f680 0x7f6198156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f619dfb1640 1 -- 172.21.15.137:0/2631205217 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6198163aa0 msgr2=0x7f61981622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.098+0000 7f619dfb1640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6198163aa0 0x7f61981622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.099+0000 7f619dfb1640 1 -- 172.21.15.137:0/2631205217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619815f680 msgr2=0x7f6198156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.099+0000 7f619dfb1640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619815f680 0x7f6198156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.099+0000 7f619dfb1640 1 -- 172.21.15.137:0/2631205217 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6198161500 con 0x7f61980d4f20 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.099+0000 7f619dfb1640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61980d4f20 0x7f61980cd3e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6194009d90 tx=0x7f6194004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.099+0000 7f618e7fc640 1 -- 172.21.15.137:0/2631205217 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194040070 con 0x7f61980d4f20 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.099+0000 7f618e7fc640 1 -- 172.21.15.137:0/2631205217 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6194031c40 con 0x7f61980d4f20 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.099+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61981617e0 con 0x7f61980d4f20 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.099+0000 7f618e7fc640 1 -- 172.21.15.137:0/2631205217 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619403c420 con 0x7f61980d4f20 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.099+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61980cd920 con 0x7f61980d4f20 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.100+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f619806a290 con 0x7f61980d4f20 2024-04-26T21:59:19.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.100+0000 7f618e7fc640 1 -- 172.21.15.137:0/2631205217 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6194039040 con 0x7f61980d4f20 2024-04-26T21:59:19.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.101+0000 7f618e7fc640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f617c06c920 0x7f617c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.101+0000 7f619d7b0640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f617c06c920 0x7f617c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.101+0000 7f618e7fc640 1 -- 172.21.15.137:0/2631205217 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f61940acf40 con 0x7f61980d4f20 2024-04-26T21:59:19.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.101+0000 7f619d7b0640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f617c06c920 0x7f617c06ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f619815c950 tx=0x7f6188007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:19.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.105+0000 7f618e7fc640 1 -- 172.21.15.137:0/2631205217 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f619407adb0 con 0x7f61980d4f20 2024-04-26T21:59:19.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.279+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f61980b4cd0 con 0x7f61980d4f20 2024-04-26T21:59:19.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.279+0000 7f618e7fc640 1 -- 172.21.15.137:0/2631205217 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f619407f0b0 con 0x7f61980d4f20 2024-04-26T21:59:19.280 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f617c06c920 msgr2=0x7f617c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f617c06c920 0x7f617c06ede0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f619815c950 tx=0x7f6188007e40 comp rx=0 tx=0).stop 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61980d4f20 msgr2=0x7f61980cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61980d4f20 0x7f61980cd3e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6194009d90 tx=0x7f6194004a40 comp rx=0 tx=0).stop 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 shutdown_connections 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f617c06c920 0x7f617c06ede0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6198163aa0 0x7f61981622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f619815f680 0x7f6198156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 --2- 172.21.15.137:0/2631205217 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61980d4f20 0x7f61980cd3e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 >> 172.21.15.137:0/2631205217 conn(0x7f619808eca0 msgr2=0x7f619815e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:19.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 shutdown_connections 2024-04-26T21:59:19.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.281+0000 7f61a0215640 1 -- 172.21.15.137:0/2631205217 wait complete. 2024-04-26T21:59:19.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:19.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.391+0000 7f478f951640 1 Processor -- start 2024-04-26T21:59:19.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.392+0000 7f478f951640 1 -- start start 2024-04-26T21:59:19.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.392+0000 7f478f951640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f478815f680 0x7f47880d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.392+0000 7f478f951640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4788163aa0 0x7f47880b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.392+0000 7f478f951640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f47880b60b0 0x7f47880d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.392+0000 7f478f951640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f478815fa60 con 0x7f4788163aa0 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.392+0000 7f478f951640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f47880d3f50 con 0x7f47880b60b0 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.392+0000 7f478f951640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f47880b5090 con 0x7f478815f680 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.392+0000 7f478ceec640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4788163aa0 0x7f47880b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.392+0000 7f478ceec640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4788163aa0 0x7f47880b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54270/0 (socket says 172.21.15.137:54270) 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.393+0000 7f478ceec640 1 -- 172.21.15.137:0/2027768702 learned_addr learned my addr 172.21.15.137:0/2027768702 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.393+0000 7f478deee640 1 --2- 172.21.15.137:0/2027768702 >> v2:172.21.15.170:3300/0 conn(0x7f47880b60b0 0x7f47880d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.393+0000 7f478d6ed640 1 --2- 172.21.15.137:0/2027768702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f478815f680 0x7f47880d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.393+0000 7f478ceec640 1 -- 172.21.15.137:0/2027768702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f478815f680 msgr2=0x7f47880d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.393+0000 7f478ceec640 1 --2- 172.21.15.137:0/2027768702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f478815f680 0x7f47880d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.393+0000 7f478ceec640 1 -- 172.21.15.137:0/2027768702 >> v2:172.21.15.170:3300/0 conn(0x7f47880b60b0 msgr2=0x7f47880d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:19.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.393+0000 7f478ceec640 1 --2- 172.21.15.137:0/2027768702 >> v2:172.21.15.170:3300/0 conn(0x7f47880b60b0 0x7f47880d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.393+0000 7f478ceec640 1 -- 172.21.15.137:0/2027768702 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47880b5370 con 0x7f4788163aa0 2024-04-26T21:59:19.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.393+0000 7f478ceec640 1 --2- 172.21.15.137:0/2027768702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4788163aa0 0x7f47880b5b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f47880b4b10 tx=0x7f477802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8d606963374ebe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:19.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f477ffff640 1 -- 172.21.15.137:0/2027768702 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778037070 con 0x7f4788163aa0 2024-04-26T21:59:19.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f477ffff640 1 -- 172.21.15.137:0/2027768702 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4778032440 con 0x7f4788163aa0 2024-04-26T21:59:19.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f477ffff640 1 -- 172.21.15.137:0/2027768702 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778032810 con 0x7f4788163aa0 2024-04-26T21:59:19.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f478f951640 1 -- 172.21.15.137:0/2027768702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4788163aa0 msgr2=0x7f47880b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f478f951640 1 --2- 172.21.15.137:0/2027768702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4788163aa0 0x7f47880b5b70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f47880b4b10 tx=0x7f477802a1e0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f478f951640 1 -- 172.21.15.137:0/2027768702 shutdown_connections 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f478f951640 1 --2- 172.21.15.137:0/2027768702 >> v2:172.21.15.170:3300/0 conn(0x7f47880b60b0 0x7f47880d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f478f951640 1 --2- 172.21.15.137:0/2027768702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4788163aa0 0x7f47880b5b70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f478f951640 1 --2- 172.21.15.137:0/2027768702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f478815f680 0x7f47880d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f478f951640 1 -- 172.21.15.137:0/2027768702 >> 172.21.15.137:0/2027768702 conn(0x7f478808eca0 msgr2=0x7f478809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f478f951640 1 -- 172.21.15.137:0/2027768702 shutdown_connections 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.394+0000 7f478f951640 1 -- 172.21.15.137:0/2027768702 wait complete. 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.395+0000 7f478f951640 1 Processor -- start 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.395+0000 7f478f951640 1 -- start start 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478f951640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47880b60b0 0x7f4788149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478f951640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f478815f680 0x7f47880cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478f951640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4788163aa0 0x7f4788145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478f951640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f47880d55e0 con 0x7f478815f680 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478f951640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f47880d5460 con 0x7f4788163aa0 2024-04-26T21:59:19.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478f951640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f47880d5760 con 0x7f47880b60b0 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478ceec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f478815f680 0x7f47880cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478ceec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f478815f680 0x7f47880cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54284/0 (socket says 172.21.15.137:54284) 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478ceec640 1 -- 172.21.15.137:0/2410501138 learned_addr learned my addr 172.21.15.137:0/2410501138 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478deee640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4788163aa0 0x7f4788145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478d6ed640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47880b60b0 0x7f4788149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478ceec640 1 -- 172.21.15.137:0/2410501138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47880b60b0 msgr2=0x7f4788149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478ceec640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47880b60b0 0x7f4788149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478ceec640 1 -- 172.21.15.137:0/2410501138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4788163aa0 msgr2=0x7f4788145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478ceec640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4788163aa0 0x7f4788145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.396+0000 7f478ceec640 1 -- 172.21.15.137:0/2410501138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47881490f0 con 0x7f478815f680 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.397+0000 7f478ceec640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f478815f680 0x7f47880cec90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f477802a220 tx=0x7f47780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.397+0000 7f477dffb640 1 -- 172.21.15.137:0/2410501138 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778041020 con 0x7f478815f680 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.397+0000 7f477dffb640 1 -- 172.21.15.137:0/2410501138 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47780306c0 con 0x7f478815f680 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.397+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4788160150 con 0x7f478815f680 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.397+0000 7f477dffb640 1 -- 172.21.15.137:0/2410501138 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778037040 con 0x7f478815f680 2024-04-26T21:59:19.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.397+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4788162540 con 0x7f478815f680 2024-04-26T21:59:19.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.398+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478806a290 con 0x7f478815f680 2024-04-26T21:59:19.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.398+0000 7f477dffb640 1 -- 172.21.15.137:0/2410501138 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4778044020 con 0x7f478815f680 2024-04-26T21:59:19.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.399+0000 7f477dffb640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f476c06c8f0 0x7f476c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.399+0000 7f477dffb640 1 -- 172.21.15.137:0/2410501138 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f47780ac340 con 0x7f478815f680 2024-04-26T21:59:19.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.399+0000 7f478d6ed640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f476c06c8f0 0x7f476c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.399+0000 7f478d6ed640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f476c06c8f0 0x7f476c06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f47840070b0 tx=0x7f4784007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:19.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.403+0000 7f477dffb640 1 -- 172.21.15.137:0/2410501138 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f477804b030 con 0x7f478815f680 2024-04-26T21:59:19.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.575+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f47880b4cd0 con 0x7f478815f680 2024-04-26T21:59:19.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.576+0000 7f477dffb640 1 -- 172.21.15.137:0/2410501138 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f47881490f0 con 0x7f478815f680 2024-04-26T21:59:19.576 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:19.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f476c06c8f0 msgr2=0x7f476c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f476c06c8f0 0x7f476c06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f47840070b0 tx=0x7f4784007040 comp rx=0 tx=0).stop 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f478815f680 msgr2=0x7f47880cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f478815f680 0x7f47880cec90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f477802a220 tx=0x7f47780046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 shutdown_connections 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f476c06c8f0 0x7f476c06edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f478815f680 0x7f47880cec90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4788163aa0 0x7f4788145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 --2- 172.21.15.137:0/2410501138 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47880b60b0 0x7f4788149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 >> 172.21.15.137:0/2410501138 conn(0x7f478808eca0 msgr2=0x7f47880b2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 shutdown_connections 2024-04-26T21:59:19.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.578+0000 7f478f951640 1 -- 172.21.15.137:0/2410501138 wait complete. 2024-04-26T21:59:19.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:59:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.687+0000 7f7ec9a45640 1 Processor -- start 2024-04-26T21:59:19.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.687+0000 7f7ec9a45640 1 -- start start 2024-04-26T21:59:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec9a45640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 0x7f7ec40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec9a45640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7ec415f750 0x7f7ec40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec9a45640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec40d03a0 con 0x7f7ec40d37d0 2024-04-26T21:59:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec9a45640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec40b4d10 con 0x7f7ec415f750 2024-04-26T21:59:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec9a45640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec40d0680 con 0x7f7ec415f370 2024-04-26T21:59:19.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec27fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7ec415f750 0x7f7ec40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec37fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7ec40d37d0 0x7f7ec40d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50068/0 (socket says 172.21.15.137:50068) 2024-04-26T21:59:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec37fe640 1 -- 172.21.15.137:0/276051098 learned_addr learned my addr 172.21.15.137:0/276051098 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec2ffd640 1 --2- 172.21.15.137:0/276051098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 0x7f7ec40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec27fc640 1 -- 172.21.15.137:0/276051098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 msgr2=0x7f7ec40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec27fc640 1 --2- 172.21.15.137:0/276051098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 0x7f7ec40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec27fc640 1 -- 172.21.15.137:0/276051098 >> v1:172.21.15.137:6789/0 conn(0x7f7ec40d37d0 legacy=0x7f7ec40d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.688+0000 7f7ec27fc640 1 -- 172.21.15.137:0/276051098 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec40d0960 con 0x7f7ec415f750 2024-04-26T21:59:19.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec27fc640 1 --2- 172.21.15.137:0/276051098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 0x7f7ec40b47d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80097a0 tx=0x7f7eb802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e16837217f0ba0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:19.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec1ffb640 1 -- 172.21.15.137:0/276051098 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8037070 con 0x7f7ec415f750 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec1ffb640 1 -- 172.21.15.137:0/276051098 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb802ae50 con 0x7f7ec415f750 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec1ffb640 1 -- 172.21.15.137:0/276051098 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8032660 con 0x7f7ec415f750 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec9a45640 1 -- 172.21.15.137:0/276051098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 msgr2=0x7f7ec40b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec9a45640 1 --2- 172.21.15.137:0/276051098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 0x7f7ec40b47d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80097a0 tx=0x7f7eb802a100 comp rx=0 tx=0).stop 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec9a45640 1 -- 172.21.15.137:0/276051098 shutdown_connections 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec9a45640 1 --2- 172.21.15.137:0/276051098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 0x7f7ec40b47d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec9a45640 1 --2- 172.21.15.137:0/276051098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 0x7f7ec40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec9a45640 1 -- 172.21.15.137:0/276051098 >> 172.21.15.137:0/276051098 conn(0x7f7ec408ec10 msgr2=0x7f7ec409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec9a45640 1 -- 172.21.15.137:0/276051098 shutdown_connections 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.689+0000 7f7ec9a45640 1 -- 172.21.15.137:0/276051098 wait complete. 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.691+0000 7f7ec9a45640 1 Processor -- start 2024-04-26T21:59:19.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.691+0000 7f7ec9a45640 1 -- start start 2024-04-26T21:59:19.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.691+0000 7f7ec9a45640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec40d37d0 0x7f7ec406d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.691+0000 7f7ec9a45640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 0x7f7ec40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.691+0000 7f7ec9a45640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 0x7f7ec40cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.691+0000 7f7ec9a45640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec40b51c0 con 0x7f7ec415f750 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.691+0000 7f7ec9a45640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec40d0f20 con 0x7f7ec40d37d0 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.691+0000 7f7ec9a45640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec40b5340 con 0x7f7ec415f370 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 0x7f7ec40cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 0x7f7ec40cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54304/0 (socket says 172.21.15.137:54304) 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec37fe640 1 -- 172.21.15.137:0/672056647 learned_addr learned my addr 172.21.15.137:0/672056647 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec27fc640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 0x7f7ec40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec2ffd640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec40d37d0 0x7f7ec406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec37fe640 1 -- 172.21.15.137:0/672056647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 msgr2=0x7f7ec40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec37fe640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 0x7f7ec40cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec37fe640 1 -- 172.21.15.137:0/672056647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec40d37d0 msgr2=0x7f7ec406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec37fe640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec40d37d0 0x7f7ec406d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec37fe640 1 -- 172.21.15.137:0/672056647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec40cdef0 con 0x7f7ec415f750 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec37fe640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 0x7f7ec40cd850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00cbf0 tx=0x7f7ebc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:19.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7eabfff640 1 -- 172.21.15.137:0/672056647 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc017070 con 0x7f7ec415f750 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7eabfff640 1 -- 172.21.15.137:0/672056647 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc00ad40 con 0x7f7ec415f750 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec40ce1d0 con 0x7f7ec415f750 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7eabfff640 1 -- 172.21.15.137:0/672056647 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc012600 con 0x7f7ec415f750 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.692+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec40b8ea0 con 0x7f7ec415f750 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.693+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec406a290 con 0x7f7ec415f750 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.694+0000 7f7eabfff640 1 -- 172.21.15.137:0/672056647 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ebc01a070 con 0x7f7ec415f750 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.694+0000 7f7eabfff640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb006c8f0 0x7f7eb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.694+0000 7f7eabfff640 1 -- 172.21.15.137:0/672056647 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7ebc08b720 con 0x7f7ec415f750 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.694+0000 7f7ec2ffd640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb006c8f0 0x7f7eb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:19.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.695+0000 7f7ec2ffd640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb006c8f0 0x7f7eb006edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4006fd0 tx=0x7f7eb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:19.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.698+0000 7f7eabfff640 1 -- 172.21.15.137:0/672056647 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7ebc059590 con 0x7f7ec415f750 2024-04-26T21:59:19.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.883+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7ec415ea70 con 0x7f7ec415f750 2024-04-26T21:59:19.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.884+0000 7f7eabfff640 1 -- 172.21.15.137:0/672056647 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f7ebc05d890 con 0x7f7ec415f750 2024-04-26T21:59:19.884 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T21:59:19.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb006c8f0 msgr2=0x7f7eb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb006c8f0 0x7f7eb006edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4006fd0 tx=0x7f7eb4008040 comp rx=0 tx=0).stop 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 msgr2=0x7f7ec40cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 0x7f7ec40cd850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00cbf0 tx=0x7f7ebc00a430 comp rx=0 tx=0).stop 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 shutdown_connections 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb006c8f0 0x7f7eb006edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ec415f750 0x7f7ec40cd850 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ec415f370 0x7f7ec40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 --2- 172.21.15.137:0/672056647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ec40d37d0 0x7f7ec406d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 >> 172.21.15.137:0/672056647 conn(0x7f7ec408ec10 msgr2=0x7f7ec40b62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 shutdown_connections 2024-04-26T21:59:19.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:19.886+0000 7f7ec9a45640 1 -- 172.21.15.137:0/672056647 wait complete. 2024-04-26T21:59:19.897 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-26T21:59:19.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:19.897 DEBUG:teuthology.orchestra.run.smithi170:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-26T21:59:19.928 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T21:59:19.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:19.928 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-26T21:59:19.987 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T21:59:19.987 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:20.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.084+0000 7f25f7e15640 1 Processor -- start 2024-04-26T21:59:20.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.084+0000 7f25f7e15640 1 -- start start 2024-04-26T21:59:20.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f7e15640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f25f00cf2e0 0x7f25f006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f7e15640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f00d1740 con 0x7f25f006e490 2024-04-26T21:59:20.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f7e15640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f00d1a20 con 0x7f25f00d11b0 2024-04-26T21:59:20.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f7e15640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f25f00d1d00 con 0x7f25f00cf2e0 2024-04-26T21:59:20.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f5bb1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f25f00cf2e0 0x7f25f006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f5bb1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f25f00cf2e0 0x7f25f006d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54306/0 (socket says 172.21.15.137:54306) 2024-04-26T21:59:20.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f5bb1640 1 -- 172.21.15.137:0/2909704974 learned_addr learned my addr 172.21.15.137:0/2909704974 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:20.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f63b2640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f25f006e490 0x7f25f015ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50080/0 (socket says 172.21.15.137:50080) 2024-04-26T21:59:20.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f5bb1640 1 -- 172.21.15.137:0/2909704974 >> v1:172.21.15.170:6789/0 conn(0x7f25f00d11b0 legacy=0x7f25f006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:20.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f5bb1640 1 -- 172.21.15.137:0/2909704974 >> v1:172.21.15.137:6789/0 conn(0x7f25f006e490 legacy=0x7f25f015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.085+0000 7f25f5bb1640 1 -- 172.21.15.137:0/2909704974 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f00d1fe0 con 0x7f25f00cf2e0 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.086+0000 7f25f5bb1640 1 --2- 172.21.15.137:0/2909704974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00cf2e0 0x7f25f006d4d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0098a0 tx=0x7f25ec02a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b908000a94a9fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.086+0000 7f25f4baf640 1 -- 172.21.15.137:0/2909704974 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec037070 con 0x7f25f00cf2e0 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.086+0000 7f25f4baf640 1 -- 172.21.15.137:0/2909704974 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ec032440 con 0x7f25f00cf2e0 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.086+0000 7f25f4baf640 1 -- 172.21.15.137:0/2909704974 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec032810 con 0x7f25f00cf2e0 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.087+0000 7f25f7e15640 1 -- 172.21.15.137:0/2909704974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00cf2e0 msgr2=0x7f25f006d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.087+0000 7f25f7e15640 1 --2- 172.21.15.137:0/2909704974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00cf2e0 0x7f25f006d4d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0098a0 tx=0x7f25ec02a2e0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.087+0000 7f25f7e15640 1 -- 172.21.15.137:0/2909704974 shutdown_connections 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.087+0000 7f25f7e15640 1 --2- 172.21.15.137:0/2909704974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00cf2e0 0x7f25f006d4d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.087+0000 7f25f7e15640 1 -- 172.21.15.137:0/2909704974 >> 172.21.15.137:0/2909704974 conn(0x7f25f00b4a60 msgr2=0x7f25f00b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.087+0000 7f25f7e15640 1 -- 172.21.15.137:0/2909704974 shutdown_connections 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.087+0000 7f25f7e15640 1 -- 172.21.15.137:0/2909704974 wait complete. 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.088+0000 7f25f7e15640 1 Processor -- start 2024-04-26T21:59:20.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.088+0000 7f25f7e15640 1 -- start start 2024-04-26T21:59:20.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.088+0000 7f25f7e15640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f006e490 0x7f25f01553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.088+0000 7f25f7e15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f00cf2e0 0x7f25f01ea660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.088+0000 7f25f7e15640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00d11b0 0x7f25f00cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.088+0000 7f25f7e15640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f25f00cf6c0 con 0x7f25f00d11b0 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.088+0000 7f25f7e15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f25f006da10 con 0x7f25f00cf2e0 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.088+0000 7f25f7e15640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f25f00cf840 con 0x7f25f006e490 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f63b2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00d11b0 0x7f25f00cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f63b2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00d11b0 0x7f25f00cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54310/0 (socket says 172.21.15.137:54310) 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f63b2640 1 -- 172.21.15.137:0/1110128003 learned_addr learned my addr 172.21.15.137:0/1110128003 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f53b0640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f00cf2e0 0x7f25f01ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f5bb1640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f006e490 0x7f25f01553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f63b2640 1 -- 172.21.15.137:0/1110128003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f006e490 msgr2=0x7f25f01553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f63b2640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f006e490 0x7f25f01553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f63b2640 1 -- 172.21.15.137:0/1110128003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f00cf2e0 msgr2=0x7f25f01ea660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f63b2640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f00cf2e0 0x7f25f01ea660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f63b2640 1 -- 172.21.15.137:0/1110128003 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f01f8de0 con 0x7f25f00d11b0 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f63b2640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00d11b0 0x7f25f00cc210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f25e800c730 tx=0x7f25e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25e67fc640 1 -- 172.21.15.137:0/1110128003 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e8018070 con 0x7f25f00d11b0 2024-04-26T21:59:20.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25e67fc640 1 -- 172.21.15.137:0/1110128003 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e8004d60 con 0x7f25f00d11b0 2024-04-26T21:59:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f01f90c0 con 0x7f25f00d11b0 2024-04-26T21:59:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25e67fc640 1 -- 172.21.15.137:0/1110128003 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e800a880 con 0x7f25f00d11b0 2024-04-26T21:59:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.089+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f01f9680 con 0x7f25f00d11b0 2024-04-26T21:59:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.090+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f006a290 con 0x7f25f00d11b0 2024-04-26T21:59:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.091+0000 7f25e67fc640 1 -- 172.21.15.137:0/1110128003 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25e801b070 con 0x7f25f00d11b0 2024-04-26T21:59:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.091+0000 7f25e67fc640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f25d406c8f0 0x7f25d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.091+0000 7f25f5bb1640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f25d406c8f0 0x7f25d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.091+0000 7f25e67fc640 1 -- 172.21.15.137:0/1110128003 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f25e808b070 con 0x7f25f00d11b0 2024-04-26T21:59:20.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.092+0000 7f25f5bb1640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f25d406c8f0 0x7f25d406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f25ec034000 tx=0x7f25ec02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:20.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.096+0000 7f25e67fc640 1 -- 172.21.15.137:0/1110128003 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f25e80594a0 con 0x7f25f00d11b0 2024-04-26T21:59:20.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.311+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25f00c9e00 con 0x7f25f00d11b0 2024-04-26T21:59:20.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.312+0000 7f25e67fc640 1 -- 172.21.15.137:0/1110128003 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f25e8058da0 con 0x7f25f00d11b0 2024-04-26T21:59:20.312 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:20.312 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1319361701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1319361701},{"type":"v1","addr":"172.21.15.170:6833","nonce":1319361701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3941293249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3941293249},{"type":"v1","addr":"172.21.15.137:6837","nonce":3941293249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:58:40.598750+0000","modified":"2024-04-26T21:58:42.690405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/268686042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":268686042},{"type":"v1","addr":"172.21.15.170:6835","nonce":268686042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-26T21:59:20.312 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 7 2024-04-26T21:59:20.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f25d406c8f0 msgr2=0x7f25d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f25d406c8f0 0x7f25d406edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f25ec034000 tx=0x7f25ec02e000 comp rx=0 tx=0).stop 2024-04-26T21:59:20.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00d11b0 msgr2=0x7f25f00cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00d11b0 0x7f25f00cc210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f25e800c730 tx=0x7f25e800cbf0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 shutdown_connections 2024-04-26T21:59:20.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f25d406c8f0 0x7f25d406edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f25f00d11b0 0x7f25f00cc210 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25f00cf2e0 0x7f25f01ea660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 --2- 172.21.15.137:0/1110128003 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f25f006e490 0x7f25f01553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 >> 172.21.15.137:0/1110128003 conn(0x7f25f00b4a60 msgr2=0x7f25f0071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:20.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 shutdown_connections 2024-04-26T21:59:20.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.314+0000 7f25f7e15640 1 -- 172.21.15.137:0/1110128003 wait complete. 2024-04-26T21:59:20.325 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:20.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.421+0000 7f96d0504640 1 Processor -- start 2024-04-26T21:59:20.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.422+0000 7f96d0504640 1 -- start start 2024-04-26T21:59:20.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.422+0000 7f96d0504640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8140350 0x7f96c80cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.422+0000 7f96d0504640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c80d05b0 con 0x7f96c813ff70 2024-04-26T21:59:20.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.422+0000 7f96d0504640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c80d0890 con 0x7f96c8146790 2024-04-26T21:59:20.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.422+0000 7f96d0504640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f96c806e450 con 0x7f96c8140350 2024-04-26T21:59:20.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96ce2a0640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f96c813ff70 0x7f96c8146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50088/0 (socket says 172.21.15.137:50088) 2024-04-26T21:59:20.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96ce2a0640 1 -- 172.21.15.137:0/30634584 learned_addr learned my addr 172.21.15.137:0/30634584 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893344606 0 0) 0x7f96c80d05b0 con 0x7f96c813ff70 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96b0003520 con 0x7f96c813ff70 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cda9f640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8140350 0x7f96c80cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 994917351 0 0) 0x7f96b0003520 con 0x7f96c813ff70 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8140350 msgr2=0x7f96c80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8140350 0x7f96c80cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 >> v1:172.21.15.170:6789/0 conn(0x7f96c8146790 legacy=0x7f96c80cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c806e730 con 0x7f96c813ff70 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f96c00019f0 con 0x7f96c813ff70 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 >> v1:172.21.15.137:6789/0 conn(0x7f96c813ff70 legacy=0x7f96c8146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8140350 0x7f96b00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96b0003f60 0x7f96b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96c806e450 con 0x7f96b0004d40 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f96b000bb50 con 0x7f96b0003f60 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f96b000bd50 con 0x7f96c8140350 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96ceaa1640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96cda9f640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96b0003f60 0x7f96b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.423+0000 7f96ce2a0640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8140350 0x7f96b00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.424+0000 7f96ceaa1640 1 -- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8140350 msgr2=0x7f96b00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.424+0000 7f96ceaa1640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8140350 0x7f96b00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.424+0000 7f96ceaa1640 1 -- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96b0003f60 msgr2=0x7f96b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.424+0000 7f96ceaa1640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96b0003f60 0x7f96b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.424+0000 7f96ceaa1640 1 -- 172.21.15.137:0/30634584 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b0003520 con 0x7f96b0004d40 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.424+0000 7f96ceaa1640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96b00051c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f96b8001720 tx=0x7f96b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab63fd283575628e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.424+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8001370 con 0x7f96b0004d40 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.424+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b80052d0 con 0x7f96b0004d40 2024-04-26T21:59:20.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.424+0000 7f96cd29e640 1 -- 172.21.15.137:0/30634584 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b802abc0 con 0x7f96b0004d40 2024-04-26T21:59:20.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.425+0000 7f96d0504640 1 -- 172.21.15.137:0/30634584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 msgr2=0x7f96b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.425+0000 7f96d0504640 1 --2- 172.21.15.137:0/30634584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96b00051c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f96b8001720 tx=0x7f96b0005830 comp rx=0 tx=0).stop 2024-04-26T21:59:20.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.425+0000 7f96ceaa1640 1 -- 172.21.15.137:0/30634584 reap_dead start 2024-04-26T21:59:20.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.425+0000 7f96d0504640 1 -- 172.21.15.137:0/30634584 shutdown_connections 2024-04-26T21:59:20.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.425+0000 7f96d0504640 1 -- 172.21.15.137:0/30634584 >> 172.21.15.137:0/30634584 conn(0x7f96c80d0d30 msgr2=0x7f96c80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:20.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.425+0000 7f96d0504640 1 -- 172.21.15.137:0/30634584 shutdown_connections 2024-04-26T21:59:20.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.425+0000 7f96d0504640 1 -- 172.21.15.137:0/30634584 wait complete. 2024-04-26T21:59:20.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.426+0000 7f96d0504640 1 Processor -- start 2024-04-26T21:59:20.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.426+0000 7f96d0504640 1 -- start start 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96d0504640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96c813b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96d0504640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8144bb0 0x7f96c81430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96d0504640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96c8143600 0x7f96c814e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96d0504640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96c80cf810 con 0x7f96b0004d40 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96d0504640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f96c80cf990 con 0x7f96c8143600 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96d0504640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f96c80cfb10 con 0x7f96c8144bb0 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96ce2a0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96c813b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96ce2a0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96c813b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54328/0 (socket says 172.21.15.137:54328) 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96ce2a0640 1 -- 172.21.15.137:0/2437729595 learned_addr learned my addr 172.21.15.137:0/2437729595 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96ce2a0640 1 -- 172.21.15.137:0/2437729595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8144bb0 msgr2=0x7f96c81430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96ce2a0640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8144bb0 0x7f96c81430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96ce2a0640 1 -- 172.21.15.137:0/2437729595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96c8143600 msgr2=0x7f96c814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96ce2a0640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96c8143600 0x7f96c814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96ce2a0640 1 -- 172.21.15.137:0/2437729595 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c8143b10 con 0x7f96b0004d40 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.427+0000 7f96ce2a0640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96c813b520 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f96c0001560 tx=0x7f96c000a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.428+0000 7f96c6ffd640 1 -- 172.21.15.137:0/2437729595 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0017020 con 0x7f96b0004d40 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.428+0000 7f96c6ffd640 1 -- 172.21.15.137:0/2437729595 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c00133f0 con 0x7f96b0004d40 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.428+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c8143df0 con 0x7f96b0004d40 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.428+0000 7f96c6ffd640 1 -- 172.21.15.137:0/2437729595 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c00137c0 con 0x7f96b0004d40 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.428+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c81443b0 con 0x7f96b0004d40 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.429+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c806a290 con 0x7f96b0004d40 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.429+0000 7f96c6ffd640 1 -- 172.21.15.137:0/2437729595 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96c001a020 con 0x7f96b0004d40 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.429+0000 7f96c6ffd640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96b406c920 0x7f96b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.429+0000 7f96cda9f640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96b406c920 0x7f96b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.429+0000 7f96c6ffd640 1 -- 172.21.15.137:0/2437729595 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96c008c600 con 0x7f96b0004d40 2024-04-26T21:59:20.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.430+0000 7f96cda9f640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96b406c920 0x7f96b406ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f96c81f65c0 tx=0x7f96bc0095d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:20.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.434+0000 7f96c6ffd640 1 -- 172.21.15.137:0/2437729595 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f96c0021020 con 0x7f96b0004d40 2024-04-26T21:59:20.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.608+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96c80b45e0 con 0x7f96b0004d40 2024-04-26T21:59:20.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.610+0000 7f96c6ffd640 1 -- 172.21.15.137:0/2437729595 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16617 (secure 0 0 0) 0x7f96c005aa30 con 0x7f96b0004d40 2024-04-26T21:59:20.611 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:20.611 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":21,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:58:42.247427+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.612+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96b406c920 msgr2=0x7f96b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.612+0000 7f96d0504640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96b406c920 0x7f96b406ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f96c81f65c0 tx=0x7f96bc0095d0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.612+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 msgr2=0x7f96c813b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.612+0000 7f96d0504640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96c813b520 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f96c0001560 tx=0x7f96c000a6f0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.612+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 shutdown_connections 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.612+0000 7f96d0504640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96b406c920 0x7f96b406ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.612+0000 7f96d0504640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96c8143600 0x7f96c814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.612+0000 7f96d0504640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96c8144bb0 0x7f96c81430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.612+0000 7f96d0504640 1 --2- 172.21.15.137:0/2437729595 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96b0004d40 0x7f96c813b520 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.613+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 >> 172.21.15.137:0/2437729595 conn(0x7f96c80d0d30 msgr2=0x7f96c813f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:20.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.613+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 shutdown_connections 2024-04-26T21:59:20.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.613+0000 7f96d0504640 1 -- 172.21.15.137:0/2437729595 wait complete. 2024-04-26T21:59:20.624 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:58:38.629082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:58:39.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:20.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:20.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.726+0000 7fefe10f8640 1 Processor -- start 2024-04-26T21:59:20.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.726+0000 7fefe10f8640 1 -- start start 2024-04-26T21:59:20.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.726+0000 7fefe10f8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fefdc0b3c20 0x7fefdc06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefe10f8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fefdc0b33e0 0x7fefdc163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefe10f8640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefdc09c700 con 0x7fefdc0d0010 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefe10f8640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fefdc0b4480 con 0x7fefdc0b33e0 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefe10f8640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fefdc06e050 con 0x7fefdc0b3c20 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefdb59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fefdc0b33e0 0x7fefdc163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefdad9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fefdc0d0010 0x7fefdc0b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50102/0 (socket says 172.21.15.137:50102) 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefdad9d640 1 -- 172.21.15.137:0/3847338738 learned_addr learned my addr 172.21.15.137:0/3847338738 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefda59c640 1 --2- 172.21.15.137:0/3847338738 >> v2:172.21.15.170:3300/0 conn(0x7fefdc0b3c20 0x7fefdc06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefdb59e640 1 -- 172.21.15.137:0/3847338738 >> v2:172.21.15.170:3300/0 conn(0x7fefdc0b3c20 msgr2=0x7fefdc06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefdb59e640 1 --2- 172.21.15.137:0/3847338738 >> v2:172.21.15.170:3300/0 conn(0x7fefdc0b3c20 0x7fefdc06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefdb59e640 1 -- 172.21.15.137:0/3847338738 >> v1:172.21.15.137:6789/0 conn(0x7fefdc0d0010 legacy=0x7fefdc0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefd9d9b640 1 -- 172.21.15.137:0/3847338738 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230857085 0 0) 0x7fefdc09c700 con 0x7fefdc0d0010 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.727+0000 7fefdb59e640 1 -- 172.21.15.137:0/3847338738 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefdc0d1c50 con 0x7fefdc0b33e0 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefdb59e640 1 --2- 172.21.15.137:0/3847338738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b33e0 0x7fefdc163280 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fefdc073930 tx=0x7fefd402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0c34f5c6a39aab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefd9d9b640 1 -- 172.21.15.137:0/3847338738 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd4037070 con 0x7fefdc0b33e0 2024-04-26T21:59:20.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefd9d9b640 1 -- 172.21.15.137:0/3847338738 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd4032440 con 0x7fefdc0b33e0 2024-04-26T21:59:20.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefd9d9b640 1 -- 172.21.15.137:0/3847338738 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd4032810 con 0x7fefdc0b33e0 2024-04-26T21:59:20.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefe10f8640 1 -- 172.21.15.137:0/3847338738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b33e0 msgr2=0x7fefdc163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefe10f8640 1 --2- 172.21.15.137:0/3847338738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b33e0 0x7fefdc163280 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fefdc073930 tx=0x7fefd402a1a0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefe10f8640 1 -- 172.21.15.137:0/3847338738 shutdown_connections 2024-04-26T21:59:20.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefe10f8640 1 --2- 172.21.15.137:0/3847338738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b33e0 0x7fefdc163280 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefe10f8640 1 --2- 172.21.15.137:0/3847338738 >> v2:172.21.15.170:3300/0 conn(0x7fefdc0b3c20 0x7fefdc06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefe10f8640 1 -- 172.21.15.137:0/3847338738 >> 172.21.15.137:0/3847338738 conn(0x7fefdc09ba40 msgr2=0x7fefdc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:20.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefe10f8640 1 -- 172.21.15.137:0/3847338738 shutdown_connections 2024-04-26T21:59:20.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.728+0000 7fefe10f8640 1 -- 172.21.15.137:0/3847338738 wait complete. 2024-04-26T21:59:20.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.730+0000 7fefe10f8640 1 Processor -- start 2024-04-26T21:59:20.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.730+0000 7fefe10f8640 1 -- start start 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.730+0000 7fefe10f8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc0b33e0 0x7fefdc15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.730+0000 7fefe10f8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b3c20 0x7fefdc15ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefe10f8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc0d0010 0x7fefdc145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefe10f8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fefdc0b3990 con 0x7fefdc0b3c20 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefe10f8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fefdc0b3810 con 0x7fefdc0b33e0 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefe10f8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fefdc1637c0 con 0x7fefdc0d0010 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefda59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b3c20 0x7fefdc15ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefda59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b3c20 0x7fefdc15ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54344/0 (socket says 172.21.15.137:54344) 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefda59c640 1 -- 172.21.15.137:0/924889585 learned_addr learned my addr 172.21.15.137:0/924889585 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefdad9d640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc0b33e0 0x7fefdc15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefdb59e640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc0d0010 0x7fefdc145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefda59c640 1 -- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc0d0010 msgr2=0x7fefdc145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefda59c640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc0d0010 0x7fefdc145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefda59c640 1 -- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc0b33e0 msgr2=0x7fefdc15ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefda59c640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc0b33e0 0x7fefdc15ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefda59c640 1 -- 172.21.15.137:0/924889585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefdc15a220 con 0x7fefdc0b3c20 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefdb59e640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc0d0010 0x7fefdc145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefdad9d640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc0b33e0 0x7fefdc15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefda59c640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b3c20 0x7fefdc15ba70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fefd000d800 tx=0x7fefd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefc37fe640 1 -- 172.21.15.137:0/924889585 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd000b6c0 con 0x7fefdc0b3c20 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefc37fe640 1 -- 172.21.15.137:0/924889585 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd0019070 con 0x7fefdc0b3c20 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefc37fe640 1 -- 172.21.15.137:0/924889585 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd000ba80 con 0x7fefdc0b3c20 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefdc156760 con 0x7fefdc0b3c20 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.731+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefdc146d40 con 0x7fefdc0b3c20 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.732+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefdc06a290 con 0x7fefdc0b3c20 2024-04-26T21:59:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.733+0000 7fefc37fe640 1 -- 172.21.15.137:0/924889585 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fefd000bc20 con 0x7fefdc0b3c20 2024-04-26T21:59:20.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.733+0000 7fefc37fe640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fefc806c8f0 0x7fefc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:20.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.733+0000 7fefc37fe640 1 -- 172.21.15.137:0/924889585 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fefd008c040 con 0x7fefdc0b3c20 2024-04-26T21:59:20.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.733+0000 7fefdad9d640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fefc806c8f0 0x7fefc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:20.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.734+0000 7fefdad9d640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fefc806c8f0 0x7fefc806edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0012e0 tx=0x7fefcc005b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:20.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.737+0000 7fefc37fe640 1 -- 172.21.15.137:0/924889585 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fefd001c360 con 0x7fefdc0b3c20 2024-04-26T21:59:20.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.911+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fefdc0b8f10 con 0x7fefdc0b3c20 2024-04-26T21:59:20.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.912+0000 7fefc37fe640 1 -- 172.21.15.137:0/924889585 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fefd005a470 con 0x7fefdc0b3c20 2024-04-26T21:59:20.912 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:20.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fefc806c8f0 msgr2=0x7fefc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fefc806c8f0 0x7fefc806edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0012e0 tx=0x7fefcc005b90 comp rx=0 tx=0).stop 2024-04-26T21:59:20.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b3c20 msgr2=0x7fefdc15ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:20.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b3c20 0x7fefdc15ba70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fefd000d800 tx=0x7fefd000dcc0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 shutdown_connections 2024-04-26T21:59:20.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fefc806c8f0 0x7fefc806edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fefdc0b3c20 0x7fefdc15ba70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fefdc0d0010 0x7fefdc145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 --2- 172.21.15.137:0/924889585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc0b33e0 0x7fefdc15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:20.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 >> 172.21.15.137:0/924889585 conn(0x7fefdc09ba40 msgr2=0x7fefdc070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:20.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 shutdown_connections 2024-04-26T21:59:20.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:20.914+0000 7fefe10f8640 1 -- 172.21.15.137:0/924889585 wait complete. 2024-04-26T21:59:20.925 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:21.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.025+0000 7f85dbd0a640 1 Processor -- start 2024-04-26T21:59:21.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.025+0000 7f85dbd0a640 1 -- start start 2024-04-26T21:59:21.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85dbd0a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85d406f340 0x7f85d40b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85dbd0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40b3e50 0x7f85d40720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85dbd0a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d40b46a0 con 0x7f85d40d0300 2024-04-26T21:59:21.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85dbd0a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f85d40b5db0 con 0x7f85d406f340 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85dbd0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f85d40b6090 con 0x7f85d40b3e50 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85d9aa6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85d406f340 0x7f85d40b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85d92a5640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f85d40d0300 0x7f85d406f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50110/0 (socket says 172.21.15.137:50110) 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85d92a5640 1 -- 172.21.15.137:0/948982100 learned_addr learned my addr 172.21.15.137:0/948982100 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85da2a7640 1 --2- 172.21.15.137:0/948982100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40b3e50 0x7f85d40720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85d9aa6640 1 -- 172.21.15.137:0/948982100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40b3e50 msgr2=0x7f85d40720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85d9aa6640 1 --2- 172.21.15.137:0/948982100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40b3e50 0x7f85d40720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85d9aa6640 1 -- 172.21.15.137:0/948982100 >> v1:172.21.15.137:6789/0 conn(0x7f85d40d0300 legacy=0x7f85d406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85d9aa6640 1 -- 172.21.15.137:0/948982100 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d40b6370 con 0x7f85d406f340 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85d8aa4640 1 -- 172.21.15.137:0/948982100 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632439184 0 0) 0x7f85d40b46a0 con 0x7f85d40d0300 2024-04-26T21:59:21.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.026+0000 7f85da2a7640 1 --2- 172.21.15.137:0/948982100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40b3e50 0x7f85d40720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.027+0000 7f85d9aa6640 1 --2- 172.21.15.137:0/948982100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d406f340 0x7f85d40b6b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097a0 tx=0x7f85d002a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed1d78a69f7f4a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.027+0000 7f85d8aa4640 1 -- 172.21.15.137:0/948982100 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0037070 con 0x7f85d406f340 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.027+0000 7f85d8aa4640 1 -- 172.21.15.137:0/948982100 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d002adb0 con 0x7f85d406f340 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.027+0000 7f85d8aa4640 1 -- 172.21.15.137:0/948982100 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0032660 con 0x7f85d406f340 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.027+0000 7f85dbd0a640 1 -- 172.21.15.137:0/948982100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d406f340 msgr2=0x7f85d40b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.027+0000 7f85dbd0a640 1 --2- 172.21.15.137:0/948982100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d406f340 0x7f85d40b6b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097a0 tx=0x7f85d002a060 comp rx=0 tx=0).stop 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.028+0000 7f85dbd0a640 1 -- 172.21.15.137:0/948982100 shutdown_connections 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.028+0000 7f85dbd0a640 1 --2- 172.21.15.137:0/948982100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40b3e50 0x7f85d40720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.028+0000 7f85dbd0a640 1 --2- 172.21.15.137:0/948982100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d406f340 0x7f85d40b6b70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.028+0000 7f85dbd0a640 1 -- 172.21.15.137:0/948982100 >> 172.21.15.137:0/948982100 conn(0x7f85d40cd8a0 msgr2=0x7f85d40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.028+0000 7f85dbd0a640 1 -- 172.21.15.137:0/948982100 shutdown_connections 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.028+0000 7f85dbd0a640 1 -- 172.21.15.137:0/948982100 wait complete. 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.029+0000 7f85dbd0a640 1 Processor -- start 2024-04-26T21:59:21.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.029+0000 7f85dbd0a640 1 -- start start 2024-04-26T21:59:21.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.029+0000 7f85dbd0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85d406f340 0x7f85d4159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.029+0000 7f85dbd0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40b3e50 0x7f85d40c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85dbd0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40d0300 0x7f85d40c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85dbd0a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40b4460 con 0x7f85d40b3e50 2024-04-26T21:59:21.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85dbd0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40b42e0 con 0x7f85d406f340 2024-04-26T21:59:21.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85dbd0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f85d4142a30 con 0x7f85d40d0300 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85d92a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40b3e50 0x7f85d40c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85d92a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40b3e50 0x7f85d40c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54366/0 (socket says 172.21.15.137:54366) 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85d92a5640 1 -- 172.21.15.137:0/345751914 learned_addr learned my addr 172.21.15.137:0/345751914 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85d92a5640 1 -- 172.21.15.137:0/345751914 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40d0300 msgr2=0x7f85d40c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85d92a5640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40d0300 0x7f85d40c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85d92a5640 1 -- 172.21.15.137:0/345751914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85d406f340 msgr2=0x7f85d4159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85d92a5640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85d406f340 0x7f85d4159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85d92a5640 1 -- 172.21.15.137:0/345751914 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d40c6880 con 0x7f85d40b3e50 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85d92a5640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40b3e50 0x7f85d40c5dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c4d0 tx=0x7f85c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85ca7fc640 1 -- 172.21.15.137:0/345751914 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4018070 con 0x7f85d40b3e50 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85ca7fc640 1 -- 172.21.15.137:0/345751914 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c4007500 con 0x7f85d40b3e50 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d40c6b60 con 0x7f85d40b3e50 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85ca7fc640 1 -- 172.21.15.137:0/345751914 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4004a20 con 0x7f85d40b3e50 2024-04-26T21:59:21.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.030+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d40c7120 con 0x7f85d40b3e50 2024-04-26T21:59:21.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.031+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d406a290 con 0x7f85d40b3e50 2024-04-26T21:59:21.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.032+0000 7f85ca7fc640 1 -- 172.21.15.137:0/345751914 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85c401b070 con 0x7f85d40b3e50 2024-04-26T21:59:21.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.032+0000 7f85ca7fc640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85b806c8f0 0x7f85b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.032+0000 7f85ca7fc640 1 -- 172.21.15.137:0/345751914 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f85c408ae90 con 0x7f85d40b3e50 2024-04-26T21:59:21.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.032+0000 7f85d9aa6640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85b806c8f0 0x7f85b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.033+0000 7f85d9aa6640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85b806c8f0 0x7f85b806edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85d0034000 tx=0x7f85d002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.036+0000 7f85ca7fc640 1 -- 172.21.15.137:0/345751914 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f85c40592c0 con 0x7f85d40b3e50 2024-04-26T21:59:21.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.211+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f85d4075740 con 0x7f85d40b3e50 2024-04-26T21:59:21.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.211+0000 7f85ca7fc640 1 -- 172.21.15.137:0/345751914 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f85c4058bc0 con 0x7f85d40b3e50 2024-04-26T21:59:21.212 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85b806c8f0 msgr2=0x7f85b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85b806c8f0 0x7f85b806edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85d0034000 tx=0x7f85d002c000 comp rx=0 tx=0).stop 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40b3e50 msgr2=0x7f85d40c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40b3e50 0x7f85d40c5dc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f85c400c4d0 tx=0x7f85c400c990 comp rx=0 tx=0).stop 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 shutdown_connections 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85b806c8f0 0x7f85b806edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85d40b3e50 0x7f85d40c5dc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85d40d0300 0x7f85d40c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 --2- 172.21.15.137:0/345751914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85d406f340 0x7f85d4159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 >> 172.21.15.137:0/345751914 conn(0x7f85d40cd8a0 msgr2=0x7f85d40ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 shutdown_connections 2024-04-26T21:59:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.213+0000 7f85dbd0a640 1 -- 172.21.15.137:0/345751914 wait complete. 2024-04-26T21:59:21.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:21.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.325+0000 7f567c7f0640 1 Processor -- start 2024-04-26T21:59:21.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.325+0000 7f567c7f0640 1 -- start start 2024-04-26T21:59:21.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567c7f0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f567406f340 0x7f56740b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567c7f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56740d0300 0x7f567406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567c7f0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f56740b3e50 0x7f56740720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567c7f0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f567406fc60 con 0x7f567406f340 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567c7f0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f56740b46a0 con 0x7f56740b3e50 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567c7f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56740b5db0 con 0x7f56740d0300 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567a58c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f567406f340 0x7f56740b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567a58c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f567406f340 0x7f56740b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54372/0 (socket says 172.21.15.137:54372) 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567a58c640 1 -- 172.21.15.137:0/3323590337 learned_addr learned my addr 172.21.15.137:0/3323590337 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567a58c640 1 -- 172.21.15.137:0/3323590337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56740d0300 msgr2=0x7f567406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567a58c640 1 --2- 172.21.15.137:0/3323590337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56740d0300 0x7f567406f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567a58c640 1 -- 172.21.15.137:0/3323590337 >> v2:172.21.15.170:3300/0 conn(0x7f56740b3e50 msgr2=0x7f56740720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567a58c640 1 --2- 172.21.15.137:0/3323590337 >> v2:172.21.15.170:3300/0 conn(0x7f56740b3e50 0x7f56740720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.326+0000 7f567a58c640 1 -- 172.21.15.137:0/3323590337 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56740b6090 con 0x7f567406f340 2024-04-26T21:59:21.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.327+0000 7f567a58c640 1 --2- 172.21.15.137:0/3323590337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 0x7f56740b6b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5674072080 tx=0x7f567002c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5addbc90bb9818b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.327+0000 7f567958a640 1 -- 172.21.15.137:0/3323590337 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670009600 con 0x7f567406f340 2024-04-26T21:59:21.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.327+0000 7f567958a640 1 -- 172.21.15.137:0/3323590337 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56700097a0 con 0x7f567406f340 2024-04-26T21:59:21.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.327+0000 7f567958a640 1 -- 172.21.15.137:0/3323590337 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670009b70 con 0x7f567406f340 2024-04-26T21:59:21.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.328+0000 7f567c7f0640 1 -- 172.21.15.137:0/3323590337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 msgr2=0x7f56740b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.328+0000 7f567c7f0640 1 --2- 172.21.15.137:0/3323590337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 0x7f56740b6b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5674072080 tx=0x7f567002c780 comp rx=0 tx=0).stop 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.328+0000 7f567c7f0640 1 -- 172.21.15.137:0/3323590337 shutdown_connections 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.328+0000 7f567c7f0640 1 --2- 172.21.15.137:0/3323590337 >> v2:172.21.15.170:3300/0 conn(0x7f56740b3e50 0x7f56740720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.328+0000 7f567c7f0640 1 --2- 172.21.15.137:0/3323590337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56740d0300 0x7f567406f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.328+0000 7f567c7f0640 1 --2- 172.21.15.137:0/3323590337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 0x7f56740b6b70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.328+0000 7f567c7f0640 1 -- 172.21.15.137:0/3323590337 >> 172.21.15.137:0/3323590337 conn(0x7f56740cd8a0 msgr2=0x7f56740cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.328+0000 7f567c7f0640 1 -- 172.21.15.137:0/3323590337 shutdown_connections 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.328+0000 7f567c7f0640 1 -- 172.21.15.137:0/3323590337 wait complete. 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.329+0000 7f567c7f0640 1 Processor -- start 2024-04-26T21:59:21.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.329+0000 7f567c7f0640 1 -- start start 2024-04-26T21:59:21.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567c7f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 0x7f5674137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567c7f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56740b3e50 0x7f56740ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567c7f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56740d0300 0x7f56741f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567c7f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f56740b42e0 con 0x7f567406f340 2024-04-26T21:59:21.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567c7f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f56740b6650 con 0x7f56740b3e50 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567c7f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56740b4460 con 0x7f56740d0300 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567a58c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 0x7f5674137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567a58c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 0x7f5674137480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54378/0 (socket says 172.21.15.137:54378) 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567a58c640 1 -- 172.21.15.137:0/260974074 learned_addr learned my addr 172.21.15.137:0/260974074 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567ad8d640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56740d0300 0x7f56741f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f5679d8b640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56740b3e50 0x7f56740ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567a58c640 1 -- 172.21.15.137:0/260974074 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56740d0300 msgr2=0x7f56741f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567a58c640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56740d0300 0x7f56741f0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567a58c640 1 -- 172.21.15.137:0/260974074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56740b3e50 msgr2=0x7f56740ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567a58c640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56740b3e50 0x7f56740ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567a58c640 1 -- 172.21.15.137:0/260974074 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56740c8810 con 0x7f567406f340 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567a58c640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 0x7f5674137480 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5670036040 tx=0x7f5670004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f566affd640 1 -- 172.21.15.137:0/260974074 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670044020 con 0x7f567406f340 2024-04-26T21:59:21.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f566affd640 1 -- 172.21.15.137:0/260974074 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5670034c30 con 0x7f567406f340 2024-04-26T21:59:21.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56740c8af0 con 0x7f567406f340 2024-04-26T21:59:21.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.330+0000 7f566affd640 1 -- 172.21.15.137:0/260974074 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670009600 con 0x7f567406f340 2024-04-26T21:59:21.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.331+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56740c90b0 con 0x7f567406f340 2024-04-26T21:59:21.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.332+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f567406a290 con 0x7f567406f340 2024-04-26T21:59:21.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.332+0000 7f566affd640 1 -- 172.21.15.137:0/260974074 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5670047020 con 0x7f567406f340 2024-04-26T21:59:21.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.332+0000 7f566affd640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565806c8f0 0x7f565806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.332+0000 7f566affd640 1 -- 172.21.15.137:0/260974074 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f56700aed80 con 0x7f567406f340 2024-04-26T21:59:21.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.332+0000 7f5679d8b640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565806c8f0 0x7f565806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.333+0000 7f5679d8b640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565806c8f0 0x7f565806edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56740cffb0 tx=0x7f5664008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.337+0000 7f566affd640 1 -- 172.21.15.137:0/260974074 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f567004e030 con 0x7f567406f340 2024-04-26T21:59:21.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.509+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5674144ff0 con 0x7f567406f340 2024-04-26T21:59:21.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.510+0000 7f566affd640 1 -- 172.21.15.137:0/260974074 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f567007d240 con 0x7f567406f340 2024-04-26T21:59:21.510 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:21.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565806c8f0 msgr2=0x7f565806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565806c8f0 0x7f565806edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56740cffb0 tx=0x7f5664008040 comp rx=0 tx=0).stop 2024-04-26T21:59:21.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 msgr2=0x7f5674137480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 0x7f5674137480 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5670036040 tx=0x7f5670004a40 comp rx=0 tx=0).stop 2024-04-26T21:59:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 shutdown_connections 2024-04-26T21:59:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f565806c8f0 0x7f565806edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f56740d0300 0x7f56741f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56740b3e50 0x7f56740ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 --2- 172.21.15.137:0/260974074 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567406f340 0x7f5674137480 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 >> 172.21.15.137:0/260974074 conn(0x7f56740cd8a0 msgr2=0x7f567415a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 shutdown_connections 2024-04-26T21:59:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.512+0000 7f567c7f0640 1 -- 172.21.15.137:0/260974074 wait complete. 2024-04-26T21:59:21.523 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:21.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.622+0000 7fe87cc1d640 1 Processor -- start 2024-04-26T21:59:21.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.622+0000 7fe87cc1d640 1 -- start start 2024-04-26T21:59:21.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe87cc1d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe878145980 0x7fe878160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe87cc1d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe8780b3de0 0x7fe8780b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe87cc1d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8780b4260 con 0x7fe8780b5fd0 2024-04-26T21:59:21.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe87cc1d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe8780b5140 con 0x7fe8780b3de0 2024-04-26T21:59:21.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe87cc1d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe8780b6410 con 0x7fe878145980 2024-04-26T21:59:21.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe875d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe8780b3de0 0x7fe8780b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe875d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe8780b3de0 0x7fe8780b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54392/0 (socket says 172.21.15.137:54392) 2024-04-26T21:59:21.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe875d9b640 1 -- 172.21.15.137:0/2942419958 learned_addr learned my addr 172.21.15.137:0/2942419958 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:21.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe87659c640 1 --2- 172.21.15.137:0/2942419958 >> v2:172.21.15.170:3300/0 conn(0x7fe878145980 0x7fe878160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe875d9b640 1 -- 172.21.15.137:0/2942419958 >> v2:172.21.15.170:3300/0 conn(0x7fe878145980 msgr2=0x7fe878160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:21.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe875d9b640 1 --2- 172.21.15.137:0/2942419958 >> v2:172.21.15.170:3300/0 conn(0x7fe878145980 0x7fe878160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe875d9b640 1 -- 172.21.15.137:0/2942419958 >> v1:172.21.15.170:6789/0 conn(0x7fe8780b5fd0 legacy=0x7fe87815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.624+0000 7fe875d9b640 1 -- 172.21.15.137:0/2942419958 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8780b4530 con 0x7fe8780b3de0 2024-04-26T21:59:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.625+0000 7fe875d9b640 1 --2- 172.21.15.137:0/2942419958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8780b3de0 0x7fe8780b5a90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe87806ff10 tx=0x7fe86c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96f8af72e5ea40a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.625+0000 7fe87559a640 1 -- 172.21.15.137:0/2942419958 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c037070 con 0x7fe8780b3de0 2024-04-26T21:59:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.625+0000 7fe87559a640 1 -- 172.21.15.137:0/2942419958 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86c032440 con 0x7fe8780b3de0 2024-04-26T21:59:21.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.625+0000 7fe87559a640 1 -- 172.21.15.137:0/2942419958 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c032810 con 0x7fe8780b3de0 2024-04-26T21:59:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.626+0000 7fe87cc1d640 1 -- 172.21.15.137:0/2942419958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8780b3de0 msgr2=0x7fe8780b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.626+0000 7fe87cc1d640 1 --2- 172.21.15.137:0/2942419958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8780b3de0 0x7fe8780b5a90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe87806ff10 tx=0x7fe86c02a1e0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.626+0000 7fe87cc1d640 1 -- 172.21.15.137:0/2942419958 shutdown_connections 2024-04-26T21:59:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.626+0000 7fe87cc1d640 1 --2- 172.21.15.137:0/2942419958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8780b3de0 0x7fe8780b5a90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.626+0000 7fe87cc1d640 1 --2- 172.21.15.137:0/2942419958 >> v2:172.21.15.170:3300/0 conn(0x7fe878145980 0x7fe878160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.626+0000 7fe87cc1d640 1 -- 172.21.15.137:0/2942419958 >> 172.21.15.137:0/2942419958 conn(0x7fe8780d0d30 msgr2=0x7fe8780d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.626+0000 7fe87cc1d640 1 -- 172.21.15.137:0/2942419958 shutdown_connections 2024-04-26T21:59:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.626+0000 7fe87cc1d640 1 -- 172.21.15.137:0/2942419958 wait complete. 2024-04-26T21:59:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.627+0000 7fe87cc1d640 1 Processor -- start 2024-04-26T21:59:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.627+0000 7fe87cc1d640 1 -- start start 2024-04-26T21:59:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe87cc1d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8780b3de0 0x7fe87813b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe87cc1d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8780b5fd0 0x7fe87815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe87cc1d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe878145980 0x7fe878140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe87cc1d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8780b4dd0 con 0x7fe878145980 2024-04-26T21:59:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe87cc1d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe8780b4af0 con 0x7fe8780b5fd0 2024-04-26T21:59:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe87cc1d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe8780730e0 con 0x7fe8780b3de0 2024-04-26T21:59:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe876d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe878145980 0x7fe878140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe876d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe878145980 0x7fe878140350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54408/0 (socket says 172.21.15.137:54408) 2024-04-26T21:59:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe876d9d640 1 -- 172.21.15.137:0/1807392923 learned_addr learned my addr 172.21.15.137:0/1807392923 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe87659c640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8780b3de0 0x7fe87813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe875d9b640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8780b5fd0 0x7fe87815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe876d9d640 1 -- 172.21.15.137:0/1807392923 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8780b3de0 msgr2=0x7fe87813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe876d9d640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8780b3de0 0x7fe87813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe876d9d640 1 -- 172.21.15.137:0/1807392923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8780b5fd0 msgr2=0x7fe87815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe876d9d640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8780b5fd0 0x7fe87815d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.628+0000 7fe876d9d640 1 -- 172.21.15.137:0/1807392923 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87813f590 con 0x7fe878145980 2024-04-26T21:59:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.629+0000 7fe876d9d640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe878145980 0x7fe878140350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c7a0 tx=0x7fe87000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.629+0000 7fe866ffd640 1 -- 172.21.15.137:0/1807392923 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870003b70 con 0x7fe878145980 2024-04-26T21:59:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.629+0000 7fe866ffd640 1 -- 172.21.15.137:0/1807392923 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe870003d30 con 0x7fe878145980 2024-04-26T21:59:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.629+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87813f870 con 0x7fe878145980 2024-04-26T21:59:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.629+0000 7fe866ffd640 1 -- 172.21.15.137:0/1807392923 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87000aa90 con 0x7fe878145980 2024-04-26T21:59:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.629+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87813bb70 con 0x7fe878145980 2024-04-26T21:59:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.630+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87806a290 con 0x7fe878145980 2024-04-26T21:59:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.630+0000 7fe866ffd640 1 -- 172.21.15.137:0/1807392923 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe87000ac30 con 0x7fe878145980 2024-04-26T21:59:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.630+0000 7fe866ffd640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85806c8f0 0x7fe85806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.631+0000 7fe866ffd640 1 -- 172.21.15.137:0/1807392923 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fe87008b9e0 con 0x7fe878145980 2024-04-26T21:59:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.631+0000 7fe87659c640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85806c8f0 0x7fe85806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.631+0000 7fe87659c640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85806c8f0 0x7fe85806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe868009aa0 tx=0x7fe868009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.635+0000 7fe866ffd640 1 -- 172.21.15.137:0/1807392923 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe870059740 con 0x7fe878145980 2024-04-26T21:59:21.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.850+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe878073cc0 con 0x7fe878145980 2024-04-26T21:59:21.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.850+0000 7fe866ffd640 1 -- 172.21.15.137:0/1807392923 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7fe87005da40 con 0x7fe878145980 2024-04-26T21:59:21.851 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:21.851 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1319361701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1319361701},{"type":"v1","addr":"172.21.15.170:6833","nonce":1319361701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3941293249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3941293249},{"type":"v1","addr":"172.21.15.137:6837","nonce":3941293249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:58:40.598750+0000","modified":"2024-04-26T21:58:42.690405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/268686042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":268686042},{"type":"v1","addr":"172.21.15.170:6835","nonce":268686042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-26T21:59:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 7 2024-04-26T21:59:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85806c8f0 msgr2=0x7fe85806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85806c8f0 0x7fe85806edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe868009aa0 tx=0x7fe868009190 comp rx=0 tx=0).stop 2024-04-26T21:59:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe878145980 msgr2=0x7fe878140350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe878145980 0x7fe878140350 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c7a0 tx=0x7fe87000cc60 comp rx=0 tx=0).stop 2024-04-26T21:59:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 shutdown_connections 2024-04-26T21:59:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85806c8f0 0x7fe85806edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe878145980 0x7fe878140350 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8780b5fd0 0x7fe87815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 --2- 172.21.15.137:0/1807392923 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8780b3de0 0x7fe87813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 >> 172.21.15.137:0/1807392923 conn(0x7fe8780d0d30 msgr2=0x7fe8780b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:21.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 shutdown_connections 2024-04-26T21:59:21.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.852+0000 7fe87cc1d640 1 -- 172.21.15.137:0/1807392923 wait complete. 2024-04-26T21:59:21.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:21.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.962+0000 7f001921d640 1 Processor -- start 2024-04-26T21:59:21.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.962+0000 7f001921d640 1 -- start start 2024-04-26T21:59:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.962+0000 7f001921d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001415b4e0 0x7f0014071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.962+0000 7f001921d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f001406f2c0 0x7f00140cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.962+0000 7f001921d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00140733e0 con 0x7f001415b8c0 2024-04-26T21:59:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.962+0000 7f001921d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f00140ce230 con 0x7f001406f2c0 2024-04-26T21:59:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.962+0000 7f001921d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0014072f00 con 0x7f001415b4e0 2024-04-26T21:59:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.963+0000 7f0012d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001415b4e0 0x7f0014071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.963+0000 7f0012d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001415b4e0 0x7f0014071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:39134/0 (socket says 172.21.15.137:39134) 2024-04-26T21:59:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.963+0000 7f001359e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f001406f2c0 0x7f00140cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.963+0000 7f0012d9d640 1 -- 172.21.15.137:0/50669305 learned_addr learned my addr 172.21.15.137:0/50669305 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.963+0000 7f0012d9d640 1 -- 172.21.15.137:0/50669305 >> v2:172.21.15.170:3300/0 conn(0x7f001406f2c0 msgr2=0x7f00140cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.963+0000 7f0012d9d640 1 --2- 172.21.15.137:0/50669305 >> v2:172.21.15.170:3300/0 conn(0x7f001406f2c0 0x7f00140cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.963+0000 7f0012d9d640 1 -- 172.21.15.137:0/50669305 >> v1:172.21.15.170:6789/0 conn(0x7f001415b8c0 legacy=0x7f001406ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.963+0000 7f0012d9d640 1 -- 172.21.15.137:0/50669305 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0014072660 con 0x7f001415b4e0 2024-04-26T21:59:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.964+0000 7f0012d9d640 1 --2- 172.21.15.137:0/50669305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001415b4e0 0x7f0014071fd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f000c009e50 tx=0x7f000c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=245f109f28fcd391 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.964+0000 7f0011d9b640 1 -- 172.21.15.137:0/50669305 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c036070 con 0x7f001415b4e0 2024-04-26T21:59:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.964+0000 7f0011d9b640 1 -- 172.21.15.137:0/50669305 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c031600 con 0x7f001415b4e0 2024-04-26T21:59:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.964+0000 7f0011d9b640 1 -- 172.21.15.137:0/50669305 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0319d0 con 0x7f001415b4e0 2024-04-26T21:59:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.965+0000 7f001921d640 1 -- 172.21.15.137:0/50669305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001415b4e0 msgr2=0x7f0014071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.965+0000 7f001921d640 1 --2- 172.21.15.137:0/50669305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001415b4e0 0x7f0014071fd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f000c009e50 tx=0x7f000c02a710 comp rx=0 tx=0).stop 2024-04-26T21:59:21.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.965+0000 7f001921d640 1 -- 172.21.15.137:0/50669305 shutdown_connections 2024-04-26T21:59:21.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.965+0000 7f001921d640 1 --2- 172.21.15.137:0/50669305 >> v2:172.21.15.170:3300/0 conn(0x7f001406f2c0 0x7f00140cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.965+0000 7f001921d640 1 --2- 172.21.15.137:0/50669305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001415b4e0 0x7f0014071fd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.965+0000 7f001921d640 1 -- 172.21.15.137:0/50669305 >> 172.21.15.137:0/50669305 conn(0x7f00140d0d30 msgr2=0x7f00140d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:21.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.965+0000 7f001921d640 1 -- 172.21.15.137:0/50669305 shutdown_connections 2024-04-26T21:59:21.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.965+0000 7f001921d640 1 -- 172.21.15.137:0/50669305 wait complete. 2024-04-26T21:59:21.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.966+0000 7f001921d640 1 Processor -- start 2024-04-26T21:59:21.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.966+0000 7f001921d640 1 -- start start 2024-04-26T21:59:21.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001921d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001406f2c0 0x7f0014154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001921d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001415b4e0 0x7f001414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001921d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001415b8c0 0x7f00140b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001921d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f00140b3e80 con 0x7f001415b8c0 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001921d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0014072c20 con 0x7f001415b4e0 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001921d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0014073820 con 0x7f001406f2c0 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001359e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001415b8c0 0x7f00140b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001359e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001415b8c0 0x7f00140b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54422/0 (socket says 172.21.15.137:54422) 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001359e640 1 -- 172.21.15.137:0/3113510257 learned_addr learned my addr 172.21.15.137:0/3113510257 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001259c640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001415b4e0 0x7f001414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f0012d9d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001406f2c0 0x7f0014154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001359e640 1 -- 172.21.15.137:0/3113510257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001406f2c0 msgr2=0x7f0014154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001359e640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001406f2c0 0x7f0014154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001359e640 1 -- 172.21.15.137:0/3113510257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001415b4e0 msgr2=0x7f001414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001359e640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001415b4e0 0x7f001414df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001359e640 1 -- 172.21.15.137:0/3113510257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0014154f60 con 0x7f001415b8c0 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f0012d9d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001406f2c0 0x7f0014154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:21.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.967+0000 7f001359e640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001415b8c0 0x7f00140b13d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0004010b70 tx=0x7f000400e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.968+0000 7f000b7fe640 1 -- 172.21.15.137:0/3113510257 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000401e070 con 0x7f001415b8c0 2024-04-26T21:59:21.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.968+0000 7f000b7fe640 1 -- 172.21.15.137:0/3113510257 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0004011650 con 0x7f001415b8c0 2024-04-26T21:59:21.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.968+0000 7f000b7fe640 1 -- 172.21.15.137:0/3113510257 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004011a40 con 0x7f001415b8c0 2024-04-26T21:59:21.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.968+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001414e470 con 0x7f001415b8c0 2024-04-26T21:59:21.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.968+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0014156e00 con 0x7f001415b8c0 2024-04-26T21:59:21.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.969+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f001406a290 con 0x7f001415b8c0 2024-04-26T21:59:21.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.969+0000 7f000b7fe640 1 -- 172.21.15.137:0/3113510257 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0004021070 con 0x7f001415b8c0 2024-04-26T21:59:21.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.970+0000 7f000b7fe640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efff406c8f0 0x7efff406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:21.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.970+0000 7f000b7fe640 1 -- 172.21.15.137:0/3113510257 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f000408dc10 con 0x7f001415b8c0 2024-04-26T21:59:21.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.970+0000 7f0012d9d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efff406c8f0 0x7efff406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:21.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.970+0000 7f0012d9d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efff406c8f0 0x7efff406edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f000c033000 tx=0x7f000c009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:21.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:21.974+0000 7f000b7fe640 1 -- 172.21.15.137:0/3113510257 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f001414e470 con 0x7f001415b8c0 2024-04-26T21:59:22.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.148+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00140cfaf0 con 0x7f001415b8c0 2024-04-26T21:59:22.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.149+0000 7f000b7fe640 1 -- 172.21.15.137:0/3113510257 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16867 (secure 0 0 0) 0x7f000405ba00 con 0x7f001415b8c0 2024-04-26T21:59:22.149 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:22.149 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:21.609430+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:22.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efff406c8f0 msgr2=0x7efff406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efff406c8f0 0x7efff406edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f000c033000 tx=0x7f000c009000 comp rx=0 tx=0).stop 2024-04-26T21:59:22.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001415b8c0 msgr2=0x7f00140b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001415b8c0 0x7f00140b13d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0004010b70 tx=0x7f000400e730 comp rx=0 tx=0).stop 2024-04-26T21:59:22.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 shutdown_connections 2024-04-26T21:59:22.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efff406c8f0 0x7efff406edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f001415b8c0 0x7f00140b13d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f001415b4e0 0x7f001414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 --2- 172.21.15.137:0/3113510257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f001406f2c0 0x7f0014154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 >> 172.21.15.137:0/3113510257 conn(0x7f00140d0d30 msgr2=0x7f0014151860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:22.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 shutdown_connections 2024-04-26T21:59:22.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.151+0000 7f001921d640 1 -- 172.21.15.137:0/3113510257 wait complete. 2024-04-26T21:59:22.162 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T21:59:22.163 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:22.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.259+0000 7f7e84e86640 1 Processor -- start 2024-04-26T21:59:22.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.259+0000 7f7e84e86640 1 -- start start 2024-04-26T21:59:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.260+0000 7f7e84e86640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e80145980 0x7f7e80160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.260+0000 7f7e84e86640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7e800b3de0 0x7f7e800b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.260+0000 7f7e84e86640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e800b4260 con 0x7f7e800b5fd0 2024-04-26T21:59:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.260+0000 7f7e84e86640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7e800b6440 con 0x7f7e800b3de0 2024-04-26T21:59:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.260+0000 7f7e84e86640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7e800b5140 con 0x7f7e80145980 2024-04-26T21:59:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.261+0000 7f7e7e59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e80145980 0x7f7e80160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.261+0000 7f7e7dd9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7e800b3de0 0x7f7e800b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.261+0000 7f7e7e59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e80145980 0x7f7e80160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:39150/0 (socket says 172.21.15.137:39150) 2024-04-26T21:59:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.261+0000 7f7e7e59c640 1 -- 172.21.15.137:0/4048346275 learned_addr learned my addr 172.21.15.137:0/4048346275 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.261+0000 7f7e7e59c640 1 -- 172.21.15.137:0/4048346275 >> v2:172.21.15.170:3300/0 conn(0x7f7e800b3de0 msgr2=0x7f7e800b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.261+0000 7f7e7e59c640 1 --2- 172.21.15.137:0/4048346275 >> v2:172.21.15.170:3300/0 conn(0x7f7e800b3de0 0x7f7e800b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.261+0000 7f7e7e59c640 1 -- 172.21.15.137:0/4048346275 >> v1:172.21.15.170:6789/0 conn(0x7f7e800b5fd0 legacy=0x7f7e8015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.261+0000 7f7e7e59c640 1 -- 172.21.15.137:0/4048346275 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e800b4530 con 0x7f7e80145980 2024-04-26T21:59:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.262+0000 7f7e7e59c640 1 --2- 172.21.15.137:0/4048346275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e80145980 0x7f7e80160630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009870 tx=0x7f7e7002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=533832b5d0332692 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.262+0000 7f7e7d59a640 1 -- 172.21.15.137:0/4048346275 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70037070 con 0x7f7e80145980 2024-04-26T21:59:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.262+0000 7f7e7d59a640 1 -- 172.21.15.137:0/4048346275 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e70032440 con 0x7f7e80145980 2024-04-26T21:59:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.262+0000 7f7e7d59a640 1 -- 172.21.15.137:0/4048346275 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70032810 con 0x7f7e80145980 2024-04-26T21:59:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.263+0000 7f7e84e86640 1 -- 172.21.15.137:0/4048346275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e80145980 msgr2=0x7f7e80160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.263+0000 7f7e84e86640 1 --2- 172.21.15.137:0/4048346275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e80145980 0x7f7e80160630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009870 tx=0x7f7e7002a1c0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.263+0000 7f7e84e86640 1 -- 172.21.15.137:0/4048346275 shutdown_connections 2024-04-26T21:59:22.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.263+0000 7f7e84e86640 1 --2- 172.21.15.137:0/4048346275 >> v2:172.21.15.170:3300/0 conn(0x7f7e800b3de0 0x7f7e800b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.263+0000 7f7e84e86640 1 --2- 172.21.15.137:0/4048346275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e80145980 0x7f7e80160630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.263+0000 7f7e84e86640 1 -- 172.21.15.137:0/4048346275 >> 172.21.15.137:0/4048346275 conn(0x7f7e800d0d30 msgr2=0x7f7e800d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:22.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.263+0000 7f7e84e86640 1 -- 172.21.15.137:0/4048346275 shutdown_connections 2024-04-26T21:59:22.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.263+0000 7f7e84e86640 1 -- 172.21.15.137:0/4048346275 wait complete. 2024-04-26T21:59:22.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.264+0000 7f7e84e86640 1 Processor -- start 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.264+0000 7f7e84e86640 1 -- start start 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e84e86640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e800b3de0 0x7f7e8013d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e84e86640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e800b5fd0 0x7f7e8015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e84e86640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e80145980 0x7f7e80139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e84e86640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7e800b4dd0 con 0x7f7e800b3de0 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e84e86640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7e800b4af0 con 0x7f7e80145980 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e84e86640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7e800730e0 con 0x7f7e800b5fd0 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e800b3de0 0x7f7e8013d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e800b3de0 0x7f7e8013d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54438/0 (socket says 172.21.15.137:54438) 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7e59c640 1 -- 172.21.15.137:0/979287561 learned_addr learned my addr 172.21.15.137:0/979287561 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7dd9b640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e800b5fd0 0x7f7e8015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7ed9d640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e80145980 0x7f7e80139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7e59c640 1 -- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e800b5fd0 msgr2=0x7f7e8015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7e59c640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e800b5fd0 0x7f7e8015b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7e59c640 1 -- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e80145980 msgr2=0x7f7e80139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7e59c640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e80145980 0x7f7e80139d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7e59c640 1 -- 172.21.15.137:0/979287561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e800ce6f0 con 0x7f7e800b3de0 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7dd9b640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e800b5fd0 0x7f7e8015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7ed9d640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e80145980 0x7f7e80139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.265+0000 7f7e7e59c640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e800b3de0 0x7f7e8013d300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000c00 tx=0x7f7e700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.266+0000 7f7e6effd640 1 -- 172.21.15.137:0/979287561 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70037040 con 0x7f7e800b3de0 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.266+0000 7f7e6effd640 1 -- 172.21.15.137:0/979287561 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e70042070 con 0x7f7e800b3de0 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.266+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8013ab70 con 0x7f7e800b3de0 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.266+0000 7f7e6effd640 1 -- 172.21.15.137:0/979287561 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70030880 con 0x7f7e800b3de0 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.266+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8013a890 con 0x7f7e800b3de0 2024-04-26T21:59:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.267+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8006a290 con 0x7f7e800b3de0 2024-04-26T21:59:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.267+0000 7f7e6effd640 1 -- 172.21.15.137:0/979287561 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e7002ad10 con 0x7f7e800b3de0 2024-04-26T21:59:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.268+0000 7f7e6effd640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e6006c8f0 0x7f7e6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.268+0000 7f7e7dd9b640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e6006c8f0 0x7f7e6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.268+0000 7f7e6effd640 1 -- 172.21.15.137:0/979287561 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f7e700ac0e0 con 0x7f7e800b3de0 2024-04-26T21:59:22.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.268+0000 7f7e7dd9b640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e6006c8f0 0x7f7e6006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400d2c0 tx=0x7f7e74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:22.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.272+0000 7f7e6effd640 1 -- 172.21.15.137:0/979287561 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7e7007a520 con 0x7f7e800b3de0 2024-04-26T21:59:22.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.484+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e80073cc0 con 0x7f7e800b3de0 2024-04-26T21:59:22.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.485+0000 7f7e6effd640 1 -- 172.21.15.137:0/979287561 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f7e70079e20 con 0x7f7e800b3de0 2024-04-26T21:59:22.485 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:22.485 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1319361701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1319361701},{"type":"v1","addr":"172.21.15.170:6833","nonce":1319361701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3941293249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3941293249},{"type":"v1","addr":"172.21.15.137:6837","nonce":3941293249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:58:40.598750+0000","modified":"2024-04-26T21:58:42.690405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/268686042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":268686042},{"type":"v1","addr":"172.21.15.170:6835","nonce":268686042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-26T21:59:22.485 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 7 2024-04-26T21:59:22.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e6006c8f0 msgr2=0x7f7e6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e6006c8f0 0x7f7e6006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400d2c0 tx=0x7f7e74008040 comp rx=0 tx=0).stop 2024-04-26T21:59:22.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e800b3de0 msgr2=0x7f7e8013d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e800b3de0 0x7f7e8013d300 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000c00 tx=0x7f7e700046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 shutdown_connections 2024-04-26T21:59:22.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e6006c8f0 0x7f7e6006edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e80145980 0x7f7e80139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e800b5fd0 0x7f7e8015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 --2- 172.21.15.137:0/979287561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e800b3de0 0x7f7e8013d300 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 >> 172.21.15.137:0/979287561 conn(0x7f7e800d0d30 msgr2=0x7f7e80143e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:22.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 shutdown_connections 2024-04-26T21:59:22.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.487+0000 7f7e84e86640 1 -- 172.21.15.137:0/979287561 wait complete. 2024-04-26T21:59:22.498 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:22.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.595+0000 7f35b7f0a640 1 Processor -- start 2024-04-26T21:59:22.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.595+0000 7f35b7f0a640 1 -- start start 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b7f0a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f35b015d380 0x7f35b00ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b7f0a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b00d0be0 con 0x7f35b0160d50 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b7f0a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b00d0ec0 con 0x7f35b00b56d0 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b7f0a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f35b00d11a0 con 0x7f35b015d380 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b5ca6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f35b015d380 0x7f35b00ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b5ca6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f35b015d380 0x7f35b00ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54454/0 (socket says 172.21.15.137:54454) 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b64a7640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f35b0160d50 0x7f35b00b5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50114/0 (socket says 172.21.15.137:50114) 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b5ca6640 1 -- 172.21.15.137:0/819338099 learned_addr learned my addr 172.21.15.137:0/819338099 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b5ca6640 1 -- 172.21.15.137:0/819338099 >> v1:172.21.15.170:6789/0 conn(0x7f35b00b56d0 legacy=0x7f35b00d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b5ca6640 1 -- 172.21.15.137:0/819338099 >> v1:172.21.15.137:6789/0 conn(0x7f35b0160d50 legacy=0x7f35b00b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.597+0000 7f35b5ca6640 1 -- 172.21.15.137:0/819338099 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b00d1480 con 0x7f35b015d380 2024-04-26T21:59:22.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.596+0000 7f35b4ca4640 1 -- 172.21.15.137:0/819338099 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360995365 0 0) 0x7f35b00d0be0 con 0x7f35b0160d50 2024-04-26T21:59:22.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.597+0000 7f35b5ca6640 1 --2- 172.21.15.137:0/819338099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b015d380 0x7f35b00ce590 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009870 tx=0x7f35ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42374166ea71a5a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:22.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.597+0000 7f35b4ca4640 1 -- 172.21.15.137:0/819338099 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac037070 con 0x7f35b015d380 2024-04-26T21:59:22.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.597+0000 7f35b4ca4640 1 -- 172.21.15.137:0/819338099 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ac032440 con 0x7f35b015d380 2024-04-26T21:59:22.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.597+0000 7f35b4ca4640 1 -- 172.21.15.137:0/819338099 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac032810 con 0x7f35b015d380 2024-04-26T21:59:22.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.598+0000 7f35b7f0a640 1 -- 172.21.15.137:0/819338099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b015d380 msgr2=0x7f35b00ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.598+0000 7f35b7f0a640 1 --2- 172.21.15.137:0/819338099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b015d380 0x7f35b00ce590 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009870 tx=0x7f35ac02a270 comp rx=0 tx=0).stop 2024-04-26T21:59:22.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.598+0000 7f35b7f0a640 1 -- 172.21.15.137:0/819338099 shutdown_connections 2024-04-26T21:59:22.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.598+0000 7f35b7f0a640 1 --2- 172.21.15.137:0/819338099 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b015d380 0x7f35b00ce590 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.598+0000 7f35b7f0a640 1 -- 172.21.15.137:0/819338099 >> 172.21.15.137:0/819338099 conn(0x7f35b00b4a60 msgr2=0x7f35b00b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:22.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.598+0000 7f35b7f0a640 1 -- 172.21.15.137:0/819338099 shutdown_connections 2024-04-26T21:59:22.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.598+0000 7f35b7f0a640 1 -- 172.21.15.137:0/819338099 wait complete. 2024-04-26T21:59:22.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.599+0000 7f35b7f0a640 1 Processor -- start 2024-04-26T21:59:22.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.599+0000 7f35b7f0a640 1 -- start start 2024-04-26T21:59:22.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b7f0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b00b56d0 0x7f35b00c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b7f0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35b015d380 0x7f35b0160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b7f0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b0160d50 0x7f35b00cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b7f0a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f35b00b64d0 con 0x7f35b0160d50 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b7f0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f35b00cedc0 con 0x7f35b00b56d0 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b7f0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f35b00b6650 con 0x7f35b015d380 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b64a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b0160d50 0x7f35b00cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b64a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b0160d50 0x7f35b00cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54456/0 (socket says 172.21.15.137:54456) 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b64a7640 1 -- 172.21.15.137:0/1558016164 learned_addr learned my addr 172.21.15.137:0/1558016164 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b64a7640 1 -- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35b015d380 msgr2=0x7f35b0160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b54a5640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35b015d380 0x7f35b0160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b5ca6640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b00b56d0 0x7f35b00c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b64a7640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35b015d380 0x7f35b0160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b64a7640 1 -- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b00b56d0 msgr2=0x7f35b00c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b64a7640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b00b56d0 0x7f35b00c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b64a7640 1 -- 172.21.15.137:0/1558016164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b00c9400 con 0x7f35b0160d50 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b54a5640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35b015d380 0x7f35b0160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b5ca6640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b00b56d0 0x7f35b00c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.600+0000 7f35b64a7640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b0160d50 0x7f35b00cbc00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f35a800c700 tx=0x7f35a800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.601+0000 7f35a67fc640 1 -- 172.21.15.137:0/1558016164 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a8018070 con 0x7f35b0160d50 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.601+0000 7f35a67fc640 1 -- 172.21.15.137:0/1558016164 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a800ce10 con 0x7f35b0160d50 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.601+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b01f6dc0 con 0x7f35b0160d50 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.601+0000 7f35a67fc640 1 -- 172.21.15.137:0/1558016164 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a800a880 con 0x7f35b0160d50 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.601+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b00c8e40 con 0x7f35b0160d50 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.602+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b006a290 con 0x7f35b0160d50 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.602+0000 7f35a67fc640 1 -- 172.21.15.137:0/1558016164 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35a801b070 con 0x7f35b0160d50 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.602+0000 7f35a67fc640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f359406c8f0 0x7f359406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.602+0000 7f35a67fc640 1 -- 172.21.15.137:0/1558016164 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7f35a808b0f0 con 0x7f35b0160d50 2024-04-26T21:59:22.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.602+0000 7f35b5ca6640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f359406c8f0 0x7f359406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.603+0000 7f35b5ca6640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f359406c8f0 0x7f359406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f35ac034000 tx=0x7f35ac02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:22.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.607+0000 7f35a67fc640 1 -- 172.21.15.137:0/1558016164 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f35a80594a0 con 0x7f35b0160d50 2024-04-26T21:59:22.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.823+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35b0072160 con 0x7f35b0160d50 2024-04-26T21:59:22.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.823+0000 7f35a67fc640 1 -- 172.21.15.137:0/1558016164 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5184 (secure 0 0 0) 0x7f35a8058da0 con 0x7f35b0160d50 2024-04-26T21:59:22.823 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:22.823 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/1319361701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1319361701},{"type":"v1","addr":"172.21.15.170:6833","nonce":1319361701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3688475564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3688475564},{"type":"v1","addr":"172.21.15.137:6836","nonce":3688475564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3941293249","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3941293249},{"type":"v1","addr":"172.21.15.137:6837","nonce":3941293249}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:58:40.598750+0000","modified":"2024-04-26T21:58:42.690405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4305},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4305":{"gid":4305,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/268686042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":268686042},{"type":"v1","addr":"172.21.15.170:6835","nonce":268686042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4305,"qdb_cluster":[4305]},"id":1}]} 2024-04-26T21:59:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 7 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f359406c8f0 msgr2=0x7f359406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f359406c8f0 0x7f359406edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f35ac034000 tx=0x7f35ac02e000 comp rx=0 tx=0).stop 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b0160d50 msgr2=0x7f35b00cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b0160d50 0x7f35b00cbc00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f35a800c700 tx=0x7f35a800cbc0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 shutdown_connections 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f359406c8f0 0x7f359406edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f35b0160d50 0x7f35b00cbc00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f35b015d380 0x7f35b0160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 --2- 172.21.15.137:0/1558016164 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35b00b56d0 0x7f35b00c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 >> 172.21.15.137:0/1558016164 conn(0x7f35b00b4a60 msgr2=0x7f35b015bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:22.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 shutdown_connections 2024-04-26T21:59:22.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.825+0000 7f35b7f0a640 1 -- 172.21.15.137:0/1558016164 wait complete. 2024-04-26T21:59:22.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:22.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.933+0000 7f641c124640 1 Processor -- start 2024-04-26T21:59:22.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.934+0000 7f641c124640 1 -- start start 2024-04-26T21:59:22.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.934+0000 7f641c124640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140afe30 0x7f641416a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.934+0000 7f641c124640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64140aed90 con 0x7f64140b47d0 2024-04-26T21:59:22.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.934+0000 7f641c124640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64140af070 con 0x7f641415f4a0 2024-04-26T21:59:22.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.934+0000 7f641c124640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f641415f880 con 0x7f64140afe30 2024-04-26T21:59:22.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.934+0000 7f64196bf640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f64140b47d0 0x7f64140b0470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50118/0 (socket says 172.21.15.137:50118) 2024-04-26T21:59:22.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.934+0000 7f64196bf640 1 -- 172.21.15.137:0/3773788709 learned_addr learned my addr 172.21.15.137:0/3773788709 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:22.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f641a6c1640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140afe30 0x7f641416a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428002191 0 0) 0x7f64140aed90 con 0x7f64140b47d0 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6400003520 con 0x7f64140b47d0 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244332848 0 0) 0x7f64140af070 con 0x7f641415f4a0 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64140aed90 con 0x7f641415f4a0 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3717306632 0 0) 0x7f6400003520 con 0x7f64140b47d0 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140afe30 msgr2=0x7f641416a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140afe30 0x7f641416a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 >> v1:172.21.15.170:6789/0 conn(0x7f641415f4a0 legacy=0x7f64140b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64140af350 con 0x7f64140b47d0 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6410001670 con 0x7f64140b47d0 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 >> v1:172.21.15.137:6789/0 conn(0x7f64140b47d0 legacy=0x7f64140b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6400003b70 0x7f6400003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f6400004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140afe30 0x7f64000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f641415f880 con 0x7f6400004800 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f640000baa0 con 0x7f6400003b70 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f640000bca0 con 0x7f64140afe30 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f64196bf640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f6400004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f6419ec0640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6400003b70 0x7f6400003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f641a6c1640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140afe30 0x7f64000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f64196bf640 1 -- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140afe30 msgr2=0x7f64000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f64196bf640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140afe30 0x7f64000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f64196bf640 1 -- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6400003b70 msgr2=0x7f6400003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f64196bf640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6400003b70 0x7f6400003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.935+0000 7f64196bf640 1 -- 172.21.15.137:0/3773788709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6400003520 con 0x7f6400004800 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.936+0000 7f64196bf640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f6400004c80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6410007fc0 tx=0x7f6400005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f1b9fd120f99c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.936+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410007be0 con 0x7f6400004800 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.936+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6410005af0 con 0x7f6400004800 2024-04-26T21:59:22.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.936+0000 7f6418ebe640 1 -- 172.21.15.137:0/3773788709 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410007070 con 0x7f6400004800 2024-04-26T21:59:22.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.937+0000 7f641c124640 1 -- 172.21.15.137:0/3773788709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 msgr2=0x7f6400004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.937+0000 7f641c124640 1 --2- 172.21.15.137:0/3773788709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f6400004c80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6410007fc0 tx=0x7f6400005830 comp rx=0 tx=0).stop 2024-04-26T21:59:22.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.937+0000 7f641a6c1640 1 -- 172.21.15.137:0/3773788709 reap_dead start 2024-04-26T21:59:22.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.937+0000 7f641c124640 1 -- 172.21.15.137:0/3773788709 shutdown_connections 2024-04-26T21:59:22.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.937+0000 7f641c124640 1 -- 172.21.15.137:0/3773788709 >> 172.21.15.137:0/3773788709 conn(0x7f64140b6800 msgr2=0x7f64140738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:22.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.937+0000 7f641c124640 1 -- 172.21.15.137:0/3773788709 shutdown_connections 2024-04-26T21:59:22.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.937+0000 7f641c124640 1 -- 172.21.15.137:0/3773788709 wait complete. 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.938+0000 7f641c124640 1 Processor -- start 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.938+0000 7f641c124640 1 -- start start 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641c124640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f641415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641c124640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f641415a030 0x7f641409e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641c124640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64141500f0 0x7f6414150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641c124640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f64140aea80 con 0x7f6400004800 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641c124640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f64140af9a0 con 0x7f641415a030 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641c124640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f64140b6320 con 0x7f64141500f0 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f6419ec0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f641415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f6419ec0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f641415cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54466/0 (socket says 172.21.15.137:54466) 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f6419ec0640 1 -- 172.21.15.137:0/2347430535 learned_addr learned my addr 172.21.15.137:0/2347430535 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f64196bf640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f641415a030 0x7f641409e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641a6c1640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64141500f0 0x7f6414150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f6419ec0640 1 -- 172.21.15.137:0/2347430535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64141500f0 msgr2=0x7f6414150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f6419ec0640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64141500f0 0x7f6414150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f6419ec0640 1 -- 172.21.15.137:0/2347430535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f641415a030 msgr2=0x7f641409e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f6419ec0640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f641415a030 0x7f641409e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f6419ec0640 1 -- 172.21.15.137:0/2347430535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641415d5d0 con 0x7f6400004800 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641a6c1640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64141500f0 0x7f6414150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f6419ec0640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f641415cda0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f640800f7a0 tx=0x7f640800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f64067fc640 1 -- 172.21.15.137:0/2347430535 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640801a070 con 0x7f6400004800 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f64067fc640 1 -- 172.21.15.137:0/2347430535 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f640800fe50 con 0x7f6400004800 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f64067fc640 1 -- 172.21.15.137:0/2347430535 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408007050 con 0x7f6400004800 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641415d8b0 con 0x7f6400004800 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.939+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641409bf50 con 0x7f6400004800 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.940+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64140b16e0 con 0x7f6400004800 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.941+0000 7f64067fc640 1 -- 172.21.15.137:0/2347430535 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f640801d070 con 0x7f6400004800 2024-04-26T21:59:22.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.941+0000 7f64067fc640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c920 0x7f63f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:22.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.941+0000 7f64196bf640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c920 0x7f63f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:22.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.941+0000 7f64067fc640 1 -- 172.21.15.137:0/2347430535 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f640808b360 con 0x7f6400004800 2024-04-26T21:59:22.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.942+0000 7f64196bf640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c920 0x7f63f806ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6410032000 tx=0x7f6410034040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:22.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:22.946+0000 7f64067fc640 1 -- 172.21.15.137:0/2347430535 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f64140b16e0 con 0x7f6400004800 2024-04-26T21:59:23.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.122+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f641409bd40 con 0x7f6400004800 2024-04-26T21:59:23.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.123+0000 7f64067fc640 1 -- 172.21.15.137:0/2347430535 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16867 (secure 0 0 0) 0x7f64080590c0 con 0x7f6400004800 2024-04-26T21:59:23.124 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:23.124 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":23,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:22.613820+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:58:38.629082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T21:58:39.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c920 msgr2=0x7f63f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c920 0x7f63f806ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6410032000 tx=0x7f6410034040 comp rx=0 tx=0).stop 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 msgr2=0x7f641415cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f641415cda0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f640800f7a0 tx=0x7f640800fc60 comp rx=0 tx=0).stop 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 shutdown_connections 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c920 0x7f63f806ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64141500f0 0x7f6414150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f641415a030 0x7f641409e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 --2- 172.21.15.137:0/2347430535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6400004800 0x7f641415cda0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.125+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 >> 172.21.15.137:0/2347430535 conn(0x7f64140b6800 msgr2=0x7f6414162f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.126+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 shutdown_connections 2024-04-26T21:59:23.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.126+0000 7f641c124640 1 -- 172.21.15.137:0/2347430535 wait complete. 2024-04-26T21:59:23.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T21:59:23.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.236+0000 7f68fa072640 1 Processor -- start 2024-04-26T21:59:23.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.236+0000 7f68fa072640 1 -- start start 2024-04-26T21:59:23.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.236+0000 7f68fa072640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f4145980 0x7f68f4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.236+0000 7f68fa072640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f68f40b3de0 0x7f68f40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.236+0000 7f68fa072640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f40b4260 con 0x7f68f40b5fd0 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.236+0000 7f68fa072640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f68f40b6440 con 0x7f68f40b3de0 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.236+0000 7f68fa072640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f68f40b5140 con 0x7f68f4145980 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.237+0000 7f68f2ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f68f40b3de0 0x7f68f40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.237+0000 7f68f3fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f68f40b5fd0 0x7f68f415c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50126/0 (socket says 172.21.15.137:50126) 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.237+0000 7f68f3fff640 1 -- 172.21.15.137:0/643229172 learned_addr learned my addr 172.21.15.137:0/643229172 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.237+0000 7f68f37fe640 1 --2- 172.21.15.137:0/643229172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f4145980 0x7f68f4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.237+0000 7f68f2ffd640 1 -- 172.21.15.137:0/643229172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f4145980 msgr2=0x7f68f4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.237+0000 7f68f2ffd640 1 --2- 172.21.15.137:0/643229172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f4145980 0x7f68f4160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.237+0000 7f68f2ffd640 1 -- 172.21.15.137:0/643229172 >> v1:172.21.15.137:6789/0 conn(0x7f68f40b5fd0 legacy=0x7f68f415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.237+0000 7f68f27fc640 1 -- 172.21.15.137:0/643229172 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621841255 0 0) 0x7f68f40b4260 con 0x7f68f40b5fd0 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.237+0000 7f68f2ffd640 1 -- 172.21.15.137:0/643229172 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f40b4530 con 0x7f68f40b3de0 2024-04-26T21:59:23.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68f2ffd640 1 --2- 172.21.15.137:0/643229172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f40b3de0 0x7f68f40b5a90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009d90 tx=0x7f68e802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb8af602322dda0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:23.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68f27fc640 1 -- 172.21.15.137:0/643229172 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8031600 con 0x7f68f40b3de0 2024-04-26T21:59:23.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68f27fc640 1 -- 172.21.15.137:0/643229172 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e80317a0 con 0x7f68f40b3de0 2024-04-26T21:59:23.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68f27fc640 1 -- 172.21.15.137:0/643229172 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8031b70 con 0x7f68f40b3de0 2024-04-26T21:59:23.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68fa072640 1 -- 172.21.15.137:0/643229172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f40b3de0 msgr2=0x7f68f40b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68fa072640 1 --2- 172.21.15.137:0/643229172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f40b3de0 0x7f68f40b5a90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009d90 tx=0x7f68e802a5d0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68fa072640 1 -- 172.21.15.137:0/643229172 shutdown_connections 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68fa072640 1 --2- 172.21.15.137:0/643229172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f40b3de0 0x7f68f40b5a90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68fa072640 1 --2- 172.21.15.137:0/643229172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f4145980 0x7f68f4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68fa072640 1 -- 172.21.15.137:0/643229172 >> 172.21.15.137:0/643229172 conn(0x7f68f40d0d30 msgr2=0x7f68f40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68fa072640 1 -- 172.21.15.137:0/643229172 shutdown_connections 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.238+0000 7f68fa072640 1 -- 172.21.15.137:0/643229172 wait complete. 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.239+0000 7f68fa072640 1 Processor -- start 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68fa072640 1 -- start start 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68fa072640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68f40b3de0 0x7f68f415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68fa072640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f40b5fd0 0x7f68f413e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68fa072640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f4145980 0x7f68f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68fa072640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40b4dd0 con 0x7f68f4145980 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68fa072640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40b4af0 con 0x7f68f40b3de0 2024-04-26T21:59:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68fa072640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f68f40730e0 con 0x7f68f40b5fd0 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f4145980 0x7f68f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f4145980 0x7f68f406ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54486/0 (socket says 172.21.15.137:54486) 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68f3fff640 1 -- 172.21.15.137:0/4147725641 learned_addr learned my addr 172.21.15.137:0/4147725641 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68f2ffd640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f40b5fd0 0x7f68f413e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.240+0000 7f68f37fe640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68f40b3de0 0x7f68f415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68f3fff640 1 -- 172.21.15.137:0/4147725641 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f40b5fd0 msgr2=0x7f68f413e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68f3fff640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f40b5fd0 0x7f68f413e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68f3fff640 1 -- 172.21.15.137:0/4147725641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68f40b3de0 msgr2=0x7f68f415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68f3fff640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68f40b3de0 0x7f68f415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68f3fff640 1 -- 172.21.15.137:0/4147725641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f40af290 con 0x7f68f4145980 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68f3fff640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f4145980 0x7f68f406ede0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c480 tx=0x7f68ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68dbfff640 1 -- 172.21.15.137:0/4147725641 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec017070 con 0x7f68f4145980 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68dbfff640 1 -- 172.21.15.137:0/4147725641 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec005d00 con 0x7f68f4145980 2024-04-26T21:59:23.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68dbfff640 1 -- 172.21.15.137:0/4147725641 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0072b0 con 0x7f68f4145980 2024-04-26T21:59:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f40af570 con 0x7f68f4145980 2024-04-26T21:59:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.241+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f40afb30 con 0x7f68f4145980 2024-04-26T21:59:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.242+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f4140080 con 0x7f68f4145980 2024-04-26T21:59:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.242+0000 7f68dbfff640 1 -- 172.21.15.137:0/4147725641 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f68ec01a070 con 0x7f68f4145980 2024-04-26T21:59:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.243+0000 7f68dbfff640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f68e006c8f0 0x7f68e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.243+0000 7f68dbfff640 1 -- 172.21.15.137:0/4147725641 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f68ec08ae70 con 0x7f68f4145980 2024-04-26T21:59:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.243+0000 7f68f37fe640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f68e006c8f0 0x7f68e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.243+0000 7f68f37fe640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f68e006c8f0 0x7f68e006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68f406f9d0 tx=0x7f68e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.247+0000 7f68dbfff640 1 -- 172.21.15.137:0/4147725641 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f68ec058c60 con 0x7f68f4145980 2024-04-26T21:59:23.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.462+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f68f406a290 con 0x7f68f4145980 2024-04-26T21:59:23.462 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T21:59:23.462+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T21:59:23.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.464+0000 7f68dbfff640 1 -- 172.21.15.137:0/4147725641 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f68ec05cf60 con 0x7f68f4145980 2024-04-26T21:59:23.464 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T21:59:23.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f68e006c8f0 msgr2=0x7f68e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f68e006c8f0 0x7f68e006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68f406f9d0 tx=0x7f68e4008040 comp rx=0 tx=0).stop 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f4145980 msgr2=0x7f68f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f4145980 0x7f68f406ede0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c480 tx=0x7f68ec00c940 comp rx=0 tx=0).stop 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 shutdown_connections 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f68e006c8f0 0x7f68e006edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68f4145980 0x7f68f406ede0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68f40b5fd0 0x7f68f413e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 --2- 172.21.15.137:0/4147725641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68f40b3de0 0x7f68f415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 >> 172.21.15.137:0/4147725641 conn(0x7f68f40d0d30 msgr2=0x7f68f40b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 shutdown_connections 2024-04-26T21:59:23.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.466+0000 7f68fa072640 1 -- 172.21.15.137:0/4147725641 wait complete. 2024-04-26T21:59:23.470 INFO:tasks.ceph.mds.b.smithi170.stderr: -7458> 2024-04-26T21:58:46.233+0000 7fad03c24640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:59:23.478 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T21:59:23.502 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T21:59:23.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.577+0000 7fda0a86d640 1 Processor -- start 2024-04-26T21:59:23.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.577+0000 7fda0a86d640 1 -- start start 2024-04-26T21:59:23.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda0a86d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fda04160950 0x7fda040cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda0a86d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda040cf430 0x7fda040cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda0a86d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda040d07e0 con 0x7fda040b1ef0 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda0a86d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fda040cf040 con 0x7fda040cf430 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda0a86d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fda040d2090 con 0x7fda04160950 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda08e0a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda040cf430 0x7fda040cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda037fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fda040b1ef0 0x7fda04161080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50142/0 (socket says 172.21.15.137:50142) 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda037fe640 1 -- 172.21.15.137:0/1001921779 learned_addr learned my addr 172.21.15.137:0/1001921779 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda08e0a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda040cf430 0x7fda040cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54494/0 (socket says 172.21.15.137:54494) 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda03fff640 1 --2- 172.21.15.137:0/1001921779 >> v2:172.21.15.170:3300/0 conn(0x7fda04160950 0x7fda040cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda08e0a640 1 -- 172.21.15.137:0/1001921779 >> v2:172.21.15.170:3300/0 conn(0x7fda04160950 msgr2=0x7fda040cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda08e0a640 1 --2- 172.21.15.137:0/1001921779 >> v2:172.21.15.170:3300/0 conn(0x7fda04160950 0x7fda040cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda08e0a640 1 -- 172.21.15.137:0/1001921779 >> v1:172.21.15.137:6789/0 conn(0x7fda040b1ef0 legacy=0x7fda04161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda08e0a640 1 -- 172.21.15.137:0/1001921779 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0409c700 con 0x7fda040cf430 2024-04-26T21:59:23.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.578+0000 7fda03fff640 1 --2- 172.21.15.137:0/1001921779 >> v2:172.21.15.170:3300/0 conn(0x7fda04160950 0x7fda040cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:23.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.579+0000 7fda08e0a640 1 --2- 172.21.15.137:0/1001921779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 0x7fda040cfec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fda040d2ef0 tx=0x7fd9fc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a91b1af5c0ada32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:23.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.579+0000 7fda02ffd640 1 -- 172.21.15.137:0/1001921779 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc007740 con 0x7fda040cf430 2024-04-26T21:59:23.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.579+0000 7fda02ffd640 1 -- 172.21.15.137:0/1001921779 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc0078e0 con 0x7fda040cf430 2024-04-26T21:59:23.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.579+0000 7fda02ffd640 1 -- 172.21.15.137:0/1001921779 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc007cb0 con 0x7fda040cf430 2024-04-26T21:59:23.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.580+0000 7fda0a86d640 1 -- 172.21.15.137:0/1001921779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 msgr2=0x7fda040cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.580+0000 7fda0a86d640 1 --2- 172.21.15.137:0/1001921779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 0x7fda040cfec0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fda040d2ef0 tx=0x7fd9fc02a680 comp rx=0 tx=0).stop 2024-04-26T21:59:23.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.580+0000 7fda0a86d640 1 -- 172.21.15.137:0/1001921779 shutdown_connections 2024-04-26T21:59:23.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.580+0000 7fda0a86d640 1 --2- 172.21.15.137:0/1001921779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 0x7fda040cfec0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.580+0000 7fda0a86d640 1 --2- 172.21.15.137:0/1001921779 >> v2:172.21.15.170:3300/0 conn(0x7fda04160950 0x7fda040cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.580+0000 7fda0a86d640 1 -- 172.21.15.137:0/1001921779 >> 172.21.15.137:0/1001921779 conn(0x7fda0409ba40 msgr2=0x7fda0409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:23.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.580+0000 7fda0a86d640 1 -- 172.21.15.137:0/1001921779 shutdown_connections 2024-04-26T21:59:23.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.580+0000 7fda0a86d640 1 -- 172.21.15.137:0/1001921779 wait complete. 2024-04-26T21:59:23.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.581+0000 7fda0a86d640 1 Processor -- start 2024-04-26T21:59:23.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.581+0000 7fda0a86d640 1 -- start start 2024-04-26T21:59:23.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda0a86d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda040b1ef0 0x7fda0409d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda0a86d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 0x7fda040a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda0a86d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda04160950 0x7fda040a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda0a86d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fda04160d30 con 0x7fda040cf430 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda0a86d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fda040d1d20 con 0x7fda04160950 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda0a86d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fda040b28f0 con 0x7fda040b1ef0 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda037fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 0x7fda040a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda037fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 0x7fda040a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54508/0 (socket says 172.21.15.137:54508) 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda037fe640 1 -- 172.21.15.137:0/2414427109 learned_addr learned my addr 172.21.15.137:0/2414427109 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda03fff640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda040b1ef0 0x7fda0409d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda08e0a640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda04160950 0x7fda040a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda037fe640 1 -- 172.21.15.137:0/2414427109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda040b1ef0 msgr2=0x7fda0409d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda037fe640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda040b1ef0 0x7fda0409d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda037fe640 1 -- 172.21.15.137:0/2414427109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda04160950 msgr2=0x7fda040a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda037fe640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda04160950 0x7fda040a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:23.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda037fe640 1 -- 172.21.15.137:0/2414427109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0406e150 con 0x7fda040cf430 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda037fe640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 0x7fda040a0370 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c480 tx=0x7fd9f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda00ff9640 1 -- 172.21.15.137:0/2414427109 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8017070 con 0x7fda040cf430 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda00ff9640 1 -- 172.21.15.137:0/2414427109 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f8005ce0 con 0x7fda040cf430 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0406e430 con 0x7fda040cf430 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.582+0000 7fda00ff9640 1 -- 172.21.15.137:0/2414427109 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80072f0 con 0x7fda040cf430 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.583+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0406e9f0 con 0x7fda040cf430 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.584+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda040d2880 con 0x7fda040cf430 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.584+0000 7fda00ff9640 1 -- 172.21.15.137:0/2414427109 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd9f801a070 con 0x7fda040cf430 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.584+0000 7fda00ff9640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd9f006c8f0 0x7fd9f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.585+0000 7fda03fff640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd9f006c8f0 0x7fd9f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:23.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.585+0000 7fda00ff9640 1 -- 172.21.15.137:0/2414427109 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7fd9f808aeb0 con 0x7fda040cf430 2024-04-26T21:59:23.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.585+0000 7fda03fff640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd9f006c8f0 0x7fd9f006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fda040b89e0 tx=0x7fd9f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:23.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.589+0000 7fda00ff9640 1 -- 172.21.15.137:0/2414427109 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fda040d2880 con 0x7fda040cf430 2024-04-26T21:59:23.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:23.805+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fda0406a290 con 0x7fda040cf430 2024-04-26T21:59:24.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.465+0000 7fda00ff9640 1 -- 172.21.15.137:0/2414427109 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fd9f8058c50 con 0x7fda040cf430 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd9f006c8f0 msgr2=0x7fd9f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd9f006c8f0 0x7fd9f006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fda040b89e0 tx=0x7fd9f4008040 comp rx=0 tx=0).stop 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 msgr2=0x7fda040a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 0x7fda040a0370 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c480 tx=0x7fd9f800c940 comp rx=0 tx=0).stop 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 shutdown_connections 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd9f006c8f0 0x7fd9f006edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda040cf430 0x7fda040a0370 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda04160950 0x7fda040a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 --2- 172.21.15.137:0/2414427109 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda040b1ef0 0x7fda0409d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 >> 172.21.15.137:0/2414427109 conn(0x7fda0409ba40 msgr2=0x7fda04071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 shutdown_connections 2024-04-26T21:59:24.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.469+0000 7fda0a86d640 1 -- 172.21.15.137:0/2414427109 wait complete. 2024-04-26T21:59:24.481 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T21:59:24.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.583+0000 7fa36fb71640 1 Processor -- start 2024-04-26T21:59:24.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.584+0000 7fa36fb71640 1 -- start start 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.584+0000 7fa36fb71640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa36815f670 0x7fa3680ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.584+0000 7fa36fb71640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3680d1320 con 0x7fa368160700 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.584+0000 7fa36fb71640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36815fc20 con 0x7fa36806d2b0 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.584+0000 7fa36fb71640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa368160270 con 0x7fa36815f670 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.585+0000 7fa36e10e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa36815f670 0x7fa3680ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.585+0000 7fa36d10c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa368160700 0x7fa3680cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50154/0 (socket says 172.21.15.137:50154) 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.585+0000 7fa36e10e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa36815f670 0x7fa3680ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54518/0 (socket says 172.21.15.137:54518) 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.585+0000 7fa36e10e640 1 -- 172.21.15.137:0/3576889868 learned_addr learned my addr 172.21.15.137:0/3576889868 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.585+0000 7fa36e10e640 1 -- 172.21.15.137:0/3576889868 >> v1:172.21.15.170:6789/0 conn(0x7fa36806d2b0 legacy=0x7fa36806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.585+0000 7fa36e10e640 1 -- 172.21.15.137:0/3576889868 >> v1:172.21.15.137:6789/0 conn(0x7fa368160700 legacy=0x7fa3680cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.585+0000 7fa36e10e640 1 -- 172.21.15.137:0/3576889868 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36815ff00 con 0x7fa36815f670 2024-04-26T21:59:24.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.585+0000 7fa36c90b640 1 -- 172.21.15.137:0/3576889868 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351776986 0 0) 0x7fa3680d1320 con 0x7fa368160700 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36e10e640 1 --2- 172.21.15.137:0/3576889868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 0x7fa3680ae8b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa360009e50 tx=0x7fa36002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb394f12d20b1643 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36c90b640 1 -- 172.21.15.137:0/3576889868 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360036070 con 0x7fa36815f670 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36c90b640 1 -- 172.21.15.137:0/3576889868 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa360031600 con 0x7fa36815f670 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36c90b640 1 -- 172.21.15.137:0/3576889868 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3600319d0 con 0x7fa36815f670 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36fb71640 1 -- 172.21.15.137:0/3576889868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 msgr2=0x7fa3680ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36fb71640 1 --2- 172.21.15.137:0/3576889868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 0x7fa3680ae8b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa360009e50 tx=0x7fa36002a6a0 comp rx=0 tx=0).stop 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36fb71640 1 -- 172.21.15.137:0/3576889868 shutdown_connections 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36fb71640 1 --2- 172.21.15.137:0/3576889868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 0x7fa3680ae8b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36fb71640 1 -- 172.21.15.137:0/3576889868 >> 172.21.15.137:0/3576889868 conn(0x7fa368072900 msgr2=0x7fa368072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36fb71640 1 -- 172.21.15.137:0/3576889868 shutdown_connections 2024-04-26T21:59:24.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.586+0000 7fa36fb71640 1 -- 172.21.15.137:0/3576889868 wait complete. 2024-04-26T21:59:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.587+0000 7fa36fb71640 1 Processor -- start 2024-04-26T21:59:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.587+0000 7fa36fb71640 1 -- start start 2024-04-26T21:59:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36fb71640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36806d2b0 0x7fa3680b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36fb71640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 0x7fa368151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36fb71640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa368160700 0x7fa368153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36fb71640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa368071270 con 0x7fa36815f670 2024-04-26T21:59:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36fb71640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680710f0 con 0x7fa36806d2b0 2024-04-26T21:59:24.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36fb71640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa3680cf9a0 con 0x7fa368160700 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36d10c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 0x7fa368151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36d10c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 0x7fa368151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54528/0 (socket says 172.21.15.137:54528) 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36d10c640 1 -- 172.21.15.137:0/2360140373 learned_addr learned my addr 172.21.15.137:0/2360140373 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36d90d640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36806d2b0 0x7fa3680b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36d10c640 1 -- 172.21.15.137:0/2360140373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa368160700 msgr2=0x7fa368153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36d10c640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa368160700 0x7fa368153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.588+0000 7fa36d10c640 1 -- 172.21.15.137:0/2360140373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36806d2b0 msgr2=0x7fa3680b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.589+0000 7fa36d10c640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36806d2b0 0x7fa3680b6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.589+0000 7fa36d10c640 1 -- 172.21.15.137:0/2360140373 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3680b7390 con 0x7fa36815f670 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.589+0000 7fa36d10c640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 0x7fa368151590 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c3f0 tx=0x7fa36400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.589+0000 7fa35a7fc640 1 -- 172.21.15.137:0/2360140373 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3640074e0 con 0x7fa36815f670 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.589+0000 7fa35a7fc640 1 -- 172.21.15.137:0/2360140373 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3640047e0 con 0x7fa36815f670 2024-04-26T21:59:24.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.589+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa368154150 con 0x7fa36815f670 2024-04-26T21:59:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.589+0000 7fa35a7fc640 1 -- 172.21.15.137:0/2360140373 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364004c10 con 0x7fa36815f670 2024-04-26T21:59:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.589+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3680b6650 con 0x7fa36815f670 2024-04-26T21:59:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.590+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36806a290 con 0x7fa36815f670 2024-04-26T21:59:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.590+0000 7fa35a7fc640 1 -- 172.21.15.137:0/2360140373 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa364011070 con 0x7fa36815f670 2024-04-26T21:59:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.590+0000 7fa35a7fc640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa34c06c8f0 0x7fa34c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:24.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.591+0000 7fa35a7fc640 1 -- 172.21.15.137:0/2360140373 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7fa36408b760 con 0x7fa36815f670 2024-04-26T21:59:24.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.591+0000 7fa36d90d640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa34c06c8f0 0x7fa34c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:24.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.591+0000 7fa36d90d640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa34c06c8f0 0x7fa34c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000f60 tx=0x7fa35c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:24.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.595+0000 7fa35a7fc640 1 -- 172.21.15.137:0/2360140373 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa36401a2b0 con 0x7fa36815f670 2024-04-26T21:59:24.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:24.772+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa368073bb0 con 0x7fa36815f670 2024-04-26T21:59:25.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.628+0000 7fa35a7fc640 1 -- 172.21.15.137:0/2360140373 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7fa364059b50 con 0x7fa36815f670 2024-04-26T21:59:25.628 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T21:59:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.631+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa34c06c8f0 msgr2=0x7fa34c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.631+0000 7fa36fb71640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa34c06c8f0 0x7fa34c06edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa35c000f60 tx=0x7fa35c009040 comp rx=0 tx=0).stop 2024-04-26T21:59:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.631+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 msgr2=0x7fa368151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.631+0000 7fa36fb71640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 0x7fa368151590 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c3f0 tx=0x7fa36400c8b0 comp rx=0 tx=0).stop 2024-04-26T21:59:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.632+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 shutdown_connections 2024-04-26T21:59:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.632+0000 7fa36fb71640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa34c06c8f0 0x7fa34c06edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.632+0000 7fa36fb71640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa36815f670 0x7fa368151590 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.632+0000 7fa36fb71640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa368160700 0x7fa368153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:25.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.632+0000 7fa36fb71640 1 --2- 172.21.15.137:0/2360140373 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa36806d2b0 0x7fa3680b6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:25.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.632+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 >> 172.21.15.137:0/2360140373 conn(0x7fa368072900 msgr2=0x7fa36806e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:25.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.632+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 shutdown_connections 2024-04-26T21:59:25.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.632+0000 7fa36fb71640 1 -- 172.21.15.137:0/2360140373 wait complete. 2024-04-26T21:59:25.645 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T21:59:25.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.747+0000 7f565b63e640 1 Processor -- start 2024-04-26T21:59:25.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.747+0000 7f565b63e640 1 -- start start 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.748+0000 7f565b63e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5654148d00 0x7f56540b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.748+0000 7f565b63e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5654163080 con 0x7f5654148150 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.748+0000 7f565b63e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5654163360 con 0x7f56540b5190 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.748+0000 7f565b63e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5654148530 con 0x7f5654148d00 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.748+0000 7f5658bd9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5654148d00 0x7f56540b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.748+0000 7f56593da640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5654148150 0x7f56540d38f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57250/0 (socket says 172.21.15.137:57250) 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.748+0000 7f56593da640 1 -- 172.21.15.137:0/3501458578 learned_addr learned my addr 172.21.15.137:0/3501458578 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.749+0000 7f5658bd9640 1 -- 172.21.15.137:0/3501458578 >> v1:172.21.15.170:6789/0 conn(0x7f56540b5190 legacy=0x7f565406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.749+0000 7f5658bd9640 1 -- 172.21.15.137:0/3501458578 >> v1:172.21.15.137:6789/0 conn(0x7f5654148150 legacy=0x7f56540d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.749+0000 7f5658bd9640 1 -- 172.21.15.137:0/3501458578 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5654163640 con 0x7f5654148d00 2024-04-26T21:59:25.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.749+0000 7f564bfff640 1 -- 172.21.15.137:0/3501458578 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687687989 0 0) 0x7f5654163080 con 0x7f5654148150 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.749+0000 7f5658bd9640 1 --2- 172.21.15.137:0/3501458578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5654148d00 0x7f56540b4c50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f56440097a0 tx=0x7f564402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7da0640363b99ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f564bfff640 1 -- 172.21.15.137:0/3501458578 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644037070 con 0x7f5654148d00 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f564bfff640 1 -- 172.21.15.137:0/3501458578 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5644032440 con 0x7f5654148d00 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f564bfff640 1 -- 172.21.15.137:0/3501458578 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644032810 con 0x7f5654148d00 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f565b63e640 1 -- 172.21.15.137:0/3501458578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5654148d00 msgr2=0x7f56540b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f565b63e640 1 --2- 172.21.15.137:0/3501458578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5654148d00 0x7f56540b4c50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f56440097a0 tx=0x7f564402a1e0 comp rx=0 tx=0).stop 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f565b63e640 1 -- 172.21.15.137:0/3501458578 shutdown_connections 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f565b63e640 1 --2- 172.21.15.137:0/3501458578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5654148d00 0x7f56540b4c50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f565b63e640 1 -- 172.21.15.137:0/3501458578 >> 172.21.15.137:0/3501458578 conn(0x7f565406c960 msgr2=0x7f56540b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f565b63e640 1 -- 172.21.15.137:0/3501458578 shutdown_connections 2024-04-26T21:59:25.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.750+0000 7f565b63e640 1 -- 172.21.15.137:0/3501458578 wait complete. 2024-04-26T21:59:25.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.751+0000 7f565b63e640 1 Processor -- start 2024-04-26T21:59:25.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.751+0000 7f565b63e640 1 -- start start 2024-04-26T21:59:25.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f565b63e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56540b5190 0x7f56541f8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:25.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f565b63e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5654148150 0x7f56541f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:25.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f565b63e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5654148d00 0x7f565413e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:25.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f565b63e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f56540b55d0 con 0x7f56540b5190 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f565b63e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5654163c90 con 0x7f5654148150 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f565b63e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f565406dfe0 con 0x7f5654148d00 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f56593da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56540b5190 0x7f56541f8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f56593da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56540b5190 0x7f56541f8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41780/0 (socket says 172.21.15.137:41780) 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f56593da640 1 -- 172.21.15.137:0/3587574037 learned_addr learned my addr 172.21.15.137:0/3587574037 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.752+0000 7f5658bd9640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5654148150 0x7f56541f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f5659bdb640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5654148d00 0x7f565413e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f56593da640 1 -- 172.21.15.137:0/3587574037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5654148d00 msgr2=0x7f565413e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f56593da640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5654148d00 0x7f565413e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f56593da640 1 -- 172.21.15.137:0/3587574037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5654148150 msgr2=0x7f56541f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f56593da640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5654148150 0x7f56541f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f56593da640 1 -- 172.21.15.137:0/3587574037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56541f8a90 con 0x7f56540b5190 2024-04-26T21:59:25.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f5659bdb640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5654148d00 0x7f565413e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:25.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f56593da640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56540b5190 0x7f56541f8320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f565000c8c0 tx=0x7f565000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:25.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f5649ffb640 1 -- 172.21.15.137:0/3587574037 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650018070 con 0x7f56540b5190 2024-04-26T21:59:25.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f5649ffb640 1 -- 172.21.15.137:0/3587574037 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565000a640 con 0x7f56540b5190 2024-04-26T21:59:25.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f5649ffb640 1 -- 172.21.15.137:0/3587574037 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565000aa30 con 0x7f56540b5190 2024-04-26T21:59:25.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56541f8d70 con 0x7f56540b5190 2024-04-26T21:59:25.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.753+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56541f4ab0 con 0x7f56540b5190 2024-04-26T21:59:25.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.754+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56540693d0 con 0x7f56540b5190 2024-04-26T21:59:25.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.754+0000 7f5649ffb640 1 -- 172.21.15.137:0/3587574037 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f565001b070 con 0x7f56540b5190 2024-04-26T21:59:25.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.755+0000 7f5649ffb640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f563806c8f0 0x7f563806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:25.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.755+0000 7f5658bd9640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f563806c8f0 0x7f563806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:25.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.755+0000 7f5649ffb640 1 -- 172.21.15.137:0/3587574037 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5473+0+0 (secure 0 0 0) 0x7f565008b140 con 0x7f56540b5190 2024-04-26T21:59:25.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.755+0000 7f5658bd9640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f563806c8f0 0x7f563806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5644034000 tx=0x7f564402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:25.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.759+0000 7f5649ffb640 1 -- 172.21.15.137:0/3587574037 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5650059650 con 0x7f56540b5190 2024-04-26T21:59:25.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:25.937+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f565415f3f0 con 0x7f56540b5190 2024-04-26T21:59:26.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.637+0000 7f5649ffb640 1 -- 172.21.15.137:0/3587574037 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f5650058f50 con 0x7f56540b5190 2024-04-26T21:59:26.637 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T21:59:26.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f563806c8f0 msgr2=0x7f563806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:26.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f563806c8f0 0x7f563806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5644034000 tx=0x7f564402e000 comp rx=0 tx=0).stop 2024-04-26T21:59:26.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56540b5190 msgr2=0x7f56541f8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56540b5190 0x7f56541f8320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f565000c8c0 tx=0x7f565000cd80 comp rx=0 tx=0).stop 2024-04-26T21:59:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 shutdown_connections 2024-04-26T21:59:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f563806c8f0 0x7f563806edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5654148d00 0x7f565413e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5654148150 0x7f56541f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 --2- 172.21.15.137:0/3587574037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f56540b5190 0x7f56541f8320 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 >> 172.21.15.137:0/3587574037 conn(0x7f565406c960 msgr2=0x7f56540d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 shutdown_connections 2024-04-26T21:59:26.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.640+0000 7f565b63e640 1 -- 172.21.15.137:0/3587574037 wait complete. 2024-04-26T21:59:26.654 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T21:59:26.654 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T21:59:26.654 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T21:59:26.654 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:59:26.655 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T21:59:26.655 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T21:59:26.655 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T21:59:26.655 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:59:26.655 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T21:59:26.655 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T21:59:26.655 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T21:59:26.656 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:59:26.656 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T21:59:26.656 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T21:59:26.656 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T21:59:26.656 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T21:59:26.666 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T21:59:26.666 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T21:59:26.667 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T21:59:26.667 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T21:59:26.668 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T21:59:26.668 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T21:59:26.668 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T21:59:26.669 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T21:59:26.708 INFO:tasks.ceph.mds.a:Started 2024-04-26T21:59:26.709 DEBUG:teuthology.parallel:result is None 2024-04-26T21:59:26.710 INFO:tasks.ceph.mds.c:Started 2024-04-26T21:59:26.710 DEBUG:teuthology.parallel:result is None 2024-04-26T21:59:26.711 INFO:tasks.ceph.mds.b:Started 2024-04-26T21:59:26.711 DEBUG:teuthology.parallel:result is None 2024-04-26T21:59:26.712 INFO:tasks.ceph.mds.d:Started 2024-04-26T21:59:26.712 DEBUG:teuthology.parallel:result is None 2024-04-26T21:59:26.712 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T21:59:26.786 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T21:59:26.786 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T21:59:26.790 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T21:59:26.791 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T21:59:26.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.817+0000 7f05e70cf640 1 Processor -- start 2024-04-26T21:59:26.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.817+0000 7f05e70cf640 1 -- start start 2024-04-26T21:59:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e70cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e015fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e70cf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f05e006f590 0x7f05e00d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e70cf640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e0160780 con 0x7f05e0160200 2024-04-26T21:59:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e70cf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f05e0160a60 con 0x7f05e006f590 2024-04-26T21:59:26.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e70cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f05e00cff90 con 0x7f05e015d0c0 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05dffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f05e0160200 0x7f05e006ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57260/0 (socket says 172.21.15.137:57260) 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05dffff640 1 -- 172.21.15.137:0/2055692994 learned_addr learned my addr 172.21.15.137:0/2055692994 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e566c640 1 --2- 172.21.15.137:0/2055692994 >> v2:172.21.15.137:3300/0 conn(0x7f05e006f590 0x7f05e00d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e4e6b640 1 --2- 172.21.15.137:0/2055692994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e015fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05df7fe640 1 -- 172.21.15.137:0/2055692994 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531065261 0 0) 0x7f05e0160780 con 0x7f05e0160200 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05df7fe640 1 -- 172.21.15.137:0/2055692994 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05d0003520 con 0x7f05e0160200 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e566c640 1 -- 172.21.15.137:0/2055692994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 msgr2=0x7f05e015fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e566c640 1 --2- 172.21.15.137:0/2055692994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e015fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e566c640 1 -- 172.21.15.137:0/2055692994 >> v1:172.21.15.137:6789/0 conn(0x7f05e0160200 legacy=0x7f05e006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e566c640 1 -- 172.21.15.137:0/2055692994 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e00d0270 con 0x7f05e006f590 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.818+0000 7f05e4e6b640 1 --2- 172.21.15.137:0/2055692994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.819+0000 7f05e566c640 1 --2- 172.21.15.137:0/2055692994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 0x7f05e00d0790 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009d90 tx=0x7f05d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd318ef50cb982d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.819+0000 7f05df7fe640 1 -- 172.21.15.137:0/2055692994 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8007740 con 0x7f05e006f590 2024-04-26T21:59:26.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.819+0000 7f05df7fe640 1 -- 172.21.15.137:0/2055692994 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d80078e0 con 0x7f05e006f590 2024-04-26T21:59:26.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.819+0000 7f05df7fe640 1 -- 172.21.15.137:0/2055692994 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8007cb0 con 0x7f05e006f590 2024-04-26T21:59:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.820+0000 7f05e70cf640 1 -- 172.21.15.137:0/2055692994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 msgr2=0x7f05e00d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.820+0000 7f05e70cf640 1 --2- 172.21.15.137:0/2055692994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 0x7f05e00d0790 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009d90 tx=0x7f05d802a660 comp rx=0 tx=0).stop 2024-04-26T21:59:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.820+0000 7f05e70cf640 1 -- 172.21.15.137:0/2055692994 shutdown_connections 2024-04-26T21:59:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.820+0000 7f05e70cf640 1 --2- 172.21.15.137:0/2055692994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 0x7f05e00d0790 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.820+0000 7f05e70cf640 1 --2- 172.21.15.137:0/2055692994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.820+0000 7f05e70cf640 1 -- 172.21.15.137:0/2055692994 >> 172.21.15.137:0/2055692994 conn(0x7f05e00b3b10 msgr2=0x7f05e00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.820+0000 7f05e70cf640 1 -- 172.21.15.137:0/2055692994 shutdown_connections 2024-04-26T21:59:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.820+0000 7f05e70cf640 1 -- 172.21.15.137:0/2055692994 wait complete. 2024-04-26T21:59:26.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.821+0000 7f05e70cf640 1 Processor -- start 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.821+0000 7f05e70cf640 1 -- start start 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e70cf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 0x7f05e01527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e70cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e00b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e70cf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0160200 0x7f05e00b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e70cf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05e015d620 con 0x7f05e006f590 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e70cf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f05e015d4a0 con 0x7f05e0160200 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e70cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f05e00d0cd0 con 0x7f05e015d0c0 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e4e6b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 0x7f05e01527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e4e6b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 0x7f05e01527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41840/0 (socket says 172.21.15.137:41840) 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e4e6b640 1 -- 172.21.15.137:0/1045755811 learned_addr learned my addr 172.21.15.137:0/1045755811 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e566c640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0160200 0x7f05e00b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05dffff640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e00b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:26.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e4e6b640 1 -- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 msgr2=0x7f05e00b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e4e6b640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e00b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e4e6b640 1 -- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0160200 msgr2=0x7f05e00b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e4e6b640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0160200 0x7f05e00b5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e4e6b640 1 -- 172.21.15.137:0/1045755811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e01f3390 con 0x7f05e006f590 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e566c640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0160200 0x7f05e00b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05dffff640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e00b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05e4e6b640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 0x7f05e01527d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f05d400ec10 tx=0x7f05d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.822+0000 7f05dd7fa640 1 -- 172.21.15.137:0/1045755811 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4017070 con 0x7f05e006f590 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.823+0000 7f05dd7fa640 1 -- 172.21.15.137:0/1045755811 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d400cc30 con 0x7f05e006f590 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.823+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e013d5e0 con 0x7f05e006f590 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.823+0000 7f05dd7fa640 1 -- 172.21.15.137:0/1045755811 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4013470 con 0x7f05e006f590 2024-04-26T21:59:26.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.823+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e01f3910 con 0x7f05e006f590 2024-04-26T21:59:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.824+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e00693d0 con 0x7f05e006f590 2024-04-26T21:59:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.824+0000 7f05dd7fa640 1 -- 172.21.15.137:0/1045755811 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05d401a070 con 0x7f05e006f590 2024-04-26T21:59:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.824+0000 7f05dd7fa640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05c406c8f0 0x7f05c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.824+0000 7f05dd7fa640 1 -- 172.21.15.137:0/1045755811 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f05d408bb60 con 0x7f05e006f590 2024-04-26T21:59:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.824+0000 7f05dffff640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05c406c8f0 0x7f05c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.825+0000 7f05dffff640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05c406c8f0 0x7f05c406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f05e00d2220 tx=0x7f05cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:26.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:26.829+0000 7f05dd7fa640 1 -- 172.21.15.137:0/1045755811 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f05d405a290 con 0x7f05e006f590 2024-04-26T21:59:27.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.016+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f05e00b10b0 con 0x7f05e006f590 2024-04-26T21:59:27.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.646+0000 7f05dd7fa640 1 -- 172.21.15.137:0/1045755811 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f05d4059b90 con 0x7f05e006f590 2024-04-26T21:59:27.646 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T21:59:27.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05c406c8f0 msgr2=0x7f05c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:27.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05c406c8f0 0x7f05c406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f05e00d2220 tx=0x7f05cc009040 comp rx=0 tx=0).stop 2024-04-26T21:59:27.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 msgr2=0x7f05e01527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:27.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 0x7f05e01527d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f05d400ec10 tx=0x7f05d400c520 comp rx=0 tx=0).stop 2024-04-26T21:59:27.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 shutdown_connections 2024-04-26T21:59:27.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f05c406c8f0 0x7f05c406edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0160200 0x7f05e00b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05e015d0c0 0x7f05e00b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 --2- 172.21.15.137:0/1045755811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05e006f590 0x7f05e01527d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 >> 172.21.15.137:0/1045755811 conn(0x7f05e00b3b10 msgr2=0x7f05e006ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 shutdown_connections 2024-04-26T21:59:27.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.649+0000 7f05e70cf640 1 -- 172.21.15.137:0/1045755811 wait complete. 2024-04-26T21:59:27.662 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T21:59:27.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.761+0000 7f9cfe778640 1 Processor -- start 2024-04-26T21:59:27.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.761+0000 7f9cfe778640 1 -- start start 2024-04-26T21:59:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.762+0000 7f9cfe778640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9cf806f2c0 0x7f9cf8071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.762+0000 7f9cfe778640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf80733e0 con 0x7f9cf815b4e0 2024-04-26T21:59:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.762+0000 7f9cfe778640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf8072f00 con 0x7f9cf815b8c0 2024-04-26T21:59:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.762+0000 7f9cfe778640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9cf8072660 con 0x7f9cf806f2c0 2024-04-26T21:59:27.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.762+0000 7f9cf7fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9cf815b4e0 0x7f9cf806ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57272/0 (socket says 172.21.15.137:57272) 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.762+0000 7f9cf7fff640 1 -- 172.21.15.137:0/1686849686 learned_addr learned my addr 172.21.15.137:0/1686849686 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051173841 0 0) 0x7f9cf80733e0 con 0x7f9cf815b4e0 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ce0003520 con 0x7f9cf815b4e0 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf77fe640 1 --2- 172.21.15.137:0/1686849686 >> v2:172.21.15.170:3300/0 conn(0x7f9cf806f2c0 0x7f9cf8071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3424946778 0 0) 0x7f9ce0003520 con 0x7f9cf815b4e0 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 >> v2:172.21.15.170:3300/0 conn(0x7f9cf806f2c0 msgr2=0x7f9cf8071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 --2- 172.21.15.137:0/1686849686 >> v2:172.21.15.170:3300/0 conn(0x7f9cf806f2c0 0x7f9cf8071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 >> v1:172.21.15.170:6789/0 conn(0x7f9cf815b8c0 legacy=0x7f9cf80b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf8072940 con 0x7f9cf815b4e0 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f9ce8001670 con 0x7f9cf815b4e0 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 >> v1:172.21.15.137:6789/0 conn(0x7f9cf815b4e0 legacy=0x7f9cf806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce00039b0 0x7f9ce0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:27.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce0004800 0x7f9ce0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ce00052e0 0x7f9ce000cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8072660 con 0x7f9ce0004800 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce000d2c0 con 0x7f9ce00039b0 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce000d4c0 con 0x7f9ce00052e0 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf77fe640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce0004800 0x7f9ce0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf7fff640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce00039b0 0x7f9ce0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cfcd15640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ce00052e0 0x7f9ce000cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf77fe640 1 -- 172.21.15.137:0/1686849686 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ce00052e0 msgr2=0x7f9ce000cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf77fe640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ce00052e0 0x7f9ce000cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf77fe640 1 -- 172.21.15.137:0/1686849686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce00039b0 msgr2=0x7f9ce0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf77fe640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce00039b0 0x7f9ce0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cf77fe640 1 -- 172.21.15.137:0/1686849686 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce0003520 con 0x7f9ce0004800 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.763+0000 7f9cfcd15640 1 -- 172.21.15.137:0/1686849686 reap_dead start 2024-04-26T21:59:27.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.764+0000 7f9cf77fe640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce0004800 0x7f9ce0004c80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00ba00 tx=0x7f9ce0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c6c125284b6807 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.764+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec030070 con 0x7f9ce0004800 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.764+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cec02ad80 con 0x7f9ce0004800 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.764+0000 7f9cf6ffd640 1 -- 172.21.15.137:0/1686849686 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00b600 con 0x7f9ce0004800 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.765+0000 7f9cfe778640 1 -- 172.21.15.137:0/1686849686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce0004800 msgr2=0x7f9ce0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.765+0000 7f9cfe778640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce0004800 0x7f9ce0004c80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00ba00 tx=0x7f9ce0005830 comp rx=0 tx=0).stop 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.765+0000 7f9cfe778640 1 -- 172.21.15.137:0/1686849686 shutdown_connections 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.765+0000 7f9cfe778640 1 --2- 172.21.15.137:0/1686849686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9ce0004800 0x7f9ce0004c80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.765+0000 7f9cfe778640 1 -- 172.21.15.137:0/1686849686 >> 172.21.15.137:0/1686849686 conn(0x7f9cf80d0d30 msgr2=0x7f9cf80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.765+0000 7f9cfe778640 1 -- 172.21.15.137:0/1686849686 shutdown_connections 2024-04-26T21:59:27.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.765+0000 7f9cfe778640 1 -- 172.21.15.137:0/1686849686 wait complete. 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.766+0000 7f9cfe778640 1 Processor -- start 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.766+0000 7f9cfe778640 1 -- start start 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfe778640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce0004800 0x7f9cf814b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfe778640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9cf80afa10 0x7f9cf81595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfe778640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf80afe70 0x7f9cf8159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfe778640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8073820 con 0x7f9cf80afe70 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfe778640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf80b3e80 con 0x7f9ce0004800 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfe778640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf80739a0 con 0x7f9cf80afa10 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfcd15640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf80afe70 0x7f9cf8159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfcd15640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf80afe70 0x7f9cf8159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41862/0 (socket says 172.21.15.137:41862) 2024-04-26T21:59:27.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfcd15640 1 -- 172.21.15.137:0/159494971 learned_addr learned my addr 172.21.15.137:0/159494971 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cf7fff640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce0004800 0x7f9cf814b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cf77fe640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9cf80afa10 0x7f9cf81595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfcd15640 1 -- 172.21.15.137:0/159494971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9cf80afa10 msgr2=0x7f9cf81595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfcd15640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9cf80afa10 0x7f9cf81595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfcd15640 1 -- 172.21.15.137:0/159494971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce0004800 msgr2=0x7f9cf814b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfcd15640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce0004800 0x7f9cf814b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfcd15640 1 -- 172.21.15.137:0/159494971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf815dcf0 con 0x7f9cf80afe70 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cf7fff640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce0004800 0x7f9cf814b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cfcd15640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf80afe70 0x7f9cf8159b30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0007fd0 tx=0x7f9cf000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.767+0000 7f9cf4ff9640 1 -- 172.21.15.137:0/159494971 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0006b50 con 0x7f9cf80afe70 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.768+0000 7f9cf4ff9640 1 -- 172.21.15.137:0/159494971 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf0006cf0 con 0x7f9cf80afe70 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.768+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf815dfd0 con 0x7f9cf80afe70 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.768+0000 7f9cf4ff9640 1 -- 172.21.15.137:0/159494971 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0003970 con 0x7f9cf80afe70 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.768+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf815e590 con 0x7f9cf80afe70 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.768+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf806a290 con 0x7f9cf80afe70 2024-04-26T21:59:27.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.769+0000 7f9cf4ff9640 1 -- 172.21.15.137:0/159494971 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cf001a020 con 0x7f9cf80afe70 2024-04-26T21:59:27.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.769+0000 7f9cf4ff9640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ce406c920 0x7f9ce406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:27.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.769+0000 7f9cf4ff9640 1 -- 172.21.15.137:0/159494971 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f9cf008ad30 con 0x7f9cf80afe70 2024-04-26T21:59:27.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.769+0000 7f9cf7fff640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ce406c920 0x7f9ce406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:27.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.770+0000 7f9cf7fff640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ce406c920 0x7f9ce406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9cf806b1f0 tx=0x7f9ce8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:27.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:27.774+0000 7f9cf4ff9640 1 -- 172.21.15.137:0/159494971 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9cf00594b0 con 0x7f9cf80afe70 2024-04-26T21:59:28.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.015+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9cf814fb70 con 0x7f9cf80afe70 2024-04-26T21:59:28.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.015+0000 7f9cf4ff9640 1 -- 172.21.15.137:0/159494971 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f9cf0058db0 con 0x7f9cf80afe70 2024-04-26T21:59:28.015 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:28.016 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T21:59:28.016 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T21:59:28.016 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.016 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T21:59:28.016 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmKffkBRAAh7EvvT0pmNbLKtJsBH/25Q==", 2024-04-26T21:59:28.016 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.016 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T21:59:28.016 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T21:59:28.016 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmd5UHERAAykWO/C56qwLwimzH2f6mcA==", 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.017 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmMbCsDBAANF98tMtCSOy4TVN7I498cw==", 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.018 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmQ47KFxAAsreL970BTH5yQLOol942iQ==", 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T21:59:28.019 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBcIyxmY2T8NhAAMyJ5OP3dhuqMymrlUG4q2A==", 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBfIyxmNfGnNRAAp+tTaVBwfAMUsyqRSgoRvw==", 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T21:59:28.020 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBiIyxm3Q1yMxAAf7f6Me7uKYzM+Fp+2FCQsA==", 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.021 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlIyxmFcj2MRAAL/yPxOwtgMnfbmr0YUZs6Q==", 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T21:59:28.022 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBpIyxmaaAqORAAfowCddy0wT/LptWvqD4CDw==", 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBsIyxmJaOFNhAAqjJAuU/SoVnjIAYCODWMnA==", 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T21:59:28.023 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBvIyxmRkINNBAAjfFLMQ9/XMLLU8ZAoUxvkQ==", 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.024 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQByIyxmeF1gMRAAH0t727lSCZgkTgJ0ZXyA6g==", 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T21:59:28.025 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ==", 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxms4U0JBAAMZ056L4EP1qzX2KVx8JiEg==", 2024-04-26T21:59:28.026 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmUnswIRAA5nYDanYzHiEVk98/041RHA==", 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T21:59:28.027 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmHOORKRAA6Agn7TqBPywtop3Eo8+yFQ==", 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T21:59:28.028 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxm7ue6JhAAyLiai4CKXmiB00fCAfp2WA==", 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.029 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-mds", 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB4IyxmbxVQIRAAbp42J+CgjZOtiFLow6Udkg==", 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-mds" 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-mgr", 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB4Iyxmz1pQIRAAlTmCCMQWRQUgIO7I0rZ7hw==", 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.030 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-osd", 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB4IyxmsGFQIRAAM7AqoLq3itIdEryhIuljAw==", 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-osd" 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-rbd", 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB4Iyxm1GdQIRAAuUdIYdzGKOFkuaS+XMnd3g==", 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.031 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB4IyxmWW5QIRAA7J9HD/WOAXS/uAn8XXSJTA==", 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.bootstrap-rgw", 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQB4Iyxm13RQIRAAWHqfipnraMzShcAO6siruQ==", 2024-04-26T21:59:28.032 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmFBrPAhAAfrkQvzF5SSyb5iQ0zr0eww==", 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.033 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxmlrq3OhAA9Fd+zmECU9xK/pWp2Hg9kg==", 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T21:59:28.034 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T21:59:28.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ce406c920 msgr2=0x7f9ce406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ce406c920 0x7f9ce406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9cf806b1f0 tx=0x7f9ce8009040 comp rx=0 tx=0).stop 2024-04-26T21:59:28.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf80afe70 msgr2=0x7f9cf8159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf80afe70 0x7f9cf8159b30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0007fd0 tx=0x7f9cf000ec10 comp rx=0 tx=0).stop 2024-04-26T21:59:28.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 shutdown_connections 2024-04-26T21:59:28.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ce406c920 0x7f9ce406ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9cf80afe70 0x7f9cf8159b30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9cf80afa10 0x7f9cf81595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 --2- 172.21.15.137:0/159494971 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ce0004800 0x7f9cf814b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 >> 172.21.15.137:0/159494971 conn(0x7f9cf80d0d30 msgr2=0x7f9cf80b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:28.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 shutdown_connections 2024-04-26T21:59:28.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.017+0000 7f9cfe778640 1 -- 172.21.15.137:0/159494971 wait complete. 2024-04-26T21:59:28.037 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-26T21:59:28.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.135+0000 7f2dfadf2640 1 Processor -- start 2024-04-26T21:59:28.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.135+0000 7f2dfadf2640 1 -- start start 2024-04-26T21:59:28.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2dfadf2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df415d130 0x7f2df406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2dfadf2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2df40733c0 0x7f2df406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2dfadf2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2df415d510 con 0x7f2df4070d00 2024-04-26T21:59:28.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2dfadf2640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2df40b0e80 con 0x7f2df40733c0 2024-04-26T21:59:28.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2dfadf2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2df40b54f0 con 0x7f2df415d130 2024-04-26T21:59:28.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2df40733c0 0x7f2df406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2df40733c0 0x7f2df406d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41868/0 (socket says 172.21.15.137:41868) 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df3fff640 1 -- 172.21.15.137:0/3704172835 learned_addr learned my addr 172.21.15.137:0/3704172835 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df938f640 1 --1- 172.21.15.137:0/3704172835 >> v1:172.21.15.137:6789/0 conn(0x7f2df4070d00 0x7f2df4160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57282/0 (socket says 172.21.15.137:57282) 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df8b8e640 1 --2- 172.21.15.137:0/3704172835 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df415d130 0x7f2df406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df3fff640 1 -- 172.21.15.137:0/3704172835 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df415d130 msgr2=0x7f2df406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df3fff640 1 --2- 172.21.15.137:0/3704172835 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df415d130 0x7f2df406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df3fff640 1 -- 172.21.15.137:0/3704172835 >> v1:172.21.15.137:6789/0 conn(0x7f2df4070d00 legacy=0x7f2df4160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df3fff640 1 -- 172.21.15.137:0/3704172835 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df40d12c0 con 0x7f2df40733c0 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.136+0000 7f2df37fe640 1 -- 172.21.15.137:0/3704172835 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973536763 0 0) 0x7f2df415d510 con 0x7f2df4070d00 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.137+0000 7f2df3fff640 1 --2- 172.21.15.137:0/3704172835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df40733c0 0x7f2df406d7f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009870 tx=0x7f2de802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecd4b8394fedf01 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.137+0000 7f2df37fe640 1 -- 172.21.15.137:0/3704172835 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8037070 con 0x7f2df40733c0 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.137+0000 7f2df37fe640 1 -- 172.21.15.137:0/3704172835 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de8032440 con 0x7f2df40733c0 2024-04-26T21:59:28.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.137+0000 7f2df37fe640 1 -- 172.21.15.137:0/3704172835 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8032810 con 0x7f2df40733c0 2024-04-26T21:59:28.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.138+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3704172835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df40733c0 msgr2=0x7f2df406d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.138+0000 7f2dfadf2640 1 --2- 172.21.15.137:0/3704172835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df40733c0 0x7f2df406d7f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2de8009870 tx=0x7f2de802a270 comp rx=0 tx=0).stop 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.138+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3704172835 shutdown_connections 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.138+0000 7f2dfadf2640 1 --2- 172.21.15.137:0/3704172835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df40733c0 0x7f2df406d7f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.138+0000 7f2dfadf2640 1 --2- 172.21.15.137:0/3704172835 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df415d130 0x7f2df406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.138+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3704172835 >> 172.21.15.137:0/3704172835 conn(0x7f2df40728a0 msgr2=0x7f2df4072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.138+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3704172835 shutdown_connections 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.138+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3704172835 wait complete. 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.139+0000 7f2dfadf2640 1 Processor -- start 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.139+0000 7f2dfadf2640 1 -- start start 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2dfadf2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df4070d00 0x7f2df4154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2dfadf2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40733c0 0x7f2df41492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2dfadf2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df415d130 0x7f2df4158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2dfadf2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2df40d07e0 con 0x7f2df415d130 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2dfadf2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2df40d0500 con 0x7f2df4070d00 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2dfadf2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2df40d0ac0 con 0x7f2df40733c0 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df938f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df415d130 0x7f2df4158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df938f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df415d130 0x7f2df4158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41870/0 (socket says 172.21.15.137:41870) 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df938f640 1 -- 172.21.15.137:0/3598918732 learned_addr learned my addr 172.21.15.137:0/3598918732 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df8b8e640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df4070d00 0x7f2df4154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df3fff640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40733c0 0x7f2df41492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df938f640 1 -- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40733c0 msgr2=0x7f2df41492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df938f640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40733c0 0x7f2df41492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df938f640 1 -- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df4070d00 msgr2=0x7f2df4154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df938f640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df4070d00 0x7f2df4154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df938f640 1 -- 172.21.15.137:0/3598918732 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df4154d60 con 0x7f2df415d130 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df8b8e640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df4070d00 0x7f2df4154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df3fff640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40733c0 0x7f2df41492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:28.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df938f640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df415d130 0x7f2df4158570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c780 tx=0x7f2dec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df17fa640 1 -- 172.21.15.137:0/3598918732 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec018070 con 0x7f2df415d130 2024-04-26T21:59:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df17fa640 1 -- 172.21.15.137:0/3598918732 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dec00a640 con 0x7f2df415d130 2024-04-26T21:59:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df4155040 con 0x7f2df415d130 2024-04-26T21:59:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2df17fa640 1 -- 172.21.15.137:0/3598918732 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00aa30 con 0x7f2df415d130 2024-04-26T21:59:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.140+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df4155600 con 0x7f2df415d130 2024-04-26T21:59:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.141+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df4155ae0 con 0x7f2df415d130 2024-04-26T21:59:28.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.142+0000 7f2df17fa640 1 -- 172.21.15.137:0/3598918732 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2dec01b070 con 0x7f2df415d130 2024-04-26T21:59:28.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.142+0000 7f2df17fa640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de006c8f0 0x7f2de006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.142+0000 7f2df17fa640 1 -- 172.21.15.137:0/3598918732 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f2dec08ae50 con 0x7f2df415d130 2024-04-26T21:59:28.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.142+0000 7f2df8b8e640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de006c8f0 0x7f2de006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.143+0000 7f2df8b8e640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de006c8f0 0x7f2de006edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2de4006fd0 tx=0x7f2de4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:28.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.146+0000 7f2df17fa640 1 -- 172.21.15.137:0/3598918732 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2df4155ae0 con 0x7f2df415d130 2024-04-26T21:59:28.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.392+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f2df406a290 con 0x7f2df415d130 2024-04-26T21:59:28.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.394+0000 7f2df17fa640 1 -- 172.21.15.137:0/3598918732 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f2dec059540 con 0x7f2df415d130 2024-04-26T21:59:28.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de006c8f0 msgr2=0x7f2de006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de006c8f0 0x7f2de006edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2de4006fd0 tx=0x7f2de4008040 comp rx=0 tx=0).stop 2024-04-26T21:59:28.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df415d130 msgr2=0x7f2df4158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df415d130 0x7f2df4158570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c780 tx=0x7f2dec00cc40 comp rx=0 tx=0).stop 2024-04-26T21:59:28.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 shutdown_connections 2024-04-26T21:59:28.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de006c8f0 0x7f2de006edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2df415d130 0x7f2df4158570 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2df40733c0 0x7f2df41492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 --2- 172.21.15.137:0/3598918732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2df4070d00 0x7f2df4154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 >> 172.21.15.137:0/3598918732 conn(0x7f2df40728a0 msgr2=0x7f2df40b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:28.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 shutdown_connections 2024-04-26T21:59:28.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.396+0000 7f2dfadf2640 1 -- 172.21.15.137:0/3598918732 wait complete. 2024-04-26T21:59:28.407 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-26T21:59:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.505+0000 7f4e6e09b640 1 Processor -- start 2024-04-26T21:59:28.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.505+0000 7f4e6e09b640 1 -- start start 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e6e09b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4e680d3ee0 0x7f4e680cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e6e09b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e680d03a0 con 0x7f4e6815f750 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e6e09b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e680d0680 con 0x7f4e6815f370 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e6e09b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4e680d0960 con 0x7f4e680d3ee0 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e67fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4e6815f750 0x7f4e680b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57288/0 (socket says 172.21.15.137:57288) 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e67fff640 1 -- 172.21.15.137:0/1038975647 learned_addr learned my addr 172.21.15.137:0/1038975647 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e66ffd640 1 --2- 172.21.15.137:0/1038975647 >> v2:172.21.15.170:3300/0 conn(0x7f4e680d3ee0 0x7f4e680cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132542038 0 0) 0x7f4e680d03a0 con 0x7f4e6815f750 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e50003520 con 0x7f4e6815f750 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3271899117 0 0) 0x7f4e50003520 con 0x7f4e6815f750 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 >> v2:172.21.15.170:3300/0 conn(0x7f4e680d3ee0 msgr2=0x7f4e680cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:28.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 --2- 172.21.15.137:0/1038975647 >> v2:172.21.15.170:3300/0 conn(0x7f4e680d3ee0 0x7f4e680cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 >> v1:172.21.15.170:6789/0 conn(0x7f4e6815f370 legacy=0x7f4e680d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e680d0c40 con 0x7f4e6815f750 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f4e600019f0 con 0x7f4e6815f750 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 >> v1:172.21.15.137:6789/0 conn(0x7f4e6815f750 legacy=0x7f4e680b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e500039b0 0x7f4e50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e50004800 0x7f4e50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e500051c0 0x7f4e5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680d0960 con 0x7f4e500051c0 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5000c060 con 0x7f4e500039b0 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5000c260 con 0x7f4e50004800 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e67fff640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e500051c0 0x7f4e5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.506+0000 7f4e677fe640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e500039b0 0x7f4e50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e66ffd640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e50004800 0x7f4e50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e67fff640 1 -- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e50004800 msgr2=0x7f4e50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e67fff640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e50004800 0x7f4e50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e67fff640 1 -- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e500039b0 msgr2=0x7f4e50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e67fff640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e500039b0 0x7f4e50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e67fff640 1 -- 172.21.15.137:0/1038975647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e50003520 con 0x7f4e500051c0 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e677fe640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e500039b0 0x7f4e50003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e66ffd640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e50004800 0x7f4e50004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e67fff640 1 -- 172.21.15.137:0/1038975647 reap_dead start 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e67fff640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e500051c0 0x7f4e5000b9c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000a840 tx=0x7f4e50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f479f3db13db47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000a460 con 0x7f4e500051c0 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6002f070 con 0x7f4e500051c0 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.507+0000 7f4e667fc640 1 -- 172.21.15.137:0/1038975647 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6002bcb0 con 0x7f4e500051c0 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.508+0000 7f4e6e09b640 1 -- 172.21.15.137:0/1038975647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e500051c0 msgr2=0x7f4e5000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.508+0000 7f4e6e09b640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e500051c0 0x7f4e5000b9c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000a840 tx=0x7f4e50005830 comp rx=0 tx=0).stop 2024-04-26T21:59:28.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.508+0000 7f4e6e09b640 1 -- 172.21.15.137:0/1038975647 shutdown_connections 2024-04-26T21:59:28.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.508+0000 7f4e6e09b640 1 --2- 172.21.15.137:0/1038975647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e500051c0 0x7f4e5000b9c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.508+0000 7f4e6e09b640 1 -- 172.21.15.137:0/1038975647 >> 172.21.15.137:0/1038975647 conn(0x7f4e6808ec10 msgr2=0x7f4e6809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:28.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.508+0000 7f4e6e09b640 1 -- 172.21.15.137:0/1038975647 shutdown_connections 2024-04-26T21:59:28.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.508+0000 7f4e6e09b640 1 -- 172.21.15.137:0/1038975647 wait complete. 2024-04-26T21:59:28.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.509+0000 7f4e6e09b640 1 Processor -- start 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.509+0000 7f4e6e09b640 1 -- start start 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e6e09b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e500051c0 0x7f4e68158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e6e09b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e681600b0 0x7f4e68160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e6e09b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e680ca5f0 0x7f4e680caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e6e09b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680cfef0 con 0x7f4e680ca5f0 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e6e09b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680cfd70 con 0x7f4e681600b0 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e6e09b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e680d0070 con 0x7f4e500051c0 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e680ca5f0 0x7f4e680caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e680ca5f0 0x7f4e680caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41892/0 (socket says 172.21.15.137:41892) 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e67fff640 1 -- 172.21.15.137:0/3755138847 learned_addr learned my addr 172.21.15.137:0/3755138847 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e66ffd640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e681600b0 0x7f4e68160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e677fe640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e500051c0 0x7f4e68158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e67fff640 1 -- 172.21.15.137:0/3755138847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e500051c0 msgr2=0x7f4e68158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e67fff640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e500051c0 0x7f4e68158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e67fff640 1 -- 172.21.15.137:0/3755138847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e681600b0 msgr2=0x7f4e68160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e67fff640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e681600b0 0x7f4e68160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.510+0000 7f4e67fff640 1 -- 172.21.15.137:0/3755138847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e680ba4a0 con 0x7f4e680ca5f0 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.511+0000 7f4e67fff640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e680ca5f0 0x7f4e680caa70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000a960 tx=0x7f4e680d0850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.511+0000 7f4e4ffff640 1 -- 172.21.15.137:0/3755138847 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6002bc60 con 0x7f4e680ca5f0 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.511+0000 7f4e4ffff640 1 -- 172.21.15.137:0/3755138847 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6002be00 con 0x7f4e680ca5f0 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.511+0000 7f4e4ffff640 1 -- 172.21.15.137:0/3755138847 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60034670 con 0x7f4e680ca5f0 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.511+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e680c9850 con 0x7f4e680ca5f0 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.511+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e680c9e10 con 0x7f4e680ca5f0 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.512+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e680d1390 con 0x7f4e680ca5f0 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.512+0000 7f4e4ffff640 1 -- 172.21.15.137:0/3755138847 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e600348d0 con 0x7f4e680ca5f0 2024-04-26T21:59:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.512+0000 7f4e4ffff640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e5406c8f0 0x7f4e5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.513+0000 7f4e4ffff640 1 -- 172.21.15.137:0/3755138847 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f4e600ab8e0 con 0x7f4e680ca5f0 2024-04-26T21:59:28.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.513+0000 7f4e677fe640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e5406c8f0 0x7f4e5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.513+0000 7f4e677fe640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e5406c8f0 0x7f4e5406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000c00 tx=0x7f4e58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:28.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.517+0000 7f4e4ffff640 1 -- 172.21.15.137:0/3755138847 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4e680d1390 con 0x7f4e680ca5f0 2024-04-26T21:59:28.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.763+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f4e680d34a0 con 0x7f4e680ca5f0 2024-04-26T21:59:28.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.767+0000 7f4e4ffff640 1 -- 172.21.15.137:0/3755138847 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f4e680d34a0 con 0x7f4e680ca5f0 2024-04-26T21:59:28.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e5406c8f0 msgr2=0x7f4e5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e5406c8f0 0x7f4e5406edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000c00 tx=0x7f4e58009040 comp rx=0 tx=0).stop 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e680ca5f0 msgr2=0x7f4e680caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e680ca5f0 0x7f4e680caa70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000a960 tx=0x7f4e680d0850 comp rx=0 tx=0).stop 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 shutdown_connections 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e5406c8f0 0x7f4e5406edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e680ca5f0 0x7f4e680caa70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e681600b0 0x7f4e68160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 --2- 172.21.15.137:0/3755138847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e500051c0 0x7f4e68158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 >> 172.21.15.137:0/3755138847 conn(0x7f4e6808ec10 msgr2=0x7f4e680d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 shutdown_connections 2024-04-26T21:59:28.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.769+0000 7f4e6e09b640 1 -- 172.21.15.137:0/3755138847 wait complete. 2024-04-26T21:59:28.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-26T21:59:28.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.877+0000 7f886502c640 1 Processor -- start 2024-04-26T21:59:28.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.877+0000 7f886502c640 1 -- start start 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.878+0000 7f886502c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600d3ee0 0x7f88600cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.878+0000 7f886502c640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88600d03a0 con 0x7f886015f370 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.878+0000 7f886502c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88600d0680 con 0x7f886015f750 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.878+0000 7f886502c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f88600d0960 con 0x7f88600d3ee0 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.878+0000 7f885ed9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f886015f370 0x7f88600d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57294/0 (socket says 172.21.15.137:57294) 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.878+0000 7f885ed9d640 1 -- 172.21.15.137:0/2196818634 learned_addr learned my addr 172.21.15.137:0/2196818634 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.878+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973420812 0 0) 0x7f88600d03a0 con 0x7f886015f370 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.878+0000 7f885e59c640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600d3ee0 0x7f88600cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.878+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8848003520 con 0x7f886015f370 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3715143904 0 0) 0x7f8848003520 con 0x7f886015f370 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600d3ee0 msgr2=0x7f88600cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600d3ee0 0x7f88600cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 >> v1:172.21.15.170:6789/0 conn(0x7f886015f750 legacy=0x7f88600b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88600d0c40 con 0x7f886015f370 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f88500019f0 con 0x7f886015f370 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 >> v1:172.21.15.137:6789/0 conn(0x7f886015f370 legacy=0x7f88600d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600d3ee0 0x7f88480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8848003f20 0x7f8848004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8848004d40 0x7f88480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88600d0960 con 0x7f8848004d40 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f884800ba20 con 0x7f8848003f20 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f884800bc20 con 0x7f88600d3ee0 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885f59e640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8848004d40 0x7f88480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885ed9d640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600d3ee0 0x7f88480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885e59c640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8848003f20 0x7f8848004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885f59e640 1 -- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600d3ee0 msgr2=0x7f88480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885f59e640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600d3ee0 0x7f88480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885f59e640 1 -- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8848003f20 msgr2=0x7f8848004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:28.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885f59e640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8848003f20 0x7f8848004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.879+0000 7f885f59e640 1 -- 172.21.15.137:0/2196818634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8848003520 con 0x7f8848004d40 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.880+0000 7f885f59e640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8848004d40 0x7f88480051c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8858001860 tx=0x7f8848005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed9658fc9d0befb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.880+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858037070 con 0x7f8848004d40 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.880+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f885802abf0 con 0x7f8848004d40 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.880+0000 7f885dd9b640 1 -- 172.21.15.137:0/2196818634 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858001430 con 0x7f8848004d40 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.881+0000 7f886502c640 1 -- 172.21.15.137:0/2196818634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8848004d40 msgr2=0x7f88480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.881+0000 7f886502c640 1 --2- 172.21.15.137:0/2196818634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8848004d40 0x7f88480051c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8858001860 tx=0x7f8848005830 comp rx=0 tx=0).stop 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.881+0000 7f885f59e640 1 -- 172.21.15.137:0/2196818634 reap_dead start 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.881+0000 7f886502c640 1 -- 172.21.15.137:0/2196818634 shutdown_connections 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.881+0000 7f886502c640 1 -- 172.21.15.137:0/2196818634 >> 172.21.15.137:0/2196818634 conn(0x7f886008ec10 msgr2=0x7f886009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.881+0000 7f886502c640 1 -- 172.21.15.137:0/2196818634 shutdown_connections 2024-04-26T21:59:28.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.881+0000 7f886502c640 1 -- 172.21.15.137:0/2196818634 wait complete. 2024-04-26T21:59:28.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.882+0000 7f886502c640 1 Processor -- start 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.882+0000 7f886502c640 1 -- start start 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f886502c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f886015d210 0x7f8860161f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f886502c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8860162480 0x7f88600cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f886502c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600baaa0 0x7f88600cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f886502c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88600cfef0 con 0x7f886015d210 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f886502c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f88600cfd70 con 0x7f8860162480 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f886502c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f88600d0070 con 0x7f88600baaa0 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f885ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f886015d210 0x7f8860161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f885ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f886015d210 0x7f8860161f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41902/0 (socket says 172.21.15.137:41902) 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f885ed9d640 1 -- 172.21.15.137:0/459541836 learned_addr learned my addr 172.21.15.137:0/459541836 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f885ed9d640 1 -- 172.21.15.137:0/459541836 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600baaa0 msgr2=0x7f88600cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f885ed9d640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600baaa0 0x7f88600cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f885ed9d640 1 -- 172.21.15.137:0/459541836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8860162480 msgr2=0x7f88600cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f885ed9d640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8860162480 0x7f88600cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f885ed9d640 1 -- 172.21.15.137:0/459541836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88600cce90 con 0x7f886015d210 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f885ed9d640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f886015d210 0x7f8860161f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f88500079f0 tx=0x7f885000a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f88477fe640 1 -- 172.21.15.137:0/459541836 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850017020 con 0x7f886015d210 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f88477fe640 1 -- 172.21.15.137:0/459541836 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88500133f0 con 0x7f886015d210 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88600cd170 con 0x7f886015d210 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f88477fe640 1 -- 172.21.15.137:0/459541836 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88500137e0 con 0x7f886015d210 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.883+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f886015d5f0 con 0x7f886015d210 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.884+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88600d46f0 con 0x7f886015d210 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.885+0000 7f88477fe640 1 -- 172.21.15.137:0/459541836 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f885001a020 con 0x7f886015d210 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.885+0000 7f88477fe640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f884c06c8f0 0x7f884c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.885+0000 7f885e59c640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f884c06c8f0 0x7f884c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.885+0000 7f88477fe640 1 -- 172.21.15.137:0/459541836 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f885008c3a0 con 0x7f886015d210 2024-04-26T21:59:28.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.886+0000 7f885e59c640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f884c06c8f0 0x7f884c06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8860162880 tx=0x7f88540095d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:28.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:28.889+0000 7f88477fe640 1 -- 172.21.15.137:0/459541836 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f88600d46f0 con 0x7f886015d210 2024-04-26T21:59:29.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.133+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f886006a290 con 0x7f886015d210 2024-04-26T21:59:29.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.137+0000 7f88477fe640 1 -- 172.21.15.137:0/459541836 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f8850021020 con 0x7f886015d210 2024-04-26T21:59:29.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.139+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f884c06c8f0 msgr2=0x7f884c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.139+0000 7f886502c640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f884c06c8f0 0x7f884c06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8860162880 tx=0x7f88540095d0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.139+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f886015d210 msgr2=0x7f8860161f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.139+0000 7f886502c640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f886015d210 0x7f8860161f40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f88500079f0 tx=0x7f885000a730 comp rx=0 tx=0).stop 2024-04-26T21:59:29.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.139+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 shutdown_connections 2024-04-26T21:59:29.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.139+0000 7f886502c640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f884c06c8f0 0x7f884c06edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.139+0000 7f886502c640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88600baaa0 0x7f88600cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.139+0000 7f886502c640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8860162480 0x7f88600cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.139+0000 7f886502c640 1 --2- 172.21.15.137:0/459541836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f886015d210 0x7f8860161f40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.140+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 >> 172.21.15.137:0/459541836 conn(0x7f886008ec10 msgr2=0x7f88600d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:29.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.140+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 shutdown_connections 2024-04-26T21:59:29.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.140+0000 7f886502c640 1 -- 172.21.15.137:0/459541836 wait complete. 2024-04-26T21:59:29.150 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-26T21:59:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.248+0000 7fcb12c28640 1 Processor -- start 2024-04-26T21:59:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.248+0000 7fcb12c28640 1 -- start start 2024-04-26T21:59:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.248+0000 7fcb12c28640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb0c145980 0x7fcb0c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.248+0000 7fcb12c28640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcb0c0b3de0 0x7fcb0c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.248+0000 7fcb12c28640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb0c0b4260 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.248+0000 7fcb12c28640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcb0c0b5140 con 0x7fcb0c145980 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.248+0000 7fcb12c28640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcb0c0b6410 con 0x7fcb0c0b3de0 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.249+0000 7fcb109c4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb0c145980 0x7fcb0c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.249+0000 7fcb109c4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb0c145980 0x7fcb0c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41904/0 (socket says 172.21.15.137:41904) 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.249+0000 7fcb109c4640 1 -- 172.21.15.137:0/1484054463 learned_addr learned my addr 172.21.15.137:0/1484054463 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.249+0000 7fcb0bfff640 1 --2- 172.21.15.137:0/1484054463 >> v2:172.21.15.170:3300/0 conn(0x7fcb0c0b3de0 0x7fcb0c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.249+0000 7fcb109c4640 1 -- 172.21.15.137:0/1484054463 >> v2:172.21.15.170:3300/0 conn(0x7fcb0c0b3de0 msgr2=0x7fcb0c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.249+0000 7fcb109c4640 1 --2- 172.21.15.137:0/1484054463 >> v2:172.21.15.170:3300/0 conn(0x7fcb0c0b3de0 0x7fcb0c0b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.249+0000 7fcb109c4640 1 -- 172.21.15.137:0/1484054463 >> v1:172.21.15.170:6789/0 conn(0x7fcb0c0b5fd0 legacy=0x7fcb0c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.249+0000 7fcb109c4640 1 -- 172.21.15.137:0/1484054463 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0c0b4530 con 0x7fcb0c145980 2024-04-26T21:59:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb109c4640 1 --2- 172.21.15.137:0/1484054463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c145980 0x7fcb0c160630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0d0d00 tx=0x7fcb0002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810a9392b694efc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb0b7fe640 1 -- 172.21.15.137:0/1484054463 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00037070 con 0x7fcb0c145980 2024-04-26T21:59:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb0b7fe640 1 -- 172.21.15.137:0/1484054463 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb00032440 con 0x7fcb0c145980 2024-04-26T21:59:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb0b7fe640 1 -- 172.21.15.137:0/1484054463 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00032810 con 0x7fcb0c145980 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb12c28640 1 -- 172.21.15.137:0/1484054463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c145980 msgr2=0x7fcb0c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb12c28640 1 --2- 172.21.15.137:0/1484054463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c145980 0x7fcb0c160630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0d0d00 tx=0x7fcb0002a1a0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb12c28640 1 -- 172.21.15.137:0/1484054463 shutdown_connections 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb12c28640 1 --2- 172.21.15.137:0/1484054463 >> v2:172.21.15.170:3300/0 conn(0x7fcb0c0b3de0 0x7fcb0c0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb12c28640 1 --2- 172.21.15.137:0/1484054463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c145980 0x7fcb0c160630 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb12c28640 1 -- 172.21.15.137:0/1484054463 >> 172.21.15.137:0/1484054463 conn(0x7fcb0c0d0d30 msgr2=0x7fcb0c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb12c28640 1 -- 172.21.15.137:0/1484054463 shutdown_connections 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.250+0000 7fcb12c28640 1 -- 172.21.15.137:0/1484054463 wait complete. 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.251+0000 7fcb12c28640 1 Processor -- start 2024-04-26T21:59:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.252+0000 7fcb12c28640 1 -- start start 2024-04-26T21:59:29.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.252+0000 7fcb12c28640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb0c0b3de0 0x7fcb0c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.252+0000 7fcb12c28640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c0b5fd0 0x7fcb0c1363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.252+0000 7fcb12c28640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb0c145980 0x7fcb0c137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.252+0000 7fcb12c28640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c0b4dd0 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.252+0000 7fcb12c28640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c0b4af0 con 0x7fcb0c0b3de0 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.252+0000 7fcb12c28640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcb0c0730e0 con 0x7fcb0c145980 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.252+0000 7fcb0bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c0b5fd0 0x7fcb0c1363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb0bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c0b5fd0 0x7fcb0c1363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41914/0 (socket says 172.21.15.137:41914) 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb0bfff640 1 -- 172.21.15.137:0/293045812 learned_addr learned my addr 172.21.15.137:0/293045812 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb109c4640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb0c0b3de0 0x7fcb0c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb111c5640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb0c145980 0x7fcb0c137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb0bfff640 1 -- 172.21.15.137:0/293045812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb0c145980 msgr2=0x7fcb0c137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb0bfff640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb0c145980 0x7fcb0c137f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb0bfff640 1 -- 172.21.15.137:0/293045812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb0c0b3de0 msgr2=0x7fcb0c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb0bfff640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb0c0b3de0 0x7fcb0c15bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb0bfff640 1 -- 172.21.15.137:0/293045812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0c133710 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb111c5640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb0c145980 0x7fcb0c137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:29.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb0bfff640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c0b5fd0 0x7fcb0c1363d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c7f0 tx=0x7fcaf800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb097fa640 1 -- 172.21.15.137:0/293045812 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8015070 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb097fa640 1 -- 172.21.15.137:0/293045812 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf8004240 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0c1339f0 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb097fa640 1 -- 172.21.15.137:0/293045812 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8007620 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.253+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0c133fb0 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.254+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb0c06a290 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.255+0000 7fcb097fa640 1 -- 172.21.15.137:0/293045812 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcaf80079d0 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.255+0000 7fcb097fa640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcaf006c8f0 0x7fcaf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.255+0000 7fcb097fa640 1 -- 172.21.15.137:0/293045812 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fcaf808bb80 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.255+0000 7fcb109c4640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcaf006c8f0 0x7fcaf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.256+0000 7fcb109c4640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcaf006c8f0 0x7fcaf006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcb00034000 tx=0x7fcb0002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:29.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.259+0000 7fcb097fa640 1 -- 172.21.15.137:0/293045812 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcaf805a390 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.500+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fcb0c0d0a70 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.504+0000 7fcb097fa640 1 -- 172.21.15.137:0/293045812 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fcaf8059c90 con 0x7fcb0c0b5fd0 2024-04-26T21:59:29.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcaf006c8f0 msgr2=0x7fcaf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcaf006c8f0 0x7fcaf006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcb00034000 tx=0x7fcb0002e000 comp rx=0 tx=0).stop 2024-04-26T21:59:29.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c0b5fd0 msgr2=0x7fcb0c1363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c0b5fd0 0x7fcb0c1363d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c7f0 tx=0x7fcaf800ccb0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 shutdown_connections 2024-04-26T21:59:29.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcaf006c8f0 0x7fcaf006edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb0c0b5fd0 0x7fcb0c1363d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb0c145980 0x7fcb0c137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 --2- 172.21.15.137:0/293045812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb0c0b3de0 0x7fcb0c15bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 >> 172.21.15.137:0/293045812 conn(0x7fcb0c0d0d30 msgr2=0x7fcb0c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:29.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 shutdown_connections 2024-04-26T21:59:29.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.506+0000 7fcb12c28640 1 -- 172.21.15.137:0/293045812 wait complete. 2024-04-26T21:59:29.517 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-26T21:59:29.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.614+0000 7f8eb3f89640 1 Processor -- start 2024-04-26T21:59:29.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.614+0000 7f8eb3f89640 1 -- start start 2024-04-26T21:59:29.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb3f89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac15b4e0 0x7f8eac071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb3f89640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8eac06f2c0 0x7f8eac0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb3f89640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eac0733e0 con 0x7f8eac15b8c0 2024-04-26T21:59:29.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb3f89640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8eac0ce230 con 0x7f8eac06f2c0 2024-04-26T21:59:29.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb3f89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8eac072f00 con 0x7f8eac15b4e0 2024-04-26T21:59:29.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb2526640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8eac06f2c0 0x7f8eac0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb1524640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8eac15b8c0 0x7f8eac06ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57304/0 (socket says 172.21.15.137:57304) 2024-04-26T21:59:29.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb2526640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8eac06f2c0 0x7f8eac0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41916/0 (socket says 172.21.15.137:41916) 2024-04-26T21:59:29.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb1524640 1 -- 172.21.15.137:0/1383771343 learned_addr learned my addr 172.21.15.137:0/1383771343 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb2526640 1 -- 172.21.15.137:0/1383771343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac15b4e0 msgr2=0x7f8eac071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb1d25640 1 --2- 172.21.15.137:0/1383771343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac15b4e0 0x7f8eac071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb0d23640 1 -- 172.21.15.137:0/1383771343 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161655232 0 0) 0x7f8eac0733e0 con 0x7f8eac15b8c0 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb2526640 1 --2- 172.21.15.137:0/1383771343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac15b4e0 0x7f8eac071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb2526640 1 -- 172.21.15.137:0/1383771343 >> v1:172.21.15.137:6789/0 conn(0x7f8eac15b8c0 legacy=0x7f8eac06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.615+0000 7f8eb2526640 1 -- 172.21.15.137:0/1383771343 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac072660 con 0x7f8eac06f2c0 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.616+0000 7f8eb2526640 1 --2- 172.21.15.137:0/1383771343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac06f2c0 0x7f8eac0cdcf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400bfa0 tx=0x7f8ea402c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f52392f813f8bb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.616+0000 7f8eb0d23640 1 -- 172.21.15.137:0/1383771343 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4039070 con 0x7f8eac06f2c0 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.616+0000 7f8eb0d23640 1 -- 172.21.15.137:0/1383771343 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea4009540 con 0x7f8eac06f2c0 2024-04-26T21:59:29.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.616+0000 7f8eb0d23640 1 -- 172.21.15.137:0/1383771343 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4009910 con 0x7f8eac06f2c0 2024-04-26T21:59:29.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.616+0000 7f8eb3f89640 1 -- 172.21.15.137:0/1383771343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac06f2c0 msgr2=0x7f8eac0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.617+0000 7f8eb3f89640 1 --2- 172.21.15.137:0/1383771343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac06f2c0 0x7f8eac0cdcf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400bfa0 tx=0x7f8ea402c860 comp rx=0 tx=0).stop 2024-04-26T21:59:29.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.617+0000 7f8eb3f89640 1 -- 172.21.15.137:0/1383771343 shutdown_connections 2024-04-26T21:59:29.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.617+0000 7f8eb3f89640 1 --2- 172.21.15.137:0/1383771343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac06f2c0 0x7f8eac0cdcf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.617+0000 7f8eb3f89640 1 --2- 172.21.15.137:0/1383771343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac15b4e0 0x7f8eac071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.617+0000 7f8eb3f89640 1 -- 172.21.15.137:0/1383771343 >> 172.21.15.137:0/1383771343 conn(0x7f8eac0d0d30 msgr2=0x7f8eac0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.617+0000 7f8eb3f89640 1 -- 172.21.15.137:0/1383771343 shutdown_connections 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.617+0000 7f8eb3f89640 1 -- 172.21.15.137:0/1383771343 wait complete. 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.618+0000 7f8eb3f89640 1 Processor -- start 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.618+0000 7f8eb3f89640 1 -- start start 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.618+0000 7f8eb3f89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac06f2c0 0x7f8eac14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.618+0000 7f8eb3f89640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac15b4e0 0x7f8eac159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.618+0000 7f8eb3f89640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eac15b8c0 0x7f8eac0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.618+0000 7f8eb3f89640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac0b3e80 con 0x7f8eac15b4e0 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.618+0000 7f8eb3f89640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8eac072c20 con 0x7f8eac15b8c0 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.618+0000 7f8eb3f89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8eac073820 con 0x7f8eac06f2c0 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1524640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac15b4e0 0x7f8eac159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1524640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac15b4e0 0x7f8eac159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41918/0 (socket says 172.21.15.137:41918) 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1524640 1 -- 172.21.15.137:0/343834244 learned_addr learned my addr 172.21.15.137:0/343834244 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1524640 1 -- 172.21.15.137:0/343834244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac06f2c0 msgr2=0x7f8eac14fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1d25640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac06f2c0 0x7f8eac14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb2526640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eac15b8c0 0x7f8eac0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1524640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac06f2c0 0x7f8eac14fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1524640 1 -- 172.21.15.137:0/343834244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eac15b8c0 msgr2=0x7f8eac0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1524640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eac15b8c0 0x7f8eac0b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1524640 1 -- 172.21.15.137:0/343834244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eac153d10 con 0x7f8eac15b4e0 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb1524640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac15b4e0 0x7f8eac159830 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00c430 tx=0x7f8e9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8ea27fc640 1 -- 172.21.15.137:0/343834244 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0074e0 con 0x7f8eac15b4e0 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8ea27fc640 1 -- 172.21.15.137:0/343834244 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9c0047e0 con 0x7f8eac15b4e0 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eac153f90 con 0x7f8eac15b4e0 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8ea27fc640 1 -- 172.21.15.137:0/343834244 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c004bd0 con 0x7f8eac15b4e0 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.619+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eac154550 con 0x7f8eac15b4e0 2024-04-26T21:59:29.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.620+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eac06a290 con 0x7f8eac15b4e0 2024-04-26T21:59:29.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.620+0000 7f8ea27fc640 1 -- 172.21.15.137:0/343834244 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e9c011070 con 0x7f8eac15b4e0 2024-04-26T21:59:29.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.621+0000 7f8ea27fc640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9006c920 0x7f8e9006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.621+0000 7f8eb1d25640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9006c920 0x7f8e9006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.621+0000 7f8ea27fc640 1 -- 172.21.15.137:0/343834244 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8e9c08b390 con 0x7f8eac15b4e0 2024-04-26T21:59:29.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.621+0000 7f8eb1d25640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9006c920 0x7f8e9006ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8006fd0 tx=0x7f8ea8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:29.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.625+0000 7f8ea27fc640 1 -- 172.21.15.137:0/343834244 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8eac153d10 con 0x7f8eac15b4e0 2024-04-26T21:59:29.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.871+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f8eac06d2b0 con 0x7f8eac15b4e0 2024-04-26T21:59:29.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.873+0000 7f8ea27fc640 1 -- 172.21.15.137:0/343834244 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f8e9c00e280 con 0x7f8eac15b4e0 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9006c920 msgr2=0x7f8e9006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9006c920 0x7f8e9006ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8006fd0 tx=0x7f8ea8008040 comp rx=0 tx=0).stop 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac15b4e0 msgr2=0x7f8eac159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac15b4e0 0x7f8eac159830 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00c430 tx=0x7f8e9c00c8f0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 shutdown_connections 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9006c920 0x7f8e9006ede0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8eac15b4e0 0x7f8eac159830 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8eac15b8c0 0x7f8eac0b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 --2- 172.21.15.137:0/343834244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8eac06f2c0 0x7f8eac14fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 >> 172.21.15.137:0/343834244 conn(0x7f8eac0d0d30 msgr2=0x7f8eac0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 shutdown_connections 2024-04-26T21:59:29.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.875+0000 7f8eb3f89640 1 -- 172.21.15.137:0/343834244 wait complete. 2024-04-26T21:59:29.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-26T21:59:29.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.984+0000 7fc760f40640 1 Processor -- start 2024-04-26T21:59:29.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.984+0000 7fc760f40640 1 -- start start 2024-04-26T21:59:29.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc760f40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c06f2c0 0x7fc75c071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc760f40640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc75c15b8c0 0x7fc75c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc760f40640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc75c0733e0 con 0x7fc75c15b4e0 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc760f40640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc75c0ce230 con 0x7fc75c15b8c0 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc760f40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc75c072f00 con 0x7fc75c06f2c0 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc75ad9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc75c15b8c0 0x7fc75c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc75ad9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc75c15b8c0 0x7fc75c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41930/0 (socket says 172.21.15.137:41930) 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc75ad9d640 1 -- 172.21.15.137:0/876165495 learned_addr learned my addr 172.21.15.137:0/876165495 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc753fff640 1 --2- 172.21.15.137:0/876165495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c06f2c0 0x7fc75c071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc75ad9d640 1 -- 172.21.15.137:0/876165495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c06f2c0 msgr2=0x7fc75c071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc75ad9d640 1 --2- 172.21.15.137:0/876165495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c06f2c0 0x7fc75c071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc75ad9d640 1 -- 172.21.15.137:0/876165495 >> v1:172.21.15.170:6789/0 conn(0x7fc75c15b4e0 legacy=0x7fc75c06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.985+0000 7fc75ad9d640 1 -- 172.21.15.137:0/876165495 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c072660 con 0x7fc75c15b8c0 2024-04-26T21:59:29.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.986+0000 7fc75ad9d640 1 --2- 172.21.15.137:0/876165495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c15b8c0 0x7fc75c0cdcf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc75400d150 tx=0x7fc75402c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e84f9e99e54c5aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.986+0000 7fc759d9b640 1 -- 172.21.15.137:0/876165495 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75400b2e0 con 0x7fc75c15b8c0 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.986+0000 7fc759d9b640 1 -- 172.21.15.137:0/876165495 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc754009600 con 0x7fc75c15b8c0 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.986+0000 7fc759d9b640 1 -- 172.21.15.137:0/876165495 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75400b480 con 0x7fc75c15b8c0 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.986+0000 7fc760f40640 1 -- 172.21.15.137:0/876165495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c15b8c0 msgr2=0x7fc75c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.986+0000 7fc760f40640 1 --2- 172.21.15.137:0/876165495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c15b8c0 0x7fc75c0cdcf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc75400d150 tx=0x7fc75402c8e0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.987+0000 7fc760f40640 1 -- 172.21.15.137:0/876165495 shutdown_connections 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.987+0000 7fc760f40640 1 --2- 172.21.15.137:0/876165495 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c15b8c0 0x7fc75c0cdcf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.987+0000 7fc760f40640 1 --2- 172.21.15.137:0/876165495 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c06f2c0 0x7fc75c071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.987+0000 7fc760f40640 1 -- 172.21.15.137:0/876165495 >> 172.21.15.137:0/876165495 conn(0x7fc75c0d0d30 msgr2=0x7fc75c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.987+0000 7fc760f40640 1 -- 172.21.15.137:0/876165495 shutdown_connections 2024-04-26T21:59:29.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.987+0000 7fc760f40640 1 -- 172.21.15.137:0/876165495 wait complete. 2024-04-26T21:59:29.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.988+0000 7fc760f40640 1 Processor -- start 2024-04-26T21:59:29.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.988+0000 7fc760f40640 1 -- start start 2024-04-26T21:59:29.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.988+0000 7fc760f40640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c06f2c0 0x7fc75c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc760f40640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75c15b4e0 0x7fc75c149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc760f40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c15b8c0 0x7fc75c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc760f40640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c0b3e80 con 0x7fc75c06f2c0 2024-04-26T21:59:29.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc760f40640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c072c20 con 0x7fc75c15b4e0 2024-04-26T21:59:29.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc760f40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc75c073820 con 0x7fc75c15b8c0 2024-04-26T21:59:29.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc75a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c06f2c0 0x7fc75c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc75a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c06f2c0 0x7fc75c156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41944/0 (socket says 172.21.15.137:41944) 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc75a59c640 1 -- 172.21.15.137:0/3461773368 learned_addr learned my addr 172.21.15.137:0/3461773368 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc75a59c640 1 -- 172.21.15.137:0/3461773368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c15b8c0 msgr2=0x7fc75c1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc75a59c640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c15b8c0 0x7fc75c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc75a59c640 1 -- 172.21.15.137:0/3461773368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75c15b4e0 msgr2=0x7fc75c149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc75a59c640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75c15b4e0 0x7fc75c149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc75a59c640 1 -- 172.21.15.137:0/3461773368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c1572b0 con 0x7fc75c06f2c0 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc75a59c640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c06f2c0 0x7fc75c156c60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c430 tx=0x7fc74c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc752ffd640 1 -- 172.21.15.137:0/3461773368 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c011790 con 0x7fc75c06f2c0 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc752ffd640 1 -- 172.21.15.137:0/3461773368 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74c017070 con 0x7fc75c06f2c0 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75c146350 con 0x7fc75c06f2c0 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc752ffd640 1 -- 172.21.15.137:0/3461773368 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c011bb0 con 0x7fc75c06f2c0 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.989+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75c146910 con 0x7fc75c06f2c0 2024-04-26T21:59:29.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.990+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75c06a290 con 0x7fc75c06f2c0 2024-04-26T21:59:29.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.991+0000 7fc752ffd640 1 -- 172.21.15.137:0/3461773368 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc74c01c460 con 0x7fc75c06f2c0 2024-04-26T21:59:29.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.991+0000 7fc752ffd640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc73c06c920 0x7fc73c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:29.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.991+0000 7fc752ffd640 1 -- 172.21.15.137:0/3461773368 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fc74c08b5f0 con 0x7fc75c06f2c0 2024-04-26T21:59:29.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.991+0000 7fc753fff640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc73c06c920 0x7fc73c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:29.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.992+0000 7fc753fff640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc73c06c920 0x7fc73c06ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc75c14a850 tx=0x7fc744008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:29.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:29.996+0000 7fc752ffd640 1 -- 172.21.15.137:0/3461773368 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc74c059e00 con 0x7fc75c06f2c0 2024-04-26T21:59:30.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.240+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fc75c146ae0 con 0x7fc75c06f2c0 2024-04-26T21:59:30.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.242+0000 7fc752ffd640 1 -- 172.21.15.137:0/3461773368 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fc74c059700 con 0x7fc75c06f2c0 2024-04-26T21:59:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.244+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc73c06c920 msgr2=0x7fc73c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.244+0000 7fc760f40640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc73c06c920 0x7fc73c06ede0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc75c14a850 tx=0x7fc744008040 comp rx=0 tx=0).stop 2024-04-26T21:59:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.244+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c06f2c0 msgr2=0x7fc75c156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.244+0000 7fc760f40640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c06f2c0 0x7fc75c156c60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c430 tx=0x7fc74c00c8f0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.244+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 shutdown_connections 2024-04-26T21:59:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.245+0000 7fc760f40640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc73c06c920 0x7fc73c06ede0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.245+0000 7fc760f40640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc75c15b8c0 0x7fc75c1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.245+0000 7fc760f40640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc75c15b4e0 0x7fc75c149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.245+0000 7fc760f40640 1 --2- 172.21.15.137:0/3461773368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc75c06f2c0 0x7fc75c156c60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.245+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 >> 172.21.15.137:0/3461773368 conn(0x7fc75c0d0d30 msgr2=0x7fc75c15fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:30.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.245+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 shutdown_connections 2024-04-26T21:59:30.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.245+0000 7fc760f40640 1 -- 172.21.15.137:0/3461773368 wait complete. 2024-04-26T21:59:30.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:30.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.352+0000 7f2e4c112640 1 Processor -- start 2024-04-26T21:59:30.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.352+0000 7f2e4c112640 1 -- start start 2024-04-26T21:59:30.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4c112640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2e440b47d0 0x7f2e440b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4c112640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e440afe30 0x7f2e440b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4c112640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e440aed90 con 0x7f2e4415f4a0 2024-04-26T21:59:30.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4c112640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2e4415f880 con 0x7f2e440afe30 2024-04-26T21:59:30.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4c112640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2e440af9a0 con 0x7f2e440b47d0 2024-04-26T21:59:30.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4a6af640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e440afe30 0x7f2e440b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4a6af640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e440afe30 0x7f2e440b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41946/0 (socket says 172.21.15.137:41946) 2024-04-26T21:59:30.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e49eae640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2e4415f4a0 0x7f2e440b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57312/0 (socket says 172.21.15.137:57312) 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4a6af640 1 -- 172.21.15.137:0/392694983 learned_addr learned my addr 172.21.15.137:0/392694983 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4a6af640 1 -- 172.21.15.137:0/392694983 >> v2:172.21.15.170:3300/0 conn(0x7f2e440b47d0 msgr2=0x7f2e440b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e496ad640 1 --2- 172.21.15.137:0/392694983 >> v2:172.21.15.170:3300/0 conn(0x7f2e440b47d0 0x7f2e440b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4a6af640 1 --2- 172.21.15.137:0/392694983 >> v2:172.21.15.170:3300/0 conn(0x7f2e440b47d0 0x7f2e440b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e48eac640 1 -- 172.21.15.137:0/392694983 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2499636017 0 0) 0x7f2e440aed90 con 0x7f2e4415f4a0 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4a6af640 1 -- 172.21.15.137:0/392694983 >> v1:172.21.15.137:6789/0 conn(0x7f2e4415f4a0 legacy=0x7f2e440b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e4a6af640 1 -- 172.21.15.137:0/392694983 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e440af070 con 0x7f2e440afe30 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.353+0000 7f2e496ad640 1 --2- 172.21.15.137:0/392694983 >> v2:172.21.15.170:3300/0 conn(0x7f2e440b47d0 0x7f2e440b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.354+0000 7f2e4a6af640 1 --2- 172.21.15.137:0/392694983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 0x7f2e440b09b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e44070c10 tx=0x7f2e3c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618c3776f2eeef3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.354+0000 7f2e48eac640 1 -- 172.21.15.137:0/392694983 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c036070 con 0x7f2e440afe30 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.354+0000 7f2e48eac640 1 -- 172.21.15.137:0/392694983 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3c031600 con 0x7f2e440afe30 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.354+0000 7f2e48eac640 1 -- 172.21.15.137:0/392694983 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0319d0 con 0x7f2e440afe30 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.355+0000 7f2e4c112640 1 -- 172.21.15.137:0/392694983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 msgr2=0x7f2e440b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.355+0000 7f2e4c112640 1 --2- 172.21.15.137:0/392694983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 0x7f2e440b09b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2e44070c10 tx=0x7f2e3c02a730 comp rx=0 tx=0).stop 2024-04-26T21:59:30.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.355+0000 7f2e4c112640 1 -- 172.21.15.137:0/392694983 shutdown_connections 2024-04-26T21:59:30.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.355+0000 7f2e4c112640 1 --2- 172.21.15.137:0/392694983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 0x7f2e440b09b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.355+0000 7f2e4c112640 1 --2- 172.21.15.137:0/392694983 >> v2:172.21.15.170:3300/0 conn(0x7f2e440b47d0 0x7f2e440b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.355+0000 7f2e4c112640 1 -- 172.21.15.137:0/392694983 >> 172.21.15.137:0/392694983 conn(0x7f2e440b6800 msgr2=0x7f2e440738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:30.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.355+0000 7f2e4c112640 1 -- 172.21.15.137:0/392694983 shutdown_connections 2024-04-26T21:59:30.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.355+0000 7f2e4c112640 1 -- 172.21.15.137:0/392694983 wait complete. 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.356+0000 7f2e4c112640 1 Processor -- start 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.356+0000 7f2e4c112640 1 -- start start 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4c112640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 0x7f2e44158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4c112640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e440b47d0 0x7f2e441547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4c112640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e4415f4a0 0x7f2e44160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4c112640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e440aea80 con 0x7f2e440afe30 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4c112640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e440af630 con 0x7f2e4415f4a0 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4c112640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e440b6320 con 0x7f2e440b47d0 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e49eae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 0x7f2e44158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e49eae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 0x7f2e44158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41948/0 (socket says 172.21.15.137:41948) 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e49eae640 1 -- 172.21.15.137:0/3479903112 learned_addr learned my addr 172.21.15.137:0/3479903112 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:30.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e496ad640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e440b47d0 0x7f2e441547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e49eae640 1 -- 172.21.15.137:0/3479903112 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e440b47d0 msgr2=0x7f2e441547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4a6af640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e4415f4a0 0x7f2e44160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e49eae640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e440b47d0 0x7f2e441547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e49eae640 1 -- 172.21.15.137:0/3479903112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e4415f4a0 msgr2=0x7f2e44160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e49eae640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e4415f4a0 0x7f2e44160f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e49eae640 1 -- 172.21.15.137:0/3479903112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e44158c00 con 0x7f2e440afe30 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4a6af640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e4415f4a0 0x7f2e44160f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e49eae640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 0x7f2e44158500 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000c430 tx=0x7f2e4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e3a7fc640 1 -- 172.21.15.137:0/3479903112 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e400074e0 con 0x7f2e440afe30 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e3a7fc640 1 -- 172.21.15.137:0/3479903112 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e400047e0 con 0x7f2e440afe30 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e44158ee0 con 0x7f2e440afe30 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e3a7fc640 1 -- 172.21.15.137:0/3479903112 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40004bd0 con 0x7f2e440afe30 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.357+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e441594a0 con 0x7f2e440afe30 2024-04-26T21:59:30.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.358+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e4406a290 con 0x7f2e440afe30 2024-04-26T21:59:30.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.359+0000 7f2e3a7fc640 1 -- 172.21.15.137:0/3479903112 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e40011070 con 0x7f2e440afe30 2024-04-26T21:59:30.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.359+0000 7f2e3a7fc640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e2806c8f0 0x7f2e2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.359+0000 7f2e3a7fc640 1 -- 172.21.15.137:0/3479903112 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f2e4008b410 con 0x7f2e440afe30 2024-04-26T21:59:30.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.359+0000 7f2e496ad640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e2806c8f0 0x7f2e2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.360+0000 7f2e496ad640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e2806c8f0 0x7f2e2806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e4415ea10 tx=0x7f2e34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:30.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.364+0000 7f2e3a7fc640 1 -- 172.21.15.137:0/3479903112 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2e40059c20 con 0x7f2e440afe30 2024-04-26T21:59:30.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.539+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e44154d10 con 0x7f2e440afe30 2024-04-26T21:59:30.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.540+0000 7f2e3a7fc640 1 -- 172.21.15.137:0/3479903112 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+12903 (secure 0 0 0) 0x7f2e40059520 con 0x7f2e440afe30 2024-04-26T21:59:30.540 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:30.540 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":30,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:27.654756+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e2806c8f0 msgr2=0x7f2e2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e2806c8f0 0x7f2e2806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2e4415ea10 tx=0x7f2e34008040 comp rx=0 tx=0).stop 2024-04-26T21:59:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 msgr2=0x7f2e44158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 0x7f2e44158500 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000c430 tx=0x7f2e4000c8f0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 shutdown_connections 2024-04-26T21:59:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e2806c8f0 0x7f2e2806edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e4415f4a0 0x7f2e44160f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e440b47d0 0x7f2e441547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 --2- 172.21.15.137:0/3479903112 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e440afe30 0x7f2e44158500 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 >> 172.21.15.137:0/3479903112 conn(0x7f2e440b6800 msgr2=0x7f2e440b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 shutdown_connections 2024-04-26T21:59:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.542+0000 7f2e4c112640 1 -- 172.21.15.137:0/3479903112 wait complete. 2024-04-26T21:59:30.553 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:30.554 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:30.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.654+0000 7f056ad1b640 1 Processor -- start 2024-04-26T21:59:30.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.654+0000 7f056ad1b640 1 -- start start 2024-04-26T21:59:30.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.654+0000 7f056ad1b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f05640737a0 0x7f056406f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.654+0000 7f056ad1b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05640cfec0 con 0x7f05640d14d0 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.654+0000 7f056ad1b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05640d01a0 con 0x7f05640cd940 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.654+0000 7f056ad1b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f05640d07f0 con 0x7f05640737a0 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.655+0000 7f05692b8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f05640737a0 0x7f056406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.655+0000 7f05692b8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f05640737a0 0x7f056406f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41958/0 (socket says 172.21.15.137:41958) 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.655+0000 7f05692b8640 1 -- 172.21.15.137:0/3101616021 learned_addr learned my addr 172.21.15.137:0/3101616021 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.655+0000 7f05692b8640 1 -- 172.21.15.137:0/3101616021 >> v1:172.21.15.170:6789/0 conn(0x7f05640cd940 legacy=0x7f0564070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.655+0000 7f05692b8640 1 -- 172.21.15.137:0/3101616021 >> v1:172.21.15.137:6789/0 conn(0x7f05640d14d0 legacy=0x7f0564073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.655+0000 7f05637fe640 1 -- 172.21.15.137:0/3101616021 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1203110323 0 0) 0x7f05640cfec0 con 0x7f05640d14d0 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.655+0000 7f05692b8640 1 -- 172.21.15.137:0/3101616021 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05640d0480 con 0x7f05640737a0 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f05692b8640 1 --2- 172.21.15.137:0/3101616021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 0x7f056406f020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0554009870 tx=0x7f055402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d035abffa68adc6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f05637fe640 1 -- 172.21.15.137:0/3101616021 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554037070 con 0x7f05640737a0 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f05637fe640 1 -- 172.21.15.137:0/3101616021 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055402ae50 con 0x7f05640737a0 2024-04-26T21:59:30.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f05637fe640 1 -- 172.21.15.137:0/3101616021 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554032860 con 0x7f05640737a0 2024-04-26T21:59:30.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f056ad1b640 1 -- 172.21.15.137:0/3101616021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 msgr2=0x7f056406f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f056ad1b640 1 --2- 172.21.15.137:0/3101616021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 0x7f056406f020 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0554009870 tx=0x7f055402a300 comp rx=0 tx=0).stop 2024-04-26T21:59:30.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f056ad1b640 1 -- 172.21.15.137:0/3101616021 shutdown_connections 2024-04-26T21:59:30.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f056ad1b640 1 --2- 172.21.15.137:0/3101616021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 0x7f056406f020 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f056ad1b640 1 -- 172.21.15.137:0/3101616021 >> 172.21.15.137:0/3101616021 conn(0x7f05640d1e40 msgr2=0x7f05640d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:30.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f056ad1b640 1 -- 172.21.15.137:0/3101616021 shutdown_connections 2024-04-26T21:59:30.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.656+0000 7f056ad1b640 1 -- 172.21.15.137:0/3101616021 wait complete. 2024-04-26T21:59:30.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.657+0000 7f056ad1b640 1 Processor -- start 2024-04-26T21:59:30.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.658+0000 7f056ad1b640 1 -- start start 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.658+0000 7f056ad1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 0x7f0564158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.658+0000 7f056ad1b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05640cd940 0x7f0564160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.658+0000 7f056ad1b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05640d14d0 0x7f056415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f056ad1b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f05640d0e00 con 0x7f05640737a0 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f056ad1b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f05640d0c80 con 0x7f05640d14d0 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f056ad1b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f05640d0f80 con 0x7f05640cd940 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0568ab7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 0x7f0564158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0568ab7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 0x7f0564158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41974/0 (socket says 172.21.15.137:41974) 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0568ab7640 1 -- 172.21.15.137:0/3352916475 learned_addr learned my addr 172.21.15.137:0/3352916475 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f05692b8640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05640d14d0 0x7f056415a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0563fff640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05640cd940 0x7f0564160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0568ab7640 1 -- 172.21.15.137:0/3352916475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05640cd940 msgr2=0x7f0564160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0568ab7640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05640cd940 0x7f0564160fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0568ab7640 1 -- 172.21.15.137:0/3352916475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05640d14d0 msgr2=0x7f056415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0568ab7640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05640d14d0 0x7f056415a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0568ab7640 1 -- 172.21.15.137:0/3352916475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0564158c40 con 0x7f05640737a0 2024-04-26T21:59:30.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.659+0000 7f0568ab7640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 0x7f0564158700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c870 tx=0x7f055c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:30.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.661+0000 7f05617fa640 1 -- 172.21.15.137:0/3352916475 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c003b70 con 0x7f05640737a0 2024-04-26T21:59:30.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.661+0000 7f05617fa640 1 -- 172.21.15.137:0/3352916475 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055c003d30 con 0x7f05640737a0 2024-04-26T21:59:30.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.661+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05640c7820 con 0x7f05640737a0 2024-04-26T21:59:30.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.661+0000 7f05617fa640 1 -- 172.21.15.137:0/3352916475 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c00aa90 con 0x7f05640737a0 2024-04-26T21:59:30.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.661+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056415b070 con 0x7f05640737a0 2024-04-26T21:59:30.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.662+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05640693d0 con 0x7f05640737a0 2024-04-26T21:59:30.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.662+0000 7f05617fa640 1 -- 172.21.15.137:0/3352916475 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f055c00ac30 con 0x7f05640737a0 2024-04-26T21:59:30.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.663+0000 7f05617fa640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f054406c8f0 0x7f054406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.663+0000 7f05617fa640 1 -- 172.21.15.137:0/3352916475 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f055c08b5c0 con 0x7f05640737a0 2024-04-26T21:59:30.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.663+0000 7f0563fff640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f054406c8f0 0x7f054406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.663+0000 7f0563fff640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f054406c8f0 0x7f054406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0564160c40 tx=0x7f054c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:30.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.667+0000 7f05617fa640 1 -- 172.21.15.137:0/3352916475 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f055c059780 con 0x7f05640737a0 2024-04-26T21:59:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.843+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f05640b7dc0 con 0x7f05640737a0 2024-04-26T21:59:30.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.843+0000 7f05617fa640 1 -- 172.21.15.137:0/3352916475 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7f055c05da80 con 0x7f05640737a0 2024-04-26T21:59:30.844 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f054406c8f0 msgr2=0x7f054406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f054406c8f0 0x7f054406edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0564160c40 tx=0x7f054c009040 comp rx=0 tx=0).stop 2024-04-26T21:59:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 msgr2=0x7f0564158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 0x7f0564158700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c870 tx=0x7f055c00cd30 comp rx=0 tx=0).stop 2024-04-26T21:59:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 shutdown_connections 2024-04-26T21:59:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f054406c8f0 0x7f054406edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05640d14d0 0x7f056415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f05640cd940 0x7f0564160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 --2- 172.21.15.137:0/3352916475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f05640737a0 0x7f0564158700 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.845+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 >> 172.21.15.137:0/3352916475 conn(0x7f05640d1e40 msgr2=0x7f05640b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.846+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 shutdown_connections 2024-04-26T21:59:30.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.846+0000 7f056ad1b640 1 -- 172.21.15.137:0/3352916475 wait complete. 2024-04-26T21:59:30.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T21:59:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.952+0000 7fad57ab0640 1 Processor -- start 2024-04-26T21:59:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.953+0000 7fad57ab0640 1 -- start start 2024-04-26T21:59:30.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.953+0000 7fad57ab0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad500d3ee0 0x7fad500cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.953+0000 7fad57ab0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad500d03a0 con 0x7fad5015f370 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.953+0000 7fad57ab0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad500d0680 con 0x7fad5015f750 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.953+0000 7fad57ab0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fad500d0960 con 0x7fad500d3ee0 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.954+0000 7fad5504b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad500d3ee0 0x7fad500cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.954+0000 7fad5584c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fad5015f370 0x7fad500d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57326/0 (socket says 172.21.15.137:57326) 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.954+0000 7fad5504b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fad500d3ee0 0x7fad500cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41990/0 (socket says 172.21.15.137:41990) 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.954+0000 7fad5584c640 1 -- 172.21.15.137:0/257844137 learned_addr learned my addr 172.21.15.137:0/257844137 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.954+0000 7fad5504b640 1 -- 172.21.15.137:0/257844137 >> v1:172.21.15.170:6789/0 conn(0x7fad5015f750 legacy=0x7fad500b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.954+0000 7fad5504b640 1 -- 172.21.15.137:0/257844137 >> v1:172.21.15.137:6789/0 conn(0x7fad5015f370 legacy=0x7fad500d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.954+0000 7fad5504b640 1 -- 172.21.15.137:0/257844137 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad500d0c40 con 0x7fad500d3ee0 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.954+0000 7fad5484a640 1 -- 172.21.15.137:0/257844137 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2169734762 0 0) 0x7fad500d03a0 con 0x7fad5015f370 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad5504b640 1 --2- 172.21.15.137:0/257844137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 0x7fad500cfd70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fad400097d0 tx=0x7fad4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c4aabd2238bdb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:30.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad5484a640 1 -- 172.21.15.137:0/257844137 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40037070 con 0x7fad500d3ee0 2024-04-26T21:59:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad5484a640 1 -- 172.21.15.137:0/257844137 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad40032440 con 0x7fad500d3ee0 2024-04-26T21:59:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad5484a640 1 -- 172.21.15.137:0/257844137 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad40032810 con 0x7fad500d3ee0 2024-04-26T21:59:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad57ab0640 1 -- 172.21.15.137:0/257844137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 msgr2=0x7fad500cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad57ab0640 1 --2- 172.21.15.137:0/257844137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 0x7fad500cfd70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fad400097d0 tx=0x7fad4002a270 comp rx=0 tx=0).stop 2024-04-26T21:59:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad57ab0640 1 -- 172.21.15.137:0/257844137 shutdown_connections 2024-04-26T21:59:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad57ab0640 1 --2- 172.21.15.137:0/257844137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 0x7fad500cfd70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad57ab0640 1 -- 172.21.15.137:0/257844137 >> 172.21.15.137:0/257844137 conn(0x7fad5008ec10 msgr2=0x7fad5009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad57ab0640 1 -- 172.21.15.137:0/257844137 shutdown_connections 2024-04-26T21:59:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.955+0000 7fad57ab0640 1 -- 172.21.15.137:0/257844137 wait complete. 2024-04-26T21:59:30.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.956+0000 7fad57ab0640 1 Processor -- start 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad57ab0640 1 -- start start 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad57ab0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 0x7fad50158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad57ab0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad5015f370 0x7fad501623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad57ab0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad5015f750 0x7fad501f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad57ab0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fad500b4950 con 0x7fad500d3ee0 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad57ab0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fad500b47d0 con 0x7fad5015f370 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad57ab0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fad500b4ad0 con 0x7fad5015f750 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad5584c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 0x7fad50158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad5584c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 0x7fad50158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42000/0 (socket says 172.21.15.137:42000) 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad5584c640 1 -- 172.21.15.137:0/3560382010 learned_addr learned my addr 172.21.15.137:0/3560382010 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad5504b640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad5015f370 0x7fad501623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.957+0000 7fad5604d640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad5015f750 0x7fad501f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad5584c640 1 -- 172.21.15.137:0/3560382010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad5015f750 msgr2=0x7fad501f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad5584c640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad5015f750 0x7fad501f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad5584c640 1 -- 172.21.15.137:0/3560382010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad5015f370 msgr2=0x7fad501623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad5584c640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad5015f370 0x7fad501623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad5584c640 1 -- 172.21.15.137:0/3560382010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad500cd310 con 0x7fad500d3ee0 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad5584c640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 0x7fad50158850 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fad4800c4a0 tx=0x7fad4800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad467fc640 1 -- 172.21.15.137:0/3560382010 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48018070 con 0x7fad500d3ee0 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad467fc640 1 -- 172.21.15.137:0/3560382010 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad480074e0 con 0x7fad500d3ee0 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5015ffa0 con 0x7fad500d3ee0 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad467fc640 1 -- 172.21.15.137:0/3560382010 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48004a20 con 0x7fad500d3ee0 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.958+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad500cd5b0 con 0x7fad500d3ee0 2024-04-26T21:59:30.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.959+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5006a290 con 0x7fad500d3ee0 2024-04-26T21:59:30.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.959+0000 7fad467fc640 1 -- 172.21.15.137:0/3560382010 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad4801b070 con 0x7fad500d3ee0 2024-04-26T21:59:30.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.960+0000 7fad467fc640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad3406c8f0 0x7fad3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:30.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.960+0000 7fad467fc640 1 -- 172.21.15.137:0/3560382010 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fad4808aa10 con 0x7fad500d3ee0 2024-04-26T21:59:30.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.960+0000 7fad5504b640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad3406c8f0 0x7fad3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:30.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.960+0000 7fad5504b640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad3406c8f0 0x7fad3406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad40034000 tx=0x7fad4002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:30.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:30.964+0000 7fad467fc640 1 -- 172.21.15.137:0/3560382010 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fad48058b40 con 0x7fad500d3ee0 2024-04-26T21:59:31.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.141+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fad500bad70 con 0x7fad500d3ee0 2024-04-26T21:59:31.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.141+0000 7fad467fc640 1 -- 172.21.15.137:0/3560382010 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7fad4805ce40 con 0x7fad500d3ee0 2024-04-26T21:59:31.141 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:31.141 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T21:59:31.142 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T21:59:31.142 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T21:59:31.142 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T21:59:31.142 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T21:59:31.142 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T21:59:31.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad3406c8f0 msgr2=0x7fad3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad3406c8f0 0x7fad3406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad40034000 tx=0x7fad4002e000 comp rx=0 tx=0).stop 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 msgr2=0x7fad50158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 0x7fad50158850 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fad4800c4a0 tx=0x7fad4800c960 comp rx=0 tx=0).stop 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 shutdown_connections 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fad3406c8f0 0x7fad3406edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fad5015f750 0x7fad501f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad5015f370 0x7fad501623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 --2- 172.21.15.137:0/3560382010 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fad500d3ee0 0x7fad50158850 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 >> 172.21.15.137:0/3560382010 conn(0x7fad5008ec10 msgr2=0x7fad500d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 shutdown_connections 2024-04-26T21:59:31.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.143+0000 7fad57ab0640 1 -- 172.21.15.137:0/3560382010 wait complete. 2024-04-26T21:59:31.154 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T21:59:31.154 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T21:59:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.255+0000 7fee10608640 1 Processor -- start 2024-04-26T21:59:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.255+0000 7fee10608640 1 -- start start 2024-04-26T21:59:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee10608640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee08070940 0x7fee0806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee10608640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee081632c0 con 0x7fee080d21f0 2024-04-26T21:59:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee10608640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee08163580 con 0x7fee08148d40 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee10608640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fee08163e20 con 0x7fee08070940 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee0e3a4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee08070940 0x7fee0806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee0e3a4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee08070940 0x7fee0806f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42008/0 (socket says 172.21.15.137:42008) 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee0e3a4640 1 -- 172.21.15.137:0/1304144325 learned_addr learned my addr 172.21.15.137:0/1304144325 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee0eba5640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fee080d21f0 0x7fee080d1120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57332/0 (socket says 172.21.15.137:57332) 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee0e3a4640 1 -- 172.21.15.137:0/1304144325 >> v1:172.21.15.170:6789/0 conn(0x7fee08148d40 legacy=0x7fee080731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee0e3a4640 1 -- 172.21.15.137:0/1304144325 >> v1:172.21.15.137:6789/0 conn(0x7fee080d21f0 legacy=0x7fee080d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee0e3a4640 1 -- 172.21.15.137:0/1304144325 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee08163860 con 0x7fee08070940 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.256+0000 7fee0d3a2640 1 -- 172.21.15.137:0/1304144325 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582412840 0 0) 0x7fee081632c0 con 0x7fee080d21f0 2024-04-26T21:59:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.257+0000 7fee0e3a4640 1 --2- 172.21.15.137:0/1304144325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee08070940 0x7fee0806f440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee0402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69dbcc6a1358119 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.257+0000 7fee0d3a2640 1 -- 172.21.15.137:0/1304144325 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04037070 con 0x7fee08070940 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.257+0000 7fee0d3a2640 1 -- 172.21.15.137:0/1304144325 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0402ae50 con 0x7fee08070940 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.257+0000 7fee0d3a2640 1 -- 172.21.15.137:0/1304144325 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04032860 con 0x7fee08070940 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.257+0000 7fee10608640 1 -- 172.21.15.137:0/1304144325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee08070940 msgr2=0x7fee0806f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.257+0000 7fee10608640 1 --2- 172.21.15.137:0/1304144325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee08070940 0x7fee0806f440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee0402a300 comp rx=0 tx=0).stop 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.257+0000 7fee10608640 1 -- 172.21.15.137:0/1304144325 shutdown_connections 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.257+0000 7fee10608640 1 --2- 172.21.15.137:0/1304144325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee08070940 0x7fee0806f440 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.257+0000 7fee10608640 1 -- 172.21.15.137:0/1304144325 >> 172.21.15.137:0/1304144325 conn(0x7fee0806d590 msgr2=0x7fee0806d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.258+0000 7fee10608640 1 -- 172.21.15.137:0/1304144325 shutdown_connections 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.258+0000 7fee10608640 1 -- 172.21.15.137:0/1304144325 wait complete. 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee10608640 1 Processor -- start 2024-04-26T21:59:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee10608640 1 -- start start 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee10608640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee08070940 0x7fee08143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee10608640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee080d21f0 0x7fee080b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee10608640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee08148d40 0x7fee080b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee10608640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee080d1830 con 0x7fee080d21f0 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee10608640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fee08162fb0 con 0x7fee08070940 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee10608640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee080d19b0 con 0x7fee08148d40 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee0dba3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee080d21f0 0x7fee080b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.259+0000 7fee0dba3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee080d21f0 0x7fee080b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42018/0 (socket says 172.21.15.137:42018) 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee0dba3640 1 -- 172.21.15.137:0/2892267913 learned_addr learned my addr 172.21.15.137:0/2892267913 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:31.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee0e3a4640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee08070940 0x7fee08143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee0eba5640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee08148d40 0x7fee080b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee0dba3640 1 -- 172.21.15.137:0/2892267913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee08148d40 msgr2=0x7fee080b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee0dba3640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee08148d40 0x7fee080b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee0dba3640 1 -- 172.21.15.137:0/2892267913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee08070940 msgr2=0x7fee08143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee0dba3640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee08070940 0x7fee08143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee0dba3640 1 -- 172.21.15.137:0/2892267913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee08161350 con 0x7fee080d21f0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee0dba3640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee080d21f0 0x7fee080b0ca0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fedf800c400 tx=0x7fedf800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fedfeffd640 1 -- 172.21.15.137:0/2892267913 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8017070 con 0x7fee080d21f0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fedfeffd640 1 -- 172.21.15.137:0/2892267913 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf80052d0 con 0x7fee080d21f0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee08161630 con 0x7fee080d21f0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fedfeffd640 1 -- 172.21.15.137:0/2892267913 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8003830 con 0x7fee080d21f0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.260+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee08161bf0 con 0x7fee080d21f0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.261+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee08069750 con 0x7fee080d21f0 2024-04-26T21:59:31.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.262+0000 7fedfeffd640 1 -- 172.21.15.137:0/2892267913 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fedf801a070 con 0x7fee080d21f0 2024-04-26T21:59:31.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.262+0000 7fedfeffd640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedec06c8f0 0x7fedec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.262+0000 7fedfeffd640 1 -- 172.21.15.137:0/2892267913 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fedf808aa30 con 0x7fee080d21f0 2024-04-26T21:59:31.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.262+0000 7fee0e3a4640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedec06c8f0 0x7fedec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.262+0000 7fee0e3a4640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedec06c8f0 0x7fedec06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fee04034000 tx=0x7fee0402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:31.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.266+0000 7fedfeffd640 1 -- 172.21.15.137:0/2892267913 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fee08069750 con 0x7fee080d21f0 2024-04-26T21:59:31.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.441+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fee0806a290 con 0x7fee080d21f0 2024-04-26T21:59:31.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.664+0000 7fedfeffd640 1 -- 172.21.15.137:0/2892267913 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7fedf8058bf0 con 0x7fee080d21f0 2024-04-26T21:59:31.664 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T21:59:31.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedec06c8f0 msgr2=0x7fedec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedec06c8f0 0x7fedec06edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fee04034000 tx=0x7fee0402e000 comp rx=0 tx=0).stop 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee080d21f0 msgr2=0x7fee080b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee080d21f0 0x7fee080b0ca0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fedf800c400 tx=0x7fedf800c8c0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 shutdown_connections 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fedec06c8f0 0x7fedec06edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee080d21f0 0x7fee080b0ca0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee08148d40 0x7fee080b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 --2- 172.21.15.137:0/2892267913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee08070940 0x7fee08143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 >> 172.21.15.137:0/2892267913 conn(0x7fee0806d590 msgr2=0x7fee08073c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 shutdown_connections 2024-04-26T21:59:31.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.666+0000 7fee10608640 1 -- 172.21.15.137:0/2892267913 wait complete. 2024-04-26T21:59:31.680 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T21:59:31.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.784+0000 7fb14e4f2640 1 Processor -- start 2024-04-26T21:59:31.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.784+0000 7fb14e4f2640 1 -- start start 2024-04-26T21:59:31.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.785+0000 7fb14e4f2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb1481459a0 0x7fb1480b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.785+0000 7fb14e4f2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 0x7fb1480b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.785+0000 7fb14e4f2640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1480b4480 con 0x7fb1480b6130 2024-04-26T21:59:31.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.785+0000 7fb14e4f2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb1480b4760 con 0x7fb1481459a0 2024-04-26T21:59:31.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.785+0000 7fb14e4f2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb1480b4a40 con 0x7fb14815d030 2024-04-26T21:59:31.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb147fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb1481459a0 0x7fb1480b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb1477fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 0x7fb1480b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb147fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb1481459a0 0x7fb1480b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:53014/0 (socket says 172.21.15.137:53014) 2024-04-26T21:59:31.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb14ca8f640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb1480b6130 0x7fb14815fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:60514/0 (socket says 172.21.15.137:60514) 2024-04-26T21:59:31.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb147fff640 1 -- 172.21.15.137:0/3266649838 learned_addr learned my addr 172.21.15.137:0/3266649838 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:31.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb146ffd640 1 -- 172.21.15.137:0/3266649838 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976027223 0 0) 0x7fb1480b4480 con 0x7fb1480b6130 2024-04-26T21:59:31.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb146ffd640 1 -- 172.21.15.137:0/3266649838 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb130003520 con 0x7fb1480b6130 2024-04-26T21:59:31.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb1477fe640 1 -- 172.21.15.137:0/3266649838 >> v2:172.21.15.170:3300/0 conn(0x7fb1481459a0 msgr2=0x7fb1480b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:31.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb1477fe640 1 --2- 172.21.15.137:0/3266649838 >> v2:172.21.15.170:3300/0 conn(0x7fb1481459a0 0x7fb1480b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb1477fe640 1 -- 172.21.15.137:0/3266649838 >> v1:172.21.15.170:6789/0 conn(0x7fb1480b6130 legacy=0x7fb14815fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb1477fe640 1 -- 172.21.15.137:0/3266649838 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1480b4d20 con 0x7fb14815d030 2024-04-26T21:59:31.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.786+0000 7fb147fff640 1 --2- 172.21.15.137:0/3266649838 >> v2:172.21.15.170:3300/0 conn(0x7fb1481459a0 0x7fb1480b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:31.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb1477fe640 1 --2- 172.21.15.137:0/3266649838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 0x7fb1480b5bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0097a0 tx=0x7fb13c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6761bc89e5bcd02e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:31.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb146ffd640 1 -- 172.21.15.137:0/3266649838 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c037070 con 0x7fb14815d030 2024-04-26T21:59:31.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb146ffd640 1 -- 172.21.15.137:0/3266649838 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13c032440 con 0x7fb14815d030 2024-04-26T21:59:31.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb146ffd640 1 -- 172.21.15.137:0/3266649838 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0327f0 con 0x7fb14815d030 2024-04-26T21:59:31.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb14e4f2640 1 -- 172.21.15.137:0/3266649838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 msgr2=0x7fb1480b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb14e4f2640 1 --2- 172.21.15.137:0/3266649838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 0x7fb1480b5bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0097a0 tx=0x7fb13c02a180 comp rx=0 tx=0).stop 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb14e4f2640 1 -- 172.21.15.137:0/3266649838 shutdown_connections 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb14e4f2640 1 --2- 172.21.15.137:0/3266649838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 0x7fb1480b5bf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb14e4f2640 1 --2- 172.21.15.137:0/3266649838 >> v2:172.21.15.170:3300/0 conn(0x7fb1481459a0 0x7fb1480b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.787+0000 7fb14e4f2640 1 -- 172.21.15.137:0/3266649838 >> 172.21.15.137:0/3266649838 conn(0x7fb1480d0d30 msgr2=0x7fb1480d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.788+0000 7fb14e4f2640 1 -- 172.21.15.137:0/3266649838 shutdown_connections 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.788+0000 7fb14e4f2640 1 -- 172.21.15.137:0/3266649838 wait complete. 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.789+0000 7fb14e4f2640 1 Processor -- start 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.789+0000 7fb14e4f2640 1 -- start start 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.789+0000 7fb14e4f2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1480b6130 0x7fb148133230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.789+0000 7fb14e4f2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1481459a0 0x7fb1480b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.789+0000 7fb14e4f2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 0x7fb148149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb14e4f2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb148073100 con 0x7fb1481459a0 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb14e4f2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb14815d470 con 0x7fb1480b6130 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb14e4f2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb148073280 con 0x7fb14815d030 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb1477fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1481459a0 0x7fb1480b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb1477fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1481459a0 0x7fb1480b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42026/0 (socket says 172.21.15.137:42026) 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb1477fe640 1 -- 172.21.15.137:0/538283838 learned_addr learned my addr 172.21.15.137:0/538283838 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb147fff640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1480b6130 0x7fb148133230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb14ca8f640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 0x7fb148149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb1477fe640 1 -- 172.21.15.137:0/538283838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 msgr2=0x7fb148149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb1477fe640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 0x7fb148149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb1477fe640 1 -- 172.21.15.137:0/538283838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1480b6130 msgr2=0x7fb148133230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb1477fe640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1480b6130 0x7fb148133230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb1477fe640 1 -- 172.21.15.137:0/538283838 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb148133770 con 0x7fb1481459a0 2024-04-26T21:59:31.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb1477fe640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1481459a0 0x7fb1480b0c90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0098c0 tx=0x7fb13c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:31.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb144ff9640 1 -- 172.21.15.137:0/538283838 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c037040 con 0x7fb1481459a0 2024-04-26T21:59:31.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb144ff9640 1 -- 172.21.15.137:0/538283838 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb13c0044c0 con 0x7fb1481459a0 2024-04-26T21:59:31.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1480ce630 con 0x7fb1481459a0 2024-04-26T21:59:31.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb144ff9640 1 -- 172.21.15.137:0/538283838 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0325f0 con 0x7fb1481459a0 2024-04-26T21:59:31.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.790+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1480cebf0 con 0x7fb1481459a0 2024-04-26T21:59:31.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.791+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14815c8c0 con 0x7fb1481459a0 2024-04-26T21:59:31.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.792+0000 7fb144ff9640 1 -- 172.21.15.137:0/538283838 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb13c044020 con 0x7fb1481459a0 2024-04-26T21:59:31.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.792+0000 7fb144ff9640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb13406c8f0 0x7fb13406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:31.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.792+0000 7fb144ff9640 1 -- 172.21.15.137:0/538283838 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7fb13c0abc60 con 0x7fb1481459a0 2024-04-26T21:59:31.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.792+0000 7fb147fff640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb13406c8f0 0x7fb13406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:31.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.793+0000 7fb147fff640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb13406c8f0 0x7fb13406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb138009b70 tx=0x7fb138008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:31.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.797+0000 7fb144ff9640 1 -- 172.21.15.137:0/538283838 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb14815c8c0 con 0x7fb1481459a0 2024-04-26T21:59:31.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:31.974+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb14806a290 con 0x7fb1481459a0 2024-04-26T21:59:32.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.670+0000 7fb144ff9640 1 -- 172.21.15.137:0/538283838 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7fb148133770 con 0x7fb1481459a0 2024-04-26T21:59:32.670 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T21:59:32.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.673+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb13406c8f0 msgr2=0x7fb13406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:32.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.673+0000 7fb14e4f2640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb13406c8f0 0x7fb13406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb138009b70 tx=0x7fb138008040 comp rx=0 tx=0).stop 2024-04-26T21:59:32.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.673+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1481459a0 msgr2=0x7fb1480b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:32.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.673+0000 7fb14e4f2640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1481459a0 0x7fb1480b0c90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb13c0098c0 tx=0x7fb13c0046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.673+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 shutdown_connections 2024-04-26T21:59:32.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.673+0000 7fb14e4f2640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb13406c8f0 0x7fb13406edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.674+0000 7fb14e4f2640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1481459a0 0x7fb1480b0c90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.674+0000 7fb14e4f2640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb14815d030 0x7fb148149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.674+0000 7fb14e4f2640 1 --2- 172.21.15.137:0/538283838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1480b6130 0x7fb148133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.674+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 >> 172.21.15.137:0/538283838 conn(0x7fb1480d0d30 msgr2=0x7fb14815e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:32.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.678+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 shutdown_connections 2024-04-26T21:59:32.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.680+0000 7fb14e4f2640 1 -- 172.21.15.137:0/538283838 wait complete. 2024-04-26T21:59:32.699 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T21:59:32.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.802+0000 7fee41158640 1 Processor -- start 2024-04-26T21:59:32.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.802+0000 7fee41158640 1 -- start start 2024-04-26T21:59:32.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee41158640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c0706a0 0x7fee3c06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:32.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee41158640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee3c06c9b0 0x7fee3c0afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:32.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee41158640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee3c070b30 con 0x7fee3c15f2b0 2024-04-26T21:59:32.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee41158640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fee3c0af610 con 0x7fee3c06c9b0 2024-04-26T21:59:32.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee41158640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee3c0700b0 con 0x7fee3c0706a0 2024-04-26T21:59:32.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee3b59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee3c06c9b0 0x7fee3c0afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:32.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee3b59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee3c06c9b0 0x7fee3c0afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42030/0 (socket says 172.21.15.137:42030) 2024-04-26T21:59:32.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee3b59e640 1 -- 172.21.15.137:0/3201233201 learned_addr learned my addr 172.21.15.137:0/3201233201 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:32.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee33fff640 1 --2- 172.21.15.137:0/3201233201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c0706a0 0x7fee3c06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:32.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee3b59e640 1 -- 172.21.15.137:0/3201233201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c0706a0 msgr2=0x7fee3c06fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:32.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee3b59e640 1 --2- 172.21.15.137:0/3201233201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c0706a0 0x7fee3c06fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee3b59e640 1 -- 172.21.15.137:0/3201233201 >> v1:172.21.15.170:6789/0 conn(0x7fee3c15f2b0 legacy=0x7fee3c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:32.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee3b59e640 1 -- 172.21.15.137:0/3201233201 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c070e10 con 0x7fee3c06c9b0 2024-04-26T21:59:32.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.803+0000 7fee33fff640 1 --2- 172.21.15.137:0/3201233201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c0706a0 0x7fee3c06fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:32.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.804+0000 7fee3b59e640 1 --2- 172.21.15.137:0/3201233201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c06c9b0 0x7fee3c0afa80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fee34009e50 tx=0x7fee3402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b9da628c7bddb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:32.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.804+0000 7fee3a59c640 1 -- 172.21.15.137:0/3201233201 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34036070 con 0x7fee3c06c9b0 2024-04-26T21:59:32.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.804+0000 7fee3a59c640 1 -- 172.21.15.137:0/3201233201 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee34031600 con 0x7fee3c06c9b0 2024-04-26T21:59:32.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.804+0000 7fee3a59c640 1 -- 172.21.15.137:0/3201233201 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee340319d0 con 0x7fee3c06c9b0 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.805+0000 7fee41158640 1 -- 172.21.15.137:0/3201233201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c06c9b0 msgr2=0x7fee3c0afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.805+0000 7fee41158640 1 --2- 172.21.15.137:0/3201233201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c06c9b0 0x7fee3c0afa80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fee34009e50 tx=0x7fee3402a710 comp rx=0 tx=0).stop 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.805+0000 7fee41158640 1 -- 172.21.15.137:0/3201233201 shutdown_connections 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.805+0000 7fee41158640 1 --2- 172.21.15.137:0/3201233201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c06c9b0 0x7fee3c0afa80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.805+0000 7fee41158640 1 --2- 172.21.15.137:0/3201233201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c0706a0 0x7fee3c06fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.805+0000 7fee41158640 1 -- 172.21.15.137:0/3201233201 >> 172.21.15.137:0/3201233201 conn(0x7fee3c06f050 msgr2=0x7fee3c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.805+0000 7fee41158640 1 -- 172.21.15.137:0/3201233201 shutdown_connections 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.805+0000 7fee41158640 1 -- 172.21.15.137:0/3201233201 wait complete. 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.806+0000 7fee41158640 1 Processor -- start 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.806+0000 7fee41158640 1 -- start start 2024-04-26T21:59:32.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee41158640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c06c9b0 0x7fee3c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee41158640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c15f2b0 0x7fee3c146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee41158640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee3c152520 0x7fee3c1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee41158640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c0b4f40 con 0x7fee3c15f2b0 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee41158640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fee3c0713d0 con 0x7fee3c152520 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee41158640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee3c0b1890 con 0x7fee3c06c9b0 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c15f2b0 0x7fee3c146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c15f2b0 0x7fee3c146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42042/0 (socket says 172.21.15.137:42042) 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee33fff640 1 -- 172.21.15.137:0/1566397416 learned_addr learned my addr 172.21.15.137:0/1566397416 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee3b59e640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee3c152520 0x7fee3c1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee3ad9d640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c06c9b0 0x7fee3c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee33fff640 1 -- 172.21.15.137:0/1566397416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c06c9b0 msgr2=0x7fee3c150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee33fff640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c06c9b0 0x7fee3c150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee33fff640 1 -- 172.21.15.137:0/1566397416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee3c152520 msgr2=0x7fee3c1529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:32.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee33fff640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee3c152520 0x7fee3c1529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:32.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee33fff640 1 -- 172.21.15.137:0/1566397416 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3c1531f0 con 0x7fee3c15f2b0 2024-04-26T21:59:32.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee33fff640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c15f2b0 0x7fee3c146140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fee2400e7e0 tx=0x7fee2400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:32.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee337fe640 1 -- 172.21.15.137:0/1566397416 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2400f040 con 0x7fee3c15f2b0 2024-04-26T21:59:32.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee337fe640 1 -- 172.21.15.137:0/1566397416 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee24004030 con 0x7fee3c15f2b0 2024-04-26T21:59:32.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3c146680 con 0x7fee3c15f2b0 2024-04-26T21:59:32.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee337fe640 1 -- 172.21.15.137:0/1566397416 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24004400 con 0x7fee3c15f2b0 2024-04-26T21:59:32.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.807+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee3c153770 con 0x7fee3c15f2b0 2024-04-26T21:59:32.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.808+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3c160a70 con 0x7fee3c15f2b0 2024-04-26T21:59:32.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.809+0000 7fee337fe640 1 -- 172.21.15.137:0/1566397416 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee2400c6d0 con 0x7fee3c15f2b0 2024-04-26T21:59:32.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.809+0000 7fee337fe640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee1c06c8f0 0x7fee1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:32.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.809+0000 7fee337fe640 1 -- 172.21.15.137:0/1566397416 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7fee2408b8d0 con 0x7fee3c15f2b0 2024-04-26T21:59:32.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.809+0000 7fee3ad9d640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee1c06c8f0 0x7fee1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:32.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.810+0000 7fee3ad9d640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee1c06c8f0 0x7fee1c06edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee2c007fd0 tx=0x7fee2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:32.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:32.814+0000 7fee337fe640 1 -- 172.21.15.137:0/1566397416 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fee24017020 con 0x7fee3c15f2b0 2024-04-26T21:59:33.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.027+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fee3c06a290 con 0x7fee3c15f2b0 2024-04-26T21:59:33.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.679+0000 7fee337fe640 1 -- 172.21.15.137:0/1566397416 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7fee24059d60 con 0x7fee3c15f2b0 2024-04-26T21:59:33.683 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 4 and data pool 5 2024-04-26T21:59:33.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee1c06c8f0 msgr2=0x7fee1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:33.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee1c06c8f0 0x7fee1c06edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee2c007fd0 tx=0x7fee2c009040 comp rx=0 tx=0).stop 2024-04-26T21:59:33.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c15f2b0 msgr2=0x7fee3c146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:33.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c15f2b0 0x7fee3c146140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fee2400e7e0 tx=0x7fee2400eca0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 shutdown_connections 2024-04-26T21:59:33.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee1c06c8f0 0x7fee1c06edb0 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee2c007fd0 tx=0x7fee2c009040 comp rx=0 tx=0).stop 2024-04-26T21:59:33.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee3c15f2b0 0x7fee3c146140 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee3c152520 0x7fee3c1529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 --2- 172.21.15.137:0/1566397416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee3c06c9b0 0x7fee3c150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.689+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 >> 172.21.15.137:0/1566397416 conn(0x7fee3c06f050 msgr2=0x7fee3c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:33.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.697+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 shutdown_connections 2024-04-26T21:59:33.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.697+0000 7fee41158640 1 -- 172.21.15.137:0/1566397416 wait complete. 2024-04-26T21:59:33.714 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:33.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.814+0000 7ff2ca1f0640 1 Processor -- start 2024-04-26T21:59:33.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.814+0000 7ff2ca1f0640 1 -- start start 2024-04-26T21:59:33.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2ca1f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c415d380 0x7ff2c40ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2ca1f0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2c40b56d0 0x7ff2c40d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2ca1f0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff2c4160d50 0x7ff2c41611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2ca1f0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c40d0be0 con 0x7ff2c40b56d0 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2ca1f0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff2c40d0ec0 con 0x7ff2c4160d50 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2ca1f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c40d11a0 con 0x7ff2c415d380 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c2ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2c40b56d0 0x7ff2c40d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c2ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2c40b56d0 0x7ff2c40d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42046/0 (socket says 172.21.15.137:42046) 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c2ffd640 1 -- 172.21.15.137:0/1140423716 learned_addr learned my addr 172.21.15.137:0/1140423716 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c3fff640 1 --2- 172.21.15.137:0/1140423716 >> v2:172.21.15.170:3300/0 conn(0x7ff2c4160d50 0x7ff2c41611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c37fe640 1 --2- 172.21.15.137:0/1140423716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c415d380 0x7ff2c40ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c2ffd640 1 -- 172.21.15.137:0/1140423716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c415d380 msgr2=0x7ff2c40ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c2ffd640 1 --2- 172.21.15.137:0/1140423716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c415d380 0x7ff2c40ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c2ffd640 1 -- 172.21.15.137:0/1140423716 >> v2:172.21.15.170:3300/0 conn(0x7ff2c4160d50 msgr2=0x7ff2c41611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c2ffd640 1 --2- 172.21.15.137:0/1140423716 >> v2:172.21.15.170:3300/0 conn(0x7ff2c4160d50 0x7ff2c41611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c2ffd640 1 -- 172.21.15.137:0/1140423716 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c40d1480 con 0x7ff2c40b56d0 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.815+0000 7ff2c3fff640 1 --2- 172.21.15.137:0/1140423716 >> v2:172.21.15.170:3300/0 conn(0x7ff2c4160d50 0x7ff2c41611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.816+0000 7ff2c2ffd640 1 --2- 172.21.15.137:0/1140423716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c40b56d0 0x7ff2c40d19a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4160c90 tx=0x7ff2b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c0dc69fc8c464e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.816+0000 7ff2c27fc640 1 -- 172.21.15.137:0/1140423716 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8037070 con 0x7ff2c40b56d0 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.816+0000 7ff2c27fc640 1 -- 172.21.15.137:0/1140423716 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b8032440 con 0x7ff2c40b56d0 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.816+0000 7ff2c27fc640 1 -- 172.21.15.137:0/1140423716 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8032810 con 0x7ff2c40b56d0 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.816+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/1140423716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c40b56d0 msgr2=0x7ff2c40d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.816+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/1140423716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c40b56d0 0x7ff2c40d19a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4160c90 tx=0x7ff2b802a1e0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.817+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/1140423716 shutdown_connections 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.817+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/1140423716 >> v2:172.21.15.170:3300/0 conn(0x7ff2c4160d50 0x7ff2c41611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.817+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/1140423716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c40b56d0 0x7ff2c40d19a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.817+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/1140423716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c415d380 0x7ff2c40ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.817+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/1140423716 >> 172.21.15.137:0/1140423716 conn(0x7ff2c40b4a60 msgr2=0x7ff2c40b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:33.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.817+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/1140423716 shutdown_connections 2024-04-26T21:59:33.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.817+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/1140423716 wait complete. 2024-04-26T21:59:33.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.818+0000 7ff2ca1f0640 1 Processor -- start 2024-04-26T21:59:33.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.818+0000 7ff2ca1f0640 1 -- start start 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2ca1f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c40b56d0 0x7ff2c414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2ca1f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c415d380 0x7ff2c415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2ca1f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2c4160d50 0x7ff2c40714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2ca1f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c40cedc0 con 0x7ff2c415d380 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2ca1f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c40d1ee0 con 0x7ff2c4160d50 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2ca1f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c40b5dc0 con 0x7ff2c40b56d0 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c415d380 0x7ff2c415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c415d380 0x7ff2c415e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42050/0 (socket says 172.21.15.137:42050) 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c2ffd640 1 -- 172.21.15.137:0/3937207557 learned_addr learned my addr 172.21.15.137:0/3937207557 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c37fe640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c40b56d0 0x7ff2c414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c3fff640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2c4160d50 0x7ff2c40714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c2ffd640 1 -- 172.21.15.137:0/3937207557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c40b56d0 msgr2=0x7ff2c414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c2ffd640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c40b56d0 0x7ff2c414e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c2ffd640 1 -- 172.21.15.137:0/3937207557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2c4160d50 msgr2=0x7ff2c40714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c2ffd640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2c4160d50 0x7ff2c40714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c2ffd640 1 -- 172.21.15.137:0/3937207557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c40ca500 con 0x7ff2c415d380 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2c2ffd640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c415d380 0x7ff2c415e170 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8000c00 tx=0x7ff2b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2abfff640 1 -- 172.21.15.137:0/3937207557 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8041020 con 0x7ff2c415d380 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2abfff640 1 -- 172.21.15.137:0/3937207557 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b80306c0 con 0x7ff2c415d380 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2abfff640 1 -- 172.21.15.137:0/3937207557 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8037040 con 0x7ff2c415d380 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c415eb80 con 0x7ff2c415d380 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.819+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c415f140 con 0x7ff2c415d380 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.820+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c40ca6d0 con 0x7ff2c415d380 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.821+0000 7ff2abfff640 1 -- 172.21.15.137:0/3937207557 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2b8044020 con 0x7ff2c415d380 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.821+0000 7ff2abfff640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2b006c8f0 0x7ff2b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.821+0000 7ff2abfff640 1 -- 172.21.15.137:0/3937207557 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff2b80ac270 con 0x7ff2c415d380 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.821+0000 7ff2c37fe640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2b006c8f0 0x7ff2b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:33.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.822+0000 7ff2c37fe640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2b006c8f0 0x7ff2b006edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4006fd0 tx=0x7ff2b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:33.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:33.826+0000 7ff2abfff640 1 -- 172.21.15.137:0/3937207557 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff2b804b030 con 0x7ff2c415d380 2024-04-26T21:59:34.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.000+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2c406a290 con 0x7ff2c415d380 2024-04-26T21:59:34.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.001+0000 7ff2abfff640 1 -- 172.21.15.137:0/3937207557 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16694 (secure 0 0 0) 0x7ff2b807a050 con 0x7ff2c415d380 2024-04-26T21:59:34.002 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:34.002 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:33.028523+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:59:31.445571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T21:59:31.978335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:34.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2b006c8f0 msgr2=0x7ff2b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2b006c8f0 0x7ff2b006edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4006fd0 tx=0x7ff2b4008040 comp rx=0 tx=0).stop 2024-04-26T21:59:34.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c415d380 msgr2=0x7ff2c415e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c415d380 0x7ff2c415e170 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8000c00 tx=0x7ff2b80046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 shutdown_connections 2024-04-26T21:59:34.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2b006c8f0 0x7ff2b006edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2c415d380 0x7ff2c415e170 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2c4160d50 0x7ff2c40714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 --2- 172.21.15.137:0/3937207557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2c40b56d0 0x7ff2c414e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.003+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 >> 172.21.15.137:0/3937207557 conn(0x7ff2c40b4a60 msgr2=0x7ff2c4158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:34.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.004+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 shutdown_connections 2024-04-26T21:59:34.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.004+0000 7ff2ca1f0640 1 -- 172.21.15.137:0/3937207557 wait complete. 2024-04-26T21:59:34.015 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:34.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.111+0000 7ff7db190640 1 Processor -- start 2024-04-26T21:59:34.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.111+0000 7ff7db190640 1 -- start start 2024-04-26T21:59:34.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7db190640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff7d40b44e0 0x7ff7d406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7db190640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff7d406d2b0 0x7ff7d406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7db190640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7d40b4a10 con 0x7ff7d415f1e0 2024-04-26T21:59:34.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7db190640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d406dc60 con 0x7ff7d40b44e0 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7db190640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d406eeb0 con 0x7ff7d406d2b0 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7d3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff7d40b44e0 0x7ff7d406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7d3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff7d40b44e0 0x7ff7d406e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42060/0 (socket says 172.21.15.137:42060) 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7d3fff640 1 -- 172.21.15.137:0/2250669028 learned_addr learned my addr 172.21.15.137:0/2250669028 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7d972d640 1 --2- 172.21.15.137:0/2250669028 >> v2:172.21.15.170:3300/0 conn(0x7ff7d406d2b0 0x7ff7d406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7d3fff640 1 -- 172.21.15.137:0/2250669028 >> v2:172.21.15.170:3300/0 conn(0x7ff7d406d2b0 msgr2=0x7ff7d406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7d3fff640 1 --2- 172.21.15.137:0/2250669028 >> v2:172.21.15.170:3300/0 conn(0x7ff7d406d2b0 0x7ff7d406d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.112+0000 7ff7d3fff640 1 -- 172.21.15.137:0/2250669028 >> v1:172.21.15.170:6789/0 conn(0x7ff7d415f1e0 legacy=0x7ff7d40ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.113+0000 7ff7d3fff640 1 -- 172.21.15.137:0/2250669028 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d40b4cf0 con 0x7ff7d40b44e0 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.113+0000 7ff7d3fff640 1 --2- 172.21.15.137:0/2250669028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d40b44e0 0x7ff7d406e970 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40b0ba0 tx=0x7ff7c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afceb30f97637281 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:34.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.113+0000 7ff7d37fe640 1 -- 172.21.15.137:0/2250669028 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8037070 con 0x7ff7d40b44e0 2024-04-26T21:59:34.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.113+0000 7ff7d37fe640 1 -- 172.21.15.137:0/2250669028 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c8032440 con 0x7ff7d40b44e0 2024-04-26T21:59:34.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.113+0000 7ff7d37fe640 1 -- 172.21.15.137:0/2250669028 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8032810 con 0x7ff7d40b44e0 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.114+0000 7ff7db190640 1 -- 172.21.15.137:0/2250669028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d40b44e0 msgr2=0x7ff7d406e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.114+0000 7ff7db190640 1 --2- 172.21.15.137:0/2250669028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d40b44e0 0x7ff7d406e970 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40b0ba0 tx=0x7ff7c802a270 comp rx=0 tx=0).stop 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.114+0000 7ff7db190640 1 -- 172.21.15.137:0/2250669028 shutdown_connections 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.114+0000 7ff7db190640 1 --2- 172.21.15.137:0/2250669028 >> v2:172.21.15.170:3300/0 conn(0x7ff7d406d2b0 0x7ff7d406d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.114+0000 7ff7db190640 1 --2- 172.21.15.137:0/2250669028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d40b44e0 0x7ff7d406e970 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.114+0000 7ff7db190640 1 -- 172.21.15.137:0/2250669028 >> 172.21.15.137:0/2250669028 conn(0x7ff7d40728a0 msgr2=0x7ff7d4072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.114+0000 7ff7db190640 1 -- 172.21.15.137:0/2250669028 shutdown_connections 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.114+0000 7ff7db190640 1 -- 172.21.15.137:0/2250669028 wait complete. 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.115+0000 7ff7db190640 1 Processor -- start 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.115+0000 7ff7db190640 1 -- start start 2024-04-26T21:59:34.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7db190640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7d406d2b0 0x7ff7d4157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7db190640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7d40b44e0 0x7ff7d4161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7db190640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d415f1e0 0x7ff7d415f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7db190640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d40b5590 con 0x7ff7d415f1e0 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7db190640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d40b52b0 con 0x7ff7d406d2b0 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7db190640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d415f5c0 con 0x7ff7d40b44e0 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d972d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d415f1e0 0x7ff7d415f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d972d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d415f1e0 0x7ff7d415f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42068/0 (socket says 172.21.15.137:42068) 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d972d640 1 -- 172.21.15.137:0/3746636815 learned_addr learned my addr 172.21.15.137:0/3746636815 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d8f2c640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7d406d2b0 0x7ff7d4157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d3fff640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7d40b44e0 0x7ff7d4161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d972d640 1 -- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7d40b44e0 msgr2=0x7ff7d4161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d972d640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7d40b44e0 0x7ff7d4161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d972d640 1 -- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7d406d2b0 msgr2=0x7ff7d4157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d972d640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7d406d2b0 0x7ff7d4157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d972d640 1 -- 172.21.15.137:0/3746636815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d415c870 con 0x7ff7d415f1e0 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d3fff640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7d40b44e0 0x7ff7d4161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.116+0000 7ff7d8f2c640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7d406d2b0 0x7ff7d4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.117+0000 7ff7d972d640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d415f1e0 0x7ff7d415f860 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc007e70 tx=0x7ff7cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.117+0000 7ff7d17fa640 1 -- 172.21.15.137:0/3746636815 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc014620 con 0x7ff7d415f1e0 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.117+0000 7ff7d17fa640 1 -- 172.21.15.137:0/3746636815 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7cc019070 con 0x7ff7d415f1e0 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.117+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d41624d0 con 0x7ff7d415f1e0 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.117+0000 7ff7d17fa640 1 -- 172.21.15.137:0/3746636815 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc014a20 con 0x7ff7d415f1e0 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.117+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d4158210 con 0x7ff7d415f1e0 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.118+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d406a290 con 0x7ff7d415f1e0 2024-04-26T21:59:34.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.118+0000 7ff7d17fa640 1 -- 172.21.15.137:0/3746636815 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7cc014bc0 con 0x7ff7d415f1e0 2024-04-26T21:59:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.118+0000 7ff7d17fa640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff7c006c920 0x7ff7c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.118+0000 7ff7d17fa640 1 -- 172.21.15.137:0/3746636815 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff7cc08c460 con 0x7ff7d415f1e0 2024-04-26T21:59:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.118+0000 7ff7d8f2c640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff7c006c920 0x7ff7c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.119+0000 7ff7d8f2c640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff7c006c920 0x7ff7c006ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40015e0 tx=0x7ff7c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:34.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.123+0000 7ff7d17fa640 1 -- 172.21.15.137:0/3746636815 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff7cc011260 con 0x7ff7d415f1e0 2024-04-26T21:59:34.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.295+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7d41557e0 con 0x7ff7d415f1e0 2024-04-26T21:59:34.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.297+0000 7ff7d17fa640 1 -- 172.21.15.137:0/3746636815 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16694 (secure 0 0 0) 0x7ff7cc05a890 con 0x7ff7d415f1e0 2024-04-26T21:59:34.298 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:34.299 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":33,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:33.028523+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:59:31.445571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T21:59:31.978335+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:34.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.298+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff7c006c920 msgr2=0x7ff7c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.298+0000 7ff7db190640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff7c006c920 0x7ff7c006ede0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40015e0 tx=0x7ff7c4009040 comp rx=0 tx=0).stop 2024-04-26T21:59:34.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.298+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d415f1e0 msgr2=0x7ff7d415f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.298+0000 7ff7db190640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d415f1e0 0x7ff7d415f860 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc007e70 tx=0x7ff7cc00e4b0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.299+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 shutdown_connections 2024-04-26T21:59:34.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.299+0000 7ff7db190640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff7c006c920 0x7ff7c006ede0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.299+0000 7ff7db190640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff7d415f1e0 0x7ff7d415f860 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.299+0000 7ff7db190640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7d40b44e0 0x7ff7d4161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.299+0000 7ff7db190640 1 --2- 172.21.15.137:0/3746636815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7d406d2b0 0x7ff7d4157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.299+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 >> 172.21.15.137:0/3746636815 conn(0x7ff7d40728a0 msgr2=0x7ff7d406fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:34.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.299+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 shutdown_connections 2024-04-26T21:59:34.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.299+0000 7ff7db190640 1 -- 172.21.15.137:0/3746636815 wait complete. 2024-04-26T21:59:34.311 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T21:59:34.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.410+0000 7f6fa159e640 1 Processor -- start 2024-04-26T21:59:34.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.410+0000 7f6fa159e640 1 -- start start 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6fa159e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f9c15f210 0x7f6f9c160170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6fa159e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c0d2820 0x7f6f9c06c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6fa159e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9c0d1440 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6fa159e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6f9c0d16e0 con 0x7f6f9c15f210 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6fa159e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c0d19c0 con 0x7f6f9c0d2820 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6f9bfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f9c15f210 0x7f6f9c160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6f9bfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f9c15f210 0x7f6f9c160170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42072/0 (socket says 172.21.15.137:42072) 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6f9bfff640 1 -- 172.21.15.137:0/2648582428 learned_addr learned my addr 172.21.15.137:0/2648582428 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6f9b7fe640 1 --2- 172.21.15.137:0/2648582428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c0d2820 0x7f6f9c06c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6f9bfff640 1 -- 172.21.15.137:0/2648582428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c0d2820 msgr2=0x7f6f9c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6f9bfff640 1 --2- 172.21.15.137:0/2648582428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c0d2820 0x7f6f9c06c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6f9bfff640 1 -- 172.21.15.137:0/2648582428 >> v1:172.21.15.170:6789/0 conn(0x7f6f9c06c7e0 legacy=0x7f6f9c162ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6f9bfff640 1 -- 172.21.15.137:0/2648582428 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0cf9a0 con 0x7f6f9c15f210 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.411+0000 7f6f9b7fe640 1 --2- 172.21.15.137:0/2648582428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c0d2820 0x7f6f9c06c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6f9bfff640 1 --2- 172.21.15.137:0/2648582428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c15f210 0x7f6f9c160170 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009870 tx=0x7f6f8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a441221bcf4aa41f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6f9affd640 1 -- 172.21.15.137:0/2648582428 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c037070 con 0x7f6f9c15f210 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6f9affd640 1 -- 172.21.15.137:0/2648582428 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8c032440 con 0x7f6f9c15f210 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6f9affd640 1 -- 172.21.15.137:0/2648582428 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c032810 con 0x7f6f9c15f210 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6fa159e640 1 -- 172.21.15.137:0/2648582428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c15f210 msgr2=0x7f6f9c160170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6fa159e640 1 --2- 172.21.15.137:0/2648582428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c15f210 0x7f6f9c160170 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009870 tx=0x7f6f8c02a270 comp rx=0 tx=0).stop 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6fa159e640 1 -- 172.21.15.137:0/2648582428 shutdown_connections 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6fa159e640 1 --2- 172.21.15.137:0/2648582428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c0d2820 0x7f6f9c06c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6fa159e640 1 --2- 172.21.15.137:0/2648582428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c15f210 0x7f6f9c160170 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.412+0000 7f6fa159e640 1 -- 172.21.15.137:0/2648582428 >> 172.21.15.137:0/2648582428 conn(0x7f6f9c0d1d30 msgr2=0x7f6f9c0d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:34.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.413+0000 7f6fa159e640 1 -- 172.21.15.137:0/2648582428 shutdown_connections 2024-04-26T21:59:34.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.413+0000 7f6fa159e640 1 -- 172.21.15.137:0/2648582428 wait complete. 2024-04-26T21:59:34.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.414+0000 7f6fa159e640 1 Processor -- start 2024-04-26T21:59:34.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.414+0000 7f6fa159e640 1 -- start start 2024-04-26T21:59:34.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6fa159e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c06c7e0 0x7f6f9c15b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6fa159e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f9c0d2820 0x7f6f9c161110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6fa159e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c15f210 0x7f6f9c15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6fa159e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c0aea40 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6fa159e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c0ae8c0 con 0x7f6f9c0d2820 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6fa159e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c1633f0 con 0x7f6f9c15f210 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c06c7e0 0x7f6f9c15b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c06c7e0 0x7f6f9c15b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42088/0 (socket says 172.21.15.137:42088) 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9bfff640 1 -- 172.21.15.137:0/2771475587 learned_addr learned my addr 172.21.15.137:0/2771475587 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9b7fe640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f9c0d2820 0x7f6f9c161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6fa0d9d640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c15f210 0x7f6f9c15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9bfff640 1 -- 172.21.15.137:0/2771475587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c15f210 msgr2=0x7f6f9c15a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9bfff640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c15f210 0x7f6f9c15a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9bfff640 1 -- 172.21.15.137:0/2771475587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f9c0d2820 msgr2=0x7f6f9c161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9bfff640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f9c0d2820 0x7f6f9c161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9bfff640 1 -- 172.21.15.137:0/2771475587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0c82a0 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9b7fe640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f9c0d2820 0x7f6f9c161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:34.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f9bfff640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c06c7e0 0x7f6f9c15b8d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f98ff9640 1 -- 172.21.15.137:0/2771475587 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c041020 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f98ff9640 1 -- 172.21.15.137:0/2771475587 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f8c0306c0 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6f98ff9640 1 -- 172.21.15.137:0/2771475587 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c037040 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.415+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c0c7690 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.416+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c0c7c50 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.417+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c050730 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.417+0000 7f6f98ff9640 1 -- 172.21.15.137:0/2771475587 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f8c044020 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.417+0000 7f6f98ff9640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f8806c8f0 0x7f6f8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.417+0000 7f6f98ff9640 1 -- 172.21.15.137:0/2771475587 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6f8c0ac2f0 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.417+0000 7f6f9b7fe640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f8806c8f0 0x7f6f8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.418+0000 7f6f9b7fe640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f8806c8f0 0x7f6f8806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c15d270 tx=0x7f6f90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:34.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.421+0000 7f6f98ff9640 1 -- 172.21.15.137:0/2771475587 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6f8c04b030 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.632+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6f9c06cf10 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.682+0000 7f6f98ff9640 1 -- 172.21.15.137:0/2771475587 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f6f8c07a720 con 0x7f6f9c06c7e0 2024-04-26T21:59:34.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f8806c8f0 msgr2=0x7f6f8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f8806c8f0 0x7f6f8806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c15d270 tx=0x7f6f90008040 comp rx=0 tx=0).stop 2024-04-26T21:59:34.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c06c7e0 msgr2=0x7f6f9c15b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c06c7e0 0x7f6f9c15b8d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c0046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 shutdown_connections 2024-04-26T21:59:34.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f8806c8f0 0x7f6f8806edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f9c15f210 0x7f6f9c15a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f9c0d2820 0x7f6f9c161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 --2- 172.21.15.137:0/2771475587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f9c06c7e0 0x7f6f9c15b8d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 >> 172.21.15.137:0/2771475587 conn(0x7f6f9c0d1d30 msgr2=0x7f6f9c15d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:34.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 shutdown_connections 2024-04-26T21:59:34.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.685+0000 7f6fa159e640 1 -- 172.21.15.137:0/2771475587 wait complete. 2024-04-26T21:59:34.697 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T21:59:34.697 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T21:59:34.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.796+0000 7f1aacd39640 1 Processor -- start 2024-04-26T21:59:34.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.796+0000 7f1aacd39640 1 -- start start 2024-04-26T21:59:34.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1aacd39640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1aa813ef90 0x7f1aa813f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1aacd39640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa813faf0 0x7f1aa815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1aacd39640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa80d0800 con 0x7f1aa815ca20 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1aacd39640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa815d000 con 0x7f1aa813ef90 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1aacd39640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa815d2e0 con 0x7f1aa813faf0 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa813faf0 0x7f1aa815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1aa659c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1aa813ef90 0x7f1aa813f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa813faf0 0x7f1aa815c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:37224/0 (socket says 172.21.15.137:37224) 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1a9ffff640 1 -- 172.21.15.137:0/4022711357 learned_addr learned my addr 172.21.15.137:0/4022711357 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.797+0000 7f1aa6d9d640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1aa815ca20 0x7f1aa80706a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:60548/0 (socket says 172.21.15.137:60548) 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.798+0000 7f1a9ffff640 1 -- 172.21.15.137:0/4022711357 >> v2:172.21.15.170:3300/0 conn(0x7f1aa813ef90 msgr2=0x7f1aa813f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.798+0000 7f1a9ffff640 1 --2- 172.21.15.137:0/4022711357 >> v2:172.21.15.170:3300/0 conn(0x7f1aa813ef90 0x7f1aa813f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.798+0000 7f1a9ffff640 1 -- 172.21.15.137:0/4022711357 >> v1:172.21.15.170:6789/0 conn(0x7f1aa815ca20 legacy=0x7f1aa80706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.798+0000 7f1a9ffff640 1 -- 172.21.15.137:0/4022711357 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa80d0a80 con 0x7f1aa813faf0 2024-04-26T21:59:34.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.798+0000 7f1aa659c640 1 --2- 172.21.15.137:0/4022711357 >> v2:172.21.15.170:3300/0 conn(0x7f1aa813ef90 0x7f1aa813f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.798+0000 7f1a9ffff640 1 --2- 172.21.15.137:0/4022711357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa813faf0 0x7f1aa815c4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009870 tx=0x7f1a9002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dbb11e7923da7af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aa5d9b640 1 -- 172.21.15.137:0/4022711357 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90037070 con 0x7f1aa813faf0 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aa5d9b640 1 -- 172.21.15.137:0/4022711357 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a90032440 con 0x7f1aa813faf0 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aa5d9b640 1 -- 172.21.15.137:0/4022711357 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90032810 con 0x7f1aa813faf0 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aacd39640 1 -- 172.21.15.137:0/4022711357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa813faf0 msgr2=0x7f1aa815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aacd39640 1 --2- 172.21.15.137:0/4022711357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa813faf0 0x7f1aa815c4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009870 tx=0x7f1a9002a270 comp rx=0 tx=0).stop 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aacd39640 1 -- 172.21.15.137:0/4022711357 shutdown_connections 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aacd39640 1 --2- 172.21.15.137:0/4022711357 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa813faf0 0x7f1aa815c4e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aacd39640 1 --2- 172.21.15.137:0/4022711357 >> v2:172.21.15.170:3300/0 conn(0x7f1aa813ef90 0x7f1aa813f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aacd39640 1 -- 172.21.15.137:0/4022711357 >> 172.21.15.137:0/4022711357 conn(0x7f1aa806f050 msgr2=0x7f1aa806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aacd39640 1 -- 172.21.15.137:0/4022711357 shutdown_connections 2024-04-26T21:59:34.802 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.799+0000 7f1aacd39640 1 -- 172.21.15.137:0/4022711357 wait complete. 2024-04-26T21:59:34.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.800+0000 7f1aacd39640 1 Processor -- start 2024-04-26T21:59:34.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.800+0000 7f1aacd39640 1 -- start start 2024-04-26T21:59:34.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1aacd39640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa813ef90 0x7f1aa8136830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1aacd39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa813faf0 0x7f1aa813a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1aacd39640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa815ca20 0x7f1aa815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1aacd39640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8071ab0 con 0x7f1aa813faf0 2024-04-26T21:59:34.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1aacd39640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8071930 con 0x7f1aa813ef90 2024-04-26T21:59:34.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1aacd39640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa8070db0 con 0x7f1aa815ca20 2024-04-26T21:59:34.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa813faf0 0x7f1aa813a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa813faf0 0x7f1aa813a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:42092/0 (socket says 172.21.15.137:42092) 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1a9ffff640 1 -- 172.21.15.137:0/2107074551 learned_addr learned my addr 172.21.15.137:0/2107074551 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1aa659c640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa813ef90 0x7f1aa8136830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.801+0000 7f1aa6d9d640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa815ca20 0x7f1aa815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1a9ffff640 1 -- 172.21.15.137:0/2107074551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa815ca20 msgr2=0x7f1aa815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1a9ffff640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa815ca20 0x7f1aa815d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1a9ffff640 1 -- 172.21.15.137:0/2107074551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa813ef90 msgr2=0x7f1aa8136830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1a9ffff640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa813ef90 0x7f1aa8136830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1a9ffff640 1 -- 172.21.15.137:0/2107074551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa8136d70 con 0x7f1aa813faf0 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1a9ffff640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa813faf0 0x7f1aa813a220 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1a90000c00 tx=0x7f1a900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1a9effd640 1 -- 172.21.15.137:0/2107074551 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90037040 con 0x7f1aa813faf0 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1a9effd640 1 -- 172.21.15.137:0/2107074551 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a90042070 con 0x7f1aa813faf0 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa813aba0 con 0x7f1aa813faf0 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1a9effd640 1 -- 172.21.15.137:0/2107074551 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90030860 con 0x7f1aa813faf0 2024-04-26T21:59:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.802+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa80b3220 con 0x7f1aa813faf0 2024-04-26T21:59:34.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.803+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa806a290 con 0x7f1aa813faf0 2024-04-26T21:59:34.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.803+0000 7f1a9effd640 1 -- 172.21.15.137:0/2107074551 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a90030a00 con 0x7f1aa813faf0 2024-04-26T21:59:34.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.804+0000 7f1a9effd640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a8806c8f0 0x7f1a8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:34.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.804+0000 7f1aa659c640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a8806c8f0 0x7f1a8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:34.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.804+0000 7f1a9effd640 1 -- 172.21.15.137:0/2107074551 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1a900ac200 con 0x7f1aa813faf0 2024-04-26T21:59:34.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.804+0000 7f1aa659c640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a8806c8f0 0x7f1a8806edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009560 tx=0x7f1a98009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:34.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:34.808+0000 7f1a9effd640 1 -- 172.21.15.137:0/2107074551 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1aa8136d70 con 0x7f1aa813faf0 2024-04-26T21:59:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.020+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1aa8071550 con 0x7f1aa813faf0 2024-04-26T21:59:35.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.687+0000 7f1a9effd640 1 -- 172.21.15.137:0/2107074551 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f1a9007a070 con 0x7f1aa813faf0 2024-04-26T21:59:35.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a8806c8f0 msgr2=0x7f1a8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:35.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a8806c8f0 0x7f1a8806edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009560 tx=0x7f1a98009190 comp rx=0 tx=0).stop 2024-04-26T21:59:35.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa813faf0 msgr2=0x7f1aa813a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:35.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa813faf0 0x7f1aa813a220 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1a90000c00 tx=0x7f1a900046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 shutdown_connections 2024-04-26T21:59:35.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a8806c8f0 0x7f1a8806edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1aa813faf0 0x7f1aa813a220 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1aa815ca20 0x7f1aa815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 --2- 172.21.15.137:0/2107074551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1aa813ef90 0x7f1aa8136830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 >> 172.21.15.137:0/2107074551 conn(0x7f1aa806f050 msgr2=0x7f1aa815b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:35.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 shutdown_connections 2024-04-26T21:59:35.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.690+0000 7f1aacd39640 1 -- 172.21.15.137:0/2107074551 wait complete. 2024-04-26T21:59:35.704 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T21:59:35.704 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:35.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.804+0000 7f3972a85640 1 Processor -- start 2024-04-26T21:59:35.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.804+0000 7f3972a85640 1 -- start start 2024-04-26T21:59:35.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.805+0000 7f3972a85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:35.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.805+0000 7f3972a85640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f396c0b3de0 0x7f396c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:35.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.805+0000 7f3972a85640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f396c0b4260 con 0x7f396c0b5fd0 2024-04-26T21:59:35.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.805+0000 7f3972a85640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f396c0b6440 con 0x7f396c0b3de0 2024-04-26T21:59:35.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.805+0000 7f3972a85640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f396c0b5140 con 0x7f396c145980 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f3970821640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f396bfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f396c0b3de0 0x7f396c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f3970821640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:37880/0 (socket says 172.21.15.137:37880) 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f3971022640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f396c0b5fd0 0x7f396c15c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:40758/0 (socket says 172.21.15.137:40758) 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f3970821640 1 -- 172.21.15.137:0/2399538603 learned_addr learned my addr 172.21.15.137:0/2399538603 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f396bfff640 1 -- 172.21.15.137:0/2399538603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 msgr2=0x7f396c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f396bfff640 1 --2- 172.21.15.137:0/2399538603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f396bfff640 1 -- 172.21.15.137:0/2399538603 >> v1:172.21.15.170:6789/0 conn(0x7f396c0b5fd0 legacy=0x7f396c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f396bfff640 1 -- 172.21.15.137:0/2399538603 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c0b4530 con 0x7f396c0b3de0 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f396b7fe640 1 -- 172.21.15.137:0/2399538603 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206219333 0 0) 0x7f396c0b4260 con 0x7f396c0b5fd0 2024-04-26T21:59:35.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.806+0000 7f3970821640 1 --2- 172.21.15.137:0/2399538603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f396bfff640 1 --2- 172.21.15.137:0/2399538603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c0b3de0 0x7f396c0b5a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f39600097a0 tx=0x7f396002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e77198d40812c4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f396b7fe640 1 -- 172.21.15.137:0/2399538603 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960037070 con 0x7f396c0b3de0 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f396b7fe640 1 -- 172.21.15.137:0/2399538603 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396002ae50 con 0x7f396c0b3de0 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f396b7fe640 1 -- 172.21.15.137:0/2399538603 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960032660 con 0x7f396c0b3de0 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f3972a85640 1 -- 172.21.15.137:0/2399538603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c0b3de0 msgr2=0x7f396c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f3972a85640 1 --2- 172.21.15.137:0/2399538603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c0b3de0 0x7f396c0b5a90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f39600097a0 tx=0x7f396002a100 comp rx=0 tx=0).stop 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f3972a85640 1 -- 172.21.15.137:0/2399538603 shutdown_connections 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f3972a85640 1 --2- 172.21.15.137:0/2399538603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c0b3de0 0x7f396c0b5a90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f3972a85640 1 --2- 172.21.15.137:0/2399538603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f3972a85640 1 -- 172.21.15.137:0/2399538603 >> 172.21.15.137:0/2399538603 conn(0x7f396c0d0d30 msgr2=0x7f396c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f3972a85640 1 -- 172.21.15.137:0/2399538603 shutdown_connections 2024-04-26T21:59:35.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.807+0000 7f3972a85640 1 -- 172.21.15.137:0/2399538603 wait complete. 2024-04-26T21:59:35.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.808+0000 7f3972a85640 1 Processor -- start 2024-04-26T21:59:35.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.809+0000 7f3972a85640 1 -- start start 2024-04-26T21:59:35.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.809+0000 7f3972a85640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c0b3de0 0x7f396c140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:35.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.809+0000 7f3972a85640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f396c0b5fd0 0x7f396c13d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:35.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.809+0000 7f3972a85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c0ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.809+0000 7f3972a85640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f396c0b4dd0 con 0x7f396c0b5fd0 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.809+0000 7f3972a85640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f396c0b4af0 con 0x7f396c0b3de0 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.809+0000 7f3972a85640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f396c0730e0 con 0x7f396c145980 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f396bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f396c0b5fd0 0x7f396c13d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f396bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f396c0b5fd0 0x7f396c13d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50224/0 (socket says 172.21.15.137:50224) 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f396bfff640 1 -- 172.21.15.137:0/3614605194 learned_addr learned my addr 172.21.15.137:0/3614605194 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f3970821640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c0b3de0 0x7f396c140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f3971022640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c0ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f396bfff640 1 -- 172.21.15.137:0/3614605194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 msgr2=0x7f396c0ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f396bfff640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c0ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f396bfff640 1 -- 172.21.15.137:0/3614605194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c0b3de0 msgr2=0x7f396c140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f396bfff640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c0b3de0 0x7f396c140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:35.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f396bfff640 1 -- 172.21.15.137:0/3614605194 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c0af0d0 con 0x7f396c0b5fd0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f396bfff640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f396c0b5fd0 0x7f396c13d870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f39600097a0 tx=0x7f39600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f39697fa640 1 -- 172.21.15.137:0/3614605194 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960037040 con 0x7f396c0b5fd0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f39697fa640 1 -- 172.21.15.137:0/3614605194 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3960004030 con 0x7f396c0b5fd0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c0af3b0 con 0x7f396c0b5fd0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f39697fa640 1 -- 172.21.15.137:0/3614605194 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960004420 con 0x7f396c0b5fd0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.810+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c0af970 con 0x7f396c0b5fd0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.811+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396c06a290 con 0x7f396c0b5fd0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.812+0000 7f39697fa640 1 -- 172.21.15.137:0/3614605194 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3960003610 con 0x7f396c0b5fd0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.812+0000 7f39697fa640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c8f0 0x7f395806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.812+0000 7f39697fa640 1 -- 172.21.15.137:0/3614605194 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f39600ac710 con 0x7f396c0b5fd0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.812+0000 7f3970821640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c8f0 0x7f395806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:35.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.813+0000 7f3970821640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c8f0 0x7f395806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f395c009630 tx=0x7f395c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:35.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:35.817+0000 7f39697fa640 1 -- 172.21.15.137:0/3614605194 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f396007a560 con 0x7f396c0b5fd0 2024-04-26T21:59:36.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.030+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f396c073cc0 con 0x7f396c0b5fd0 2024-04-26T21:59:36.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.031+0000 7f39697fa640 1 -- 172.21.15.137:0/3614605194 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f396007e860 con 0x7f396c0b5fd0 2024-04-26T21:59:36.032 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:36.032 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3532925157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3532925157},{"type":"v1","addr":"172.21.15.137:6836","nonce":3532925157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3509631448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3509631448},{"type":"v1","addr":"172.21.15.170:6834","nonce":3509631448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3228449407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3228449407},{"type":"v1","addr":"172.21.15.170:6835","nonce":3228449407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:59:33.028489+0000","modified":"2024-04-26T21:59:35.023196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1394398285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1394398285},{"type":"v1","addr":"172.21.15.137:6837","nonce":1394398285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5139,"qdb_cluster":[5139]},"id":2}]} 2024-04-26T21:59:36.033 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-04-26T21:59:36.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c8f0 msgr2=0x7f395806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c8f0 0x7f395806edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f395c009630 tx=0x7f395c009240 comp rx=0 tx=0).stop 2024-04-26T21:59:36.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f396c0b5fd0 msgr2=0x7f396c13d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f396c0b5fd0 0x7f396c13d870 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f39600097a0 tx=0x7f39600046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 shutdown_connections 2024-04-26T21:59:36.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f395806c8f0 0x7f395806edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f396c0b5fd0 0x7f396c13d870 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f396c145980 0x7f396c0ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 --2- 172.21.15.137:0/3614605194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f396c0b3de0 0x7f396c140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 >> 172.21.15.137:0/3614605194 conn(0x7f396c0d0d30 msgr2=0x7f396c0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:36.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 shutdown_connections 2024-04-26T21:59:36.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.033+0000 7f3972a85640 1 -- 172.21.15.137:0/3614605194 wait complete. 2024-04-26T21:59:36.045 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:36.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.140+0000 7fb192ff0640 1 Processor -- start 2024-04-26T21:59:36.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.140+0000 7fb192ff0640 1 -- start start 2024-04-26T21:59:36.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb192ff0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb18c0cf2e0 0x7fb18c06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb192ff0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb18c06e490 0x7fb18c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb192ff0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb18c0d1740 con 0x7fb18c0d11b0 2024-04-26T21:59:36.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb192ff0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb18c0d1a20 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb192ff0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb18c0d1d00 con 0x7fb18c06e490 2024-04-26T21:59:36.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb190d8c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb18c0cf2e0 0x7fb18c06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb18bfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb18c0d11b0 0x7fb18c06dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42138/0 (socket says 172.21.15.137:42138) 2024-04-26T21:59:36.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb190d8c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb18c0cf2e0 0x7fb18c06d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50226/0 (socket says 172.21.15.137:50226) 2024-04-26T21:59:36.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb18bfff640 1 -- 172.21.15.137:0/659991788 learned_addr learned my addr 172.21.15.137:0/659991788 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb19158d640 1 --2- 172.21.15.137:0/659991788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb18c06e490 0x7fb18c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb190d8c640 1 -- 172.21.15.137:0/659991788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb18c06e490 msgr2=0x7fb18c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb190d8c640 1 --2- 172.21.15.137:0/659991788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb18c06e490 0x7fb18c15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb190d8c640 1 -- 172.21.15.137:0/659991788 >> v1:172.21.15.137:6789/0 conn(0x7fb18c0d11b0 legacy=0x7fb18c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb190d8c640 1 -- 172.21.15.137:0/659991788 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18c0d1fe0 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.141+0000 7fb18b7fe640 1 -- 172.21.15.137:0/659991788 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292179336 0 0) 0x7fb18c0d1740 con 0x7fb18c0d11b0 2024-04-26T21:59:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.142+0000 7fb190d8c640 1 --2- 172.21.15.137:0/659991788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 0x7fb18c06d4d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb1800097d0 tx=0x7fb18002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e055f956d798f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.142+0000 7fb18b7fe640 1 -- 172.21.15.137:0/659991788 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180037070 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.142+0000 7fb18b7fe640 1 -- 172.21.15.137:0/659991788 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb180032440 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.142+0000 7fb18b7fe640 1 -- 172.21.15.137:0/659991788 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180032810 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.142+0000 7fb192ff0640 1 -- 172.21.15.137:0/659991788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 msgr2=0x7fb18c06d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.142+0000 7fb192ff0640 1 --2- 172.21.15.137:0/659991788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 0x7fb18c06d4d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb1800097d0 tx=0x7fb18002a1c0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.143+0000 7fb192ff0640 1 -- 172.21.15.137:0/659991788 shutdown_connections 2024-04-26T21:59:36.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.143+0000 7fb192ff0640 1 --2- 172.21.15.137:0/659991788 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb18c06e490 0x7fb18c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.143+0000 7fb192ff0640 1 --2- 172.21.15.137:0/659991788 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 0x7fb18c06d4d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.143+0000 7fb192ff0640 1 -- 172.21.15.137:0/659991788 >> 172.21.15.137:0/659991788 conn(0x7fb18c0b4a60 msgr2=0x7fb18c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:36.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.143+0000 7fb192ff0640 1 -- 172.21.15.137:0/659991788 shutdown_connections 2024-04-26T21:59:36.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.143+0000 7fb192ff0640 1 -- 172.21.15.137:0/659991788 wait complete. 2024-04-26T21:59:36.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.144+0000 7fb192ff0640 1 Processor -- start 2024-04-26T21:59:36.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.144+0000 7fb192ff0640 1 -- start start 2024-04-26T21:59:36.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb192ff0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb18c06e490 0x7fb18c1e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb192ff0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 0x7fb18c0705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb192ff0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb18c0d11b0 0x7fb18c151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb192ff0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c0cf6c0 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb192ff0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb18c06da10 con 0x7fb18c06e490 2024-04-26T21:59:36.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb192ff0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb18c0cf840 con 0x7fb18c0d11b0 2024-04-26T21:59:36.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb18bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 0x7fb18c0705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb18bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 0x7fb18c0705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50236/0 (socket says 172.21.15.137:50236) 2024-04-26T21:59:36.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb18bfff640 1 -- 172.21.15.137:0/2466893364 learned_addr learned my addr 172.21.15.137:0/2466893364 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:36.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb190d8c640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb18c06e490 0x7fb18c1e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb18bfff640 1 -- 172.21.15.137:0/2466893364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb18c0d11b0 msgr2=0x7fb18c151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb18bfff640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb18c0d11b0 0x7fb18c151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb18bfff640 1 -- 172.21.15.137:0/2466893364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb18c06e490 msgr2=0x7fb18c1e96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb18bfff640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb18c06e490 0x7fb18c1e96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb18bfff640 1 -- 172.21.15.137:0/2466893364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18c152a00 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb18bfff640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 0x7fb18c0705a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c430 tx=0x7fb17800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:36.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb1897fa640 1 -- 172.21.15.137:0/2466893364 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1780074e0 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb1897fa640 1 -- 172.21.15.137:0/2466893364 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1780047e0 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb18c152ce0 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb1897fa640 1 -- 172.21.15.137:0/2466893364 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178004bd0 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.145+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18c1e91d0 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.146+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb18c06a290 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.147+0000 7fb1897fa640 1 -- 172.21.15.137:0/2466893364 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb178011070 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.147+0000 7fb1897fa640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb17006c8f0 0x7fb17006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.147+0000 7fb190d8c640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb17006c8f0 0x7fb17006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.147+0000 7fb1897fa640 1 -- 172.21.15.137:0/2466893364 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb17808b830 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.148+0000 7fb190d8c640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb17006c8f0 0x7fb17006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb180034000 tx=0x7fb18002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:36.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.152+0000 7fb1897fa640 1 -- 172.21.15.137:0/2466893364 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb178059c60 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.328+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb18c1e93a0 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.329+0000 7fb1897fa640 1 -- 172.21.15.137:0/2466893364 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16681 (secure 0 0 0) 0x7fb178059560 con 0x7fb18c0cf2e0 2024-04-26T21:59:36.331 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:36.331 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":34,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:34.679270+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:59:31.445571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T21:59:31.978335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb17006c8f0 msgr2=0x7fb17006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb17006c8f0 0x7fb17006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb180034000 tx=0x7fb18002e000 comp rx=0 tx=0).stop 2024-04-26T21:59:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 msgr2=0x7fb18c0705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 0x7fb18c0705a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c430 tx=0x7fb17800c8f0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 shutdown_connections 2024-04-26T21:59:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb17006c8f0 0x7fb17006edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb18c0cf2e0 0x7fb18c0705a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb18c0d11b0 0x7fb18c151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 --2- 172.21.15.137:0/2466893364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb18c06e490 0x7fb18c1e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 >> 172.21.15.137:0/2466893364 conn(0x7fb18c0b4a60 msgr2=0x7fb18c09c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 shutdown_connections 2024-04-26T21:59:36.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.332+0000 7fb192ff0640 1 -- 172.21.15.137:0/2466893364 wait complete. 2024-04-26T21:59:36.344 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T21:59:36.344 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:59:36.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.440+0000 7fab21122640 1 Processor -- start 2024-04-26T21:59:36.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.440+0000 7fab21122640 1 -- start start 2024-04-26T21:59:36.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab21122640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fab1c13ff70 0x7fab1c146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab21122640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c140350 0x7fab1c1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab21122640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab1c0d05b0 con 0x7fab1c0cf810 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab21122640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fab1c0d0390 con 0x7fab1c13ff70 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab21122640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab1c0d0890 con 0x7fab1c140350 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1b59e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fab1c0cf810 0x7fab1c0cfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42154/0 (socket says 172.21.15.137:42154) 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1b59e640 1 -- 172.21.15.137:0/1015641954 learned_addr learned my addr 172.21.15.137:0/1015641954 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1ad9d640 1 --2- 172.21.15.137:0/1015641954 >> v2:172.21.15.170:3300/0 conn(0x7fab1c13ff70 0x7fab1c146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab13fff640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c140350 0x7fab1c1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498865049 0 0) 0x7fab1c0d05b0 con 0x7fab1c0cf810 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab08003520 con 0x7fab1c0cf810 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2740393205 0 0) 0x7fab08003520 con 0x7fab1c0cf810 2024-04-26T21:59:36.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c140350 msgr2=0x7fab1c1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:36.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c140350 0x7fab1c1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 >> v2:172.21.15.170:3300/0 conn(0x7fab1c13ff70 msgr2=0x7fab1c146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:36.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 --2- 172.21.15.137:0/1015641954 >> v2:172.21.15.170:3300/0 conn(0x7fab1c13ff70 0x7fab1c146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c06e450 con 0x7fab1c0cf810 2024-04-26T21:59:36.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fab140019f0 con 0x7fab1c0cf810 2024-04-26T21:59:36.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 >> v1:172.21.15.137:6789/0 conn(0x7fab1c0cf810 legacy=0x7fab1c0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab080039b0 0x7fab08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c140350 0x7fab08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab08004d40 0x7fab080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c0d0390 con 0x7fab08004d40 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c0d0890 con 0x7fab080039b0 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab0800b9f0 con 0x7fab1c140350 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.441+0000 7fab1b59e640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab08004d40 0x7fab080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab13fff640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c140350 0x7fab08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab1ad9d640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab080039b0 0x7fab08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab1b59e640 1 -- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c140350 msgr2=0x7fab08004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab1b59e640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c140350 0x7fab08004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab1b59e640 1 -- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab080039b0 msgr2=0x7fab08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab1b59e640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab080039b0 0x7fab08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab1b59e640 1 -- 172.21.15.137:0/1015641954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab08003520 con 0x7fab08004d40 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab1ad9d640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab080039b0 0x7fab08003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:36.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab1b59e640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab08004d40 0x7fab080051c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fab1400a880 tx=0x7fab08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6ef479ff2f8545 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.442+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1400a4a0 con 0x7fab08004d40 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.443+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1402f070 con 0x7fab08004d40 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.443+0000 7fab1a59c640 1 -- 172.21.15.137:0/1015641954 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1402bd00 con 0x7fab08004d40 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.443+0000 7fab21122640 1 -- 172.21.15.137:0/1015641954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab08004d40 msgr2=0x7fab080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.443+0000 7fab21122640 1 --2- 172.21.15.137:0/1015641954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab08004d40 0x7fab080051c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fab1400a880 tx=0x7fab08005830 comp rx=0 tx=0).stop 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.443+0000 7fab1b59e640 1 -- 172.21.15.137:0/1015641954 reap_dead start 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.443+0000 7fab21122640 1 -- 172.21.15.137:0/1015641954 shutdown_connections 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.443+0000 7fab21122640 1 -- 172.21.15.137:0/1015641954 >> 172.21.15.137:0/1015641954 conn(0x7fab1c0d0d30 msgr2=0x7fab1c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.443+0000 7fab21122640 1 -- 172.21.15.137:0/1015641954 shutdown_connections 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.443+0000 7fab21122640 1 -- 172.21.15.137:0/1015641954 wait complete. 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.444+0000 7fab21122640 1 Processor -- start 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.444+0000 7fab21122640 1 -- start start 2024-04-26T21:59:36.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab21122640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c0b5b20 0x7fab1c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab21122640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab1c0b5f00 0x7fab1c1f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab21122640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab1c13b120 0x7fab1c13b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab21122640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c146740 con 0x7fab1c13b120 2024-04-26T21:59:36.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab21122640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c1465c0 con 0x7fab1c0b5f00 2024-04-26T21:59:36.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab21122640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab1c1468c0 con 0x7fab1c0b5b20 2024-04-26T21:59:36.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab1b59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab1c13b120 0x7fab1c13b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab1b59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab1c13b120 0x7fab1c13b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50256/0 (socket says 172.21.15.137:50256) 2024-04-26T21:59:36.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab1b59e640 1 -- 172.21.15.137:0/233939365 learned_addr learned my addr 172.21.15.137:0/233939365 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:36.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab1ad9d640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c0b5b20 0x7fab1c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab13fff640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab1c0b5f00 0x7fab1c1f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab1b59e640 1 -- 172.21.15.137:0/233939365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c0b5b20 msgr2=0x7fab1c15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab1b59e640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c0b5b20 0x7fab1c15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab1b59e640 1 -- 172.21.15.137:0/233939365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab1c0b5f00 msgr2=0x7fab1c1f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab1b59e640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab1c0b5f00 0x7fab1c1f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab1b59e640 1 -- 172.21.15.137:0/233939365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c1f6770 con 0x7fab1c13b120 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.445+0000 7fab13fff640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab1c0b5f00 0x7fab1c1f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.446+0000 7fab1b59e640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab1c13b120 0x7fab1c13b5a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fab14001cf0 tx=0x7fab1c0d0780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.446+0000 7fab137fe640 1 -- 172.21.15.137:0/233939365 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1400a4a0 con 0x7fab1c13b120 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.446+0000 7fab137fe640 1 -- 172.21.15.137:0/233939365 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab14034470 con 0x7fab1c13b120 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.446+0000 7fab137fe640 1 -- 172.21.15.137:0/233939365 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14001ff0 con 0x7fab1c13b120 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.446+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab1c1f6a10 con 0x7fab1c13b120 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.446+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab1c1f6fd0 con 0x7fab1c13b120 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.447+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab1c06a290 con 0x7fab1c13b120 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.447+0000 7fab137fe640 1 -- 172.21.15.137:0/233939365 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab14034840 con 0x7fab1c13b120 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.448+0000 7fab137fe640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faafc06c8f0 0x7faafc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.448+0000 7fab137fe640 1 -- 172.21.15.137:0/233939365 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fab140abcd0 con 0x7fab1c13b120 2024-04-26T21:59:36.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.448+0000 7fab1ad9d640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faafc06c8f0 0x7faafc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.448+0000 7fab1ad9d640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faafc06c8f0 0x7faafc06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009930 tx=0x7fab0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:36.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.452+0000 7fab137fe640 1 -- 172.21.15.137:0/233939365 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fab14046060 con 0x7fab1c13b120 2024-04-26T21:59:36.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.624+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab1c06d2b0 con 0x7faafc06c8f0 2024-04-26T21:59:36.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.630+0000 7fab137fe640 1 -- 172.21.15.137:0/233939365 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7fab1c06d2b0 con 0x7faafc06c8f0 2024-04-26T21:59:36.633 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:36.634 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faafc06c8f0 msgr2=0x7faafc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faafc06c8f0 0x7faafc06edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fab0c009930 tx=0x7fab0c008040 comp rx=0 tx=0).stop 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab1c13b120 msgr2=0x7fab1c13b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab1c13b120 0x7fab1c13b5a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fab14001cf0 tx=0x7fab1c0d0780 comp rx=0 tx=0).stop 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 shutdown_connections 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faafc06c8f0 0x7faafc06edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab1c13b120 0x7fab1c13b5a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab1c0b5f00 0x7fab1c1f6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 --2- 172.21.15.137:0/233939365 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab1c0b5b20 0x7fab1c15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 >> 172.21.15.137:0/233939365 conn(0x7fab1c0d0d30 msgr2=0x7fab1c15fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:36.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 shutdown_connections 2024-04-26T21:59:36.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.633+0000 7fab21122640 1 -- 172.21.15.137:0/233939365 wait complete. 2024-04-26T21:59:36.644 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-26T21:59:34.703302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236692,"kb_used_data":3892,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738028,"statfs":{"total":773094113280,"available":772851740672,"internally_reserved":0,"allocated":3985408,"data_stored":2242499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000630"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678274+0000","last_change":"2024-04-26T21:59:32.678274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678274+0000","last_undegraded":"2024-04-26T21:59:32.678274+0000","last_fullsized":"2024-04-26T21:59:32.678274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.680281+0000","last_change":"2024-04-26T21:59:32.680281+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.680281+0000","last_undegraded":"2024-04-26T21:59:32.680281+0000","last_fullsized":"2024-04-26T21:59:32.680281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679007+0000","last_change":"2024-04-26T21:59:32.679007+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679007+0000","last_undegraded":"2024-04-26T21:59:32.679007+0000","last_fullsized":"2024-04-26T21:59:32.679007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678488+0000","last_change":"2024-04-26T21:59:32.678488+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678488+0000","last_undegraded":"2024-04-26T21:59:32.678488+0000","last_fullsized":"2024-04-26T21:59:32.678488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679092+0000","last_change":"2024-04-26T21:59:32.679092+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679092+0000","last_undegraded":"2024-04-26T21:59:32.679092+0000","last_fullsized":"2024-04-26T21:59:32.679092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.680273+0000","last_change":"2024-04-26T21:59:32.680273+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.680273+0000","last_undegraded":"2024-04-26T21:59:32.680273+0000","last_fullsized":"2024-04-26T21:59:32.680273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678556+0000","last_change":"2024-04-26T21:59:32.678556+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678556+0000","last_undegraded":"2024-04-26T21:59:32.678556+0000","last_fullsized":"2024-04-26T21:59:32.678556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678086+0000","last_change":"2024-04-26T21:59:32.678086+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678086+0000","last_undegraded":"2024-04-26T21:59:32.678086+0000","last_fullsized":"2024-04-26T21:59:32.678086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679274+0000","last_change":"2024-04-26T21:59:32.679274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679274+0000","last_undegraded":"2024-04-26T21:59:32.679274+0000","last_fullsized":"2024-04-26T21:59:32.679274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678642+0000","last_change":"2024-04-26T21:59:32.678642+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678642+0000","last_undegraded":"2024-04-26T21:59:32.678642+0000","last_fullsized":"2024-04-26T21:59:32.678642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678065+0000","last_change":"2024-04-26T21:59:32.678065+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678065+0000","last_undegraded":"2024-04-26T21:59:32.678065+0000","last_fullsized":"2024-04-26T21:59:32.678065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678990+0000","last_change":"2024-04-26T21:59:32.678990+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678990+0000","last_undegraded":"2024-04-26T21:59:32.678990+0000","last_fullsized":"2024-04-26T21:59:32.678990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678673+0000","last_change":"2024-04-26T21:59:32.678673+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678673+0000","last_undegraded":"2024-04-26T21:59:32.678673+0000","last_fullsized":"2024-04-26T21:59:32.678673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679787+0000","last_change":"2024-04-26T21:59:32.679787+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679787+0000","last_undegraded":"2024-04-26T21:59:32.679787+0000","last_fullsized":"2024-04-26T21:59:32.679787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678230+0000","last_change":"2024-04-26T21:59:32.678230+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678230+0000","last_undegraded":"2024-04-26T21:59:32.678230+0000","last_fullsized":"2024-04-26T21:59:32.678230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677063+0000","last_change":"2024-04-26T21:59:32.677063+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677063+0000","last_undegraded":"2024-04-26T21:59:32.677063+0000","last_fullsized":"2024-04-26T21:59:32.677063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676815+0000","last_change":"2024-04-26T21:59:32.676815+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676815+0000","last_undegraded":"2024-04-26T21:59:32.676815+0000","last_fullsized":"2024-04-26T21:59:32.676815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679769+0000","last_change":"2024-04-26T21:59:32.679769+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679769+0000","last_undegraded":"2024-04-26T21:59:32.679769+0000","last_fullsized":"2024-04-26T21:59:32.679769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679294+0000","last_change":"2024-04-26T21:59:32.679294+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679294+0000","last_undegraded":"2024-04-26T21:59:32.679294+0000","last_fullsized":"2024-04-26T21:59:32.679294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679422+0000","last_change":"2024-04-26T21:59:32.679422+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679422+0000","last_undegraded":"2024-04-26T21:59:32.679422+0000","last_fullsized":"2024-04-26T21:59:32.679422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678586+0000","last_change":"2024-04-26T21:59:32.678586+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678586+0000","last_undegraded":"2024-04-26T21:59:32.678586+0000","last_fullsized":"2024-04-26T21:59:32.678586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677858+0000","last_change":"2024-04-26T21:59:32.677858+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677858+0000","last_undegraded":"2024-04-26T21:59:32.677858+0000","last_fullsized":"2024-04-26T21:59:32.677858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675755+0000","last_change":"2024-04-26T21:59:32.675755+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675755+0000","last_undegraded":"2024-04-26T21:59:32.675755+0000","last_fullsized":"2024-04-26T21:59:32.675755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677757+0000","last_change":"2024-04-26T21:59:32.677757+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677757+0000","last_undegraded":"2024-04-26T21:59:32.677757+0000","last_fullsized":"2024-04-26T21:59:32.677757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677513+0000","last_change":"2024-04-26T21:59:32.677513+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677513+0000","last_undegraded":"2024-04-26T21:59:32.677513+0000","last_fullsized":"2024-04-26T21:59:32.677513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679315+0000","last_change":"2024-04-26T21:59:32.679315+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679315+0000","last_undegraded":"2024-04-26T21:59:32.679315+0000","last_fullsized":"2024-04-26T21:59:32.679315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676238+0000","last_change":"2024-04-26T21:59:32.676238+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676238+0000","last_undegraded":"2024-04-26T21:59:32.676238+0000","last_fullsized":"2024-04-26T21:59:32.676238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677274+0000","last_change":"2024-04-26T21:59:32.677274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677274+0000","last_undegraded":"2024-04-26T21:59:32.677274+0000","last_fullsized":"2024-04-26T21:59:32.677274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678217+0000","last_change":"2024-04-26T21:59:32.678217+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678217+0000","last_undegraded":"2024-04-26T21:59:32.678217+0000","last_fullsized":"2024-04-26T21:59:32.678217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676669+0000","last_change":"2024-04-26T21:59:32.676669+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676669+0000","last_undegraded":"2024-04-26T21:59:32.676669+0000","last_fullsized":"2024-04-26T21:59:32.676669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677376+0000","last_change":"2024-04-26T21:59:32.677376+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677376+0000","last_undegraded":"2024-04-26T21:59:32.677376+0000","last_fullsized":"2024-04-26T21:59:32.677376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676596+0000","last_change":"2024-04-26T21:59:32.676596+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676596+0000","last_undegraded":"2024-04-26T21:59:32.676596+0000","last_fullsized":"2024-04-26T21:59:32.676596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677150+0000","last_change":"2024-04-26T21:59:32.677150+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677150+0000","last_undegraded":"2024-04-26T21:59:32.677150+0000","last_fullsized":"2024-04-26T21:59:32.677150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.688401+0000","last_change":"2024-04-26T21:59:32.687035+0000","last_active":"2024-04-26T21:59:32.688401+0000","last_peered":"2024-04-26T21:59:32.688401+0000","last_clean":"2024-04-26T21:59:32.688401+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:32.688401+0000","last_undegraded":"2024-04-26T21:59:32.688401+0000","last_fullsized":"2024-04-26T21:59:32.688401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677872+0000","last_change":"2024-04-26T21:59:32.677872+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677872+0000","last_undegraded":"2024-04-26T21:59:32.677872+0000","last_fullsized":"2024-04-26T21:59:32.677872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689793+0000","last_change":"2024-04-26T21:59:32.683890+0000","last_active":"2024-04-26T21:59:32.689793+0000","last_peered":"2024-04-26T21:59:32.689793+0000","last_clean":"2024-04-26T21:59:32.689793+0000","last_became_active":"2024-04-26T21:59:32.683625+0000","last_became_peered":"2024-04-26T21:59:32.683625+0000","last_unstale":"2024-04-26T21:59:32.689793+0000","last_undegraded":"2024-04-26T21:59:32.689793+0000","last_fullsized":"2024-04-26T21:59:32.689793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:11.635296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678732+0000","last_change":"2024-04-26T21:59:32.678732+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678732+0000","last_undegraded":"2024-04-26T21:59:32.678732+0000","last_fullsized":"2024-04-26T21:59:32.678732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691339+0000","last_change":"2024-04-26T21:59:32.688412+0000","last_active":"2024-04-26T21:59:32.691339+0000","last_peered":"2024-04-26T21:59:32.691339+0000","last_clean":"2024-04-26T21:59:32.691339+0000","last_became_active":"2024-04-26T21:59:32.688125+0000","last_became_peered":"2024-04-26T21:59:32.688125+0000","last_unstale":"2024-04-26T21:59:32.691339+0000","last_undegraded":"2024-04-26T21:59:32.691339+0000","last_fullsized":"2024-04-26T21:59:32.691339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:02.376805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675751+0000","last_change":"2024-04-26T21:59:32.675751+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675751+0000","last_undegraded":"2024-04-26T21:59:32.675751+0000","last_fullsized":"2024-04-26T21:59:32.675751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689758+0000","last_change":"2024-04-26T21:59:32.689082+0000","last_active":"2024-04-26T21:59:32.689758+0000","last_peered":"2024-04-26T21:59:32.689758+0000","last_clean":"2024-04-26T21:59:32.689758+0000","last_became_active":"2024-04-26T21:59:32.688823+0000","last_became_peered":"2024-04-26T21:59:32.688823+0000","last_unstale":"2024-04-26T21:59:32.689758+0000","last_undegraded":"2024-04-26T21:59:32.689758+0000","last_fullsized":"2024-04-26T21:59:32.689758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:47.525567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675243+0000","last_change":"2024-04-26T21:59:32.675243+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675243+0000","last_undegraded":"2024-04-26T21:59:32.675243+0000","last_fullsized":"2024-04-26T21:59:32.675243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691539+0000","last_change":"2024-04-26T21:59:32.690777+0000","last_active":"2024-04-26T21:59:32.691539+0000","last_peered":"2024-04-26T21:59:32.691539+0000","last_clean":"2024-04-26T21:59:32.691539+0000","last_became_active":"2024-04-26T21:59:32.690516+0000","last_became_peered":"2024-04-26T21:59:32.690516+0000","last_unstale":"2024-04-26T21:59:32.691539+0000","last_undegraded":"2024-04-26T21:59:32.691539+0000","last_fullsized":"2024-04-26T21:59:32.691539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.585367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677315+0000","last_change":"2024-04-26T21:59:32.677315+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677315+0000","last_undegraded":"2024-04-26T21:59:32.677315+0000","last_fullsized":"2024-04-26T21:59:32.677315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691560+0000","last_change":"2024-04-26T21:59:32.690853+0000","last_active":"2024-04-26T21:59:32.691560+0000","last_peered":"2024-04-26T21:59:32.691560+0000","last_clean":"2024-04-26T21:59:32.691560+0000","last_became_active":"2024-04-26T21:59:32.690526+0000","last_became_peered":"2024-04-26T21:59:32.690526+0000","last_unstale":"2024-04-26T21:59:32.691560+0000","last_undegraded":"2024-04-26T21:59:32.691560+0000","last_fullsized":"2024-04-26T21:59:32.691560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:42.939756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674905+0000","last_change":"2024-04-26T21:59:32.674905+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674905+0000","last_undegraded":"2024-04-26T21:59:32.674905+0000","last_fullsized":"2024-04-26T21:59:32.674905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691283+0000","last_change":"2024-04-26T21:59:32.687125+0000","last_active":"2024-04-26T21:59:32.691283+0000","last_peered":"2024-04-26T21:59:32.691283+0000","last_clean":"2024-04-26T21:59:32.691283+0000","last_became_active":"2024-04-26T21:59:32.686826+0000","last_became_peered":"2024-04-26T21:59:32.686826+0000","last_unstale":"2024-04-26T21:59:32.691283+0000","last_undegraded":"2024-04-26T21:59:32.691283+0000","last_fullsized":"2024-04-26T21:59:32.691283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:45.135845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677093+0000","last_change":"2024-04-26T21:59:32.677093+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677093+0000","last_undegraded":"2024-04-26T21:59:32.677093+0000","last_fullsized":"2024-04-26T21:59:32.677093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689148+0000","last_change":"2024-04-26T21:59:32.686878+0000","last_active":"2024-04-26T21:59:32.689148+0000","last_peered":"2024-04-26T21:59:32.689148+0000","last_clean":"2024-04-26T21:59:32.689148+0000","last_became_active":"2024-04-26T21:59:32.686568+0000","last_became_peered":"2024-04-26T21:59:32.686568+0000","last_unstale":"2024-04-26T21:59:32.689148+0000","last_undegraded":"2024-04-26T21:59:32.689148+0000","last_fullsized":"2024-04-26T21:59:32.689148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:07.883511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676773+0000","last_change":"2024-04-26T21:59:32.676773+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676773+0000","last_undegraded":"2024-04-26T21:59:32.676773+0000","last_fullsized":"2024-04-26T21:59:32.676773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691271+0000","last_change":"2024-04-26T21:59:32.685122+0000","last_active":"2024-04-26T21:59:32.691271+0000","last_peered":"2024-04-26T21:59:32.691271+0000","last_clean":"2024-04-26T21:59:32.691271+0000","last_became_active":"2024-04-26T21:59:32.684797+0000","last_became_peered":"2024-04-26T21:59:32.684797+0000","last_unstale":"2024-04-26T21:59:32.691271+0000","last_undegraded":"2024-04-26T21:59:32.691271+0000","last_fullsized":"2024-04-26T21:59:32.691271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:42.691495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679248+0000","last_change":"2024-04-26T21:59:32.679248+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679248+0000","last_undegraded":"2024-04-26T21:59:32.679248+0000","last_fullsized":"2024-04-26T21:59:32.679248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689876+0000","last_change":"2024-04-26T21:59:32.685108+0000","last_active":"2024-04-26T21:59:32.689876+0000","last_peered":"2024-04-26T21:59:32.689876+0000","last_clean":"2024-04-26T21:59:32.689876+0000","last_became_active":"2024-04-26T21:59:32.684831+0000","last_became_peered":"2024-04-26T21:59:32.684831+0000","last_unstale":"2024-04-26T21:59:32.689876+0000","last_undegraded":"2024-04-26T21:59:32.689876+0000","last_fullsized":"2024-04-26T21:59:32.689876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678241+0000","last_change":"2024-04-26T21:59:32.678241+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678241+0000","last_undegraded":"2024-04-26T21:59:32.678241+0000","last_fullsized":"2024-04-26T21:59:32.678241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.687651+0000","last_change":"2024-04-26T21:59:32.684327+0000","last_active":"2024-04-26T21:59:32.687651+0000","last_peered":"2024-04-26T21:59:32.687651+0000","last_clean":"2024-04-26T21:59:32.687651+0000","last_became_active":"2024-04-26T21:59:32.684028+0000","last_became_peered":"2024-04-26T21:59:32.684028+0000","last_unstale":"2024-04-26T21:59:32.687651+0000","last_undegraded":"2024-04-26T21:59:32.687651+0000","last_fullsized":"2024-04-26T21:59:32.687651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:20.380688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676154+0000","last_change":"2024-04-26T21:59:32.676154+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676154+0000","last_undegraded":"2024-04-26T21:59:32.676154+0000","last_fullsized":"2024-04-26T21:59:32.676154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691339+0000","last_change":"2024-04-26T21:59:32.688426+0000","last_active":"2024-04-26T21:59:32.691339+0000","last_peered":"2024-04-26T21:59:32.691339+0000","last_clean":"2024-04-26T21:59:32.691339+0000","last_became_active":"2024-04-26T21:59:32.688159+0000","last_became_peered":"2024-04-26T21:59:32.688159+0000","last_unstale":"2024-04-26T21:59:32.691339+0000","last_undegraded":"2024-04-26T21:59:32.691339+0000","last_fullsized":"2024-04-26T21:59:32.691339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677918+0000","last_change":"2024-04-26T21:59:32.677918+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677918+0000","last_undegraded":"2024-04-26T21:59:32.677918+0000","last_fullsized":"2024-04-26T21:59:32.677918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689164+0000","last_change":"2024-04-26T21:59:32.687044+0000","last_active":"2024-04-26T21:59:32.689164+0000","last_peered":"2024-04-26T21:59:32.689164+0000","last_clean":"2024-04-26T21:59:32.689164+0000","last_became_active":"2024-04-26T21:59:32.686749+0000","last_became_peered":"2024-04-26T21:59:32.686749+0000","last_unstale":"2024-04-26T21:59:32.689164+0000","last_undegraded":"2024-04-26T21:59:32.689164+0000","last_fullsized":"2024-04-26T21:59:32.689164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:54.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677540+0000","last_change":"2024-04-26T21:59:32.677540+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677540+0000","last_undegraded":"2024-04-26T21:59:32.677540+0000","last_fullsized":"2024-04-26T21:59:32.677540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.686410+0000","last_change":"2024-04-26T21:59:32.684862+0000","last_active":"2024-04-26T21:59:32.686410+0000","last_peered":"2024-04-26T21:59:32.686410+0000","last_clean":"2024-04-26T21:59:32.686410+0000","last_became_active":"2024-04-26T21:59:32.684371+0000","last_became_peered":"2024-04-26T21:59:32.684371+0000","last_unstale":"2024-04-26T21:59:32.686410+0000","last_undegraded":"2024-04-26T21:59:32.686410+0000","last_fullsized":"2024-04-26T21:59:32.686410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675225+0000","last_change":"2024-04-26T21:59:32.675225+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675225+0000","last_undegraded":"2024-04-26T21:59:32.675225+0000","last_fullsized":"2024-04-26T21:59:32.675225+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691175+0000","last_change":"2024-04-26T21:59:32.684322+0000","last_active":"2024-04-26T21:59:32.691175+0000","last_peered":"2024-04-26T21:59:32.691175+0000","last_clean":"2024-04-26T21:59:32.691175+0000","last_became_active":"2024-04-26T21:59:32.684050+0000","last_became_peered":"2024-04-26T21:59:32.684050+0000","last_unstale":"2024-04-26T21:59:32.691175+0000","last_undegraded":"2024-04-26T21:59:32.691175+0000","last_fullsized":"2024-04-26T21:59:32.691175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676893+0000","last_change":"2024-04-26T21:59:32.676893+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676893+0000","last_undegraded":"2024-04-26T21:59:32.676893+0000","last_fullsized":"2024-04-26T21:59:32.676893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691158+0000","last_change":"2024-04-26T21:59:32.683976+0000","last_active":"2024-04-26T21:59:32.691158+0000","last_peered":"2024-04-26T21:59:32.691158+0000","last_clean":"2024-04-26T21:59:32.691158+0000","last_became_active":"2024-04-26T21:59:32.683703+0000","last_became_peered":"2024-04-26T21:59:32.683703+0000","last_unstale":"2024-04-26T21:59:32.691158+0000","last_undegraded":"2024-04-26T21:59:32.691158+0000","last_fullsized":"2024-04-26T21:59:32.691158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679491+0000","last_change":"2024-04-26T21:59:32.679491+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679491+0000","last_undegraded":"2024-04-26T21:59:32.679491+0000","last_fullsized":"2024-04-26T21:59:32.679491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.692374+0000","last_change":"2024-04-26T21:59:32.687047+0000","last_active":"2024-04-26T21:59:32.692374+0000","last_peered":"2024-04-26T21:59:32.692374+0000","last_clean":"2024-04-26T21:59:32.692374+0000","last_became_active":"2024-04-26T21:59:32.686745+0000","last_became_peered":"2024-04-26T21:59:32.686745+0000","last_unstale":"2024-04-26T21:59:32.692374+0000","last_undegraded":"2024-04-26T21:59:32.692374+0000","last_fullsized":"2024-04-26T21:59:32.692374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675546+0000","last_change":"2024-04-26T21:59:32.675546+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675546+0000","last_undegraded":"2024-04-26T21:59:32.675546+0000","last_fullsized":"2024-04-26T21:59:32.675546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689541+0000","last_change":"2024-04-26T21:59:32.688686+0000","last_active":"2024-04-26T21:59:32.689541+0000","last_peered":"2024-04-26T21:59:32.689541+0000","last_clean":"2024-04-26T21:59:32.689541+0000","last_became_active":"2024-04-26T21:59:32.688324+0000","last_became_peered":"2024-04-26T21:59:32.688324+0000","last_unstale":"2024-04-26T21:59:32.689541+0000","last_undegraded":"2024-04-26T21:59:32.689541+0000","last_fullsized":"2024-04-26T21:59:32.689541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:23.800646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678050+0000","last_change":"2024-04-26T21:59:32.678050+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678050+0000","last_undegraded":"2024-04-26T21:59:32.678050+0000","last_fullsized":"2024-04-26T21:59:32.678050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689222+0000","last_change":"2024-04-26T21:59:32.687084+0000","last_active":"2024-04-26T21:59:32.689222+0000","last_peered":"2024-04-26T21:59:32.689222+0000","last_clean":"2024-04-26T21:59:32.689222+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:32.689222+0000","last_undegraded":"2024-04-26T21:59:32.689222+0000","last_fullsized":"2024-04-26T21:59:32.689222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:32:30.568876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679745+0000","last_change":"2024-04-26T21:59:32.679745+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679745+0000","last_undegraded":"2024-04-26T21:59:32.679745+0000","last_fullsized":"2024-04-26T21:59:32.679745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691565+0000","last_change":"2024-04-26T21:59:32.691030+0000","last_active":"2024-04-26T21:59:32.691565+0000","last_peered":"2024-04-26T21:59:32.691565+0000","last_clean":"2024-04-26T21:59:32.691565+0000","last_became_active":"2024-04-26T21:59:32.690506+0000","last_became_peered":"2024-04-26T21:59:32.690506+0000","last_unstale":"2024-04-26T21:59:32.691565+0000","last_undegraded":"2024-04-26T21:59:32.691565+0000","last_fullsized":"2024-04-26T21:59:32.691565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:36.604666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677132+0000","last_change":"2024-04-26T21:59:32.677132+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677132+0000","last_undegraded":"2024-04-26T21:59:32.677132+0000","last_fullsized":"2024-04-26T21:59:32.677132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691189+0000","last_change":"2024-04-26T21:59:32.688347+0000","last_active":"2024-04-26T21:59:32.691189+0000","last_peered":"2024-04-26T21:59:32.691189+0000","last_clean":"2024-04-26T21:59:32.691189+0000","last_became_active":"2024-04-26T21:59:32.688072+0000","last_became_peered":"2024-04-26T21:59:32.688072+0000","last_unstale":"2024-04-26T21:59:32.691189+0000","last_undegraded":"2024-04-26T21:59:32.691189+0000","last_fullsized":"2024-04-26T21:59:32.691189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678256+0000","last_change":"2024-04-26T21:59:32.678256+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678256+0000","last_undegraded":"2024-04-26T21:59:32.678256+0000","last_fullsized":"2024-04-26T21:59:32.678256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.687532+0000","last_change":"2024-04-26T21:59:32.686618+0000","last_active":"2024-04-26T21:59:32.687532+0000","last_peered":"2024-04-26T21:59:32.687532+0000","last_clean":"2024-04-26T21:59:32.687532+0000","last_became_active":"2024-04-26T21:59:32.686281+0000","last_became_peered":"2024-04-26T21:59:32.686281+0000","last_unstale":"2024-04-26T21:59:32.687532+0000","last_undegraded":"2024-04-26T21:59:32.687532+0000","last_fullsized":"2024-04-26T21:59:32.687532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:11.635296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676641+0000","last_change":"2024-04-26T21:59:32.676641+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676641+0000","last_undegraded":"2024-04-26T21:59:32.676641+0000","last_fullsized":"2024-04-26T21:59:32.676641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.690052+0000","last_change":"2024-04-26T21:59:32.689448+0000","last_active":"2024-04-26T21:59:32.690052+0000","last_peered":"2024-04-26T21:59:32.690052+0000","last_clean":"2024-04-26T21:59:32.690052+0000","last_became_active":"2024-04-26T21:59:32.689075+0000","last_became_peered":"2024-04-26T21:59:32.689075+0000","last_unstale":"2024-04-26T21:59:32.690052+0000","last_undegraded":"2024-04-26T21:59:32.690052+0000","last_fullsized":"2024-04-26T21:59:32.690052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:47.525567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674682+0000","last_change":"2024-04-26T21:59:32.674682+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674682+0000","last_undegraded":"2024-04-26T21:59:32.674682+0000","last_fullsized":"2024-04-26T21:59:32.674682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.686774+0000","last_change":"2024-04-26T21:59:32.683700+0000","last_active":"2024-04-26T21:59:32.686774+0000","last_peered":"2024-04-26T21:59:32.686774+0000","last_clean":"2024-04-26T21:59:32.686774+0000","last_became_active":"2024-04-26T21:59:32.683407+0000","last_became_peered":"2024-04-26T21:59:32.683407+0000","last_unstale":"2024-04-26T21:59:32.686774+0000","last_undegraded":"2024-04-26T21:59:32.686774+0000","last_fullsized":"2024-04-26T21:59:32.686774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678019+0000","last_change":"2024-04-26T21:59:32.678019+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678019+0000","last_undegraded":"2024-04-26T21:59:32.678019+0000","last_fullsized":"2024-04-26T21:59:32.678019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691555+0000","last_change":"2024-04-26T21:59:32.685973+0000","last_active":"2024-04-26T21:59:32.691555+0000","last_peered":"2024-04-26T21:59:32.691555+0000","last_clean":"2024-04-26T21:59:32.691555+0000","last_became_active":"2024-04-26T21:59:32.685635+0000","last_became_peered":"2024-04-26T21:59:32.685635+0000","last_unstale":"2024-04-26T21:59:32.691555+0000","last_undegraded":"2024-04-26T21:59:32.691555+0000","last_fullsized":"2024-04-26T21:59:32.691555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674907+0000","last_change":"2024-04-26T21:59:32.674907+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674907+0000","last_undegraded":"2024-04-26T21:59:32.674907+0000","last_fullsized":"2024-04-26T21:59:32.674907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691208+0000","last_change":"2024-04-26T21:59:32.688381+0000","last_active":"2024-04-26T21:59:32.691208+0000","last_peered":"2024-04-26T21:59:32.691208+0000","last_clean":"2024-04-26T21:59:32.691208+0000","last_became_active":"2024-04-26T21:59:32.688098+0000","last_became_peered":"2024-04-26T21:59:32.688098+0000","last_unstale":"2024-04-26T21:59:32.691208+0000","last_undegraded":"2024-04-26T21:59:32.691208+0000","last_fullsized":"2024-04-26T21:59:32.691208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675807+0000","last_change":"2024-04-26T21:59:32.675807+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675807+0000","last_undegraded":"2024-04-26T21:59:32.675807+0000","last_fullsized":"2024-04-26T21:59:32.675807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.692314+0000","last_change":"2024-04-26T21:59:32.686480+0000","last_active":"2024-04-26T21:59:32.692314+0000","last_peered":"2024-04-26T21:59:32.692314+0000","last_clean":"2024-04-26T21:59:32.692314+0000","last_became_active":"2024-04-26T21:59:32.685352+0000","last_became_peered":"2024-04-26T21:59:32.685352+0000","last_unstale":"2024-04-26T21:59:32.692314+0000","last_undegraded":"2024-04-26T21:59:32.692314+0000","last_fullsized":"2024-04-26T21:59:32.692314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679415+0000","last_change":"2024-04-26T21:59:32.679415+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679415+0000","last_undegraded":"2024-04-26T21:59:32.679415+0000","last_fullsized":"2024-04-26T21:59:32.679415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689828+0000","last_change":"2024-04-26T21:59:32.684632+0000","last_active":"2024-04-26T21:59:32.689828+0000","last_peered":"2024-04-26T21:59:32.689828+0000","last_clean":"2024-04-26T21:59:32.689828+0000","last_became_active":"2024-04-26T21:59:32.684385+0000","last_became_peered":"2024-04-26T21:59:32.684385+0000","last_unstale":"2024-04-26T21:59:32.689828+0000","last_undegraded":"2024-04-26T21:59:32.689828+0000","last_fullsized":"2024-04-26T21:59:32.689828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678116+0000","last_change":"2024-04-26T21:59:32.678116+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678116+0000","last_undegraded":"2024-04-26T21:59:32.678116+0000","last_fullsized":"2024-04-26T21:59:32.678116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691597+0000","last_change":"2024-04-26T21:59:32.686076+0000","last_active":"2024-04-26T21:59:32.691597+0000","last_peered":"2024-04-26T21:59:32.691597+0000","last_clean":"2024-04-26T21:59:32.691597+0000","last_became_active":"2024-04-26T21:59:32.685776+0000","last_became_peered":"2024-04-26T21:59:32.685776+0000","last_unstale":"2024-04-26T21:59:32.691597+0000","last_undegraded":"2024-04-26T21:59:32.691597+0000","last_fullsized":"2024-04-26T21:59:32.691597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676519+0000","last_change":"2024-04-26T21:59:32.676519+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676519+0000","last_undegraded":"2024-04-26T21:59:32.676519+0000","last_fullsized":"2024-04-26T21:59:32.676519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.685795+0000","last_change":"2024-04-26T21:59:32.684485+0000","last_active":"2024-04-26T21:59:32.685795+0000","last_peered":"2024-04-26T21:59:32.685795+0000","last_clean":"2024-04-26T21:59:32.685795+0000","last_became_active":"2024-04-26T21:59:32.682716+0000","last_became_peered":"2024-04-26T21:59:32.682716+0000","last_unstale":"2024-04-26T21:59:32.685795+0000","last_undegraded":"2024-04-26T21:59:32.685795+0000","last_fullsized":"2024-04-26T21:59:32.685795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:26.174489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676671+0000","last_change":"2024-04-26T21:59:32.676671+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676671+0000","last_undegraded":"2024-04-26T21:59:32.676671+0000","last_fullsized":"2024-04-26T21:59:32.676671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691184+0000","last_change":"2024-04-26T21:59:32.684576+0000","last_active":"2024-04-26T21:59:32.691184+0000","last_peered":"2024-04-26T21:59:32.691184+0000","last_clean":"2024-04-26T21:59:32.691184+0000","last_became_active":"2024-04-26T21:59:32.684294+0000","last_became_peered":"2024-04-26T21:59:32.684294+0000","last_unstale":"2024-04-26T21:59:32.691184+0000","last_undegraded":"2024-04-26T21:59:32.691184+0000","last_fullsized":"2024-04-26T21:59:32.691184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:34.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674042+0000","last_change":"2024-04-26T21:59:32.674042+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674042+0000","last_undegraded":"2024-04-26T21:59:32.674042+0000","last_fullsized":"2024-04-26T21:59:32.674042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691044+0000","last_change":"2024-04-26T21:59:32.690047+0000","last_active":"2024-04-26T21:59:32.691044+0000","last_peered":"2024-04-26T21:59:32.691044+0000","last_clean":"2024-04-26T21:59:32.691044+0000","last_became_active":"2024-04-26T21:59:32.689747+0000","last_became_peered":"2024-04-26T21:59:32.689747+0000","last_unstale":"2024-04-26T21:59:32.691044+0000","last_undegraded":"2024-04-26T21:59:32.691044+0000","last_fullsized":"2024-04-26T21:59:32.691044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.673772+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:59:32.673772+0000","last_peered":"2024-04-26T21:59:32.673772+0000","last_clean":"2024-04-26T21:59:32.673772+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:59:32.673772+0000","last_undegraded":"2024-04-26T21:59:32.673772+0000","last_fullsized":"2024-04-26T21:59:32.673772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:59:36.648 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:59:36.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.780+0000 7fcaa7637640 1 Processor -- start 2024-04-26T21:59:36.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.781+0000 7fcaa7637640 1 -- start start 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.781+0000 7fcaa7637640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00d3ee0 0x7fcaa00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.781+0000 7fcaa7637640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa00d03a0 con 0x7fcaa015f750 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.781+0000 7fcaa7637640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa00d0680 con 0x7fcaa015f370 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.781+0000 7fcaa7637640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa00d0960 con 0x7fcaa00d3ee0 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.781+0000 7fcaa5bd4640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcaa015f750 0x7fcaa00b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42170/0 (socket says 172.21.15.137:42170) 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.781+0000 7fcaa5bd4640 1 -- 172.21.15.137:0/3855017260 learned_addr learned my addr 172.21.15.137:0/3855017260 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa4bd2640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00d3ee0 0x7fcaa00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814889516 0 0) 0x7fcaa00d03a0 con 0x7fcaa015f750 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca8c003520 con 0x7fcaa015f750 2024-04-26T21:59:36.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1448068625 0 0) 0x7fca8c003520 con 0x7fcaa015f750 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00d3ee0 msgr2=0x7fcaa00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00d3ee0 0x7fcaa00cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 >> v1:172.21.15.170:6789/0 conn(0x7fcaa015f370 legacy=0x7fcaa00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa00d0c40 con 0x7fcaa015f750 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fca98001670 con 0x7fcaa015f750 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 >> v1:172.21.15.137:6789/0 conn(0x7fcaa015f750 legacy=0x7fcaa00b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fca8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00d3ee0 0x7fca8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca8c004d40 0x7fca8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa00d0960 con 0x7fca8c0039e0 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c00ba70 con 0x7fca8c004d40 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fca8c00bc70 con 0x7fcaa00d3ee0 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa53d3640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fca8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa4bd2640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00d3ee0 0x7fca8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa5bd4640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca8c004d40 0x7fca8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa53d3640 1 -- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00d3ee0 msgr2=0x7fca8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa53d3640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00d3ee0 0x7fca8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa53d3640 1 -- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca8c004d40 msgr2=0x7fca8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa53d3640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca8c004d40 0x7fca8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa53d3640 1 -- 172.21.15.137:0/3855017260 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c003520 con 0x7fca8c0039e0 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.782+0000 7fcaa4bd2640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00d3ee0 0x7fca8c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.783+0000 7fcaa53d3640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fca8c003e00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca9c001e20 tx=0x7fca8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7de471d24bb50a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.783+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c001a70 con 0x7fca8c0039e0 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.783+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c02ae40 con 0x7fca8c0039e0 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.783+0000 7fca97fff640 1 -- 172.21.15.137:0/3855017260 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c003bb0 con 0x7fca8c0039e0 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.784+0000 7fcaa7637640 1 -- 172.21.15.137:0/3855017260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 msgr2=0x7fca8c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.784+0000 7fcaa7637640 1 --2- 172.21.15.137:0/3855017260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fca8c003e00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca9c001e20 tx=0x7fca8c005830 comp rx=0 tx=0).stop 2024-04-26T21:59:36.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.784+0000 7fcaa5bd4640 1 -- 172.21.15.137:0/3855017260 reap_dead start 2024-04-26T21:59:36.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.784+0000 7fcaa7637640 1 -- 172.21.15.137:0/3855017260 shutdown_connections 2024-04-26T21:59:36.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.784+0000 7fcaa7637640 1 -- 172.21.15.137:0/3855017260 >> 172.21.15.137:0/3855017260 conn(0x7fcaa008ec10 msgr2=0x7fcaa009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:36.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.784+0000 7fcaa7637640 1 -- 172.21.15.137:0/3855017260 shutdown_connections 2024-04-26T21:59:36.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.784+0000 7fcaa7637640 1 -- 172.21.15.137:0/3855017260 wait complete. 2024-04-26T21:59:36.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.785+0000 7fcaa7637640 1 Processor -- start 2024-04-26T21:59:36.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.785+0000 7fcaa7637640 1 -- start start 2024-04-26T21:59:36.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa7637640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fcaa015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa7637640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcaa00cd3f0 0x7fcaa0160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa7637640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00b7da0 0x7fcaa00b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa7637640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa00cfef0 con 0x7fca8c0039e0 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa7637640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa00cfd70 con 0x7fcaa00cd3f0 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa7637640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa00d0070 con 0x7fcaa00b7da0 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa53d3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fcaa015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa53d3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fcaa015b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50276/0 (socket says 172.21.15.137:50276) 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa53d3640 1 -- 172.21.15.137:0/1546250553 learned_addr learned my addr 172.21.15.137:0/1546250553 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa4bd2640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcaa00cd3f0 0x7fcaa0160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa5bd4640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00b7da0 0x7fcaa00b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa53d3640 1 -- 172.21.15.137:0/1546250553 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00b7da0 msgr2=0x7fcaa00b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa53d3640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00b7da0 0x7fcaa00b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa53d3640 1 -- 172.21.15.137:0/1546250553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcaa00cd3f0 msgr2=0x7fcaa0160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa53d3640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcaa00cd3f0 0x7fcaa0160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa53d3640 1 -- 172.21.15.137:0/1546250553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa00cd880 con 0x7fca8c0039e0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa53d3640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fcaa015b9a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fca9c001f40 tx=0x7fca9c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fca95ffb640 1 -- 172.21.15.137:0/1546250553 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c03f030 con 0x7fca8c0039e0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fca95ffb640 1 -- 172.21.15.137:0/1546250553 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c02ac40 con 0x7fca8c0039e0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa00cdb60 con 0x7fca8c0039e0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.786+0000 7fca95ffb640 1 -- 172.21.15.137:0/1546250553 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c007db0 con 0x7fca8c0039e0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.787+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa00ce120 con 0x7fca8c0039e0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.787+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa006a290 con 0x7fca8c0039e0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.788+0000 7fca95ffb640 1 -- 172.21.15.137:0/1546250553 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca9c042070 con 0x7fca8c0039e0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.788+0000 7fca95ffb640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8406c8f0 0x7fca8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.788+0000 7fca95ffb640 1 -- 172.21.15.137:0/1546250553 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fca9c0ab7e0 con 0x7fca8c0039e0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.788+0000 7fcaa4bd2640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8406c8f0 0x7fca8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:36.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.789+0000 7fcaa4bd2640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8406c8f0 0x7fca8406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00c8c90 tx=0x7fca90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:36.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.793+0000 7fca95ffb640 1 -- 172.21.15.137:0/1546250553 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fca9c079cf0 con 0x7fca8c0039e0 2024-04-26T21:59:36.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.962+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcaa006dc30 con 0x7fca8406c8f0 2024-04-26T21:59:36.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.968+0000 7fca95ffb640 1 -- 172.21.15.137:0/1546250553 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7fcaa006dc30 con 0x7fca8406c8f0 2024-04-26T21:59:36.971 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:36.972 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:59:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8406c8f0 msgr2=0x7fca8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8406c8f0 0x7fca8406edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00c8c90 tx=0x7fca90008040 comp rx=0 tx=0).stop 2024-04-26T21:59:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 msgr2=0x7fcaa015b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fcaa015b9a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fca9c001f40 tx=0x7fca9c0014a0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 shutdown_connections 2024-04-26T21:59:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8406c8f0 0x7fca8406edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcaa00b7da0 0x7fcaa00b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcaa00cd3f0 0x7fcaa0160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 --2- 172.21.15.137:0/1546250553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca8c0039e0 0x7fcaa015b9a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:36.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 >> 172.21.15.137:0/1546250553 conn(0x7fcaa008ec10 msgr2=0x7fcaa006e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:36.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 shutdown_connections 2024-04-26T21:59:36.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:36.971+0000 7fcaa7637640 1 -- 172.21.15.137:0/1546250553 wait complete. 2024-04-26T21:59:36.982 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-04-26T21:59:36.703584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236692,"kb_used_data":3892,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738028,"statfs":{"total":773094113280,"available":772851740672,"internally_reserved":0,"allocated":3985408,"data_stored":2242499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.037566"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678274+0000","last_change":"2024-04-26T21:59:32.678274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678274+0000","last_undegraded":"2024-04-26T21:59:32.678274+0000","last_fullsized":"2024-04-26T21:59:32.678274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.680281+0000","last_change":"2024-04-26T21:59:32.680281+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.680281+0000","last_undegraded":"2024-04-26T21:59:32.680281+0000","last_fullsized":"2024-04-26T21:59:32.680281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679007+0000","last_change":"2024-04-26T21:59:32.679007+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679007+0000","last_undegraded":"2024-04-26T21:59:32.679007+0000","last_fullsized":"2024-04-26T21:59:32.679007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678488+0000","last_change":"2024-04-26T21:59:32.678488+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678488+0000","last_undegraded":"2024-04-26T21:59:32.678488+0000","last_fullsized":"2024-04-26T21:59:32.678488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679092+0000","last_change":"2024-04-26T21:59:32.679092+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679092+0000","last_undegraded":"2024-04-26T21:59:32.679092+0000","last_fullsized":"2024-04-26T21:59:32.679092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.680273+0000","last_change":"2024-04-26T21:59:32.680273+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.680273+0000","last_undegraded":"2024-04-26T21:59:32.680273+0000","last_fullsized":"2024-04-26T21:59:32.680273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678556+0000","last_change":"2024-04-26T21:59:32.678556+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678556+0000","last_undegraded":"2024-04-26T21:59:32.678556+0000","last_fullsized":"2024-04-26T21:59:32.678556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678086+0000","last_change":"2024-04-26T21:59:32.678086+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678086+0000","last_undegraded":"2024-04-26T21:59:32.678086+0000","last_fullsized":"2024-04-26T21:59:32.678086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679274+0000","last_change":"2024-04-26T21:59:32.679274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679274+0000","last_undegraded":"2024-04-26T21:59:32.679274+0000","last_fullsized":"2024-04-26T21:59:32.679274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678642+0000","last_change":"2024-04-26T21:59:32.678642+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678642+0000","last_undegraded":"2024-04-26T21:59:32.678642+0000","last_fullsized":"2024-04-26T21:59:32.678642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678065+0000","last_change":"2024-04-26T21:59:32.678065+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678065+0000","last_undegraded":"2024-04-26T21:59:32.678065+0000","last_fullsized":"2024-04-26T21:59:32.678065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678990+0000","last_change":"2024-04-26T21:59:32.678990+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678990+0000","last_undegraded":"2024-04-26T21:59:32.678990+0000","last_fullsized":"2024-04-26T21:59:32.678990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678673+0000","last_change":"2024-04-26T21:59:32.678673+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678673+0000","last_undegraded":"2024-04-26T21:59:32.678673+0000","last_fullsized":"2024-04-26T21:59:32.678673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679787+0000","last_change":"2024-04-26T21:59:32.679787+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679787+0000","last_undegraded":"2024-04-26T21:59:32.679787+0000","last_fullsized":"2024-04-26T21:59:32.679787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678230+0000","last_change":"2024-04-26T21:59:32.678230+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678230+0000","last_undegraded":"2024-04-26T21:59:32.678230+0000","last_fullsized":"2024-04-26T21:59:32.678230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677063+0000","last_change":"2024-04-26T21:59:32.677063+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677063+0000","last_undegraded":"2024-04-26T21:59:32.677063+0000","last_fullsized":"2024-04-26T21:59:32.677063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676815+0000","last_change":"2024-04-26T21:59:32.676815+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676815+0000","last_undegraded":"2024-04-26T21:59:32.676815+0000","last_fullsized":"2024-04-26T21:59:32.676815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679769+0000","last_change":"2024-04-26T21:59:32.679769+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679769+0000","last_undegraded":"2024-04-26T21:59:32.679769+0000","last_fullsized":"2024-04-26T21:59:32.679769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679294+0000","last_change":"2024-04-26T21:59:32.679294+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679294+0000","last_undegraded":"2024-04-26T21:59:32.679294+0000","last_fullsized":"2024-04-26T21:59:32.679294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679422+0000","last_change":"2024-04-26T21:59:32.679422+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679422+0000","last_undegraded":"2024-04-26T21:59:32.679422+0000","last_fullsized":"2024-04-26T21:59:32.679422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678586+0000","last_change":"2024-04-26T21:59:32.678586+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678586+0000","last_undegraded":"2024-04-26T21:59:32.678586+0000","last_fullsized":"2024-04-26T21:59:32.678586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677858+0000","last_change":"2024-04-26T21:59:32.677858+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677858+0000","last_undegraded":"2024-04-26T21:59:32.677858+0000","last_fullsized":"2024-04-26T21:59:32.677858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675755+0000","last_change":"2024-04-26T21:59:32.675755+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675755+0000","last_undegraded":"2024-04-26T21:59:32.675755+0000","last_fullsized":"2024-04-26T21:59:32.675755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677757+0000","last_change":"2024-04-26T21:59:32.677757+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677757+0000","last_undegraded":"2024-04-26T21:59:32.677757+0000","last_fullsized":"2024-04-26T21:59:32.677757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677513+0000","last_change":"2024-04-26T21:59:32.677513+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677513+0000","last_undegraded":"2024-04-26T21:59:32.677513+0000","last_fullsized":"2024-04-26T21:59:32.677513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679315+0000","last_change":"2024-04-26T21:59:32.679315+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679315+0000","last_undegraded":"2024-04-26T21:59:32.679315+0000","last_fullsized":"2024-04-26T21:59:32.679315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676238+0000","last_change":"2024-04-26T21:59:32.676238+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676238+0000","last_undegraded":"2024-04-26T21:59:32.676238+0000","last_fullsized":"2024-04-26T21:59:32.676238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677274+0000","last_change":"2024-04-26T21:59:32.677274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677274+0000","last_undegraded":"2024-04-26T21:59:32.677274+0000","last_fullsized":"2024-04-26T21:59:32.677274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678217+0000","last_change":"2024-04-26T21:59:32.678217+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678217+0000","last_undegraded":"2024-04-26T21:59:32.678217+0000","last_fullsized":"2024-04-26T21:59:32.678217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676669+0000","last_change":"2024-04-26T21:59:32.676669+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676669+0000","last_undegraded":"2024-04-26T21:59:32.676669+0000","last_fullsized":"2024-04-26T21:59:32.676669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677376+0000","last_change":"2024-04-26T21:59:32.677376+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677376+0000","last_undegraded":"2024-04-26T21:59:32.677376+0000","last_fullsized":"2024-04-26T21:59:32.677376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676596+0000","last_change":"2024-04-26T21:59:32.676596+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676596+0000","last_undegraded":"2024-04-26T21:59:32.676596+0000","last_fullsized":"2024-04-26T21:59:32.676596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677150+0000","last_change":"2024-04-26T21:59:32.677150+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677150+0000","last_undegraded":"2024-04-26T21:59:32.677150+0000","last_fullsized":"2024-04-26T21:59:32.677150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.688401+0000","last_change":"2024-04-26T21:59:32.687035+0000","last_active":"2024-04-26T21:59:32.688401+0000","last_peered":"2024-04-26T21:59:32.688401+0000","last_clean":"2024-04-26T21:59:32.688401+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:32.688401+0000","last_undegraded":"2024-04-26T21:59:32.688401+0000","last_fullsized":"2024-04-26T21:59:32.688401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677872+0000","last_change":"2024-04-26T21:59:32.677872+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677872+0000","last_undegraded":"2024-04-26T21:59:32.677872+0000","last_fullsized":"2024-04-26T21:59:32.677872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689793+0000","last_change":"2024-04-26T21:59:32.683890+0000","last_active":"2024-04-26T21:59:32.689793+0000","last_peered":"2024-04-26T21:59:32.689793+0000","last_clean":"2024-04-26T21:59:32.689793+0000","last_became_active":"2024-04-26T21:59:32.683625+0000","last_became_peered":"2024-04-26T21:59:32.683625+0000","last_unstale":"2024-04-26T21:59:32.689793+0000","last_undegraded":"2024-04-26T21:59:32.689793+0000","last_fullsized":"2024-04-26T21:59:32.689793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:11.635296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678732+0000","last_change":"2024-04-26T21:59:32.678732+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678732+0000","last_undegraded":"2024-04-26T21:59:32.678732+0000","last_fullsized":"2024-04-26T21:59:32.678732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691339+0000","last_change":"2024-04-26T21:59:32.688412+0000","last_active":"2024-04-26T21:59:32.691339+0000","last_peered":"2024-04-26T21:59:32.691339+0000","last_clean":"2024-04-26T21:59:32.691339+0000","last_became_active":"2024-04-26T21:59:32.688125+0000","last_became_peered":"2024-04-26T21:59:32.688125+0000","last_unstale":"2024-04-26T21:59:32.691339+0000","last_undegraded":"2024-04-26T21:59:32.691339+0000","last_fullsized":"2024-04-26T21:59:32.691339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:02.376805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675751+0000","last_change":"2024-04-26T21:59:32.675751+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675751+0000","last_undegraded":"2024-04-26T21:59:32.675751+0000","last_fullsized":"2024-04-26T21:59:32.675751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689758+0000","last_change":"2024-04-26T21:59:32.689082+0000","last_active":"2024-04-26T21:59:32.689758+0000","last_peered":"2024-04-26T21:59:32.689758+0000","last_clean":"2024-04-26T21:59:32.689758+0000","last_became_active":"2024-04-26T21:59:32.688823+0000","last_became_peered":"2024-04-26T21:59:32.688823+0000","last_unstale":"2024-04-26T21:59:32.689758+0000","last_undegraded":"2024-04-26T21:59:32.689758+0000","last_fullsized":"2024-04-26T21:59:32.689758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:47.525567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675243+0000","last_change":"2024-04-26T21:59:32.675243+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675243+0000","last_undegraded":"2024-04-26T21:59:32.675243+0000","last_fullsized":"2024-04-26T21:59:32.675243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691539+0000","last_change":"2024-04-26T21:59:32.690777+0000","last_active":"2024-04-26T21:59:32.691539+0000","last_peered":"2024-04-26T21:59:32.691539+0000","last_clean":"2024-04-26T21:59:32.691539+0000","last_became_active":"2024-04-26T21:59:32.690516+0000","last_became_peered":"2024-04-26T21:59:32.690516+0000","last_unstale":"2024-04-26T21:59:32.691539+0000","last_undegraded":"2024-04-26T21:59:32.691539+0000","last_fullsized":"2024-04-26T21:59:32.691539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.585367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677315+0000","last_change":"2024-04-26T21:59:32.677315+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677315+0000","last_undegraded":"2024-04-26T21:59:32.677315+0000","last_fullsized":"2024-04-26T21:59:32.677315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691560+0000","last_change":"2024-04-26T21:59:32.690853+0000","last_active":"2024-04-26T21:59:32.691560+0000","last_peered":"2024-04-26T21:59:32.691560+0000","last_clean":"2024-04-26T21:59:32.691560+0000","last_became_active":"2024-04-26T21:59:32.690526+0000","last_became_peered":"2024-04-26T21:59:32.690526+0000","last_unstale":"2024-04-26T21:59:32.691560+0000","last_undegraded":"2024-04-26T21:59:32.691560+0000","last_fullsized":"2024-04-26T21:59:32.691560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:42.939756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674905+0000","last_change":"2024-04-26T21:59:32.674905+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674905+0000","last_undegraded":"2024-04-26T21:59:32.674905+0000","last_fullsized":"2024-04-26T21:59:32.674905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691283+0000","last_change":"2024-04-26T21:59:32.687125+0000","last_active":"2024-04-26T21:59:32.691283+0000","last_peered":"2024-04-26T21:59:32.691283+0000","last_clean":"2024-04-26T21:59:32.691283+0000","last_became_active":"2024-04-26T21:59:32.686826+0000","last_became_peered":"2024-04-26T21:59:32.686826+0000","last_unstale":"2024-04-26T21:59:32.691283+0000","last_undegraded":"2024-04-26T21:59:32.691283+0000","last_fullsized":"2024-04-26T21:59:32.691283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:45.135845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677093+0000","last_change":"2024-04-26T21:59:32.677093+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677093+0000","last_undegraded":"2024-04-26T21:59:32.677093+0000","last_fullsized":"2024-04-26T21:59:32.677093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689148+0000","last_change":"2024-04-26T21:59:32.686878+0000","last_active":"2024-04-26T21:59:32.689148+0000","last_peered":"2024-04-26T21:59:32.689148+0000","last_clean":"2024-04-26T21:59:32.689148+0000","last_became_active":"2024-04-26T21:59:32.686568+0000","last_became_peered":"2024-04-26T21:59:32.686568+0000","last_unstale":"2024-04-26T21:59:32.689148+0000","last_undegraded":"2024-04-26T21:59:32.689148+0000","last_fullsized":"2024-04-26T21:59:32.689148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:07.883511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676773+0000","last_change":"2024-04-26T21:59:32.676773+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676773+0000","last_undegraded":"2024-04-26T21:59:32.676773+0000","last_fullsized":"2024-04-26T21:59:32.676773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691271+0000","last_change":"2024-04-26T21:59:32.685122+0000","last_active":"2024-04-26T21:59:32.691271+0000","last_peered":"2024-04-26T21:59:32.691271+0000","last_clean":"2024-04-26T21:59:32.691271+0000","last_became_active":"2024-04-26T21:59:32.684797+0000","last_became_peered":"2024-04-26T21:59:32.684797+0000","last_unstale":"2024-04-26T21:59:32.691271+0000","last_undegraded":"2024-04-26T21:59:32.691271+0000","last_fullsized":"2024-04-26T21:59:32.691271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:42.691495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679248+0000","last_change":"2024-04-26T21:59:32.679248+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679248+0000","last_undegraded":"2024-04-26T21:59:32.679248+0000","last_fullsized":"2024-04-26T21:59:32.679248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689876+0000","last_change":"2024-04-26T21:59:32.685108+0000","last_active":"2024-04-26T21:59:32.689876+0000","last_peered":"2024-04-26T21:59:32.689876+0000","last_clean":"2024-04-26T21:59:32.689876+0000","last_became_active":"2024-04-26T21:59:32.684831+0000","last_became_peered":"2024-04-26T21:59:32.684831+0000","last_unstale":"2024-04-26T21:59:32.689876+0000","last_undegraded":"2024-04-26T21:59:32.689876+0000","last_fullsized":"2024-04-26T21:59:32.689876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678241+0000","last_change":"2024-04-26T21:59:32.678241+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678241+0000","last_undegraded":"2024-04-26T21:59:32.678241+0000","last_fullsized":"2024-04-26T21:59:32.678241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.687651+0000","last_change":"2024-04-26T21:59:32.684327+0000","last_active":"2024-04-26T21:59:32.687651+0000","last_peered":"2024-04-26T21:59:32.687651+0000","last_clean":"2024-04-26T21:59:32.687651+0000","last_became_active":"2024-04-26T21:59:32.684028+0000","last_became_peered":"2024-04-26T21:59:32.684028+0000","last_unstale":"2024-04-26T21:59:32.687651+0000","last_undegraded":"2024-04-26T21:59:32.687651+0000","last_fullsized":"2024-04-26T21:59:32.687651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:20.380688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676154+0000","last_change":"2024-04-26T21:59:32.676154+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676154+0000","last_undegraded":"2024-04-26T21:59:32.676154+0000","last_fullsized":"2024-04-26T21:59:32.676154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691339+0000","last_change":"2024-04-26T21:59:32.688426+0000","last_active":"2024-04-26T21:59:32.691339+0000","last_peered":"2024-04-26T21:59:32.691339+0000","last_clean":"2024-04-26T21:59:32.691339+0000","last_became_active":"2024-04-26T21:59:32.688159+0000","last_became_peered":"2024-04-26T21:59:32.688159+0000","last_unstale":"2024-04-26T21:59:32.691339+0000","last_undegraded":"2024-04-26T21:59:32.691339+0000","last_fullsized":"2024-04-26T21:59:32.691339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677918+0000","last_change":"2024-04-26T21:59:32.677918+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677918+0000","last_undegraded":"2024-04-26T21:59:32.677918+0000","last_fullsized":"2024-04-26T21:59:32.677918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689164+0000","last_change":"2024-04-26T21:59:32.687044+0000","last_active":"2024-04-26T21:59:32.689164+0000","last_peered":"2024-04-26T21:59:32.689164+0000","last_clean":"2024-04-26T21:59:32.689164+0000","last_became_active":"2024-04-26T21:59:32.686749+0000","last_became_peered":"2024-04-26T21:59:32.686749+0000","last_unstale":"2024-04-26T21:59:32.689164+0000","last_undegraded":"2024-04-26T21:59:32.689164+0000","last_fullsized":"2024-04-26T21:59:32.689164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:54.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677540+0000","last_change":"2024-04-26T21:59:32.677540+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677540+0000","last_undegraded":"2024-04-26T21:59:32.677540+0000","last_fullsized":"2024-04-26T21:59:32.677540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.686410+0000","last_change":"2024-04-26T21:59:32.684862+0000","last_active":"2024-04-26T21:59:32.686410+0000","last_peered":"2024-04-26T21:59:32.686410+0000","last_clean":"2024-04-26T21:59:32.686410+0000","last_became_active":"2024-04-26T21:59:32.684371+0000","last_became_peered":"2024-04-26T21:59:32.684371+0000","last_unstale":"2024-04-26T21:59:32.686410+0000","last_undegraded":"2024-04-26T21:59:32.686410+0000","last_fullsized":"2024-04-26T21:59:32.686410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675225+0000","last_change":"2024-04-26T21:59:32.675225+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675225+0000","last_undegraded":"2024-04-26T21:59:32.675225+0000","last_fullsized":"2024-04-26T21:59:32.675225+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691175+0000","last_change":"2024-04-26T21:59:32.684322+0000","last_active":"2024-04-26T21:59:32.691175+0000","last_peered":"2024-04-26T21:59:32.691175+0000","last_clean":"2024-04-26T21:59:32.691175+0000","last_became_active":"2024-04-26T21:59:32.684050+0000","last_became_peered":"2024-04-26T21:59:32.684050+0000","last_unstale":"2024-04-26T21:59:32.691175+0000","last_undegraded":"2024-04-26T21:59:32.691175+0000","last_fullsized":"2024-04-26T21:59:32.691175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676893+0000","last_change":"2024-04-26T21:59:32.676893+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676893+0000","last_undegraded":"2024-04-26T21:59:32.676893+0000","last_fullsized":"2024-04-26T21:59:32.676893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691158+0000","last_change":"2024-04-26T21:59:32.683976+0000","last_active":"2024-04-26T21:59:32.691158+0000","last_peered":"2024-04-26T21:59:32.691158+0000","last_clean":"2024-04-26T21:59:32.691158+0000","last_became_active":"2024-04-26T21:59:32.683703+0000","last_became_peered":"2024-04-26T21:59:32.683703+0000","last_unstale":"2024-04-26T21:59:32.691158+0000","last_undegraded":"2024-04-26T21:59:32.691158+0000","last_fullsized":"2024-04-26T21:59:32.691158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679491+0000","last_change":"2024-04-26T21:59:32.679491+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679491+0000","last_undegraded":"2024-04-26T21:59:32.679491+0000","last_fullsized":"2024-04-26T21:59:32.679491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.692374+0000","last_change":"2024-04-26T21:59:32.687047+0000","last_active":"2024-04-26T21:59:32.692374+0000","last_peered":"2024-04-26T21:59:32.692374+0000","last_clean":"2024-04-26T21:59:32.692374+0000","last_became_active":"2024-04-26T21:59:32.686745+0000","last_became_peered":"2024-04-26T21:59:32.686745+0000","last_unstale":"2024-04-26T21:59:32.692374+0000","last_undegraded":"2024-04-26T21:59:32.692374+0000","last_fullsized":"2024-04-26T21:59:32.692374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675546+0000","last_change":"2024-04-26T21:59:32.675546+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675546+0000","last_undegraded":"2024-04-26T21:59:32.675546+0000","last_fullsized":"2024-04-26T21:59:32.675546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689541+0000","last_change":"2024-04-26T21:59:32.688686+0000","last_active":"2024-04-26T21:59:32.689541+0000","last_peered":"2024-04-26T21:59:32.689541+0000","last_clean":"2024-04-26T21:59:32.689541+0000","last_became_active":"2024-04-26T21:59:32.688324+0000","last_became_peered":"2024-04-26T21:59:32.688324+0000","last_unstale":"2024-04-26T21:59:32.689541+0000","last_undegraded":"2024-04-26T21:59:32.689541+0000","last_fullsized":"2024-04-26T21:59:32.689541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:23.800646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678050+0000","last_change":"2024-04-26T21:59:32.678050+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678050+0000","last_undegraded":"2024-04-26T21:59:32.678050+0000","last_fullsized":"2024-04-26T21:59:32.678050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689222+0000","last_change":"2024-04-26T21:59:32.687084+0000","last_active":"2024-04-26T21:59:32.689222+0000","last_peered":"2024-04-26T21:59:32.689222+0000","last_clean":"2024-04-26T21:59:32.689222+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:32.689222+0000","last_undegraded":"2024-04-26T21:59:32.689222+0000","last_fullsized":"2024-04-26T21:59:32.689222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:32:30.568876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679745+0000","last_change":"2024-04-26T21:59:32.679745+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679745+0000","last_undegraded":"2024-04-26T21:59:32.679745+0000","last_fullsized":"2024-04-26T21:59:32.679745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691565+0000","last_change":"2024-04-26T21:59:32.691030+0000","last_active":"2024-04-26T21:59:32.691565+0000","last_peered":"2024-04-26T21:59:32.691565+0000","last_clean":"2024-04-26T21:59:32.691565+0000","last_became_active":"2024-04-26T21:59:32.690506+0000","last_became_peered":"2024-04-26T21:59:32.690506+0000","last_unstale":"2024-04-26T21:59:32.691565+0000","last_undegraded":"2024-04-26T21:59:32.691565+0000","last_fullsized":"2024-04-26T21:59:32.691565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:36.604666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677132+0000","last_change":"2024-04-26T21:59:32.677132+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677132+0000","last_undegraded":"2024-04-26T21:59:32.677132+0000","last_fullsized":"2024-04-26T21:59:32.677132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691189+0000","last_change":"2024-04-26T21:59:32.688347+0000","last_active":"2024-04-26T21:59:32.691189+0000","last_peered":"2024-04-26T21:59:32.691189+0000","last_clean":"2024-04-26T21:59:32.691189+0000","last_became_active":"2024-04-26T21:59:32.688072+0000","last_became_peered":"2024-04-26T21:59:32.688072+0000","last_unstale":"2024-04-26T21:59:32.691189+0000","last_undegraded":"2024-04-26T21:59:32.691189+0000","last_fullsized":"2024-04-26T21:59:32.691189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678256+0000","last_change":"2024-04-26T21:59:32.678256+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678256+0000","last_undegraded":"2024-04-26T21:59:32.678256+0000","last_fullsized":"2024-04-26T21:59:32.678256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.687532+0000","last_change":"2024-04-26T21:59:32.686618+0000","last_active":"2024-04-26T21:59:32.687532+0000","last_peered":"2024-04-26T21:59:32.687532+0000","last_clean":"2024-04-26T21:59:32.687532+0000","last_became_active":"2024-04-26T21:59:32.686281+0000","last_became_peered":"2024-04-26T21:59:32.686281+0000","last_unstale":"2024-04-26T21:59:32.687532+0000","last_undegraded":"2024-04-26T21:59:32.687532+0000","last_fullsized":"2024-04-26T21:59:32.687532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:11.635296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676641+0000","last_change":"2024-04-26T21:59:32.676641+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676641+0000","last_undegraded":"2024-04-26T21:59:32.676641+0000","last_fullsized":"2024-04-26T21:59:32.676641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.690052+0000","last_change":"2024-04-26T21:59:32.689448+0000","last_active":"2024-04-26T21:59:32.690052+0000","last_peered":"2024-04-26T21:59:32.690052+0000","last_clean":"2024-04-26T21:59:32.690052+0000","last_became_active":"2024-04-26T21:59:32.689075+0000","last_became_peered":"2024-04-26T21:59:32.689075+0000","last_unstale":"2024-04-26T21:59:32.690052+0000","last_undegraded":"2024-04-26T21:59:32.690052+0000","last_fullsized":"2024-04-26T21:59:32.690052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:47.525567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674682+0000","last_change":"2024-04-26T21:59:32.674682+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674682+0000","last_undegraded":"2024-04-26T21:59:32.674682+0000","last_fullsized":"2024-04-26T21:59:32.674682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.686774+0000","last_change":"2024-04-26T21:59:32.683700+0000","last_active":"2024-04-26T21:59:32.686774+0000","last_peered":"2024-04-26T21:59:32.686774+0000","last_clean":"2024-04-26T21:59:32.686774+0000","last_became_active":"2024-04-26T21:59:32.683407+0000","last_became_peered":"2024-04-26T21:59:32.683407+0000","last_unstale":"2024-04-26T21:59:32.686774+0000","last_undegraded":"2024-04-26T21:59:32.686774+0000","last_fullsized":"2024-04-26T21:59:32.686774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678019+0000","last_change":"2024-04-26T21:59:32.678019+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678019+0000","last_undegraded":"2024-04-26T21:59:32.678019+0000","last_fullsized":"2024-04-26T21:59:32.678019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691555+0000","last_change":"2024-04-26T21:59:32.685973+0000","last_active":"2024-04-26T21:59:32.691555+0000","last_peered":"2024-04-26T21:59:32.691555+0000","last_clean":"2024-04-26T21:59:32.691555+0000","last_became_active":"2024-04-26T21:59:32.685635+0000","last_became_peered":"2024-04-26T21:59:32.685635+0000","last_unstale":"2024-04-26T21:59:32.691555+0000","last_undegraded":"2024-04-26T21:59:32.691555+0000","last_fullsized":"2024-04-26T21:59:32.691555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674907+0000","last_change":"2024-04-26T21:59:32.674907+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674907+0000","last_undegraded":"2024-04-26T21:59:32.674907+0000","last_fullsized":"2024-04-26T21:59:32.674907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691208+0000","last_change":"2024-04-26T21:59:32.688381+0000","last_active":"2024-04-26T21:59:32.691208+0000","last_peered":"2024-04-26T21:59:32.691208+0000","last_clean":"2024-04-26T21:59:32.691208+0000","last_became_active":"2024-04-26T21:59:32.688098+0000","last_became_peered":"2024-04-26T21:59:32.688098+0000","last_unstale":"2024-04-26T21:59:32.691208+0000","last_undegraded":"2024-04-26T21:59:32.691208+0000","last_fullsized":"2024-04-26T21:59:32.691208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675807+0000","last_change":"2024-04-26T21:59:32.675807+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675807+0000","last_undegraded":"2024-04-26T21:59:32.675807+0000","last_fullsized":"2024-04-26T21:59:32.675807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.692314+0000","last_change":"2024-04-26T21:59:32.686480+0000","last_active":"2024-04-26T21:59:32.692314+0000","last_peered":"2024-04-26T21:59:32.692314+0000","last_clean":"2024-04-26T21:59:32.692314+0000","last_became_active":"2024-04-26T21:59:32.685352+0000","last_became_peered":"2024-04-26T21:59:32.685352+0000","last_unstale":"2024-04-26T21:59:32.692314+0000","last_undegraded":"2024-04-26T21:59:32.692314+0000","last_fullsized":"2024-04-26T21:59:32.692314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679415+0000","last_change":"2024-04-26T21:59:32.679415+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679415+0000","last_undegraded":"2024-04-26T21:59:32.679415+0000","last_fullsized":"2024-04-26T21:59:32.679415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689828+0000","last_change":"2024-04-26T21:59:32.684632+0000","last_active":"2024-04-26T21:59:32.689828+0000","last_peered":"2024-04-26T21:59:32.689828+0000","last_clean":"2024-04-26T21:59:32.689828+0000","last_became_active":"2024-04-26T21:59:32.684385+0000","last_became_peered":"2024-04-26T21:59:32.684385+0000","last_unstale":"2024-04-26T21:59:32.689828+0000","last_undegraded":"2024-04-26T21:59:32.689828+0000","last_fullsized":"2024-04-26T21:59:32.689828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678116+0000","last_change":"2024-04-26T21:59:32.678116+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678116+0000","last_undegraded":"2024-04-26T21:59:32.678116+0000","last_fullsized":"2024-04-26T21:59:32.678116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691597+0000","last_change":"2024-04-26T21:59:32.686076+0000","last_active":"2024-04-26T21:59:32.691597+0000","last_peered":"2024-04-26T21:59:32.691597+0000","last_clean":"2024-04-26T21:59:32.691597+0000","last_became_active":"2024-04-26T21:59:32.685776+0000","last_became_peered":"2024-04-26T21:59:32.685776+0000","last_unstale":"2024-04-26T21:59:32.691597+0000","last_undegraded":"2024-04-26T21:59:32.691597+0000","last_fullsized":"2024-04-26T21:59:32.691597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676519+0000","last_change":"2024-04-26T21:59:32.676519+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676519+0000","last_undegraded":"2024-04-26T21:59:32.676519+0000","last_fullsized":"2024-04-26T21:59:32.676519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.685795+0000","last_change":"2024-04-26T21:59:32.684485+0000","last_active":"2024-04-26T21:59:32.685795+0000","last_peered":"2024-04-26T21:59:32.685795+0000","last_clean":"2024-04-26T21:59:32.685795+0000","last_became_active":"2024-04-26T21:59:32.682716+0000","last_became_peered":"2024-04-26T21:59:32.682716+0000","last_unstale":"2024-04-26T21:59:32.685795+0000","last_undegraded":"2024-04-26T21:59:32.685795+0000","last_fullsized":"2024-04-26T21:59:32.685795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:26.174489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676671+0000","last_change":"2024-04-26T21:59:32.676671+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676671+0000","last_undegraded":"2024-04-26T21:59:32.676671+0000","last_fullsized":"2024-04-26T21:59:32.676671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691184+0000","last_change":"2024-04-26T21:59:32.684576+0000","last_active":"2024-04-26T21:59:32.691184+0000","last_peered":"2024-04-26T21:59:32.691184+0000","last_clean":"2024-04-26T21:59:32.691184+0000","last_became_active":"2024-04-26T21:59:32.684294+0000","last_became_peered":"2024-04-26T21:59:32.684294+0000","last_unstale":"2024-04-26T21:59:32.691184+0000","last_undegraded":"2024-04-26T21:59:32.691184+0000","last_fullsized":"2024-04-26T21:59:32.691184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:34.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674042+0000","last_change":"2024-04-26T21:59:32.674042+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674042+0000","last_undegraded":"2024-04-26T21:59:32.674042+0000","last_fullsized":"2024-04-26T21:59:32.674042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691044+0000","last_change":"2024-04-26T21:59:32.690047+0000","last_active":"2024-04-26T21:59:32.691044+0000","last_peered":"2024-04-26T21:59:32.691044+0000","last_clean":"2024-04-26T21:59:32.691044+0000","last_became_active":"2024-04-26T21:59:32.689747+0000","last_became_peered":"2024-04-26T21:59:32.689747+0000","last_unstale":"2024-04-26T21:59:32.691044+0000","last_undegraded":"2024-04-26T21:59:32.691044+0000","last_fullsized":"2024-04-26T21:59:32.691044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.673772+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:59:32.673772+0000","last_peered":"2024-04-26T21:59:32.673772+0000","last_clean":"2024-04-26T21:59:32.673772+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:59:32.673772+0000","last_undegraded":"2024-04-26T21:59:32.673772+0000","last_fullsized":"2024-04-26T21:59:32.673772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:59:36.986 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:59:37.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.120+0000 7f1580b40640 1 Processor -- start 2024-04-26T21:59:37.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.120+0000 7f1580b40640 1 -- start start 2024-04-26T21:59:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.120+0000 7f1580b40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c148a30 0x7f157c073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.120+0000 7f1580b40640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f157c0b3af0 0x7f157c0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.120+0000 7f1580b40640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f157c0cfa80 con 0x7f157c160640 2024-04-26T21:59:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.120+0000 7f1580b40640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f157c0b44a0 con 0x7f157c0b3af0 2024-04-26T21:59:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.120+0000 7f1580b40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f157c0cfd60 con 0x7f157c148a30 2024-04-26T21:59:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.121+0000 7f157a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c148a30 0x7f157c073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.121+0000 7f157ad9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f157c0b3af0 0x7f157c0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.121+0000 7f1573fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f157c160640 0x7f157c1636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:40782/0 (socket says 172.21.15.137:40782) 2024-04-26T21:59:37.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.121+0000 7f1573fff640 1 -- 172.21.15.137:0/661109638 learned_addr learned my addr 172.21.15.137:0/661109638 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:37.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.121+0000 7f157ad9d640 1 -- 172.21.15.137:0/661109638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c148a30 msgr2=0x7f157c073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:37.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.121+0000 7f157ad9d640 1 --2- 172.21.15.137:0/661109638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c148a30 0x7f157c073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.121+0000 7f157ad9d640 1 -- 172.21.15.137:0/661109638 >> v1:172.21.15.170:6789/0 conn(0x7f157c160640 legacy=0x7f157c1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.121+0000 7f157ad9d640 1 -- 172.21.15.137:0/661109638 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c0d0040 con 0x7f157c0b3af0 2024-04-26T21:59:37.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.121+0000 7f157a59c640 1 --2- 172.21.15.137:0/661109638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c148a30 0x7f157c073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.122+0000 7f157ad9d640 1 --2- 172.21.15.137:0/661109638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0b3af0 0x7f157c0b3f60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1574009d90 tx=0x7f157402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24e903fe6866ca94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.122+0000 7f1579d9b640 1 -- 172.21.15.137:0/661109638 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574031600 con 0x7f157c0b3af0 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.122+0000 7f1579d9b640 1 -- 172.21.15.137:0/661109638 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15740317a0 con 0x7f157c0b3af0 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.122+0000 7f1579d9b640 1 -- 172.21.15.137:0/661109638 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574031b70 con 0x7f157c0b3af0 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.122+0000 7f1580b40640 1 -- 172.21.15.137:0/661109638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0b3af0 msgr2=0x7f157c0b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.122+0000 7f1580b40640 1 --2- 172.21.15.137:0/661109638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0b3af0 0x7f157c0b3f60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1574009d90 tx=0x7f157402a5d0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.122+0000 7f1580b40640 1 -- 172.21.15.137:0/661109638 shutdown_connections 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.122+0000 7f1580b40640 1 --2- 172.21.15.137:0/661109638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0b3af0 0x7f157c0b3f60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.122+0000 7f1580b40640 1 --2- 172.21.15.137:0/661109638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c148a30 0x7f157c073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.123+0000 7f1580b40640 1 -- 172.21.15.137:0/661109638 >> 172.21.15.137:0/661109638 conn(0x7f157c0ce8b0 msgr2=0x7f157c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.123+0000 7f1580b40640 1 -- 172.21.15.137:0/661109638 shutdown_connections 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.123+0000 7f1580b40640 1 -- 172.21.15.137:0/661109638 wait complete. 2024-04-26T21:59:37.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.124+0000 7f1580b40640 1 Processor -- start 2024-04-26T21:59:37.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.124+0000 7f1580b40640 1 -- start start 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.124+0000 7f1580b40640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0b3af0 0x7f157c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.124+0000 7f1580b40640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c148a30 0x7f157c136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1580b40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c160640 0x7f157c1f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1580b40640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f157c163db0 con 0x7f157c148a30 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1580b40640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f157c163180 con 0x7f157c0b3af0 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1580b40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f157c074410 con 0x7f157c160640 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1573fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c148a30 0x7f157c136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1573fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c148a30 0x7f157c136ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50292/0 (socket says 172.21.15.137:50292) 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1573fff640 1 -- 172.21.15.137:0/3159331902 learned_addr learned my addr 172.21.15.137:0/3159331902 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f157ad9d640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c160640 0x7f157c1f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f157a59c640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0b3af0 0x7f157c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1573fff640 1 -- 172.21.15.137:0/3159331902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c160640 msgr2=0x7f157c1f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1573fff640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c160640 0x7f157c1f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1573fff640 1 -- 172.21.15.137:0/3159331902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0b3af0 msgr2=0x7f157c0b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1573fff640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0b3af0 0x7f157c0b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1573fff640 1 -- 172.21.15.137:0/3159331902 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c0aecd0 con 0x7f157c148a30 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1573fff640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c148a30 0x7f157c136ab0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f156400c440 tx=0x7f1564001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1572ffd640 1 -- 172.21.15.137:0/3159331902 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564017070 con 0x7f157c148a30 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157c0aefb0 con 0x7f157c148a30 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1572ffd640 1 -- 172.21.15.137:0/3159331902 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1564005ce0 con 0x7f157c148a30 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1572ffd640 1 -- 172.21.15.137:0/3159331902 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640072f0 con 0x7f157c148a30 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.125+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157c0af570 con 0x7f157c148a30 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.126+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f157c0b49f0 con 0x7f157c148a30 2024-04-26T21:59:37.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.127+0000 7f1572ffd640 1 -- 172.21.15.137:0/3159331902 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f156401a070 con 0x7f157c148a30 2024-04-26T21:59:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.127+0000 7f1572ffd640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.127+0000 7f1572ffd640 1 -- 172.21.15.137:0/3159331902 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f156408ae80 con 0x7f157c148a30 2024-04-26T21:59:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.127+0000 7f157a59c640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.128+0000 7f157a59c640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f156c009560 tx=0x7f156c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:37.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.131+0000 7f1572ffd640 1 -- 172.21.15.137:0/3159331902 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f157c0b49f0 con 0x7f157c148a30 2024-04-26T21:59:37.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.301+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f157c1f9050 con 0x7f155c06c8f0 2024-04-26T21:59:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.307+0000 7f1572ffd640 1 -- 172.21.15.137:0/3159331902 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7f156c011a60 con 0x7f155c06c8f0 2024-04-26T21:59:37.309 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 msgr2=0x7f155c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f156c009560 tx=0x7f156c009190 comp rx=0 tx=0).stop 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c148a30 msgr2=0x7f157c136ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c148a30 0x7f157c136ab0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f156400c440 tx=0x7f1564001e70 comp rx=0 tx=0).stop 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 shutdown_connections 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157c148a30 0x7f157c136ab0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157c160640 0x7f157c1f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 --2- 172.21.15.137:0/3159331902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0b3af0 0x7f157c0b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.309+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 >> 172.21.15.137:0/3159331902 conn(0x7f157c0ce8b0 msgr2=0x7f157c06f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:37.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.310+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 shutdown_connections 2024-04-26T21:59:37.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.310+0000 7f1580b40640 1 -- 172.21.15.137:0/3159331902 wait complete. 2024-04-26T21:59:37.320 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-04-26T21:59:36.703584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236692,"kb_used_data":3892,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738028,"statfs":{"total":773094113280,"available":772851740672,"internally_reserved":0,"allocated":3985408,"data_stored":2242499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.037566"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678274+0000","last_change":"2024-04-26T21:59:32.678274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678274+0000","last_undegraded":"2024-04-26T21:59:32.678274+0000","last_fullsized":"2024-04-26T21:59:32.678274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.680281+0000","last_change":"2024-04-26T21:59:32.680281+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.680281+0000","last_undegraded":"2024-04-26T21:59:32.680281+0000","last_fullsized":"2024-04-26T21:59:32.680281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679007+0000","last_change":"2024-04-26T21:59:32.679007+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679007+0000","last_undegraded":"2024-04-26T21:59:32.679007+0000","last_fullsized":"2024-04-26T21:59:32.679007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678488+0000","last_change":"2024-04-26T21:59:32.678488+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678488+0000","last_undegraded":"2024-04-26T21:59:32.678488+0000","last_fullsized":"2024-04-26T21:59:32.678488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679092+0000","last_change":"2024-04-26T21:59:32.679092+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679092+0000","last_undegraded":"2024-04-26T21:59:32.679092+0000","last_fullsized":"2024-04-26T21:59:32.679092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.680273+0000","last_change":"2024-04-26T21:59:32.680273+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.680273+0000","last_undegraded":"2024-04-26T21:59:32.680273+0000","last_fullsized":"2024-04-26T21:59:32.680273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678556+0000","last_change":"2024-04-26T21:59:32.678556+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678556+0000","last_undegraded":"2024-04-26T21:59:32.678556+0000","last_fullsized":"2024-04-26T21:59:32.678556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678086+0000","last_change":"2024-04-26T21:59:32.678086+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678086+0000","last_undegraded":"2024-04-26T21:59:32.678086+0000","last_fullsized":"2024-04-26T21:59:32.678086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679274+0000","last_change":"2024-04-26T21:59:32.679274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679274+0000","last_undegraded":"2024-04-26T21:59:32.679274+0000","last_fullsized":"2024-04-26T21:59:32.679274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678642+0000","last_change":"2024-04-26T21:59:32.678642+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678642+0000","last_undegraded":"2024-04-26T21:59:32.678642+0000","last_fullsized":"2024-04-26T21:59:32.678642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678065+0000","last_change":"2024-04-26T21:59:32.678065+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678065+0000","last_undegraded":"2024-04-26T21:59:32.678065+0000","last_fullsized":"2024-04-26T21:59:32.678065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678990+0000","last_change":"2024-04-26T21:59:32.678990+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678990+0000","last_undegraded":"2024-04-26T21:59:32.678990+0000","last_fullsized":"2024-04-26T21:59:32.678990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678673+0000","last_change":"2024-04-26T21:59:32.678673+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678673+0000","last_undegraded":"2024-04-26T21:59:32.678673+0000","last_fullsized":"2024-04-26T21:59:32.678673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679787+0000","last_change":"2024-04-26T21:59:32.679787+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679787+0000","last_undegraded":"2024-04-26T21:59:32.679787+0000","last_fullsized":"2024-04-26T21:59:32.679787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678230+0000","last_change":"2024-04-26T21:59:32.678230+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678230+0000","last_undegraded":"2024-04-26T21:59:32.678230+0000","last_fullsized":"2024-04-26T21:59:32.678230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677063+0000","last_change":"2024-04-26T21:59:32.677063+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677063+0000","last_undegraded":"2024-04-26T21:59:32.677063+0000","last_fullsized":"2024-04-26T21:59:32.677063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676815+0000","last_change":"2024-04-26T21:59:32.676815+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676815+0000","last_undegraded":"2024-04-26T21:59:32.676815+0000","last_fullsized":"2024-04-26T21:59:32.676815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679769+0000","last_change":"2024-04-26T21:59:32.679769+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679769+0000","last_undegraded":"2024-04-26T21:59:32.679769+0000","last_fullsized":"2024-04-26T21:59:32.679769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679294+0000","last_change":"2024-04-26T21:59:32.679294+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679294+0000","last_undegraded":"2024-04-26T21:59:32.679294+0000","last_fullsized":"2024-04-26T21:59:32.679294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679422+0000","last_change":"2024-04-26T21:59:32.679422+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679422+0000","last_undegraded":"2024-04-26T21:59:32.679422+0000","last_fullsized":"2024-04-26T21:59:32.679422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678586+0000","last_change":"2024-04-26T21:59:32.678586+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678586+0000","last_undegraded":"2024-04-26T21:59:32.678586+0000","last_fullsized":"2024-04-26T21:59:32.678586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677858+0000","last_change":"2024-04-26T21:59:32.677858+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677858+0000","last_undegraded":"2024-04-26T21:59:32.677858+0000","last_fullsized":"2024-04-26T21:59:32.677858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675755+0000","last_change":"2024-04-26T21:59:32.675755+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675755+0000","last_undegraded":"2024-04-26T21:59:32.675755+0000","last_fullsized":"2024-04-26T21:59:32.675755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677757+0000","last_change":"2024-04-26T21:59:32.677757+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677757+0000","last_undegraded":"2024-04-26T21:59:32.677757+0000","last_fullsized":"2024-04-26T21:59:32.677757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677513+0000","last_change":"2024-04-26T21:59:32.677513+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677513+0000","last_undegraded":"2024-04-26T21:59:32.677513+0000","last_fullsized":"2024-04-26T21:59:32.677513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679315+0000","last_change":"2024-04-26T21:59:32.679315+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679315+0000","last_undegraded":"2024-04-26T21:59:32.679315+0000","last_fullsized":"2024-04-26T21:59:32.679315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676238+0000","last_change":"2024-04-26T21:59:32.676238+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676238+0000","last_undegraded":"2024-04-26T21:59:32.676238+0000","last_fullsized":"2024-04-26T21:59:32.676238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677274+0000","last_change":"2024-04-26T21:59:32.677274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677274+0000","last_undegraded":"2024-04-26T21:59:32.677274+0000","last_fullsized":"2024-04-26T21:59:32.677274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678217+0000","last_change":"2024-04-26T21:59:32.678217+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678217+0000","last_undegraded":"2024-04-26T21:59:32.678217+0000","last_fullsized":"2024-04-26T21:59:32.678217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676669+0000","last_change":"2024-04-26T21:59:32.676669+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676669+0000","last_undegraded":"2024-04-26T21:59:32.676669+0000","last_fullsized":"2024-04-26T21:59:32.676669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677376+0000","last_change":"2024-04-26T21:59:32.677376+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677376+0000","last_undegraded":"2024-04-26T21:59:32.677376+0000","last_fullsized":"2024-04-26T21:59:32.677376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676596+0000","last_change":"2024-04-26T21:59:32.676596+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676596+0000","last_undegraded":"2024-04-26T21:59:32.676596+0000","last_fullsized":"2024-04-26T21:59:32.676596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677150+0000","last_change":"2024-04-26T21:59:32.677150+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677150+0000","last_undegraded":"2024-04-26T21:59:32.677150+0000","last_fullsized":"2024-04-26T21:59:32.677150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.688401+0000","last_change":"2024-04-26T21:59:32.687035+0000","last_active":"2024-04-26T21:59:32.688401+0000","last_peered":"2024-04-26T21:59:32.688401+0000","last_clean":"2024-04-26T21:59:32.688401+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:32.688401+0000","last_undegraded":"2024-04-26T21:59:32.688401+0000","last_fullsized":"2024-04-26T21:59:32.688401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677872+0000","last_change":"2024-04-26T21:59:32.677872+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677872+0000","last_undegraded":"2024-04-26T21:59:32.677872+0000","last_fullsized":"2024-04-26T21:59:32.677872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689793+0000","last_change":"2024-04-26T21:59:32.683890+0000","last_active":"2024-04-26T21:59:32.689793+0000","last_peered":"2024-04-26T21:59:32.689793+0000","last_clean":"2024-04-26T21:59:32.689793+0000","last_became_active":"2024-04-26T21:59:32.683625+0000","last_became_peered":"2024-04-26T21:59:32.683625+0000","last_unstale":"2024-04-26T21:59:32.689793+0000","last_undegraded":"2024-04-26T21:59:32.689793+0000","last_fullsized":"2024-04-26T21:59:32.689793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:11.635296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678732+0000","last_change":"2024-04-26T21:59:32.678732+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678732+0000","last_undegraded":"2024-04-26T21:59:32.678732+0000","last_fullsized":"2024-04-26T21:59:32.678732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691339+0000","last_change":"2024-04-26T21:59:32.688412+0000","last_active":"2024-04-26T21:59:32.691339+0000","last_peered":"2024-04-26T21:59:32.691339+0000","last_clean":"2024-04-26T21:59:32.691339+0000","last_became_active":"2024-04-26T21:59:32.688125+0000","last_became_peered":"2024-04-26T21:59:32.688125+0000","last_unstale":"2024-04-26T21:59:32.691339+0000","last_undegraded":"2024-04-26T21:59:32.691339+0000","last_fullsized":"2024-04-26T21:59:32.691339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:02.376805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675751+0000","last_change":"2024-04-26T21:59:32.675751+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675751+0000","last_undegraded":"2024-04-26T21:59:32.675751+0000","last_fullsized":"2024-04-26T21:59:32.675751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689758+0000","last_change":"2024-04-26T21:59:32.689082+0000","last_active":"2024-04-26T21:59:32.689758+0000","last_peered":"2024-04-26T21:59:32.689758+0000","last_clean":"2024-04-26T21:59:32.689758+0000","last_became_active":"2024-04-26T21:59:32.688823+0000","last_became_peered":"2024-04-26T21:59:32.688823+0000","last_unstale":"2024-04-26T21:59:32.689758+0000","last_undegraded":"2024-04-26T21:59:32.689758+0000","last_fullsized":"2024-04-26T21:59:32.689758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:47.525567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675243+0000","last_change":"2024-04-26T21:59:32.675243+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675243+0000","last_undegraded":"2024-04-26T21:59:32.675243+0000","last_fullsized":"2024-04-26T21:59:32.675243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691539+0000","last_change":"2024-04-26T21:59:32.690777+0000","last_active":"2024-04-26T21:59:32.691539+0000","last_peered":"2024-04-26T21:59:32.691539+0000","last_clean":"2024-04-26T21:59:32.691539+0000","last_became_active":"2024-04-26T21:59:32.690516+0000","last_became_peered":"2024-04-26T21:59:32.690516+0000","last_unstale":"2024-04-26T21:59:32.691539+0000","last_undegraded":"2024-04-26T21:59:32.691539+0000","last_fullsized":"2024-04-26T21:59:32.691539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.585367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677315+0000","last_change":"2024-04-26T21:59:32.677315+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677315+0000","last_undegraded":"2024-04-26T21:59:32.677315+0000","last_fullsized":"2024-04-26T21:59:32.677315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691560+0000","last_change":"2024-04-26T21:59:32.690853+0000","last_active":"2024-04-26T21:59:32.691560+0000","last_peered":"2024-04-26T21:59:32.691560+0000","last_clean":"2024-04-26T21:59:32.691560+0000","last_became_active":"2024-04-26T21:59:32.690526+0000","last_became_peered":"2024-04-26T21:59:32.690526+0000","last_unstale":"2024-04-26T21:59:32.691560+0000","last_undegraded":"2024-04-26T21:59:32.691560+0000","last_fullsized":"2024-04-26T21:59:32.691560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:42.939756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674905+0000","last_change":"2024-04-26T21:59:32.674905+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674905+0000","last_undegraded":"2024-04-26T21:59:32.674905+0000","last_fullsized":"2024-04-26T21:59:32.674905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691283+0000","last_change":"2024-04-26T21:59:32.687125+0000","last_active":"2024-04-26T21:59:32.691283+0000","last_peered":"2024-04-26T21:59:32.691283+0000","last_clean":"2024-04-26T21:59:32.691283+0000","last_became_active":"2024-04-26T21:59:32.686826+0000","last_became_peered":"2024-04-26T21:59:32.686826+0000","last_unstale":"2024-04-26T21:59:32.691283+0000","last_undegraded":"2024-04-26T21:59:32.691283+0000","last_fullsized":"2024-04-26T21:59:32.691283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:45.135845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677093+0000","last_change":"2024-04-26T21:59:32.677093+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677093+0000","last_undegraded":"2024-04-26T21:59:32.677093+0000","last_fullsized":"2024-04-26T21:59:32.677093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689148+0000","last_change":"2024-04-26T21:59:32.686878+0000","last_active":"2024-04-26T21:59:32.689148+0000","last_peered":"2024-04-26T21:59:32.689148+0000","last_clean":"2024-04-26T21:59:32.689148+0000","last_became_active":"2024-04-26T21:59:32.686568+0000","last_became_peered":"2024-04-26T21:59:32.686568+0000","last_unstale":"2024-04-26T21:59:32.689148+0000","last_undegraded":"2024-04-26T21:59:32.689148+0000","last_fullsized":"2024-04-26T21:59:32.689148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:07.883511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676773+0000","last_change":"2024-04-26T21:59:32.676773+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676773+0000","last_undegraded":"2024-04-26T21:59:32.676773+0000","last_fullsized":"2024-04-26T21:59:32.676773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691271+0000","last_change":"2024-04-26T21:59:32.685122+0000","last_active":"2024-04-26T21:59:32.691271+0000","last_peered":"2024-04-26T21:59:32.691271+0000","last_clean":"2024-04-26T21:59:32.691271+0000","last_became_active":"2024-04-26T21:59:32.684797+0000","last_became_peered":"2024-04-26T21:59:32.684797+0000","last_unstale":"2024-04-26T21:59:32.691271+0000","last_undegraded":"2024-04-26T21:59:32.691271+0000","last_fullsized":"2024-04-26T21:59:32.691271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:42.691495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679248+0000","last_change":"2024-04-26T21:59:32.679248+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679248+0000","last_undegraded":"2024-04-26T21:59:32.679248+0000","last_fullsized":"2024-04-26T21:59:32.679248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689876+0000","last_change":"2024-04-26T21:59:32.685108+0000","last_active":"2024-04-26T21:59:32.689876+0000","last_peered":"2024-04-26T21:59:32.689876+0000","last_clean":"2024-04-26T21:59:32.689876+0000","last_became_active":"2024-04-26T21:59:32.684831+0000","last_became_peered":"2024-04-26T21:59:32.684831+0000","last_unstale":"2024-04-26T21:59:32.689876+0000","last_undegraded":"2024-04-26T21:59:32.689876+0000","last_fullsized":"2024-04-26T21:59:32.689876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678241+0000","last_change":"2024-04-26T21:59:32.678241+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678241+0000","last_undegraded":"2024-04-26T21:59:32.678241+0000","last_fullsized":"2024-04-26T21:59:32.678241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.687651+0000","last_change":"2024-04-26T21:59:32.684327+0000","last_active":"2024-04-26T21:59:32.687651+0000","last_peered":"2024-04-26T21:59:32.687651+0000","last_clean":"2024-04-26T21:59:32.687651+0000","last_became_active":"2024-04-26T21:59:32.684028+0000","last_became_peered":"2024-04-26T21:59:32.684028+0000","last_unstale":"2024-04-26T21:59:32.687651+0000","last_undegraded":"2024-04-26T21:59:32.687651+0000","last_fullsized":"2024-04-26T21:59:32.687651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:20.380688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676154+0000","last_change":"2024-04-26T21:59:32.676154+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676154+0000","last_undegraded":"2024-04-26T21:59:32.676154+0000","last_fullsized":"2024-04-26T21:59:32.676154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691339+0000","last_change":"2024-04-26T21:59:32.688426+0000","last_active":"2024-04-26T21:59:32.691339+0000","last_peered":"2024-04-26T21:59:32.691339+0000","last_clean":"2024-04-26T21:59:32.691339+0000","last_became_active":"2024-04-26T21:59:32.688159+0000","last_became_peered":"2024-04-26T21:59:32.688159+0000","last_unstale":"2024-04-26T21:59:32.691339+0000","last_undegraded":"2024-04-26T21:59:32.691339+0000","last_fullsized":"2024-04-26T21:59:32.691339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677918+0000","last_change":"2024-04-26T21:59:32.677918+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677918+0000","last_undegraded":"2024-04-26T21:59:32.677918+0000","last_fullsized":"2024-04-26T21:59:32.677918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689164+0000","last_change":"2024-04-26T21:59:32.687044+0000","last_active":"2024-04-26T21:59:32.689164+0000","last_peered":"2024-04-26T21:59:32.689164+0000","last_clean":"2024-04-26T21:59:32.689164+0000","last_became_active":"2024-04-26T21:59:32.686749+0000","last_became_peered":"2024-04-26T21:59:32.686749+0000","last_unstale":"2024-04-26T21:59:32.689164+0000","last_undegraded":"2024-04-26T21:59:32.689164+0000","last_fullsized":"2024-04-26T21:59:32.689164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:54.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677540+0000","last_change":"2024-04-26T21:59:32.677540+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677540+0000","last_undegraded":"2024-04-26T21:59:32.677540+0000","last_fullsized":"2024-04-26T21:59:32.677540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.686410+0000","last_change":"2024-04-26T21:59:32.684862+0000","last_active":"2024-04-26T21:59:32.686410+0000","last_peered":"2024-04-26T21:59:32.686410+0000","last_clean":"2024-04-26T21:59:32.686410+0000","last_became_active":"2024-04-26T21:59:32.684371+0000","last_became_peered":"2024-04-26T21:59:32.684371+0000","last_unstale":"2024-04-26T21:59:32.686410+0000","last_undegraded":"2024-04-26T21:59:32.686410+0000","last_fullsized":"2024-04-26T21:59:32.686410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675225+0000","last_change":"2024-04-26T21:59:32.675225+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675225+0000","last_undegraded":"2024-04-26T21:59:32.675225+0000","last_fullsized":"2024-04-26T21:59:32.675225+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691175+0000","last_change":"2024-04-26T21:59:32.684322+0000","last_active":"2024-04-26T21:59:32.691175+0000","last_peered":"2024-04-26T21:59:32.691175+0000","last_clean":"2024-04-26T21:59:32.691175+0000","last_became_active":"2024-04-26T21:59:32.684050+0000","last_became_peered":"2024-04-26T21:59:32.684050+0000","last_unstale":"2024-04-26T21:59:32.691175+0000","last_undegraded":"2024-04-26T21:59:32.691175+0000","last_fullsized":"2024-04-26T21:59:32.691175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676893+0000","last_change":"2024-04-26T21:59:32.676893+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676893+0000","last_undegraded":"2024-04-26T21:59:32.676893+0000","last_fullsized":"2024-04-26T21:59:32.676893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691158+0000","last_change":"2024-04-26T21:59:32.683976+0000","last_active":"2024-04-26T21:59:32.691158+0000","last_peered":"2024-04-26T21:59:32.691158+0000","last_clean":"2024-04-26T21:59:32.691158+0000","last_became_active":"2024-04-26T21:59:32.683703+0000","last_became_peered":"2024-04-26T21:59:32.683703+0000","last_unstale":"2024-04-26T21:59:32.691158+0000","last_undegraded":"2024-04-26T21:59:32.691158+0000","last_fullsized":"2024-04-26T21:59:32.691158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679491+0000","last_change":"2024-04-26T21:59:32.679491+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679491+0000","last_undegraded":"2024-04-26T21:59:32.679491+0000","last_fullsized":"2024-04-26T21:59:32.679491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.692374+0000","last_change":"2024-04-26T21:59:32.687047+0000","last_active":"2024-04-26T21:59:32.692374+0000","last_peered":"2024-04-26T21:59:32.692374+0000","last_clean":"2024-04-26T21:59:32.692374+0000","last_became_active":"2024-04-26T21:59:32.686745+0000","last_became_peered":"2024-04-26T21:59:32.686745+0000","last_unstale":"2024-04-26T21:59:32.692374+0000","last_undegraded":"2024-04-26T21:59:32.692374+0000","last_fullsized":"2024-04-26T21:59:32.692374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675546+0000","last_change":"2024-04-26T21:59:32.675546+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675546+0000","last_undegraded":"2024-04-26T21:59:32.675546+0000","last_fullsized":"2024-04-26T21:59:32.675546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689541+0000","last_change":"2024-04-26T21:59:32.688686+0000","last_active":"2024-04-26T21:59:32.689541+0000","last_peered":"2024-04-26T21:59:32.689541+0000","last_clean":"2024-04-26T21:59:32.689541+0000","last_became_active":"2024-04-26T21:59:32.688324+0000","last_became_peered":"2024-04-26T21:59:32.688324+0000","last_unstale":"2024-04-26T21:59:32.689541+0000","last_undegraded":"2024-04-26T21:59:32.689541+0000","last_fullsized":"2024-04-26T21:59:32.689541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:23.800646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678050+0000","last_change":"2024-04-26T21:59:32.678050+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678050+0000","last_undegraded":"2024-04-26T21:59:32.678050+0000","last_fullsized":"2024-04-26T21:59:32.678050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689222+0000","last_change":"2024-04-26T21:59:32.687084+0000","last_active":"2024-04-26T21:59:32.689222+0000","last_peered":"2024-04-26T21:59:32.689222+0000","last_clean":"2024-04-26T21:59:32.689222+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:32.689222+0000","last_undegraded":"2024-04-26T21:59:32.689222+0000","last_fullsized":"2024-04-26T21:59:32.689222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:32:30.568876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679745+0000","last_change":"2024-04-26T21:59:32.679745+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679745+0000","last_undegraded":"2024-04-26T21:59:32.679745+0000","last_fullsized":"2024-04-26T21:59:32.679745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691565+0000","last_change":"2024-04-26T21:59:32.691030+0000","last_active":"2024-04-26T21:59:32.691565+0000","last_peered":"2024-04-26T21:59:32.691565+0000","last_clean":"2024-04-26T21:59:32.691565+0000","last_became_active":"2024-04-26T21:59:32.690506+0000","last_became_peered":"2024-04-26T21:59:32.690506+0000","last_unstale":"2024-04-26T21:59:32.691565+0000","last_undegraded":"2024-04-26T21:59:32.691565+0000","last_fullsized":"2024-04-26T21:59:32.691565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:36.604666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677132+0000","last_change":"2024-04-26T21:59:32.677132+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677132+0000","last_undegraded":"2024-04-26T21:59:32.677132+0000","last_fullsized":"2024-04-26T21:59:32.677132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691189+0000","last_change":"2024-04-26T21:59:32.688347+0000","last_active":"2024-04-26T21:59:32.691189+0000","last_peered":"2024-04-26T21:59:32.691189+0000","last_clean":"2024-04-26T21:59:32.691189+0000","last_became_active":"2024-04-26T21:59:32.688072+0000","last_became_peered":"2024-04-26T21:59:32.688072+0000","last_unstale":"2024-04-26T21:59:32.691189+0000","last_undegraded":"2024-04-26T21:59:32.691189+0000","last_fullsized":"2024-04-26T21:59:32.691189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678256+0000","last_change":"2024-04-26T21:59:32.678256+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678256+0000","last_undegraded":"2024-04-26T21:59:32.678256+0000","last_fullsized":"2024-04-26T21:59:32.678256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.687532+0000","last_change":"2024-04-26T21:59:32.686618+0000","last_active":"2024-04-26T21:59:32.687532+0000","last_peered":"2024-04-26T21:59:32.687532+0000","last_clean":"2024-04-26T21:59:32.687532+0000","last_became_active":"2024-04-26T21:59:32.686281+0000","last_became_peered":"2024-04-26T21:59:32.686281+0000","last_unstale":"2024-04-26T21:59:32.687532+0000","last_undegraded":"2024-04-26T21:59:32.687532+0000","last_fullsized":"2024-04-26T21:59:32.687532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:11.635296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676641+0000","last_change":"2024-04-26T21:59:32.676641+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676641+0000","last_undegraded":"2024-04-26T21:59:32.676641+0000","last_fullsized":"2024-04-26T21:59:32.676641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.690052+0000","last_change":"2024-04-26T21:59:32.689448+0000","last_active":"2024-04-26T21:59:32.690052+0000","last_peered":"2024-04-26T21:59:32.690052+0000","last_clean":"2024-04-26T21:59:32.690052+0000","last_became_active":"2024-04-26T21:59:32.689075+0000","last_became_peered":"2024-04-26T21:59:32.689075+0000","last_unstale":"2024-04-26T21:59:32.690052+0000","last_undegraded":"2024-04-26T21:59:32.690052+0000","last_fullsized":"2024-04-26T21:59:32.690052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:47.525567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674682+0000","last_change":"2024-04-26T21:59:32.674682+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674682+0000","last_undegraded":"2024-04-26T21:59:32.674682+0000","last_fullsized":"2024-04-26T21:59:32.674682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.686774+0000","last_change":"2024-04-26T21:59:32.683700+0000","last_active":"2024-04-26T21:59:32.686774+0000","last_peered":"2024-04-26T21:59:32.686774+0000","last_clean":"2024-04-26T21:59:32.686774+0000","last_became_active":"2024-04-26T21:59:32.683407+0000","last_became_peered":"2024-04-26T21:59:32.683407+0000","last_unstale":"2024-04-26T21:59:32.686774+0000","last_undegraded":"2024-04-26T21:59:32.686774+0000","last_fullsized":"2024-04-26T21:59:32.686774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678019+0000","last_change":"2024-04-26T21:59:32.678019+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678019+0000","last_undegraded":"2024-04-26T21:59:32.678019+0000","last_fullsized":"2024-04-26T21:59:32.678019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691555+0000","last_change":"2024-04-26T21:59:32.685973+0000","last_active":"2024-04-26T21:59:32.691555+0000","last_peered":"2024-04-26T21:59:32.691555+0000","last_clean":"2024-04-26T21:59:32.691555+0000","last_became_active":"2024-04-26T21:59:32.685635+0000","last_became_peered":"2024-04-26T21:59:32.685635+0000","last_unstale":"2024-04-26T21:59:32.691555+0000","last_undegraded":"2024-04-26T21:59:32.691555+0000","last_fullsized":"2024-04-26T21:59:32.691555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674907+0000","last_change":"2024-04-26T21:59:32.674907+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674907+0000","last_undegraded":"2024-04-26T21:59:32.674907+0000","last_fullsized":"2024-04-26T21:59:32.674907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691208+0000","last_change":"2024-04-26T21:59:32.688381+0000","last_active":"2024-04-26T21:59:32.691208+0000","last_peered":"2024-04-26T21:59:32.691208+0000","last_clean":"2024-04-26T21:59:32.691208+0000","last_became_active":"2024-04-26T21:59:32.688098+0000","last_became_peered":"2024-04-26T21:59:32.688098+0000","last_unstale":"2024-04-26T21:59:32.691208+0000","last_undegraded":"2024-04-26T21:59:32.691208+0000","last_fullsized":"2024-04-26T21:59:32.691208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675807+0000","last_change":"2024-04-26T21:59:32.675807+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675807+0000","last_undegraded":"2024-04-26T21:59:32.675807+0000","last_fullsized":"2024-04-26T21:59:32.675807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.692314+0000","last_change":"2024-04-26T21:59:32.686480+0000","last_active":"2024-04-26T21:59:32.692314+0000","last_peered":"2024-04-26T21:59:32.692314+0000","last_clean":"2024-04-26T21:59:32.692314+0000","last_became_active":"2024-04-26T21:59:32.685352+0000","last_became_peered":"2024-04-26T21:59:32.685352+0000","last_unstale":"2024-04-26T21:59:32.692314+0000","last_undegraded":"2024-04-26T21:59:32.692314+0000","last_fullsized":"2024-04-26T21:59:32.692314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679415+0000","last_change":"2024-04-26T21:59:32.679415+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679415+0000","last_undegraded":"2024-04-26T21:59:32.679415+0000","last_fullsized":"2024-04-26T21:59:32.679415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689828+0000","last_change":"2024-04-26T21:59:32.684632+0000","last_active":"2024-04-26T21:59:32.689828+0000","last_peered":"2024-04-26T21:59:32.689828+0000","last_clean":"2024-04-26T21:59:32.689828+0000","last_became_active":"2024-04-26T21:59:32.684385+0000","last_became_peered":"2024-04-26T21:59:32.684385+0000","last_unstale":"2024-04-26T21:59:32.689828+0000","last_undegraded":"2024-04-26T21:59:32.689828+0000","last_fullsized":"2024-04-26T21:59:32.689828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678116+0000","last_change":"2024-04-26T21:59:32.678116+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678116+0000","last_undegraded":"2024-04-26T21:59:32.678116+0000","last_fullsized":"2024-04-26T21:59:32.678116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691597+0000","last_change":"2024-04-26T21:59:32.686076+0000","last_active":"2024-04-26T21:59:32.691597+0000","last_peered":"2024-04-26T21:59:32.691597+0000","last_clean":"2024-04-26T21:59:32.691597+0000","last_became_active":"2024-04-26T21:59:32.685776+0000","last_became_peered":"2024-04-26T21:59:32.685776+0000","last_unstale":"2024-04-26T21:59:32.691597+0000","last_undegraded":"2024-04-26T21:59:32.691597+0000","last_fullsized":"2024-04-26T21:59:32.691597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676519+0000","last_change":"2024-04-26T21:59:32.676519+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676519+0000","last_undegraded":"2024-04-26T21:59:32.676519+0000","last_fullsized":"2024-04-26T21:59:32.676519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.685795+0000","last_change":"2024-04-26T21:59:32.684485+0000","last_active":"2024-04-26T21:59:32.685795+0000","last_peered":"2024-04-26T21:59:32.685795+0000","last_clean":"2024-04-26T21:59:32.685795+0000","last_became_active":"2024-04-26T21:59:32.682716+0000","last_became_peered":"2024-04-26T21:59:32.682716+0000","last_unstale":"2024-04-26T21:59:32.685795+0000","last_undegraded":"2024-04-26T21:59:32.685795+0000","last_fullsized":"2024-04-26T21:59:32.685795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:26.174489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676671+0000","last_change":"2024-04-26T21:59:32.676671+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676671+0000","last_undegraded":"2024-04-26T21:59:32.676671+0000","last_fullsized":"2024-04-26T21:59:32.676671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691184+0000","last_change":"2024-04-26T21:59:32.684576+0000","last_active":"2024-04-26T21:59:32.691184+0000","last_peered":"2024-04-26T21:59:32.691184+0000","last_clean":"2024-04-26T21:59:32.691184+0000","last_became_active":"2024-04-26T21:59:32.684294+0000","last_became_peered":"2024-04-26T21:59:32.684294+0000","last_unstale":"2024-04-26T21:59:32.691184+0000","last_undegraded":"2024-04-26T21:59:32.691184+0000","last_fullsized":"2024-04-26T21:59:32.691184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:34.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674042+0000","last_change":"2024-04-26T21:59:32.674042+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674042+0000","last_undegraded":"2024-04-26T21:59:32.674042+0000","last_fullsized":"2024-04-26T21:59:32.674042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691044+0000","last_change":"2024-04-26T21:59:32.690047+0000","last_active":"2024-04-26T21:59:32.691044+0000","last_peered":"2024-04-26T21:59:32.691044+0000","last_clean":"2024-04-26T21:59:32.691044+0000","last_became_active":"2024-04-26T21:59:32.689747+0000","last_became_peered":"2024-04-26T21:59:32.689747+0000","last_unstale":"2024-04-26T21:59:32.691044+0000","last_undegraded":"2024-04-26T21:59:32.691044+0000","last_fullsized":"2024-04-26T21:59:32.691044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.673772+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:59:32.673772+0000","last_peered":"2024-04-26T21:59:32.673772+0000","last_clean":"2024-04-26T21:59:32.673772+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:59:32.673772+0000","last_undegraded":"2024-04-26T21:59:32.673772+0000","last_fullsized":"2024-04-26T21:59:32.673772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:59:37.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-26T21:59:37.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678274+0000', 'last_change': '2024-04-26T21:59:32.678274+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678274+0000', 'last_undegraded': '2024-04-26T21:59:32.678274+0000', 'last_fullsized': '2024-04-26T21:59:32.678274+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:59:37.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-26T21:59:37.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.680281+0000', 'last_change': '2024-04-26T21:59:32.680281+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.680281+0000', 'last_undegraded': '2024-04-26T21:59:32.680281+0000', 'last_fullsized': '2024-04-26T21:59:32.680281+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679007+0000', 'last_change': '2024-04-26T21:59:32.679007+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679007+0000', 'last_undegraded': '2024-04-26T21:59:32.679007+0000', 'last_fullsized': '2024-04-26T21:59:32.679007+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678488+0000', 'last_change': '2024-04-26T21:59:32.678488+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678488+0000', 'last_undegraded': '2024-04-26T21:59:32.678488+0000', 'last_fullsized': '2024-04-26T21:59:32.678488+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679092+0000', 'last_change': '2024-04-26T21:59:32.679092+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679092+0000', 'last_undegraded': '2024-04-26T21:59:32.679092+0000', 'last_fullsized': '2024-04-26T21:59:32.679092+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.680273+0000', 'last_change': '2024-04-26T21:59:32.680273+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.680273+0000', 'last_undegraded': '2024-04-26T21:59:32.680273+0000', 'last_fullsized': '2024-04-26T21:59:32.680273+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678556+0000', 'last_change': '2024-04-26T21:59:32.678556+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678556+0000', 'last_undegraded': '2024-04-26T21:59:32.678556+0000', 'last_fullsized': '2024-04-26T21:59:32.678556+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-26T21:59:37.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678086+0000', 'last_change': '2024-04-26T21:59:32.678086+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678086+0000', 'last_undegraded': '2024-04-26T21:59:32.678086+0000', 'last_fullsized': '2024-04-26T21:59:32.678086+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679274+0000', 'last_change': '2024-04-26T21:59:32.679274+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679274+0000', 'last_undegraded': '2024-04-26T21:59:32.679274+0000', 'last_fullsized': '2024-04-26T21:59:32.679274+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678642+0000', 'last_change': '2024-04-26T21:59:32.678642+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678642+0000', 'last_undegraded': '2024-04-26T21:59:32.678642+0000', 'last_fullsized': '2024-04-26T21:59:32.678642+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678065+0000', 'last_change': '2024-04-26T21:59:32.678065+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678065+0000', 'last_undegraded': '2024-04-26T21:59:32.678065+0000', 'last_fullsized': '2024-04-26T21:59:32.678065+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678990+0000', 'last_change': '2024-04-26T21:59:32.678990+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678990+0000', 'last_undegraded': '2024-04-26T21:59:32.678990+0000', 'last_fullsized': '2024-04-26T21:59:32.678990+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678673+0000', 'last_change': '2024-04-26T21:59:32.678673+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678673+0000', 'last_undegraded': '2024-04-26T21:59:32.678673+0000', 'last_fullsized': '2024-04-26T21:59:32.678673+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T21:59:37.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679787+0000', 'last_change': '2024-04-26T21:59:32.679787+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679787+0000', 'last_undegraded': '2024-04-26T21:59:32.679787+0000', 'last_fullsized': '2024-04-26T21:59:32.679787+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678230+0000', 'last_change': '2024-04-26T21:59:32.678230+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678230+0000', 'last_undegraded': '2024-04-26T21:59:32.678230+0000', 'last_fullsized': '2024-04-26T21:59:32.678230+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677063+0000', 'last_change': '2024-04-26T21:59:32.677063+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677063+0000', 'last_undegraded': '2024-04-26T21:59:32.677063+0000', 'last_fullsized': '2024-04-26T21:59:32.677063+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676815+0000', 'last_change': '2024-04-26T21:59:32.676815+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676815+0000', 'last_undegraded': '2024-04-26T21:59:32.676815+0000', 'last_fullsized': '2024-04-26T21:59:32.676815+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679769+0000', 'last_change': '2024-04-26T21:59:32.679769+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679769+0000', 'last_undegraded': '2024-04-26T21:59:32.679769+0000', 'last_fullsized': '2024-04-26T21:59:32.679769+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-26T21:59:37.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679294+0000', 'last_change': '2024-04-26T21:59:32.679294+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679294+0000', 'last_undegraded': '2024-04-26T21:59:32.679294+0000', 'last_fullsized': '2024-04-26T21:59:32.679294+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679422+0000', 'last_change': '2024-04-26T21:59:32.679422+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679422+0000', 'last_undegraded': '2024-04-26T21:59:32.679422+0000', 'last_fullsized': '2024-04-26T21:59:32.679422+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678586+0000', 'last_change': '2024-04-26T21:59:32.678586+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678586+0000', 'last_undegraded': '2024-04-26T21:59:32.678586+0000', 'last_fullsized': '2024-04-26T21:59:32.678586+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677858+0000', 'last_change': '2024-04-26T21:59:32.677858+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677858+0000', 'last_undegraded': '2024-04-26T21:59:32.677858+0000', 'last_fullsized': '2024-04-26T21:59:32.677858+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.675755+0000', 'last_change': '2024-04-26T21:59:32.675755+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.675755+0000', 'last_undegraded': '2024-04-26T21:59:32.675755+0000', 'last_fullsized': '2024-04-26T21:59:32.675755+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677757+0000', 'last_change': '2024-04-26T21:59:32.677757+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677757+0000', 'last_undegraded': '2024-04-26T21:59:32.677757+0000', 'last_fullsized': '2024-04-26T21:59:32.677757+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677513+0000', 'last_change': '2024-04-26T21:59:32.677513+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677513+0000', 'last_undegraded': '2024-04-26T21:59:32.677513+0000', 'last_fullsized': '2024-04-26T21:59:32.677513+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679315+0000', 'last_change': '2024-04-26T21:59:32.679315+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679315+0000', 'last_undegraded': '2024-04-26T21:59:32.679315+0000', 'last_fullsized': '2024-04-26T21:59:32.679315+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676238+0000', 'last_change': '2024-04-26T21:59:32.676238+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676238+0000', 'last_undegraded': '2024-04-26T21:59:32.676238+0000', 'last_fullsized': '2024-04-26T21:59:32.676238+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677274+0000', 'last_change': '2024-04-26T21:59:32.677274+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677274+0000', 'last_undegraded': '2024-04-26T21:59:32.677274+0000', 'last_fullsized': '2024-04-26T21:59:32.677274+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678217+0000', 'last_change': '2024-04-26T21:59:32.678217+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678217+0000', 'last_undegraded': '2024-04-26T21:59:32.678217+0000', 'last_fullsized': '2024-04-26T21:59:32.678217+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-26T21:59:37.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676669+0000', 'last_change': '2024-04-26T21:59:32.676669+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676669+0000', 'last_undegraded': '2024-04-26T21:59:32.676669+0000', 'last_fullsized': '2024-04-26T21:59:32.676669+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677376+0000', 'last_change': '2024-04-26T21:59:32.677376+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677376+0000', 'last_undegraded': '2024-04-26T21:59:32.677376+0000', 'last_fullsized': '2024-04-26T21:59:32.677376+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676596+0000', 'last_change': '2024-04-26T21:59:32.676596+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676596+0000', 'last_undegraded': '2024-04-26T21:59:32.676596+0000', 'last_fullsized': '2024-04-26T21:59:32.676596+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677150+0000', 'last_change': '2024-04-26T21:59:32.677150+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677150+0000', 'last_undegraded': '2024-04-26T21:59:32.677150+0000', 'last_fullsized': '2024-04-26T21:59:32.677150+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677872+0000', 'last_change': '2024-04-26T21:59:32.677872+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677872+0000', 'last_undegraded': '2024-04-26T21:59:32.677872+0000', 'last_fullsized': '2024-04-26T21:59:32.677872+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678732+0000', 'last_change': '2024-04-26T21:59:32.678732+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678732+0000', 'last_undegraded': '2024-04-26T21:59:32.678732+0000', 'last_fullsized': '2024-04-26T21:59:32.678732+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:59:37.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.675751+0000', 'last_change': '2024-04-26T21:59:32.675751+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.675751+0000', 'last_undegraded': '2024-04-26T21:59:32.675751+0000', 'last_fullsized': '2024-04-26T21:59:32.675751+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.675243+0000', 'last_change': '2024-04-26T21:59:32.675243+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.675243+0000', 'last_undegraded': '2024-04-26T21:59:32.675243+0000', 'last_fullsized': '2024-04-26T21:59:32.675243+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677315+0000', 'last_change': '2024-04-26T21:59:32.677315+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677315+0000', 'last_undegraded': '2024-04-26T21:59:32.677315+0000', 'last_fullsized': '2024-04-26T21:59:32.677315+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.674905+0000', 'last_change': '2024-04-26T21:59:32.674905+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.674905+0000', 'last_undegraded': '2024-04-26T21:59:32.674905+0000', 'last_fullsized': '2024-04-26T21:59:32.674905+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677093+0000', 'last_change': '2024-04-26T21:59:32.677093+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677093+0000', 'last_undegraded': '2024-04-26T21:59:32.677093+0000', 'last_fullsized': '2024-04-26T21:59:32.677093+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-26T21:59:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676773+0000', 'last_change': '2024-04-26T21:59:32.676773+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676773+0000', 'last_undegraded': '2024-04-26T21:59:32.676773+0000', 'last_fullsized': '2024-04-26T21:59:32.676773+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679248+0000', 'last_change': '2024-04-26T21:59:32.679248+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679248+0000', 'last_undegraded': '2024-04-26T21:59:32.679248+0000', 'last_fullsized': '2024-04-26T21:59:32.679248+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678241+0000', 'last_change': '2024-04-26T21:59:32.678241+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678241+0000', 'last_undegraded': '2024-04-26T21:59:32.678241+0000', 'last_fullsized': '2024-04-26T21:59:32.678241+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676154+0000', 'last_change': '2024-04-26T21:59:32.676154+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676154+0000', 'last_undegraded': '2024-04-26T21:59:32.676154+0000', 'last_fullsized': '2024-04-26T21:59:32.676154+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677918+0000', 'last_change': '2024-04-26T21:59:32.677918+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677918+0000', 'last_undegraded': '2024-04-26T21:59:32.677918+0000', 'last_fullsized': '2024-04-26T21:59:32.677918+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677540+0000', 'last_change': '2024-04-26T21:59:32.677540+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677540+0000', 'last_undegraded': '2024-04-26T21:59:32.677540+0000', 'last_fullsized': '2024-04-26T21:59:32.677540+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.675225+0000', 'last_change': '2024-04-26T21:59:32.675225+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.675225+0000', 'last_undegraded': '2024-04-26T21:59:32.675225+0000', 'last_fullsized': '2024-04-26T21:59:32.675225+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676893+0000', 'last_change': '2024-04-26T21:59:32.676893+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676893+0000', 'last_undegraded': '2024-04-26T21:59:32.676893+0000', 'last_fullsized': '2024-04-26T21:59:32.676893+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679491+0000', 'last_change': '2024-04-26T21:59:32.679491+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679491+0000', 'last_undegraded': '2024-04-26T21:59:32.679491+0000', 'last_fullsized': '2024-04-26T21:59:32.679491+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.675546+0000', 'last_change': '2024-04-26T21:59:32.675546+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.675546+0000', 'last_undegraded': '2024-04-26T21:59:32.675546+0000', 'last_fullsized': '2024-04-26T21:59:32.675546+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678050+0000', 'last_change': '2024-04-26T21:59:32.678050+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678050+0000', 'last_undegraded': '2024-04-26T21:59:32.678050+0000', 'last_fullsized': '2024-04-26T21:59:32.678050+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-26T21:59:37.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679745+0000', 'last_change': '2024-04-26T21:59:32.679745+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679745+0000', 'last_undegraded': '2024-04-26T21:59:32.679745+0000', 'last_fullsized': '2024-04-26T21:59:32.679745+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T21:59:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-26T21:59:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.677132+0000', 'last_change': '2024-04-26T21:59:32.677132+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.677132+0000', 'last_undegraded': '2024-04-26T21:59:32.677132+0000', 'last_fullsized': '2024-04-26T21:59:32.677132+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T21:59:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-26T21:59:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678256+0000', 'last_change': '2024-04-26T21:59:32.678256+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678256+0000', 'last_undegraded': '2024-04-26T21:59:32.678256+0000', 'last_fullsized': '2024-04-26T21:59:32.678256+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T21:59:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-26T21:59:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676641+0000', 'last_change': '2024-04-26T21:59:32.676641+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676641+0000', 'last_undegraded': '2024-04-26T21:59:32.676641+0000', 'last_fullsized': '2024-04-26T21:59:32.676641+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T21:59:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-26T21:59:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.674682+0000', 'last_change': '2024-04-26T21:59:32.674682+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.674682+0000', 'last_undegraded': '2024-04-26T21:59:32.674682+0000', 'last_fullsized': '2024-04-26T21:59:32.674682+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678019+0000', 'last_change': '2024-04-26T21:59:32.678019+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678019+0000', 'last_undegraded': '2024-04-26T21:59:32.678019+0000', 'last_fullsized': '2024-04-26T21:59:32.678019+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.674907+0000', 'last_change': '2024-04-26T21:59:32.674907+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.674907+0000', 'last_undegraded': '2024-04-26T21:59:32.674907+0000', 'last_fullsized': '2024-04-26T21:59:32.674907+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.675807+0000', 'last_change': '2024-04-26T21:59:32.675807+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.675807+0000', 'last_undegraded': '2024-04-26T21:59:32.675807+0000', 'last_fullsized': '2024-04-26T21:59:32.675807+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.679415+0000', 'last_change': '2024-04-26T21:59:32.679415+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.679415+0000', 'last_undegraded': '2024-04-26T21:59:32.679415+0000', 'last_fullsized': '2024-04-26T21:59:32.679415+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.678116+0000', 'last_change': '2024-04-26T21:59:32.678116+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.678116+0000', 'last_undegraded': '2024-04-26T21:59:32.678116+0000', 'last_fullsized': '2024-04-26T21:59:32.678116+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-26T21:59:37.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676519+0000', 'last_change': '2024-04-26T21:59:32.676519+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676519+0000', 'last_undegraded': '2024-04-26T21:59:32.676519+0000', 'last_fullsized': '2024-04-26T21:59:32.676519+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T21:59:37.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-26T21:59:37.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.676671+0000', 'last_change': '2024-04-26T21:59:32.676671+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.676671+0000', 'last_undegraded': '2024-04-26T21:59:32.676671+0000', 'last_fullsized': '2024-04-26T21:59:32.676671+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T21:59:37.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-26T21:59:37.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-04-26T21:59:32.674042+0000', 'last_change': '2024-04-26T21:59:32.674042+0000', 'last_active': '2024-04-26T21:59:32.665628+0000', 'last_peered': '2024-04-26T21:59:32.665628+0000', 'last_clean': '2024-04-26T21:59:32.665628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T21:59:32.674042+0000', 'last_undegraded': '2024-04-26T21:59:32.674042+0000', 'last_fullsized': '2024-04-26T21:59:32.674042+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'last_clean_scrub_stamp': '2024-04-26T21:59:32.665628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T21:59:37.336 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T21:59:37.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.457+0000 7fca9a10a640 1 Processor -- start 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.457+0000 7fca9a10a640 1 -- start start 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.458+0000 7fca9a10a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fca94145870 0x7fca9406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.458+0000 7fca9a10a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fca94073420 0x7fca9415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.458+0000 7fca9a10a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca94073a40 con 0x7fca9406f980 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.458+0000 7fca9a10a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fca9406fde0 con 0x7fca94145870 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.458+0000 7fca9a10a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fca9415d8d0 con 0x7fca94073420 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.458+0000 7fca937fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fca94145870 0x7fca9406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.458+0000 7fca937fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fca94145870 0x7fca9406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50308/0 (socket says 172.21.15.137:50308) 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.458+0000 7fca937fe640 1 -- 172.21.15.137:0/1283575169 learned_addr learned my addr 172.21.15.137:0/1283575169 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:37.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.458+0000 7fca93fff640 1 --2- 172.21.15.137:0/1283575169 >> v2:172.21.15.170:3300/0 conn(0x7fca94073420 0x7fca9415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.459+0000 7fca937fe640 1 -- 172.21.15.137:0/1283575169 >> v2:172.21.15.170:3300/0 conn(0x7fca94073420 msgr2=0x7fca9415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:37.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.459+0000 7fca937fe640 1 --2- 172.21.15.137:0/1283575169 >> v2:172.21.15.170:3300/0 conn(0x7fca94073420 0x7fca9415e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.459+0000 7fca937fe640 1 -- 172.21.15.137:0/1283575169 >> v1:172.21.15.170:6789/0 conn(0x7fca9406f980 legacy=0x7fca94072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.459+0000 7fca937fe640 1 -- 172.21.15.137:0/1283575169 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9415dbb0 con 0x7fca94145870 2024-04-26T21:59:37.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.459+0000 7fca937fe640 1 --2- 172.21.15.137:0/1283575169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 0x7fca9406f440 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fca940ce890 tx=0x7fca8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b4135b79f8d184 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:37.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.459+0000 7fca927fc640 1 -- 172.21.15.137:0/1283575169 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84037070 con 0x7fca94145870 2024-04-26T21:59:37.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.459+0000 7fca927fc640 1 -- 172.21.15.137:0/1283575169 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca84032440 con 0x7fca94145870 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.459+0000 7fca927fc640 1 -- 172.21.15.137:0/1283575169 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84032810 con 0x7fca94145870 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.460+0000 7fca9a10a640 1 -- 172.21.15.137:0/1283575169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 msgr2=0x7fca9406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.460+0000 7fca9a10a640 1 --2- 172.21.15.137:0/1283575169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 0x7fca9406f440 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fca940ce890 tx=0x7fca8402a270 comp rx=0 tx=0).stop 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.460+0000 7fca9a10a640 1 -- 172.21.15.137:0/1283575169 shutdown_connections 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.460+0000 7fca9a10a640 1 --2- 172.21.15.137:0/1283575169 >> v2:172.21.15.170:3300/0 conn(0x7fca94073420 0x7fca9415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.460+0000 7fca9a10a640 1 --2- 172.21.15.137:0/1283575169 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 0x7fca9406f440 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.460+0000 7fca9a10a640 1 -- 172.21.15.137:0/1283575169 >> 172.21.15.137:0/1283575169 conn(0x7fca940cd830 msgr2=0x7fca940cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.460+0000 7fca9a10a640 1 -- 172.21.15.137:0/1283575169 shutdown_connections 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.460+0000 7fca9a10a640 1 -- 172.21.15.137:0/1283575169 wait complete. 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.461+0000 7fca9a10a640 1 Processor -- start 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.461+0000 7fca9a10a640 1 -- start start 2024-04-26T21:59:37.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca9a10a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca9406f980 0x7fca9413ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca9a10a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca94073420 0x7fca940cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca9a10a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 0x7fca940d0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca9a10a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca94145c50 con 0x7fca94145870 2024-04-26T21:59:37.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca9a10a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fca9415d5d0 con 0x7fca9406f980 2024-04-26T21:59:37.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca9a10a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fca9415e8f0 con 0x7fca94073420 2024-04-26T21:59:37.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca93fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 0x7fca940d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca93fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 0x7fca940d0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50322/0 (socket says 172.21.15.137:50322) 2024-04-26T21:59:37.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca93fff640 1 -- 172.21.15.137:0/4009294554 learned_addr learned my addr 172.21.15.137:0/4009294554 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:37.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca92ffd640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca94073420 0x7fca940cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca937fe640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca9406f980 0x7fca9413ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca93fff640 1 -- 172.21.15.137:0/4009294554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca94073420 msgr2=0x7fca940cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca93fff640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca94073420 0x7fca940cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca93fff640 1 -- 172.21.15.137:0/4009294554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca9406f980 msgr2=0x7fca9413ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca93fff640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca9406f980 0x7fca9413ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca93fff640 1 -- 172.21.15.137:0/4009294554 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca941e5640 con 0x7fca94145870 2024-04-26T21:59:37.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.462+0000 7fca92ffd640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca94073420 0x7fca940cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:37.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.463+0000 7fca93fff640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 0x7fca940d0200 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00efc0 tx=0x7fca8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:37.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.463+0000 7fca7bfff640 1 -- 172.21.15.137:0/4009294554 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c018020 con 0x7fca94145870 2024-04-26T21:59:37.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.463+0000 7fca7bfff640 1 -- 172.21.15.137:0/4009294554 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c009b10 con 0x7fca94145870 2024-04-26T21:59:37.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.463+0000 7fca7bfff640 1 -- 172.21.15.137:0/4009294554 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0146c0 con 0x7fca94145870 2024-04-26T21:59:37.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.463+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca940b0af0 con 0x7fca94145870 2024-04-26T21:59:37.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.463+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca940b10b0 con 0x7fca94145870 2024-04-26T21:59:37.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.464+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca9406a290 con 0x7fca94145870 2024-04-26T21:59:37.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.464+0000 7fca7bfff640 1 -- 172.21.15.137:0/4009294554 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca8c005d10 con 0x7fca94145870 2024-04-26T21:59:37.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.464+0000 7fca7bfff640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8006c8f0 0x7fca8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.465+0000 7fca7bfff640 1 -- 172.21.15.137:0/4009294554 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fca8c08c910 con 0x7fca94145870 2024-04-26T21:59:37.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.465+0000 7fca937fe640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8006c8f0 0x7fca8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.465+0000 7fca937fe640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8006c8f0 0x7fca8006edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca84034000 tx=0x7fca8402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:37.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.469+0000 7fca7bfff640 1 -- 172.21.15.137:0/4009294554 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fca8c022030 con 0x7fca94145870 2024-04-26T21:59:37.649 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T21:59:37.649+0000 7fbdbe40b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T21:59:37.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.716+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fca9406d2b0 con 0x7fca94145870 2024-04-26T21:59:37.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.716+0000 7fca7bfff640 1 -- 172.21.15.137:0/4009294554 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1581 (secure 0 0 0) 0x7fca8c010040 con 0x7fca94145870 2024-04-26T21:59:37.716 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:37.717 INFO:teuthology.orchestra.run.smithi137.stdout:{"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":81,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1714168707,"num_in_osds":8,"osd_in_since":1714168698,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242372608,"bytes_avail":772851740672,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5139}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-26T21:59:28.702396+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.718+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8006c8f0 msgr2=0x7fca8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.718+0000 7fca9a10a640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8006c8f0 0x7fca8006edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca84034000 tx=0x7fca8402e000 comp rx=0 tx=0).stop 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.718+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 msgr2=0x7fca940d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.718+0000 7fca9a10a640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 0x7fca940d0200 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00efc0 tx=0x7fca8c00c490 comp rx=0 tx=0).stop 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.719+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 shutdown_connections 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.719+0000 7fca9a10a640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fca8006c8f0 0x7fca8006edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.719+0000 7fca9a10a640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca94145870 0x7fca940d0200 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.719+0000 7fca9a10a640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca94073420 0x7fca940cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.719+0000 7fca9a10a640 1 --2- 172.21.15.137:0/4009294554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca9406f980 0x7fca9413ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.719+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 >> 172.21.15.137:0/4009294554 conn(0x7fca940cd830 msgr2=0x7fca9415a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:37.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.719+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 shutdown_connections 2024-04-26T21:59:37.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.719+0000 7fca9a10a640 1 -- 172.21.15.137:0/4009294554 wait complete. 2024-04-26T21:59:37.729 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T21:59:37.730 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:59:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.826+0000 7f84378d1640 1 Processor -- start 2024-04-26T21:59:37.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.826+0000 7f84378d1640 1 -- start start 2024-04-26T21:59:37.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f84378d1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8430145980 0x7f8430160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f84378d1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84300b4260 con 0x7f84300b61a0 2024-04-26T21:59:37.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f84378d1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84300b4530 con 0x7f84300b3de0 2024-04-26T21:59:37.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f84378d1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f84300b5140 con 0x7f8430145980 2024-04-26T21:59:37.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8435e6e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f84300b61a0 0x7f84300720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42184/0 (socket says 172.21.15.137:42184) 2024-04-26T21:59:37.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8435e6e640 1 -- 172.21.15.137:0/2824501502 learned_addr learned my addr 172.21.15.137:0/2824501502 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282147076 0 0) 0x7f84300b4260 con 0x7f84300b61a0 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f841c003520 con 0x7f84300b61a0 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f843566d640 1 --2- 172.21.15.137:0/2824501502 >> v2:172.21.15.170:3300/0 conn(0x7f8430145980 0x7f8430160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1535901617 0 0) 0x7f841c003520 con 0x7f84300b61a0 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 >> v2:172.21.15.170:3300/0 conn(0x7f8430145980 msgr2=0x7f8430160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 --2- 172.21.15.137:0/2824501502 >> v2:172.21.15.170:3300/0 conn(0x7f8430145980 0x7f8430160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 >> v1:172.21.15.170:6789/0 conn(0x7f84300b3de0 legacy=0x7f84300b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84300b4810 con 0x7f84300b61a0 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f84280019f0 con 0x7f84300b61a0 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 >> v1:172.21.15.137:6789/0 conn(0x7f84300b61a0 legacy=0x7f84300720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c0039b0 0x7f841c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c004800 0x7f841c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f841c0051c0 0x7f841c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84300b5140 con 0x7f841c004800 2024-04-26T21:59:37.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f841c00c160 con 0x7f841c0039b0 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.827+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f841c00c360 con 0x7f841c0051c0 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f843566d640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c0039b0 0x7f841c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f8434e6c640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c004800 0x7f841c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f8435e6e640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f841c0051c0 0x7f841c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f8434e6c640 1 -- 172.21.15.137:0/2824501502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f841c0051c0 msgr2=0x7f841c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f8434e6c640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f841c0051c0 0x7f841c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f8434e6c640 1 -- 172.21.15.137:0/2824501502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c0039b0 msgr2=0x7f841c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f8434e6c640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c0039b0 0x7f841c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f8435e6e640 1 -- 172.21.15.137:0/2824501502 reap_dead start 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f8434e6c640 1 -- 172.21.15.137:0/2824501502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c003520 con 0x7f841c004800 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.828+0000 7f843566d640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c0039b0 0x7f841c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f8434e6c640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c004800 0x7f841c004c80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f842c001750 tx=0x7f841c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726484ee81163606 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c001370 con 0x7f841c004800 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c0052d0 con 0x7f841c004800 2024-04-26T21:59:37.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f8423fff640 1 -- 172.21.15.137:0/2824501502 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c02abc0 con 0x7f841c004800 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f84378d1640 1 -- 172.21.15.137:0/2824501502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c004800 msgr2=0x7f841c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f84378d1640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c004800 0x7f841c004c80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f842c001750 tx=0x7f841c005830 comp rx=0 tx=0).stop 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f84378d1640 1 -- 172.21.15.137:0/2824501502 shutdown_connections 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f84378d1640 1 --2- 172.21.15.137:0/2824501502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f841c004800 0x7f841c004c80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f84378d1640 1 -- 172.21.15.137:0/2824501502 >> 172.21.15.137:0/2824501502 conn(0x7f84300d0d30 msgr2=0x7f84300d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f84378d1640 1 -- 172.21.15.137:0/2824501502 shutdown_connections 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.829+0000 7f84378d1640 1 -- 172.21.15.137:0/2824501502 wait complete. 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.830+0000 7f84378d1640 1 Processor -- start 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.830+0000 7f84378d1640 1 -- start start 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f84378d1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c004800 0x7f8430150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f84378d1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f843015b740 0x7f843013fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f84378d1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84301f0ed0 0x7f84301f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f84378d1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8430160630 con 0x7f843015b740 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f84378d1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f84300b4dd0 con 0x7f841c004800 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f84378d1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f84301607b0 con 0x7f84301f0ed0 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f8434e6c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f843015b740 0x7f843013fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f8434e6c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f843015b740 0x7f843013fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50336/0 (socket says 172.21.15.137:50336) 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f8434e6c640 1 -- 172.21.15.137:0/2560335926 learned_addr learned my addr 172.21.15.137:0/2560335926 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f843566d640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c004800 0x7f8430150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.831+0000 7f8435e6e640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84301f0ed0 0x7f84301f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f8434e6c640 1 -- 172.21.15.137:0/2560335926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84301f0ed0 msgr2=0x7f84301f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f8434e6c640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84301f0ed0 0x7f84301f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f8434e6c640 1 -- 172.21.15.137:0/2560335926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c004800 msgr2=0x7f8430150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f8434e6c640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c004800 0x7f8430150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f8434e6c640 1 -- 172.21.15.137:0/2560335926 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843013b1b0 con 0x7f843015b740 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f8434e6c640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f843015b740 0x7f843013fae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f842c001870 tx=0x7f842c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f8421ffb640 1 -- 172.21.15.137:0/2560335926 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c03f030 con 0x7f843015b740 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f8421ffb640 1 -- 172.21.15.137:0/2560335926 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c005480 con 0x7f843015b740 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843013b490 con 0x7f843015b740 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f8421ffb640 1 -- 172.21.15.137:0/2560335926 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c037040 con 0x7f843015b740 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.832+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f843013ba50 con 0x7f843015b740 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.833+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843006a290 con 0x7f843015b740 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.833+0000 7f8421ffb640 1 -- 172.21.15.137:0/2560335926 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f842c042070 con 0x7f843015b740 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.834+0000 7f8421ffb640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f841406c8f0 0x7f841406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.834+0000 7f8421ffb640 1 -- 172.21.15.137:0/2560335926 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f842c0ab160 con 0x7f843015b740 2024-04-26T21:59:37.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.834+0000 7f843566d640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f841406c8f0 0x7f841406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.834+0000 7f843566d640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f841406c8f0 0x7f841406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f843006b1f0 tx=0x7f8424008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:37.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:37.838+0000 7f8421ffb640 1 -- 172.21.15.137:0/2560335926 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f842c079500 con 0x7f843015b740 2024-04-26T21:59:38.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.008+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8430073cc0 con 0x7f841406c8f0 2024-04-26T21:59:38.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.014+0000 7f8421ffb640 1 -- 172.21.15.137:0/2560335926 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246632 (secure 0 0 0) 0x7f8430073cc0 con 0x7f841406c8f0 2024-04-26T21:59:38.016 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:38.018 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:59:38.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f841406c8f0 msgr2=0x7f841406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:38.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f841406c8f0 0x7f841406edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f843006b1f0 tx=0x7f8424008040 comp rx=0 tx=0).stop 2024-04-26T21:59:38.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f843015b740 msgr2=0x7f843013fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:38.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f843015b740 0x7f843013fae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f842c001870 tx=0x7f842c001120 comp rx=0 tx=0).stop 2024-04-26T21:59:38.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 shutdown_connections 2024-04-26T21:59:38.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f841406c8f0 0x7f841406edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:38.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f843015b740 0x7f843013fae0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:38.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84301f0ed0 0x7f84301f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:38.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 --2- 172.21.15.137:0/2560335926 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f841c004800 0x7f8430150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:38.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 >> 172.21.15.137:0/2560335926 conn(0x7f84300d0d30 msgr2=0x7f84300b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:38.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 shutdown_connections 2024-04-26T21:59:38.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:38.017+0000 7f84378d1640 1 -- 172.21.15.137:0/2560335926 wait complete. 2024-04-26T21:59:38.028 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-04-26T21:59:36.703584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236692,"kb_used_data":3892,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738028,"statfs":{"total":773094113280,"available":772851740672,"internally_reserved":0,"allocated":3985408,"data_stored":2242499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.037566"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678274+0000","last_change":"2024-04-26T21:59:32.678274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678274+0000","last_undegraded":"2024-04-26T21:59:32.678274+0000","last_fullsized":"2024-04-26T21:59:32.678274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.680281+0000","last_change":"2024-04-26T21:59:32.680281+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.680281+0000","last_undegraded":"2024-04-26T21:59:32.680281+0000","last_fullsized":"2024-04-26T21:59:32.680281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679007+0000","last_change":"2024-04-26T21:59:32.679007+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679007+0000","last_undegraded":"2024-04-26T21:59:32.679007+0000","last_fullsized":"2024-04-26T21:59:32.679007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678488+0000","last_change":"2024-04-26T21:59:32.678488+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678488+0000","last_undegraded":"2024-04-26T21:59:32.678488+0000","last_fullsized":"2024-04-26T21:59:32.678488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679092+0000","last_change":"2024-04-26T21:59:32.679092+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679092+0000","last_undegraded":"2024-04-26T21:59:32.679092+0000","last_fullsized":"2024-04-26T21:59:32.679092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.680273+0000","last_change":"2024-04-26T21:59:32.680273+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.680273+0000","last_undegraded":"2024-04-26T21:59:32.680273+0000","last_fullsized":"2024-04-26T21:59:32.680273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678556+0000","last_change":"2024-04-26T21:59:32.678556+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678556+0000","last_undegraded":"2024-04-26T21:59:32.678556+0000","last_fullsized":"2024-04-26T21:59:32.678556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678086+0000","last_change":"2024-04-26T21:59:32.678086+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678086+0000","last_undegraded":"2024-04-26T21:59:32.678086+0000","last_fullsized":"2024-04-26T21:59:32.678086+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679274+0000","last_change":"2024-04-26T21:59:32.679274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679274+0000","last_undegraded":"2024-04-26T21:59:32.679274+0000","last_fullsized":"2024-04-26T21:59:32.679274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678642+0000","last_change":"2024-04-26T21:59:32.678642+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678642+0000","last_undegraded":"2024-04-26T21:59:32.678642+0000","last_fullsized":"2024-04-26T21:59:32.678642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678065+0000","last_change":"2024-04-26T21:59:32.678065+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678065+0000","last_undegraded":"2024-04-26T21:59:32.678065+0000","last_fullsized":"2024-04-26T21:59:32.678065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678990+0000","last_change":"2024-04-26T21:59:32.678990+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678990+0000","last_undegraded":"2024-04-26T21:59:32.678990+0000","last_fullsized":"2024-04-26T21:59:32.678990+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678673+0000","last_change":"2024-04-26T21:59:32.678673+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678673+0000","last_undegraded":"2024-04-26T21:59:32.678673+0000","last_fullsized":"2024-04-26T21:59:32.678673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679787+0000","last_change":"2024-04-26T21:59:32.679787+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679787+0000","last_undegraded":"2024-04-26T21:59:32.679787+0000","last_fullsized":"2024-04-26T21:59:32.679787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678230+0000","last_change":"2024-04-26T21:59:32.678230+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678230+0000","last_undegraded":"2024-04-26T21:59:32.678230+0000","last_fullsized":"2024-04-26T21:59:32.678230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677063+0000","last_change":"2024-04-26T21:59:32.677063+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677063+0000","last_undegraded":"2024-04-26T21:59:32.677063+0000","last_fullsized":"2024-04-26T21:59:32.677063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676815+0000","last_change":"2024-04-26T21:59:32.676815+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676815+0000","last_undegraded":"2024-04-26T21:59:32.676815+0000","last_fullsized":"2024-04-26T21:59:32.676815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679769+0000","last_change":"2024-04-26T21:59:32.679769+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679769+0000","last_undegraded":"2024-04-26T21:59:32.679769+0000","last_fullsized":"2024-04-26T21:59:32.679769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679294+0000","last_change":"2024-04-26T21:59:32.679294+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679294+0000","last_undegraded":"2024-04-26T21:59:32.679294+0000","last_fullsized":"2024-04-26T21:59:32.679294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679422+0000","last_change":"2024-04-26T21:59:32.679422+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679422+0000","last_undegraded":"2024-04-26T21:59:32.679422+0000","last_fullsized":"2024-04-26T21:59:32.679422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678586+0000","last_change":"2024-04-26T21:59:32.678586+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678586+0000","last_undegraded":"2024-04-26T21:59:32.678586+0000","last_fullsized":"2024-04-26T21:59:32.678586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677858+0000","last_change":"2024-04-26T21:59:32.677858+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677858+0000","last_undegraded":"2024-04-26T21:59:32.677858+0000","last_fullsized":"2024-04-26T21:59:32.677858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675755+0000","last_change":"2024-04-26T21:59:32.675755+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675755+0000","last_undegraded":"2024-04-26T21:59:32.675755+0000","last_fullsized":"2024-04-26T21:59:32.675755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677757+0000","last_change":"2024-04-26T21:59:32.677757+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677757+0000","last_undegraded":"2024-04-26T21:59:32.677757+0000","last_fullsized":"2024-04-26T21:59:32.677757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677513+0000","last_change":"2024-04-26T21:59:32.677513+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677513+0000","last_undegraded":"2024-04-26T21:59:32.677513+0000","last_fullsized":"2024-04-26T21:59:32.677513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679315+0000","last_change":"2024-04-26T21:59:32.679315+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679315+0000","last_undegraded":"2024-04-26T21:59:32.679315+0000","last_fullsized":"2024-04-26T21:59:32.679315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676238+0000","last_change":"2024-04-26T21:59:32.676238+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676238+0000","last_undegraded":"2024-04-26T21:59:32.676238+0000","last_fullsized":"2024-04-26T21:59:32.676238+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677274+0000","last_change":"2024-04-26T21:59:32.677274+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677274+0000","last_undegraded":"2024-04-26T21:59:32.677274+0000","last_fullsized":"2024-04-26T21:59:32.677274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678217+0000","last_change":"2024-04-26T21:59:32.678217+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678217+0000","last_undegraded":"2024-04-26T21:59:32.678217+0000","last_fullsized":"2024-04-26T21:59:32.678217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676669+0000","last_change":"2024-04-26T21:59:32.676669+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676669+0000","last_undegraded":"2024-04-26T21:59:32.676669+0000","last_fullsized":"2024-04-26T21:59:32.676669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677376+0000","last_change":"2024-04-26T21:59:32.677376+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677376+0000","last_undegraded":"2024-04-26T21:59:32.677376+0000","last_fullsized":"2024-04-26T21:59:32.677376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676596+0000","last_change":"2024-04-26T21:59:32.676596+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676596+0000","last_undegraded":"2024-04-26T21:59:32.676596+0000","last_fullsized":"2024-04-26T21:59:32.676596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677150+0000","last_change":"2024-04-26T21:59:32.677150+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677150+0000","last_undegraded":"2024-04-26T21:59:32.677150+0000","last_fullsized":"2024-04-26T21:59:32.677150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.688401+0000","last_change":"2024-04-26T21:59:32.687035+0000","last_active":"2024-04-26T21:59:32.688401+0000","last_peered":"2024-04-26T21:59:32.688401+0000","last_clean":"2024-04-26T21:59:32.688401+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:32.688401+0000","last_undegraded":"2024-04-26T21:59:32.688401+0000","last_fullsized":"2024-04-26T21:59:32.688401+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677872+0000","last_change":"2024-04-26T21:59:32.677872+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677872+0000","last_undegraded":"2024-04-26T21:59:32.677872+0000","last_fullsized":"2024-04-26T21:59:32.677872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689793+0000","last_change":"2024-04-26T21:59:32.683890+0000","last_active":"2024-04-26T21:59:32.689793+0000","last_peered":"2024-04-26T21:59:32.689793+0000","last_clean":"2024-04-26T21:59:32.689793+0000","last_became_active":"2024-04-26T21:59:32.683625+0000","last_became_peered":"2024-04-26T21:59:32.683625+0000","last_unstale":"2024-04-26T21:59:32.689793+0000","last_undegraded":"2024-04-26T21:59:32.689793+0000","last_fullsized":"2024-04-26T21:59:32.689793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:11.635296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678732+0000","last_change":"2024-04-26T21:59:32.678732+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678732+0000","last_undegraded":"2024-04-26T21:59:32.678732+0000","last_fullsized":"2024-04-26T21:59:32.678732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691339+0000","last_change":"2024-04-26T21:59:32.688412+0000","last_active":"2024-04-26T21:59:32.691339+0000","last_peered":"2024-04-26T21:59:32.691339+0000","last_clean":"2024-04-26T21:59:32.691339+0000","last_became_active":"2024-04-26T21:59:32.688125+0000","last_became_peered":"2024-04-26T21:59:32.688125+0000","last_unstale":"2024-04-26T21:59:32.691339+0000","last_undegraded":"2024-04-26T21:59:32.691339+0000","last_fullsized":"2024-04-26T21:59:32.691339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:02.376805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675751+0000","last_change":"2024-04-26T21:59:32.675751+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675751+0000","last_undegraded":"2024-04-26T21:59:32.675751+0000","last_fullsized":"2024-04-26T21:59:32.675751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689758+0000","last_change":"2024-04-26T21:59:32.689082+0000","last_active":"2024-04-26T21:59:32.689758+0000","last_peered":"2024-04-26T21:59:32.689758+0000","last_clean":"2024-04-26T21:59:32.689758+0000","last_became_active":"2024-04-26T21:59:32.688823+0000","last_became_peered":"2024-04-26T21:59:32.688823+0000","last_unstale":"2024-04-26T21:59:32.689758+0000","last_undegraded":"2024-04-26T21:59:32.689758+0000","last_fullsized":"2024-04-26T21:59:32.689758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:47.525567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675243+0000","last_change":"2024-04-26T21:59:32.675243+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675243+0000","last_undegraded":"2024-04-26T21:59:32.675243+0000","last_fullsized":"2024-04-26T21:59:32.675243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691539+0000","last_change":"2024-04-26T21:59:32.690777+0000","last_active":"2024-04-26T21:59:32.691539+0000","last_peered":"2024-04-26T21:59:32.691539+0000","last_clean":"2024-04-26T21:59:32.691539+0000","last_became_active":"2024-04-26T21:59:32.690516+0000","last_became_peered":"2024-04-26T21:59:32.690516+0000","last_unstale":"2024-04-26T21:59:32.691539+0000","last_undegraded":"2024-04-26T21:59:32.691539+0000","last_fullsized":"2024-04-26T21:59:32.691539+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.585367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677315+0000","last_change":"2024-04-26T21:59:32.677315+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677315+0000","last_undegraded":"2024-04-26T21:59:32.677315+0000","last_fullsized":"2024-04-26T21:59:32.677315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691560+0000","last_change":"2024-04-26T21:59:32.690853+0000","last_active":"2024-04-26T21:59:32.691560+0000","last_peered":"2024-04-26T21:59:32.691560+0000","last_clean":"2024-04-26T21:59:32.691560+0000","last_became_active":"2024-04-26T21:59:32.690526+0000","last_became_peered":"2024-04-26T21:59:32.690526+0000","last_unstale":"2024-04-26T21:59:32.691560+0000","last_undegraded":"2024-04-26T21:59:32.691560+0000","last_fullsized":"2024-04-26T21:59:32.691560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:42.939756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674905+0000","last_change":"2024-04-26T21:59:32.674905+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674905+0000","last_undegraded":"2024-04-26T21:59:32.674905+0000","last_fullsized":"2024-04-26T21:59:32.674905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691283+0000","last_change":"2024-04-26T21:59:32.687125+0000","last_active":"2024-04-26T21:59:32.691283+0000","last_peered":"2024-04-26T21:59:32.691283+0000","last_clean":"2024-04-26T21:59:32.691283+0000","last_became_active":"2024-04-26T21:59:32.686826+0000","last_became_peered":"2024-04-26T21:59:32.686826+0000","last_unstale":"2024-04-26T21:59:32.691283+0000","last_undegraded":"2024-04-26T21:59:32.691283+0000","last_fullsized":"2024-04-26T21:59:32.691283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:45.135845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677093+0000","last_change":"2024-04-26T21:59:32.677093+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677093+0000","last_undegraded":"2024-04-26T21:59:32.677093+0000","last_fullsized":"2024-04-26T21:59:32.677093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689148+0000","last_change":"2024-04-26T21:59:32.686878+0000","last_active":"2024-04-26T21:59:32.689148+0000","last_peered":"2024-04-26T21:59:32.689148+0000","last_clean":"2024-04-26T21:59:32.689148+0000","last_became_active":"2024-04-26T21:59:32.686568+0000","last_became_peered":"2024-04-26T21:59:32.686568+0000","last_unstale":"2024-04-26T21:59:32.689148+0000","last_undegraded":"2024-04-26T21:59:32.689148+0000","last_fullsized":"2024-04-26T21:59:32.689148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:53:07.883511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676773+0000","last_change":"2024-04-26T21:59:32.676773+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676773+0000","last_undegraded":"2024-04-26T21:59:32.676773+0000","last_fullsized":"2024-04-26T21:59:32.676773+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691271+0000","last_change":"2024-04-26T21:59:32.685122+0000","last_active":"2024-04-26T21:59:32.691271+0000","last_peered":"2024-04-26T21:59:32.691271+0000","last_clean":"2024-04-26T21:59:32.691271+0000","last_became_active":"2024-04-26T21:59:32.684797+0000","last_became_peered":"2024-04-26T21:59:32.684797+0000","last_unstale":"2024-04-26T21:59:32.691271+0000","last_undegraded":"2024-04-26T21:59:32.691271+0000","last_fullsized":"2024-04-26T21:59:32.691271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:42.691495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679248+0000","last_change":"2024-04-26T21:59:32.679248+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679248+0000","last_undegraded":"2024-04-26T21:59:32.679248+0000","last_fullsized":"2024-04-26T21:59:32.679248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689876+0000","last_change":"2024-04-26T21:59:32.685108+0000","last_active":"2024-04-26T21:59:32.689876+0000","last_peered":"2024-04-26T21:59:32.689876+0000","last_clean":"2024-04-26T21:59:32.689876+0000","last_became_active":"2024-04-26T21:59:32.684831+0000","last_became_peered":"2024-04-26T21:59:32.684831+0000","last_unstale":"2024-04-26T21:59:32.689876+0000","last_undegraded":"2024-04-26T21:59:32.689876+0000","last_fullsized":"2024-04-26T21:59:32.689876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678241+0000","last_change":"2024-04-26T21:59:32.678241+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678241+0000","last_undegraded":"2024-04-26T21:59:32.678241+0000","last_fullsized":"2024-04-26T21:59:32.678241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.687651+0000","last_change":"2024-04-26T21:59:32.684327+0000","last_active":"2024-04-26T21:59:32.687651+0000","last_peered":"2024-04-26T21:59:32.687651+0000","last_clean":"2024-04-26T21:59:32.687651+0000","last_became_active":"2024-04-26T21:59:32.684028+0000","last_became_peered":"2024-04-26T21:59:32.684028+0000","last_unstale":"2024-04-26T21:59:32.687651+0000","last_undegraded":"2024-04-26T21:59:32.687651+0000","last_fullsized":"2024-04-26T21:59:32.687651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:20.380688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676154+0000","last_change":"2024-04-26T21:59:32.676154+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676154+0000","last_undegraded":"2024-04-26T21:59:32.676154+0000","last_fullsized":"2024-04-26T21:59:32.676154+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691339+0000","last_change":"2024-04-26T21:59:32.688426+0000","last_active":"2024-04-26T21:59:32.691339+0000","last_peered":"2024-04-26T21:59:32.691339+0000","last_clean":"2024-04-26T21:59:32.691339+0000","last_became_active":"2024-04-26T21:59:32.688159+0000","last_became_peered":"2024-04-26T21:59:32.688159+0000","last_unstale":"2024-04-26T21:59:32.691339+0000","last_undegraded":"2024-04-26T21:59:32.691339+0000","last_fullsized":"2024-04-26T21:59:32.691339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677918+0000","last_change":"2024-04-26T21:59:32.677918+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677918+0000","last_undegraded":"2024-04-26T21:59:32.677918+0000","last_fullsized":"2024-04-26T21:59:32.677918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689164+0000","last_change":"2024-04-26T21:59:32.687044+0000","last_active":"2024-04-26T21:59:32.689164+0000","last_peered":"2024-04-26T21:59:32.689164+0000","last_clean":"2024-04-26T21:59:32.689164+0000","last_became_active":"2024-04-26T21:59:32.686749+0000","last_became_peered":"2024-04-26T21:59:32.686749+0000","last_unstale":"2024-04-26T21:59:32.689164+0000","last_undegraded":"2024-04-26T21:59:32.689164+0000","last_fullsized":"2024-04-26T21:59:32.689164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:54.527477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677540+0000","last_change":"2024-04-26T21:59:32.677540+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677540+0000","last_undegraded":"2024-04-26T21:59:32.677540+0000","last_fullsized":"2024-04-26T21:59:32.677540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.686410+0000","last_change":"2024-04-26T21:59:32.684862+0000","last_active":"2024-04-26T21:59:32.686410+0000","last_peered":"2024-04-26T21:59:32.686410+0000","last_clean":"2024-04-26T21:59:32.686410+0000","last_became_active":"2024-04-26T21:59:32.684371+0000","last_became_peered":"2024-04-26T21:59:32.684371+0000","last_unstale":"2024-04-26T21:59:32.686410+0000","last_undegraded":"2024-04-26T21:59:32.686410+0000","last_fullsized":"2024-04-26T21:59:32.686410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675225+0000","last_change":"2024-04-26T21:59:32.675225+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675225+0000","last_undegraded":"2024-04-26T21:59:32.675225+0000","last_fullsized":"2024-04-26T21:59:32.675225+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691175+0000","last_change":"2024-04-26T21:59:32.684322+0000","last_active":"2024-04-26T21:59:32.691175+0000","last_peered":"2024-04-26T21:59:32.691175+0000","last_clean":"2024-04-26T21:59:32.691175+0000","last_became_active":"2024-04-26T21:59:32.684050+0000","last_became_peered":"2024-04-26T21:59:32.684050+0000","last_unstale":"2024-04-26T21:59:32.691175+0000","last_undegraded":"2024-04-26T21:59:32.691175+0000","last_fullsized":"2024-04-26T21:59:32.691175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676893+0000","last_change":"2024-04-26T21:59:32.676893+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676893+0000","last_undegraded":"2024-04-26T21:59:32.676893+0000","last_fullsized":"2024-04-26T21:59:32.676893+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691158+0000","last_change":"2024-04-26T21:59:32.683976+0000","last_active":"2024-04-26T21:59:32.691158+0000","last_peered":"2024-04-26T21:59:32.691158+0000","last_clean":"2024-04-26T21:59:32.691158+0000","last_became_active":"2024-04-26T21:59:32.683703+0000","last_became_peered":"2024-04-26T21:59:32.683703+0000","last_unstale":"2024-04-26T21:59:32.691158+0000","last_undegraded":"2024-04-26T21:59:32.691158+0000","last_fullsized":"2024-04-26T21:59:32.691158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679491+0000","last_change":"2024-04-26T21:59:32.679491+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679491+0000","last_undegraded":"2024-04-26T21:59:32.679491+0000","last_fullsized":"2024-04-26T21:59:32.679491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.692374+0000","last_change":"2024-04-26T21:59:32.687047+0000","last_active":"2024-04-26T21:59:32.692374+0000","last_peered":"2024-04-26T21:59:32.692374+0000","last_clean":"2024-04-26T21:59:32.692374+0000","last_became_active":"2024-04-26T21:59:32.686745+0000","last_became_peered":"2024-04-26T21:59:32.686745+0000","last_unstale":"2024-04-26T21:59:32.692374+0000","last_undegraded":"2024-04-26T21:59:32.692374+0000","last_fullsized":"2024-04-26T21:59:32.692374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675546+0000","last_change":"2024-04-26T21:59:32.675546+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675546+0000","last_undegraded":"2024-04-26T21:59:32.675546+0000","last_fullsized":"2024-04-26T21:59:32.675546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689541+0000","last_change":"2024-04-26T21:59:32.688686+0000","last_active":"2024-04-26T21:59:32.689541+0000","last_peered":"2024-04-26T21:59:32.689541+0000","last_clean":"2024-04-26T21:59:32.689541+0000","last_became_active":"2024-04-26T21:59:32.688324+0000","last_became_peered":"2024-04-26T21:59:32.688324+0000","last_unstale":"2024-04-26T21:59:32.689541+0000","last_undegraded":"2024-04-26T21:59:32.689541+0000","last_fullsized":"2024-04-26T21:59:32.689541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:23.800646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678050+0000","last_change":"2024-04-26T21:59:32.678050+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678050+0000","last_undegraded":"2024-04-26T21:59:32.678050+0000","last_fullsized":"2024-04-26T21:59:32.678050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689222+0000","last_change":"2024-04-26T21:59:32.687084+0000","last_active":"2024-04-26T21:59:32.689222+0000","last_peered":"2024-04-26T21:59:32.689222+0000","last_clean":"2024-04-26T21:59:32.689222+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:32.689222+0000","last_undegraded":"2024-04-26T21:59:32.689222+0000","last_fullsized":"2024-04-26T21:59:32.689222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:32:30.568876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679745+0000","last_change":"2024-04-26T21:59:32.679745+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679745+0000","last_undegraded":"2024-04-26T21:59:32.679745+0000","last_fullsized":"2024-04-26T21:59:32.679745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691565+0000","last_change":"2024-04-26T21:59:32.691030+0000","last_active":"2024-04-26T21:59:32.691565+0000","last_peered":"2024-04-26T21:59:32.691565+0000","last_clean":"2024-04-26T21:59:32.691565+0000","last_became_active":"2024-04-26T21:59:32.690506+0000","last_became_peered":"2024-04-26T21:59:32.690506+0000","last_unstale":"2024-04-26T21:59:32.691565+0000","last_undegraded":"2024-04-26T21:59:32.691565+0000","last_fullsized":"2024-04-26T21:59:32.691565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:36.604666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.677132+0000","last_change":"2024-04-26T21:59:32.677132+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.677132+0000","last_undegraded":"2024-04-26T21:59:32.677132+0000","last_fullsized":"2024-04-26T21:59:32.677132+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691189+0000","last_change":"2024-04-26T21:59:32.688347+0000","last_active":"2024-04-26T21:59:32.691189+0000","last_peered":"2024-04-26T21:59:32.691189+0000","last_clean":"2024-04-26T21:59:32.691189+0000","last_became_active":"2024-04-26T21:59:32.688072+0000","last_became_peered":"2024-04-26T21:59:32.688072+0000","last_unstale":"2024-04-26T21:59:32.691189+0000","last_undegraded":"2024-04-26T21:59:32.691189+0000","last_fullsized":"2024-04-26T21:59:32.691189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678256+0000","last_change":"2024-04-26T21:59:32.678256+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678256+0000","last_undegraded":"2024-04-26T21:59:32.678256+0000","last_fullsized":"2024-04-26T21:59:32.678256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.687532+0000","last_change":"2024-04-26T21:59:32.686618+0000","last_active":"2024-04-26T21:59:32.687532+0000","last_peered":"2024-04-26T21:59:32.687532+0000","last_clean":"2024-04-26T21:59:32.687532+0000","last_became_active":"2024-04-26T21:59:32.686281+0000","last_became_peered":"2024-04-26T21:59:32.686281+0000","last_unstale":"2024-04-26T21:59:32.687532+0000","last_undegraded":"2024-04-26T21:59:32.687532+0000","last_fullsized":"2024-04-26T21:59:32.687532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:11.635296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676641+0000","last_change":"2024-04-26T21:59:32.676641+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676641+0000","last_undegraded":"2024-04-26T21:59:32.676641+0000","last_fullsized":"2024-04-26T21:59:32.676641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.690052+0000","last_change":"2024-04-26T21:59:32.689448+0000","last_active":"2024-04-26T21:59:32.690052+0000","last_peered":"2024-04-26T21:59:32.690052+0000","last_clean":"2024-04-26T21:59:32.690052+0000","last_became_active":"2024-04-26T21:59:32.689075+0000","last_became_peered":"2024-04-26T21:59:32.689075+0000","last_unstale":"2024-04-26T21:59:32.690052+0000","last_undegraded":"2024-04-26T21:59:32.690052+0000","last_fullsized":"2024-04-26T21:59:32.690052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:47.525567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674682+0000","last_change":"2024-04-26T21:59:32.674682+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674682+0000","last_undegraded":"2024-04-26T21:59:32.674682+0000","last_fullsized":"2024-04-26T21:59:32.674682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.686774+0000","last_change":"2024-04-26T21:59:32.683700+0000","last_active":"2024-04-26T21:59:32.686774+0000","last_peered":"2024-04-26T21:59:32.686774+0000","last_clean":"2024-04-26T21:59:32.686774+0000","last_became_active":"2024-04-26T21:59:32.683407+0000","last_became_peered":"2024-04-26T21:59:32.683407+0000","last_unstale":"2024-04-26T21:59:32.686774+0000","last_undegraded":"2024-04-26T21:59:32.686774+0000","last_fullsized":"2024-04-26T21:59:32.686774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678019+0000","last_change":"2024-04-26T21:59:32.678019+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678019+0000","last_undegraded":"2024-04-26T21:59:32.678019+0000","last_fullsized":"2024-04-26T21:59:32.678019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691555+0000","last_change":"2024-04-26T21:59:32.685973+0000","last_active":"2024-04-26T21:59:32.691555+0000","last_peered":"2024-04-26T21:59:32.691555+0000","last_clean":"2024-04-26T21:59:32.691555+0000","last_became_active":"2024-04-26T21:59:32.685635+0000","last_became_peered":"2024-04-26T21:59:32.685635+0000","last_unstale":"2024-04-26T21:59:32.691555+0000","last_undegraded":"2024-04-26T21:59:32.691555+0000","last_fullsized":"2024-04-26T21:59:32.691555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674907+0000","last_change":"2024-04-26T21:59:32.674907+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674907+0000","last_undegraded":"2024-04-26T21:59:32.674907+0000","last_fullsized":"2024-04-26T21:59:32.674907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691208+0000","last_change":"2024-04-26T21:59:32.688381+0000","last_active":"2024-04-26T21:59:32.691208+0000","last_peered":"2024-04-26T21:59:32.691208+0000","last_clean":"2024-04-26T21:59:32.691208+0000","last_became_active":"2024-04-26T21:59:32.688098+0000","last_became_peered":"2024-04-26T21:59:32.688098+0000","last_unstale":"2024-04-26T21:59:32.691208+0000","last_undegraded":"2024-04-26T21:59:32.691208+0000","last_fullsized":"2024-04-26T21:59:32.691208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.675807+0000","last_change":"2024-04-26T21:59:32.675807+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.675807+0000","last_undegraded":"2024-04-26T21:59:32.675807+0000","last_fullsized":"2024-04-26T21:59:32.675807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.692314+0000","last_change":"2024-04-26T21:59:32.686480+0000","last_active":"2024-04-26T21:59:32.692314+0000","last_peered":"2024-04-26T21:59:32.692314+0000","last_clean":"2024-04-26T21:59:32.692314+0000","last_became_active":"2024-04-26T21:59:32.685352+0000","last_became_peered":"2024-04-26T21:59:32.685352+0000","last_unstale":"2024-04-26T21:59:32.692314+0000","last_undegraded":"2024-04-26T21:59:32.692314+0000","last_fullsized":"2024-04-26T21:59:32.692314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.679415+0000","last_change":"2024-04-26T21:59:32.679415+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.679415+0000","last_undegraded":"2024-04-26T21:59:32.679415+0000","last_fullsized":"2024-04-26T21:59:32.679415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.689828+0000","last_change":"2024-04-26T21:59:32.684632+0000","last_active":"2024-04-26T21:59:32.689828+0000","last_peered":"2024-04-26T21:59:32.689828+0000","last_clean":"2024-04-26T21:59:32.689828+0000","last_became_active":"2024-04-26T21:59:32.684385+0000","last_became_peered":"2024-04-26T21:59:32.684385+0000","last_unstale":"2024-04-26T21:59:32.689828+0000","last_undegraded":"2024-04-26T21:59:32.689828+0000","last_fullsized":"2024-04-26T21:59:32.689828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.678116+0000","last_change":"2024-04-26T21:59:32.678116+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.678116+0000","last_undegraded":"2024-04-26T21:59:32.678116+0000","last_fullsized":"2024-04-26T21:59:32.678116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691597+0000","last_change":"2024-04-26T21:59:32.686076+0000","last_active":"2024-04-26T21:59:32.691597+0000","last_peered":"2024-04-26T21:59:32.691597+0000","last_clean":"2024-04-26T21:59:32.691597+0000","last_became_active":"2024-04-26T21:59:32.685776+0000","last_became_peered":"2024-04-26T21:59:32.685776+0000","last_unstale":"2024-04-26T21:59:32.691597+0000","last_undegraded":"2024-04-26T21:59:32.691597+0000","last_fullsized":"2024-04-26T21:59:32.691597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676519+0000","last_change":"2024-04-26T21:59:32.676519+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676519+0000","last_undegraded":"2024-04-26T21:59:32.676519+0000","last_fullsized":"2024-04-26T21:59:32.676519+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.685795+0000","last_change":"2024-04-26T21:59:32.684485+0000","last_active":"2024-04-26T21:59:32.685795+0000","last_peered":"2024-04-26T21:59:32.685795+0000","last_clean":"2024-04-26T21:59:32.685795+0000","last_became_active":"2024-04-26T21:59:32.682716+0000","last_became_peered":"2024-04-26T21:59:32.682716+0000","last_unstale":"2024-04-26T21:59:32.685795+0000","last_undegraded":"2024-04-26T21:59:32.685795+0000","last_fullsized":"2024-04-26T21:59:32.685795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:26.174489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.676671+0000","last_change":"2024-04-26T21:59:32.676671+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.676671+0000","last_undegraded":"2024-04-26T21:59:32.676671+0000","last_fullsized":"2024-04-26T21:59:32.676671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691184+0000","last_change":"2024-04-26T21:59:32.684576+0000","last_active":"2024-04-26T21:59:32.691184+0000","last_peered":"2024-04-26T21:59:32.691184+0000","last_clean":"2024-04-26T21:59:32.691184+0000","last_became_active":"2024-04-26T21:59:32.684294+0000","last_became_peered":"2024-04-26T21:59:32.684294+0000","last_unstale":"2024-04-26T21:59:32.691184+0000","last_undegraded":"2024-04-26T21:59:32.691184+0000","last_fullsized":"2024-04-26T21:59:32.691184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:34.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-04-26T21:59:32.674042+0000","last_change":"2024-04-26T21:59:32.674042+0000","last_active":"2024-04-26T21:59:32.665628+0000","last_peered":"2024-04-26T21:59:32.665628+0000","last_clean":"2024-04-26T21:59:32.665628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T21:59:32.674042+0000","last_undegraded":"2024-04-26T21:59:32.674042+0000","last_fullsized":"2024-04-26T21:59:32.674042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.691044+0000","last_change":"2024-04-26T21:59:32.690047+0000","last_active":"2024-04-26T21:59:32.691044+0000","last_peered":"2024-04-26T21:59:32.691044+0000","last_clean":"2024-04-26T21:59:32.691044+0000","last_became_active":"2024-04-26T21:59:32.689747+0000","last_became_peered":"2024-04-26T21:59:32.689747+0000","last_unstale":"2024-04-26T21:59:32.691044+0000","last_undegraded":"2024-04-26T21:59:32.691044+0000","last_fullsized":"2024-04-26T21:59:32.691044+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-26T21:59:32.673772+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:59:32.673772+0000","last_peered":"2024-04-26T21:59:32.673772+0000","last_clean":"2024-04-26T21:59:32.673772+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:59:32.673772+0000","last_undegraded":"2024-04-26T21:59:32.673772+0000","last_fullsized":"2024-04-26T21:59:32.673772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":348160,"data_stored":131937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":722305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:59:41.033 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T21:59:41.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.141+0000 7f6c1c338640 1 Processor -- start 2024-04-26T21:59:41.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.141+0000 7f6c1c338640 1 -- start start 2024-04-26T21:59:41.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c1c338640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c14145980 0x7f6c14160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c1c338640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6c140b3de0 0x7f6c140b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c1c338640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c140b4260 con 0x7f6c140b5fd0 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c1c338640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6c140b6440 con 0x7f6c140b3de0 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c1c338640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c140b5140 con 0x7f6c14145980 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c1a8d5640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6c140b5fd0 0x7f6c1415c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42186/0 (socket says 172.21.15.137:42186) 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c1a8d5640 1 -- 172.21.15.137:0/1698893411 learned_addr learned my addr 172.21.15.137:0/1698893411 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c198d3640 1 --2- 172.21.15.137:0/1698893411 >> v2:172.21.15.170:3300/0 conn(0x7f6c140b3de0 0x7f6c140b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960191190 0 0) 0x7f6c140b4260 con 0x7f6c140b5fd0 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c1a0d4640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c14145980 0x7f6c14160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.142+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c00003520 con 0x7f6c140b5fd0 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 19368141 0 0) 0x7f6c00003520 con 0x7f6c140b5fd0 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c14145980 msgr2=0x7f6c14160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c14145980 0x7f6c14160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 >> v2:172.21.15.170:3300/0 conn(0x7f6c140b3de0 msgr2=0x7f6c140b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:41.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 --2- 172.21.15.137:0/1698893411 >> v2:172.21.15.170:3300/0 conn(0x7f6c140b3de0 0x7f6c140b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c140b4530 con 0x7f6c140b5fd0 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6c0c001a10 con 0x7f6c140b5fd0 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 >> v1:172.21.15.137:6789/0 conn(0x7f6c140b5fd0 legacy=0x7f6c1415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c14145980 0x7f6c000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c00003f30 0x7f6c00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c00004d40 0x7f6c000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140b6440 con 0x7f6c00004d40 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140b5140 con 0x7f6c00003f30 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0000ba10 con 0x7f6c14145980 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c1a8d5640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c00004d40 0x7f6c000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c1a0d4640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c14145980 0x7f6c000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c198d3640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c00003f30 0x7f6c00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c1a8d5640 1 -- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c14145980 msgr2=0x7f6c000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c1a8d5640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c14145980 0x7f6c000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c1a8d5640 1 -- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c00003f30 msgr2=0x7f6c00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c1a8d5640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c00003f30 0x7f6c00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.143+0000 7f6c1a8d5640 1 -- 172.21.15.137:0/1698893411 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c00003520 con 0x7f6c00004d40 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.144+0000 7f6c1a8d5640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c00004d40 0x7f6c000051c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00a8b0 tx=0x7f6c00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18773e9a978182e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.144+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00a4d0 con 0x7f6c00004d40 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.144+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c02f070 con 0x7f6c00004d40 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.144+0000 7f6c190d2640 1 -- 172.21.15.137:0/1698893411 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c02bd00 con 0x7f6c00004d40 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.144+0000 7f6c1c338640 1 -- 172.21.15.137:0/1698893411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c00004d40 msgr2=0x7f6c000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.144+0000 7f6c1c338640 1 --2- 172.21.15.137:0/1698893411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c00004d40 0x7f6c000051c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00a8b0 tx=0x7f6c00005830 comp rx=0 tx=0).stop 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.144+0000 7f6c1a8d5640 1 -- 172.21.15.137:0/1698893411 reap_dead start 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.145+0000 7f6c1c338640 1 -- 172.21.15.137:0/1698893411 shutdown_connections 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.145+0000 7f6c1c338640 1 -- 172.21.15.137:0/1698893411 >> 172.21.15.137:0/1698893411 conn(0x7f6c140d0d30 msgr2=0x7f6c140d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.145+0000 7f6c1c338640 1 -- 172.21.15.137:0/1698893411 shutdown_connections 2024-04-26T21:59:41.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.145+0000 7f6c1c338640 1 -- 172.21.15.137:0/1698893411 wait complete. 2024-04-26T21:59:41.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.146+0000 7f6c1c338640 1 Processor -- start 2024-04-26T21:59:41.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.146+0000 7f6c1c338640 1 -- start start 2024-04-26T21:59:41.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.146+0000 7f6c1c338640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c00004d40 0x7f6c1413fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.146+0000 7f6c1c338640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c141f5580 0x7f6c1415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1c338640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c1413d010 0x7f6c1413d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1c338640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140b4dd0 con 0x7f6c1413d010 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1c338640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140b4af0 con 0x7f6c141f5580 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1c338640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c140730e0 con 0x7f6c00004d40 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a8d5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c1413d010 0x7f6c1413d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a8d5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c1413d010 0x7f6c1413d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50354/0 (socket says 172.21.15.137:50354) 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a8d5640 1 -- 172.21.15.137:0/1990412494 learned_addr learned my addr 172.21.15.137:0/1990412494 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c198d3640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c141f5580 0x7f6c1415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a0d4640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c00004d40 0x7f6c1413fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a8d5640 1 -- 172.21.15.137:0/1990412494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c00004d40 msgr2=0x7f6c1413fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a8d5640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c00004d40 0x7f6c1413fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a8d5640 1 -- 172.21.15.137:0/1990412494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c141f5580 msgr2=0x7f6c1415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a8d5640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c141f5580 0x7f6c1415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a8d5640 1 -- 172.21.15.137:0/1990412494 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c140ae8b0 con 0x7f6c1413d010 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1a8d5640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c1413d010 0x7f6c1413d490 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000f80 tx=0x7f6c0c001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:41.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c0affd640 1 -- 172.21.15.137:0/1990412494 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00a4d0 con 0x7f6c1413d010 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c0affd640 1 -- 172.21.15.137:0/1990412494 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c004b60 con 0x7f6c1413d010 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c141f5e00 con 0x7f6c1413d010 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c0affd640 1 -- 172.21.15.137:0/1990412494 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c002020 con 0x7f6c1413d010 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.147+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c141f63c0 con 0x7f6c1413d010 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.149+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1406a290 con 0x7f6c1413d010 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.149+0000 7f6c0affd640 1 -- 172.21.15.137:0/1990412494 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c0c034470 con 0x7f6c1413d010 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.149+0000 7f6c0affd640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf806c890 0x7f6bf806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.149+0000 7f6c0affd640 1 -- 172.21.15.137:0/1990412494 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6c0c0aba10 con 0x7f6c1413d010 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.149+0000 7f6c1a0d4640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf806c890 0x7f6bf806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.150+0000 7f6c1a0d4640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf806c890 0x7f6bf806ed50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c140d08b0 tx=0x7f6c10009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:41.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.154+0000 7f6c0affd640 1 -- 172.21.15.137:0/1990412494 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6c0c079f00 con 0x7f6c1413d010 2024-04-26T21:59:41.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.323+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c1415ffc0 con 0x7f6bf806c890 2024-04-26T21:59:41.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.329+0000 7f6c0affd640 1 -- 172.21.15.137:0/1990412494 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251951 (secure 0 0 0) 0x7f6c10014bb0 con 0x7f6bf806c890 2024-04-26T21:59:41.332 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:41.333 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T21:59:41.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf806c890 msgr2=0x7f6bf806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf806c890 0x7f6bf806ed50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c140d08b0 tx=0x7f6c10009190 comp rx=0 tx=0).stop 2024-04-26T21:59:41.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c1413d010 msgr2=0x7f6c1413d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c1413d010 0x7f6c1413d490 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c000f80 tx=0x7f6c0c001de0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 shutdown_connections 2024-04-26T21:59:41.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6bf806c890 0x7f6bf806ed50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c1413d010 0x7f6c1413d490 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c141f5580 0x7f6c1415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 --2- 172.21.15.137:0/1990412494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c00004d40 0x7f6c1413fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 >> 172.21.15.137:0/1990412494 conn(0x7f6c140d0d30 msgr2=0x7f6c140b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:41.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 shutdown_connections 2024-04-26T21:59:41.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.332+0000 7f6c1c338640 1 -- 172.21.15.137:0/1990412494 wait complete. 2024-04-26T21:59:41.343 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-04-26T21:59:40.704496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237096,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737624,"statfs":{"total":773094113280,"available":772851326976,"internally_reserved":0,"allocated":4333568,"data_stored":2395788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001546"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.684414+0000","last_change":"2024-04-26T21:59:33.689928+0000","last_active":"2024-04-26T21:59:34.684414+0000","last_peered":"2024-04-26T21:59:34.684414+0000","last_clean":"2024-04-26T21:59:34.684414+0000","last_became_active":"2024-04-26T21:59:33.689665+0000","last_became_peered":"2024-04-26T21:59:33.689665+0000","last_unstale":"2024-04-26T21:59:34.684414+0000","last_undegraded":"2024-04-26T21:59:34.684414+0000","last_fullsized":"2024-04-26T21:59:34.684414+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:15.970013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682492+0000","last_change":"2024-04-26T21:59:33.696679+0000","last_active":"2024-04-26T21:59:34.682492+0000","last_peered":"2024-04-26T21:59:34.682492+0000","last_clean":"2024-04-26T21:59:34.682492+0000","last_became_active":"2024-04-26T21:59:33.695187+0000","last_became_peered":"2024-04-26T21:59:33.695187+0000","last_unstale":"2024-04-26T21:59:34.682492+0000","last_undegraded":"2024-04-26T21:59:34.682492+0000","last_fullsized":"2024-04-26T21:59:34.682492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:29.655065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887989+0000","last_change":"2024-04-26T21:59:33.700955+0000","last_active":"2024-04-26T21:59:34.887989+0000","last_peered":"2024-04-26T21:59:34.887989+0000","last_clean":"2024-04-26T21:59:34.887989+0000","last_became_active":"2024-04-26T21:59:33.700650+0000","last_became_peered":"2024-04-26T21:59:33.700650+0000","last_unstale":"2024-04-26T21:59:34.887989+0000","last_undegraded":"2024-04-26T21:59:34.887989+0000","last_fullsized":"2024-04-26T21:59:34.887989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:29.151885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887437+0000","last_change":"2024-04-26T21:59:33.702888+0000","last_active":"2024-04-26T21:59:34.887437+0000","last_peered":"2024-04-26T21:59:34.887437+0000","last_clean":"2024-04-26T21:59:34.887437+0000","last_became_active":"2024-04-26T21:59:33.702430+0000","last_became_peered":"2024-04-26T21:59:33.702430+0000","last_unstale":"2024-04-26T21:59:34.887437+0000","last_undegraded":"2024-04-26T21:59:34.887437+0000","last_fullsized":"2024-04-26T21:59:34.887437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:29.043040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888003+0000","last_change":"2024-04-26T21:59:33.694616+0000","last_active":"2024-04-26T21:59:34.888003+0000","last_peered":"2024-04-26T21:59:34.888003+0000","last_clean":"2024-04-26T21:59:34.888003+0000","last_became_active":"2024-04-26T21:59:33.694289+0000","last_became_peered":"2024-04-26T21:59:33.694289+0000","last_unstale":"2024-04-26T21:59:34.888003+0000","last_undegraded":"2024-04-26T21:59:34.888003+0000","last_fullsized":"2024-04-26T21:59:34.888003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:35.595227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682190+0000","last_change":"2024-04-26T21:59:33.692836+0000","last_active":"2024-04-26T21:59:34.682190+0000","last_peered":"2024-04-26T21:59:34.682190+0000","last_clean":"2024-04-26T21:59:34.682190+0000","last_became_active":"2024-04-26T21:59:33.692178+0000","last_became_peered":"2024-04-26T21:59:33.692178+0000","last_unstale":"2024-04-26T21:59:34.682190+0000","last_undegraded":"2024-04-26T21:59:34.682190+0000","last_fullsized":"2024-04-26T21:59:34.682190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:29.151885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683343+0000","last_change":"2024-04-26T21:59:33.689498+0000","last_active":"2024-04-26T21:59:34.683343+0000","last_peered":"2024-04-26T21:59:34.683343+0000","last_clean":"2024-04-26T21:59:34.683343+0000","last_became_active":"2024-04-26T21:59:33.689246+0000","last_became_peered":"2024-04-26T21:59:33.689246+0000","last_unstale":"2024-04-26T21:59:34.683343+0000","last_undegraded":"2024-04-26T21:59:34.683343+0000","last_fullsized":"2024-04-26T21:59:34.683343+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:37.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683674+0000","last_change":"2024-04-26T21:59:33.684732+0000","last_active":"2024-04-26T21:59:34.683674+0000","last_peered":"2024-04-26T21:59:34.683674+0000","last_clean":"2024-04-26T21:59:34.683674+0000","last_became_active":"2024-04-26T21:59:33.684419+0000","last_became_peered":"2024-04-26T21:59:33.684419+0000","last_unstale":"2024-04-26T21:59:34.683674+0000","last_undegraded":"2024-04-26T21:59:34.683674+0000","last_fullsized":"2024-04-26T21:59:34.683674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:49.176983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888577+0000","last_change":"2024-04-26T21:59:33.704189+0000","last_active":"2024-04-26T21:59:34.888577+0000","last_peered":"2024-04-26T21:59:34.888577+0000","last_clean":"2024-04-26T21:59:34.888577+0000","last_became_active":"2024-04-26T21:59:33.703918+0000","last_became_peered":"2024-04-26T21:59:33.703918+0000","last_unstale":"2024-04-26T21:59:34.888577+0000","last_undegraded":"2024-04-26T21:59:34.888577+0000","last_fullsized":"2024-04-26T21:59:34.888577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:21.434385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887512+0000","last_change":"2024-04-26T21:59:33.698791+0000","last_active":"2024-04-26T21:59:34.887512+0000","last_peered":"2024-04-26T21:59:34.887512+0000","last_clean":"2024-04-26T21:59:34.887512+0000","last_became_active":"2024-04-26T21:59:33.698415+0000","last_became_peered":"2024-04-26T21:59:33.698415+0000","last_unstale":"2024-04-26T21:59:34.887512+0000","last_undegraded":"2024-04-26T21:59:34.887512+0000","last_fullsized":"2024-04-26T21:59:34.887512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:44.106344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683866+0000","last_change":"2024-04-26T21:59:33.704623+0000","last_active":"2024-04-26T21:59:34.683866+0000","last_peered":"2024-04-26T21:59:34.683866+0000","last_clean":"2024-04-26T21:59:34.683866+0000","last_became_active":"2024-04-26T21:59:33.704250+0000","last_became_peered":"2024-04-26T21:59:33.704250+0000","last_unstale":"2024-04-26T21:59:34.683866+0000","last_undegraded":"2024-04-26T21:59:34.683866+0000","last_fullsized":"2024-04-26T21:59:34.683866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:12.744934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887895+0000","last_change":"2024-04-26T21:59:33.700278+0000","last_active":"2024-04-26T21:59:34.887895+0000","last_peered":"2024-04-26T21:59:34.887895+0000","last_clean":"2024-04-26T21:59:34.887895+0000","last_became_active":"2024-04-26T21:59:33.700031+0000","last_became_peered":"2024-04-26T21:59:33.700031+0000","last_unstale":"2024-04-26T21:59:34.887895+0000","last_undegraded":"2024-04-26T21:59:34.887895+0000","last_fullsized":"2024-04-26T21:59:34.887895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:38.453855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888117+0000","last_change":"2024-04-26T21:59:33.704459+0000","last_active":"2024-04-26T21:59:34.888117+0000","last_peered":"2024-04-26T21:59:34.888117+0000","last_clean":"2024-04-26T21:59:34.888117+0000","last_became_active":"2024-04-26T21:59:33.704144+0000","last_became_peered":"2024-04-26T21:59:33.704144+0000","last_unstale":"2024-04-26T21:59:34.888117+0000","last_undegraded":"2024-04-26T21:59:34.888117+0000","last_fullsized":"2024-04-26T21:59:34.888117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:46.141079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682273+0000","last_change":"2024-04-26T21:59:33.694256+0000","last_active":"2024-04-26T21:59:34.682273+0000","last_peered":"2024-04-26T21:59:34.682273+0000","last_clean":"2024-04-26T21:59:34.682273+0000","last_became_active":"2024-04-26T21:59:33.692825+0000","last_became_peered":"2024-04-26T21:59:33.692825+0000","last_unstale":"2024-04-26T21:59:34.682273+0000","last_undegraded":"2024-04-26T21:59:34.682273+0000","last_fullsized":"2024-04-26T21:59:34.682273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:41.643962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887720+0000","last_change":"2024-04-26T21:59:33.686533+0000","last_active":"2024-04-26T21:59:34.887720+0000","last_peered":"2024-04-26T21:59:34.887720+0000","last_clean":"2024-04-26T21:59:34.887720+0000","last_became_active":"2024-04-26T21:59:33.686242+0000","last_became_peered":"2024-04-26T21:59:33.686242+0000","last_unstale":"2024-04-26T21:59:34.887720+0000","last_undegraded":"2024-04-26T21:59:34.887720+0000","last_fullsized":"2024-04-26T21:59:34.887720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:47.525957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683817+0000","last_change":"2024-04-26T21:59:33.695923+0000","last_active":"2024-04-26T21:59:34.683817+0000","last_peered":"2024-04-26T21:59:34.683817+0000","last_clean":"2024-04-26T21:59:34.683817+0000","last_became_active":"2024-04-26T21:59:33.695581+0000","last_became_peered":"2024-04-26T21:59:33.695581+0000","last_unstale":"2024-04-26T21:59:34.683817+0000","last_undegraded":"2024-04-26T21:59:34.683817+0000","last_fullsized":"2024-04-26T21:59:34.683817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:29.151885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683950+0000","last_change":"2024-04-26T21:59:33.690874+0000","last_active":"2024-04-26T21:59:34.683950+0000","last_peered":"2024-04-26T21:59:34.683950+0000","last_clean":"2024-04-26T21:59:34.683950+0000","last_became_active":"2024-04-26T21:59:33.690592+0000","last_became_peered":"2024-04-26T21:59:33.690592+0000","last_unstale":"2024-04-26T21:59:34.683950+0000","last_undegraded":"2024-04-26T21:59:34.683950+0000","last_fullsized":"2024-04-26T21:59:34.683950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:41.643962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682502+0000","last_change":"2024-04-26T21:59:33.701822+0000","last_active":"2024-04-26T21:59:34.682502+0000","last_peered":"2024-04-26T21:59:34.682502+0000","last_clean":"2024-04-26T21:59:34.682502+0000","last_became_active":"2024-04-26T21:59:33.701557+0000","last_became_peered":"2024-04-26T21:59:33.701557+0000","last_unstale":"2024-04-26T21:59:34.682502+0000","last_undegraded":"2024-04-26T21:59:34.682502+0000","last_fullsized":"2024-04-26T21:59:34.682502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:37:46.903098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682319+0000","last_change":"2024-04-26T21:59:33.702681+0000","last_active":"2024-04-26T21:59:34.682319+0000","last_peered":"2024-04-26T21:59:34.682319+0000","last_clean":"2024-04-26T21:59:34.682319+0000","last_became_active":"2024-04-26T21:59:33.702254+0000","last_became_peered":"2024-04-26T21:59:33.702254+0000","last_unstale":"2024-04-26T21:59:34.682319+0000","last_undegraded":"2024-04-26T21:59:34.682319+0000","last_fullsized":"2024-04-26T21:59:34.682319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:50.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888304+0000","last_change":"2024-04-26T21:59:33.688469+0000","last_active":"2024-04-26T21:59:34.888304+0000","last_peered":"2024-04-26T21:59:34.888304+0000","last_clean":"2024-04-26T21:59:34.888304+0000","last_became_active":"2024-04-26T21:59:33.688221+0000","last_became_peered":"2024-04-26T21:59:33.688221+0000","last_unstale":"2024-04-26T21:59:34.888304+0000","last_undegraded":"2024-04-26T21:59:34.888304+0000","last_fullsized":"2024-04-26T21:59:34.888304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:04.859032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888192+0000","last_change":"2024-04-26T21:59:33.691820+0000","last_active":"2024-04-26T21:59:34.888192+0000","last_peered":"2024-04-26T21:59:34.888192+0000","last_clean":"2024-04-26T21:59:34.888192+0000","last_became_active":"2024-04-26T21:59:33.691557+0000","last_became_peered":"2024-04-26T21:59:33.691557+0000","last_unstale":"2024-04-26T21:59:34.888192+0000","last_undegraded":"2024-04-26T21:59:34.888192+0000","last_fullsized":"2024-04-26T21:59:34.888192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:58.567302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888587+0000","last_change":"2024-04-26T21:59:33.695060+0000","last_active":"2024-04-26T21:59:34.888587+0000","last_peered":"2024-04-26T21:59:34.888587+0000","last_clean":"2024-04-26T21:59:34.888587+0000","last_became_active":"2024-04-26T21:59:33.694721+0000","last_became_peered":"2024-04-26T21:59:33.694721+0000","last_unstale":"2024-04-26T21:59:34.888587+0000","last_undegraded":"2024-04-26T21:59:34.888587+0000","last_fullsized":"2024-04-26T21:59:34.888587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:27.951522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888472+0000","last_change":"2024-04-26T21:59:33.686385+0000","last_active":"2024-04-26T21:59:34.888472+0000","last_peered":"2024-04-26T21:59:34.888472+0000","last_clean":"2024-04-26T21:59:34.888472+0000","last_became_active":"2024-04-26T21:59:33.686111+0000","last_became_peered":"2024-04-26T21:59:33.686111+0000","last_unstale":"2024-04-26T21:59:34.888472+0000","last_undegraded":"2024-04-26T21:59:34.888472+0000","last_fullsized":"2024-04-26T21:59:34.888472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:58.567302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887557+0000","last_change":"2024-04-26T21:59:33.687596+0000","last_active":"2024-04-26T21:59:34.887557+0000","last_peered":"2024-04-26T21:59:34.887557+0000","last_clean":"2024-04-26T21:59:34.887557+0000","last_became_active":"2024-04-26T21:59:33.687332+0000","last_became_peered":"2024-04-26T21:59:33.687332+0000","last_unstale":"2024-04-26T21:59:34.887557+0000","last_undegraded":"2024-04-26T21:59:34.887557+0000","last_fullsized":"2024-04-26T21:59:34.887557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:28.876495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887571+0000","last_change":"2024-04-26T21:59:33.697879+0000","last_active":"2024-04-26T21:59:34.887571+0000","last_peered":"2024-04-26T21:59:34.887571+0000","last_clean":"2024-04-26T21:59:34.887571+0000","last_became_active":"2024-04-26T21:59:33.697576+0000","last_became_peered":"2024-04-26T21:59:33.697576+0000","last_unstale":"2024-04-26T21:59:34.887571+0000","last_undegraded":"2024-04-26T21:59:34.887571+0000","last_fullsized":"2024-04-26T21:59:34.887571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:21.434385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682634+0000","last_change":"2024-04-26T21:59:33.693867+0000","last_active":"2024-04-26T21:59:34.682634+0000","last_peered":"2024-04-26T21:59:34.682634+0000","last_clean":"2024-04-26T21:59:34.682634+0000","last_became_active":"2024-04-26T21:59:33.693452+0000","last_became_peered":"2024-04-26T21:59:33.693452+0000","last_unstale":"2024-04-26T21:59:34.682634+0000","last_undegraded":"2024-04-26T21:59:34.682634+0000","last_fullsized":"2024-04-26T21:59:34.682634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:57:43.130516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888118+0000","last_change":"2024-04-26T21:59:33.698080+0000","last_active":"2024-04-26T21:59:34.888118+0000","last_peered":"2024-04-26T21:59:34.888118+0000","last_clean":"2024-04-26T21:59:34.888118+0000","last_became_active":"2024-04-26T21:59:33.697674+0000","last_became_peered":"2024-04-26T21:59:33.697674+0000","last_unstale":"2024-04-26T21:59:34.888118+0000","last_undegraded":"2024-04-26T21:59:34.888118+0000","last_fullsized":"2024-04-26T21:59:34.888118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:47.525957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887976+0000","last_change":"2024-04-26T21:59:33.688741+0000","last_active":"2024-04-26T21:59:34.887976+0000","last_peered":"2024-04-26T21:59:34.887976+0000","last_clean":"2024-04-26T21:59:34.887976+0000","last_became_active":"2024-04-26T21:59:33.688472+0000","last_became_peered":"2024-04-26T21:59:33.688472+0000","last_unstale":"2024-04-26T21:59:34.887976+0000","last_undegraded":"2024-04-26T21:59:34.887976+0000","last_fullsized":"2024-04-26T21:59:34.887976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:12.744934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888357+0000","last_change":"2024-04-26T21:59:33.693521+0000","last_active":"2024-04-26T21:59:34.888357+0000","last_peered":"2024-04-26T21:59:34.888357+0000","last_clean":"2024-04-26T21:59:34.888357+0000","last_became_active":"2024-04-26T21:59:33.693254+0000","last_became_peered":"2024-04-26T21:59:33.693254+0000","last_unstale":"2024-04-26T21:59:34.888357+0000","last_undegraded":"2024-04-26T21:59:34.888357+0000","last_fullsized":"2024-04-26T21:59:34.888357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:29.043040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683481+0000","last_change":"2024-04-26T21:59:33.688973+0000","last_active":"2024-04-26T21:59:34.683481+0000","last_peered":"2024-04-26T21:59:34.683481+0000","last_clean":"2024-04-26T21:59:34.683481+0000","last_became_active":"2024-04-26T21:59:33.688610+0000","last_became_peered":"2024-04-26T21:59:33.688610+0000","last_unstale":"2024-04-26T21:59:34.683481+0000","last_undegraded":"2024-04-26T21:59:34.683481+0000","last_fullsized":"2024-04-26T21:59:34.683481+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:54:47.525957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683751+0000","last_change":"2024-04-26T21:59:33.689116+0000","last_active":"2024-04-26T21:59:34.683751+0000","last_peered":"2024-04-26T21:59:34.683751+0000","last_clean":"2024-04-26T21:59:34.683751+0000","last_became_active":"2024-04-26T21:59:33.688844+0000","last_became_peered":"2024-04-26T21:59:33.688844+0000","last_unstale":"2024-04-26T21:59:34.683751+0000","last_undegraded":"2024-04-26T21:59:34.683751+0000","last_fullsized":"2024-04-26T21:59:34.683751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:21.385922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683221+0000","last_change":"2024-04-26T21:59:33.682744+0000","last_active":"2024-04-26T21:59:34.683221+0000","last_peered":"2024-04-26T21:59:34.683221+0000","last_clean":"2024-04-26T21:59:34.683221+0000","last_became_active":"2024-04-26T21:59:33.682457+0000","last_became_peered":"2024-04-26T21:59:33.682457+0000","last_unstale":"2024-04-26T21:59:34.683221+0000","last_undegraded":"2024-04-26T21:59:34.683221+0000","last_fullsized":"2024-04-26T21:59:34.683221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:28.876495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888387+0000","last_change":"2024-04-26T21:59:33.692061+0000","last_active":"2024-04-26T21:59:34.888387+0000","last_peered":"2024-04-26T21:59:34.888387+0000","last_clean":"2024-04-26T21:59:34.888387+0000","last_became_active":"2024-04-26T21:59:33.691801+0000","last_became_peered":"2024-04-26T21:59:33.691801+0000","last_unstale":"2024-04-26T21:59:34.888387+0000","last_undegraded":"2024-04-26T21:59:34.888387+0000","last_fullsized":"2024-04-26T21:59:34.888387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:07.883227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.684471+0000","last_change":"2024-04-26T21:59:32.687035+0000","last_active":"2024-04-26T21:59:34.684471+0000","last_peered":"2024-04-26T21:59:34.684471+0000","last_clean":"2024-04-26T21:59:34.684471+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:34.684471+0000","last_undegraded":"2024-04-26T21:59:34.684471+0000","last_fullsized":"2024-04-26T21:59:34.684471+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.684409+0000","last_change":"2024-04-26T21:59:33.694081+0000","last_active":"2024-04-26T21:59:34.684409+0000","last_peered":"2024-04-26T21:59:34.684409+0000","last_clean":"2024-04-26T21:59:34.684409+0000","last_became_active":"2024-04-26T21:59:33.693723+0000","last_became_peered":"2024-04-26T21:59:33.693723+0000","last_unstale":"2024-04-26T21:59:34.684409+0000","last_undegraded":"2024-04-26T21:59:34.684409+0000","last_fullsized":"2024-04-26T21:59:34.684409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:37.257259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888424+0000","last_change":"2024-04-26T21:59:32.683890+0000","last_active":"2024-04-26T21:59:34.888424+0000","last_peered":"2024-04-26T21:59:34.888424+0000","last_clean":"2024-04-26T21:59:34.888424+0000","last_became_active":"2024-04-26T21:59:32.683625+0000","last_became_peered":"2024-04-26T21:59:32.683625+0000","last_unstale":"2024-04-26T21:59:34.888424+0000","last_undegraded":"2024-04-26T21:59:34.888424+0000","last_fullsized":"2024-04-26T21:59:34.888424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:34.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888402+0000","last_change":"2024-04-26T21:59:33.694224+0000","last_active":"2024-04-26T21:59:34.888402+0000","last_peered":"2024-04-26T21:59:34.888402+0000","last_clean":"2024-04-26T21:59:34.888402+0000","last_became_active":"2024-04-26T21:59:33.693933+0000","last_became_peered":"2024-04-26T21:59:33.693933+0000","last_unstale":"2024-04-26T21:59:34.888402+0000","last_undegraded":"2024-04-26T21:59:34.888402+0000","last_fullsized":"2024-04-26T21:59:34.888402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:44.106344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682325+0000","last_change":"2024-04-26T21:59:32.688412+0000","last_active":"2024-04-26T21:59:34.682325+0000","last_peered":"2024-04-26T21:59:34.682325+0000","last_clean":"2024-04-26T21:59:34.682325+0000","last_became_active":"2024-04-26T21:59:32.688125+0000","last_became_peered":"2024-04-26T21:59:32.688125+0000","last_unstale":"2024-04-26T21:59:34.682325+0000","last_undegraded":"2024-04-26T21:59:34.682325+0000","last_fullsized":"2024-04-26T21:59:34.682325+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:33.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888059+0000","last_change":"2024-04-26T21:59:33.697984+0000","last_active":"2024-04-26T21:59:34.888059+0000","last_peered":"2024-04-26T21:59:34.888059+0000","last_clean":"2024-04-26T21:59:34.888059+0000","last_became_active":"2024-04-26T21:59:33.697367+0000","last_became_peered":"2024-04-26T21:59:33.697367+0000","last_unstale":"2024-04-26T21:59:34.888059+0000","last_undegraded":"2024-04-26T21:59:34.888059+0000","last_fullsized":"2024-04-26T21:59:34.888059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:28.876495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888192+0000","last_change":"2024-04-26T21:59:32.689082+0000","last_active":"2024-04-26T21:59:34.888192+0000","last_peered":"2024-04-26T21:59:34.888192+0000","last_clean":"2024-04-26T21:59:34.888192+0000","last_became_active":"2024-04-26T21:59:32.688823+0000","last_became_peered":"2024-04-26T21:59:32.688823+0000","last_unstale":"2024-04-26T21:59:34.888192+0000","last_undegraded":"2024-04-26T21:59:34.888192+0000","last_fullsized":"2024-04-26T21:59:34.888192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:32.585367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683590+0000","last_change":"2024-04-26T21:59:33.686397+0000","last_active":"2024-04-26T21:59:34.683590+0000","last_peered":"2024-04-26T21:59:34.683590+0000","last_clean":"2024-04-26T21:59:34.683590+0000","last_became_active":"2024-04-26T21:59:33.686125+0000","last_became_peered":"2024-04-26T21:59:33.686125+0000","last_unstale":"2024-04-26T21:59:34.683590+0000","last_undegraded":"2024-04-26T21:59:34.683590+0000","last_fullsized":"2024-04-26T21:59:34.683590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:40:42.243808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888476+0000","last_change":"2024-04-26T21:59:32.690777+0000","last_active":"2024-04-26T21:59:34.888476+0000","last_peered":"2024-04-26T21:59:34.888476+0000","last_clean":"2024-04-26T21:59:34.888476+0000","last_became_active":"2024-04-26T21:59:32.690516+0000","last_became_peered":"2024-04-26T21:59:32.690516+0000","last_unstale":"2024-04-26T21:59:34.888476+0000","last_undegraded":"2024-04-26T21:59:34.888476+0000","last_fullsized":"2024-04-26T21:59:34.888476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887881+0000","last_change":"2024-04-26T21:59:33.692922+0000","last_active":"2024-04-26T21:59:34.887881+0000","last_peered":"2024-04-26T21:59:34.887881+0000","last_clean":"2024-04-26T21:59:34.887881+0000","last_became_active":"2024-04-26T21:59:33.692460+0000","last_became_peered":"2024-04-26T21:59:33.692460+0000","last_unstale":"2024-04-26T21:59:34.887881+0000","last_undegraded":"2024-04-26T21:59:34.887881+0000","last_fullsized":"2024-04-26T21:59:34.887881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:49.176983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888477+0000","last_change":"2024-04-26T21:59:32.690853+0000","last_active":"2024-04-26T21:59:34.888477+0000","last_peered":"2024-04-26T21:59:34.888477+0000","last_clean":"2024-04-26T21:59:34.888477+0000","last_became_active":"2024-04-26T21:59:32.690526+0000","last_became_peered":"2024-04-26T21:59:32.690526+0000","last_unstale":"2024-04-26T21:59:34.888477+0000","last_undegraded":"2024-04-26T21:59:34.888477+0000","last_fullsized":"2024-04-26T21:59:34.888477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:34.061888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887719+0000","last_change":"2024-04-26T21:59:33.690750+0000","last_active":"2024-04-26T21:59:34.887719+0000","last_peered":"2024-04-26T21:59:34.887719+0000","last_clean":"2024-04-26T21:59:34.887719+0000","last_became_active":"2024-04-26T21:59:33.689758+0000","last_became_peered":"2024-04-26T21:59:33.689758+0000","last_unstale":"2024-04-26T21:59:34.887719+0000","last_undegraded":"2024-04-26T21:59:34.887719+0000","last_fullsized":"2024-04-26T21:59:34.887719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:15.970013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682104+0000","last_change":"2024-04-26T21:59:32.687125+0000","last_active":"2024-04-26T21:59:34.682104+0000","last_peered":"2024-04-26T21:59:34.682104+0000","last_clean":"2024-04-26T21:59:34.682104+0000","last_became_active":"2024-04-26T21:59:32.686826+0000","last_became_peered":"2024-04-26T21:59:32.686826+0000","last_unstale":"2024-04-26T21:59:34.682104+0000","last_undegraded":"2024-04-26T21:59:34.682104+0000","last_fullsized":"2024-04-26T21:59:34.682104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:36.252026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887646+0000","last_change":"2024-04-26T21:59:33.699513+0000","last_active":"2024-04-26T21:59:34.887646+0000","last_peered":"2024-04-26T21:59:34.887646+0000","last_clean":"2024-04-26T21:59:34.887646+0000","last_became_active":"2024-04-26T21:59:33.699239+0000","last_became_peered":"2024-04-26T21:59:33.699239+0000","last_unstale":"2024-04-26T21:59:34.887646+0000","last_undegraded":"2024-04-26T21:59:34.887646+0000","last_fullsized":"2024-04-26T21:59:34.887646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:27.951522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888200+0000","last_change":"2024-04-26T21:59:32.686878+0000","last_active":"2024-04-26T21:59:34.888200+0000","last_peered":"2024-04-26T21:59:34.888200+0000","last_clean":"2024-04-26T21:59:34.888200+0000","last_became_active":"2024-04-26T21:59:32.686568+0000","last_became_peered":"2024-04-26T21:59:32.686568+0000","last_unstale":"2024-04-26T21:59:34.888200+0000","last_undegraded":"2024-04-26T21:59:34.888200+0000","last_fullsized":"2024-04-26T21:59:34.888200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:04:02.161541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888074+0000","last_change":"2024-04-26T21:59:33.700151+0000","last_active":"2024-04-26T21:59:34.888074+0000","last_peered":"2024-04-26T21:59:34.888074+0000","last_clean":"2024-04-26T21:59:34.888074+0000","last_became_active":"2024-04-26T21:59:33.699777+0000","last_became_peered":"2024-04-26T21:59:33.699777+0000","last_unstale":"2024-04-26T21:59:34.888074+0000","last_undegraded":"2024-04-26T21:59:34.888074+0000","last_fullsized":"2024-04-26T21:59:34.888074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:41.643962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682510+0000","last_change":"2024-04-26T21:59:32.685122+0000","last_active":"2024-04-26T21:59:34.682510+0000","last_peered":"2024-04-26T21:59:34.682510+0000","last_clean":"2024-04-26T21:59:34.682510+0000","last_became_active":"2024-04-26T21:59:32.684797+0000","last_became_peered":"2024-04-26T21:59:32.684797+0000","last_unstale":"2024-04-26T21:59:34.682510+0000","last_undegraded":"2024-04-26T21:59:34.682510+0000","last_fullsized":"2024-04-26T21:59:34.682510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:57.562069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682404+0000","last_change":"2024-04-26T21:59:33.701389+0000","last_active":"2024-04-26T21:59:34.682404+0000","last_peered":"2024-04-26T21:59:34.682404+0000","last_clean":"2024-04-26T21:59:34.682404+0000","last_became_active":"2024-04-26T21:59:33.701134+0000","last_became_peered":"2024-04-26T21:59:33.701134+0000","last_unstale":"2024-04-26T21:59:34.682404+0000","last_undegraded":"2024-04-26T21:59:34.682404+0000","last_fullsized":"2024-04-26T21:59:34.682404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:43.973498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888522+0000","last_change":"2024-04-26T21:59:32.685108+0000","last_active":"2024-04-26T21:59:34.888522+0000","last_peered":"2024-04-26T21:59:34.888522+0000","last_clean":"2024-04-26T21:59:34.888522+0000","last_became_active":"2024-04-26T21:59:32.684831+0000","last_became_peered":"2024-04-26T21:59:32.684831+0000","last_unstale":"2024-04-26T21:59:34.888522+0000","last_undegraded":"2024-04-26T21:59:34.888522+0000","last_fullsized":"2024-04-26T21:59:34.888522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:02.376805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682552+0000","last_change":"2024-04-26T21:59:33.692702+0000","last_active":"2024-04-26T21:59:34.682552+0000","last_peered":"2024-04-26T21:59:34.682552+0000","last_clean":"2024-04-26T21:59:34.682552+0000","last_became_active":"2024-04-26T21:59:33.692169+0000","last_became_peered":"2024-04-26T21:59:33.692169+0000","last_unstale":"2024-04-26T21:59:34.682552+0000","last_undegraded":"2024-04-26T21:59:34.682552+0000","last_fullsized":"2024-04-26T21:59:34.682552+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:48:55.076536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888104+0000","last_change":"2024-04-26T21:59:32.684327+0000","last_active":"2024-04-26T21:59:34.888104+0000","last_peered":"2024-04-26T21:59:34.888104+0000","last_clean":"2024-04-26T21:59:34.888104+0000","last_became_active":"2024-04-26T21:59:32.684028+0000","last_became_peered":"2024-04-26T21:59:32.684028+0000","last_unstale":"2024-04-26T21:59:34.888104+0000","last_undegraded":"2024-04-26T21:59:34.888104+0000","last_fullsized":"2024-04-26T21:59:34.888104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:35:36.252026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887804+0000","last_change":"2024-04-26T21:59:33.700780+0000","last_active":"2024-04-26T21:59:34.887804+0000","last_peered":"2024-04-26T21:59:34.887804+0000","last_clean":"2024-04-26T21:59:34.887804+0000","last_became_active":"2024-04-26T21:59:33.700539+0000","last_became_peered":"2024-04-26T21:59:33.700539+0000","last_unstale":"2024-04-26T21:59:34.887804+0000","last_undegraded":"2024-04-26T21:59:34.887804+0000","last_fullsized":"2024-04-26T21:59:34.887804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:40:42.243808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682550+0000","last_change":"2024-04-26T21:59:32.688426+0000","last_active":"2024-04-26T21:59:34.682550+0000","last_peered":"2024-04-26T21:59:34.682550+0000","last_clean":"2024-04-26T21:59:34.682550+0000","last_became_active":"2024-04-26T21:59:32.688159+0000","last_became_peered":"2024-04-26T21:59:32.688159+0000","last_unstale":"2024-04-26T21:59:34.682550+0000","last_undegraded":"2024-04-26T21:59:34.682550+0000","last_fullsized":"2024-04-26T21:59:34.682550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:06.877994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887774+0000","last_change":"2024-04-26T21:59:33.691822+0000","last_active":"2024-04-26T21:59:34.887774+0000","last_peered":"2024-04-26T21:59:34.887774+0000","last_clean":"2024-04-26T21:59:34.887774+0000","last_became_active":"2024-04-26T21:59:33.691518+0000","last_became_peered":"2024-04-26T21:59:33.691518+0000","last_unstale":"2024-04-26T21:59:34.887774+0000","last_undegraded":"2024-04-26T21:59:34.887774+0000","last_fullsized":"2024-04-26T21:59:34.887774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:36.246595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888486+0000","last_change":"2024-04-26T21:59:32.687044+0000","last_active":"2024-04-26T21:59:34.888486+0000","last_peered":"2024-04-26T21:59:34.888486+0000","last_clean":"2024-04-26T21:59:34.888486+0000","last_became_active":"2024-04-26T21:59:32.686749+0000","last_became_peered":"2024-04-26T21:59:32.686749+0000","last_unstale":"2024-04-26T21:59:34.888486+0000","last_undegraded":"2024-04-26T21:59:34.888486+0000","last_fullsized":"2024-04-26T21:59:34.888486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682432+0000","last_change":"2024-04-26T21:59:33.694348+0000","last_active":"2024-04-26T21:59:34.682432+0000","last_peered":"2024-04-26T21:59:34.682432+0000","last_clean":"2024-04-26T21:59:34.682432+0000","last_became_active":"2024-04-26T21:59:33.692735+0000","last_became_peered":"2024-04-26T21:59:33.692735+0000","last_unstale":"2024-04-26T21:59:34.682432+0000","last_undegraded":"2024-04-26T21:59:34.682432+0000","last_fullsized":"2024-04-26T21:59:34.682432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:37:44.045435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887858+0000","last_change":"2024-04-26T21:59:32.684862+0000","last_active":"2024-04-26T21:59:34.887858+0000","last_peered":"2024-04-26T21:59:34.887858+0000","last_clean":"2024-04-26T21:59:34.887858+0000","last_became_active":"2024-04-26T21:59:32.684371+0000","last_became_peered":"2024-04-26T21:59:32.684371+0000","last_unstale":"2024-04-26T21:59:34.887858+0000","last_undegraded":"2024-04-26T21:59:34.887858+0000","last_fullsized":"2024-04-26T21:59:34.887858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:34.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683681+0000","last_change":"2024-04-26T21:59:33.686377+0000","last_active":"2024-04-26T21:59:34.683681+0000","last_peered":"2024-04-26T21:59:34.683681+0000","last_clean":"2024-04-26T21:59:34.683681+0000","last_became_active":"2024-04-26T21:59:33.686061+0000","last_became_peered":"2024-04-26T21:59:33.686061+0000","last_unstale":"2024-04-26T21:59:34.683681+0000","last_undegraded":"2024-04-26T21:59:34.683681+0000","last_fullsized":"2024-04-26T21:59:34.683681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:38.453855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682033+0000","last_change":"2024-04-26T21:59:32.684322+0000","last_active":"2024-04-26T21:59:34.682033+0000","last_peered":"2024-04-26T21:59:34.682033+0000","last_clean":"2024-04-26T21:59:34.682033+0000","last_became_active":"2024-04-26T21:59:32.684050+0000","last_became_peered":"2024-04-26T21:59:32.684050+0000","last_unstale":"2024-04-26T21:59:34.682033+0000","last_undegraded":"2024-04-26T21:59:34.682033+0000","last_fullsized":"2024-04-26T21:59:34.682033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:26.196355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683898+0000","last_change":"2024-04-26T21:59:33.693314+0000","last_active":"2024-04-26T21:59:34.683898+0000","last_peered":"2024-04-26T21:59:34.683898+0000","last_clean":"2024-04-26T21:59:34.683898+0000","last_became_active":"2024-04-26T21:59:33.693049+0000","last_became_peered":"2024-04-26T21:59:33.693049+0000","last_unstale":"2024-04-26T21:59:34.683898+0000","last_undegraded":"2024-04-26T21:59:34.683898+0000","last_fullsized":"2024-04-26T21:59:34.683898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:27.201589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682146+0000","last_change":"2024-04-26T21:59:32.683976+0000","last_active":"2024-04-26T21:59:34.682146+0000","last_peered":"2024-04-26T21:59:34.682146+0000","last_clean":"2024-04-26T21:59:34.682146+0000","last_became_active":"2024-04-26T21:59:32.683703+0000","last_became_peered":"2024-04-26T21:59:32.683703+0000","last_unstale":"2024-04-26T21:59:34.682146+0000","last_undegraded":"2024-04-26T21:59:34.682146+0000","last_fullsized":"2024-04-26T21:59:34.682146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:14.964780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887940+0000","last_change":"2024-04-26T21:59:33.690851+0000","last_active":"2024-04-26T21:59:34.887940+0000","last_peered":"2024-04-26T21:59:34.887940+0000","last_clean":"2024-04-26T21:59:34.887940+0000","last_became_active":"2024-04-26T21:59:33.689954+0000","last_became_peered":"2024-04-26T21:59:33.689954+0000","last_unstale":"2024-04-26T21:59:34.887940+0000","last_undegraded":"2024-04-26T21:59:34.887940+0000","last_fullsized":"2024-04-26T21:59:34.887940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:34.528966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887745+0000","last_change":"2024-04-26T21:59:32.687047+0000","last_active":"2024-04-26T21:59:34.887745+0000","last_peered":"2024-04-26T21:59:34.887745+0000","last_clean":"2024-04-26T21:59:34.887745+0000","last_became_active":"2024-04-26T21:59:32.686745+0000","last_became_peered":"2024-04-26T21:59:32.686745+0000","last_unstale":"2024-04-26T21:59:34.887745+0000","last_undegraded":"2024-04-26T21:59:34.887745+0000","last_fullsized":"2024-04-26T21:59:34.887745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:45.135845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888357+0000","last_change":"2024-04-26T21:59:33.689252+0000","last_active":"2024-04-26T21:59:34.888357+0000","last_peered":"2024-04-26T21:59:34.888357+0000","last_clean":"2024-04-26T21:59:34.888357+0000","last_became_active":"2024-04-26T21:59:33.688850+0000","last_became_peered":"2024-04-26T21:59:33.688850+0000","last_unstale":"2024-04-26T21:59:34.888357+0000","last_undegraded":"2024-04-26T21:59:34.888357+0000","last_fullsized":"2024-04-26T21:59:34.888357+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:39:43.973498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888060+0000","last_change":"2024-04-26T21:59:32.688686+0000","last_active":"2024-04-26T21:59:34.888060+0000","last_peered":"2024-04-26T21:59:34.888060+0000","last_clean":"2024-04-26T21:59:34.888060+0000","last_became_active":"2024-04-26T21:59:32.688324+0000","last_became_peered":"2024-04-26T21:59:32.688324+0000","last_unstale":"2024-04-26T21:59:34.888060+0000","last_undegraded":"2024-04-26T21:59:34.888060+0000","last_fullsized":"2024-04-26T21:59:34.888060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:11.635296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887940+0000","last_change":"2024-04-26T21:59:33.702690+0000","last_active":"2024-04-26T21:59:34.887940+0000","last_peered":"2024-04-26T21:59:34.887940+0000","last_clean":"2024-04-26T21:59:34.887940+0000","last_became_active":"2024-04-26T21:59:33.702156+0000","last_became_peered":"2024-04-26T21:59:33.702156+0000","last_unstale":"2024-04-26T21:59:34.887940+0000","last_undegraded":"2024-04-26T21:59:34.887940+0000","last_fullsized":"2024-04-26T21:59:34.887940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:37.299557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888152+0000","last_change":"2024-04-26T21:59:32.687084+0000","last_active":"2024-04-26T21:59:34.888152+0000","last_peered":"2024-04-26T21:59:34.888152+0000","last_clean":"2024-04-26T21:59:34.888152+0000","last_became_active":"2024-04-26T21:59:32.686773+0000","last_became_peered":"2024-04-26T21:59:32.686773+0000","last_unstale":"2024-04-26T21:59:34.888152+0000","last_undegraded":"2024-04-26T21:59:34.888152+0000","last_fullsized":"2024-04-26T21:59:34.888152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:47:22.588292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887587+0000","last_change":"2024-04-26T21:59:33.687129+0000","last_active":"2024-04-26T21:59:34.887587+0000","last_peered":"2024-04-26T21:59:34.887587+0000","last_clean":"2024-04-26T21:59:34.887587+0000","last_became_active":"2024-04-26T21:59:33.686837+0000","last_became_peered":"2024-04-26T21:59:33.686837+0000","last_unstale":"2024-04-26T21:59:34.887587+0000","last_undegraded":"2024-04-26T21:59:34.887587+0000","last_fullsized":"2024-04-26T21:59:34.887587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:47.487241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888561+0000","last_change":"2024-04-26T21:59:32.691030+0000","last_active":"2024-04-26T21:59:34.888561+0000","last_peered":"2024-04-26T21:59:34.888561+0000","last_clean":"2024-04-26T21:59:34.888561+0000","last_became_active":"2024-04-26T21:59:32.690506+0000","last_became_peered":"2024-04-26T21:59:32.690506+0000","last_unstale":"2024-04-26T21:59:34.888561+0000","last_undegraded":"2024-04-26T21:59:34.888561+0000","last_fullsized":"2024-04-26T21:59:34.888561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:57:34.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887734+0000","last_change":"2024-04-26T21:59:33.686216+0000","last_active":"2024-04-26T21:59:34.887734+0000","last_peered":"2024-04-26T21:59:34.887734+0000","last_clean":"2024-04-26T21:59:34.887734+0000","last_became_active":"2024-04-26T21:59:33.685943+0000","last_became_peered":"2024-04-26T21:59:33.685943+0000","last_unstale":"2024-04-26T21:59:34.887734+0000","last_undegraded":"2024-04-26T21:59:34.887734+0000","last_fullsized":"2024-04-26T21:59:34.887734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:35.067121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887477+0000","last_change":"2024-04-26T21:59:32.688347+0000","last_active":"2024-04-26T21:59:34.887477+0000","last_peered":"2024-04-26T21:59:34.887477+0000","last_clean":"2024-04-26T21:59:34.887477+0000","last_became_active":"2024-04-26T21:59:32.688072+0000","last_became_peered":"2024-04-26T21:59:32.688072+0000","last_unstale":"2024-04-26T21:59:34.887477+0000","last_undegraded":"2024-04-26T21:59:34.887477+0000","last_fullsized":"2024-04-26T21:59:34.887477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:45.135845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888198+0000","last_change":"2024-04-26T21:59:33.690852+0000","last_active":"2024-04-26T21:59:34.888198+0000","last_peered":"2024-04-26T21:59:34.888198+0000","last_clean":"2024-04-26T21:59:34.888198+0000","last_became_active":"2024-04-26T21:59:33.690589+0000","last_became_peered":"2024-04-26T21:59:33.690589+0000","last_unstale":"2024-04-26T21:59:34.888198+0000","last_undegraded":"2024-04-26T21:59:34.888198+0000","last_fullsized":"2024-04-26T21:59:34.888198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:03.382038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.684277+0000","last_change":"2024-04-26T21:59:32.686618+0000","last_active":"2024-04-26T21:59:34.684277+0000","last_peered":"2024-04-26T21:59:34.684277+0000","last_clean":"2024-04-26T21:59:34.684277+0000","last_became_active":"2024-04-26T21:59:32.686281+0000","last_became_peered":"2024-04-26T21:59:32.686281+0000","last_unstale":"2024-04-26T21:59:34.684277+0000","last_undegraded":"2024-04-26T21:59:34.684277+0000","last_fullsized":"2024-04-26T21:59:34.684277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:10.698304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887944+0000","last_change":"2024-04-26T21:59:33.688062+0000","last_active":"2024-04-26T21:59:34.887944+0000","last_peered":"2024-04-26T21:59:34.887944+0000","last_clean":"2024-04-26T21:59:34.887944+0000","last_became_active":"2024-04-26T21:59:33.687728+0000","last_became_peered":"2024-04-26T21:59:33.687728+0000","last_unstale":"2024-04-26T21:59:34.887944+0000","last_undegraded":"2024-04-26T21:59:34.887944+0000","last_fullsized":"2024-04-26T21:59:34.887944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:11.703537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888233+0000","last_change":"2024-04-26T21:59:32.689448+0000","last_active":"2024-04-26T21:59:34.888233+0000","last_peered":"2024-04-26T21:59:34.888233+0000","last_clean":"2024-04-26T21:59:34.888233+0000","last_became_active":"2024-04-26T21:59:32.689075+0000","last_became_peered":"2024-04-26T21:59:32.689075+0000","last_unstale":"2024-04-26T21:59:34.888233+0000","last_undegraded":"2024-04-26T21:59:34.888233+0000","last_fullsized":"2024-04-26T21:59:34.888233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:34.850481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683332+0000","last_change":"2024-04-26T21:59:33.690142+0000","last_active":"2024-04-26T21:59:34.683332+0000","last_peered":"2024-04-26T21:59:34.683332+0000","last_clean":"2024-04-26T21:59:34.683332+0000","last_became_active":"2024-04-26T21:59:33.689904+0000","last_became_peered":"2024-04-26T21:59:33.689904+0000","last_unstale":"2024-04-26T21:59:34.683332+0000","last_undegraded":"2024-04-26T21:59:34.683332+0000","last_fullsized":"2024-04-26T21:59:34.683332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:36.246595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887485+0000","last_change":"2024-04-26T21:59:32.683700+0000","last_active":"2024-04-26T21:59:34.887485+0000","last_peered":"2024-04-26T21:59:34.887485+0000","last_clean":"2024-04-26T21:59:34.887485+0000","last_became_active":"2024-04-26T21:59:32.683407+0000","last_became_peered":"2024-04-26T21:59:32.683407+0000","last_unstale":"2024-04-26T21:59:34.887485+0000","last_undegraded":"2024-04-26T21:59:34.887485+0000","last_fullsized":"2024-04-26T21:59:34.887485+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:31.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888054+0000","last_change":"2024-04-26T21:59:33.694610+0000","last_active":"2024-04-26T21:59:34.888054+0000","last_peered":"2024-04-26T21:59:34.888054+0000","last_clean":"2024-04-26T21:59:34.888054+0000","last_became_active":"2024-04-26T21:59:33.694186+0000","last_became_peered":"2024-04-26T21:59:33.694186+0000","last_unstale":"2024-04-26T21:59:34.888054+0000","last_undegraded":"2024-04-26T21:59:34.888054+0000","last_fullsized":"2024-04-26T21:59:34.888054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:43.696728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887749+0000","last_change":"2024-04-26T21:59:32.685973+0000","last_active":"2024-04-26T21:59:34.887749+0000","last_peered":"2024-04-26T21:59:34.887749+0000","last_clean":"2024-04-26T21:59:34.887749+0000","last_became_active":"2024-04-26T21:59:32.685635+0000","last_became_peered":"2024-04-26T21:59:32.685635+0000","last_unstale":"2024-04-26T21:59:34.887749+0000","last_undegraded":"2024-04-26T21:59:34.887749+0000","last_fullsized":"2024-04-26T21:59:34.887749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:14:02.376805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888355+0000","last_change":"2024-04-26T21:59:33.700794+0000","last_active":"2024-04-26T21:59:34.888355+0000","last_peered":"2024-04-26T21:59:34.888355+0000","last_clean":"2024-04-26T21:59:34.888355+0000","last_became_active":"2024-04-26T21:59:33.700563+0000","last_became_peered":"2024-04-26T21:59:33.700563+0000","last_unstale":"2024-04-26T21:59:34.888355+0000","last_undegraded":"2024-04-26T21:59:34.888355+0000","last_fullsized":"2024-04-26T21:59:34.888355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:50.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888517+0000","last_change":"2024-04-26T21:59:32.688381+0000","last_active":"2024-04-26T21:59:34.888517+0000","last_peered":"2024-04-26T21:59:34.888517+0000","last_clean":"2024-04-26T21:59:34.888517+0000","last_became_active":"2024-04-26T21:59:32.688098+0000","last_became_peered":"2024-04-26T21:59:32.688098+0000","last_unstale":"2024-04-26T21:59:34.888517+0000","last_undegraded":"2024-04-26T21:59:34.888517+0000","last_fullsized":"2024-04-26T21:59:34.888517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:42.691495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888351+0000","last_change":"2024-04-26T21:59:33.700658+0000","last_active":"2024-04-26T21:59:34.888351+0000","last_peered":"2024-04-26T21:59:34.888351+0000","last_clean":"2024-04-26T21:59:34.888351+0000","last_became_active":"2024-04-26T21:59:33.700377+0000","last_became_peered":"2024-04-26T21:59:33.700377+0000","last_unstale":"2024-04-26T21:59:34.888351+0000","last_undegraded":"2024-04-26T21:59:34.888351+0000","last_fullsized":"2024-04-26T21:59:34.888351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:12:34.528966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888011+0000","last_change":"2024-04-26T21:59:32.686480+0000","last_active":"2024-04-26T21:59:34.888011+0000","last_peered":"2024-04-26T21:59:34.888011+0000","last_clean":"2024-04-26T21:59:34.888011+0000","last_became_active":"2024-04-26T21:59:32.685352+0000","last_became_peered":"2024-04-26T21:59:32.685352+0000","last_unstale":"2024-04-26T21:59:34.888011+0000","last_undegraded":"2024-04-26T21:59:34.888011+0000","last_fullsized":"2024-04-26T21:59:34.888011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.684211+0000","last_change":"2024-04-26T21:59:33.688487+0000","last_active":"2024-04-26T21:59:34.684211+0000","last_peered":"2024-04-26T21:59:34.684211+0000","last_clean":"2024-04-26T21:59:34.684211+0000","last_became_active":"2024-04-26T21:59:33.688199+0000","last_became_peered":"2024-04-26T21:59:33.688199+0000","last_unstale":"2024-04-26T21:59:34.684211+0000","last_undegraded":"2024-04-26T21:59:34.684211+0000","last_fullsized":"2024-04-26T21:59:34.684211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:32.605199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888248+0000","last_change":"2024-04-26T21:59:32.684632+0000","last_active":"2024-04-26T21:59:34.888248+0000","last_peered":"2024-04-26T21:59:34.888248+0000","last_clean":"2024-04-26T21:59:34.888248+0000","last_became_active":"2024-04-26T21:59:32.684385+0000","last_became_peered":"2024-04-26T21:59:32.684385+0000","last_unstale":"2024-04-26T21:59:34.888248+0000","last_undegraded":"2024-04-26T21:59:34.888248+0000","last_fullsized":"2024-04-26T21:59:34.888248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:03.853799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887384+0000","last_change":"2024-04-26T21:59:33.690598+0000","last_active":"2024-04-26T21:59:34.887384+0000","last_peered":"2024-04-26T21:59:34.887384+0000","last_clean":"2024-04-26T21:59:34.887384+0000","last_became_active":"2024-04-26T21:59:33.690192+0000","last_became_peered":"2024-04-26T21:59:33.690192+0000","last_unstale":"2024-04-26T21:59:34.887384+0000","last_undegraded":"2024-04-26T21:59:34.887384+0000","last_fullsized":"2024-04-26T21:59:34.887384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:15.970013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.887942+0000","last_change":"2024-04-26T21:59:32.686076+0000","last_active":"2024-04-26T21:59:34.887942+0000","last_peered":"2024-04-26T21:59:34.887942+0000","last_clean":"2024-04-26T21:59:34.887942+0000","last_became_active":"2024-04-26T21:59:32.685776+0000","last_became_peered":"2024-04-26T21:59:32.685776+0000","last_unstale":"2024-04-26T21:59:34.887942+0000","last_undegraded":"2024-04-26T21:59:34.887942+0000","last_fullsized":"2024-04-26T21:59:34.887942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:42.691495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682047+0000","last_change":"2024-04-26T21:59:33.700732+0000","last_active":"2024-04-26T21:59:34.682047+0000","last_peered":"2024-04-26T21:59:34.682047+0000","last_clean":"2024-04-26T21:59:34.682047+0000","last_became_active":"2024-04-26T21:59:33.700444+0000","last_became_peered":"2024-04-26T21:59:33.700444+0000","last_unstale":"2024-04-26T21:59:34.682047+0000","last_undegraded":"2024-04-26T21:59:34.682047+0000","last_fullsized":"2024-04-26T21:59:34.682047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:12.744934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888335+0000","last_change":"2024-04-26T21:59:32.684485+0000","last_active":"2024-04-26T21:59:34.888335+0000","last_peered":"2024-04-26T21:59:34.888335+0000","last_clean":"2024-04-26T21:59:34.888335+0000","last_became_active":"2024-04-26T21:59:32.682716+0000","last_became_peered":"2024-04-26T21:59:32.682716+0000","last_unstale":"2024-04-26T21:59:34.888335+0000","last_undegraded":"2024-04-26T21:59:34.888335+0000","last_fullsized":"2024-04-26T21:59:34.888335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:50:09.532656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.888070+0000","last_change":"2024-04-26T21:59:33.692676+0000","last_active":"2024-04-26T21:59:34.888070+0000","last_peered":"2024-04-26T21:59:34.888070+0000","last_clean":"2024-04-26T21:59:34.888070+0000","last_became_active":"2024-04-26T21:59:33.692418+0000","last_became_peered":"2024-04-26T21:59:33.692418+0000","last_unstale":"2024-04-26T21:59:34.888070+0000","last_undegraded":"2024-04-26T21:59:34.888070+0000","last_fullsized":"2024-04-26T21:59:34.888070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:07.883227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.682057+0000","last_change":"2024-04-26T21:59:32.684576+0000","last_active":"2024-04-26T21:59:34.682057+0000","last_peered":"2024-04-26T21:59:34.682057+0000","last_clean":"2024-04-26T21:59:34.682057+0000","last_became_active":"2024-04-26T21:59:32.684294+0000","last_became_peered":"2024-04-26T21:59:32.684294+0000","last_unstale":"2024-04-26T21:59:34.682057+0000","last_undegraded":"2024-04-26T21:59:34.682057+0000","last_fullsized":"2024-04-26T21:59:34.682057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:31.599966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683304+0000","last_change":"2024-04-26T21:59:33.683811+0000","last_active":"2024-04-26T21:59:34.683304+0000","last_peered":"2024-04-26T21:59:34.683304+0000","last_clean":"2024-04-26T21:59:34.683304+0000","last_became_active":"2024-04-26T21:59:33.683541+0000","last_became_peered":"2024-04-26T21:59:33.683541+0000","last_unstale":"2024-04-26T21:59:34.683304+0000","last_undegraded":"2024-04-26T21:59:34.683304+0000","last_fullsized":"2024-04-26T21:59:34.683304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:32.665628+0000","last_clean_scrub_stamp":"2024-04-26T21:59:32.665628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:12:27.951522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683394+0000","last_change":"2024-04-26T21:59:32.690047+0000","last_active":"2024-04-26T21:59:34.683394+0000","last_peered":"2024-04-26T21:59:34.683394+0000","last_clean":"2024-04-26T21:59:34.683394+0000","last_became_active":"2024-04-26T21:59:32.689747+0000","last_became_peered":"2024-04-26T21:59:32.689747+0000","last_unstale":"2024-04-26T21:59:34.683394+0000","last_undegraded":"2024-04-26T21:59:34.683394+0000","last_fullsized":"2024-04-26T21:59:34.683394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:59:31.660394+0000","last_clean_scrub_stamp":"2024-04-26T21:59:31.660394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:46.482007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T21:59:34.683795+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T21:59:34.683795+0000","last_peered":"2024-04-26T21:59:34.683795+0000","last_clean":"2024-04-26T21:59:34.683795+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T21:59:34.683795+0000","last_undegraded":"2024-04-26T21:59:34.683795+0000","last_fullsized":"2024-04-26T21:59:34.683795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":983040,"data_stored":741737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":393216,"data_stored":151895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":393216,"data_stored":151951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":393216,"data_stored":151383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":152913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":151349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":152913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":741647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T21:59:41.347 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T21:59:41.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T21:59:41.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.487+0000 7fd2ac714640 1 Processor -- start 2024-04-26T21:59:41.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.487+0000 7fd2ac714640 1 -- start start 2024-04-26T21:59:41.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2ac714640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2a4073b10 0x7fd2a415f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2ac714640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a4073050 con 0x7fd2a415fe70 2024-04-26T21:59:41.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2ac714640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2a41604f0 con 0x7fd2a406c2a0 2024-04-26T21:59:41.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2ac714640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd2a41602c0 con 0x7fd2a4073b10 2024-04-26T21:59:41.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2a9caf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2a4073b10 0x7fd2a415f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2aacb1640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd2a415fe70 0x7fd2a406f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42198/0 (socket says 172.21.15.137:42198) 2024-04-26T21:59:41.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2aacb1640 1 -- 172.21.15.137:0/3091523216 learned_addr learned my addr 172.21.15.137:0/3091523216 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:41.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2a9caf640 1 -- 172.21.15.137:0/3091523216 >> v1:172.21.15.170:6789/0 conn(0x7fd2a406c2a0 legacy=0x7fd2a406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:41.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2a9caf640 1 -- 172.21.15.137:0/3091523216 >> v1:172.21.15.137:6789/0 conn(0x7fd2a415fe70 legacy=0x7fd2a406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.488+0000 7fd2a9caf640 1 -- 172.21.15.137:0/3091523216 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a41607d0 con 0x7fd2a4073b10 2024-04-26T21:59:41.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.489+0000 7fd2a9caf640 1 --2- 172.21.15.137:0/3091523216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a4073b10 0x7fd2a415f930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd2940097a0 tx=0x7fd29402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58862835bd5ca303 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:41.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.489+0000 7fd2a94ae640 1 -- 172.21.15.137:0/3091523216 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294037070 con 0x7fd2a4073b10 2024-04-26T21:59:41.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.489+0000 7fd2a94ae640 1 -- 172.21.15.137:0/3091523216 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd294032440 con 0x7fd2a4073b10 2024-04-26T21:59:41.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.489+0000 7fd2a94ae640 1 -- 172.21.15.137:0/3091523216 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294032810 con 0x7fd2a4073b10 2024-04-26T21:59:41.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.490+0000 7fd2ac714640 1 -- 172.21.15.137:0/3091523216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a4073b10 msgr2=0x7fd2a415f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.490+0000 7fd2ac714640 1 --2- 172.21.15.137:0/3091523216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a4073b10 0x7fd2a415f930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd2940097a0 tx=0x7fd29402a1e0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.490+0000 7fd2ac714640 1 -- 172.21.15.137:0/3091523216 shutdown_connections 2024-04-26T21:59:41.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.490+0000 7fd2ac714640 1 --2- 172.21.15.137:0/3091523216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a4073b10 0x7fd2a415f930 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.490+0000 7fd2ac714640 1 -- 172.21.15.137:0/3091523216 >> 172.21.15.137:0/3091523216 conn(0x7fd2a40d1e20 msgr2=0x7fd2a40d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:41.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.490+0000 7fd2ac714640 1 -- 172.21.15.137:0/3091523216 shutdown_connections 2024-04-26T21:59:41.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.490+0000 7fd2ac714640 1 -- 172.21.15.137:0/3091523216 wait complete. 2024-04-26T21:59:41.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.491+0000 7fd2ac714640 1 Processor -- start 2024-04-26T21:59:41.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.491+0000 7fd2ac714640 1 -- start start 2024-04-26T21:59:41.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.491+0000 7fd2ac714640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2a406c2a0 0x7fd2a4141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.491+0000 7fd2ac714640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2a4073b10 0x7fd2a40b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.491+0000 7fd2ac714640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a415fe70 0x7fd2a415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.491+0000 7fd2ac714640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a40aeb40 con 0x7fd2a415fe70 2024-04-26T21:59:41.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.491+0000 7fd2ac714640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4073680 con 0x7fd2a406c2a0 2024-04-26T21:59:41.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.491+0000 7fd2ac714640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a4073f80 con 0x7fd2a4073b10 2024-04-26T21:59:41.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aacb1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a415fe70 0x7fd2a415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aacb1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a415fe70 0x7fd2a415d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50368/0 (socket says 172.21.15.137:50368) 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aacb1640 1 -- 172.21.15.137:0/2454685660 learned_addr learned my addr 172.21.15.137:0/2454685660 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aa4b0640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2a406c2a0 0x7fd2a4141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2a9caf640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2a4073b10 0x7fd2a40b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aacb1640 1 -- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2a4073b10 msgr2=0x7fd2a40b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aacb1640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2a4073b10 0x7fd2a40b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aacb1640 1 -- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2a406c2a0 msgr2=0x7fd2a4141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aacb1640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2a406c2a0 0x7fd2a4141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aacb1640 1 -- 172.21.15.137:0/2454685660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a41421e0 con 0x7fd2a415fe70 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aa4b0640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2a406c2a0 0x7fd2a4141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2a9caf640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2a4073b10 0x7fd2a40b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2aacb1640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a415fe70 0x7fd2a415d8b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00ca80 tx=0x7fd29c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd29affd640 1 -- 172.21.15.137:0/2454685660 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c017070 con 0x7fd2a415fe70 2024-04-26T21:59:41.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd29affd640 1 -- 172.21.15.137:0/2454685660 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c00ac30 con 0x7fd2a415fe70 2024-04-26T21:59:41.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a41424a0 con 0x7fd2a415fe70 2024-04-26T21:59:41.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd29affd640 1 -- 172.21.15.137:0/2454685660 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c012600 con 0x7fd2a415fe70 2024-04-26T21:59:41.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.492+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a4142a60 con 0x7fd2a415fe70 2024-04-26T21:59:41.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.493+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a40b0c40 con 0x7fd2a415fe70 2024-04-26T21:59:41.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.494+0000 7fd29affd640 1 -- 172.21.15.137:0/2454685660 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd29c01a070 con 0x7fd2a415fe70 2024-04-26T21:59:41.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.494+0000 7fd29affd640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd28806c8f0 0x7fd28806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.494+0000 7fd29affd640 1 -- 172.21.15.137:0/2454685660 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd29c08b6e0 con 0x7fd2a415fe70 2024-04-26T21:59:41.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.494+0000 7fd2aa4b0640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd28806c8f0 0x7fd28806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.495+0000 7fd2aa4b0640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd28806c8f0 0x7fd28806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0003eb0 tx=0x7fd2a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:41.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.499+0000 7fd29affd640 1 -- 172.21.15.137:0/2454685660 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd2a40b0c40 con 0x7fd2a415fe70 2024-04-26T21:59:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.744+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd2a406a290 con 0x7fd2a415fe70 2024-04-26T21:59:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.746+0000 7fd29affd640 1 -- 172.21.15.137:0/2454685660 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fd29c00ae20 con 0x7fd2a415fe70 2024-04-26T21:59:41.747 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T21:59:41.747 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ== 2024-04-26T21:59:41.747 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T21:59:41.747 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T21:59:41.747 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T21:59:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T21:59:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd28806c8f0 msgr2=0x7fd28806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd28806c8f0 0x7fd28806edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0003eb0 tx=0x7fd2a0009040 comp rx=0 tx=0).stop 2024-04-26T21:59:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a415fe70 msgr2=0x7fd2a415d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a415fe70 0x7fd2a415d8b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00ca80 tx=0x7fd29c00cf40 comp rx=0 tx=0).stop 2024-04-26T21:59:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 shutdown_connections 2024-04-26T21:59:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd28806c8f0 0x7fd28806edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2a415fe70 0x7fd2a415d8b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2a4073b10 0x7fd2a40b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 --2- 172.21.15.137:0/2454685660 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2a406c2a0 0x7fd2a4141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 >> 172.21.15.137:0/2454685660 conn(0x7fd2a40d1e20 msgr2=0x7fd2a415e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 shutdown_connections 2024-04-26T21:59:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.749+0000 7fd2ac714640 1 -- 172.21.15.137:0/2454685660 wait complete. 2024-04-26T21:59:41.761 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:41.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.857+0000 7f01861f2640 1 Processor -- start 2024-04-26T21:59:41.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.857+0000 7f01861f2640 1 -- start start 2024-04-26T21:59:41.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.858+0000 7f01861f2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f018015f370 0x7f01800cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.858+0000 7f01861f2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01800d3ee0 0x7f01800b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.858+0000 7f01861f2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01800d03a0 con 0x7f018015f750 2024-04-26T21:59:41.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.858+0000 7f01861f2640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f01800b4d10 con 0x7f018015f370 2024-04-26T21:59:41.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.858+0000 7f01861f2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f01800d0680 con 0x7f01800d3ee0 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.858+0000 7f017f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f018015f370 0x7f01800cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.858+0000 7f017effd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f018015f750 0x7f01800d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42200/0 (socket says 172.21.15.137:42200) 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.858+0000 7f017f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f018015f370 0x7f01800cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50382/0 (socket says 172.21.15.137:50382) 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.858+0000 7f017effd640 1 -- 172.21.15.137:0/4265529939 learned_addr learned my addr 172.21.15.137:0/4265529939 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.859+0000 7f017ffff640 1 --2- 172.21.15.137:0/4265529939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01800d3ee0 0x7f01800b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.859+0000 7f017f7fe640 1 -- 172.21.15.137:0/4265529939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01800d3ee0 msgr2=0x7f01800b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.859+0000 7f017f7fe640 1 --2- 172.21.15.137:0/4265529939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01800d3ee0 0x7f01800b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.859+0000 7f017f7fe640 1 -- 172.21.15.137:0/4265529939 >> v1:172.21.15.137:6789/0 conn(0x7f018015f750 legacy=0x7f01800d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.859+0000 7f017f7fe640 1 -- 172.21.15.137:0/4265529939 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01800d0960 con 0x7f018015f370 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.859+0000 7f017e7fc640 1 -- 172.21.15.137:0/4265529939 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223367164 0 0) 0x7f01800d03a0 con 0x7f018015f750 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.859+0000 7f017ffff640 1 --2- 172.21.15.137:0/4265529939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01800d3ee0 0x7f01800b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.859+0000 7f017f7fe640 1 --2- 172.21.15.137:0/4265529939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018015f370 0x7f01800cfd70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f01700097a0 tx=0x7f017002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469fd933b65b726d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f017e7fc640 1 -- 172.21.15.137:0/4265529939 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170037070 con 0x7f018015f370 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f017e7fc640 1 -- 172.21.15.137:0/4265529939 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0170032440 con 0x7f018015f370 2024-04-26T21:59:41.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f017e7fc640 1 -- 172.21.15.137:0/4265529939 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170032810 con 0x7f018015f370 2024-04-26T21:59:41.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f01861f2640 1 -- 172.21.15.137:0/4265529939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018015f370 msgr2=0x7f01800cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f01861f2640 1 --2- 172.21.15.137:0/4265529939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018015f370 0x7f01800cfd70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f01700097a0 tx=0x7f017002a180 comp rx=0 tx=0).stop 2024-04-26T21:59:41.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f01861f2640 1 -- 172.21.15.137:0/4265529939 shutdown_connections 2024-04-26T21:59:41.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f01861f2640 1 --2- 172.21.15.137:0/4265529939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01800d3ee0 0x7f01800b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f01861f2640 1 --2- 172.21.15.137:0/4265529939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f018015f370 0x7f01800cfd70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f01861f2640 1 -- 172.21.15.137:0/4265529939 >> 172.21.15.137:0/4265529939 conn(0x7f018008ec10 msgr2=0x7f018009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:41.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f01861f2640 1 -- 172.21.15.137:0/4265529939 shutdown_connections 2024-04-26T21:59:41.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.860+0000 7f01861f2640 1 -- 172.21.15.137:0/4265529939 wait complete. 2024-04-26T21:59:41.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.861+0000 7f01861f2640 1 Processor -- start 2024-04-26T21:59:41.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.861+0000 7f01861f2640 1 -- start start 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f01861f2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01800d3ee0 0x7f01800cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f01861f2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f018015f370 0x7f01800ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f01861f2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f018015f750 0x7f01800cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f01861f2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01800b51c0 con 0x7f01800d3ee0 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f01861f2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01800d0f20 con 0x7f018015f370 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f01861f2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f01800b5340 con 0x7f018015f750 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01800d3ee0 0x7f01800cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01800d3ee0 0x7f01800cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50390/0 (socket says 172.21.15.137:50390) 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017f7fe640 1 -- 172.21.15.137:0/1195236998 learned_addr learned my addr 172.21.15.137:0/1195236998 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017effd640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f018015f370 0x7f01800ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017f7fe640 1 -- 172.21.15.137:0/1195236998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f018015f750 msgr2=0x7f01800cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017ffff640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f018015f750 0x7f01800cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017f7fe640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f018015f750 0x7f01800cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017f7fe640 1 -- 172.21.15.137:0/1195236998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f018015f370 msgr2=0x7f01800ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:41.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017f7fe640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f018015f370 0x7f01800ce720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:41.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.862+0000 7f017f7fe640 1 -- 172.21.15.137:0/1195236998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01801627c0 con 0x7f01800d3ee0 2024-04-26T21:59:41.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.863+0000 7f017f7fe640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01800d3ee0 0x7f01800cb560 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f01700097a0 tx=0x7f01700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:41.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.863+0000 7f0167fff640 1 -- 172.21.15.137:0/1195236998 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170037050 con 0x7f01800d3ee0 2024-04-26T21:59:41.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.863+0000 7f0167fff640 1 -- 172.21.15.137:0/1195236998 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0170038040 con 0x7f01800d3ee0 2024-04-26T21:59:41.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.863+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0180162aa0 con 0x7f01800d3ee0 2024-04-26T21:59:41.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.863+0000 7f0167fff640 1 -- 172.21.15.137:0/1195236998 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170004490 con 0x7f01800d3ee0 2024-04-26T21:59:41.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.863+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01800c90a0 con 0x7f01800d3ee0 2024-04-26T21:59:41.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.864+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018006a290 con 0x7f01800d3ee0 2024-04-26T21:59:41.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.864+0000 7f0167fff640 1 -- 172.21.15.137:0/1195236998 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0170030980 con 0x7f01800d3ee0 2024-04-26T21:59:41.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.865+0000 7f0167fff640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f016c06c8f0 0x7f016c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:41.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.865+0000 7f0167fff640 1 -- 172.21.15.137:0/1195236998 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f01700ac7a0 con 0x7f01800d3ee0 2024-04-26T21:59:41.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.865+0000 7f017effd640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f016c06c8f0 0x7f016c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:41.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.865+0000 7f017effd640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f016c06c8f0 0x7f016c06edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f018006e9c0 tx=0x7f0174009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:41.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:41.869+0000 7f0167fff640 1 -- 172.21.15.137:0/1195236998 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f017007abd0 con 0x7f01800d3ee0 2024-04-26T21:59:42.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.080+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0180075fb0 con 0x7f01800d3ee0 2024-04-26T21:59:42.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.081+0000 7f0167fff640 1 -- 172.21.15.137:0/1195236998 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f017007a4d0 con 0x7f01800d3ee0 2024-04-26T21:59:42.081 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:42.081 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3532925157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3532925157},{"type":"v1","addr":"172.21.15.137:6836","nonce":3532925157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3509631448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3509631448},{"type":"v1","addr":"172.21.15.170:6834","nonce":3509631448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3228449407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3228449407},{"type":"v1","addr":"172.21.15.170:6835","nonce":3228449407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:59:33.028489+0000","modified":"2024-04-26T21:59:35.023196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1394398285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1394398285},{"type":"v1","addr":"172.21.15.137:6837","nonce":1394398285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5139,"qdb_cluster":[5139]},"id":2}]} 2024-04-26T21:59:42.081 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-04-26T21:59:42.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.082+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f016c06c8f0 msgr2=0x7f016c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.082+0000 7f01861f2640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f016c06c8f0 0x7f016c06edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f018006e9c0 tx=0x7f0174009040 comp rx=0 tx=0).stop 2024-04-26T21:59:42.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01800d3ee0 msgr2=0x7f01800cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01800d3ee0 0x7f01800cb560 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f01700097a0 tx=0x7f01700046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 shutdown_connections 2024-04-26T21:59:42.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f016c06c8f0 0x7f016c06edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f018015f750 0x7f01800cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f018015f370 0x7f01800ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 --2- 172.21.15.137:0/1195236998 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01800d3ee0 0x7f01800cb560 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 >> 172.21.15.137:0/1195236998 conn(0x7f018008ec10 msgr2=0x7f018006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:42.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 shutdown_connections 2024-04-26T21:59:42.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.083+0000 7f01861f2640 1 -- 172.21.15.137:0/1195236998 wait complete. 2024-04-26T21:59:42.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T21:59:33.028489+0000', 'modified': '2024-04-26T21:59:35.023196+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5139}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5139': {'gid': 5139, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6837/1394398285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 1394398285}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 1394398285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5139, 'qdb_cluster': [5139]} 2024-04-26T21:59:42.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T21:59:42.497 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T21:59:42.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.596+0000 7fac6419e640 1 Processor -- start 2024-04-26T21:59:42.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.597+0000 7fac6419e640 1 -- start start 2024-04-26T21:59:42.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.597+0000 7fac6419e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fac5c148a30 0x7fac5c073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.597+0000 7fac6419e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fac5c0b3af0 0x7fac5c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.597+0000 7fac6419e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c0cfa80 con 0x7fac5c160640 2024-04-26T21:59:42.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.597+0000 7fac6419e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c0cfd60 con 0x7fac5c0b3af0 2024-04-26T21:59:42.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.597+0000 7fac6419e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c0d0040 con 0x7fac5c148a30 2024-04-26T21:59:42.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac6273b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fac5c0b3af0 0x7fac5c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac61739640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fac5c160640 0x7fac5c1636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42206/0 (socket says 172.21.15.137:42206) 2024-04-26T21:59:42.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac61739640 1 -- 172.21.15.137:0/1831518753 learned_addr learned my addr 172.21.15.137:0/1831518753 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:42.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac61f3a640 1 --2- 172.21.15.137:0/1831518753 >> v2:172.21.15.170:3300/0 conn(0x7fac5c148a30 0x7fac5c073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac6273b640 1 -- 172.21.15.137:0/1831518753 >> v2:172.21.15.170:3300/0 conn(0x7fac5c148a30 msgr2=0x7fac5c073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:42.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac6273b640 1 --2- 172.21.15.137:0/1831518753 >> v2:172.21.15.170:3300/0 conn(0x7fac5c148a30 0x7fac5c073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac6273b640 1 -- 172.21.15.137:0/1831518753 >> v1:172.21.15.137:6789/0 conn(0x7fac5c160640 legacy=0x7fac5c1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac6273b640 1 -- 172.21.15.137:0/1831518753 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c162ea0 con 0x7fac5c0b3af0 2024-04-26T21:59:42.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac60f38640 1 -- 172.21.15.137:0/1831518753 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843216330 0 0) 0x7fac5c0cfa80 con 0x7fac5c160640 2024-04-26T21:59:42.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.598+0000 7fac6273b640 1 --2- 172.21.15.137:0/1831518753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0b3af0 0x7fac5c0b3fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0cf6d0 tx=0x7fac5402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4b6193ccb95dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac60f38640 1 -- 172.21.15.137:0/1831518753 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54037070 con 0x7fac5c0b3af0 2024-04-26T21:59:42.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac60f38640 1 -- 172.21.15.137:0/1831518753 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac54032440 con 0x7fac5c0b3af0 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac60f38640 1 -- 172.21.15.137:0/1831518753 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54032810 con 0x7fac5c0b3af0 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac6419e640 1 -- 172.21.15.137:0/1831518753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0b3af0 msgr2=0x7fac5c0b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac6419e640 1 --2- 172.21.15.137:0/1831518753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0b3af0 0x7fac5c0b3fa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0cf6d0 tx=0x7fac5402a130 comp rx=0 tx=0).stop 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac6419e640 1 -- 172.21.15.137:0/1831518753 shutdown_connections 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac6419e640 1 --2- 172.21.15.137:0/1831518753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0b3af0 0x7fac5c0b3fa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac6419e640 1 --2- 172.21.15.137:0/1831518753 >> v2:172.21.15.170:3300/0 conn(0x7fac5c148a30 0x7fac5c073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac6419e640 1 -- 172.21.15.137:0/1831518753 >> 172.21.15.137:0/1831518753 conn(0x7fac5c0ce8b0 msgr2=0x7fac5c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac6419e640 1 -- 172.21.15.137:0/1831518753 shutdown_connections 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.599+0000 7fac6419e640 1 -- 172.21.15.137:0/1831518753 wait complete. 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.600+0000 7fac6419e640 1 Processor -- start 2024-04-26T21:59:42.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.600+0000 7fac6419e640 1 -- start start 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac6419e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b3af0 0x7fac5c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac6419e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c148a30 0x7fac5c147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac6419e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c160640 0x7fac5c15e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac6419e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c074410 con 0x7fac5c148a30 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac6419e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c163db0 con 0x7fac5c160640 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac6419e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c074590 con 0x7fac5c0b3af0 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac61739640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c148a30 0x7fac5c147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac61739640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c148a30 0x7fac5c147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50406/0 (socket says 172.21.15.137:50406) 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac61739640 1 -- 172.21.15.137:0/2528819252 learned_addr learned my addr 172.21.15.137:0/2528819252 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:42.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac6273b640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c160640 0x7fac5c15e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac61f3a640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b3af0 0x7fac5c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.601+0000 7fac61739640 1 -- 172.21.15.137:0/2528819252 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b3af0 msgr2=0x7fac5c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac61739640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b3af0 0x7fac5c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac61739640 1 -- 172.21.15.137:0/2528819252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c160640 msgr2=0x7fac5c15e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac61739640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c160640 0x7fac5c15e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac61739640 1 -- 172.21.15.137:0/2528819252 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c148240 con 0x7fac5c148a30 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac6273b640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c160640 0x7fac5c15e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac61739640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c148a30 0x7fac5c147d00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c440 tx=0x7fac4c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac527fc640 1 -- 172.21.15.137:0/2528819252 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c018070 con 0x7fac5c148a30 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac527fc640 1 -- 172.21.15.137:0/2528819252 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c0074e0 con 0x7fac5c148a30 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac6419e640 1 -- 172.21.15.137:0/2528819252 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c0aee90 con 0x7fac5c148a30 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac527fc640 1 -- 172.21.15.137:0/2528819252 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c007690 con 0x7fac5c148a30 2024-04-26T21:59:42.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.602+0000 7fac6419e640 1 -- 172.21.15.137:0/2528819252 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c0af450 con 0x7fac5c148a30 2024-04-26T21:59:42.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.603+0000 7fac527fc640 1 -- 172.21.15.137:0/2528819252 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac4c01b070 con 0x7fac5c148a30 2024-04-26T21:59:42.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.604+0000 7fac527fc640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4006c8f0 0x7fac4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.604+0000 7fac527fc640 1 -- 172.21.15.137:0/2528819252 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fac4c08ae00 con 0x7fac5c148a30 2024-04-26T21:59:42.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.604+0000 7fac61f3a640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4006c8f0 0x7fac4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.604+0000 7fac61f3a640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4006c8f0 0x7fac4006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fac580074a0 tx=0x7fac5800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.605+0000 7fac66f8a740 1 Processor -- start 2024-04-26T21:59:42.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.605+0000 7fac66f8a740 1 -- start start 2024-04-26T21:59:42.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.605+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999c8440 0x55a3999c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.605+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999e5ce0 0x55a3999e6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.605+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a39999e120 0x55a3999e43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.605+0000 7fac66f8a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a399902740 con 0x55a39999e120 2024-04-26T21:59:42.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.605+0000 7fac66f8a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a39989e3a0 con 0x55a3999e5ce0 2024-04-26T21:59:42.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.605+0000 7fac66f8a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a3998fe700 con 0x55a3999c8440 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac6273b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a39999e120 0x55a3999e43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac6273b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a39999e120 0x55a3999e43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50420/0 (socket says 172.21.15.137:50420) 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac6273b640 1 -- 172.21.15.137:0/4116132212 learned_addr learned my addr 172.21.15.137:0/4116132212 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac61f3a640 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999c8440 0x55a3999c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac61739640 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999e5ce0 0x55a3999e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac6273b640 1 -- 172.21.15.137:0/4116132212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999c8440 msgr2=0x55a3999c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac6273b640 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999c8440 0x55a3999c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac6273b640 1 -- 172.21.15.137:0/4116132212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999e5ce0 msgr2=0x55a3999e6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac6273b640 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999e5ce0 0x55a3999e6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac6273b640 1 -- 172.21.15.137:0/4116132212 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3998ba750 con 0x55a39999e120 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac61739640 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999e5ce0 0x55a3999e6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac6273b640 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a39999e120 0x55a3999e43a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fac54009890 tx=0x7fac5402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cba722d16535d4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac3f7fe640 1 -- 172.21.15.137:0/4116132212 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54037040 con 0x55a39999e120 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac3f7fe640 1 -- 172.21.15.137:0/4116132212 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac54032740 con 0x55a39999e120 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.606+0000 7fac3f7fe640 1 -- 172.21.15.137:0/4116132212 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54032af0 con 0x55a39999e120 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 -- 172.21.15.137:0/4116132212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a39999e120 msgr2=0x55a3999e43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a39999e120 0x55a3999e43a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fac54009890 tx=0x7fac5402c000 comp rx=0 tx=0).stop 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 -- 172.21.15.137:0/4116132212 shutdown_connections 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a39999e120 0x55a3999e43a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999e5ce0 0x55a3999e6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 --2- 172.21.15.137:0/4116132212 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999c8440 0x55a3999c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 -- 172.21.15.137:0/4116132212 >> 172.21.15.137:0/4116132212 conn(0x55a39999aa50 msgr2=0x55a3999e3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 -- 172.21.15.137:0/4116132212 shutdown_connections 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 -- 172.21.15.137:0/4116132212 wait complete. 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.607+0000 7fac66f8a740 1 -- start start 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.608+0000 7fac66f8a740 1 Processor -- start 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.608+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999c8440 0x55a3999f6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.608+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999e5ce0 0x55a3999da300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.608+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999f3e30 0x55a3999de040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.608+0000 7fac66f8a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a39999eec0 con 0x55a3999e5ce0 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.608+0000 7fac66f8a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a399889fe0 con 0x55a3999f3e30 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.608+0000 7fac66f8a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a399998980 con 0x55a3999c8440 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 10 client.0 _ll_register_callbacks cb 0x55a3998a0150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac61739640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999e5ce0 0x55a3999da300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac61739640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999e5ce0 0x55a3999da300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50426/0 (socket says 172.21.15.137:50426) 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac61739640 1 -- 172.21.15.137:0/2530489394 learned_addr learned my addr 172.21.15.137:0/2530489394 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac6273b640 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999f3e30 0x55a3999de040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac61739640 1 -- 172.21.15.137:0/2530489394 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999c8440 msgr2=0x55a3999f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac61739640 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999c8440 0x55a3999f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac61739640 1 -- 172.21.15.137:0/2530489394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999f3e30 msgr2=0x55a3999de040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:42.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac61739640 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999f3e30 0x55a3999de040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac61739640 1 -- 172.21.15.137:0/2530489394 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3996142d0 con 0x55a3999e5ce0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac61739640 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999e5ce0 0x55a3999da300 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fac4c058790 tx=0x7fac4c05ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169df6ebdf047d12 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac3cff9640 1 -- 172.21.15.137:0/2530489394 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c05f2c0 con 0x55a3999e5ce0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac3cff9640 1 -- 172.21.15.137:0/2530489394 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fac4c057ee0 con 0x55a3999e5ce0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 1 -- 172.21.15.137:0/2530489394 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac54032740 con 0x55a3999e5ce0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac3cff9640 1 -- 172.21.15.137:0/2530489394 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fac4c087050 con 0x55a3999e5ce0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 10 client.5346 fetch_fsmap learned FSMap version 14 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 1 -- 172.21.15.137:0/2530489394 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55a3996de6b0 con 0x55a3999e5ce0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac3cff9640 1 -- 172.21.15.137:0/2530489394 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac54032740 con 0x55a3999e5ce0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac3cff9640 1 -- 172.21.15.137:0/2530489394 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7fac4c0547e0 con 0x55a3999e5ce0 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 10 client.5346 fetch_fsmap finished waiting for FSMap version 14 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 10 client.5346 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 20 client.5346 populate_metadata read hostname 'smithi137' 2024-04-26T21:59:42.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] conn(0x55a3999dc080 0x55a3999dc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 4 client.5346 mds_command: new command op to 5139 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.609+0000 7fac66f8a740 1 -- 172.21.15.137:0/2530489394 --> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a399910350 con 0x55a3999dc080 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.610+0000 7fac61f3a640 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] conn(0x55a3999dc080 0x55a3999dc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.610+0000 7fac3cff9640 10 client.5346 ms_handle_connect on v2:172.21.15.137:6834/1394398285 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.610+0000 7fac61f3a640 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] conn(0x55a3999dc080 0x55a3999dc460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daf26deed8588529 server_cookie=dade759a9a7fc0cd in_seq=0 out_seq=0 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.610+0000 7fac3cff9640 1 -- 172.21.15.137:0/2530489394 <== mds.0 v2:172.21.15.137:6834/1394398285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a399910350 con 0x55a3999dc080 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.610+0000 7fac3cff9640 10 client.5346 handle_command_reply: tid=0 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.610+0000 7fac66f8a740 1 client.5346 shutdown 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 -- 172.21.15.137:0/2530489394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999e5ce0 msgr2=0x55a3999da300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999e5ce0 0x55a3999da300 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fac4c058790 tx=0x7fac4c05ce40 comp rx=0 tx=0).stop 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 -- 172.21.15.137:0/2530489394 shutdown_connections 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] conn(0x55a3999dc080 0x55a3999dc460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999e5ce0 0x55a3999da300 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac3cff9640 0 client.5346 ms_handle_reset on v2:172.21.15.137:6834/1394398285 2024-04-26T21:59:42.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999f3e30 0x55a3999de040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 --2- 172.21.15.137:0/2530489394 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999c8440 0x55a3999f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 -- 172.21.15.137:0/2530489394 >> 172.21.15.137:0/2530489394 conn(0x55a39999e120 msgr2=0x55a3999e7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:42.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 -- 172.21.15.137:0/2530489394 shutdown_connections 2024-04-26T21:59:42.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 1 -- 172.21.15.137:0/2530489394 wait complete. 2024-04-26T21:59:42.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.611+0000 7fac66f8a740 20 client.5346 trim_cache size 0 max 16384 2024-04-26T21:59:42.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.629+0000 7fac66f8a740 1 Processor -- start 2024-04-26T21:59:42.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.629+0000 7fac66f8a740 1 -- start start 2024-04-26T21:59:42.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.629+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999c8440 0x55a3999dc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.629+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999e5ce0 0x55a3999f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.629+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999f3e30 0x55a3999f3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.629+0000 7fac66f8a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0b6b00 con 0x55a3999c8440 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.629+0000 7fac66f8a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c146bc0 con 0x55a3999f3e30 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.629+0000 7fac66f8a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c0b64b0 con 0x55a3999e5ce0 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac61f3a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999c8440 0x55a3999dc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac61f3a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999c8440 0x55a3999dc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50432/0 (socket says 172.21.15.137:50432) 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac61f3a640 1 -- 172.21.15.137:0/710500222 learned_addr learned my addr 172.21.15.137:0/710500222 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac61f3a640 1 -- 172.21.15.137:0/710500222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999e5ce0 msgr2=0x55a3999f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac61f3a640 1 --2- 172.21.15.137:0/710500222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999e5ce0 0x55a3999f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac61f3a640 1 -- 172.21.15.137:0/710500222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999f3e30 msgr2=0x55a3999f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac61f3a640 1 --2- 172.21.15.137:0/710500222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999f3e30 0x55a3999f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac61f3a640 1 -- 172.21.15.137:0/710500222 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3999c8d20 con 0x55a3999c8440 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac61f3a640 1 --2- 172.21.15.137:0/710500222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999c8440 0x55a3999dc4f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55a3999cc820 tx=0x7fac58014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b0704470743898 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac3effd640 1 -- 172.21.15.137:0/710500222 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5801d040 con 0x55a3999c8440 2024-04-26T21:59:42.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac3effd640 1 -- 172.21.15.137:0/710500222 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5802c070 con 0x55a3999c8440 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.630+0000 7fac3effd640 1 -- 172.21.15.137:0/710500222 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58027360 con 0x55a3999c8440 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 -- 172.21.15.137:0/710500222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999c8440 msgr2=0x55a3999dc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 --2- 172.21.15.137:0/710500222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999c8440 0x55a3999dc4f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55a3999cc820 tx=0x7fac58014000 comp rx=0 tx=0).stop 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 -- 172.21.15.137:0/710500222 shutdown_connections 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 --2- 172.21.15.137:0/710500222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999f3e30 0x55a3999f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 --2- 172.21.15.137:0/710500222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999e5ce0 0x55a3999f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 --2- 172.21.15.137:0/710500222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999c8440 0x55a3999dc4f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 -- 172.21.15.137:0/710500222 >> 172.21.15.137:0/710500222 conn(0x55a39999e120 msgr2=0x55a39999d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 -- 172.21.15.137:0/710500222 shutdown_connections 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 -- 172.21.15.137:0/710500222 wait complete. 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 -- start start 2024-04-26T21:59:42.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.631+0000 7fac66f8a740 1 Processor -- start 2024-04-26T21:59:42.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999c8440 0x55a3999f0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999e5ce0 0x55a3999c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac66f8a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999f3e30 0x55a399997670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac66f8a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a3999c5e80 con 0x55a3999f3e30 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac66f8a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a3999ddb80 con 0x55a3999c8440 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac66f8a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a3999ca9d0 con 0x55a3999e5ce0 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac66f8a740 10 client.0 _ll_register_callbacks cb 0x7fac4c059220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac6273b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999f3e30 0x55a399997670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac6273b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999f3e30 0x55a399997670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50438/0 (socket says 172.21.15.137:50438) 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac6273b640 1 -- 172.21.15.137:0/1981924912 learned_addr learned my addr 172.21.15.137:0/1981924912 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac61f3a640 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999c8440 0x55a3999f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.632+0000 7fac61739640 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999e5ce0 0x55a3999c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac6273b640 1 -- 172.21.15.137:0/1981924912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999e5ce0 msgr2=0x55a3999c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac6273b640 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999e5ce0 0x55a3999c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac6273b640 1 -- 172.21.15.137:0/1981924912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999c8440 msgr2=0x55a3999f0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac6273b640 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999c8440 0x55a3999f0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac6273b640 1 -- 172.21.15.137:0/1981924912 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3999dca30 con 0x55a3999f3e30 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac61f3a640 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999c8440 0x55a3999f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac6273b640 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999f3e30 0x55a399997670 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac5402a170 tx=0x7fac540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112281e71c731500 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac3cff9640 1 -- 172.21.15.137:0/1981924912 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54037040 con 0x55a3999f3e30 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac3cff9640 1 -- 172.21.15.137:0/1981924912 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fac54003a20 con 0x55a3999f3e30 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac66f8a740 1 -- 172.21.15.137:0/1981924912 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac5802c070 con 0x55a3999f3e30 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac3cff9640 1 -- 172.21.15.137:0/1981924912 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fac54054050 con 0x55a3999f3e30 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac66f8a740 10 client.5352 fetch_fsmap learned FSMap version 14 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac66f8a740 1 -- 172.21.15.137:0/1981924912 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55a3999efe40 con 0x55a3999f3e30 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac3cff9640 1 -- 172.21.15.137:0/1981924912 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5802c070 con 0x55a3999f3e30 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac3cff9640 1 -- 172.21.15.137:0/1981924912 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7fac54057020 con 0x55a3999f3e30 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac66f8a740 10 client.5352 fetch_fsmap finished waiting for FSMap version 14 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac66f8a740 10 client.5352 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T21:59:42.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac66f8a740 20 client.5352 populate_metadata read hostname 'smithi137' 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac66f8a740 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] conn(0x55a399997bb0 0x55a3999dac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac66f8a740 4 client.5352 mds_command: new command op to 5139 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac66f8a740 1 -- 172.21.15.137:0/1981924912 --> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] -- command(tid 0: {"prefix": "status"}) -- 0x55a39990a1c0 con 0x55a399997bb0 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.633+0000 7fac61f3a640 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] conn(0x55a399997bb0 0x55a3999dac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac3cff9640 10 client.5352 ms_handle_connect on v2:172.21.15.137:6834/1394398285 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac61f3a640 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] conn(0x55a399997bb0 0x55a3999dac80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faf96dc9af4bedf7 server_cookie=b85a1e6de7a1e016 in_seq=0 out_seq=0 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac3cff9640 1 -- 172.21.15.137:0/1981924912 <== mds.0 v2:172.21.15.137:6834/1394398285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a39990a1c0 con 0x55a399997bb0 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac3cff9640 10 client.5352 handle_command_reply: tid=0 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 client.5352 shutdown 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 -- 172.21.15.137:0/1981924912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999f3e30 msgr2=0x55a399997670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999f3e30 0x55a399997670 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac5402a170 tx=0x7fac540046c0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 -- 172.21.15.137:0/1981924912 shutdown_connections 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.137:6834/1394398285,v1:172.21.15.137:6837/1394398285] conn(0x55a399997bb0 0x55a3999dac80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3999f3e30 0x55a399997670 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3999e5ce0 0x55a3999c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac3cff9640 0 client.5352 ms_handle_reset on v2:172.21.15.137:6834/1394398285 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 --2- 172.21.15.137:0/1981924912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3999c8440 0x55a3999f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 -- 172.21.15.137:0/1981924912 >> 172.21.15.137:0/1981924912 conn(0x55a39999e120 msgr2=0x55a3999f6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 -- 172.21.15.137:0/1981924912 shutdown_connections 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 1 -- 172.21.15.137:0/1981924912 wait complete. 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.634+0000 7fac66f8a740 20 client.5352 trim_cache size 0 max 16384 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T21:59:42.641 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 5139, 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 8.9543241009999992, 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 14, 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 34, 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 34, 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 15.846447359000001 2024-04-26T21:59:42.642 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T21:59:42.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 -- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4006c8f0 msgr2=0x7fac4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4006c8f0 0x7fac4006edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fac580074a0 tx=0x7fac5800b040 comp rx=0 tx=0).stop 2024-04-26T21:59:42.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 -- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c148a30 msgr2=0x7fac5c147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c148a30 0x7fac5c147d00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00c440 tx=0x7fac4c00c900 comp rx=0 tx=0).stop 2024-04-26T21:59:42.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 -- 172.21.15.137:0/2528819252 shutdown_connections 2024-04-26T21:59:42.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4006c8f0 0x7fac4006edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c148a30 0x7fac5c147d00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c160640 0x7fac5c15e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 --2- 172.21.15.137:0/2528819252 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b3af0 0x7fac5c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 -- 172.21.15.137:0/2528819252 >> 172.21.15.137:0/2528819252 conn(0x7fac5c0ce8b0 msgr2=0x7fac5c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:42.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 -- 172.21.15.137:0/2528819252 shutdown_connections 2024-04-26T21:59:42.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.635+0000 7fac6419e640 1 -- 172.21.15.137:0/2528819252 wait complete. 2024-04-26T21:59:42.646 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T21:59:42.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.743+0000 7f9f3221d640 1 Processor -- start 2024-04-26T21:59:42.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.743+0000 7f9f3221d640 1 -- start start 2024-04-26T21:59:42.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.743+0000 7f9f3221d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9f2c160640 0x7f9f2c1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.743+0000 7f9f3221d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2c0cfa80 con 0x7f9f2c148a30 2024-04-26T21:59:42.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.743+0000 7f9f3221d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2c0cfd60 con 0x7f9f2c163be0 2024-04-26T21:59:42.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.743+0000 7f9f3221d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9f2c0745e0 con 0x7f9f2c160640 2024-04-26T21:59:42.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.744+0000 7f9f2b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9f2c148a30 0x7f9f2c073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42222/0 (socket says 172.21.15.137:42222) 2024-04-26T21:59:42.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.744+0000 7f9f2b7fe640 1 -- 172.21.15.137:0/190934324 learned_addr learned my addr 172.21.15.137:0/190934324 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:42.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.744+0000 7f9f2affd640 1 --2- 172.21.15.137:0/190934324 >> v2:172.21.15.170:3300/0 conn(0x7f9f2c160640 0x7f9f2c1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.744+0000 7f9f2a7fc640 1 -- 172.21.15.137:0/190934324 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285547029 0 0) 0x7f9f2c0cfa80 con 0x7f9f2c148a30 2024-04-26T21:59:42.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.744+0000 7f9f2a7fc640 1 -- 172.21.15.137:0/190934324 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f14003520 con 0x7f9f2c148a30 2024-04-26T21:59:42.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.744+0000 7f9f2a7fc640 1 -- 172.21.15.137:0/190934324 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1450096841 0 0) 0x7f9f14003520 con 0x7f9f2c148a30 2024-04-26T21:59:42.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.744+0000 7f9f2affd640 1 -- 172.21.15.137:0/190934324 >> v1:172.21.15.170:6789/0 conn(0x7f9f2c163be0 legacy=0x7f9f2c0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.744+0000 7f9f2affd640 1 -- 172.21.15.137:0/190934324 >> v1:172.21.15.137:6789/0 conn(0x7f9f2c148a30 legacy=0x7f9f2c073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.744+0000 7f9f2affd640 1 -- 172.21.15.137:0/190934324 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c0d0040 con 0x7f9f2c160640 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.745+0000 7f9f2affd640 1 --2- 172.21.15.137:0/190934324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2c160640 0x7f9f2c1636a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f200097a0 tx=0x7f9f2002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d69907ce573e59ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.745+0000 7f9f2a7fc640 1 -- 172.21.15.137:0/190934324 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f20037070 con 0x7f9f2c160640 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.745+0000 7f9f2a7fc640 1 -- 172.21.15.137:0/190934324 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f2002abc0 con 0x7f9f2c160640 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.745+0000 7f9f2a7fc640 1 -- 172.21.15.137:0/190934324 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c001670 con 0x7f9f2c160640 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.746+0000 7f9f3221d640 1 -- 172.21.15.137:0/190934324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2c160640 msgr2=0x7f9f2c1636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.746+0000 7f9f3221d640 1 --2- 172.21.15.137:0/190934324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2c160640 0x7f9f2c1636a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9f200097a0 tx=0x7f9f2002a130 comp rx=0 tx=0).stop 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.746+0000 7f9f3221d640 1 -- 172.21.15.137:0/190934324 shutdown_connections 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.746+0000 7f9f3221d640 1 --2- 172.21.15.137:0/190934324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2c160640 0x7f9f2c1636a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.746+0000 7f9f3221d640 1 -- 172.21.15.137:0/190934324 >> 172.21.15.137:0/190934324 conn(0x7f9f2c0ce8b0 msgr2=0x7f9f2c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.746+0000 7f9f3221d640 1 -- 172.21.15.137:0/190934324 shutdown_connections 2024-04-26T21:59:42.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.746+0000 7f9f3221d640 1 -- 172.21.15.137:0/190934324 wait complete. 2024-04-26T21:59:42.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.747+0000 7f9f3221d640 1 Processor -- start 2024-04-26T21:59:42.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.747+0000 7f9f3221d640 1 -- start start 2024-04-26T21:59:42.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f3221d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f2c148a30 0x7f9f2c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f3221d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2c160640 0x7f9f2c0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f3221d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f2c163be0 0x7f9f2c0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f3221d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c148e10 con 0x7f9f2c148a30 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f3221d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c163180 con 0x7f9f2c160640 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f3221d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9f2c148f90 con 0x7f9f2c163be0 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f2c148a30 0x7f9f2c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f2c148a30 0x7f9f2c15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50444/0 (socket says 172.21.15.137:50444) 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2b7fe640 1 -- 172.21.15.137:0/2394172853 learned_addr learned my addr 172.21.15.137:0/2394172853 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2affd640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2c160640 0x7f9f2c0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2b7fe640 1 -- 172.21.15.137:0/2394172853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f2c163be0 msgr2=0x7f9f2c0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2bfff640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f2c163be0 0x7f9f2c0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2b7fe640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f2c163be0 0x7f9f2c0c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2b7fe640 1 -- 172.21.15.137:0/2394172853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2c160640 msgr2=0x7f9f2c0c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2b7fe640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2c160640 0x7f9f2c0c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2b7fe640 1 -- 172.21.15.137:0/2394172853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c0b17c0 con 0x7f9f2c148a30 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f2b7fe640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f2c148a30 0x7f9f2c15eb10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c750 tx=0x7f9f1c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f13fff640 1 -- 172.21.15.137:0/2394172853 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c017070 con 0x7f9f2c148a30 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f13fff640 1 -- 172.21.15.137:0/2394172853 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1c005ad0 con 0x7f9f2c148a30 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.748+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c0b14e0 con 0x7f9f2c148a30 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.749+0000 7f9f13fff640 1 -- 172.21.15.137:0/2394172853 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c007070 con 0x7f9f2c148a30 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.749+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c0b5c40 con 0x7f9f2c148a30 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.749+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2c06a290 con 0x7f9f2c148a30 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.750+0000 7f9f13fff640 1 -- 172.21.15.137:0/2394172853 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f1c01a070 con 0x7f9f2c148a30 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.750+0000 7f9f13fff640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1806c8f0 0x7f9f1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.750+0000 7f9f13fff640 1 -- 172.21.15.137:0/2394172853 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9f1c08b140 con 0x7f9f2c148a30 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.750+0000 7f9f2affd640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1806c8f0 0x7f9f1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:42.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.751+0000 7f9f2affd640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1806c8f0 0x7f9f1806edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f20034000 tx=0x7f9f2002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:42.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.754+0000 7f9f13fff640 1 -- 172.21.15.137:0/2394172853 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9f1c0594f0 con 0x7f9f2c148a30 2024-04-26T21:59:42.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:59:42.849 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T21:59:42.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.970+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9f2c074000 con 0x7f9f2c148a30 2024-04-26T21:59:42.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.970+0000 7f9f13fff640 1 -- 172.21.15.137:0/2394172853 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f9f1c058df0 con 0x7f9f2c148a30 2024-04-26T21:59:42.970 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T21:59:42.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1806c8f0 msgr2=0x7f9f1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1806c8f0 0x7f9f1806edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f20034000 tx=0x7f9f2002e000 comp rx=0 tx=0).stop 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f2c148a30 msgr2=0x7f9f2c15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f2c148a30 0x7f9f2c15eb10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00c750 tx=0x7f9f1c00cc10 comp rx=0 tx=0).stop 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 shutdown_connections 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1806c8f0 0x7f9f1806edb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f2c163be0 0x7f9f2c0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f2c160640 0x7f9f2c0c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 --2- 172.21.15.137:0/2394172853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f2c148a30 0x7f9f2c15eb10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 >> 172.21.15.137:0/2394172853 conn(0x7f9f2c0ce8b0 msgr2=0x7f9f2c1621a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 shutdown_connections 2024-04-26T21:59:42.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:42.972+0000 7f9f3221d640 1 -- 172.21.15.137:0/2394172853 wait complete. 2024-04-26T21:59:42.983 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T21:59:42.983 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T21:59:42.983 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T21:59:42.983 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T21:59:42.983 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T21:59:42.983 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T21:59:42.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T21:59:42.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T21:59:42.983 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:59:42.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:42.984 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T21:59:42.999 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42723sec preferred_lft 42723sec 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T21:59:43.000 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T21:59:43.001 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T21:59:43.001 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:43.001 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T21:59:43.001 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T21:59:43.001 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T21:59:43.001 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T21:59:43.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.001 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T21:59:43.061 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T21:59:43.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.062 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T21:59:43.117 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T21:59:43.117 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T21:59:43.117 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T21:59:43.117 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T21:59:43.117 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T21:59:43.118 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T21:59:43.118 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T21:59:43.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T21:59:43.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T21:59:43.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T21:59:43.118 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T21:59:43.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T21:59:43.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:43.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.241 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T21:59:43.255 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T21:59:43.256 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T21:59:43.256 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:59:43.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T21:59:43.319 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:59:43.319 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T21:59:43.373 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T21:59:43.373 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T21:59:43.373 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:59:43.428 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T21:59:43.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.428 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:43.508 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:43.509 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:59:43.515 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T21:59:43.516 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T21:59:43.516 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T21:59:43.516 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T21:59:43.516 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T21:59:43.516 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T21:59:43.516 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T21:59:43.516 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T21:59:43.516 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T21:59:43.517 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T21:59:43.518 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T21:59:43.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T21:59:43.583 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T21:59:43.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T21:59:43.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:43.682 INFO:teuthology.orchestra.run.smithi137.stdout:client5361 2024-04-26T21:59:43.682 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:43.682 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:43.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.697 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-04-26T21:59:43.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.757 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-04-26T21:59:43.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.813 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-04-26T21:59:43.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.869 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-04-26T21:59:43.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.927 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-04-26T21:59:43.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:43.982 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-26T21:59:44.040 INFO:teuthology.orchestra.run.smithi137.stdout:./ 2024-04-26T21:59:44.041 INFO:teuthology.orchestra.run.smithi137.stdout:./rfile 2024-04-26T21:59:44.041 INFO:teuthology.orchestra.run.smithi137.stdout:./parentdir 2024-04-26T21:59:44.041 INFO:teuthology.orchestra.run.smithi137.stdout:./parentdir/pfile 2024-04-26T21:59:44.041 INFO:teuthology.orchestra.run.smithi137.stdout:./parentdir/childdir 2024-04-26T21:59:44.041 INFO:teuthology.orchestra.run.smithi137.stdout:./parentdir/childdir/cfile 2024-04-26T21:59:44.042 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T21:59:44.042 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T21:59:44.042 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T21:59:44.042 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T21:59:44.042 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-26T21:59:44.042 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T21:59:44.145 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T21:59:44.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:44.154 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T21:59:44.154 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T21:59:44.154 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T21:59:44.155 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T21:59:44.155 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-04-26T21:59:44.155 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T21:59:44.259 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627778 2024-04-26T21:59:44.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:44.268 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T21:59:44.268 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T21:59:44.268 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T21:59:44.268 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T21:59:44.268 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-04-26T21:59:44.269 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T21:59:44.372 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627776 2024-04-26T21:59:44.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:44.382 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T21:59:44.382 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T21:59:44.382 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T21:59:44.382 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T21:59:44.382 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-04-26T21:59:44.382 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T21:59:44.486 INFO:teuthology.orchestra.run.smithi137.stdout:1099511628279 2024-04-26T21:59:44.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:44.495 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T21:59:44.495 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T21:59:44.495 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T21:59:44.496 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T21:59:44.496 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-04-26T21:59:44.496 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T21:59:44.600 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627777 2024-04-26T21:59:44.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:44.610 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T21:59:44.610 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T21:59:44.610 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T21:59:44.610 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T21:59:44.610 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-04-26T21:59:44.610 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T21:59:44.718 INFO:teuthology.orchestra.run.smithi137.stdout:1099511628280 2024-04-26T21:59:44.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T21:59:44.725 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:44.725 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:44.780 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:44.780 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:44.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:44.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.973+0000 7f8d9735f640 1 Processor -- start 2024-04-26T21:59:44.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.974+0000 7f8d9735f640 1 -- start start 2024-04-26T21:59:44.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.974+0000 7f8d9735f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8d900d3ee0 0x7f8d900cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:44.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.974+0000 7f8d9735f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8d9015f750 0x7f8d900b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:44.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.974+0000 7f8d9735f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d900d03a0 con 0x7f8d9015f370 2024-04-26T21:59:44.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.974+0000 7f8d9735f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8d900b4d10 con 0x7f8d900d3ee0 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.974+0000 7f8d9735f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8d900d0680 con 0x7f8d9015f750 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.975+0000 7f8d948fa640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8d900d3ee0 0x7f8d900cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.975+0000 7f8d948fa640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8d900d3ee0 0x7f8d900cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50448/0 (socket says 172.21.15.137:50448) 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.975+0000 7f8d948fa640 1 -- 172.21.15.137:0/1591529734 learned_addr learned my addr 172.21.15.137:0/1591529734 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.975+0000 7f8d958fc640 1 --2- 172.21.15.137:0/1591529734 >> v2:172.21.15.170:3300/0 conn(0x7f8d9015f750 0x7f8d900b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.975+0000 7f8d948fa640 1 -- 172.21.15.137:0/1591529734 >> v2:172.21.15.170:3300/0 conn(0x7f8d9015f750 msgr2=0x7f8d900b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.975+0000 7f8d948fa640 1 --2- 172.21.15.137:0/1591529734 >> v2:172.21.15.170:3300/0 conn(0x7f8d9015f750 0x7f8d900b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.975+0000 7f8d948fa640 1 -- 172.21.15.137:0/1591529734 >> v1:172.21.15.170:6789/0 conn(0x7f8d9015f370 legacy=0x7f8d900d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.975+0000 7f8d948fa640 1 -- 172.21.15.137:0/1591529734 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d900d0960 con 0x7f8d900d3ee0 2024-04-26T21:59:44.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d948fa640 1 --2- 172.21.15.137:0/1591529734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d900d3ee0 0x7f8d900cfd70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009870 tx=0x7f8d8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23421de5066a815 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:44.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d87fff640 1 -- 172.21.15.137:0/1591529734 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c037070 con 0x7f8d900d3ee0 2024-04-26T21:59:44.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d87fff640 1 -- 172.21.15.137:0/1591529734 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8c032440 con 0x7f8d900d3ee0 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d87fff640 1 -- 172.21.15.137:0/1591529734 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c032810 con 0x7f8d900d3ee0 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d9735f640 1 -- 172.21.15.137:0/1591529734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d900d3ee0 msgr2=0x7f8d900cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d9735f640 1 --2- 172.21.15.137:0/1591529734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d900d3ee0 0x7f8d900cfd70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c009870 tx=0x7f8d8c02a270 comp rx=0 tx=0).stop 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d9735f640 1 -- 172.21.15.137:0/1591529734 shutdown_connections 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d9735f640 1 --2- 172.21.15.137:0/1591529734 >> v2:172.21.15.170:3300/0 conn(0x7f8d9015f750 0x7f8d900b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d9735f640 1 --2- 172.21.15.137:0/1591529734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d900d3ee0 0x7f8d900cfd70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d9735f640 1 -- 172.21.15.137:0/1591529734 >> 172.21.15.137:0/1591529734 conn(0x7f8d9008ec10 msgr2=0x7f8d9009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d9735f640 1 -- 172.21.15.137:0/1591529734 shutdown_connections 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.976+0000 7f8d9735f640 1 -- 172.21.15.137:0/1591529734 wait complete. 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.977+0000 7f8d9735f640 1 Processor -- start 2024-04-26T21:59:44.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d9735f640 1 -- start start 2024-04-26T21:59:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d9735f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d900d3ee0 0x7f8d9015d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d9735f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d9015f370 0x7f8d900c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d9735f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d9015f750 0x7f8d900caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d9735f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8d900b51c0 con 0x7f8d9015f750 2024-04-26T21:59:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d9735f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d900d0f20 con 0x7f8d900d3ee0 2024-04-26T21:59:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d9735f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8d900b5340 con 0x7f8d9015f370 2024-04-26T21:59:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d958fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d9015f750 0x7f8d900caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d958fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d9015f750 0x7f8d900caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50454/0 (socket says 172.21.15.137:50454) 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d958fc640 1 -- 172.21.15.137:0/3573453423 learned_addr learned my addr 172.21.15.137:0/3573453423 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d950fb640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d900d3ee0 0x7f8d9015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.978+0000 7f8d948fa640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d9015f370 0x7f8d900c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d958fc640 1 -- 172.21.15.137:0/3573453423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d9015f370 msgr2=0x7f8d900c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d958fc640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d9015f370 0x7f8d900c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d958fc640 1 -- 172.21.15.137:0/3573453423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d900d3ee0 msgr2=0x7f8d9015d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d958fc640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d900d3ee0 0x7f8d9015d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d958fc640 1 -- 172.21.15.137:0/3573453423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d900c95f0 con 0x7f8d9015f750 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d958fc640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d9015f750 0x7f8d900caa70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8d88007e60 tx=0x7f8d8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d85ffb640 1 -- 172.21.15.137:0/3573453423 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88014420 con 0x7f8d9015f750 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d85ffb640 1 -- 172.21.15.137:0/3573453423 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d88019070 con 0x7f8d9015f750 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d900c98d0 con 0x7f8d9015f750 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d85ffb640 1 -- 172.21.15.137:0/3573453423 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88014820 con 0x7f8d9015f750 2024-04-26T21:59:44.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.979+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d900c9e90 con 0x7f8d9015f750 2024-04-26T21:59:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.980+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d9006a290 con 0x7f8d9015f750 2024-04-26T21:59:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.980+0000 7f8d85ffb640 1 -- 172.21.15.137:0/3573453423 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d880149c0 con 0x7f8d9015f750 2024-04-26T21:59:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.981+0000 7f8d85ffb640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d7406c8f0 0x7f8d7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.981+0000 7f8d85ffb640 1 -- 172.21.15.137:0/3573453423 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8d8808c220 con 0x7f8d9015f750 2024-04-26T21:59:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.981+0000 7f8d950fb640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d7406c8f0 0x7f8d7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.981+0000 7f8d950fb640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d7406c8f0 0x7f8d7406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8d900d0160 tx=0x7f8d80007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:44.985+0000 7f8d85ffb640 1 -- 172.21.15.137:0/3573453423 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8d88059ff0 con 0x7f8d9015f750 2024-04-26T21:59:45.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.159+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d900d1330 con 0x7f8d9015f750 2024-04-26T21:59:45.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.160+0000 7f8d85ffb640 1 -- 172.21.15.137:0/3573453423 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16681 (secure 0 0 0) 0x7f8d8805e2f0 con 0x7f8d9015f750 2024-04-26T21:59:45.161 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:45.161 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":34,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:34.679270+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:59:31.445571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T21:59:31.978335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.162+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d7406c8f0 msgr2=0x7f8d7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.162+0000 7f8d9735f640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d7406c8f0 0x7f8d7406edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8d900d0160 tx=0x7f8d80007e30 comp rx=0 tx=0).stop 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.162+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d9015f750 msgr2=0x7f8d900caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.162+0000 7f8d9735f640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d9015f750 0x7f8d900caa70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8d88007e60 tx=0x7f8d8800e4b0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.163+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 shutdown_connections 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.163+0000 7f8d9735f640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d7406c8f0 0x7f8d7406edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.163+0000 7f8d9735f640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d9015f750 0x7f8d900caa70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.163+0000 7f8d9735f640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d9015f370 0x7f8d900c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.163+0000 7f8d9735f640 1 --2- 172.21.15.137:0/3573453423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d900d3ee0 0x7f8d9015d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.163+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 >> 172.21.15.137:0/3573453423 conn(0x7f8d9008ec10 msgr2=0x7f8d9015e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.163+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 shutdown_connections 2024-04-26T21:59:45.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.163+0000 7f8d9735f640 1 -- 172.21.15.137:0/3573453423 wait complete. 2024-04-26T21:59:45.174 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:59:31.445571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:59:31.978335+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:45.174 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:45.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.273+0000 7fbf7a9af640 1 Processor -- start 2024-04-26T21:59:45.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.273+0000 7fbf7a9af640 1 -- start start 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.274+0000 7fbf7a9af640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbf7415f680 0x7fbf740d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.274+0000 7fbf7a9af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf74163aa0 0x7fbf740b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.274+0000 7fbf7a9af640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf740d3f50 con 0x7fbf740b60b0 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.274+0000 7fbf7a9af640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbf7415fa60 con 0x7fbf7415f680 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.274+0000 7fbf7a9af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf740b5090 con 0x7fbf74163aa0 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.274+0000 7fbf78f4c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbf740b60b0 0x7fbf740d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42236/0 (socket says 172.21.15.137:42236) 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.274+0000 7fbf78f4c640 1 -- 172.21.15.137:0/1766618974 learned_addr learned my addr 172.21.15.137:0/1766618974 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf73fff640 1 --2- 172.21.15.137:0/1766618974 >> v2:172.21.15.170:3300/0 conn(0x7fbf7415f680 0x7fbf740d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf737fe640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf74163aa0 0x7fbf740b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497113659 0 0) 0x7fbf740d3f50 con 0x7fbf740b60b0 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf5c003520 con 0x7fbf740b60b0 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1006664678 0 0) 0x7fbf5c003520 con 0x7fbf740b60b0 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf74163aa0 msgr2=0x7fbf740b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf74163aa0 0x7fbf740b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 >> v2:172.21.15.170:3300/0 conn(0x7fbf7415f680 msgr2=0x7fbf740d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 --2- 172.21.15.137:0/1766618974 >> v2:172.21.15.170:3300/0 conn(0x7fbf7415f680 0x7fbf740d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf740b5370 con 0x7fbf740b60b0 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fbf6c0019f0 con 0x7fbf740b60b0 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 >> v1:172.21.15.137:6789/0 conn(0x7fbf740b60b0 legacy=0x7fbf740d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf5c0039b0 0x7fbf5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf5c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf5c004ef0 0x7fbf5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7415fa60 con 0x7fbf5c0043a0 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbf740b5090 con 0x7fbf5c004ef0 2024-04-26T21:59:45.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5c00bf00 con 0x7fbf5c0039b0 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf737fe640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf74163aa0 0x7fbf740b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf737fe640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf5c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf73fff640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf5c0039b0 0x7fbf5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf78f4c640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf5c004ef0 0x7fbf5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf737fe640 1 -- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf5c0039b0 msgr2=0x7fbf5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf737fe640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf5c0039b0 0x7fbf5c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf737fe640 1 -- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf5c004ef0 msgr2=0x7fbf5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf737fe640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf5c004ef0 0x7fbf5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.275+0000 7fbf737fe640 1 -- 172.21.15.137:0/1766618974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c003520 con 0x7fbf5c0043a0 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.276+0000 7fbf737fe640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf5c004880 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbf7408fab0 tx=0x7fbf5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af54d3e31716800 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.276+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68036070 con 0x7fbf5c0043a0 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.276+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68004030 con 0x7fbf5c0043a0 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.276+0000 7fbf72ffd640 1 -- 172.21.15.137:0/1766618974 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf680097d0 con 0x7fbf5c0043a0 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.277+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1766618974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 msgr2=0x7fbf5c004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.277+0000 7fbf7a9af640 1 --2- 172.21.15.137:0/1766618974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf5c004880 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbf7408fab0 tx=0x7fbf5c005830 comp rx=0 tx=0).stop 2024-04-26T21:59:45.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.277+0000 7fbf78f4c640 1 -- 172.21.15.137:0/1766618974 reap_dead start 2024-04-26T21:59:45.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.277+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1766618974 shutdown_connections 2024-04-26T21:59:45.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.277+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1766618974 >> 172.21.15.137:0/1766618974 conn(0x7fbf7408eca0 msgr2=0x7fbf7409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:45.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.277+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1766618974 shutdown_connections 2024-04-26T21:59:45.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.277+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1766618974 wait complete. 2024-04-26T21:59:45.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.278+0000 7fbf7a9af640 1 Processor -- start 2024-04-26T21:59:45.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.278+0000 7fbf7a9af640 1 -- start start 2024-04-26T21:59:45.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf7a9af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf741568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf7a9af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf740ccc40 0x7fbf740cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf7a9af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf740d2010 0x7fbf740d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf7a9af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf740d57b0 con 0x7fbf5c0043a0 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf7a9af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbf740d5630 con 0x7fbf740ccc40 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf7a9af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf740d5930 con 0x7fbf740d2010 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf73fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf741568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf73fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf741568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50460/0 (socket says 172.21.15.137:50460) 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf73fff640 1 -- 172.21.15.137:0/1575115875 learned_addr learned my addr 172.21.15.137:0/1575115875 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf737fe640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf740ccc40 0x7fbf740cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf78f4c640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf740d2010 0x7fbf740d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf73fff640 1 -- 172.21.15.137:0/1575115875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf740d2010 msgr2=0x7fbf740d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf73fff640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf740d2010 0x7fbf740d24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf73fff640 1 -- 172.21.15.137:0/1575115875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf740ccc40 msgr2=0x7fbf740cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf73fff640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf740ccc40 0x7fbf740cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf73fff640 1 -- 172.21.15.137:0/1575115875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf741f8750 con 0x7fbf5c0043a0 2024-04-26T21:59:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.279+0000 7fbf73fff640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf741568b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbf64011960 tx=0x7fbf64011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.280+0000 7fbf70ff9640 1 -- 172.21.15.137:0/1575115875 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6400fa90 con 0x7fbf5c0043a0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.280+0000 7fbf70ff9640 1 -- 172.21.15.137:0/1575115875 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6400fc30 con 0x7fbf5c0043a0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.280+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf741f8a30 con 0x7fbf5c0043a0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.280+0000 7fbf70ff9640 1 -- 172.21.15.137:0/1575115875 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf64014440 con 0x7fbf5c0043a0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.280+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7415fbe0 con 0x7fbf5c0043a0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.281+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7406a290 con 0x7fbf5c0043a0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.281+0000 7fbf70ff9640 1 -- 172.21.15.137:0/1575115875 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf64012040 con 0x7fbf5c0043a0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.281+0000 7fbf70ff9640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6006c8f0 0x7fbf6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.282+0000 7fbf70ff9640 1 -- 172.21.15.137:0/1575115875 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fbf6408c0d0 con 0x7fbf5c0043a0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.282+0000 7fbf737fe640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6006c8f0 0x7fbf6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.282+0000 7fbf737fe640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6006c8f0 0x7fbf6006edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbf68033000 tx=0x7fbf68008070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:45.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.286+0000 7fbf70ff9640 1 -- 172.21.15.137:0/1575115875 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbf64019030 con 0x7fbf5c0043a0 2024-04-26T21:59:45.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.459+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbf740bae50 con 0x7fbf5c0043a0 2024-04-26T21:59:45.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.460+0000 7fbf70ff9640 1 -- 172.21.15.137:0/1575115875 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7fbf6405a590 con 0x7fbf5c0043a0 2024-04-26T21:59:45.460 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:45.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6006c8f0 msgr2=0x7fbf6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6006c8f0 0x7fbf6006edb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbf68033000 tx=0x7fbf68008070 comp rx=0 tx=0).stop 2024-04-26T21:59:45.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 msgr2=0x7fbf741568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf741568b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbf64011960 tx=0x7fbf64011e20 comp rx=0 tx=0).stop 2024-04-26T21:59:45.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 shutdown_connections 2024-04-26T21:59:45.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6006c8f0 0x7fbf6006edb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf740d2010 0x7fbf740d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf740ccc40 0x7fbf740cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 --2- 172.21.15.137:0/1575115875 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf5c0043a0 0x7fbf741568b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 >> 172.21.15.137:0/1575115875 conn(0x7fbf7408eca0 msgr2=0x7fbf7415e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:45.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 shutdown_connections 2024-04-26T21:59:45.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.462+0000 7fbf7a9af640 1 -- 172.21.15.137:0/1575115875 wait complete. 2024-04-26T21:59:45.473 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:45.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.573+0000 7fa0fda45640 1 Processor -- start 2024-04-26T21:59:45.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.573+0000 7fa0fda45640 1 -- start start 2024-04-26T21:59:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.573+0000 7fa0fda45640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815d340 0x7fa0f809c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.573+0000 7fa0fda45640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f80cee60 con 0x7fa0f80b2420 2024-04-26T21:59:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.573+0000 7fa0fda45640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0f80d0ff0 con 0x7fa0f80d1940 2024-04-26T21:59:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.573+0000 7fa0fda45640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f80ce9d0 con 0x7fa0f815d340 2024-04-26T21:59:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0ee7fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa0f80b2420 0x7fa0f80d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39156/0 (socket says 172.21.15.137:39156) 2024-04-26T21:59:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0ee7fc640 1 -- 172.21.15.137:0/2052752865 learned_addr learned my addr 172.21.15.137:0/2052752865 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:45.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3166361454 0 0) 0x7fa0f80cee60 con 0x7fa0f80b2420 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f6ffd640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815d340 0x7fa0f809c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0e4003520 con 0x7fa0f80b2420 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 824527996 0 0) 0x7fa0e4003520 con 0x7fa0f80b2420 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815d340 msgr2=0x7fa0f809c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815d340 0x7fa0f809c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 >> v1:172.21.15.170:6789/0 conn(0x7fa0f80d1940 legacy=0x7fa0f80702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f80d0d10 con 0x7fa0f80b2420 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fa0e0001670 con 0x7fa0f80b2420 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 >> v1:172.21.15.137:6789/0 conn(0x7fa0f80b2420 legacy=0x7fa0f80d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e40039e0 0x7fa0e4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815d340 0x7fa0e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e4004d40 0x7fa0e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f80ce9d0 con 0x7fa0e40039e0 2024-04-26T21:59:45.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e400b9c0 con 0x7fa0e4004d40 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e400bbc0 con 0x7fa0f815d340 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f6ffd640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e40039e0 0x7fa0e4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0ee7fc640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815d340 0x7fa0e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f77fe640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e4004d40 0x7fa0e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f6ffd640 1 -- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815d340 msgr2=0x7fa0e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f6ffd640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815d340 0x7fa0e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f6ffd640 1 -- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e4004d40 msgr2=0x7fa0e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f6ffd640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e4004d40 0x7fa0e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.574+0000 7fa0f6ffd640 1 -- 172.21.15.137:0/2052752865 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e4003520 con 0x7fa0e40039e0 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.575+0000 7fa0f6ffd640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e40039e0 0x7fa0e4003dc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009ac0 tx=0x7fa0e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e494c143b1e9249d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.575+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8036070 con 0x7fa0e40039e0 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.575+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e8031400 con 0x7fa0e40039e0 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.575+0000 7fa0f67fc640 1 -- 172.21.15.137:0/2052752865 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8009690 con 0x7fa0e40039e0 2024-04-26T21:59:45.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.576+0000 7fa0fda45640 1 -- 172.21.15.137:0/2052752865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e40039e0 msgr2=0x7fa0e4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.576+0000 7fa0fda45640 1 --2- 172.21.15.137:0/2052752865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0e40039e0 0x7fa0e4003dc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009ac0 tx=0x7fa0e4005830 comp rx=0 tx=0).stop 2024-04-26T21:59:45.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.576+0000 7fa0f77fe640 1 -- 172.21.15.137:0/2052752865 reap_dead start 2024-04-26T21:59:45.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.576+0000 7fa0fda45640 1 -- 172.21.15.137:0/2052752865 shutdown_connections 2024-04-26T21:59:45.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.576+0000 7fa0fda45640 1 -- 172.21.15.137:0/2052752865 >> 172.21.15.137:0/2052752865 conn(0x7fa0f809ba40 msgr2=0x7fa0f809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:45.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.576+0000 7fa0fda45640 1 -- 172.21.15.137:0/2052752865 shutdown_connections 2024-04-26T21:59:45.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.576+0000 7fa0fda45640 1 -- 172.21.15.137:0/2052752865 wait complete. 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.577+0000 7fa0fda45640 1 Processor -- start 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.577+0000 7fa0fda45640 1 -- start start 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0fda45640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e40039e0 0x7fa0f8157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0fda45640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f81563f0 0x7fa0f8156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0fda45640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80b6cc0 0x7fa0f80b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0fda45640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f80b2090 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0fda45640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f815d720 con 0x7fa0e40039e0 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0fda45640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f80b2210 con 0x7fa0f81563f0 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80b6cc0 0x7fa0f80b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80b6cc0 0x7fa0f80b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60268/0 (socket says 172.21.15.137:60268) 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f77fe640 1 -- 172.21.15.137:0/1673667437 learned_addr learned my addr 172.21.15.137:0/1673667437 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f6ffd640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e40039e0 0x7fa0f8157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0ee7fc640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f81563f0 0x7fa0f8156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f77fe640 1 -- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f81563f0 msgr2=0x7fa0f8156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f77fe640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f81563f0 0x7fa0f8156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f77fe640 1 -- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e40039e0 msgr2=0x7fa0f8157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f77fe640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e40039e0 0x7fa0f8157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f77fe640 1 -- 172.21.15.137:0/1673667437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f80b7960 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f6ffd640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e40039e0 0x7fa0f8157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0ee7fc640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f81563f0 0x7fa0f8156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.578+0000 7fa0f77fe640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80b6cc0 0x7fa0f80b7140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8073930 tx=0x7fa0f000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.579+0000 7fa0f4ff9640 1 -- 172.21.15.137:0/1673667437 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000ee50 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.579+0000 7fa0f4ff9640 1 -- 172.21.15.137:0/1673667437 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f0018070 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.579+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f80b7c40 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.579+0000 7fa0f4ff9640 1 -- 172.21.15.137:0/1673667437 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0003dc0 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.579+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f80b8200 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.580+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f80693d0 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.580+0000 7fa0f4ff9640 1 -- 172.21.15.137:0/1673667437 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa0f00050d0 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.580+0000 7fa0f4ff9640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.581+0000 7fa0f4ff9640 1 -- 172.21.15.137:0/1673667437 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa0f008ba40 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.581+0000 7fa0f6ffd640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.581+0000 7fa0f6ffd640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8033000 tx=0x7fa0e8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:45.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.585+0000 7fa0f4ff9640 1 -- 172.21.15.137:0/1673667437 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa0f0059e70 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.761+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa0f80b7680 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.761+0000 7fa0f4ff9640 1 -- 172.21.15.137:0/1673667437 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7fa0f008be20 con 0x7fa0f80b6cc0 2024-04-26T21:59:45.761 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:45.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 msgr2=0x7fa0d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8033000 tx=0x7fa0e8008030 comp rx=0 tx=0).stop 2024-04-26T21:59:45.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80b6cc0 msgr2=0x7fa0f80b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80b6cc0 0x7fa0f80b7140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8073930 tx=0x7fa0f000ec00 comp rx=0 tx=0).stop 2024-04-26T21:59:45.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 shutdown_connections 2024-04-26T21:59:45.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80b6cc0 0x7fa0f80b7140 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f81563f0 0x7fa0f8156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 --2- 172.21.15.137:0/1673667437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0e40039e0 0x7fa0f8157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 >> 172.21.15.137:0/1673667437 conn(0x7fa0f809ba40 msgr2=0x7fa0f80d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:45.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 shutdown_connections 2024-04-26T21:59:45.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.763+0000 7fa0fda45640 1 -- 172.21.15.137:0/1673667437 wait complete. 2024-04-26T21:59:45.775 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:45.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.874+0000 7f3ac4b12640 1 Processor -- start 2024-04-26T21:59:45.874 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.874+0000 7f3ac4b12640 1 -- start start 2024-04-26T21:59:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3ac4b12640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3ac006f340 0x7f3ac00b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3ac4b12640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3ac00d0300 0x7f3ac006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3ac4b12640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac006fc60 con 0x7f3ac00b3e50 2024-04-26T21:59:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3ac4b12640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac00b46a0 con 0x7f3ac00d0300 2024-04-26T21:59:45.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3ac4b12640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac00b5db0 con 0x7f3ac006f340 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3abdd9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3ac00d0300 0x7f3ac006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3abdd9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3ac00d0300 0x7f3ac006f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60272/0 (socket says 172.21.15.137:60272) 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3abdd9b640 1 -- 172.21.15.137:0/2918204386 learned_addr learned my addr 172.21.15.137:0/2918204386 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3abe59c640 1 --2- 172.21.15.137:0/2918204386 >> v2:172.21.15.170:3300/0 conn(0x7f3ac006f340 0x7f3ac00b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3abdd9b640 1 -- 172.21.15.137:0/2918204386 >> v2:172.21.15.170:3300/0 conn(0x7f3ac006f340 msgr2=0x7f3ac00b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3abdd9b640 1 --2- 172.21.15.137:0/2918204386 >> v2:172.21.15.170:3300/0 conn(0x7f3ac006f340 0x7f3ac00b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3abdd9b640 1 -- 172.21.15.137:0/2918204386 >> v1:172.21.15.170:6789/0 conn(0x7f3ac00b3e50 legacy=0x7f3ac00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3abdd9b640 1 -- 172.21.15.137:0/2918204386 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac00b6090 con 0x7f3ac00d0300 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.875+0000 7f3abe59c640 1 --2- 172.21.15.137:0/2918204386 >> v2:172.21.15.170:3300/0 conn(0x7f3ac006f340 0x7f3ac00b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.876+0000 7f3abdd9b640 1 --2- 172.21.15.137:0/2918204386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 0x7f3ac006f720 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0076180 tx=0x7f3ab002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefc6339dbbf3474 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.876+0000 7f3abd59a640 1 -- 172.21.15.137:0/2918204386 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0037070 con 0x7f3ac00d0300 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.876+0000 7f3abd59a640 1 -- 172.21.15.137:0/2918204386 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab002ae20 con 0x7f3ac00d0300 2024-04-26T21:59:45.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.876+0000 7f3abd59a640 1 -- 172.21.15.137:0/2918204386 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0032660 con 0x7f3ac00d0300 2024-04-26T21:59:45.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.877+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2918204386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 msgr2=0x7f3ac006f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.877+0000 7f3ac4b12640 1 --2- 172.21.15.137:0/2918204386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 0x7f3ac006f720 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0076180 tx=0x7f3ab002a110 comp rx=0 tx=0).stop 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.877+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2918204386 shutdown_connections 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.877+0000 7f3ac4b12640 1 --2- 172.21.15.137:0/2918204386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 0x7f3ac006f720 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.877+0000 7f3ac4b12640 1 --2- 172.21.15.137:0/2918204386 >> v2:172.21.15.170:3300/0 conn(0x7f3ac006f340 0x7f3ac00b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.877+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2918204386 >> 172.21.15.137:0/2918204386 conn(0x7f3ac00cd8a0 msgr2=0x7f3ac00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.877+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2918204386 shutdown_connections 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.877+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2918204386 wait complete. 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.878+0000 7f3ac4b12640 1 Processor -- start 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.878+0000 7f3ac4b12640 1 -- start start 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3ac4b12640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ac006f340 0x7f3ac01f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3ac4b12640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ac00b3e50 0x7f3ac00ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3ac4b12640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 0x7f3ac0140950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3ac4b12640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac00b42e0 con 0x7f3ac00d0300 2024-04-26T21:59:45.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3ac4b12640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac00b6650 con 0x7f3ac006f340 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3ac4b12640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac00b4460 con 0x7f3ac00b3e50 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3abed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 0x7f3ac0140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3abed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 0x7f3ac0140950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60276/0 (socket says 172.21.15.137:60276) 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3abed9d640 1 -- 172.21.15.137:0/2585408925 learned_addr learned my addr 172.21.15.137:0/2585408925 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3abe59c640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ac006f340 0x7f3ac01f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.879+0000 7f3abdd9b640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ac00b3e50 0x7f3ac00ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3abed9d640 1 -- 172.21.15.137:0/2585408925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ac00b3e50 msgr2=0x7f3ac00ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3abed9d640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ac00b3e50 0x7f3ac00ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3abed9d640 1 -- 172.21.15.137:0/2585408925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ac006f340 msgr2=0x7f3ac01f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3abed9d640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ac006f340 0x7f3ac01f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3abed9d640 1 -- 172.21.15.137:0/2585408925 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac00caa40 con 0x7f3ac00d0300 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3abed9d640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 0x7f3ac0140950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800b970 tx=0x7f3ab800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3ab6ffd640 1 -- 172.21.15.137:0/2585408925 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8019070 con 0x7f3ac00d0300 2024-04-26T21:59:45.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3ab6ffd640 1 -- 172.21.15.137:0/2585408925 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab800cb40 con 0x7f3ac00d0300 2024-04-26T21:59:45.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3ab6ffd640 1 -- 172.21.15.137:0/2585408925 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8014440 con 0x7f3ac00d0300 2024-04-26T21:59:45.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac00cad20 con 0x7f3ac00d0300 2024-04-26T21:59:45.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.880+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac013c4c0 con 0x7f3ac00d0300 2024-04-26T21:59:45.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.881+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac00caef0 con 0x7f3ac00d0300 2024-04-26T21:59:45.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.882+0000 7f3ab6ffd640 1 -- 172.21.15.137:0/2585408925 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ab801c070 con 0x7f3ac00d0300 2024-04-26T21:59:45.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.882+0000 7f3ab6ffd640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3aa006c920 0x7f3aa006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:45.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.882+0000 7f3ab6ffd640 1 -- 172.21.15.137:0/2585408925 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3ab808b5d0 con 0x7f3ac00d0300 2024-04-26T21:59:45.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.882+0000 7f3abe59c640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3aa006c920 0x7f3aa006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:45.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.882+0000 7f3abe59c640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3aa006c920 0x7f3aa006ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800aac0 tx=0x7f3aa8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:45.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:45.886+0000 7f3ab6ffd640 1 -- 172.21.15.137:0/2585408925 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3ab8059440 con 0x7f3ac00d0300 2024-04-26T21:59:46.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.060+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3ac006a290 con 0x7f3ac00d0300 2024-04-26T21:59:46.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.061+0000 7f3ab6ffd640 1 -- 172.21.15.137:0/2585408925 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f3ab805d740 con 0x7f3ac00d0300 2024-04-26T21:59:46.061 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3aa006c920 msgr2=0x7f3aa006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3aa006c920 0x7f3aa006ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800aac0 tx=0x7f3aa8008040 comp rx=0 tx=0).stop 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 msgr2=0x7f3ac0140950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 0x7f3ac0140950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800b970 tx=0x7f3ab800be30 comp rx=0 tx=0).stop 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 shutdown_connections 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3aa006c920 0x7f3aa006ede0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3ac00d0300 0x7f3ac0140950 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3ac00b3e50 0x7f3ac00ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 --2- 172.21.15.137:0/2585408925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ac006f340 0x7f3ac01f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 >> 172.21.15.137:0/2585408925 conn(0x7f3ac00cd8a0 msgr2=0x7f3ac0145630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 shutdown_connections 2024-04-26T21:59:46.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.063+0000 7f3ac4b12640 1 -- 172.21.15.137:0/2585408925 wait complete. 2024-04-26T21:59:46.075 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T21:59:46.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.173+0000 7f4d5ec99640 1 Processor -- start 2024-04-26T21:59:46.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.173+0000 7f4d5ec99640 1 -- start start 2024-04-26T21:59:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.173+0000 7f4d5ec99640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d5815f370 0x7f4d580cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.173+0000 7f4d5ec99640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d5815f750 0x7f4d580b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.173+0000 7f4d5ec99640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4d580d37d0 0x7f4d580d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.173+0000 7f4d5ec99640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4d580b4d10 con 0x7f4d5815f370 2024-04-26T21:59:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.173+0000 7f4d5ec99640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4d580d4120 con 0x7f4d580d37d0 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.173+0000 7f4d5ec99640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4d580d03a0 con 0x7f4d5815f750 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5ca35640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d5815f370 0x7f4d580cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5ca35640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4d5815f370 0x7f4d580cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60290/0 (socket says 172.21.15.137:60290) 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5ca35640 1 -- 172.21.15.137:0/3226534004 learned_addr learned my addr 172.21.15.137:0/3226534004 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5d236640 1 --2- 172.21.15.137:0/3226534004 >> v2:172.21.15.170:3300/0 conn(0x7f4d580d37d0 0x7f4d580d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5ca35640 1 -- 172.21.15.137:0/3226534004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d5815f750 msgr2=0x7f4d580b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5ca35640 1 --2- 172.21.15.137:0/3226534004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d5815f750 0x7f4d580b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5ca35640 1 -- 172.21.15.137:0/3226534004 >> v2:172.21.15.170:3300/0 conn(0x7f4d580d37d0 msgr2=0x7f4d580d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5ca35640 1 --2- 172.21.15.137:0/3226534004 >> v2:172.21.15.170:3300/0 conn(0x7f4d580d37d0 0x7f4d580d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5ca35640 1 -- 172.21.15.137:0/3226534004 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d580d0680 con 0x7f4d5815f370 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.174+0000 7f4d5d236640 1 --2- 172.21.15.137:0/3226534004 >> v2:172.21.15.170:3300/0 conn(0x7f4d580d37d0 0x7f4d580d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ca35640 1 --2- 172.21.15.137:0/3226534004 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f370 0x7f4d580cfd70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4d580d02b0 tx=0x7f4d4c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4596d0954a55d80c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d577fe640 1 -- 172.21.15.137:0/3226534004 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c037070 con 0x7f4d5815f370 2024-04-26T21:59:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d577fe640 1 -- 172.21.15.137:0/3226534004 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4c032440 con 0x7f4d5815f370 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d577fe640 1 -- 172.21.15.137:0/3226534004 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c032810 con 0x7f4d5815f370 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ec99640 1 -- 172.21.15.137:0/3226534004 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f370 msgr2=0x7f4d580cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/3226534004 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f370 0x7f4d580cfd70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4d580d02b0 tx=0x7f4d4c02a140 comp rx=0 tx=0).stop 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ec99640 1 -- 172.21.15.137:0/3226534004 shutdown_connections 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/3226534004 >> v2:172.21.15.170:3300/0 conn(0x7f4d580d37d0 0x7f4d580d3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/3226534004 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d5815f750 0x7f4d580b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/3226534004 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f370 0x7f4d580cfd70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ec99640 1 -- 172.21.15.137:0/3226534004 >> 172.21.15.137:0/3226534004 conn(0x7f4d5808ec10 msgr2=0x7f4d5809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ec99640 1 -- 172.21.15.137:0/3226534004 shutdown_connections 2024-04-26T21:59:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.175+0000 7f4d5ec99640 1 -- 172.21.15.137:0/3226534004 wait complete. 2024-04-26T21:59:46.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.176+0000 7f4d5ec99640 1 Processor -- start 2024-04-26T21:59:46.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.176+0000 7f4d5ec99640 1 -- start start 2024-04-26T21:59:46.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5ec99640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d580d37d0 0x7f4d580b8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5ec99640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5815f370 0x7f4d580cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5ec99640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f750 0x7f4d580cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5ec99640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4d580d0f20 con 0x7f4d5815f750 2024-04-26T21:59:46.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5ec99640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4d580d0c40 con 0x7f4d5815f370 2024-04-26T21:59:46.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5ec99640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4d580d1bd0 con 0x7f4d580d37d0 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5d236640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f750 0x7f4d580cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5d236640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f750 0x7f4d580cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60300/0 (socket says 172.21.15.137:60300) 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5d236640 1 -- 172.21.15.137:0/331657344 learned_addr learned my addr 172.21.15.137:0/331657344 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d57fff640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5815f370 0x7f4d580cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.177+0000 7f4d5ca35640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d580d37d0 0x7f4d580b8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d5d236640 1 -- 172.21.15.137:0/331657344 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d580d37d0 msgr2=0x7f4d580b8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d5d236640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d580d37d0 0x7f4d580b8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d5d236640 1 -- 172.21.15.137:0/331657344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5815f370 msgr2=0x7f4d580cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d5d236640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5815f370 0x7f4d580cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d5d236640 1 -- 172.21.15.137:0/331657344 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d580b94b0 con 0x7f4d5815f750 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d5d236640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f750 0x7f4d580cc9c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000cef0 tx=0x7f4d5000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d557fa640 1 -- 172.21.15.137:0/331657344 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5001a070 con 0x7f4d5815f750 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d557fa640 1 -- 172.21.15.137:0/331657344 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5000d860 con 0x7f4d5815f750 2024-04-26T21:59:46.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d557fa640 1 -- 172.21.15.137:0/331657344 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000dc50 con 0x7f4d5815f750 2024-04-26T21:59:46.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d580b9790 con 0x7f4d5815f750 2024-04-26T21:59:46.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.178+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d580b9d50 con 0x7f4d5815f750 2024-04-26T21:59:46.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.179+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5806a290 con 0x7f4d5815f750 2024-04-26T21:59:46.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.179+0000 7f4d557fa640 1 -- 172.21.15.137:0/331657344 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d5001d070 con 0x7f4d5815f750 2024-04-26T21:59:46.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.180+0000 7f4d557fa640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4d3c06c8f0 0x7f4d3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.180+0000 7f4d557fa640 1 -- 172.21.15.137:0/331657344 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4d5008c2a0 con 0x7f4d5815f750 2024-04-26T21:59:46.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.180+0000 7f4d5ca35640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4d3c06c8f0 0x7f4d3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.180+0000 7f4d5ca35640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4d3c06c8f0 0x7f4d3c06edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c034000 tx=0x7f4d4c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:46.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.184+0000 7f4d557fa640 1 -- 172.21.15.137:0/331657344 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4d5005a110 con 0x7f4d5815f750 2024-04-26T21:59:46.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.370+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4d580008d0 con 0x7f4d5815f750 2024-04-26T21:59:46.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.370+0000 7f4d557fa640 1 -- 172.21.15.137:0/331657344 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f4d5008c0c0 con 0x7f4d5815f750 2024-04-26T21:59:46.371 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4d3c06c8f0 msgr2=0x7f4d3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4d3c06c8f0 0x7f4d3c06edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c034000 tx=0x7f4d4c02e000 comp rx=0 tx=0).stop 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f750 msgr2=0x7f4d580cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f750 0x7f4d580cc9c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000cef0 tx=0x7f4d5000a710 comp rx=0 tx=0).stop 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 shutdown_connections 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4d3c06c8f0 0x7f4d3c06edb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4d5815f750 0x7f4d580cc9c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5815f370 0x7f4d580cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 --2- 172.21.15.137:0/331657344 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4d580d37d0 0x7f4d580b8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.372+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 >> 172.21.15.137:0/331657344 conn(0x7f4d5808ec10 msgr2=0x7f4d580d5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.373+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 shutdown_connections 2024-04-26T21:59:46.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.373+0000 7f4d5ec99640 1 -- 172.21.15.137:0/331657344 wait complete. 2024-04-26T21:59:46.383 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T21:59:46.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:46.384 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T21:59:46.422 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T21:59:46.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T21:59:46.422 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T21:59:46.477 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:46.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.616+0000 7f45ca0f9640 1 Processor -- start 2024-04-26T21:59:46.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.616+0000 7f45ca0f9640 1 -- start start 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45ca0f9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f45c40b61a0 0x7f45c4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45ca0f9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45c40b3de0 0x7f45c40720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45ca0f9640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c40b4270 con 0x7f45c4145980 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45ca0f9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f45c40b5140 con 0x7f45c40b61a0 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45ca0f9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f45c40b4530 con 0x7f45c40b3de0 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c37fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f45c4145980 0x7f45c40b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39162/0 (socket says 172.21.15.137:39162) 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c37fe640 1 -- 172.21.15.137:0/1196484768 learned_addr learned my addr 172.21.15.137:0/1196484768 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c3fff640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45c40b3de0 0x7f45c40720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c2ffd640 1 --2- 172.21.15.137:0/1196484768 >> v2:172.21.15.170:3300/0 conn(0x7f45c40b61a0 0x7f45c4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710895135 0 0) 0x7f45c40b4270 con 0x7f45c4145980 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45ac003520 con 0x7f45c4145980 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3817013183 0 0) 0x7f45ac003520 con 0x7f45c4145980 2024-04-26T21:59:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45c40b3de0 msgr2=0x7f45c40720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45c40b3de0 0x7f45c40720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 >> v2:172.21.15.170:3300/0 conn(0x7f45c40b61a0 msgr2=0x7f45c4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 --2- 172.21.15.137:0/1196484768 >> v2:172.21.15.170:3300/0 conn(0x7f45c40b61a0 0x7f45c4160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c40b4810 con 0x7f45c4145980 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f45b4001690 con 0x7f45c4145980 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 >> v1:172.21.15.137:6789/0 conn(0x7f45c4145980 legacy=0x7f45c40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45c40b3de0 0x7f45ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45ac003f30 0x7f45ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45ac004d40 0x7f45ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f45c40b5140 con 0x7f45ac004d40 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.617+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f45c40b4530 con 0x7f45ac003f30 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f45ac00ba10 con 0x7f45c40b3de0 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c2ffd640 1 --2- 172.21.15.137:0/1196484768 >> v2:172.21.15.170:3300/0 conn(0x7f45c40b61a0 0x7f45c4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c3fff640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45ac004d40 0x7f45ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c37fe640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45c40b3de0 0x7f45ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c2ffd640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45ac003f30 0x7f45ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c3fff640 1 -- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45c40b3de0 msgr2=0x7f45ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c3fff640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45c40b3de0 0x7f45ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c3fff640 1 -- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45ac003f30 msgr2=0x7f45ac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c3fff640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45ac003f30 0x7f45ac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.618+0000 7f45c3fff640 1 -- 172.21.15.137:0/1196484768 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ac003520 con 0x7f45ac004d40 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45c3fff640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45ac004d40 0x7f45ac0051c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00e170 tx=0x7f45ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7434a2f1869a6dc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc034020 con 0x7f45ac004d40 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45bc0305f0 con 0x7f45ac004d40 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45c27fc640 1 -- 172.21.15.137:0/1196484768 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc009c10 con 0x7f45ac004d40 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45ca0f9640 1 -- 172.21.15.137:0/1196484768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45ac004d40 msgr2=0x7f45ac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45ca0f9640 1 --2- 172.21.15.137:0/1196484768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45ac004d40 0x7f45ac0051c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00e170 tx=0x7f45ac005830 comp rx=0 tx=0).stop 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45c3fff640 1 -- 172.21.15.137:0/1196484768 reap_dead start 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45ca0f9640 1 -- 172.21.15.137:0/1196484768 shutdown_connections 2024-04-26T21:59:46.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45ca0f9640 1 -- 172.21.15.137:0/1196484768 >> 172.21.15.137:0/1196484768 conn(0x7f45c40d0d30 msgr2=0x7f45c40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:46.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45ca0f9640 1 -- 172.21.15.137:0/1196484768 shutdown_connections 2024-04-26T21:59:46.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.619+0000 7f45ca0f9640 1 -- 172.21.15.137:0/1196484768 wait complete. 2024-04-26T21:59:46.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.620+0000 7f45ca0f9640 1 Processor -- start 2024-04-26T21:59:46.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45ca0f9640 1 -- start start 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45ca0f9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45ac004d40 0x7f45c4158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45ca0f9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45c40b00f0 0x7f45c413de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45ca0f9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c413f740 0x7f45c406ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45ca0f9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f45c40720d0 con 0x7f45c413f740 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45ca0f9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f45c40b4dd0 con 0x7f45c40b00f0 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45ca0f9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f45c4072250 con 0x7f45ac004d40 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45c3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c413f740 0x7f45c406ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45c3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c413f740 0x7f45c406ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60316/0 (socket says 172.21.15.137:60316) 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45c3fff640 1 -- 172.21.15.137:0/675235521 learned_addr learned my addr 172.21.15.137:0/675235521 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45c2ffd640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45c40b00f0 0x7f45c413de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.621+0000 7f45c37fe640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45ac004d40 0x7f45c4158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45c3fff640 1 -- 172.21.15.137:0/675235521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45ac004d40 msgr2=0x7f45c4158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45c3fff640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45ac004d40 0x7f45c4158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45c3fff640 1 -- 172.21.15.137:0/675235521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45c40b00f0 msgr2=0x7f45c413de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45c3fff640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45c40b00f0 0x7f45c413de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45c3fff640 1 -- 172.21.15.137:0/675235521 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c41590d0 con 0x7f45c413f740 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45c3fff640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c413f740 0x7f45c406ebb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009f90 tx=0x7f45bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45abfff640 1 -- 172.21.15.137:0/675235521 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc034040 con 0x7f45c413f740 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45abfff640 1 -- 172.21.15.137:0/675235521 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45bc003990 con 0x7f45c413f740 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c413e3d0 con 0x7f45c413f740 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45abfff640 1 -- 172.21.15.137:0/675235521 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc009c10 con 0x7f45c413f740 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.622+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c413e980 con 0x7f45c413f740 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.623+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c406a290 con 0x7f45c413f740 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.623+0000 7f45abfff640 1 -- 172.21.15.137:0/675235521 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45bc037020 con 0x7f45c413f740 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.624+0000 7f45abfff640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f45b006c920 0x7f45b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.624+0000 7f45abfff640 1 -- 172.21.15.137:0/675235521 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f45bc0ac6a0 con 0x7f45c413f740 2024-04-26T21:59:46.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.624+0000 7f45c37fe640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f45b006c920 0x7f45b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:46.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.624+0000 7f45c37fe640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f45b006c920 0x7f45b006ede0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f45c4073c90 tx=0x7f45b4001e70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:46.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.628+0000 7f45abfff640 1 -- 172.21.15.137:0/675235521 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f45bc049060 con 0x7f45c413f740 2024-04-26T21:59:46.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.842+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45c40737f0 con 0x7f45c413f740 2024-04-26T21:59:46.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.842+0000 7f45abfff640 1 -- 172.21.15.137:0/675235521 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f45bc07a480 con 0x7f45c413f740 2024-04-26T21:59:46.843 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:46.843 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3532925157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3532925157},{"type":"v1","addr":"172.21.15.137:6836","nonce":3532925157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3509631448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3509631448},{"type":"v1","addr":"172.21.15.170:6834","nonce":3509631448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3228449407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3228449407},{"type":"v1","addr":"172.21.15.170:6835","nonce":3228449407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:59:33.028489+0000","modified":"2024-04-26T21:59:35.023196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1394398285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1394398285},{"type":"v1","addr":"172.21.15.137:6837","nonce":1394398285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5139,"qdb_cluster":[5139]},"id":2}]} 2024-04-26T21:59:46.843 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f45b006c920 msgr2=0x7f45b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f45b006c920 0x7f45b006ede0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f45c4073c90 tx=0x7f45b4001e70 comp rx=0 tx=0).stop 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c413f740 msgr2=0x7f45c406ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c413f740 0x7f45c406ebb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009f90 tx=0x7f45bc009750 comp rx=0 tx=0).stop 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 shutdown_connections 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f45b006c920 0x7f45b006ede0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45c413f740 0x7f45c406ebb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45c40b00f0 0x7f45c413de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 --2- 172.21.15.137:0/675235521 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f45ac004d40 0x7f45c4158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 >> 172.21.15.137:0/675235521 conn(0x7f45c40d0d30 msgr2=0x7f45c40b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 shutdown_connections 2024-04-26T21:59:46.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:46.845+0000 7f45ca0f9640 1 -- 172.21.15.137:0/675235521 wait complete. 2024-04-26T21:59:46.856 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-26T21:59:46.985 INFO:teuthology.orchestra.run.smithi137.stdout:{"message":"","return_code":0} 2024-04-26T21:59:46.985 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T21:59:46.986 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:47.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.083+0000 7f954617f640 1 Processor -- start 2024-04-26T21:59:47.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.083+0000 7f954617f640 1 -- start start 2024-04-26T21:59:47.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.083+0000 7f954617f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f954015f370 0x7f95400cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:47.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.083+0000 7f954617f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f95400d3ee0 0x7f95400b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:47.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.083+0000 7f954617f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95400d03a0 con 0x7f954015f750 2024-04-26T21:59:47.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.083+0000 7f954617f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f95400b4d10 con 0x7f954015f370 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.083+0000 7f954617f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f95400d0680 con 0x7f95400d3ee0 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f954015f370 0x7f95400cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f954015f370 0x7f95400cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60322/0 (socket says 172.21.15.137:60322) 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953effd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f954015f750 0x7f95400d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39166/0 (socket says 172.21.15.137:39166) 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953f7fe640 1 -- 172.21.15.137:0/3820286001 learned_addr learned my addr 172.21.15.137:0/3820286001 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953ffff640 1 --2- 172.21.15.137:0/3820286001 >> v2:172.21.15.170:3300/0 conn(0x7f95400d3ee0 0x7f95400b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953f7fe640 1 -- 172.21.15.137:0/3820286001 >> v2:172.21.15.170:3300/0 conn(0x7f95400d3ee0 msgr2=0x7f95400b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953f7fe640 1 --2- 172.21.15.137:0/3820286001 >> v2:172.21.15.170:3300/0 conn(0x7f95400d3ee0 0x7f95400b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953f7fe640 1 -- 172.21.15.137:0/3820286001 >> v1:172.21.15.137:6789/0 conn(0x7f954015f750 legacy=0x7f95400d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953f7fe640 1 -- 172.21.15.137:0/3820286001 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95400d0960 con 0x7f954015f370 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953e7fc640 1 -- 172.21.15.137:0/3820286001 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1246602480 0 0) 0x7f95400d03a0 con 0x7f954015f750 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.084+0000 7f953ffff640 1 --2- 172.21.15.137:0/3820286001 >> v2:172.21.15.170:3300/0 conn(0x7f95400d3ee0 0x7f95400b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:47.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f953f7fe640 1 --2- 172.21.15.137:0/3820286001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 0x7f95400cfd70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f95400c8cf0 tx=0x7f953002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173804b9e09ce53c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f953e7fc640 1 -- 172.21.15.137:0/3820286001 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530037070 con 0x7f954015f370 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f953e7fc640 1 -- 172.21.15.137:0/3820286001 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9530032440 con 0x7f954015f370 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f953e7fc640 1 -- 172.21.15.137:0/3820286001 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530032810 con 0x7f954015f370 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f954617f640 1 -- 172.21.15.137:0/3820286001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 msgr2=0x7f95400cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f954617f640 1 --2- 172.21.15.137:0/3820286001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 0x7f95400cfd70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f95400c8cf0 tx=0x7f953002a270 comp rx=0 tx=0).stop 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f954617f640 1 -- 172.21.15.137:0/3820286001 shutdown_connections 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f954617f640 1 --2- 172.21.15.137:0/3820286001 >> v2:172.21.15.170:3300/0 conn(0x7f95400d3ee0 0x7f95400b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f954617f640 1 --2- 172.21.15.137:0/3820286001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 0x7f95400cfd70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f954617f640 1 -- 172.21.15.137:0/3820286001 >> 172.21.15.137:0/3820286001 conn(0x7f954008ec10 msgr2=0x7f954009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f954617f640 1 -- 172.21.15.137:0/3820286001 shutdown_connections 2024-04-26T21:59:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.085+0000 7f954617f640 1 -- 172.21.15.137:0/3820286001 wait complete. 2024-04-26T21:59:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.086+0000 7f954617f640 1 Processor -- start 2024-04-26T21:59:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f954617f640 1 -- start start 2024-04-26T21:59:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f954617f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3ee0 0x7f954015d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f954617f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 0x7f9540161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f954617f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015f750 0x7f95400ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f954617f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95400b51c0 con 0x7f954015f370 2024-04-26T21:59:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f954617f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f95400d0f20 con 0x7f954015f750 2024-04-26T21:59:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f954617f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95400b5340 con 0x7f95400d3ee0 2024-04-26T21:59:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f953effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 0x7f9540161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f953effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 0x7f9540161c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:60330/0 (socket says 172.21.15.137:60330) 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.087+0000 7f953effd640 1 -- 172.21.15.137:0/1230711881 learned_addr learned my addr 172.21.15.137:0/1230711881 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f953ffff640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015f750 0x7f95400ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f953f7fe640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3ee0 0x7f954015d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f953effd640 1 -- 172.21.15.137:0/1230711881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3ee0 msgr2=0x7f954015d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f953effd640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3ee0 0x7f954015d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f953effd640 1 -- 172.21.15.137:0/1230711881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015f750 msgr2=0x7f95400ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f953effd640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015f750 0x7f95400ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f953effd640 1 -- 172.21.15.137:0/1230711881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95400b8120 con 0x7f954015f370 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f953ffff640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015f750 0x7f95400ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f953effd640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 0x7f9540161c40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f953400c420 tx=0x7f953400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f9527fff640 1 -- 172.21.15.137:0/1230711881 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95340074e0 con 0x7f954015f370 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f9527fff640 1 -- 172.21.15.137:0/1230711881 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95340047e0 con 0x7f954015f370 2024-04-26T21:59:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95400b8400 con 0x7f954015f370 2024-04-26T21:59:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f9527fff640 1 -- 172.21.15.137:0/1230711881 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9534004c10 con 0x7f954015f370 2024-04-26T21:59:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.088+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95400b89c0 con 0x7f954015f370 2024-04-26T21:59:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.089+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95400d4490 con 0x7f954015f370 2024-04-26T21:59:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.089+0000 7f9527fff640 1 -- 172.21.15.137:0/1230711881 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9534011070 con 0x7f954015f370 2024-04-26T21:59:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.090+0000 7f9527fff640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.090+0000 7f9527fff640 1 -- 172.21.15.137:0/1230711881 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f953408b720 con 0x7f954015f370 2024-04-26T21:59:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.090+0000 7f953f7fe640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.090+0000 7f953f7fe640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9530034000 tx=0x7f953002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:47.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.094+0000 7f9527fff640 1 -- 172.21.15.137:0/1230711881 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f95400d4490 con 0x7f954015f370 2024-04-26T21:59:47.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.306+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95400bb0f0 con 0x7f954015f370 2024-04-26T21:59:47.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.307+0000 7f9527fff640 1 -- 172.21.15.137:0/1230711881 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f95400bb0f0 con 0x7f954015f370 2024-04-26T21:59:47.307 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:47.307 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3532925157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3532925157},{"type":"v1","addr":"172.21.15.137:6836","nonce":3532925157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3509631448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3509631448},{"type":"v1","addr":"172.21.15.170:6834","nonce":3509631448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3228449407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3228449407},{"type":"v1","addr":"172.21.15.170:6835","nonce":3228449407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:59:33.028489+0000","modified":"2024-04-26T21:59:35.023196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1394398285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1394398285},{"type":"v1","addr":"172.21.15.137:6837","nonce":1394398285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5139,"qdb_cluster":[5139]},"id":2}]} 2024-04-26T21:59:47.307 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-04-26T21:59:47.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 msgr2=0x7f952c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:47.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9530034000 tx=0x7f953002e000 comp rx=0 tx=0).stop 2024-04-26T21:59:47.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 msgr2=0x7f9540161c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:47.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 0x7f9540161c40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f953400c420 tx=0x7f953400c8e0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 shutdown_connections 2024-04-26T21:59:47.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f954015f370 0x7f9540161c40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015f750 0x7f95400ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 --2- 172.21.15.137:0/1230711881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3ee0 0x7f954015d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:47.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 >> 172.21.15.137:0/1230711881 conn(0x7f954008ec10 msgr2=0x7f95400b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:47.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 shutdown_connections 2024-04-26T21:59:47.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:47.309+0000 7f954617f640 1 -- 172.21.15.137:0/1230711881 wait complete. 2024-04-26T21:59:47.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2024-04-26T21:59:47.437 INFO:teuthology.orchestra.run.smithi137.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-04-26T21:59:47.437 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-04-26T21:59:57.438 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-04-26T21:59:57.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.488+0000 7fd18b867f40 1 Processor -- start 2024-04-26T21:59:57.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.488+0000 7fd18b867f40 1 -- start start 2024-04-26T21:59:57.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd18b867f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f3b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd18b867f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f44ac00 0x55d48f45a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd18b867f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f452080 0x55d48f45aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd18b867f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d48f32ce40 con 0x7fd1740022d0 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd18b867f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d48f330e80 con 0x55d48f44ac00 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd18b867f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d48f3cd9b0 con 0x55d48f452080 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189361640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f3b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189361640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f3b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57230/0 (socket says 172.21.15.137:57230) 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189361640 1 -- 172.21.15.137:0/2790427092 learned_addr learned my addr 172.21.15.137:0/2790427092 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189b62640 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f452080 0x55d48f45aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd188b60640 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f44ac00 0x55d48f45a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189361640 1 -- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f452080 msgr2=0x55d48f45aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189361640 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f452080 0x55d48f45aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189361640 1 -- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f44ac00 msgr2=0x55d48f45a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189361640 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f44ac00 0x55d48f45a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189361640 1 -- 172.21.15.137:0/2790427092 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48f452cd0 con 0x7fd1740022d0 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd188b60640 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f44ac00 0x55d48f45a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:57.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.489+0000 7fd189b62640 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f452080 0x55d48f45aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd189361640 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f3b5420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd17c026440 tx=0x7fd17c050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df055fb237afac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd17b7fe640 1 -- 172.21.15.137:0/2790427092 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c001630 con 0x7fd1740022d0 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd17b7fe640 1 -- 172.21.15.137:0/2790427092 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17c066070 con 0x7fd1740022d0 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd17b7fe640 1 -- 172.21.15.137:0/2790427092 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17c061670 con 0x7fd1740022d0 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd18b867f40 1 -- 172.21.15.137:0/2790427092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 msgr2=0x55d48f3b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd18b867f40 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f3b5420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd17c026440 tx=0x7fd17c050000 comp rx=0 tx=0).stop 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd18b867f40 1 -- 172.21.15.137:0/2790427092 shutdown_connections 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd18b867f40 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f452080 0x55d48f45aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd18b867f40 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f44ac00 0x55d48f45a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd18b867f40 1 --2- 172.21.15.137:0/2790427092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f3b5420 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd18b867f40 1 -- 172.21.15.137:0/2790427092 >> 172.21.15.137:0/2790427092 conn(0x55d48f3cffd0 msgr2=0x55d48f45b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd18b867f40 1 -- 172.21.15.137:0/2790427092 shutdown_connections 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.490+0000 7fd18b867f40 1 -- 172.21.15.137:0/2790427092 wait complete. 2024-04-26T21:59:57.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.491+0000 7fd18b867f40 1 Processor -- start 2024-04-26T21:59:57.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.491+0000 7fd18b867f40 1 -- start start 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd18b867f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f44ac00 0x55d48f4468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd18b867f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f452080 0x55d48f44afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd18b867f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f44b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd18b867f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d48f452a30 con 0x7fd1740022d0 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd18b867f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d48f451ba0 con 0x55d48f452080 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd18b867f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d48f3cbcb0 con 0x55d48f44ac00 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd189b62640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f44b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd189b62640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f44b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57244/0 (socket says 172.21.15.137:57244) 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd189b62640 1 -- 172.21.15.137:0/1241953782 learned_addr learned my addr 172.21.15.137:0/1241953782 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd189361640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f44ac00 0x55d48f4468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd188b60640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f452080 0x55d48f44afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd189b62640 1 -- 172.21.15.137:0/1241953782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f44ac00 msgr2=0x55d48f4468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd189b62640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d48f44ac00 0x55d48f4468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd189b62640 1 -- 172.21.15.137:0/1241953782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f452080 msgr2=0x55d48f44afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd189b62640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d48f452080 0x55d48f44afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.492+0000 7fd189b62640 1 -- 172.21.15.137:0/1241953782 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48f387100 con 0x7fd1740022d0 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.493+0000 7fd189b62640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f44b520 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55d48f3897e0 tx=0x7fd18400e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.493+0000 7fd17a7fc640 1 -- 172.21.15.137:0/1241953782 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184017070 con 0x7fd1740022d0 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.493+0000 7fd17a7fc640 1 -- 172.21.15.137:0/1241953782 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd184006020 con 0x7fd1740022d0 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.493+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d48f386e20 con 0x7fd1740022d0 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.493+0000 7fd17a7fc640 1 -- 172.21.15.137:0/1241953782 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184013680 con 0x7fd1740022d0 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.493+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d48f44d410 con 0x7fd1740022d0 2024-04-26T21:59:57.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.494+0000 7fd17a7fc640 1 -- 172.21.15.137:0/1241953782 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd184013820 con 0x7fd1740022d0 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.495+0000 7fd17a7fc640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd16c06b2d0 0x7fd16c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.495+0000 7fd189361640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd16c06b2d0 0x7fd16c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.495+0000 7fd17a7fc640 1 -- 172.21.15.137:0/1241953782 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd18408a1d0 con 0x7fd1740022d0 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.495+0000 7fd18b867f40 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d48f449500 0x55d48f449920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.495+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d48f44dc10 con 0x55d48f449500 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.495+0000 7fd188b60640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d48f449500 0x55d48f449920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.495+0000 7fd189361640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd16c06b2d0 0x7fd16c06d790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd17c065000 tx=0x7fd17c06f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.495+0000 7fd188b60640 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d48f449500 0x55d48f449920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd188b60640 1 -- 172.21.15.137:0/1241953782 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fd180009950 con 0x55d48f449500 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d48f449500 msgr2=0x55d48f449920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d48f449500 0x55d48f449920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd16c06b2d0 msgr2=0x7fd16c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd16c06b2d0 0x7fd16c06d790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd17c065000 tx=0x7fd17c06f040 comp rx=0 tx=0).stop 2024-04-26T21:59:57.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 msgr2=0x55d48f44b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 --2- 172.21.15.137:0/1241953782 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd1740022d0 0x55d48f44b520 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55d48f3897e0 tx=0x7fd18400e890 comp rx=0 tx=0).stop 2024-04-26T21:59:57.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd189b62640 1 -- 172.21.15.137:0/1241953782 reap_dead start 2024-04-26T21:59:57.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 shutdown_connections 2024-04-26T21:59:57.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 >> 172.21.15.137:0/1241953782 conn(0x55d48f3cffd0 msgr2=0x55d48f3b5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 shutdown_connections 2024-04-26T21:59:57.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.496+0000 7fd18b867f40 1 -- 172.21.15.137:0/1241953782 wait complete. 2024-04-26T21:59:57.501 INFO:teuthology.orchestra.run.smithi137.stdout:mytag 2024-04-26T21:59:57.501 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-04-26T21:59:57.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.546+0000 7ff0f790df40 1 Processor -- start 2024-04-26T21:59:57.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f790df40 1 -- start start 2024-04-26T21:59:57.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f790df40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 0x55c5238c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f790df40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c5238802a0 0x55c5239e7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f790df40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5239562d0 0x55c5239e7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f790df40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c523827e40 con 0x55c5239562d0 2024-04-26T21:59:57.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f790df40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c52382be80 con 0x55c52387ef10 2024-04-26T21:59:57.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f790df40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c5238829d0 con 0x55c5238802a0 2024-04-26T21:59:57.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f5c08640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5239562d0 0x55c5239e7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f5c08640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5239562d0 0x55c5239e7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57252/0 (socket says 172.21.15.137:57252) 2024-04-26T21:59:57.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f5c08640 1 -- 172.21.15.137:0/3522602031 learned_addr learned my addr 172.21.15.137:0/3522602031 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.547+0000 7ff0f5407640 1 --2- 172.21.15.137:0/3522602031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 0x55c5238c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f4c06640 1 --2- 172.21.15.137:0/3522602031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c5238802a0 0x55c5239e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f5c08640 1 -- 172.21.15.137:0/3522602031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c5238802a0 msgr2=0x55c5239e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f5c08640 1 --2- 172.21.15.137:0/3522602031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c5238802a0 0x55c5239e7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f5c08640 1 -- 172.21.15.137:0/3522602031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 msgr2=0x55c5238c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f5c08640 1 --2- 172.21.15.137:0/3522602031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 0x55c5238c7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f5c08640 1 -- 172.21.15.137:0/3522602031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c52394d950 con 0x55c5239562d0 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f5c08640 1 --2- 172.21.15.137:0/3522602031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5239562d0 0x55c5239e7dd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000b320 tx=0x7ff0f000b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe8830e7447544 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0e77fe640 1 -- 172.21.15.137:0/3522602031 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0012020 con 0x55c5239562d0 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0e77fe640 1 -- 172.21.15.137:0/3522602031 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f000d690 con 0x55c5239562d0 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0e77fe640 1 -- 172.21.15.137:0/3522602031 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000da80 con 0x55c5239562d0 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f790df40 1 -- 172.21.15.137:0/3522602031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5239562d0 msgr2=0x55c5239e7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f790df40 1 --2- 172.21.15.137:0/3522602031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5239562d0 0x55c5239e7dd0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000b320 tx=0x7ff0f000b7e0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f790df40 1 -- 172.21.15.137:0/3522602031 shutdown_connections 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f790df40 1 --2- 172.21.15.137:0/3522602031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5239562d0 0x55c5239e7dd0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f790df40 1 --2- 172.21.15.137:0/3522602031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c5238802a0 0x55c5239e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f790df40 1 --2- 172.21.15.137:0/3522602031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 0x55c5238c7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f790df40 1 -- 172.21.15.137:0/3522602031 >> 172.21.15.137:0/3522602031 conn(0x55c5238cafd0 msgr2=0x55c5238cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.548+0000 7ff0f790df40 1 -- 172.21.15.137:0/3522602031 shutdown_connections 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.549+0000 7ff0f790df40 1 -- 172.21.15.137:0/3522602031 wait complete. 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.549+0000 7ff0f790df40 1 Processor -- start 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.549+0000 7ff0f790df40 1 -- start start 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f790df40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 0x55c523949740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f790df40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5238802a0 0x55c523957a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f790df40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c5239562d0 0x55c523957f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f790df40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c523954700 con 0x55c5238802a0 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f790df40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c52394fef0 con 0x55c52387ef10 2024-04-26T21:59:57.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f790df40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c523954e70 con 0x55c5239562d0 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f4c06640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5238802a0 0x55c523957a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f4c06640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5238802a0 0x55c523957a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57254/0 (socket says 172.21.15.137:57254) 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f4c06640 1 -- 172.21.15.137:0/2287073288 learned_addr learned my addr 172.21.15.137:0/2287073288 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f5407640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 0x55c523949740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f5c08640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c5239562d0 0x55c523957f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f4c06640 1 -- 172.21.15.137:0/2287073288 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c5239562d0 msgr2=0x55c523957f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f4c06640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c5239562d0 0x55c523957f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f4c06640 1 -- 172.21.15.137:0/2287073288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 msgr2=0x55c523949740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f4c06640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 0x55c523949740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f4c06640 1 -- 172.21.15.137:0/2287073288 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5238ac540 con 0x55c5238802a0 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f5407640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c52387ef10 0x55c523949740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.550+0000 7ff0f4c06640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5238802a0 0x55c523957a10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec057040 tx=0x7ff0ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.551+0000 7ff0e67fc640 1 -- 172.21.15.137:0/2287073288 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec064020 con 0x55c5238802a0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.551+0000 7ff0e67fc640 1 -- 172.21.15.137:0/2287073288 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ec05a040 con 0x55c5238802a0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.551+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5238ac820 con 0x55c5238802a0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.551+0000 7ff0e67fc640 1 -- 172.21.15.137:0/2287073288 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec059070 con 0x55c5238802a0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.551+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5238aefd0 con 0x55c5238802a0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.552+0000 7ff0e67fc640 1 -- 172.21.15.137:0/2287073288 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff0ec067020 con 0x55c5238802a0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.552+0000 7ff0e67fc640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0d806b2d0 0x7ff0d806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0e67fc640 1 -- 172.21.15.137:0/2287073288 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff0ec0cdf30 con 0x55c5238802a0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0f5407640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0d806b2d0 0x7ff0d806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0f790df40 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c523956c50 0x55c5239509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c523950f10 con 0x55c523956c50 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0f5c08640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c523956c50 0x55c5239509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0f5407640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0d806b2d0 0x7ff0d806d790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8000f80 tx=0x7ff0e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0f5c08640 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c523956c50 0x55c5239509d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0f5c08640 1 -- 172.21.15.137:0/2287073288 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7ff0f000d840 con 0x55c523956c50 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c523956c50 msgr2=0x55c5239509d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.553+0000 7ff0f790df40 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c523956c50 0x55c5239509d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.554+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0d806b2d0 msgr2=0x7ff0d806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.554+0000 7ff0f790df40 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0d806b2d0 0x7ff0d806d790 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8000f80 tx=0x7ff0e8008040 comp rx=0 tx=0).stop 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.554+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5238802a0 msgr2=0x55c523957a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.554+0000 7ff0f790df40 1 --2- 172.21.15.137:0/2287073288 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c5238802a0 0x55c523957a10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec057040 tx=0x7ff0ec002fb0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.554+0000 7ff0f5c08640 1 -- 172.21.15.137:0/2287073288 reap_dead start 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.554+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 shutdown_connections 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.554+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 >> 172.21.15.137:0/2287073288 conn(0x55c5238cafd0 msgr2=0x55c5238c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.554+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 shutdown_connections 2024-04-26T21:59:57.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.554+0000 7ff0f790df40 1 -- 172.21.15.137:0/2287073288 wait complete. 2024-04-26T21:59:57.560 INFO:teuthology.orchestra.run.smithi137.stdout:mytag 2024-04-26T21:59:57.560 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-26T21:59:57.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa70a11df40 1 Processor -- start 2024-04-26T21:59:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa70a11df40 1 -- start start 2024-04-26T21:59:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa70a11df40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f00030f0 0x563894bddcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa70a11df40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563894c715c0 0x563894c69a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa70a11df40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563894c6a2d0 0x563894be6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa70a11df40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563894b43e40 con 0x7fa6f00030f0 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa70a11df40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563894b47e80 con 0x563894c6a2d0 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa70a11df40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563894be7760 con 0x563894c715c0 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa7072ee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f00030f0 0x563894bddcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa7072ee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f00030f0 0x563894bddcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57270/0 (socket says 172.21.15.137:57270) 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.604+0000 7fa7072ee640 1 -- 172.21.15.137:0/3062777745 learned_addr learned my addr 172.21.15.137:0/3062777745 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa707aef640 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563894c6a2d0 0x563894be6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa706aed640 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563894c715c0 0x563894c69a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa7072ee640 1 -- 172.21.15.137:0/3062777745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563894c715c0 msgr2=0x563894c69a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa7072ee640 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563894c715c0 0x563894c69a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa7072ee640 1 -- 172.21.15.137:0/3062777745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563894c6a2d0 msgr2=0x563894be6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa7072ee640 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563894c6a2d0 0x563894be6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa7072ee640 1 -- 172.21.15.137:0/3062777745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563894c73b20 con 0x7fa6f00030f0 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa707aef640 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563894c6a2d0 0x563894be6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa7072ee640 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f00030f0 0x563894bddcd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800a830 tx=0x7fa6f8005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378fa5fc1176ab22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa705aeb640 1 -- 172.21.15.137:0/3062777745 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8017030 con 0x7fa6f00030f0 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa705aeb640 1 -- 172.21.15.137:0/3062777745 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f8010ab0 con 0x7fa6f00030f0 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa705aeb640 1 -- 172.21.15.137:0/3062777745 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8010c80 con 0x7fa6f00030f0 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa70a11df40 1 -- 172.21.15.137:0/3062777745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f00030f0 msgr2=0x563894bddcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa70a11df40 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f00030f0 0x563894bddcd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa6f800a830 tx=0x7fa6f8005d80 comp rx=0 tx=0).stop 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa70a11df40 1 -- 172.21.15.137:0/3062777745 shutdown_connections 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa70a11df40 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563894c6a2d0 0x563894be6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa70a11df40 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563894c715c0 0x563894c69a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa70a11df40 1 --2- 172.21.15.137:0/3062777745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa6f00030f0 0x563894bddcd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa70a11df40 1 -- 172.21.15.137:0/3062777745 >> 172.21.15.137:0/3062777745 conn(0x563894b9b210 msgr2=0x563894bdce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa70a11df40 1 -- 172.21.15.137:0/3062777745 shutdown_connections 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.605+0000 7fa70a11df40 1 -- 172.21.15.137:0/3062777745 wait complete. 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.606+0000 7fa70a11df40 1 Processor -- start 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.606+0000 7fa70a11df40 1 -- start start 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa70a11df40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563894c6a2d0 0x563894c65680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa70a11df40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563894c715c0 0x563894be6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa70a11df40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6f00030f0 0x563894be6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa70a11df40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563894c73dc0 con 0x563894c6a2d0 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa70a11df40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563894bdd560 con 0x7fa6f00030f0 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa70a11df40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563894c740a0 con 0x563894c715c0 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa7072ee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563894c6a2d0 0x563894c65680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa7072ee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563894c6a2d0 0x563894c65680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57272/0 (socket says 172.21.15.137:57272) 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa7072ee640 1 -- 172.21.15.137:0/3340811014 learned_addr learned my addr 172.21.15.137:0/3340811014 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa707aef640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6f00030f0 0x563894be6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa706aed640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563894c715c0 0x563894be6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa7072ee640 1 -- 172.21.15.137:0/3340811014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563894c715c0 msgr2=0x563894be6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa7072ee640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563894c715c0 0x563894be6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa7072ee640 1 -- 172.21.15.137:0/3340811014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6f00030f0 msgr2=0x563894be6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa7072ee640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa6f00030f0 0x563894be6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa7072ee640 1 -- 172.21.15.137:0/3340811014 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563894b9c780 con 0x563894c6a2d0 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa7072ee640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563894c6a2d0 0x563894c65680 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8013970 tx=0x7fa6f8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa704ae9640 1 -- 172.21.15.137:0/3340811014 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8005a80 con 0x563894c6a2d0 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa704ae9640 1 -- 172.21.15.137:0/3340811014 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6f8013d60 con 0x563894c6a2d0 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563894b9ca60 con 0x563894c6a2d0 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa704ae9640 1 -- 172.21.15.137:0/3340811014 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8026630 con 0x563894c6a2d0 2024-04-26T21:59:57.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.607+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563894b9d020 con 0x563894c6a2d0 2024-04-26T21:59:57.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.609+0000 7fa704ae9640 1 -- 172.21.15.137:0/3340811014 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa6f8024030 con 0x563894c6a2d0 2024-04-26T21:59:57.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.609+0000 7fa704ae9640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa6f406b2d0 0x7fa6f406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.609+0000 7fa706aed640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa6f406b2d0 0x7fa6f406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.609+0000 7fa704ae9640 1 -- 172.21.15.137:0/3340811014 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa6f808c460 con 0x563894c6a2d0 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.609+0000 7fa70a11df40 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x563894c69a60 0x563894c6b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.609+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:1 5.36 5:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563894c6be60 con 0x563894c69a60 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa707aef640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x563894c69a60 0x563894c6b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa706aed640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa6f406b2d0 0x7fa6f406d790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc055000 tx=0x7fa6fc053000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa707aef640 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x563894c69a60 0x563894c6b920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa707aef640 1 -- 172.21.15.137:0/3340811014 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fa700009540 con 0x563894c69a60 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x563894c69a60 msgr2=0x563894c6b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x563894c69a60 0x563894c6b920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa6f406b2d0 msgr2=0x7fa6f406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa6f406b2d0 0x7fa6f406d790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc055000 tx=0x7fa6fc053000 comp rx=0 tx=0).stop 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563894c6a2d0 msgr2=0x563894c65680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 --2- 172.21.15.137:0/3340811014 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563894c6a2d0 0x563894c65680 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8013970 tx=0x7fa6f8003330 comp rx=0 tx=0).stop 2024-04-26T21:59:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa707aef640 1 -- 172.21.15.137:0/3340811014 reap_dead start 2024-04-26T21:59:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 shutdown_connections 2024-04-26T21:59:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 >> 172.21.15.137:0/3340811014 conn(0x563894b9b210 msgr2=0x563894bdce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 shutdown_connections 2024-04-26T21:59:57.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.610+0000 7fa70a11df40 1 -- 172.21.15.137:0/3340811014 wait complete. 2024-04-26T21:59:57.617 INFO:teuthology.orchestra.run.smithi137.stdout:mytag 2024-04-26T21:59:57.617 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-26T21:59:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.659+0000 7fa622d56f40 1 Processor -- start 2024-04-26T21:59:57.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa622d56f40 1 -- start start 2024-04-26T21:59:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa622d56f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e07f18eb0 0x555e07fbc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa622d56f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07f2fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa622d56f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e07fc4fd0 0x555e07f30230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa622d56f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555e07eeb510 con 0x555e07f33b40 2024-04-26T21:59:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa622d56f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555e07e91e40 con 0x555e07fc4fd0 2024-04-26T21:59:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa622d56f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555e07f17ce0 con 0x555e07f18eb0 2024-04-26T21:59:57.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa62004f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07f2fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa62004f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07f2fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57280/0 (socket says 172.21.15.137:57280) 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa62004f640 1 -- 172.21.15.137:0/2508127728 learned_addr learned my addr 172.21.15.137:0/2508127728 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa620850640 1 --2- 172.21.15.137:0/2508127728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e07f18eb0 0x555e07fbc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.660+0000 7fa621051640 1 --2- 172.21.15.137:0/2508127728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e07fc4fd0 0x555e07f30230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa62004f640 1 -- 172.21.15.137:0/2508127728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e07f18eb0 msgr2=0x555e07fbc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa62004f640 1 --2- 172.21.15.137:0/2508127728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e07f18eb0 0x555e07fbc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa62004f640 1 -- 172.21.15.137:0/2508127728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e07fc4fd0 msgr2=0x555e07f30230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa62004f640 1 --2- 172.21.15.137:0/2508127728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e07fc4fd0 0x555e07f30230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa62004f640 1 -- 172.21.15.137:0/2508127728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e07fc0710 con 0x555e07f33b40 2024-04-26T21:59:57.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa62004f640 1 --2- 172.21.15.137:0/2508127728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07f2fcf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa6140099a0 tx=0x7fa614005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b629e27296fed4a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa61f04d640 1 -- 172.21.15.137:0/2508127728 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614008a30 con 0x555e07f33b40 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa61f04d640 1 -- 172.21.15.137:0/2508127728 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa614018070 con 0x555e07f33b40 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa61f04d640 1 -- 172.21.15.137:0/2508127728 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614008dd0 con 0x555e07f33b40 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa622d56f40 1 -- 172.21.15.137:0/2508127728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 msgr2=0x555e07f2fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa622d56f40 1 --2- 172.21.15.137:0/2508127728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07f2fcf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa6140099a0 tx=0x7fa614005a00 comp rx=0 tx=0).stop 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa622d56f40 1 -- 172.21.15.137:0/2508127728 shutdown_connections 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa622d56f40 1 --2- 172.21.15.137:0/2508127728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07f2fcf0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa622d56f40 1 --2- 172.21.15.137:0/2508127728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e07fc4fd0 0x555e07f30230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa622d56f40 1 --2- 172.21.15.137:0/2508127728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e07f18eb0 0x555e07fbc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa622d56f40 1 -- 172.21.15.137:0/2508127728 >> 172.21.15.137:0/2508127728 conn(0x555e07ee8dd0 msgr2=0x555e07fc5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa622d56f40 1 -- 172.21.15.137:0/2508127728 shutdown_connections 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.661+0000 7fa622d56f40 1 -- 172.21.15.137:0/2508127728 wait complete. 2024-04-26T21:59:57.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.662+0000 7fa622d56f40 1 Processor -- start 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.662+0000 7fa622d56f40 1 -- start start 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa622d56f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e07f18eb0 0x555e07fa41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa622d56f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07fbcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa622d56f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e07fc4fd0 0x555e07eec140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa622d56f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555e07fbce20 con 0x555e07f33b40 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa622d56f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555e07eeae70 con 0x555e07f18eb0 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa622d56f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555e07eeb0c0 con 0x555e07fc4fd0 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa62004f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07fbcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa62004f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07fbcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57284/0 (socket says 172.21.15.137:57284) 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa62004f640 1 -- 172.21.15.137:0/3720514154 learned_addr learned my addr 172.21.15.137:0/3720514154 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa621051640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e07fc4fd0 0x555e07eec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa620850640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e07f18eb0 0x555e07fa41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa62004f640 1 -- 172.21.15.137:0/3720514154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e07fc4fd0 msgr2=0x555e07eec140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa62004f640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e07fc4fd0 0x555e07eec140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa62004f640 1 -- 172.21.15.137:0/3720514154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e07f18eb0 msgr2=0x555e07fa41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa62004f640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e07f18eb0 0x555e07fa41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa62004f640 1 -- 172.21.15.137:0/3720514154 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e07fa46e0 con 0x555e07f33b40 2024-04-26T21:59:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa62004f640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07fbcfd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c010 tx=0x7fa614003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa61e04b640 1 -- 172.21.15.137:0/3720514154 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614026670 con 0x555e07f33b40 2024-04-26T21:59:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa61e04b640 1 -- 172.21.15.137:0/3720514154 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa614021070 con 0x555e07f33b40 2024-04-26T21:59:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e07f2de80 con 0x555e07f33b40 2024-04-26T21:59:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa61e04b640 1 -- 172.21.15.137:0/3720514154 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614026a50 con 0x555e07f33b40 2024-04-26T21:59:57.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.663+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e07fbd990 con 0x555e07f33b40 2024-04-26T21:59:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.665+0000 7fa61e04b640 1 -- 172.21.15.137:0/3720514154 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa614026bf0 con 0x555e07f33b40 2024-04-26T21:59:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.665+0000 7fa61e04b640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa60c06b2d0 0x7fa60c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.665+0000 7fa61e04b640 1 -- 172.21.15.137:0/3720514154 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa61408c130 con 0x555e07f33b40 2024-04-26T21:59:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.665+0000 7fa620850640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa60c06b2d0 0x7fa60c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.665+0000 7fa622d56f40 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x555e07fb9070 0x555e07f2ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.665+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:1 5.19 5:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e07f2f370 con 0x555e07fb9070 2024-04-26T21:59:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa621051640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x555e07fb9070 0x555e07f2ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa620850640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa60c06b2d0 0x7fa60c06d790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x555e07f30740 tx=0x7fa618006af0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa621051640 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x555e07fb9070 0x555e07f2ee30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa621051640 1 -- 172.21.15.137:0/3720514154 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) ==== 164+0+9 (crc 0 0 0) 0x7fa61005c040 con 0x555e07fb9070 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x555e07fb9070 msgr2=0x555e07f2ee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x555e07fb9070 0x555e07f2ee30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa60c06b2d0 msgr2=0x7fa60c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa60c06b2d0 0x7fa60c06d790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x555e07f30740 tx=0x7fa618006af0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 msgr2=0x555e07fbcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 --2- 172.21.15.137:0/3720514154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e07f33b40 0x555e07fbcfd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c010 tx=0x7fa614003020 comp rx=0 tx=0).stop 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa621051640 1 -- 172.21.15.137:0/3720514154 reap_dead start 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 shutdown_connections 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 >> 172.21.15.137:0/3720514154 conn(0x555e07ee8dd0 msgr2=0x555e07fc0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 shutdown_connections 2024-04-26T21:59:57.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.666+0000 7fa622d56f40 1 -- 172.21.15.137:0/3720514154 wait complete. 2024-04-26T21:59:57.674 INFO:teuthology.orchestra.run.smithi137.stdout:mytag 2024-04-26T21:59:57.674 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-26T21:59:57.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.756+0000 7f7e1e5b7f40 1 Processor -- start 2024-04-26T21:59:57.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.756+0000 7f7e1e5b7f40 1 -- start start 2024-04-26T21:59:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e1e5b7f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecae9bf90 0x561ecaf6a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e1e5b7f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaee26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e1e5b7f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561ecaf70de0 0x561ecaf60640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e1e5b7f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561ecaee3760 con 0x561ecaee0940 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e1e5b7f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561ecae3fe40 con 0x561ecae9bf90 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e1e5b7f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561ecaec7630 con 0x561ecaf70de0 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e138b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaee26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e138b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaee26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57298/0 (socket says 172.21.15.137:57298) 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e138b0640 1 -- 172.21.15.137:0/1055806702 learned_addr learned my addr 172.21.15.137:0/1055806702 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e138b0640 1 -- 172.21.15.137:0/1055806702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561ecaf70de0 msgr2=0x561ecaf60640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e138b0640 1 --2- 172.21.15.137:0/1055806702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561ecaf70de0 0x561ecaf60640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e138b0640 1 -- 172.21.15.137:0/1055806702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecae9bf90 msgr2=0x561ecaf6a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e1c0b1640 1 --2- 172.21.15.137:0/1055806702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecae9bf90 0x561ecaf6a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e138b0640 1 --2- 172.21.15.137:0/1055806702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecae9bf90 0x561ecaf6a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e138b0640 1 -- 172.21.15.137:0/1055806702 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ecae976f0 con 0x561ecaee0940 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e138b0640 1 --2- 172.21.15.137:0/1055806702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaee26c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400a7a0 tx=0x7f7e0400a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409d3c7323639b1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.757+0000 7f7e1b0af640 1 -- 172.21.15.137:0/1055806702 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04019070 con 0x561ecaee0940 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1b0af640 1 -- 172.21.15.137:0/1055806702 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e04007600 con 0x561ecaee0940 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1b0af640 1 -- 172.21.15.137:0/1055806702 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e040079d0 con 0x561ecaee0940 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/1055806702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 msgr2=0x561ecaee26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1e5b7f40 1 --2- 172.21.15.137:0/1055806702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaee26c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400a7a0 tx=0x7f7e0400a890 comp rx=0 tx=0).stop 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/1055806702 shutdown_connections 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1e5b7f40 1 --2- 172.21.15.137:0/1055806702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaee26c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1e5b7f40 1 --2- 172.21.15.137:0/1055806702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561ecaf70de0 0x561ecaf60640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1e5b7f40 1 --2- 172.21.15.137:0/1055806702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecae9bf90 0x561ecaf6a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/1055806702 >> 172.21.15.137:0/1055806702 conn(0x561ecae97210 msgr2=0x561ecaec5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/1055806702 shutdown_connections 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.758+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/1055806702 wait complete. 2024-04-26T21:59:57.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1e5b7f40 1 Processor -- start 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1e5b7f40 1 -- start start 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1e5b7f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561ecae9bf90 0x561ecaf5fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1e5b7f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaf5c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1e5b7f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecaf70de0 0x561ecaf61530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1e5b7f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561ecaf6a260 con 0x561ecaee0940 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1e5b7f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561ecaf6ac30 con 0x561ecaf70de0 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1e5b7f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561ecae9ae50 con 0x561ecae9bf90 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e138b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaf5c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e138b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaf5c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57304/0 (socket says 172.21.15.137:57304) 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e138b0640 1 -- 172.21.15.137:0/2090724518 learned_addr learned my addr 172.21.15.137:0/2090724518 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1c0b1640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561ecae9bf90 0x561ecaf5fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.759+0000 7f7e1c8b2640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecaf70de0 0x561ecaf61530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e138b0640 1 -- 172.21.15.137:0/2090724518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561ecae9bf90 msgr2=0x561ecaf5fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e138b0640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561ecae9bf90 0x561ecaf5fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e138b0640 1 -- 172.21.15.137:0/2090724518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecaf70de0 msgr2=0x561ecaf61530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e138b0640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecaf70de0 0x561ecaf61530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e138b0640 1 -- 172.21.15.137:0/2090724518 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ecaf6b9c0 con 0x561ecaee0940 2024-04-26T21:59:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e138b0640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaf5c8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7e04017040 tx=0x7f7e04003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e1a0ad640 1 -- 172.21.15.137:0/2090724518 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04019050 con 0x561ecaee0940 2024-04-26T21:59:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e1a0ad640 1 -- 172.21.15.137:0/2090724518 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e0401a040 con 0x561ecaee0940 2024-04-26T21:59:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e1a0ad640 1 -- 172.21.15.137:0/2090724518 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e040148c0 con 0x561ecaee0940 2024-04-26T21:59:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ecaf6b6e0 con 0x561ecaee0940 2024-04-26T21:59:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.760+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ecaf5efa0 con 0x561ecaee0940 2024-04-26T21:59:57.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.761+0000 7f7e1a0ad640 1 -- 172.21.15.137:0/2090724518 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e04027030 con 0x561ecaee0940 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.762+0000 7f7e1a0ad640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7dfc06b300 0x7f7dfc06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.762+0000 7f7e1c0b1640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7dfc06b300 0x7f7dfc06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.762+0000 7f7e1a0ad640 1 -- 172.21.15.137:0/2090724518 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7e0408b5a0 con 0x561ecaee0940 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.762+0000 7f7e1e5b7f40 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x561ecaec5760 0x561ecaf671d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.762+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:1 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561ecaee3260 con 0x561ecaec5760 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.762+0000 7f7e1c8b2640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x561ecaec5760 0x561ecaf671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.762+0000 7f7e1c0b1640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7dfc06b300 0x7f7dfc06d7c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x561ecae9d330 tx=0x7f7e0c050000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.762+0000 7f7e1c8b2640 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x561ecaec5760 0x561ecaf671d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1c8b2640 1 -- 172.21.15.137:0/2090724518 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f7e14003800 con 0x561ecaec5760 2024-04-26T21:59:57.767 INFO:teuthology.orchestra.run.smithi137.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x561ecaec5760 msgr2=0x561ecaf671d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x561ecaec5760 0x561ecaf671d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7dfc06b300 msgr2=0x7f7dfc06d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7dfc06b300 0x7f7dfc06d7c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x561ecae9d330 tx=0x7f7e0c050000 comp rx=0 tx=0).stop 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 msgr2=0x561ecaf5c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 --2- 172.21.15.137:0/2090724518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561ecaee0940 0x561ecaf5c8f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7e04017040 tx=0x7f7e04003020 comp rx=0 tx=0).stop 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1c8b2640 1 -- 172.21.15.137:0/2090724518 reap_dead start 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 shutdown_connections 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 >> 172.21.15.137:0/2090724518 conn(0x561ecae97210 msgr2=0x561ecaf6afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 shutdown_connections 2024-04-26T21:59:57.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:57.763+0000 7f7e1e5b7f40 1 -- 172.21.15.137:0/2090724518 wait complete. 2024-04-26T21:59:57.769 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T21:59:57.769 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T21:59:57.856 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T21:59:57.917 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T21:59:57.917 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T21:59:57.917 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:57.917 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:57.932 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T21:59:57.933 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T21:59:57.933 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:57.933 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:57.950 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T21:59:57.950 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T21:59:57.951 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T21:59:57.951 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:57.987 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T21:59:57.987 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T21:59:57.987 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T21:59:57.987 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T21:59:58.007 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T21:59:58.007 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:58.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.124+0000 7f108a46d640 1 Processor -- start 2024-04-26T21:59:58.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.124+0000 7f108a46d640 1 -- start start 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f108a46d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f10840d11b0 0x7f108406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f108a46d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f108406e2c0 0x7f108415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f108a46d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10840d1740 con 0x7f10840cf2e0 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f108a46d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f108406e710 con 0x7f108406e2c0 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f108a46d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f10840d1a20 con 0x7f10840d11b0 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f1088a0a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f108406e2c0 0x7f108415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f1083fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f10840cf2e0 0x7f108406d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54716/0 (socket says 172.21.15.137:54716) 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f1083fff640 1 -- 172.21.15.137:0/989694842 learned_addr learned my addr 172.21.15.137:0/989694842 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f10837fe640 1 --2- 172.21.15.137:0/989694842 >> v2:172.21.15.170:3300/0 conn(0x7f10840d11b0 0x7f108406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f1088a0a640 1 -- 172.21.15.137:0/989694842 >> v2:172.21.15.170:3300/0 conn(0x7f10840d11b0 msgr2=0x7f108406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:58.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f1088a0a640 1 --2- 172.21.15.137:0/989694842 >> v2:172.21.15.170:3300/0 conn(0x7f10840d11b0 0x7f108406dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f1088a0a640 1 -- 172.21.15.137:0/989694842 >> v1:172.21.15.137:6789/0 conn(0x7f10840cf2e0 legacy=0x7f108406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f1088a0a640 1 -- 172.21.15.137:0/989694842 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10840d1d00 con 0x7f108406e2c0 2024-04-26T21:59:58.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.125+0000 7f1082ffd640 1 -- 172.21.15.137:0/989694842 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028992875 0 0) 0x7f10840d1740 con 0x7f10840cf2e0 2024-04-26T21:59:58.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.126+0000 7f1088a0a640 1 --2- 172.21.15.137:0/989694842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f108406e2c0 0x7f108415ebe0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f107c009d90 tx=0x7f107c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408ef680517809d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:58.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.126+0000 7f1082ffd640 1 -- 172.21.15.137:0/989694842 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c007740 con 0x7f108406e2c0 2024-04-26T21:59:58.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.126+0000 7f1082ffd640 1 -- 172.21.15.137:0/989694842 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c0078e0 con 0x7f108406e2c0 2024-04-26T21:59:58.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.126+0000 7f1082ffd640 1 -- 172.21.15.137:0/989694842 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c007cb0 con 0x7f108406e2c0 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.127+0000 7f108a46d640 1 -- 172.21.15.137:0/989694842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f108406e2c0 msgr2=0x7f108415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.127+0000 7f108a46d640 1 --2- 172.21.15.137:0/989694842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f108406e2c0 0x7f108415ebe0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f107c009d90 tx=0x7f107c02a6a0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.127+0000 7f108a46d640 1 -- 172.21.15.137:0/989694842 shutdown_connections 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.127+0000 7f108a46d640 1 --2- 172.21.15.137:0/989694842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f108406e2c0 0x7f108415ebe0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.127+0000 7f108a46d640 1 --2- 172.21.15.137:0/989694842 >> v2:172.21.15.170:3300/0 conn(0x7f10840d11b0 0x7f108406dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.127+0000 7f108a46d640 1 -- 172.21.15.137:0/989694842 >> 172.21.15.137:0/989694842 conn(0x7f10840b4a60 msgr2=0x7f10840b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.127+0000 7f108a46d640 1 -- 172.21.15.137:0/989694842 shutdown_connections 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.127+0000 7f108a46d640 1 -- 172.21.15.137:0/989694842 wait complete. 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.128+0000 7f108a46d640 1 Processor -- start 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.128+0000 7f108a46d640 1 -- start start 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f108a46d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f108406e2c0 0x7f10840afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f108a46d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10840cf2e0 0x7f10841603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f108a46d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10840d11b0 0x7f10840b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f108a46d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f10840cf6c0 con 0x7f10840cf2e0 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f108a46d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f10840d22c0 con 0x7f10840d11b0 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f108a46d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f10840cf840 con 0x7f108406e2c0 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f10837fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10840cf2e0 0x7f10841603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f10837fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10840cf2e0 0x7f10841603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57316/0 (socket says 172.21.15.137:57316) 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f10837fe640 1 -- 172.21.15.137:0/3548746718 learned_addr learned my addr 172.21.15.137:0/3548746718 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f1088a0a640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10840d11b0 0x7f10840b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f1083fff640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f108406e2c0 0x7f10840afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f10837fe640 1 -- 172.21.15.137:0/3548746718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f108406e2c0 msgr2=0x7f10840afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f10837fe640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f108406e2c0 0x7f10840afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f10837fe640 1 -- 172.21.15.137:0/3548746718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10840d11b0 msgr2=0x7f10840b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f10837fe640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10840d11b0 0x7f10840b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f10837fe640 1 -- 172.21.15.137:0/3548746718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10840b1ca0 con 0x7f10840cf2e0 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f10837fe640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10840cf2e0 0x7f10841603b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f107800d5f0 tx=0x7f107800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f1080ff9640 1 -- 172.21.15.137:0/3548746718 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10780125f0 con 0x7f10840cf2e0 2024-04-26T21:59:58.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f1080ff9640 1 -- 172.21.15.137:0/3548746718 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1078019070 con 0x7f10840cf2e0 2024-04-26T21:59:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10840b1f80 con 0x7f10840cf2e0 2024-04-26T21:59:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f1080ff9640 1 -- 172.21.15.137:0/3548746718 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10780129d0 con 0x7f10840cf2e0 2024-04-26T21:59:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.129+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10840b0260 con 0x7f10840cf2e0 2024-04-26T21:59:58.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.130+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108406a290 con 0x7f10840cf2e0 2024-04-26T21:59:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.131+0000 7f1080ff9640 1 -- 172.21.15.137:0/3548746718 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1078012b70 con 0x7f10840cf2e0 2024-04-26T21:59:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.131+0000 7f1080ff9640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f107006c8f0 0x7f107006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.131+0000 7f1083fff640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f107006c8f0 0x7f107006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.131+0000 7f1080ff9640 1 -- 172.21.15.137:0/3548746718 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f107808bf40 con 0x7f10840cf2e0 2024-04-26T21:59:58.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.132+0000 7f1083fff640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f107006c8f0 0x7f107006edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1074000f60 tx=0x7f1074007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:58.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.136+0000 7f1080ff9640 1 -- 172.21.15.137:0/3548746718 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f107805a380 con 0x7f10840cf2e0 2024-04-26T21:59:58.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.347+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10840b8a80 con 0x7f10840cf2e0 2024-04-26T21:59:58.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.348+0000 7f1080ff9640 1 -- 172.21.15.137:0/3548746718 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f1078059c80 con 0x7f10840cf2e0 2024-04-26T21:59:58.348 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:58.348 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3532925157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3532925157},{"type":"v1","addr":"172.21.15.137:6836","nonce":3532925157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3509631448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3509631448},{"type":"v1","addr":"172.21.15.170:6834","nonce":3509631448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3228449407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3228449407},{"type":"v1","addr":"172.21.15.170:6835","nonce":3228449407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:59:33.028489+0000","modified":"2024-04-26T21:59:35.023196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1394398285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1394398285},{"type":"v1","addr":"172.21.15.137:6837","nonce":1394398285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5139,"qdb_cluster":[5139]},"id":2}]} 2024-04-26T21:59:58.348 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-04-26T21:59:58.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f107006c8f0 msgr2=0x7f107006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f107006c8f0 0x7f107006edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1074000f60 tx=0x7f1074007c00 comp rx=0 tx=0).stop 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10840cf2e0 msgr2=0x7f10841603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10840cf2e0 0x7f10841603b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f107800d5f0 tx=0x7f107800dab0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 shutdown_connections 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f107006c8f0 0x7f107006edb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f10840cf2e0 0x7f10841603b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f10840d11b0 0x7f10840b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 --2- 172.21.15.137:0/3548746718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f108406e2c0 0x7f10840afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 >> 172.21.15.137:0/3548746718 conn(0x7f10840b4a60 msgr2=0x7f1084160f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 shutdown_connections 2024-04-26T21:59:58.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.350+0000 7f108a46d640 1 -- 172.21.15.137:0/3548746718 wait complete. 2024-04-26T21:59:58.361 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:58.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.457+0000 7ff08d8f1640 1 Processor -- start 2024-04-26T21:59:58.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.457+0000 7ff08d8f1640 1 -- start start 2024-04-26T21:59:58.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.458+0000 7ff08d8f1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff08815f370 0x7ff0880cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.458+0000 7ff08d8f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f750 0x7ff0880b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.458+0000 7ff08d8f1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0880d03a0 con 0x7ff0880d37d0 2024-04-26T21:59:58.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.458+0000 7ff08d8f1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff0880b4d10 con 0x7ff08815f370 2024-04-26T21:59:58.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.458+0000 7ff08d8f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff0880d0680 con 0x7ff08815f750 2024-04-26T21:59:58.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff0867fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f750 0x7ff0880b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff086ffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff08815f370 0x7ff0880cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff0877fe640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ff0880d37d0 0x7ff0880d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:59970/0 (socket says 172.21.15.137:59970) 2024-04-26T21:59:58.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff0867fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f750 0x7ff0880b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:34964/0 (socket says 172.21.15.137:34964) 2024-04-26T21:59:58.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff0877fe640 1 -- 172.21.15.137:0/683566719 learned_addr learned my addr 172.21.15.137:0/683566719 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:58.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff0867fc640 1 -- 172.21.15.137:0/683566719 >> v2:172.21.15.170:3300/0 conn(0x7ff08815f370 msgr2=0x7ff0880cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:58.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff0867fc640 1 --2- 172.21.15.137:0/683566719 >> v2:172.21.15.170:3300/0 conn(0x7ff08815f370 0x7ff0880cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff0867fc640 1 -- 172.21.15.137:0/683566719 >> v1:172.21.15.170:6789/0 conn(0x7ff0880d37d0 legacy=0x7ff0880d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff0867fc640 1 -- 172.21.15.137:0/683566719 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0880d0960 con 0x7ff08815f750 2024-04-26T21:59:58.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.459+0000 7ff086ffd640 1 --2- 172.21.15.137:0/683566719 >> v2:172.21.15.170:3300/0 conn(0x7ff08815f370 0x7ff0880cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T21:59:58.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.460+0000 7ff0867fc640 1 --2- 172.21.15.137:0/683566719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f750 0x7ff0880b47d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff07c0097a0 tx=0x7ff07c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96a42b518da32a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:58.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.460+0000 7ff085ffb640 1 -- 172.21.15.137:0/683566719 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c037070 con 0x7ff08815f750 2024-04-26T21:59:58.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.460+0000 7ff085ffb640 1 -- 172.21.15.137:0/683566719 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c02ae50 con 0x7ff08815f750 2024-04-26T21:59:58.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.460+0000 7ff085ffb640 1 -- 172.21.15.137:0/683566719 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c032660 con 0x7ff08815f750 2024-04-26T21:59:58.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.461+0000 7ff08d8f1640 1 -- 172.21.15.137:0/683566719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f750 msgr2=0x7ff0880b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.461+0000 7ff08d8f1640 1 --2- 172.21.15.137:0/683566719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f750 0x7ff0880b47d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff07c0097a0 tx=0x7ff07c02a100 comp rx=0 tx=0).stop 2024-04-26T21:59:58.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.461+0000 7ff08d8f1640 1 -- 172.21.15.137:0/683566719 shutdown_connections 2024-04-26T21:59:58.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.461+0000 7ff08d8f1640 1 --2- 172.21.15.137:0/683566719 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f750 0x7ff0880b47d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.461+0000 7ff08d8f1640 1 --2- 172.21.15.137:0/683566719 >> v2:172.21.15.170:3300/0 conn(0x7ff08815f370 0x7ff0880cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.461+0000 7ff08d8f1640 1 -- 172.21.15.137:0/683566719 >> 172.21.15.137:0/683566719 conn(0x7ff08808ec10 msgr2=0x7ff08809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:58.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.461+0000 7ff08d8f1640 1 -- 172.21.15.137:0/683566719 shutdown_connections 2024-04-26T21:59:58.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.461+0000 7ff08d8f1640 1 -- 172.21.15.137:0/683566719 wait complete. 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.462+0000 7ff08d8f1640 1 Processor -- start 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.462+0000 7ff08d8f1640 1 -- start start 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff08d8f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0880d37d0 0x7ff08809f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff08d8f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f370 0x7ff08815d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff08d8f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08815f750 0x7ff0880b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff08d8f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0880b51c0 con 0x7ff08815f750 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff08d8f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff0880d0f20 con 0x7ff0880d37d0 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff08d8f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff0880b5340 con 0x7ff08815f370 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0877fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08815f750 0x7ff0880b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0877fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08815f750 0x7ff0880b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57332/0 (socket says 172.21.15.137:57332) 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0877fe640 1 -- 172.21.15.137:0/849852749 learned_addr learned my addr 172.21.15.137:0/849852749 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:58.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff086ffd640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0880d37d0 0x7ff08809f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0867fc640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f370 0x7ff08815d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0877fe640 1 -- 172.21.15.137:0/849852749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f370 msgr2=0x7ff08815d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0877fe640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f370 0x7ff08815d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0877fe640 1 -- 172.21.15.137:0/849852749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0880d37d0 msgr2=0x7ff08809f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0877fe640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0880d37d0 0x7ff08809f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0877fe640 1 -- 172.21.15.137:0/849852749 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08809fef0 con 0x7ff08815f750 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0867fc640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f370 0x7ff08815d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.463+0000 7ff0877fe640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08815f750 0x7ff0880b57a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff08000c420 tx=0x7ff08000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.464+0000 7ff06ffff640 1 -- 172.21.15.137:0/849852749 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080017070 con 0x7ff08815f750 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.464+0000 7ff06ffff640 1 -- 172.21.15.137:0/849852749 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff080005ce0 con 0x7ff08815f750 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.464+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0880a0390 con 0x7ff08815f750 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.464+0000 7ff06ffff640 1 -- 172.21.15.137:0/849852749 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0800072d0 con 0x7ff08815f750 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.464+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0880a0950 con 0x7ff08815f750 2024-04-26T21:59:58.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.465+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08806a290 con 0x7ff08815f750 2024-04-26T21:59:58.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.465+0000 7ff06ffff640 1 -- 172.21.15.137:0/849852749 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff08001a070 con 0x7ff08815f750 2024-04-26T21:59:58.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.466+0000 7ff06ffff640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07406c8f0 0x7ff07406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.466+0000 7ff086ffd640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07406c8f0 0x7ff07406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.466+0000 7ff06ffff640 1 -- 172.21.15.137:0/849852749 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff08008ad80 con 0x7ff08815f750 2024-04-26T21:59:58.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.466+0000 7ff086ffd640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07406c8f0 0x7ff07406edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff078009bd0 tx=0x7ff07800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:58.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.470+0000 7ff06ffff640 1 -- 172.21.15.137:0/849852749 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff080058bf0 con 0x7ff08815f750 2024-04-26T21:59:58.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.643+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff08815dce0 con 0x7ff08815f750 2024-04-26T21:59:58.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.644+0000 7ff06ffff640 1 -- 172.21.15.137:0/849852749 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16681 (secure 0 0 0) 0x7ff08005cef0 con 0x7ff08815f750 2024-04-26T21:59:58.645 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:58.645 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":34,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:34.679270+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:59:31.445571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T21:59:31.978335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07406c8f0 msgr2=0x7ff07406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07406c8f0 0x7ff07406edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff078009bd0 tx=0x7ff07800b040 comp rx=0 tx=0).stop 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08815f750 msgr2=0x7ff0880b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08815f750 0x7ff0880b57a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff08000c420 tx=0x7ff08000c8e0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 shutdown_connections 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07406c8f0 0x7ff07406edb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08815f750 0x7ff0880b57a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08815f370 0x7ff08815d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 --2- 172.21.15.137:0/849852749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0880d37d0 0x7ff08809f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.646+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 >> 172.21.15.137:0/849852749 conn(0x7ff08808ec10 msgr2=0x7ff0880b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.647+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 shutdown_connections 2024-04-26T21:59:58.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.647+0000 7ff08d8f1640 1 -- 172.21.15.137:0/849852749 wait complete. 2024-04-26T21:59:58.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T21:59:31.445571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T21:59:31.978335+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T21:59:58.658 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T21:59:58.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.757+0000 7fa390ebd640 1 Processor -- start 2024-04-26T21:59:58.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.757+0000 7fa390ebd640 1 -- start start 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.758+0000 7fa390ebd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa38c143300 0x7fa38c0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.758+0000 7fa390ebd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c0cd7d0 0x7fa38c160c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.758+0000 7fa390ebd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa38c0cdc30 con 0x7fa38c161170 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.758+0000 7fa390ebd640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa38c1615d0 con 0x7fa38c143300 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.758+0000 7fa390ebd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa38c0cded0 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.758+0000 7fa38a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa38c143300 0x7fa38c0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.758+0000 7fa38a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa38c143300 0x7fa38c0d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57334/0 (socket says 172.21.15.137:57334) 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.758+0000 7fa38a59c640 1 -- 172.21.15.137:0/4128753853 learned_addr learned my addr 172.21.15.137:0/4128753853 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.759+0000 7fa389d9b640 1 --2- 172.21.15.137:0/4128753853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c0cd7d0 0x7fa38c160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.759+0000 7fa38a59c640 1 -- 172.21.15.137:0/4128753853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c0cd7d0 msgr2=0x7fa38c160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.759+0000 7fa38a59c640 1 --2- 172.21.15.137:0/4128753853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c0cd7d0 0x7fa38c160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.759+0000 7fa38a59c640 1 -- 172.21.15.137:0/4128753853 >> v1:172.21.15.170:6789/0 conn(0x7fa38c161170 legacy=0x7fa38c15d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:58.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.759+0000 7fa38a59c640 1 -- 172.21.15.137:0/4128753853 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c0ce1b0 con 0x7fa38c143300 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.759+0000 7fa38a59c640 1 --2- 172.21.15.137:0/4128753853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c143300 0x7fa38c0d0e90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0d2680 tx=0x7fa37c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdbf3a305449b36 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.759+0000 7fa38959a640 1 -- 172.21.15.137:0/4128753853 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c036070 con 0x7fa38c143300 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.759+0000 7fa38959a640 1 -- 172.21.15.137:0/4128753853 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c031600 con 0x7fa38c143300 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.759+0000 7fa38959a640 1 -- 172.21.15.137:0/4128753853 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c0319d0 con 0x7fa38c143300 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.760+0000 7fa390ebd640 1 -- 172.21.15.137:0/4128753853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c143300 msgr2=0x7fa38c0d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.760+0000 7fa390ebd640 1 --2- 172.21.15.137:0/4128753853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c143300 0x7fa38c0d0e90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0d2680 tx=0x7fa37c02a6a0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.760+0000 7fa390ebd640 1 -- 172.21.15.137:0/4128753853 shutdown_connections 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.760+0000 7fa390ebd640 1 --2- 172.21.15.137:0/4128753853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c0cd7d0 0x7fa38c160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.760+0000 7fa390ebd640 1 --2- 172.21.15.137:0/4128753853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c143300 0x7fa38c0d0e90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.760+0000 7fa390ebd640 1 -- 172.21.15.137:0/4128753853 >> 172.21.15.137:0/4128753853 conn(0x7fa38c0d1610 msgr2=0x7fa38c0d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.760+0000 7fa390ebd640 1 -- 172.21.15.137:0/4128753853 shutdown_connections 2024-04-26T21:59:58.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.760+0000 7fa390ebd640 1 -- 172.21.15.137:0/4128753853 wait complete. 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.761+0000 7fa390ebd640 1 Processor -- start 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.761+0000 7fa390ebd640 1 -- start start 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa390ebd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c0cd7d0 0x7fa38c1f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa390ebd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa38c143300 0x7fa38c15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa390ebd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c161170 0x7fa38c15c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa390ebd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c0cea50 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa390ebd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c0ce770 con 0x7fa38c143300 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa390ebd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa38c1436e0 con 0x7fa38c161170 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c0cd7d0 0x7fa38c1f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c0cd7d0 0x7fa38c1f5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57340/0 (socket says 172.21.15.137:57340) 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38a59c640 1 -- 172.21.15.137:0/1770498417 learned_addr learned my addr 172.21.15.137:0/1770498417 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:58.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa389d9b640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa38c143300 0x7fa38c15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38a59c640 1 -- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c161170 msgr2=0x7fa38c15c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38ad9d640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c161170 0x7fa38c15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38a59c640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c161170 0x7fa38c15c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38a59c640 1 -- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa38c143300 msgr2=0x7fa38c15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38a59c640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa38c143300 0x7fa38c15bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38a59c640 1 -- 172.21.15.137:0/1770498417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c156110 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa389d9b640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa38c143300 0x7fa38c15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.762+0000 7fa38ad9d640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c161170 0x7fa38c15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.763+0000 7fa38a59c640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c0cd7d0 0x7fa38c1f5ec0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa37c034040 tx=0x7fa37c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.763+0000 7fa382ffd640 1 -- 172.21.15.137:0/1770498417 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c036050 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.763+0000 7fa382ffd640 1 -- 172.21.15.137:0/1770498417 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c042070 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.763+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38c1563b0 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.763+0000 7fa382ffd640 1 -- 172.21.15.137:0/1770498417 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c009510 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.763+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38c156970 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.764+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38c06a290 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.764+0000 7fa382ffd640 1 -- 172.21.15.137:0/1770498417 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa37c007c50 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.765+0000 7fa382ffd640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa36c06c8f0 0x7fa36c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.765+0000 7fa382ffd640 1 -- 172.21.15.137:0/1770498417 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa37c0acac0 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.765+0000 7fa389d9b640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa36c06c8f0 0x7fa36c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:58.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.765+0000 7fa389d9b640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa36c06c8f0 0x7fa36c06edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa38c1591d0 tx=0x7fa374008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:58.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.769+0000 7fa382ffd640 1 -- 172.21.15.137:0/1770498417 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa38c06a290 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.946+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa38c0ced60 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.946+0000 7fa382ffd640 1 -- 172.21.15.137:0/1770498417 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7fa38c0ced60 con 0x7fa38c0cd7d0 2024-04-26T21:59:58.946 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T21:59:58.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa36c06c8f0 msgr2=0x7fa36c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa36c06c8f0 0x7fa36c06edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa38c1591d0 tx=0x7fa374008040 comp rx=0 tx=0).stop 2024-04-26T21:59:58.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c0cd7d0 msgr2=0x7fa38c1f5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:58.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c0cd7d0 0x7fa38c1f5ec0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa37c034040 tx=0x7fa37c004a40 comp rx=0 tx=0).stop 2024-04-26T21:59:58.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 shutdown_connections 2024-04-26T21:59:58.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa36c06c8f0 0x7fa36c06edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa38c161170 0x7fa38c15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa38c143300 0x7fa38c15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 --2- 172.21.15.137:0/1770498417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa38c0cd7d0 0x7fa38c1f5ec0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:58.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 >> 172.21.15.137:0/1770498417 conn(0x7fa38c0d1610 msgr2=0x7fa38c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:58.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 shutdown_connections 2024-04-26T21:59:58.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:58.948+0000 7fa390ebd640 1 -- 172.21.15.137:0/1770498417 wait complete. 2024-04-26T21:59:58.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T21:59:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.058+0000 7f1e05646640 1 Processor -- start 2024-04-26T21:59:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.058+0000 7f1e05646640 1 -- start start 2024-04-26T21:59:59.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1e05646640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e0015f5b0 0x7f1e000b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1e05646640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e000b55b0 0x7f1e000d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1e05646640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e000b6aa0 con 0x7f1e0015f990 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1e05646640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1e000d3eb0 con 0x7f1e0015f5b0 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1e05646640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1e000d4190 con 0x7f1e000b55b0 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1dfe7fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1e0015f990 0x7f1e000d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54728/0 (socket says 172.21.15.137:54728) 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1dfe7fc640 1 -- 172.21.15.137:0/1385311927 learned_addr learned my addr 172.21.15.137:0/1385311927 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1dfeffd640 1 --2- 172.21.15.137:0/1385311927 >> v2:172.21.15.170:3300/0 conn(0x7f1e0015f5b0 0x7f1e000b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1dff7fe640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e000b55b0 0x7f1e000d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827329660 0 0) 0x7f1e000b6aa0 con 0x7f1e0015f990 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.059+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1de8003520 con 0x7f1e0015f990 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2472752406 0 0) 0x7f1de8003520 con 0x7f1e0015f990 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e000b55b0 msgr2=0x7f1e000d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e000b55b0 0x7f1e000d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 >> v2:172.21.15.170:3300/0 conn(0x7f1e0015f5b0 msgr2=0x7f1e000b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 --2- 172.21.15.137:0/1385311927 >> v2:172.21.15.170:3300/0 conn(0x7f1e0015f5b0 0x7f1e000b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e000d0200 con 0x7f1e0015f990 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f1df4001670 con 0x7f1e0015f990 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 >> v1:172.21.15.137:6789/0 conn(0x7f1e0015f990 legacy=0x7f1e000d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de80039b0 0x7f1de8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1de8004800 0x7f1de8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e000b55b0 0x7f1de80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000d3eb0 con 0x7f1de80039b0 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000d4190 con 0x7f1de8004800 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1de800b9c0 con 0x7f1e000b55b0 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfeffd640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de80039b0 0x7f1de8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfe7fc640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1de8004800 0x7f1de8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dff7fe640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e000b55b0 0x7f1de80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfeffd640 1 -- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e000b55b0 msgr2=0x7f1de80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfeffd640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e000b55b0 0x7f1de80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfeffd640 1 -- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1de8004800 msgr2=0x7f1de8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfeffd640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1de8004800 0x7f1de8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfeffd640 1 -- 172.21.15.137:0/1385311927 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de8003520 con 0x7f1de80039b0 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.060+0000 7f1dfe7fc640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1de8004800 0x7f1de8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1dfeffd640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de80039b0 0x7f1de8003dd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013a40 tx=0x7f1de8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69c7fa63e9296ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0041070 con 0x7f1de80039b0 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df003c410 con 0x7f1de80039b0 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1dfdffb640 1 -- 172.21.15.137:0/1385311927 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0009d60 con 0x7f1de80039b0 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1e05646640 1 -- 172.21.15.137:0/1385311927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de80039b0 msgr2=0x7f1de8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1e05646640 1 --2- 172.21.15.137:0/1385311927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1de80039b0 0x7f1de8003dd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1df0013a40 tx=0x7f1de8005830 comp rx=0 tx=0).stop 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1dff7fe640 1 -- 172.21.15.137:0/1385311927 reap_dead start 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1e05646640 1 -- 172.21.15.137:0/1385311927 shutdown_connections 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1e05646640 1 -- 172.21.15.137:0/1385311927 >> 172.21.15.137:0/1385311927 conn(0x7f1e0008ec40 msgr2=0x7f1e0009e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.061+0000 7f1e05646640 1 -- 172.21.15.137:0/1385311927 shutdown_connections 2024-04-26T21:59:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.062+0000 7f1e05646640 1 -- 172.21.15.137:0/1385311927 wait complete. 2024-04-26T21:59:59.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.063+0000 7f1e05646640 1 Processor -- start 2024-04-26T21:59:59.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.063+0000 7f1e05646640 1 -- start start 2024-04-26T21:59:59.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.063+0000 7f1e05646640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1de80039b0 0x7f1e000cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.063+0000 7f1e05646640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e00163240 0x7f1e001636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.063+0000 7f1e05646640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e001f44b0 0x7f1e001f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.063+0000 7f1e05646640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000d1290 con 0x7f1e001f44b0 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.063+0000 7f1e05646640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000d1110 con 0x7f1e00163240 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.063+0000 7f1e05646640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1e000d3340 con 0x7f1de80039b0 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dff7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e001f44b0 0x7f1e001f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dff7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e001f44b0 0x7f1e001f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57352/0 (socket says 172.21.15.137:57352) 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dff7fe640 1 -- 172.21.15.137:0/3451816939 learned_addr learned my addr 172.21.15.137:0/3451816939 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dfe7fc640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e00163240 0x7f1e001636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dfeffd640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1de80039b0 0x7f1e000cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dff7fe640 1 -- 172.21.15.137:0/3451816939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1de80039b0 msgr2=0x7f1e000cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dff7fe640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1de80039b0 0x7f1e000cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dff7fe640 1 -- 172.21.15.137:0/3451816939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e00163240 msgr2=0x7f1e001636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dff7fe640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e00163240 0x7f1e001636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dff7fe640 1 -- 172.21.15.137:0/3451816939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e000cdcc0 con 0x7f1e001f44b0 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dfe7fc640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e00163240 0x7f1e001636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:59.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1dff7fe640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e001f44b0 0x7f1e001f4930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1df8011490 tx=0x7f1df8011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1de77fe640 1 -- 172.21.15.137:0/3451816939 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8003610 con 0x7f1e001f44b0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1de77fe640 1 -- 172.21.15.137:0/3451816939 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df801b070 con 0x7f1e001f44b0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1de77fe640 1 -- 172.21.15.137:0/3451816939 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df80039f0 con 0x7f1e001f44b0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e000cdfa0 con 0x7f1e001f44b0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.064+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e001f4e70 con 0x7f1e001f44b0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.065+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e00163be0 con 0x7f1e001f44b0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.065+0000 7f1de77fe640 1 -- 172.21.15.137:0/3451816939 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1df8003b90 con 0x7f1e001f44b0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.066+0000 7f1de77fe640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1dec06c8f0 0x7f1dec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.066+0000 7f1de77fe640 1 -- 172.21.15.137:0/3451816939 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1df808bcd0 con 0x7f1e001f44b0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.066+0000 7f1dfeffd640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1dec06c8f0 0x7f1dec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.066+0000 7f1dfeffd640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1dec06c8f0 0x7f1dec06edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1df003e000 tx=0x7f1df0039000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.070+0000 7f1de77fe640 1 -- 172.21.15.137:0/3451816939 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1e00163be0 con 0x7f1e001f44b0 2024-04-26T21:59:59.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.248+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1e000ce4c0 con 0x7f1e001f44b0 2024-04-26T21:59:59.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.248+0000 7f1de77fe640 1 -- 172.21.15.137:0/3451816939 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7f1df8025020 con 0x7f1e001f44b0 2024-04-26T21:59:59.248 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T21:59:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1dec06c8f0 msgr2=0x7f1dec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1dec06c8f0 0x7f1dec06edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1df003e000 tx=0x7f1df0039000 comp rx=0 tx=0).stop 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e001f44b0 msgr2=0x7f1e001f4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e001f44b0 0x7f1e001f4930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1df8011490 tx=0x7f1df8011950 comp rx=0 tx=0).stop 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 shutdown_connections 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1dec06c8f0 0x7f1dec06edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e001f44b0 0x7f1e001f4930 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e00163240 0x7f1e001636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 --2- 172.21.15.137:0/3451816939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1de80039b0 0x7f1e000cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 >> 172.21.15.137:0/3451816939 conn(0x7f1e0008ec40 msgr2=0x7f1e000b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 shutdown_connections 2024-04-26T21:59:59.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.250+0000 7f1e05646640 1 -- 172.21.15.137:0/3451816939 wait complete. 2024-04-26T21:59:59.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T21:59:59.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.361+0000 7f62875f0640 1 Processor -- start 2024-04-26T21:59:59.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.361+0000 7f62875f0640 1 -- start start 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f62875f0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f628015f2b0 0x7f628006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f62875f0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f62800706a0 0x7f628006c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f62875f0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628006cbf0 con 0x7f628006c7e0 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f62875f0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f62800af610 con 0x7f628015f2b0 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f62875f0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f62800700b0 con 0x7f62800706a0 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f628538c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f628015f2b0 0x7f628006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f6285b8d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f628006c7e0 0x7f6280162e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54736/0 (socket says 172.21.15.137:54736) 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f628538c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f628015f2b0 0x7f628006fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57360/0 (socket says 172.21.15.137:57360) 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f6285b8d640 1 -- 172.21.15.137:0/2181104393 learned_addr learned my addr 172.21.15.137:0/2181104393 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f6284b8b640 1 --2- 172.21.15.137:0/2181104393 >> v2:172.21.15.170:3300/0 conn(0x7f62800706a0 0x7f628006c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f628538c640 1 -- 172.21.15.137:0/2181104393 >> v2:172.21.15.170:3300/0 conn(0x7f62800706a0 msgr2=0x7f628006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:59.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f628538c640 1 --2- 172.21.15.137:0/2181104393 >> v2:172.21.15.170:3300/0 conn(0x7f62800706a0 0x7f628006c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f628538c640 1 -- 172.21.15.137:0/2181104393 >> v1:172.21.15.137:6789/0 conn(0x7f628006c7e0 legacy=0x7f6280162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f628538c640 1 -- 172.21.15.137:0/2181104393 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6280070b30 con 0x7f628015f2b0 2024-04-26T21:59:59.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f6277fff640 1 -- 172.21.15.137:0/2181104393 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678442541 0 0) 0x7f6278001490 con 0x7f628006c7e0 2024-04-26T21:59:59.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.362+0000 7f6284b8b640 1 --2- 172.21.15.137:0/2181104393 >> v2:172.21.15.170:3300/0 conn(0x7f62800706a0 0x7f628006c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:59.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f628538c640 1 --2- 172.21.15.137:0/2181104393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f628015f2b0 0x7f628006fb70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f628006cec0 tx=0x7f627c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c43e9dbac4deeb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f6277fff640 1 -- 172.21.15.137:0/2181104393 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c037070 con 0x7f628015f2b0 2024-04-26T21:59:59.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f6277fff640 1 -- 172.21.15.137:0/2181104393 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c032440 con 0x7f628015f2b0 2024-04-26T21:59:59.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f6277fff640 1 -- 172.21.15.137:0/2181104393 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c032810 con 0x7f628015f2b0 2024-04-26T21:59:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f62875f0640 1 -- 172.21.15.137:0/2181104393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f628015f2b0 msgr2=0x7f628006fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f62875f0640 1 --2- 172.21.15.137:0/2181104393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f628015f2b0 0x7f628006fb70 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f628006cec0 tx=0x7f627c02a1a0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f62875f0640 1 -- 172.21.15.137:0/2181104393 shutdown_connections 2024-04-26T21:59:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f62875f0640 1 --2- 172.21.15.137:0/2181104393 >> v2:172.21.15.170:3300/0 conn(0x7f62800706a0 0x7f628006c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f62875f0640 1 --2- 172.21.15.137:0/2181104393 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f628015f2b0 0x7f628006fb70 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.363+0000 7f62875f0640 1 -- 172.21.15.137:0/2181104393 >> 172.21.15.137:0/2181104393 conn(0x7f628006f050 msgr2=0x7f628006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.364+0000 7f62875f0640 1 -- 172.21.15.137:0/2181104393 shutdown_connections 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.364+0000 7f62875f0640 1 -- 172.21.15.137:0/2181104393 wait complete. 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f62875f0640 1 Processor -- start 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f62875f0640 1 -- start start 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f62875f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628006c7e0 0x7f62801f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f62875f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628015f2b0 0x7f62801f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f62875f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6280155d00 0x7f6280156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f62875f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f62800713d0 con 0x7f6280155d00 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f62875f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f62800710f0 con 0x7f628015f2b0 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f62875f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f62800b4f40 con 0x7f628006c7e0 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f6285b8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6280155d00 0x7f6280156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f6285b8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6280155d00 0x7f6280156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57372/0 (socket says 172.21.15.137:57372) 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.365+0000 7f6285b8d640 1 -- 172.21.15.137:0/4240523603 learned_addr learned my addr 172.21.15.137:0/4240523603 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6284b8b640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628015f2b0 0x7f62801f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f628538c640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628006c7e0 0x7f62801f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6285b8d640 1 -- 172.21.15.137:0/4240523603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628006c7e0 msgr2=0x7f62801f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6285b8d640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628006c7e0 0x7f62801f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6285b8d640 1 -- 172.21.15.137:0/4240523603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628015f2b0 msgr2=0x7f62801f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6285b8d640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628015f2b0 0x7f62801f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6285b8d640 1 -- 172.21.15.137:0/4240523603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62801f93a0 con 0x7f6280155d00 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6284b8b640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628015f2b0 0x7f62801f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6285b8d640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6280155d00 0x7f6280156190 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f627800c820 tx=0x7f627800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6275ffb640 1 -- 172.21.15.137:0/4240523603 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278018070 con 0x7f6280155d00 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6275ffb640 1 -- 172.21.15.137:0/4240523603 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627800a5e0 con 0x7f6280155d00 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6280156830 con 0x7f6280155d00 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f6275ffb640 1 -- 172.21.15.137:0/4240523603 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627800a9d0 con 0x7f6280155d00 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.366+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6280151de0 con 0x7f6280155d00 2024-04-26T21:59:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.367+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628006a290 con 0x7f6280155d00 2024-04-26T21:59:59.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.368+0000 7f6275ffb640 1 -- 172.21.15.137:0/4240523603 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f627801b070 con 0x7f6280155d00 2024-04-26T21:59:59.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.368+0000 7f6275ffb640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626406c8f0 0x7f626406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.368+0000 7f6275ffb640 1 -- 172.21.15.137:0/4240523603 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f627808b120 con 0x7f6280155d00 2024-04-26T21:59:59.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.368+0000 7f628538c640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626406c8f0 0x7f626406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.368+0000 7f628538c640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626406c8f0 0x7f626406edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f627c034000 tx=0x7f627c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.372+0000 7f6275ffb640 1 -- 172.21.15.137:0/4240523603 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f628006cbf0 con 0x7f6280155d00 2024-04-26T21:59:59.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.546+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f62800b31f0 con 0x7f6280155d00 2024-04-26T21:59:59.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.547+0000 7f6275ffb640 1 -- 172.21.15.137:0/4240523603 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f6278059550 con 0x7f6280155d00 2024-04-26T21:59:59.547 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T21:59:59.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626406c8f0 msgr2=0x7f626406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626406c8f0 0x7f626406edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f627c034000 tx=0x7f627c02e000 comp rx=0 tx=0).stop 2024-04-26T21:59:59.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6280155d00 msgr2=0x7f6280156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6280155d00 0x7f6280156190 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f627800c820 tx=0x7f627800cce0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 shutdown_connections 2024-04-26T21:59:59.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626406c8f0 0x7f626406edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6280155d00 0x7f6280156190 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628015f2b0 0x7f62801f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 --2- 172.21.15.137:0/4240523603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628006c7e0 0x7f62801f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 >> 172.21.15.137:0/4240523603 conn(0x7f628006f050 msgr2=0x7f6280150200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 shutdown_connections 2024-04-26T21:59:59.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.549+0000 7f62875f0640 1 -- 172.21.15.137:0/4240523603 wait complete. 2024-04-26T21:59:59.560 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T21:59:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.656+0000 7fe3c17e9640 1 Processor -- start 2024-04-26T21:59:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.656+0000 7fe3c17e9640 1 -- start start 2024-04-26T21:59:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.657+0000 7fe3c17e9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe3bc160640 0x7fe3bc1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.657+0000 7fe3c17e9640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3bc0cfa80 con 0x7fe3bc163be0 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.657+0000 7fe3c17e9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3bc0cfd60 con 0x7fe3bc148a30 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.657+0000 7fe3c17e9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe3bc0745e0 con 0x7fe3bc160640 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.657+0000 7fe3bb7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe3bc163be0 0x7fe3bc0b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54738/0 (socket says 172.21.15.137:54738) 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.657+0000 7fe3bb7fe640 1 -- 172.21.15.137:0/3640746240 learned_addr learned my addr 172.21.15.137:0/3640746240 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.658+0000 7fe3b3fff640 1 --2- 172.21.15.137:0/3640746240 >> v2:172.21.15.170:3300/0 conn(0x7fe3bc160640 0x7fe3bc1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.658+0000 7fe3ba7fc640 1 -- 172.21.15.137:0/3640746240 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445266334 0 0) 0x7fe3bc0cfa80 con 0x7fe3bc163be0 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.658+0000 7fe3ba7fc640 1 -- 172.21.15.137:0/3640746240 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a8003520 con 0x7fe3bc163be0 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.658+0000 7fe3b3fff640 1 -- 172.21.15.137:0/3640746240 >> v1:172.21.15.170:6789/0 conn(0x7fe3bc148a30 legacy=0x7fe3bc073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.658+0000 7fe3b3fff640 1 -- 172.21.15.137:0/3640746240 >> v1:172.21.15.137:6789/0 conn(0x7fe3bc163be0 legacy=0x7fe3bc0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.658+0000 7fe3b3fff640 1 -- 172.21.15.137:0/3640746240 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc0d0040 con 0x7fe3bc160640 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3b3fff640 1 --2- 172.21.15.137:0/3640746240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc160640 0x7fe3bc1636a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40097a0 tx=0x7fe3a402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a542bedaed0e00d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3ba7fc640 1 -- 172.21.15.137:0/3640746240 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4037070 con 0x7fe3bc160640 2024-04-26T21:59:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3ba7fc640 1 -- 172.21.15.137:0/3640746240 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a4032440 con 0x7fe3bc160640 2024-04-26T21:59:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3ba7fc640 1 -- 172.21.15.137:0/3640746240 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a40327f0 con 0x7fe3bc160640 2024-04-26T21:59:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3c17e9640 1 -- 172.21.15.137:0/3640746240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc160640 msgr2=0x7fe3bc1636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3c17e9640 1 --2- 172.21.15.137:0/3640746240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc160640 0x7fe3bc1636a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40097a0 tx=0x7fe3a402a1a0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3c17e9640 1 -- 172.21.15.137:0/3640746240 shutdown_connections 2024-04-26T21:59:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3c17e9640 1 --2- 172.21.15.137:0/3640746240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc160640 0x7fe3bc1636a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3c17e9640 1 -- 172.21.15.137:0/3640746240 >> 172.21.15.137:0/3640746240 conn(0x7fe3bc0ce8b0 msgr2=0x7fe3bc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3c17e9640 1 -- 172.21.15.137:0/3640746240 shutdown_connections 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.659+0000 7fe3c17e9640 1 -- 172.21.15.137:0/3640746240 wait complete. 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3c17e9640 1 Processor -- start 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3c17e9640 1 -- start start 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3c17e9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc148a30 0x7fe3bc15ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3c17e9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3bc160640 0x7fe3bc0b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3c17e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3bc163be0 0x7fe3bc142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3c17e9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc148e10 con 0x7fe3bc163be0 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3c17e9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe3bc163180 con 0x7fe3bc148a30 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3c17e9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe3bc148f90 con 0x7fe3bc160640 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3bb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3bc163be0 0x7fe3bc142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3bb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3bc163be0 0x7fe3bc142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57388/0 (socket says 172.21.15.137:57388) 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.661+0000 7fe3bb7fe640 1 -- 172.21.15.137:0/2993371502 learned_addr learned my addr 172.21.15.137:0/2993371502 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3b3fff640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3bc160640 0x7fe3bc0b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3baffd640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc148a30 0x7fe3bc15ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3bb7fe640 1 -- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3bc160640 msgr2=0x7fe3bc0b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3bb7fe640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3bc160640 0x7fe3bc0b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3bb7fe640 1 -- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc148a30 msgr2=0x7fe3bc15ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3bb7fe640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc148a30 0x7fe3bc15ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3bb7fe640 1 -- 172.21.15.137:0/2993371502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3bc0aec70 con 0x7fe3bc163be0 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3baffd640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc148a30 0x7fe3bc15ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3b3fff640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3bc160640 0x7fe3bc0b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3bb7fe640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3bc163be0 0x7fe3bc142d40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400caa0 tx=0x7fe3b400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3b37fe640 1 -- 172.21.15.137:0/2993371502 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4017070 con 0x7fe3bc163be0 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3b37fe640 1 -- 172.21.15.137:0/2993371502 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b400ac00 con 0x7fe3bc163be0 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3bc0aef50 con 0x7fe3bc163be0 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3b37fe640 1 -- 172.21.15.137:0/2993371502 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4012400 con 0x7fe3bc163be0 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.662+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3bc0af510 con 0x7fe3bc163be0 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.663+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3bc06a290 con 0x7fe3bc163be0 2024-04-26T21:59:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.663+0000 7fe3b37fe640 1 -- 172.21.15.137:0/2993371502 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe3b401a070 con 0x7fe3bc163be0 2024-04-26T21:59:59.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.664+0000 7fe3b37fe640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe39c06c8f0 0x7fe39c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.664+0000 7fe3b37fe640 1 -- 172.21.15.137:0/2993371502 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe3b408b980 con 0x7fe3bc163be0 2024-04-26T21:59:59.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.664+0000 7fe3baffd640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe39c06c8f0 0x7fe39c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.664+0000 7fe3baffd640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe39c06c8f0 0x7fe39c06edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac001680 tx=0x7fe3ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.668+0000 7fe3b37fe640 1 -- 172.21.15.137:0/2993371502 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe3b4059db0 con 0x7fe3bc163be0 2024-04-26T21:59:59.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.878+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3bc0b47b0 con 0x7fe3bc163be0 2024-04-26T21:59:59.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.878+0000 7fe3b37fe640 1 -- 172.21.15.137:0/2993371502 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7fe3b40596b0 con 0x7fe3bc163be0 2024-04-26T21:59:59.878 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T21:59:59.879 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3532925157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3532925157},{"type":"v1","addr":"172.21.15.137:6836","nonce":3532925157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3509631448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3509631448},{"type":"v1","addr":"172.21.15.170:6834","nonce":3509631448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3228449407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3228449407},{"type":"v1","addr":"172.21.15.170:6835","nonce":3228449407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:59:33.028489+0000","modified":"2024-04-26T21:59:35.023196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1394398285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1394398285},{"type":"v1","addr":"172.21.15.137:6837","nonce":1394398285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5139,"qdb_cluster":[5139]},"id":2}]} 2024-04-26T21:59:59.879 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-04-26T21:59:59.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe39c06c8f0 msgr2=0x7fe39c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe39c06c8f0 0x7fe39c06edb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac001680 tx=0x7fe3ac009040 comp rx=0 tx=0).stop 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3bc163be0 msgr2=0x7fe3bc142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3bc163be0 0x7fe3bc142d40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400caa0 tx=0x7fe3b400cf60 comp rx=0 tx=0).stop 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 shutdown_connections 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe39c06c8f0 0x7fe39c06edb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3bc163be0 0x7fe3bc142d40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3bc160640 0x7fe3bc0b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 --2- 172.21.15.137:0/2993371502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3bc148a30 0x7fe3bc15ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 >> 172.21.15.137:0/2993371502 conn(0x7fe3bc0ce8b0 msgr2=0x7fe3bc073ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 shutdown_connections 2024-04-26T21:59:59.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.880+0000 7fe3c17e9640 1 -- 172.21.15.137:0/2993371502 wait complete. 2024-04-26T21:59:59.891 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T21:59:59.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.988+0000 7f12743c6640 1 Processor -- start 2024-04-26T21:59:59.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.988+0000 7f12743c6640 1 -- start start 2024-04-26T21:59:59.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f12743c6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c145980 0x7f126c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f12743c6640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f126c0b61a0 0x7f126c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f12743c6640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c0b4260 con 0x7f126c0b3de0 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f12743c6640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f126c0b5140 con 0x7f126c0b61a0 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f12743c6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f126c0b4530 con 0x7f126c145980 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271961640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f126c0b3de0 0x7f126c0b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54740/0 (socket says 172.21.15.137:54740) 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271961640 1 -- 172.21.15.137:0/560419604 learned_addr learned my addr 172.21.15.137:0/560419604 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1272963640 1 --2- 172.21.15.137:0/560419604 >> v2:172.21.15.170:3300/0 conn(0x7f126c0b61a0 0x7f126c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1272162640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c145980 0x7f126c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1323032043 0 0) 0x7f126c0b4260 con 0x7f126c0b3de0 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1258003520 con 0x7f126c0b3de0 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 444143099 0 0) 0x7f1258003520 con 0x7f126c0b3de0 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c145980 msgr2=0x7f126c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c145980 0x7f126c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 >> v2:172.21.15.170:3300/0 conn(0x7f126c0b61a0 msgr2=0x7f126c0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:59.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 --2- 172.21.15.137:0/560419604 >> v2:172.21.15.170:3300/0 conn(0x7f126c0b61a0 0x7f126c0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c0b4810 con 0x7f126c0b3de0 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f125c001690 con 0x7f126c0b3de0 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.989+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 >> v1:172.21.15.137:6789/0 conn(0x7f126c0b3de0 legacy=0x7f126c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271160640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12580039b0 0x7f1258003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271160640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f1258004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271160640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c145980 0x7f12580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f126c0b5140 con 0x7f1258004800 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f126c0b4530 con 0x7f12580039b0 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f125800b9c0 con 0x7f126c145980 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271961640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f1258004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1272162640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12580039b0 0x7f1258003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1272963640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c145980 0x7f12580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271961640 1 -- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c145980 msgr2=0x7f12580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271961640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c145980 0x7f12580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271961640 1 -- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12580039b0 msgr2=0x7f1258003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271961640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12580039b0 0x7f1258003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.990+0000 7f1271961640 1 -- 172.21.15.137:0/560419604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1258003520 con 0x7f1258004800 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f1271961640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f1258004c80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c210 tx=0x7f1258005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fa075e160c9afc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c007d50 con 0x7f1258004800 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c0058d0 con 0x7f1258004800 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f1271160640 1 -- 172.21.15.137:0/560419604 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c005ca0 con 0x7f1258004800 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f12743c6640 1 -- 172.21.15.137:0/560419604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 msgr2=0x7f1258004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f12743c6640 1 --2- 172.21.15.137:0/560419604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f1258004c80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f125c00c210 tx=0x7f1258005830 comp rx=0 tx=0).stop 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f1272963640 1 -- 172.21.15.137:0/560419604 reap_dead start 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f12743c6640 1 -- 172.21.15.137:0/560419604 shutdown_connections 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f12743c6640 1 -- 172.21.15.137:0/560419604 >> 172.21.15.137:0/560419604 conn(0x7f126c0d0d30 msgr2=0x7f126c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f12743c6640 1 -- 172.21.15.137:0/560419604 shutdown_connections 2024-04-26T21:59:59.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.991+0000 7f12743c6640 1 -- 172.21.15.137:0/560419604 wait complete. 2024-04-26T21:59:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.992+0000 7f12743c6640 1 Processor -- start 2024-04-26T21:59:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f12743c6640 1 -- start start 2024-04-26T21:59:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f12743c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f126c15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f12743c6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c139190 0x7f126c0cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f12743c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f126c0cff50 0x7f126c13d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f12743c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f126c160630 con 0x7f1258004800 2024-04-26T21:59:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f12743c6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f126c0b4dd0 con 0x7f126c0cff50 2024-04-26T21:59:59.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f12743c6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f126c1607b0 con 0x7f126c139190 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f1272162640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f126c15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f1272162640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f126c15b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57400/0 (socket says 172.21.15.137:57400) 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f1272162640 1 -- 172.21.15.137:0/4056123552 learned_addr learned my addr 172.21.15.137:0/4056123552 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f1271961640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c139190 0x7f126c0cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.993+0000 7f1272963640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f126c0cff50 0x7f126c13d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f1272162640 1 -- 172.21.15.137:0/4056123552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c139190 msgr2=0x7f126c0cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f1272162640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c139190 0x7f126c0cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f1272162640 1 -- 172.21.15.137:0/4056123552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f126c0cff50 msgr2=0x7f126c13d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f1272162640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f126c0cff50 0x7f126c13d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f1272162640 1 -- 172.21.15.137:0/4056123552 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c1395f0 con 0x7f1258004800 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f1272162640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f126c15b6f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1268009f90 tx=0x7f126800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f1262ffd640 1 -- 172.21.15.137:0/4056123552 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126800fea0 con 0x7f1258004800 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f1262ffd640 1 -- 172.21.15.137:0/4056123552 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1268015630 con 0x7f1258004800 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f1262ffd640 1 -- 172.21.15.137:0/4056123552 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268015a20 con 0x7f1258004800 2024-04-26T21:59:59.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126c13e0a0 con 0x7f1258004800 2024-04-26T21:59:59.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.994+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126c13e660 con 0x7f1258004800 2024-04-26T21:59:59.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.995+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126c06a290 con 0x7f1258004800 2024-04-26T21:59:59.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.995+0000 7f1262ffd640 1 -- 172.21.15.137:0/4056123552 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1268015bc0 con 0x7f1258004800 2024-04-26T21:59:59.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.996+0000 7f1262ffd640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f125006c860 0x7f125006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T21:59:59.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.996+0000 7f1271961640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f125006c860 0x7f125006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T21:59:59.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.996+0000 7f1262ffd640 1 -- 172.21.15.137:0/4056123552 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f126808ca50 con 0x7f1258004800 2024-04-26T21:59:59.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T21:59:59.996+0000 7f1271961640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f125006c860 0x7f125006ed20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f125c033000 tx=0x7f125c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.000+0000 7f1262ffd640 1 -- 172.21.15.137:0/4056123552 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1268019030 con 0x7f1258004800 2024-04-26T22:00:00.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.176+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f126c0d0330 con 0x7f1258004800 2024-04-26T22:00:00.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.177+0000 7f1262ffd640 1 -- 172.21.15.137:0/4056123552 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16681 (secure 0 0 0) 0x7f1268010040 con 0x7f1258004800 2024-04-26T22:00:00.177 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:00.177 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":34,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:34.679270+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:59:31.445571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T21:59:31.978335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:00.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f125006c860 msgr2=0x7f125006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f125006c860 0x7f125006ed20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f125c033000 tx=0x7f125c009030 comp rx=0 tx=0).stop 2024-04-26T22:00:00.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 msgr2=0x7f126c15b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f126c15b6f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1268009f90 tx=0x7f126800f580 comp rx=0 tx=0).stop 2024-04-26T22:00:00.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 shutdown_connections 2024-04-26T22:00:00.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f125006c860 0x7f125006ed20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f126c0cff50 0x7f126c13d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f126c139190 0x7f126c0cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 --2- 172.21.15.137:0/4056123552 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1258004800 0x7f126c15b6f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 >> 172.21.15.137:0/4056123552 conn(0x7f126c0d0d30 msgr2=0x7f126c144b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:00.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 shutdown_connections 2024-04-26T22:00:00.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.179+0000 7f12743c6640 1 -- 172.21.15.137:0/4056123552 wait complete. 2024-04-26T22:00:00.191 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:00:00.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:00.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.290+0000 7fea0ef58640 1 Processor -- start 2024-04-26T22:00:00.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.290+0000 7fea0ef58640 1 -- start start 2024-04-26T22:00:00.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.290+0000 7fea0ef58640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fea0815f370 0x7fea080cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.290+0000 7fea0ef58640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fea0815f750 0x7fea080b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.290+0000 7fea0ef58640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea080d03a0 con 0x7fea080d37d0 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.290+0000 7fea0ef58640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fea080b4d10 con 0x7fea0815f370 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.290+0000 7fea0ef58640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fea080d0680 con 0x7fea0815f750 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.291+0000 7fea0ccf4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fea0815f370 0x7fea080cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.291+0000 7fea0ccf4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fea0815f370 0x7fea080cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57416/0 (socket says 172.21.15.137:57416) 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.291+0000 7fea0ccf4640 1 -- 172.21.15.137:0/2442696897 learned_addr learned my addr 172.21.15.137:0/2442696897 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.291+0000 7fea0ccf4640 1 -- 172.21.15.137:0/2442696897 >> v2:172.21.15.170:3300/0 conn(0x7fea0815f750 msgr2=0x7fea080b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.291+0000 7fea0ccf4640 1 --2- 172.21.15.137:0/2442696897 >> v2:172.21.15.170:3300/0 conn(0x7fea0815f750 0x7fea080b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.291+0000 7fea0ccf4640 1 -- 172.21.15.137:0/2442696897 >> v1:172.21.15.170:6789/0 conn(0x7fea080d37d0 legacy=0x7fea080d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.291+0000 7fea0ccf4640 1 -- 172.21.15.137:0/2442696897 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea080d0960 con 0x7fea0815f370 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.291+0000 7fea0ccf4640 1 --2- 172.21.15.137:0/2442696897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f370 0x7fea080cfd70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fea080d02b0 tx=0x7fea0002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7d13f74960dfdf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea077fe640 1 -- 172.21.15.137:0/2442696897 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea00037070 con 0x7fea0815f370 2024-04-26T22:00:00.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea077fe640 1 -- 172.21.15.137:0/2442696897 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea00032440 con 0x7fea0815f370 2024-04-26T22:00:00.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea077fe640 1 -- 172.21.15.137:0/2442696897 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea00032810 con 0x7fea0815f370 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea0ef58640 1 -- 172.21.15.137:0/2442696897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f370 msgr2=0x7fea080cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea0ef58640 1 --2- 172.21.15.137:0/2442696897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f370 0x7fea080cfd70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fea080d02b0 tx=0x7fea0002a230 comp rx=0 tx=0).stop 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea0ef58640 1 -- 172.21.15.137:0/2442696897 shutdown_connections 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea0ef58640 1 --2- 172.21.15.137:0/2442696897 >> v2:172.21.15.170:3300/0 conn(0x7fea0815f750 0x7fea080b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea0ef58640 1 --2- 172.21.15.137:0/2442696897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f370 0x7fea080cfd70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea0ef58640 1 -- 172.21.15.137:0/2442696897 >> 172.21.15.137:0/2442696897 conn(0x7fea0808ec10 msgr2=0x7fea0809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea0ef58640 1 -- 172.21.15.137:0/2442696897 shutdown_connections 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.292+0000 7fea0ef58640 1 -- 172.21.15.137:0/2442696897 wait complete. 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.293+0000 7fea0ef58640 1 Processor -- start 2024-04-26T22:00:00.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.293+0000 7fea0ef58640 1 -- start start 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.294+0000 7fea0ef58640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea080d37d0 0x7fea08158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.294+0000 7fea0ef58640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea0815f370 0x7fea080cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.294+0000 7fea0ef58640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f750 0x7fea080b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.294+0000 7fea0ef58640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fea080b61d0 con 0x7fea0815f750 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.294+0000 7fea0ef58640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fea080d0f20 con 0x7fea080d37d0 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.294+0000 7fea0ef58640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fea080b6350 con 0x7fea0815f370 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.294+0000 7fea0d4f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f750 0x7fea080b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.294+0000 7fea0d4f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f750 0x7fea080b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57422/0 (socket says 172.21.15.137:57422) 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.294+0000 7fea0d4f5640 1 -- 172.21.15.137:0/797322560 learned_addr learned my addr 172.21.15.137:0/797322560 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea0ccf4640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea080d37d0 0x7fea08158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea07fff640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea0815f370 0x7fea080cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea0d4f5640 1 -- 172.21.15.137:0/797322560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea0815f370 msgr2=0x7fea080cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea0d4f5640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea0815f370 0x7fea080cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea0d4f5640 1 -- 172.21.15.137:0/797322560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea080d37d0 msgr2=0x7fea08158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea0d4f5640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea080d37d0 0x7fea08158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea0d4f5640 1 -- 172.21.15.137:0/797322560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea08158840 con 0x7fea0815f750 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea07fff640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea0815f370 0x7fea080cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea0d4f5640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f750 0x7fea080b3900 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000c3c0 tx=0x7fe9f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea057fa640 1 -- 172.21.15.137:0/797322560 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0017070 con 0x7fea0815f750 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea057fa640 1 -- 172.21.15.137:0/797322560 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f00035f0 con 0x7fea0815f750 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea057fa640 1 -- 172.21.15.137:0/797322560 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00039e0 con 0x7fea0815f750 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea080cd1d0 con 0x7fea0815f750 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.295+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea080b9220 con 0x7fea0815f750 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.296+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea0806a290 con 0x7fea0815f750 2024-04-26T22:00:00.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.297+0000 7fea057fa640 1 -- 172.21.15.137:0/797322560 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9f001a070 con 0x7fea0815f750 2024-04-26T22:00:00.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.297+0000 7fea057fa640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9e806c8f0 0x7fe9e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.297+0000 7fea057fa640 1 -- 172.21.15.137:0/797322560 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe9f008ae90 con 0x7fea0815f750 2024-04-26T22:00:00.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.297+0000 7fea0ccf4640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9e806c8f0 0x7fe9e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.297+0000 7fea0ccf4640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9e806c8f0 0x7fe9e806edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea00034000 tx=0x7fea0002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.301+0000 7fea057fa640 1 -- 172.21.15.137:0/797322560 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe9f0059350 con 0x7fea0815f750 2024-04-26T22:00:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.515+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea080d1510 con 0x7fea0815f750 2024-04-26T22:00:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.515+0000 7fea057fa640 1 -- 172.21.15.137:0/797322560 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7fe9f0058c50 con 0x7fea0815f750 2024-04-26T22:00:00.515 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:00.515 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3532925157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3532925157},{"type":"v1","addr":"172.21.15.137:6836","nonce":3532925157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3509631448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3509631448},{"type":"v1","addr":"172.21.15.170:6834","nonce":3509631448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3228449407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3228449407},{"type":"v1","addr":"172.21.15.170:6835","nonce":3228449407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:59:33.028489+0000","modified":"2024-04-26T21:59:35.023196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1394398285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1394398285},{"type":"v1","addr":"172.21.15.137:6837","nonce":1394398285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5139,"qdb_cluster":[5139]},"id":2}]} 2024-04-26T22:00:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-04-26T22:00:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9e806c8f0 msgr2=0x7fe9e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9e806c8f0 0x7fe9e806edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea00034000 tx=0x7fea0002e000 comp rx=0 tx=0).stop 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f750 msgr2=0x7fea080b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f750 0x7fea080b3900 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe9f000c3c0 tx=0x7fe9f000c880 comp rx=0 tx=0).stop 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 shutdown_connections 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9e806c8f0 0x7fe9e806edb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fea0815f750 0x7fea080b3900 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fea0815f370 0x7fea080cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 --2- 172.21.15.137:0/797322560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fea080d37d0 0x7fea08158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 >> 172.21.15.137:0/797322560 conn(0x7fea0808ec10 msgr2=0x7fea08075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 shutdown_connections 2024-04-26T22:00:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.517+0000 7fea0ef58640 1 -- 172.21.15.137:0/797322560 wait complete. 2024-04-26T22:00:00.528 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:00.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.625+0000 7f6d6adbf640 1 Processor -- start 2024-04-26T22:00:00.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.625+0000 7f6d6adbf640 1 -- start start 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d6adbf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d64146980 0x7f6d64073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d6adbf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d64161850 0x7f6d640740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d6adbf640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d6415e2e0 con 0x7f6d6415d6b0 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d6adbf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6d6415e5c0 con 0x7f6d64161850 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d6adbf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6d641613c0 con 0x7f6d64146980 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d63fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d64161850 0x7f6d640740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d63fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d64161850 0x7f6d640740f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57430/0 (socket says 172.21.15.137:57430) 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d63fff640 1 -- 172.21.15.137:0/1612243155 learned_addr learned my addr 172.21.15.137:0/1612243155 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d63fff640 1 -- 172.21.15.137:0/1612243155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d64146980 msgr2=0x7f6d64073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:00.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d63fff640 1 --2- 172.21.15.137:0/1612243155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d64146980 0x7f6d64073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d63fff640 1 -- 172.21.15.137:0/1612243155 >> v1:172.21.15.170:6789/0 conn(0x7f6d6415d6b0 legacy=0x7f6d6406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:00.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.626+0000 7f6d63fff640 1 -- 172.21.15.137:0/1612243155 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d64160d70 con 0x7f6d64161850 2024-04-26T22:00:00.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.627+0000 7f6d63fff640 1 --2- 172.21.15.137:0/1612243155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 0x7f6d640740f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009870 tx=0x7f6d5002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8192b6d58b8199 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.627+0000 7f6d637fe640 1 -- 172.21.15.137:0/1612243155 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50037070 con 0x7f6d64161850 2024-04-26T22:00:00.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.627+0000 7f6d637fe640 1 -- 172.21.15.137:0/1612243155 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d50032440 con 0x7f6d64161850 2024-04-26T22:00:00.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.627+0000 7f6d637fe640 1 -- 172.21.15.137:0/1612243155 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50032810 con 0x7f6d64161850 2024-04-26T22:00:00.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.628+0000 7f6d6adbf640 1 -- 172.21.15.137:0/1612243155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 msgr2=0x7f6d640740f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.628+0000 7f6d6adbf640 1 --2- 172.21.15.137:0/1612243155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 0x7f6d640740f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009870 tx=0x7f6d5002a210 comp rx=0 tx=0).stop 2024-04-26T22:00:00.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.628+0000 7f6d6adbf640 1 -- 172.21.15.137:0/1612243155 shutdown_connections 2024-04-26T22:00:00.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.628+0000 7f6d6adbf640 1 --2- 172.21.15.137:0/1612243155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 0x7f6d640740f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.628+0000 7f6d6adbf640 1 --2- 172.21.15.137:0/1612243155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d64146980 0x7f6d64073bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.628+0000 7f6d6adbf640 1 -- 172.21.15.137:0/1612243155 >> 172.21.15.137:0/1612243155 conn(0x7f6d640ce8b0 msgr2=0x7f6d640cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:00.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.628+0000 7f6d6adbf640 1 -- 172.21.15.137:0/1612243155 shutdown_connections 2024-04-26T22:00:00.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.628+0000 7f6d6adbf640 1 -- 172.21.15.137:0/1612243155 wait complete. 2024-04-26T22:00:00.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.629+0000 7f6d6adbf640 1 Processor -- start 2024-04-26T22:00:00.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.629+0000 7f6d6adbf640 1 -- start start 2024-04-26T22:00:00.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6adbf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d64146980 0x7f6d640ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6adbf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d6415d6b0 0x7f6d6415f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6adbf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 0x7f6d6415fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6adbf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d64146d60 con 0x7f6d64161850 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6adbf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6d640b5120 con 0x7f6d64146980 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6adbf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6d6415db40 con 0x7f6d6415d6b0 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6935c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 0x7f6d6415fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6935c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 0x7f6d6415fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57438/0 (socket says 172.21.15.137:57438) 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6935c640 1 -- 172.21.15.137:0/2317781790 learned_addr learned my addr 172.21.15.137:0/2317781790 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d68b5b640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d64146980 0x7f6d640ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6935c640 1 -- 172.21.15.137:0/2317781790 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d6415d6b0 msgr2=0x7f6d6415f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6935c640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d6415d6b0 0x7f6d6415f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6935c640 1 -- 172.21.15.137:0/2317781790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d64146980 msgr2=0x7f6d640ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6935c640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d64146980 0x7f6d640ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6935c640 1 -- 172.21.15.137:0/2317781790 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d641416a0 con 0x7f6d64161850 2024-04-26T22:00:00.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6935c640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 0x7f6d6415fed0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00c780 tx=0x7f6d5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d617fa640 1 -- 172.21.15.137:0/2317781790 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c017070 con 0x7f6d64161850 2024-04-26T22:00:00.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d617fa640 1 -- 172.21.15.137:0/2317781790 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5c003da0 con 0x7f6d64161850 2024-04-26T22:00:00.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d64141980 con 0x7f6d64161850 2024-04-26T22:00:00.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d617fa640 1 -- 172.21.15.137:0/2317781790 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0052b0 con 0x7f6d64161850 2024-04-26T22:00:00.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.630+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d64141f40 con 0x7f6d64161850 2024-04-26T22:00:00.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.631+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6406a290 con 0x7f6d64161850 2024-04-26T22:00:00.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.632+0000 7f6d617fa640 1 -- 172.21.15.137:0/2317781790 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d5c01a070 con 0x7f6d64161850 2024-04-26T22:00:00.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.632+0000 7f6d617fa640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6d4806c8f0 0x7f6d4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.632+0000 7f6d617fa640 1 -- 172.21.15.137:0/2317781790 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6d5c08b1f0 con 0x7f6d64161850 2024-04-26T22:00:00.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.632+0000 7f6d68b5b640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6d4806c8f0 0x7f6d4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.633+0000 7f6d68b5b640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6d4806c8f0 0x7f6d4806edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800a810 tx=0x7f6d58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.636+0000 7f6d617fa640 1 -- 172.21.15.137:0/2317781790 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6d5c059620 con 0x7f6d64161850 2024-04-26T22:00:00.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.853+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d640cec90 con 0x7f6d64161850 2024-04-26T22:00:00.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.853+0000 7f6d617fa640 1 -- 172.21.15.137:0/2317781790 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5193 (secure 0 0 0) 0x7f6d5c058f20 con 0x7f6d64161850 2024-04-26T22:00:00.853 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:00.853 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3532925157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3532925157},{"type":"v1","addr":"172.21.15.137:6836","nonce":3532925157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3509631448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3509631448},{"type":"v1","addr":"172.21.15.170:6834","nonce":3509631448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3228449407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3228449407},{"type":"v1","addr":"172.21.15.170:6835","nonce":3228449407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T21:59:33.028489+0000","modified":"2024-04-26T21:59:35.023196+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5139},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5139":{"gid":5139,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1394398285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1394398285},{"type":"v1","addr":"172.21.15.137:6837","nonce":1394398285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5139,"qdb_cluster":[5139]},"id":2}]} 2024-04-26T22:00:00.854 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 14 2024-04-26T22:00:00.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6d4806c8f0 msgr2=0x7f6d4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6d4806c8f0 0x7f6d4806edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800a810 tx=0x7f6d58008040 comp rx=0 tx=0).stop 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 msgr2=0x7f6d6415fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 0x7f6d6415fed0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00c780 tx=0x7f6d5c00cc40 comp rx=0 tx=0).stop 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 shutdown_connections 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6d4806c8f0 0x7f6d4806edb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d64161850 0x7f6d6415fed0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d6415d6b0 0x7f6d6415f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 --2- 172.21.15.137:0/2317781790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d64146980 0x7f6d640ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 >> 172.21.15.137:0/2317781790 conn(0x7f6d640ce8b0 msgr2=0x7f6d640b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 shutdown_connections 2024-04-26T22:00:00.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.855+0000 7f6d6adbf640 1 -- 172.21.15.137:0/2317781790 wait complete. 2024-04-26T22:00:00.866 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:00.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.963+0000 7f42a5820640 1 Processor -- start 2024-04-26T22:00:00.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.963+0000 7f42a5820640 1 -- start start 2024-04-26T22:00:00.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f42a5820640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a015f370 0x7f42a00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f42a5820640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a00d03a0 con 0x7f42a00d3ee0 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f42a5820640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a00d0680 con 0x7f42a015f750 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f42a5820640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42a00d0960 con 0x7f42a015f370 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429f7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f42a00d3ee0 0x7f42a00b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54756/0 (socket says 172.21.15.137:54756) 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429f7fe640 1 -- 172.21.15.137:0/1821651574 learned_addr learned my addr 172.21.15.137:0/1821651574 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278595859 0 0) 0x7f42a00d03a0 con 0x7f42a00d3ee0 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c003520 con 0x7f42a00d3ee0 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429effd640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a015f370 0x7f42a00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 72087624 0 0) 0x7f428c003520 con 0x7f42a00d3ee0 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a015f370 msgr2=0x7f42a00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a015f370 0x7f42a00cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 >> v1:172.21.15.170:6789/0 conn(0x7f42a015f750 legacy=0x7f42a00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a00d0c40 con 0x7f42a00d3ee0 2024-04-26T22:00:00.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f42980019f0 con 0x7f42a00d3ee0 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429effd640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a015f370 0x7f42a00cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 >> v1:172.21.15.137:6789/0 conn(0x7f42a00d3ee0 legacy=0x7f42a00b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f428c0039e0 0x7f428c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f428c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a015f370 0x7f428c0052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42a00d0960 con 0x7f428c004800 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f428c00bba0 con 0x7f428c0039e0 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f428c00bda0 con 0x7f42a015f370 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f4297fff640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f428c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.964+0000 7f429effd640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f428c0039e0 0x7f428c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.965+0000 7f429f7fe640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a015f370 0x7f428c0052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.965+0000 7f4297fff640 1 -- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a015f370 msgr2=0x7f428c0052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.965+0000 7f4297fff640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a015f370 0x7f428c0052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.965+0000 7f4297fff640 1 -- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f428c0039e0 msgr2=0x7f428c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.965+0000 7f4297fff640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f428c0039e0 0x7f428c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.965+0000 7f4297fff640 1 -- 172.21.15.137:0/1821651574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c003520 con 0x7f428c004800 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.965+0000 7f4297fff640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f428c004c80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4288001750 tx=0x7f428c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28e71ed217c8d90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288001370 con 0x7f428c004800 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42880052d0 con 0x7f428c004800 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f429e7fc640 1 -- 172.21.15.137:0/1821651574 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428802abe0 con 0x7f428c004800 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f42a5820640 1 -- 172.21.15.137:0/1821651574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 msgr2=0x7f428c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f42a5820640 1 --2- 172.21.15.137:0/1821651574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f428c004c80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4288001750 tx=0x7f428c005830 comp rx=0 tx=0).stop 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f429f7fe640 1 -- 172.21.15.137:0/1821651574 reap_dead start 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f42a5820640 1 -- 172.21.15.137:0/1821651574 shutdown_connections 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f42a5820640 1 -- 172.21.15.137:0/1821651574 >> 172.21.15.137:0/1821651574 conn(0x7f42a008ec10 msgr2=0x7f42a009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f42a5820640 1 -- 172.21.15.137:0/1821651574 shutdown_connections 2024-04-26T22:00:00.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.966+0000 7f42a5820640 1 -- 172.21.15.137:0/1821651574 wait complete. 2024-04-26T22:00:00.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.967+0000 7f42a5820640 1 Processor -- start 2024-04-26T22:00:00.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.967+0000 7f42a5820640 1 -- start start 2024-04-26T22:00:00.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f42a5820640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f42a015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f42a5820640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a00c94a0 0x7f42a00c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f42a5820640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a00b3a10 0x7f42a00b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f42a5820640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42a00cfef0 con 0x7f428c004800 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f42a5820640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42a00cfd70 con 0x7f42a00b3a10 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f42a5820640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42a00d0070 con 0x7f42a00c94a0 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f42a015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f42a015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57458/0 (socket says 172.21.15.137:57458) 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429effd640 1 -- 172.21.15.137:0/2122033337 learned_addr learned my addr 172.21.15.137:0/2122033337 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f4297fff640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a00c94a0 0x7f42a00c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429f7fe640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a00b3a10 0x7f42a00b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429effd640 1 -- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a00c94a0 msgr2=0x7f42a00c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429effd640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a00c94a0 0x7f42a00c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429effd640 1 -- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a00b3a10 msgr2=0x7f42a00b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429effd640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a00b3a10 0x7f42a00b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429effd640 1 -- 172.21.15.137:0/2122033337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a015bfe0 con 0x7f428c004800 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f4297fff640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a00c94a0 0x7f42a00c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.968+0000 7f429f7fe640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a00b3a10 0x7f42a00b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:00.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.969+0000 7f429effd640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f42a015baa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f42900115f0 tx=0x7f4290011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.969+0000 7f429cff9640 1 -- 172.21.15.137:0/2122033337 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290019070 con 0x7f428c004800 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.969+0000 7f429cff9640 1 -- 172.21.15.137:0/2122033337 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4290004220 con 0x7f428c004800 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.969+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a00b2970 con 0x7f428c004800 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.969+0000 7f429cff9640 1 -- 172.21.15.137:0/2122033337 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429000f040 con 0x7f428c004800 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.969+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a00b2f30 con 0x7f428c004800 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.970+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a006a290 con 0x7f428c004800 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.970+0000 7f429cff9640 1 -- 172.21.15.137:0/2122033337 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f429000f6f0 con 0x7f428c004800 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.970+0000 7f429cff9640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f428006c8f0 0x7f428006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.971+0000 7f429cff9640 1 -- 172.21.15.137:0/2122033337 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f429008be60 con 0x7f428c004800 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.971+0000 7f4297fff640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f428006c8f0 0x7f428006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:00.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.971+0000 7f4297fff640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f428006c8f0 0x7f428006edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4288032000 tx=0x7f428802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:00.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:00.975+0000 7f429cff9640 1 -- 172.21.15.137:0/2122033337 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f429005a290 con 0x7f428c004800 2024-04-26T22:00:01.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.150+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42a00d52c0 con 0x7f428c004800 2024-04-26T22:00:01.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.152+0000 7f429cff9640 1 -- 172.21.15.137:0/2122033337 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16681 (secure 0 0 0) 0x7f4290059b90 con 0x7f428c004800 2024-04-26T22:00:01.152 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:01.152 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":34,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T21:59:34.679270+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T21:59:31.445571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T21:59:31.978335+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f428006c8f0 msgr2=0x7f428006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f428006c8f0 0x7f428006edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4288032000 tx=0x7f428802e000 comp rx=0 tx=0).stop 2024-04-26T22:00:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 msgr2=0x7f42a015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f42a015baa0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f42900115f0 tx=0x7f4290011ab0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 shutdown_connections 2024-04-26T22:00:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f428006c8f0 0x7f428006edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42a00b3a10 0x7f42a00b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42a00c94a0 0x7f42a00c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 --2- 172.21.15.137:0/2122033337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f428c004800 0x7f42a015baa0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 >> 172.21.15.137:0/2122033337 conn(0x7f42a008ec10 msgr2=0x7f42a00d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 shutdown_connections 2024-04-26T22:00:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.154+0000 7f42a5820640 1 -- 172.21.15.137:0/2122033337 wait complete. 2024-04-26T22:00:01.165 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:00:01.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.263+0000 7fc03eb9d640 1 Processor -- start 2024-04-26T22:00:01.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.263+0000 7fc03eb9d640 1 -- start start 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc03eb9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc038145980 0x7fc038160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc03eb9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0380b3de0 0x7fc0380b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc03eb9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b5fd0 0x7fc03815c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc03eb9d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc0380b5140 con 0x7fc0380b3de0 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc03eb9d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc0380b6410 con 0x7fc038145980 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc03eb9d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc0380b4260 con 0x7fc0380b5fd0 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc037fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0380b3de0 0x7fc0380b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc037fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc0380b3de0 0x7fc0380b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57464/0 (socket says 172.21.15.137:57464) 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc037fff640 1 -- 172.21.15.137:0/266712058 learned_addr learned my addr 172.21.15.137:0/266712058 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc03c939640 1 --2- 172.21.15.137:0/266712058 >> v2:172.21.15.170:3300/0 conn(0x7fc038145980 0x7fc038160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc03d13a640 1 --2- 172.21.15.137:0/266712058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b5fd0 0x7fc03815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc037fff640 1 -- 172.21.15.137:0/266712058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b5fd0 msgr2=0x7fc03815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc037fff640 1 --2- 172.21.15.137:0/266712058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b5fd0 0x7fc03815c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc037fff640 1 -- 172.21.15.137:0/266712058 >> v2:172.21.15.170:3300/0 conn(0x7fc038145980 msgr2=0x7fc038160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc037fff640 1 --2- 172.21.15.137:0/266712058 >> v2:172.21.15.170:3300/0 conn(0x7fc038145980 0x7fc038160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc037fff640 1 -- 172.21.15.137:0/266712058 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0380b4530 con 0x7fc0380b3de0 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.264+0000 7fc03c939640 1 --2- 172.21.15.137:0/266712058 >> v2:172.21.15.170:3300/0 conn(0x7fc038145980 0x7fc038160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc037fff640 1 --2- 172.21.15.137:0/266712058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 0x7fc0380b5a90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc0380b6590 tx=0x7fc02402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be700fed648df3af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc0377fe640 1 -- 172.21.15.137:0/266712058 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024037070 con 0x7fc0380b3de0 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc0377fe640 1 -- 172.21.15.137:0/266712058 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc024032440 con 0x7fc0380b3de0 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc0377fe640 1 -- 172.21.15.137:0/266712058 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024032810 con 0x7fc0380b3de0 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc03eb9d640 1 -- 172.21.15.137:0/266712058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 msgr2=0x7fc0380b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/266712058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 0x7fc0380b5a90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc0380b6590 tx=0x7fc02402a130 comp rx=0 tx=0).stop 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc03eb9d640 1 -- 172.21.15.137:0/266712058 shutdown_connections 2024-04-26T22:00:01.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/266712058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc0380b5fd0 0x7fc03815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/266712058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 0x7fc0380b5a90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/266712058 >> v2:172.21.15.170:3300/0 conn(0x7fc038145980 0x7fc038160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.265+0000 7fc03eb9d640 1 -- 172.21.15.137:0/266712058 >> 172.21.15.137:0/266712058 conn(0x7fc0380d0d30 msgr2=0x7fc0380d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:01.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.266+0000 7fc03eb9d640 1 -- 172.21.15.137:0/266712058 shutdown_connections 2024-04-26T22:00:01.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.266+0000 7fc03eb9d640 1 -- 172.21.15.137:0/266712058 wait complete. 2024-04-26T22:00:01.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.267+0000 7fc03eb9d640 1 Processor -- start 2024-04-26T22:00:01.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.267+0000 7fc03eb9d640 1 -- start start 2024-04-26T22:00:01.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03eb9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 0x7fc0381f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03eb9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380b5fd0 0x7fc03813d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03eb9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc038145980 0x7fc03815b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03eb9d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc0380b4dd0 con 0x7fc0380b3de0 2024-04-26T22:00:01.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03eb9d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc0380b4af0 con 0x7fc0380b5fd0 2024-04-26T22:00:01.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03eb9d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc03815ca50 con 0x7fc038145980 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03c939640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 0x7fc0381f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03c939640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 0x7fc0381f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57478/0 (socket says 172.21.15.137:57478) 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03c939640 1 -- 172.21.15.137:0/3858610976 learned_addr learned my addr 172.21.15.137:0/3858610976 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc037fff640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380b5fd0 0x7fc03813d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03d13a640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc038145980 0x7fc03815b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03c939640 1 -- 172.21.15.137:0/3858610976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc038145980 msgr2=0x7fc03815b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03c939640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc038145980 0x7fc03815b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03c939640 1 -- 172.21.15.137:0/3858610976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380b5fd0 msgr2=0x7fc03813d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03c939640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380b5fd0 0x7fc03813d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03c939640 1 -- 172.21.15.137:0/3858610976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03813dd20 con 0x7fc0380b3de0 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc037fff640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380b5fd0 0x7fc03813d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03c939640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 0x7fc0381f5f50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00eb40 tx=0x7fc02c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc0357fa640 1 -- 172.21.15.137:0/3858610976 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c007c10 con 0x7fc0380b3de0 2024-04-26T22:00:01.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc0357fa640 1 -- 172.21.15.137:0/3858610976 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc02c007db0 con 0x7fc0380b3de0 2024-04-26T22:00:01.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03815b890 con 0x7fc0380b3de0 2024-04-26T22:00:01.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc0357fa640 1 -- 172.21.15.137:0/3858610976 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c010680 con 0x7fc0380b3de0 2024-04-26T22:00:01.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.268+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03813e2a0 con 0x7fc0380b3de0 2024-04-26T22:00:01.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.269+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc03806a290 con 0x7fc0380b3de0 2024-04-26T22:00:01.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.270+0000 7fc0357fa640 1 -- 172.21.15.137:0/3858610976 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc02c00b030 con 0x7fc0380b3de0 2024-04-26T22:00:01.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.270+0000 7fc0357fa640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc01c06c8f0 0x7fc01c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.270+0000 7fc0357fa640 1 -- 172.21.15.137:0/3858610976 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc02c08de90 con 0x7fc0380b3de0 2024-04-26T22:00:01.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.270+0000 7fc037fff640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc01c06c8f0 0x7fc01c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.271+0000 7fc037fff640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc01c06c8f0 0x7fc01c06edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc024034000 tx=0x7fc02402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:01.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.274+0000 7fc0357fa640 1 -- 172.21.15.137:0/3858610976 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc02c05c2c0 con 0x7fc0380b3de0 2024-04-26T22:00:01.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.485+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc038073cc0 con 0x7fc0380b3de0 2024-04-26T22:00:01.485 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:00:01.486+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:00:01.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.487+0000 7fc0357fa640 1 -- 172.21.15.137:0/3858610976 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7fc02c05bbc0 con 0x7fc0380b3de0 2024-04-26T22:00:01.487 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:00:01.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc01c06c8f0 msgr2=0x7fc01c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc01c06c8f0 0x7fc01c06edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc024034000 tx=0x7fc02402e000 comp rx=0 tx=0).stop 2024-04-26T22:00:01.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 msgr2=0x7fc0381f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 0x7fc0381f5f50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00eb40 tx=0x7fc02c00cf70 comp rx=0 tx=0).stop 2024-04-26T22:00:01.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 shutdown_connections 2024-04-26T22:00:01.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc01c06c8f0 0x7fc01c06edb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc038145980 0x7fc03815b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0380b5fd0 0x7fc03813d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 --2- 172.21.15.137:0/3858610976 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc0380b3de0 0x7fc0381f5f50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 >> 172.21.15.137:0/3858610976 conn(0x7fc0380d0d30 msgr2=0x7fc038144620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:01.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 shutdown_connections 2024-04-26T22:00:01.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.490+0000 7fc03eb9d640 1 -- 172.21.15.137:0/3858610976 wait complete. 2024-04-26T22:00:01.493 INFO:tasks.ceph.mds.a.smithi137.stderr: -6643> 2024-04-26T21:59:37.649+0000 7fbdbe40b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:00:01.502 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:00:01.525 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:00:01.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.603+0000 7fb21f314640 1 Processor -- start 2024-04-26T22:00:01.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.603+0000 7fb21f314640 1 -- start start 2024-04-26T22:00:01.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.603+0000 7fb21f314640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb21806f340 0x7fb2180b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.603+0000 7fb21f314640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb2180d0300 0x7fb21806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21f314640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb21806fc60 con 0x7fb2180b3e50 2024-04-26T22:00:01.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21f314640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb2180b46a0 con 0x7fb2180d0300 2024-04-26T22:00:01.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21f314640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb2180b5db0 con 0x7fb21806f340 2024-04-26T22:00:01.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21c8af640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb2180d0300 0x7fb21806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21c8af640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb2180d0300 0x7fb21806f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57490/0 (socket says 172.21.15.137:57490) 2024-04-26T22:00:01.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21c8af640 1 -- 172.21.15.137:0/3705523063 learned_addr learned my addr 172.21.15.137:0/3705523063 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:01.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21d0b0640 1 --2- 172.21.15.137:0/3705523063 >> v2:172.21.15.170:3300/0 conn(0x7fb21806f340 0x7fb2180b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21c8af640 1 -- 172.21.15.137:0/3705523063 >> v2:172.21.15.170:3300/0 conn(0x7fb21806f340 msgr2=0x7fb2180b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:01.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21c8af640 1 --2- 172.21.15.137:0/3705523063 >> v2:172.21.15.170:3300/0 conn(0x7fb21806f340 0x7fb2180b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21c8af640 1 -- 172.21.15.137:0/3705523063 >> v1:172.21.15.170:6789/0 conn(0x7fb2180b3e50 legacy=0x7fb2180720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.604+0000 7fb21c8af640 1 -- 172.21.15.137:0/3705523063 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2180b6090 con 0x7fb2180d0300 2024-04-26T22:00:01.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb21c8af640 1 --2- 172.21.15.137:0/3705523063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180d0300 0x7fb21806f720 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb218076180 tx=0x7fb21402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c381cda1f2009a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:01.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb20ffff640 1 -- 172.21.15.137:0/3705523063 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214037070 con 0x7fb2180d0300 2024-04-26T22:00:01.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb20ffff640 1 -- 172.21.15.137:0/3705523063 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb214032440 con 0x7fb2180d0300 2024-04-26T22:00:01.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb20ffff640 1 -- 172.21.15.137:0/3705523063 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214032810 con 0x7fb2180d0300 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb21f314640 1 -- 172.21.15.137:0/3705523063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180d0300 msgr2=0x7fb21806f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb21f314640 1 --2- 172.21.15.137:0/3705523063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180d0300 0x7fb21806f720 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb218076180 tx=0x7fb21402a150 comp rx=0 tx=0).stop 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb21f314640 1 -- 172.21.15.137:0/3705523063 shutdown_connections 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb21f314640 1 --2- 172.21.15.137:0/3705523063 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180d0300 0x7fb21806f720 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb21f314640 1 --2- 172.21.15.137:0/3705523063 >> v2:172.21.15.170:3300/0 conn(0x7fb21806f340 0x7fb2180b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb21f314640 1 -- 172.21.15.137:0/3705523063 >> 172.21.15.137:0/3705523063 conn(0x7fb2180cd8a0 msgr2=0x7fb2180cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb21f314640 1 -- 172.21.15.137:0/3705523063 shutdown_connections 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.605+0000 7fb21f314640 1 -- 172.21.15.137:0/3705523063 wait complete. 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21f314640 1 Processor -- start 2024-04-26T22:00:01.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21f314640 1 -- start start 2024-04-26T22:00:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21f314640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb21806f340 0x7fb2181f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21f314640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180b3e50 0x7fb2180c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21f314640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2180d0300 0x7fb21813cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21f314640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180b42e0 con 0x7fb2180b3e50 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21f314640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180b6650 con 0x7fb2180d0300 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21f314640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb2180b4460 con 0x7fb21806f340 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21c8af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180b3e50 0x7fb2180c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21c8af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180b3e50 0x7fb2180c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57506/0 (socket says 172.21.15.137:57506) 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21c8af640 1 -- 172.21.15.137:0/4073390201 learned_addr learned my addr 172.21.15.137:0/4073390201 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21d0b0640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb21806f340 0x7fb2181f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.607+0000 7fb21d8b1640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2180d0300 0x7fb21813cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb21c8af640 1 -- 172.21.15.137:0/4073390201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb21806f340 msgr2=0x7fb2181f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb21c8af640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb21806f340 0x7fb2181f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb21c8af640 1 -- 172.21.15.137:0/4073390201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2180d0300 msgr2=0x7fb21813cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb21c8af640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2180d0300 0x7fb21813cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:01.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb21c8af640 1 -- 172.21.15.137:0/4073390201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2180c6300 con 0x7fb2180b3e50 2024-04-26T22:00:01.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb21d0b0640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb21806f340 0x7fb2181f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:01.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb21c8af640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180b3e50 0x7fb2180c5dc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb214000c00 tx=0x7fb2140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:01.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb20dffb640 1 -- 172.21.15.137:0/4073390201 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214041070 con 0x7fb2180b3e50 2024-04-26T22:00:01.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb20dffb640 1 -- 172.21.15.137:0/4073390201 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21403c870 con 0x7fb2180b3e50 2024-04-26T22:00:01.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21813d510 con 0x7fb2180b3e50 2024-04-26T22:00:01.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb20dffb640 1 -- 172.21.15.137:0/4073390201 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb214037040 con 0x7fb2180b3e50 2024-04-26T22:00:01.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.608+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2181f5250 con 0x7fb2180b3e50 2024-04-26T22:00:01.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.609+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21806a290 con 0x7fb2180b3e50 2024-04-26T22:00:01.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.610+0000 7fb20dffb640 1 -- 172.21.15.137:0/4073390201 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb214044070 con 0x7fb2180b3e50 2024-04-26T22:00:01.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.610+0000 7fb20dffb640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1fc06c8f0 0x7fb1fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:01.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.610+0000 7fb20dffb640 1 -- 172.21.15.137:0/4073390201 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fb2140ac4b0 con 0x7fb2180b3e50 2024-04-26T22:00:01.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.610+0000 7fb21d0b0640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1fc06c8f0 0x7fb1fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:01.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.611+0000 7fb21d0b0640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1fc06c8f0 0x7fb1fc06edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb208009af0 tx=0x7fb208008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:01.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.614+0000 7fb20dffb640 1 -- 172.21.15.137:0/4073390201 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb21407a230 con 0x7fb2180b3e50 2024-04-26T22:00:01.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:01.830+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb2180cfe50 con 0x7fb2180b3e50 2024-04-26T22:00:02.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.489+0000 7fb20dffb640 1 -- 172.21.15.137:0/4073390201 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7fb21407e530 con 0x7fb2180b3e50 2024-04-26T22:00:02.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1fc06c8f0 msgr2=0x7fb1fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:02.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1fc06c8f0 0x7fb1fc06edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb208009af0 tx=0x7fb208008040 comp rx=0 tx=0).stop 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180b3e50 msgr2=0x7fb2180c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180b3e50 0x7fb2180c5dc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb214000c00 tx=0x7fb2140046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 shutdown_connections 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1fc06c8f0 0x7fb1fc06edb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2180b3e50 0x7fb2180c5dc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2180d0300 0x7fb21813cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 --2- 172.21.15.137:0/4073390201 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb21806f340 0x7fb2181f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 >> 172.21.15.137:0/4073390201 conn(0x7fb2180cd8a0 msgr2=0x7fb21815e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 shutdown_connections 2024-04-26T22:00:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.491+0000 7fb21f314640 1 -- 172.21.15.137:0/4073390201 wait complete. 2024-04-26T22:00:02.505 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:00:02.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.651+0000 7f66a2d9e640 1 Processor -- start 2024-04-26T22:00:02.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.651+0000 7f66a2d9e640 1 -- start start 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a2d9e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f669c0b2250 0x7f669c070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a2d9e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c0cff30 con 0x7f669c0d1360 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a2d9e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c0d0210 con 0x7f669c15d350 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a2d9e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f669c0cdc30 con 0x7f669c0b2250 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a259d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f669c0d1360 0x7f669c0ce0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54766/0 (socket says 172.21.15.137:54766) 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a259d640 1 -- 172.21.15.137:0/1489766619 learned_addr learned my addr 172.21.15.137:0/1489766619 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a159b640 1 --2- 172.21.15.137:0/1489766619 >> v2:172.21.15.170:3300/0 conn(0x7f669c0b2250 0x7f669c070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179789184 0 0) 0x7f669c0cff30 con 0x7f669c0d1360 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6688003520 con 0x7f669c0d1360 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1543196171 0 0) 0x7f6688003520 con 0x7f669c0d1360 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 >> v2:172.21.15.170:3300/0 conn(0x7f669c0b2250 msgr2=0x7f669c070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 --2- 172.21.15.137:0/1489766619 >> v2:172.21.15.170:3300/0 conn(0x7f669c0b2250 0x7f669c070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 >> v1:172.21.15.170:6789/0 conn(0x7f669c15d350 legacy=0x7f669c0cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c0d04f0 con 0x7f669c0d1360 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f66940019f0 con 0x7f669c0d1360 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 >> v1:172.21.15.137:6789/0 conn(0x7f669c0d1360 legacy=0x7f669c0ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f6688003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6688004800 0x7f6688004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66880051c0 0x7f668800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f669c0cdc30 con 0x7f66880039b0 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f668800c070 con 0x7f66880051c0 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.652+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f668800c270 con 0x7f6688004800 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a1d9c640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f6688003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a259d640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66880051c0 0x7f668800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a159b640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6688004800 0x7f6688004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a1d9c640 1 -- 172.21.15.137:0/1489766619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6688004800 msgr2=0x7f6688004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:02.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a1d9c640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6688004800 0x7f6688004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a1d9c640 1 -- 172.21.15.137:0/1489766619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66880051c0 msgr2=0x7f668800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:02.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a1d9c640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66880051c0 0x7f668800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a1d9c640 1 -- 172.21.15.137:0/1489766619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6688003520 con 0x7f66880039b0 2024-04-26T22:00:02.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a259d640 1 -- 172.21.15.137:0/1489766619 reap_dead start 2024-04-26T22:00:02.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.653+0000 7f66a1d9c640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f6688003dd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6698001750 tx=0x7f6688005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac7c04af52660fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:02.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698001370 con 0x7f66880039b0 2024-04-26T22:00:02.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66980052d0 con 0x7f66880039b0 2024-04-26T22:00:02.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a0d9a640 1 -- 172.21.15.137:0/1489766619 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669802abc0 con 0x7f66880039b0 2024-04-26T22:00:02.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1489766619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 msgr2=0x7f6688003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:02.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a2d9e640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f6688003dd0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6698001750 tx=0x7f6688005830 comp rx=0 tx=0).stop 2024-04-26T22:00:02.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1489766619 shutdown_connections 2024-04-26T22:00:02.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a2d9e640 1 --2- 172.21.15.137:0/1489766619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f6688003dd0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1489766619 >> 172.21.15.137:0/1489766619 conn(0x7f669c0d2d80 msgr2=0x7f669c0d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:02.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1489766619 shutdown_connections 2024-04-26T22:00:02.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.654+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1489766619 wait complete. 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a2d9e640 1 Processor -- start 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a2d9e640 1 -- start start 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a2d9e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f669c14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a2d9e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669c15f2f0 0x7f669c1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a2d9e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669c15f750 0x7f669c154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a2d9e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f669c0702a0 con 0x7f66880039b0 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a2d9e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f669c070120 con 0x7f669c15f750 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a2d9e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f669c070420 con 0x7f669c15f2f0 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a1d9c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f669c14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a1d9c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f669c14f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57524/0 (socket says 172.21.15.137:57524) 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a1d9c640 1 -- 172.21.15.137:0/1837522430 learned_addr learned my addr 172.21.15.137:0/1837522430 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:02.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a159b640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669c15f2f0 0x7f669c1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.656+0000 7f66a259d640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669c15f750 0x7f669c154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66a1d9c640 1 -- 172.21.15.137:0/1837522430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669c15f2f0 msgr2=0x7f669c1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66a1d9c640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669c15f2f0 0x7f669c1546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66a1d9c640 1 -- 172.21.15.137:0/1837522430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669c15f750 msgr2=0x7f669c154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66a1d9c640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669c15f750 0x7f669c154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66a1d9c640 1 -- 172.21.15.137:0/1837522430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c0cbe70 con 0x7f66880039b0 2024-04-26T22:00:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66a1d9c640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f669c14f450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f669802a570 tx=0x7f6698001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:02.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66927fc640 1 -- 172.21.15.137:0/1837522430 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698040030 con 0x7f66880039b0 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66927fc640 1 -- 172.21.15.137:0/1837522430 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669802be50 con 0x7f66880039b0 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66927fc640 1 -- 172.21.15.137:0/1837522430 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698001370 con 0x7f66880039b0 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669c0cc150 con 0x7f66880039b0 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.657+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669c0cc710 con 0x7f66880039b0 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.658+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669c050730 con 0x7f66880039b0 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.658+0000 7f66927fc640 1 -- 172.21.15.137:0/1837522430 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6698043070 con 0x7f66880039b0 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.659+0000 7f66927fc640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f668006c8f0 0x7f668006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.659+0000 7f66927fc640 1 -- 172.21.15.137:0/1837522430 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f66980ab290 con 0x7f66880039b0 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.659+0000 7f66a159b640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f668006c8f0 0x7f668006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:02.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.659+0000 7f66a159b640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f668006c8f0 0x7f668006edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f669c1f66a0 tx=0x7f668c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:02.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.663+0000 7f66927fc640 1 -- 172.21.15.137:0/1837522430 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f669804b020 con 0x7f66880039b0 2024-04-26T22:00:02.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:02.843+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f669c1557b0 con 0x7f66880039b0 2024-04-26T22:00:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.809+0000 7f66927fc640 1 -- 172.21.15.137:0/1837522430 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7f6698078f80 con 0x7f66880039b0 2024-04-26T22:00:03.809 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.812+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f668006c8f0 msgr2=0x7f668006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.812+0000 7f66a2d9e640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f668006c8f0 0x7f668006edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f669c1f66a0 tx=0x7f668c008040 comp rx=0 tx=0).stop 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.812+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 msgr2=0x7f669c14f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.812+0000 7f66a2d9e640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f669c14f450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f669802a570 tx=0x7f6698001120 comp rx=0 tx=0).stop 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.813+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 shutdown_connections 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.813+0000 7f66a2d9e640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f668006c8f0 0x7f668006edb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.813+0000 7f66a2d9e640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f669c15f750 0x7f669c154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.813+0000 7f66a2d9e640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f669c15f2f0 0x7f669c1546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.813+0000 7f66a2d9e640 1 --2- 172.21.15.137:0/1837522430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f66880039b0 0x7f669c14f450 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.813+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 >> 172.21.15.137:0/1837522430 conn(0x7f669c0d2d80 msgr2=0x7f669c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.813+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 shutdown_connections 2024-04-26T22:00:03.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.813+0000 7f66a2d9e640 1 -- 172.21.15.137:0/1837522430 wait complete. 2024-04-26T22:00:03.825 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:00:03.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.927+0000 7f6871daf640 1 Processor -- start 2024-04-26T22:00:03.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.928+0000 7f6871daf640 1 -- start start 2024-04-26T22:00:03.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.928+0000 7f6871daf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f686c1458b0 0x7f686c0d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:03.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.928+0000 7f6871daf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c06f760 0x7f686c06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.928+0000 7f6871daf640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f686c0d1cc0 con 0x7f686c15fd00 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.928+0000 7f6871daf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f686c160880 con 0x7f686c1458b0 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.928+0000 7f6871daf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f686c0d0790 con 0x7f686c06f760 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.929+0000 7f686b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f686c1458b0 0x7f686c0d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.929+0000 7f686b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f686c1458b0 0x7f686c0d1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57540/0 (socket says 172.21.15.137:57540) 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.929+0000 7f686b7fe640 1 -- 172.21.15.137:0/311888340 learned_addr learned my addr 172.21.15.137:0/311888340 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.929+0000 7f686affd640 1 --2- 172.21.15.137:0/311888340 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c06f760 0x7f686c06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.929+0000 7f686b7fe640 1 -- 172.21.15.137:0/311888340 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c06f760 msgr2=0x7f686c06fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.929+0000 7f686b7fe640 1 --2- 172.21.15.137:0/311888340 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c06f760 0x7f686c06fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.929+0000 7f686b7fe640 1 -- 172.21.15.137:0/311888340 >> v1:172.21.15.170:6789/0 conn(0x7f686c15fd00 legacy=0x7f686c160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.929+0000 7f686b7fe640 1 -- 172.21.15.137:0/311888340 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c145c90 con 0x7f686c1458b0 2024-04-26T22:00:03.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f686b7fe640 1 --2- 172.21.15.137:0/311888340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 0x7f686c0d1780 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f685c009870 tx=0x7f685c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a779057256c7a1ed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:03.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f686a7fc640 1 -- 172.21.15.137:0/311888340 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c037070 con 0x7f686c1458b0 2024-04-26T22:00:03.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f686a7fc640 1 -- 172.21.15.137:0/311888340 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f685c032440 con 0x7f686c1458b0 2024-04-26T22:00:03.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f686a7fc640 1 -- 172.21.15.137:0/311888340 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c032810 con 0x7f686c1458b0 2024-04-26T22:00:03.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f6871daf640 1 -- 172.21.15.137:0/311888340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 msgr2=0x7f686c0d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:03.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f6871daf640 1 --2- 172.21.15.137:0/311888340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 0x7f686c0d1780 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f685c009870 tx=0x7f685c02a270 comp rx=0 tx=0).stop 2024-04-26T22:00:03.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f6871daf640 1 -- 172.21.15.137:0/311888340 shutdown_connections 2024-04-26T22:00:03.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f6871daf640 1 --2- 172.21.15.137:0/311888340 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c06f760 0x7f686c06fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:03.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f6871daf640 1 --2- 172.21.15.137:0/311888340 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 0x7f686c0d1780 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:03.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f6871daf640 1 -- 172.21.15.137:0/311888340 >> 172.21.15.137:0/311888340 conn(0x7f686c0b7460 msgr2=0x7f686c0b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:03.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f6871daf640 1 -- 172.21.15.137:0/311888340 shutdown_connections 2024-04-26T22:00:03.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.930+0000 7f6871daf640 1 -- 172.21.15.137:0/311888340 wait complete. 2024-04-26T22:00:03.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.931+0000 7f6871daf640 1 Processor -- start 2024-04-26T22:00:03.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f6871daf640 1 -- start start 2024-04-26T22:00:03.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f6871daf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686c06f760 0x7f686c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:03.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f6871daf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 0x7f686c0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:03.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f6871daf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c15fd00 0x7f686c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:03.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f6871daf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f686c0d0ca0 con 0x7f686c1458b0 2024-04-26T22:00:03.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f6871daf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f686c160aa0 con 0x7f686c06f760 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f6871daf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f686c0d0f80 con 0x7f686c15fd00 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f686affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 0x7f686c0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f686affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 0x7f686c0b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57550/0 (socket says 172.21.15.137:57550) 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f686affd640 1 -- 172.21.15.137:0/3890606621 learned_addr learned my addr 172.21.15.137:0/3890606621 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f686b7fe640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686c06f760 0x7f686c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.932+0000 7f686bfff640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c15fd00 0x7f686c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f686affd640 1 -- 172.21.15.137:0/3890606621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c15fd00 msgr2=0x7f686c15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f686affd640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c15fd00 0x7f686c15a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f686affd640 1 -- 172.21.15.137:0/3890606621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686c06f760 msgr2=0x7f686c155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f686affd640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686c06f760 0x7f686c155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f686affd640 1 -- 172.21.15.137:0/3890606621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c13ecd0 con 0x7f686c1458b0 2024-04-26T22:00:03.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f686affd640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 0x7f686c0b1bb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f686000d800 tx=0x7f686000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f6853fff640 1 -- 172.21.15.137:0/3890606621 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686000b6c0 con 0x7f686c1458b0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f6853fff640 1 -- 172.21.15.137:0/3890606621 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6860019070 con 0x7f686c1458b0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c0b2240 con 0x7f686c1458b0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f6853fff640 1 -- 172.21.15.137:0/3890606621 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686000bac0 con 0x7f686c1458b0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.933+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c0b2800 con 0x7f686c1458b0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.934+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686c0693d0 con 0x7f686c1458b0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.935+0000 7f6853fff640 1 -- 172.21.15.137:0/3890606621 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f686000bc60 con 0x7f686c1458b0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.935+0000 7f6853fff640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685806c8f0 0x7f685806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.935+0000 7f6853fff640 1 -- 172.21.15.137:0/3890606621 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7f686008bd10 con 0x7f686c1458b0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.935+0000 7f686b7fe640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685806c8f0 0x7f685806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:03.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.935+0000 7f686b7fe640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685806c8f0 0x7f685806edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f685c034000 tx=0x7f685c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:03.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:03.939+0000 7f6853fff640 1 -- 172.21.15.137:0/3890606621 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6860059ce0 con 0x7f686c1458b0 2024-04-26T22:00:04.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.115+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f686c06e3c0 con 0x7f686c1458b0 2024-04-26T22:00:04.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.815+0000 7f6853fff640 1 -- 172.21.15.137:0/3890606621 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f686005dfe0 con 0x7f686c1458b0 2024-04-26T22:00:04.815 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T22:00:04.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685806c8f0 msgr2=0x7f685806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:04.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685806c8f0 0x7f685806edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f685c034000 tx=0x7f685c02e000 comp rx=0 tx=0).stop 2024-04-26T22:00:04.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 msgr2=0x7f686c0b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:04.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 0x7f686c0b1bb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f686000d800 tx=0x7f686000dcc0 comp rx=0 tx=0).stop 2024-04-26T22:00:04.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 shutdown_connections 2024-04-26T22:00:04.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685806c8f0 0x7f685806edb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:04.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f686c1458b0 0x7f686c0b1bb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:04.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f686c15fd00 0x7f686c15a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:04.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 --2- 172.21.15.137:0/3890606621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686c06f760 0x7f686c155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:04.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 >> 172.21.15.137:0/3890606621 conn(0x7f686c0b7460 msgr2=0x7f686c160170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:04.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 shutdown_connections 2024-04-26T22:00:04.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.819+0000 7f6871daf640 1 -- 172.21.15.137:0/3890606621 wait complete. 2024-04-26T22:00:04.832 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T22:00:04.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.932+0000 7f176532b640 1 Processor -- start 2024-04-26T22:00:04.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.932+0000 7f176532b640 1 -- start start 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.933+0000 7f176532b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 0x7f17600d3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.933+0000 7f176532b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17600b63e0 con 0x7f17600d2230 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.933+0000 7f176532b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17600d3120 con 0x7f17600d0d10 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.933+0000 7f176532b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f17600d5ed0 con 0x7f176015f950 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.933+0000 7f175e7fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f17600d2230 0x7f17600c8db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54782/0 (socket says 172.21.15.137:54782) 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.933+0000 7f175e7fc640 1 -- 172.21.15.137:0/3809435822 learned_addr learned my addr 172.21.15.137:0/3809435822 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.933+0000 7f175effd640 1 --2- 172.21.15.137:0/3809435822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 0x7f17600d3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.934+0000 7f175dffb640 1 -- 172.21.15.137:0/3809435822 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310234903 0 0) 0x7f17600b63e0 con 0x7f17600d2230 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.934+0000 7f175dffb640 1 -- 172.21.15.137:0/3809435822 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1748003520 con 0x7f17600d2230 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.934+0000 7f175dffb640 1 -- 172.21.15.137:0/3809435822 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428399567 0 0) 0x7f17600d3120 con 0x7f17600d0d10 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.934+0000 7f175dffb640 1 -- 172.21.15.137:0/3809435822 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17600b63e0 con 0x7f17600d0d10 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.934+0000 7f175effd640 1 -- 172.21.15.137:0/3809435822 >> v1:172.21.15.170:6789/0 conn(0x7f17600d0d10 legacy=0x7f17600c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.934+0000 7f175effd640 1 -- 172.21.15.137:0/3809435822 >> v1:172.21.15.137:6789/0 conn(0x7f17600d2230 legacy=0x7f17600c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:04.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.934+0000 7f175effd640 1 -- 172.21.15.137:0/3809435822 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17600b69c0 con 0x7f176015f950 2024-04-26T22:00:04.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f175effd640 1 --2- 172.21.15.137:0/3809435822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 0x7f17600d3740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1750009df0 tx=0x7f175002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9850ca3b5ed94f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:04.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f175dffb640 1 -- 172.21.15.137:0/3809435822 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175002ae60 con 0x7f176015f950 2024-04-26T22:00:04.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f175dffb640 1 -- 172.21.15.137:0/3809435822 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1750007740 con 0x7f176015f950 2024-04-26T22:00:04.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f175dffb640 1 -- 172.21.15.137:0/3809435822 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1750007b10 con 0x7f176015f950 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f176532b640 1 -- 172.21.15.137:0/3809435822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 msgr2=0x7f17600d3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f176532b640 1 --2- 172.21.15.137:0/3809435822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 0x7f17600d3740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1750009df0 tx=0x7f175002a680 comp rx=0 tx=0).stop 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f176532b640 1 -- 172.21.15.137:0/3809435822 shutdown_connections 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f176532b640 1 --2- 172.21.15.137:0/3809435822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 0x7f17600d3740 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f176532b640 1 -- 172.21.15.137:0/3809435822 >> 172.21.15.137:0/3809435822 conn(0x7f17600d5160 msgr2=0x7f17600d5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f176532b640 1 -- 172.21.15.137:0/3809435822 shutdown_connections 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.935+0000 7f176532b640 1 -- 172.21.15.137:0/3809435822 wait complete. 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.937+0000 7f176532b640 1 Processor -- start 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.937+0000 7f176532b640 1 -- start start 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.937+0000 7f176532b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17600d0d10 0x7f1760161e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.937+0000 7f176532b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17600d2230 0x7f17600ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.937+0000 7f176532b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 0x7f17601f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:04.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.937+0000 7f176532b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17600d4050 con 0x7f17600d2230 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.937+0000 7f176532b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f17600d3ed0 con 0x7f17600d0d10 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.937+0000 7f176532b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f17600c9bd0 con 0x7f176015f950 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.937+0000 7f175e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17600d2230 0x7f17600ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17600d2230 0x7f17600ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57566/0 (socket says 172.21.15.137:57566) 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175e7fc640 1 -- 172.21.15.137:0/3379980550 learned_addr learned my addr 172.21.15.137:0/3379980550 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175effd640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17600d0d10 0x7f1760161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175f7fe640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 0x7f17601f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175e7fc640 1 -- 172.21.15.137:0/3379980550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 msgr2=0x7f17601f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175e7fc640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 0x7f17601f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175e7fc640 1 -- 172.21.15.137:0/3379980550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17600d0d10 msgr2=0x7f1760161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175e7fc640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17600d0d10 0x7f1760161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175e7fc640 1 -- 172.21.15.137:0/3379980550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17600ce6f0 con 0x7f17600d2230 2024-04-26T22:00:04.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f175e7fc640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17600d2230 0x7f17600ceba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f175400c500 tx=0x7f175400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f17477fe640 1 -- 172.21.15.137:0/3379980550 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754017070 con 0x7f17600d2230 2024-04-26T22:00:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f17477fe640 1 -- 172.21.15.137:0/3379980550 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1754005ce0 con 0x7f17600d2230 2024-04-26T22:00:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17601f53e0 con 0x7f17600d2230 2024-04-26T22:00:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f17477fe640 1 -- 172.21.15.137:0/3379980550 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17540072f0 con 0x7f17600d2230 2024-04-26T22:00:04.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.938+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17601f59a0 con 0x7f17600d2230 2024-04-26T22:00:04.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.939+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17600cd400 con 0x7f17600d2230 2024-04-26T22:00:04.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.940+0000 7f17477fe640 1 -- 172.21.15.137:0/3379980550 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f175401a070 con 0x7f17600d2230 2024-04-26T22:00:04.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.940+0000 7f17477fe640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f174c06c8f0 0x7f174c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:04.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.940+0000 7f175effd640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f174c06c8f0 0x7f174c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:04.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.940+0000 7f17477fe640 1 -- 172.21.15.137:0/3379980550 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f175408ab50 con 0x7f17600d2230 2024-04-26T22:00:04.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.941+0000 7f175effd640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f174c06c8f0 0x7f174c06edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1750034000 tx=0x7f175002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:04.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:04.944+0000 7f17477fe640 1 -- 172.21.15.137:0/3379980550 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1754058cc0 con 0x7f17600d2230 2024-04-26T22:00:05.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.124+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f1760075730 con 0x7f17600d2230 2024-04-26T22:00:05.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.127+0000 7f17477fe640 1 -- 172.21.15.137:0/3379980550 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f1760075730 con 0x7f17600d2230 2024-04-26T22:00:05.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f174c06c8f0 msgr2=0x7f174c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f174c06c8f0 0x7f174c06edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1750034000 tx=0x7f175002f000 comp rx=0 tx=0).stop 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17600d2230 msgr2=0x7f17600ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17600d2230 0x7f17600ceba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f175400c500 tx=0x7f175400c9c0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 shutdown_connections 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f174c06c8f0 0x7f174c06edb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17600d2230 0x7f17600ceba0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f176015f950 0x7f17601f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 --2- 172.21.15.137:0/3379980550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17600d0d10 0x7f1760161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 >> 172.21.15.137:0/3379980550 conn(0x7f17600d5160 msgr2=0x7f176006ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 shutdown_connections 2024-04-26T22:00:05.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.129+0000 7f176532b640 1 -- 172.21.15.137:0/3379980550 wait complete. 2024-04-26T22:00:05.140 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-26T22:00:05.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.237+0000 7f818f54e640 1 Processor -- start 2024-04-26T22:00:05.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.237+0000 7f818f54e640 1 -- start start 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818f54e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880cf2e0 0x7f818806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818f54e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f818806e490 0x7f818815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818f54e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81880d1740 con 0x7f81880d11b0 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818f54e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f81880d1a20 con 0x7f818806e490 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818f54e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81880d1d00 con 0x7f81880cf2e0 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818daeb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f818806e490 0x7f818815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818d2ea640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880cf2e0 0x7f818806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818daeb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f818806e490 0x7f818815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:44766/0 (socket says 172.21.15.137:44766) 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818daeb640 1 -- 172.21.15.137:0/131799354 learned_addr learned my addr 172.21.15.137:0/131799354 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.238+0000 7f818cae9640 1 --1- 172.21.15.137:0/131799354 >> v1:172.21.15.170:6789/0 conn(0x7f81880d11b0 0x7f818806dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:60086/0 (socket says 172.21.15.137:60086) 2024-04-26T22:00:05.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.239+0000 7f818daeb640 1 -- 172.21.15.137:0/131799354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880cf2e0 msgr2=0x7f818806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:05.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.239+0000 7f818daeb640 1 --2- 172.21.15.137:0/131799354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880cf2e0 0x7f818806d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.239+0000 7f818daeb640 1 -- 172.21.15.137:0/131799354 >> v1:172.21.15.170:6789/0 conn(0x7f81880d11b0 legacy=0x7f818806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.239+0000 7f817ffff640 1 -- 172.21.15.137:0/131799354 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582045404 0 0) 0x7f81880d1740 con 0x7f81880d11b0 2024-04-26T22:00:05.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.239+0000 7f818daeb640 1 -- 172.21.15.137:0/131799354 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81880d1fe0 con 0x7f818806e490 2024-04-26T22:00:05.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.239+0000 7f818d2ea640 1 --2- 172.21.15.137:0/131799354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880cf2e0 0x7f818806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:05.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f818daeb640 1 --2- 172.21.15.137:0/131799354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f818806e490 0x7f818815ebe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e50 tx=0x7f818002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7068c176197a049 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f817ffff640 1 -- 172.21.15.137:0/131799354 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180036070 con 0x7f818806e490 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f817ffff640 1 -- 172.21.15.137:0/131799354 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8180031600 con 0x7f818806e490 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f817ffff640 1 -- 172.21.15.137:0/131799354 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81800319d0 con 0x7f818806e490 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f818f54e640 1 -- 172.21.15.137:0/131799354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f818806e490 msgr2=0x7f818815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f818f54e640 1 --2- 172.21.15.137:0/131799354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f818806e490 0x7f818815ebe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8180009e50 tx=0x7f818002a710 comp rx=0 tx=0).stop 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f818f54e640 1 -- 172.21.15.137:0/131799354 shutdown_connections 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f818f54e640 1 --2- 172.21.15.137:0/131799354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f818806e490 0x7f818815ebe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f818f54e640 1 --2- 172.21.15.137:0/131799354 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880cf2e0 0x7f818806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f818f54e640 1 -- 172.21.15.137:0/131799354 >> 172.21.15.137:0/131799354 conn(0x7f81880b4a60 msgr2=0x7f81880b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f818f54e640 1 -- 172.21.15.137:0/131799354 shutdown_connections 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.240+0000 7f818f54e640 1 -- 172.21.15.137:0/131799354 wait complete. 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.241+0000 7f818f54e640 1 Processor -- start 2024-04-26T22:00:05.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818f54e640 1 -- start start 2024-04-26T22:00:05.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818f54e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f818806e490 0x7f81881529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818f54e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81880cf2e0 0x7f81880b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818f54e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880d11b0 0x7f81880cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818f54e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81880cf6c0 con 0x7f818806e490 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818f54e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f818806da10 con 0x7f81880cf2e0 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818f54e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81880cf840 con 0x7f81880d11b0 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818d2ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f818806e490 0x7f81881529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818d2ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f818806e490 0x7f81881529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57572/0 (socket says 172.21.15.137:57572) 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818d2ea640 1 -- 172.21.15.137:0/2715594468 learned_addr learned my addr 172.21.15.137:0/2715594468 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818cae9640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81880cf2e0 0x7f81880b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.242+0000 7f818daeb640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880d11b0 0x7f81880cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f818d2ea640 1 -- 172.21.15.137:0/2715594468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880d11b0 msgr2=0x7f81880cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f818d2ea640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880d11b0 0x7f81880cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f818d2ea640 1 -- 172.21.15.137:0/2715594468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81880cf2e0 msgr2=0x7f81880b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f818d2ea640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81880cf2e0 0x7f81880b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f818d2ea640 1 -- 172.21.15.137:0/2715594468 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81880b8b80 con 0x7f818806e490 2024-04-26T22:00:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f818d2ea640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f818806e490 0x7f81881529e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f818400e990 tx=0x7f818400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f817dffb640 1 -- 172.21.15.137:0/2715594468 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8184017070 con 0x7f818806e490 2024-04-26T22:00:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f817dffb640 1 -- 172.21.15.137:0/2715594468 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f818400c9e0 con 0x7f818806e490 2024-04-26T22:00:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f817dffb640 1 -- 172.21.15.137:0/2715594468 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818400cdb0 con 0x7f818806e490 2024-04-26T22:00:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81880c86d0 con 0x7f818806e490 2024-04-26T22:00:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.243+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81880c8c90 con 0x7f818806e490 2024-04-26T22:00:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.244+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f818806a290 con 0x7f818806e490 2024-04-26T22:00:05.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.244+0000 7f817dffb640 1 -- 172.21.15.137:0/2715594468 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f818401a070 con 0x7f818806e490 2024-04-26T22:00:05.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.245+0000 7f817dffb640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f816c06c8f0 0x7f816c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.245+0000 7f818cae9640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f816c06c8f0 0x7f816c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.245+0000 7f817dffb640 1 -- 172.21.15.137:0/2715594468 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f818408b940 con 0x7f818806e490 2024-04-26T22:00:05.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.245+0000 7f818cae9640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f816c06c8f0 0x7f816c06edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f81881f8280 tx=0x7f8178007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:05.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.249+0000 7f817dffb640 1 -- 172.21.15.137:0/2715594468 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8184059ab0 con 0x7f818806e490 2024-04-26T22:00:05.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.495+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) -- 0x7f81880b8ef0 con 0x7f818806e490 2024-04-26T22:00:05.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.817+0000 7f817dffb640 1 -- 172.21.15.137:0/2715594468 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v100) ==== 142+0+0 (secure 0 0 0) 0x7f818405ddb0 con 0x7f818806e490 2024-04-26T22:00:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f816c06c8f0 msgr2=0x7f816c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f816c06c8f0 0x7f816c06edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f81881f8280 tx=0x7f8178007e40 comp rx=0 tx=0).stop 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f818806e490 msgr2=0x7f81881529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f818806e490 0x7f81881529e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f818400e990 tx=0x7f818400ee50 comp rx=0 tx=0).stop 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 shutdown_connections 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f816c06c8f0 0x7f816c06edb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81880d11b0 0x7f81880cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81880cf2e0 0x7f81880b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 --2- 172.21.15.137:0/2715594468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f818806e490 0x7f81881529e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 >> 172.21.15.137:0/2715594468 conn(0x7f81880b4a60 msgr2=0x7f818809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 shutdown_connections 2024-04-26T22:00:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.819+0000 7f818f54e640 1 -- 172.21.15.137:0/2715594468 wait complete. 2024-04-26T22:00:05.831 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-26T22:00:05.831 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-04-26T22:00:05.832 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-26T22:00:05.832 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:05.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.930+0000 7f6128acf640 1 Processor -- start 2024-04-26T22:00:05.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.930+0000 7f6128acf640 1 -- start start 2024-04-26T22:00:05.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6128acf640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f612415d130 0x7f612406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6128acf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124070d00 0x7f612406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6128acf640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612415d510 con 0x7f61240733c0 2024-04-26T22:00:05.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6128acf640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f61240b0e80 con 0x7f612415d130 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6128acf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f61240b54f0 con 0x7f6124070d00 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f611bfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f61240733c0 0x7f6124160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54416/0 (socket says 172.21.15.137:54416) 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f611bfff640 1 -- 172.21.15.137:0/4217829687 learned_addr learned my addr 172.21.15.137:0/4217829687 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627542414 0 0) 0x7f612415d510 con 0x7f61240733c0 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6122d9d640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124070d00 0x7f612406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f612259c640 1 --2- 172.21.15.137:0/4217829687 >> v2:172.21.15.170:3300/0 conn(0x7f612415d130 0x7f612406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6110003520 con 0x7f61240733c0 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3159263442 0 0) 0x7f6110003520 con 0x7f61240733c0 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124070d00 msgr2=0x7f612406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124070d00 0x7f612406d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 >> v2:172.21.15.170:3300/0 conn(0x7f612415d130 msgr2=0x7f612406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 --2- 172.21.15.137:0/4217829687 >> v2:172.21.15.170:3300/0 conn(0x7f612415d130 0x7f612406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61240d12c0 con 0x7f61240733c0 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f610c001670 con 0x7f61240733c0 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 >> v1:172.21.15.137:6789/0 conn(0x7f61240733c0 legacy=0x7f6124160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f6110003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6110004800 0x7f6110004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124070d00 0x7f61100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61240b0e80 con 0x7f61100039b0 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f61240b54f0 con 0x7f6110004800 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.931+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f611000b9c0 con 0x7f6124070d00 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f612259c640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f6110003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f6122d9d640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124070d00 0x7f61100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f611bfff640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6110004800 0x7f6110004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f612259c640 1 -- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124070d00 msgr2=0x7f61100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f612259c640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124070d00 0x7f61100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f612259c640 1 -- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6110004800 msgr2=0x7f6110004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f612259c640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6110004800 0x7f6110004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f612259c640 1 -- 172.21.15.137:0/4217829687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6110003520 con 0x7f61100039b0 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f611bfff640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6110004800 0x7f6110004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.932+0000 7f612259c640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f6110003dd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6114009ac0 tx=0x7f6110005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f22b7d0c41b8431 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114036070 con 0x7f61100039b0 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6114031400 con 0x7f61100039b0 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6121d9b640 1 -- 172.21.15.137:0/4217829687 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114009690 con 0x7f61100039b0 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6128acf640 1 -- 172.21.15.137:0/4217829687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 msgr2=0x7f6110003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6128acf640 1 --2- 172.21.15.137:0/4217829687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f6110003dd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6114009ac0 tx=0x7f6110005830 comp rx=0 tx=0).stop 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6122d9d640 1 -- 172.21.15.137:0/4217829687 reap_dead start 2024-04-26T22:00:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6128acf640 1 -- 172.21.15.137:0/4217829687 shutdown_connections 2024-04-26T22:00:05.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6128acf640 1 -- 172.21.15.137:0/4217829687 >> 172.21.15.137:0/4217829687 conn(0x7f61240728a0 msgr2=0x7f6124072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:05.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6128acf640 1 -- 172.21.15.137:0/4217829687 shutdown_connections 2024-04-26T22:00:05.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.933+0000 7f6128acf640 1 -- 172.21.15.137:0/4217829687 wait complete. 2024-04-26T22:00:05.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.934+0000 7f6128acf640 1 Processor -- start 2024-04-26T22:00:05.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f6128acf640 1 -- start start 2024-04-26T22:00:05.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f6128acf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f61241470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f6128acf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6124144dc0 0x7f6124159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f6128acf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159f80 0x7f61241f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f6128acf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61240d07e0 con 0x7f61100039b0 2024-04-26T22:00:05.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f6128acf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f61240d0500 con 0x7f6124144dc0 2024-04-26T22:00:05.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f6128acf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f61240d0ac0 con 0x7f6124159f80 2024-04-26T22:00:05.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f612259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f61241470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f612259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f61241470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40772/0 (socket says 172.21.15.137:40772) 2024-04-26T22:00:05.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f612259c640 1 -- 172.21.15.137:0/1164252432 learned_addr learned my addr 172.21.15.137:0/1164252432 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:05.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f611bfff640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6124144dc0 0x7f6124159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.935+0000 7f6122d9d640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159f80 0x7f61241f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f612259c640 1 -- 172.21.15.137:0/1164252432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159f80 msgr2=0x7f61241f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f612259c640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159f80 0x7f61241f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f612259c640 1 -- 172.21.15.137:0/1164252432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6124144dc0 msgr2=0x7f6124159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f612259c640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6124144dc0 0x7f6124159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f612259c640 1 -- 172.21.15.137:0/1164252432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612415a770 con 0x7f61100039b0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f612259c640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f61241470c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6114009ac0 tx=0x7f6114004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f611affd640 1 -- 172.21.15.137:0/1164252432 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114040020 con 0x7f61100039b0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f611affd640 1 -- 172.21.15.137:0/1164252432 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6114003b40 con 0x7f61100039b0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61240aa540 con 0x7f61100039b0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f611affd640 1 -- 172.21.15.137:0/1164252432 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6114036040 con 0x7f61100039b0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.936+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61240aab00 con 0x7f61100039b0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.937+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612406a290 con 0x7f61100039b0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.937+0000 7f611affd640 1 -- 172.21.15.137:0/1164252432 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6114043020 con 0x7f61100039b0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.938+0000 7f611affd640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f610406c920 0x7f610406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.938+0000 7f611bfff640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f610406c920 0x7f610406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.938+0000 7f611affd640 1 -- 172.21.15.137:0/1164252432 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f61140ab850 con 0x7f61100039b0 2024-04-26T22:00:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.938+0000 7f611bfff640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f610406c920 0x7f610406ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f61241f6950 tx=0x7f610c007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:05.942+0000 7f611affd640 1 -- 172.21.15.137:0/1164252432 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f611404a070 con 0x7f61100039b0 2024-04-26T22:00:06.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.119+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f612415d510 con 0x7f61100039b0 2024-04-26T22:00:06.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.119+0000 7f611affd640 1 -- 172.21.15.137:0/1164252432 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13034 (secure 0 0 0) 0x7f61140044e0 con 0x7f61100039b0 2024-04-26T22:00:06.119 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:06.120 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":37,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:00:04.810740+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/1394398285":"2024-04-27T22:00:01.486780+0000","172.21.15.137:6834/1394398285":"2024-04-27T22:00:01.486780+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f610406c920 msgr2=0x7f610406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f610406c920 0x7f610406ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f61241f6950 tx=0x7f610c007040 comp rx=0 tx=0).stop 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 msgr2=0x7f61241470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f61241470c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6114009ac0 tx=0x7f6114004730 comp rx=0 tx=0).stop 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 shutdown_connections 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f610406c920 0x7f610406ede0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6124159f80 0x7f61241f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6124144dc0 0x7f6124159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 --2- 172.21.15.137:0/1164252432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61100039b0 0x7f61241470c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 >> 172.21.15.137:0/1164252432 conn(0x7f61240728a0 msgr2=0x7f612406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 shutdown_connections 2024-04-26T22:00:06.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.121+0000 7f6128acf640 1 -- 172.21.15.137:0/1164252432 wait complete. 2024-04-26T22:00:06.135 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:00:06.135 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:00:06.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.234+0000 7f9e57597640 1 Processor -- start 2024-04-26T22:00:06.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.235+0000 7f9e57597640 1 -- start start 2024-04-26T22:00:06.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.235+0000 7f9e57597640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e50143840 0x7f9e500b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.235+0000 7f9e57597640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9e500b55c0 0x7f9e500ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.235+0000 7f9e57597640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e5015dca0 con 0x7f9e500b4520 2024-04-26T22:00:06.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.235+0000 7f9e57597640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9e50143c20 con 0x7f9e500b55c0 2024-04-26T22:00:06.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.235+0000 7f9e57597640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5015df80 con 0x7f9e50143840 2024-04-26T22:00:06.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e55333640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e50143840 0x7f9e500b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e55b34640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9e500b55c0 0x7f9e500ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e55333640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e50143840 0x7f9e500b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:33302/0 (socket says 172.21.15.137:33302) 2024-04-26T22:00:06.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e55333640 1 -- 172.21.15.137:0/1444615615 learned_addr learned my addr 172.21.15.137:0/1444615615 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e47fff640 1 -- 172.21.15.137:0/1444615615 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943901011 0 0) 0x7f9e5015dca0 con 0x7f9e500b4520 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e47fff640 1 -- 172.21.15.137:0/1444615615 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e3c003520 con 0x7f9e500b4520 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e55b34640 1 -- 172.21.15.137:0/1444615615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e50143840 msgr2=0x7f9e500b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e55b34640 1 --2- 172.21.15.137:0/1444615615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e50143840 0x7f9e500b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e55b34640 1 -- 172.21.15.137:0/1444615615 >> v1:172.21.15.170:6789/0 conn(0x7f9e500b4520 legacy=0x7f9e500b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e55b34640 1 -- 172.21.15.137:0/1444615615 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5015e260 con 0x7f9e500b55c0 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.236+0000 7f9e55333640 1 --2- 172.21.15.137:0/1444615615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e50143840 0x7f9e500b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.237+0000 7f9e55b34640 1 --2- 172.21.15.137:0/1444615615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b55c0 0x7f9e500ceff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009d90 tx=0x7f9e4802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7243e002c3420752 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.237+0000 7f9e47fff640 1 -- 172.21.15.137:0/1444615615 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48007740 con 0x7f9e500b55c0 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.237+0000 7f9e47fff640 1 -- 172.21.15.137:0/1444615615 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e480078e0 con 0x7f9e500b55c0 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.237+0000 7f9e47fff640 1 -- 172.21.15.137:0/1444615615 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48007c90 con 0x7f9e500b55c0 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.238+0000 7f9e57597640 1 -- 172.21.15.137:0/1444615615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b55c0 msgr2=0x7f9e500ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.238+0000 7f9e57597640 1 --2- 172.21.15.137:0/1444615615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b55c0 0x7f9e500ceff0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009d90 tx=0x7f9e4802a660 comp rx=0 tx=0).stop 2024-04-26T22:00:06.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.238+0000 7f9e57597640 1 -- 172.21.15.137:0/1444615615 shutdown_connections 2024-04-26T22:00:06.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.238+0000 7f9e57597640 1 --2- 172.21.15.137:0/1444615615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b55c0 0x7f9e500ceff0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.238+0000 7f9e57597640 1 --2- 172.21.15.137:0/1444615615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e50143840 0x7f9e500b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.238+0000 7f9e57597640 1 -- 172.21.15.137:0/1444615615 >> 172.21.15.137:0/1444615615 conn(0x7f9e500cd8a0 msgr2=0x7f9e500cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:06.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.238+0000 7f9e57597640 1 -- 172.21.15.137:0/1444615615 shutdown_connections 2024-04-26T22:00:06.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.238+0000 7f9e57597640 1 -- 172.21.15.137:0/1444615615 wait complete. 2024-04-26T22:00:06.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.239+0000 7f9e57597640 1 Processor -- start 2024-04-26T22:00:06.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.239+0000 7f9e57597640 1 -- start start 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e57597640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b4520 0x7f9e5015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e57597640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e500b55c0 0x7f9e5013ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e57597640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e50143840 0x7f9e50159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e57597640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5015da40 con 0x7f9e50143840 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e57597640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5015d8c0 con 0x7f9e500b4520 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e57597640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9e500cf530 con 0x7f9e500b55c0 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55b34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e50143840 0x7f9e50159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55b34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e50143840 0x7f9e50159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40776/0 (socket says 172.21.15.137:40776) 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55b34640 1 -- 172.21.15.137:0/4050092409 learned_addr learned my addr 172.21.15.137:0/4050092409 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e54b32640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e500b55c0 0x7f9e5013ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55333640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b4520 0x7f9e5015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55b34640 1 -- 172.21.15.137:0/4050092409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e500b55c0 msgr2=0x7f9e5013ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55b34640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e500b55c0 0x7f9e5013ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55b34640 1 -- 172.21.15.137:0/4050092409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b4520 msgr2=0x7f9e5015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55b34640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b4520 0x7f9e5015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55b34640 1 -- 172.21.15.137:0/4050092409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5015a580 con 0x7f9e50143840 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55333640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b4520 0x7f9e5015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e55b34640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e50143840 0x7f9e50159c30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009eb0 tx=0x7f9e48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e45ffb640 1 -- 172.21.15.137:0/4050092409 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48040070 con 0x7f9e50143840 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.240+0000 7f9e45ffb640 1 -- 172.21.15.137:0/4050092409 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e48031c60 con 0x7f9e50143840 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.241+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e501f30d0 con 0x7f9e50143840 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.241+0000 7f9e45ffb640 1 -- 172.21.15.137:0/4050092409 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48009450 con 0x7f9e50143840 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.241+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e501f2d50 con 0x7f9e50143840 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.242+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5006a290 con 0x7f9e50143840 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.242+0000 7f9e45ffb640 1 -- 172.21.15.137:0/4050092409 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e48039040 con 0x7f9e50143840 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.242+0000 7f9e45ffb640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9e3406c920 0x7f9e3406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.243+0000 7f9e45ffb640 1 -- 172.21.15.137:0/4050092409 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9e480acb80 con 0x7f9e50143840 2024-04-26T22:00:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.243+0000 7f9e55333640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9e3406c920 0x7f9e3406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.243+0000 7f9e55333640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9e3406c920 0x7f9e3406ede0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e500b09d0 tx=0x7f9e4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:06.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.247+0000 7f9e45ffb640 1 -- 172.21.15.137:0/4050092409 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9e4807b340 con 0x7f9e50143840 2024-04-26T22:00:06.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.418+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9e500ce420 con 0x7f9e50143840 2024-04-26T22:00:06.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.419+0000 7f9e45ffb640 1 -- 172.21.15.137:0/4050092409 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f9e4807ac40 con 0x7f9e50143840 2024-04-26T22:00:06.419 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:00:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9e3406c920 msgr2=0x7f9e3406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9e3406c920 0x7f9e3406ede0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e500b09d0 tx=0x7f9e4c008040 comp rx=0 tx=0).stop 2024-04-26T22:00:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e50143840 msgr2=0x7f9e50159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e50143840 0x7f9e50159c30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009eb0 tx=0x7f9e48004a40 comp rx=0 tx=0).stop 2024-04-26T22:00:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 shutdown_connections 2024-04-26T22:00:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9e3406c920 0x7f9e3406ede0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9e50143840 0x7f9e50159c30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9e500b55c0 0x7f9e5013ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 --2- 172.21.15.137:0/4050092409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e500b4520 0x7f9e5015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 >> 172.21.15.137:0/4050092409 conn(0x7f9e500cd8a0 msgr2=0x7f9e500b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 shutdown_connections 2024-04-26T22:00:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.421+0000 7f9e57597640 1 -- 172.21.15.137:0/4050092409 wait complete. 2024-04-26T22:00:06.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-26T22:00:06.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.529+0000 7f17b34f9640 1 Processor -- start 2024-04-26T22:00:06.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.529+0000 7f17b34f9640 1 -- start start 2024-04-26T22:00:06.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b34f9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f17ac145870 0x7f17ac06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b34f9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17ac06f980 0x7f17ac072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b34f9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17ac073250 0x7f17ac15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b34f9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f17ac06fde0 con 0x7f17ac145870 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b34f9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f17ac073a40 con 0x7f17ac06f980 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b34f9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac15d8d0 con 0x7f17ac073250 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b1295640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f17ac145870 0x7f17ac06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b1295640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f17ac145870 0x7f17ac06f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40786/0 (socket says 172.21.15.137:40786) 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b1295640 1 -- 172.21.15.137:0/3289062364 learned_addr learned my addr 172.21.15.137:0/3289062364 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b1a96640 1 --2- 172.21.15.137:0/3289062364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17ac073250 0x7f17ac15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b0a94640 1 --2- 172.21.15.137:0/3289062364 >> v2:172.21.15.170:3300/0 conn(0x7f17ac06f980 0x7f17ac072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b1295640 1 -- 172.21.15.137:0/3289062364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17ac073250 msgr2=0x7f17ac15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b1295640 1 --2- 172.21.15.137:0/3289062364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17ac073250 0x7f17ac15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b1295640 1 -- 172.21.15.137:0/3289062364 >> v2:172.21.15.170:3300/0 conn(0x7f17ac06f980 msgr2=0x7f17ac072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b1295640 1 --2- 172.21.15.137:0/3289062364 >> v2:172.21.15.170:3300/0 conn(0x7f17ac06f980 0x7f17ac072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.530+0000 7f17b1295640 1 -- 172.21.15.137:0/3289062364 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac15dbb0 con 0x7f17ac145870 2024-04-26T22:00:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.531+0000 7f17b1295640 1 --2- 172.21.15.137:0/3289062364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac145870 0x7f17ac06f440 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f17ac070530 tx=0x7f17a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b3efc1adb45084 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.531+0000 7f17a3fff640 1 -- 172.21.15.137:0/3289062364 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8037070 con 0x7f17ac145870 2024-04-26T22:00:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.531+0000 7f17a3fff640 1 -- 172.21.15.137:0/3289062364 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a8032440 con 0x7f17ac145870 2024-04-26T22:00:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.531+0000 7f17a3fff640 1 -- 172.21.15.137:0/3289062364 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a8032810 con 0x7f17ac145870 2024-04-26T22:00:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.532+0000 7f17b34f9640 1 -- 172.21.15.137:0/3289062364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac145870 msgr2=0x7f17ac06f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.532+0000 7f17b34f9640 1 --2- 172.21.15.137:0/3289062364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac145870 0x7f17ac06f440 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f17ac070530 tx=0x7f17a802a1e0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.532+0000 7f17b34f9640 1 -- 172.21.15.137:0/3289062364 shutdown_connections 2024-04-26T22:00:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.532+0000 7f17b34f9640 1 --2- 172.21.15.137:0/3289062364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17ac073250 0x7f17ac15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.532+0000 7f17b34f9640 1 --2- 172.21.15.137:0/3289062364 >> v2:172.21.15.170:3300/0 conn(0x7f17ac06f980 0x7f17ac072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.532+0000 7f17b34f9640 1 --2- 172.21.15.137:0/3289062364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac145870 0x7f17ac06f440 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.532+0000 7f17b34f9640 1 -- 172.21.15.137:0/3289062364 >> 172.21.15.137:0/3289062364 conn(0x7f17ac0cd830 msgr2=0x7f17ac0cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:06.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.532+0000 7f17b34f9640 1 -- 172.21.15.137:0/3289062364 shutdown_connections 2024-04-26T22:00:06.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.532+0000 7f17b34f9640 1 -- 172.21.15.137:0/3289062364 wait complete. 2024-04-26T22:00:06.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.533+0000 7f17b34f9640 1 Processor -- start 2024-04-26T22:00:06.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.533+0000 7f17b34f9640 1 -- start start 2024-04-26T22:00:06.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.533+0000 7f17b34f9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17ac06f980 0x7f17ac0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.533+0000 7f17b34f9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac073250 0x7f17ac0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.533+0000 7f17b34f9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17ac145870 0x7f17ac143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.533+0000 7f17b34f9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac145c50 con 0x7f17ac073250 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.533+0000 7f17b34f9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac15d5d0 con 0x7f17ac145870 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.533+0000 7f17b34f9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac0736e0 con 0x7f17ac06f980 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b0a94640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac073250 0x7f17ac0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b0a94640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac073250 0x7f17ac0b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40794/0 (socket says 172.21.15.137:40794) 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b0a94640 1 -- 172.21.15.137:0/1484562203 learned_addr learned my addr 172.21.15.137:0/1484562203 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b1a96640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17ac145870 0x7f17ac143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b0a94640 1 -- 172.21.15.137:0/1484562203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17ac06f980 msgr2=0x7f17ac0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b0a94640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17ac06f980 0x7f17ac0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b0a94640 1 -- 172.21.15.137:0/1484562203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17ac145870 msgr2=0x7f17ac143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b0a94640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17ac145870 0x7f17ac143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b0a94640 1 -- 172.21.15.137:0/1484562203 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac159410 con 0x7f17ac073250 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b1a96640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17ac145870 0x7f17ac143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:06.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b0a94640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac073250 0x7f17ac0b14a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f179c00d620 tx=0x7f179c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17a1ffb640 1 -- 172.21.15.137:0/1484562203 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c00b620 con 0x7f17ac073250 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17a1ffb640 1 -- 172.21.15.137:0/1484562203 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c019070 con 0x7f17ac073250 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17a1ffb640 1 -- 172.21.15.137:0/1484562203 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c00ba00 con 0x7f17ac073250 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ac0b2190 con 0x7f17ac073250 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.534+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ac0b0ca0 con 0x7f17ac073250 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.535+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ac06a290 con 0x7f17ac073250 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.536+0000 7f17a1ffb640 1 -- 172.21.15.137:0/1484562203 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f179c00bba0 con 0x7f17ac073250 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.536+0000 7f17a1ffb640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f179006c8f0 0x7f179006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.536+0000 7f17a1ffb640 1 -- 172.21.15.137:0/1484562203 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f179c08bc50 con 0x7f17ac073250 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.536+0000 7f17b1295640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f179006c8f0 0x7f179006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.536+0000 7f17b1295640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f179006c8f0 0x7f179006edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f17a8034000 tx=0x7f17a802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:06.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.540+0000 7f17a1ffb640 1 -- 172.21.15.137:0/1484562203 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f179c091020 con 0x7f17ac073250 2024-04-26T22:00:06.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.785+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7f17ac0cef00 con 0x7f17ac073250 2024-04-26T22:00:06.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.824+0000 7f17a1ffb640 1 -- 172.21.15.137:0/1484562203 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v101) ==== 152+0+0 (secure 0 0 0) 0x7f179c05a380 con 0x7f17ac073250 2024-04-26T22:00:06.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f179006c8f0 msgr2=0x7f179006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f179006c8f0 0x7f179006edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f17a8034000 tx=0x7f17a802c000 comp rx=0 tx=0).stop 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac073250 msgr2=0x7f17ac0b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac073250 0x7f17ac0b14a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f179c00d620 tx=0x7f179c00dae0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 shutdown_connections 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f179006c8f0 0x7f179006edb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17ac073250 0x7f17ac0b14a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17ac145870 0x7f17ac143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 --2- 172.21.15.137:0/1484562203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17ac06f980 0x7f17ac0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 >> 172.21.15.137:0/1484562203 conn(0x7f17ac0cd830 msgr2=0x7f17ac0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 shutdown_connections 2024-04-26T22:00:06.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.826+0000 7f17b34f9640 1 -- 172.21.15.137:0/1484562203 wait complete. 2024-04-26T22:00:06.837 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T22:00:06.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.936+0000 7f27a0420640 1 Processor -- start 2024-04-26T22:00:06.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.936+0000 7f27a0420640 1 -- start start 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.937+0000 7f27a0420640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27980d3820 0x7f27980b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.937+0000 7f27a0420640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27980b60b0 0x7f27980d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.937+0000 7f27a0420640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27980d3c90 con 0x7f279815f680 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.937+0000 7f27a0420640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f279815fa60 con 0x7f27980d3820 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.937+0000 7f27a0420640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27980d3f50 con 0x7f27980b60b0 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279d9bb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27980d3820 0x7f27980b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279d9bb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27980d3820 0x7f27980b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40798/0 (socket says 172.21.15.137:40798) 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279e1bc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f279815f680 0x7f2798163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54420/0 (socket says 172.21.15.137:54420) 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279d9bb640 1 -- 172.21.15.137:0/2817235264 learned_addr learned my addr 172.21.15.137:0/2817235264 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:06.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279e9bd640 1 --2- 172.21.15.137:0/2817235264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27980b60b0 0x7f27980d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279d9bb640 1 -- 172.21.15.137:0/2817235264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27980b60b0 msgr2=0x7f27980d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:06.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279d9bb640 1 --2- 172.21.15.137:0/2817235264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27980b60b0 0x7f27980d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279d9bb640 1 -- 172.21.15.137:0/2817235264 >> v1:172.21.15.137:6789/0 conn(0x7f279815f680 legacy=0x7f2798163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279d9bb640 1 -- 172.21.15.137:0/2817235264 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27980b5090 con 0x7f27980d3820 2024-04-26T22:00:06.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.938+0000 7f279d1ba640 1 -- 172.21.15.137:0/2817235264 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283757277 0 0) 0x7f27980d3c90 con 0x7f279815f680 2024-04-26T22:00:06.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f279d9bb640 1 --2- 172.21.15.137:0/2817235264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 0x7f27980b5b70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2788009870 tx=0x7f278802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f33df3570394466 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:06.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f279d1ba640 1 -- 172.21.15.137:0/2817235264 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788037070 con 0x7f27980d3820 2024-04-26T22:00:06.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f279d1ba640 1 -- 172.21.15.137:0/2817235264 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2788032440 con 0x7f27980d3820 2024-04-26T22:00:06.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f279d1ba640 1 -- 172.21.15.137:0/2817235264 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788032810 con 0x7f27980d3820 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f27a0420640 1 -- 172.21.15.137:0/2817235264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 msgr2=0x7f27980b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f27a0420640 1 --2- 172.21.15.137:0/2817235264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 0x7f27980b5b70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2788009870 tx=0x7f278802a270 comp rx=0 tx=0).stop 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f27a0420640 1 -- 172.21.15.137:0/2817235264 shutdown_connections 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f27a0420640 1 --2- 172.21.15.137:0/2817235264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27980b60b0 0x7f27980d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f27a0420640 1 --2- 172.21.15.137:0/2817235264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 0x7f27980b5b70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f27a0420640 1 -- 172.21.15.137:0/2817235264 >> 172.21.15.137:0/2817235264 conn(0x7f279808eca0 msgr2=0x7f279809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f27a0420640 1 -- 172.21.15.137:0/2817235264 shutdown_connections 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.939+0000 7f27a0420640 1 -- 172.21.15.137:0/2817235264 wait complete. 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f27a0420640 1 Processor -- start 2024-04-26T22:00:06.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f27a0420640 1 -- start start 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f27a0420640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980b60b0 0x7f27981562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f27a0420640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 0x7f27981f95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f27a0420640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f279815f680 0x7f27980b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f27a0420640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27980d55e0 con 0x7f27980d3820 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f27a0420640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27980d5460 con 0x7f27980b60b0 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f27a0420640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27980d5760 con 0x7f279815f680 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f279d9bb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 0x7f27981f95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f279d9bb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 0x7f27981f95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40808/0 (socket says 172.21.15.137:40808) 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.941+0000 7f279d9bb640 1 -- 172.21.15.137:0/187074887 learned_addr learned my addr 172.21.15.137:0/187074887 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f279d9bb640 1 -- 172.21.15.137:0/187074887 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f279815f680 msgr2=0x7f27980b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f279e1bc640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980b60b0 0x7f27981562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f279d9bb640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f279815f680 0x7f27980b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f279d9bb640 1 -- 172.21.15.137:0/187074887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980b60b0 msgr2=0x7f27981562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:06.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f279d9bb640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980b60b0 0x7f27981562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f279d9bb640 1 -- 172.21.15.137:0/187074887 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27980d1220 con 0x7f27980d3820 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f279e1bc640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980b60b0 0x7f27981562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f279d9bb640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 0x7f27981f95d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2788000c00 tx=0x7f27880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f278effd640 1 -- 172.21.15.137:0/187074887 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788037040 con 0x7f27980d3820 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f278effd640 1 -- 172.21.15.137:0/187074887 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2788042070 con 0x7f27980d3820 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27980d1500 con 0x7f27980d3820 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f278effd640 1 -- 172.21.15.137:0/187074887 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278803b870 con 0x7f27980d3820 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.942+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27980d1ac0 con 0x7f27980d3820 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.943+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279806a290 con 0x7f27980d3820 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.943+0000 7f278effd640 1 -- 172.21.15.137:0/187074887 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f278803ba10 con 0x7f27980d3820 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.944+0000 7f278effd640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f277c06c8f0 0x7f277c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.944+0000 7f278effd640 1 -- 172.21.15.137:0/187074887 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f27880abfd0 con 0x7f27980d3820 2024-04-26T22:00:06.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.944+0000 7f279e1bc640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f277c06c8f0 0x7f277c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:06.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.944+0000 7f279e1bc640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f277c06c8f0 0x7f277c06edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2794000f60 tx=0x7f2794009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:06.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:06.948+0000 7f278effd640 1 -- 172.21.15.137:0/187074887 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f278803bd00 con 0x7f27980d3820 2024-04-26T22:00:07.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.122+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f27980d2ae0 con 0x7f27980d3820 2024-04-26T22:00:07.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.127+0000 7f278effd640 1 -- 172.21.15.137:0/187074887 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f278807a700 con 0x7f27980d3820 2024-04-26T22:00:07.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f277c06c8f0 msgr2=0x7f277c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f277c06c8f0 0x7f277c06edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2794000f60 tx=0x7f2794009040 comp rx=0 tx=0).stop 2024-04-26T22:00:07.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 msgr2=0x7f27981f95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 0x7f27981f95d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2788000c00 tx=0x7f27880046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 shutdown_connections 2024-04-26T22:00:07.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f277c06c8f0 0x7f277c06edb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27980d3820 0x7f27981f95d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f279815f680 0x7f27980b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 --2- 172.21.15.137:0/187074887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980b60b0 0x7f27981562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 >> 172.21.15.137:0/187074887 conn(0x7f279808eca0 msgr2=0x7f279815de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:07.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 shutdown_connections 2024-04-26T22:00:07.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.129+0000 7f27a0420640 1 -- 172.21.15.137:0/187074887 wait complete. 2024-04-26T22:00:07.140 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:00:07.141 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:00:07.185 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:00:07.229 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:00:07.229 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:00:07.230 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:07.245 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:00:07.245 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:00:07.245 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:07.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:00:07.288 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:00:07.288 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:07.303 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:00:07.303 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:00:07.303 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:07.346 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:00:07.346 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T22:00:07.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:07.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.443+0000 7f3d5ad5f640 1 Processor -- start 2024-04-26T22:00:07.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.443+0000 7f3d5ad5f640 1 -- start start 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d5ad5f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3d54145980 0x7f3d54160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d5ad5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d540b61a0 0x7f3d540720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d5ad5f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d540b4260 con 0x7f3d540b3de0 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d5ad5f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3d540b5140 con 0x7f3d54145980 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d5ad5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3d540b4530 con 0x7f3d540b61a0 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d58afb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3d54145980 0x7f3d54160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d58afb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3d54145980 0x7f3d54160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40818/0 (socket says 172.21.15.137:40818) 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d53fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3d540b3de0 0x7f3d540b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54422/0 (socket says 172.21.15.137:54422) 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d58afb640 1 -- 172.21.15.137:0/168680654 learned_addr learned my addr 172.21.15.137:0/168680654 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d58afb640 1 -- 172.21.15.137:0/168680654 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d540b61a0 msgr2=0x7f3d540720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d58afb640 1 --2- 172.21.15.137:0/168680654 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d540b61a0 0x7f3d540720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d58afb640 1 -- 172.21.15.137:0/168680654 >> v1:172.21.15.137:6789/0 conn(0x7f3d540b3de0 legacy=0x7f3d540b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d58afb640 1 -- 172.21.15.137:0/168680654 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d540b4810 con 0x7f3d54145980 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.444+0000 7f3d537fe640 1 -- 172.21.15.137:0/168680654 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182411355 0 0) 0x7f3d540b4260 con 0x7f3d540b3de0 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.445+0000 7f3d58afb640 1 --2- 172.21.15.137:0/168680654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d54145980 0x7f3d54160630 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009870 tx=0x7f3d4802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcacb8c96c97707 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.445+0000 7f3d537fe640 1 -- 172.21.15.137:0/168680654 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48037070 con 0x7f3d54145980 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.445+0000 7f3d537fe640 1 -- 172.21.15.137:0/168680654 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48032440 con 0x7f3d54145980 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.445+0000 7f3d537fe640 1 -- 172.21.15.137:0/168680654 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48032810 con 0x7f3d54145980 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.446+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/168680654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d54145980 msgr2=0x7f3d54160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.446+0000 7f3d5ad5f640 1 --2- 172.21.15.137:0/168680654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d54145980 0x7f3d54160630 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009870 tx=0x7f3d4802a1c0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.446+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/168680654 shutdown_connections 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.446+0000 7f3d5ad5f640 1 --2- 172.21.15.137:0/168680654 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d540b61a0 0x7f3d540720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.446+0000 7f3d5ad5f640 1 --2- 172.21.15.137:0/168680654 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d54145980 0x7f3d54160630 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.446+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/168680654 >> 172.21.15.137:0/168680654 conn(0x7f3d540d0d30 msgr2=0x7f3d540d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:07.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.446+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/168680654 shutdown_connections 2024-04-26T22:00:07.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.446+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/168680654 wait complete. 2024-04-26T22:00:07.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.447+0000 7f3d5ad5f640 1 Processor -- start 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.447+0000 7f3d5ad5f640 1 -- start start 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d5ad5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d540b3de0 0x7f3d54142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d5ad5f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d540b61a0 0x7f3d541e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d5ad5f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d54145980 0x7f3d541e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d5ad5f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3d54072610 con 0x7f3d540b61a0 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d5ad5f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3d540b4dd0 con 0x7f3d54145980 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d5ad5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3d54072790 con 0x7f3d540b3de0 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d53fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d540b61a0 0x7f3d541e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d53fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d540b61a0 0x7f3d541e6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40834/0 (socket says 172.21.15.137:40834) 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d53fff640 1 -- 172.21.15.137:0/518730772 learned_addr learned my addr 172.21.15.137:0/518730772 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d58afb640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d540b3de0 0x7f3d54142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d592fc640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d54145980 0x7f3d541e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d53fff640 1 -- 172.21.15.137:0/518730772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d540b3de0 msgr2=0x7f3d54142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d53fff640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d540b3de0 0x7f3d54142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d53fff640 1 -- 172.21.15.137:0/518730772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d54145980 msgr2=0x7f3d541e72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d53fff640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d54145980 0x7f3d541e72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d53fff640 1 -- 172.21.15.137:0/518730772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d541f3280 con 0x7f3d540b61a0 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d592fc640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d54145980 0x7f3d541e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d53fff640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d540b61a0 0x7f3d541e6d70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c4d0 tx=0x7f3d4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d517fa640 1 -- 172.21.15.137:0/518730772 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40018070 con 0x7f3d540b61a0 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d517fa640 1 -- 172.21.15.137:0/518730772 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d40007500 con 0x7f3d540b61a0 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d541f3560 con 0x7f3d540b61a0 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d517fa640 1 -- 172.21.15.137:0/518730772 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40004a20 con 0x7f3d540b61a0 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.448+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d541f3b20 con 0x7f3d540b61a0 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.449+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d54069be0 con 0x7f3d540b61a0 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.450+0000 7f3d517fa640 1 -- 172.21.15.137:0/518730772 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d4001b070 con 0x7f3d540b61a0 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.450+0000 7f3d517fa640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d3806c8f0 0x7f3d3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.450+0000 7f3d517fa640 1 -- 172.21.15.137:0/518730772 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f3d4008ab90 con 0x7f3d540b61a0 2024-04-26T22:00:07.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.450+0000 7f3d58afb640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d3806c8f0 0x7f3d3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.451+0000 7f3d58afb640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d3806c8f0 0x7f3d3806edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d48034000 tx=0x7f3d4802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:07.454 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.455+0000 7f3d517fa640 1 -- 172.21.15.137:0/518730772 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3d54069be0 con 0x7f3d540b61a0 2024-04-26T22:00:07.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.666+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d5406a290 con 0x7f3d540b61a0 2024-04-26T22:00:07.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.666+0000 7f3d517fa640 1 -- 172.21.15.137:0/518730772 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3881 (secure 0 0 0) 0x7f3d400592c0 con 0x7f3d540b61a0 2024-04-26T22:00:07.667 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:07.667 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3532925157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3532925157},{"type":"v1","addr":"172.21.15.137:6836","nonce":3532925157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3509631448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3509631448},{"type":"v1","addr":"172.21.15.170:6834","nonce":3509631448}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4846,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3228449407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3228449407},{"type":"v1","addr":"172.21.15.170:6835","nonce":3228449407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5520,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/2763323473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2763323473},{"type":"v1","addr":"172.21.15.137:6837","nonce":2763323473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[]} 2024-04-26T22:00:07.667 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 16 2024-04-26T22:00:07.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d3806c8f0 msgr2=0x7f3d3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d3806c8f0 0x7f3d3806edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d48034000 tx=0x7f3d4802e000 comp rx=0 tx=0).stop 2024-04-26T22:00:07.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d540b61a0 msgr2=0x7f3d541e6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d540b61a0 0x7f3d541e6d70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c4d0 tx=0x7f3d4000c990 comp rx=0 tx=0).stop 2024-04-26T22:00:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 shutdown_connections 2024-04-26T22:00:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3d3806c8f0 0x7f3d3806edb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3d540b61a0 0x7f3d541e6d70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3d54145980 0x7f3d541e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 --2- 172.21.15.137:0/518730772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3d540b3de0 0x7f3d54142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 >> 172.21.15.137:0/518730772 conn(0x7f3d540d0d30 msgr2=0x7f3d540d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 shutdown_connections 2024-04-26T22:00:07.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.668+0000 7f3d5ad5f640 1 -- 172.21.15.137:0/518730772 wait complete. 2024-04-26T22:00:07.679 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T22:00:07.679 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T22:00:07.680 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:00:07.680 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:00:07.680 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T22:00:07.680 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T22:00:07.680 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T22:00:07.680 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:00:07.680 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T22:00:07.681 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T22:00:07.681 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:00:07.681 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:00:07.681 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T22:00:07.681 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T22:00:07.681 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T22:00:07.681 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:00:07.690 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:00:07.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T22:00:07.691 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T22:00:07.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T22:00:07.692 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:00:07.693 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T22:00:07.693 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T22:00:07.693 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T22:00:07.732 INFO:tasks.ceph.mds.a:Started 2024-04-26T22:00:07.732 DEBUG:teuthology.parallel:result is None 2024-04-26T22:00:07.733 INFO:tasks.ceph.mds.c:Started 2024-04-26T22:00:07.733 DEBUG:teuthology.parallel:result is None 2024-04-26T22:00:07.735 INFO:tasks.ceph.mds.b:Started 2024-04-26T22:00:07.735 DEBUG:teuthology.parallel:result is None 2024-04-26T22:00:07.736 INFO:tasks.ceph.mds.d:Started 2024-04-26T22:00:07.736 DEBUG:teuthology.parallel:result is None 2024-04-26T22:00:07.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T22:00:07.806 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:00:07.806 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:00:07.816 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T22:00:07.816 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T22:00:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.839+0000 7f95a7122640 1 Processor -- start 2024-04-26T22:00:07.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.839+0000 7f95a7122640 1 -- start start 2024-04-26T22:00:07.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.840+0000 7f95a7122640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f95a00d3ee0 0x7f95a00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.840+0000 7f95a7122640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f95a015f750 0x7f95a00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.840+0000 7f95a7122640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a00d03a0 con 0x7f95a015f370 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.840+0000 7f95a7122640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f95a00b4d10 con 0x7f95a00d3ee0 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.840+0000 7f95a7122640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f95a00d0680 con 0x7f95a015f750 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.840+0000 7f959ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f95a00d3ee0 0x7f95a00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.840+0000 7f959ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f95a00d3ee0 0x7f95a00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40870/0 (socket says 172.21.15.137:40870) 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.840+0000 7f959ffff640 1 -- 172.21.15.137:0/2540306135 learned_addr learned my addr 172.21.15.137:0/2540306135 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.840+0000 7f95a56bf640 1 --2- 172.21.15.137:0/2540306135 >> v2:172.21.15.170:3300/0 conn(0x7f95a015f750 0x7f95a00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.841+0000 7f959ffff640 1 -- 172.21.15.137:0/2540306135 >> v2:172.21.15.170:3300/0 conn(0x7f95a015f750 msgr2=0x7f95a00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.841+0000 7f959ffff640 1 --2- 172.21.15.137:0/2540306135 >> v2:172.21.15.170:3300/0 conn(0x7f95a015f750 0x7f95a00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.841+0000 7f959ffff640 1 -- 172.21.15.137:0/2540306135 >> v1:172.21.15.170:6789/0 conn(0x7f95a015f370 legacy=0x7f95a00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.841+0000 7f959ffff640 1 -- 172.21.15.137:0/2540306135 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a00d0960 con 0x7f95a00d3ee0 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.841+0000 7f959ffff640 1 --2- 172.21.15.137:0/2540306135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a00d3ee0 0x7f95a00cfd70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f958c009870 tx=0x7f958c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2c4e017cbb167f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.841+0000 7f959f7fe640 1 -- 172.21.15.137:0/2540306135 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c037070 con 0x7f95a00d3ee0 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.841+0000 7f959f7fe640 1 -- 172.21.15.137:0/2540306135 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958c032440 con 0x7f95a00d3ee0 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.841+0000 7f959f7fe640 1 -- 172.21.15.137:0/2540306135 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c032810 con 0x7f95a00d3ee0 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.842+0000 7f95a7122640 1 -- 172.21.15.137:0/2540306135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a00d3ee0 msgr2=0x7f95a00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.842+0000 7f95a7122640 1 --2- 172.21.15.137:0/2540306135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a00d3ee0 0x7f95a00cfd70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f958c009870 tx=0x7f958c02a2a0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.842+0000 7f95a7122640 1 -- 172.21.15.137:0/2540306135 shutdown_connections 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.842+0000 7f95a7122640 1 --2- 172.21.15.137:0/2540306135 >> v2:172.21.15.170:3300/0 conn(0x7f95a015f750 0x7f95a00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.842+0000 7f95a7122640 1 --2- 172.21.15.137:0/2540306135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a00d3ee0 0x7f95a00cfd70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.842+0000 7f95a7122640 1 -- 172.21.15.137:0/2540306135 >> 172.21.15.137:0/2540306135 conn(0x7f95a008ec10 msgr2=0x7f95a009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.842+0000 7f95a7122640 1 -- 172.21.15.137:0/2540306135 shutdown_connections 2024-04-26T22:00:07.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.842+0000 7f95a7122640 1 -- 172.21.15.137:0/2540306135 wait complete. 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.843+0000 7f95a7122640 1 Processor -- start 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.843+0000 7f95a7122640 1 -- start start 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f95a7122640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95a00d3ee0 0x7f95a0162ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f95a7122640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a015f370 0x7f95a00cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f95a7122640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95a015f750 0x7f95a0156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f95a7122640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95a00b51c0 con 0x7f95a015f370 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f95a7122640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f95a00d0f20 con 0x7f95a00d3ee0 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f95a7122640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95a00b5340 con 0x7f95a015f750 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f959ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a015f370 0x7f95a00cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f959ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a015f370 0x7f95a00cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40884/0 (socket says 172.21.15.137:40884) 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f95a56bf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95a015f750 0x7f95a0156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f959ffff640 1 -- 172.21.15.137:0/2264825058 learned_addr learned my addr 172.21.15.137:0/2264825058 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:07.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.844+0000 7f95a4ebe640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95a00d3ee0 0x7f95a0162ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.845+0000 7f959ffff640 1 -- 172.21.15.137:0/2264825058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95a015f750 msgr2=0x7f95a0156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.845+0000 7f959ffff640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95a015f750 0x7f95a0156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.845+0000 7f959ffff640 1 -- 172.21.15.137:0/2264825058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95a00d3ee0 msgr2=0x7f95a0162ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.845+0000 7f959ffff640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95a00d3ee0 0x7f95a0162ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.845+0000 7f959ffff640 1 -- 172.21.15.137:0/2264825058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a00ca630 con 0x7f95a015f370 2024-04-26T22:00:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.845+0000 7f95a4ebe640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95a00d3ee0 0x7f95a0162ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.845+0000 7f95a56bf640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95a015f750 0x7f95a0156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:07.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.845+0000 7f959ffff640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a015f370 0x7f95a00cb6d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f958c02a2e0 tx=0x7f958c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:07.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.849+0000 7f959d7fa640 1 -- 172.21.15.137:0/2264825058 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c037040 con 0x7f95a015f370 2024-04-26T22:00:07.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.849+0000 7f95a7122640 1 -- 172.21.15.137:0/2264825058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a00ca910 con 0x7f95a015f370 2024-04-26T22:00:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.849+0000 7f95a7122640 1 -- 172.21.15.137:0/2264825058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a00caed0 con 0x7f95a015f370 2024-04-26T22:00:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.849+0000 7f959d7fa640 1 -- 172.21.15.137:0/2264825058 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958c042070 con 0x7f95a015f370 2024-04-26T22:00:07.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.849+0000 7f959d7fa640 1 -- 172.21.15.137:0/2264825058 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c030840 con 0x7f95a015f370 2024-04-26T22:00:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.851+0000 7f958affd640 1 -- 172.21.15.137:0/2264825058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a006a290 con 0x7f95a015f370 2024-04-26T22:00:07.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.851+0000 7f959d7fa640 1 -- 172.21.15.137:0/2264825058 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f958c0309e0 con 0x7f95a015f370 2024-04-26T22:00:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.852+0000 7f959d7fa640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f958406c8f0 0x7f958406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.852+0000 7f959d7fa640 1 -- 172.21.15.137:0/2264825058 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4943+0+0 (secure 0 0 0) 0x7f958c0abfe0 con 0x7f95a015f370 2024-04-26T22:00:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.852+0000 7f95a4ebe640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f958406c8f0 0x7f958406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:07.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.852+0000 7f95a4ebe640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f958406c8f0 0x7f958406edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95a00bb100 tx=0x7f9594009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:07.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:07.856+0000 7f959d7fa640 1 -- 172.21.15.137:0/2264825058 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f958c07a030 con 0x7f95a015f370 2024-04-26T22:00:08.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.044+0000 7f958affd640 1 -- 172.21.15.137:0/2264825058 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f95a00008d0 con 0x7f95a015f370 2024-04-26T22:00:08.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.858+0000 7f959d7fa640 1 -- 172.21.15.137:0/2264825058 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) ==== 97+0+0 (secure 0 0 0) 0x7f958c07e330 con 0x7f95a015f370 2024-04-26T22:00:08.858 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.860+0000 7f958affd640 1 -- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f958406c8f0 msgr2=0x7f958406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.860+0000 7f958affd640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f958406c8f0 0x7f958406edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f95a00bb100 tx=0x7f9594009040 comp rx=0 tx=0).stop 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.860+0000 7f958affd640 1 -- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a015f370 msgr2=0x7f95a00cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.860+0000 7f958affd640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a015f370 0x7f95a00cb6d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f958c02a2e0 tx=0x7f958c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.861+0000 7f958affd640 1 -- 172.21.15.137:0/2264825058 shutdown_connections 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.861+0000 7f958affd640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f958406c8f0 0x7f958406edb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.861+0000 7f958affd640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95a015f370 0x7f95a00cb6d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.861+0000 7f958affd640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95a015f750 0x7f95a0156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.861+0000 7f958affd640 1 --2- 172.21.15.137:0/2264825058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95a00d3ee0 0x7f95a0162ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.861+0000 7f958affd640 1 -- 172.21.15.137:0/2264825058 >> 172.21.15.137:0/2264825058 conn(0x7f95a008ec10 msgr2=0x7f95a00d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.861+0000 7f958affd640 1 -- 172.21.15.137:0/2264825058 shutdown_connections 2024-04-26T22:00:08.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.861+0000 7f958affd640 1 -- 172.21.15.137:0/2264825058 wait complete. 2024-04-26T22:00:08.874 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T22:00:08.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.976+0000 7faeb75f0640 1 Processor -- start 2024-04-26T22:00:08.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.977+0000 7faeb75f0640 1 -- start start 2024-04-26T22:00:08.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.977+0000 7faeb75f0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faeb015f370 0x7faeb00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.977+0000 7faeb75f0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faeb015f750 0x7faeb00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.977+0000 7faeb75f0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faeb00d03a0 con 0x7faeb00d37d0 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.977+0000 7faeb75f0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faeb00b4d10 con 0x7faeb015f370 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.977+0000 7faeb75f0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7faeb00d0680 con 0x7faeb015f750 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.977+0000 7faeb538c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faeb015f370 0x7faeb00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.977+0000 7faeb5b8d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7faeb00d37d0 0x7faeb00d1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54452/0 (socket says 172.21.15.137:54452) 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.977+0000 7faeb5b8d640 1 -- 172.21.15.137:0/1849475083 learned_addr learned my addr 172.21.15.137:0/1849475083 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.978+0000 7faea7fff640 1 -- 172.21.15.137:0/1849475083 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095273903 0 0) 0x7faeb00d03a0 con 0x7faeb00d37d0 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.978+0000 7faea7fff640 1 -- 172.21.15.137:0/1849475083 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae9c003520 con 0x7faeb00d37d0 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.978+0000 7faeb4b8b640 1 --2- 172.21.15.137:0/1849475083 >> v2:172.21.15.170:3300/0 conn(0x7faeb015f750 0x7faeb00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.978+0000 7faeb538c640 1 -- 172.21.15.137:0/1849475083 >> v2:172.21.15.170:3300/0 conn(0x7faeb015f750 msgr2=0x7faeb00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.978+0000 7faeb538c640 1 --2- 172.21.15.137:0/1849475083 >> v2:172.21.15.170:3300/0 conn(0x7faeb015f750 0x7faeb00b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.978+0000 7faeb538c640 1 -- 172.21.15.137:0/1849475083 >> v1:172.21.15.137:6789/0 conn(0x7faeb00d37d0 legacy=0x7faeb00d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:08.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.978+0000 7faeb538c640 1 -- 172.21.15.137:0/1849475083 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb00d0960 con 0x7faeb015f370 2024-04-26T22:00:08.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faeb538c640 1 --2- 172.21.15.137:0/1849475083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb015f370 0x7faeb00cfd70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faeb00d02b0 tx=0x7faeac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee35e4526f8ed0e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:08.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faea7fff640 1 -- 172.21.15.137:0/1849475083 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac037070 con 0x7faeb015f370 2024-04-26T22:00:08.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faea7fff640 1 -- 172.21.15.137:0/1849475083 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeac032440 con 0x7faeb015f370 2024-04-26T22:00:08.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faea7fff640 1 -- 172.21.15.137:0/1849475083 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac0327f0 con 0x7faeb015f370 2024-04-26T22:00:08.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faeb75f0640 1 -- 172.21.15.137:0/1849475083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb015f370 msgr2=0x7faeb00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:08.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faeb75f0640 1 --2- 172.21.15.137:0/1849475083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb015f370 0x7faeb00cfd70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7faeb00d02b0 tx=0x7faeac02a1a0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faeb75f0640 1 -- 172.21.15.137:0/1849475083 shutdown_connections 2024-04-26T22:00:08.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faeb75f0640 1 --2- 172.21.15.137:0/1849475083 >> v2:172.21.15.170:3300/0 conn(0x7faeb015f750 0x7faeb00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faeb75f0640 1 --2- 172.21.15.137:0/1849475083 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb015f370 0x7faeb00cfd70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faeb75f0640 1 -- 172.21.15.137:0/1849475083 >> 172.21.15.137:0/1849475083 conn(0x7faeb008ec10 msgr2=0x7faeb009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faeb75f0640 1 -- 172.21.15.137:0/1849475083 shutdown_connections 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.979+0000 7faeb75f0640 1 -- 172.21.15.137:0/1849475083 wait complete. 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.980+0000 7faeb75f0640 1 Processor -- start 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.980+0000 7faeb75f0640 1 -- start start 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb75f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00d37d0 0x7faeb00ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb75f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faeb015f370 0x7faeb015fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb75f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb015f750 0x7faeb0160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb75f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faeb00b61d0 con 0x7faeb00d37d0 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb75f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faeb00d0f20 con 0x7faeb015f750 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb75f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faeb00b6350 con 0x7faeb015f370 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb538c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00d37d0 0x7faeb00ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb538c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00d37d0 0x7faeb00ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40900/0 (socket says 172.21.15.137:40900) 2024-04-26T22:00:08.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb538c640 1 -- 172.21.15.137:0/3538668638 learned_addr learned my addr 172.21.15.137:0/3538668638 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb5b8d640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb015f750 0x7faeb0160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.981+0000 7faeb4b8b640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faeb015f370 0x7faeb015fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faeb538c640 1 -- 172.21.15.137:0/3538668638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faeb015f370 msgr2=0x7faeb015fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faeb538c640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faeb015f370 0x7faeb015fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faeb538c640 1 -- 172.21.15.137:0/3538668638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb015f750 msgr2=0x7faeb0160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faeb538c640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb015f750 0x7faeb0160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faeb538c640 1 -- 172.21.15.137:0/3538668638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb01607f0 con 0x7faeb00d37d0 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faeb538c640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00d37d0 0x7faeb00ca960 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7faeac000c00 tx=0x7faeac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faea5ffb640 1 -- 172.21.15.137:0/3538668638 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac037040 con 0x7faeb00d37d0 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faea5ffb640 1 -- 172.21.15.137:0/3538668638 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeac0304c0 con 0x7faeb00d37d0 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faea5ffb640 1 -- 172.21.15.137:0/3538668638 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac030890 con 0x7faeb00d37d0 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb0160ad0 con 0x7faeb00d37d0 2024-04-26T22:00:08.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.982+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb0161090 con 0x7faeb00d37d0 2024-04-26T22:00:08.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.983+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb006a290 con 0x7faeb00d37d0 2024-04-26T22:00:08.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.983+0000 7faea5ffb640 1 -- 172.21.15.137:0/3538668638 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faeac044020 con 0x7faeb00d37d0 2024-04-26T22:00:08.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.984+0000 7faea5ffb640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae9406c8f0 0x7fae9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:08.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.984+0000 7faea5ffb640 1 -- 172.21.15.137:0/3538668638 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7faeac0ab9a0 con 0x7faeb00d37d0 2024-04-26T22:00:08.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.984+0000 7faeb4b8b640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae9406c8f0 0x7fae9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:08.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.984+0000 7faeb4b8b640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae9406c8f0 0x7fae9406edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faeb01e86a0 tx=0x7faea0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:08.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:08.988+0000 7faea5ffb640 1 -- 172.21.15.137:0/3538668638 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faeac079ad0 con 0x7faeb00d37d0 2024-04-26T22:00:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.230+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7faeb00c8ad0 con 0x7faeb00d37d0 2024-04-26T22:00:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.230+0000 7faea5ffb640 1 -- 172.21.15.137:0/3538668638 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7faeac07ddd0 con 0x7faeb00d37d0 2024-04-26T22:00:09.230 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:09.230 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:00:09.230 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmKffkBRAAh7EvvT0pmNbLKtJsBH/25Q==", 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmd5UHERAAykWO/C56qwLwimzH2f6mcA==", 2024-04-26T22:00:09.231 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmMbCsDBAANF98tMtCSOy4TVN7I498cw==", 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.232 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmQ47KFxAAsreL970BTH5yQLOol942iQ==", 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBcIyxmY2T8NhAAMyJ5OP3dhuqMymrlUG4q2A==", 2024-04-26T22:00:09.233 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBfIyxmNfGnNRAAp+tTaVBwfAMUsyqRSgoRvw==", 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.234 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBiIyxm3Q1yMxAAf7f6Me7uKYzM+Fp+2FCQsA==", 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlIyxmFcj2MRAAL/yPxOwtgMnfbmr0YUZs6Q==", 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:00:09.235 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBpIyxmaaAqORAAfowCddy0wT/LptWvqD4CDw==", 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBsIyxmJaOFNhAAqjJAuU/SoVnjIAYCODWMnA==", 2024-04-26T22:00:09.236 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBvIyxmRkINNBAAjfFLMQ9/XMLLU8ZAoUxvkQ==", 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.237 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQByIyxmeF1gMRAAH0t727lSCZgkTgJ0ZXyA6g==", 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ==", 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow r", 2024-04-26T22:00:09.238 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxms4U0JBAAMZ056L4EP1qzX2KVx8JiEg==", 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T22:00:09.239 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmUnswIRAA5nYDanYzHiEVk98/041RHA==", 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmHOORKRAA6Agn7TqBPywtop3Eo8+yFQ==", 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:00:09.240 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxm7ue6JhAAyLiai4CKXmiB00fCAfp2WA==", 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmFBrPAhAAfrkQvzF5SSyb5iQ0zr0eww==", 2024-04-26T22:00:09.241 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxmlrq3OhAA9Fd+zmECU9xK/pWp2Hg9kg==", 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:00:09.242 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:00:09.243 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:00:09.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:09.243 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T22:00:09.243 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:00:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae9406c8f0 msgr2=0x7fae9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae9406c8f0 0x7fae9406edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faeb01e86a0 tx=0x7faea0008040 comp rx=0 tx=0).stop 2024-04-26T22:00:09.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00d37d0 msgr2=0x7faeb00ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00d37d0 0x7faeb00ca960 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7faeac000c00 tx=0x7faeac0046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 shutdown_connections 2024-04-26T22:00:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae9406c8f0 0x7fae9406edb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faeb015f750 0x7faeb0160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faeb015f370 0x7faeb015fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 --2- 172.21.15.137:0/3538668638 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faeb00d37d0 0x7faeb00ca960 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 >> 172.21.15.137:0/3538668638 conn(0x7faeb008ec10 msgr2=0x7faeb006df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 shutdown_connections 2024-04-26T22:00:09.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.232+0000 7faeb75f0640 1 -- 172.21.15.137:0/3538668638 wait complete. 2024-04-26T22:00:09.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:09.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.342+0000 7fd24bc83640 1 Processor -- start 2024-04-26T22:00:09.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.342+0000 7fd24bc83640 1 -- start start 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd24bc83640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2440cf2e0 0x7fd24406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd24bc83640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd2440d11b0 0x7fd24406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd24bc83640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd24406e2c0 0x7fd24415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd24bc83640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd24406e750 con 0x7fd2440cf2e0 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd24bc83640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd2440d1740 con 0x7fd2440d11b0 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd24bc83640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd2440d1a20 con 0x7fd24406e2c0 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd249a1f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2440cf2e0 0x7fd24406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd249a1f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2440cf2e0 0x7fd24406d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40912/0 (socket says 172.21.15.137:40912) 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd249a1f640 1 -- 172.21.15.137:0/80304337 learned_addr learned my addr 172.21.15.137:0/80304337 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:09.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd24a220640 1 --2- 172.21.15.137:0/80304337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd24406e2c0 0x7fd24415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd24921e640 1 --2- 172.21.15.137:0/80304337 >> v2:172.21.15.170:3300/0 conn(0x7fd2440d11b0 0x7fd24406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd249a1f640 1 -- 172.21.15.137:0/80304337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd24406e2c0 msgr2=0x7fd24415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd249a1f640 1 --2- 172.21.15.137:0/80304337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd24406e2c0 0x7fd24415ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd249a1f640 1 -- 172.21.15.137:0/80304337 >> v2:172.21.15.170:3300/0 conn(0x7fd2440d11b0 msgr2=0x7fd24406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd249a1f640 1 --2- 172.21.15.137:0/80304337 >> v2:172.21.15.170:3300/0 conn(0x7fd2440d11b0 0x7fd24406dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.343+0000 7fd249a1f640 1 -- 172.21.15.137:0/80304337 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2440d1d00 con 0x7fd2440cf2e0 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.344+0000 7fd249a1f640 1 --2- 172.21.15.137:0/80304337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 0x7fd24406d4d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd240009870 tx=0x7fd24002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c254fecdaaf827ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.344+0000 7fd248a1d640 1 -- 172.21.15.137:0/80304337 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240037070 con 0x7fd2440cf2e0 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.344+0000 7fd248a1d640 1 -- 172.21.15.137:0/80304337 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd240032440 con 0x7fd2440cf2e0 2024-04-26T22:00:09.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.344+0000 7fd248a1d640 1 -- 172.21.15.137:0/80304337 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240032810 con 0x7fd2440cf2e0 2024-04-26T22:00:09.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.344+0000 7fd24bc83640 1 -- 172.21.15.137:0/80304337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 msgr2=0x7fd24406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.344+0000 7fd24bc83640 1 --2- 172.21.15.137:0/80304337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 0x7fd24406d4d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd240009870 tx=0x7fd24002a210 comp rx=0 tx=0).stop 2024-04-26T22:00:09.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.344+0000 7fd24bc83640 1 -- 172.21.15.137:0/80304337 shutdown_connections 2024-04-26T22:00:09.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.345+0000 7fd24bc83640 1 --2- 172.21.15.137:0/80304337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd24406e2c0 0x7fd24415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.345+0000 7fd24bc83640 1 --2- 172.21.15.137:0/80304337 >> v2:172.21.15.170:3300/0 conn(0x7fd2440d11b0 0x7fd24406dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.345+0000 7fd24bc83640 1 --2- 172.21.15.137:0/80304337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 0x7fd24406d4d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.345+0000 7fd24bc83640 1 -- 172.21.15.137:0/80304337 >> 172.21.15.137:0/80304337 conn(0x7fd2440b4a60 msgr2=0x7fd2440b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.345+0000 7fd24bc83640 1 -- 172.21.15.137:0/80304337 shutdown_connections 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.345+0000 7fd24bc83640 1 -- 172.21.15.137:0/80304337 wait complete. 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.346+0000 7fd24bc83640 1 Processor -- start 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.346+0000 7fd24bc83640 1 -- start start 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.346+0000 7fd24bc83640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd24406e2c0 0x7fd2441f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.346+0000 7fd24bc83640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 0x7fd2440b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.346+0000 7fd24bc83640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2440d11b0 0x7fd2440b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.346+0000 7fd24bc83640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd24406da10 con 0x7fd2440cf2e0 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.346+0000 7fd24bc83640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd2440d22c0 con 0x7fd24406e2c0 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.346+0000 7fd24bc83640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd2440cf6c0 con 0x7fd2440d11b0 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24921e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 0x7fd2440b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24921e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 0x7fd2440b83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40922/0 (socket says 172.21.15.137:40922) 2024-04-26T22:00:09.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24921e640 1 -- 172.21.15.137:0/4077881600 learned_addr learned my addr 172.21.15.137:0/4077881600 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd249a1f640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd24406e2c0 0x7fd2441f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24a220640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2440d11b0 0x7fd2440b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24921e640 1 -- 172.21.15.137:0/4077881600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2440d11b0 msgr2=0x7fd2440b88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24921e640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2440d11b0 0x7fd2440b88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24921e640 1 -- 172.21.15.137:0/4077881600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd24406e2c0 msgr2=0x7fd2441f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24921e640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd24406e2c0 0x7fd2441f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24921e640 1 -- 172.21.15.137:0/4077881600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2441f5bc0 con 0x7fd2440cf2e0 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24921e640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 0x7fd2440b83b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c7f0 tx=0x7fd23400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd23a7fc640 1 -- 172.21.15.137:0/4077881600 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234015070 con 0x7fd2440cf2e0 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd23a7fc640 1 -- 172.21.15.137:0/4077881600 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd234004220 con 0x7fd2440cf2e0 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2441f5ea0 con 0x7fd2440cf2e0 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd23a7fc640 1 -- 172.21.15.137:0/4077881600 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd234003610 con 0x7fd2440cf2e0 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.347+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2440b5790 con 0x7fd2440cf2e0 2024-04-26T22:00:09.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.348+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24406a290 con 0x7fd2440cf2e0 2024-04-26T22:00:09.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.349+0000 7fd23a7fc640 1 -- 172.21.15.137:0/4077881600 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd2340039c0 con 0x7fd2440cf2e0 2024-04-26T22:00:09.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.349+0000 7fd23a7fc640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd22806c8f0 0x7fd22806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.349+0000 7fd23a7fc640 1 -- 172.21.15.137:0/4077881600 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7fd23408ba30 con 0x7fd2440cf2e0 2024-04-26T22:00:09.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.349+0000 7fd249a1f640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd22806c8f0 0x7fd22806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.350+0000 7fd249a1f640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd22806c8f0 0x7fd22806edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd240034000 tx=0x7fd24002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:09.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.353+0000 7fd23a7fc640 1 -- 172.21.15.137:0/4077881600 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd23405a240 con 0x7fd2440cf2e0 2024-04-26T22:00:09.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.529+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2440c9c70 con 0x7fd2440cf2e0 2024-04-26T22:00:09.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.530+0000 7fd23a7fc640 1 -- 172.21.15.137:0/4077881600 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+12903 (secure 0 0 0) 0x7fd234059b40 con 0x7fd2440cf2e0 2024-04-26T22:00:09.530 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:09.530 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":42,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:00:08.857391+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:09.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd22806c8f0 msgr2=0x7fd22806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd22806c8f0 0x7fd22806edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd240034000 tx=0x7fd24002e000 comp rx=0 tx=0).stop 2024-04-26T22:00:09.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 msgr2=0x7fd2440b83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 0x7fd2440b83b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd23400c7f0 tx=0x7fd23400ccb0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 shutdown_connections 2024-04-26T22:00:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd22806c8f0 0x7fd22806edb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2440cf2e0 0x7fd2440b83b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2440d11b0 0x7fd2440b88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 --2- 172.21.15.137:0/4077881600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd24406e2c0 0x7fd2441f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 >> 172.21.15.137:0/4077881600 conn(0x7fd2440b4a60 msgr2=0x7fd244071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 shutdown_connections 2024-04-26T22:00:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.532+0000 7fd24bc83640 1 -- 172.21.15.137:0/4077881600 wait complete. 2024-04-26T22:00:09.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:00:09.543 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:00:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.644+0000 7f8323bb6640 1 Processor -- start 2024-04-26T22:00:09.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.644+0000 7f8323bb6640 1 -- start start 2024-04-26T22:00:09.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8323bb6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f831c161cb0 0x7f831c0d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8323bb6640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f831c0cdd40 con 0x7f831c15e7e0 2024-04-26T22:00:09.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8323bb6640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f831c0cdfe0 con 0x7f831c0d1d90 2024-04-26T22:00:09.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8323bb6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f831c0d2280 con 0x7f831c161cb0 2024-04-26T22:00:09.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8321952640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f831c15e7e0 0x7f831c0ceda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54468/0 (socket says 172.21.15.137:54468) 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8321952640 1 -- 172.21.15.137:0/745219948 learned_addr learned my addr 172.21.15.137:0/745219948 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760338675 0 0) 0x7f831c0cdd40 con 0x7f831c15e7e0 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8321151640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f831c161cb0 0x7f831c0d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8308003520 con 0x7f831c15e7e0 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2022427450 0 0) 0x7f8308003520 con 0x7f831c15e7e0 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f831c161cb0 msgr2=0x7f831c0d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f831c161cb0 0x7f831c0d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 >> v1:172.21.15.170:6789/0 conn(0x7f831c0d1d90 legacy=0x7f831c161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831c0ce2c0 con 0x7f831c15e7e0 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f8318001670 con 0x7f831c15e7e0 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8321151640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f831c161cb0 0x7f831c0d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 >> v1:172.21.15.137:6789/0 conn(0x7f831c15e7e0 legacy=0x7f831c0ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83080039e0 0x7f8308003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f831c161cb0 0x7f8308004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8308004d40 0x7f83080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f831c0d2280 con 0x7f8308004d40 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f830800bb50 con 0x7f83080039e0 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.645+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f830800bd50 con 0x7f831c161cb0 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.646+0000 7f8322153640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8308004d40 0x7f83080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.646+0000 7f8321952640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83080039e0 0x7f8308003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.646+0000 7f8321151640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f831c161cb0 0x7f8308004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.646+0000 7f8322153640 1 -- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f831c161cb0 msgr2=0x7f8308004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.646+0000 7f8322153640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f831c161cb0 0x7f8308004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.646+0000 7f8322153640 1 -- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83080039e0 msgr2=0x7f8308003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.646+0000 7f8322153640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83080039e0 0x7f8308003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.646+0000 7f8322153640 1 -- 172.21.15.137:0/745219948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8308003520 con 0x7f8308004d40 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.646+0000 7f8322153640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8308004d40 0x7f83080051c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8314001e50 tx=0x7f8308005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af049ae1f2aa9c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314001a70 con 0x7f8308004d40 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8314003970 con 0x7f8308004d40 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8320950640 1 -- 172.21.15.137:0/745219948 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314003d60 con 0x7f8308004d40 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8323bb6640 1 -- 172.21.15.137:0/745219948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8308004d40 msgr2=0x7f83080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8323bb6640 1 --2- 172.21.15.137:0/745219948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8308004d40 0x7f83080051c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8314001e50 tx=0x7f8308005830 comp rx=0 tx=0).stop 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8322153640 1 -- 172.21.15.137:0/745219948 reap_dead start 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8323bb6640 1 -- 172.21.15.137:0/745219948 shutdown_connections 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8323bb6640 1 -- 172.21.15.137:0/745219948 >> 172.21.15.137:0/745219948 conn(0x7f831c09ba40 msgr2=0x7f831c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8323bb6640 1 -- 172.21.15.137:0/745219948 shutdown_connections 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.647+0000 7f8323bb6640 1 -- 172.21.15.137:0/745219948 wait complete. 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.648+0000 7f8323bb6640 1 Processor -- start 2024-04-26T22:00:09.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.648+0000 7f8323bb6640 1 -- start start 2024-04-26T22:00:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8323bb6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8308004d40 0x7f831c0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8323bb6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c0c57e0 0x7f831c156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8323bb6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c15d490 0x7f831c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8323bb6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f831c161790 con 0x7f831c0c57e0 2024-04-26T22:00:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8323bb6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f831c0ce880 con 0x7f831c15d490 2024-04-26T22:00:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8323bb6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f831c161910 con 0x7f8308004d40 2024-04-26T22:00:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321151640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c0c57e0 0x7f831c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321151640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c0c57e0 0x7f831c156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40946/0 (socket says 172.21.15.137:40946) 2024-04-26T22:00:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321151640 1 -- 172.21.15.137:0/2965833789 learned_addr learned my addr 172.21.15.137:0/2965833789 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321952640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8308004d40 0x7f831c0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8322153640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c15d490 0x7f831c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321151640 1 -- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8308004d40 msgr2=0x7f831c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321151640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8308004d40 0x7f831c0c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321151640 1 -- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c15d490 msgr2=0x7f831c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321151640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c15d490 0x7f831c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321151640 1 -- 172.21.15.137:0/2965833789 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831c06d790 con 0x7f831c0c57e0 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8321952640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8308004d40 0x7f831c0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.649+0000 7f8322153640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c15d490 0x7f831c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.650+0000 7f8321151640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c0c57e0 0x7f831c156660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f830c011650 tx=0x7f830c011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.650+0000 7f83127fc640 1 -- 172.21.15.137:0/2965833789 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c019070 con 0x7f831c0c57e0 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.650+0000 7f83127fc640 1 -- 172.21.15.137:0/2965833789 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f830c004220 con 0x7f831c0c57e0 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.650+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831c06da70 con 0x7f831c0c57e0 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.650+0000 7f83127fc640 1 -- 172.21.15.137:0/2965833789 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f830c00f040 con 0x7f831c0c57e0 2024-04-26T22:00:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.650+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831c06e030 con 0x7f831c0c57e0 2024-04-26T22:00:09.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.651+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f831c06a290 con 0x7f831c0c57e0 2024-04-26T22:00:09.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.651+0000 7f83127fc640 1 -- 172.21.15.137:0/2965833789 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f830c00f760 con 0x7f831c0c57e0 2024-04-26T22:00:09.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.652+0000 7f83127fc640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f830006c920 0x7f830006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.652+0000 7f8321952640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f830006c920 0x7f830006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.652+0000 7f83127fc640 1 -- 172.21.15.137:0/2965833789 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f830c08ba60 con 0x7f831c0c57e0 2024-04-26T22:00:09.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.652+0000 7f8321952640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f830006c920 0x7f830006ede0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8318001eb0 tx=0x7f8318009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:09.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.656+0000 7f83127fc640 1 -- 172.21.15.137:0/2965833789 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f830c05a150 con 0x7f831c0c57e0 2024-04-26T22:00:09.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.829+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f831c068e00 con 0x7f831c0c57e0 2024-04-26T22:00:09.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.829+0000 7f83127fc640 1 -- 172.21.15.137:0/2965833789 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f830c059a50 con 0x7f831c0c57e0 2024-04-26T22:00:09.829 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:00:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f830006c920 msgr2=0x7f830006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f830006c920 0x7f830006ede0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8318001eb0 tx=0x7f8318009040 comp rx=0 tx=0).stop 2024-04-26T22:00:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c0c57e0 msgr2=0x7f831c156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c0c57e0 0x7f831c156660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f830c011650 tx=0x7f830c011b10 comp rx=0 tx=0).stop 2024-04-26T22:00:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 shutdown_connections 2024-04-26T22:00:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f830006c920 0x7f830006ede0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f831c0c57e0 0x7f831c156660 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f831c15d490 0x7f831c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 --2- 172.21.15.137:0/2965833789 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8308004d40 0x7f831c0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 >> 172.21.15.137:0/2965833789 conn(0x7f831c09ba40 msgr2=0x7f831c0cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 shutdown_connections 2024-04-26T22:00:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.831+0000 7f8323bb6640 1 -- 172.21.15.137:0/2965833789 wait complete. 2024-04-26T22:00:09.842 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T22:00:09.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.940+0000 7f8f05274640 1 Processor -- start 2024-04-26T22:00:09.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.940+0000 7f8f05274640 1 -- start start 2024-04-26T22:00:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8f05274640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 0x7f8f00073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8f05274640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8f000b3af0 0x7f8f000b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8f05274640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f000cfa80 con 0x7f8f00160640 2024-04-26T22:00:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8f05274640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8f000b44a0 con 0x7f8f000b3af0 2024-04-26T22:00:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8f05274640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8f000cfd60 con 0x7f8f00148a30 2024-04-26T22:00:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8eff7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8f000b3af0 0x7f8f000b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8eff7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8f000b3af0 0x7f8f000b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40956/0 (socket says 172.21.15.137:40956) 2024-04-26T22:00:09.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8eff7fe640 1 -- 172.21.15.137:0/1271144016 learned_addr learned my addr 172.21.15.137:0/1271144016 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8eff7fe640 1 -- 172.21.15.137:0/1271144016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 msgr2=0x7f8f00073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8efeffd640 1 --2- 172.21.15.137:0/1271144016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 0x7f8f00073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8eff7fe640 1 --2- 172.21.15.137:0/1271144016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 0x7f8f00073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8eff7fe640 1 -- 172.21.15.137:0/1271144016 >> v1:172.21.15.170:6789/0 conn(0x7f8f00160640 legacy=0x7f8f001636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8eff7fe640 1 -- 172.21.15.137:0/1271144016 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f000d0040 con 0x7f8f000b3af0 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.941+0000 7f8efeffd640 1 --2- 172.21.15.137:0/1271144016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 0x7f8f00073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.942+0000 7f8eff7fe640 1 --2- 172.21.15.137:0/1271144016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 0x7f8f000b3f60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009e50 tx=0x7f8ef802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4034bcb58c0233a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.942+0000 7f8efdffb640 1 -- 172.21.15.137:0/1271144016 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8036070 con 0x7f8f000b3af0 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.942+0000 7f8efdffb640 1 -- 172.21.15.137:0/1271144016 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef8031600 con 0x7f8f000b3af0 2024-04-26T22:00:09.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.942+0000 7f8efdffb640 1 -- 172.21.15.137:0/1271144016 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80319d0 con 0x7f8f000b3af0 2024-04-26T22:00:09.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.943+0000 7f8f05274640 1 -- 172.21.15.137:0/1271144016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 msgr2=0x7f8f000b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.943+0000 7f8f05274640 1 --2- 172.21.15.137:0/1271144016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 0x7f8f000b3f60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009e50 tx=0x7f8ef802a630 comp rx=0 tx=0).stop 2024-04-26T22:00:09.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.943+0000 7f8f05274640 1 -- 172.21.15.137:0/1271144016 shutdown_connections 2024-04-26T22:00:09.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.943+0000 7f8f05274640 1 --2- 172.21.15.137:0/1271144016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 0x7f8f000b3f60 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.943+0000 7f8f05274640 1 --2- 172.21.15.137:0/1271144016 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 0x7f8f00073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.943+0000 7f8f05274640 1 -- 172.21.15.137:0/1271144016 >> 172.21.15.137:0/1271144016 conn(0x7f8f000ce8b0 msgr2=0x7f8f000cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:09.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.943+0000 7f8f05274640 1 -- 172.21.15.137:0/1271144016 shutdown_connections 2024-04-26T22:00:09.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.943+0000 7f8f05274640 1 -- 172.21.15.137:0/1271144016 wait complete. 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.944+0000 7f8f05274640 1 Processor -- start 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.944+0000 7f8f05274640 1 -- start start 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8f05274640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 0x7f8f00146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8f05274640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 0x7f8f0015e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8f05274640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f00160640 0x7f8f00144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8f05274640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f00163db0 con 0x7f8f000b3af0 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8f05274640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8f00163180 con 0x7f8f00160640 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8f05274640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8f00074410 con 0x7f8f00148a30 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 0x7f8f00146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 0x7f8f00146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40968/0 (socket says 172.21.15.137:40968) 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efeffd640 1 -- 172.21.15.137:0/402640220 learned_addr learned my addr 172.21.15.137:0/402640220 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efe7fc640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 0x7f8f0015e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efeffd640 1 -- 172.21.15.137:0/402640220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 msgr2=0x7f8f0015e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efeffd640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 0x7f8f0015e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8eff7fe640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f00160640 0x7f8f00144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efeffd640 1 -- 172.21.15.137:0/402640220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f00160640 msgr2=0x7f8f00144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efeffd640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f00160640 0x7f8f00144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efeffd640 1 -- 172.21.15.137:0/402640220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f0013fd40 con 0x7f8f000b3af0 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8efeffd640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 0x7f8f00146a30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000c7f0 tx=0x7f8ef000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8ee77fe640 1 -- 172.21.15.137:0/402640220 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0015070 con 0x7f8f000b3af0 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8ee77fe640 1 -- 172.21.15.137:0/402640220 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef0007a30 con 0x7f8f000b3af0 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8ee77fe640 1 -- 172.21.15.137:0/402640220 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0007e00 con 0x7f8f000b3af0 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f00140020 con 0x7f8f000b3af0 2024-04-26T22:00:09.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.945+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f001405e0 con 0x7f8f000b3af0 2024-04-26T22:00:09.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.947+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f0006a290 con 0x7f8f000b3af0 2024-04-26T22:00:09.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.947+0000 7f8ee77fe640 1 -- 172.21.15.137:0/402640220 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ef0018070 con 0x7f8f000b3af0 2024-04-26T22:00:09.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.947+0000 7f8ee77fe640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8eec06c8f0 0x7f8eec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:09.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.947+0000 7f8ee77fe640 1 -- 172.21.15.137:0/402640220 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f8ef008b780 con 0x7f8f000b3af0 2024-04-26T22:00:09.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.947+0000 7f8efe7fc640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8eec06c8f0 0x7f8eec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:09.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.948+0000 7f8efe7fc640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8eec06c8f0 0x7f8eec06edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4006fd0 tx=0x7f8ef4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:09.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:09.951+0000 7f8ee77fe640 1 -- 172.21.15.137:0/402640220 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8ef0059f90 con 0x7f8f000b3af0 2024-04-26T22:00:10.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.127+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8f00146f70 con 0x7f8f000b3af0 2024-04-26T22:00:10.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.127+0000 7f8ee77fe640 1 -- 172.21.15.137:0/402640220 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) ==== 84+0+65 (secure 0 0 0) 0x7f8ef0059890 con 0x7f8f000b3af0 2024-04-26T22:00:10.127 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:10.128 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:00:10.128 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:10.128 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T22:00:10.128 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T22:00:10.128 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:10.128 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:00:10.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8eec06c8f0 msgr2=0x7f8eec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8eec06c8f0 0x7f8eec06edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4006fd0 tx=0x7f8ef4008040 comp rx=0 tx=0).stop 2024-04-26T22:00:10.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 msgr2=0x7f8f00146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 0x7f8f00146a30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000c7f0 tx=0x7f8ef000cbf0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 shutdown_connections 2024-04-26T22:00:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8eec06c8f0 0x7f8eec06edb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f00160640 0x7f8f00144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f00148a30 0x7f8f0015e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 --2- 172.21.15.137:0/402640220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f000b3af0 0x7f8f00146a30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 >> 172.21.15.137:0/402640220 conn(0x7f8f000ce8b0 msgr2=0x7f8f000cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 shutdown_connections 2024-04-26T22:00:10.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.129+0000 7f8f05274640 1 -- 172.21.15.137:0/402640220 wait complete. 2024-04-26T22:00:10.140 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T22:00:10.140 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T22:00:10.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.241+0000 7f95461e7640 1 Processor -- start 2024-04-26T22:00:10.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.241+0000 7f95461e7640 1 -- start start 2024-04-26T22:00:10.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f95461e7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f95400cee20 0x7f954006d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f95461e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3a30 0x7f954009ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f95461e7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95400d1240 con 0x7f954009bf80 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f95461e7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f95400d1e10 con 0x7f95400cee20 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f95461e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95400d14e0 con 0x7f95400d3a30 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953ffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f954009bf80 0x7f95401630d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54474/0 (socket says 172.21.15.137:54474) 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953ffff640 1 -- 172.21.15.137:0/2856245433 learned_addr learned my addr 172.21.15.137:0/2856245433 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953effd640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3a30 0x7f954009ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953f7fe640 1 --2- 172.21.15.137:0/2856245433 >> v2:172.21.15.170:3300/0 conn(0x7f95400cee20 0x7f954006d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148619417 0 0) 0x7f95400d1240 con 0x7f954009bf80 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9528003520 con 0x7f954009bf80 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2155795998 0 0) 0x7f9528003520 con 0x7f954009bf80 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3a30 msgr2=0x7f954009ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3a30 0x7f954009ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 >> v2:172.21.15.170:3300/0 conn(0x7f95400cee20 msgr2=0x7f954006d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 --2- 172.21.15.137:0/2856245433 >> v2:172.21.15.170:3300/0 conn(0x7f95400cee20 0x7f954006d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95400d17c0 con 0x7f954009bf80 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f95380019f0 con 0x7f954009bf80 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953effd640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3a30 0x7f954009ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 >> v1:172.21.15.137:6789/0 conn(0x7f954009bf80 legacy=0x7f95401630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.242+0000 7f953e7fc640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95280039b0 0x7f9528003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953e7fc640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9528004800 0x7f9528004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953e7fc640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3a30 0x7f95280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95400d1e10 con 0x7f95280039b0 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f95400d14e0 con 0x7f9528004800 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f952800b9c0 con 0x7f95400d3a30 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953f7fe640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95280039b0 0x7f9528003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953effd640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9528004800 0x7f9528004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953ffff640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3a30 0x7f95280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953f7fe640 1 -- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3a30 msgr2=0x7f95280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953f7fe640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95400d3a30 0x7f95280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953f7fe640 1 -- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9528004800 msgr2=0x7f9528004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953f7fe640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9528004800 0x7f9528004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953f7fe640 1 -- 172.21.15.137:0/2856245433 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9528003520 con 0x7f95280039b0 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.243+0000 7f953f7fe640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95280039b0 0x7f9528003dd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9530009ac0 tx=0x7f9528005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bfaf8a2e3e17c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530036070 con 0x7f95280039b0 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9530031400 con 0x7f95280039b0 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f953e7fc640 1 -- 172.21.15.137:0/2856245433 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530009690 con 0x7f95280039b0 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f95461e7640 1 -- 172.21.15.137:0/2856245433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95280039b0 msgr2=0x7f9528003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f95461e7640 1 --2- 172.21.15.137:0/2856245433 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95280039b0 0x7f9528003dd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9530009ac0 tx=0x7f9528005830 comp rx=0 tx=0).stop 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f953ffff640 1 -- 172.21.15.137:0/2856245433 reap_dead start 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f95461e7640 1 -- 172.21.15.137:0/2856245433 shutdown_connections 2024-04-26T22:00:10.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f95461e7640 1 -- 172.21.15.137:0/2856245433 >> 172.21.15.137:0/2856245433 conn(0x7f95400d2f10 msgr2=0x7f95400d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:10.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f95461e7640 1 -- 172.21.15.137:0/2856245433 shutdown_connections 2024-04-26T22:00:10.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.244+0000 7f95461e7640 1 -- 172.21.15.137:0/2856245433 wait complete. 2024-04-26T22:00:10.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.245+0000 7f95461e7640 1 Processor -- start 2024-04-26T22:00:10.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f95461e7640 1 -- start start 2024-04-26T22:00:10.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f95461e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95280039b0 0x7f9540157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f95461e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015eff0 0x7f954015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f95461e7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95401f8d70 0x7f95401f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f95461e7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95400cf200 con 0x7f95401f8d70 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f95461e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f954009c7a0 con 0x7f954015eff0 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f95461e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95400cf380 con 0x7f95280039b0 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f953ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95401f8d70 0x7f95401f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f953ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95401f8d70 0x7f95401f91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41000/0 (socket says 172.21.15.137:41000) 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f953ffff640 1 -- 172.21.15.137:0/769655246 learned_addr learned my addr 172.21.15.137:0/769655246 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f953f7fe640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95280039b0 0x7f9540157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.246+0000 7f953effd640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015eff0 0x7f954015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f953ffff640 1 -- 172.21.15.137:0/769655246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95280039b0 msgr2=0x7f9540157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f953ffff640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95280039b0 0x7f9540157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f953ffff640 1 -- 172.21.15.137:0/769655246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015eff0 msgr2=0x7f954015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f953ffff640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015eff0 0x7f954015c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f953ffff640 1 -- 172.21.15.137:0/769655246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954015f560 con 0x7f95401f8d70 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f953effd640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015eff0 0x7f954015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:10.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f953ffff640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95401f8d70 0x7f95401f91f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9540164170 tx=0x7f953800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f9527fff640 1 -- 172.21.15.137:0/769655246 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953800edf0 con 0x7f95401f8d70 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f9527fff640 1 -- 172.21.15.137:0/769655246 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9538014430 con 0x7f95401f8d70 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954015f840 con 0x7f95401f8d70 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f9527fff640 1 -- 172.21.15.137:0/769655246 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538014820 con 0x7f95401f8d70 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.247+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95400c7f70 con 0x7f95401f8d70 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.248+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95400d29e0 con 0x7f95401f8d70 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.248+0000 7f9527fff640 1 -- 172.21.15.137:0/769655246 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95380149c0 con 0x7f95401f8d70 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.249+0000 7f9527fff640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.249+0000 7f9527fff640 1 -- 172.21.15.137:0/769655246 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f953808b5a0 con 0x7f95401f8d70 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.249+0000 7f953f7fe640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.249+0000 7f953f7fe640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9530033000 tx=0x7f9530008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:10.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.253+0000 7f9527fff640 1 -- 172.21.15.137:0/769655246 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f95400d29e0 con 0x7f95401f8d70 2024-04-26T22:00:10.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.425+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f954006a290 con 0x7f95401f8d70 2024-04-26T22:00:10.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.863+0000 7f9527fff640 1 -- 172.21.15.137:0/769655246 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) ==== 138+0+0 (secure 0 0 0) 0x7f9538059760 con 0x7f95401f8d70 2024-04-26T22:00:10.864 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 msgr2=0x7f952c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9530033000 tx=0x7f9530008030 comp rx=0 tx=0).stop 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95401f8d70 msgr2=0x7f95401f91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95401f8d70 0x7f95401f91f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9540164170 tx=0x7f953800e530 comp rx=0 tx=0).stop 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 shutdown_connections 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f952c06c8f0 0x7f952c06edb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95401f8d70 0x7f95401f91f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f954015eff0 0x7f954015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 --2- 172.21.15.137:0/769655246 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95280039b0 0x7f9540157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.866+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 >> 172.21.15.137:0/769655246 conn(0x7f95400d2f10 msgr2=0x7f95400cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:10.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.867+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 shutdown_connections 2024-04-26T22:00:10.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.867+0000 7f95461e7640 1 -- 172.21.15.137:0/769655246 wait complete. 2024-04-26T22:00:10.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T22:00:10.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.990+0000 7f569a252640 1 Processor -- start 2024-04-26T22:00:10.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.990+0000 7f569a252640 1 -- start start 2024-04-26T22:00:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.991+0000 7f569a252640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f56940d2170 0x7f56940d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.991+0000 7f569a252640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56940d33d0 con 0x7f5694162a40 2024-04-26T22:00:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.991+0000 7f569a252640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56940d36b0 con 0x7f56940b6050 2024-04-26T22:00:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.991+0000 7f569a252640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f56940b49a0 con 0x7f56940d2170 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.991+0000 7f56937fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5694162a40 0x7f56940d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54484/0 (socket says 172.21.15.137:54484) 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.991+0000 7f56937fe640 1 -- 172.21.15.137:0/4258362566 learned_addr learned my addr 172.21.15.137:0/4258362566 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f5692ffd640 1 --2- 172.21.15.137:0/4258362566 >> v2:172.21.15.170:3300/0 conn(0x7f56940d2170 0x7f56940d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848371810 0 0) 0x7f56940d33d0 con 0x7f5694162a40 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f567c003520 con 0x7f5694162a40 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 274135541 0 0) 0x7f567c003520 con 0x7f5694162a40 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 >> v2:172.21.15.170:3300/0 conn(0x7f56940d2170 msgr2=0x7f56940d2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 --2- 172.21.15.137:0/4258362566 >> v2:172.21.15.170:3300/0 conn(0x7f56940d2170 0x7f56940d2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 >> v1:172.21.15.170:6789/0 conn(0x7f56940b6050 legacy=0x7f56940cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56940d3990 con 0x7f5694162a40 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f56840019f0 con 0x7f5694162a40 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 >> v1:172.21.15.137:6789/0 conn(0x7f5694162a40 legacy=0x7f56940d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0039b0 0x7f567c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c004800 0x7f567c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567c0051c0 0x7f567c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f567c00c030 con 0x7f567c0051c0 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f567c00c1e0 con 0x7f567c004800 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f567c00c3e0 con 0x7f567c0039b0 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f5693fff640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567c0051c0 0x7f567c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f56937fe640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0039b0 0x7f567c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f5692ffd640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c004800 0x7f567c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f5693fff640 1 -- 172.21.15.137:0/4258362566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0039b0 msgr2=0x7f567c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f5693fff640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0039b0 0x7f567c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f5693fff640 1 -- 172.21.15.137:0/4258362566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c004800 msgr2=0x7f567c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f5693fff640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f567c004800 0x7f567c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.992+0000 7f5693fff640 1 -- 172.21.15.137:0/4258362566 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567c003520 con 0x7f567c0051c0 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.993+0000 7f5693fff640 1 -- 172.21.15.137:0/4258362566 reap_dead start 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.993+0000 7f5693fff640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567c0051c0 0x7f567c00b9c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f568c001750 tx=0x7f567c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746ffad0f5b93318 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.993+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c001370 con 0x7f567c0051c0 2024-04-26T22:00:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.993+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568c005310 con 0x7f567c0051c0 2024-04-26T22:00:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.993+0000 7f56927fc640 1 -- 172.21.15.137:0/4258362566 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c02abe0 con 0x7f567c0051c0 2024-04-26T22:00:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.994+0000 7f569a252640 1 -- 172.21.15.137:0/4258362566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567c0051c0 msgr2=0x7f567c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.994+0000 7f569a252640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567c0051c0 0x7f567c00b9c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f568c001750 tx=0x7f567c005830 comp rx=0 tx=0).stop 2024-04-26T22:00:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.994+0000 7f569a252640 1 -- 172.21.15.137:0/4258362566 shutdown_connections 2024-04-26T22:00:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.994+0000 7f569a252640 1 --2- 172.21.15.137:0/4258362566 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f567c0051c0 0x7f567c00b9c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.994+0000 7f569a252640 1 -- 172.21.15.137:0/4258362566 >> 172.21.15.137:0/4258362566 conn(0x7f569409e560 msgr2=0x7f56940d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.994+0000 7f569a252640 1 -- 172.21.15.137:0/4258362566 shutdown_connections 2024-04-26T22:00:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.994+0000 7f569a252640 1 -- 172.21.15.137:0/4258362566 wait complete. 2024-04-26T22:00:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.995+0000 7f569a252640 1 Processor -- start 2024-04-26T22:00:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.995+0000 7f569a252640 1 -- start start 2024-04-26T22:00:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f569a252640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0051c0 0x7f56940c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f569a252640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694152010 0x7f56940b9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f569a252640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5694152470 0x7f56940ba500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f569a252640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5694162e20 con 0x7f5694152010 2024-04-26T22:00:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f569a252640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f56940d3f50 con 0x7f5694152470 2024-04-26T22:00:11.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f569a252640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f56940b6630 con 0x7f567c0051c0 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5692ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694152010 0x7f56940b9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5692ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694152010 0x7f56940b9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41026/0 (socket says 172.21.15.137:41026) 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5692ffd640 1 -- 172.21.15.137:0/1419177172 learned_addr learned my addr 172.21.15.137:0/1419177172 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f56937fe640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0051c0 0x7f56940c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5693fff640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5694152470 0x7f56940ba500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5692ffd640 1 -- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0051c0 msgr2=0x7f56940c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5692ffd640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0051c0 0x7f56940c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5692ffd640 1 -- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5694152470 msgr2=0x7f56940ba500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5692ffd640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5694152470 0x7f56940ba500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5692ffd640 1 -- 172.21.15.137:0/1419177172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56940c9160 con 0x7f5694152010 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f56937fe640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0051c0 0x7f56940c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5693fff640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5694152470 0x7f56940ba500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.996+0000 7f5692ffd640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694152010 0x7f56940b9fc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5688011940 tx=0x7f5688011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.997+0000 7f567bfff640 1 -- 172.21.15.137:0/1419177172 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568800faf0 con 0x7f5694152010 2024-04-26T22:00:11.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.997+0000 7f567bfff640 1 -- 172.21.15.137:0/1419177172 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568800fc90 con 0x7f5694152010 2024-04-26T22:00:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.997+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569415cc10 con 0x7f5694152010 2024-04-26T22:00:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.997+0000 7f567bfff640 1 -- 172.21.15.137:0/1419177172 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688014440 con 0x7f5694152010 2024-04-26T22:00:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.997+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f569415d1d0 con 0x7f5694152010 2024-04-26T22:00:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.998+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569406a290 con 0x7f5694152010 2024-04-26T22:00:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.998+0000 7f567bfff640 1 -- 172.21.15.137:0/1419177172 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5688012040 con 0x7f5694152010 2024-04-26T22:00:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.998+0000 7f567bfff640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f568006c8f0 0x7f568006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.999+0000 7f567bfff640 1 -- 172.21.15.137:0/1419177172 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5227+0+0 (secure 0 0 0) 0x7f568808c040 con 0x7f5694152010 2024-04-26T22:00:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.999+0000 7f56937fe640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f568006c8f0 0x7f568006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:11.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:10.999+0000 7f56937fe640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f568006c8f0 0x7f568006edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5684002040 tx=0x7f5684006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:11.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.003+0000 7f567bfff640 1 -- 172.21.15.137:0/1419177172 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5688019030 con 0x7f5694152010 2024-04-26T22:00:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.177+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f56940cfe30 con 0x7f5694152010 2024-04-26T22:00:11.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.866+0000 7f567bfff640 1 -- 172.21.15.137:0/1419177172 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) ==== 170+0+0 (secure 0 0 0) 0x7f568805a5c0 con 0x7f5694152010 2024-04-26T22:00:11.866 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T22:00:11.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f568006c8f0 msgr2=0x7f568006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:11.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f568006c8f0 0x7f568006edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5684002040 tx=0x7f5684006040 comp rx=0 tx=0).stop 2024-04-26T22:00:11.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694152010 msgr2=0x7f56940b9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:11.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694152010 0x7f56940b9fc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5688011940 tx=0x7f5688011e00 comp rx=0 tx=0).stop 2024-04-26T22:00:11.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 shutdown_connections 2024-04-26T22:00:11.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f568006c8f0 0x7f568006edb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:11.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5694152010 0x7f56940b9fc0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:11.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5694152470 0x7f56940ba500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:11.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 --2- 172.21.15.137:0/1419177172 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f567c0051c0 0x7f56940c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:11.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.869+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 >> 172.21.15.137:0/1419177172 conn(0x7f569409e560 msgr2=0x7f56940d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:11.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.870+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 shutdown_connections 2024-04-26T22:00:11.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.871+0000 7f569a252640 1 -- 172.21.15.137:0/1419177172 wait complete. 2024-04-26T22:00:11.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T22:00:12.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:11.999+0000 7fc1add24640 1 Processor -- start 2024-04-26T22:00:12.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.000+0000 7fc1add24640 1 -- start start 2024-04-26T22:00:12.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.000+0000 7fc1add24640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 0x7fc1a80b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:12.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.000+0000 7fc1add24640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc1a80d0300 0x7fc1a806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:12.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.000+0000 7fc1add24640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1a80b3e50 0x7fc1a80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.000+0000 7fc1add24640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a806fc60 con 0x7fc1a80b3e50 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.000+0000 7fc1add24640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a80b46a0 con 0x7fc1a80d0300 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.000+0000 7fc1add24640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a80b5db0 con 0x7fc1a806f340 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.000+0000 7fc1a7fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1a80b3e50 0x7fc1a80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a7fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1a80b3e50 0x7fc1a80720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41032/0 (socket says 172.21.15.137:41032) 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a7fff640 1 -- 172.21.15.137:0/2035748188 learned_addr learned my addr 172.21.15.137:0/2035748188 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a77fe640 1 --2- 172.21.15.137:0/2035748188 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 0x7fc1a80b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a6ffd640 1 --2- 172.21.15.137:0/2035748188 >> v2:172.21.15.170:3300/0 conn(0x7fc1a80d0300 0x7fc1a806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a7fff640 1 -- 172.21.15.137:0/2035748188 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 msgr2=0x7fc1a80b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a7fff640 1 --2- 172.21.15.137:0/2035748188 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 0x7fc1a80b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a7fff640 1 -- 172.21.15.137:0/2035748188 >> v2:172.21.15.170:3300/0 conn(0x7fc1a80d0300 msgr2=0x7fc1a806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a7fff640 1 --2- 172.21.15.137:0/2035748188 >> v2:172.21.15.170:3300/0 conn(0x7fc1a80d0300 0x7fc1a806f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a7fff640 1 -- 172.21.15.137:0/2035748188 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a80b6090 con 0x7fc1a80b3e50 2024-04-26T22:00:12.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a6ffd640 1 --2- 172.21.15.137:0/2035748188 >> v2:172.21.15.170:3300/0 conn(0x7fc1a80d0300 0x7fc1a806f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.001+0000 7fc1a7fff640 1 --2- 172.21.15.137:0/2035748188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 0x7fc1a80720f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80b3c10 tx=0x7fc1a002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5aaeaaa39808072 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1a67fc640 1 -- 172.21.15.137:0/2035748188 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0036070 con 0x7fc1a80b3e50 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1a67fc640 1 -- 172.21.15.137:0/2035748188 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a0031600 con 0x7fc1a80b3e50 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1a67fc640 1 -- 172.21.15.137:0/2035748188 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00319d0 con 0x7fc1a80b3e50 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1add24640 1 -- 172.21.15.137:0/2035748188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 msgr2=0x7fc1a80720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1add24640 1 --2- 172.21.15.137:0/2035748188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 0x7fc1a80720f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80b3c10 tx=0x7fc1a002a570 comp rx=0 tx=0).stop 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1add24640 1 -- 172.21.15.137:0/2035748188 shutdown_connections 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1add24640 1 --2- 172.21.15.137:0/2035748188 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 0x7fc1a80720f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1add24640 1 --2- 172.21.15.137:0/2035748188 >> v2:172.21.15.170:3300/0 conn(0x7fc1a80d0300 0x7fc1a806f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1add24640 1 --2- 172.21.15.137:0/2035748188 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 0x7fc1a80b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1add24640 1 -- 172.21.15.137:0/2035748188 >> 172.21.15.137:0/2035748188 conn(0x7fc1a80cd8a0 msgr2=0x7fc1a80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1add24640 1 -- 172.21.15.137:0/2035748188 shutdown_connections 2024-04-26T22:00:12.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.002+0000 7fc1add24640 1 -- 172.21.15.137:0/2035748188 wait complete. 2024-04-26T22:00:12.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.003+0000 7fc1add24640 1 Processor -- start 2024-04-26T22:00:12.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1add24640 1 -- start start 2024-04-26T22:00:12.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1add24640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 0x7fc1a81597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:12.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1add24640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 0x7fc1a815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:12.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1add24640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80d0300 0x7fc1a815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:12.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1add24640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80b42e0 con 0x7fc1a80b3e50 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1add24640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a80b6650 con 0x7fc1a80d0300 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1add24640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a80b4460 con 0x7fc1a806f340 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1a6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 0x7fc1a815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1a6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 0x7fc1a815a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41034/0 (socket says 172.21.15.137:41034) 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1a6ffd640 1 -- 172.21.15.137:0/4178234073 learned_addr learned my addr 172.21.15.137:0/4178234073 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1a77fe640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 0x7fc1a81597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.004+0000 7fc1a7fff640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80d0300 0x7fc1a815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc1a6ffd640 1 -- 172.21.15.137:0/4178234073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 msgr2=0x7fc1a81597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc1a6ffd640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 0x7fc1a81597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc1a6ffd640 1 -- 172.21.15.137:0/4178234073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80d0300 msgr2=0x7fc1a815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc1a6ffd640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80d0300 0x7fc1a815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc1a6ffd640 1 -- 172.21.15.137:0/4178234073 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a814f660 con 0x7fc1a80b3e50 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc1a6ffd640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 0x7fc1a815a520 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c7f0 tx=0x7fc19c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc18ffff640 1 -- 172.21.15.137:0/4178234073 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c015070 con 0x7fc1a80b3e50 2024-04-26T22:00:12.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc18ffff640 1 -- 172.21.15.137:0/4178234073 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c007820 con 0x7fc1a80b3e50 2024-04-26T22:00:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc18ffff640 1 -- 172.21.15.137:0/4178234073 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c007bd0 con 0x7fc1a80b3e50 2024-04-26T22:00:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a80ca420 con 0x7fc1a80b3e50 2024-04-26T22:00:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.005+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a8159d20 con 0x7fc1a80b3e50 2024-04-26T22:00:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.006+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a806a290 con 0x7fc1a80b3e50 2024-04-26T22:00:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.007+0000 7fc18ffff640 1 -- 172.21.15.137:0/4178234073 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc19c018070 con 0x7fc1a80b3e50 2024-04-26T22:00:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.007+0000 7fc18ffff640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc19406c8f0 0x7fc19406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.007+0000 7fc18ffff640 1 -- 172.21.15.137:0/4178234073 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5609+0+0 (secure 0 0 0) 0x7fc19c08bb10 con 0x7fc1a80b3e50 2024-04-26T22:00:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.007+0000 7fc1a77fe640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc19406c8f0 0x7fc19406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:12.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.008+0000 7fc1a77fe640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc19406c8f0 0x7fc19406edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc1a813f310 tx=0x7fc198008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:12.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.012+0000 7fc18ffff640 1 -- 172.21.15.137:0/4178234073 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc19c059950 con 0x7fc1a80b3e50 2024-04-26T22:00:12.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.223+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc1a80739a0 con 0x7fc1a80b3e50 2024-04-26T22:00:12.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.891+0000 7fc18ffff640 1 -- 172.21.15.137:0/4178234073 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) ==== 172+0+0 (secure 0 0 0) 0x7fc19c05dc50 con 0x7fc1a80b3e50 2024-04-26T22:00:12.891 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 6 and data pool 7 2024-04-26T22:00:12.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc19406c8f0 msgr2=0x7fc19406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:12.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc19406c8f0 0x7fc19406edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc1a813f310 tx=0x7fc198008040 comp rx=0 tx=0).stop 2024-04-26T22:00:12.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 msgr2=0x7fc1a815a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:12.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 0x7fc1a815a520 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c7f0 tx=0x7fc19c00ccb0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 shutdown_connections 2024-04-26T22:00:12.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc19406c8f0 0x7fc19406edb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1a80b3e50 0x7fc1a815a520 secure :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c7f0 tx=0x7fc19c00ccb0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1a80d0300 0x7fc1a815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 --2- 172.21.15.137:0/4178234073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc1a806f340 0x7fc1a81597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:12.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 >> 172.21.15.137:0/4178234073 conn(0x7fc1a80cd8a0 msgr2=0x7fc1a8072940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:12.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 shutdown_connections 2024-04-26T22:00:12.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:12.904+0000 7fc1add24640 1 -- 172.21.15.137:0/4178234073 wait complete. 2024-04-26T22:00:12.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:00:12.913 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:00:12.923 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:13.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.064+0000 7f30ba62a640 1 Processor -- start 2024-04-26T22:00:13.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.064+0000 7f30ba62a640 1 -- start start 2024-04-26T22:00:13.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.065+0000 7f30ba62a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f30b4160630 0x7f30b40b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.065+0000 7f30ba62a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b40b4530 con 0x7f30b40b61a0 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.065+0000 7f30ba62a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b40b4810 con 0x7f30b4145980 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.065+0000 7f30ba62a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f30b4160ac0 con 0x7f30b4160630 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.065+0000 7f30b37fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f30b40b61a0 0x7f30b40720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54492/0 (socket says 172.21.15.137:54492) 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.065+0000 7f30b37fe640 1 -- 172.21.15.137:0/413581985 learned_addr learned my addr 172.21.15.137:0/413581985 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.065+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519191507 0 0) 0x7f30b40b4530 con 0x7f30b40b61a0 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.065+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f309c003520 con 0x7f30b40b61a0 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.065+0000 7f30b8bc7640 1 --2- 172.21.15.137:0/413581985 >> v2:172.21.15.170:3300/0 conn(0x7f30b4160630 0x7f30b40b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4147837267 0 0) 0x7f309c003520 con 0x7f30b40b61a0 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 >> v2:172.21.15.170:3300/0 conn(0x7f30b4160630 msgr2=0x7f30b40b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 --2- 172.21.15.137:0/413581985 >> v2:172.21.15.170:3300/0 conn(0x7f30b4160630 0x7f30b40b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 >> v1:172.21.15.170:6789/0 conn(0x7f30b4145980 legacy=0x7f30b40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b40b4af0 con 0x7f30b40b61a0 2024-04-26T22:00:13.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f30a8001670 con 0x7f30b40b61a0 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 >> v1:172.21.15.137:6789/0 conn(0x7f30b40b61a0 legacy=0x7f30b40720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c003a00 0x7f309c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f309c004800 0x7f309c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c005210 0x7f309c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f309c00c130 con 0x7f309c003a00 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f309c00c2e0 con 0x7f309c004800 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f309c00e6f0 con 0x7f309c005210 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b3fff640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c003a00 0x7f309c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b37fe640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f309c004800 0x7f309c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b8bc7640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c005210 0x7f309c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b3fff640 1 -- 172.21.15.137:0/413581985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c005210 msgr2=0x7f309c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b3fff640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c005210 0x7f309c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b3fff640 1 -- 172.21.15.137:0/413581985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f309c004800 msgr2=0x7f309c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b3fff640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f309c004800 0x7f309c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b3fff640 1 -- 172.21.15.137:0/413581985 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c003520 con 0x7f309c003a00 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b8bc7640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c005210 0x7f309c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.066+0000 7f30b8bc7640 1 -- 172.21.15.137:0/413581985 reap_dead start 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30b3fff640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c003a00 0x7f309c003e20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f30a4001720 tx=0x7f309c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ab7c4aec2fdf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4001370 con 0x7f309c003a00 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a40052d0 con 0x7f309c003a00 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30b2ffd640 1 -- 172.21.15.137:0/413581985 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a402ab90 con 0x7f309c003a00 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30ba62a640 1 -- 172.21.15.137:0/413581985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c003a00 msgr2=0x7f309c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30ba62a640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c003a00 0x7f309c003e20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f30a4001720 tx=0x7f309c005830 comp rx=0 tx=0).stop 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30ba62a640 1 -- 172.21.15.137:0/413581985 shutdown_connections 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30ba62a640 1 --2- 172.21.15.137:0/413581985 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f309c003a00 0x7f309c003e20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30ba62a640 1 -- 172.21.15.137:0/413581985 >> 172.21.15.137:0/413581985 conn(0x7f30b40d0d30 msgr2=0x7f30b40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:13.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.067+0000 7f30ba62a640 1 -- 172.21.15.137:0/413581985 shutdown_connections 2024-04-26T22:00:13.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.068+0000 7f30ba62a640 1 -- 172.21.15.137:0/413581985 wait complete. 2024-04-26T22:00:13.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.069+0000 7f30ba62a640 1 Processor -- start 2024-04-26T22:00:13.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.069+0000 7f30ba62a640 1 -- start start 2024-04-26T22:00:13.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.069+0000 7f30ba62a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c003a00 0x7f30b4138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30ba62a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30b413cb10 0x7f30b413cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30ba62a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b40d00f0 0x7f30b40d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30ba62a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40b3de0 con 0x7f30b40d00f0 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30ba62a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40b5140 con 0x7f30b413cb10 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30ba62a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40b3f60 con 0x7f309c003a00 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b8bc7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b40d00f0 0x7f30b40d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b8bc7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b40d00f0 0x7f30b40d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41054/0 (socket says 172.21.15.137:41054) 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b8bc7640 1 -- 172.21.15.137:0/2640413836 learned_addr learned my addr 172.21.15.137:0/2640413836 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b37fe640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30b413cb10 0x7f30b413cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b3fff640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c003a00 0x7f30b4138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b8bc7640 1 -- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c003a00 msgr2=0x7f30b4138db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b8bc7640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c003a00 0x7f30b4138db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b8bc7640 1 -- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30b413cb10 msgr2=0x7f30b413cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b8bc7640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30b413cb10 0x7f30b413cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b8bc7640 1 -- 172.21.15.137:0/2640413836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b41392f0 con 0x7f30b40d00f0 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b37fe640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30b413cb10 0x7f30b413cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:13.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b3fff640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c003a00 0x7f30b4138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b8bc7640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b40d00f0 0x7f30b40d0570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009fd0 tx=0x7f30ac010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b0ff9640 1 -- 172.21.15.137:0/2640413836 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac010dd0 con 0x7f30b40d00f0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b0ff9640 1 -- 172.21.15.137:0/2640413836 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ac003990 con 0x7f30b40d00f0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b413d5b0 con 0x7f30b40d00f0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30b0ff9640 1 -- 172.21.15.137:0/2640413836 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac003dc0 con 0x7f30b40d00f0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.070+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b413db70 con 0x7f30b40d00f0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.071+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b40d0ab0 con 0x7f30b40d00f0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.072+0000 7f30b0ff9640 1 -- 172.21.15.137:0/2640413836 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30ac01e020 con 0x7f30b40d00f0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.072+0000 7f30b0ff9640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f30a006c8f0 0x7f30a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.072+0000 7f30b0ff9640 1 -- 172.21.15.137:0/2640413836 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f30ac08c160 con 0x7f30b40d00f0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.072+0000 7f30b3fff640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f30a006c8f0 0x7f30a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.073+0000 7f30b3fff640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f30a006c8f0 0x7f30a006edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f30a4032000 tx=0x7f30a402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:13.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.076+0000 7f30b0ff9640 1 -- 172.21.15.137:0/2640413836 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f30ac05a620 con 0x7f30b40d00f0 2024-04-26T22:00:13.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.253+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30b4073cc0 con 0x7f30b40d00f0 2024-04-26T22:00:13.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.254+0000 7f30b0ff9640 1 -- 172.21.15.137:0/2640413836 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16638 (secure 0 0 0) 0x7f30ac059f20 con 0x7f30b40d00f0 2024-04-26T22:00:13.255 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:13.255 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":45,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:00:12.224819+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:00:10.430051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T22:00:11.181890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f30a006c8f0 msgr2=0x7f30a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f30a006c8f0 0x7f30a006edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f30a4032000 tx=0x7f30a402e000 comp rx=0 tx=0).stop 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b40d00f0 msgr2=0x7f30b40d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b40d00f0 0x7f30b40d0570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009fd0 tx=0x7f30ac010590 comp rx=0 tx=0).stop 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 shutdown_connections 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f30a006c8f0 0x7f30a006edb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f30b40d00f0 0x7f30b40d0570 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30b413cb10 0x7f30b413cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 --2- 172.21.15.137:0/2640413836 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f309c003a00 0x7f30b4138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 >> 172.21.15.137:0/2640413836 conn(0x7f30b40d0d30 msgr2=0x7f30b40b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 shutdown_connections 2024-04-26T22:00:13.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.256+0000 7f30ba62a640 1 -- 172.21.15.137:0/2640413836 wait complete. 2024-04-26T22:00:13.268 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:13.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.364+0000 7f6389b5f640 1 Processor -- start 2024-04-26T22:00:13.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.364+0000 7f6389b5f640 1 -- start start 2024-04-26T22:00:13.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.364+0000 7f6389b5f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f63840cf2e0 0x7f638406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.364+0000 7f6389b5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63840d11b0 0x7f638406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.364+0000 7f6389b5f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63840d1740 con 0x7f638406e2c0 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.364+0000 7f6389b5f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f638406e750 con 0x7f63840cf2e0 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.364+0000 7f6389b5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f63840d1a20 con 0x7f63840d11b0 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f6382ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63840d11b0 0x7f638406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f63837fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f63840cf2e0 0x7f638406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f6383fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f638406e2c0 0x7f638415ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:37128/0 (socket says 172.21.15.137:37128) 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f6382ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63840d11b0 0x7f638406dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:33584/0 (socket says 172.21.15.137:33584) 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f6383fff640 1 -- 172.21.15.137:0/3408437903 learned_addr learned my addr 172.21.15.137:0/3408437903 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f63837fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f63840cf2e0 0x7f638406d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:38432/0 (socket says 172.21.15.137:38432) 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f6382ffd640 1 -- 172.21.15.137:0/3408437903 >> v2:172.21.15.170:3300/0 conn(0x7f63840cf2e0 msgr2=0x7f638406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f6382ffd640 1 --2- 172.21.15.137:0/3408437903 >> v2:172.21.15.170:3300/0 conn(0x7f63840cf2e0 0x7f638406d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f6382ffd640 1 -- 172.21.15.137:0/3408437903 >> v1:172.21.15.170:6789/0 conn(0x7f638406e2c0 legacy=0x7f638415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f6382ffd640 1 -- 172.21.15.137:0/3408437903 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63840d1d00 con 0x7f63840d11b0 2024-04-26T22:00:13.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.365+0000 7f63837fe640 1 --2- 172.21.15.137:0/3408437903 >> v2:172.21.15.170:3300/0 conn(0x7f63840cf2e0 0x7f638406d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.366+0000 7f6382ffd640 1 --2- 172.21.15.137:0/3408437903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63840d11b0 0x7f638406dd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63780097a0 tx=0x7f637802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90f7895a12d92242 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.366+0000 7f63827fc640 1 -- 172.21.15.137:0/3408437903 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378037070 con 0x7f63840d11b0 2024-04-26T22:00:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.366+0000 7f63827fc640 1 -- 172.21.15.137:0/3408437903 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6378032440 con 0x7f63840d11b0 2024-04-26T22:00:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.366+0000 7f63827fc640 1 -- 172.21.15.137:0/3408437903 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378032810 con 0x7f63840d11b0 2024-04-26T22:00:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.367+0000 7f6389b5f640 1 -- 172.21.15.137:0/3408437903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63840d11b0 msgr2=0x7f638406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.367+0000 7f6389b5f640 1 --2- 172.21.15.137:0/3408437903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63840d11b0 0x7f638406dd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f63780097a0 tx=0x7f637802a180 comp rx=0 tx=0).stop 2024-04-26T22:00:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.367+0000 7f6389b5f640 1 -- 172.21.15.137:0/3408437903 shutdown_connections 2024-04-26T22:00:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.367+0000 7f6389b5f640 1 --2- 172.21.15.137:0/3408437903 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f63840d11b0 0x7f638406dd80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.367+0000 7f6389b5f640 1 --2- 172.21.15.137:0/3408437903 >> v2:172.21.15.170:3300/0 conn(0x7f63840cf2e0 0x7f638406d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.367+0000 7f6389b5f640 1 -- 172.21.15.137:0/3408437903 >> 172.21.15.137:0/3408437903 conn(0x7f63840b4a60 msgr2=0x7f63840b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:13.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.367+0000 7f6389b5f640 1 -- 172.21.15.137:0/3408437903 shutdown_connections 2024-04-26T22:00:13.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.367+0000 7f6389b5f640 1 -- 172.21.15.137:0/3408437903 wait complete. 2024-04-26T22:00:13.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.368+0000 7f6389b5f640 1 Processor -- start 2024-04-26T22:00:13.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.368+0000 7f6389b5f640 1 -- start start 2024-04-26T22:00:13.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6389b5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f638406e2c0 0x7f63841f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6389b5f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63840cf2e0 0x7f63840b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6389b5f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840d11b0 0x7f63840b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6389b5f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f638406da10 con 0x7f63840cf2e0 2024-04-26T22:00:13.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6389b5f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f63840d22c0 con 0x7f63840d11b0 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6389b5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f63840cf6c0 con 0x7f638406e2c0 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6382ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63840cf2e0 0x7f63840b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6382ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63840cf2e0 0x7f63840b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41058/0 (socket says 172.21.15.137:41058) 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6382ffd640 1 -- 172.21.15.137:0/2839027483 learned_addr learned my addr 172.21.15.137:0/2839027483 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f63837fe640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f638406e2c0 0x7f63841f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6383fff640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840d11b0 0x7f63840b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6382ffd640 1 -- 172.21.15.137:0/2839027483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f638406e2c0 msgr2=0x7f63841f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6382ffd640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f638406e2c0 0x7f63841f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6382ffd640 1 -- 172.21.15.137:0/2839027483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840d11b0 msgr2=0x7f63840b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6382ffd640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840d11b0 0x7f63840b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6382ffd640 1 -- 172.21.15.137:0/2839027483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63840b80e0 con 0x7f63840cf2e0 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.369+0000 7f6382ffd640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63840cf2e0 0x7f63840b7ba0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6378000c00 tx=0x7f63780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.370+0000 7f636bfff640 1 -- 172.21.15.137:0/2839027483 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378037040 con 0x7f63840cf2e0 2024-04-26T22:00:13.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.370+0000 7f636bfff640 1 -- 172.21.15.137:0/2839027483 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6378042070 con 0x7f63840cf2e0 2024-04-26T22:00:13.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.370+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63841f6630 con 0x7f63840cf2e0 2024-04-26T22:00:13.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.370+0000 7f636bfff640 1 -- 172.21.15.137:0/2839027483 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378030920 con 0x7f63840cf2e0 2024-04-26T22:00:13.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.370+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63841f6bf0 con 0x7f63840cf2e0 2024-04-26T22:00:13.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.371+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f638406a290 con 0x7f63840cf2e0 2024-04-26T22:00:13.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.371+0000 7f636bfff640 1 -- 172.21.15.137:0/2839027483 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6378030ac0 con 0x7f63840cf2e0 2024-04-26T22:00:13.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.371+0000 7f636bfff640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f637006c8f0 0x7f637006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.371+0000 7f636bfff640 1 -- 172.21.15.137:0/2839027483 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f63780ac4f0 con 0x7f63840cf2e0 2024-04-26T22:00:13.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.372+0000 7f63837fe640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f637006c8f0 0x7f637006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.372+0000 7f63837fe640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f637006c8f0 0x7f637006edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6374009560 tx=0x7f6374008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:13.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.376+0000 7f636bfff640 1 -- 172.21.15.137:0/2839027483 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f637807a2d0 con 0x7f63840cf2e0 2024-04-26T22:00:13.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.550+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63840b8ef0 con 0x7f63840cf2e0 2024-04-26T22:00:13.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.551+0000 7f636bfff640 1 -- 172.21.15.137:0/2839027483 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16638 (secure 0 0 0) 0x7f637807e5d0 con 0x7f63840cf2e0 2024-04-26T22:00:13.552 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:13.552 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":45,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:00:12.224819+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:00:10.430051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T22:00:11.181890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f637006c8f0 msgr2=0x7f637006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f637006c8f0 0x7f637006edb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6374009560 tx=0x7f6374008040 comp rx=0 tx=0).stop 2024-04-26T22:00:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63840cf2e0 msgr2=0x7f63840b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63840cf2e0 0x7f63840b7ba0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6378000c00 tx=0x7f63780046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 shutdown_connections 2024-04-26T22:00:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f637006c8f0 0x7f637006edb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f63840cf2e0 0x7f63840b7ba0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63840d11b0 0x7f63840b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 --2- 172.21.15.137:0/2839027483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f638406e2c0 0x7f63841f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 >> 172.21.15.137:0/2839027483 conn(0x7f63840b4a60 msgr2=0x7f63840c6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:13.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 shutdown_connections 2024-04-26T22:00:13.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.554+0000 7f6389b5f640 1 -- 172.21.15.137:0/2839027483 wait complete. 2024-04-26T22:00:13.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T22:00:13.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.664+0000 7f8556628640 1 Processor -- start 2024-04-26T22:00:13.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.664+0000 7f8556628640 1 -- start start 2024-04-26T22:00:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f8556628640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f855015b930 0x7f855015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f8556628640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015f4f0 0x7f8550073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f8556628640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855015c530 con 0x7f8550074030 2024-04-26T22:00:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f8556628640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f855015c810 con 0x7f855015b930 2024-04-26T22:00:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f8556628640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f855015caf0 con 0x7f855015f4f0 2024-04-26T22:00:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f854ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f855015b930 0x7f855015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f854ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f855015b930 0x7f855015bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41074/0 (socket says 172.21.15.137:41074) 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f854ffff640 1 -- 172.21.15.137:0/4231189132 learned_addr learned my addr 172.21.15.137:0/4231189132 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f854f7fe640 1 --2- 172.21.15.137:0/4231189132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015f4f0 0x7f8550073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f854ffff640 1 -- 172.21.15.137:0/4231189132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015f4f0 msgr2=0x7f8550073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f854ffff640 1 --2- 172.21.15.137:0/4231189132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015f4f0 0x7f8550073af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f854ffff640 1 -- 172.21.15.137:0/4231189132 >> v1:172.21.15.170:6789/0 conn(0x7f8550074030 legacy=0x7f85500720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f854ffff640 1 -- 172.21.15.137:0/4231189132 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855015cdd0 con 0x7f855015b930 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.665+0000 7f854f7fe640 1 --2- 172.21.15.137:0/4231189132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015f4f0 0x7f8550073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.666+0000 7f854ffff640 1 --2- 172.21.15.137:0/4231189132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f855015b930 0x7f855015bd10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8544009870 tx=0x7f854402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d06463219bd881e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.666+0000 7f854effd640 1 -- 172.21.15.137:0/4231189132 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544037070 con 0x7f855015b930 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.666+0000 7f854effd640 1 -- 172.21.15.137:0/4231189132 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544032440 con 0x7f855015b930 2024-04-26T22:00:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.666+0000 7f854effd640 1 -- 172.21.15.137:0/4231189132 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544032810 con 0x7f855015b930 2024-04-26T22:00:13.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.667+0000 7f8556628640 1 -- 172.21.15.137:0/4231189132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f855015b930 msgr2=0x7f855015bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.667+0000 7f8556628640 1 --2- 172.21.15.137:0/4231189132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f855015b930 0x7f855015bd10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8544009870 tx=0x7f854402a270 comp rx=0 tx=0).stop 2024-04-26T22:00:13.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.667+0000 7f8556628640 1 -- 172.21.15.137:0/4231189132 shutdown_connections 2024-04-26T22:00:13.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.667+0000 7f8556628640 1 --2- 172.21.15.137:0/4231189132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015f4f0 0x7f8550073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.667+0000 7f8556628640 1 --2- 172.21.15.137:0/4231189132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f855015b930 0x7f855015bd10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.667+0000 7f8556628640 1 -- 172.21.15.137:0/4231189132 >> 172.21.15.137:0/4231189132 conn(0x7f85500cd8a0 msgr2=0x7f85500cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:13.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.667+0000 7f8556628640 1 -- 172.21.15.137:0/4231189132 shutdown_connections 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.667+0000 7f8556628640 1 -- 172.21.15.137:0/4231189132 wait complete. 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.668+0000 7f8556628640 1 Processor -- start 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.668+0000 7f8556628640 1 -- start start 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f8556628640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8550074030 0x7f8550150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f8556628640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015b930 0x7f8550148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f8556628640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f855015f4f0 0x7f855014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f8556628640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f855006fdd0 con 0x7f8550074030 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f8556628640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f855015c250 con 0x7f855015f4f0 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f8556628640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f85500d0270 con 0x7f855015b930 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8550074030 0x7f8550150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8550074030 0x7f8550150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41082/0 (socket says 172.21.15.137:41082) 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854ffff640 1 -- 172.21.15.137:0/203288425 learned_addr learned my addr 172.21.15.137:0/203288425 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f8554bc5640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f855015f4f0 0x7f855014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854f7fe640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015b930 0x7f8550148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854ffff640 1 -- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015b930 msgr2=0x7f8550148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854ffff640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015b930 0x7f8550148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854ffff640 1 -- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f855015f4f0 msgr2=0x7f855014a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854ffff640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f855015f4f0 0x7f855014a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854ffff640 1 -- 172.21.15.137:0/203288425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8550148ff0 con 0x7f8550074030 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f8554bc5640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f855015f4f0 0x7f855014a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854f7fe640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015b930 0x7f8550148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.669+0000 7f854ffff640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8550074030 0x7f8550150090 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8544009870 tx=0x7f85440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.670+0000 7f854cff9640 1 -- 172.21.15.137:0/203288425 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544041070 con 0x7f8550074030 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.670+0000 7f854cff9640 1 -- 172.21.15.137:0/203288425 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f854403c890 con 0x7f8550074030 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.670+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85501492d0 con 0x7f8550074030 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.670+0000 7f854cff9640 1 -- 172.21.15.137:0/203288425 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544037040 con 0x7f8550074030 2024-04-26T22:00:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.670+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8550149890 con 0x7f8550074030 2024-04-26T22:00:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.671+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855006a290 con 0x7f8550074030 2024-04-26T22:00:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.671+0000 7f854cff9640 1 -- 172.21.15.137:0/203288425 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8544044070 con 0x7f8550074030 2024-04-26T22:00:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.672+0000 7f854cff9640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f853c06c920 0x7f853c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.672+0000 7f854f7fe640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f853c06c920 0x7f853c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.672+0000 7f854cff9640 1 -- 172.21.15.137:0/203288425 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f85440ac580 con 0x7f8550074030 2024-04-26T22:00:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.672+0000 7f854f7fe640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f853c06c920 0x7f853c06ede0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f855015eba0 tx=0x7f8540008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:13.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.676+0000 7f854cff9640 1 -- 172.21.15.137:0/203288425 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f854407aad0 con 0x7f8550074030 2024-04-26T22:00:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.889+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f855006f700 con 0x7f8550074030 2024-04-26T22:00:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.895+0000 7f854cff9640 1 -- 172.21.15.137:0/203288425 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f854407a3d0 con 0x7f8550074030 2024-04-26T22:00:13.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f853c06c920 msgr2=0x7f853c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f853c06c920 0x7f853c06ede0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f855015eba0 tx=0x7f8540008040 comp rx=0 tx=0).stop 2024-04-26T22:00:13.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8550074030 msgr2=0x7f8550150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:13.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8550074030 0x7f8550150090 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8544009870 tx=0x7f85440046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 shutdown_connections 2024-04-26T22:00:13.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f853c06c920 0x7f853c06ede0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f855015f4f0 0x7f855014a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f855015b930 0x7f8550148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 --2- 172.21.15.137:0/203288425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8550074030 0x7f8550150090 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:13.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 >> 172.21.15.137:0/203288425 conn(0x7f85500cd8a0 msgr2=0x7f85500b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:13.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 shutdown_connections 2024-04-26T22:00:13.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:13.897+0000 7f8556628640 1 -- 172.21.15.137:0/203288425 wait complete. 2024-04-26T22:00:13.908 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T22:00:13.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T22:00:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.007+0000 7fe763bac640 1 Processor -- start 2024-04-26T22:00:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.008+0000 7fe763bac640 1 -- start start 2024-04-26T22:00:14.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.008+0000 7fe763bac640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe75c15d340 0x7fe75c09c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:14.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.008+0000 7fe763bac640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe75c0d1940 0x7fe75c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:14.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.008+0000 7fe763bac640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75c0cee60 con 0x7fe75c0b2420 2024-04-26T22:00:14.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.008+0000 7fe763bac640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe75c0ce9d0 con 0x7fe75c0d1940 2024-04-26T22:00:14.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.008+0000 7fe763bac640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe75c0d0ff0 con 0x7fe75c15d340 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe762149640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe75c0d1940 0x7fe75c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe761147640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe75c0b2420 0x7fe75c0d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54494/0 (socket says 172.21.15.137:54494) 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe762149640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe75c0d1940 0x7fe75c0702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41098/0 (socket says 172.21.15.137:41098) 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe761147640 1 -- 172.21.15.137:0/2191138530 learned_addr learned my addr 172.21.15.137:0/2191138530 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe762149640 1 -- 172.21.15.137:0/2191138530 >> v2:172.21.15.170:3300/0 conn(0x7fe75c15d340 msgr2=0x7fe75c09c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe761948640 1 --2- 172.21.15.137:0/2191138530 >> v2:172.21.15.170:3300/0 conn(0x7fe75c15d340 0x7fe75c09c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe760946640 1 -- 172.21.15.137:0/2191138530 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212198048 0 0) 0x7fe75c0cee60 con 0x7fe75c0b2420 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe762149640 1 --2- 172.21.15.137:0/2191138530 >> v2:172.21.15.170:3300/0 conn(0x7fe75c15d340 0x7fe75c09c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe762149640 1 -- 172.21.15.137:0/2191138530 >> v1:172.21.15.137:6789/0 conn(0x7fe75c0b2420 legacy=0x7fe75c0d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe762149640 1 -- 172.21.15.137:0/2191138530 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c0d0d10 con 0x7fe75c0d1940 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.009+0000 7fe761948640 1 --2- 172.21.15.137:0/2191138530 >> v2:172.21.15.170:3300/0 conn(0x7fe75c15d340 0x7fe75c09c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:14.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe762149640 1 --2- 172.21.15.137:0/2191138530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c0d1940 0x7fe75c0702a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe75c072ee0 tx=0x7fe75402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2411018b230c47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe760946640 1 -- 172.21.15.137:0/2191138530 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754007740 con 0x7fe75c0d1940 2024-04-26T22:00:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe760946640 1 -- 172.21.15.137:0/2191138530 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7540078e0 con 0x7fe75c0d1940 2024-04-26T22:00:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe760946640 1 -- 172.21.15.137:0/2191138530 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754007cb0 con 0x7fe75c0d1940 2024-04-26T22:00:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe763bac640 1 -- 172.21.15.137:0/2191138530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c0d1940 msgr2=0x7fe75c0702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe763bac640 1 --2- 172.21.15.137:0/2191138530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c0d1940 0x7fe75c0702a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe75c072ee0 tx=0x7fe75402a680 comp rx=0 tx=0).stop 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe763bac640 1 -- 172.21.15.137:0/2191138530 shutdown_connections 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe763bac640 1 --2- 172.21.15.137:0/2191138530 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c0d1940 0x7fe75c0702a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe763bac640 1 --2- 172.21.15.137:0/2191138530 >> v2:172.21.15.170:3300/0 conn(0x7fe75c15d340 0x7fe75c09c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe763bac640 1 -- 172.21.15.137:0/2191138530 >> 172.21.15.137:0/2191138530 conn(0x7fe75c09ba40 msgr2=0x7fe75c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe763bac640 1 -- 172.21.15.137:0/2191138530 shutdown_connections 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.010+0000 7fe763bac640 1 -- 172.21.15.137:0/2191138530 wait complete. 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.011+0000 7fe763bac640 1 Processor -- start 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.011+0000 7fe763bac640 1 -- start start 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe763bac640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe75c0d1940 0x7fe75c09f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe763bac640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c15d340 0x7fe75c1e6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe763bac640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c09d0a0 0x7fe75c1e5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe763bac640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c0b2090 con 0x7fe75c15d340 2024-04-26T22:00:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe763bac640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c15d720 con 0x7fe75c09d0a0 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe763bac640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c0b2210 con 0x7fe75c0d1940 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe761147640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c15d340 0x7fe75c1e6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe761147640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c15d340 0x7fe75c1e6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41104/0 (socket says 172.21.15.137:41104) 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe761147640 1 -- 172.21.15.137:0/3008559192 learned_addr learned my addr 172.21.15.137:0/3008559192 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe761147640 1 -- 172.21.15.137:0/3008559192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe75c0d1940 msgr2=0x7fe75c09f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe761147640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe75c0d1940 0x7fe75c09f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe761147640 1 -- 172.21.15.137:0/3008559192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c09d0a0 msgr2=0x7fe75c1e5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe761147640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c09d0a0 0x7fe75c1e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.012+0000 7fe761147640 1 -- 172.21.15.137:0/3008559192 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c1e7510 con 0x7fe75c15d340 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.013+0000 7fe761147640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c15d340 0x7fe75c1e6fd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c4d0 tx=0x7fe74c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.013+0000 7fe7527fc640 1 -- 172.21.15.137:0/3008559192 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c018070 con 0x7fe75c15d340 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.013+0000 7fe7527fc640 1 -- 172.21.15.137:0/3008559192 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c007500 con 0x7fe75c15d340 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.013+0000 7fe7527fc640 1 -- 172.21.15.137:0/3008559192 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c004a20 con 0x7fe75c15d340 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.013+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75c09ff60 con 0x7fe75c15d340 2024-04-26T22:00:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.013+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe75c0a0520 con 0x7fe75c15d340 2024-04-26T22:00:14.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.014+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe75c0693d0 con 0x7fe75c15d340 2024-04-26T22:00:14.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.014+0000 7fe7527fc640 1 -- 172.21.15.137:0/3008559192 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe74c01b070 con 0x7fe75c15d340 2024-04-26T22:00:14.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.014+0000 7fe7527fc640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe74006c920 0x7fe74006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:14.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.015+0000 7fe7527fc640 1 -- 172.21.15.137:0/3008559192 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe74c08adc0 con 0x7fe75c15d340 2024-04-26T22:00:14.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.015+0000 7fe761948640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe74006c920 0x7fe74006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:14.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.015+0000 7fe761948640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe74006c920 0x7fe74006ede0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe758006fd0 tx=0x7fe758008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:14.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.019+0000 7fe7527fc640 1 -- 172.21.15.137:0/3008559192 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe74c059280 con 0x7fe75c15d340 2024-04-26T22:00:14.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.231+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe75c0b8e60 con 0x7fe75c15d340 2024-04-26T22:00:14.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.899+0000 7fe7527fc640 1 -- 172.21.15.137:0/3008559192 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7fe74c058b80 con 0x7fe75c15d340 2024-04-26T22:00:14.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe74006c920 msgr2=0x7fe74006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:14.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe74006c920 0x7fe74006ede0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe758006fd0 tx=0x7fe758008040 comp rx=0 tx=0).stop 2024-04-26T22:00:14.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c15d340 msgr2=0x7fe75c1e6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:14.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c15d340 0x7fe75c1e6fd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c4d0 tx=0x7fe74c00c990 comp rx=0 tx=0).stop 2024-04-26T22:00:14.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 shutdown_connections 2024-04-26T22:00:14.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe74006c920 0x7fe74006ede0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:14.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe75c15d340 0x7fe75c1e6fd0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:14.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe75c09d0a0 0x7fe75c1e5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:14.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 --2- 172.21.15.137:0/3008559192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe75c0d1940 0x7fe75c09f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:14.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 >> 172.21.15.137:0/3008559192 conn(0x7fe75c09ba40 msgr2=0x7fe75c0b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:14.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 shutdown_connections 2024-04-26T22:00:14.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:14.902+0000 7fe763bac640 1 -- 172.21.15.137:0/3008559192 wait complete. 2024-04-26T22:00:14.914 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T22:00:14.914 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:15.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.012+0000 7f7153540640 1 Processor -- start 2024-04-26T22:00:15.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.013+0000 7f7153540640 1 -- start start 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.013+0000 7f7153540640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f714c15f750 0x7f714c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.013+0000 7f7153540640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f714c0d03a0 con 0x7f714c0d3ee0 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.013+0000 7f7153540640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f714c0d0680 con 0x7f714c15f370 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.013+0000 7f7153540640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f714c0d0960 con 0x7f714c15f750 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.014+0000 7f7151add640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f714c15f750 0x7f714c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.014+0000 7f7150adb640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f714c0d3ee0 0x7f714c0b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54506/0 (socket says 172.21.15.137:54506) 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.014+0000 7f7150adb640 1 -- 172.21.15.137:0/415220333 learned_addr learned my addr 172.21.15.137:0/415220333 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.014+0000 7f7151add640 1 -- 172.21.15.137:0/415220333 >> v1:172.21.15.170:6789/0 conn(0x7f714c15f370 legacy=0x7f714c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.014+0000 7f7151add640 1 -- 172.21.15.137:0/415220333 >> v1:172.21.15.137:6789/0 conn(0x7f714c0d3ee0 legacy=0x7f714c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.014+0000 7f7151add640 1 -- 172.21.15.137:0/415220333 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c0d0c40 con 0x7f714c15f750 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f7151add640 1 --2- 172.21.15.137:0/415220333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c15f750 0x7f714c0cfd70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7144009d90 tx=0x7f714402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1b9e6bcc10e4fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f713ffff640 1 -- 172.21.15.137:0/415220333 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144007740 con 0x7f714c15f750 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f713ffff640 1 -- 172.21.15.137:0/415220333 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71440078e0 con 0x7f714c15f750 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f713ffff640 1 -- 172.21.15.137:0/415220333 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144007cb0 con 0x7f714c15f750 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f7153540640 1 -- 172.21.15.137:0/415220333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c15f750 msgr2=0x7f714c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f7153540640 1 --2- 172.21.15.137:0/415220333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c15f750 0x7f714c0cfd70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7144009d90 tx=0x7f714402a6a0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f7153540640 1 -- 172.21.15.137:0/415220333 shutdown_connections 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f7153540640 1 --2- 172.21.15.137:0/415220333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c15f750 0x7f714c0cfd70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f7153540640 1 -- 172.21.15.137:0/415220333 >> 172.21.15.137:0/415220333 conn(0x7f714c08ec10 msgr2=0x7f714c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f7153540640 1 -- 172.21.15.137:0/415220333 shutdown_connections 2024-04-26T22:00:15.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.015+0000 7f7153540640 1 -- 172.21.15.137:0/415220333 wait complete. 2024-04-26T22:00:15.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.016+0000 7f7153540640 1 Processor -- start 2024-04-26T22:00:15.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.016+0000 7f7153540640 1 -- start start 2024-04-26T22:00:15.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f7153540640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c0d3ee0 0x7f714c1f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f7153540640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c15f370 0x7f714c0c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f7153540640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f714c15f750 0x7f714c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f7153540640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f714c0b4950 con 0x7f714c0d3ee0 2024-04-26T22:00:15.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f7153540640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f714c0b47d0 con 0x7f714c15f370 2024-04-26T22:00:15.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f7153540640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f714c0b4ad0 con 0x7f714c15f750 2024-04-26T22:00:15.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f71512dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c0d3ee0 0x7f714c1f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f71512dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c0d3ee0 0x7f714c1f4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41128/0 (socket says 172.21.15.137:41128) 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f71512dc640 1 -- 172.21.15.137:0/2023661386 learned_addr learned my addr 172.21.15.137:0/2023661386 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.017+0000 7f7150adb640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c15f370 0x7f714c0c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f71512dc640 1 -- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f714c15f750 msgr2=0x7f714c06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f7151add640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f714c15f750 0x7f714c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f71512dc640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f714c15f750 0x7f714c06d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f71512dc640 1 -- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c15f370 msgr2=0x7f714c0c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f71512dc640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c15f370 0x7f714c0c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f71512dc640 1 -- 172.21.15.137:0/2023661386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c0c9750 con 0x7f714c0d3ee0 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f7150adb640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c15f370 0x7f714c0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f7151add640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f714c15f750 0x7f714c06d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f71512dc640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c0d3ee0 0x7f714c1f4530 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f714000c430 tx=0x7f714000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f713dffb640 1 -- 172.21.15.137:0/2023661386 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140011790 con 0x7f714c0d3ee0 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f713dffb640 1 -- 172.21.15.137:0/2023661386 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7140017070 con 0x7f714c0d3ee0 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f713dffb640 1 -- 172.21.15.137:0/2023661386 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140011bb0 con 0x7f714c0d3ee0 2024-04-26T22:00:15.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c15fd70 con 0x7f714c0d3ee0 2024-04-26T22:00:15.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.018+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c160330 con 0x7f714c0d3ee0 2024-04-26T22:00:15.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.019+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714c160530 con 0x7f714c0d3ee0 2024-04-26T22:00:15.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.019+0000 7f713dffb640 1 -- 172.21.15.137:0/2023661386 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f714001c460 con 0x7f714c0d3ee0 2024-04-26T22:00:15.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.020+0000 7f713dffb640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f713006c8f0 0x7f713006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.020+0000 7f713dffb640 1 -- 172.21.15.137:0/2023661386 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f714008b960 con 0x7f714c0d3ee0 2024-04-26T22:00:15.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.020+0000 7f7150adb640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f713006c8f0 0x7f713006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.020+0000 7f7150adb640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f713006c8f0 0x7f713006edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f714c0c8bb0 tx=0x7f7148009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.024+0000 7f713dffb640 1 -- 172.21.15.137:0/2023661386 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f714c160530 con 0x7f714c0d3ee0 2024-04-26T22:00:15.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.234+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f714c06a290 con 0x7f714c0d3ee0 2024-04-26T22:00:15.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.235+0000 7f713dffb640 1 -- 172.21.15.137:0/2023661386 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7f7140059e20 con 0x7f714c0d3ee0 2024-04-26T22:00:15.235 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:15.235 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1453946915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1453946915},{"type":"v1","addr":"172.21.15.170:6835","nonce":1453946915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3097952323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3097952323},{"type":"v1","addr":"172.21.15.170:6834","nonce":3097952323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3002187785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3002187785},{"type":"v1","addr":"172.21.15.137:6835","nonce":3002187785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:00:12.224783+0000","modified":"2024-04-26T22:00:14.233247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5592":{"gid":5592,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/924509332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":924509332},{"type":"v1","addr":"172.21.15.137:6837","nonce":924509332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5592,"qdb_cluster":[5592]},"id":3}]} 2024-04-26T22:00:15.236 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 20 2024-04-26T22:00:15.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f713006c8f0 msgr2=0x7f713006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f713006c8f0 0x7f713006edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f714c0c8bb0 tx=0x7f7148009040 comp rx=0 tx=0).stop 2024-04-26T22:00:15.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c0d3ee0 msgr2=0x7f714c1f4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c0d3ee0 0x7f714c1f4530 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f714000c430 tx=0x7f714000c8f0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 shutdown_connections 2024-04-26T22:00:15.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f713006c8f0 0x7f713006edb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f714c15f750 0x7f714c06d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f714c15f370 0x7f714c0c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 --2- 172.21.15.137:0/2023661386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f714c0d3ee0 0x7f714c1f4530 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 >> 172.21.15.137:0/2023661386 conn(0x7f714c08ec10 msgr2=0x7f714c0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:15.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 shutdown_connections 2024-04-26T22:00:15.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.237+0000 7f7153540640 1 -- 172.21.15.137:0/2023661386 wait complete. 2024-04-26T22:00:15.248 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:15.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.345+0000 7ff0926ea640 1 Processor -- start 2024-04-26T22:00:15.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.345+0000 7ff0926ea640 1 -- start start 2024-04-26T22:00:15.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff0926ea640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff08c0d5610 0x7ff08c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff0926ea640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08c0b2510 con 0x7ff08c15f720 2024-04-26T22:00:15.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff0926ea640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08c0b27f0 con 0x7ff08c15f340 2024-04-26T22:00:15.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff0926ea640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff08c0b2ad0 con 0x7ff08c0d5610 2024-04-26T22:00:15.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff090c87640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff08c0d5610 0x7ff08c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff08b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff08c15f720 0x7ff08c0b35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:54516/0 (socket says 172.21.15.137:54516) 2024-04-26T22:00:15.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff08b7fe640 1 -- 172.21.15.137:0/695804320 learned_addr learned my addr 172.21.15.137:0/695804320 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:15.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff090c87640 1 -- 172.21.15.137:0/695804320 >> v1:172.21.15.170:6789/0 conn(0x7ff08c15f340 legacy=0x7ff08c0d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:15.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff090c87640 1 -- 172.21.15.137:0/695804320 >> v1:172.21.15.137:6789/0 conn(0x7ff08c15f720 legacy=0x7ff08c0b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff090c87640 1 -- 172.21.15.137:0/695804320 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c0b2db0 con 0x7ff08c0d5610 2024-04-26T22:00:15.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.346+0000 7ff08affd640 1 -- 172.21.15.137:0/695804320 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524885838 0 0) 0x7ff08c0b2510 con 0x7ff08c15f720 2024-04-26T22:00:15.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.347+0000 7ff090c87640 1 --2- 172.21.15.137:0/695804320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0d5610 0x7ff08c0b1e80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff084009d90 tx=0x7ff08402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbe2ab4d4d66936 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.347+0000 7ff08affd640 1 -- 172.21.15.137:0/695804320 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084031600 con 0x7ff08c0d5610 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.347+0000 7ff08affd640 1 -- 172.21.15.137:0/695804320 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0840317a0 con 0x7ff08c0d5610 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.347+0000 7ff08affd640 1 -- 172.21.15.137:0/695804320 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084031b70 con 0x7ff08c0d5610 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.347+0000 7ff0926ea640 1 -- 172.21.15.137:0/695804320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0d5610 msgr2=0x7ff08c0b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.347+0000 7ff0926ea640 1 --2- 172.21.15.137:0/695804320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0d5610 0x7ff08c0b1e80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff084009d90 tx=0x7ff08402a610 comp rx=0 tx=0).stop 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.347+0000 7ff0926ea640 1 -- 172.21.15.137:0/695804320 shutdown_connections 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.347+0000 7ff0926ea640 1 --2- 172.21.15.137:0/695804320 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c0d5610 0x7ff08c0b1e80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.347+0000 7ff0926ea640 1 -- 172.21.15.137:0/695804320 >> 172.21.15.137:0/695804320 conn(0x7ff08c08ec70 msgr2=0x7ff08c09e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.348+0000 7ff0926ea640 1 -- 172.21.15.137:0/695804320 shutdown_connections 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.348+0000 7ff0926ea640 1 -- 172.21.15.137:0/695804320 wait complete. 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.349+0000 7ff0926ea640 1 Processor -- start 2024-04-26T22:00:15.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.349+0000 7ff0926ea640 1 -- start start 2024-04-26T22:00:15.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.349+0000 7ff0926ea640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0d5610 0x7ff08c1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.349+0000 7ff0926ea640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15f340 0x7ff08c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.349+0000 7ff0926ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c15f720 0x7ff08c0d0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.349+0000 7ff0926ea640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c0d40d0 con 0x7ff08c15f720 2024-04-26T22:00:15.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.349+0000 7ff0926ea640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c0d3f50 con 0x7ff08c15f340 2024-04-26T22:00:15.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.349+0000 7ff0926ea640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff08c0b3cc0 con 0x7ff08c0d5610 2024-04-26T22:00:15.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff090c87640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c15f720 0x7ff08c0d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff090c87640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c15f720 0x7ff08c0d0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41154/0 (socket says 172.21.15.137:41154) 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff090c87640 1 -- 172.21.15.137:0/1856851963 learned_addr learned my addr 172.21.15.137:0/1856851963 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff08b7fe640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15f340 0x7ff08c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff08bfff640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0d5610 0x7ff08c1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff090c87640 1 -- 172.21.15.137:0/1856851963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0d5610 msgr2=0x7ff08c1590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff090c87640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0d5610 0x7ff08c1590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff090c87640 1 -- 172.21.15.137:0/1856851963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15f340 msgr2=0x7ff08c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff090c87640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15f340 0x7ff08c0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff090c87640 1 -- 172.21.15.137:0/1856851963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c0b8430 con 0x7ff08c15f720 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff090c87640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c15f720 0x7ff08c0d0590 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff084009eb0 tx=0x7ff084004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff088ff9640 1 -- 172.21.15.137:0/1856851963 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084040070 con 0x7ff08c15f720 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff088ff9640 1 -- 172.21.15.137:0/1856851963 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff084030be0 con 0x7ff08c15f720 2024-04-26T22:00:15.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff088ff9640 1 -- 172.21.15.137:0/1856851963 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084009450 con 0x7ff08c15f720 2024-04-26T22:00:15.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08c0b8710 con 0x7ff08c15f720 2024-04-26T22:00:15.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.350+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08c0b8cd0 con 0x7ff08c15f720 2024-04-26T22:00:15.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.351+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08c06a290 con 0x7ff08c15f720 2024-04-26T22:00:15.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.352+0000 7ff088ff9640 1 -- 172.21.15.137:0/1856851963 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff084039040 con 0x7ff08c15f720 2024-04-26T22:00:15.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.352+0000 7ff088ff9640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07806c8f0 0x7ff07806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.352+0000 7ff088ff9640 1 -- 172.21.15.137:0/1856851963 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7ff0840ac950 con 0x7ff08c15f720 2024-04-26T22:00:15.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.352+0000 7ff08bfff640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07806c8f0 0x7ff07806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.353+0000 7ff08bfff640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07806c8f0 0x7ff07806edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0d1310 tx=0x7ff07c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.357+0000 7ff088ff9640 1 -- 172.21.15.137:0/1856851963 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff08407ad90 con 0x7ff08c15f720 2024-04-26T22:00:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.532+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff08c0b49f0 con 0x7ff08c15f720 2024-04-26T22:00:15.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.533+0000 7ff088ff9640 1 -- 172.21.15.137:0/1856851963 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16625 (secure 0 0 0) 0x7ff08407a690 con 0x7ff08c15f720 2024-04-26T22:00:15.533 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:15.534 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":46,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:00:13.891258+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:00:10.430051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T22:00:11.181890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:15.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07806c8f0 msgr2=0x7ff07806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07806c8f0 0x7ff07806edb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0d1310 tx=0x7ff07c009040 comp rx=0 tx=0).stop 2024-04-26T22:00:15.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c15f720 msgr2=0x7ff08c0d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c15f720 0x7ff08c0d0590 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff084009eb0 tx=0x7ff084004a40 comp rx=0 tx=0).stop 2024-04-26T22:00:15.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 shutdown_connections 2024-04-26T22:00:15.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff07806c8f0 0x7ff07806edb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff08c15f720 0x7ff08c0d0590 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff08c15f340 0x7ff08c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 --2- 172.21.15.137:0/1856851963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff08c0d5610 0x7ff08c1590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 >> 172.21.15.137:0/1856851963 conn(0x7ff08c08ec70 msgr2=0x7ff08c0b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:15.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 shutdown_connections 2024-04-26T22:00:15.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.535+0000 7ff0926ea640 1 -- 172.21.15.137:0/1856851963 wait complete. 2024-04-26T22:00:15.546 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T22:00:15.546 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:00:15.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.643+0000 7fb28eca9640 1 Processor -- start 2024-04-26T22:00:15.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.643+0000 7fb28eca9640 1 -- start start 2024-04-26T22:00:15.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb28eca9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb2880b4200 0x7fb288073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb28eca9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb288163950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb28eca9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2880aed00 con 0x7fb288145970 2024-04-26T22:00:15.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb28eca9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb288145d50 con 0x7fb2880b4200 2024-04-26T22:00:15.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb28eca9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb2880cfaf0 con 0x7fb2880ae8b0 2024-04-26T22:00:15.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb287fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb2880b4200 0x7fb288073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb287fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb2880b4200 0x7fb288073ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38072/0 (socket says 172.21.15.137:38072) 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb287fff640 1 -- 172.21.15.137:0/3723025410 learned_addr learned my addr 172.21.15.137:0/3723025410 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb28d246640 1 --2- 172.21.15.137:0/3723025410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb288163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb287fff640 1 -- 172.21.15.137:0/3723025410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 msgr2=0x7fb288163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb287fff640 1 --2- 172.21.15.137:0/3723025410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb288163950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb287fff640 1 -- 172.21.15.137:0/3723025410 >> v1:172.21.15.170:6789/0 conn(0x7fb288145970 legacy=0x7fb2880b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb287fff640 1 -- 172.21.15.137:0/3723025410 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2880cfdd0 con 0x7fb2880b4200 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.644+0000 7fb28d246640 1 --2- 172.21.15.137:0/3723025410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb288163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.645+0000 7fb287fff640 1 --2- 172.21.15.137:0/3723025410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 0x7fb288073ef0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009870 tx=0x7fb27c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc74b0743024de1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.645+0000 7fb2877fe640 1 -- 172.21.15.137:0/3723025410 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c037070 con 0x7fb2880b4200 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.645+0000 7fb2877fe640 1 -- 172.21.15.137:0/3723025410 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c032440 con 0x7fb2880b4200 2024-04-26T22:00:15.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.645+0000 7fb2877fe640 1 -- 172.21.15.137:0/3723025410 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c032810 con 0x7fb2880b4200 2024-04-26T22:00:15.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.646+0000 7fb28eca9640 1 -- 172.21.15.137:0/3723025410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 msgr2=0x7fb288073ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.646+0000 7fb28eca9640 1 --2- 172.21.15.137:0/3723025410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 0x7fb288073ef0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb27c009870 tx=0x7fb27c02a270 comp rx=0 tx=0).stop 2024-04-26T22:00:15.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.646+0000 7fb28eca9640 1 -- 172.21.15.137:0/3723025410 shutdown_connections 2024-04-26T22:00:15.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.646+0000 7fb28eca9640 1 --2- 172.21.15.137:0/3723025410 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb288163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.646+0000 7fb28eca9640 1 --2- 172.21.15.137:0/3723025410 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 0x7fb288073ef0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.646+0000 7fb28eca9640 1 -- 172.21.15.137:0/3723025410 >> 172.21.15.137:0/3723025410 conn(0x7fb2880ce8b0 msgr2=0x7fb2880cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:15.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.646+0000 7fb28eca9640 1 -- 172.21.15.137:0/3723025410 shutdown_connections 2024-04-26T22:00:15.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.646+0000 7fb28eca9640 1 -- 172.21.15.137:0/3723025410 wait complete. 2024-04-26T22:00:15.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.647+0000 7fb28eca9640 1 Processor -- start 2024-04-26T22:00:15.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.647+0000 7fb28eca9640 1 -- start start 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28eca9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb2880d2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28eca9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 0x7fb288160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28eca9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb288145970 0x7fb2881613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28eca9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb28806f8f0 con 0x7fb2880b4200 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28eca9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb28806f3d0 con 0x7fb288145970 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28eca9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb28806fa70 con 0x7fb2880ae8b0 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb287fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 0x7fb288160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb287fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 0x7fb288160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38082/0 (socket says 172.21.15.137:38082) 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb287fff640 1 -- 172.21.15.137:0/4245001488 learned_addr learned my addr 172.21.15.137:0/4245001488 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb287fff640 1 -- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 msgr2=0x7fb2880d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28ca45640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb2880d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28d246640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb288145970 0x7fb2881613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb287fff640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb2880d2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb287fff640 1 -- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb288145970 msgr2=0x7fb2881613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb287fff640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb288145970 0x7fb2881613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb287fff640 1 -- 172.21.15.137:0/4245001488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2880b76d0 con 0x7fb2880b4200 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28ca45640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb2880d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.648+0000 7fb28d246640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb288145970 0x7fb2881613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.649+0000 7fb287fff640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 0x7fb288160e60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb27c000c00 tx=0x7fb27c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.649+0000 7fb2857fa640 1 -- 172.21.15.137:0/4245001488 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c041020 con 0x7fb2880b4200 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.649+0000 7fb2857fa640 1 -- 172.21.15.137:0/4245001488 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c0306c0 con 0x7fb2880b4200 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.649+0000 7fb2857fa640 1 -- 172.21.15.137:0/4245001488 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c037040 con 0x7fb2880b4200 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.649+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2881f8820 con 0x7fb2880b4200 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.649+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb288161a30 con 0x7fb2880b4200 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.650+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28806a290 con 0x7fb2880b4200 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.650+0000 7fb2857fa640 1 -- 172.21.15.137:0/4245001488 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb27c044020 con 0x7fb2880b4200 2024-04-26T22:00:15.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.651+0000 7fb2857fa640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb27406c8f0 0x7fb27406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.651+0000 7fb28ca45640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb27406c8f0 0x7fb27406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.651+0000 7fb2857fa640 1 -- 172.21.15.137:0/4245001488 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb27c0ac360 con 0x7fb2880b4200 2024-04-26T22:00:15.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.651+0000 7fb28ca45640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb27406c8f0 0x7fb27406edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb2780015e0 tx=0x7fb278009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.655+0000 7fb2857fa640 1 -- 172.21.15.137:0/4245001488 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb27c04b030 con 0x7fb2880b4200 2024-04-26T22:00:15.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.827+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb288073980 con 0x7fb27406c8f0 2024-04-26T22:00:15.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.833+0000 7fb2857fa640 1 -- 172.21.15.137:0/4245001488 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7fb288073980 con 0x7fb27406c8f0 2024-04-26T22:00:15.836 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:15.838 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:00:15.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.836+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb27406c8f0 msgr2=0x7fb27406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.836+0000 7fb28eca9640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb27406c8f0 0x7fb27406edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb2780015e0 tx=0x7fb278009040 comp rx=0 tx=0).stop 2024-04-26T22:00:15.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.836+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 msgr2=0x7fb288160e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.836+0000 7fb28eca9640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 0x7fb288160e60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb27c000c00 tx=0x7fb27c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.837+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 shutdown_connections 2024-04-26T22:00:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.837+0000 7fb28eca9640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb27406c8f0 0x7fb27406edb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.837+0000 7fb28eca9640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2880b4200 0x7fb288160e60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.837+0000 7fb28eca9640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb288145970 0x7fb2881613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.837+0000 7fb28eca9640 1 --2- 172.21.15.137:0/4245001488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2880ae8b0 0x7fb2880d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.837+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 >> 172.21.15.137:0/4245001488 conn(0x7fb2880ce8b0 msgr2=0x7fb2880b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.837+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 shutdown_connections 2024-04-26T22:00:15.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.837+0000 7fb28eca9640 1 -- 172.21.15.137:0/4245001488 wait complete. 2024-04-26T22:00:15.847 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-26T22:00:14.711652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237992,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736728,"statfs":{"total":773094113280,"available":772850409472,"internally_reserved":0,"allocated":5316608,"data_stored":2834424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000820"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.871194+0000","last_change":"2024-04-26T22:00:11.871194+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.871194+0000","last_undegraded":"2024-04-26T22:00:11.871194+0000","last_fullsized":"2024-04-26T22:00:11.871194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874539+0000","last_change":"2024-04-26T22:00:11.874539+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874539+0000","last_undegraded":"2024-04-26T22:00:11.874539+0000","last_fullsized":"2024-04-26T22:00:11.874539+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872529+0000","last_change":"2024-04-26T22:00:11.872529+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872529+0000","last_undegraded":"2024-04-26T22:00:11.872529+0000","last_fullsized":"2024-04-26T22:00:11.872529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880788+0000","last_change":"2024-04-26T22:00:11.880788+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880788+0000","last_undegraded":"2024-04-26T22:00:11.880788+0000","last_fullsized":"2024-04-26T22:00:11.880788+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874852+0000","last_change":"2024-04-26T22:00:11.874852+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874852+0000","last_undegraded":"2024-04-26T22:00:11.874852+0000","last_fullsized":"2024-04-26T22:00:11.874852+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873945+0000","last_change":"2024-04-26T22:00:11.873945+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873945+0000","last_undegraded":"2024-04-26T22:00:11.873945+0000","last_fullsized":"2024-04-26T22:00:11.873945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870799+0000","last_change":"2024-04-26T22:00:11.870799+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870799+0000","last_undegraded":"2024-04-26T22:00:11.870799+0000","last_fullsized":"2024-04-26T22:00:11.870799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880282+0000","last_change":"2024-04-26T22:00:11.880282+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880282+0000","last_undegraded":"2024-04-26T22:00:11.880282+0000","last_fullsized":"2024-04-26T22:00:11.880282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874589+0000","last_change":"2024-04-26T22:00:11.874589+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874589+0000","last_undegraded":"2024-04-26T22:00:11.874589+0000","last_fullsized":"2024-04-26T22:00:11.874589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875477+0000","last_change":"2024-04-26T22:00:11.875477+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875477+0000","last_undegraded":"2024-04-26T22:00:11.875477+0000","last_fullsized":"2024-04-26T22:00:11.875477+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875140+0000","last_change":"2024-04-26T22:00:11.875140+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875140+0000","last_undegraded":"2024-04-26T22:00:11.875140+0000","last_fullsized":"2024-04-26T22:00:11.875140+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876023+0000","last_change":"2024-04-26T22:00:11.876023+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876023+0000","last_undegraded":"2024-04-26T22:00:11.876023+0000","last_fullsized":"2024-04-26T22:00:11.876023+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872908+0000","last_change":"2024-04-26T22:00:11.872908+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872908+0000","last_undegraded":"2024-04-26T22:00:11.872908+0000","last_fullsized":"2024-04-26T22:00:11.872908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875038+0000","last_change":"2024-04-26T22:00:11.875038+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875038+0000","last_undegraded":"2024-04-26T22:00:11.875038+0000","last_fullsized":"2024-04-26T22:00:11.875038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874069+0000","last_change":"2024-04-26T22:00:11.874069+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874069+0000","last_undegraded":"2024-04-26T22:00:11.874069+0000","last_fullsized":"2024-04-26T22:00:11.874069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879074+0000","last_change":"2024-04-26T22:00:11.879074+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879074+0000","last_undegraded":"2024-04-26T22:00:11.879074+0000","last_fullsized":"2024-04-26T22:00:11.879074+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873144+0000","last_change":"2024-04-26T22:00:11.873144+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873144+0000","last_undegraded":"2024-04-26T22:00:11.873144+0000","last_fullsized":"2024-04-26T22:00:11.873144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873220+0000","last_change":"2024-04-26T22:00:11.873220+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873220+0000","last_undegraded":"2024-04-26T22:00:11.873220+0000","last_fullsized":"2024-04-26T22:00:11.873220+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876590+0000","last_change":"2024-04-26T22:00:11.876590+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876590+0000","last_undegraded":"2024-04-26T22:00:11.876590+0000","last_fullsized":"2024-04-26T22:00:11.876590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875133+0000","last_change":"2024-04-26T22:00:11.875133+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875133+0000","last_undegraded":"2024-04-26T22:00:11.875133+0000","last_fullsized":"2024-04-26T22:00:11.875133+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879213+0000","last_change":"2024-04-26T22:00:11.879213+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879213+0000","last_undegraded":"2024-04-26T22:00:11.879213+0000","last_fullsized":"2024-04-26T22:00:11.879213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874569+0000","last_change":"2024-04-26T22:00:11.874569+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874569+0000","last_undegraded":"2024-04-26T22:00:11.874569+0000","last_fullsized":"2024-04-26T22:00:11.874569+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879112+0000","last_change":"2024-04-26T22:00:11.879112+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879112+0000","last_undegraded":"2024-04-26T22:00:11.879112+0000","last_fullsized":"2024-04-26T22:00:11.879112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875399+0000","last_change":"2024-04-26T22:00:11.875399+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875399+0000","last_undegraded":"2024-04-26T22:00:11.875399+0000","last_fullsized":"2024-04-26T22:00:11.875399+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.881178+0000","last_change":"2024-04-26T22:00:11.881178+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.881178+0000","last_undegraded":"2024-04-26T22:00:11.881178+0000","last_fullsized":"2024-04-26T22:00:11.881178+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873493+0000","last_change":"2024-04-26T22:00:11.873493+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873493+0000","last_undegraded":"2024-04-26T22:00:11.873493+0000","last_fullsized":"2024-04-26T22:00:11.873493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870587+0000","last_change":"2024-04-26T22:00:11.870587+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870587+0000","last_undegraded":"2024-04-26T22:00:11.870587+0000","last_fullsized":"2024-04-26T22:00:11.870587+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875613+0000","last_change":"2024-04-26T22:00:11.875613+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875613+0000","last_undegraded":"2024-04-26T22:00:11.875613+0000","last_fullsized":"2024-04-26T22:00:11.875613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.878613+0000","last_change":"2024-04-26T22:00:11.878613+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.878613+0000","last_undegraded":"2024-04-26T22:00:11.878613+0000","last_fullsized":"2024-04-26T22:00:11.878613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872101+0000","last_change":"2024-04-26T22:00:11.872101+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872101+0000","last_undegraded":"2024-04-26T22:00:11.872101+0000","last_fullsized":"2024-04-26T22:00:11.872101+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873652+0000","last_change":"2024-04-26T22:00:11.873652+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873652+0000","last_undegraded":"2024-04-26T22:00:11.873652+0000","last_fullsized":"2024-04-26T22:00:11.873652+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874364+0000","last_change":"2024-04-26T22:00:11.874364+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874364+0000","last_undegraded":"2024-04-26T22:00:11.874364+0000","last_fullsized":"2024-04-26T22:00:11.874364+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876896+0000","last_change":"2024-04-26T22:00:11.876896+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876896+0000","last_undegraded":"2024-04-26T22:00:11.876896+0000","last_fullsized":"2024-04-26T22:00:11.876896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892465+0000","last_change":"2024-04-26T22:00:11.887450+0000","last_active":"2024-04-26T22:00:11.892465+0000","last_peered":"2024-04-26T22:00:11.892465+0000","last_clean":"2024-04-26T22:00:11.892465+0000","last_became_active":"2024-04-26T22:00:11.887100+0000","last_became_peered":"2024-04-26T22:00:11.887100+0000","last_unstale":"2024-04-26T22:00:11.892465+0000","last_undegraded":"2024-04-26T22:00:11.892465+0000","last_fullsized":"2024-04-26T22:00:11.892465+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:58.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880786+0000","last_change":"2024-04-26T22:00:11.880786+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880786+0000","last_undegraded":"2024-04-26T22:00:11.880786+0000","last_fullsized":"2024-04-26T22:00:11.880786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887804+0000","last_change":"2024-04-26T22:00:11.882486+0000","last_active":"2024-04-26T22:00:11.887804+0000","last_peered":"2024-04-26T22:00:11.887804+0000","last_clean":"2024-04-26T22:00:11.887804+0000","last_became_active":"2024-04-26T22:00:11.882256+0000","last_became_peered":"2024-04-26T22:00:11.882256+0000","last_unstale":"2024-04-26T22:00:11.887804+0000","last_undegraded":"2024-04-26T22:00:11.887804+0000","last_fullsized":"2024-04-26T22:00:11.887804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:33.271613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875200+0000","last_change":"2024-04-26T22:00:11.875200+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875200+0000","last_undegraded":"2024-04-26T22:00:11.875200+0000","last_fullsized":"2024-04-26T22:00:11.875200+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889980+0000","last_change":"2024-04-26T22:00:11.882943+0000","last_active":"2024-04-26T22:00:11.889980+0000","last_peered":"2024-04-26T22:00:11.889980+0000","last_clean":"2024-04-26T22:00:11.889980+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:11.889980+0000","last_undegraded":"2024-04-26T22:00:11.889980+0000","last_fullsized":"2024-04-26T22:00:11.889980+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:33.271613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876300+0000","last_change":"2024-04-26T22:00:11.876300+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876300+0000","last_undegraded":"2024-04-26T22:00:11.876300+0000","last_fullsized":"2024-04-26T22:00:11.876300+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.884005+0000","last_change":"2024-04-26T22:00:11.879917+0000","last_active":"2024-04-26T22:00:11.884005+0000","last_peered":"2024-04-26T22:00:11.884005+0000","last_clean":"2024-04-26T22:00:11.884005+0000","last_became_active":"2024-04-26T22:00:11.879301+0000","last_became_peered":"2024-04-26T22:00:11.879301+0000","last_unstale":"2024-04-26T22:00:11.884005+0000","last_undegraded":"2024-04-26T22:00:11.884005+0000","last_fullsized":"2024-04-26T22:00:11.884005+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:50.350527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.871550+0000","last_change":"2024-04-26T22:00:11.871550+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.871550+0000","last_undegraded":"2024-04-26T22:00:11.871550+0000","last_fullsized":"2024-04-26T22:00:11.871550+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892400+0000","last_change":"2024-04-26T22:00:11.884768+0000","last_active":"2024-04-26T22:00:11.892400+0000","last_peered":"2024-04-26T22:00:11.892400+0000","last_clean":"2024-04-26T22:00:11.892400+0000","last_became_active":"2024-04-26T22:00:11.884497+0000","last_became_peered":"2024-04-26T22:00:11.884497+0000","last_unstale":"2024-04-26T22:00:11.892400+0000","last_undegraded":"2024-04-26T22:00:11.892400+0000","last_fullsized":"2024-04-26T22:00:11.892400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:48.325283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874185+0000","last_change":"2024-04-26T22:00:11.874185+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874185+0000","last_undegraded":"2024-04-26T22:00:11.874185+0000","last_fullsized":"2024-04-26T22:00:11.874185+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.881969+0000","last_change":"2024-04-26T22:00:11.878473+0000","last_active":"2024-04-26T22:00:11.881969+0000","last_peered":"2024-04-26T22:00:11.881969+0000","last_clean":"2024-04-26T22:00:11.881969+0000","last_became_active":"2024-04-26T22:00:11.878195+0000","last_became_peered":"2024-04-26T22:00:11.878195+0000","last_unstale":"2024-04-26T22:00:11.881969+0000","last_undegraded":"2024-04-26T22:00:11.881969+0000","last_fullsized":"2024-04-26T22:00:11.881969+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:07.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874070+0000","last_change":"2024-04-26T22:00:11.874070+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874070+0000","last_undegraded":"2024-04-26T22:00:11.874070+0000","last_fullsized":"2024-04-26T22:00:11.874070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.883126+0000","last_change":"2024-04-26T22:00:11.880991+0000","last_active":"2024-04-26T22:00:11.883126+0000","last_peered":"2024-04-26T22:00:11.883126+0000","last_clean":"2024-04-26T22:00:11.883126+0000","last_became_active":"2024-04-26T22:00:11.880707+0000","last_became_peered":"2024-04-26T22:00:11.880707+0000","last_unstale":"2024-04-26T22:00:11.883126+0000","last_undegraded":"2024-04-26T22:00:11.883126+0000","last_fullsized":"2024-04-26T22:00:11.883126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:05.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879532+0000","last_change":"2024-04-26T22:00:11.879532+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879532+0000","last_undegraded":"2024-04-26T22:00:11.879532+0000","last_fullsized":"2024-04-26T22:00:11.879532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892362+0000","last_change":"2024-04-26T22:00:11.881712+0000","last_active":"2024-04-26T22:00:11.892362+0000","last_peered":"2024-04-26T22:00:11.892362+0000","last_clean":"2024-04-26T22:00:11.892362+0000","last_became_active":"2024-04-26T22:00:11.881009+0000","last_became_peered":"2024-04-26T22:00:11.881009+0000","last_unstale":"2024-04-26T22:00:11.892362+0000","last_undegraded":"2024-04-26T22:00:11.892362+0000","last_fullsized":"2024-04-26T22:00:11.892362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:07.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872193+0000","last_change":"2024-04-26T22:00:11.872193+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872193+0000","last_undegraded":"2024-04-26T22:00:11.872193+0000","last_fullsized":"2024-04-26T22:00:11.872193+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887657+0000","last_change":"2024-04-26T22:00:11.884051+0000","last_active":"2024-04-26T22:00:11.887657+0000","last_peered":"2024-04-26T22:00:11.887657+0000","last_clean":"2024-04-26T22:00:11.887657+0000","last_became_active":"2024-04-26T22:00:11.883778+0000","last_became_peered":"2024-04-26T22:00:11.883778+0000","last_unstale":"2024-04-26T22:00:11.887657+0000","last_undegraded":"2024-04-26T22:00:11.887657+0000","last_fullsized":"2024-04-26T22:00:11.887657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:21.325594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870481+0000","last_change":"2024-04-26T22:00:11.870481+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870481+0000","last_undegraded":"2024-04-26T22:00:11.870481+0000","last_fullsized":"2024-04-26T22:00:11.870481+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.880225+0000","last_change":"2024-04-26T22:00:11.876171+0000","last_active":"2024-04-26T22:00:11.880225+0000","last_peered":"2024-04-26T22:00:11.880225+0000","last_clean":"2024-04-26T22:00:11.880225+0000","last_became_active":"2024-04-26T22:00:11.875895+0000","last_became_peered":"2024-04-26T22:00:11.875895+0000","last_unstale":"2024-04-26T22:00:11.880225+0000","last_undegraded":"2024-04-26T22:00:11.880225+0000","last_fullsized":"2024-04-26T22:00:11.880225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:22.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875630+0000","last_change":"2024-04-26T22:00:11.875630+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875630+0000","last_undegraded":"2024-04-26T22:00:11.875630+0000","last_fullsized":"2024-04-26T22:00:11.875630+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886070+0000","last_change":"2024-04-26T22:00:11.884653+0000","last_active":"2024-04-26T22:00:11.886070+0000","last_peered":"2024-04-26T22:00:11.886070+0000","last_clean":"2024-04-26T22:00:11.886070+0000","last_became_active":"2024-04-26T22:00:11.884363+0000","last_became_peered":"2024-04-26T22:00:11.884363+0000","last_unstale":"2024-04-26T22:00:11.886070+0000","last_undegraded":"2024-04-26T22:00:11.886070+0000","last_fullsized":"2024-04-26T22:00:11.886070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:33.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872112+0000","last_change":"2024-04-26T22:00:11.872112+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872112+0000","last_undegraded":"2024-04-26T22:00:11.872112+0000","last_fullsized":"2024-04-26T22:00:11.872112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889666+0000","last_change":"2024-04-26T22:00:11.883768+0000","last_active":"2024-04-26T22:00:11.889666+0000","last_peered":"2024-04-26T22:00:11.889666+0000","last_clean":"2024-04-26T22:00:11.889666+0000","last_became_active":"2024-04-26T22:00:11.883484+0000","last_became_peered":"2024-04-26T22:00:11.883484+0000","last_unstale":"2024-04-26T22:00:11.889666+0000","last_undegraded":"2024-04-26T22:00:11.889666+0000","last_fullsized":"2024-04-26T22:00:11.889666+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:59.629462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875024+0000","last_change":"2024-04-26T22:00:11.875024+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875024+0000","last_undegraded":"2024-04-26T22:00:11.875024+0000","last_fullsized":"2024-04-26T22:00:11.875024+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.897696+0000","last_change":"2024-04-26T22:00:11.893028+0000","last_active":"2024-04-26T22:00:11.897696+0000","last_peered":"2024-04-26T22:00:11.897696+0000","last_clean":"2024-04-26T22:00:11.897696+0000","last_became_active":"2024-04-26T22:00:11.892704+0000","last_became_peered":"2024-04-26T22:00:11.892704+0000","last_unstale":"2024-04-26T22:00:11.897696+0000","last_undegraded":"2024-04-26T22:00:11.897696+0000","last_fullsized":"2024-04-26T22:00:11.897696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:55.142122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873637+0000","last_change":"2024-04-26T22:00:11.873637+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873637+0000","last_undegraded":"2024-04-26T22:00:11.873637+0000","last_fullsized":"2024-04-26T22:00:11.873637+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887530+0000","last_change":"2024-04-26T22:00:11.885985+0000","last_active":"2024-04-26T22:00:11.887530+0000","last_peered":"2024-04-26T22:00:11.887530+0000","last_clean":"2024-04-26T22:00:11.887530+0000","last_became_active":"2024-04-26T22:00:11.885602+0000","last_became_peered":"2024-04-26T22:00:11.885602+0000","last_unstale":"2024-04-26T22:00:11.887530+0000","last_undegraded":"2024-04-26T22:00:11.887530+0000","last_fullsized":"2024-04-26T22:00:11.887530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:49.855119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875281+0000","last_change":"2024-04-26T22:00:11.875281+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875281+0000","last_undegraded":"2024-04-26T22:00:11.875281+0000","last_fullsized":"2024-04-26T22:00:11.875281+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892890+0000","last_change":"2024-04-26T22:00:11.890223+0000","last_active":"2024-04-26T22:00:11.892890+0000","last_peered":"2024-04-26T22:00:11.892890+0000","last_clean":"2024-04-26T22:00:11.892890+0000","last_became_active":"2024-04-26T22:00:11.889918+0000","last_became_peered":"2024-04-26T22:00:11.889918+0000","last_unstale":"2024-04-26T22:00:11.892890+0000","last_undegraded":"2024-04-26T22:00:11.892890+0000","last_fullsized":"2024-04-26T22:00:11.892890+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:52.959212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870239+0000","last_change":"2024-04-26T22:00:11.870239+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870239+0000","last_undegraded":"2024-04-26T22:00:11.870239+0000","last_fullsized":"2024-04-26T22:00:11.870239+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889525+0000","last_change":"2024-04-26T22:00:11.880931+0000","last_active":"2024-04-26T22:00:11.889525+0000","last_peered":"2024-04-26T22:00:11.889525+0000","last_clean":"2024-04-26T22:00:11.889525+0000","last_became_active":"2024-04-26T22:00:11.880653+0000","last_became_peered":"2024-04-26T22:00:11.880653+0000","last_unstale":"2024-04-26T22:00:11.889525+0000","last_undegraded":"2024-04-26T22:00:11.889525+0000","last_fullsized":"2024-04-26T22:00:11.889525+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:22.240513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872946+0000","last_change":"2024-04-26T22:00:11.872946+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872946+0000","last_undegraded":"2024-04-26T22:00:11.872946+0000","last_fullsized":"2024-04-26T22:00:11.872946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892724+0000","last_change":"2024-04-26T22:00:11.890718+0000","last_active":"2024-04-26T22:00:11.892724+0000","last_peered":"2024-04-26T22:00:11.892724+0000","last_clean":"2024-04-26T22:00:11.892724+0000","last_became_active":"2024-04-26T22:00:11.890389+0000","last_became_peered":"2024-04-26T22:00:11.890389+0000","last_unstale":"2024-04-26T22:00:11.892724+0000","last_undegraded":"2024-04-26T22:00:11.892724+0000","last_fullsized":"2024-04-26T22:00:11.892724+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:06.146600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873665+0000","last_change":"2024-04-26T22:00:11.873665+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873665+0000","last_undegraded":"2024-04-26T22:00:11.873665+0000","last_fullsized":"2024-04-26T22:00:11.873665+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886509+0000","last_change":"2024-04-26T22:00:11.881392+0000","last_active":"2024-04-26T22:00:11.886509+0000","last_peered":"2024-04-26T22:00:11.886509+0000","last_clean":"2024-04-26T22:00:11.886509+0000","last_became_active":"2024-04-26T22:00:11.881088+0000","last_became_peered":"2024-04-26T22:00:11.881088+0000","last_unstale":"2024-04-26T22:00:11.886509+0000","last_undegraded":"2024-04-26T22:00:11.886509+0000","last_fullsized":"2024-04-26T22:00:11.886509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:25.098175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.877945+0000","last_change":"2024-04-26T22:00:11.877945+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.877945+0000","last_undegraded":"2024-04-26T22:00:11.877945+0000","last_fullsized":"2024-04-26T22:00:11.877945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.883174+0000","last_change":"2024-04-26T22:00:11.881410+0000","last_active":"2024-04-26T22:00:11.883174+0000","last_peered":"2024-04-26T22:00:11.883174+0000","last_clean":"2024-04-26T22:00:11.883174+0000","last_became_active":"2024-04-26T22:00:11.881152+0000","last_became_peered":"2024-04-26T22:00:11.881152+0000","last_unstale":"2024-04-26T22:00:11.883174+0000","last_undegraded":"2024-04-26T22:00:11.883174+0000","last_fullsized":"2024-04-26T22:00:11.883174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:14.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.877557+0000","last_change":"2024-04-26T22:00:11.877557+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.877557+0000","last_undegraded":"2024-04-26T22:00:11.877557+0000","last_fullsized":"2024-04-26T22:00:11.877557+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892427+0000","last_change":"2024-04-26T22:00:11.887429+0000","last_active":"2024-04-26T22:00:11.892427+0000","last_peered":"2024-04-26T22:00:11.892427+0000","last_clean":"2024-04-26T22:00:11.892427+0000","last_became_active":"2024-04-26T22:00:11.887126+0000","last_became_peered":"2024-04-26T22:00:11.887126+0000","last_unstale":"2024-04-26T22:00:11.892427+0000","last_undegraded":"2024-04-26T22:00:11.892427+0000","last_fullsized":"2024-04-26T22:00:11.892427+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:04.876803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873501+0000","last_change":"2024-04-26T22:00:11.873501+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873501+0000","last_undegraded":"2024-04-26T22:00:11.873501+0000","last_fullsized":"2024-04-26T22:00:11.873501+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892376+0000","last_change":"2024-04-26T22:00:11.884714+0000","last_active":"2024-04-26T22:00:11.892376+0000","last_peered":"2024-04-26T22:00:11.892376+0000","last_clean":"2024-04-26T22:00:11.892376+0000","last_became_active":"2024-04-26T22:00:11.884458+0000","last_became_peered":"2024-04-26T22:00:11.884458+0000","last_unstale":"2024-04-26T22:00:11.892376+0000","last_undegraded":"2024-04-26T22:00:11.892376+0000","last_fullsized":"2024-04-26T22:00:11.892376+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:01.295815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875898+0000","last_change":"2024-04-26T22:00:11.875898+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875898+0000","last_undegraded":"2024-04-26T22:00:11.875898+0000","last_fullsized":"2024-04-26T22:00:11.875898+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.888543+0000","last_change":"2024-04-26T22:00:11.887720+0000","last_active":"2024-04-26T22:00:11.888543+0000","last_peered":"2024-04-26T22:00:11.888543+0000","last_clean":"2024-04-26T22:00:11.888543+0000","last_became_active":"2024-04-26T22:00:11.887407+0000","last_became_peered":"2024-04-26T22:00:11.887407+0000","last_unstale":"2024-04-26T22:00:11.888543+0000","last_undegraded":"2024-04-26T22:00:11.888543+0000","last_fullsized":"2024-04-26T22:00:11.888543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:07.267948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873985+0000","last_change":"2024-04-26T22:00:11.873985+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873985+0000","last_undegraded":"2024-04-26T22:00:11.873985+0000","last_fullsized":"2024-04-26T22:00:11.873985+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.880188+0000","last_change":"2024-04-26T22:00:11.875970+0000","last_active":"2024-04-26T22:00:11.880188+0000","last_peered":"2024-04-26T22:00:11.880188+0000","last_clean":"2024-04-26T22:00:11.880188+0000","last_became_active":"2024-04-26T22:00:11.875677+0000","last_became_peered":"2024-04-26T22:00:11.875677+0000","last_unstale":"2024-04-26T22:00:11.880188+0000","last_undegraded":"2024-04-26T22:00:11.880188+0000","last_fullsized":"2024-04-26T22:00:11.880188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:28.812254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873120+0000","last_change":"2024-04-26T22:00:11.873120+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873120+0000","last_undegraded":"2024-04-26T22:00:11.873120+0000","last_fullsized":"2024-04-26T22:00:11.873120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.885022+0000","last_change":"2024-04-26T22:00:11.881790+0000","last_active":"2024-04-26T22:00:11.885022+0000","last_peered":"2024-04-26T22:00:11.885022+0000","last_clean":"2024-04-26T22:00:11.885022+0000","last_became_active":"2024-04-26T22:00:11.881500+0000","last_became_peered":"2024-04-26T22:00:11.881500+0000","last_unstale":"2024-04-26T22:00:11.885022+0000","last_undegraded":"2024-04-26T22:00:11.885022+0000","last_fullsized":"2024-04-26T22:00:11.885022+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:05.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879691+0000","last_change":"2024-04-26T22:00:11.879691+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879691+0000","last_undegraded":"2024-04-26T22:00:11.879691+0000","last_fullsized":"2024-04-26T22:00:11.879691+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889529+0000","last_change":"2024-04-26T22:00:11.880307+0000","last_active":"2024-04-26T22:00:11.889529+0000","last_peered":"2024-04-26T22:00:11.889529+0000","last_clean":"2024-04-26T22:00:11.889529+0000","last_became_active":"2024-04-26T22:00:11.879974+0000","last_became_peered":"2024-04-26T22:00:11.879974+0000","last_unstale":"2024-04-26T22:00:11.889529+0000","last_undegraded":"2024-04-26T22:00:11.889529+0000","last_fullsized":"2024-04-26T22:00:11.889529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:03.645360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872363+0000","last_change":"2024-04-26T22:00:11.872363+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872363+0000","last_undegraded":"2024-04-26T22:00:11.872363+0000","last_fullsized":"2024-04-26T22:00:11.872363+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886091+0000","last_change":"2024-04-26T22:00:11.884583+0000","last_active":"2024-04-26T22:00:11.886091+0000","last_peered":"2024-04-26T22:00:11.886091+0000","last_clean":"2024-04-26T22:00:11.886091+0000","last_became_active":"2024-04-26T22:00:11.884020+0000","last_became_peered":"2024-04-26T22:00:11.884020+0000","last_unstale":"2024-04-26T22:00:11.886091+0000","last_undegraded":"2024-04-26T22:00:11.886091+0000","last_fullsized":"2024-04-26T22:00:11.886091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:07.267948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870252+0000","last_change":"2024-04-26T22:00:11.870252+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870252+0000","last_undegraded":"2024-04-26T22:00:11.870252+0000","last_fullsized":"2024-04-26T22:00:11.870252+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889956+0000","last_change":"2024-04-26T22:00:11.882987+0000","last_active":"2024-04-26T22:00:11.889956+0000","last_peered":"2024-04-26T22:00:11.889956+0000","last_clean":"2024-04-26T22:00:11.889956+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:11.889956+0000","last_undegraded":"2024-04-26T22:00:11.889956+0000","last_fullsized":"2024-04-26T22:00:11.889956+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:21.325594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872992+0000","last_change":"2024-04-26T22:00:11.872992+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872992+0000","last_undegraded":"2024-04-26T22:00:11.872992+0000","last_fullsized":"2024-04-26T22:00:11.872992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.885029+0000","last_change":"2024-04-26T22:00:11.882822+0000","last_active":"2024-04-26T22:00:11.885029+0000","last_peered":"2024-04-26T22:00:11.885029+0000","last_clean":"2024-04-26T22:00:11.885029+0000","last_became_active":"2024-04-26T22:00:11.882569+0000","last_became_peered":"2024-04-26T22:00:11.882569+0000","last_unstale":"2024-04-26T22:00:11.885029+0000","last_undegraded":"2024-04-26T22:00:11.885029+0000","last_fullsized":"2024-04-26T22:00:11.885029+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:14.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.878596+0000","last_change":"2024-04-26T22:00:11.878596+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.878596+0000","last_undegraded":"2024-04-26T22:00:11.878596+0000","last_fullsized":"2024-04-26T22:00:11.878596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887702+0000","last_change":"2024-04-26T22:00:11.884725+0000","last_active":"2024-04-26T22:00:11.887702+0000","last_peered":"2024-04-26T22:00:11.887702+0000","last_clean":"2024-04-26T22:00:11.887702+0000","last_became_active":"2024-04-26T22:00:11.884448+0000","last_became_peered":"2024-04-26T22:00:11.884448+0000","last_unstale":"2024-04-26T22:00:11.887702+0000","last_undegraded":"2024-04-26T22:00:11.887702+0000","last_fullsized":"2024-04-26T22:00:11.887702+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:55.814565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874489+0000","last_change":"2024-04-26T22:00:11.874489+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874489+0000","last_undegraded":"2024-04-26T22:00:11.874489+0000","last_fullsized":"2024-04-26T22:00:11.874489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.890418+0000","last_change":"2024-04-26T22:00:11.887954+0000","last_active":"2024-04-26T22:00:11.890418+0000","last_peered":"2024-04-26T22:00:11.890418+0000","last_clean":"2024-04-26T22:00:11.890418+0000","last_became_active":"2024-04-26T22:00:11.887653+0000","last_became_peered":"2024-04-26T22:00:11.887653+0000","last_unstale":"2024-04-26T22:00:11.890418+0000","last_undegraded":"2024-04-26T22:00:11.890418+0000","last_fullsized":"2024-04-26T22:00:11.890418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:55.814565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870509+0000","last_change":"2024-04-26T22:00:11.870509+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870509+0000","last_undegraded":"2024-04-26T22:00:11.870509+0000","last_fullsized":"2024-04-26T22:00:11.870509+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892447+0000","last_change":"2024-04-26T22:00:11.882774+0000","last_active":"2024-04-26T22:00:11.892447+0000","last_peered":"2024-04-26T22:00:11.892447+0000","last_clean":"2024-04-26T22:00:11.892447+0000","last_became_active":"2024-04-26T22:00:11.882439+0000","last_became_peered":"2024-04-26T22:00:11.882439+0000","last_unstale":"2024-04-26T22:00:11.892447+0000","last_undegraded":"2024-04-26T22:00:11.892447+0000","last_fullsized":"2024-04-26T22:00:11.892447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:25.098175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875081+0000","last_change":"2024-04-26T22:00:11.875081+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875081+0000","last_undegraded":"2024-04-26T22:00:11.875081+0000","last_fullsized":"2024-04-26T22:00:11.875081+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886225+0000","last_change":"2024-04-26T22:00:11.884787+0000","last_active":"2024-04-26T22:00:11.886225+0000","last_peered":"2024-04-26T22:00:11.886225+0000","last_clean":"2024-04-26T22:00:11.886225+0000","last_became_active":"2024-04-26T22:00:11.884493+0000","last_became_peered":"2024-04-26T22:00:11.884493+0000","last_unstale":"2024-04-26T22:00:11.886225+0000","last_undegraded":"2024-04-26T22:00:11.886225+0000","last_fullsized":"2024-04-26T22:00:11.886225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:33.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.873495+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:00:11.873495+0000","last_peered":"2024-04-26T22:00:11.873495+0000","last_clean":"2024-04-26T22:00:11.873495+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:00:11.873495+0000","last_undegraded":"2024-04-26T22:00:11.873495+0000","last_fullsized":"2024-04-26T22:00:11.873495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":797079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1110016,"data_stored":797079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:00:15.852 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:00:15.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.984+0000 7fb2bd79d640 1 Processor -- start 2024-04-26T22:00:15.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.984+0000 7fb2bd79d640 1 -- start start 2024-04-26T22:00:15.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.985+0000 7fb2bd79d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.985+0000 7fb2bd79d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb2b815f750 0x7fb2b80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.985+0000 7fb2bd79d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b80d03a0 con 0x7fb2b815f370 2024-04-26T22:00:15.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.985+0000 7fb2bd79d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b80b4d10 con 0x7fb2b815f750 2024-04-26T22:00:15.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.985+0000 7fb2bd79d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b80d0680 con 0x7fb2b80d3ee0 2024-04-26T22:00:15.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.985+0000 7fb2b67fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.985+0000 7fb2b77fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb2b815f750 0x7fb2b80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.986+0000 7fb2b67fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:42354/0 (socket says 172.21.15.137:42354) 2024-04-26T22:00:15.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.986+0000 7fb2b67fc640 1 -- 172.21.15.137:0/1492944156 learned_addr learned my addr 172.21.15.137:0/1492944156 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.986+0000 7fb2b67fc640 1 -- 172.21.15.137:0/1492944156 >> v2:172.21.15.170:3300/0 conn(0x7fb2b815f750 msgr2=0x7fb2b80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.986+0000 7fb2b67fc640 1 --2- 172.21.15.137:0/1492944156 >> v2:172.21.15.170:3300/0 conn(0x7fb2b815f750 0x7fb2b80b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.986+0000 7fb2b67fc640 1 -- 172.21.15.137:0/1492944156 >> v1:172.21.15.170:6789/0 conn(0x7fb2b815f370 legacy=0x7fb2b80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.986+0000 7fb2b67fc640 1 -- 172.21.15.137:0/1492944156 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b80d0960 con 0x7fb2b80d3ee0 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.986+0000 7fb2b77fe640 1 --2- 172.21.15.137:0/1492944156 >> v2:172.21.15.170:3300/0 conn(0x7fb2b815f750 0x7fb2b80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2b67fc640 1 --2- 172.21.15.137:0/1492944156 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cfd70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009870 tx=0x7fb2ac02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a7371f7f8ccc7b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2b5ffb640 1 -- 172.21.15.137:0/1492944156 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac037070 con 0x7fb2b80d3ee0 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2b5ffb640 1 -- 172.21.15.137:0/1492944156 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ac032440 con 0x7fb2b80d3ee0 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2b5ffb640 1 -- 172.21.15.137:0/1492944156 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac032810 con 0x7fb2b80d3ee0 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1492944156 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 msgr2=0x7fb2b80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2bd79d640 1 --2- 172.21.15.137:0/1492944156 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cfd70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009870 tx=0x7fb2ac02a270 comp rx=0 tx=0).stop 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1492944156 shutdown_connections 2024-04-26T22:00:15.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2bd79d640 1 --2- 172.21.15.137:0/1492944156 >> v2:172.21.15.170:3300/0 conn(0x7fb2b815f750 0x7fb2b80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2bd79d640 1 --2- 172.21.15.137:0/1492944156 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cfd70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1492944156 >> 172.21.15.137:0/1492944156 conn(0x7fb2b808ec10 msgr2=0x7fb2b809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:15.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1492944156 shutdown_connections 2024-04-26T22:00:15.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.987+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1492944156 wait complete. 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2bd79d640 1 Processor -- start 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2bd79d640 1 -- start start 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2bd79d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2bd79d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2b815f370 0x7fb2b81587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2bd79d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2b815f750 0x7fb2b80cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2bd79d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b80b51c0 con 0x7fb2b815f750 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2bd79d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b80d0f20 con 0x7fb2b815f370 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2bd79d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b80b5340 con 0x7fb2b80d3ee0 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2b77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2b815f750 0x7fb2b80cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2b77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2b815f750 0x7fb2b80cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38086/0 (socket says 172.21.15.137:38086) 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.989+0000 7fb2b77fe640 1 -- 172.21.15.137:0/1555496911 learned_addr learned my addr 172.21.15.137:0/1555496911 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2b6ffd640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2b67fc640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2b815f370 0x7fb2b81587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2b77fe640 1 -- 172.21.15.137:0/1555496911 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 msgr2=0x7fb2b80cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2b77fe640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2b77fe640 1 -- 172.21.15.137:0/1555496911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2b815f370 msgr2=0x7fb2b81587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2b77fe640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2b815f370 0x7fb2b81587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2b77fe640 1 -- 172.21.15.137:0/1555496911 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b806deb0 con 0x7fb2b815f750 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2b67fc640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2b815f370 0x7fb2b81587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2b77fe640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2b815f750 0x7fb2b80cc2c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e880 tx=0x7fb2b000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb29f7fe640 1 -- 172.21.15.137:0/1555496911 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0017070 con 0x7fb2b815f750 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb29f7fe640 1 -- 172.21.15.137:0/1555496911 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b0004020 con 0x7fb2b815f750 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb29f7fe640 1 -- 172.21.15.137:0/1555496911 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00043f0 con 0x7fb2b815f750 2024-04-26T22:00:15.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b80ce2c0 con 0x7fb2b815f750 2024-04-26T22:00:15.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.990+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b80ce880 con 0x7fb2b815f750 2024-04-26T22:00:15.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.991+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b806a290 con 0x7fb2b815f750 2024-04-26T22:00:15.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.992+0000 7fb29f7fe640 1 -- 172.21.15.137:0/1555496911 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2b000c940 con 0x7fb2b815f750 2024-04-26T22:00:15.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.992+0000 7fb29f7fe640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb2a406c920 0x7fb2a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:15.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.992+0000 7fb29f7fe640 1 -- 172.21.15.137:0/1555496911 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb2b008b7d0 con 0x7fb2b815f750 2024-04-26T22:00:15.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.992+0000 7fb2b6ffd640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb2a406c920 0x7fb2a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:15.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.992+0000 7fb2b6ffd640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb2a406c920 0x7fb2a406ede0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8001f10 tx=0x7fb2a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:15.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:15.996+0000 7fb29f7fe640 1 -- 172.21.15.137:0/1555496911 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb2b806deb0 con 0x7fb2b815f750 2024-04-26T22:00:16.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.168+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2b80cf360 con 0x7fb2a406c920 2024-04-26T22:00:16.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.174+0000 7fb29f7fe640 1 -- 172.21.15.137:0/1555496911 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7fb2a8002060 con 0x7fb2a406c920 2024-04-26T22:00:16.177 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:16.178 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:00:16.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb2a406c920 msgr2=0x7fb2a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb2a406c920 0x7fb2a406ede0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8001f10 tx=0x7fb2a8009040 comp rx=0 tx=0).stop 2024-04-26T22:00:16.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2b815f750 msgr2=0x7fb2b80cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2b815f750 0x7fb2b80cc2c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e880 tx=0x7fb2b000ed40 comp rx=0 tx=0).stop 2024-04-26T22:00:16.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 shutdown_connections 2024-04-26T22:00:16.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb2a406c920 0x7fb2a406ede0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb2b815f750 0x7fb2b80cc2c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb2b815f370 0x7fb2b81587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 --2- 172.21.15.137:0/1555496911 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2b80d3ee0 0x7fb2b80cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 >> 172.21.15.137:0/1555496911 conn(0x7fb2b808ec10 msgr2=0x7fb2b80d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 shutdown_connections 2024-04-26T22:00:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.177+0000 7fb2bd79d640 1 -- 172.21.15.137:0/1555496911 wait complete. 2024-04-26T22:00:16.188 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-26T22:00:14.711652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237992,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736728,"statfs":{"total":773094113280,"available":772850409472,"internally_reserved":0,"allocated":5316608,"data_stored":2834424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000820"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.871194+0000","last_change":"2024-04-26T22:00:11.871194+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.871194+0000","last_undegraded":"2024-04-26T22:00:11.871194+0000","last_fullsized":"2024-04-26T22:00:11.871194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874539+0000","last_change":"2024-04-26T22:00:11.874539+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874539+0000","last_undegraded":"2024-04-26T22:00:11.874539+0000","last_fullsized":"2024-04-26T22:00:11.874539+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872529+0000","last_change":"2024-04-26T22:00:11.872529+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872529+0000","last_undegraded":"2024-04-26T22:00:11.872529+0000","last_fullsized":"2024-04-26T22:00:11.872529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880788+0000","last_change":"2024-04-26T22:00:11.880788+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880788+0000","last_undegraded":"2024-04-26T22:00:11.880788+0000","last_fullsized":"2024-04-26T22:00:11.880788+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874852+0000","last_change":"2024-04-26T22:00:11.874852+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874852+0000","last_undegraded":"2024-04-26T22:00:11.874852+0000","last_fullsized":"2024-04-26T22:00:11.874852+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873945+0000","last_change":"2024-04-26T22:00:11.873945+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873945+0000","last_undegraded":"2024-04-26T22:00:11.873945+0000","last_fullsized":"2024-04-26T22:00:11.873945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870799+0000","last_change":"2024-04-26T22:00:11.870799+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870799+0000","last_undegraded":"2024-04-26T22:00:11.870799+0000","last_fullsized":"2024-04-26T22:00:11.870799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880282+0000","last_change":"2024-04-26T22:00:11.880282+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880282+0000","last_undegraded":"2024-04-26T22:00:11.880282+0000","last_fullsized":"2024-04-26T22:00:11.880282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874589+0000","last_change":"2024-04-26T22:00:11.874589+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874589+0000","last_undegraded":"2024-04-26T22:00:11.874589+0000","last_fullsized":"2024-04-26T22:00:11.874589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875477+0000","last_change":"2024-04-26T22:00:11.875477+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875477+0000","last_undegraded":"2024-04-26T22:00:11.875477+0000","last_fullsized":"2024-04-26T22:00:11.875477+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875140+0000","last_change":"2024-04-26T22:00:11.875140+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875140+0000","last_undegraded":"2024-04-26T22:00:11.875140+0000","last_fullsized":"2024-04-26T22:00:11.875140+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876023+0000","last_change":"2024-04-26T22:00:11.876023+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876023+0000","last_undegraded":"2024-04-26T22:00:11.876023+0000","last_fullsized":"2024-04-26T22:00:11.876023+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872908+0000","last_change":"2024-04-26T22:00:11.872908+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872908+0000","last_undegraded":"2024-04-26T22:00:11.872908+0000","last_fullsized":"2024-04-26T22:00:11.872908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875038+0000","last_change":"2024-04-26T22:00:11.875038+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875038+0000","last_undegraded":"2024-04-26T22:00:11.875038+0000","last_fullsized":"2024-04-26T22:00:11.875038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874069+0000","last_change":"2024-04-26T22:00:11.874069+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874069+0000","last_undegraded":"2024-04-26T22:00:11.874069+0000","last_fullsized":"2024-04-26T22:00:11.874069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879074+0000","last_change":"2024-04-26T22:00:11.879074+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879074+0000","last_undegraded":"2024-04-26T22:00:11.879074+0000","last_fullsized":"2024-04-26T22:00:11.879074+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873144+0000","last_change":"2024-04-26T22:00:11.873144+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873144+0000","last_undegraded":"2024-04-26T22:00:11.873144+0000","last_fullsized":"2024-04-26T22:00:11.873144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873220+0000","last_change":"2024-04-26T22:00:11.873220+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873220+0000","last_undegraded":"2024-04-26T22:00:11.873220+0000","last_fullsized":"2024-04-26T22:00:11.873220+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876590+0000","last_change":"2024-04-26T22:00:11.876590+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876590+0000","last_undegraded":"2024-04-26T22:00:11.876590+0000","last_fullsized":"2024-04-26T22:00:11.876590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875133+0000","last_change":"2024-04-26T22:00:11.875133+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875133+0000","last_undegraded":"2024-04-26T22:00:11.875133+0000","last_fullsized":"2024-04-26T22:00:11.875133+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879213+0000","last_change":"2024-04-26T22:00:11.879213+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879213+0000","last_undegraded":"2024-04-26T22:00:11.879213+0000","last_fullsized":"2024-04-26T22:00:11.879213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874569+0000","last_change":"2024-04-26T22:00:11.874569+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874569+0000","last_undegraded":"2024-04-26T22:00:11.874569+0000","last_fullsized":"2024-04-26T22:00:11.874569+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879112+0000","last_change":"2024-04-26T22:00:11.879112+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879112+0000","last_undegraded":"2024-04-26T22:00:11.879112+0000","last_fullsized":"2024-04-26T22:00:11.879112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875399+0000","last_change":"2024-04-26T22:00:11.875399+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875399+0000","last_undegraded":"2024-04-26T22:00:11.875399+0000","last_fullsized":"2024-04-26T22:00:11.875399+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.881178+0000","last_change":"2024-04-26T22:00:11.881178+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.881178+0000","last_undegraded":"2024-04-26T22:00:11.881178+0000","last_fullsized":"2024-04-26T22:00:11.881178+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873493+0000","last_change":"2024-04-26T22:00:11.873493+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873493+0000","last_undegraded":"2024-04-26T22:00:11.873493+0000","last_fullsized":"2024-04-26T22:00:11.873493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870587+0000","last_change":"2024-04-26T22:00:11.870587+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870587+0000","last_undegraded":"2024-04-26T22:00:11.870587+0000","last_fullsized":"2024-04-26T22:00:11.870587+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875613+0000","last_change":"2024-04-26T22:00:11.875613+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875613+0000","last_undegraded":"2024-04-26T22:00:11.875613+0000","last_fullsized":"2024-04-26T22:00:11.875613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.878613+0000","last_change":"2024-04-26T22:00:11.878613+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.878613+0000","last_undegraded":"2024-04-26T22:00:11.878613+0000","last_fullsized":"2024-04-26T22:00:11.878613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872101+0000","last_change":"2024-04-26T22:00:11.872101+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872101+0000","last_undegraded":"2024-04-26T22:00:11.872101+0000","last_fullsized":"2024-04-26T22:00:11.872101+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873652+0000","last_change":"2024-04-26T22:00:11.873652+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873652+0000","last_undegraded":"2024-04-26T22:00:11.873652+0000","last_fullsized":"2024-04-26T22:00:11.873652+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874364+0000","last_change":"2024-04-26T22:00:11.874364+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874364+0000","last_undegraded":"2024-04-26T22:00:11.874364+0000","last_fullsized":"2024-04-26T22:00:11.874364+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876896+0000","last_change":"2024-04-26T22:00:11.876896+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876896+0000","last_undegraded":"2024-04-26T22:00:11.876896+0000","last_fullsized":"2024-04-26T22:00:11.876896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892465+0000","last_change":"2024-04-26T22:00:11.887450+0000","last_active":"2024-04-26T22:00:11.892465+0000","last_peered":"2024-04-26T22:00:11.892465+0000","last_clean":"2024-04-26T22:00:11.892465+0000","last_became_active":"2024-04-26T22:00:11.887100+0000","last_became_peered":"2024-04-26T22:00:11.887100+0000","last_unstale":"2024-04-26T22:00:11.892465+0000","last_undegraded":"2024-04-26T22:00:11.892465+0000","last_fullsized":"2024-04-26T22:00:11.892465+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:58.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880786+0000","last_change":"2024-04-26T22:00:11.880786+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880786+0000","last_undegraded":"2024-04-26T22:00:11.880786+0000","last_fullsized":"2024-04-26T22:00:11.880786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887804+0000","last_change":"2024-04-26T22:00:11.882486+0000","last_active":"2024-04-26T22:00:11.887804+0000","last_peered":"2024-04-26T22:00:11.887804+0000","last_clean":"2024-04-26T22:00:11.887804+0000","last_became_active":"2024-04-26T22:00:11.882256+0000","last_became_peered":"2024-04-26T22:00:11.882256+0000","last_unstale":"2024-04-26T22:00:11.887804+0000","last_undegraded":"2024-04-26T22:00:11.887804+0000","last_fullsized":"2024-04-26T22:00:11.887804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:33.271613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875200+0000","last_change":"2024-04-26T22:00:11.875200+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875200+0000","last_undegraded":"2024-04-26T22:00:11.875200+0000","last_fullsized":"2024-04-26T22:00:11.875200+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889980+0000","last_change":"2024-04-26T22:00:11.882943+0000","last_active":"2024-04-26T22:00:11.889980+0000","last_peered":"2024-04-26T22:00:11.889980+0000","last_clean":"2024-04-26T22:00:11.889980+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:11.889980+0000","last_undegraded":"2024-04-26T22:00:11.889980+0000","last_fullsized":"2024-04-26T22:00:11.889980+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:33.271613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876300+0000","last_change":"2024-04-26T22:00:11.876300+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876300+0000","last_undegraded":"2024-04-26T22:00:11.876300+0000","last_fullsized":"2024-04-26T22:00:11.876300+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.884005+0000","last_change":"2024-04-26T22:00:11.879917+0000","last_active":"2024-04-26T22:00:11.884005+0000","last_peered":"2024-04-26T22:00:11.884005+0000","last_clean":"2024-04-26T22:00:11.884005+0000","last_became_active":"2024-04-26T22:00:11.879301+0000","last_became_peered":"2024-04-26T22:00:11.879301+0000","last_unstale":"2024-04-26T22:00:11.884005+0000","last_undegraded":"2024-04-26T22:00:11.884005+0000","last_fullsized":"2024-04-26T22:00:11.884005+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:50.350527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.871550+0000","last_change":"2024-04-26T22:00:11.871550+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.871550+0000","last_undegraded":"2024-04-26T22:00:11.871550+0000","last_fullsized":"2024-04-26T22:00:11.871550+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892400+0000","last_change":"2024-04-26T22:00:11.884768+0000","last_active":"2024-04-26T22:00:11.892400+0000","last_peered":"2024-04-26T22:00:11.892400+0000","last_clean":"2024-04-26T22:00:11.892400+0000","last_became_active":"2024-04-26T22:00:11.884497+0000","last_became_peered":"2024-04-26T22:00:11.884497+0000","last_unstale":"2024-04-26T22:00:11.892400+0000","last_undegraded":"2024-04-26T22:00:11.892400+0000","last_fullsized":"2024-04-26T22:00:11.892400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:48.325283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874185+0000","last_change":"2024-04-26T22:00:11.874185+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874185+0000","last_undegraded":"2024-04-26T22:00:11.874185+0000","last_fullsized":"2024-04-26T22:00:11.874185+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.881969+0000","last_change":"2024-04-26T22:00:11.878473+0000","last_active":"2024-04-26T22:00:11.881969+0000","last_peered":"2024-04-26T22:00:11.881969+0000","last_clean":"2024-04-26T22:00:11.881969+0000","last_became_active":"2024-04-26T22:00:11.878195+0000","last_became_peered":"2024-04-26T22:00:11.878195+0000","last_unstale":"2024-04-26T22:00:11.881969+0000","last_undegraded":"2024-04-26T22:00:11.881969+0000","last_fullsized":"2024-04-26T22:00:11.881969+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:07.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874070+0000","last_change":"2024-04-26T22:00:11.874070+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874070+0000","last_undegraded":"2024-04-26T22:00:11.874070+0000","last_fullsized":"2024-04-26T22:00:11.874070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.883126+0000","last_change":"2024-04-26T22:00:11.880991+0000","last_active":"2024-04-26T22:00:11.883126+0000","last_peered":"2024-04-26T22:00:11.883126+0000","last_clean":"2024-04-26T22:00:11.883126+0000","last_became_active":"2024-04-26T22:00:11.880707+0000","last_became_peered":"2024-04-26T22:00:11.880707+0000","last_unstale":"2024-04-26T22:00:11.883126+0000","last_undegraded":"2024-04-26T22:00:11.883126+0000","last_fullsized":"2024-04-26T22:00:11.883126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:05.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879532+0000","last_change":"2024-04-26T22:00:11.879532+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879532+0000","last_undegraded":"2024-04-26T22:00:11.879532+0000","last_fullsized":"2024-04-26T22:00:11.879532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892362+0000","last_change":"2024-04-26T22:00:11.881712+0000","last_active":"2024-04-26T22:00:11.892362+0000","last_peered":"2024-04-26T22:00:11.892362+0000","last_clean":"2024-04-26T22:00:11.892362+0000","last_became_active":"2024-04-26T22:00:11.881009+0000","last_became_peered":"2024-04-26T22:00:11.881009+0000","last_unstale":"2024-04-26T22:00:11.892362+0000","last_undegraded":"2024-04-26T22:00:11.892362+0000","last_fullsized":"2024-04-26T22:00:11.892362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:07.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872193+0000","last_change":"2024-04-26T22:00:11.872193+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872193+0000","last_undegraded":"2024-04-26T22:00:11.872193+0000","last_fullsized":"2024-04-26T22:00:11.872193+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887657+0000","last_change":"2024-04-26T22:00:11.884051+0000","last_active":"2024-04-26T22:00:11.887657+0000","last_peered":"2024-04-26T22:00:11.887657+0000","last_clean":"2024-04-26T22:00:11.887657+0000","last_became_active":"2024-04-26T22:00:11.883778+0000","last_became_peered":"2024-04-26T22:00:11.883778+0000","last_unstale":"2024-04-26T22:00:11.887657+0000","last_undegraded":"2024-04-26T22:00:11.887657+0000","last_fullsized":"2024-04-26T22:00:11.887657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:21.325594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870481+0000","last_change":"2024-04-26T22:00:11.870481+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870481+0000","last_undegraded":"2024-04-26T22:00:11.870481+0000","last_fullsized":"2024-04-26T22:00:11.870481+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.880225+0000","last_change":"2024-04-26T22:00:11.876171+0000","last_active":"2024-04-26T22:00:11.880225+0000","last_peered":"2024-04-26T22:00:11.880225+0000","last_clean":"2024-04-26T22:00:11.880225+0000","last_became_active":"2024-04-26T22:00:11.875895+0000","last_became_peered":"2024-04-26T22:00:11.875895+0000","last_unstale":"2024-04-26T22:00:11.880225+0000","last_undegraded":"2024-04-26T22:00:11.880225+0000","last_fullsized":"2024-04-26T22:00:11.880225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:22.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875630+0000","last_change":"2024-04-26T22:00:11.875630+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875630+0000","last_undegraded":"2024-04-26T22:00:11.875630+0000","last_fullsized":"2024-04-26T22:00:11.875630+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886070+0000","last_change":"2024-04-26T22:00:11.884653+0000","last_active":"2024-04-26T22:00:11.886070+0000","last_peered":"2024-04-26T22:00:11.886070+0000","last_clean":"2024-04-26T22:00:11.886070+0000","last_became_active":"2024-04-26T22:00:11.884363+0000","last_became_peered":"2024-04-26T22:00:11.884363+0000","last_unstale":"2024-04-26T22:00:11.886070+0000","last_undegraded":"2024-04-26T22:00:11.886070+0000","last_fullsized":"2024-04-26T22:00:11.886070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:33.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872112+0000","last_change":"2024-04-26T22:00:11.872112+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872112+0000","last_undegraded":"2024-04-26T22:00:11.872112+0000","last_fullsized":"2024-04-26T22:00:11.872112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889666+0000","last_change":"2024-04-26T22:00:11.883768+0000","last_active":"2024-04-26T22:00:11.889666+0000","last_peered":"2024-04-26T22:00:11.889666+0000","last_clean":"2024-04-26T22:00:11.889666+0000","last_became_active":"2024-04-26T22:00:11.883484+0000","last_became_peered":"2024-04-26T22:00:11.883484+0000","last_unstale":"2024-04-26T22:00:11.889666+0000","last_undegraded":"2024-04-26T22:00:11.889666+0000","last_fullsized":"2024-04-26T22:00:11.889666+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:59.629462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875024+0000","last_change":"2024-04-26T22:00:11.875024+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875024+0000","last_undegraded":"2024-04-26T22:00:11.875024+0000","last_fullsized":"2024-04-26T22:00:11.875024+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.897696+0000","last_change":"2024-04-26T22:00:11.893028+0000","last_active":"2024-04-26T22:00:11.897696+0000","last_peered":"2024-04-26T22:00:11.897696+0000","last_clean":"2024-04-26T22:00:11.897696+0000","last_became_active":"2024-04-26T22:00:11.892704+0000","last_became_peered":"2024-04-26T22:00:11.892704+0000","last_unstale":"2024-04-26T22:00:11.897696+0000","last_undegraded":"2024-04-26T22:00:11.897696+0000","last_fullsized":"2024-04-26T22:00:11.897696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:55.142122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873637+0000","last_change":"2024-04-26T22:00:11.873637+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873637+0000","last_undegraded":"2024-04-26T22:00:11.873637+0000","last_fullsized":"2024-04-26T22:00:11.873637+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887530+0000","last_change":"2024-04-26T22:00:11.885985+0000","last_active":"2024-04-26T22:00:11.887530+0000","last_peered":"2024-04-26T22:00:11.887530+0000","last_clean":"2024-04-26T22:00:11.887530+0000","last_became_active":"2024-04-26T22:00:11.885602+0000","last_became_peered":"2024-04-26T22:00:11.885602+0000","last_unstale":"2024-04-26T22:00:11.887530+0000","last_undegraded":"2024-04-26T22:00:11.887530+0000","last_fullsized":"2024-04-26T22:00:11.887530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:49.855119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875281+0000","last_change":"2024-04-26T22:00:11.875281+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875281+0000","last_undegraded":"2024-04-26T22:00:11.875281+0000","last_fullsized":"2024-04-26T22:00:11.875281+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892890+0000","last_change":"2024-04-26T22:00:11.890223+0000","last_active":"2024-04-26T22:00:11.892890+0000","last_peered":"2024-04-26T22:00:11.892890+0000","last_clean":"2024-04-26T22:00:11.892890+0000","last_became_active":"2024-04-26T22:00:11.889918+0000","last_became_peered":"2024-04-26T22:00:11.889918+0000","last_unstale":"2024-04-26T22:00:11.892890+0000","last_undegraded":"2024-04-26T22:00:11.892890+0000","last_fullsized":"2024-04-26T22:00:11.892890+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:52.959212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870239+0000","last_change":"2024-04-26T22:00:11.870239+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870239+0000","last_undegraded":"2024-04-26T22:00:11.870239+0000","last_fullsized":"2024-04-26T22:00:11.870239+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889525+0000","last_change":"2024-04-26T22:00:11.880931+0000","last_active":"2024-04-26T22:00:11.889525+0000","last_peered":"2024-04-26T22:00:11.889525+0000","last_clean":"2024-04-26T22:00:11.889525+0000","last_became_active":"2024-04-26T22:00:11.880653+0000","last_became_peered":"2024-04-26T22:00:11.880653+0000","last_unstale":"2024-04-26T22:00:11.889525+0000","last_undegraded":"2024-04-26T22:00:11.889525+0000","last_fullsized":"2024-04-26T22:00:11.889525+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:22.240513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872946+0000","last_change":"2024-04-26T22:00:11.872946+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872946+0000","last_undegraded":"2024-04-26T22:00:11.872946+0000","last_fullsized":"2024-04-26T22:00:11.872946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892724+0000","last_change":"2024-04-26T22:00:11.890718+0000","last_active":"2024-04-26T22:00:11.892724+0000","last_peered":"2024-04-26T22:00:11.892724+0000","last_clean":"2024-04-26T22:00:11.892724+0000","last_became_active":"2024-04-26T22:00:11.890389+0000","last_became_peered":"2024-04-26T22:00:11.890389+0000","last_unstale":"2024-04-26T22:00:11.892724+0000","last_undegraded":"2024-04-26T22:00:11.892724+0000","last_fullsized":"2024-04-26T22:00:11.892724+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:06.146600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873665+0000","last_change":"2024-04-26T22:00:11.873665+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873665+0000","last_undegraded":"2024-04-26T22:00:11.873665+0000","last_fullsized":"2024-04-26T22:00:11.873665+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886509+0000","last_change":"2024-04-26T22:00:11.881392+0000","last_active":"2024-04-26T22:00:11.886509+0000","last_peered":"2024-04-26T22:00:11.886509+0000","last_clean":"2024-04-26T22:00:11.886509+0000","last_became_active":"2024-04-26T22:00:11.881088+0000","last_became_peered":"2024-04-26T22:00:11.881088+0000","last_unstale":"2024-04-26T22:00:11.886509+0000","last_undegraded":"2024-04-26T22:00:11.886509+0000","last_fullsized":"2024-04-26T22:00:11.886509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:25.098175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.877945+0000","last_change":"2024-04-26T22:00:11.877945+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.877945+0000","last_undegraded":"2024-04-26T22:00:11.877945+0000","last_fullsized":"2024-04-26T22:00:11.877945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.883174+0000","last_change":"2024-04-26T22:00:11.881410+0000","last_active":"2024-04-26T22:00:11.883174+0000","last_peered":"2024-04-26T22:00:11.883174+0000","last_clean":"2024-04-26T22:00:11.883174+0000","last_became_active":"2024-04-26T22:00:11.881152+0000","last_became_peered":"2024-04-26T22:00:11.881152+0000","last_unstale":"2024-04-26T22:00:11.883174+0000","last_undegraded":"2024-04-26T22:00:11.883174+0000","last_fullsized":"2024-04-26T22:00:11.883174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:14.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.877557+0000","last_change":"2024-04-26T22:00:11.877557+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.877557+0000","last_undegraded":"2024-04-26T22:00:11.877557+0000","last_fullsized":"2024-04-26T22:00:11.877557+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892427+0000","last_change":"2024-04-26T22:00:11.887429+0000","last_active":"2024-04-26T22:00:11.892427+0000","last_peered":"2024-04-26T22:00:11.892427+0000","last_clean":"2024-04-26T22:00:11.892427+0000","last_became_active":"2024-04-26T22:00:11.887126+0000","last_became_peered":"2024-04-26T22:00:11.887126+0000","last_unstale":"2024-04-26T22:00:11.892427+0000","last_undegraded":"2024-04-26T22:00:11.892427+0000","last_fullsized":"2024-04-26T22:00:11.892427+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:04.876803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873501+0000","last_change":"2024-04-26T22:00:11.873501+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873501+0000","last_undegraded":"2024-04-26T22:00:11.873501+0000","last_fullsized":"2024-04-26T22:00:11.873501+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892376+0000","last_change":"2024-04-26T22:00:11.884714+0000","last_active":"2024-04-26T22:00:11.892376+0000","last_peered":"2024-04-26T22:00:11.892376+0000","last_clean":"2024-04-26T22:00:11.892376+0000","last_became_active":"2024-04-26T22:00:11.884458+0000","last_became_peered":"2024-04-26T22:00:11.884458+0000","last_unstale":"2024-04-26T22:00:11.892376+0000","last_undegraded":"2024-04-26T22:00:11.892376+0000","last_fullsized":"2024-04-26T22:00:11.892376+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:01.295815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875898+0000","last_change":"2024-04-26T22:00:11.875898+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875898+0000","last_undegraded":"2024-04-26T22:00:11.875898+0000","last_fullsized":"2024-04-26T22:00:11.875898+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.888543+0000","last_change":"2024-04-26T22:00:11.887720+0000","last_active":"2024-04-26T22:00:11.888543+0000","last_peered":"2024-04-26T22:00:11.888543+0000","last_clean":"2024-04-26T22:00:11.888543+0000","last_became_active":"2024-04-26T22:00:11.887407+0000","last_became_peered":"2024-04-26T22:00:11.887407+0000","last_unstale":"2024-04-26T22:00:11.888543+0000","last_undegraded":"2024-04-26T22:00:11.888543+0000","last_fullsized":"2024-04-26T22:00:11.888543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:07.267948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873985+0000","last_change":"2024-04-26T22:00:11.873985+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873985+0000","last_undegraded":"2024-04-26T22:00:11.873985+0000","last_fullsized":"2024-04-26T22:00:11.873985+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.880188+0000","last_change":"2024-04-26T22:00:11.875970+0000","last_active":"2024-04-26T22:00:11.880188+0000","last_peered":"2024-04-26T22:00:11.880188+0000","last_clean":"2024-04-26T22:00:11.880188+0000","last_became_active":"2024-04-26T22:00:11.875677+0000","last_became_peered":"2024-04-26T22:00:11.875677+0000","last_unstale":"2024-04-26T22:00:11.880188+0000","last_undegraded":"2024-04-26T22:00:11.880188+0000","last_fullsized":"2024-04-26T22:00:11.880188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:28.812254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873120+0000","last_change":"2024-04-26T22:00:11.873120+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873120+0000","last_undegraded":"2024-04-26T22:00:11.873120+0000","last_fullsized":"2024-04-26T22:00:11.873120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.885022+0000","last_change":"2024-04-26T22:00:11.881790+0000","last_active":"2024-04-26T22:00:11.885022+0000","last_peered":"2024-04-26T22:00:11.885022+0000","last_clean":"2024-04-26T22:00:11.885022+0000","last_became_active":"2024-04-26T22:00:11.881500+0000","last_became_peered":"2024-04-26T22:00:11.881500+0000","last_unstale":"2024-04-26T22:00:11.885022+0000","last_undegraded":"2024-04-26T22:00:11.885022+0000","last_fullsized":"2024-04-26T22:00:11.885022+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:05.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879691+0000","last_change":"2024-04-26T22:00:11.879691+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879691+0000","last_undegraded":"2024-04-26T22:00:11.879691+0000","last_fullsized":"2024-04-26T22:00:11.879691+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889529+0000","last_change":"2024-04-26T22:00:11.880307+0000","last_active":"2024-04-26T22:00:11.889529+0000","last_peered":"2024-04-26T22:00:11.889529+0000","last_clean":"2024-04-26T22:00:11.889529+0000","last_became_active":"2024-04-26T22:00:11.879974+0000","last_became_peered":"2024-04-26T22:00:11.879974+0000","last_unstale":"2024-04-26T22:00:11.889529+0000","last_undegraded":"2024-04-26T22:00:11.889529+0000","last_fullsized":"2024-04-26T22:00:11.889529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:03.645360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872363+0000","last_change":"2024-04-26T22:00:11.872363+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872363+0000","last_undegraded":"2024-04-26T22:00:11.872363+0000","last_fullsized":"2024-04-26T22:00:11.872363+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886091+0000","last_change":"2024-04-26T22:00:11.884583+0000","last_active":"2024-04-26T22:00:11.886091+0000","last_peered":"2024-04-26T22:00:11.886091+0000","last_clean":"2024-04-26T22:00:11.886091+0000","last_became_active":"2024-04-26T22:00:11.884020+0000","last_became_peered":"2024-04-26T22:00:11.884020+0000","last_unstale":"2024-04-26T22:00:11.886091+0000","last_undegraded":"2024-04-26T22:00:11.886091+0000","last_fullsized":"2024-04-26T22:00:11.886091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:07.267948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870252+0000","last_change":"2024-04-26T22:00:11.870252+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870252+0000","last_undegraded":"2024-04-26T22:00:11.870252+0000","last_fullsized":"2024-04-26T22:00:11.870252+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889956+0000","last_change":"2024-04-26T22:00:11.882987+0000","last_active":"2024-04-26T22:00:11.889956+0000","last_peered":"2024-04-26T22:00:11.889956+0000","last_clean":"2024-04-26T22:00:11.889956+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:11.889956+0000","last_undegraded":"2024-04-26T22:00:11.889956+0000","last_fullsized":"2024-04-26T22:00:11.889956+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:21.325594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872992+0000","last_change":"2024-04-26T22:00:11.872992+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872992+0000","last_undegraded":"2024-04-26T22:00:11.872992+0000","last_fullsized":"2024-04-26T22:00:11.872992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.885029+0000","last_change":"2024-04-26T22:00:11.882822+0000","last_active":"2024-04-26T22:00:11.885029+0000","last_peered":"2024-04-26T22:00:11.885029+0000","last_clean":"2024-04-26T22:00:11.885029+0000","last_became_active":"2024-04-26T22:00:11.882569+0000","last_became_peered":"2024-04-26T22:00:11.882569+0000","last_unstale":"2024-04-26T22:00:11.885029+0000","last_undegraded":"2024-04-26T22:00:11.885029+0000","last_fullsized":"2024-04-26T22:00:11.885029+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:14.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.878596+0000","last_change":"2024-04-26T22:00:11.878596+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.878596+0000","last_undegraded":"2024-04-26T22:00:11.878596+0000","last_fullsized":"2024-04-26T22:00:11.878596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887702+0000","last_change":"2024-04-26T22:00:11.884725+0000","last_active":"2024-04-26T22:00:11.887702+0000","last_peered":"2024-04-26T22:00:11.887702+0000","last_clean":"2024-04-26T22:00:11.887702+0000","last_became_active":"2024-04-26T22:00:11.884448+0000","last_became_peered":"2024-04-26T22:00:11.884448+0000","last_unstale":"2024-04-26T22:00:11.887702+0000","last_undegraded":"2024-04-26T22:00:11.887702+0000","last_fullsized":"2024-04-26T22:00:11.887702+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:55.814565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874489+0000","last_change":"2024-04-26T22:00:11.874489+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874489+0000","last_undegraded":"2024-04-26T22:00:11.874489+0000","last_fullsized":"2024-04-26T22:00:11.874489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.890418+0000","last_change":"2024-04-26T22:00:11.887954+0000","last_active":"2024-04-26T22:00:11.890418+0000","last_peered":"2024-04-26T22:00:11.890418+0000","last_clean":"2024-04-26T22:00:11.890418+0000","last_became_active":"2024-04-26T22:00:11.887653+0000","last_became_peered":"2024-04-26T22:00:11.887653+0000","last_unstale":"2024-04-26T22:00:11.890418+0000","last_undegraded":"2024-04-26T22:00:11.890418+0000","last_fullsized":"2024-04-26T22:00:11.890418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:55.814565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870509+0000","last_change":"2024-04-26T22:00:11.870509+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870509+0000","last_undegraded":"2024-04-26T22:00:11.870509+0000","last_fullsized":"2024-04-26T22:00:11.870509+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892447+0000","last_change":"2024-04-26T22:00:11.882774+0000","last_active":"2024-04-26T22:00:11.892447+0000","last_peered":"2024-04-26T22:00:11.892447+0000","last_clean":"2024-04-26T22:00:11.892447+0000","last_became_active":"2024-04-26T22:00:11.882439+0000","last_became_peered":"2024-04-26T22:00:11.882439+0000","last_unstale":"2024-04-26T22:00:11.892447+0000","last_undegraded":"2024-04-26T22:00:11.892447+0000","last_fullsized":"2024-04-26T22:00:11.892447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:25.098175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875081+0000","last_change":"2024-04-26T22:00:11.875081+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875081+0000","last_undegraded":"2024-04-26T22:00:11.875081+0000","last_fullsized":"2024-04-26T22:00:11.875081+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886225+0000","last_change":"2024-04-26T22:00:11.884787+0000","last_active":"2024-04-26T22:00:11.886225+0000","last_peered":"2024-04-26T22:00:11.886225+0000","last_clean":"2024-04-26T22:00:11.886225+0000","last_became_active":"2024-04-26T22:00:11.884493+0000","last_became_peered":"2024-04-26T22:00:11.884493+0000","last_unstale":"2024-04-26T22:00:11.886225+0000","last_undegraded":"2024-04-26T22:00:11.886225+0000","last_fullsized":"2024-04-26T22:00:11.886225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:33.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.873495+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:00:11.873495+0000","last_peered":"2024-04-26T22:00:11.873495+0000","last_clean":"2024-04-26T22:00:11.873495+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:00:11.873495+0000","last_undegraded":"2024-04-26T22:00:11.873495+0000","last_fullsized":"2024-04-26T22:00:11.873495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":797079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1110016,"data_stored":797079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:00:16.192 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:00:16.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.325+0000 7fb245e7e640 1 Processor -- start 2024-04-26T22:00:16.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.325+0000 7fb245e7e640 1 -- start start 2024-04-26T22:00:16.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb245e7e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb24015f1e0 0x7fb24006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb245e7e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2400b4a10 con 0x7fb24006d2b0 2024-04-26T22:00:16.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb245e7e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2400b4cf0 con 0x7fb2400b44e0 2024-04-26T22:00:16.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb245e7e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb24006eeb0 con 0x7fb24015f1e0 2024-04-26T22:00:16.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb23f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb24015f1e0 0x7fb24006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:16.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb23ffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb24006d2b0 0x7fb2400b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:35332/0 (socket says 172.21.15.137:35332) 2024-04-26T22:00:16.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb23f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb24015f1e0 0x7fb24006e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38100/0 (socket says 172.21.15.137:38100) 2024-04-26T22:00:16.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb23ffff640 1 -- 172.21.15.137:0/4145574476 learned_addr learned my addr 172.21.15.137:0/4145574476 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:16.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb23f7fe640 1 -- 172.21.15.137:0/4145574476 >> v1:172.21.15.170:6789/0 conn(0x7fb2400b44e0 legacy=0x7fb2400ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:16.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb23f7fe640 1 -- 172.21.15.137:0/4145574476 >> v1:172.21.15.137:6789/0 conn(0x7fb24006d2b0 legacy=0x7fb2400b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.326+0000 7fb23f7fe640 1 -- 172.21.15.137:0/4145574476 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2400b4fd0 con 0x7fb24015f1e0 2024-04-26T22:00:16.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.327+0000 7fb23f7fe640 1 --2- 172.21.15.137:0/4145574476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24015f1e0 0x7fb24006e970 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097a0 tx=0x7fb23002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a71eea2f20ece15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:16.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.327+0000 7fb23e7fc640 1 -- 172.21.15.137:0/4145574476 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230037070 con 0x7fb24015f1e0 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.327+0000 7fb23e7fc640 1 -- 172.21.15.137:0/4145574476 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb230032440 con 0x7fb24015f1e0 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.327+0000 7fb23e7fc640 1 -- 172.21.15.137:0/4145574476 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230032810 con 0x7fb24015f1e0 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.327+0000 7fb245e7e640 1 -- 172.21.15.137:0/4145574476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24015f1e0 msgr2=0x7fb24006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.327+0000 7fb245e7e640 1 --2- 172.21.15.137:0/4145574476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24015f1e0 0x7fb24006e970 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097a0 tx=0x7fb23002a1e0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.328+0000 7fb245e7e640 1 -- 172.21.15.137:0/4145574476 shutdown_connections 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.328+0000 7fb245e7e640 1 --2- 172.21.15.137:0/4145574476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24015f1e0 0x7fb24006e970 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.328+0000 7fb245e7e640 1 -- 172.21.15.137:0/4145574476 >> 172.21.15.137:0/4145574476 conn(0x7fb2400728a0 msgr2=0x7fb240072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.328+0000 7fb245e7e640 1 -- 172.21.15.137:0/4145574476 shutdown_connections 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.328+0000 7fb245e7e640 1 -- 172.21.15.137:0/4145574476 wait complete. 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.329+0000 7fb245e7e640 1 Processor -- start 2024-04-26T22:00:16.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.329+0000 7fb245e7e640 1 -- start start 2024-04-26T22:00:16.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.329+0000 7fb245e7e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24006d2b0 0x7fb24015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.329+0000 7fb245e7e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2400b44e0 0x7fb240143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.329+0000 7fb245e7e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb24015f1e0 0x7fb24015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb245e7e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb24015f5c0 con 0x7fb24006d2b0 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb245e7e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb2400b5590 con 0x7fb24015f1e0 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb245e7e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb24015c900 con 0x7fb2400b44e0 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb23f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24006d2b0 0x7fb24015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb23f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24006d2b0 0x7fb24015cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38102/0 (socket says 172.21.15.137:38102) 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb23f7fe640 1 -- 172.21.15.137:0/713498847 learned_addr learned my addr 172.21.15.137:0/713498847 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb23f7fe640 1 -- 172.21.15.137:0/713498847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2400b44e0 msgr2=0x7fb240143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb23f7fe640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2400b44e0 0x7fb240143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb23f7fe640 1 -- 172.21.15.137:0/713498847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb24015f1e0 msgr2=0x7fb24015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb23f7fe640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb24015f1e0 0x7fb24015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb23f7fe640 1 -- 172.21.15.137:0/713498847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24015ba50 con 0x7fb24006d2b0 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb23f7fe640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24006d2b0 0x7fb24015cd90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb230000c00 tx=0x7fb2300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb227fff640 1 -- 172.21.15.137:0/713498847 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230037040 con 0x7fb24006d2b0 2024-04-26T22:00:16.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb227fff640 1 -- 172.21.15.137:0/713498847 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb230042070 con 0x7fb24006d2b0 2024-04-26T22:00:16.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24015bcf0 con 0x7fb24006d2b0 2024-04-26T22:00:16.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb227fff640 1 -- 172.21.15.137:0/713498847 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230030a70 con 0x7fb24006d2b0 2024-04-26T22:00:16.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.330+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24015c2b0 con 0x7fb24006d2b0 2024-04-26T22:00:16.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.331+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb24006a290 con 0x7fb24006d2b0 2024-04-26T22:00:16.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.332+0000 7fb227fff640 1 -- 172.21.15.137:0/713498847 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb230030c10 con 0x7fb24006d2b0 2024-04-26T22:00:16.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.332+0000 7fb227fff640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb22c06c8f0 0x7fb22c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.332+0000 7fb227fff640 1 -- 172.21.15.137:0/713498847 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb2300ac630 con 0x7fb24006d2b0 2024-04-26T22:00:16.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.332+0000 7fb23effd640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb22c06c8f0 0x7fb22c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:16.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.332+0000 7fb23effd640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb22c06c8f0 0x7fb22c06edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb2400afbc0 tx=0x7fb2340079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:16.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.336+0000 7fb227fff640 1 -- 172.21.15.137:0/713498847 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb23007aa60 con 0x7fb24006d2b0 2024-04-26T22:00:16.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.510+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb240073710 con 0x7fb22c06c8f0 2024-04-26T22:00:16.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.516+0000 7fb227fff640 1 -- 172.21.15.137:0/713498847 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7fb234014400 con 0x7fb22c06c8f0 2024-04-26T22:00:16.519 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:16.520 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:00:16.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb22c06c8f0 msgr2=0x7fb22c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb22c06c8f0 0x7fb22c06edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb2400afbc0 tx=0x7fb2340079b0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24006d2b0 msgr2=0x7fb24015cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24006d2b0 0x7fb24015cd90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb230000c00 tx=0x7fb2300046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 shutdown_connections 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb22c06c8f0 0x7fb22c06edb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb24015f1e0 0x7fb24015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb2400b44e0 0x7fb240143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 --2- 172.21.15.137:0/713498847 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb24006d2b0 0x7fb24015cd90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 >> 172.21.15.137:0/713498847 conn(0x7fb2400728a0 msgr2=0x7fb240070680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 shutdown_connections 2024-04-26T22:00:16.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.519+0000 7fb245e7e640 1 -- 172.21.15.137:0/713498847 wait complete. 2024-04-26T22:00:16.530 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-26T22:00:14.711652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237992,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736728,"statfs":{"total":773094113280,"available":772850409472,"internally_reserved":0,"allocated":5316608,"data_stored":2834424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000820"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.871194+0000","last_change":"2024-04-26T22:00:11.871194+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.871194+0000","last_undegraded":"2024-04-26T22:00:11.871194+0000","last_fullsized":"2024-04-26T22:00:11.871194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874539+0000","last_change":"2024-04-26T22:00:11.874539+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874539+0000","last_undegraded":"2024-04-26T22:00:11.874539+0000","last_fullsized":"2024-04-26T22:00:11.874539+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872529+0000","last_change":"2024-04-26T22:00:11.872529+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872529+0000","last_undegraded":"2024-04-26T22:00:11.872529+0000","last_fullsized":"2024-04-26T22:00:11.872529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880788+0000","last_change":"2024-04-26T22:00:11.880788+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880788+0000","last_undegraded":"2024-04-26T22:00:11.880788+0000","last_fullsized":"2024-04-26T22:00:11.880788+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874852+0000","last_change":"2024-04-26T22:00:11.874852+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874852+0000","last_undegraded":"2024-04-26T22:00:11.874852+0000","last_fullsized":"2024-04-26T22:00:11.874852+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873945+0000","last_change":"2024-04-26T22:00:11.873945+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873945+0000","last_undegraded":"2024-04-26T22:00:11.873945+0000","last_fullsized":"2024-04-26T22:00:11.873945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870799+0000","last_change":"2024-04-26T22:00:11.870799+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870799+0000","last_undegraded":"2024-04-26T22:00:11.870799+0000","last_fullsized":"2024-04-26T22:00:11.870799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880282+0000","last_change":"2024-04-26T22:00:11.880282+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880282+0000","last_undegraded":"2024-04-26T22:00:11.880282+0000","last_fullsized":"2024-04-26T22:00:11.880282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874589+0000","last_change":"2024-04-26T22:00:11.874589+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874589+0000","last_undegraded":"2024-04-26T22:00:11.874589+0000","last_fullsized":"2024-04-26T22:00:11.874589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875477+0000","last_change":"2024-04-26T22:00:11.875477+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875477+0000","last_undegraded":"2024-04-26T22:00:11.875477+0000","last_fullsized":"2024-04-26T22:00:11.875477+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875140+0000","last_change":"2024-04-26T22:00:11.875140+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875140+0000","last_undegraded":"2024-04-26T22:00:11.875140+0000","last_fullsized":"2024-04-26T22:00:11.875140+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876023+0000","last_change":"2024-04-26T22:00:11.876023+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876023+0000","last_undegraded":"2024-04-26T22:00:11.876023+0000","last_fullsized":"2024-04-26T22:00:11.876023+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872908+0000","last_change":"2024-04-26T22:00:11.872908+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872908+0000","last_undegraded":"2024-04-26T22:00:11.872908+0000","last_fullsized":"2024-04-26T22:00:11.872908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875038+0000","last_change":"2024-04-26T22:00:11.875038+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875038+0000","last_undegraded":"2024-04-26T22:00:11.875038+0000","last_fullsized":"2024-04-26T22:00:11.875038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874069+0000","last_change":"2024-04-26T22:00:11.874069+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874069+0000","last_undegraded":"2024-04-26T22:00:11.874069+0000","last_fullsized":"2024-04-26T22:00:11.874069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879074+0000","last_change":"2024-04-26T22:00:11.879074+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879074+0000","last_undegraded":"2024-04-26T22:00:11.879074+0000","last_fullsized":"2024-04-26T22:00:11.879074+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873144+0000","last_change":"2024-04-26T22:00:11.873144+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873144+0000","last_undegraded":"2024-04-26T22:00:11.873144+0000","last_fullsized":"2024-04-26T22:00:11.873144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873220+0000","last_change":"2024-04-26T22:00:11.873220+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873220+0000","last_undegraded":"2024-04-26T22:00:11.873220+0000","last_fullsized":"2024-04-26T22:00:11.873220+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876590+0000","last_change":"2024-04-26T22:00:11.876590+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876590+0000","last_undegraded":"2024-04-26T22:00:11.876590+0000","last_fullsized":"2024-04-26T22:00:11.876590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875133+0000","last_change":"2024-04-26T22:00:11.875133+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875133+0000","last_undegraded":"2024-04-26T22:00:11.875133+0000","last_fullsized":"2024-04-26T22:00:11.875133+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879213+0000","last_change":"2024-04-26T22:00:11.879213+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879213+0000","last_undegraded":"2024-04-26T22:00:11.879213+0000","last_fullsized":"2024-04-26T22:00:11.879213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874569+0000","last_change":"2024-04-26T22:00:11.874569+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874569+0000","last_undegraded":"2024-04-26T22:00:11.874569+0000","last_fullsized":"2024-04-26T22:00:11.874569+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879112+0000","last_change":"2024-04-26T22:00:11.879112+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879112+0000","last_undegraded":"2024-04-26T22:00:11.879112+0000","last_fullsized":"2024-04-26T22:00:11.879112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875399+0000","last_change":"2024-04-26T22:00:11.875399+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875399+0000","last_undegraded":"2024-04-26T22:00:11.875399+0000","last_fullsized":"2024-04-26T22:00:11.875399+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.881178+0000","last_change":"2024-04-26T22:00:11.881178+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.881178+0000","last_undegraded":"2024-04-26T22:00:11.881178+0000","last_fullsized":"2024-04-26T22:00:11.881178+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873493+0000","last_change":"2024-04-26T22:00:11.873493+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873493+0000","last_undegraded":"2024-04-26T22:00:11.873493+0000","last_fullsized":"2024-04-26T22:00:11.873493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870587+0000","last_change":"2024-04-26T22:00:11.870587+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870587+0000","last_undegraded":"2024-04-26T22:00:11.870587+0000","last_fullsized":"2024-04-26T22:00:11.870587+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875613+0000","last_change":"2024-04-26T22:00:11.875613+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875613+0000","last_undegraded":"2024-04-26T22:00:11.875613+0000","last_fullsized":"2024-04-26T22:00:11.875613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.878613+0000","last_change":"2024-04-26T22:00:11.878613+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.878613+0000","last_undegraded":"2024-04-26T22:00:11.878613+0000","last_fullsized":"2024-04-26T22:00:11.878613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872101+0000","last_change":"2024-04-26T22:00:11.872101+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872101+0000","last_undegraded":"2024-04-26T22:00:11.872101+0000","last_fullsized":"2024-04-26T22:00:11.872101+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873652+0000","last_change":"2024-04-26T22:00:11.873652+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873652+0000","last_undegraded":"2024-04-26T22:00:11.873652+0000","last_fullsized":"2024-04-26T22:00:11.873652+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874364+0000","last_change":"2024-04-26T22:00:11.874364+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874364+0000","last_undegraded":"2024-04-26T22:00:11.874364+0000","last_fullsized":"2024-04-26T22:00:11.874364+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876896+0000","last_change":"2024-04-26T22:00:11.876896+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876896+0000","last_undegraded":"2024-04-26T22:00:11.876896+0000","last_fullsized":"2024-04-26T22:00:11.876896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892465+0000","last_change":"2024-04-26T22:00:11.887450+0000","last_active":"2024-04-26T22:00:11.892465+0000","last_peered":"2024-04-26T22:00:11.892465+0000","last_clean":"2024-04-26T22:00:11.892465+0000","last_became_active":"2024-04-26T22:00:11.887100+0000","last_became_peered":"2024-04-26T22:00:11.887100+0000","last_unstale":"2024-04-26T22:00:11.892465+0000","last_undegraded":"2024-04-26T22:00:11.892465+0000","last_fullsized":"2024-04-26T22:00:11.892465+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:58.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880786+0000","last_change":"2024-04-26T22:00:11.880786+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880786+0000","last_undegraded":"2024-04-26T22:00:11.880786+0000","last_fullsized":"2024-04-26T22:00:11.880786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887804+0000","last_change":"2024-04-26T22:00:11.882486+0000","last_active":"2024-04-26T22:00:11.887804+0000","last_peered":"2024-04-26T22:00:11.887804+0000","last_clean":"2024-04-26T22:00:11.887804+0000","last_became_active":"2024-04-26T22:00:11.882256+0000","last_became_peered":"2024-04-26T22:00:11.882256+0000","last_unstale":"2024-04-26T22:00:11.887804+0000","last_undegraded":"2024-04-26T22:00:11.887804+0000","last_fullsized":"2024-04-26T22:00:11.887804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:33.271613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875200+0000","last_change":"2024-04-26T22:00:11.875200+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875200+0000","last_undegraded":"2024-04-26T22:00:11.875200+0000","last_fullsized":"2024-04-26T22:00:11.875200+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889980+0000","last_change":"2024-04-26T22:00:11.882943+0000","last_active":"2024-04-26T22:00:11.889980+0000","last_peered":"2024-04-26T22:00:11.889980+0000","last_clean":"2024-04-26T22:00:11.889980+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:11.889980+0000","last_undegraded":"2024-04-26T22:00:11.889980+0000","last_fullsized":"2024-04-26T22:00:11.889980+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:33.271613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876300+0000","last_change":"2024-04-26T22:00:11.876300+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876300+0000","last_undegraded":"2024-04-26T22:00:11.876300+0000","last_fullsized":"2024-04-26T22:00:11.876300+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.884005+0000","last_change":"2024-04-26T22:00:11.879917+0000","last_active":"2024-04-26T22:00:11.884005+0000","last_peered":"2024-04-26T22:00:11.884005+0000","last_clean":"2024-04-26T22:00:11.884005+0000","last_became_active":"2024-04-26T22:00:11.879301+0000","last_became_peered":"2024-04-26T22:00:11.879301+0000","last_unstale":"2024-04-26T22:00:11.884005+0000","last_undegraded":"2024-04-26T22:00:11.884005+0000","last_fullsized":"2024-04-26T22:00:11.884005+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:50.350527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.871550+0000","last_change":"2024-04-26T22:00:11.871550+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.871550+0000","last_undegraded":"2024-04-26T22:00:11.871550+0000","last_fullsized":"2024-04-26T22:00:11.871550+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892400+0000","last_change":"2024-04-26T22:00:11.884768+0000","last_active":"2024-04-26T22:00:11.892400+0000","last_peered":"2024-04-26T22:00:11.892400+0000","last_clean":"2024-04-26T22:00:11.892400+0000","last_became_active":"2024-04-26T22:00:11.884497+0000","last_became_peered":"2024-04-26T22:00:11.884497+0000","last_unstale":"2024-04-26T22:00:11.892400+0000","last_undegraded":"2024-04-26T22:00:11.892400+0000","last_fullsized":"2024-04-26T22:00:11.892400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:48.325283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874185+0000","last_change":"2024-04-26T22:00:11.874185+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874185+0000","last_undegraded":"2024-04-26T22:00:11.874185+0000","last_fullsized":"2024-04-26T22:00:11.874185+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.881969+0000","last_change":"2024-04-26T22:00:11.878473+0000","last_active":"2024-04-26T22:00:11.881969+0000","last_peered":"2024-04-26T22:00:11.881969+0000","last_clean":"2024-04-26T22:00:11.881969+0000","last_became_active":"2024-04-26T22:00:11.878195+0000","last_became_peered":"2024-04-26T22:00:11.878195+0000","last_unstale":"2024-04-26T22:00:11.881969+0000","last_undegraded":"2024-04-26T22:00:11.881969+0000","last_fullsized":"2024-04-26T22:00:11.881969+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:07.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874070+0000","last_change":"2024-04-26T22:00:11.874070+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874070+0000","last_undegraded":"2024-04-26T22:00:11.874070+0000","last_fullsized":"2024-04-26T22:00:11.874070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.883126+0000","last_change":"2024-04-26T22:00:11.880991+0000","last_active":"2024-04-26T22:00:11.883126+0000","last_peered":"2024-04-26T22:00:11.883126+0000","last_clean":"2024-04-26T22:00:11.883126+0000","last_became_active":"2024-04-26T22:00:11.880707+0000","last_became_peered":"2024-04-26T22:00:11.880707+0000","last_unstale":"2024-04-26T22:00:11.883126+0000","last_undegraded":"2024-04-26T22:00:11.883126+0000","last_fullsized":"2024-04-26T22:00:11.883126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:05.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879532+0000","last_change":"2024-04-26T22:00:11.879532+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879532+0000","last_undegraded":"2024-04-26T22:00:11.879532+0000","last_fullsized":"2024-04-26T22:00:11.879532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892362+0000","last_change":"2024-04-26T22:00:11.881712+0000","last_active":"2024-04-26T22:00:11.892362+0000","last_peered":"2024-04-26T22:00:11.892362+0000","last_clean":"2024-04-26T22:00:11.892362+0000","last_became_active":"2024-04-26T22:00:11.881009+0000","last_became_peered":"2024-04-26T22:00:11.881009+0000","last_unstale":"2024-04-26T22:00:11.892362+0000","last_undegraded":"2024-04-26T22:00:11.892362+0000","last_fullsized":"2024-04-26T22:00:11.892362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:07.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872193+0000","last_change":"2024-04-26T22:00:11.872193+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872193+0000","last_undegraded":"2024-04-26T22:00:11.872193+0000","last_fullsized":"2024-04-26T22:00:11.872193+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887657+0000","last_change":"2024-04-26T22:00:11.884051+0000","last_active":"2024-04-26T22:00:11.887657+0000","last_peered":"2024-04-26T22:00:11.887657+0000","last_clean":"2024-04-26T22:00:11.887657+0000","last_became_active":"2024-04-26T22:00:11.883778+0000","last_became_peered":"2024-04-26T22:00:11.883778+0000","last_unstale":"2024-04-26T22:00:11.887657+0000","last_undegraded":"2024-04-26T22:00:11.887657+0000","last_fullsized":"2024-04-26T22:00:11.887657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:21.325594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870481+0000","last_change":"2024-04-26T22:00:11.870481+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870481+0000","last_undegraded":"2024-04-26T22:00:11.870481+0000","last_fullsized":"2024-04-26T22:00:11.870481+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.880225+0000","last_change":"2024-04-26T22:00:11.876171+0000","last_active":"2024-04-26T22:00:11.880225+0000","last_peered":"2024-04-26T22:00:11.880225+0000","last_clean":"2024-04-26T22:00:11.880225+0000","last_became_active":"2024-04-26T22:00:11.875895+0000","last_became_peered":"2024-04-26T22:00:11.875895+0000","last_unstale":"2024-04-26T22:00:11.880225+0000","last_undegraded":"2024-04-26T22:00:11.880225+0000","last_fullsized":"2024-04-26T22:00:11.880225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:22.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875630+0000","last_change":"2024-04-26T22:00:11.875630+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875630+0000","last_undegraded":"2024-04-26T22:00:11.875630+0000","last_fullsized":"2024-04-26T22:00:11.875630+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886070+0000","last_change":"2024-04-26T22:00:11.884653+0000","last_active":"2024-04-26T22:00:11.886070+0000","last_peered":"2024-04-26T22:00:11.886070+0000","last_clean":"2024-04-26T22:00:11.886070+0000","last_became_active":"2024-04-26T22:00:11.884363+0000","last_became_peered":"2024-04-26T22:00:11.884363+0000","last_unstale":"2024-04-26T22:00:11.886070+0000","last_undegraded":"2024-04-26T22:00:11.886070+0000","last_fullsized":"2024-04-26T22:00:11.886070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:33.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872112+0000","last_change":"2024-04-26T22:00:11.872112+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872112+0000","last_undegraded":"2024-04-26T22:00:11.872112+0000","last_fullsized":"2024-04-26T22:00:11.872112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889666+0000","last_change":"2024-04-26T22:00:11.883768+0000","last_active":"2024-04-26T22:00:11.889666+0000","last_peered":"2024-04-26T22:00:11.889666+0000","last_clean":"2024-04-26T22:00:11.889666+0000","last_became_active":"2024-04-26T22:00:11.883484+0000","last_became_peered":"2024-04-26T22:00:11.883484+0000","last_unstale":"2024-04-26T22:00:11.889666+0000","last_undegraded":"2024-04-26T22:00:11.889666+0000","last_fullsized":"2024-04-26T22:00:11.889666+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:59.629462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875024+0000","last_change":"2024-04-26T22:00:11.875024+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875024+0000","last_undegraded":"2024-04-26T22:00:11.875024+0000","last_fullsized":"2024-04-26T22:00:11.875024+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.897696+0000","last_change":"2024-04-26T22:00:11.893028+0000","last_active":"2024-04-26T22:00:11.897696+0000","last_peered":"2024-04-26T22:00:11.897696+0000","last_clean":"2024-04-26T22:00:11.897696+0000","last_became_active":"2024-04-26T22:00:11.892704+0000","last_became_peered":"2024-04-26T22:00:11.892704+0000","last_unstale":"2024-04-26T22:00:11.897696+0000","last_undegraded":"2024-04-26T22:00:11.897696+0000","last_fullsized":"2024-04-26T22:00:11.897696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:55.142122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873637+0000","last_change":"2024-04-26T22:00:11.873637+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873637+0000","last_undegraded":"2024-04-26T22:00:11.873637+0000","last_fullsized":"2024-04-26T22:00:11.873637+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887530+0000","last_change":"2024-04-26T22:00:11.885985+0000","last_active":"2024-04-26T22:00:11.887530+0000","last_peered":"2024-04-26T22:00:11.887530+0000","last_clean":"2024-04-26T22:00:11.887530+0000","last_became_active":"2024-04-26T22:00:11.885602+0000","last_became_peered":"2024-04-26T22:00:11.885602+0000","last_unstale":"2024-04-26T22:00:11.887530+0000","last_undegraded":"2024-04-26T22:00:11.887530+0000","last_fullsized":"2024-04-26T22:00:11.887530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:49.855119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875281+0000","last_change":"2024-04-26T22:00:11.875281+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875281+0000","last_undegraded":"2024-04-26T22:00:11.875281+0000","last_fullsized":"2024-04-26T22:00:11.875281+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892890+0000","last_change":"2024-04-26T22:00:11.890223+0000","last_active":"2024-04-26T22:00:11.892890+0000","last_peered":"2024-04-26T22:00:11.892890+0000","last_clean":"2024-04-26T22:00:11.892890+0000","last_became_active":"2024-04-26T22:00:11.889918+0000","last_became_peered":"2024-04-26T22:00:11.889918+0000","last_unstale":"2024-04-26T22:00:11.892890+0000","last_undegraded":"2024-04-26T22:00:11.892890+0000","last_fullsized":"2024-04-26T22:00:11.892890+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:52.959212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870239+0000","last_change":"2024-04-26T22:00:11.870239+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870239+0000","last_undegraded":"2024-04-26T22:00:11.870239+0000","last_fullsized":"2024-04-26T22:00:11.870239+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889525+0000","last_change":"2024-04-26T22:00:11.880931+0000","last_active":"2024-04-26T22:00:11.889525+0000","last_peered":"2024-04-26T22:00:11.889525+0000","last_clean":"2024-04-26T22:00:11.889525+0000","last_became_active":"2024-04-26T22:00:11.880653+0000","last_became_peered":"2024-04-26T22:00:11.880653+0000","last_unstale":"2024-04-26T22:00:11.889525+0000","last_undegraded":"2024-04-26T22:00:11.889525+0000","last_fullsized":"2024-04-26T22:00:11.889525+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:22.240513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872946+0000","last_change":"2024-04-26T22:00:11.872946+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872946+0000","last_undegraded":"2024-04-26T22:00:11.872946+0000","last_fullsized":"2024-04-26T22:00:11.872946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892724+0000","last_change":"2024-04-26T22:00:11.890718+0000","last_active":"2024-04-26T22:00:11.892724+0000","last_peered":"2024-04-26T22:00:11.892724+0000","last_clean":"2024-04-26T22:00:11.892724+0000","last_became_active":"2024-04-26T22:00:11.890389+0000","last_became_peered":"2024-04-26T22:00:11.890389+0000","last_unstale":"2024-04-26T22:00:11.892724+0000","last_undegraded":"2024-04-26T22:00:11.892724+0000","last_fullsized":"2024-04-26T22:00:11.892724+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:06.146600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873665+0000","last_change":"2024-04-26T22:00:11.873665+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873665+0000","last_undegraded":"2024-04-26T22:00:11.873665+0000","last_fullsized":"2024-04-26T22:00:11.873665+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886509+0000","last_change":"2024-04-26T22:00:11.881392+0000","last_active":"2024-04-26T22:00:11.886509+0000","last_peered":"2024-04-26T22:00:11.886509+0000","last_clean":"2024-04-26T22:00:11.886509+0000","last_became_active":"2024-04-26T22:00:11.881088+0000","last_became_peered":"2024-04-26T22:00:11.881088+0000","last_unstale":"2024-04-26T22:00:11.886509+0000","last_undegraded":"2024-04-26T22:00:11.886509+0000","last_fullsized":"2024-04-26T22:00:11.886509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:25.098175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.877945+0000","last_change":"2024-04-26T22:00:11.877945+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.877945+0000","last_undegraded":"2024-04-26T22:00:11.877945+0000","last_fullsized":"2024-04-26T22:00:11.877945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.883174+0000","last_change":"2024-04-26T22:00:11.881410+0000","last_active":"2024-04-26T22:00:11.883174+0000","last_peered":"2024-04-26T22:00:11.883174+0000","last_clean":"2024-04-26T22:00:11.883174+0000","last_became_active":"2024-04-26T22:00:11.881152+0000","last_became_peered":"2024-04-26T22:00:11.881152+0000","last_unstale":"2024-04-26T22:00:11.883174+0000","last_undegraded":"2024-04-26T22:00:11.883174+0000","last_fullsized":"2024-04-26T22:00:11.883174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:14.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.877557+0000","last_change":"2024-04-26T22:00:11.877557+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.877557+0000","last_undegraded":"2024-04-26T22:00:11.877557+0000","last_fullsized":"2024-04-26T22:00:11.877557+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892427+0000","last_change":"2024-04-26T22:00:11.887429+0000","last_active":"2024-04-26T22:00:11.892427+0000","last_peered":"2024-04-26T22:00:11.892427+0000","last_clean":"2024-04-26T22:00:11.892427+0000","last_became_active":"2024-04-26T22:00:11.887126+0000","last_became_peered":"2024-04-26T22:00:11.887126+0000","last_unstale":"2024-04-26T22:00:11.892427+0000","last_undegraded":"2024-04-26T22:00:11.892427+0000","last_fullsized":"2024-04-26T22:00:11.892427+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:04.876803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873501+0000","last_change":"2024-04-26T22:00:11.873501+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873501+0000","last_undegraded":"2024-04-26T22:00:11.873501+0000","last_fullsized":"2024-04-26T22:00:11.873501+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892376+0000","last_change":"2024-04-26T22:00:11.884714+0000","last_active":"2024-04-26T22:00:11.892376+0000","last_peered":"2024-04-26T22:00:11.892376+0000","last_clean":"2024-04-26T22:00:11.892376+0000","last_became_active":"2024-04-26T22:00:11.884458+0000","last_became_peered":"2024-04-26T22:00:11.884458+0000","last_unstale":"2024-04-26T22:00:11.892376+0000","last_undegraded":"2024-04-26T22:00:11.892376+0000","last_fullsized":"2024-04-26T22:00:11.892376+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:01.295815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875898+0000","last_change":"2024-04-26T22:00:11.875898+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875898+0000","last_undegraded":"2024-04-26T22:00:11.875898+0000","last_fullsized":"2024-04-26T22:00:11.875898+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.888543+0000","last_change":"2024-04-26T22:00:11.887720+0000","last_active":"2024-04-26T22:00:11.888543+0000","last_peered":"2024-04-26T22:00:11.888543+0000","last_clean":"2024-04-26T22:00:11.888543+0000","last_became_active":"2024-04-26T22:00:11.887407+0000","last_became_peered":"2024-04-26T22:00:11.887407+0000","last_unstale":"2024-04-26T22:00:11.888543+0000","last_undegraded":"2024-04-26T22:00:11.888543+0000","last_fullsized":"2024-04-26T22:00:11.888543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:07.267948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873985+0000","last_change":"2024-04-26T22:00:11.873985+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873985+0000","last_undegraded":"2024-04-26T22:00:11.873985+0000","last_fullsized":"2024-04-26T22:00:11.873985+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.880188+0000","last_change":"2024-04-26T22:00:11.875970+0000","last_active":"2024-04-26T22:00:11.880188+0000","last_peered":"2024-04-26T22:00:11.880188+0000","last_clean":"2024-04-26T22:00:11.880188+0000","last_became_active":"2024-04-26T22:00:11.875677+0000","last_became_peered":"2024-04-26T22:00:11.875677+0000","last_unstale":"2024-04-26T22:00:11.880188+0000","last_undegraded":"2024-04-26T22:00:11.880188+0000","last_fullsized":"2024-04-26T22:00:11.880188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:28.812254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873120+0000","last_change":"2024-04-26T22:00:11.873120+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873120+0000","last_undegraded":"2024-04-26T22:00:11.873120+0000","last_fullsized":"2024-04-26T22:00:11.873120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.885022+0000","last_change":"2024-04-26T22:00:11.881790+0000","last_active":"2024-04-26T22:00:11.885022+0000","last_peered":"2024-04-26T22:00:11.885022+0000","last_clean":"2024-04-26T22:00:11.885022+0000","last_became_active":"2024-04-26T22:00:11.881500+0000","last_became_peered":"2024-04-26T22:00:11.881500+0000","last_unstale":"2024-04-26T22:00:11.885022+0000","last_undegraded":"2024-04-26T22:00:11.885022+0000","last_fullsized":"2024-04-26T22:00:11.885022+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:05.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879691+0000","last_change":"2024-04-26T22:00:11.879691+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879691+0000","last_undegraded":"2024-04-26T22:00:11.879691+0000","last_fullsized":"2024-04-26T22:00:11.879691+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889529+0000","last_change":"2024-04-26T22:00:11.880307+0000","last_active":"2024-04-26T22:00:11.889529+0000","last_peered":"2024-04-26T22:00:11.889529+0000","last_clean":"2024-04-26T22:00:11.889529+0000","last_became_active":"2024-04-26T22:00:11.879974+0000","last_became_peered":"2024-04-26T22:00:11.879974+0000","last_unstale":"2024-04-26T22:00:11.889529+0000","last_undegraded":"2024-04-26T22:00:11.889529+0000","last_fullsized":"2024-04-26T22:00:11.889529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:03.645360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872363+0000","last_change":"2024-04-26T22:00:11.872363+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872363+0000","last_undegraded":"2024-04-26T22:00:11.872363+0000","last_fullsized":"2024-04-26T22:00:11.872363+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886091+0000","last_change":"2024-04-26T22:00:11.884583+0000","last_active":"2024-04-26T22:00:11.886091+0000","last_peered":"2024-04-26T22:00:11.886091+0000","last_clean":"2024-04-26T22:00:11.886091+0000","last_became_active":"2024-04-26T22:00:11.884020+0000","last_became_peered":"2024-04-26T22:00:11.884020+0000","last_unstale":"2024-04-26T22:00:11.886091+0000","last_undegraded":"2024-04-26T22:00:11.886091+0000","last_fullsized":"2024-04-26T22:00:11.886091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:07.267948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870252+0000","last_change":"2024-04-26T22:00:11.870252+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870252+0000","last_undegraded":"2024-04-26T22:00:11.870252+0000","last_fullsized":"2024-04-26T22:00:11.870252+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889956+0000","last_change":"2024-04-26T22:00:11.882987+0000","last_active":"2024-04-26T22:00:11.889956+0000","last_peered":"2024-04-26T22:00:11.889956+0000","last_clean":"2024-04-26T22:00:11.889956+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:11.889956+0000","last_undegraded":"2024-04-26T22:00:11.889956+0000","last_fullsized":"2024-04-26T22:00:11.889956+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:21.325594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872992+0000","last_change":"2024-04-26T22:00:11.872992+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872992+0000","last_undegraded":"2024-04-26T22:00:11.872992+0000","last_fullsized":"2024-04-26T22:00:11.872992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.885029+0000","last_change":"2024-04-26T22:00:11.882822+0000","last_active":"2024-04-26T22:00:11.885029+0000","last_peered":"2024-04-26T22:00:11.885029+0000","last_clean":"2024-04-26T22:00:11.885029+0000","last_became_active":"2024-04-26T22:00:11.882569+0000","last_became_peered":"2024-04-26T22:00:11.882569+0000","last_unstale":"2024-04-26T22:00:11.885029+0000","last_undegraded":"2024-04-26T22:00:11.885029+0000","last_fullsized":"2024-04-26T22:00:11.885029+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:14.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.878596+0000","last_change":"2024-04-26T22:00:11.878596+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.878596+0000","last_undegraded":"2024-04-26T22:00:11.878596+0000","last_fullsized":"2024-04-26T22:00:11.878596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887702+0000","last_change":"2024-04-26T22:00:11.884725+0000","last_active":"2024-04-26T22:00:11.887702+0000","last_peered":"2024-04-26T22:00:11.887702+0000","last_clean":"2024-04-26T22:00:11.887702+0000","last_became_active":"2024-04-26T22:00:11.884448+0000","last_became_peered":"2024-04-26T22:00:11.884448+0000","last_unstale":"2024-04-26T22:00:11.887702+0000","last_undegraded":"2024-04-26T22:00:11.887702+0000","last_fullsized":"2024-04-26T22:00:11.887702+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:55.814565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874489+0000","last_change":"2024-04-26T22:00:11.874489+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874489+0000","last_undegraded":"2024-04-26T22:00:11.874489+0000","last_fullsized":"2024-04-26T22:00:11.874489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.890418+0000","last_change":"2024-04-26T22:00:11.887954+0000","last_active":"2024-04-26T22:00:11.890418+0000","last_peered":"2024-04-26T22:00:11.890418+0000","last_clean":"2024-04-26T22:00:11.890418+0000","last_became_active":"2024-04-26T22:00:11.887653+0000","last_became_peered":"2024-04-26T22:00:11.887653+0000","last_unstale":"2024-04-26T22:00:11.890418+0000","last_undegraded":"2024-04-26T22:00:11.890418+0000","last_fullsized":"2024-04-26T22:00:11.890418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:55.814565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870509+0000","last_change":"2024-04-26T22:00:11.870509+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870509+0000","last_undegraded":"2024-04-26T22:00:11.870509+0000","last_fullsized":"2024-04-26T22:00:11.870509+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892447+0000","last_change":"2024-04-26T22:00:11.882774+0000","last_active":"2024-04-26T22:00:11.892447+0000","last_peered":"2024-04-26T22:00:11.892447+0000","last_clean":"2024-04-26T22:00:11.892447+0000","last_became_active":"2024-04-26T22:00:11.882439+0000","last_became_peered":"2024-04-26T22:00:11.882439+0000","last_unstale":"2024-04-26T22:00:11.892447+0000","last_undegraded":"2024-04-26T22:00:11.892447+0000","last_fullsized":"2024-04-26T22:00:11.892447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:25.098175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875081+0000","last_change":"2024-04-26T22:00:11.875081+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875081+0000","last_undegraded":"2024-04-26T22:00:11.875081+0000","last_fullsized":"2024-04-26T22:00:11.875081+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886225+0000","last_change":"2024-04-26T22:00:11.884787+0000","last_active":"2024-04-26T22:00:11.886225+0000","last_peered":"2024-04-26T22:00:11.886225+0000","last_clean":"2024-04-26T22:00:11.886225+0000","last_became_active":"2024-04-26T22:00:11.884493+0000","last_became_peered":"2024-04-26T22:00:11.884493+0000","last_unstale":"2024-04-26T22:00:11.886225+0000","last_undegraded":"2024-04-26T22:00:11.886225+0000","last_fullsized":"2024-04-26T22:00:11.886225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:33.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.873495+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:00:11.873495+0000","last_peered":"2024-04-26T22:00:11.873495+0000","last_clean":"2024-04-26T22:00:11.873495+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:00:11.873495+0000","last_undegraded":"2024-04-26T22:00:11.873495+0000","last_fullsized":"2024-04-26T22:00:11.873495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":797079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1110016,"data_stored":797079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:00:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-04-26T22:00:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.871194+0000', 'last_change': '2024-04-26T22:00:11.871194+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.871194+0000', 'last_undegraded': '2024-04-26T22:00:11.871194+0000', 'last_fullsized': '2024-04-26T22:00:11.871194+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T22:00:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-04-26T22:00:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.874539+0000', 'last_change': '2024-04-26T22:00:11.874539+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.874539+0000', 'last_undegraded': '2024-04-26T22:00:11.874539+0000', 'last_fullsized': '2024-04-26T22:00:11.874539+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T22:00:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-04-26T22:00:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.872529+0000', 'last_change': '2024-04-26T22:00:11.872529+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.872529+0000', 'last_undegraded': '2024-04-26T22:00:11.872529+0000', 'last_fullsized': '2024-04-26T22:00:11.872529+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:00:16.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-04-26T22:00:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.880788+0000', 'last_change': '2024-04-26T22:00:11.880788+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.880788+0000', 'last_undegraded': '2024-04-26T22:00:11.880788+0000', 'last_fullsized': '2024-04-26T22:00:11.880788+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-04-26T22:00:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.874852+0000', 'last_change': '2024-04-26T22:00:11.874852+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.874852+0000', 'last_undegraded': '2024-04-26T22:00:11.874852+0000', 'last_fullsized': '2024-04-26T22:00:11.874852+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T22:00:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-04-26T22:00:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873945+0000', 'last_change': '2024-04-26T22:00:11.873945+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873945+0000', 'last_undegraded': '2024-04-26T22:00:11.873945+0000', 'last_fullsized': '2024-04-26T22:00:11.873945+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:00:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-04-26T22:00:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.870799+0000', 'last_change': '2024-04-26T22:00:11.870799+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.870799+0000', 'last_undegraded': '2024-04-26T22:00:11.870799+0000', 'last_fullsized': '2024-04-26T22:00:11.870799+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T22:00:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-04-26T22:00:16.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.880282+0000', 'last_change': '2024-04-26T22:00:11.880282+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.880282+0000', 'last_undegraded': '2024-04-26T22:00:11.880282+0000', 'last_fullsized': '2024-04-26T22:00:11.880282+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.874589+0000', 'last_change': '2024-04-26T22:00:11.874589+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.874589+0000', 'last_undegraded': '2024-04-26T22:00:11.874589+0000', 'last_fullsized': '2024-04-26T22:00:11.874589+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875477+0000', 'last_change': '2024-04-26T22:00:11.875477+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875477+0000', 'last_undegraded': '2024-04-26T22:00:11.875477+0000', 'last_fullsized': '2024-04-26T22:00:11.875477+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875140+0000', 'last_change': '2024-04-26T22:00:11.875140+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875140+0000', 'last_undegraded': '2024-04-26T22:00:11.875140+0000', 'last_fullsized': '2024-04-26T22:00:11.875140+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.876023+0000', 'last_change': '2024-04-26T22:00:11.876023+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.876023+0000', 'last_undegraded': '2024-04-26T22:00:11.876023+0000', 'last_fullsized': '2024-04-26T22:00:11.876023+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.872908+0000', 'last_change': '2024-04-26T22:00:11.872908+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.872908+0000', 'last_undegraded': '2024-04-26T22:00:11.872908+0000', 'last_fullsized': '2024-04-26T22:00:11.872908+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-04-26T22:00:16.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875038+0000', 'last_change': '2024-04-26T22:00:11.875038+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875038+0000', 'last_undegraded': '2024-04-26T22:00:11.875038+0000', 'last_fullsized': '2024-04-26T22:00:11.875038+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.874069+0000', 'last_change': '2024-04-26T22:00:11.874069+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.874069+0000', 'last_undegraded': '2024-04-26T22:00:11.874069+0000', 'last_fullsized': '2024-04-26T22:00:11.874069+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.879074+0000', 'last_change': '2024-04-26T22:00:11.879074+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.879074+0000', 'last_undegraded': '2024-04-26T22:00:11.879074+0000', 'last_fullsized': '2024-04-26T22:00:11.879074+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873144+0000', 'last_change': '2024-04-26T22:00:11.873144+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873144+0000', 'last_undegraded': '2024-04-26T22:00:11.873144+0000', 'last_fullsized': '2024-04-26T22:00:11.873144+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873220+0000', 'last_change': '2024-04-26T22:00:11.873220+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873220+0000', 'last_undegraded': '2024-04-26T22:00:11.873220+0000', 'last_fullsized': '2024-04-26T22:00:11.873220+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.876590+0000', 'last_change': '2024-04-26T22:00:11.876590+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.876590+0000', 'last_undegraded': '2024-04-26T22:00:11.876590+0000', 'last_fullsized': '2024-04-26T22:00:11.876590+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875133+0000', 'last_change': '2024-04-26T22:00:11.875133+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875133+0000', 'last_undegraded': '2024-04-26T22:00:11.875133+0000', 'last_fullsized': '2024-04-26T22:00:11.875133+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.879213+0000', 'last_change': '2024-04-26T22:00:11.879213+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.879213+0000', 'last_undegraded': '2024-04-26T22:00:11.879213+0000', 'last_fullsized': '2024-04-26T22:00:11.879213+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.874569+0000', 'last_change': '2024-04-26T22:00:11.874569+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.874569+0000', 'last_undegraded': '2024-04-26T22:00:11.874569+0000', 'last_fullsized': '2024-04-26T22:00:11.874569+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.879112+0000', 'last_change': '2024-04-26T22:00:11.879112+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.879112+0000', 'last_undegraded': '2024-04-26T22:00:11.879112+0000', 'last_fullsized': '2024-04-26T22:00:11.879112+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875399+0000', 'last_change': '2024-04-26T22:00:11.875399+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875399+0000', 'last_undegraded': '2024-04-26T22:00:11.875399+0000', 'last_fullsized': '2024-04-26T22:00:11.875399+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.881178+0000', 'last_change': '2024-04-26T22:00:11.881178+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.881178+0000', 'last_undegraded': '2024-04-26T22:00:11.881178+0000', 'last_fullsized': '2024-04-26T22:00:11.881178+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873493+0000', 'last_change': '2024-04-26T22:00:11.873493+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873493+0000', 'last_undegraded': '2024-04-26T22:00:11.873493+0000', 'last_fullsized': '2024-04-26T22:00:11.873493+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.870587+0000', 'last_change': '2024-04-26T22:00:11.870587+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.870587+0000', 'last_undegraded': '2024-04-26T22:00:11.870587+0000', 'last_fullsized': '2024-04-26T22:00:11.870587+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875613+0000', 'last_change': '2024-04-26T22:00:11.875613+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875613+0000', 'last_undegraded': '2024-04-26T22:00:11.875613+0000', 'last_fullsized': '2024-04-26T22:00:11.875613+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.878613+0000', 'last_change': '2024-04-26T22:00:11.878613+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.878613+0000', 'last_undegraded': '2024-04-26T22:00:11.878613+0000', 'last_fullsized': '2024-04-26T22:00:11.878613+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.872101+0000', 'last_change': '2024-04-26T22:00:11.872101+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.872101+0000', 'last_undegraded': '2024-04-26T22:00:11.872101+0000', 'last_fullsized': '2024-04-26T22:00:11.872101+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873652+0000', 'last_change': '2024-04-26T22:00:11.873652+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873652+0000', 'last_undegraded': '2024-04-26T22:00:11.873652+0000', 'last_fullsized': '2024-04-26T22:00:11.873652+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:00:16.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.874364+0000', 'last_change': '2024-04-26T22:00:11.874364+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.874364+0000', 'last_undegraded': '2024-04-26T22:00:11.874364+0000', 'last_fullsized': '2024-04-26T22:00:11.874364+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.876896+0000', 'last_change': '2024-04-26T22:00:11.876896+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.876896+0000', 'last_undegraded': '2024-04-26T22:00:11.876896+0000', 'last_fullsized': '2024-04-26T22:00:11.876896+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.880786+0000', 'last_change': '2024-04-26T22:00:11.880786+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.880786+0000', 'last_undegraded': '2024-04-26T22:00:11.880786+0000', 'last_fullsized': '2024-04-26T22:00:11.880786+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875200+0000', 'last_change': '2024-04-26T22:00:11.875200+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875200+0000', 'last_undegraded': '2024-04-26T22:00:11.875200+0000', 'last_fullsized': '2024-04-26T22:00:11.875200+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.876300+0000', 'last_change': '2024-04-26T22:00:11.876300+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.876300+0000', 'last_undegraded': '2024-04-26T22:00:11.876300+0000', 'last_fullsized': '2024-04-26T22:00:11.876300+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.871550+0000', 'last_change': '2024-04-26T22:00:11.871550+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.871550+0000', 'last_undegraded': '2024-04-26T22:00:11.871550+0000', 'last_fullsized': '2024-04-26T22:00:11.871550+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-04-26T22:00:16.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.874185+0000', 'last_change': '2024-04-26T22:00:11.874185+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.874185+0000', 'last_undegraded': '2024-04-26T22:00:11.874185+0000', 'last_fullsized': '2024-04-26T22:00:11.874185+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.874070+0000', 'last_change': '2024-04-26T22:00:11.874070+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.874070+0000', 'last_undegraded': '2024-04-26T22:00:11.874070+0000', 'last_fullsized': '2024-04-26T22:00:11.874070+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.879532+0000', 'last_change': '2024-04-26T22:00:11.879532+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.879532+0000', 'last_undegraded': '2024-04-26T22:00:11.879532+0000', 'last_fullsized': '2024-04-26T22:00:11.879532+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.872193+0000', 'last_change': '2024-04-26T22:00:11.872193+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.872193+0000', 'last_undegraded': '2024-04-26T22:00:11.872193+0000', 'last_fullsized': '2024-04-26T22:00:11.872193+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.870481+0000', 'last_change': '2024-04-26T22:00:11.870481+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.870481+0000', 'last_undegraded': '2024-04-26T22:00:11.870481+0000', 'last_fullsized': '2024-04-26T22:00:11.870481+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875630+0000', 'last_change': '2024-04-26T22:00:11.875630+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875630+0000', 'last_undegraded': '2024-04-26T22:00:11.875630+0000', 'last_fullsized': '2024-04-26T22:00:11.875630+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-04-26T22:00:16.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.872112+0000', 'last_change': '2024-04-26T22:00:11.872112+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.872112+0000', 'last_undegraded': '2024-04-26T22:00:11.872112+0000', 'last_fullsized': '2024-04-26T22:00:11.872112+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875024+0000', 'last_change': '2024-04-26T22:00:11.875024+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875024+0000', 'last_undegraded': '2024-04-26T22:00:11.875024+0000', 'last_fullsized': '2024-04-26T22:00:11.875024+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873637+0000', 'last_change': '2024-04-26T22:00:11.873637+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873637+0000', 'last_undegraded': '2024-04-26T22:00:11.873637+0000', 'last_fullsized': '2024-04-26T22:00:11.873637+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875281+0000', 'last_change': '2024-04-26T22:00:11.875281+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875281+0000', 'last_undegraded': '2024-04-26T22:00:11.875281+0000', 'last_fullsized': '2024-04-26T22:00:11.875281+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.870239+0000', 'last_change': '2024-04-26T22:00:11.870239+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.870239+0000', 'last_undegraded': '2024-04-26T22:00:11.870239+0000', 'last_fullsized': '2024-04-26T22:00:11.870239+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.872946+0000', 'last_change': '2024-04-26T22:00:11.872946+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.872946+0000', 'last_undegraded': '2024-04-26T22:00:11.872946+0000', 'last_fullsized': '2024-04-26T22:00:11.872946+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-04-26T22:00:16.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873665+0000', 'last_change': '2024-04-26T22:00:11.873665+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873665+0000', 'last_undegraded': '2024-04-26T22:00:11.873665+0000', 'last_fullsized': '2024-04-26T22:00:11.873665+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.877945+0000', 'last_change': '2024-04-26T22:00:11.877945+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.877945+0000', 'last_undegraded': '2024-04-26T22:00:11.877945+0000', 'last_fullsized': '2024-04-26T22:00:11.877945+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.877557+0000', 'last_change': '2024-04-26T22:00:11.877557+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.877557+0000', 'last_undegraded': '2024-04-26T22:00:11.877557+0000', 'last_fullsized': '2024-04-26T22:00:11.877557+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873501+0000', 'last_change': '2024-04-26T22:00:11.873501+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873501+0000', 'last_undegraded': '2024-04-26T22:00:11.873501+0000', 'last_fullsized': '2024-04-26T22:00:11.873501+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875898+0000', 'last_change': '2024-04-26T22:00:11.875898+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875898+0000', 'last_undegraded': '2024-04-26T22:00:11.875898+0000', 'last_fullsized': '2024-04-26T22:00:11.875898+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873985+0000', 'last_change': '2024-04-26T22:00:11.873985+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873985+0000', 'last_undegraded': '2024-04-26T22:00:11.873985+0000', 'last_fullsized': '2024-04-26T22:00:11.873985+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-26T22:00:16.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.873120+0000', 'last_change': '2024-04-26T22:00:11.873120+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.873120+0000', 'last_undegraded': '2024-04-26T22:00:11.873120+0000', 'last_fullsized': '2024-04-26T22:00:11.873120+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.879691+0000', 'last_change': '2024-04-26T22:00:11.879691+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.879691+0000', 'last_undegraded': '2024-04-26T22:00:11.879691+0000', 'last_fullsized': '2024-04-26T22:00:11.879691+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.872363+0000', 'last_change': '2024-04-26T22:00:11.872363+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.872363+0000', 'last_undegraded': '2024-04-26T22:00:11.872363+0000', 'last_fullsized': '2024-04-26T22:00:11.872363+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.870252+0000', 'last_change': '2024-04-26T22:00:11.870252+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.870252+0000', 'last_undegraded': '2024-04-26T22:00:11.870252+0000', 'last_fullsized': '2024-04-26T22:00:11.870252+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.872992+0000', 'last_change': '2024-04-26T22:00:11.872992+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.872992+0000', 'last_undegraded': '2024-04-26T22:00:11.872992+0000', 'last_fullsized': '2024-04-26T22:00:11.872992+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.878596+0000', 'last_change': '2024-04-26T22:00:11.878596+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.878596+0000', 'last_undegraded': '2024-04-26T22:00:11.878596+0000', 'last_fullsized': '2024-04-26T22:00:11.878596+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:00:16.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-04-26T22:00:16.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.874489+0000', 'last_change': '2024-04-26T22:00:11.874489+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.874489+0000', 'last_undegraded': '2024-04-26T22:00:11.874489+0000', 'last_fullsized': '2024-04-26T22:00:11.874489+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T22:00:16.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-04-26T22:00:16.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.870509+0000', 'last_change': '2024-04-26T22:00:11.870509+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.870509+0000', 'last_undegraded': '2024-04-26T22:00:11.870509+0000', 'last_fullsized': '2024-04-26T22:00:11.870509+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:00:16.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-04-26T22:00:16.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:00:11.875081+0000', 'last_change': '2024-04-26T22:00:11.875081+0000', 'last_active': '2024-04-26T22:00:11.864856+0000', 'last_peered': '2024-04-26T22:00:11.864856+0000', 'last_clean': '2024-04-26T22:00:11.864856+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:00:11.875081+0000', 'last_undegraded': '2024-04-26T22:00:11.875081+0000', 'last_fullsized': '2024-04-26T22:00:11.875081+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'last_clean_scrub_stamp': '2024-04-26T22:00:11.864856+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:00:16.545 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T22:00:16.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.666+0000 7fce867e4640 1 Processor -- start 2024-04-26T22:00:16.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.666+0000 7fce867e4640 1 -- start start 2024-04-26T22:00:16.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce867e4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce800ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce867e4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fce800d1410 0x7fce800b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce867e4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce80160f40 con 0x7fce800cd420 2024-04-26T22:00:16.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce867e4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fce800b5960 con 0x7fce800d1410 2024-04-26T22:00:16.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce867e4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fce80161ac0 con 0x7fce801469f0 2024-04-26T22:00:16.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce800ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:16.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce84d81640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fce800d1410 0x7fce800b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce800ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:42388/0 (socket says 172.21.15.137:42388) 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce84d81640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fce800d1410 0x7fce800b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:59094/0 (socket says 172.21.15.137:59094) 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce7ffff640 1 -- 172.21.15.137:0/1198619237 learned_addr learned my addr 172.21.15.137:0/1198619237 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.667+0000 7fce7f7fe640 1 --1- 172.21.15.137:0/1198619237 >> v1:172.21.15.170:6789/0 conn(0x7fce800cd420 0x7fce800d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42422/0 (socket says 172.21.15.137:42422) 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.668+0000 7fce7ffff640 1 -- 172.21.15.137:0/1198619237 >> v2:172.21.15.170:3300/0 conn(0x7fce800d1410 msgr2=0x7fce800b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.668+0000 7fce7ffff640 1 --2- 172.21.15.137:0/1198619237 >> v2:172.21.15.170:3300/0 conn(0x7fce800d1410 0x7fce800b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.668+0000 7fce7ffff640 1 -- 172.21.15.137:0/1198619237 >> v1:172.21.15.170:6789/0 conn(0x7fce800cd420 legacy=0x7fce800d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.668+0000 7fce7ffff640 1 -- 172.21.15.137:0/1198619237 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce80161220 con 0x7fce801469f0 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.668+0000 7fce7ffff640 1 --2- 172.21.15.137:0/1198619237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce800ccee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce70009870 tx=0x7fce7002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6dff75f5858a90 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce7effd640 1 -- 172.21.15.137:0/1198619237 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70037070 con 0x7fce801469f0 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce7effd640 1 -- 172.21.15.137:0/1198619237 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce70032440 con 0x7fce801469f0 2024-04-26T22:00:16.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce7effd640 1 -- 172.21.15.137:0/1198619237 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70032810 con 0x7fce801469f0 2024-04-26T22:00:16.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce867e4640 1 -- 172.21.15.137:0/1198619237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 msgr2=0x7fce800ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce867e4640 1 --2- 172.21.15.137:0/1198619237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce800ccee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fce70009870 tx=0x7fce7002a270 comp rx=0 tx=0).stop 2024-04-26T22:00:16.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce867e4640 1 -- 172.21.15.137:0/1198619237 shutdown_connections 2024-04-26T22:00:16.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce867e4640 1 --2- 172.21.15.137:0/1198619237 >> v2:172.21.15.170:3300/0 conn(0x7fce800d1410 0x7fce800b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce867e4640 1 --2- 172.21.15.137:0/1198619237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce800ccee0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce867e4640 1 -- 172.21.15.137:0/1198619237 >> 172.21.15.137:0/1198619237 conn(0x7fce800cd830 msgr2=0x7fce800cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:16.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce867e4640 1 -- 172.21.15.137:0/1198619237 shutdown_connections 2024-04-26T22:00:16.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.669+0000 7fce867e4640 1 -- 172.21.15.137:0/1198619237 wait complete. 2024-04-26T22:00:16.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.670+0000 7fce867e4640 1 Processor -- start 2024-04-26T22:00:16.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce867e4640 1 -- start start 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce867e4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce800cd420 0x7fce8015c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce867e4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce800d1410 0x7fce801e8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce867e4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce801e9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce867e4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fce80072020 con 0x7fce800cd420 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce867e4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fce801617e0 con 0x7fce800d1410 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce867e4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fce80160b80 con 0x7fce801469f0 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce800cd420 0x7fce8015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce800cd420 0x7fce8015c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38108/0 (socket says 172.21.15.137:38108) 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce7ffff640 1 -- 172.21.15.137:0/2590931880 learned_addr learned my addr 172.21.15.137:0/2590931880 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.671+0000 7fce84d81640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce801e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:16.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7f7fe640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce800d1410 0x7fce801e8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7ffff640 1 -- 172.21.15.137:0/2590931880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 msgr2=0x7fce801e9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7ffff640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce801e9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7ffff640 1 -- 172.21.15.137:0/2590931880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce800d1410 msgr2=0x7fce801e8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7ffff640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce800d1410 0x7fce801e8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7ffff640 1 -- 172.21.15.137:0/2590931880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8015f9c0 con 0x7fce800cd420 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce84d81640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce801e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7ffff640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce800cd420 0x7fce8015c310 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fce700090b0 tx=0x7fce700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7cff9640 1 -- 172.21.15.137:0/2590931880 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70041020 con 0x7fce800cd420 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7cff9640 1 -- 172.21.15.137:0/2590931880 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce70030660 con 0x7fce800cd420 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8015fca0 con 0x7fce800cd420 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce7cff9640 1 -- 172.21.15.137:0/2590931880 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70037040 con 0x7fce800cd420 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.672+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce80160260 con 0x7fce800cd420 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.673+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce8006a290 con 0x7fce800cd420 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.674+0000 7fce7cff9640 1 -- 172.21.15.137:0/2590931880 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce70044020 con 0x7fce800cd420 2024-04-26T22:00:16.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.674+0000 7fce7cff9640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce6c06c920 0x7fce6c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:16.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.674+0000 7fce7cff9640 1 -- 172.21.15.137:0/2590931880 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fce700ac260 con 0x7fce800cd420 2024-04-26T22:00:16.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.674+0000 7fce7f7fe640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce6c06c920 0x7fce6c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:16.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.674+0000 7fce7f7fe640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce6c06c920 0x7fce6c06ede0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fce74007fd0 tx=0x7fce74007c40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:16.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.678+0000 7fce7cff9640 1 -- 172.21.15.137:0/2590931880 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fce7004b030 con 0x7fce800cd420 2024-04-26T22:00:16.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.926+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fce8006fd90 con 0x7fce800cd420 2024-04-26T22:00:16.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.926+0000 7fce7cff9640 1 -- 172.21.15.137:0/2590931880 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1582 (secure 0 0 0) 0x7fce7007a720 con 0x7fce800cd420 2024-04-26T22:00:16.926 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:16.926 INFO:teuthology.orchestra.run.smithi137.stdout:{"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":120,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1714168707,"num_in_osds":8,"osd_in_since":1714168698,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":243703808,"bytes_avail":772850409472,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":20,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5592}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-26T21:59:58.708826+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-26T22:00:16.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.928+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce6c06c920 msgr2=0x7fce6c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.928+0000 7fce867e4640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce6c06c920 0x7fce6c06ede0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fce74007fd0 tx=0x7fce74007c40 comp rx=0 tx=0).stop 2024-04-26T22:00:16.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.928+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce800cd420 msgr2=0x7fce8015c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:16.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.928+0000 7fce867e4640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce800cd420 0x7fce8015c310 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fce700090b0 tx=0x7fce700046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.928+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 shutdown_connections 2024-04-26T22:00:16.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.929+0000 7fce867e4640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce6c06c920 0x7fce6c06ede0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.929+0000 7fce867e4640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fce801469f0 0x7fce801e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.929+0000 7fce867e4640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fce800d1410 0x7fce801e8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.929+0000 7fce867e4640 1 --2- 172.21.15.137:0/2590931880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fce800cd420 0x7fce8015c310 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:16.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.929+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 >> 172.21.15.137:0/2590931880 conn(0x7fce800cd830 msgr2=0x7fce80073eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:16.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.929+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 shutdown_connections 2024-04-26T22:00:16.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:16.929+0000 7fce867e4640 1 -- 172.21.15.137:0/2590931880 wait complete. 2024-04-26T22:00:16.939 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T22:00:16.940 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:00:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.035+0000 7ff2fce6d640 1 Processor -- start 2024-04-26T22:00:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.035+0000 7ff2fce6d640 1 -- start start 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.036+0000 7ff2fce6d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2f80b61a0 0x7ff2f8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.036+0000 7ff2fce6d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f80b4270 con 0x7ff2f8145980 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.036+0000 7ff2fce6d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f80b4530 con 0x7ff2f80b3de0 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.036+0000 7ff2fce6d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f80b5140 con 0x7ff2f80b61a0 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.037+0000 7ff2f5d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2f80b61a0 0x7ff2f8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.037+0000 7ff2f659c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff2f8145980 0x7ff2f80b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:35346/0 (socket says 172.21.15.137:35346) 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.037+0000 7ff2f5d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2f80b61a0 0x7ff2f8160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38122/0 (socket says 172.21.15.137:38122) 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.037+0000 7ff2f659c640 1 -- 172.21.15.137:0/2881793208 learned_addr learned my addr 172.21.15.137:0/2881793208 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.037+0000 7ff2f5d9b640 1 -- 172.21.15.137:0/2881793208 >> v1:172.21.15.170:6789/0 conn(0x7ff2f80b3de0 legacy=0x7ff2f80720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:17.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.037+0000 7ff2f5d9b640 1 -- 172.21.15.137:0/2881793208 >> v1:172.21.15.137:6789/0 conn(0x7ff2f8145980 legacy=0x7ff2f80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:17.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.037+0000 7ff2f5d9b640 1 -- 172.21.15.137:0/2881793208 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f80b4810 con 0x7ff2f80b61a0 2024-04-26T22:00:17.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.037+0000 7ff2f559a640 1 -- 172.21.15.137:0/2881793208 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1033506280 0 0) 0x7ff2f80b4270 con 0x7ff2f8145980 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2f5d9b640 1 --2- 172.21.15.137:0/2881793208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b61a0 0x7ff2f8160630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80097a0 tx=0x7ff2e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903b75a89e679bb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2f559a640 1 -- 172.21.15.137:0/2881793208 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8037070 con 0x7ff2f80b61a0 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2f559a640 1 -- 172.21.15.137:0/2881793208 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e8032440 con 0x7ff2f80b61a0 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2f559a640 1 -- 172.21.15.137:0/2881793208 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8032810 con 0x7ff2f80b61a0 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2881793208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b61a0 msgr2=0x7ff2f8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2fce6d640 1 --2- 172.21.15.137:0/2881793208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b61a0 0x7ff2f8160630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80097a0 tx=0x7ff2e802a1a0 comp rx=0 tx=0).stop 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2881793208 shutdown_connections 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2fce6d640 1 --2- 172.21.15.137:0/2881793208 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b61a0 0x7ff2f8160630 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2881793208 >> 172.21.15.137:0/2881793208 conn(0x7ff2f80d0d30 msgr2=0x7ff2f80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:17.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2881793208 shutdown_connections 2024-04-26T22:00:17.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.038+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2881793208 wait complete. 2024-04-26T22:00:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2fce6d640 1 Processor -- start 2024-04-26T22:00:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2fce6d640 1 -- start start 2024-04-26T22:00:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2fce6d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b3de0 0x7ff2f80b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2fce6d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f80b61a0 0x7ff2f8146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2fce6d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f8145980 0x7ff2f813e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2fce6d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f80727e0 con 0x7ff2f80b3de0 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2fce6d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f80b4dd0 con 0x7ff2f8145980 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2fce6d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f8072960 con 0x7ff2f80b61a0 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2f659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b3de0 0x7ff2f80b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.040+0000 7ff2f659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b3de0 0x7ff2f80b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38128/0 (socket says 172.21.15.137:38128) 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2f659c640 1 -- 172.21.15.137:0/2402260824 learned_addr learned my addr 172.21.15.137:0/2402260824 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2f659c640 1 -- 172.21.15.137:0/2402260824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f80b61a0 msgr2=0x7ff2f8146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2f659c640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f80b61a0 0x7ff2f8146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2f659c640 1 -- 172.21.15.137:0/2402260824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f8145980 msgr2=0x7ff2f813e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2f6d9d640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f8145980 0x7ff2f813e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2f659c640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f8145980 0x7ff2f813e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2f659c640 1 -- 172.21.15.137:0/2402260824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f80b1f70 con 0x7ff2f80b3de0 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2f659c640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b3de0 0x7ff2f80b3010 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000c3f0 tx=0x7ff2e000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2eeffd640 1 -- 172.21.15.137:0/2402260824 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00074e0 con 0x7ff2f80b3de0 2024-04-26T22:00:17.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2eeffd640 1 -- 172.21.15.137:0/2402260824 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e00047e0 con 0x7ff2f80b3de0 2024-04-26T22:00:17.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f80b2250 con 0x7ff2f80b3de0 2024-04-26T22:00:17.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2eeffd640 1 -- 172.21.15.137:0/2402260824 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0004c10 con 0x7ff2f80b3de0 2024-04-26T22:00:17.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.041+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f80b2810 con 0x7ff2f80b3de0 2024-04-26T22:00:17.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.042+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f806a290 con 0x7ff2f80b3de0 2024-04-26T22:00:17.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.042+0000 7ff2eeffd640 1 -- 172.21.15.137:0/2402260824 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2e0011070 con 0x7ff2f80b3de0 2024-04-26T22:00:17.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.043+0000 7ff2eeffd640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:17.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.043+0000 7ff2eeffd640 1 -- 172.21.15.137:0/2402260824 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7ff2e008b760 con 0x7ff2f80b3de0 2024-04-26T22:00:17.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.043+0000 7ff2f5d9b640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:17.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.043+0000 7ff2f5d9b640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8034000 tx=0x7ff2e802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:17.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.047+0000 7ff2eeffd640 1 -- 172.21.15.137:0/2402260824 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff2e001a2b0 con 0x7ff2f80b3de0 2024-04-26T22:00:17.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.218+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2f8073cc0 con 0x7ff2d806c920 2024-04-26T22:00:17.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.224+0000 7ff2eeffd640 1 -- 172.21.15.137:0/2402260824 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246638 (secure 0 0 0) 0x7ff2f8073cc0 con 0x7ff2d806c920 2024-04-26T22:00:17.226 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:17.228 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:00:17.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 msgr2=0x7ff2d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:17.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8034000 tx=0x7ff2e802c000 comp rx=0 tx=0).stop 2024-04-26T22:00:17.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b3de0 msgr2=0x7ff2f80b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:17.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b3de0 0x7ff2f80b3010 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000c3f0 tx=0x7ff2e000c8b0 comp rx=0 tx=0).stop 2024-04-26T22:00:17.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 shutdown_connections 2024-04-26T22:00:17.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2d806c920 0x7ff2d806ede0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:17.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2f8145980 0x7ff2f813e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:17.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2f80b61a0 0x7ff2f8146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:17.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 --2- 172.21.15.137:0/2402260824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2f80b3de0 0x7ff2f80b3010 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:17.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 >> 172.21.15.137:0/2402260824 conn(0x7ff2f80d0d30 msgr2=0x7ff2f815f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:17.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 shutdown_connections 2024-04-26T22:00:17.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:17.227+0000 7ff2fce6d640 1 -- 172.21.15.137:0/2402260824 wait complete. 2024-04-26T22:00:17.238 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-04-26T22:00:16.712053+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237992,"kb_used_data":5192,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736728,"statfs":{"total":773094113280,"available":772850409472,"internally_reserved":0,"allocated":5316608,"data_stored":2834424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.846386"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.871194+0000","last_change":"2024-04-26T22:00:11.871194+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.871194+0000","last_undegraded":"2024-04-26T22:00:11.871194+0000","last_fullsized":"2024-04-26T22:00:11.871194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874539+0000","last_change":"2024-04-26T22:00:11.874539+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874539+0000","last_undegraded":"2024-04-26T22:00:11.874539+0000","last_fullsized":"2024-04-26T22:00:11.874539+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872529+0000","last_change":"2024-04-26T22:00:11.872529+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872529+0000","last_undegraded":"2024-04-26T22:00:11.872529+0000","last_fullsized":"2024-04-26T22:00:11.872529+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880788+0000","last_change":"2024-04-26T22:00:11.880788+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880788+0000","last_undegraded":"2024-04-26T22:00:11.880788+0000","last_fullsized":"2024-04-26T22:00:11.880788+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874852+0000","last_change":"2024-04-26T22:00:11.874852+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874852+0000","last_undegraded":"2024-04-26T22:00:11.874852+0000","last_fullsized":"2024-04-26T22:00:11.874852+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873945+0000","last_change":"2024-04-26T22:00:11.873945+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873945+0000","last_undegraded":"2024-04-26T22:00:11.873945+0000","last_fullsized":"2024-04-26T22:00:11.873945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870799+0000","last_change":"2024-04-26T22:00:11.870799+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870799+0000","last_undegraded":"2024-04-26T22:00:11.870799+0000","last_fullsized":"2024-04-26T22:00:11.870799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880282+0000","last_change":"2024-04-26T22:00:11.880282+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880282+0000","last_undegraded":"2024-04-26T22:00:11.880282+0000","last_fullsized":"2024-04-26T22:00:11.880282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874589+0000","last_change":"2024-04-26T22:00:11.874589+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874589+0000","last_undegraded":"2024-04-26T22:00:11.874589+0000","last_fullsized":"2024-04-26T22:00:11.874589+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875477+0000","last_change":"2024-04-26T22:00:11.875477+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875477+0000","last_undegraded":"2024-04-26T22:00:11.875477+0000","last_fullsized":"2024-04-26T22:00:11.875477+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875140+0000","last_change":"2024-04-26T22:00:11.875140+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875140+0000","last_undegraded":"2024-04-26T22:00:11.875140+0000","last_fullsized":"2024-04-26T22:00:11.875140+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876023+0000","last_change":"2024-04-26T22:00:11.876023+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876023+0000","last_undegraded":"2024-04-26T22:00:11.876023+0000","last_fullsized":"2024-04-26T22:00:11.876023+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872908+0000","last_change":"2024-04-26T22:00:11.872908+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872908+0000","last_undegraded":"2024-04-26T22:00:11.872908+0000","last_fullsized":"2024-04-26T22:00:11.872908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875038+0000","last_change":"2024-04-26T22:00:11.875038+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875038+0000","last_undegraded":"2024-04-26T22:00:11.875038+0000","last_fullsized":"2024-04-26T22:00:11.875038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874069+0000","last_change":"2024-04-26T22:00:11.874069+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874069+0000","last_undegraded":"2024-04-26T22:00:11.874069+0000","last_fullsized":"2024-04-26T22:00:11.874069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879074+0000","last_change":"2024-04-26T22:00:11.879074+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879074+0000","last_undegraded":"2024-04-26T22:00:11.879074+0000","last_fullsized":"2024-04-26T22:00:11.879074+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873144+0000","last_change":"2024-04-26T22:00:11.873144+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873144+0000","last_undegraded":"2024-04-26T22:00:11.873144+0000","last_fullsized":"2024-04-26T22:00:11.873144+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873220+0000","last_change":"2024-04-26T22:00:11.873220+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873220+0000","last_undegraded":"2024-04-26T22:00:11.873220+0000","last_fullsized":"2024-04-26T22:00:11.873220+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876590+0000","last_change":"2024-04-26T22:00:11.876590+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876590+0000","last_undegraded":"2024-04-26T22:00:11.876590+0000","last_fullsized":"2024-04-26T22:00:11.876590+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875133+0000","last_change":"2024-04-26T22:00:11.875133+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875133+0000","last_undegraded":"2024-04-26T22:00:11.875133+0000","last_fullsized":"2024-04-26T22:00:11.875133+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879213+0000","last_change":"2024-04-26T22:00:11.879213+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879213+0000","last_undegraded":"2024-04-26T22:00:11.879213+0000","last_fullsized":"2024-04-26T22:00:11.879213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874569+0000","last_change":"2024-04-26T22:00:11.874569+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874569+0000","last_undegraded":"2024-04-26T22:00:11.874569+0000","last_fullsized":"2024-04-26T22:00:11.874569+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879112+0000","last_change":"2024-04-26T22:00:11.879112+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879112+0000","last_undegraded":"2024-04-26T22:00:11.879112+0000","last_fullsized":"2024-04-26T22:00:11.879112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875399+0000","last_change":"2024-04-26T22:00:11.875399+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875399+0000","last_undegraded":"2024-04-26T22:00:11.875399+0000","last_fullsized":"2024-04-26T22:00:11.875399+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.881178+0000","last_change":"2024-04-26T22:00:11.881178+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.881178+0000","last_undegraded":"2024-04-26T22:00:11.881178+0000","last_fullsized":"2024-04-26T22:00:11.881178+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873493+0000","last_change":"2024-04-26T22:00:11.873493+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873493+0000","last_undegraded":"2024-04-26T22:00:11.873493+0000","last_fullsized":"2024-04-26T22:00:11.873493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870587+0000","last_change":"2024-04-26T22:00:11.870587+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870587+0000","last_undegraded":"2024-04-26T22:00:11.870587+0000","last_fullsized":"2024-04-26T22:00:11.870587+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875613+0000","last_change":"2024-04-26T22:00:11.875613+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875613+0000","last_undegraded":"2024-04-26T22:00:11.875613+0000","last_fullsized":"2024-04-26T22:00:11.875613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.878613+0000","last_change":"2024-04-26T22:00:11.878613+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.878613+0000","last_undegraded":"2024-04-26T22:00:11.878613+0000","last_fullsized":"2024-04-26T22:00:11.878613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872101+0000","last_change":"2024-04-26T22:00:11.872101+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872101+0000","last_undegraded":"2024-04-26T22:00:11.872101+0000","last_fullsized":"2024-04-26T22:00:11.872101+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873652+0000","last_change":"2024-04-26T22:00:11.873652+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873652+0000","last_undegraded":"2024-04-26T22:00:11.873652+0000","last_fullsized":"2024-04-26T22:00:11.873652+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874364+0000","last_change":"2024-04-26T22:00:11.874364+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874364+0000","last_undegraded":"2024-04-26T22:00:11.874364+0000","last_fullsized":"2024-04-26T22:00:11.874364+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876896+0000","last_change":"2024-04-26T22:00:11.876896+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876896+0000","last_undegraded":"2024-04-26T22:00:11.876896+0000","last_fullsized":"2024-04-26T22:00:11.876896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892465+0000","last_change":"2024-04-26T22:00:11.887450+0000","last_active":"2024-04-26T22:00:11.892465+0000","last_peered":"2024-04-26T22:00:11.892465+0000","last_clean":"2024-04-26T22:00:11.892465+0000","last_became_active":"2024-04-26T22:00:11.887100+0000","last_became_peered":"2024-04-26T22:00:11.887100+0000","last_unstale":"2024-04-26T22:00:11.892465+0000","last_undegraded":"2024-04-26T22:00:11.892465+0000","last_fullsized":"2024-04-26T22:00:11.892465+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:58.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.880786+0000","last_change":"2024-04-26T22:00:11.880786+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.880786+0000","last_undegraded":"2024-04-26T22:00:11.880786+0000","last_fullsized":"2024-04-26T22:00:11.880786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887804+0000","last_change":"2024-04-26T22:00:11.882486+0000","last_active":"2024-04-26T22:00:11.887804+0000","last_peered":"2024-04-26T22:00:11.887804+0000","last_clean":"2024-04-26T22:00:11.887804+0000","last_became_active":"2024-04-26T22:00:11.882256+0000","last_became_peered":"2024-04-26T22:00:11.882256+0000","last_unstale":"2024-04-26T22:00:11.887804+0000","last_undegraded":"2024-04-26T22:00:11.887804+0000","last_fullsized":"2024-04-26T22:00:11.887804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:33.271613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875200+0000","last_change":"2024-04-26T22:00:11.875200+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875200+0000","last_undegraded":"2024-04-26T22:00:11.875200+0000","last_fullsized":"2024-04-26T22:00:11.875200+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889980+0000","last_change":"2024-04-26T22:00:11.882943+0000","last_active":"2024-04-26T22:00:11.889980+0000","last_peered":"2024-04-26T22:00:11.889980+0000","last_clean":"2024-04-26T22:00:11.889980+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:11.889980+0000","last_undegraded":"2024-04-26T22:00:11.889980+0000","last_fullsized":"2024-04-26T22:00:11.889980+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:33.271613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.876300+0000","last_change":"2024-04-26T22:00:11.876300+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.876300+0000","last_undegraded":"2024-04-26T22:00:11.876300+0000","last_fullsized":"2024-04-26T22:00:11.876300+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.884005+0000","last_change":"2024-04-26T22:00:11.879917+0000","last_active":"2024-04-26T22:00:11.884005+0000","last_peered":"2024-04-26T22:00:11.884005+0000","last_clean":"2024-04-26T22:00:11.884005+0000","last_became_active":"2024-04-26T22:00:11.879301+0000","last_became_peered":"2024-04-26T22:00:11.879301+0000","last_unstale":"2024-04-26T22:00:11.884005+0000","last_undegraded":"2024-04-26T22:00:11.884005+0000","last_fullsized":"2024-04-26T22:00:11.884005+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:50.350527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.871550+0000","last_change":"2024-04-26T22:00:11.871550+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.871550+0000","last_undegraded":"2024-04-26T22:00:11.871550+0000","last_fullsized":"2024-04-26T22:00:11.871550+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892400+0000","last_change":"2024-04-26T22:00:11.884768+0000","last_active":"2024-04-26T22:00:11.892400+0000","last_peered":"2024-04-26T22:00:11.892400+0000","last_clean":"2024-04-26T22:00:11.892400+0000","last_became_active":"2024-04-26T22:00:11.884497+0000","last_became_peered":"2024-04-26T22:00:11.884497+0000","last_unstale":"2024-04-26T22:00:11.892400+0000","last_undegraded":"2024-04-26T22:00:11.892400+0000","last_fullsized":"2024-04-26T22:00:11.892400+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:48.325283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874185+0000","last_change":"2024-04-26T22:00:11.874185+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874185+0000","last_undegraded":"2024-04-26T22:00:11.874185+0000","last_fullsized":"2024-04-26T22:00:11.874185+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.881969+0000","last_change":"2024-04-26T22:00:11.878473+0000","last_active":"2024-04-26T22:00:11.881969+0000","last_peered":"2024-04-26T22:00:11.881969+0000","last_clean":"2024-04-26T22:00:11.881969+0000","last_became_active":"2024-04-26T22:00:11.878195+0000","last_became_peered":"2024-04-26T22:00:11.878195+0000","last_unstale":"2024-04-26T22:00:11.881969+0000","last_undegraded":"2024-04-26T22:00:11.881969+0000","last_fullsized":"2024-04-26T22:00:11.881969+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:07.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874070+0000","last_change":"2024-04-26T22:00:11.874070+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874070+0000","last_undegraded":"2024-04-26T22:00:11.874070+0000","last_fullsized":"2024-04-26T22:00:11.874070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.883126+0000","last_change":"2024-04-26T22:00:11.880991+0000","last_active":"2024-04-26T22:00:11.883126+0000","last_peered":"2024-04-26T22:00:11.883126+0000","last_clean":"2024-04-26T22:00:11.883126+0000","last_became_active":"2024-04-26T22:00:11.880707+0000","last_became_peered":"2024-04-26T22:00:11.880707+0000","last_unstale":"2024-04-26T22:00:11.883126+0000","last_undegraded":"2024-04-26T22:00:11.883126+0000","last_fullsized":"2024-04-26T22:00:11.883126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:05.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879532+0000","last_change":"2024-04-26T22:00:11.879532+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879532+0000","last_undegraded":"2024-04-26T22:00:11.879532+0000","last_fullsized":"2024-04-26T22:00:11.879532+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892362+0000","last_change":"2024-04-26T22:00:11.881712+0000","last_active":"2024-04-26T22:00:11.892362+0000","last_peered":"2024-04-26T22:00:11.892362+0000","last_clean":"2024-04-26T22:00:11.892362+0000","last_became_active":"2024-04-26T22:00:11.881009+0000","last_became_peered":"2024-04-26T22:00:11.881009+0000","last_unstale":"2024-04-26T22:00:11.892362+0000","last_undegraded":"2024-04-26T22:00:11.892362+0000","last_fullsized":"2024-04-26T22:00:11.892362+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:07.850143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872193+0000","last_change":"2024-04-26T22:00:11.872193+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872193+0000","last_undegraded":"2024-04-26T22:00:11.872193+0000","last_fullsized":"2024-04-26T22:00:11.872193+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887657+0000","last_change":"2024-04-26T22:00:11.884051+0000","last_active":"2024-04-26T22:00:11.887657+0000","last_peered":"2024-04-26T22:00:11.887657+0000","last_clean":"2024-04-26T22:00:11.887657+0000","last_became_active":"2024-04-26T22:00:11.883778+0000","last_became_peered":"2024-04-26T22:00:11.883778+0000","last_unstale":"2024-04-26T22:00:11.887657+0000","last_undegraded":"2024-04-26T22:00:11.887657+0000","last_fullsized":"2024-04-26T22:00:11.887657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:21.325594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870481+0000","last_change":"2024-04-26T22:00:11.870481+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870481+0000","last_undegraded":"2024-04-26T22:00:11.870481+0000","last_fullsized":"2024-04-26T22:00:11.870481+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.880225+0000","last_change":"2024-04-26T22:00:11.876171+0000","last_active":"2024-04-26T22:00:11.880225+0000","last_peered":"2024-04-26T22:00:11.880225+0000","last_clean":"2024-04-26T22:00:11.880225+0000","last_became_active":"2024-04-26T22:00:11.875895+0000","last_became_peered":"2024-04-26T22:00:11.875895+0000","last_unstale":"2024-04-26T22:00:11.880225+0000","last_undegraded":"2024-04-26T22:00:11.880225+0000","last_fullsized":"2024-04-26T22:00:11.880225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:22.168576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875630+0000","last_change":"2024-04-26T22:00:11.875630+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875630+0000","last_undegraded":"2024-04-26T22:00:11.875630+0000","last_fullsized":"2024-04-26T22:00:11.875630+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886070+0000","last_change":"2024-04-26T22:00:11.884653+0000","last_active":"2024-04-26T22:00:11.886070+0000","last_peered":"2024-04-26T22:00:11.886070+0000","last_clean":"2024-04-26T22:00:11.886070+0000","last_became_active":"2024-04-26T22:00:11.884363+0000","last_became_peered":"2024-04-26T22:00:11.884363+0000","last_unstale":"2024-04-26T22:00:11.886070+0000","last_undegraded":"2024-04-26T22:00:11.886070+0000","last_fullsized":"2024-04-26T22:00:11.886070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:33.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872112+0000","last_change":"2024-04-26T22:00:11.872112+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872112+0000","last_undegraded":"2024-04-26T22:00:11.872112+0000","last_fullsized":"2024-04-26T22:00:11.872112+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889666+0000","last_change":"2024-04-26T22:00:11.883768+0000","last_active":"2024-04-26T22:00:11.889666+0000","last_peered":"2024-04-26T22:00:11.889666+0000","last_clean":"2024-04-26T22:00:11.889666+0000","last_became_active":"2024-04-26T22:00:11.883484+0000","last_became_peered":"2024-04-26T22:00:11.883484+0000","last_unstale":"2024-04-26T22:00:11.889666+0000","last_undegraded":"2024-04-26T22:00:11.889666+0000","last_fullsized":"2024-04-26T22:00:11.889666+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:59.629462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875024+0000","last_change":"2024-04-26T22:00:11.875024+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875024+0000","last_undegraded":"2024-04-26T22:00:11.875024+0000","last_fullsized":"2024-04-26T22:00:11.875024+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.897696+0000","last_change":"2024-04-26T22:00:11.893028+0000","last_active":"2024-04-26T22:00:11.897696+0000","last_peered":"2024-04-26T22:00:11.897696+0000","last_clean":"2024-04-26T22:00:11.897696+0000","last_became_active":"2024-04-26T22:00:11.892704+0000","last_became_peered":"2024-04-26T22:00:11.892704+0000","last_unstale":"2024-04-26T22:00:11.897696+0000","last_undegraded":"2024-04-26T22:00:11.897696+0000","last_fullsized":"2024-04-26T22:00:11.897696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:55.142122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873637+0000","last_change":"2024-04-26T22:00:11.873637+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873637+0000","last_undegraded":"2024-04-26T22:00:11.873637+0000","last_fullsized":"2024-04-26T22:00:11.873637+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887530+0000","last_change":"2024-04-26T22:00:11.885985+0000","last_active":"2024-04-26T22:00:11.887530+0000","last_peered":"2024-04-26T22:00:11.887530+0000","last_clean":"2024-04-26T22:00:11.887530+0000","last_became_active":"2024-04-26T22:00:11.885602+0000","last_became_peered":"2024-04-26T22:00:11.885602+0000","last_unstale":"2024-04-26T22:00:11.887530+0000","last_undegraded":"2024-04-26T22:00:11.887530+0000","last_fullsized":"2024-04-26T22:00:11.887530+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:49.855119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875281+0000","last_change":"2024-04-26T22:00:11.875281+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875281+0000","last_undegraded":"2024-04-26T22:00:11.875281+0000","last_fullsized":"2024-04-26T22:00:11.875281+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892890+0000","last_change":"2024-04-26T22:00:11.890223+0000","last_active":"2024-04-26T22:00:11.892890+0000","last_peered":"2024-04-26T22:00:11.892890+0000","last_clean":"2024-04-26T22:00:11.892890+0000","last_became_active":"2024-04-26T22:00:11.889918+0000","last_became_peered":"2024-04-26T22:00:11.889918+0000","last_unstale":"2024-04-26T22:00:11.892890+0000","last_undegraded":"2024-04-26T22:00:11.892890+0000","last_fullsized":"2024-04-26T22:00:11.892890+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:52.959212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870239+0000","last_change":"2024-04-26T22:00:11.870239+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870239+0000","last_undegraded":"2024-04-26T22:00:11.870239+0000","last_fullsized":"2024-04-26T22:00:11.870239+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889525+0000","last_change":"2024-04-26T22:00:11.880931+0000","last_active":"2024-04-26T22:00:11.889525+0000","last_peered":"2024-04-26T22:00:11.889525+0000","last_clean":"2024-04-26T22:00:11.889525+0000","last_became_active":"2024-04-26T22:00:11.880653+0000","last_became_peered":"2024-04-26T22:00:11.880653+0000","last_unstale":"2024-04-26T22:00:11.889525+0000","last_undegraded":"2024-04-26T22:00:11.889525+0000","last_fullsized":"2024-04-26T22:00:11.889525+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:22.240513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872946+0000","last_change":"2024-04-26T22:00:11.872946+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872946+0000","last_undegraded":"2024-04-26T22:00:11.872946+0000","last_fullsized":"2024-04-26T22:00:11.872946+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892724+0000","last_change":"2024-04-26T22:00:11.890718+0000","last_active":"2024-04-26T22:00:11.892724+0000","last_peered":"2024-04-26T22:00:11.892724+0000","last_clean":"2024-04-26T22:00:11.892724+0000","last_became_active":"2024-04-26T22:00:11.890389+0000","last_became_peered":"2024-04-26T22:00:11.890389+0000","last_unstale":"2024-04-26T22:00:11.892724+0000","last_undegraded":"2024-04-26T22:00:11.892724+0000","last_fullsized":"2024-04-26T22:00:11.892724+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:06.146600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873665+0000","last_change":"2024-04-26T22:00:11.873665+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873665+0000","last_undegraded":"2024-04-26T22:00:11.873665+0000","last_fullsized":"2024-04-26T22:00:11.873665+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886509+0000","last_change":"2024-04-26T22:00:11.881392+0000","last_active":"2024-04-26T22:00:11.886509+0000","last_peered":"2024-04-26T22:00:11.886509+0000","last_clean":"2024-04-26T22:00:11.886509+0000","last_became_active":"2024-04-26T22:00:11.881088+0000","last_became_peered":"2024-04-26T22:00:11.881088+0000","last_unstale":"2024-04-26T22:00:11.886509+0000","last_undegraded":"2024-04-26T22:00:11.886509+0000","last_fullsized":"2024-04-26T22:00:11.886509+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:25.098175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.877945+0000","last_change":"2024-04-26T22:00:11.877945+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.877945+0000","last_undegraded":"2024-04-26T22:00:11.877945+0000","last_fullsized":"2024-04-26T22:00:11.877945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.883174+0000","last_change":"2024-04-26T22:00:11.881410+0000","last_active":"2024-04-26T22:00:11.883174+0000","last_peered":"2024-04-26T22:00:11.883174+0000","last_clean":"2024-04-26T22:00:11.883174+0000","last_became_active":"2024-04-26T22:00:11.881152+0000","last_became_peered":"2024-04-26T22:00:11.881152+0000","last_unstale":"2024-04-26T22:00:11.883174+0000","last_undegraded":"2024-04-26T22:00:11.883174+0000","last_fullsized":"2024-04-26T22:00:11.883174+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:14.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.877557+0000","last_change":"2024-04-26T22:00:11.877557+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.877557+0000","last_undegraded":"2024-04-26T22:00:11.877557+0000","last_fullsized":"2024-04-26T22:00:11.877557+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892427+0000","last_change":"2024-04-26T22:00:11.887429+0000","last_active":"2024-04-26T22:00:11.892427+0000","last_peered":"2024-04-26T22:00:11.892427+0000","last_clean":"2024-04-26T22:00:11.892427+0000","last_became_active":"2024-04-26T22:00:11.887126+0000","last_became_peered":"2024-04-26T22:00:11.887126+0000","last_unstale":"2024-04-26T22:00:11.892427+0000","last_undegraded":"2024-04-26T22:00:11.892427+0000","last_fullsized":"2024-04-26T22:00:11.892427+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:04.876803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873501+0000","last_change":"2024-04-26T22:00:11.873501+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873501+0000","last_undegraded":"2024-04-26T22:00:11.873501+0000","last_fullsized":"2024-04-26T22:00:11.873501+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892376+0000","last_change":"2024-04-26T22:00:11.884714+0000","last_active":"2024-04-26T22:00:11.892376+0000","last_peered":"2024-04-26T22:00:11.892376+0000","last_clean":"2024-04-26T22:00:11.892376+0000","last_became_active":"2024-04-26T22:00:11.884458+0000","last_became_peered":"2024-04-26T22:00:11.884458+0000","last_unstale":"2024-04-26T22:00:11.892376+0000","last_undegraded":"2024-04-26T22:00:11.892376+0000","last_fullsized":"2024-04-26T22:00:11.892376+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:01.295815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875898+0000","last_change":"2024-04-26T22:00:11.875898+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875898+0000","last_undegraded":"2024-04-26T22:00:11.875898+0000","last_fullsized":"2024-04-26T22:00:11.875898+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.888543+0000","last_change":"2024-04-26T22:00:11.887720+0000","last_active":"2024-04-26T22:00:11.888543+0000","last_peered":"2024-04-26T22:00:11.888543+0000","last_clean":"2024-04-26T22:00:11.888543+0000","last_became_active":"2024-04-26T22:00:11.887407+0000","last_became_peered":"2024-04-26T22:00:11.887407+0000","last_unstale":"2024-04-26T22:00:11.888543+0000","last_undegraded":"2024-04-26T22:00:11.888543+0000","last_fullsized":"2024-04-26T22:00:11.888543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:07.267948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873985+0000","last_change":"2024-04-26T22:00:11.873985+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873985+0000","last_undegraded":"2024-04-26T22:00:11.873985+0000","last_fullsized":"2024-04-26T22:00:11.873985+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.880188+0000","last_change":"2024-04-26T22:00:11.875970+0000","last_active":"2024-04-26T22:00:11.880188+0000","last_peered":"2024-04-26T22:00:11.880188+0000","last_clean":"2024-04-26T22:00:11.880188+0000","last_became_active":"2024-04-26T22:00:11.875677+0000","last_became_peered":"2024-04-26T22:00:11.875677+0000","last_unstale":"2024-04-26T22:00:11.880188+0000","last_undegraded":"2024-04-26T22:00:11.880188+0000","last_fullsized":"2024-04-26T22:00:11.880188+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:28.812254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.873120+0000","last_change":"2024-04-26T22:00:11.873120+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.873120+0000","last_undegraded":"2024-04-26T22:00:11.873120+0000","last_fullsized":"2024-04-26T22:00:11.873120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.885022+0000","last_change":"2024-04-26T22:00:11.881790+0000","last_active":"2024-04-26T22:00:11.885022+0000","last_peered":"2024-04-26T22:00:11.885022+0000","last_clean":"2024-04-26T22:00:11.885022+0000","last_became_active":"2024-04-26T22:00:11.881500+0000","last_became_peered":"2024-04-26T22:00:11.881500+0000","last_unstale":"2024-04-26T22:00:11.885022+0000","last_undegraded":"2024-04-26T22:00:11.885022+0000","last_fullsized":"2024-04-26T22:00:11.885022+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:05.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.879691+0000","last_change":"2024-04-26T22:00:11.879691+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.879691+0000","last_undegraded":"2024-04-26T22:00:11.879691+0000","last_fullsized":"2024-04-26T22:00:11.879691+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889529+0000","last_change":"2024-04-26T22:00:11.880307+0000","last_active":"2024-04-26T22:00:11.889529+0000","last_peered":"2024-04-26T22:00:11.889529+0000","last_clean":"2024-04-26T22:00:11.889529+0000","last_became_active":"2024-04-26T22:00:11.879974+0000","last_became_peered":"2024-04-26T22:00:11.879974+0000","last_unstale":"2024-04-26T22:00:11.889529+0000","last_undegraded":"2024-04-26T22:00:11.889529+0000","last_fullsized":"2024-04-26T22:00:11.889529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:03.645360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872363+0000","last_change":"2024-04-26T22:00:11.872363+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872363+0000","last_undegraded":"2024-04-26T22:00:11.872363+0000","last_fullsized":"2024-04-26T22:00:11.872363+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886091+0000","last_change":"2024-04-26T22:00:11.884583+0000","last_active":"2024-04-26T22:00:11.886091+0000","last_peered":"2024-04-26T22:00:11.886091+0000","last_clean":"2024-04-26T22:00:11.886091+0000","last_became_active":"2024-04-26T22:00:11.884020+0000","last_became_peered":"2024-04-26T22:00:11.884020+0000","last_unstale":"2024-04-26T22:00:11.886091+0000","last_undegraded":"2024-04-26T22:00:11.886091+0000","last_fullsized":"2024-04-26T22:00:11.886091+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:07.267948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870252+0000","last_change":"2024-04-26T22:00:11.870252+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870252+0000","last_undegraded":"2024-04-26T22:00:11.870252+0000","last_fullsized":"2024-04-26T22:00:11.870252+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.889956+0000","last_change":"2024-04-26T22:00:11.882987+0000","last_active":"2024-04-26T22:00:11.889956+0000","last_peered":"2024-04-26T22:00:11.889956+0000","last_clean":"2024-04-26T22:00:11.889956+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:11.889956+0000","last_undegraded":"2024-04-26T22:00:11.889956+0000","last_fullsized":"2024-04-26T22:00:11.889956+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:21.325594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.872992+0000","last_change":"2024-04-26T22:00:11.872992+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.872992+0000","last_undegraded":"2024-04-26T22:00:11.872992+0000","last_fullsized":"2024-04-26T22:00:11.872992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.885029+0000","last_change":"2024-04-26T22:00:11.882822+0000","last_active":"2024-04-26T22:00:11.885029+0000","last_peered":"2024-04-26T22:00:11.885029+0000","last_clean":"2024-04-26T22:00:11.885029+0000","last_became_active":"2024-04-26T22:00:11.882569+0000","last_became_peered":"2024-04-26T22:00:11.882569+0000","last_unstale":"2024-04-26T22:00:11.885029+0000","last_undegraded":"2024-04-26T22:00:11.885029+0000","last_fullsized":"2024-04-26T22:00:11.885029+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:14.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.878596+0000","last_change":"2024-04-26T22:00:11.878596+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.878596+0000","last_undegraded":"2024-04-26T22:00:11.878596+0000","last_fullsized":"2024-04-26T22:00:11.878596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.887702+0000","last_change":"2024-04-26T22:00:11.884725+0000","last_active":"2024-04-26T22:00:11.887702+0000","last_peered":"2024-04-26T22:00:11.887702+0000","last_clean":"2024-04-26T22:00:11.887702+0000","last_became_active":"2024-04-26T22:00:11.884448+0000","last_became_peered":"2024-04-26T22:00:11.884448+0000","last_unstale":"2024-04-26T22:00:11.887702+0000","last_undegraded":"2024-04-26T22:00:11.887702+0000","last_fullsized":"2024-04-26T22:00:11.887702+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:55.814565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.874489+0000","last_change":"2024-04-26T22:00:11.874489+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.874489+0000","last_undegraded":"2024-04-26T22:00:11.874489+0000","last_fullsized":"2024-04-26T22:00:11.874489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.890418+0000","last_change":"2024-04-26T22:00:11.887954+0000","last_active":"2024-04-26T22:00:11.890418+0000","last_peered":"2024-04-26T22:00:11.890418+0000","last_clean":"2024-04-26T22:00:11.890418+0000","last_became_active":"2024-04-26T22:00:11.887653+0000","last_became_peered":"2024-04-26T22:00:11.887653+0000","last_unstale":"2024-04-26T22:00:11.890418+0000","last_undegraded":"2024-04-26T22:00:11.890418+0000","last_fullsized":"2024-04-26T22:00:11.890418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:55.814565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.870509+0000","last_change":"2024-04-26T22:00:11.870509+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.870509+0000","last_undegraded":"2024-04-26T22:00:11.870509+0000","last_fullsized":"2024-04-26T22:00:11.870509+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.892447+0000","last_change":"2024-04-26T22:00:11.882774+0000","last_active":"2024-04-26T22:00:11.892447+0000","last_peered":"2024-04-26T22:00:11.892447+0000","last_clean":"2024-04-26T22:00:11.892447+0000","last_became_active":"2024-04-26T22:00:11.882439+0000","last_became_peered":"2024-04-26T22:00:11.882439+0000","last_unstale":"2024-04-26T22:00:11.892447+0000","last_undegraded":"2024-04-26T22:00:11.892447+0000","last_fullsized":"2024-04-26T22:00:11.892447+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:25.098175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-04-26T22:00:11.875081+0000","last_change":"2024-04-26T22:00:11.875081+0000","last_active":"2024-04-26T22:00:11.864856+0000","last_peered":"2024-04-26T22:00:11.864856+0000","last_clean":"2024-04-26T22:00:11.864856+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:00:11.875081+0000","last_undegraded":"2024-04-26T22:00:11.875081+0000","last_fullsized":"2024-04-26T22:00:11.875081+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.886225+0000","last_change":"2024-04-26T22:00:11.884787+0000","last_active":"2024-04-26T22:00:11.886225+0000","last_peered":"2024-04-26T22:00:11.886225+0000","last_clean":"2024-04-26T22:00:11.886225+0000","last_became_active":"2024-04-26T22:00:11.884493+0000","last_became_peered":"2024-04-26T22:00:11.884493+0000","last_unstale":"2024-04-26T22:00:11.886225+0000","last_undegraded":"2024-04-26T22:00:11.886225+0000","last_fullsized":"2024-04-26T22:00:11.886225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:33.654892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":216,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-26T22:00:11.873495+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:00:11.873495+0000","last_peered":"2024-04-26T22:00:11.873495+0000","last_clean":"2024-04-26T22:00:11.873495+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:00:11.873495+0000","last_undegraded":"2024-04-26T22:00:11.873495+0000","last_fullsized":"2024-04-26T22:00:11.873495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1110016,"data_stored":797079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":206711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1110016,"data_stored":797079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:00:18.134 INFO:tasks.ceph.mds.c.smithi137.stderr:2024-04-26T22:00:18.135+0000 7f136523a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:00:20.243 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:00:20.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.351+0000 7fe9d40b0640 1 Processor -- start 2024-04-26T22:00:20.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.351+0000 7fe9d40b0640 1 -- start start 2024-04-26T22:00:20.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d40b0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe9cc15f340 0x7fe9cc0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d40b0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe9cc15f720 0x7fe9cc0d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d40b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 0x7fe9cc0d5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d40b0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe9cc0d58d0 con 0x7fe9cc15f720 2024-04-26T22:00:20.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d40b0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe9cc0b2510 con 0x7fe9cc15f340 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d40b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe9cc0b27f0 con 0x7fe9cc0d4f00 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d164b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe9cc15f720 0x7fe9cc0d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d164b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe9cc15f720 0x7fe9cc0d3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38132/0 (socket says 172.21.15.137:38132) 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d164b640 1 -- 172.21.15.137:0/3606756768 learned_addr learned my addr 172.21.15.137:0/3606756768 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d1e4c640 1 --2- 172.21.15.137:0/3606756768 >> v2:172.21.15.170:3300/0 conn(0x7fe9cc15f340 0x7fe9cc0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d264d640 1 --2- 172.21.15.137:0/3606756768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 0x7fe9cc0d5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d164b640 1 -- 172.21.15.137:0/3606756768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 msgr2=0x7fe9cc0d5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.352+0000 7fe9d164b640 1 --2- 172.21.15.137:0/3606756768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 0x7fe9cc0d5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.353+0000 7fe9d164b640 1 -- 172.21.15.137:0/3606756768 >> v2:172.21.15.170:3300/0 conn(0x7fe9cc15f340 msgr2=0x7fe9cc0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.353+0000 7fe9d164b640 1 --2- 172.21.15.137:0/3606756768 >> v2:172.21.15.170:3300/0 conn(0x7fe9cc15f340 0x7fe9cc0b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.353+0000 7fe9d164b640 1 -- 172.21.15.137:0/3606756768 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc0b2ad0 con 0x7fe9cc15f720 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.353+0000 7fe9d164b640 1 --2- 172.21.15.137:0/3606756768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f720 0x7fe9cc0d3d40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0d6000 tx=0x7fe9bc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10e643e0b787d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:20.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.353+0000 7fe9d0e4a640 1 -- 172.21.15.137:0/3606756768 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc037070 con 0x7fe9cc15f720 2024-04-26T22:00:20.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.353+0000 7fe9d0e4a640 1 -- 172.21.15.137:0/3606756768 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9bc032440 con 0x7fe9cc15f720 2024-04-26T22:00:20.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.353+0000 7fe9d0e4a640 1 -- 172.21.15.137:0/3606756768 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc032810 con 0x7fe9cc15f720 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.354+0000 7fe9d40b0640 1 -- 172.21.15.137:0/3606756768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f720 msgr2=0x7fe9cc0d3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.354+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/3606756768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f720 0x7fe9cc0d3d40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0d6000 tx=0x7fe9bc02a140 comp rx=0 tx=0).stop 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.354+0000 7fe9d40b0640 1 -- 172.21.15.137:0/3606756768 shutdown_connections 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.354+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/3606756768 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 0x7fe9cc0d5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.354+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/3606756768 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f720 0x7fe9cc0d3d40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.354+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/3606756768 >> v2:172.21.15.170:3300/0 conn(0x7fe9cc15f340 0x7fe9cc0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.354+0000 7fe9d40b0640 1 -- 172.21.15.137:0/3606756768 >> 172.21.15.137:0/3606756768 conn(0x7fe9cc08ec70 msgr2=0x7fe9cc09e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.354+0000 7fe9d40b0640 1 -- 172.21.15.137:0/3606756768 shutdown_connections 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.354+0000 7fe9d40b0640 1 -- 172.21.15.137:0/3606756768 wait complete. 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.355+0000 7fe9d40b0640 1 Processor -- start 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.355+0000 7fe9d40b0640 1 -- start start 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d40b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 0x7fe9cc15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d40b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f340 0x7fe9cc1f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d40b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9cc15f720 0x7fe9cc1f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d40b0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc0b5040 con 0x7fe9cc15f340 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d40b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe9cc0b4ec0 con 0x7fe9cc15f720 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d40b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe9cc0b51c0 con 0x7fe9cc0d4f00 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d164b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f340 0x7fe9cc1f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d164b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f340 0x7fe9cc1f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38140/0 (socket says 172.21.15.137:38140) 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d164b640 1 -- 172.21.15.137:0/1019022778 learned_addr learned my addr 172.21.15.137:0/1019022778 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d1e4c640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 0x7fe9cc15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d264d640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9cc15f720 0x7fe9cc1f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d164b640 1 -- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 msgr2=0x7fe9cc15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d164b640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 0x7fe9cc15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d164b640 1 -- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9cc15f720 msgr2=0x7fe9cc1f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d164b640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9cc15f720 0x7fe9cc1f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d164b640 1 -- 172.21.15.137:0/1019022778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9cc1f2ba0 con 0x7fe9cc15f340 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d264d640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9cc15f720 0x7fe9cc1f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:20.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.356+0000 7fe9d1e4c640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 0x7fe9cc15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:20.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.357+0000 7fe9d164b640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f340 0x7fe9cc1f4f60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc02a180 tx=0x7fe9bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:20.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.357+0000 7fe9c27fc640 1 -- 172.21.15.137:0/1019022778 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc041020 con 0x7fe9cc15f340 2024-04-26T22:00:20.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.357+0000 7fe9c27fc640 1 -- 172.21.15.137:0/1019022778 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9bc03d620 con 0x7fe9cc15f340 2024-04-26T22:00:20.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.357+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9cc1f5a90 con 0x7fe9cc15f340 2024-04-26T22:00:20.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.357+0000 7fe9c27fc640 1 -- 172.21.15.137:0/1019022778 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc037040 con 0x7fe9cc15f340 2024-04-26T22:00:20.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.357+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9cc1f2e60 con 0x7fe9cc15f340 2024-04-26T22:00:20.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.358+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9cc06a290 con 0x7fe9cc15f340 2024-04-26T22:00:20.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.358+0000 7fe9c27fc640 1 -- 172.21.15.137:0/1019022778 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9bc044020 con 0x7fe9cc15f340 2024-04-26T22:00:20.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.359+0000 7fe9c27fc640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9b006c8f0 0x7fe9b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.359+0000 7fe9c27fc640 1 -- 172.21.15.137:0/1019022778 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe9bc0ac100 con 0x7fe9cc15f340 2024-04-26T22:00:20.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.359+0000 7fe9d1e4c640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9b006c8f0 0x7fe9b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.359+0000 7fe9d1e4c640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9b006c8f0 0x7fe9b006edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc15e3c0 tx=0x7fe9c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:20.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.363+0000 7fe9c27fc640 1 -- 172.21.15.137:0/1019022778 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe9bc04b030 con 0x7fe9cc15f340 2024-04-26T22:00:20.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.537+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9cc0c8770 con 0x7fe9b006c8f0 2024-04-26T22:00:20.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.543+0000 7fe9c27fc640 1 -- 172.21.15.137:0/1019022778 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fe9cc0c8770 con 0x7fe9b006c8f0 2024-04-26T22:00:20.546 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:20.547 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:00:20.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9b006c8f0 msgr2=0x7fe9b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9b006c8f0 0x7fe9b006edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc15e3c0 tx=0x7fe9c8008040 comp rx=0 tx=0).stop 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f340 msgr2=0x7fe9cc1f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f340 0x7fe9cc1f4f60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc02a180 tx=0x7fe9bc0046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 shutdown_connections 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9b006c8f0 0x7fe9b006edb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9cc15f340 0x7fe9cc1f4f60 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9cc15f720 0x7fe9cc1f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 --2- 172.21.15.137:0/1019022778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9cc0d4f00 0x7fe9cc15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.546+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 >> 172.21.15.137:0/1019022778 conn(0x7fe9cc08ec70 msgr2=0x7fe9cc0b75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.547+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 shutdown_connections 2024-04-26T22:00:20.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.547+0000 7fe9d40b0640 1 -- 172.21.15.137:0/1019022778 wait complete. 2024-04-26T22:00:20.557 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-04-26T22:00:18.712407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238272,"kb_used_data":5448,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736448,"statfs":{"total":773094113280,"available":772850122752,"internally_reserved":0,"allocated":5578752,"data_stored":2943844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.844165"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898949+0000","last_change":"2024-04-26T22:00:12.898677+0000","last_active":"2024-04-26T22:00:13.898949+0000","last_peered":"2024-04-26T22:00:13.898949+0000","last_clean":"2024-04-26T22:00:13.898949+0000","last_became_active":"2024-04-26T22:00:12.898378+0000","last_became_peered":"2024-04-26T22:00:12.898378+0000","last_unstale":"2024-04-26T22:00:13.898949+0000","last_undegraded":"2024-04-26T22:00:13.898949+0000","last_fullsized":"2024-04-26T22:00:13.898949+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:46.887610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899413+0000","last_change":"2024-04-26T22:00:12.903036+0000","last_active":"2024-04-26T22:00:13.899413+0000","last_peered":"2024-04-26T22:00:13.899413+0000","last_clean":"2024-04-26T22:00:13.899413+0000","last_became_active":"2024-04-26T22:00:12.902764+0000","last_became_peered":"2024-04-26T22:00:12.902764+0000","last_unstale":"2024-04-26T22:00:13.899413+0000","last_undegraded":"2024-04-26T22:00:13.899413+0000","last_fullsized":"2024-04-26T22:00:13.899413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:12.657628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898754+0000","last_change":"2024-04-26T22:00:12.907709+0000","last_active":"2024-04-26T22:00:13.898754+0000","last_peered":"2024-04-26T22:00:13.898754+0000","last_clean":"2024-04-26T22:00:13.898754+0000","last_became_active":"2024-04-26T22:00:12.907416+0000","last_became_peered":"2024-04-26T22:00:12.907416+0000","last_unstale":"2024-04-26T22:00:13.898754+0000","last_undegraded":"2024-04-26T22:00:13.898754+0000","last_fullsized":"2024-04-26T22:00:13.898754+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:05.880953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183260+0000","last_change":"2024-04-26T22:00:12.895053+0000","last_active":"2024-04-26T22:00:14.183260+0000","last_peered":"2024-04-26T22:00:14.183260+0000","last_clean":"2024-04-26T22:00:14.183260+0000","last_became_active":"2024-04-26T22:00:12.894780+0000","last_became_peered":"2024-04-26T22:00:12.894780+0000","last_unstale":"2024-04-26T22:00:14.183260+0000","last_undegraded":"2024-04-26T22:00:14.183260+0000","last_fullsized":"2024-04-26T22:00:14.183260+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:09.143865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899163+0000","last_change":"2024-04-26T22:00:12.905325+0000","last_active":"2024-04-26T22:00:13.899163+0000","last_peered":"2024-04-26T22:00:13.899163+0000","last_clean":"2024-04-26T22:00:13.899163+0000","last_became_active":"2024-04-26T22:00:12.905041+0000","last_became_peered":"2024-04-26T22:00:12.905041+0000","last_unstale":"2024-04-26T22:00:13.899163+0000","last_undegraded":"2024-04-26T22:00:13.899163+0000","last_fullsized":"2024-04-26T22:00:13.899163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:03.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.129840+0000","last_change":"2024-04-26T22:00:12.891923+0000","last_active":"2024-04-26T22:00:14.129840+0000","last_peered":"2024-04-26T22:00:14.129840+0000","last_clean":"2024-04-26T22:00:14.129840+0000","last_became_active":"2024-04-26T22:00:12.891623+0000","last_became_peered":"2024-04-26T22:00:12.891623+0000","last_unstale":"2024-04-26T22:00:14.129840+0000","last_undegraded":"2024-04-26T22:00:14.129840+0000","last_fullsized":"2024-04-26T22:00:14.129840+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:56:54.853957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898832+0000","last_change":"2024-04-26T22:00:12.903454+0000","last_active":"2024-04-26T22:00:13.898832+0000","last_peered":"2024-04-26T22:00:13.898832+0000","last_clean":"2024-04-26T22:00:13.898832+0000","last_became_active":"2024-04-26T22:00:12.903144+0000","last_became_peered":"2024-04-26T22:00:12.903144+0000","last_unstale":"2024-04-26T22:00:13.898832+0000","last_undegraded":"2024-04-26T22:00:13.898832+0000","last_fullsized":"2024-04-26T22:00:13.898832+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:09.143865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183030+0000","last_change":"2024-04-26T22:00:12.894384+0000","last_active":"2024-04-26T22:00:14.183030+0000","last_peered":"2024-04-26T22:00:14.183030+0000","last_clean":"2024-04-26T22:00:14.183030+0000","last_became_active":"2024-04-26T22:00:12.894086+0000","last_became_peered":"2024-04-26T22:00:12.894086+0000","last_unstale":"2024-04-26T22:00:14.183030+0000","last_undegraded":"2024-04-26T22:00:14.183030+0000","last_fullsized":"2024-04-26T22:00:14.183030+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:58.561776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183379+0000","last_change":"2024-04-26T22:00:12.896111+0000","last_active":"2024-04-26T22:00:14.183379+0000","last_peered":"2024-04-26T22:00:14.183379+0000","last_clean":"2024-04-26T22:00:14.183379+0000","last_became_active":"2024-04-26T22:00:12.895822+0000","last_became_peered":"2024-04-26T22:00:12.895822+0000","last_unstale":"2024-04-26T22:00:14.183379+0000","last_undegraded":"2024-04-26T22:00:14.183379+0000","last_fullsized":"2024-04-26T22:00:14.183379+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:20.451736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183602+0000","last_change":"2024-04-26T22:00:12.896278+0000","last_active":"2024-04-26T22:00:14.183602+0000","last_peered":"2024-04-26T22:00:14.183602+0000","last_clean":"2024-04-26T22:00:14.183602+0000","last_became_active":"2024-04-26T22:00:12.895471+0000","last_became_peered":"2024-04-26T22:00:12.895471+0000","last_unstale":"2024-04-26T22:00:14.183602+0000","last_undegraded":"2024-04-26T22:00:14.183602+0000","last_fullsized":"2024-04-26T22:00:14.183602+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:09.026685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183331+0000","last_change":"2024-04-26T22:00:12.901322+0000","last_active":"2024-04-26T22:00:14.183331+0000","last_peered":"2024-04-26T22:00:14.183331+0000","last_clean":"2024-04-26T22:00:14.183331+0000","last_became_active":"2024-04-26T22:00:12.900814+0000","last_became_peered":"2024-04-26T22:00:12.900814+0000","last_unstale":"2024-04-26T22:00:14.183331+0000","last_undegraded":"2024-04-26T22:00:14.183331+0000","last_fullsized":"2024-04-26T22:00:14.183331+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:01.572358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899814+0000","last_change":"2024-04-26T22:00:12.897909+0000","last_active":"2024-04-26T22:00:13.899814+0000","last_peered":"2024-04-26T22:00:13.899814+0000","last_clean":"2024-04-26T22:00:13.899814+0000","last_became_active":"2024-04-26T22:00:12.896930+0000","last_became_peered":"2024-04-26T22:00:12.896930+0000","last_unstale":"2024-04-26T22:00:13.899814+0000","last_undegraded":"2024-04-26T22:00:13.899814+0000","last_fullsized":"2024-04-26T22:00:13.899814+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:43.620810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196836+0000","last_change":"2024-04-26T22:00:12.904618+0000","last_active":"2024-04-26T22:00:14.196836+0000","last_peered":"2024-04-26T22:00:14.196836+0000","last_clean":"2024-04-26T22:00:14.196836+0000","last_became_active":"2024-04-26T22:00:12.904355+0000","last_became_peered":"2024-04-26T22:00:12.904355+0000","last_unstale":"2024-04-26T22:00:14.196836+0000","last_undegraded":"2024-04-26T22:00:14.196836+0000","last_fullsized":"2024-04-26T22:00:14.196836+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:26.102326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183168+0000","last_change":"2024-04-26T22:00:12.901680+0000","last_active":"2024-04-26T22:00:14.183168+0000","last_peered":"2024-04-26T22:00:14.183168+0000","last_clean":"2024-04-26T22:00:14.183168+0000","last_became_active":"2024-04-26T22:00:12.900953+0000","last_became_peered":"2024-04-26T22:00:12.900953+0000","last_unstale":"2024-04-26T22:00:14.183168+0000","last_undegraded":"2024-04-26T22:00:14.183168+0000","last_fullsized":"2024-04-26T22:00:14.183168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:26.529489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.129790+0000","last_change":"2024-04-26T22:00:12.896511+0000","last_active":"2024-04-26T22:00:14.129790+0000","last_peered":"2024-04-26T22:00:14.129790+0000","last_clean":"2024-04-26T22:00:14.129790+0000","last_became_active":"2024-04-26T22:00:12.896206+0000","last_became_peered":"2024-04-26T22:00:12.896206+0000","last_unstale":"2024-04-26T22:00:14.129790+0000","last_undegraded":"2024-04-26T22:00:14.129790+0000","last_fullsized":"2024-04-26T22:00:14.129790+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:11.988681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197001+0000","last_change":"2024-04-26T22:00:12.897619+0000","last_active":"2024-04-26T22:00:14.197001+0000","last_peered":"2024-04-26T22:00:14.197001+0000","last_clean":"2024-04-26T22:00:14.197001+0000","last_became_active":"2024-04-26T22:00:12.897369+0000","last_became_peered":"2024-04-26T22:00:12.897369+0000","last_unstale":"2024-04-26T22:00:14.197001+0000","last_undegraded":"2024-04-26T22:00:14.197001+0000","last_fullsized":"2024-04-26T22:00:14.197001+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:51.354677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899126+0000","last_change":"2024-04-26T22:00:12.899571+0000","last_active":"2024-04-26T22:00:13.899126+0000","last_peered":"2024-04-26T22:00:13.899126+0000","last_clean":"2024-04-26T22:00:13.899126+0000","last_became_active":"2024-04-26T22:00:12.899282+0000","last_became_peered":"2024-04-26T22:00:12.899282+0000","last_unstale":"2024-04-26T22:00:13.899126+0000","last_undegraded":"2024-04-26T22:00:13.899126+0000","last_fullsized":"2024-04-26T22:00:13.899126+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:20.741262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899207+0000","last_change":"2024-04-26T22:00:12.905328+0000","last_active":"2024-04-26T22:00:13.899207+0000","last_peered":"2024-04-26T22:00:13.899207+0000","last_clean":"2024-04-26T22:00:13.899207+0000","last_became_active":"2024-04-26T22:00:12.905018+0000","last_became_peered":"2024-04-26T22:00:12.905018+0000","last_unstale":"2024-04-26T22:00:13.899207+0000","last_undegraded":"2024-04-26T22:00:13.899207+0000","last_fullsized":"2024-04-26T22:00:13.899207+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:12.657628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197528+0000","last_change":"2024-04-26T22:00:12.902500+0000","last_active":"2024-04-26T22:00:14.197528+0000","last_peered":"2024-04-26T22:00:14.197528+0000","last_clean":"2024-04-26T22:00:14.197528+0000","last_became_active":"2024-04-26T22:00:12.902159+0000","last_became_peered":"2024-04-26T22:00:12.902159+0000","last_unstale":"2024-04-26T22:00:14.197528+0000","last_undegraded":"2024-04-26T22:00:14.197528+0000","last_fullsized":"2024-04-26T22:00:14.197528+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:59.935385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196770+0000","last_change":"2024-04-26T22:00:12.907273+0000","last_active":"2024-04-26T22:00:14.196770+0000","last_peered":"2024-04-26T22:00:14.196770+0000","last_clean":"2024-04-26T22:00:14.196770+0000","last_became_active":"2024-04-26T22:00:12.907025+0000","last_became_peered":"2024-04-26T22:00:12.907025+0000","last_unstale":"2024-04-26T22:00:14.196770+0000","last_undegraded":"2024-04-26T22:00:14.196770+0000","last_fullsized":"2024-04-26T22:00:14.196770+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:08.854294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130189+0000","last_change":"2024-04-26T22:00:12.898324+0000","last_active":"2024-04-26T22:00:14.130189+0000","last_peered":"2024-04-26T22:00:14.130189+0000","last_clean":"2024-04-26T22:00:14.130189+0000","last_became_active":"2024-04-26T22:00:12.898028+0000","last_became_peered":"2024-04-26T22:00:12.898028+0000","last_unstale":"2024-04-26T22:00:14.130189+0000","last_undegraded":"2024-04-26T22:00:14.130189+0000","last_fullsized":"2024-04-26T22:00:14.130189+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:48.087450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183309+0000","last_change":"2024-04-26T22:00:12.906335+0000","last_active":"2024-04-26T22:00:14.183309+0000","last_peered":"2024-04-26T22:00:14.183309+0000","last_clean":"2024-04-26T22:00:14.183309+0000","last_became_active":"2024-04-26T22:00:12.904820+0000","last_became_peered":"2024-04-26T22:00:12.904820+0000","last_unstale":"2024-04-26T22:00:14.183309+0000","last_undegraded":"2024-04-26T22:00:14.183309+0000","last_fullsized":"2024-04-26T22:00:14.183309+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:35.507803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197179+0000","last_change":"2024-04-26T22:00:12.893011+0000","last_active":"2024-04-26T22:00:14.197179+0000","last_peered":"2024-04-26T22:00:14.197179+0000","last_clean":"2024-04-26T22:00:14.197179+0000","last_became_active":"2024-04-26T22:00:12.892741+0000","last_became_peered":"2024-04-26T22:00:12.892741+0000","last_unstale":"2024-04-26T22:00:14.197179+0000","last_undegraded":"2024-04-26T22:00:14.197179+0000","last_fullsized":"2024-04-26T22:00:14.197179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:08.272098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197030+0000","last_change":"2024-04-26T22:00:12.890360+0000","last_active":"2024-04-26T22:00:14.197030+0000","last_peered":"2024-04-26T22:00:14.197030+0000","last_clean":"2024-04-26T22:00:14.197030+0000","last_became_active":"2024-04-26T22:00:12.889822+0000","last_became_peered":"2024-04-26T22:00:12.889822+0000","last_unstale":"2024-04-26T22:00:14.197030+0000","last_undegraded":"2024-04-26T22:00:14.197030+0000","last_fullsized":"2024-04-26T22:00:14.197030+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:15.641670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197481+0000","last_change":"2024-04-26T22:00:12.903161+0000","last_active":"2024-04-26T22:00:14.197481+0000","last_peered":"2024-04-26T22:00:14.197481+0000","last_clean":"2024-04-26T22:00:14.197481+0000","last_became_active":"2024-04-26T22:00:12.901352+0000","last_became_peered":"2024-04-26T22:00:12.901352+0000","last_unstale":"2024-04-26T22:00:14.197481+0000","last_undegraded":"2024-04-26T22:00:14.197481+0000","last_fullsized":"2024-04-26T22:00:14.197481+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:49.329433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196704+0000","last_change":"2024-04-26T22:00:12.907875+0000","last_active":"2024-04-26T22:00:14.196704+0000","last_peered":"2024-04-26T22:00:14.196704+0000","last_clean":"2024-04-26T22:00:14.196704+0000","last_became_active":"2024-04-26T22:00:12.907596+0000","last_became_peered":"2024-04-26T22:00:12.907596+0000","last_unstale":"2024-04-26T22:00:14.196704+0000","last_undegraded":"2024-04-26T22:00:14.196704+0000","last_fullsized":"2024-04-26T22:00:14.196704+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:23.244663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898907+0000","last_change":"2024-04-26T22:00:12.899300+0000","last_active":"2024-04-26T22:00:13.898907+0000","last_peered":"2024-04-26T22:00:13.898907+0000","last_clean":"2024-04-26T22:00:13.898907+0000","last_became_active":"2024-04-26T22:00:12.899023+0000","last_became_peered":"2024-04-26T22:00:12.899023+0000","last_unstale":"2024-04-26T22:00:13.898907+0000","last_undegraded":"2024-04-26T22:00:13.898907+0000","last_fullsized":"2024-04-26T22:00:13.898907+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:10:56.146272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899911+0000","last_change":"2024-04-26T22:00:12.896915+0000","last_active":"2024-04-26T22:00:13.899911+0000","last_peered":"2024-04-26T22:00:13.899911+0000","last_clean":"2024-04-26T22:00:13.899911+0000","last_became_active":"2024-04-26T22:00:12.896555+0000","last_became_peered":"2024-04-26T22:00:12.896555+0000","last_unstale":"2024-04-26T22:00:13.899911+0000","last_undegraded":"2024-04-26T22:00:13.899911+0000","last_fullsized":"2024-04-26T22:00:13.899911+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:09.143865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197101+0000","last_change":"2024-04-26T22:00:12.899171+0000","last_active":"2024-04-26T22:00:14.197101+0000","last_peered":"2024-04-26T22:00:14.197101+0000","last_clean":"2024-04-26T22:00:14.197101+0000","last_became_active":"2024-04-26T22:00:12.898919+0000","last_became_peered":"2024-04-26T22:00:12.898919+0000","last_unstale":"2024-04-26T22:00:14.197101+0000","last_undegraded":"2024-04-26T22:00:14.197101+0000","last_fullsized":"2024-04-26T22:00:14.197101+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:29:34.659042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899183+0000","last_change":"2024-04-26T22:00:12.897662+0000","last_active":"2024-04-26T22:00:13.899183+0000","last_peered":"2024-04-26T22:00:13.899183+0000","last_clean":"2024-04-26T22:00:13.899183+0000","last_became_active":"2024-04-26T22:00:12.897370+0000","last_became_peered":"2024-04-26T22:00:12.897370+0000","last_unstale":"2024-04-26T22:00:13.899183+0000","last_undegraded":"2024-04-26T22:00:13.899183+0000","last_fullsized":"2024-04-26T22:00:13.899183+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:03.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.129827+0000","last_change":"2024-04-26T22:00:12.892844+0000","last_active":"2024-04-26T22:00:14.129827+0000","last_peered":"2024-04-26T22:00:14.129827+0000","last_clean":"2024-04-26T22:00:14.129827+0000","last_became_active":"2024-04-26T22:00:12.892553+0000","last_became_peered":"2024-04-26T22:00:12.892553+0000","last_unstale":"2024-04-26T22:00:14.129827+0000","last_undegraded":"2024-04-26T22:00:14.129827+0000","last_fullsized":"2024-04-26T22:00:14.129827+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:21.927012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196530+0000","last_change":"2024-04-26T22:00:12.898551+0000","last_active":"2024-04-26T22:00:14.196530+0000","last_peered":"2024-04-26T22:00:14.196530+0000","last_clean":"2024-04-26T22:00:14.196530+0000","last_became_active":"2024-04-26T22:00:12.898287+0000","last_became_peered":"2024-04-26T22:00:12.898287+0000","last_unstale":"2024-04-26T22:00:14.196530+0000","last_undegraded":"2024-04-26T22:00:14.196530+0000","last_fullsized":"2024-04-26T22:00:14.196530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:29.816404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197363+0000","last_change":"2024-04-26T22:00:12.899834+0000","last_active":"2024-04-26T22:00:14.197363+0000","last_peered":"2024-04-26T22:00:14.197363+0000","last_clean":"2024-04-26T22:00:14.197363+0000","last_became_active":"2024-04-26T22:00:12.899566+0000","last_became_peered":"2024-04-26T22:00:12.899566+0000","last_unstale":"2024-04-26T22:00:14.197363+0000","last_undegraded":"2024-04-26T22:00:14.197363+0000","last_fullsized":"2024-04-26T22:00:14.197363+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:00.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130094+0000","last_change":"2024-04-26T22:00:11.887450+0000","last_active":"2024-04-26T22:00:14.130094+0000","last_peered":"2024-04-26T22:00:14.130094+0000","last_clean":"2024-04-26T22:00:14.130094+0000","last_became_active":"2024-04-26T22:00:11.887100+0000","last_became_peered":"2024-04-26T22:00:11.887100+0000","last_unstale":"2024-04-26T22:00:14.130094+0000","last_undegraded":"2024-04-26T22:00:14.130094+0000","last_fullsized":"2024-04-26T22:00:14.130094+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:02.537373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197483+0000","last_change":"2024-04-26T22:00:12.901296+0000","last_active":"2024-04-26T22:00:14.197483+0000","last_peered":"2024-04-26T22:00:14.197483+0000","last_clean":"2024-04-26T22:00:14.197483+0000","last_became_active":"2024-04-26T22:00:12.900918+0000","last_became_peered":"2024-04-26T22:00:12.900918+0000","last_unstale":"2024-04-26T22:00:14.197483+0000","last_undegraded":"2024-04-26T22:00:14.197483+0000","last_fullsized":"2024-04-26T22:00:14.197483+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:02.299965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899624+0000","last_change":"2024-04-26T22:00:11.882486+0000","last_active":"2024-04-26T22:00:13.899624+0000","last_peered":"2024-04-26T22:00:13.899624+0000","last_clean":"2024-04-26T22:00:13.899624+0000","last_became_active":"2024-04-26T22:00:11.882256+0000","last_became_peered":"2024-04-26T22:00:11.882256+0000","last_unstale":"2024-04-26T22:00:13.899624+0000","last_undegraded":"2024-04-26T22:00:13.899624+0000","last_fullsized":"2024-04-26T22:00:13.899624+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:05.404610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899978+0000","last_change":"2024-04-26T22:00:12.898601+0000","last_active":"2024-04-26T22:00:13.899978+0000","last_peered":"2024-04-26T22:00:13.899978+0000","last_clean":"2024-04-26T22:00:13.899978+0000","last_became_active":"2024-04-26T22:00:12.898355+0000","last_became_peered":"2024-04-26T22:00:12.898355+0000","last_unstale":"2024-04-26T22:00:13.899978+0000","last_undegraded":"2024-04-26T22:00:13.899978+0000","last_fullsized":"2024-04-26T22:00:13.899978+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:35.507803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197080+0000","last_change":"2024-04-26T22:00:11.882943+0000","last_active":"2024-04-26T22:00:14.197080+0000","last_peered":"2024-04-26T22:00:14.197080+0000","last_clean":"2024-04-26T22:00:14.197080+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:14.197080+0000","last_undegraded":"2024-04-26T22:00:14.197080+0000","last_fullsized":"2024-04-26T22:00:14.197080+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:50.350527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196984+0000","last_change":"2024-04-26T22:00:12.896909+0000","last_active":"2024-04-26T22:00:14.196984+0000","last_peered":"2024-04-26T22:00:14.196984+0000","last_clean":"2024-04-26T22:00:14.196984+0000","last_became_active":"2024-04-26T22:00:12.896616+0000","last_became_peered":"2024-04-26T22:00:12.896616+0000","last_unstale":"2024-04-26T22:00:14.196984+0000","last_undegraded":"2024-04-26T22:00:14.196984+0000","last_fullsized":"2024-04-26T22:00:14.196984+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:39:08.272098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898733+0000","last_change":"2024-04-26T22:00:11.879917+0000","last_active":"2024-04-26T22:00:13.898733+0000","last_peered":"2024-04-26T22:00:13.898733+0000","last_clean":"2024-04-26T22:00:13.898733+0000","last_became_active":"2024-04-26T22:00:11.879301+0000","last_became_peered":"2024-04-26T22:00:11.879301+0000","last_unstale":"2024-04-26T22:00:13.898733+0000","last_undegraded":"2024-04-26T22:00:13.898733+0000","last_fullsized":"2024-04-26T22:00:13.898733+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:03.645360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899535+0000","last_change":"2024-04-26T22:00:12.901944+0000","last_active":"2024-04-26T22:00:13.899535+0000","last_peered":"2024-04-26T22:00:13.899535+0000","last_clean":"2024-04-26T22:00:13.899535+0000","last_became_active":"2024-04-26T22:00:12.901672+0000","last_became_peered":"2024-04-26T22:00:12.901672+0000","last_unstale":"2024-04-26T22:00:13.899535+0000","last_undegraded":"2024-04-26T22:00:13.899535+0000","last_fullsized":"2024-04-26T22:00:13.899535+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:43.620810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130217+0000","last_change":"2024-04-26T22:00:11.884768+0000","last_active":"2024-04-26T22:00:14.130217+0000","last_peered":"2024-04-26T22:00:14.130217+0000","last_clean":"2024-04-26T22:00:14.130217+0000","last_became_active":"2024-04-26T22:00:11.884497+0000","last_became_peered":"2024-04-26T22:00:11.884497+0000","last_unstale":"2024-04-26T22:00:14.130217+0000","last_undegraded":"2024-04-26T22:00:14.130217+0000","last_fullsized":"2024-04-26T22:00:14.130217+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:11.653478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183228+0000","last_change":"2024-04-26T22:00:12.899207+0000","last_active":"2024-04-26T22:00:14.183228+0000","last_peered":"2024-04-26T22:00:14.183228+0000","last_clean":"2024-04-26T22:00:14.183228+0000","last_became_active":"2024-04-26T22:00:12.897533+0000","last_became_peered":"2024-04-26T22:00:12.897533+0000","last_unstale":"2024-04-26T22:00:14.183228+0000","last_undegraded":"2024-04-26T22:00:14.183228+0000","last_fullsized":"2024-04-26T22:00:14.183228+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:43.620810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899317+0000","last_change":"2024-04-26T22:00:11.878473+0000","last_active":"2024-04-26T22:00:13.899317+0000","last_peered":"2024-04-26T22:00:13.899317+0000","last_clean":"2024-04-26T22:00:13.899317+0000","last_became_active":"2024-04-26T22:00:11.878195+0000","last_became_peered":"2024-04-26T22:00:11.878195+0000","last_unstale":"2024-04-26T22:00:13.899317+0000","last_undegraded":"2024-04-26T22:00:13.899317+0000","last_fullsized":"2024-04-26T22:00:13.899317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:10.045908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183054+0000","last_change":"2024-04-26T22:00:12.902697+0000","last_active":"2024-04-26T22:00:14.183054+0000","last_peered":"2024-04-26T22:00:14.183054+0000","last_clean":"2024-04-26T22:00:14.183054+0000","last_became_active":"2024-04-26T22:00:12.902445+0000","last_became_peered":"2024-04-26T22:00:12.902445+0000","last_unstale":"2024-04-26T22:00:14.183054+0000","last_undegraded":"2024-04-26T22:00:14.183054+0000","last_fullsized":"2024-04-26T22:00:14.183054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:03.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898726+0000","last_change":"2024-04-26T22:00:11.880991+0000","last_active":"2024-04-26T22:00:13.898726+0000","last_peered":"2024-04-26T22:00:13.898726+0000","last_clean":"2024-04-26T22:00:13.898726+0000","last_became_active":"2024-04-26T22:00:11.880707+0000","last_became_peered":"2024-04-26T22:00:11.880707+0000","last_unstale":"2024-04-26T22:00:13.898726+0000","last_undegraded":"2024-04-26T22:00:13.898726+0000","last_fullsized":"2024-04-26T22:00:13.898726+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:59.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196940+0000","last_change":"2024-04-26T22:00:12.893799+0000","last_active":"2024-04-26T22:00:14.196940+0000","last_peered":"2024-04-26T22:00:14.196940+0000","last_clean":"2024-04-26T22:00:14.196940+0000","last_became_active":"2024-04-26T22:00:12.893539+0000","last_became_peered":"2024-04-26T22:00:12.893539+0000","last_unstale":"2024-04-26T22:00:14.196940+0000","last_undegraded":"2024-04-26T22:00:14.196940+0000","last_fullsized":"2024-04-26T22:00:14.196940+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:26:06.408760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183239+0000","last_change":"2024-04-26T22:00:11.881712+0000","last_active":"2024-04-26T22:00:14.183239+0000","last_peered":"2024-04-26T22:00:14.183239+0000","last_clean":"2024-04-26T22:00:14.183239+0000","last_became_active":"2024-04-26T22:00:11.881009+0000","last_became_peered":"2024-04-26T22:00:11.881009+0000","last_unstale":"2024-04-26T22:00:14.183239+0000","last_undegraded":"2024-04-26T22:00:14.183239+0000","last_fullsized":"2024-04-26T22:00:14.183239+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:58:21.325594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899471+0000","last_change":"2024-04-26T22:00:12.905237+0000","last_active":"2024-04-26T22:00:13.899471+0000","last_peered":"2024-04-26T22:00:13.899471+0000","last_clean":"2024-04-26T22:00:13.899471+0000","last_became_active":"2024-04-26T22:00:12.904949+0000","last_became_peered":"2024-04-26T22:00:12.904949+0000","last_unstale":"2024-04-26T22:00:13.899471+0000","last_undegraded":"2024-04-26T22:00:13.899471+0000","last_fullsized":"2024-04-26T22:00:13.899471+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:26.529489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899285+0000","last_change":"2024-04-26T22:00:11.884051+0000","last_active":"2024-04-26T22:00:13.899285+0000","last_peered":"2024-04-26T22:00:13.899285+0000","last_clean":"2024-04-26T22:00:13.899285+0000","last_became_active":"2024-04-26T22:00:11.883778+0000","last_became_peered":"2024-04-26T22:00:11.883778+0000","last_unstale":"2024-04-26T22:00:13.899285+0000","last_undegraded":"2024-04-26T22:00:13.899285+0000","last_fullsized":"2024-04-26T22:00:13.899285+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:50.350527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899551+0000","last_change":"2024-04-26T22:00:12.890956+0000","last_active":"2024-04-26T22:00:13.899551+0000","last_peered":"2024-04-26T22:00:13.899551+0000","last_clean":"2024-04-26T22:00:13.899551+0000","last_became_active":"2024-04-26T22:00:12.890657+0000","last_became_peered":"2024-04-26T22:00:12.890657+0000","last_unstale":"2024-04-26T22:00:13.899551+0000","last_undegraded":"2024-04-26T22:00:13.899551+0000","last_fullsized":"2024-04-26T22:00:13.899551+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:58.561776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183677+0000","last_change":"2024-04-26T22:00:11.876171+0000","last_active":"2024-04-26T22:00:14.183677+0000","last_peered":"2024-04-26T22:00:14.183677+0000","last_clean":"2024-04-26T22:00:14.183677+0000","last_became_active":"2024-04-26T22:00:11.875895+0000","last_became_peered":"2024-04-26T22:00:11.875895+0000","last_unstale":"2024-04-26T22:00:14.183677+0000","last_undegraded":"2024-04-26T22:00:14.183677+0000","last_fullsized":"2024-04-26T22:00:14.183677+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:10.045908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130172+0000","last_change":"2024-04-26T22:00:12.909632+0000","last_active":"2024-04-26T22:00:14.130172+0000","last_peered":"2024-04-26T22:00:14.130172+0000","last_clean":"2024-04-26T22:00:14.130172+0000","last_became_active":"2024-04-26T22:00:12.909330+0000","last_became_peered":"2024-04-26T22:00:12.909330+0000","last_unstale":"2024-04-26T22:00:14.130172+0000","last_undegraded":"2024-04-26T22:00:14.130172+0000","last_fullsized":"2024-04-26T22:00:14.130172+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:44:41.418204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899318+0000","last_change":"2024-04-26T22:00:11.884653+0000","last_active":"2024-04-26T22:00:13.899318+0000","last_peered":"2024-04-26T22:00:13.899318+0000","last_clean":"2024-04-26T22:00:13.899318+0000","last_became_active":"2024-04-26T22:00:11.884363+0000","last_became_peered":"2024-04-26T22:00:11.884363+0000","last_unstale":"2024-04-26T22:00:13.899318+0000","last_undegraded":"2024-04-26T22:00:13.899318+0000","last_fullsized":"2024-04-26T22:00:13.899318+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:31:58.931234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899065+0000","last_change":"2024-04-26T22:00:12.901772+0000","last_active":"2024-04-26T22:00:13.899065+0000","last_peered":"2024-04-26T22:00:13.899065+0000","last_clean":"2024-04-26T22:00:13.899065+0000","last_became_active":"2024-04-26T22:00:12.901529+0000","last_became_peered":"2024-04-26T22:00:12.901529+0000","last_unstale":"2024-04-26T22:00:13.899065+0000","last_undegraded":"2024-04-26T22:00:13.899065+0000","last_fullsized":"2024-04-26T22:00:13.899065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:01.572358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196854+0000","last_change":"2024-04-26T22:00:11.883768+0000","last_active":"2024-04-26T22:00:14.196854+0000","last_peered":"2024-04-26T22:00:14.196854+0000","last_clean":"2024-04-26T22:00:14.196854+0000","last_became_active":"2024-04-26T22:00:11.883484+0000","last_became_peered":"2024-04-26T22:00:11.883484+0000","last_unstale":"2024-04-26T22:00:14.196854+0000","last_undegraded":"2024-04-26T22:00:14.196854+0000","last_fullsized":"2024-04-26T22:00:14.196854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:47:15.494635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197203+0000","last_change":"2024-04-26T22:00:12.902217+0000","last_active":"2024-04-26T22:00:14.197203+0000","last_peered":"2024-04-26T22:00:14.197203+0000","last_clean":"2024-04-26T22:00:14.197203+0000","last_became_active":"2024-04-26T22:00:12.901930+0000","last_became_peered":"2024-04-26T22:00:12.901930+0000","last_unstale":"2024-04-26T22:00:14.197203+0000","last_undegraded":"2024-04-26T22:00:14.197203+0000","last_fullsized":"2024-04-26T22:00:14.197203+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:50.859269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130280+0000","last_change":"2024-04-26T22:00:11.893028+0000","last_active":"2024-04-26T22:00:14.130280+0000","last_peered":"2024-04-26T22:00:14.130280+0000","last_clean":"2024-04-26T22:00:14.130280+0000","last_became_active":"2024-04-26T22:00:11.892704+0000","last_became_peered":"2024-04-26T22:00:11.892704+0000","last_unstale":"2024-04-26T22:00:14.130280+0000","last_undegraded":"2024-04-26T22:00:14.130280+0000","last_fullsized":"2024-04-26T22:00:14.130280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:25.525339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183420+0000","last_change":"2024-04-26T22:00:12.899413+0000","last_active":"2024-04-26T22:00:14.183420+0000","last_peered":"2024-04-26T22:00:14.183420+0000","last_clean":"2024-04-26T22:00:14.183420+0000","last_became_active":"2024-04-26T22:00:12.898953+0000","last_became_peered":"2024-04-26T22:00:12.898953+0000","last_unstale":"2024-04-26T22:00:14.183420+0000","last_undegraded":"2024-04-26T22:00:14.183420+0000","last_fullsized":"2024-04-26T22:00:14.183420+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:34.689185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.900006+0000","last_change":"2024-04-26T22:00:11.885985+0000","last_active":"2024-04-26T22:00:13.900006+0000","last_peered":"2024-04-26T22:00:13.900006+0000","last_clean":"2024-04-26T22:00:13.900006+0000","last_became_active":"2024-04-26T22:00:11.885602+0000","last_became_peered":"2024-04-26T22:00:11.885602+0000","last_unstale":"2024-04-26T22:00:13.900006+0000","last_undegraded":"2024-04-26T22:00:13.900006+0000","last_fullsized":"2024-04-26T22:00:13.900006+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:04.876803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.129746+0000","last_change":"2024-04-26T22:00:12.896515+0000","last_active":"2024-04-26T22:00:14.129746+0000","last_peered":"2024-04-26T22:00:14.129746+0000","last_clean":"2024-04-26T22:00:14.129746+0000","last_became_active":"2024-04-26T22:00:12.896261+0000","last_became_peered":"2024-04-26T22:00:12.896261+0000","last_unstale":"2024-04-26T22:00:14.129746+0000","last_undegraded":"2024-04-26T22:00:14.129746+0000","last_fullsized":"2024-04-26T22:00:14.129746+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:58.446735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.129897+0000","last_change":"2024-04-26T22:00:11.890223+0000","last_active":"2024-04-26T22:00:14.129897+0000","last_peered":"2024-04-26T22:00:14.129897+0000","last_clean":"2024-04-26T22:00:14.129897+0000","last_became_active":"2024-04-26T22:00:11.889918+0000","last_became_peered":"2024-04-26T22:00:11.889918+0000","last_unstale":"2024-04-26T22:00:14.129897+0000","last_undegraded":"2024-04-26T22:00:14.129897+0000","last_fullsized":"2024-04-26T22:00:14.129897+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:48:19.737112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898878+0000","last_change":"2024-04-26T22:00:12.897299+0000","last_active":"2024-04-26T22:00:13.898878+0000","last_peered":"2024-04-26T22:00:13.898878+0000","last_clean":"2024-04-26T22:00:13.898878+0000","last_became_active":"2024-04-26T22:00:12.895981+0000","last_became_peered":"2024-04-26T22:00:12.895981+0000","last_unstale":"2024-04-26T22:00:13.898878+0000","last_undegraded":"2024-04-26T22:00:13.898878+0000","last_fullsized":"2024-04-26T22:00:13.898878+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:35.507803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183328+0000","last_change":"2024-04-26T22:00:11.880931+0000","last_active":"2024-04-26T22:00:14.183328+0000","last_peered":"2024-04-26T22:00:14.183328+0000","last_clean":"2024-04-26T22:00:14.183328+0000","last_became_active":"2024-04-26T22:00:11.880653+0000","last_became_peered":"2024-04-26T22:00:11.880653+0000","last_unstale":"2024-04-26T22:00:14.183328+0000","last_undegraded":"2024-04-26T22:00:14.183328+0000","last_fullsized":"2024-04-26T22:00:14.183328+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:55.814565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196855+0000","last_change":"2024-04-26T22:00:12.906746+0000","last_active":"2024-04-26T22:00:14.196855+0000","last_peered":"2024-04-26T22:00:14.196855+0000","last_clean":"2024-04-26T22:00:14.196855+0000","last_became_active":"2024-04-26T22:00:12.906483+0000","last_became_peered":"2024-04-26T22:00:12.906483+0000","last_unstale":"2024-04-26T22:00:14.196855+0000","last_undegraded":"2024-04-26T22:00:14.196855+0000","last_fullsized":"2024-04-26T22:00:14.196855+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:34.275764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196759+0000","last_change":"2024-04-26T22:00:11.890718+0000","last_active":"2024-04-26T22:00:14.196759+0000","last_peered":"2024-04-26T22:00:14.196759+0000","last_clean":"2024-04-26T22:00:14.196759+0000","last_became_active":"2024-04-26T22:00:11.890389+0000","last_became_peered":"2024-04-26T22:00:11.890389+0000","last_unstale":"2024-04-26T22:00:14.196759+0000","last_undegraded":"2024-04-26T22:00:14.196759+0000","last_fullsized":"2024-04-26T22:00:14.196759+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:07.071573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183517+0000","last_change":"2024-04-26T22:00:12.901275+0000","last_active":"2024-04-26T22:00:14.183517+0000","last_peered":"2024-04-26T22:00:14.183517+0000","last_clean":"2024-04-26T22:00:14.183517+0000","last_became_active":"2024-04-26T22:00:12.901032+0000","last_became_peered":"2024-04-26T22:00:12.901032+0000","last_unstale":"2024-04-26T22:00:14.183517+0000","last_undegraded":"2024-04-26T22:00:14.183517+0000","last_fullsized":"2024-04-26T22:00:14.183517+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:09.298518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899753+0000","last_change":"2024-04-26T22:00:11.881392+0000","last_active":"2024-04-26T22:00:13.899753+0000","last_peered":"2024-04-26T22:00:13.899753+0000","last_clean":"2024-04-26T22:00:13.899753+0000","last_became_active":"2024-04-26T22:00:11.881088+0000","last_became_peered":"2024-04-26T22:00:11.881088+0000","last_unstale":"2024-04-26T22:00:13.899753+0000","last_undegraded":"2024-04-26T22:00:13.899753+0000","last_fullsized":"2024-04-26T22:00:13.899753+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:14:14.637520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197340+0000","last_change":"2024-04-26T22:00:12.902592+0000","last_active":"2024-04-26T22:00:14.197340+0000","last_peered":"2024-04-26T22:00:14.197340+0000","last_clean":"2024-04-26T22:00:14.197340+0000","last_became_active":"2024-04-26T22:00:12.901639+0000","last_became_peered":"2024-04-26T22:00:12.901639+0000","last_unstale":"2024-04-26T22:00:14.197340+0000","last_undegraded":"2024-04-26T22:00:14.197340+0000","last_fullsized":"2024-04-26T22:00:14.197340+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:32:00.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.900047+0000","last_change":"2024-04-26T22:00:11.881410+0000","last_active":"2024-04-26T22:00:13.900047+0000","last_peered":"2024-04-26T22:00:13.900047+0000","last_clean":"2024-04-26T22:00:13.900047+0000","last_became_active":"2024-04-26T22:00:11.881152+0000","last_became_peered":"2024-04-26T22:00:11.881152+0000","last_unstale":"2024-04-26T22:00:13.900047+0000","last_undegraded":"2024-04-26T22:00:13.900047+0000","last_fullsized":"2024-04-26T22:00:13.900047+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:03.645360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197401+0000","last_change":"2024-04-26T22:00:12.900536+0000","last_active":"2024-04-26T22:00:14.197401+0000","last_peered":"2024-04-26T22:00:14.197401+0000","last_clean":"2024-04-26T22:00:14.197401+0000","last_became_active":"2024-04-26T22:00:12.900267+0000","last_became_peered":"2024-04-26T22:00:12.900267+0000","last_unstale":"2024-04-26T22:00:14.197401+0000","last_undegraded":"2024-04-26T22:00:14.197401+0000","last_fullsized":"2024-04-26T22:00:14.197401+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:19:04.649510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130189+0000","last_change":"2024-04-26T22:00:11.887429+0000","last_active":"2024-04-26T22:00:14.130189+0000","last_peered":"2024-04-26T22:00:14.130189+0000","last_clean":"2024-04-26T22:00:14.130189+0000","last_became_active":"2024-04-26T22:00:11.887126+0000","last_became_peered":"2024-04-26T22:00:11.887126+0000","last_unstale":"2024-04-26T22:00:14.130189+0000","last_undegraded":"2024-04-26T22:00:14.130189+0000","last_fullsized":"2024-04-26T22:00:14.130189+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:34.503652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.129914+0000","last_change":"2024-04-26T22:00:12.899149+0000","last_active":"2024-04-26T22:00:14.129914+0000","last_peered":"2024-04-26T22:00:14.129914+0000","last_clean":"2024-04-26T22:00:14.129914+0000","last_became_active":"2024-04-26T22:00:12.898883+0000","last_became_peered":"2024-04-26T22:00:12.898883+0000","last_unstale":"2024-04-26T22:00:14.129914+0000","last_undegraded":"2024-04-26T22:00:14.129914+0000","last_fullsized":"2024-04-26T22:00:14.129914+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:50.983095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130314+0000","last_change":"2024-04-26T22:00:11.884714+0000","last_active":"2024-04-26T22:00:14.130314+0000","last_peered":"2024-04-26T22:00:14.130314+0000","last_clean":"2024-04-26T22:00:14.130314+0000","last_became_active":"2024-04-26T22:00:11.884458+0000","last_became_peered":"2024-04-26T22:00:11.884458+0000","last_unstale":"2024-04-26T22:00:14.130314+0000","last_undegraded":"2024-04-26T22:00:14.130314+0000","last_fullsized":"2024-04-26T22:00:14.130314+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:42.616659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197211+0000","last_change":"2024-04-26T22:00:12.894117+0000","last_active":"2024-04-26T22:00:14.197211+0000","last_peered":"2024-04-26T22:00:14.197211+0000","last_clean":"2024-04-26T22:00:14.197211+0000","last_became_active":"2024-04-26T22:00:12.893819+0000","last_became_peered":"2024-04-26T22:00:12.893819+0000","last_unstale":"2024-04-26T22:00:14.197211+0000","last_undegraded":"2024-04-26T22:00:14.197211+0000","last_fullsized":"2024-04-26T22:00:14.197211+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:50.859269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898850+0000","last_change":"2024-04-26T22:00:11.887720+0000","last_active":"2024-04-26T22:00:13.898850+0000","last_peered":"2024-04-26T22:00:13.898850+0000","last_clean":"2024-04-26T22:00:13.898850+0000","last_became_active":"2024-04-26T22:00:11.887407+0000","last_became_peered":"2024-04-26T22:00:11.887407+0000","last_unstale":"2024-04-26T22:00:13.898850+0000","last_undegraded":"2024-04-26T22:00:13.898850+0000","last_fullsized":"2024-04-26T22:00:13.898850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:46:49.855119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196533+0000","last_change":"2024-04-26T22:00:12.894079+0000","last_active":"2024-04-26T22:00:14.196533+0000","last_peered":"2024-04-26T22:00:14.196533+0000","last_clean":"2024-04-26T22:00:14.196533+0000","last_became_active":"2024-04-26T22:00:12.893765+0000","last_became_peered":"2024-04-26T22:00:12.893765+0000","last_unstale":"2024-04-26T22:00:14.196533+0000","last_undegraded":"2024-04-26T22:00:14.196533+0000","last_fullsized":"2024-04-26T22:00:14.196533+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:40:23.172726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183069+0000","last_change":"2024-04-26T22:00:11.875970+0000","last_active":"2024-04-26T22:00:14.183069+0000","last_peered":"2024-04-26T22:00:14.183069+0000","last_clean":"2024-04-26T22:00:14.183069+0000","last_became_active":"2024-04-26T22:00:11.875677+0000","last_became_peered":"2024-04-26T22:00:11.875677+0000","last_unstale":"2024-04-26T22:00:14.183069+0000","last_undegraded":"2024-04-26T22:00:14.183069+0000","last_fullsized":"2024-04-26T22:00:14.183069+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:33.271613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183161+0000","last_change":"2024-04-26T22:00:12.911286+0000","last_active":"2024-04-26T22:00:14.183161+0000","last_peered":"2024-04-26T22:00:14.183161+0000","last_clean":"2024-04-26T22:00:14.183161+0000","last_became_active":"2024-04-26T22:00:12.911040+0000","last_became_peered":"2024-04-26T22:00:12.911040+0000","last_unstale":"2024-04-26T22:00:14.183161+0000","last_undegraded":"2024-04-26T22:00:14.183161+0000","last_fullsized":"2024-04-26T22:00:14.183161+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:12.657628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898565+0000","last_change":"2024-04-26T22:00:11.881790+0000","last_active":"2024-04-26T22:00:13.898565+0000","last_peered":"2024-04-26T22:00:13.898565+0000","last_clean":"2024-04-26T22:00:13.898565+0000","last_became_active":"2024-04-26T22:00:11.881500+0000","last_became_peered":"2024-04-26T22:00:11.881500+0000","last_unstale":"2024-04-26T22:00:13.898565+0000","last_undegraded":"2024-04-26T22:00:13.898565+0000","last_fullsized":"2024-04-26T22:00:13.898565+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:59.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197624+0000","last_change":"2024-04-26T22:00:12.910930+0000","last_active":"2024-04-26T22:00:14.197624+0000","last_peered":"2024-04-26T22:00:14.197624+0000","last_clean":"2024-04-26T22:00:14.197624+0000","last_became_active":"2024-04-26T22:00:12.910656+0000","last_became_peered":"2024-04-26T22:00:12.910656+0000","last_unstale":"2024-04-26T22:00:14.197624+0000","last_undegraded":"2024-04-26T22:00:14.197624+0000","last_fullsized":"2024-04-26T22:00:14.197624+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:05.880953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130025+0000","last_change":"2024-04-26T22:00:11.880307+0000","last_active":"2024-04-26T22:00:14.130025+0000","last_peered":"2024-04-26T22:00:14.130025+0000","last_clean":"2024-04-26T22:00:14.130025+0000","last_became_active":"2024-04-26T22:00:11.879974+0000","last_became_peered":"2024-04-26T22:00:11.879974+0000","last_unstale":"2024-04-26T22:00:14.130025+0000","last_undegraded":"2024-04-26T22:00:14.130025+0000","last_fullsized":"2024-04-26T22:00:14.130025+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:08.139715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183403+0000","last_change":"2024-04-26T22:00:12.900699+0000","last_active":"2024-04-26T22:00:14.183403+0000","last_peered":"2024-04-26T22:00:14.183403+0000","last_clean":"2024-04-26T22:00:14.183403+0000","last_became_active":"2024-04-26T22:00:12.900404+0000","last_became_peered":"2024-04-26T22:00:12.900404+0000","last_unstale":"2024-04-26T22:00:14.183403+0000","last_undegraded":"2024-04-26T22:00:14.183403+0000","last_fullsized":"2024-04-26T22:00:14.183403+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:54:46.887610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899402+0000","last_change":"2024-04-26T22:00:11.884583+0000","last_active":"2024-04-26T22:00:13.899402+0000","last_peered":"2024-04-26T22:00:13.899402+0000","last_clean":"2024-04-26T22:00:13.899402+0000","last_became_active":"2024-04-26T22:00:11.884020+0000","last_became_peered":"2024-04-26T22:00:11.884020+0000","last_unstale":"2024-04-26T22:00:13.899402+0000","last_undegraded":"2024-04-26T22:00:13.899402+0000","last_fullsized":"2024-04-26T22:00:13.899402+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:48.325283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899218+0000","last_change":"2024-04-26T22:00:12.890518+0000","last_active":"2024-04-26T22:00:13.899218+0000","last_peered":"2024-04-26T22:00:13.899218+0000","last_clean":"2024-04-26T22:00:13.899218+0000","last_became_active":"2024-04-26T22:00:12.890259+0000","last_became_peered":"2024-04-26T22:00:12.890259+0000","last_unstale":"2024-04-26T22:00:13.899218+0000","last_undegraded":"2024-04-26T22:00:13.899218+0000","last_fullsized":"2024-04-26T22:00:13.899218+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:41:20.451736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.197201+0000","last_change":"2024-04-26T22:00:11.882987+0000","last_active":"2024-04-26T22:00:14.197201+0000","last_peered":"2024-04-26T22:00:14.197201+0000","last_clean":"2024-04-26T22:00:14.197201+0000","last_became_active":"2024-04-26T22:00:11.882612+0000","last_became_peered":"2024-04-26T22:00:11.882612+0000","last_unstale":"2024-04-26T22:00:14.197201+0000","last_undegraded":"2024-04-26T22:00:14.197201+0000","last_fullsized":"2024-04-26T22:00:14.197201+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:08:05.465038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130001+0000","last_change":"2024-04-26T22:00:12.901538+0000","last_active":"2024-04-26T22:00:14.130001+0000","last_peered":"2024-04-26T22:00:14.130001+0000","last_clean":"2024-04-26T22:00:14.130001+0000","last_became_active":"2024-04-26T22:00:12.901269+0000","last_became_peered":"2024-04-26T22:00:12.901269+0000","last_unstale":"2024-04-26T22:00:14.130001+0000","last_undegraded":"2024-04-26T22:00:14.130001+0000","last_fullsized":"2024-04-26T22:00:14.130001+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:10.622853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899857+0000","last_change":"2024-04-26T22:00:11.882822+0000","last_active":"2024-04-26T22:00:13.899857+0000","last_peered":"2024-04-26T22:00:13.899857+0000","last_clean":"2024-04-26T22:00:13.899857+0000","last_became_active":"2024-04-26T22:00:11.882569+0000","last_became_peered":"2024-04-26T22:00:11.882569+0000","last_unstale":"2024-04-26T22:00:13.899857+0000","last_undegraded":"2024-04-26T22:00:13.899857+0000","last_fullsized":"2024-04-26T22:00:13.899857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:01.295815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.130165+0000","last_change":"2024-04-26T22:00:12.910397+0000","last_active":"2024-04-26T22:00:14.130165+0000","last_peered":"2024-04-26T22:00:14.130165+0000","last_clean":"2024-04-26T22:00:14.130165+0000","last_became_active":"2024-04-26T22:00:12.909194+0000","last_became_peered":"2024-04-26T22:00:12.909194+0000","last_unstale":"2024-04-26T22:00:14.130165+0000","last_undegraded":"2024-04-26T22:00:14.130165+0000","last_fullsized":"2024-04-26T22:00:14.130165+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:15:47.638611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899411+0000","last_change":"2024-04-26T22:00:11.884725+0000","last_active":"2024-04-26T22:00:13.899411+0000","last_peered":"2024-04-26T22:00:13.899411+0000","last_clean":"2024-04-26T22:00:13.899411+0000","last_became_active":"2024-04-26T22:00:11.884448+0000","last_became_peered":"2024-04-26T22:00:11.884448+0000","last_unstale":"2024-04-26T22:00:13.899411+0000","last_undegraded":"2024-04-26T22:00:13.899411+0000","last_fullsized":"2024-04-26T22:00:13.899411+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:08:05.465038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899638+0000","last_change":"2024-04-26T22:00:12.899429+0000","last_active":"2024-04-26T22:00:13.899638+0000","last_peered":"2024-04-26T22:00:13.899638+0000","last_clean":"2024-04-26T22:00:13.899638+0000","last_became_active":"2024-04-26T22:00:12.899149+0000","last_became_peered":"2024-04-26T22:00:12.899149+0000","last_unstale":"2024-04-26T22:00:13.899638+0000","last_undegraded":"2024-04-26T22:00:13.899638+0000","last_fullsized":"2024-04-26T22:00:13.899638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:26.529489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.196985+0000","last_change":"2024-04-26T22:00:11.887954+0000","last_active":"2024-04-26T22:00:14.196985+0000","last_peered":"2024-04-26T22:00:14.196985+0000","last_clean":"2024-04-26T22:00:14.196985+0000","last_became_active":"2024-04-26T22:00:11.887653+0000","last_became_peered":"2024-04-26T22:00:11.887653+0000","last_unstale":"2024-04-26T22:00:14.196985+0000","last_undegraded":"2024-04-26T22:00:14.196985+0000","last_fullsized":"2024-04-26T22:00:14.196985+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:10.045908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.898865+0000","last_change":"2024-04-26T22:00:12.903577+0000","last_active":"2024-04-26T22:00:13.898865+0000","last_peered":"2024-04-26T22:00:13.898865+0000","last_clean":"2024-04-26T22:00:13.898865+0000","last_became_active":"2024-04-26T22:00:12.903300+0000","last_became_peered":"2024-04-26T22:00:12.903300+0000","last_unstale":"2024-04-26T22:00:13.898865+0000","last_undegraded":"2024-04-26T22:00:13.898865+0000","last_fullsized":"2024-04-26T22:00:13.898865+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:48:53.963363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183420+0000","last_change":"2024-04-26T22:00:11.882774+0000","last_active":"2024-04-26T22:00:14.183420+0000","last_peered":"2024-04-26T22:00:14.183420+0000","last_clean":"2024-04-26T22:00:14.183420+0000","last_became_active":"2024-04-26T22:00:11.882439+0000","last_became_peered":"2024-04-26T22:00:11.882439+0000","last_unstale":"2024-04-26T22:00:14.183420+0000","last_undegraded":"2024-04-26T22:00:14.183420+0000","last_fullsized":"2024-04-26T22:00:14.183420+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:08:05.465038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:14.183617+0000","last_change":"2024-04-26T22:00:12.903464+0000","last_active":"2024-04-26T22:00:14.183617+0000","last_peered":"2024-04-26T22:00:14.183617+0000","last_clean":"2024-04-26T22:00:14.183617+0000","last_became_active":"2024-04-26T22:00:12.903209+0000","last_became_peered":"2024-04-26T22:00:12.903209+0000","last_unstale":"2024-04-26T22:00:14.183617+0000","last_undegraded":"2024-04-26T22:00:14.183617+0000","last_fullsized":"2024-04-26T22:00:14.183617+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:11.864856+0000","last_clean_scrub_stamp":"2024-04-26T22:00:11.864856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:12:19.643025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.900167+0000","last_change":"2024-04-26T22:00:11.884787+0000","last_active":"2024-04-26T22:00:13.900167+0000","last_peered":"2024-04-26T22:00:13.900167+0000","last_clean":"2024-04-26T22:00:13.900167+0000","last_became_active":"2024-04-26T22:00:11.884493+0000","last_became_peered":"2024-04-26T22:00:11.884493+0000","last_unstale":"2024-04-26T22:00:13.900167+0000","last_undegraded":"2024-04-26T22:00:13.900167+0000","last_fullsized":"2024-04-26T22:00:13.900167+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:00:10.860706+0000","last_clean_scrub_stamp":"2024-04-26T22:00:10.860706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:01.295815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-26T22:00:13.899558+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:00:13.899558+0000","last_peered":"2024-04-26T22:00:13.899558+0000","last_clean":"2024-04-26T22:00:13.899558+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:00:13.899558+0000","last_undegraded":"2024-04-26T22:00:13.899558+0000","last_fullsized":"2024-04-26T22:00:13.899558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":810244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":548864,"data_stored":220458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":544768,"data_stored":219856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31728,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":552960,"data_stored":221398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":220424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":221420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":219856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1138688,"data_stored":810188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:00:20.560 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T22:00:20.561 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T22:00:20.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.701+0000 7fc7ac9da640 1 Processor -- start 2024-04-26T22:00:20.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.701+0000 7fc7ac9da640 1 -- start start 2024-04-26T22:00:20.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.702+0000 7fc7ac9da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80b1ea0 0x7fc7a80d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.702+0000 7fc7ac9da640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc7a80d56a0 0x7fc7a80b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.702+0000 7fc7ac9da640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a80b2300 con 0x7fc7a815f6e0 2024-04-26T22:00:20.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.702+0000 7fc7ac9da640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a80d5b10 con 0x7fc7a80d56a0 2024-04-26T22:00:20.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.702+0000 7fc7ac9da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80b2580 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.702+0000 7fc7a6d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc7a80d56a0 0x7fc7a80b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.702+0000 7fc7a659c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc7a815f6e0 0x7fc7a80d3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:35360/0 (socket says 172.21.15.137:35360) 2024-04-26T22:00:20.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.702+0000 7fc7a659c640 1 -- 172.21.15.137:0/360162785 learned_addr learned my addr 172.21.15.137:0/360162785 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:20.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.703+0000 7fc7a5d9b640 1 --2- 172.21.15.137:0/360162785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80b1ea0 0x7fc7a80d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.703+0000 7fc7a6d9d640 1 -- 172.21.15.137:0/360162785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80b1ea0 msgr2=0x7fc7a80d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:20.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.703+0000 7fc7a6d9d640 1 --2- 172.21.15.137:0/360162785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80b1ea0 0x7fc7a80d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.703+0000 7fc7a6d9d640 1 -- 172.21.15.137:0/360162785 >> v1:172.21.15.137:6789/0 conn(0x7fc7a815f6e0 legacy=0x7fc7a80d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.703+0000 7fc7a559a640 1 -- 172.21.15.137:0/360162785 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412159311 0 0) 0x7fc798001490 con 0x7fc7a815f6e0 2024-04-26T22:00:20.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.703+0000 7fc7a6d9d640 1 -- 172.21.15.137:0/360162785 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a80b2860 con 0x7fc7a80d56a0 2024-04-26T22:00:20.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7a6d9d640 1 --2- 172.21.15.137:0/360162785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80d56a0 0x7fc7a80b3620 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00097a0 tx=0x7fc7a002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc6988fe77e216 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7a559a640 1 -- 172.21.15.137:0/360162785 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0037070 con 0x7fc7a80d56a0 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7a559a640 1 -- 172.21.15.137:0/360162785 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a0032440 con 0x7fc7a80d56a0 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7a559a640 1 -- 172.21.15.137:0/360162785 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0032810 con 0x7fc7a80d56a0 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7ac9da640 1 -- 172.21.15.137:0/360162785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80d56a0 msgr2=0x7fc7a80b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7ac9da640 1 --2- 172.21.15.137:0/360162785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80d56a0 0x7fc7a80b3620 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00097a0 tx=0x7fc7a002a180 comp rx=0 tx=0).stop 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7ac9da640 1 -- 172.21.15.137:0/360162785 shutdown_connections 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7ac9da640 1 --2- 172.21.15.137:0/360162785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80d56a0 0x7fc7a80b3620 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7ac9da640 1 --2- 172.21.15.137:0/360162785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80b1ea0 0x7fc7a80d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7ac9da640 1 -- 172.21.15.137:0/360162785 >> 172.21.15.137:0/360162785 conn(0x7fc7a808ec20 msgr2=0x7fc7a809e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7ac9da640 1 -- 172.21.15.137:0/360162785 shutdown_connections 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.704+0000 7fc7ac9da640 1 -- 172.21.15.137:0/360162785 wait complete. 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7ac9da640 1 Processor -- start 2024-04-26T22:00:20.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7ac9da640 1 -- start start 2024-04-26T22:00:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7ac9da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80b1ea0 0x7fc7a80c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7ac9da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80d56a0 0x7fc7a80b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7ac9da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a815f6e0 0x7fc7a81f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7ac9da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80b3b60 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7ac9da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a80b2e20 con 0x7fc7a815f6e0 2024-04-26T22:00:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7ac9da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a80b3ce0 con 0x7fc7a80d56a0 2024-04-26T22:00:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7a659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80b1ea0 0x7fc7a80c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7a659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80b1ea0 0x7fc7a80c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38168/0 (socket says 172.21.15.137:38168) 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.706+0000 7fc7a659c640 1 -- 172.21.15.137:0/911733236 learned_addr learned my addr 172.21.15.137:0/911733236 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7a6d9d640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a815f6e0 0x7fc7a81f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7a5d9b640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80d56a0 0x7fc7a80b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7a659c640 1 -- 172.21.15.137:0/911733236 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80d56a0 msgr2=0x7fc7a80b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7a659c640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80d56a0 0x7fc7a80b9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7a659c640 1 -- 172.21.15.137:0/911733236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a815f6e0 msgr2=0x7fc7a81f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7a659c640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a815f6e0 0x7fc7a81f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7a659c640 1 -- 172.21.15.137:0/911733236 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a80ba7d0 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7a6d9d640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a815f6e0 0x7fc7a81f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7a659c640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80b1ea0 0x7fc7a80c8db0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc79800c7f0 tx=0x7fc79800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc796ffd640 1 -- 172.21.15.137:0/911733236 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798018070 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc796ffd640 1 -- 172.21.15.137:0/911733236 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79800a640 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a80baab0 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc796ffd640 1 -- 172.21.15.137:0/911733236 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79800aa30 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.707+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a80b97a0 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.708+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a80b8870 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.708+0000 7fc796ffd640 1 -- 172.21.15.137:0/911733236 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc79801b070 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.709+0000 7fc796ffd640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc78806c920 0x7fc78806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.709+0000 7fc796ffd640 1 -- 172.21.15.137:0/911733236 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fc79808b0a0 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.709+0000 7fc7a5d9b640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc78806c920 0x7fc78806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:20.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.709+0000 7fc7a5d9b640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc78806c920 0x7fc78806ede0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8155470 tx=0x7fc79c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:20.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.716+0000 7fc796ffd640 1 -- 172.21.15.137:0/911733236 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc7a80b2300 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.967+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc7a806a290 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.969+0000 7fc796ffd640 1 -- 172.21.15.137:0/911733236 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fc798059560 con 0x7fc7a80b1ea0 2024-04-26T22:00:20.969 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T22:00:20.969 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ== 2024-04-26T22:00:20.970 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T22:00:20.970 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T22:00:20.970 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T22:00:20.970 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T22:00:20.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc78806c920 msgr2=0x7fc78806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc78806c920 0x7fc78806ede0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8155470 tx=0x7fc79c008040 comp rx=0 tx=0).stop 2024-04-26T22:00:20.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80b1ea0 msgr2=0x7fc7a80c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:20.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80b1ea0 0x7fc7a80c8db0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc79800c7f0 tx=0x7fc79800ccb0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 shutdown_connections 2024-04-26T22:00:20.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc78806c920 0x7fc78806ede0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7a815f6e0 0x7fc7a81f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc7a80d56a0 0x7fc7a80b9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 --2- 172.21.15.137:0/911733236 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc7a80b1ea0 0x7fc7a80c8db0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:20.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 >> 172.21.15.137:0/911733236 conn(0x7fc7a808ec20 msgr2=0x7fc7a80b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:20.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 shutdown_connections 2024-04-26T22:00:20.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:20.971+0000 7fc7ac9da640 1 -- 172.21.15.137:0/911733236 wait complete. 2024-04-26T22:00:20.982 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:21.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.078+0000 7fb1ca2bb640 1 Processor -- start 2024-04-26T22:00:21.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.078+0000 7fb1ca2bb640 1 -- start start 2024-04-26T22:00:21.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.079+0000 7fb1ca2bb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb1c415f370 0x7fb1c40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.079+0000 7fb1ca2bb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb1c415f750 0x7fb1c40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.079+0000 7fb1ca2bb640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c40d03a0 con 0x7fb1c40d37d0 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.079+0000 7fb1ca2bb640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c40b4d10 con 0x7fb1c415f370 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.079+0000 7fb1ca2bb640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c40d0680 con 0x7fb1c415f750 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.079+0000 7fb1c3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb1c415f370 0x7fb1c40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.079+0000 7fb1c3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb1c415f370 0x7fb1c40cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38176/0 (socket says 172.21.15.137:38176) 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.079+0000 7fb1c3fff640 1 -- 172.21.15.137:0/475100724 learned_addr learned my addr 172.21.15.137:0/475100724 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.080+0000 7fb1c37fe640 1 --2- 172.21.15.137:0/475100724 >> v2:172.21.15.170:3300/0 conn(0x7fb1c415f750 0x7fb1c40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.080+0000 7fb1c3fff640 1 -- 172.21.15.137:0/475100724 >> v2:172.21.15.170:3300/0 conn(0x7fb1c415f750 msgr2=0x7fb1c40b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.080+0000 7fb1c3fff640 1 --2- 172.21.15.137:0/475100724 >> v2:172.21.15.170:3300/0 conn(0x7fb1c415f750 0x7fb1c40b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.080+0000 7fb1c3fff640 1 -- 172.21.15.137:0/475100724 >> v1:172.21.15.170:6789/0 conn(0x7fb1c40d37d0 legacy=0x7fb1c40d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.080+0000 7fb1c3fff640 1 -- 172.21.15.137:0/475100724 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c40d0960 con 0x7fb1c415f370 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.080+0000 7fb1c37fe640 1 --2- 172.21.15.137:0/475100724 >> v2:172.21.15.170:3300/0 conn(0x7fb1c415f750 0x7fb1c40b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.080+0000 7fb1c3fff640 1 --2- 172.21.15.137:0/475100724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c415f370 0x7fb1c40cfd70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40d02b0 tx=0x7fb1b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939fdadb7935f8eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1c2ffd640 1 -- 172.21.15.137:0/475100724 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4037070 con 0x7fb1c415f370 2024-04-26T22:00:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1c2ffd640 1 -- 172.21.15.137:0/475100724 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b4032440 con 0x7fb1c415f370 2024-04-26T22:00:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1c2ffd640 1 -- 172.21.15.137:0/475100724 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4032810 con 0x7fb1c415f370 2024-04-26T22:00:21.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/475100724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c415f370 msgr2=0x7fb1c40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1ca2bb640 1 --2- 172.21.15.137:0/475100724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c415f370 0x7fb1c40cfd70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40d02b0 tx=0x7fb1b402a270 comp rx=0 tx=0).stop 2024-04-26T22:00:21.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/475100724 shutdown_connections 2024-04-26T22:00:21.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1ca2bb640 1 --2- 172.21.15.137:0/475100724 >> v2:172.21.15.170:3300/0 conn(0x7fb1c415f750 0x7fb1c40b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1ca2bb640 1 --2- 172.21.15.137:0/475100724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c415f370 0x7fb1c40cfd70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/475100724 >> 172.21.15.137:0/475100724 conn(0x7fb1c408ec10 msgr2=0x7fb1c409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:21.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/475100724 shutdown_connections 2024-04-26T22:00:21.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.081+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/475100724 wait complete. 2024-04-26T22:00:21.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.083+0000 7fb1ca2bb640 1 Processor -- start 2024-04-26T22:00:21.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.083+0000 7fb1ca2bb640 1 -- start start 2024-04-26T22:00:21.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.083+0000 7fb1ca2bb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c40d37d0 0x7fb1c40b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.083+0000 7fb1ca2bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c415f750 0x7fb1c40b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.083+0000 7fb1ca2bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c415d2a0 0x7fb1c40cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.083+0000 7fb1ca2bb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40b61d0 con 0x7fb1c40d37d0 2024-04-26T22:00:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.083+0000 7fb1ca2bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40d0f20 con 0x7fb1c415f750 2024-04-26T22:00:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.083+0000 7fb1ca2bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c40b6350 con 0x7fb1c415d2a0 2024-04-26T22:00:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c40d37d0 0x7fb1c40b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c40d37d0 0x7fb1c40b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38180/0 (socket says 172.21.15.137:38180) 2024-04-26T22:00:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c3fff640 1 -- 172.21.15.137:0/1836285241 learned_addr learned my addr 172.21.15.137:0/1836285241 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c37fe640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c415f750 0x7fb1c40b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c8858640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c415d2a0 0x7fb1c40cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c3fff640 1 -- 172.21.15.137:0/1836285241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c415d2a0 msgr2=0x7fb1c40cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c3fff640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c415d2a0 0x7fb1c40cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c3fff640 1 -- 172.21.15.137:0/1836285241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c415f750 msgr2=0x7fb1c40b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c3fff640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c415f750 0x7fb1c40b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c3fff640 1 -- 172.21.15.137:0/1836285241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c40c8e50 con 0x7fb1c40d37d0 2024-04-26T22:00:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c3fff640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c40d37d0 0x7fb1c40b50a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000c00 tx=0x7fb1b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c0ff9640 1 -- 172.21.15.137:0/1836285241 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4041020 con 0x7fb1c40d37d0 2024-04-26T22:00:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c0ff9640 1 -- 172.21.15.137:0/1836285241 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b4030760 con 0x7fb1c40d37d0 2024-04-26T22:00:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c40c9130 con 0x7fb1c40d37d0 2024-04-26T22:00:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1c0ff9640 1 -- 172.21.15.137:0/1836285241 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4037040 con 0x7fb1c40d37d0 2024-04-26T22:00:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.084+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c40c96f0 con 0x7fb1c40d37d0 2024-04-26T22:00:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.085+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c406a290 con 0x7fb1c40d37d0 2024-04-26T22:00:21.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.086+0000 7fb1c0ff9640 1 -- 172.21.15.137:0/1836285241 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1b4044020 con 0x7fb1c40d37d0 2024-04-26T22:00:21.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.086+0000 7fb1c0ff9640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1b006c920 0x7fb1b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.086+0000 7fb1c0ff9640 1 -- 172.21.15.137:0/1836285241 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fb1b40ac1e0 con 0x7fb1c40d37d0 2024-04-26T22:00:21.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.086+0000 7fb1c37fe640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1b006c920 0x7fb1b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.087+0000 7fb1c37fe640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1b006c920 0x7fb1b006ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40ba7a0 tx=0x7fb1b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.091+0000 7fb1c0ff9640 1 -- 172.21.15.137:0/1836285241 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb1b404b030 con 0x7fb1c40d37d0 2024-04-26T22:00:21.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.302+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1c4162bf0 con 0x7fb1c40d37d0 2024-04-26T22:00:21.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.302+0000 7fb1c0ff9640 1 -- 172.21.15.137:0/1836285241 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7fb1b407a6a0 con 0x7fb1c40d37d0 2024-04-26T22:00:21.302 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:21.302 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1453946915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1453946915},{"type":"v1","addr":"172.21.15.170:6835","nonce":1453946915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3097952323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3097952323},{"type":"v1","addr":"172.21.15.170:6834","nonce":3097952323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3002187785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3002187785},{"type":"v1","addr":"172.21.15.137:6835","nonce":3002187785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:00:12.224783+0000","modified":"2024-04-26T22:00:14.233247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5592":{"gid":5592,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/924509332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":924509332},{"type":"v1","addr":"172.21.15.137:6837","nonce":924509332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5592,"qdb_cluster":[5592]},"id":3}]} 2024-04-26T22:00:21.303 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 20 2024-04-26T22:00:21.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1b006c920 msgr2=0x7fb1b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1b006c920 0x7fb1b006ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40ba7a0 tx=0x7fb1b8008040 comp rx=0 tx=0).stop 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c40d37d0 msgr2=0x7fb1c40b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c40d37d0 0x7fb1c40b50a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000c00 tx=0x7fb1b40046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 shutdown_connections 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb1b006c920 0x7fb1b006ede0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1c415d2a0 0x7fb1c40cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb1c415f750 0x7fb1c40b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 --2- 172.21.15.137:0/1836285241 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb1c40d37d0 0x7fb1c40b50a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 >> 172.21.15.137:0/1836285241 conn(0x7fb1c408ec10 msgr2=0x7fb1c415e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 shutdown_connections 2024-04-26T22:00:21.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.304+0000 7fb1ca2bb640 1 -- 172.21.15.137:0/1836285241 wait complete. 2024-04-26T22:00:21.718 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:00:12.224783+0000', 'modified': '2024-04-26T22:00:14.233247+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5592}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5592': {'gid': 5592, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6837/924509332', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 924509332}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 924509332}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5592, 'qdb_cluster': [5592]} 2024-04-26T22:00:21.718 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:00:21.719 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T22:00:21.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.817+0000 7f9786264640 1 Processor -- start 2024-04-26T22:00:21.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.817+0000 7f9786264640 1 -- start start 2024-04-26T22:00:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f9786264640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f97800b61a0 0x7f9780160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f9786264640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97800b3de0 0x7f97800720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f9786264640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97800b4270 con 0x7f9780145980 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f9786264640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f97800b5140 con 0x7f97800b61a0 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f9786264640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f97800b4530 con 0x7f97800b3de0 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f977f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f97800b61a0 0x7f9780160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f977f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f97800b61a0 0x7f9780160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38196/0 (socket says 172.21.15.137:38196) 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f977f7fe640 1 -- 172.21.15.137:0/2962073872 learned_addr learned my addr 172.21.15.137:0/2962073872 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f9784801640 1 --2- 172.21.15.137:0/2962073872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97800b3de0 0x7f97800720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f977f7fe640 1 -- 172.21.15.137:0/2962073872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97800b3de0 msgr2=0x7f97800720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f977f7fe640 1 --2- 172.21.15.137:0/2962073872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97800b3de0 0x7f97800720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f977f7fe640 1 -- 172.21.15.137:0/2962073872 >> v1:172.21.15.170:6789/0 conn(0x7f9780145980 legacy=0x7f97800b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.818+0000 7f977f7fe640 1 -- 172.21.15.137:0/2962073872 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97800b4810 con 0x7f97800b61a0 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.819+0000 7f977f7fe640 1 --2- 172.21.15.137:0/2962073872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b61a0 0x7f9780160630 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9774009870 tx=0x7f977402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49987a25cc95d16d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.819+0000 7f977effd640 1 -- 172.21.15.137:0/2962073872 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9774037070 con 0x7f97800b61a0 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.819+0000 7f977effd640 1 -- 172.21.15.137:0/2962073872 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9774032440 con 0x7f97800b61a0 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.819+0000 7f977effd640 1 -- 172.21.15.137:0/2962073872 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9774032810 con 0x7f97800b61a0 2024-04-26T22:00:21.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.820+0000 7f9786264640 1 -- 172.21.15.137:0/2962073872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b61a0 msgr2=0x7f9780160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.820+0000 7f9786264640 1 --2- 172.21.15.137:0/2962073872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b61a0 0x7f9780160630 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9774009870 tx=0x7f977402a1c0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.820+0000 7f9786264640 1 -- 172.21.15.137:0/2962073872 shutdown_connections 2024-04-26T22:00:21.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.820+0000 7f9786264640 1 --2- 172.21.15.137:0/2962073872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97800b3de0 0x7f97800720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.820+0000 7f9786264640 1 --2- 172.21.15.137:0/2962073872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b61a0 0x7f9780160630 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.820+0000 7f9786264640 1 -- 172.21.15.137:0/2962073872 >> 172.21.15.137:0/2962073872 conn(0x7f97800d0d30 msgr2=0x7f97800d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:21.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.820+0000 7f9786264640 1 -- 172.21.15.137:0/2962073872 shutdown_connections 2024-04-26T22:00:21.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.820+0000 7f9786264640 1 -- 172.21.15.137:0/2962073872 wait complete. 2024-04-26T22:00:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.821+0000 7f9786264640 1 Processor -- start 2024-04-26T22:00:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.821+0000 7f9786264640 1 -- start start 2024-04-26T22:00:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f9786264640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b3de0 0x7f97800b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f9786264640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97800b61a0 0x7f978006ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f9786264640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9780145980 0x7f978006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f9786264640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9780072610 con 0x7f97800b3de0 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f9786264640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f97800b4dd0 con 0x7f97800b61a0 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f9786264640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9780072790 con 0x7f9780145980 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f977ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b3de0 0x7f97800b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f977ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b3de0 0x7f97800b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38204/0 (socket says 172.21.15.137:38204) 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f977ffff640 1 -- 172.21.15.137:0/180323733 learned_addr learned my addr 172.21.15.137:0/180323733 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f977ffff640 1 -- 172.21.15.137:0/180323733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9780145980 msgr2=0x7f978006f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f977ffff640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9780145980 0x7f978006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f977ffff640 1 -- 172.21.15.137:0/180323733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97800b61a0 msgr2=0x7f978006ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f977ffff640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97800b61a0 0x7f978006ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f977ffff640 1 -- 172.21.15.137:0/180323733 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97801f3240 con 0x7f97800b3de0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.822+0000 7f977ffff640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b3de0 0x7f97800b30d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f977000c340 tx=0x7f977000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.823+0000 7f977cff9640 1 -- 172.21.15.137:0/180323733 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770017070 con 0x7f97800b3de0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.823+0000 7f977cff9640 1 -- 172.21.15.137:0/180323733 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97700052f0 con 0x7f97800b3de0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.823+0000 7f977cff9640 1 -- 172.21.15.137:0/180323733 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770003850 con 0x7f97800b3de0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.823+0000 7f9786264640 1 -- 172.21.15.137:0/180323733 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97801f3520 con 0x7f97800b3de0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.823+0000 7f9786264640 1 -- 172.21.15.137:0/180323733 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97801f3ae0 con 0x7f97800b3de0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.824+0000 7f977cff9640 1 -- 172.21.15.137:0/180323733 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f977001a070 con 0x7f97800b3de0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.825+0000 7f977cff9640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f976c06c8f0 0x7f976c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.825+0000 7f977cff9640 1 -- 172.21.15.137:0/180323733 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f977008ae70 con 0x7f97800b3de0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.825+0000 7f977f7fe640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f976c06c8f0 0x7f976c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.825+0000 7f977f7fe640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f976c06c8f0 0x7f976c06edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9774034000 tx=0x7f977402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.825+0000 7f9788f7d740 1 Processor -- start 2024-04-26T22:00:21.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.825+0000 7f9788f7d740 1 -- start start 2024-04-26T22:00:21.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942ede440 0x563942ede820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942efc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942eb4120 0x563942efa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f9788f7d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563942e18740 con 0x563942efbce0 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f9788f7d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563942db43a0 con 0x563942eb4120 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f9788f7d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563942e14700 con 0x563942ede440 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f977f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942efc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f977f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942efc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38212/0 (socket says 172.21.15.137:38212) 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f977f7fe640 1 -- 172.21.15.137:0/2025073538 learned_addr learned my addr 172.21.15.137:0/2025073538 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f977f7fe640 1 -- 172.21.15.137:0/2025073538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942ede440 msgr2=0x563942ede820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f9784801640 1 --2- 172.21.15.137:0/2025073538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942eb4120 0x563942efa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f977f7fe640 1 --2- 172.21.15.137:0/2025073538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942ede440 0x563942ede820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f977f7fe640 1 -- 172.21.15.137:0/2025073538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942eb4120 msgr2=0x563942efa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f977f7fe640 1 --2- 172.21.15.137:0/2025073538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942eb4120 0x563942efa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.826+0000 7f977f7fe640 1 -- 172.21.15.137:0/2025073538 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563942dd0750 con 0x563942efbce0 2024-04-26T22:00:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f977f7fe640 1 --2- 172.21.15.137:0/2025073538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942efc230 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9774009630 tx=0x7f977402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962f5d80a68c2e3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9765ffb640 1 -- 172.21.15.137:0/2025073538 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977404d070 con 0x563942efbce0 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9765ffb640 1 -- 172.21.15.137:0/2025073538 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9774004250 con 0x563942efbce0 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9765ffb640 1 -- 172.21.15.137:0/2025073538 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9774037040 con 0x563942efbce0 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9788f7d740 1 -- 172.21.15.137:0/2025073538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 msgr2=0x563942efc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9788f7d740 1 --2- 172.21.15.137:0/2025073538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942efc230 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9774009630 tx=0x7f977402e000 comp rx=0 tx=0).stop 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9788f7d740 1 -- 172.21.15.137:0/2025073538 shutdown_connections 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9788f7d740 1 --2- 172.21.15.137:0/2025073538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942efc230 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9788f7d740 1 --2- 172.21.15.137:0/2025073538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942eb4120 0x563942efa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9788f7d740 1 --2- 172.21.15.137:0/2025073538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942ede440 0x563942ede820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9788f7d740 1 -- 172.21.15.137:0/2025073538 >> 172.21.15.137:0/2025073538 conn(0x563942eb0a50 msgr2=0x563942ef9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9788f7d740 1 -- 172.21.15.137:0/2025073538 shutdown_connections 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.827+0000 7f9788f7d740 1 -- 172.21.15.137:0/2025073538 wait complete. 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.828+0000 7f9788f7d740 1 -- start start 2024-04-26T22:00:21.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.828+0000 7f9788f7d740 1 Processor -- start 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942ede440 0x563942efa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942eda200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 0x563942eda740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f9788f7d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563942eb4ec0 con 0x563942efbce0 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f9788f7d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563942d9ffe0 con 0x563942edf3f0 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f9788f7d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563942eae980 con 0x563942ede440 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f9788f7d740 10 client.0 _ll_register_callbacks cb 0x563942db6150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942eda200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942eda200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38228/0 (socket says 172.21.15.137:38228) 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977f7fe640 1 -- 172.21.15.137:0/1846596726 learned_addr learned my addr 172.21.15.137:0/1846596726 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977f7fe640 1 -- 172.21.15.137:0/1846596726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942ede440 msgr2=0x563942efa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977ffff640 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942ede440 0x563942efa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f9784801640 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 0x563942eda740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977f7fe640 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942ede440 0x563942efa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977f7fe640 1 -- 172.21.15.137:0/1846596726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 msgr2=0x563942eda740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977f7fe640 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 0x563942eda740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977f7fe640 1 -- 172.21.15.137:0/1846596726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563942b2a2d0 con 0x563942efbce0 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f977f7fe640 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942eda200 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9774035040 tx=0x7f9774004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9dde7bae7e4073 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.829+0000 7f975effd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f975effd640 1 -- 172.21.15.137:0/1846596726 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977404d040 con 0x563942efbce0 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f975effd640 1 -- 172.21.15.137:0/1846596726 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f9774053ae0 con 0x563942efbce0 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f9788f7d740 1 -- 172.21.15.137:0/1846596726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9774004250 con 0x563942efbce0 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f975effd640 1 -- 172.21.15.137:0/1846596726 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f977405a050 con 0x563942efbce0 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f9788f7d740 10 client.5760 fetch_fsmap learned FSMap version 20 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f9788f7d740 1 -- 172.21.15.137:0/1846596726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x563942bf46b0 con 0x563942efbce0 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f975effd640 1 -- 172.21.15.137:0/1846596726 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9774004250 con 0x563942efbce0 2024-04-26T22:00:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f975effd640 1 -- 172.21.15.137:0/1846596726 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f977405d020 con 0x563942efbce0 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f9788f7d740 10 client.5760 fetch_fsmap finished waiting for FSMap version 20 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f9788f7d740 10 client.5760 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f9788f7d740 20 client.5760 populate_metadata read hostname 'smithi137' 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f9788f7d740 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x563942edc780 0x563942edcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f9788f7d740 4 client.5760 mds_command: new command op to 5592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f9788f7d740 1 -- 172.21.15.137:0/1846596726 --> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563942e26350 con 0x563942edc780 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f977ffff640 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x563942edc780 0x563942edcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f975effd640 10 client.5760 ms_handle_connect on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.830+0000 7f977ffff640 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x563942edc780 0x563942edcb60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8cf54c74454070d server_cookie=b060eace942e4d4d in_seq=0 out_seq=0 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f975effd640 1 -- 172.21.15.137:0/1846596726 <== mds.0 v2:172.21.15.137:6836/924509332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563942e26350 con 0x563942edc780 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f975effd640 10 client.5760 handle_command_reply: tid=0 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 client.5760 shutdown 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 -- 172.21.15.137:0/1846596726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 msgr2=0x563942eda200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942eda200 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9774035040 tx=0x7f9774004730 comp rx=0 tx=0).stop 2024-04-26T22:00:21.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 -- 172.21.15.137:0/1846596726 shutdown_connections 2024-04-26T22:00:21.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x563942edc780 0x563942edcb60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942efbce0 0x563942eda200 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 0x563942eda740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f975effd640 0 client.5760 ms_handle_reset on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:21.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 --2- 172.21.15.137:0/1846596726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942ede440 0x563942efa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 -- 172.21.15.137:0/1846596726 >> 172.21.15.137:0/1846596726 conn(0x563942eb4120 msgr2=0x563942ef88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:21.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 -- 172.21.15.137:0/1846596726 shutdown_connections 2024-04-26T22:00:21.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.831+0000 7f9788f7d740 1 -- 172.21.15.137:0/1846596726 wait complete. 2024-04-26T22:00:21.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.832+0000 7f9788f7d740 20 client.5760 trim_cache size 0 max 16384 2024-04-26T22:00:21.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.849+0000 7f9788f7d740 1 Processor -- start 2024-04-26T22:00:21.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.849+0000 7f9788f7d740 1 -- start start 2024-04-26T22:00:21.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942efc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 0x563942efc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942efbce0 0x563942ef7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f9788f7d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f978013e470 con 0x563942ede440 2024-04-26T22:00:21.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f9788f7d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f978013d7d0 con 0x563942edf3f0 2024-04-26T22:00:21.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f9788f7d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f978013de20 con 0x563942efbce0 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942efc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942efc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38242/0 (socket says 172.21.15.137:38242) 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977ffff640 1 -- 172.21.15.137:0/2705489925 learned_addr learned my addr 172.21.15.137:0/2705489925 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f9784801640 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942efbce0 0x563942ef7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977ffff640 1 -- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942efbce0 msgr2=0x563942ef7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977f7fe640 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 0x563942efc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977ffff640 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942efbce0 0x563942ef7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977ffff640 1 -- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 msgr2=0x563942efc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977ffff640 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 0x563942efc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977ffff640 1 -- 172.21.15.137:0/2705489925 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563942e1d9c0 con 0x563942ede440 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f9784801640 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942efbce0 0x563942ef7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.850+0000 7f977f7fe640 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 0x563942efc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f977ffff640 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942efc190 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9770054fb0 tx=0x7f9770005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a745b997083ccb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f97657fa640 1 -- 172.21.15.137:0/2705489925 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770087070 con 0x563942ede440 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f97657fa640 1 -- 172.21.15.137:0/2705489925 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9770056ea0 con 0x563942ede440 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f97657fa640 1 -- 172.21.15.137:0/2705489925 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770071070 con 0x563942ede440 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f9788f7d740 1 -- 172.21.15.137:0/2705489925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 msgr2=0x563942efc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f9788f7d740 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942efc190 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9770054fb0 tx=0x7f9770005040 comp rx=0 tx=0).stop 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f9788f7d740 1 -- 172.21.15.137:0/2705489925 shutdown_connections 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f9788f7d740 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942efbce0 0x563942ef7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f9788f7d740 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942edf3f0 0x563942efc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f9788f7d740 1 --2- 172.21.15.137:0/2705489925 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942efc190 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f9788f7d740 1 -- 172.21.15.137:0/2705489925 >> 172.21.15.137:0/2705489925 conn(0x563942eb4120 msgr2=0x563942f1dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f9788f7d740 1 -- 172.21.15.137:0/2705489925 shutdown_connections 2024-04-26T22:00:21.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.851+0000 7f9788f7d740 1 -- 172.21.15.137:0/2705489925 wait complete. 2024-04-26T22:00:21.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.852+0000 7f9788f7d740 1 -- start start 2024-04-26T22:00:21.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.852+0000 7f9788f7d740 1 Processor -- start 2024-04-26T22:00:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942eb2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942edf3f0 0x563942ee15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f9788f7d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942efbce0 0x563942f1c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f9788f7d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563942f0ac20 con 0x563942ede440 2024-04-26T22:00:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f9788f7d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563942eb4ec0 con 0x563942efbce0 2024-04-26T22:00:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f9788f7d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563942f09fc0 con 0x563942edf3f0 2024-04-26T22:00:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f9788f7d740 10 client.0 _ll_register_callbacks cb 0x7f977404b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:00:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942eb2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942eb2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38244/0 (socket says 172.21.15.137:38244) 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977ffff640 1 -- 172.21.15.137:0/447160464 learned_addr learned my addr 172.21.15.137:0/447160464 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f9784801640 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942efbce0 0x563942f1c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977f7fe640 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942edf3f0 0x563942ee15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977ffff640 1 -- 172.21.15.137:0/447160464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942edf3f0 msgr2=0x563942ee15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977ffff640 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942edf3f0 0x563942ee15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977ffff640 1 -- 172.21.15.137:0/447160464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942efbce0 msgr2=0x563942f1c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977ffff640 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942efbce0 0x563942f1c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977ffff640 1 -- 172.21.15.137:0/447160464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563942ee0e10 con 0x563942ede440 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977f7fe640 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942edf3f0 0x563942ee15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f977ffff640 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942eb2870 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9770061940 tx=0x7f9770000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51626ca9640f7f93 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f975effd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f975effd640 1 -- 172.21.15.137:0/447160464 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770077060 con 0x563942ede440 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f975effd640 1 -- 172.21.15.137:0/447160464 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f97700581f0 con 0x563942ede440 2024-04-26T22:00:21.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.853+0000 7f9788f7d740 1 -- 172.21.15.137:0/447160464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9770056ea0 con 0x563942ede440 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f975effd640 1 -- 172.21.15.137:0/447160464 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9770087070 con 0x563942ede440 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f9788f7d740 10 client.5766 fetch_fsmap learned FSMap version 20 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f9788f7d740 1 -- 172.21.15.137:0/447160464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x563942eb3cc0 con 0x563942ede440 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f975effd640 1 -- 172.21.15.137:0/447160464 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9770056ea0 con 0x563942ede440 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f975effd640 1 -- 172.21.15.137:0/447160464 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f977005f150 con 0x563942ede440 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f9788f7d740 10 client.5766 fetch_fsmap finished waiting for FSMap version 20 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f9788f7d740 10 client.5766 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f9788f7d740 20 client.5766 populate_metadata read hostname 'smithi137' 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f9788f7d740 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x563942efc430 0x563942ed40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f9788f7d740 4 client.5766 mds_command: new command op to 5592 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f9788f7d740 1 -- 172.21.15.137:0/447160464 --> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] -- command(tid 0: {"prefix": "status"}) -- 0x563942e201c0 con 0x563942efc430 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f977f7fe640 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x563942efc430 0x563942ed40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f975effd640 10 client.5766 ms_handle_connect on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:21.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f977f7fe640 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x563942efc430 0x563942ed40f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42e1ddbee9c3dfc4 server_cookie=31abc348c095845a in_seq=0 out_seq=0 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f975effd640 1 -- 172.21.15.137:0/447160464 <== mds.0 v2:172.21.15.137:6836/924509332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563942e201c0 con 0x563942efc430 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f975effd640 10 client.5766 handle_command_reply: tid=0 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.854+0000 7f9788f7d740 1 client.5766 shutdown 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 -- 172.21.15.137:0/447160464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 msgr2=0x563942eb2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942eb2870 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9770061940 tx=0x7f9770000bc0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 -- 172.21.15.137:0/447160464 shutdown_connections 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x563942efc430 0x563942ed40f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f975effd640 0 client.5766 ms_handle_reset on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563942efbce0 0x563942f1c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563942edf3f0 0x563942ee15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 --2- 172.21.15.137:0/447160464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563942ede440 0x563942eb2870 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 -- 172.21.15.137:0/447160464 >> 172.21.15.137:0/447160464 conn(0x563942eb4120 msgr2=0x563942eb54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 -- 172.21.15.137:0/447160464 shutdown_connections 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 1 -- 172.21.15.137:0/447160464 wait complete. 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9788f7d740 20 client.5766 trim_cache size 0 max 16384 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 5592, 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:00:21.863 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 8.9638708400000002, 2024-04-26T22:00:21.864 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 20, 2024-04-26T22:00:21.864 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 46, 2024-04-26T22:00:21.864 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 46, 2024-04-26T22:00:21.864 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 14.046217453000001 2024-04-26T22:00:21.864 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 -- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f976c06c8f0 msgr2=0x7f976c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f976c06c8f0 0x7f976c06edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9774034000 tx=0x7f977402c000 comp rx=0 tx=0).stop 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 -- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b3de0 msgr2=0x7f97800b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b3de0 0x7f97800b30d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f977000c340 tx=0x7f977000c800 comp rx=0 tx=0).stop 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 -- 172.21.15.137:0/180323733 shutdown_connections 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f976c06c8f0 0x7f976c06edb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9780145980 0x7f978006f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97800b61a0 0x7f978006ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 --2- 172.21.15.137:0/180323733 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97800b3de0 0x7f97800b30d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 -- 172.21.15.137:0/180323733 >> 172.21.15.137:0/180323733 conn(0x7f97800d0d30 msgr2=0x7f97800ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 -- 172.21.15.137:0/180323733 shutdown_connections 2024-04-26T22:00:21.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.855+0000 7f9786264640 1 -- 172.21.15.137:0/180323733 wait complete. 2024-04-26T22:00:21.866 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:00:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.963+0000 7f4efc50a640 1 Processor -- start 2024-04-26T22:00:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.963+0000 7f4efc50a640 1 -- start start 2024-04-26T22:00:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efc50a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 0x7f4ef40b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efc50a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4ef406c9b0 0x7f4ef40ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efc50a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ef4070270 con 0x7f4ef40b0f00 2024-04-26T22:00:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efc50a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4ef4070550 con 0x7f4ef406c9b0 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efc50a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef40b69a0 con 0x7f4ef415f440 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efaaa7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4ef406c9b0 0x7f4ef40ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4ef9aa5640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4ef40b0f00 0x7f4ef406c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:35372/0 (socket says 172.21.15.137:35372) 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4ef9aa5640 1 -- 172.21.15.137:0/1274712176 learned_addr learned my addr 172.21.15.137:0/1274712176 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efa2a6640 1 --2- 172.21.15.137:0/1274712176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 0x7f4ef40b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efaaa7640 1 -- 172.21.15.137:0/1274712176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 msgr2=0x7f4ef40b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efaaa7640 1 --2- 172.21.15.137:0/1274712176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 0x7f4ef40b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efaaa7640 1 -- 172.21.15.137:0/1274712176 >> v1:172.21.15.137:6789/0 conn(0x7f4ef40b0f00 legacy=0x7f4ef406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4ef92a4640 1 -- 172.21.15.137:0/1274712176 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040967707 0 0) 0x7f4ef4070270 con 0x7f4ef40b0f00 2024-04-26T22:00:21.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.964+0000 7f4efaaa7640 1 -- 172.21.15.137:0/1274712176 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef40b6350 con 0x7f4ef406c9b0 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.965+0000 7f4efaaa7640 1 --2- 172.21.15.137:0/1274712176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef406c9b0 0x7f4ef40ae8b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009d90 tx=0x7f4eec02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7bf51700436155 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.965+0000 7f4ef92a4640 1 -- 172.21.15.137:0/1274712176 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec031600 con 0x7f4ef406c9b0 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.965+0000 7f4ef92a4640 1 -- 172.21.15.137:0/1274712176 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eec0317a0 con 0x7f4ef406c9b0 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.965+0000 7f4ef92a4640 1 -- 172.21.15.137:0/1274712176 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec031b70 con 0x7f4ef406c9b0 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.965+0000 7f4efc50a640 1 -- 172.21.15.137:0/1274712176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef406c9b0 msgr2=0x7f4ef40ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.965+0000 7f4efc50a640 1 --2- 172.21.15.137:0/1274712176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef406c9b0 0x7f4ef40ae8b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009d90 tx=0x7f4eec02a5d0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.966+0000 7f4efc50a640 1 -- 172.21.15.137:0/1274712176 shutdown_connections 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.966+0000 7f4efc50a640 1 --2- 172.21.15.137:0/1274712176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef406c9b0 0x7f4ef40ae8b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.966+0000 7f4efc50a640 1 --2- 172.21.15.137:0/1274712176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 0x7f4ef40b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.966+0000 7f4efc50a640 1 -- 172.21.15.137:0/1274712176 >> 172.21.15.137:0/1274712176 conn(0x7f4ef40b3c40 msgr2=0x7f4ef40b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:21.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.966+0000 7f4efc50a640 1 -- 172.21.15.137:0/1274712176 shutdown_connections 2024-04-26T22:00:21.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.966+0000 7f4efc50a640 1 -- 172.21.15.137:0/1274712176 wait complete. 2024-04-26T22:00:21.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.967+0000 7f4efc50a640 1 Processor -- start 2024-04-26T22:00:21.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.967+0000 7f4efc50a640 1 -- start start 2024-04-26T22:00:21.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.967+0000 7f4efc50a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ef406c9b0 0x7f4ef414c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.967+0000 7f4efc50a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef40b0f00 0x7f4ef4161120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.967+0000 7f4efc50a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 0x7f4ef4161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.967+0000 7f4efc50a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef406fd70 con 0x7f4ef40b0f00 2024-04-26T22:00:21.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.967+0000 7f4efc50a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef40b7370 con 0x7f4ef406c9b0 2024-04-26T22:00:21.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.967+0000 7f4efc50a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4ef406fef0 con 0x7f4ef415f440 2024-04-26T22:00:21.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4ef9aa5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef40b0f00 0x7f4ef4161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4ef9aa5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef40b0f00 0x7f4ef4161120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38264/0 (socket says 172.21.15.137:38264) 2024-04-26T22:00:21.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4ef9aa5640 1 -- 172.21.15.137:0/4168697963 learned_addr learned my addr 172.21.15.137:0/4168697963 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:21.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4efaaa7640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 0x7f4ef4161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4efa2a6640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ef406c9b0 0x7f4ef414c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4ef9aa5640 1 -- 172.21.15.137:0/4168697963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 msgr2=0x7f4ef4161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4ef9aa5640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 0x7f4ef4161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4ef9aa5640 1 -- 172.21.15.137:0/4168697963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ef406c9b0 msgr2=0x7f4ef414c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4ef9aa5640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ef406c9b0 0x7f4ef414c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4ef9aa5640 1 -- 172.21.15.137:0/4168697963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef4160f10 con 0x7f4ef40b0f00 2024-04-26T22:00:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4efa2a6640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ef406c9b0 0x7f4ef414c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4ef9aa5640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef40b0f00 0x7f4ef4161120 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400c4a0 tx=0x7f4ee400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4eeaffd640 1 -- 172.21.15.137:0/4168697963 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4017070 con 0x7f4ef40b0f00 2024-04-26T22:00:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4eeaffd640 1 -- 172.21.15.137:0/4168697963 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ee4005ce0 con 0x7f4ef40b0f00 2024-04-26T22:00:21.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef4160670 con 0x7f4ef40b0f00 2024-04-26T22:00:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4eeaffd640 1 -- 172.21.15.137:0/4168697963 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee40072b0 con 0x7f4ef40b0f00 2024-04-26T22:00:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.968+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef4160c30 con 0x7f4ef40b0f00 2024-04-26T22:00:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.969+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef40693d0 con 0x7f4ef40b0f00 2024-04-26T22:00:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.970+0000 7f4eeaffd640 1 -- 172.21.15.137:0/4168697963 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ee401a070 con 0x7f4ef40b0f00 2024-04-26T22:00:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.970+0000 7f4eeaffd640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4ed806c920 0x7f4ed806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.970+0000 7f4efa2a6640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4ed806c920 0x7f4ed806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:21.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.970+0000 7f4eeaffd640 1 -- 172.21.15.137:0/4168697963 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f4ee408ae50 con 0x7f4ef40b0f00 2024-04-26T22:00:21.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.971+0000 7f4efa2a6640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4ed806c920 0x7f4ed806ede0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0006fd0 tx=0x7f4ef0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:21.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:21.975+0000 7f4eeaffd640 1 -- 172.21.15.137:0/4168697963 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4ee4059310 con 0x7f4ef40b0f00 2024-04-26T22:00:22.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.186+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4ef414ce50 con 0x7f4ef40b0f00 2024-04-26T22:00:22.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.187+0000 7f4eeaffd640 1 -- 172.21.15.137:0/4168697963 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+73 (secure 0 0 0) 0x7f4ee4058c10 con 0x7f4ef40b0f00 2024-04-26T22:00:22.187 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.188+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4ed806c920 msgr2=0x7f4ed806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.188+0000 7f4efc50a640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4ed806c920 0x7f4ed806ede0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0006fd0 tx=0x7f4ef0008040 comp rx=0 tx=0).stop 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.188+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef40b0f00 msgr2=0x7f4ef4161120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.188+0000 7f4efc50a640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef40b0f00 0x7f4ef4161120 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4ee400c4a0 tx=0x7f4ee400c960 comp rx=0 tx=0).stop 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.188+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 shutdown_connections 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.188+0000 7f4efc50a640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4ed806c920 0x7f4ed806ede0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.189+0000 7f4efc50a640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ef40b0f00 0x7f4ef4161120 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.189+0000 7f4efc50a640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ef415f440 0x7f4ef4161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.189+0000 7f4efc50a640 1 --2- 172.21.15.137:0/4168697963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ef406c9b0 0x7f4ef414c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:22.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.189+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 >> 172.21.15.137:0/4168697963 conn(0x7f4ef40b3c40 msgr2=0x7f4ef40aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:22.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.189+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 shutdown_connections 2024-04-26T22:00:22.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22.189+0000 7f4efc50a640 1 -- 172.21.15.137:0/4168697963 wait complete. 2024-04-26T22:00:22.199 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:00:22.200 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:00:22.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:00:22.200 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:00:22.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:00:22.200 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:00:22.200 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:00:22.200 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:00:22.200 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:00:22.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:22.200 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:00:22.215 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:00:22.216 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42684sec preferred_lft 42684sec 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:00:22.217 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:00:22.218 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:00:22.218 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:00:22.218 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:00:22.218 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:00:22.218 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:00:22.218 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:00:22.218 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:00:22.218 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:00:22.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:22.218 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:00:22.278 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:00:22.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:22.280 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:00:22.334 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:00:22.335 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:00:22.335 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:00:22.335 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:00:22.335 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:00:22.339 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:00:22.339 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:00:22.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:00:22.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:00:22.339 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:00:22.340 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:00:22.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:00:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:00:22.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:22.470 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:00:22.485 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:00:22.485 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:00:22.485 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:00:22.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:22.485 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:00:22.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:00:22.551 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:00:22.606 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:00:22.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:00:22.606 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:00:22.660 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:00:22.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:22.660 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:00:22.742 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:00:22.742 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:00:22.751 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:00:22.753 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:00:22.753 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:00:22.753 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:00:22.753 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:00:22.754 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:00:22.754 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:00:22.754 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:00:22.754 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:00:22.754 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:00:22.755 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:00:22.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:22.755 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:00:22.819 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:00:22.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:00:22.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:00:22.919 INFO:teuthology.orchestra.run.smithi137.stdout:client4988 2024-04-26T22:00:22.919 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:00:22.919 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:22.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:22.935 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-26T22:00:22.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:22.994 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-26T22:00:23.050 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:00:23.050 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:00:23.050 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:00:23.050 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:00:23.050 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-26T22:00:23.050 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:00:23.154 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627777 2024-04-26T22:00:23.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:00:23.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:23.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.302+0000 7f061e346640 1 Processor -- start 2024-04-26T22:00:23.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.302+0000 7f061e346640 1 -- start start 2024-04-26T22:00:23.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f061e346640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f061806f2c0 0x7f0618071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f061e346640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b8c0 0x7f06180cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f061e346640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06180733e0 con 0x7f061815b4e0 2024-04-26T22:00:23.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f061e346640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f06180ce230 con 0x7f061806f2c0 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f061e346640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0618072f00 con 0x7f061815b8c0 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f06177fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f061806f2c0 0x7f0618071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f061c8e3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b8c0 0x7f06180cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f0617fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f061815b4e0 0x7f061806ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42474/0 (socket says 172.21.15.137:42474) 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f06177fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f061806f2c0 0x7f0618071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:59228/0 (socket says 172.21.15.137:59228) 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.303+0000 7f0617fff640 1 -- 172.21.15.137:0/1117666073 learned_addr learned my addr 172.21.15.137:0/1117666073 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.304+0000 7f06177fe640 1 -- 172.21.15.137:0/1117666073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b8c0 msgr2=0x7f06180cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.304+0000 7f06177fe640 1 --2- 172.21.15.137:0/1117666073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b8c0 0x7f06180cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.304+0000 7f06177fe640 1 -- 172.21.15.137:0/1117666073 >> v1:172.21.15.170:6789/0 conn(0x7f061815b4e0 legacy=0x7f061806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.304+0000 7f06177fe640 1 -- 172.21.15.137:0/1117666073 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0618072660 con 0x7f061806f2c0 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.304+0000 7f061c8e3640 1 --2- 172.21.15.137:0/1117666073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b8c0 0x7f06180cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.304+0000 7f06177fe640 1 --2- 172.21.15.137:0/1117666073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f061806f2c0 0x7f0618071fd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f06080097a0 tx=0x7f060802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ce6832d2fc3477c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f0616ffd640 1 -- 172.21.15.137:0/1117666073 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608037070 con 0x7f061806f2c0 2024-04-26T22:00:23.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f0616ffd640 1 -- 172.21.15.137:0/1117666073 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0608032440 con 0x7f061806f2c0 2024-04-26T22:00:23.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f0616ffd640 1 -- 172.21.15.137:0/1117666073 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608032810 con 0x7f061806f2c0 2024-04-26T22:00:23.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f061e346640 1 -- 172.21.15.137:0/1117666073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f061806f2c0 msgr2=0x7f0618071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f061e346640 1 --2- 172.21.15.137:0/1117666073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f061806f2c0 0x7f0618071fd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f06080097a0 tx=0x7f060802a180 comp rx=0 tx=0).stop 2024-04-26T22:00:23.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f061e346640 1 -- 172.21.15.137:0/1117666073 shutdown_connections 2024-04-26T22:00:23.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f061e346640 1 --2- 172.21.15.137:0/1117666073 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b8c0 0x7f06180cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f061e346640 1 --2- 172.21.15.137:0/1117666073 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f061806f2c0 0x7f0618071fd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f061e346640 1 -- 172.21.15.137:0/1117666073 >> 172.21.15.137:0/1117666073 conn(0x7f06180d0d30 msgr2=0x7f06180d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:23.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f061e346640 1 -- 172.21.15.137:0/1117666073 shutdown_connections 2024-04-26T22:00:23.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.305+0000 7f061e346640 1 -- 172.21.15.137:0/1117666073 wait complete. 2024-04-26T22:00:23.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.306+0000 7f061e346640 1 Processor -- start 2024-04-26T22:00:23.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.307+0000 7f061e346640 1 -- start start 2024-04-26T22:00:23.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.307+0000 7f061e346640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f061806f2c0 0x7f0618151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.307+0000 7f061e346640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b4e0 0x7f0618154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.307+0000 7f061e346640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061815b8c0 0x7f06180b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.307+0000 7f061e346640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06180b3e80 con 0x7f061815b8c0 2024-04-26T22:00:23.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.307+0000 7f061e346640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0618072c20 con 0x7f061806f2c0 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.307+0000 7f061e346640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0618073820 con 0x7f061815b4e0 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061c8e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061815b8c0 0x7f06180b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061c8e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061815b8c0 0x7f06180b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38268/0 (socket says 172.21.15.137:38268) 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061c8e3640 1 -- 172.21.15.137:0/4142080550 learned_addr learned my addr 172.21.15.137:0/4142080550 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f0617fff640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f061806f2c0 0x7f0618151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f06177fe640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b4e0 0x7f0618154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061c8e3640 1 -- 172.21.15.137:0/4142080550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b4e0 msgr2=0x7f0618154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061c8e3640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b4e0 0x7f0618154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061c8e3640 1 -- 172.21.15.137:0/4142080550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f061806f2c0 msgr2=0x7f0618151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061c8e3640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f061806f2c0 0x7f0618151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061c8e3640 1 -- 172.21.15.137:0/4142080550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06181536c0 con 0x7f061815b8c0 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061c8e3640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061815b8c0 0x7f06180b1630 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0610009dd0 tx=0x7f06100075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f0614ff9640 1 -- 172.21.15.137:0/4142080550 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0610019070 con 0x7f061815b8c0 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f0614ff9640 1 -- 172.21.15.137:0/4142080550 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0610003b90 con 0x7f061815b8c0 2024-04-26T22:00:23.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f0614ff9640 1 -- 172.21.15.137:0/4142080550 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0610007e60 con 0x7f061815b8c0 2024-04-26T22:00:23.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0618152620 con 0x7f061815b8c0 2024-04-26T22:00:23.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.308+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0618152be0 con 0x7f061815b8c0 2024-04-26T22:00:23.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.309+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f061806a290 con 0x7f061815b8c0 2024-04-26T22:00:23.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.311+0000 7f0614ff9640 1 -- 172.21.15.137:0/4142080550 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0610005d10 con 0x7f061815b8c0 2024-04-26T22:00:23.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.311+0000 7f0614ff9640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.311+0000 7f0614ff9640 1 -- 172.21.15.137:0/4142080550 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f061008bb00 con 0x7f061815b8c0 2024-04-26T22:00:23.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.311+0000 7f0617fff640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.311+0000 7f0617fff640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f060c007fd0 tx=0x7f060c007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.316+0000 7f0614ff9640 1 -- 172.21.15.137:0/4142080550 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0610011070 con 0x7f061815b8c0 2024-04-26T22:00:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.536+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0618155990 con 0x7f061815b8c0 2024-04-26T22:00:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.536+0000 7f0614ff9640 1 -- 172.21.15.137:0/4142080550 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7f0610059810 con 0x7f061815b8c0 2024-04-26T22:00:23.536 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:23.536 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1453946915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1453946915},{"type":"v1","addr":"172.21.15.170:6835","nonce":1453946915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3097952323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3097952323},{"type":"v1","addr":"172.21.15.170:6834","nonce":3097952323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3002187785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3002187785},{"type":"v1","addr":"172.21.15.137:6835","nonce":3002187785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:00:12.224783+0000","modified":"2024-04-26T22:00:14.233247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5592":{"gid":5592,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/924509332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":924509332},{"type":"v1","addr":"172.21.15.137:6837","nonce":924509332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5592,"qdb_cluster":[5592]},"id":3}]} 2024-04-26T22:00:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 20 2024-04-26T22:00:23.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 msgr2=0x7f060406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f060c007fd0 tx=0x7f060c007e80 comp rx=0 tx=0).stop 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061815b8c0 msgr2=0x7f06180b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061815b8c0 0x7f06180b1630 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0610009dd0 tx=0x7f06100075c0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 shutdown_connections 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f061815b8c0 0x7f06180b1630 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f061815b4e0 0x7f0618154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 --2- 172.21.15.137:0/4142080550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f061806f2c0 0x7f0618151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.538+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 >> 172.21.15.137:0/4142080550 conn(0x7f06180d0d30 msgr2=0x7f061815f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.539+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 shutdown_connections 2024-04-26T22:00:23.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.539+0000 7f061e346640 1 -- 172.21.15.137:0/4142080550 wait complete. 2024-04-26T22:00:23.550 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-26T22:00:23.676 INFO:teuthology.orchestra.run.smithi137.stdout:{"message":"","return_code":0} 2024-04-26T22:00:23.676 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T22:00:23.676 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-26T22:00:23.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e8b62f40 1 Processor -- start 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e8b62f40 1 -- start start 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e8b62f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f59ae4bff0 0x55f59af30de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e8b62f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63190 0x55f59ae82830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e8b62f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f59ae63570 0x55f59af2d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e8b62f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f59ae8e5a0 con 0x55f59ae63190 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e8b62f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f59ae08e40 con 0x55f59ae63570 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e8b62f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f59ae8e880 con 0x55f59ae4bff0 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e5e5b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63190 0x55f59ae82830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e5e5b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63190 0x55f59ae82830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38284/0 (socket says 172.21.15.137:38284) 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e5e5b640 1 -- 172.21.15.137:0/1699688828 learned_addr learned my addr 172.21.15.137:0/1699688828 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e6e5d640 1 --2- 172.21.15.137:0/1699688828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f59ae63570 0x55f59af2d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.720+0000 7fb8e665c640 1 --2- 172.21.15.137:0/1699688828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f59ae4bff0 0x55f59af30de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.721+0000 7fb8e5e5b640 1 -- 172.21.15.137:0/1699688828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f59ae4bff0 msgr2=0x55f59af30de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:23.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.721+0000 7fb8e5e5b640 1 --2- 172.21.15.137:0/1699688828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f59ae4bff0 0x55f59af30de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.721+0000 7fb8e5e5b640 1 -- 172.21.15.137:0/1699688828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f59ae63570 msgr2=0x55f59af2d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.721+0000 7fb8e5e5b640 1 --2- 172.21.15.137:0/1699688828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f59ae63570 0x55f59af2d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.721+0000 7fb8e5e5b640 1 -- 172.21.15.137:0/1699688828 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f59af328a0 con 0x55f59ae63190 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.721+0000 7fb8e5e5b640 1 --2- 172.21.15.137:0/1699688828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63190 0x55f59ae82830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00a520 tx=0x7fb8dc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772449e0024cbd34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.721+0000 7fb8e4e59640 1 -- 172.21.15.137:0/1699688828 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc059040 con 0x55f59ae63190 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.721+0000 7fb8e4e59640 1 -- 172.21.15.137:0/1699688828 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8dc064070 con 0x55f59ae63190 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.721+0000 7fb8e4e59640 1 -- 172.21.15.137:0/1699688828 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc054c30 con 0x55f59ae63190 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/1699688828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63190 msgr2=0x55f59ae82830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 --2- 172.21.15.137:0/1699688828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63190 0x55f59ae82830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00a520 tx=0x7fb8dc04e000 comp rx=0 tx=0).stop 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/1699688828 shutdown_connections 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 --2- 172.21.15.137:0/1699688828 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63190 0x55f59ae82830 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 --2- 172.21.15.137:0/1699688828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f59ae63570 0x55f59af2d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 --2- 172.21.15.137:0/1699688828 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f59ae4bff0 0x55f59af30de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/1699688828 >> 172.21.15.137:0/1699688828 conn(0x55f59ae5fdd0 msgr2=0x55f59ae8c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:23.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/1699688828 shutdown_connections 2024-04-26T22:00:23.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/1699688828 wait complete. 2024-04-26T22:00:23.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 Processor -- start 2024-04-26T22:00:23.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.722+0000 7fb8e8b62f40 1 -- start start 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e8b62f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f59ae4bff0 0x55f59afc5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e8b62f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f59ae63190 0x55f59ae83270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e8b62f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63570 0x55f59ae84ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e8b62f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f59af31900 con 0x55f59ae63570 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e8b62f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f59af2ddb0 con 0x55f59ae63190 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e8b62f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f59ae61340 con 0x55f59ae4bff0 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e6e5d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63570 0x55f59ae84ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e6e5d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63570 0x55f59ae84ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38298/0 (socket says 172.21.15.137:38298) 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e6e5d640 1 -- 172.21.15.137:0/478891341 learned_addr learned my addr 172.21.15.137:0/478891341 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e5e5b640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f59ae63190 0x55f59ae83270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.723+0000 7fb8e665c640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f59ae4bff0 0x55f59afc5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8e6e5d640 1 -- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f59ae4bff0 msgr2=0x55f59afc5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8e6e5d640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f59ae4bff0 0x55f59afc5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8e6e5d640 1 -- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f59ae63190 msgr2=0x55f59ae83270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8e6e5d640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f59ae63190 0x55f59ae83270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8e6e5d640 1 -- 172.21.15.137:0/478891341 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f59af2c150 con 0x55f59ae63570 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8e6e5d640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63570 0x55f59ae84ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0003ed0 tx=0x7fb8e0001830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8d77fe640 1 -- 172.21.15.137:0/478891341 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00123f0 con 0x55f59ae63570 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8d77fe640 1 -- 172.21.15.137:0/478891341 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e0017070 con 0x55f59ae63570 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f59ae8a3d0 con 0x55f59ae63570 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8d77fe640 1 -- 172.21.15.137:0/478891341 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00127f0 con 0x55f59ae63570 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.724+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f59af2c3c0 con 0x55f59ae63570 2024-04-26T22:00:23.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.725+0000 7fb8d77fe640 1 -- 172.21.15.137:0/478891341 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8e0012990 con 0x55f59ae63570 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.726+0000 7fb8d77fe640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c806b2d0 0x7fb8c806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.726+0000 7fb8d77fe640 1 -- 172.21.15.137:0/478891341 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fb8e008a550 con 0x55f59ae63570 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.726+0000 7fb8e665c640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c806b2d0 0x7fb8c806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.726+0000 7fb8e8b62f40 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f59ae61580 0x55f59ae8b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.726+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47) -- 0x55f59afce680 con 0x55f59ae61580 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.726+0000 7fb8e665c640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c806b2d0 0x7fb8c806d790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80056f0 tx=0x7fb8d800c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.726+0000 7fb8e5e5b640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f59ae61580 0x55f59ae8b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e5e5b640 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f59ae61580 0x55f59ae8b170 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e5e5b640 1 -- 172.21.15.137:0/478891341 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7fb8dc05c040 con 0x55f59ae61580 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f59ae61580 msgr2=0x55f59ae8b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f59ae61580 0x55f59ae8b170 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c806b2d0 msgr2=0x7fb8c806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c806b2d0 0x7fb8c806d790 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80056f0 tx=0x7fb8d800c040 comp rx=0 tx=0).stop 2024-04-26T22:00:23.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63570 msgr2=0x55f59ae84ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 --2- 172.21.15.137:0/478891341 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f59ae63570 0x55f59ae84ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0003ed0 tx=0x7fb8e0001830 comp rx=0 tx=0).stop 2024-04-26T22:00:23.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e6e5d640 1 -- 172.21.15.137:0/478891341 reap_dead start 2024-04-26T22:00:23.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 shutdown_connections 2024-04-26T22:00:23.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 >> 172.21.15.137:0/478891341 conn(0x55f59ae5fdd0 msgr2=0x55f59af2d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:23.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 shutdown_connections 2024-04-26T22:00:23.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.727+0000 7fb8e8b62f40 1 -- 172.21.15.137:0/478891341 wait complete. 2024-04-26T22:00:23.733 INFO:teuthology.orchestra.run.smithi137.stdout:Yalphaparent_a 2024-04-26T22:00:23.733 DEBUG:teuthology.orchestra.run.smithi137:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511627777, 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "ancestors": [ 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "dirino": 1099511627776, 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "dname": "alpha", 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "version": 2 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:23.807 INFO:teuthology.orchestra.run.smithi137.stdout: "dirino": 1, 2024-04-26T22:00:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "dname": "parent_a", 2024-04-26T22:00:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "version": 4 2024-04-26T22:00:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-26T22:00:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "pool": 7, 2024-04-26T22:00:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: "old_pools": [] 2024-04-26T22:00:23.808 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:00:23.808 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:23.824 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-04-26T22:00:23.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62871b3f40 1 Processor -- start 2024-04-26T22:00:23.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62871b3f40 1 -- start start 2024-04-26T22:00:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62871b3f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5641f8093270 0x5641f81319e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62871b3f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641f813b8a0 0x5641f8139900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62871b3f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f813bc80 0x5641f8139e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62871b3f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5641f808e7e0 con 0x5641f813bc80 2024-04-26T22:00:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62871b3f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5641f800be40 con 0x5641f813b8a0 2024-04-26T22:00:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62871b3f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5641f80ac9c0 con 0x5641f8093270 2024-04-26T22:00:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62854ae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f813bc80 0x5641f8139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62854ae640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f813bc80 0x5641f8139e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38322/0 (socket says 172.21.15.137:38322) 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.908+0000 7f62854ae640 1 -- 172.21.15.137:0/1967933961 learned_addr learned my addr 172.21.15.137:0/1967933961 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62854ae640 1 -- 172.21.15.137:0/1967933961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5641f8093270 msgr2=0x5641f81319e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62854ae640 1 --2- 172.21.15.137:0/1967933961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5641f8093270 0x5641f81319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62854ae640 1 -- 172.21.15.137:0/1967933961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641f813b8a0 msgr2=0x5641f8139900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62854ae640 1 --2- 172.21.15.137:0/1967933961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641f813b8a0 0x5641f8139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62854ae640 1 -- 172.21.15.137:0/1967933961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f80af860 con 0x5641f813bc80 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62854ae640 1 --2- 172.21.15.137:0/1967933961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f813bc80 0x5641f8139e40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f628000a560 tx=0x7f6280050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3024bde4b804329 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f627effd640 1 -- 172.21.15.137:0/1967933961 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280054040 con 0x5641f813bc80 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f627effd640 1 -- 172.21.15.137:0/1967933961 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6280050960 con 0x5641f813bc80 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f627effd640 1 -- 172.21.15.137:0/1967933961 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280050d50 con 0x5641f813bc80 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62871b3f40 1 -- 172.21.15.137:0/1967933961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f813bc80 msgr2=0x5641f8139e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62871b3f40 1 --2- 172.21.15.137:0/1967933961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f813bc80 0x5641f8139e40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f628000a560 tx=0x7f6280050000 comp rx=0 tx=0).stop 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62871b3f40 1 -- 172.21.15.137:0/1967933961 shutdown_connections 2024-04-26T22:00:23.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62871b3f40 1 --2- 172.21.15.137:0/1967933961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f813bc80 0x5641f8139e40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62871b3f40 1 --2- 172.21.15.137:0/1967933961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641f813b8a0 0x5641f8139900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62871b3f40 1 --2- 172.21.15.137:0/1967933961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5641f8093270 0x5641f81319e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62871b3f40 1 -- 172.21.15.137:0/1967933961 >> 172.21.15.137:0/1967933961 conn(0x5641f80aefe0 msgr2=0x5641f8138e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:23.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62871b3f40 1 -- 172.21.15.137:0/1967933961 shutdown_connections 2024-04-26T22:00:23.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.909+0000 7f62871b3f40 1 -- 172.21.15.137:0/1967933961 wait complete. 2024-04-26T22:00:23.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.910+0000 7f62871b3f40 1 Processor -- start 2024-04-26T22:00:23.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.910+0000 7f62871b3f40 1 -- start start 2024-04-26T22:00:23.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62871b3f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f8093270 0x5641f8062450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62871b3f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641f813b8a0 0x5641f8129de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62871b3f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5641f813bc80 0x5641f8065f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62871b3f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5641f8131f20 con 0x5641f8093270 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62871b3f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5641f813f140 con 0x5641f813b8a0 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62871b3f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5641f813e850 con 0x5641f813bc80 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f6284cad640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f8093270 0x5641f8062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f6284cad640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f8093270 0x5641f8062450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38338/0 (socket says 172.21.15.137:38338) 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f6284cad640 1 -- 172.21.15.137:0/2905150764 learned_addr learned my addr 172.21.15.137:0/2905150764 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62854ae640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5641f813bc80 0x5641f8065f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f627ffff640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641f813b8a0 0x5641f8129de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f6284cad640 1 -- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5641f813bc80 msgr2=0x5641f8065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f6284cad640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5641f813bc80 0x5641f8065f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f6284cad640 1 -- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641f813b8a0 msgr2=0x5641f8129de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f6284cad640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641f813b8a0 0x5641f8129de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f6284cad640 1 -- 172.21.15.137:0/2905150764 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641f8131cc0 con 0x5641f8093270 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62854ae640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5641f813bc80 0x5641f8065f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f6284cad640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f8093270 0x5641f8062450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f627000bb90 tx=0x7f6270009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f627dffb640 1 -- 172.21.15.137:0/2905150764 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270013070 con 0x5641f8093270 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f627dffb640 1 -- 172.21.15.137:0/2905150764 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6270009e40 con 0x5641f8093270 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641f81319e0 con 0x5641f8093270 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f627dffb640 1 -- 172.21.15.137:0/2905150764 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627000f640 con 0x5641f8093270 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.911+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641f8130730 con 0x5641f8093270 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.913+0000 7f627dffb640 1 -- 172.21.15.137:0/2905150764 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6270016070 con 0x5641f8093270 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.913+0000 7f627dffb640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626806b2d0 0x7f626806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.913+0000 7f627dffb640 1 -- 172.21.15.137:0/2905150764 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f627008a210 con 0x5641f8093270 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.913+0000 7f627ffff640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626806b2d0 0x7f626806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.913+0000 7f62871b3f40 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5641f813a8b0 0x5641f8137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.913+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47) -- 0x5641f8139ea0 con 0x5641f813a8b0 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.914+0000 7f62854ae640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5641f813a8b0 0x5641f8137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.914+0000 7f627ffff640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626806b2d0 0x7f626806d790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5641f80ab370 tx=0x7f6278005630 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.914+0000 7f62854ae640 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5641f813a8b0 0x5641f8137ce0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62854ae640 1 -- 172.21.15.137:0/2905150764 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v47'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6280056030 con 0x5641f813a8b0 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5641f813a8b0 msgr2=0x5641f8137ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5641f813a8b0 0x5641f8137ce0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626806b2d0 msgr2=0x7f626806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626806b2d0 0x7f626806d790 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5641f80ab370 tx=0x7f6278005630 comp rx=0 tx=0).stop 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f8093270 msgr2=0x5641f8062450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 --2- 172.21.15.137:0/2905150764 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5641f8093270 0x5641f8062450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f627000bb90 tx=0x7f6270009530 comp rx=0 tx=0).stop 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62854ae640 1 -- 172.21.15.137:0/2905150764 reap_dead start 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 shutdown_connections 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 >> 172.21.15.137:0/2905150764 conn(0x5641f80aefe0 msgr2=0x5641f813c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 shutdown_connections 2024-04-26T22:00:23.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:23.915+0000 7f62871b3f40 1 -- 172.21.15.137:0/2905150764 wait complete. 2024-04-26T22:00:23.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-26T22:00:23.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:23.922 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-04-26T22:00:24.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.025+0000 7f3655074640 1 Processor -- start 2024-04-26T22:00:24.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.025+0000 7f3655074640 1 -- start start 2024-04-26T22:00:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f3655074640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36500d2140 0x7f36500d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f3655074640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36500d33a0 con 0x7f36500b6020 2024-04-26T22:00:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f3655074640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36500d3680 con 0x7f3650162a10 2024-04-26T22:00:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f3655074640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f36500b4970 con 0x7f36500d2140 2024-04-26T22:00:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364f59e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f36500b6020 0x7f36500cffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:35374/0 (socket says 172.21.15.137:35374) 2024-04-26T22:00:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364f59e640 1 -- 172.21.15.137:0/1868644805 learned_addr learned my addr 172.21.15.137:0/1868644805 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253667024 0 0) 0x7f36500d33a0 con 0x7f36500b6020 2024-04-26T22:00:24.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f363c003520 con 0x7f36500b6020 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f3647fff640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36500d2140 0x7f36500d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 204467995 0 0) 0x7f363c003520 con 0x7f36500b6020 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36500d2140 msgr2=0x7f36500d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36500d2140 0x7f36500d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 >> v1:172.21.15.170:6789/0 conn(0x7f3650162a10 legacy=0x7f36500d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36500d3960 con 0x7f36500b6020 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f36480019f0 con 0x7f36500b6020 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 >> v1:172.21.15.137:6789/0 conn(0x7f36500b6020 legacy=0x7f36500cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f363c0039e0 0x7f363c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36500d2140 0x7f363c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f363c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f363c00bb50 con 0x7f363c004d40 2024-04-26T22:00:24.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f363c00bcd0 con 0x7f363c0039e0 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.026+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f363c00bea0 con 0x7f36500d2140 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.027+0000 7f364f59e640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f363c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.027+0000 7f364ed9d640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f363c0039e0 0x7f363c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.027+0000 7f3647fff640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36500d2140 0x7f363c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.027+0000 7f364f59e640 1 -- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36500d2140 msgr2=0x7f363c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.027+0000 7f364f59e640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f36500d2140 0x7f363c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.027+0000 7f364f59e640 1 -- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f363c0039e0 msgr2=0x7f363c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.027+0000 7f364f59e640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f363c0039e0 0x7f363c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.027+0000 7f364f59e640 1 -- 172.21.15.137:0/1868644805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c003520 con 0x7f363c004d40 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f364f59e640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f363c0051c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f364800a880 tx=0x7f363c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c28e16ecf2db818 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364800a4a0 con 0x7f363c004d40 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364802f070 con 0x7f363c004d40 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f364e59c640 1 -- 172.21.15.137:0/1868644805 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364802bcc0 con 0x7f363c004d40 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f3655074640 1 -- 172.21.15.137:0/1868644805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 msgr2=0x7f363c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f3655074640 1 --2- 172.21.15.137:0/1868644805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f363c0051c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f364800a880 tx=0x7f363c005830 comp rx=0 tx=0).stop 2024-04-26T22:00:24.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f364f59e640 1 -- 172.21.15.137:0/1868644805 reap_dead start 2024-04-26T22:00:24.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f3655074640 1 -- 172.21.15.137:0/1868644805 shutdown_connections 2024-04-26T22:00:24.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f3655074640 1 -- 172.21.15.137:0/1868644805 >> 172.21.15.137:0/1868644805 conn(0x7f365009e530 msgr2=0x7f36500d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.028+0000 7f3655074640 1 -- 172.21.15.137:0/1868644805 shutdown_connections 2024-04-26T22:00:24.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.029+0000 7f3655074640 1 -- 172.21.15.137:0/1868644805 wait complete. 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.030+0000 7f3655074640 1 Processor -- start 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.030+0000 7f3655074640 1 -- start start 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f3655074640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f36500b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f3655074640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3650159ed0 0x7f365006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f3655074640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f365006dcf0 0x7f36500c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f3655074640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3650162df0 con 0x7f363c004d40 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f3655074640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f36500d3f20 con 0x7f365006dcf0 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f3655074640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f36500b6600 con 0x7f3650159ed0 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f36500b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f36500b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38358/0 (socket says 172.21.15.137:38358) 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364ed9d640 1 -- 172.21.15.137:0/3470376972 learned_addr learned my addr 172.21.15.137:0/3470376972 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364f59e640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f365006dcf0 0x7f36500c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f3647fff640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3650159ed0 0x7f365006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364ed9d640 1 -- 172.21.15.137:0/3470376972 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3650159ed0 msgr2=0x7f365006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364ed9d640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3650159ed0 0x7f365006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364ed9d640 1 -- 172.21.15.137:0/3470376972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f365006dcf0 msgr2=0x7f36500c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364ed9d640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f365006dcf0 0x7f36500c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364ed9d640 1 -- 172.21.15.137:0/3470376972 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36500b3cd0 con 0x7f363c004d40 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f364ed9d640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f36500b3790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f364000f880 tx=0x7f364000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f36477fe640 1 -- 172.21.15.137:0/3470376972 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640001d20 con 0x7f363c004d40 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f36477fe640 1 -- 172.21.15.137:0/3470376972 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3640018070 con 0x7f363c004d40 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f36477fe640 1 -- 172.21.15.137:0/3470376972 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364000d730 con 0x7f363c004d40 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f3655074640 1 -- 172.21.15.137:0/3470376972 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3650161480 con 0x7f363c004d40 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.031+0000 7f3655074640 1 -- 172.21.15.137:0/3470376972 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3650161a40 con 0x7f363c004d40 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.033+0000 7f36477fe640 1 -- 172.21.15.137:0/3470376972 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f364000d8d0 con 0x7f363c004d40 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.034+0000 7f36477fe640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f363006c8f0 0x7f363006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.034+0000 7f36477fe640 1 -- 172.21.15.137:0/3470376972 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f364008b890 con 0x7f363c004d40 2024-04-26T22:00:24.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.034+0000 7f3647fff640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f363006c8f0 0x7f363006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.034+0000 7f3647fff640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f363006c8f0 0x7f363006edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36500b4f30 tx=0x7f3638008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.035+0000 7f3657d83740 1 Processor -- start 2024-04-26T22:00:24.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.035+0000 7f3657d83740 1 -- start start 2024-04-26T22:00:24.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.035+0000 7f3657d83740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 0x55a51d54c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.035+0000 7f3657d83740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d57c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.035+0000 7f3657d83740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57c9b0 0x55a51d5517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.035+0000 7f3657d83740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a51d4b6b00 con 0x55a51d57c9b0 2024-04-26T22:00:24.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.035+0000 7f3657d83740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a51d452920 con 0x55a51d57d0f0 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.035+0000 7f3657d83740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a51d4b2ac0 con 0x55a51d599fd0 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364f59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57c9b0 0x55a51d5517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364f59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57c9b0 0x55a51d5517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38368/0 (socket says 172.21.15.137:38368) 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364f59e640 1 -- 172.21.15.137:0/3814611844 learned_addr learned my addr 172.21.15.137:0/3814611844 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f3647fff640 1 --2- 172.21.15.137:0/3814611844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d57c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364ed9d640 1 --2- 172.21.15.137:0/3814611844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 0x55a51d54c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364f59e640 1 -- 172.21.15.137:0/3814611844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 msgr2=0x55a51d54c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364f59e640 1 --2- 172.21.15.137:0/3814611844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 0x55a51d54c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364f59e640 1 -- 172.21.15.137:0/3814611844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 msgr2=0x55a51d57c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364f59e640 1 --2- 172.21.15.137:0/3814611844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d57c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364f59e640 1 -- 172.21.15.137:0/3814611844 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a51d2907e0 con 0x55a51d57c9b0 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f364f59e640 1 --2- 172.21.15.137:0/3814611844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57c9b0 0x55a51d5517c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f364800a970 tx=0x7f3648007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46445397c687fef7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f3644ff9640 1 -- 172.21.15.137:0/3814611844 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36480019b0 con 0x55a51d57c9b0 2024-04-26T22:00:24.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f3644ff9640 1 -- 172.21.15.137:0/3814611844 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364802f070 con 0x55a51d57c9b0 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.036+0000 7f3644ff9640 1 -- 172.21.15.137:0/3814611844 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364802ba80 con 0x55a51d57c9b0 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.037+0000 7f3657d83740 1 -- 172.21.15.137:0/3814611844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57c9b0 msgr2=0x55a51d5517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.037+0000 7f3657d83740 1 --2- 172.21.15.137:0/3814611844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57c9b0 0x55a51d5517c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f364800a970 tx=0x7f3648007000 comp rx=0 tx=0).stop 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.037+0000 7f3657d83740 1 -- 172.21.15.137:0/3814611844 shutdown_connections 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.037+0000 7f3657d83740 1 --2- 172.21.15.137:0/3814611844 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57c9b0 0x55a51d5517c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.037+0000 7f3657d83740 1 --2- 172.21.15.137:0/3814611844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d57c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.037+0000 7f3657d83740 1 --2- 172.21.15.137:0/3814611844 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 0x55a51d54c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.037+0000 7f3657d83740 1 -- 172.21.15.137:0/3814611844 >> 172.21.15.137:0/3814611844 conn(0x55a51d54ebd0 msgr2=0x55a51d597470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.037+0000 7f3657d83740 1 -- 172.21.15.137:0/3814611844 shutdown_connections 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.037+0000 7f3657d83740 1 -- 172.21.15.137:0/3814611844 wait complete. 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.038+0000 7f3657d83740 1 -- start start 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.038+0000 7f3657d83740 1 Processor -- start 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f3657d83740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57d0f0 0x55a51d58e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f3657d83740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d599fd0 0x55a51d5a7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f3657d83740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 0x55a51d57fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f3657d83740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a51d550d80 con 0x55a51d57d0f0 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f3657d83740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a51d4505d0 con 0x55a51d599fd0 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f3657d83740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a51d550170 con 0x55a51d56c7c0 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f3657d83740 10 client.0 _ll_register_callbacks cb 0x55a51d43e080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57d0f0 0x55a51d58e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57d0f0 0x55a51d58e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38380/0 (socket says 172.21.15.137:38380) 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.039+0000 7f364ed9d640 1 -- 172.21.15.137:0/3125661078 learned_addr learned my addr 172.21.15.137:0/3125661078 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f3647fff640 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d599fd0 0x55a51d5a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f364f59e640 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 0x55a51d57fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f364ed9d640 1 -- 172.21.15.137:0/3125661078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 msgr2=0x55a51d57fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f364ed9d640 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 0x55a51d57fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f364ed9d640 1 -- 172.21.15.137:0/3125661078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d599fd0 msgr2=0x55a51d5a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f364ed9d640 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d599fd0 0x55a51d5a7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f364ed9d640 1 -- 172.21.15.137:0/3125661078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a51d2f0f70 con 0x55a51d57d0f0 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f3647fff640 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d599fd0 0x55a51d5a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f364ed9d640 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57d0f0 0x55a51d58e2a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3640059330 tx=0x7f3640059630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7a937aeae752dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f362dffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f362dffb640 1 -- 172.21.15.137:0/3125661078 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640087020 con 0x55a51d57d0f0 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f362dffb640 1 -- 172.21.15.137:0/3125661078 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f364000ddc0 con 0x55a51d57d0f0 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f3657d83740 1 -- 172.21.15.137:0/3125661078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f364802f070 con 0x55a51d57d0f0 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f362dffb640 1 -- 172.21.15.137:0/3125661078 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3640058a80 con 0x55a51d57d0f0 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f3657d83740 10 client.5805 fetch_fsmap learned FSMap version 20 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f3657d83740 1 -- 172.21.15.137:0/3125661078 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55a51d188170 con 0x55a51d57d0f0 2024-04-26T22:00:24.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f362dffb640 1 -- 172.21.15.137:0/3125661078 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364802f070 con 0x55a51d57d0f0 2024-04-26T22:00:24.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.040+0000 7f362dffb640 1 -- 172.21.15.137:0/3125661078 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f3640058c20 con 0x55a51d57d0f0 2024-04-26T22:00:24.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.041+0000 7f3657d83740 10 client.5805 fetch_fsmap finished waiting for FSMap version 20 2024-04-26T22:00:24.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.041+0000 7f3657d83740 10 client.5805 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-26T22:00:24.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.041+0000 7f3657d83740 20 client.5805 populate_metadata read hostname 'smithi137' 2024-04-26T22:00:24.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.041+0000 7f3657d83740 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55a51d551210 0x55a51d551670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.041+0000 7f3657d83740 4 client.5805 mds_command: new command op to 5592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:00:24.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.041+0000 7f3657d83740 1 -- 172.21.15.137:0/3125661078 --> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a51d4c4710 con 0x55a51d551210 2024-04-26T22:00:24.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.041+0000 7f3647fff640 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55a51d551210 0x55a51d551670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.041+0000 7f362dffb640 10 client.5805 ms_handle_connect on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.041+0000 7f3647fff640 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55a51d551210 0x55a51d551670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb346a3f0f885423 server_cookie=740d16803e4e01ee in_seq=0 out_seq=0 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f362dffb640 1 -- 172.21.15.137:0/3125661078 <== mds.0 v2:172.21.15.137:6836/924509332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a51d4c4710 con 0x55a51d551210 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f362dffb640 10 client.5805 handle_command_reply: tid=0 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 client.5805 shutdown 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 -- 172.21.15.137:0/3125661078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57d0f0 msgr2=0x55a51d58e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57d0f0 0x55a51d58e2a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3640059330 tx=0x7f3640059630 comp rx=0 tx=0).stop 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 -- 172.21.15.137:0/3125661078 shutdown_connections 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55a51d551210 0x55a51d551670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 0x55a51d57fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d599fd0 0x55a51d5a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f362dffb640 0 client.5805 ms_handle_reset on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:24.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 --2- 172.21.15.137:0/3125661078 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d57d0f0 0x55a51d58e2a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 -- 172.21.15.137:0/3125661078 >> 172.21.15.137:0/3125661078 conn(0x55a51d57c9b0 msgr2=0x55a51d54c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 -- 172.21.15.137:0/3125661078 shutdown_connections 2024-04-26T22:00:24.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 1 -- 172.21.15.137:0/3125661078 wait complete. 2024-04-26T22:00:24.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.042+0000 7f3657d83740 20 client.5805 trim_cache size 0 max 16384 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.046+0000 7f2fc63e9640 1 Processor -- start 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.046+0000 7f2fc63e9640 1 -- start start 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fc63e9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fc015f5a0 0x7f2fc00d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fc63e9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2fc00b4160 0x7f2fc00d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fc63e9640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc00d5dc0 con 0x7f2fc00b4f00 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fc63e9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc00d3640 con 0x7f2fc00b4160 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fc63e9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc00d60a0 con 0x7f2fc015f5a0 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fbf7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2fc00b4160 0x7f2fc00d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fbf7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2fc00b4160 0x7f2fc00d3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38388/0 (socket says 172.21.15.137:38388) 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fc4986640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2fc00b4f00 0x7f2fc00b5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:35390/0 (socket says 172.21.15.137:35390) 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fbf7fe640 1 -- 172.21.15.137:0/1530307616 learned_addr learned my addr 172.21.15.137:0/1530307616 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.047+0000 7f2fbffff640 1 --2- 172.21.15.137:0/1530307616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fc015f5a0 0x7f2fc00d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.048+0000 7f2fbf7fe640 1 -- 172.21.15.137:0/1530307616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fc015f5a0 msgr2=0x7f2fc00d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.048+0000 7f2fbf7fe640 1 --2- 172.21.15.137:0/1530307616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fc015f5a0 0x7f2fc00d37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.048+0000 7f2fbf7fe640 1 -- 172.21.15.137:0/1530307616 >> v1:172.21.15.137:6789/0 conn(0x7f2fc00b4f00 legacy=0x7f2fc00b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.048+0000 7f2fbeffd640 1 -- 172.21.15.137:0/1530307616 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611697308 0 0) 0x7f2fc00d5dc0 con 0x7f2fc00b4f00 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.048+0000 7f2fbf7fe640 1 -- 172.21.15.137:0/1530307616 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc00d3080 con 0x7f2fc00b4160 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.048+0000 7f2fbf7fe640 1 --2- 172.21.15.137:0/1530307616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc00b4160 0x7f2fc00d3d20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009870 tx=0x7f2fb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812225b74d2ddbe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fbeffd640 1 -- 172.21.15.137:0/1530307616 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4037070 con 0x7f2fc00b4160 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fbeffd640 1 -- 172.21.15.137:0/1530307616 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb4032440 con 0x7f2fc00b4160 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fbeffd640 1 -- 172.21.15.137:0/1530307616 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4032810 con 0x7f2fc00b4160 2024-04-26T22:00:24.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fc63e9640 1 -- 172.21.15.137:0/1530307616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc00b4160 msgr2=0x7f2fc00d3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fc63e9640 1 --2- 172.21.15.137:0/1530307616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc00b4160 0x7f2fc00d3d20 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009870 tx=0x7f2fb402a270 comp rx=0 tx=0).stop 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fc63e9640 1 -- 172.21.15.137:0/1530307616 shutdown_connections 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fc63e9640 1 --2- 172.21.15.137:0/1530307616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc00b4160 0x7f2fc00d3d20 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fc63e9640 1 --2- 172.21.15.137:0/1530307616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fc015f5a0 0x7f2fc00d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fc63e9640 1 -- 172.21.15.137:0/1530307616 >> 172.21.15.137:0/1530307616 conn(0x7f2fc00d5200 msgr2=0x7f2fc00d5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fc63e9640 1 -- 172.21.15.137:0/1530307616 shutdown_connections 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.049+0000 7f2fc63e9640 1 -- 172.21.15.137:0/1530307616 wait complete. 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.050+0000 7f2fc63e9640 1 Processor -- start 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc63e9640 1 -- start start 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc63e9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fc00b4160 0x7f2fc00ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc63e9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fc00b4f00 0x7f2fc00b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc63e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc015f5a0 0x7f2fc00b8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc63e9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc00d2500 con 0x7f2fc015f5a0 2024-04-26T22:00:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc63e9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc00d3360 con 0x7f2fc00b4f00 2024-04-26T22:00:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc63e9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc015f980 con 0x7f2fc00b4160 2024-04-26T22:00:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc4986640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc015f5a0 0x7f2fc00b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc4986640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc015f5a0 0x7f2fc00b8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38398/0 (socket says 172.21.15.137:38398) 2024-04-26T22:00:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fc4986640 1 -- 172.21.15.137:0/1051381942 learned_addr learned my addr 172.21.15.137:0/1051381942 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fbf7fe640 1 --2- 172.21.15.137:0/1051381942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fc00b4f00 0x7f2fc00b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.051+0000 7f2fbffff640 1 --2- 172.21.15.137:0/1051381942 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fc00b4160 0x7f2fc00ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fc4986640 1 -- 172.21.15.137:0/1051381942 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fc00b4160 msgr2=0x7f2fc00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fc4986640 1 --2- 172.21.15.137:0/1051381942 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2fc00b4160 0x7f2fc00ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fc4986640 1 -- 172.21.15.137:0/1051381942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fc00b4f00 msgr2=0x7f2fc00b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fc4986640 1 --2- 172.21.15.137:0/1051381942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2fc00b4f00 0x7f2fc00b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fc4986640 1 -- 172.21.15.137:0/1051381942 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc00ba040 con 0x7f2fc015f5a0 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fc4986640 1 --2- 172.21.15.137:0/1051381942 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2fc015f5a0 0x7f2fc00b8320 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c7a0 tx=0x7f2fb800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fbcff9640 1 -- 172.21.15.137:0/1051381942 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8018070 con 0x7f2fc015f5a0 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fbcff9640 1 -- 172.21.15.137:0/1051381942 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb800a640 con 0x7f2fc015f5a0 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fbcff9640 1 -- 172.21.15.137:0/1051381942 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800aab0 con 0x7f2fc015f5a0 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fc63e9640 1 -- 172.21.15.137:0/1051381942 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc00ba320 con 0x7f2fc015f5a0 2024-04-26T22:00:24.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.052+0000 7f2fc63e9640 1 -- 172.21.15.137:0/1051381942 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc00ba8e0 con 0x7f2fc015f5a0 2024-04-26T22:00:24.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.053+0000 7f2fc63e9640 1 -- 172.21.15.137:0/1051381942 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f2fc006a290 con 0x7f2fc015f5a0 2024-04-26T22:00:24.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.054+0000 7f2fbcff9640 1 -- 172.21.15.137:0/1051381942 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fb801b070 con 0x7f2fc015f5a0 2024-04-26T22:00:24.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.054+0000 7f2fbcff9640 1 --2- 172.21.15.137:0/1051381942 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2fac06c8f0 0x7f2fac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.054+0000 7f2fbcff9640 1 -- 172.21.15.137:0/1051381942 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f2fb808b110 con 0x7f2fc015f5a0 2024-04-26T22:00:24.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.054+0000 7f2fbcff9640 1 -- 172.21.15.137:0/1051381942 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+503 (secure 0 0 0) 0x7f2fb808d790 con 0x7f2fc015f5a0 2024-04-26T22:00:24.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.054+0000 7f2fbffff640 1 --2- 172.21.15.137:0/1051381942 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2fac06c8f0 0x7f2fac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.054+0000 7f2fc63e9640 1 -- 172.21.15.137:0/1051381942 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f2fc00d0c60 con 0x7f2fc015f5a0 2024-04-26T22:00:24.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.055+0000 7f2fbffff640 1 --2- 172.21.15.137:0/1051381942 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2fac06c8f0 0x7f2fac06edb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0009aa0 tx=0x7f2fb0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.061+0000 7f3657d83740 1 Processor -- start 2024-04-26T22:00:24.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.061+0000 7f3657d83740 1 -- start start 2024-04-26T22:00:24.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f3657d83740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d56c7c0 0x55a51d58f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f3657d83740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d58e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f3657d83740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 0x55a51d58ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f3657d83740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3650201f70 con 0x55a51d56c7c0 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f3657d83740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3650200f50 con 0x55a51d57d0f0 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f3657d83740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f36500ba390 con 0x55a51d599fd0 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d56c7c0 0x55a51d58f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f364ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d56c7c0 0x55a51d58f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38412/0 (socket says 172.21.15.137:38412) 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f364ed9d640 1 -- 172.21.15.137:0/1175249729 learned_addr learned my addr 172.21.15.137:0/1175249729 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f3647fff640 1 --2- 172.21.15.137:0/1175249729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d58e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f364f59e640 1 --2- 172.21.15.137:0/1175249729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 0x55a51d58ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f364ed9d640 1 -- 172.21.15.137:0/1175249729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 msgr2=0x55a51d58ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f364ed9d640 1 --2- 172.21.15.137:0/1175249729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 0x55a51d58ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f364ed9d640 1 -- 172.21.15.137:0/1175249729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 msgr2=0x55a51d58e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f364ed9d640 1 --2- 172.21.15.137:0/1175249729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d58e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.062+0000 7f364ed9d640 1 -- 172.21.15.137:0/1175249729 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a51d54fe00 con 0x55a51d56c7c0 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f364ed9d640 1 --2- 172.21.15.137:0/1175249729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d56c7c0 0x55a51d58f5b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3640055fb0 tx=0x7f3640070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab48d086c5c3d743 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f362ffff640 1 -- 172.21.15.137:0/1175249729 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640087040 con 0x55a51d56c7c0 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f362ffff640 1 -- 172.21.15.137:0/1175249729 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400554e0 con 0x55a51d56c7c0 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f362ffff640 1 -- 172.21.15.137:0/1175249729 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364000de00 con 0x55a51d56c7c0 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f3657d83740 1 -- 172.21.15.137:0/1175249729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d56c7c0 msgr2=0x55a51d58f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f3657d83740 1 --2- 172.21.15.137:0/1175249729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d56c7c0 0x55a51d58f5b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3640055fb0 tx=0x7f3640070000 comp rx=0 tx=0).stop 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f3657d83740 1 -- 172.21.15.137:0/1175249729 shutdown_connections 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f3657d83740 1 --2- 172.21.15.137:0/1175249729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d599fd0 0x55a51d58ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f3657d83740 1 --2- 172.21.15.137:0/1175249729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d58e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f3657d83740 1 --2- 172.21.15.137:0/1175249729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d56c7c0 0x55a51d58f5b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f3657d83740 1 -- 172.21.15.137:0/1175249729 >> 172.21.15.137:0/1175249729 conn(0x55a51d57c9b0 msgr2=0x55a51d550380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f3657d83740 1 -- 172.21.15.137:0/1175249729 shutdown_connections 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.063+0000 7f3657d83740 1 -- 172.21.15.137:0/1175249729 wait complete. 2024-04-26T22:00:24.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.064+0000 7f3657d83740 1 -- start start 2024-04-26T22:00:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.064+0000 7f3657d83740 1 Processor -- start 2024-04-26T22:00:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f3657d83740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 0x55a51d5a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f3657d83740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d57dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f3657d83740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d599fd0 0x55a51d611d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f3657d83740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a51d4541f0 con 0x55a51d599fd0 2024-04-26T22:00:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f3657d83740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f36500c94c0 con 0x55a51d57d0f0 2024-04-26T22:00:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f3657d83740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a51d5996a0 con 0x55a51d56c7c0 2024-04-26T22:00:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f3657d83740 10 client.0 _ll_register_callbacks cb 0x7f3640059220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:00:24.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364f59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d599fd0 0x55a51d611d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364f59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d599fd0 0x55a51d611d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38418/0 (socket says 172.21.15.137:38418) 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f3647fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d57dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364f59e640 1 -- 172.21.15.137:0/826921144 learned_addr learned my addr 172.21.15.137:0/826921144 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364ed9d640 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 0x55a51d5a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364f59e640 1 -- 172.21.15.137:0/826921144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 msgr2=0x55a51d5a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364f59e640 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 0x55a51d5a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364f59e640 1 -- 172.21.15.137:0/826921144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 msgr2=0x55a51d57dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364f59e640 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d57dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364f59e640 1 -- 172.21.15.137:0/826921144 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a51d5b1230 con 0x55a51d599fd0 2024-04-26T22:00:24.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f364f59e640 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d599fd0 0x55a51d611d70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3648001cf0 tx=0x7f364802d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38dbc7cce6fed09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.065+0000 7f362dffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:00:24.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f362dffb640 1 -- 172.21.15.137:0/826921144 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648050060 con 0x55a51d599fd0 2024-04-26T22:00:24.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f362dffb640 1 -- 172.21.15.137:0/826921144 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f364802bc70 con 0x55a51d599fd0 2024-04-26T22:00:24.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f3657d83740 1 -- 172.21.15.137:0/826921144 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36400554e0 con 0x55a51d599fd0 2024-04-26T22:00:24.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f362dffb640 1 -- 172.21.15.137:0/826921144 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f3648034470 con 0x55a51d599fd0 2024-04-26T22:00:24.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f3657d83740 10 client.5820 fetch_fsmap learned FSMap version 20 2024-04-26T22:00:24.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f3657d83740 1 -- 172.21.15.137:0/826921144 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55a51d550460 con 0x55a51d599fd0 2024-04-26T22:00:24.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f362dffb640 1 -- 172.21.15.137:0/826921144 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400554e0 con 0x55a51d599fd0 2024-04-26T22:00:24.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f362dffb640 1 -- 172.21.15.137:0/826921144 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f3648034610 con 0x55a51d599fd0 2024-04-26T22:00:24.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f3657d83740 10 client.5820 fetch_fsmap finished waiting for FSMap version 20 2024-04-26T22:00:24.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f3657d83740 10 client.5820 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-26T22:00:24.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f3657d83740 20 client.5820 populate_metadata read hostname 'smithi137' 2024-04-26T22:00:24.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f3657d83740 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55a51d60b830 0x55a51d6122b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f3657d83740 4 client.5820 mds_command: new command op to 5592 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-26T22:00:24.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f3657d83740 1 -- 172.21.15.137:0/826921144 --> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x55a51d4be580 con 0x55a51d60b830 2024-04-26T22:00:24.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.066+0000 7f364ed9d640 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55a51d60b830 0x55a51d6122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.067+0000 7f364ed9d640 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55a51d60b830 0x55a51d6122b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4138f6fd80dc6747 server_cookie=398d715903e40d0f in_seq=0 out_seq=0 2024-04-26T22:00:24.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.067+0000 7f362dffb640 10 client.5820 ms_handle_connect on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:24.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.067+0000 7f362dffb640 1 -- 172.21.15.137:0/826921144 <== mds.0 v2:172.21.15.137:6836/924509332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a51d4be580 con 0x55a51d60b830 2024-04-26T22:00:24.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.067+0000 7f362dffb640 10 client.5820 handle_command_reply: tid=0 2024-04-26T22:00:24.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.067+0000 7f3657d83740 1 client.5820 shutdown 2024-04-26T22:00:24.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.067+0000 7f3657d83740 1 -- 172.21.15.137:0/826921144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d599fd0 msgr2=0x55a51d611d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.067+0000 7f3657d83740 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d599fd0 0x55a51d611d70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3648001cf0 tx=0x7f364802d070 comp rx=0 tx=0).stop 2024-04-26T22:00:24.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.067+0000 7f3657d83740 1 -- 172.21.15.137:0/826921144 shutdown_connections 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.067+0000 7f3657d83740 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55a51d60b830 0x55a51d6122b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.068+0000 7f362dffb640 0 client.5820 ms_handle_reset on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.068+0000 7f3657d83740 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a51d599fd0 0x55a51d611d70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.068+0000 7f3657d83740 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a51d57d0f0 0x55a51d57dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.068+0000 7f3657d83740 1 --2- 172.21.15.137:0/826921144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a51d56c7c0 0x55a51d5a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.068+0000 7f3657d83740 1 -- 172.21.15.137:0/826921144 >> 172.21.15.137:0/826921144 conn(0x55a51d57c9b0 msgr2=0x55a51d58f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.068+0000 7f3657d83740 1 -- 172.21.15.137:0/826921144 shutdown_connections 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.068+0000 7f3657d83740 1 -- 172.21.15.137:0/826921144 wait complete. 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.068+0000 7f3657d83740 20 client.5820 trim_cache size 0 max 16384 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:00:24.075 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:00:24.076 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "e3b6687c-d983-400f-9285-327b2657cfc9", 2024-04-26T22:00:24.076 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:00:24.076 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:00:24.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.068+0000 7f3655074640 1 -- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f363006c8f0 msgr2=0x7f363006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f363006c8f0 0x7f363006edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36500b4f30 tx=0x7f3638008040 comp rx=0 tx=0).stop 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 -- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 msgr2=0x7f36500b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f36500b3790 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f364000f880 tx=0x7f364000fd40 comp rx=0 tx=0).stop 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 -- 172.21.15.137:0/3470376972 shutdown_connections 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f363006c8f0 0x7f363006edb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f365006dcf0 0x7f36500c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3650159ed0 0x7f365006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 --2- 172.21.15.137:0/3470376972 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f363c004d40 0x7f36500b3790 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 -- 172.21.15.137:0/3470376972 >> 172.21.15.137:0/3470376972 conn(0x7f365009e530 msgr2=0x7f365015d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 -- 172.21.15.137:0/3470376972 shutdown_connections 2024-04-26T22:00:24.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.069+0000 7f3655074640 1 -- 172.21.15.137:0/3470376972 wait complete. 2024-04-26T22:00:24.077 INFO:tasks.ceph.mds.c.smithi137.stderr:2024-04-26T22:00:24.070+0000 7f1361232640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={4988=0-4194304@1} caps={4988=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=4988 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55a4e4520680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T22:00:24.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:24.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-26T22:00:24.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.179+0000 7fc9310fc640 1 Processor -- start 2024-04-26T22:00:24.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.179+0000 7fc9310fc640 1 -- start start 2024-04-26T22:00:24.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.180+0000 7fc9310fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc92c0b23e0 0x7fc92c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.180+0000 7fc9310fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc92c09ba40 0x7fc92c09bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.180+0000 7fc9310fc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92c0b27c0 con 0x7fc92c160500 2024-04-26T22:00:24.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.180+0000 7fc9310fc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc92c070d70 con 0x7fc92c09ba40 2024-04-26T22:00:24.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.180+0000 7fc9310fc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc92c071050 con 0x7fc92c0b23e0 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.180+0000 7fc92b59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc92c09ba40 0x7fc92c09bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.180+0000 7fc92b59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc92c09ba40 0x7fc92c09bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38430/0 (socket says 172.21.15.137:38430) 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.180+0000 7fc92b59e640 1 -- 172.21.15.137:0/1332420165 learned_addr learned my addr 172.21.15.137:0/1332420165 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.180+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/1332420165 >> v2:172.21.15.170:3300/0 conn(0x7fc92c0b23e0 0x7fc92c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.181+0000 7fc92b59e640 1 -- 172.21.15.137:0/1332420165 >> v2:172.21.15.170:3300/0 conn(0x7fc92c0b23e0 msgr2=0x7fc92c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.181+0000 7fc92b59e640 1 --2- 172.21.15.137:0/1332420165 >> v2:172.21.15.170:3300/0 conn(0x7fc92c0b23e0 0x7fc92c06d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.181+0000 7fc92b59e640 1 -- 172.21.15.137:0/1332420165 >> v1:172.21.15.170:6789/0 conn(0x7fc92c160500 legacy=0x7fc92c070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.181+0000 7fc92b59e640 1 -- 172.21.15.137:0/1332420165 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c071330 con 0x7fc92c09ba40 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.181+0000 7fc92b59e640 1 --2- 172.21.15.137:0/1332420165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c09ba40 0x7fc92c09bef0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc92c06d080 tx=0x7fc92402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a3b9c1676317f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.181+0000 7fc929d9b640 1 -- 172.21.15.137:0/1332420165 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924036070 con 0x7fc92c09ba40 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.181+0000 7fc929d9b640 1 -- 172.21.15.137:0/1332420165 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924031600 con 0x7fc92c09ba40 2024-04-26T22:00:24.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.181+0000 7fc929d9b640 1 -- 172.21.15.137:0/1332420165 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9240319d0 con 0x7fc92c09ba40 2024-04-26T22:00:24.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.182+0000 7fc9310fc640 1 -- 172.21.15.137:0/1332420165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c09ba40 msgr2=0x7fc92c09bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.182+0000 7fc9310fc640 1 --2- 172.21.15.137:0/1332420165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c09ba40 0x7fc92c09bef0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc92c06d080 tx=0x7fc92402a730 comp rx=0 tx=0).stop 2024-04-26T22:00:24.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.182+0000 7fc9310fc640 1 -- 172.21.15.137:0/1332420165 shutdown_connections 2024-04-26T22:00:24.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.182+0000 7fc9310fc640 1 --2- 172.21.15.137:0/1332420165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c09ba40 0x7fc92c09bef0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.182+0000 7fc9310fc640 1 --2- 172.21.15.137:0/1332420165 >> v2:172.21.15.170:3300/0 conn(0x7fc92c0b23e0 0x7fc92c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.182+0000 7fc9310fc640 1 -- 172.21.15.137:0/1332420165 >> 172.21.15.137:0/1332420165 conn(0x7fc92c0b4a70 msgr2=0x7fc92c0b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.182+0000 7fc9310fc640 1 -- 172.21.15.137:0/1332420165 shutdown_connections 2024-04-26T22:00:24.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.182+0000 7fc9310fc640 1 -- 172.21.15.137:0/1332420165 wait complete. 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.184+0000 7fc9310fc640 1 Processor -- start 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.184+0000 7fc9310fc640 1 -- start start 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.185+0000 7fc9310fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc92c09ba40 0x7fc92c0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.185+0000 7fc9310fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc92c0b23e0 0x7fc92c152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.185+0000 7fc9310fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c160500 0x7fc92c0cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.185+0000 7fc9310fc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c15ebf0 con 0x7fc92c160500 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.185+0000 7fc9310fc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c071610 con 0x7fc92c09ba40 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.185+0000 7fc9310fc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c15ed70 con 0x7fc92c0b23e0 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.185+0000 7fc92b59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c160500 0x7fc92c0cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.185+0000 7fc92b59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c160500 0x7fc92c0cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38444/0 (socket says 172.21.15.137:38444) 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc92b59e640 1 -- 172.21.15.137:0/1395748468 learned_addr learned my addr 172.21.15.137:0/1395748468 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc92c09ba40 0x7fc92c0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc92a59c640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc92c0b23e0 0x7fc92c152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc92b59e640 1 -- 172.21.15.137:0/1395748468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc92c0b23e0 msgr2=0x7fc92c152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc92b59e640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc92c0b23e0 0x7fc92c152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc92b59e640 1 -- 172.21.15.137:0/1395748468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc92c09ba40 msgr2=0x7fc92c0ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc92b59e640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc92c09ba40 0x7fc92c0ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc92b59e640 1 -- 172.21.15.137:0/1395748468 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c0cb0d0 con 0x7fc92c160500 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc92b59e640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c160500 0x7fc92c0cff30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc924034040 tx=0x7fc924004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc9237fe640 1 -- 172.21.15.137:0/1395748468 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924036050 con 0x7fc92c160500 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc9237fe640 1 -- 172.21.15.137:0/1395748468 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924042070 con 0x7fc92c160500 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc9237fe640 1 -- 172.21.15.137:0/1395748468 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924009510 con 0x7fc92c160500 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc9310fc640 1 -- 172.21.15.137:0/1395748468 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92c0cd8f0 con 0x7fc92c160500 2024-04-26T22:00:24.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.186+0000 7fc9310fc640 1 -- 172.21.15.137:0/1395748468 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92c0cdeb0 con 0x7fc92c160500 2024-04-26T22:00:24.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.188+0000 7fc9237fe640 1 -- 172.21.15.137:0/1395748468 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc924007bf0 con 0x7fc92c160500 2024-04-26T22:00:24.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.188+0000 7fc9237fe640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc90c06c8f0 0x7fc90c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.188+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc90c06c8f0 0x7fc90c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.188+0000 7fc9237fe640 1 -- 172.21.15.137:0/1395748468 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fc9240ac850 con 0x7fc92c160500 2024-04-26T22:00:24.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.189+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc90c06c8f0 0x7fc90c06edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc914009b40 tx=0x7fc914009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.189+0000 7fc933e15740 1 Processor -- start 2024-04-26T22:00:24.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.189+0000 7fc933e15740 1 -- start start 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc933e15740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 0x55ab6b78f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc933e15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b789e10 0x55ab6b78db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc933e15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b78e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc933e15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ab6b6f3d80 con 0x55ab6b78e0c0 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc933e15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ab6b6ad8b0 con 0x55ab6b789e10 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc933e15740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ab6b6efd40 con 0x55ab6b78ef80 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc92b59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b78e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc92b59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b78e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38458/0 (socket says 172.21.15.137:38458) 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc92b59e640 1 -- 172.21.15.137:0/1470572289 learned_addr learned my addr 172.21.15.137:0/1470572289 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/1470572289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 0x55ab6b78f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.190+0000 7fc92a59c640 1 --2- 172.21.15.137:0/1470572289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b789e10 0x55ab6b78db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc92b59e640 1 -- 172.21.15.137:0/1470572289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 msgr2=0x55ab6b78f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc92b59e640 1 --2- 172.21.15.137:0/1470572289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 0x55ab6b78f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc92b59e640 1 -- 172.21.15.137:0/1470572289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b789e10 msgr2=0x55ab6b78db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc92b59e640 1 --2- 172.21.15.137:0/1470572289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b789e10 0x55ab6b78db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc92b59e640 1 -- 172.21.15.137:0/1470572289 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6b67ea40 con 0x55ab6b78e0c0 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc92b59e640 1 --2- 172.21.15.137:0/1470572289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b78e500 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc92402ad20 tx=0x7fc9240768b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbcdb2f9cc0f1c38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc920ff9640 1 -- 172.21.15.137:0/1470572289 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924031600 con 0x55ab6b78e0c0 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc920ff9640 1 -- 172.21.15.137:0/1470572289 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924037040 con 0x55ab6b78e0c0 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc920ff9640 1 -- 172.21.15.137:0/1470572289 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92407a550 con 0x55ab6b78e0c0 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc933e15740 1 -- 172.21.15.137:0/1470572289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 msgr2=0x55ab6b78e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.191+0000 7fc933e15740 1 --2- 172.21.15.137:0/1470572289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b78e500 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc92402ad20 tx=0x7fc9240768b0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.192+0000 7fc933e15740 1 -- 172.21.15.137:0/1470572289 shutdown_connections 2024-04-26T22:00:24.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.192+0000 7fc933e15740 1 --2- 172.21.15.137:0/1470572289 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b78e500 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.192+0000 7fc933e15740 1 --2- 172.21.15.137:0/1470572289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b789e10 0x55ab6b78db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.192+0000 7fc933e15740 1 --2- 172.21.15.137:0/1470572289 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 0x55ab6b78f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.192+0000 7fc933e15740 1 -- 172.21.15.137:0/1470572289 >> 172.21.15.137:0/1470572289 conn(0x55ab6b78c080 msgr2=0x55ab6b7d4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.192+0000 7fc933e15740 1 -- 172.21.15.137:0/1470572289 shutdown_connections 2024-04-26T22:00:24.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.192+0000 7fc933e15740 1 -- 172.21.15.137:0/1470572289 wait complete. 2024-04-26T22:00:24.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.192+0000 7fc933e15740 1 -- start start 2024-04-26T22:00:24.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.192+0000 7fc933e15740 1 Processor -- start 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc933e15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc933e15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78ef80 0x55ab6b7da570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc933e15740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b7daab0 0x55ab6b7d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc933e15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ab6b6f3d80 con 0x55ab6b78e0c0 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc933e15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ab6b67ad10 con 0x55ab6b78ef80 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc933e15740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ab6b7bab10 con 0x55ab6b7daab0 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc933e15740 10 client.0 _ll_register_callbacks cb 0x55ab6b6a7210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38462/0 (socket says 172.21.15.137:38462) 2024-04-26T22:00:24.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92ad9d640 1 -- 172.21.15.137:0/3666400093 learned_addr learned my addr 172.21.15.137:0/3666400093 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92a59c640 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78ef80 0x55ab6b7da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92b59e640 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b7daab0 0x55ab6b7d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92ad9d640 1 -- 172.21.15.137:0/3666400093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b7daab0 msgr2=0x55ab6b7d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b7daab0 0x55ab6b7d3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92ad9d640 1 -- 172.21.15.137:0/3666400093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78ef80 msgr2=0x55ab6b7da570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78ef80 0x55ab6b7da570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92ad9d640 1 -- 172.21.15.137:0/3666400093 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab6b4cf7d0 con 0x55ab6b78e0c0 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.193+0000 7fc92b59e640 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b7daab0 0x55ab6b7d3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d7bb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc914003920 tx=0x7fc9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a6f4213b327ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc909ffb640 1 -- 172.21.15.137:0/3666400093 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc914027070 con 0x55ab6b78e0c0 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc909ffb640 1 -- 172.21.15.137:0/3666400093 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fc914014650 con 0x55ab6b78e0c0 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc933e15740 1 -- 172.21.15.137:0/3666400093 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc924037040 con 0x55ab6b78e0c0 2024-04-26T22:00:24.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc909ffb640 1 -- 172.21.15.137:0/3666400093 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc914032050 con 0x55ab6b78e0c0 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc933e15740 10 client.5832 fetch_fsmap learned FSMap version 20 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc933e15740 1 -- 172.21.15.137:0/3666400093 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55ab6b4053f0 con 0x55ab6b78e0c0 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc909ffb640 1 -- 172.21.15.137:0/3666400093 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc924037040 con 0x55ab6b78e0c0 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc909ffb640 1 -- 172.21.15.137:0/3666400093 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc914035020 con 0x55ab6b78e0c0 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc933e15740 10 client.5832 fetch_fsmap finished waiting for FSMap version 20 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc933e15740 10 client.5832 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc933e15740 20 client.5832 populate_metadata read hostname 'smithi137' 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc933e15740 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55ab6b7d8660 0x55ab6b7d8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc933e15740 4 client.5832 mds_command: new command op to 5592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc933e15740 1 -- 172.21.15.137:0/3666400093 --> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab6b701990 con 0x55ab6b7d8660 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.194+0000 7fc92a59c640 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55ab6b7d8660 0x55ab6b7d8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc909ffb640 10 client.5832 ms_handle_connect on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc92a59c640 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55ab6b7d8660 0x55ab6b7d8a60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f76f041f5539b01 server_cookie=83e038395b97be4a in_seq=0 out_seq=0 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc909ffb640 1 -- 172.21.15.137:0/3666400093 <== mds.0 v2:172.21.15.137:6836/924509332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ab6b701990 con 0x55ab6b7d8660 2024-04-26T22:00:24.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc909ffb640 10 client.5832 handle_command_reply: tid=0 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 client.5832 shutdown 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 -- 172.21.15.137:0/3666400093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 msgr2=0x55ab6b7d7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d7bb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc914003920 tx=0x7fc9140046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 -- 172.21.15.137:0/3666400093 shutdown_connections 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55ab6b7d8660 0x55ab6b7d8a60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b7daab0 0x55ab6b7d3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78ef80 0x55ab6b7da570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc909ffb640 0 client.5832 ms_handle_reset on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 --2- 172.21.15.137:0/3666400093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d7bb0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 -- 172.21.15.137:0/3666400093 >> 172.21.15.137:0/3666400093 conn(0x55ab6b789e10 msgr2=0x55ab6b789550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 -- 172.21.15.137:0/3666400093 shutdown_connections 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.195+0000 7fc933e15740 1 -- 172.21.15.137:0/3666400093 wait complete. 2024-04-26T22:00:24.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.196+0000 7fc933e15740 20 client.5832 trim_cache size 0 max 16384 2024-04-26T22:00:24.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.229+0000 7fc933e15740 1 Processor -- start 2024-04-26T22:00:24.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.229+0000 7fc933e15740 1 -- start start 2024-04-26T22:00:24.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.229+0000 7fc933e15740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78e0c0 0x55ab6b78cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.229+0000 7fc933e15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78ef80 0x55ab6b7d45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.229+0000 7fc933e15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b7daab0 0x55ab6b7d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.229+0000 7fc933e15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c201a90 con 0x55ab6b78ef80 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.229+0000 7fc933e15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c200b30 con 0x55ab6b7daab0 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.229+0000 7fc933e15740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c1616e0 con 0x55ab6b78e0c0 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78ef80 0x55ab6b7d45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78ef80 0x55ab6b7d45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38472/0 (socket says 172.21.15.137:38472) 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92a59c640 1 -- 172.21.15.137:0/3269162067 learned_addr learned my addr 172.21.15.137:0/3269162067 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78e0c0 0x55ab6b78cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92b59e640 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b7daab0 0x55ab6b7d4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92a59c640 1 -- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78e0c0 msgr2=0x55ab6b78cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92a59c640 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78e0c0 0x55ab6b78cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92a59c640 1 -- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b7daab0 msgr2=0x55ab6b7d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92a59c640 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b7daab0 0x55ab6b7d4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92a59c640 1 -- 172.21.15.137:0/3269162067 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab6b3c50f0 con 0x55ab6b78ef80 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78e0c0 0x55ab6b78cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:24.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92b59e640 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b7daab0 0x55ab6b7d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:24.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc92a59c640 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78ef80 0x55ab6b7d45b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0018b0 tx=0x7fc91c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4d6f24a242d2e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc90bfff640 1 -- 172.21.15.137:0/3269162067 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c024070 con 0x55ab6b78ef80 2024-04-26T22:00:24.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc90bfff640 1 -- 172.21.15.137:0/3269162067 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c0050d0 con 0x55ab6b78ef80 2024-04-26T22:00:24.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.230+0000 7fc90bfff640 1 -- 172.21.15.137:0/3269162067 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c01ee60 con 0x55ab6b78ef80 2024-04-26T22:00:24.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 -- 172.21.15.137:0/3269162067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78ef80 msgr2=0x55ab6b7d45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78ef80 0x55ab6b7d45b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0018b0 tx=0x7fc91c009040 comp rx=0 tx=0).stop 2024-04-26T22:00:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 -- 172.21.15.137:0/3269162067 shutdown_connections 2024-04-26T22:00:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b78ef80 0x55ab6b7d45b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b7daab0 0x55ab6b7d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 --2- 172.21.15.137:0/3269162067 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78e0c0 0x55ab6b78cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 -- 172.21.15.137:0/3269162067 >> 172.21.15.137:0/3269162067 conn(0x55ab6b789e10 msgr2=0x55ab6b785580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 -- 172.21.15.137:0/3269162067 shutdown_connections 2024-04-26T22:00:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 -- 172.21.15.137:0/3269162067 wait complete. 2024-04-26T22:00:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 -- start start 2024-04-26T22:00:24.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.231+0000 7fc933e15740 1 Processor -- start 2024-04-26T22:00:24.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc933e15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc933e15740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 0x55ab6b7ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc933e15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b7daab0 0x55ab6b7ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc933e15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c0cf370 con 0x55ab6b7daab0 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc933e15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ab6b78e4a0 con 0x55ab6b78e0c0 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc933e15740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ab6b84f1d0 con 0x55ab6b78ef80 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc933e15740 10 client.0 _ll_register_callbacks cb 0x7fc914011bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc92b59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b7daab0 0x55ab6b7ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc92b59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b7daab0 0x55ab6b7ab6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38480/0 (socket says 172.21.15.137:38480) 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc92b59e640 1 -- 172.21.15.137:0/2930974368 learned_addr learned my addr 172.21.15.137:0/2930974368 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.232+0000 7fc92a59c640 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 0x55ab6b7ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc92b59e640 1 -- 172.21.15.137:0/2930974368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 msgr2=0x55ab6b7ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc92b59e640 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 0x55ab6b7ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc92b59e640 1 -- 172.21.15.137:0/2930974368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78e0c0 msgr2=0x55ab6b7d4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc92b59e640 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc92b59e640 1 -- 172.21.15.137:0/2930974368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab6b6b44b0 con 0x55ab6b7daab0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc92b59e640 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b7daab0 0x55ab6b7ab6e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc924082b50 tx=0x7fc924009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb5136e294aa199 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc909ffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc909ffb640 1 -- 172.21.15.137:0/2930974368 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92409e060 con 0x55ab6b7daab0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc909ffb640 1 -- 172.21.15.137:0/2930974368 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fc924079ba0 con 0x55ab6b7daab0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc933e15740 1 -- 172.21.15.137:0/2930974368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc91c0050d0 con 0x55ab6b7daab0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc909ffb640 1 -- 172.21.15.137:0/2930974368 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc9240a4050 con 0x55ab6b7daab0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc933e15740 10 client.5838 fetch_fsmap learned FSMap version 20 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc933e15740 1 -- 172.21.15.137:0/2930974368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55ab6b7d5250 con 0x55ab6b7daab0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc909ffb640 1 -- 172.21.15.137:0/2930974368 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c0050d0 con 0x55ab6b7daab0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc909ffb640 1 -- 172.21.15.137:0/2930974368 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc9240a41f0 con 0x55ab6b7daab0 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc933e15740 10 client.5838 fetch_fsmap finished waiting for FSMap version 20 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc933e15740 10 client.5838 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc933e15740 20 client.5838 populate_metadata read hostname 'smithi137' 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc933e15740 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55ab6b7d5cb0 0x55ab6b84e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:24.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc933e15740 4 client.5838 mds_command: new command op to 5592 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc933e15740 1 -- 172.21.15.137:0/2930974368 --> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ab6b6fb800 con 0x55ab6b7d5cb0 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.233+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55ab6b7d5cb0 0x55ab6b84e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc909ffb640 10 client.5838 ms_handle_connect on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc92ad9d640 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55ab6b7d5cb0 0x55ab6b84e2b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d935f9b2e8643609 server_cookie=75bd38185c688199 in_seq=0 out_seq=0 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc909ffb640 1 -- 172.21.15.137:0/2930974368 <== mds.0 v2:172.21.15.137:6836/924509332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55ab6b6fb800 con 0x55ab6b7d5cb0 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc909ffb640 10 client.5838 handle_command_reply: tid=0 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 client.5838 shutdown 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 -- 172.21.15.137:0/2930974368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b7daab0 msgr2=0x55ab6b7ab6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b7daab0 0x55ab6b7ab6e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc924082b50 tx=0x7fc924009810 comp rx=0 tx=0).stop 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 -- 172.21.15.137:0/2930974368 shutdown_connections 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x55ab6b7d5cb0 0x55ab6b84e2b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc909ffb640 0 client.5838 ms_handle_reset on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ab6b7daab0 0x55ab6b7ab6e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ab6b78ef80 0x55ab6b7ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 --2- 172.21.15.137:0/2930974368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab6b78e0c0 0x55ab6b7d4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 -- 172.21.15.137:0/2930974368 >> 172.21.15.137:0/2930974368 conn(0x55ab6b789e10 msgr2=0x55ab6b7ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 -- 172.21.15.137:0/2930974368 shutdown_connections 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 1 -- 172.21.15.137:0/2930974368 wait complete. 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.234+0000 7fc933e15740 20 client.5838 trim_cache size 0 max 16384 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "e3b6687c-d983-400f-9285-327b2657cfc9": { 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-04-26T22:00:24.242 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "e3b6687c-d983-400f-9285-327b2657cfc9", 2024-04-26T22:00:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,repair" 2024-04-26T22:00:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:24.243 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:24.243 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:00:24.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 -- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc90c06c8f0 msgr2=0x7fc90c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc90c06c8f0 0x7fc90c06edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc914009b40 tx=0x7fc914009190 comp rx=0 tx=0).stop 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 -- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c160500 msgr2=0x7fc92c0cff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c160500 0x7fc92c0cff30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc924034040 tx=0x7fc924004a40 comp rx=0 tx=0).stop 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 -- 172.21.15.137:0/1395748468 shutdown_connections 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc90c06c8f0 0x7fc90c06edb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc92c160500 0x7fc92c0cff30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc92c0b23e0 0x7fc92c152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 --2- 172.21.15.137:0/1395748468 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc92c09ba40 0x7fc92c0ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 -- 172.21.15.137:0/1395748468 >> 172.21.15.137:0/1395748468 conn(0x7fc92c0b4a70 msgr2=0x7fc92c06d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 -- 172.21.15.137:0/1395748468 shutdown_connections 2024-04-26T22:00:24.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.235+0000 7fc9310fc640 1 -- 172.21.15.137:0/1395748468 wait complete. 2024-04-26T22:00:24.246 INFO:tasks.cephfs.filesystem:scrub status for tag:e3b6687c-d983-400f-9285-327b2657cfc9 - {'path': '/', 'tag': 'e3b6687c-d983-400f-9285-327b2657cfc9', 'options': 'recursive,repair'} 2024-04-26T22:00:24.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:24.989+0000 7f2fbcff9640 1 -- 172.21.15.137:0/1051381942 <== mon.0 v2:172.21.15.137:3300/0 7 ==== log(6 entries from seq 1 at 2024-04-26T22:00:24.068169+0000) ==== 1078+0+0 (secure 0 0 0) 0x7f2fb8089710 con 0x7f2fc015f5a0 2024-04-26T22:00:24.991 INFO:teuthology.orchestra.run.smithi137.stdout: cluster: 2024-04-26T22:00:24.991 INFO:teuthology.orchestra.run.smithi137.stdout: id: 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:00:24.991 INFO:teuthology.orchestra.run.smithi137.stdout: health: HEALTH_OK 2024-04-26T22:00:24.991 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:24.991 INFO:teuthology.orchestra.run.smithi137.stdout: services: 2024-04-26T22:00:24.992 INFO:teuthology.orchestra.run.smithi137.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-26T22:00:24.992 INFO:teuthology.orchestra.run.smithi137.stdout: mgr: y(active, since 2m), standbys: x 2024-04-26T22:00:24.992 INFO:teuthology.orchestra.run.smithi137.stdout: mds: 1/1 daemons up, 3 standby 2024-04-26T22:00:24.992 INFO:teuthology.orchestra.run.smithi137.stdout: osd: 8 osds: 8 up (since 116s), 8 in (since 2m) 2024-04-26T22:00:24.992 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:24.993 INFO:teuthology.orchestra.run.smithi137.stdout: data: 2024-04-26T22:00:24.993 INFO:teuthology.orchestra.run.smithi137.stdout: volumes: 1/1 healthy 2024-04-26T22:00:24.993 INFO:teuthology.orchestra.run.smithi137.stdout: pools: 3 pools, 97 pgs 2024-04-26T22:00:24.993 INFO:teuthology.orchestra.run.smithi137.stdout: objects: 24 objects, 579 KiB 2024-04-26T22:00:24.993 INFO:teuthology.orchestra.run.smithi137.stdout: usage: 233 MiB used, 720 GiB / 720 GiB avail 2024-04-26T22:00:24.993 INFO:teuthology.orchestra.run.smithi137.stdout: pgs: 97 active+clean 2024-04-26T22:00:24.994 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:24.994 INFO:teuthology.orchestra.run.smithi137.stdout: io: 2024-04-26T22:00:24.994 INFO:teuthology.orchestra.run.smithi137.stdout: client: 1.6 KiB/s wr, 0 op/s rd, 5 op/s wr 2024-04-26T22:00:24.994 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:24.994 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:24.995 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:00:24.068169+0000 mds.c [INF] scrub queued for path: / 2024-04-26T22:00:24.995 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:00:24.068175+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-26T22:00:24.995 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:00:24.068182+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-26T22:00:24.995 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:00:24.071519+0000 mds.c [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-04-26T22:00:24.995 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:00:24.071531+0000 mds.c [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-04-26T22:00:24.995 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:00:24.074453+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-26T22:00:28.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:28.997+0000 7f2fbcff9640 1 -- 172.21.15.137:0/1051381942 <== mon.0 v2:172.21.15.137:3300/0 8 ==== log(1 entries from seq 7 at 2024-04-26T22:00:27.812506+0000) ==== 189+0+0 (secure 0 0 0) 0x7f2fb8056f50 con 0x7f2fc015f5a0 2024-04-26T22:00:28.999 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:00:27.812506+0000 mds.c [INF] scrub summary: idle 2024-04-26T22:00:42.967 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:00:42.973 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:00:54.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:54.247 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-26T22:00:54.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.358+0000 7ff926ccc640 1 Processor -- start 2024-04-26T22:00:54.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.358+0000 7ff926ccc640 1 -- start start 2024-04-26T22:00:54.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff926ccc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff9200d0300 0x7ff9200b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff926ccc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff9200b3e50 0x7ff9200720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff926ccc640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9200b46a0 con 0x7ff92006f340 2024-04-26T22:00:54.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff926ccc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff9200b5db0 con 0x7ff9200b3e50 2024-04-26T22:00:54.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff926ccc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff9200b6090 con 0x7ff9200d0300 2024-04-26T22:00:54.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff924a68640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff92006f340 0x7ff92006f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:59454/0 (socket says 172.21.15.137:59454) 2024-04-26T22:00:54.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff925269640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff9200b3e50 0x7ff9200720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff924a68640 1 -- 172.21.15.137:0/3662199984 learned_addr learned my addr 172.21.15.137:0/3662199984 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:54.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff925269640 1 -- 172.21.15.137:0/3662199984 >> v2:172.21.15.170:3300/0 conn(0x7ff9200d0300 msgr2=0x7ff9200b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff91ffff640 1 --2- 172.21.15.137:0/3662199984 >> v2:172.21.15.170:3300/0 conn(0x7ff9200d0300 0x7ff9200b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.359+0000 7ff925269640 1 --2- 172.21.15.137:0/3662199984 >> v2:172.21.15.170:3300/0 conn(0x7ff9200d0300 0x7ff9200b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.360+0000 7ff925269640 1 -- 172.21.15.137:0/3662199984 >> v1:172.21.15.137:6789/0 conn(0x7ff92006f340 legacy=0x7ff92006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.360+0000 7ff91f7fe640 1 -- 172.21.15.137:0/3662199984 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711538285 0 0) 0x7ff9200b46a0 con 0x7ff92006f340 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.360+0000 7ff925269640 1 -- 172.21.15.137:0/3662199984 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9200b6370 con 0x7ff9200b3e50 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.360+0000 7ff91ffff640 1 --2- 172.21.15.137:0/3662199984 >> v2:172.21.15.170:3300/0 conn(0x7ff9200d0300 0x7ff9200b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.360+0000 7ff925269640 1 --2- 172.21.15.137:0/3662199984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 0x7ff9200720f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff920068b90 tx=0x7ff91802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3a7a3d217641d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.360+0000 7ff91f7fe640 1 -- 172.21.15.137:0/3662199984 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918007740 con 0x7ff9200b3e50 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.360+0000 7ff91f7fe640 1 -- 172.21.15.137:0/3662199984 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9180078e0 con 0x7ff9200b3e50 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.360+0000 7ff91f7fe640 1 -- 172.21.15.137:0/3662199984 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918007cb0 con 0x7ff9200b3e50 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.361+0000 7ff926ccc640 1 -- 172.21.15.137:0/3662199984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 msgr2=0x7ff9200720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.361+0000 7ff926ccc640 1 --2- 172.21.15.137:0/3662199984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 0x7ff9200720f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff920068b90 tx=0x7ff91802a560 comp rx=0 tx=0).stop 2024-04-26T22:00:54.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.361+0000 7ff926ccc640 1 -- 172.21.15.137:0/3662199984 shutdown_connections 2024-04-26T22:00:54.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.361+0000 7ff926ccc640 1 --2- 172.21.15.137:0/3662199984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 0x7ff9200720f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.361+0000 7ff926ccc640 1 --2- 172.21.15.137:0/3662199984 >> v2:172.21.15.170:3300/0 conn(0x7ff9200d0300 0x7ff9200b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.361+0000 7ff926ccc640 1 -- 172.21.15.137:0/3662199984 >> 172.21.15.137:0/3662199984 conn(0x7ff9200cd8a0 msgr2=0x7ff9200cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:54.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.361+0000 7ff926ccc640 1 -- 172.21.15.137:0/3662199984 shutdown_connections 2024-04-26T22:00:54.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.361+0000 7ff926ccc640 1 -- 172.21.15.137:0/3662199984 wait complete. 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.362+0000 7ff926ccc640 1 Processor -- start 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.362+0000 7ff926ccc640 1 -- start start 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff926ccc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff92006f340 0x7ff92013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff926ccc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 0x7ff92013b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff926ccc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9200d0300 0x7ff92013b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff926ccc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9200b4460 con 0x7ff9200b3e50 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff926ccc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff9200b42e0 con 0x7ff92006f340 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff926ccc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff920142a30 con 0x7ff9200d0300 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 0x7ff92013b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 0x7ff92013b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59582/0 (socket says 172.21.15.137:59582) 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff91ffff640 1 -- 172.21.15.137:0/685763687 learned_addr learned my addr 172.21.15.137:0/685763687 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff924a68640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff92006f340 0x7ff92013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff925269640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9200d0300 0x7ff92013b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff91ffff640 1 -- 172.21.15.137:0/685763687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9200d0300 msgr2=0x7ff92013b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff91ffff640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9200d0300 0x7ff92013b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff91ffff640 1 -- 172.21.15.137:0/685763687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff92006f340 msgr2=0x7ff92013c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff91ffff640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff92006f340 0x7ff92013c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff91ffff640 1 -- 172.21.15.137:0/685763687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92015cc00 con 0x7ff9200b3e50 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.363+0000 7ff924a68640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff92006f340 0x7ff92013c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.364+0000 7ff91ffff640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 0x7ff92013b270 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff91400c7f0 tx=0x7ff91400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.364+0000 7ff91d7fa640 1 -- 172.21.15.137:0/685763687 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914015070 con 0x7ff9200b3e50 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.364+0000 7ff91d7fa640 1 -- 172.21.15.137:0/685763687 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff914007a30 con 0x7ff9200b3e50 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.364+0000 7ff91d7fa640 1 -- 172.21.15.137:0/685763687 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914007e00 con 0x7ff9200b3e50 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.364+0000 7ff926ccc640 1 -- 172.21.15.137:0/685763687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92013ef20 con 0x7ff9200b3e50 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.364+0000 7ff926ccc640 1 -- 172.21.15.137:0/685763687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff92013f200 con 0x7ff9200b3e50 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.365+0000 7ff91d7fa640 1 -- 172.21.15.137:0/685763687 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff914018070 con 0x7ff9200b3e50 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.366+0000 7ff91d7fa640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff90c06c8f0 0x7ff90c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.366+0000 7ff91d7fa640 1 -- 172.21.15.137:0/685763687 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7ff91408ba70 con 0x7ff9200b3e50 2024-04-26T22:00:54.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.366+0000 7ff924a68640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff90c06c8f0 0x7ff90c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.366+0000 7ff924a68640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff90c06c8f0 0x7ff90c06edb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff910000f60 tx=0x7ff910007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff9299df740 1 Processor -- start 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff9299df740 1 -- start start 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff9299df740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff9299df740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56c8e10 0x5640d56ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff9299df740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cd0c0 0x5640d56cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff9299df740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5640d5632d80 con 0x5640d56cdf80 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff9299df740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5640d55ec8b0 con 0x5640d56cd0c0 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff9299df740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5640d562ed40 con 0x5640d56c8e10 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff924a68640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff924a68640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56ce360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59598/0 (socket says 172.21.15.137:59598) 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.367+0000 7ff924a68640 1 -- 172.21.15.137:0/3772690237 learned_addr learned my addr 172.21.15.137:0/3772690237 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff924a68640 1 -- 172.21.15.137:0/3772690237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56c8e10 msgr2=0x5640d56ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff924a68640 1 --2- 172.21.15.137:0/3772690237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56c8e10 0x5640d56ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff924a68640 1 -- 172.21.15.137:0/3772690237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cd0c0 msgr2=0x5640d56cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff925269640 1 --2- 172.21.15.137:0/3772690237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cd0c0 0x5640d56cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff924a68640 1 --2- 172.21.15.137:0/3772690237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cd0c0 0x5640d56cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff924a68640 1 -- 172.21.15.137:0/3772690237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d55bda40 con 0x5640d56cdf80 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff924a68640 1 --2- 172.21.15.137:0/3772690237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56ce360 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff910005f20 tx=0x7ff910012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa8c1d341f8063c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff9067fc640 1 -- 172.21.15.137:0/3772690237 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910001d20 con 0x5640d56cdf80 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff9067fc640 1 -- 172.21.15.137:0/3772690237 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9100159c0 con 0x5640d56cdf80 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.368+0000 7ff9067fc640 1 -- 172.21.15.137:0/3772690237 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910015d70 con 0x5640d56cdf80 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 -- 172.21.15.137:0/3772690237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 msgr2=0x5640d56ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 --2- 172.21.15.137:0/3772690237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56ce360 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff910005f20 tx=0x7ff910012000 comp rx=0 tx=0).stop 2024-04-26T22:00:54.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 -- 172.21.15.137:0/3772690237 shutdown_connections 2024-04-26T22:00:54.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 --2- 172.21.15.137:0/3772690237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cd0c0 0x5640d56cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 --2- 172.21.15.137:0/3772690237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56c8e10 0x5640d56ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 --2- 172.21.15.137:0/3772690237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56ce360 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 -- 172.21.15.137:0/3772690237 >> 172.21.15.137:0/3772690237 conn(0x5640d56cb080 msgr2=0x5640d5713b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:54.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 -- 172.21.15.137:0/3772690237 shutdown_connections 2024-04-26T22:00:54.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 -- 172.21.15.137:0/3772690237 wait complete. 2024-04-26T22:00:54.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.369+0000 7ff9299df740 1 -- start start 2024-04-26T22:00:54.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff9299df740 1 Processor -- start 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff9299df740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d5718f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff9299df740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d57197a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff9299df740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 0x5640d56fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff9299df740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5640d56f9b10 con 0x5640d56cdf80 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff9299df740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5640d55b9d10 con 0x5640d56e6ed0 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff9299df740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5640d56f8f90 con 0x5640d56cd0c0 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff9299df740 10 client.0 _ll_register_callbacks cb 0x5640d55e6210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d57197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d57197a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59610/0 (socket says 172.21.15.137:59610) 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff91ffff640 1 -- 172.21.15.137:0/2154307072 learned_addr learned my addr 172.21.15.137:0/2154307072 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.370+0000 7ff924a68640 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d5718f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff925269640 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 0x5640d56fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff91ffff640 1 -- 172.21.15.137:0/2154307072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 msgr2=0x5640d5718f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff91ffff640 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d5718f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff91ffff640 1 -- 172.21.15.137:0/2154307072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 msgr2=0x5640d56fb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff91ffff640 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 0x5640d56fb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff91ffff640 1 -- 172.21.15.137:0/2154307072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640d540e7d0 con 0x5640d56cdf80 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff91ffff640 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d57197a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff914061ea0 tx=0x7ff9140597f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a822c7ba6645aa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff8ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/2154307072 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91401f040 con 0x5640d56cdf80 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/2154307072 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7ff914058e40 con 0x5640d56cdf80 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff9299df740 1 -- 172.21.15.137:0/2154307072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9100159c0 con 0x5640d56cdf80 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/2154307072 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff9140600c0 con 0x5640d56cdf80 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff9299df740 10 client.5853 fetch_fsmap learned FSMap version 20 2024-04-26T22:00:54.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff9299df740 1 -- 172.21.15.137:0/2154307072 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5640d53443f0 con 0x5640d56cdf80 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/2154307072 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9100159c0 con 0x5640d56cdf80 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/2154307072 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7ff91405ab20 con 0x5640d56cdf80 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff9299df740 10 client.5853 fetch_fsmap finished waiting for FSMap version 20 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff9299df740 10 client.5853 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff9299df740 20 client.5853 populate_metadata read hostname 'smithi137' 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff9299df740 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x5640d56ebed0 0x5640d56ec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff9299df740 4 client.5853 mds_command: new command op to 5592 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.371+0000 7ff9299df740 1 -- 172.21.15.137:0/2154307072 --> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640d5640990 con 0x5640d56ebed0 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.372+0000 7ff924a68640 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x5640d56ebed0 0x5640d56ec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.372+0000 7ff924a68640 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x5640d56ebed0 0x5640d56ec2e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87d1b61e12d25588 server_cookie=835a9077d01d3b52 in_seq=0 out_seq=0 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.372+0000 7ff8ff7fe640 10 client.5853 ms_handle_connect on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:54.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.372+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/2154307072 <== mds.0 v2:172.21.15.137:6836/924509332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5640d5640990 con 0x5640d56ebed0 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.372+0000 7ff8ff7fe640 10 client.5853 handle_command_reply: tid=0 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.372+0000 7ff9299df740 1 client.5853 shutdown 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 -- 172.21.15.137:0/2154307072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 msgr2=0x5640d57197a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d57197a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff914061ea0 tx=0x7ff9140597f0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 -- 172.21.15.137:0/2154307072 shutdown_connections 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x5640d56ebed0 0x5640d56ec2e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d57197a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 0x5640d56fb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff8ff7fe640 0 client.5853 ms_handle_reset on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 --2- 172.21.15.137:0/2154307072 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d5718f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 -- 172.21.15.137:0/2154307072 >> 172.21.15.137:0/2154307072 conn(0x5640d56c8e10 msgr2=0x5640d56c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 -- 172.21.15.137:0/2154307072 shutdown_connections 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 1 -- 172.21.15.137:0/2154307072 wait complete. 2024-04-26T22:00:54.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.373+0000 7ff9299df740 20 client.5853 trim_cache size 0 max 16384 2024-04-26T22:00:54.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.390+0000 7ff9299df740 1 Processor -- start 2024-04-26T22:00:54.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.390+0000 7ff9299df740 1 -- start start 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff9299df740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d56f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff9299df740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56eb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff9299df740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 0x5640d5712c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff9299df740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9201ff510 con 0x5640d56cdf80 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff9299df740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff9201fe590 con 0x5640d56e6ed0 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff9299df740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff92015df80 con 0x5640d56cd0c0 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff91ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56eb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59620/0 (socket says 172.21.15.137:59620) 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff91ffff640 1 -- 172.21.15.137:0/3063384405 learned_addr learned my addr 172.21.15.137:0/3063384405 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff924a68640 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d56f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff91ffff640 1 -- 172.21.15.137:0/3063384405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 msgr2=0x5640d56f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff91ffff640 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d56f96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff925269640 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 0x5640d5712c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff91ffff640 1 -- 172.21.15.137:0/3063384405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 msgr2=0x5640d5712c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff91ffff640 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 0x5640d5712c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff91ffff640 1 -- 172.21.15.137:0/3063384405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640d53040f0 con 0x5640d56cdf80 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff925269640 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 0x5640d5712c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff91ffff640 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56eb560 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff914055c50 tx=0x7ff91401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc962a5ffb43469 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff905ffb640 1 -- 172.21.15.137:0/3063384405 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91401f070 con 0x5640d56cdf80 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.391+0000 7ff905ffb640 1 -- 172.21.15.137:0/3063384405 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff914058c40 con 0x5640d56cdf80 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff905ffb640 1 -- 172.21.15.137:0/3063384405 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914055540 con 0x5640d56cdf80 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff9299df740 1 -- 172.21.15.137:0/3063384405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 msgr2=0x5640d56eb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff9299df740 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56eb560 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff914055c50 tx=0x7ff91401b000 comp rx=0 tx=0).stop 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff9299df740 1 -- 172.21.15.137:0/3063384405 shutdown_connections 2024-04-26T22:00:54.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff9299df740 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56cdf80 0x5640d56eb560 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff9299df740 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56e6ed0 0x5640d5712c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff9299df740 1 --2- 172.21.15.137:0/3063384405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d56f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff9299df740 1 -- 172.21.15.137:0/3063384405 >> 172.21.15.137:0/3063384405 conn(0x5640d56c8e10 msgr2=0x5640d56f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff9299df740 1 -- 172.21.15.137:0/3063384405 shutdown_connections 2024-04-26T22:00:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.392+0000 7ff9299df740 1 -- 172.21.15.137:0/3063384405 wait complete. 2024-04-26T22:00:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.393+0000 7ff9299df740 1 -- start start 2024-04-26T22:00:54.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.393+0000 7ff9299df740 1 Processor -- start 2024-04-26T22:00:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d56f1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cdf80 0x5640d5790790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56e6ed0 0x5640d56efe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5640d570a9f0 con 0x5640d56e6ed0 2024-04-26T22:00:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff92015e5d0 con 0x5640d56cdf80 2024-04-26T22:00:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5640d56f0770 con 0x5640d56cd0c0 2024-04-26T22:00:54.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 10 client.0 _ll_register_callbacks cb 0x7ff91400ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff925269640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56e6ed0 0x5640d56efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff925269640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56e6ed0 0x5640d56efe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59628/0 (socket says 172.21.15.137:59628) 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff925269640 1 -- 172.21.15.137:0/28315272 learned_addr learned my addr 172.21.15.137:0/28315272 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff91ffff640 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cdf80 0x5640d5790790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff924a68640 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d56f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff925269640 1 -- 172.21.15.137:0/28315272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 msgr2=0x5640d56f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff925269640 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d56f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff925269640 1 -- 172.21.15.137:0/28315272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cdf80 msgr2=0x5640d5790790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff925269640 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cdf80 0x5640d5790790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff925269640 1 -- 172.21.15.137:0/28315272 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640d55f34b0 con 0x5640d56e6ed0 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff925269640 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56e6ed0 0x5640d56efe30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff918009e80 tx=0x7ff918004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7cd841aae107 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff8ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/28315272 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91803c620 con 0x5640d56e6ed0 2024-04-26T22:00:54.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/28315272 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7ff91803c7c0 con 0x5640d56e6ed0 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 1 -- 172.21.15.137:0/28315272 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff914058c40 con 0x5640d56e6ed0 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/28315272 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff918050050 con 0x5640d56e6ed0 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 10 client.5859 fetch_fsmap learned FSMap version 20 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.394+0000 7ff9299df740 1 -- 172.21.15.137:0/28315272 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5640d572dc00 con 0x5640d56e6ed0 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/28315272 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff914058c40 con 0x5640d56e6ed0 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/28315272 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7ff918053020 con 0x5640d56e6ed0 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff9299df740 10 client.5859 fetch_fsmap finished waiting for FSMap version 20 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff9299df740 10 client.5859 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff9299df740 20 client.5859 populate_metadata read hostname 'smithi137' 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff9299df740 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x5640d56edf30 0x5640d572ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff9299df740 4 client.5859 mds_command: new command op to 5592 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff9299df740 1 -- 172.21.15.137:0/28315272 --> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5640d563a800 con 0x5640d56edf30 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff924a68640 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x5640d56edf30 0x5640d572ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff8ff7fe640 10 client.5859 ms_handle_connect on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:54.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff924a68640 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x5640d56edf30 0x5640d572ce80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd74f6f59e331b3b server_cookie=4acb6d31b7af3820 in_seq=0 out_seq=0 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff8ff7fe640 1 -- 172.21.15.137:0/28315272 <== mds.0 v2:172.21.15.137:6836/924509332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5640d563a800 con 0x5640d56edf30 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff8ff7fe640 10 client.5859 handle_command_reply: tid=0 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.395+0000 7ff9299df740 1 client.5859 shutdown 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 -- 172.21.15.137:0/28315272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56e6ed0 msgr2=0x5640d56efe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56e6ed0 0x5640d56efe30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff918009e80 tx=0x7ff918004ab0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 -- 172.21.15.137:0/28315272 shutdown_connections 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.137:6836/924509332,v1:172.21.15.137:6837/924509332] conn(0x5640d56edf30 0x5640d572ce80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5640d56e6ed0 0x5640d56efe30 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640d56cdf80 0x5640d5790790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff8ff7fe640 0 client.5859 ms_handle_reset on v2:172.21.15.137:6836/924509332 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 --2- 172.21.15.137:0/28315272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5640d56cd0c0 0x5640d56f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 -- 172.21.15.137:0/28315272 >> 172.21.15.137:0/28315272 conn(0x5640d56c8e10 msgr2=0x5640d56f8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 -- 172.21.15.137:0/28315272 shutdown_connections 2024-04-26T22:00:54.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 1 -- 172.21.15.137:0/28315272 wait complete. 2024-04-26T22:00:54.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff9299df740 20 client.5859 trim_cache size 0 max 16384 2024-04-26T22:00:54.403 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:00:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:00:54.403 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:00:54.403 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 -- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff90c06c8f0 msgr2=0x7ff90c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff90c06c8f0 0x7ff90c06edb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff910000f60 tx=0x7ff910007ca0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 -- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 msgr2=0x7ff92013b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 0x7ff92013b270 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff91400c7f0 tx=0x7ff91400cbf0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 -- 172.21.15.137:0/685763687 shutdown_connections 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff90c06c8f0 0x7ff90c06edb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9200b3e50 0x7ff92013b270 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9200d0300 0x7ff92013b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 --2- 172.21.15.137:0/685763687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff92006f340 0x7ff92013c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 -- 172.21.15.137:0/685763687 >> 172.21.15.137:0/685763687 conn(0x7ff9200cd8a0 msgr2=0x7ff920152480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:54.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 -- 172.21.15.137:0/685763687 shutdown_connections 2024-04-26T22:00:54.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.396+0000 7ff926ccc640 1 -- 172.21.15.137:0/685763687 wait complete. 2024-04-26T22:00:54.407 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:00:54.508 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:54.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.605+0000 7f28c7b39640 1 Processor -- start 2024-04-26T22:00:54.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.605+0000 7f28c7b39640 1 -- start start 2024-04-26T22:00:54.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.606+0000 7f28c7b39640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f28c015f370 0x7f28c00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.606+0000 7f28c7b39640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f28c015f750 0x7f28c00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.606+0000 7f28c7b39640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28c00d03a0 con 0x7f28c00d37d0 2024-04-26T22:00:54.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.606+0000 7f28c7b39640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f28c00b4d10 con 0x7f28c015f370 2024-04-26T22:00:54.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.606+0000 7f28c7b39640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f28c00d0680 con 0x7f28c015f750 2024-04-26T22:00:54.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.606+0000 7f28c58d5640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f28c015f370 0x7f28c00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.606+0000 7f28c58d5640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f28c015f370 0x7f28c00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59634/0 (socket says 172.21.15.137:59634) 2024-04-26T22:00:54.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.606+0000 7f28c58d5640 1 -- 172.21.15.137:0/652605723 learned_addr learned my addr 172.21.15.137:0/652605723 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:54.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.607+0000 7f28c50d4640 1 --2- 172.21.15.137:0/652605723 >> v2:172.21.15.170:3300/0 conn(0x7f28c015f750 0x7f28c00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.607+0000 7f28c58d5640 1 -- 172.21.15.137:0/652605723 >> v2:172.21.15.170:3300/0 conn(0x7f28c015f750 msgr2=0x7f28c00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.607+0000 7f28c58d5640 1 --2- 172.21.15.137:0/652605723 >> v2:172.21.15.170:3300/0 conn(0x7f28c015f750 0x7f28c00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.607+0000 7f28c58d5640 1 -- 172.21.15.137:0/652605723 >> v1:172.21.15.170:6789/0 conn(0x7f28c00d37d0 legacy=0x7f28c00d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.607+0000 7f28c58d5640 1 -- 172.21.15.137:0/652605723 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c00d0960 con 0x7f28c015f370 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.607+0000 7f28c58d5640 1 --2- 172.21.15.137:0/652605723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 0x7f28c00cfd70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f28c00d02b0 tx=0x7f28bc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6ee9367969bfda server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.607+0000 7f28c48d3640 1 -- 172.21.15.137:0/652605723 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc036070 con 0x7f28c015f370 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c48d3640 1 -- 172.21.15.137:0/652605723 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28bc031600 con 0x7f28c015f370 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c48d3640 1 -- 172.21.15.137:0/652605723 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0319d0 con 0x7f28c015f370 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c7b39640 1 -- 172.21.15.137:0/652605723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 msgr2=0x7f28c00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c7b39640 1 --2- 172.21.15.137:0/652605723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 0x7f28c00cfd70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f28c00d02b0 tx=0x7f28bc02a6f0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c7b39640 1 -- 172.21.15.137:0/652605723 shutdown_connections 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c7b39640 1 --2- 172.21.15.137:0/652605723 >> v2:172.21.15.170:3300/0 conn(0x7f28c015f750 0x7f28c00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c7b39640 1 --2- 172.21.15.137:0/652605723 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 0x7f28c00cfd70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c7b39640 1 -- 172.21.15.137:0/652605723 >> 172.21.15.137:0/652605723 conn(0x7f28c008ec10 msgr2=0x7f28c009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:54.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c7b39640 1 -- 172.21.15.137:0/652605723 shutdown_connections 2024-04-26T22:00:54.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.608+0000 7f28c7b39640 1 -- 172.21.15.137:0/652605723 wait complete. 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.609+0000 7f28c7b39640 1 Processor -- start 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.609+0000 7f28c7b39640 1 -- start start 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c7b39640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28c00d37d0 0x7f28c00b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c7b39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 0x7f28c0162330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c7b39640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28c015f750 0x7f28c0162870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c7b39640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f28c00b61d0 con 0x7f28c015f370 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c7b39640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f28c00d0f20 con 0x7f28c015f750 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c7b39640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f28c00b6350 con 0x7f28c00d37d0 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c50d4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 0x7f28c0162330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c50d4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 0x7f28c0162330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59638/0 (socket says 172.21.15.137:59638) 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c50d4640 1 -- 172.21.15.137:0/129075963 learned_addr learned my addr 172.21.15.137:0/129075963 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c50d4640 1 -- 172.21.15.137:0/129075963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28c00d37d0 msgr2=0x7f28c00b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c58d5640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28c00d37d0 0x7f28c00b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c60d6640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28c015f750 0x7f28c0162870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c50d4640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28c00d37d0 0x7f28c00b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c50d4640 1 -- 172.21.15.137:0/129075963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28c015f750 msgr2=0x7f28c0162870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c50d4640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28c015f750 0x7f28c0162870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.610+0000 7f28c50d4640 1 -- 172.21.15.137:0/129075963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c01f89e0 con 0x7f28c015f370 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.611+0000 7f28c50d4640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 0x7f28c0162330 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f28b000d800 tx=0x7f28b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.611+0000 7f28b67fc640 1 -- 172.21.15.137:0/129075963 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b000b6c0 con 0x7f28c015f370 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.611+0000 7f28b67fc640 1 -- 172.21.15.137:0/129075963 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28b0019070 con 0x7f28c015f370 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.611+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c01f8cc0 con 0x7f28c015f370 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.611+0000 7f28b67fc640 1 -- 172.21.15.137:0/129075963 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b000ba80 con 0x7f28c015f370 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.611+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c01f9280 con 0x7f28c015f370 2024-04-26T22:00:54.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.612+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c006a290 con 0x7f28c015f370 2024-04-26T22:00:54.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.612+0000 7f28b67fc640 1 -- 172.21.15.137:0/129075963 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28b000bc20 con 0x7f28c015f370 2024-04-26T22:00:54.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.613+0000 7f28b67fc640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f28a406c8f0 0x7f28a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:54.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.613+0000 7f28b67fc640 1 -- 172.21.15.137:0/129075963 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f28b008c080 con 0x7f28c015f370 2024-04-26T22:00:54.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.613+0000 7f28c58d5640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f28a406c8f0 0x7f28a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:54.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.613+0000 7f28c58d5640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f28a406c8f0 0x7f28a406edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f28bc033000 tx=0x7f28bc009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:54.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.617+0000 7f28b67fc640 1 -- 172.21.15.137:0/129075963 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f28b001c360 con 0x7f28c015f370 2024-04-26T22:00:54.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.830+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28c0075a00 con 0x7f28c015f370 2024-04-26T22:00:54.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.830+0000 7f28b67fc640 1 -- 172.21.15.137:0/129075963 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7f28b005a470 con 0x7f28c015f370 2024-04-26T22:00:54.831 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:54.831 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1453946915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1453946915},{"type":"v1","addr":"172.21.15.170:6835","nonce":1453946915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3097952323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3097952323},{"type":"v1","addr":"172.21.15.170:6834","nonce":3097952323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3002187785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3002187785},{"type":"v1","addr":"172.21.15.137:6835","nonce":3002187785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:00:12.224783+0000","modified":"2024-04-26T22:00:14.233247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5592":{"gid":5592,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/924509332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":924509332},{"type":"v1","addr":"172.21.15.137:6837","nonce":924509332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5592,"qdb_cluster":[5592]},"id":3}]} 2024-04-26T22:00:54.831 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 20 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.832+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f28a406c8f0 msgr2=0x7f28a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.832+0000 7f28c7b39640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f28a406c8f0 0x7f28a406edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f28bc033000 tx=0x7f28bc009000 comp rx=0 tx=0).stop 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.832+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 msgr2=0x7f28c0162330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.832+0000 7f28c7b39640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 0x7f28c0162330 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f28b000d800 tx=0x7f28b000dcc0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.833+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 shutdown_connections 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.833+0000 7f28c7b39640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f28a406c8f0 0x7f28a406edb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.833+0000 7f28c7b39640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f28c015f370 0x7f28c0162330 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.833+0000 7f28c7b39640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28c015f750 0x7f28c0162870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.833+0000 7f28c7b39640 1 --2- 172.21.15.137:0/129075963 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f28c00d37d0 0x7f28c00b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:54.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.833+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 >> 172.21.15.137:0/129075963 conn(0x7f28c008ec10 msgr2=0x7f28c015e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:54.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.833+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 shutdown_connections 2024-04-26T22:00:54.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:54.833+0000 7f28c7b39640 1 -- 172.21.15.137:0/129075963 wait complete. 2024-04-26T22:00:54.844 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-26T22:00:54.964 INFO:teuthology.orchestra.run.smithi137.stdout:{"message":"","return_code":0} 2024-04-26T22:00:54.964 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T22:00:54.965 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-26T22:00:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.006+0000 7f6e0f54df40 1 Processor -- start 2024-04-26T22:00:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.006+0000 7f6e0f54df40 1 -- start start 2024-04-26T22:00:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0f54df40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55632121b850 0x5563212a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0f54df40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5563212ad890 0x55632121bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0f54df40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563212adc70 0x55632121c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0f54df40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5563212007d0 con 0x55632121b850 2024-04-26T22:00:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0f54df40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55632117de40 con 0x5563212adc70 2024-04-26T22:00:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0f54df40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55632121e9b0 con 0x5563212ad890 2024-04-26T22:00:55.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0d049640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55632121b850 0x5563212a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0d049640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55632121b850 0x5563212a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59650/0 (socket says 172.21.15.137:59650) 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0d049640 1 -- 172.21.15.137:0/54212221 learned_addr learned my addr 172.21.15.137:0/54212221 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0d049640 1 -- 172.21.15.137:0/54212221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5563212ad890 msgr2=0x55632121bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0d049640 1 --2- 172.21.15.137:0/54212221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5563212ad890 0x55632121bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0d049640 1 -- 172.21.15.137:0/54212221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563212adc70 msgr2=0x55632121c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0d049640 1 --2- 172.21.15.137:0/54212221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563212adc70 0x55632121c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0d049640 1 -- 172.21.15.137:0/54212221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55632121cbc0 con 0x55632121b850 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e0d049640 1 --2- 172.21.15.137:0/54212221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55632121b850 0x5563212a1df0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000a520 tx=0x7f6e0004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f49a9ad9d202c94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e077fe640 1 -- 172.21.15.137:0/54212221 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00065070 con 0x55632121b850 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e077fe640 1 -- 172.21.15.137:0/54212221 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e00054a10 con 0x55632121b850 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.007+0000 7f6e077fe640 1 -- 172.21.15.137:0/54212221 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00059040 con 0x55632121b850 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 -- 172.21.15.137:0/54212221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55632121b850 msgr2=0x5563212a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 --2- 172.21.15.137:0/54212221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55632121b850 0x5563212a1df0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000a520 tx=0x7f6e0004e000 comp rx=0 tx=0).stop 2024-04-26T22:00:55.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 -- 172.21.15.137:0/54212221 shutdown_connections 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 --2- 172.21.15.137:0/54212221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5563212adc70 0x55632121c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 --2- 172.21.15.137:0/54212221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5563212ad890 0x55632121bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 --2- 172.21.15.137:0/54212221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55632121b850 0x5563212a1df0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 -- 172.21.15.137:0/54212221 >> 172.21.15.137:0/54212221 conn(0x556321220fd0 msgr2=0x5563212ac710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 -- 172.21.15.137:0/54212221 shutdown_connections 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 -- 172.21.15.137:0/54212221 wait complete. 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 Processor -- start 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.008+0000 7f6e0f54df40 1 -- start start 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e0f54df40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55632121b850 0x5563212a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e0f54df40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563212ad890 0x5563211d4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e0f54df40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5563212adc70 0x5563211d51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e0f54df40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55632121ce80 con 0x5563212ad890 2024-04-26T22:00:55.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e0f54df40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55632121d160 con 0x55632121b850 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e0f54df40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55632121d440 con 0x5563212adc70 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e07fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563212ad890 0x5563211d4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e07fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563212ad890 0x5563211d4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59656/0 (socket says 172.21.15.137:59656) 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e07fff640 1 -- 172.21.15.137:0/4112786486 learned_addr learned my addr 172.21.15.137:0/4112786486 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e0d049640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55632121b850 0x5563212a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e0d84a640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5563212adc70 0x5563211d51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e07fff640 1 -- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5563212adc70 msgr2=0x5563211d51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e07fff640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5563212adc70 0x5563211d51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e07fff640 1 -- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55632121b850 msgr2=0x5563212a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.009+0000 7f6e07fff640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55632121b850 0x5563212a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.010+0000 7f6e07fff640 1 -- 172.21.15.137:0/4112786486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55632129e790 con 0x5563212ad890 2024-04-26T22:00:55.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.010+0000 7f6e0d049640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55632121b850 0x5563212a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.010+0000 7f6e0d84a640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5563212adc70 0x5563211d51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.010+0000 7f6e07fff640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563212ad890 0x5563211d4cb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6df800adb0 tx=0x7f6df800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.010+0000 7f6e067fc640 1 -- 172.21.15.137:0/4112786486 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df801a070 con 0x5563212ad890 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.010+0000 7f6e067fc640 1 -- 172.21.15.137:0/4112786486 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df80089b0 con 0x5563212ad890 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.010+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563212a9060 con 0x5563212ad890 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.010+0000 7f6e067fc640 1 -- 172.21.15.137:0/4112786486 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8008d80 con 0x5563212ad890 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.010+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563212aad30 con 0x5563212ad890 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.011+0000 7f6e067fc640 1 -- 172.21.15.137:0/4112786486 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6df801d070 con 0x5563212ad890 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.011+0000 7f6e067fc640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006b2d0 0x7f6df006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.012+0000 7f6e0d049640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006b2d0 0x7f6df006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.012+0000 7f6e067fc640 1 -- 172.21.15.137:0/4112786486 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f6df80899f0 con 0x5563212ad890 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.012+0000 7f6e0f54df40 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5563212acbc0 0x55632134fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.012+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48) -- 0x55632134ff40 con 0x5563212acbc0 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.012+0000 7f6e0d049640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006b2d0 0x7f6df006d790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e00062000 tx=0x7f6e00056040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.012+0000 7f6e0d84a640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5563212acbc0 0x55632134fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.012+0000 7f6e0d84a640 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5563212acbc0 0x55632134fa00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0d84a640 1 -- 172.21.15.137:0/4112786486 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f6e08003450 con 0x5563212acbc0 2024-04-26T22:00:55.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5563212acbc0 msgr2=0x55632134fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5563212acbc0 0x55632134fa00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006b2d0 msgr2=0x7f6df006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006b2d0 0x7f6df006d790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e00062000 tx=0x7f6e00056040 comp rx=0 tx=0).stop 2024-04-26T22:00:55.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563212ad890 msgr2=0x5563211d4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 --2- 172.21.15.137:0/4112786486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5563212ad890 0x5563211d4cb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6df800adb0 tx=0x7f6df800aea0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0d84a640 1 -- 172.21.15.137:0/4112786486 reap_dead start 2024-04-26T22:00:55.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 shutdown_connections 2024-04-26T22:00:55.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 >> 172.21.15.137:0/4112786486 conn(0x556321220fd0 msgr2=0x5563212a30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:55.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 shutdown_connections 2024-04-26T22:00:55.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.013+0000 7f6e0f54df40 1 -- 172.21.15.137:0/4112786486 wait complete. 2024-04-26T22:00:55.020 INFO:teuthology.orchestra.run.smithi137.stdout:Yalphaparent_a 2024-04-26T22:00:55.020 DEBUG:teuthology.orchestra.run.smithi137:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-26T22:00:55.106 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511627777, 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "ancestors": [ 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "dirino": 1099511627776, 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "dname": "alpha", 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "version": 4 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "dirino": 1, 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "dname": "parent_a", 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: "version": 7 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:00:55.107 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-26T22:00:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "pool": 7, 2024-04-26T22:00:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: "old_pools": [] 2024-04-26T22:00:55.108 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:00:55.108 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:55.109 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:00:55.109 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:00:55.183 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:00:55.234 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:00:55.234 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:00:55.234 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:00:55.235 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:55.250 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:00:55.250 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:55.305 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:55.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.441+0000 7fe8f92bb640 1 Processor -- start 2024-04-26T22:00:55.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.441+0000 7fe8f92bb640 1 -- start start 2024-04-26T22:00:55.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.442+0000 7fe8f92bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070d20 0x7fe8f4071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.442+0000 7fe8f92bb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe8f4070520 0x7fe8f4163640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.442+0000 7fe8f92bb640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f40d14c0 con 0x7fe8f409c400 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.442+0000 7fe8f92bb640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f40d1290 con 0x7fe8f4070520 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.442+0000 7fe8f92bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f4071640 con 0x7fe8f4070d20 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.442+0000 7fe8f37fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe8f4070520 0x7fe8f4163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.442+0000 7fe8f37fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe8f4070520 0x7fe8f4163640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59668/0 (socket says 172.21.15.137:59668) 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.442+0000 7fe8f37fe640 1 -- 172.21.15.137:0/2331181243 learned_addr learned my addr 172.21.15.137:0/2331181243 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.442+0000 7fe8f2ffd640 1 --2- 172.21.15.137:0/2331181243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070d20 0x7fe8f4071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.443+0000 7fe8f37fe640 1 -- 172.21.15.137:0/2331181243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070d20 msgr2=0x7fe8f4071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.443+0000 7fe8f37fe640 1 --2- 172.21.15.137:0/2331181243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070d20 0x7fe8f4071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.443+0000 7fe8f37fe640 1 -- 172.21.15.137:0/2331181243 >> v1:172.21.15.170:6789/0 conn(0x7fe8f409c400 legacy=0x7fe8f4162f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.443+0000 7fe8f37fe640 1 -- 172.21.15.137:0/2331181243 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f40ce5b0 con 0x7fe8f4070520 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.443+0000 7fe8f37fe640 1 --2- 172.21.15.137:0/2331181243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f4070520 0x7fe8f4163640 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009870 tx=0x7fe8ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f039299ab0f4b1c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.443+0000 7fe8f1ffb640 1 -- 172.21.15.137:0/2331181243 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec037070 con 0x7fe8f4070520 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.443+0000 7fe8f1ffb640 1 -- 172.21.15.137:0/2331181243 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec032440 con 0x7fe8f4070520 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.443+0000 7fe8f1ffb640 1 -- 172.21.15.137:0/2331181243 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec032810 con 0x7fe8f4070520 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.444+0000 7fe8f92bb640 1 -- 172.21.15.137:0/2331181243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f4070520 msgr2=0x7fe8f4163640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.444+0000 7fe8f92bb640 1 --2- 172.21.15.137:0/2331181243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f4070520 0x7fe8f4163640 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009870 tx=0x7fe8ec02a270 comp rx=0 tx=0).stop 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.444+0000 7fe8f92bb640 1 -- 172.21.15.137:0/2331181243 shutdown_connections 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.444+0000 7fe8f92bb640 1 --2- 172.21.15.137:0/2331181243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f4070520 0x7fe8f4163640 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.444+0000 7fe8f92bb640 1 --2- 172.21.15.137:0/2331181243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070d20 0x7fe8f4071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.444+0000 7fe8f92bb640 1 -- 172.21.15.137:0/2331181243 >> 172.21.15.137:0/2331181243 conn(0x7fe8f40b4a40 msgr2=0x7fe8f40b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.444+0000 7fe8f92bb640 1 -- 172.21.15.137:0/2331181243 shutdown_connections 2024-04-26T22:00:55.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.444+0000 7fe8f92bb640 1 -- 172.21.15.137:0/2331181243 wait complete. 2024-04-26T22:00:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.445+0000 7fe8f92bb640 1 Processor -- start 2024-04-26T22:00:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.445+0000 7fe8f92bb640 1 -- start start 2024-04-26T22:00:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f92bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070520 0x7fe8f40b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f92bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8f4070d20 0x7fe8f4159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f92bb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f409c400 0x7fe8f40b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f92bb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f40d1d20 con 0x7fe8f409c400 2024-04-26T22:00:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f92bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f40d1a40 con 0x7fe8f4070d20 2024-04-26T22:00:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f92bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f40d2000 con 0x7fe8f4070520 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f409c400 0x7fe8f40b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f409c400 0x7fe8f40b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59670/0 (socket says 172.21.15.137:59670) 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f37fe640 1 -- 172.21.15.137:0/4032873824 learned_addr learned my addr 172.21.15.137:0/4032873824 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f2ffd640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070520 0x7fe8f40b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f27fc640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8f4070d20 0x7fe8f4159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f37fe640 1 -- 172.21.15.137:0/4032873824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070520 msgr2=0x7fe8f40b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f37fe640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070520 0x7fe8f40b8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f37fe640 1 -- 172.21.15.137:0/4032873824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8f4070d20 msgr2=0x7fe8f4159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f37fe640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8f4070d20 0x7fe8f4159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.446+0000 7fe8f37fe640 1 -- 172.21.15.137:0/4032873824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f40c91c0 con 0x7fe8f409c400 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.447+0000 7fe8f37fe640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f409c400 0x7fe8f40b3320 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009870 tx=0x7fe8ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.447+0000 7fe8db7fe640 1 -- 172.21.15.137:0/4032873824 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec037040 con 0x7fe8f409c400 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.447+0000 7fe8db7fe640 1 -- 172.21.15.137:0/4032873824 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec042070 con 0x7fe8f409c400 2024-04-26T22:00:55.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.447+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f40b85f0 con 0x7fe8f409c400 2024-04-26T22:00:55.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.447+0000 7fe8db7fe640 1 -- 172.21.15.137:0/4032873824 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec030920 con 0x7fe8f409c400 2024-04-26T22:00:55.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.447+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f40c89c0 con 0x7fe8f409c400 2024-04-26T22:00:55.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.448+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f40693d0 con 0x7fe8f409c400 2024-04-26T22:00:55.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.448+0000 7fe8db7fe640 1 -- 172.21.15.137:0/4032873824 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8ec030ac0 con 0x7fe8f409c400 2024-04-26T22:00:55.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.449+0000 7fe8db7fe640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe8e006c8f0 0x7fe8e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.449+0000 7fe8db7fe640 1 -- 172.21.15.137:0/4032873824 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fe8ec0ac460 con 0x7fe8f409c400 2024-04-26T22:00:55.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.449+0000 7fe8f2ffd640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe8e006c8f0 0x7fe8e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.449+0000 7fe8f2ffd640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe8e006c8f0 0x7fe8e006edb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40099c0 tx=0x7fe8e4003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.453+0000 7fe8db7fe640 1 -- 172.21.15.137:0/4032873824 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe8ec07a200 con 0x7fe8f409c400 2024-04-26T22:00:55.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.629+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8f4074880 con 0x7fe8f409c400 2024-04-26T22:00:55.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.630+0000 7fe8db7fe640 1 -- 172.21.15.137:0/4032873824 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16717 (secure 0 0 0) 0x7fe8ec07e500 con 0x7fe8f409c400 2024-04-26T22:00:55.630 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:55.631 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":48,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:00:23.980977+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:00:10.430051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T22:00:11.181890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:55.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe8e006c8f0 msgr2=0x7fe8e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe8e006c8f0 0x7fe8e006edb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40099c0 tx=0x7fe8e4003990 comp rx=0 tx=0).stop 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f409c400 msgr2=0x7fe8f40b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f409c400 0x7fe8f40b3320 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec009870 tx=0x7fe8ec0046c0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 shutdown_connections 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe8e006c8f0 0x7fe8e006edb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8f409c400 0x7fe8f40b3320 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8f4070d20 0x7fe8f4159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 --2- 172.21.15.137:0/4032873824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8f4070520 0x7fe8f40b8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 >> 172.21.15.137:0/4032873824 conn(0x7fe8f40b4a40 msgr2=0x7fe8f40ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 shutdown_connections 2024-04-26T22:00:55.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.632+0000 7fe8f92bb640 1 -- 172.21.15.137:0/4032873824 wait complete. 2024-04-26T22:00:55.644 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:00:10.430051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:00:11.181890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:00:55.644 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:00:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.745+0000 7f6f0c007640 1 Processor -- start 2024-04-26T22:00:55.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.745+0000 7f6f0c007640 1 -- start start 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0c007640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6f041631f0 0x7f6f040b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0c007640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040d1170 0x7f6f041635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0c007640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f040b3300 0x7f6f040b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0c007640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6f040d15f0 con 0x7f6f040b3300 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0c007640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0409c790 con 0x7f6f041631f0 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0c007640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6f04163ec0 con 0x7f6f040d1170 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0a5a4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f040b3300 0x7f6f040b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0a5a4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6f040b3300 0x7f6f040b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34052/0 (socket says 172.21.15.137:34052) 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0a5a4640 1 -- 172.21.15.137:0/338693065 learned_addr learned my addr 172.21.15.137:0/338693065 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f09da3640 1 --2- 172.21.15.137:0/338693065 >> v2:172.21.15.170:3300/0 conn(0x7f6f041631f0 0x7f6f040b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f095a2640 1 --2- 172.21.15.137:0/338693065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040d1170 0x7f6f041635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0a5a4640 1 -- 172.21.15.137:0/338693065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040d1170 msgr2=0x7f6f041635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:55.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0a5a4640 1 --2- 172.21.15.137:0/338693065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040d1170 0x7f6f041635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0a5a4640 1 -- 172.21.15.137:0/338693065 >> v2:172.21.15.170:3300/0 conn(0x7f6f041631f0 msgr2=0x7f6f040b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:55.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0a5a4640 1 --2- 172.21.15.137:0/338693065 >> v2:172.21.15.170:3300/0 conn(0x7f6f041631f0 0x7f6f040b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.746+0000 7f6f0a5a4640 1 -- 172.21.15.137:0/338693065 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f040d1a40 con 0x7f6f040b3300 2024-04-26T22:00:55.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f0a5a4640 1 --2- 172.21.15.137:0/338693065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f040b3300 0x7f6f040b3790 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6f040d2ef0 tx=0x7f6efc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf2597fedde2222 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f08da1640 1 -- 172.21.15.137:0/338693065 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc036070 con 0x7f6f040b3300 2024-04-26T22:00:55.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f08da1640 1 -- 172.21.15.137:0/338693065 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc031600 con 0x7f6f040b3300 2024-04-26T22:00:55.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f08da1640 1 -- 172.21.15.137:0/338693065 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0319d0 con 0x7f6f040b3300 2024-04-26T22:00:55.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f0c007640 1 -- 172.21.15.137:0/338693065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f040b3300 msgr2=0x7f6f040b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f0c007640 1 --2- 172.21.15.137:0/338693065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f040b3300 0x7f6f040b3790 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6f040d2ef0 tx=0x7f6efc02a610 comp rx=0 tx=0).stop 2024-04-26T22:00:55.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f0c007640 1 -- 172.21.15.137:0/338693065 shutdown_connections 2024-04-26T22:00:55.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f0c007640 1 --2- 172.21.15.137:0/338693065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f040b3300 0x7f6f040b3790 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f0c007640 1 --2- 172.21.15.137:0/338693065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040d1170 0x7f6f041635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f0c007640 1 --2- 172.21.15.137:0/338693065 >> v2:172.21.15.170:3300/0 conn(0x7f6f041631f0 0x7f6f040b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f0c007640 1 -- 172.21.15.137:0/338693065 >> 172.21.15.137:0/338693065 conn(0x7f6f0409ba40 msgr2=0x7f6f0409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.747+0000 7f6f0c007640 1 -- 172.21.15.137:0/338693065 shutdown_connections 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.748+0000 7f6f0c007640 1 -- 172.21.15.137:0/338693065 wait complete. 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0c007640 1 Processor -- start 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0c007640 1 -- start start 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0c007640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040b3300 0x7f6f040b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0c007640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f040d1170 0x7f6f0406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0c007640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f041631f0 0x7f6f040b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0c007640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f040d0230 con 0x7f6f041631f0 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0c007640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6f040d2000 con 0x7f6f040d1170 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0c007640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6f040b6160 con 0x7f6f040b3300 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0a5a4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f041631f0 0x7f6f040b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0a5a4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f041631f0 0x7f6f040b5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34056/0 (socket says 172.21.15.137:34056) 2024-04-26T22:00:55.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f0a5a4640 1 -- 172.21.15.137:0/3659527816 learned_addr learned my addr 172.21.15.137:0/3659527816 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f095a2640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f040d1170 0x7f6f0406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.749+0000 7f6f09da3640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040b3300 0x7f6f040b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f0a5a4640 1 -- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040b3300 msgr2=0x7f6f040b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f0a5a4640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040b3300 0x7f6f040b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f0a5a4640 1 -- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f040d1170 msgr2=0x7f6f0406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f0a5a4640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f040d1170 0x7f6f0406dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f0a5a4640 1 -- 172.21.15.137:0/3659527816 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f040b7b70 con 0x7f6f041631f0 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f09da3640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040b3300 0x7f6f040b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f095a2640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f040d1170 0x7f6f0406dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f0a5a4640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f041631f0 0x7f6f040b5780 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009e20 tx=0x7f6efc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6efa7fc640 1 -- 172.21.15.137:0/3659527816 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc03f020 con 0x7f6f041631f0 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6efa7fc640 1 -- 172.21.15.137:0/3659527816 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6efc037040 con 0x7f6f041631f0 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f040b7e50 con 0x7f6f041631f0 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6efa7fc640 1 -- 172.21.15.137:0/3659527816 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc036070 con 0x7f6f041631f0 2024-04-26T22:00:55.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.750+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f040b7790 con 0x7f6f041631f0 2024-04-26T22:00:55.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.751+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f0406a290 con 0x7f6f041631f0 2024-04-26T22:00:55.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.751+0000 7f6efa7fc640 1 -- 172.21.15.137:0/3659527816 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6efc042020 con 0x7f6f041631f0 2024-04-26T22:00:55.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.752+0000 7f6efa7fc640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ee806c8f0 0x7f6ee806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:55.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.752+0000 7f6efa7fc640 1 -- 172.21.15.137:0/3659527816 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f6efc0ac060 con 0x7f6f041631f0 2024-04-26T22:00:55.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.752+0000 7f6f09da3640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ee806c8f0 0x7f6ee806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:55.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.752+0000 7f6f09da3640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ee806c8f0 0x7f6ee806edb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6f00006fd0 tx=0x7f6f00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:55.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.756+0000 7f6efa7fc640 1 -- 172.21.15.137:0/3659527816 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6efc049030 con 0x7f6f041631f0 2024-04-26T22:00:55.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.932+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f04076020 con 0x7f6f041631f0 2024-04-26T22:00:55.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.932+0000 7f6efa7fc640 1 -- 172.21.15.137:0/3659527816 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) ==== 93+0+10 (secure 0 0 0) 0x7f6efc07a450 con 0x7f6f041631f0 2024-04-26T22:00:55.932 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:00:55.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ee806c8f0 msgr2=0x7f6ee806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ee806c8f0 0x7f6ee806edb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6f00006fd0 tx=0x7f6f00008040 comp rx=0 tx=0).stop 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f041631f0 msgr2=0x7f6f040b5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f041631f0 0x7f6f040b5780 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009e20 tx=0x7f6efc004a40 comp rx=0 tx=0).stop 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 shutdown_connections 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ee806c8f0 0x7f6ee806edb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f041631f0 0x7f6f040b5780 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f040d1170 0x7f6f0406dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 --2- 172.21.15.137:0/3659527816 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f040b3300 0x7f6f040b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 >> 172.21.15.137:0/3659527816 conn(0x7f6f0409ba40 msgr2=0x7f6f04070380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 shutdown_connections 2024-04-26T22:00:55.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:55.934+0000 7f6f0c007640 1 -- 172.21.15.137:0/3659527816 wait complete. 2024-04-26T22:00:55.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:00:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.045+0000 7fa3e56b1640 1 Processor -- start 2024-04-26T22:00:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.045+0000 7fa3e56b1640 1 -- start start 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.045+0000 7fa3e56b1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 0x7fa3e00b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.045+0000 7fa3e56b1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa3e01638b0 0x7fa3e00b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.045+0000 7fa3e56b1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e0148390 con 0x7fa3e0147fb0 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.045+0000 7fa3e56b1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e0163e20 con 0x7fa3e01638b0 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.045+0000 7fa3e56b1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e00b59f0 con 0x7fa3e006c9b0 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3df7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa3e01638b0 0x7fa3e00b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3df7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa3e01638b0 0x7fa3e00b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34060/0 (socket says 172.21.15.137:34060) 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3deffd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa3e0147fb0 0x7fa3e006c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:35322/0 (socket says 172.21.15.137:35322) 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3d67fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 0x7fa3e00b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3df7fe640 1 -- 172.21.15.137:0/1154206533 learned_addr learned my addr 172.21.15.137:0/1154206533 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3df7fe640 1 -- 172.21.15.137:0/1154206533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 msgr2=0x7fa3e00b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3df7fe640 1 --2- 172.21.15.137:0/1154206533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 0x7fa3e00b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3df7fe640 1 -- 172.21.15.137:0/1154206533 >> v1:172.21.15.170:6789/0 conn(0x7fa3e0147fb0 legacy=0x7fa3e006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3df7fe640 1 -- 172.21.15.137:0/1154206533 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e006fe90 con 0x7fa3e01638b0 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.046+0000 7fa3df7fe640 1 --2- 172.21.15.137:0/1154206533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e01638b0 0x7fa3e00b63c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009e50 tx=0x7fa3d802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209580daec27b361 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3de7fc640 1 -- 172.21.15.137:0/1154206533 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8036070 con 0x7fa3e01638b0 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3de7fc640 1 -- 172.21.15.137:0/1154206533 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d8031600 con 0x7fa3e01638b0 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3de7fc640 1 -- 172.21.15.137:0/1154206533 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80319d0 con 0x7fa3e01638b0 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3e56b1640 1 -- 172.21.15.137:0/1154206533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e01638b0 msgr2=0x7fa3e00b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3e56b1640 1 --2- 172.21.15.137:0/1154206533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e01638b0 0x7fa3e00b63c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009e50 tx=0x7fa3d802a680 comp rx=0 tx=0).stop 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3e56b1640 1 -- 172.21.15.137:0/1154206533 shutdown_connections 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3e56b1640 1 --2- 172.21.15.137:0/1154206533 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e01638b0 0x7fa3e00b63c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3e56b1640 1 --2- 172.21.15.137:0/1154206533 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 0x7fa3e00b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3e56b1640 1 -- 172.21.15.137:0/1154206533 >> 172.21.15.137:0/1154206533 conn(0x7fa3e00d1e90 msgr2=0x7fa3e00d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3e56b1640 1 -- 172.21.15.137:0/1154206533 shutdown_connections 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.047+0000 7fa3e56b1640 1 -- 172.21.15.137:0/1154206533 wait complete. 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.048+0000 7fa3e56b1640 1 Processor -- start 2024-04-26T22:00:56.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3e56b1640 1 -- start start 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3e56b1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 0x7fa3e01f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3e56b1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e0147fb0 0x7fa3e01f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3e56b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e01638b0 0x7fa3e00b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3e56b1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0148cd0 con 0x7fa3e0147fb0 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3e56b1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0070450 con 0x7fa3e01638b0 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3e56b1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e0148e50 con 0x7fa3e006c9b0 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3d67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e0147fb0 0x7fa3e01f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3d67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e0147fb0 0x7fa3e01f54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34062/0 (socket says 172.21.15.137:34062) 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.049+0000 7fa3d67fc640 1 -- 172.21.15.137:0/4108130683 learned_addr learned my addr 172.21.15.137:0/4108130683 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3deffd640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 0x7fa3e01f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3df7fe640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e01638b0 0x7fa3e00b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3d67fc640 1 -- 172.21.15.137:0/4108130683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 msgr2=0x7fa3e01f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3d67fc640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 0x7fa3e01f6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3d67fc640 1 -- 172.21.15.137:0/4108130683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e01638b0 msgr2=0x7fa3e00b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3d67fc640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e01638b0 0x7fa3e00b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3d67fc640 1 -- 172.21.15.137:0/4108130683 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e0160bd0 con 0x7fa3e0147fb0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3d67fc640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e0147fb0 0x7fa3e01f54d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800e9e0 tx=0x7fa3c800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3d7fff640 1 -- 172.21.15.137:0/4108130683 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8017070 con 0x7fa3e0147fb0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3d7fff640 1 -- 172.21.15.137:0/4108130683 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c800c9d0 con 0x7fa3e0147fb0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e01f5a10 con 0x7fa3e0147fb0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3d7fff640 1 -- 172.21.15.137:0/4108130683 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800cdc0 con 0x7fa3e0147fb0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.050+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e0160610 con 0x7fa3e0147fb0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.051+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e00693d0 con 0x7fa3e0147fb0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.051+0000 7fa3d7fff640 1 -- 172.21.15.137:0/4108130683 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3c801a070 con 0x7fa3e0147fb0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.052+0000 7fa3d7fff640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa3c006c920 0x7fa3c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.052+0000 7fa3d7fff640 1 -- 172.21.15.137:0/4108130683 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fa3c808bc30 con 0x7fa3e0147fb0 2024-04-26T22:00:56.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.052+0000 7fa3deffd640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa3c006c920 0x7fa3c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.052+0000 7fa3deffd640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa3c006c920 0x7fa3c006ede0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000f60 tx=0x7fa3d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:56.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.056+0000 7fa3d7fff640 1 -- 172.21.15.137:0/4108130683 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa3e0160bd0 con 0x7fa3e0147fb0 2024-04-26T22:00:56.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.232+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa3e00b52e0 con 0x7fa3e0147fb0 2024-04-26T22:00:56.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.233+0000 7fa3d7fff640 1 -- 172.21.15.137:0/4108130683 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) ==== 104+0+11 (secure 0 0 0) 0x7fa3c805a020 con 0x7fa3e0147fb0 2024-04-26T22:00:56.233 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:00:56.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa3c006c920 msgr2=0x7fa3c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa3c006c920 0x7fa3c006ede0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0000f60 tx=0x7fa3d0009040 comp rx=0 tx=0).stop 2024-04-26T22:00:56.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e0147fb0 msgr2=0x7fa3e01f54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e0147fb0 0x7fa3e01f54d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800e9e0 tx=0x7fa3c800eea0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 shutdown_connections 2024-04-26T22:00:56.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa3c006c920 0x7fa3c006ede0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3e0147fb0 0x7fa3e01f54d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3e01638b0 0x7fa3e00b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 --2- 172.21.15.137:0/4108130683 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3e006c9b0 0x7fa3e01f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 >> 172.21.15.137:0/4108130683 conn(0x7fa3e00d1e90 msgr2=0x7fa3e0142610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:56.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 shutdown_connections 2024-04-26T22:00:56.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.235+0000 7fa3e56b1640 1 -- 172.21.15.137:0/4108130683 wait complete. 2024-04-26T22:00:56.246 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:00:56.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.345+0000 7f8530f19640 1 Processor -- start 2024-04-26T22:00:56.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.345+0000 7f8530f19640 1 -- start start 2024-04-26T22:00:56.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.346+0000 7f8530f19640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f852c0d3820 0x7f852c0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.346+0000 7f8530f19640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c0b60b0 0x7f852c0d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.346+0000 7f8530f19640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f852c0d3c90 con 0x7f852c15f680 2024-04-26T22:00:56.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.346+0000 7f8530f19640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f852c15fa60 con 0x7f852c0d3820 2024-04-26T22:00:56.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.346+0000 7f8530f19640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f852c0d3f50 con 0x7f852c0b60b0 2024-04-26T22:00:56.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f852ad9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c0b60b0 0x7f852c0d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f8529d9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f852c0d3820 0x7f852c0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f8529d9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f852c0d3820 0x7f852c0b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54698/0 (socket says 172.21.15.137:54698) 2024-04-26T22:00:56.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f8529d9b640 1 -- 172.21.15.137:0/857710735 learned_addr learned my addr 172.21.15.137:0/857710735 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:56.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f852ad9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c0b60b0 0x7f852c0d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:53626/0 (socket says 172.21.15.137:53626) 2024-04-26T22:00:56.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f852a59c640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f852c15f680 0x7f852c163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:35338/0 (socket says 172.21.15.137:35338) 2024-04-26T22:00:56.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f852ad9d640 1 -- 172.21.15.137:0/857710735 >> v2:172.21.15.170:3300/0 conn(0x7f852c0d3820 msgr2=0x7f852c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:56.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f852ad9d640 1 --2- 172.21.15.137:0/857710735 >> v2:172.21.15.170:3300/0 conn(0x7f852c0d3820 0x7f852c0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f852ad9d640 1 -- 172.21.15.137:0/857710735 >> v1:172.21.15.170:6789/0 conn(0x7f852c15f680 legacy=0x7f852c163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f852ad9d640 1 -- 172.21.15.137:0/857710735 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c0b5090 con 0x7f852c0b60b0 2024-04-26T22:00:56.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.347+0000 7f8529d9b640 1 --2- 172.21.15.137:0/857710735 >> v2:172.21.15.170:3300/0 conn(0x7f852c0d3820 0x7f852c0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:56.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.348+0000 7f852ad9d640 1 --2- 172.21.15.137:0/857710735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c0b60b0 0x7f852c0d4f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85240097a0 tx=0x7f852402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff72ce6396f5dc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:56.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.348+0000 7f852959a640 1 -- 172.21.15.137:0/857710735 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524037070 con 0x7f852c0b60b0 2024-04-26T22:00:56.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.348+0000 7f852959a640 1 -- 172.21.15.137:0/857710735 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8524032440 con 0x7f852c0b60b0 2024-04-26T22:00:56.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.348+0000 7f852959a640 1 -- 172.21.15.137:0/857710735 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8524032810 con 0x7f852c0b60b0 2024-04-26T22:00:56.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.349+0000 7f8530f19640 1 -- 172.21.15.137:0/857710735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c0b60b0 msgr2=0x7f852c0d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.349+0000 7f8530f19640 1 --2- 172.21.15.137:0/857710735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c0b60b0 0x7f852c0d4f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85240097a0 tx=0x7f852402a180 comp rx=0 tx=0).stop 2024-04-26T22:00:56.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.349+0000 7f8530f19640 1 -- 172.21.15.137:0/857710735 shutdown_connections 2024-04-26T22:00:56.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.349+0000 7f8530f19640 1 --2- 172.21.15.137:0/857710735 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c0b60b0 0x7f852c0d4f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.349+0000 7f8530f19640 1 --2- 172.21.15.137:0/857710735 >> v2:172.21.15.170:3300/0 conn(0x7f852c0d3820 0x7f852c0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.349+0000 7f8530f19640 1 -- 172.21.15.137:0/857710735 >> 172.21.15.137:0/857710735 conn(0x7f852c08eca0 msgr2=0x7f852c09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:56.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.349+0000 7f8530f19640 1 -- 172.21.15.137:0/857710735 shutdown_connections 2024-04-26T22:00:56.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.349+0000 7f8530f19640 1 -- 172.21.15.137:0/857710735 wait complete. 2024-04-26T22:00:56.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.350+0000 7f8530f19640 1 Processor -- start 2024-04-26T22:00:56.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.350+0000 7f8530f19640 1 -- start start 2024-04-26T22:00:56.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8530f19640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f852c0b60b0 0x7f852c1f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8530f19640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c0d3820 0x7f852c0cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8530f19640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c15f680 0x7f852c1f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8530f19640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f852c0d55e0 con 0x7f852c0d3820 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8530f19640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f852c0d5460 con 0x7f852c0b60b0 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8530f19640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f852c0d5760 con 0x7f852c15f680 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8529d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c0d3820 0x7f852c0cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8529d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c0d3820 0x7f852c0cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34068/0 (socket says 172.21.15.137:34068) 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8529d9b640 1 -- 172.21.15.137:0/3251737871 learned_addr learned my addr 172.21.15.137:0/3251737871 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f852ad9d640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c15f680 0x7f852c1f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f852a59c640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f852c0b60b0 0x7f852c1f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8529d9b640 1 -- 172.21.15.137:0/3251737871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c15f680 msgr2=0x7f852c1f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8529d9b640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c15f680 0x7f852c1f8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8529d9b640 1 -- 172.21.15.137:0/3251737871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f852c0b60b0 msgr2=0x7f852c1f6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8529d9b640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f852c0b60b0 0x7f852c1f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8529d9b640 1 -- 172.21.15.137:0/3251737871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c15aef0 con 0x7f852c0d3820 2024-04-26T22:00:56.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8529d9b640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c0d3820 0x7f852c0cc460 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f852000e9d0 tx=0x7f852000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:56.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f851affd640 1 -- 172.21.15.137:0/3251737871 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8520017070 con 0x7f852c0d3820 2024-04-26T22:00:56.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f851affd640 1 -- 172.21.15.137:0/3251737871 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852000ca60 con 0x7f852c0d3820 2024-04-26T22:00:56.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.351+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852c15b1d0 con 0x7f852c0d3820 2024-04-26T22:00:56.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.352+0000 7f851affd640 1 -- 172.21.15.137:0/3251737871 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852000ce10 con 0x7f852c0d3820 2024-04-26T22:00:56.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.352+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852c15b790 con 0x7f852c0d3820 2024-04-26T22:00:56.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.353+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f852c06a290 con 0x7f852c0d3820 2024-04-26T22:00:56.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.353+0000 7f851affd640 1 -- 172.21.15.137:0/3251737871 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f852001a070 con 0x7f852c0d3820 2024-04-26T22:00:56.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.353+0000 7f851affd640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f850c06c8f0 0x7f850c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.354+0000 7f852a59c640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f850c06c8f0 0x7f850c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.354+0000 7f851affd640 1 -- 172.21.15.137:0/3251737871 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f852008bed0 con 0x7f852c0d3820 2024-04-26T22:00:56.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.354+0000 7f852a59c640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f850c06c8f0 0x7f850c06edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f851c0012e0 tx=0x7f851c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:56.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.358+0000 7f851affd640 1 -- 172.21.15.137:0/3251737871 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f852005a2c0 con 0x7f852c0d3820 2024-04-26T22:00:56.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.531+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f852c0d2680 con 0x7f852c0d3820 2024-04-26T22:00:56.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.532+0000 7f851affd640 1 -- 172.21.15.137:0/3251737871 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) ==== 100+0+11 (secure 0 0 0) 0x7f8520059bc0 con 0x7f852c0d3820 2024-04-26T22:00:56.532 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:00:56.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f850c06c8f0 msgr2=0x7f850c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f850c06c8f0 0x7f850c06edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f851c0012e0 tx=0x7f851c009040 comp rx=0 tx=0).stop 2024-04-26T22:00:56.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c0d3820 msgr2=0x7f852c0cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c0d3820 0x7f852c0cc460 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f852000e9d0 tx=0x7f852000ee90 comp rx=0 tx=0).stop 2024-04-26T22:00:56.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 shutdown_connections 2024-04-26T22:00:56.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f850c06c8f0 0x7f850c06edb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f852c0d3820 0x7f852c0cc460 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f852c15f680 0x7f852c1f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 --2- 172.21.15.137:0/3251737871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f852c0b60b0 0x7f852c1f6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 >> 172.21.15.137:0/3251737871 conn(0x7f852c08eca0 msgr2=0x7f852c0b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:56.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 shutdown_connections 2024-04-26T22:00:56.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.534+0000 7f8530f19640 1 -- 172.21.15.137:0/3251737871 wait complete. 2024-04-26T22:00:56.545 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:00:56.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.642+0000 7f593c4d3640 1 Processor -- start 2024-04-26T22:00:56.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.642+0000 7f593c4d3640 1 -- start start 2024-04-26T22:00:56.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f593c4d3640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f59340b61a0 0x7f5934160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f593c4d3640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f59340b3de0 0x7f59340720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f593c4d3640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59340b4270 con 0x7f5934145980 2024-04-26T22:00:56.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f593c4d3640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f59340b5140 con 0x7f59340b61a0 2024-04-26T22:00:56.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f593c4d3640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f59340b4530 con 0x7f59340b3de0 2024-04-26T22:00:56.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f5939a6e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f59340b61a0 0x7f5934160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f5939a6e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f59340b61a0 0x7f5934160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34084/0 (socket says 172.21.15.137:34084) 2024-04-26T22:00:56.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f5939a6e640 1 -- 172.21.15.137:0/3641160599 learned_addr learned my addr 172.21.15.137:0/3641160599 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:56.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f593aa70640 1 --2- 172.21.15.137:0/3641160599 >> v2:172.21.15.170:3300/0 conn(0x7f59340b3de0 0x7f59340720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f5939a6e640 1 -- 172.21.15.137:0/3641160599 >> v2:172.21.15.170:3300/0 conn(0x7f59340b3de0 msgr2=0x7f59340720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:56.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f5939a6e640 1 --2- 172.21.15.137:0/3641160599 >> v2:172.21.15.170:3300/0 conn(0x7f59340b3de0 0x7f59340720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f5939a6e640 1 -- 172.21.15.137:0/3641160599 >> v1:172.21.15.170:6789/0 conn(0x7f5934145980 legacy=0x7f59340b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.643+0000 7f5939a6e640 1 -- 172.21.15.137:0/3641160599 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59340b4810 con 0x7f59340b61a0 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.644+0000 7f5939a6e640 1 --2- 172.21.15.137:0/3641160599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b61a0 0x7f5934160630 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f59340b52c0 tx=0x7f592402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13fd829c81571ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.644+0000 7f593926d640 1 -- 172.21.15.137:0/3641160599 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924037070 con 0x7f59340b61a0 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.644+0000 7f593926d640 1 -- 172.21.15.137:0/3641160599 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5924032440 con 0x7f59340b61a0 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.644+0000 7f593926d640 1 -- 172.21.15.137:0/3641160599 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924032810 con 0x7f59340b61a0 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.645+0000 7f593c4d3640 1 -- 172.21.15.137:0/3641160599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b61a0 msgr2=0x7f5934160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.645+0000 7f593c4d3640 1 --2- 172.21.15.137:0/3641160599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b61a0 0x7f5934160630 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f59340b52c0 tx=0x7f592402a1e0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.645+0000 7f593c4d3640 1 -- 172.21.15.137:0/3641160599 shutdown_connections 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.645+0000 7f593c4d3640 1 --2- 172.21.15.137:0/3641160599 >> v2:172.21.15.170:3300/0 conn(0x7f59340b3de0 0x7f59340720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.645+0000 7f593c4d3640 1 --2- 172.21.15.137:0/3641160599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b61a0 0x7f5934160630 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.645+0000 7f593c4d3640 1 -- 172.21.15.137:0/3641160599 >> 172.21.15.137:0/3641160599 conn(0x7f59340d0d30 msgr2=0x7f59340d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:56.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.645+0000 7f593c4d3640 1 -- 172.21.15.137:0/3641160599 shutdown_connections 2024-04-26T22:00:56.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.645+0000 7f593c4d3640 1 -- 172.21.15.137:0/3641160599 wait complete. 2024-04-26T22:00:56.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.646+0000 7f593c4d3640 1 Processor -- start 2024-04-26T22:00:56.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.646+0000 7f593c4d3640 1 -- start start 2024-04-26T22:00:56.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.646+0000 7f593c4d3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b3de0 0x7f59340b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.646+0000 7f593c4d3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59340b61a0 0x7f59341f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593c4d3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5934145980 0x7f59341e54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593c4d3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5934072610 con 0x7f59340b3de0 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593c4d3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f59340b4dd0 con 0x7f5934145980 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593c4d3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5934072790 con 0x7f59340b61a0 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593a26f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b3de0 0x7f59340b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593a26f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b3de0 0x7f59340b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34088/0 (socket says 172.21.15.137:34088) 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593a26f640 1 -- 172.21.15.137:0/509330190 learned_addr learned my addr 172.21.15.137:0/509330190 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593a26f640 1 -- 172.21.15.137:0/509330190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59340b61a0 msgr2=0x7f59341f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593a26f640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59340b61a0 0x7f59341f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593a26f640 1 -- 172.21.15.137:0/509330190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5934145980 msgr2=0x7f59341e54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593aa70640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5934145980 0x7f59341e54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593a26f640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5934145980 0x7f59341e54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593a26f640 1 -- 172.21.15.137:0/509330190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59340b21a0 con 0x7f59340b3de0 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593a26f640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b3de0 0x7f59340b1bc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f593000c3f0 tx=0x7f593000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:56.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f592affd640 1 -- 172.21.15.137:0/509330190 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59300052d0 con 0x7f59340b3de0 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f592affd640 1 -- 172.21.15.137:0/509330190 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5930005470 con 0x7f59340b3de0 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f592affd640 1 -- 172.21.15.137:0/509330190 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5930007260 con 0x7f59340b3de0 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59340b2480 con 0x7f59340b3de0 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.647+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59340b2a40 con 0x7f59340b3de0 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.648+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593406a290 con 0x7f59340b3de0 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.649+0000 7f592affd640 1 -- 172.21.15.137:0/509330190 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5930007400 con 0x7f59340b3de0 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.649+0000 7f592affd640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f591806c8f0 0x7f591806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.649+0000 7f592affd640 1 -- 172.21.15.137:0/509330190 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f593008b030 con 0x7f59340b3de0 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.649+0000 7f5939a6e640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f591806c8f0 0x7f591806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:56.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.650+0000 7f5939a6e640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f591806c8f0 0x7f591806edb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5924034000 tx=0x7f592402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:56.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.654+0000 7f592affd640 1 -- 172.21.15.137:0/509330190 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5930059420 con 0x7f59340b3de0 2024-04-26T22:00:56.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.839+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5934073cc0 con 0x7f59340b3de0 2024-04-26T22:00:56.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.840+0000 7f592affd640 1 -- 172.21.15.137:0/509330190 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) ==== 80+0+0 (secure 0 0 0) 0x7f5930058d20 con 0x7f59340b3de0 2024-04-26T22:00:56.840 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.841+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f591806c8f0 msgr2=0x7f591806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.841+0000 7f593c4d3640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f591806c8f0 0x7f591806edb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5924034000 tx=0x7f592402c000 comp rx=0 tx=0).stop 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.841+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b3de0 msgr2=0x7f59340b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.841+0000 7f593c4d3640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b3de0 0x7f59340b1bc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f593000c3f0 tx=0x7f593000c8b0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.841+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 shutdown_connections 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.841+0000 7f593c4d3640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f591806c8f0 0x7f591806edb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.841+0000 7f593c4d3640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5934145980 0x7f59341e54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.842+0000 7f593c4d3640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59340b61a0 0x7f59341f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.842+0000 7f593c4d3640 1 --2- 172.21.15.137:0/509330190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59340b3de0 0x7f59340b1bc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:56.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.842+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 >> 172.21.15.137:0/509330190 conn(0x7f59340d0d30 msgr2=0x7f59340d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:56.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.842+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 shutdown_connections 2024-04-26T22:00:56.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:56.842+0000 7f593c4d3640 1 -- 172.21.15.137:0/509330190 wait complete. 2024-04-26T22:00:56.852 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:00:56.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:56.853 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:00:56.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:00:56.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:00:56.899 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:00:56.924 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:00:56.924 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:00:56.924 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:56.941 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:00:56.942 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:00:56.942 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:00:56.942 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:56.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:00:56.981 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:00:56.981 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:00:56.981 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:00:56.997 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:00:56.998 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:57.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.118+0000 7fda825bf640 1 Processor -- start 2024-04-26T22:00:57.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.118+0000 7fda825bf640 1 -- start start 2024-04-26T22:00:57.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda825bf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c145970 0x7fda7c073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda825bf640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fda7c0ae8b0 0x7fda7c163950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda825bf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda7c0b3af0 0x7fda7c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda825bf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fda7c0aed10 con 0x7fda7c0b3af0 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda825bf640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fda7c145d50 con 0x7fda7c0ae8b0 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda825bf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fda7c0cfaf0 con 0x7fda7c145970 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda80b5c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda7c0b3af0 0x7fda7c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda80b5c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda7c0b3af0 0x7fda7c0b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34092/0 (socket says 172.21.15.137:34092) 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda80b5c640 1 -- 172.21.15.137:0/3032730042 learned_addr learned my addr 172.21.15.137:0/3032730042 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda7b7fe640 1 --2- 172.21.15.137:0/3032730042 >> v2:172.21.15.170:3300/0 conn(0x7fda7c0ae8b0 0x7fda7c163950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda7bfff640 1 --2- 172.21.15.137:0/3032730042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c145970 0x7fda7c073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda80b5c640 1 -- 172.21.15.137:0/3032730042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c145970 msgr2=0x7fda7c073ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda80b5c640 1 --2- 172.21.15.137:0/3032730042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c145970 0x7fda7c073ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda80b5c640 1 -- 172.21.15.137:0/3032730042 >> v2:172.21.15.170:3300/0 conn(0x7fda7c0ae8b0 msgr2=0x7fda7c163950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda80b5c640 1 --2- 172.21.15.137:0/3032730042 >> v2:172.21.15.170:3300/0 conn(0x7fda7c0ae8b0 0x7fda7c163950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.119+0000 7fda80b5c640 1 -- 172.21.15.137:0/3032730042 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c0cfdd0 con 0x7fda7c0b3af0 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda80b5c640 1 --2- 172.21.15.137:0/3032730042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 0x7fda7c0b3f80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fda74009e50 tx=0x7fda7402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9717736eacdb919d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda7affd640 1 -- 172.21.15.137:0/3032730042 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda74036070 con 0x7fda7c0b3af0 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda7affd640 1 -- 172.21.15.137:0/3032730042 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda74031600 con 0x7fda7c0b3af0 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda7affd640 1 -- 172.21.15.137:0/3032730042 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda740319d0 con 0x7fda7c0b3af0 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda825bf640 1 -- 172.21.15.137:0/3032730042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 msgr2=0x7fda7c0b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda825bf640 1 --2- 172.21.15.137:0/3032730042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 0x7fda7c0b3f80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fda74009e50 tx=0x7fda7402a6c0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda825bf640 1 -- 172.21.15.137:0/3032730042 shutdown_connections 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda825bf640 1 --2- 172.21.15.137:0/3032730042 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 0x7fda7c0b3f80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda825bf640 1 --2- 172.21.15.137:0/3032730042 >> v2:172.21.15.170:3300/0 conn(0x7fda7c0ae8b0 0x7fda7c163950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda825bf640 1 --2- 172.21.15.137:0/3032730042 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c145970 0x7fda7c073ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.120+0000 7fda825bf640 1 -- 172.21.15.137:0/3032730042 >> 172.21.15.137:0/3032730042 conn(0x7fda7c0ce8b0 msgr2=0x7fda7c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.121+0000 7fda825bf640 1 -- 172.21.15.137:0/3032730042 shutdown_connections 2024-04-26T22:00:57.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.121+0000 7fda825bf640 1 -- 172.21.15.137:0/3032730042 wait complete. 2024-04-26T22:00:57.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.122+0000 7fda825bf640 1 Processor -- start 2024-04-26T22:00:57.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.122+0000 7fda825bf640 1 -- start start 2024-04-26T22:00:57.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.122+0000 7fda825bf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c0ae8b0 0x7fda7c0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.122+0000 7fda825bf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 0x7fda7c162150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.122+0000 7fda825bf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7c145970 0x7fda7c0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.122+0000 7fda825bf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c06f8f0 con 0x7fda7c0b3af0 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.122+0000 7fda825bf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c06f3d0 con 0x7fda7c145970 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.122+0000 7fda825bf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fda7c06fa70 con 0x7fda7c0ae8b0 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 0x7fda7c162150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 0x7fda7c162150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34102/0 (socket says 172.21.15.137:34102) 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7b7fe640 1 -- 172.21.15.137:0/486897673 learned_addr learned my addr 172.21.15.137:0/486897673 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda80b5c640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7c145970 0x7fda7c0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7bfff640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c0ae8b0 0x7fda7c0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7b7fe640 1 -- 172.21.15.137:0/486897673 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c0ae8b0 msgr2=0x7fda7c0c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7b7fe640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c0ae8b0 0x7fda7c0c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7b7fe640 1 -- 172.21.15.137:0/486897673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7c145970 msgr2=0x7fda7c0c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7b7fe640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7c145970 0x7fda7c0c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7b7fe640 1 -- 172.21.15.137:0/486897673 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7c0c8550 con 0x7fda7c0b3af0 2024-04-26T22:00:57.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda80b5c640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7c145970 0x7fda7c0c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:57.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda7b7fe640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 0x7fda7c162150 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fda7000e890 tx=0x7fda7000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:57.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda78ff9640 1 -- 172.21.15.137:0/486897673 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda70017070 con 0x7fda7c0b3af0 2024-04-26T22:00:57.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda78ff9640 1 -- 172.21.15.137:0/486897673 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda7000c940 con 0x7fda7c0b3af0 2024-04-26T22:00:57.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7c0c6f70 con 0x7fda7c0b3af0 2024-04-26T22:00:57.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda78ff9640 1 -- 172.21.15.137:0/486897673 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7000cd10 con 0x7fda7c0b3af0 2024-04-26T22:00:57.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.123+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7c0c7810 con 0x7fda7c0b3af0 2024-04-26T22:00:57.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.124+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7c06a290 con 0x7fda7c0b3af0 2024-04-26T22:00:57.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.125+0000 7fda78ff9640 1 -- 172.21.15.137:0/486897673 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda7001a070 con 0x7fda7c0b3af0 2024-04-26T22:00:57.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.125+0000 7fda78ff9640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda6806c8f0 0x7fda6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.125+0000 7fda78ff9640 1 -- 172.21.15.137:0/486897673 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fda7008bac0 con 0x7fda7c0b3af0 2024-04-26T22:00:57.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.125+0000 7fda7bfff640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda6806c8f0 0x7fda6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.125+0000 7fda7bfff640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda6806c8f0 0x7fda6806edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009970 tx=0x7fda6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:57.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.129+0000 7fda78ff9640 1 -- 172.21.15.137:0/486897673 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fda70059f40 con 0x7fda7c0b3af0 2024-04-26T22:00:57.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.341+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda7c073980 con 0x7fda7c0b3af0 2024-04-26T22:00:57.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.341+0000 7fda78ff9640 1 -- 172.21.15.137:0/486897673 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7fda70059840 con 0x7fda7c0b3af0 2024-04-26T22:00:57.341 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:57.341 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1453946915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1453946915},{"type":"v1","addr":"172.21.15.170:6835","nonce":1453946915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3097952323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3097952323},{"type":"v1","addr":"172.21.15.170:6834","nonce":3097952323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3002187785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3002187785},{"type":"v1","addr":"172.21.15.137:6835","nonce":3002187785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:00:12.224783+0000","modified":"2024-04-26T22:00:14.233247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5592":{"gid":5592,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/924509332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":924509332},{"type":"v1","addr":"172.21.15.137:6837","nonce":924509332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5592,"qdb_cluster":[5592]},"id":3}]} 2024-04-26T22:00:57.342 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 20 2024-04-26T22:00:57.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda6806c8f0 msgr2=0x7fda6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda6806c8f0 0x7fda6806edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009970 tx=0x7fda6c008040 comp rx=0 tx=0).stop 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 msgr2=0x7fda7c162150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 0x7fda7c162150 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fda7000e890 tx=0x7fda7000ed50 comp rx=0 tx=0).stop 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 shutdown_connections 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda6806c8f0 0x7fda6806edb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda7c0b3af0 0x7fda7c162150 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda7c145970 0x7fda7c0c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 --2- 172.21.15.137:0/486897673 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda7c0ae8b0 0x7fda7c0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 >> 172.21.15.137:0/486897673 conn(0x7fda7c0ce8b0 msgr2=0x7fda7c06fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 shutdown_connections 2024-04-26T22:00:57.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.343+0000 7fda825bf640 1 -- 172.21.15.137:0/486897673 wait complete. 2024-04-26T22:00:57.354 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:57.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.451+0000 7fcb4eab0640 1 Processor -- start 2024-04-26T22:00:57.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.451+0000 7fcb4eab0640 1 -- start start 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb4eab0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb48140350 0x7fcb480cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb4eab0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcb48146790 0x7fcb480cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb4eab0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb480d05b0 con 0x7fcb4813ff70 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb4eab0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480d0890 con 0x7fcb48146790 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb4eab0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4806e450 con 0x7fcb48140350 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb4c84c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcb4813ff70 0x7fcb48146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41630/0 (socket says 172.21.15.137:41630) 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb4c84c640 1 -- 172.21.15.137:0/566376702 learned_addr learned my addr 172.21.15.137:0/566376702 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285687992 0 0) 0x7fcb480d05b0 con 0x7fcb4813ff70 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb4d04d640 1 --2- 172.21.15.137:0/566376702 >> v2:172.21.15.170:3300/0 conn(0x7fcb48146790 0x7fcb480cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb38003520 con 0x7fcb4813ff70 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb47fff640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb48140350 0x7fcb480cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3258794603 0 0) 0x7fcb38003520 con 0x7fcb4813ff70 2024-04-26T22:00:57.455 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb48140350 msgr2=0x7fcb480cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb477fe640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb48140350 0x7fcb480cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 >> v2:172.21.15.170:3300/0 conn(0x7fcb48146790 msgr2=0x7fcb480cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb477fe640 1 --2- 172.21.15.137:0/566376702 >> v2:172.21.15.170:3300/0 conn(0x7fcb48146790 0x7fcb480cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4806e730 con 0x7fcb4813ff70 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.452+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fcb3c001670 con 0x7fcb4813ff70 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 >> v1:172.21.15.137:6789/0 conn(0x7fcb4813ff70 legacy=0x7fcb48146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb477fe640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb380039b0 0x7fcb38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb477fe640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb48140350 0x7fcb38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb477fe640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb38004d40 0x7fcb380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480d0890 con 0x7fcb380039b0 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4806e450 con 0x7fcb38004d40 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcb3800b9f0 con 0x7fcb48140350 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb4c84c640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb380039b0 0x7fcb38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb4d04d640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb38004d40 0x7fcb380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb47fff640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb48140350 0x7fcb38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb4c84c640 1 -- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb48140350 msgr2=0x7fcb38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb4c84c640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb48140350 0x7fcb38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb4c84c640 1 -- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb38004d40 msgr2=0x7fcb380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb4c84c640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb38004d40 0x7fcb380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.453+0000 7fcb4c84c640 1 -- 172.21.15.137:0/566376702 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb38003520 con 0x7fcb380039b0 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb4c84c640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb380039b0 0x7fcb38003dd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c240 tx=0x7fcb38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c16388d5d5e160c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c02e070 con 0x7fcb380039b0 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c005af0 con 0x7fcb380039b0 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb477fe640 1 -- 172.21.15.137:0/566376702 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c007d30 con 0x7fcb380039b0 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb4eab0640 1 -- 172.21.15.137:0/566376702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb380039b0 msgr2=0x7fcb38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb4eab0640 1 --2- 172.21.15.137:0/566376702 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb380039b0 0x7fcb38003dd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c240 tx=0x7fcb38005830 comp rx=0 tx=0).stop 2024-04-26T22:00:57.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb4d04d640 1 -- 172.21.15.137:0/566376702 reap_dead start 2024-04-26T22:00:57.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb4eab0640 1 -- 172.21.15.137:0/566376702 shutdown_connections 2024-04-26T22:00:57.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb4eab0640 1 -- 172.21.15.137:0/566376702 >> 172.21.15.137:0/566376702 conn(0x7fcb480d0d30 msgr2=0x7fcb480d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:57.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb4eab0640 1 -- 172.21.15.137:0/566376702 shutdown_connections 2024-04-26T22:00:57.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.454+0000 7fcb4eab0640 1 -- 172.21.15.137:0/566376702 wait complete. 2024-04-26T22:00:57.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.455+0000 7fcb4eab0640 1 Processor -- start 2024-04-26T22:00:57.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.455+0000 7fcb4eab0640 1 -- start start 2024-04-26T22:00:57.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.456+0000 7fcb4eab0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb380039b0 0x7fcb481e8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.456+0000 7fcb4eab0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb48141370 0x7fcb4815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.456+0000 7fcb4eab0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815f9e0 0x7fcb4815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.456+0000 7fcb4eab0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480cf990 con 0x7fcb48141370 2024-04-26T22:00:57.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.456+0000 7fcb4eab0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480cf810 con 0x7fcb4815f9e0 2024-04-26T22:00:57.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.456+0000 7fcb4eab0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcb480cfb10 con 0x7fcb380039b0 2024-04-26T22:00:57.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.456+0000 7fcb47fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb48141370 0x7fcb4815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.456+0000 7fcb47fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb48141370 0x7fcb4815c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34114/0 (socket says 172.21.15.137:34114) 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.456+0000 7fcb47fff640 1 -- 172.21.15.137:0/1905375646 learned_addr learned my addr 172.21.15.137:0/1905375646 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb4c84c640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb380039b0 0x7fcb481e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb4d04d640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815f9e0 0x7fcb4815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb47fff640 1 -- 172.21.15.137:0/1905375646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb380039b0 msgr2=0x7fcb481e8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb47fff640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb380039b0 0x7fcb481e8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb47fff640 1 -- 172.21.15.137:0/1905375646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815f9e0 msgr2=0x7fcb4815fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb47fff640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815f9e0 0x7fcb4815fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb47fff640 1 -- 172.21.15.137:0/1905375646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb481e8710 con 0x7fcb48141370 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb47fff640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb48141370 0x7fcb4815c050 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcb340118e0 tx=0x7fcb34011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb457fa640 1 -- 172.21.15.137:0/1905375646 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400faf0 con 0x7fcb48141370 2024-04-26T22:00:57.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb457fa640 1 -- 172.21.15.137:0/1905375646 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3400fc90 con 0x7fcb48141370 2024-04-26T22:00:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb481e89f0 con 0x7fcb48141370 2024-04-26T22:00:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb457fa640 1 -- 172.21.15.137:0/1905375646 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34014440 con 0x7fcb48141370 2024-04-26T22:00:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.457+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb481e8fb0 con 0x7fcb48141370 2024-04-26T22:00:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.458+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4806a290 con 0x7fcb48141370 2024-04-26T22:00:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.458+0000 7fcb457fa640 1 -- 172.21.15.137:0/1905375646 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb34012040 con 0x7fcb48141370 2024-04-26T22:00:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.459+0000 7fcb457fa640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.459+0000 7fcb457fa640 1 -- 172.21.15.137:0/1905375646 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fcb3408c260 con 0x7fcb48141370 2024-04-26T22:00:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.459+0000 7fcb4c84c640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.459+0000 7fcb4c84c640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c033000 tx=0x7fcb3c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:57.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.463+0000 7fcb457fa640 1 -- 172.21.15.137:0/1905375646 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcb34019030 con 0x7fcb48141370 2024-04-26T22:00:57.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.638+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb48146320 con 0x7fcb48141370 2024-04-26T22:00:57.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.639+0000 7fcb457fa640 1 -- 172.21.15.137:0/1905375646 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16717 (secure 0 0 0) 0x7fcb3405a650 con 0x7fcb48141370 2024-04-26T22:00:57.639 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:57.639 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":48,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:00:23.980977+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:00:10.430051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T22:00:11.181890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 msgr2=0x7fcb2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c033000 tx=0x7fcb3c009030 comp rx=0 tx=0).stop 2024-04-26T22:00:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb48141370 msgr2=0x7fcb4815c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb48141370 0x7fcb4815c050 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcb340118e0 tx=0x7fcb34011da0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 shutdown_connections 2024-04-26T22:00:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb48141370 0x7fcb4815c050 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815f9e0 0x7fcb4815fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 --2- 172.21.15.137:0/1905375646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb380039b0 0x7fcb481e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 >> 172.21.15.137:0/1905375646 conn(0x7fcb480d0d30 msgr2=0x7fcb4813dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 shutdown_connections 2024-04-26T22:00:57.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.641+0000 7fcb4eab0640 1 -- 172.21.15.137:0/1905375646 wait complete. 2024-04-26T22:00:57.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:00:10.430051+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:00:11.181890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:00:57.652 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:00:57.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.753+0000 7f686971c640 1 Processor -- start 2024-04-26T22:00:57.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.753+0000 7f686971c640 1 -- start start 2024-04-26T22:00:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.754+0000 7f686971c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f68640b1ef0 0x7f68640ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.754+0000 7f686971c640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68640d07e0 con 0x7f68640d0090 2024-04-26T22:00:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.754+0000 7f686971c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68640d2090 con 0x7f6864160950 2024-04-26T22:00:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.754+0000 7f686971c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f686409c700 con 0x7f68640b1ef0 2024-04-26T22:00:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.754+0000 7f68627fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f68640d0090 0x7f68640ce030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41644/0 (socket says 172.21.15.137:41644) 2024-04-26T22:00:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.754+0000 7f68627fc640 1 -- 172.21.15.137:0/2247171192 learned_addr learned my addr 172.21.15.137:0/2247171192 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.754+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200008765 0 0) 0x7f68640d07e0 con 0x7f68640d0090 2024-04-26T22:00:57.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.754+0000 7f68637fe640 1 --2- 172.21.15.137:0/2247171192 >> v2:172.21.15.170:3300/0 conn(0x7f68640b1ef0 0x7f68640ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.754+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f684c003520 con 0x7f68640d0090 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3954926246 0 0) 0x7f684c003520 con 0x7f68640d0090 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 >> v2:172.21.15.170:3300/0 conn(0x7f68640b1ef0 msgr2=0x7f68640ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 --2- 172.21.15.137:0/2247171192 >> v2:172.21.15.170:3300/0 conn(0x7f68640b1ef0 0x7f68640ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 >> v1:172.21.15.170:6789/0 conn(0x7f6864160950 legacy=0x7f68640cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68640d1a40 con 0x7f68640d0090 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6858001670 con 0x7f68640d0090 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 >> v1:172.21.15.137:6789/0 conn(0x7f68640d0090 legacy=0x7f68640ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f684c0039b0 0x7f684c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f684c004800 0x7f684c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f684c0051c0 0x7f684c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f686409c700 con 0x7f684c0039b0 2024-04-26T22:00:57.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f684c00c060 con 0x7f684c0051c0 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f684c00c260 con 0x7f684c004800 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6862ffd640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f684c0039b0 0x7f684c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f68627fc640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f684c004800 0x7f684c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f68637fe640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f684c0051c0 0x7f684c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6862ffd640 1 -- 172.21.15.137:0/2247171192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f684c004800 msgr2=0x7f684c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6862ffd640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f684c004800 0x7f684c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6862ffd640 1 -- 172.21.15.137:0/2247171192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f684c0051c0 msgr2=0x7f684c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6862ffd640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f684c0051c0 0x7f684c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f6862ffd640 1 -- 172.21.15.137:0/2247171192 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684c003520 con 0x7f684c0039b0 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.755+0000 7f68637fe640 1 -- 172.21.15.137:0/2247171192 reap_dead start 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f6862ffd640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f684c0039b0 0x7f684c003dd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6854001750 tx=0x7f684c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658790aab838c12c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6854001370 con 0x7f684c0039b0 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68540052d0 con 0x7f684c0039b0 2024-04-26T22:00:57.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f6861ffb640 1 -- 172.21.15.137:0/2247171192 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685402abc0 con 0x7f684c0039b0 2024-04-26T22:00:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f686971c640 1 -- 172.21.15.137:0/2247171192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f684c0039b0 msgr2=0x7f684c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f686971c640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f684c0039b0 0x7f684c003dd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6854001750 tx=0x7f684c005830 comp rx=0 tx=0).stop 2024-04-26T22:00:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f686971c640 1 -- 172.21.15.137:0/2247171192 shutdown_connections 2024-04-26T22:00:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f686971c640 1 --2- 172.21.15.137:0/2247171192 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f684c0039b0 0x7f684c003dd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f686971c640 1 -- 172.21.15.137:0/2247171192 >> 172.21.15.137:0/2247171192 conn(0x7f686409ba40 msgr2=0x7f686409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.756+0000 7f686971c640 1 -- 172.21.15.137:0/2247171192 shutdown_connections 2024-04-26T22:00:57.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.757+0000 7f686971c640 1 -- 172.21.15.137:0/2247171192 wait complete. 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.758+0000 7f686971c640 1 Processor -- start 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.758+0000 7f686971c640 1 -- start start 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.758+0000 7f686971c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f684c0039b0 0x7f68640c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.758+0000 7f686971c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68640c9970 0x7f6864151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.758+0000 7f686971c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686409edc0 0x7f686409f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.758+0000 7f686971c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68640b28f0 con 0x7f68640c9970 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f686971c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6864160d30 con 0x7f686409edc0 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f686971c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f68640b2a70 con 0x7f684c0039b0 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68627fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68640c9970 0x7f6864151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68627fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68640c9970 0x7f6864151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34128/0 (socket says 172.21.15.137:34128) 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68627fc640 1 -- 172.21.15.137:0/2152860205 learned_addr learned my addr 172.21.15.137:0/2152860205 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68637fe640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686409edc0 0x7f686409f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f6862ffd640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f684c0039b0 0x7f68640c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68627fc640 1 -- 172.21.15.137:0/2152860205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f684c0039b0 msgr2=0x7f68640c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68627fc640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f684c0039b0 0x7f68640c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68627fc640 1 -- 172.21.15.137:0/2152860205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686409edc0 msgr2=0x7f686409f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68627fc640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686409edc0 0x7f686409f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68627fc640 1 -- 172.21.15.137:0/2152860205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68640c7a40 con 0x7f68640c9970 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f68627fc640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68640c9970 0x7f6864151480 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6858007290 tx=0x7f6858007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f684b7fe640 1 -- 172.21.15.137:0/2152860205 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685800f8e0 con 0x7f68640c9970 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f684b7fe640 1 -- 172.21.15.137:0/2152860205 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6858018070 con 0x7f68640c9970 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f684b7fe640 1 -- 172.21.15.137:0/2152860205 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685800fce0 con 0x7f68640c9970 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68640c7d20 con 0x7f68640c9970 2024-04-26T22:00:57.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.759+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68640c9dd0 con 0x7f68640c9970 2024-04-26T22:00:57.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.760+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686406a290 con 0x7f68640c9970 2024-04-26T22:00:57.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.761+0000 7f684b7fe640 1 -- 172.21.15.137:0/2152860205 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f685801d460 con 0x7f68640c9970 2024-04-26T22:00:57.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.761+0000 7f684b7fe640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685006c8f0 0x7f685006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:57.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.761+0000 7f684b7fe640 1 -- 172.21.15.137:0/2152860205 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f685808bb40 con 0x7f68640c9970 2024-04-26T22:00:57.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.761+0000 7f6862ffd640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685006c8f0 0x7f685006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:57.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.761+0000 7f6862ffd640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685006c8f0 0x7f685006edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6854032000 tx=0x7f685402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:57.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.765+0000 7f684b7fe640 1 -- 172.21.15.137:0/2152860205 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6858059f30 con 0x7f68640c9970 2024-04-26T22:00:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.940+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f68640b8f10 con 0x7f68640c9970 2024-04-26T22:00:57.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.940+0000 7f684b7fe640 1 -- 172.21.15.137:0/2152860205 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) ==== 93+0+10 (secure 0 0 0) 0x7f6858059830 con 0x7f68640c9970 2024-04-26T22:00:57.941 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:00:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685006c8f0 msgr2=0x7f685006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685006c8f0 0x7f685006edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6854032000 tx=0x7f685402e000 comp rx=0 tx=0).stop 2024-04-26T22:00:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68640c9970 msgr2=0x7f6864151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:57.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68640c9970 0x7f6864151480 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6858007290 tx=0x7f6858007750 comp rx=0 tx=0).stop 2024-04-26T22:00:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 shutdown_connections 2024-04-26T22:00:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685006c8f0 0x7f685006edb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68640c9970 0x7f6864151480 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f686409edc0 0x7f686409f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 --2- 172.21.15.137:0/2152860205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f684c0039b0 0x7f68640c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 >> 172.21.15.137:0/2152860205 conn(0x7f686409ba40 msgr2=0x7f68640b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 shutdown_connections 2024-04-26T22:00:57.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:57.942+0000 7f686971c640 1 -- 172.21.15.137:0/2152860205 wait complete. 2024-04-26T22:00:57.953 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:00:58.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.053+0000 7fc17b914640 1 Processor -- start 2024-04-26T22:00:58.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.053+0000 7fc17b914640 1 -- start start 2024-04-26T22:00:58.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc17b914640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1741400c0 0x7fc1740d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc17b914640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 0x7fc17406c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc17b914640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1740d1ca0 con 0x7fc174073320 2024-04-26T22:00:58.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc17b914640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc1740d0770 con 0x7fc1741400c0 2024-04-26T22:00:58.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc17b914640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc1740740d0 con 0x7fc17406c2a0 2024-04-26T22:00:58.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc1796b0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1741400c0 0x7fc1740d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc1796b0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc1741400c0 0x7fc1740d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34142/0 (socket says 172.21.15.137:34142) 2024-04-26T22:00:58.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc1796b0640 1 -- 172.21.15.137:0/2747378022 learned_addr learned my addr 172.21.15.137:0/2747378022 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:58.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc178eaf640 1 --2- 172.21.15.137:0/2747378022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 0x7fc17406c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc1796b0640 1 -- 172.21.15.137:0/2747378022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 msgr2=0x7fc17406c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:58.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc1796b0640 1 --2- 172.21.15.137:0/2747378022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 0x7fc17406c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc1796b0640 1 -- 172.21.15.137:0/2747378022 >> v1:172.21.15.170:6789/0 conn(0x7fc174073320 legacy=0x7fc174073770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.054+0000 7fc1796b0640 1 -- 172.21.15.137:0/2747378022 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1740d09a0 con 0x7fc1741400c0 2024-04-26T22:00:58.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.055+0000 7fc1796b0640 1 --2- 172.21.15.137:0/2747378022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1741400c0 0x7fc1740d1760 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc170009870 tx=0x7fc17002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240ff81e1895baf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.055+0000 7fc16bfff640 1 -- 172.21.15.137:0/2747378022 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc170037070 con 0x7fc1741400c0 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.055+0000 7fc16bfff640 1 -- 172.21.15.137:0/2747378022 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc170032440 con 0x7fc1741400c0 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.055+0000 7fc16bfff640 1 -- 172.21.15.137:0/2747378022 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc170032810 con 0x7fc1741400c0 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.055+0000 7fc17b914640 1 -- 172.21.15.137:0/2747378022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1741400c0 msgr2=0x7fc1740d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.055+0000 7fc17b914640 1 --2- 172.21.15.137:0/2747378022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1741400c0 0x7fc1740d1760 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc170009870 tx=0x7fc17002a270 comp rx=0 tx=0).stop 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.056+0000 7fc17b914640 1 -- 172.21.15.137:0/2747378022 shutdown_connections 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.056+0000 7fc17b914640 1 --2- 172.21.15.137:0/2747378022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 0x7fc17406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.056+0000 7fc17b914640 1 --2- 172.21.15.137:0/2747378022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc1741400c0 0x7fc1740d1760 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.056+0000 7fc17b914640 1 -- 172.21.15.137:0/2747378022 >> 172.21.15.137:0/2747378022 conn(0x7fc1740d1e90 msgr2=0x7fc1740d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.056+0000 7fc17b914640 1 -- 172.21.15.137:0/2747378022 shutdown_connections 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.056+0000 7fc17b914640 1 -- 172.21.15.137:0/2747378022 wait complete. 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.057+0000 7fc17b914640 1 Processor -- start 2024-04-26T22:00:58.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.057+0000 7fc17b914640 1 -- start start 2024-04-26T22:00:58.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.057+0000 7fc17b914640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 0x7fc1741f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.057+0000 7fc17b914640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc174073320 0x7fc17406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.057+0000 7fc17b914640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1741400c0 0x7fc1740701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.057+0000 7fc17b914640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc1740d0f60 con 0x7fc174073320 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.057+0000 7fc17b914640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc174073e80 con 0x7fc1741400c0 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.057+0000 7fc17b914640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc1740d1240 con 0x7fc17406c2a0 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc178eaf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc174073320 0x7fc17406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc178eaf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc174073320 0x7fc17406fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34154/0 (socket says 172.21.15.137:34154) 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc178eaf640 1 -- 172.21.15.137:0/1808858551 learned_addr learned my addr 172.21.15.137:0/1808858551 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc1796b0640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 0x7fc1741f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc179eb1640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1741400c0 0x7fc1740701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc178eaf640 1 -- 172.21.15.137:0/1808858551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 msgr2=0x7fc1741f6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc178eaf640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 0x7fc1741f6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc178eaf640 1 -- 172.21.15.137:0/1808858551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1741400c0 msgr2=0x7fc1740701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc178eaf640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1741400c0 0x7fc1740701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc178eaf640 1 -- 172.21.15.137:0/1808858551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc174070890 con 0x7fc174073320 2024-04-26T22:00:58.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc178eaf640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc174073320 0x7fc17406fcb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc16400e9e0 tx=0x7fc16400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc169ffb640 1 -- 172.21.15.137:0/1808858551 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164017070 con 0x7fc174073320 2024-04-26T22:00:58.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc169ffb640 1 -- 172.21.15.137:0/1808858551 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16400c9d0 con 0x7fc174073320 2024-04-26T22:00:58.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc174070b70 con 0x7fc174073320 2024-04-26T22:00:58.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc169ffb640 1 -- 172.21.15.137:0/1808858551 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16400cdc0 con 0x7fc174073320 2024-04-26T22:00:58.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.058+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1741455a0 con 0x7fc174073320 2024-04-26T22:00:58.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.059+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1740693d0 con 0x7fc174073320 2024-04-26T22:00:58.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.060+0000 7fc169ffb640 1 -- 172.21.15.137:0/1808858551 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc16401a070 con 0x7fc174073320 2024-04-26T22:00:58.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.060+0000 7fc169ffb640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc15806c8f0 0x7fc15806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.060+0000 7fc169ffb640 1 -- 172.21.15.137:0/1808858551 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fc16408bee0 con 0x7fc174073320 2024-04-26T22:00:58.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.060+0000 7fc1796b0640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc15806c8f0 0x7fc15806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.060+0000 7fc1796b0640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc15806c8f0 0x7fc15806edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc170034000 tx=0x7fc17002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.064+0000 7fc169ffb640 1 -- 172.21.15.137:0/1808858551 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc16405a2d0 con 0x7fc174073320 2024-04-26T22:00:58.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.239+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc17406c7c0 con 0x7fc174073320 2024-04-26T22:00:58.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.240+0000 7fc169ffb640 1 -- 172.21.15.137:0/1808858551 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) ==== 104+0+11 (secure 0 0 0) 0x7fc164059bd0 con 0x7fc174073320 2024-04-26T22:00:58.240 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:00:58.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.241+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc15806c8f0 msgr2=0x7fc15806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.241+0000 7fc17b914640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc15806c8f0 0x7fc15806edb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc170034000 tx=0x7fc17002e000 comp rx=0 tx=0).stop 2024-04-26T22:00:58.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.241+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc174073320 msgr2=0x7fc17406fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.241+0000 7fc17b914640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc174073320 0x7fc17406fcb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc16400e9e0 tx=0x7fc16400eea0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.242+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 shutdown_connections 2024-04-26T22:00:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.242+0000 7fc17b914640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc15806c8f0 0x7fc15806edb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.242+0000 7fc17b914640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc174073320 0x7fc17406fcb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.242+0000 7fc17b914640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1741400c0 0x7fc1740701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.242+0000 7fc17b914640 1 --2- 172.21.15.137:0/1808858551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc17406c2a0 0x7fc1741f6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.242+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 >> 172.21.15.137:0/1808858551 conn(0x7fc1740d1e90 msgr2=0x7fc174140e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.242+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 shutdown_connections 2024-04-26T22:00:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.242+0000 7fc17b914640 1 -- 172.21.15.137:0/1808858551 wait complete. 2024-04-26T22:00:58.252 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:00:58.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.353+0000 7f158059d640 1 Processor -- start 2024-04-26T22:00:58.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.353+0000 7f158059d640 1 -- start start 2024-04-26T22:00:58.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.354+0000 7f158059d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f157815c0e0 0x7f157815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.354+0000 7f158059d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 0x7f157815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.354+0000 7f158059d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15780cff00 con 0x7f157806f020 2024-04-26T22:00:58.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.354+0000 7f158059d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f157815ca00 con 0x7f157815c0e0 2024-04-26T22:00:58.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.354+0000 7f158059d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1578160aa0 con 0x7f157806dac0 2024-04-26T22:00:58.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.355+0000 7f157e339640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f157815c0e0 0x7f157815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.355+0000 7f157eb3a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 0x7f157815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.355+0000 7f157db38640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f157806f020 0x7f157806d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:35366/0 (socket says 172.21.15.137:35366) 2024-04-26T22:00:58.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.355+0000 7f157db38640 1 -- 172.21.15.137:0/1519019812 learned_addr learned my addr 172.21.15.137:0/1519019812 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:58.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.355+0000 7f157e339640 1 -- 172.21.15.137:0/1519019812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 msgr2=0x7f157815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:58.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.355+0000 7f157e339640 1 --2- 172.21.15.137:0/1519019812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 0x7f157815cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.355+0000 7f157e339640 1 -- 172.21.15.137:0/1519019812 >> v1:172.21.15.170:6789/0 conn(0x7f157806f020 legacy=0x7f157806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.355+0000 7f157e339640 1 -- 172.21.15.137:0/1519019812 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157815fe90 con 0x7f157815c0e0 2024-04-26T22:00:58.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.355+0000 7f157eb3a640 1 --2- 172.21.15.137:0/1519019812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 0x7f157815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.356+0000 7f157e339640 1 --2- 172.21.15.137:0/1519019812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157815c0e0 0x7f157815c4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f157400bfa0 tx=0x7f157402c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f749e7724cf1217 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.356+0000 7f157d337640 1 -- 172.21.15.137:0/1519019812 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574039070 con 0x7f157815c0e0 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.356+0000 7f157d337640 1 -- 172.21.15.137:0/1519019812 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1574009540 con 0x7f157815c0e0 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.356+0000 7f157d337640 1 -- 172.21.15.137:0/1519019812 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574009910 con 0x7f157815c0e0 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.356+0000 7f158059d640 1 -- 172.21.15.137:0/1519019812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157815c0e0 msgr2=0x7f157815c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.356+0000 7f158059d640 1 --2- 172.21.15.137:0/1519019812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157815c0e0 0x7f157815c4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f157400bfa0 tx=0x7f157402c860 comp rx=0 tx=0).stop 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.357+0000 7f158059d640 1 -- 172.21.15.137:0/1519019812 shutdown_connections 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.357+0000 7f158059d640 1 --2- 172.21.15.137:0/1519019812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 0x7f157815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.357+0000 7f158059d640 1 --2- 172.21.15.137:0/1519019812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157815c0e0 0x7f157815c4c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.357+0000 7f158059d640 1 -- 172.21.15.137:0/1519019812 >> 172.21.15.137:0/1519019812 conn(0x7f15780d1e40 msgr2=0x7f15780d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.357+0000 7f158059d640 1 -- 172.21.15.137:0/1519019812 shutdown_connections 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.357+0000 7f158059d640 1 -- 172.21.15.137:0/1519019812 wait complete. 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.358+0000 7f158059d640 1 Processor -- start 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.358+0000 7f158059d640 1 -- start start 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.358+0000 7f158059d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 0x7f15781f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.358+0000 7f158059d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157806f020 0x7f1578150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.358+0000 7f158059d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157815c0e0 0x7f15780aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.358+0000 7f158059d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1578160730 con 0x7f157815c0e0 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.358+0000 7f158059d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1578160450 con 0x7f157806f020 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.358+0000 7f158059d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f157806f480 con 0x7f157806dac0 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.358+0000 7f157eb3a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157815c0e0 0x7f15780aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157eb3a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157815c0e0 0x7f15780aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34164/0 (socket says 172.21.15.137:34164) 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157eb3a640 1 -- 172.21.15.137:0/2480859560 learned_addr learned my addr 172.21.15.137:0/2480859560 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157e339640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 0x7f15781f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157db38640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157806f020 0x7f1578150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157eb3a640 1 -- 172.21.15.137:0/2480859560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 msgr2=0x7f15781f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157eb3a640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 0x7f15781f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157eb3a640 1 -- 172.21.15.137:0/2480859560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157806f020 msgr2=0x7f1578150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157eb3a640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157806f020 0x7f1578150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157eb3a640 1 -- 172.21.15.137:0/2480859560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15781f1f40 con 0x7f157815c0e0 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f157eb3a640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157815c0e0 0x7f15780aff00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f157000e8c0 tx=0x7f157000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f156effd640 1 -- 172.21.15.137:0/2480859560 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570017070 con 0x7f157815c0e0 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f156effd640 1 -- 172.21.15.137:0/2480859560 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157000c940 con 0x7f157815c0e0 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15780c6800 con 0x7f157815c0e0 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f156effd640 1 -- 172.21.15.137:0/2480859560 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157000cd10 con 0x7f157815c0e0 2024-04-26T22:00:58.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.359+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15780ca2d0 con 0x7f157815c0e0 2024-04-26T22:00:58.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.360+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15780693d0 con 0x7f157815c0e0 2024-04-26T22:00:58.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.360+0000 7f156effd640 1 -- 172.21.15.137:0/2480859560 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f157001a070 con 0x7f157815c0e0 2024-04-26T22:00:58.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.361+0000 7f156effd640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.361+0000 7f156effd640 1 -- 172.21.15.137:0/2480859560 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f157008bd40 con 0x7f157815c0e0 2024-04-26T22:00:58.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.361+0000 7f157e339640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.361+0000 7f157e339640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1574036000 tx=0x7f157400b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.365+0000 7f156effd640 1 -- 172.21.15.137:0/2480859560 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f15781f1f40 con 0x7f157815c0e0 2024-04-26T22:00:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.540+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f15780b7dc0 con 0x7f157815c0e0 2024-04-26T22:00:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.540+0000 7f156effd640 1 -- 172.21.15.137:0/2480859560 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) ==== 100+0+11 (secure 0 0 0) 0x7f1570059af0 con 0x7f157815c0e0 2024-04-26T22:00:58.541 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:00:58.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 msgr2=0x7f155c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1574036000 tx=0x7f157400b000 comp rx=0 tx=0).stop 2024-04-26T22:00:58.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157815c0e0 msgr2=0x7f15780aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157815c0e0 0x7f15780aff00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f157000e8c0 tx=0x7f157000ed80 comp rx=0 tx=0).stop 2024-04-26T22:00:58.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 shutdown_connections 2024-04-26T22:00:58.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f155c06c8f0 0x7f155c06edb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f157815c0e0 0x7f15780aff00 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157806f020 0x7f1578150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 --2- 172.21.15.137:0/2480859560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f157806dac0 0x7f15781f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 >> 172.21.15.137:0/2480859560 conn(0x7f15780d1e40 msgr2=0x7f1578073910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 shutdown_connections 2024-04-26T22:00:58.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.542+0000 7f158059d640 1 -- 172.21.15.137:0/2480859560 wait complete. 2024-04-26T22:00:58.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:58.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.652+0000 7f7d8b699640 1 Processor -- start 2024-04-26T22:00:58.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.652+0000 7f7d8b699640 1 -- start start 2024-04-26T22:00:58.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d8b699640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d84148a30 0x7f7d84073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d8b699640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d840cfa80 con 0x7f7d840b3af0 2024-04-26T22:00:58.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d8b699640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d840cfd60 con 0x7f7d84160640 2024-04-26T22:00:58.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d8b699640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7d840d0040 con 0x7f7d84148a30 2024-04-26T22:00:58.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d89435640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d84148a30 0x7f7d84073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d89435640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7d84148a30 0x7f7d84073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34178/0 (socket says 172.21.15.137:34178) 2024-04-26T22:00:58.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d89435640 1 -- 172.21.15.137:0/580251144 learned_addr learned my addr 172.21.15.137:0/580251144 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:58.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d89435640 1 -- 172.21.15.137:0/580251144 >> v1:172.21.15.170:6789/0 conn(0x7f7d84160640 legacy=0x7f7d841636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d89435640 1 -- 172.21.15.137:0/580251144 >> v1:172.21.15.137:6789/0 conn(0x7f7d840b3af0 legacy=0x7f7d8406f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.653+0000 7f7d89435640 1 -- 172.21.15.137:0/580251144 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d84162ea0 con 0x7f7d84148a30 2024-04-26T22:00:58.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.654+0000 7f7d89435640 1 --2- 172.21.15.137:0/580251144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84148a30 0x7f7d84073ed0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009870 tx=0x7f7d8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e2d8fa1c9b527a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.654+0000 7f7d7bfff640 1 -- 172.21.15.137:0/580251144 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80037070 con 0x7f7d84148a30 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.654+0000 7f7d7bfff640 1 -- 172.21.15.137:0/580251144 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d80032440 con 0x7f7d84148a30 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.654+0000 7f7d7bfff640 1 -- 172.21.15.137:0/580251144 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80032810 con 0x7f7d84148a30 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.654+0000 7f7d8b699640 1 -- 172.21.15.137:0/580251144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84148a30 msgr2=0x7f7d84073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.654+0000 7f7d8b699640 1 --2- 172.21.15.137:0/580251144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84148a30 0x7f7d84073ed0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009870 tx=0x7f7d8002a270 comp rx=0 tx=0).stop 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.654+0000 7f7d8b699640 1 -- 172.21.15.137:0/580251144 shutdown_connections 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.654+0000 7f7d8b699640 1 --2- 172.21.15.137:0/580251144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84148a30 0x7f7d84073ed0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.654+0000 7f7d8b699640 1 -- 172.21.15.137:0/580251144 >> 172.21.15.137:0/580251144 conn(0x7f7d840ce8b0 msgr2=0x7f7d840cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.655+0000 7f7d8b699640 1 -- 172.21.15.137:0/580251144 shutdown_connections 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.655+0000 7f7d8b699640 1 -- 172.21.15.137:0/580251144 wait complete. 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d8b699640 1 Processor -- start 2024-04-26T22:00:58.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d8b699640 1 -- start start 2024-04-26T22:00:58.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d8b699640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d840b3af0 0x7f7d84139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d8b699640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d84148a30 0x7f7d840b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d8b699640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84160640 0x7f7d841f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d8b699640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84074410 con 0x7f7d84160640 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d8b699640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84163db0 con 0x7f7d84148a30 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d8b699640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7d84074590 con 0x7f7d840b3af0 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d89c36640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84160640 0x7f7d841f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d89c36640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84160640 0x7f7d841f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34188/0 (socket says 172.21.15.137:34188) 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.656+0000 7f7d89c36640 1 -- 172.21.15.137:0/1799870506 learned_addr learned my addr 172.21.15.137:0/1799870506 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d89435640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d840b3af0 0x7f7d84139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d88c34640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d84148a30 0x7f7d840b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d89c36640 1 -- 172.21.15.137:0/1799870506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d840b3af0 msgr2=0x7f7d84139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d89c36640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d840b3af0 0x7f7d84139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d89c36640 1 -- 172.21.15.137:0/1799870506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d84148a30 msgr2=0x7f7d840b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d89c36640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d84148a30 0x7f7d840b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d89c36640 1 -- 172.21.15.137:0/1799870506 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d840b78a0 con 0x7f7d84160640 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d89c36640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84160640 0x7f7d841f8560 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00c7d0 tx=0x7f7d7c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d79ffb640 1 -- 172.21.15.137:0/1799870506 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c003b70 con 0x7f7d84160640 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d79ffb640 1 -- 172.21.15.137:0/1799870506 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7c003d30 con 0x7f7d84160640 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d840b7b80 con 0x7f7d84160640 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d79ffb640 1 -- 172.21.15.137:0/1799870506 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00aa90 con 0x7f7d84160640 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.657+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8415c960 con 0x7f7d84160640 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.658+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8406a290 con 0x7f7d84160640 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.658+0000 7f7d79ffb640 1 -- 172.21.15.137:0/1799870506 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d7c00ac30 con 0x7f7d84160640 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.659+0000 7f7d79ffb640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7d6806c8f0 0x7f7d6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.659+0000 7f7d89435640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7d6806c8f0 0x7f7d6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.659+0000 7f7d79ffb640 1 -- 172.21.15.137:0/1799870506 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f7d7c08b990 con 0x7f7d84160640 2024-04-26T22:00:58.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.659+0000 7f7d89435640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7d6806c8f0 0x7f7d6806edb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7d80034000 tx=0x7f7d8002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.663+0000 7f7d79ffb640 1 -- 172.21.15.137:0/1799870506 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7d7c059730 con 0x7f7d84160640 2024-04-26T22:00:58.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.875+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d840b1aa0 con 0x7f7d84160640 2024-04-26T22:00:58.876 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.876+0000 7f7d79ffb640 1 -- 172.21.15.137:0/1799870506 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7f7d7c05da30 con 0x7f7d84160640 2024-04-26T22:00:58.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:58.876 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1453946915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1453946915},{"type":"v1","addr":"172.21.15.170:6835","nonce":1453946915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3097952323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3097952323},{"type":"v1","addr":"172.21.15.170:6834","nonce":3097952323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3002187785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3002187785},{"type":"v1","addr":"172.21.15.137:6835","nonce":3002187785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:00:12.224783+0000","modified":"2024-04-26T22:00:14.233247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5592":{"gid":5592,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/924509332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":924509332},{"type":"v1","addr":"172.21.15.137:6837","nonce":924509332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5592,"qdb_cluster":[5592]},"id":3}]} 2024-04-26T22:00:58.877 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 20 2024-04-26T22:00:58.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7d6806c8f0 msgr2=0x7f7d6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7d6806c8f0 0x7f7d6806edb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7d80034000 tx=0x7f7d8002e000 comp rx=0 tx=0).stop 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84160640 msgr2=0x7f7d841f8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84160640 0x7f7d841f8560 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00c7d0 tx=0x7f7d7c00cc90 comp rx=0 tx=0).stop 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 shutdown_connections 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7d6806c8f0 0x7f7d6806edb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7d84160640 0x7f7d841f8560 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d84148a30 0x7f7d840b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 --2- 172.21.15.137:0/1799870506 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7d840b3af0 0x7f7d84139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 >> 172.21.15.137:0/1799870506 conn(0x7f7d840ce8b0 msgr2=0x7f7d840b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 shutdown_connections 2024-04-26T22:00:58.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.878+0000 7f7d8b699640 1 -- 172.21.15.137:0/1799870506 wait complete. 2024-04-26T22:00:58.889 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:58.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.986+0000 7f27b27b4640 1 Processor -- start 2024-04-26T22:00:58.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.987+0000 7f27b27b4640 1 -- start start 2024-04-26T22:00:58.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.987+0000 7f27b27b4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27ac145980 0x7f27ac160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.987+0000 7f27b27b4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac0b61a0 0x7f27ac0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.987+0000 7f27b27b4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27ac0b4260 con 0x7f27ac0b3de0 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.987+0000 7f27b27b4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f27ac0b5140 con 0x7f27ac145980 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.987+0000 7f27b27b4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac0b4530 con 0x7f27ac0b61a0 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.987+0000 7f27abfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27ac145980 0x7f27ac160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.987+0000 7f27abfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27ac145980 0x7f27ac160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34190/0 (socket says 172.21.15.137:34190) 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.988+0000 7f27abfff640 1 -- 172.21.15.137:0/1080440630 learned_addr learned my addr 172.21.15.137:0/1080440630 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.988+0000 7f27b0d51640 1 --2- 172.21.15.137:0/1080440630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac0b61a0 0x7f27ac0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.988+0000 7f27abfff640 1 -- 172.21.15.137:0/1080440630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac0b61a0 msgr2=0x7f27ac0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.988+0000 7f27abfff640 1 --2- 172.21.15.137:0/1080440630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac0b61a0 0x7f27ac0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.988+0000 7f27abfff640 1 -- 172.21.15.137:0/1080440630 >> v1:172.21.15.170:6789/0 conn(0x7f27ac0b3de0 legacy=0x7f27ac0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.988+0000 7f27abfff640 1 -- 172.21.15.137:0/1080440630 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac0b4810 con 0x7f27ac145980 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.988+0000 7f27abfff640 1 --2- 172.21.15.137:0/1080440630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac145980 0x7f27ac160630 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f279c009870 tx=0x7f279c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f071ca7fbb99839 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27aaffd640 1 -- 172.21.15.137:0/1080440630 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c037070 con 0x7f27ac145980 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27aaffd640 1 -- 172.21.15.137:0/1080440630 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279c032440 con 0x7f27ac145980 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27aaffd640 1 -- 172.21.15.137:0/1080440630 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c032810 con 0x7f27ac145980 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27b27b4640 1 -- 172.21.15.137:0/1080440630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac145980 msgr2=0x7f27ac160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27b27b4640 1 --2- 172.21.15.137:0/1080440630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac145980 0x7f27ac160630 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f279c009870 tx=0x7f279c02a1c0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27b27b4640 1 -- 172.21.15.137:0/1080440630 shutdown_connections 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27b27b4640 1 --2- 172.21.15.137:0/1080440630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac0b61a0 0x7f27ac0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27b27b4640 1 --2- 172.21.15.137:0/1080440630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac145980 0x7f27ac160630 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27b27b4640 1 -- 172.21.15.137:0/1080440630 >> 172.21.15.137:0/1080440630 conn(0x7f27ac0d0d30 msgr2=0x7f27ac0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27b27b4640 1 -- 172.21.15.137:0/1080440630 shutdown_connections 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.989+0000 7f27b27b4640 1 -- 172.21.15.137:0/1080440630 wait complete. 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.990+0000 7f27b27b4640 1 Processor -- start 2024-04-26T22:00:58.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.990+0000 7f27b27b4640 1 -- start start 2024-04-26T22:00:58.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27b27b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27ac0b3de0 0x7f27ac1e5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27b27b4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac0b61a0 0x7f27ac06ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27b27b4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac145980 0x7f27ac15b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27b27b4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac072610 con 0x7f27ac0b61a0 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27b27b4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac0b4dd0 con 0x7f27ac0b3de0 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27b27b4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac072790 con 0x7f27ac145980 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27ab7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac0b61a0 0x7f27ac06ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27ab7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac0b61a0 0x7f27ac06ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34206/0 (socket says 172.21.15.137:34206) 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27ab7fe640 1 -- 172.21.15.137:0/3839059669 learned_addr learned my addr 172.21.15.137:0/3839059669 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27abfff640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27ac0b3de0 0x7f27ac1e5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.991+0000 7f27b0d51640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac145980 0x7f27ac15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27ab7fe640 1 -- 172.21.15.137:0/3839059669 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac145980 msgr2=0x7f27ac15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27ab7fe640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac145980 0x7f27ac15b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27ab7fe640 1 -- 172.21.15.137:0/3839059669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27ac0b3de0 msgr2=0x7f27ac1e5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27ab7fe640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27ac0b3de0 0x7f27ac1e5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27ab7fe640 1 -- 172.21.15.137:0/3839059669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac1f57c0 con 0x7f27ac0b61a0 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27ab7fe640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac0b61a0 0x7f27ac06ee20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f27a000c480 tx=0x7f27a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27a8ff9640 1 -- 172.21.15.137:0/3839059669 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a00052d0 con 0x7f27ac0b61a0 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27a8ff9640 1 -- 172.21.15.137:0/3839059669 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a0005470 con 0x7f27ac0b61a0 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27a8ff9640 1 -- 172.21.15.137:0/3839059669 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0012870 con 0x7f27ac0b61a0 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac1f5aa0 con 0x7f27ac0b61a0 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.992+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac1f6060 con 0x7f27ac0b61a0 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.993+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ac06a290 con 0x7f27ac0b61a0 2024-04-26T22:00:58.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.993+0000 7f27a8ff9640 1 -- 172.21.15.137:0/3839059669 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27a0012a10 con 0x7f27ac0b61a0 2024-04-26T22:00:58.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.994+0000 7f27a8ff9640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f279806c8f0 0x7f279806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:58.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.994+0000 7f27abfff640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f279806c8f0 0x7f279806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:58.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.994+0000 7f27a8ff9640 1 -- 172.21.15.137:0/3839059669 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f27a008b7a0 con 0x7f27ac0b61a0 2024-04-26T22:00:58.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.994+0000 7f27abfff640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f279806c8f0 0x7f279806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f279c034000 tx=0x7f279c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:58.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:58.998+0000 7f27a8ff9640 1 -- 172.21.15.137:0/3839059669 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f27a0059c20 con 0x7f27ac0b61a0 2024-04-26T22:00:59.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.174+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27ac1444f0 con 0x7f27ac0b61a0 2024-04-26T22:00:59.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.175+0000 7f27a8ff9640 1 -- 172.21.15.137:0/3839059669 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16717 (secure 0 0 0) 0x7f27a0059520 con 0x7f27ac0b61a0 2024-04-26T22:00:59.176 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:59.176 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":48,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:00:23.980977+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:00:10.430051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T22:00:11.181890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f279806c8f0 msgr2=0x7f279806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f279806c8f0 0x7f279806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f279c034000 tx=0x7f279c02e000 comp rx=0 tx=0).stop 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac0b61a0 msgr2=0x7f27ac06ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac0b61a0 0x7f27ac06ee20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f27a000c480 tx=0x7f27a000c940 comp rx=0 tx=0).stop 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 shutdown_connections 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f279806c8f0 0x7f279806edb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac0b61a0 0x7f27ac06ee20 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac145980 0x7f27ac15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 --2- 172.21.15.137:0/3839059669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27ac0b3de0 0x7f27ac1e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.177+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 >> 172.21.15.137:0/3839059669 conn(0x7f27ac0d0d30 msgr2=0x7f27ac143d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:59.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.178+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 shutdown_connections 2024-04-26T22:00:59.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.178+0000 7f27b27b4640 1 -- 172.21.15.137:0/3839059669 wait complete. 2024-04-26T22:00:59.190 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:00:59.190 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:59.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.287+0000 7f1c74c69640 1 Processor -- start 2024-04-26T22:00:59.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.287+0000 7f1c74c69640 1 -- start start 2024-04-26T22:00:59.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c74c69640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1c7006f2c0 0x7f1c70071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c74c69640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c700733e0 con 0x7f1c7015b4e0 2024-04-26T22:00:59.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c74c69640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c70072f00 con 0x7f1c7015b8c0 2024-04-26T22:00:59.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c74c69640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1c70072660 con 0x7f1c7006f2c0 2024-04-26T22:00:59.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c6dd9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1c7006f2c0 0x7f1c70071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c6e59c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f1c7015b4e0 0x7f1c7006ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41660/0 (socket says 172.21.15.137:41660) 2024-04-26T22:00:59.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c6e59c640 1 -- 172.21.15.137:0/4053200113 learned_addr learned my addr 172.21.15.137:0/4053200113 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:00:59.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c6dd9b640 1 -- 172.21.15.137:0/4053200113 >> v1:172.21.15.170:6789/0 conn(0x7f1c7015b8c0 legacy=0x7f1c700b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:59.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c6dd9b640 1 -- 172.21.15.137:0/4053200113 >> v1:172.21.15.137:6789/0 conn(0x7f1c7015b4e0 legacy=0x7f1c7006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c6dd9b640 1 -- 172.21.15.137:0/4053200113 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c70072940 con 0x7f1c7006f2c0 2024-04-26T22:00:59.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.288+0000 7f1c6d59a640 1 -- 172.21.15.137:0/4053200113 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593630443 0 0) 0x7f1c700733e0 con 0x7f1c7015b4e0 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c6dd9b640 1 --2- 172.21.15.137:0/4053200113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 0x7f1c70071fd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1c580097a0 tx=0x7f1c5802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b2d5b39f0e4fec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c6d59a640 1 -- 172.21.15.137:0/4053200113 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58037070 con 0x7f1c7006f2c0 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c6d59a640 1 -- 172.21.15.137:0/4053200113 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c5802ae50 con 0x7f1c7006f2c0 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c6d59a640 1 -- 172.21.15.137:0/4053200113 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58032660 con 0x7f1c7006f2c0 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c74c69640 1 -- 172.21.15.137:0/4053200113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 msgr2=0x7f1c70071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c74c69640 1 --2- 172.21.15.137:0/4053200113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 0x7f1c70071fd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1c580097a0 tx=0x7f1c5802a140 comp rx=0 tx=0).stop 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c74c69640 1 -- 172.21.15.137:0/4053200113 shutdown_connections 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c74c69640 1 --2- 172.21.15.137:0/4053200113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 0x7f1c70071fd0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c74c69640 1 -- 172.21.15.137:0/4053200113 >> 172.21.15.137:0/4053200113 conn(0x7f1c700d0d30 msgr2=0x7f1c700d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c74c69640 1 -- 172.21.15.137:0/4053200113 shutdown_connections 2024-04-26T22:00:59.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.289+0000 7f1c74c69640 1 -- 172.21.15.137:0/4053200113 wait complete. 2024-04-26T22:00:59.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.291+0000 7f1c74c69640 1 Processor -- start 2024-04-26T22:00:59.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.291+0000 7f1c74c69640 1 -- start start 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.291+0000 7f1c74c69640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 0x7f1c700cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.291+0000 7f1c74c69640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1c7015b4e0 0x7f1c7016a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.291+0000 7f1c74c69640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c7015b8c0 0x7f1c70138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.291+0000 7f1c74c69640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70073820 con 0x7f1c7006f2c0 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.291+0000 7f1c74c69640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1c700b3e80 con 0x7f1c7015b8c0 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.291+0000 7f1c74c69640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1c700739a0 con 0x7f1c7015b4e0 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.291+0000 7f1c6e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 0x7f1c700cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 0x7f1c700cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34228/0 (socket says 172.21.15.137:34228) 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6e59c640 1 -- 172.21.15.137:0/557202231 learned_addr learned my addr 172.21.15.137:0/557202231 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6ed9d640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c7015b8c0 0x7f1c70138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6dd9b640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1c7015b4e0 0x7f1c7016a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6e59c640 1 -- 172.21.15.137:0/557202231 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1c7015b4e0 msgr2=0x7f1c7016a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6e59c640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1c7015b4e0 0x7f1c7016a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6e59c640 1 -- 172.21.15.137:0/557202231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c7015b8c0 msgr2=0x7f1c70138db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6e59c640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c7015b8c0 0x7f1c70138db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6e59c640 1 -- 172.21.15.137:0/557202231 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7016bb20 con 0x7f1c7006f2c0 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6dd9b640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1c7015b4e0 0x7f1c7016a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c6e59c640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 0x7f1c700cdcf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000c4d0 tx=0x7f1c6000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c66ffd640 1 -- 172.21.15.137:0/557202231 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60018070 con 0x7f1c7006f2c0 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c66ffd640 1 -- 172.21.15.137:0/557202231 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c60007500 con 0x7f1c7006f2c0 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c66ffd640 1 -- 172.21.15.137:0/557202231 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60004a20 con 0x7f1c7006f2c0 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7016c0b0 con 0x7f1c7006f2c0 2024-04-26T22:00:59.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.292+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c700ce230 con 0x7f1c7006f2c0 2024-04-26T22:00:59.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.293+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7006a290 con 0x7f1c7006f2c0 2024-04-26T22:00:59.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.294+0000 7f1c66ffd640 1 -- 172.21.15.137:0/557202231 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1c60004bc0 con 0x7f1c7006f2c0 2024-04-26T22:00:59.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.294+0000 7f1c66ffd640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1c5006c8f0 0x7f1c5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.294+0000 7f1c66ffd640 1 -- 172.21.15.137:0/557202231 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f1c6008ada0 con 0x7f1c7006f2c0 2024-04-26T22:00:59.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.294+0000 7f1c6dd9b640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1c5006c8f0 0x7f1c5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.294+0000 7f1c6dd9b640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1c5006c8f0 0x7f1c5006edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c58034000 tx=0x7f1c5802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:59.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.298+0000 7f1c66ffd640 1 -- 172.21.15.137:0/557202231 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1c60059220 con 0x7f1c7006f2c0 2024-04-26T22:00:59.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.510+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c700b3220 con 0x7f1c7006f2c0 2024-04-26T22:00:59.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.511+0000 7f1c66ffd640 1 -- 172.21.15.137:0/557202231 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7f1c60058b20 con 0x7f1c7006f2c0 2024-04-26T22:00:59.511 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:59.511 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1453946915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1453946915},{"type":"v1","addr":"172.21.15.170:6835","nonce":1453946915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3097952323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3097952323},{"type":"v1","addr":"172.21.15.170:6834","nonce":3097952323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3002187785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3002187785},{"type":"v1","addr":"172.21.15.137:6835","nonce":3002187785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:00:12.224783+0000","modified":"2024-04-26T22:00:14.233247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5592":{"gid":5592,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/924509332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":924509332},{"type":"v1","addr":"172.21.15.137:6837","nonce":924509332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5592,"qdb_cluster":[5592]},"id":3}]} 2024-04-26T22:00:59.511 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 20 2024-04-26T22:00:59.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1c5006c8f0 msgr2=0x7f1c5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1c5006c8f0 0x7f1c5006edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1c58034000 tx=0x7f1c5802e000 comp rx=0 tx=0).stop 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 msgr2=0x7f1c700cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 0x7f1c700cdcf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000c4d0 tx=0x7f1c6000c990 comp rx=0 tx=0).stop 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 shutdown_connections 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1c5006c8f0 0x7f1c5006edb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c7015b8c0 0x7f1c70138db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1c7015b4e0 0x7f1c7016a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 --2- 172.21.15.137:0/557202231 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1c7006f2c0 0x7f1c700cdcf0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 >> 172.21.15.137:0/557202231 conn(0x7f1c700d0d30 msgr2=0x7f1c700b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 shutdown_connections 2024-04-26T22:00:59.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.513+0000 7f1c74c69640 1 -- 172.21.15.137:0/557202231 wait complete. 2024-04-26T22:00:59.524 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:00:59.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.620+0000 7fedab96a640 1 Processor -- start 2024-04-26T22:00:59.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.620+0000 7fedab96a640 1 -- start start 2024-04-26T22:00:59.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.621+0000 7fedab96a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4148a30 0x7feda4073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.621+0000 7fedab96a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feda40b3af0 0x7feda40b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.621+0000 7fedab96a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda40cfa80 con 0x7feda4160640 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.621+0000 7fedab96a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feda40b44a0 con 0x7feda40b3af0 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.621+0000 7fedab96a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feda40cfd60 con 0x7feda4148a30 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.621+0000 7feda9f07640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feda40b3af0 0x7feda40b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.621+0000 7feda9f07640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feda40b3af0 0x7feda40b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34242/0 (socket says 172.21.15.137:34242) 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.621+0000 7feda9f07640 1 -- 172.21.15.137:0/200793075 learned_addr learned my addr 172.21.15.137:0/200793075 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.622+0000 7feda9706640 1 --2- 172.21.15.137:0/200793075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4148a30 0x7feda4073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.622+0000 7feda9f07640 1 -- 172.21.15.137:0/200793075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4148a30 msgr2=0x7feda4073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.622+0000 7feda9f07640 1 --2- 172.21.15.137:0/200793075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4148a30 0x7feda4073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.622+0000 7feda9f07640 1 -- 172.21.15.137:0/200793075 >> v1:172.21.15.170:6789/0 conn(0x7feda4160640 legacy=0x7feda41636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.622+0000 7feda9f07640 1 -- 172.21.15.137:0/200793075 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda40d0040 con 0x7feda40b3af0 2024-04-26T22:00:59.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.622+0000 7feda9706640 1 --2- 172.21.15.137:0/200793075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4148a30 0x7feda4073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:00:59.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.622+0000 7feda9f07640 1 --2- 172.21.15.137:0/200793075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40b3af0 0x7feda40b3f60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009870 tx=0x7fed9c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff296a1ff362be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:59.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fed9bfff640 1 -- 172.21.15.137:0/200793075 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c037070 con 0x7feda40b3af0 2024-04-26T22:00:59.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fed9bfff640 1 -- 172.21.15.137:0/200793075 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9c032440 con 0x7feda40b3af0 2024-04-26T22:00:59.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fed9bfff640 1 -- 172.21.15.137:0/200793075 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9c032810 con 0x7feda40b3af0 2024-04-26T22:00:59.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fedab96a640 1 -- 172.21.15.137:0/200793075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40b3af0 msgr2=0x7feda40b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fedab96a640 1 --2- 172.21.15.137:0/200793075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40b3af0 0x7feda40b3f60 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fed9c009870 tx=0x7fed9c02a1c0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fedab96a640 1 -- 172.21.15.137:0/200793075 shutdown_connections 2024-04-26T22:00:59.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fedab96a640 1 --2- 172.21.15.137:0/200793075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40b3af0 0x7feda40b3f60 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fedab96a640 1 --2- 172.21.15.137:0/200793075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4148a30 0x7feda4073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fedab96a640 1 -- 172.21.15.137:0/200793075 >> 172.21.15.137:0/200793075 conn(0x7feda40ce8b0 msgr2=0x7feda40cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fedab96a640 1 -- 172.21.15.137:0/200793075 shutdown_connections 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.623+0000 7fedab96a640 1 -- 172.21.15.137:0/200793075 wait complete. 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.624+0000 7fedab96a640 1 Processor -- start 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.624+0000 7fedab96a640 1 -- start start 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7fedab96a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda40b3af0 0x7feda4141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7fedab96a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda4148a30 0x7feda41432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7fedab96a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4160640 0x7feda41e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7fedab96a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feda4163db0 con 0x7feda4148a30 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7fedab96a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feda4163180 con 0x7feda4160640 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7fedab96a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feda4074410 con 0x7feda40b3af0 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda8f05640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda4148a30 0x7feda41432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda8f05640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda4148a30 0x7feda41432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34244/0 (socket says 172.21.15.137:34244) 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda8f05640 1 -- 172.21.15.137:0/1280489827 learned_addr learned my addr 172.21.15.137:0/1280489827 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda9706640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda40b3af0 0x7feda4141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda9f07640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4160640 0x7feda41e9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda8f05640 1 -- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda40b3af0 msgr2=0x7feda4141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda8f05640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda40b3af0 0x7feda4141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda8f05640 1 -- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4160640 msgr2=0x7feda41e9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda8f05640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4160640 0x7feda41e9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda8f05640 1 -- 172.21.15.137:0/1280489827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda4142210 con 0x7feda4148a30 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda9706640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda40b3af0 0x7feda4141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.625+0000 7feda9f07640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4160640 0x7feda41e9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.626+0000 7feda8f05640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda4148a30 0x7feda41432b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c470 tx=0x7fed9400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.626+0000 7fed99ffb640 1 -- 172.21.15.137:0/1280489827 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed940052d0 con 0x7feda4148a30 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.626+0000 7fed99ffb640 1 -- 172.21.15.137:0/1280489827 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed94005490 con 0x7feda4148a30 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.626+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda41424f0 con 0x7feda4148a30 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.626+0000 7fed99ffb640 1 -- 172.21.15.137:0/1280489827 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94007260 con 0x7feda4148a30 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.626+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda4142ab0 con 0x7feda4148a30 2024-04-26T22:00:59.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.627+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda406a290 con 0x7feda4148a30 2024-04-26T22:00:59.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.627+0000 7fed99ffb640 1 -- 172.21.15.137:0/1280489827 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed94007400 con 0x7feda4148a30 2024-04-26T22:00:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.628+0000 7fed99ffb640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.628+0000 7feda9706640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.628+0000 7fed99ffb640 1 -- 172.21.15.137:0/1280489827 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fed9408afd0 con 0x7feda4148a30 2024-04-26T22:00:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.628+0000 7feda9706640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feda00094c0 tx=0x7feda000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:59.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.632+0000 7fed99ffb640 1 -- 172.21.15.137:0/1280489827 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fed940593c0 con 0x7feda4148a30 2024-04-26T22:00:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.843+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feda4073f70 con 0x7feda4148a30 2024-04-26T22:00:59.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.844+0000 7fed99ffb640 1 -- 172.21.15.137:0/1280489827 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5190 (secure 0 0 0) 0x7fed94058cc0 con 0x7feda4148a30 2024-04-26T22:00:59.844 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:00:59.844 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":20,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1453946915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1453946915},{"type":"v1","addr":"172.21.15.170:6835","nonce":1453946915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3097952323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3097952323},{"type":"v1","addr":"172.21.15.170:6834","nonce":3097952323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3002187785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3002187785},{"type":"v1","addr":"172.21.15.137:6835","nonce":3002187785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:00:12.224783+0000","modified":"2024-04-26T22:00:14.233247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5592},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5592":{"gid":5592,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/924509332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":924509332},{"type":"v1","addr":"172.21.15.137:6837","nonce":924509332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5592,"qdb_cluster":[5592]},"id":3}]} 2024-04-26T22:00:59.845 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 20 2024-04-26T22:00:59.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 msgr2=0x7fed8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feda00094c0 tx=0x7feda000b040 comp rx=0 tx=0).stop 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda4148a30 msgr2=0x7feda41432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda4148a30 0x7feda41432b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c470 tx=0x7fed9400c930 comp rx=0 tx=0).stop 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 shutdown_connections 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda4148a30 0x7feda41432b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4160640 0x7feda41e9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 --2- 172.21.15.137:0/1280489827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda40b3af0 0x7feda4141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 >> 172.21.15.137:0/1280489827 conn(0x7feda40ce8b0 msgr2=0x7feda40b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 shutdown_connections 2024-04-26T22:00:59.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.846+0000 7fedab96a640 1 -- 172.21.15.137:0/1280489827 wait complete. 2024-04-26T22:00:59.858 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:00:59.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.956+0000 7f408d104640 1 Processor -- start 2024-04-26T22:00:59.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.956+0000 7f408d104640 1 -- start start 2024-04-26T22:00:59.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.956+0000 7f408d104640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f408815f370 0x7f40880cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.956+0000 7f408d104640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f40880d3ee0 0x7f40880b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.956+0000 7f408d104640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40880d03a0 con 0x7f408815f750 2024-04-26T22:00:59.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.956+0000 7f408d104640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f40880b4d10 con 0x7f408815f370 2024-04-26T22:00:59.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.956+0000 7f408d104640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f40880d0680 con 0x7f40880d3ee0 2024-04-26T22:00:59.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f408759e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f40880d3ee0 0x7f40880b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f4086d9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f408815f370 0x7f40880cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f408759e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f40880d3ee0 0x7f40880b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:53808/0 (socket says 172.21.15.137:53808) 2024-04-26T22:00:59.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f4086d9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f408815f370 0x7f40880cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:54860/0 (socket says 172.21.15.137:54860) 2024-04-26T22:00:59.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f407ffff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f408815f750 0x7f40880d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:35418/0 (socket says 172.21.15.137:35418) 2024-04-26T22:00:59.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f408759e640 1 -- 172.21.15.137:0/520159848 learned_addr learned my addr 172.21.15.137:0/520159848 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:59.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f408759e640 1 -- 172.21.15.137:0/520159848 >> v2:172.21.15.170:3300/0 conn(0x7f408815f370 msgr2=0x7f40880cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:00:59.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f408759e640 1 --2- 172.21.15.137:0/520159848 >> v2:172.21.15.170:3300/0 conn(0x7f408815f370 0x7f40880cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f408759e640 1 -- 172.21.15.137:0/520159848 >> v1:172.21.15.170:6789/0 conn(0x7f408815f750 legacy=0x7f40880d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.957+0000 7f408759e640 1 -- 172.21.15.137:0/520159848 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40880d0960 con 0x7f40880d3ee0 2024-04-26T22:00:59.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.958+0000 7f408759e640 1 --2- 172.21.15.137:0/520159848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f40880d3ee0 0x7f40880b47d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4080009e50 tx=0x7f408002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c1d82359a2b5f3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.958+0000 7f408659c640 1 -- 172.21.15.137:0/520159848 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080036070 con 0x7f40880d3ee0 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.958+0000 7f408659c640 1 -- 172.21.15.137:0/520159848 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4080031600 con 0x7f40880d3ee0 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.958+0000 7f408659c640 1 -- 172.21.15.137:0/520159848 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40800319d0 con 0x7f40880d3ee0 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.959+0000 7f408d104640 1 -- 172.21.15.137:0/520159848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f40880d3ee0 msgr2=0x7f40880b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.959+0000 7f408d104640 1 --2- 172.21.15.137:0/520159848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f40880d3ee0 0x7f40880b47d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4080009e50 tx=0x7f408002a710 comp rx=0 tx=0).stop 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.959+0000 7f408d104640 1 -- 172.21.15.137:0/520159848 shutdown_connections 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.959+0000 7f408d104640 1 --2- 172.21.15.137:0/520159848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f40880d3ee0 0x7f40880b47d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.959+0000 7f408d104640 1 --2- 172.21.15.137:0/520159848 >> v2:172.21.15.170:3300/0 conn(0x7f408815f370 0x7f40880cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.959+0000 7f408d104640 1 -- 172.21.15.137:0/520159848 >> 172.21.15.137:0/520159848 conn(0x7f408808ec10 msgr2=0x7f408809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.959+0000 7f408d104640 1 -- 172.21.15.137:0/520159848 shutdown_connections 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.959+0000 7f408d104640 1 -- 172.21.15.137:0/520159848 wait complete. 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.960+0000 7f408d104640 1 Processor -- start 2024-04-26T22:00:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.960+0000 7f408d104640 1 -- start start 2024-04-26T22:00:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f408d104640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40880d3ee0 0x7f4088160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f408d104640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f408815f370 0x7f408815b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f408d104640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f408815f750 0x7f40881f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f408d104640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f40880b51c0 con 0x7f40880d3ee0 2024-04-26T22:00:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f408d104640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f40880d0f20 con 0x7f408815f370 2024-04-26T22:00:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f408d104640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f40880b5340 con 0x7f408815f750 2024-04-26T22:00:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f4086d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40880d3ee0 0x7f4088160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f4086d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40880d3ee0 0x7f4088160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34252/0 (socket says 172.21.15.137:34252) 2024-04-26T22:00:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f4086d9d640 1 -- 172.21.15.137:0/1590236586 learned_addr learned my addr 172.21.15.137:0/1590236586 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:00:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f407ffff640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f408815f370 0x7f408815b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f4086d9d640 1 -- 172.21.15.137:0/1590236586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f408815f750 msgr2=0x7f40881f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f4086d9d640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f408815f750 0x7f40881f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f4086d9d640 1 -- 172.21.15.137:0/1590236586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f408815f370 msgr2=0x7f408815b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:00:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f4086d9d640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f408815f370 0x7f408815b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:00:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f4086d9d640 1 -- 172.21.15.137:0/1590236586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4088160cc0 con 0x7f40880d3ee0 2024-04-26T22:00:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f4086d9d640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40880d3ee0 0x7f4088160780 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f407800e9e0 tx=0x7f407800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f407f7fe640 1 -- 172.21.15.137:0/1590236586 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078017070 con 0x7f40880d3ee0 2024-04-26T22:00:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f407f7fe640 1 -- 172.21.15.137:0/1590236586 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f407800c9d0 con 0x7f40880d3ee0 2024-04-26T22:00:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4088160f60 con 0x7f40880d3ee0 2024-04-26T22:00:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f407f7fe640 1 -- 172.21.15.137:0/1590236586 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407800cdc0 con 0x7f40880d3ee0 2024-04-26T22:00:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.961+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4088161520 con 0x7f40880d3ee0 2024-04-26T22:00:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.962+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f408806a290 con 0x7f40880d3ee0 2024-04-26T22:00:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.963+0000 7f407f7fe640 1 -- 172.21.15.137:0/1590236586 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f407801a070 con 0x7f40880d3ee0 2024-04-26T22:00:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.963+0000 7f407f7fe640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f406806c8f0 0x7f406806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:00:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.963+0000 7f407f7fe640 1 -- 172.21.15.137:0/1590236586 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f407808bb90 con 0x7f40880d3ee0 2024-04-26T22:00:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.963+0000 7f407ffff640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f406806c8f0 0x7f406806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:00:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.964+0000 7f407ffff640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f406806c8f0 0x7f406806edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f408815e330 tx=0x7f4070009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:00:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:00:59.968+0000 7f407f7fe640 1 -- 172.21.15.137:0/1590236586 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4078059f80 con 0x7f40880d3ee0 2024-04-26T22:01:00.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.145+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f408815bdd0 con 0x7f40880d3ee0 2024-04-26T22:01:00.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.146+0000 7f407f7fe640 1 -- 172.21.15.137:0/1590236586 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16717 (secure 0 0 0) 0x7f4078059880 con 0x7f40880d3ee0 2024-04-26T22:01:00.147 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:00.147 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":48,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:00:23.980977+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:00:10.430051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T22:00:11.181890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.3c","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f406806c8f0 msgr2=0x7f406806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f406806c8f0 0x7f406806edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f408815e330 tx=0x7f4070009040 comp rx=0 tx=0).stop 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40880d3ee0 msgr2=0x7f4088160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40880d3ee0 0x7f4088160780 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f407800e9e0 tx=0x7f407800eea0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 shutdown_connections 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f406806c8f0 0x7f406806edb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f408815f750 0x7f40881f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f408815f370 0x7f408815b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 --2- 172.21.15.137:0/1590236586 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f40880d3ee0 0x7f4088160780 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 >> 172.21.15.137:0/1590236586 conn(0x7f408808ec10 msgr2=0x7f408815e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 shutdown_connections 2024-04-26T22:01:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.148+0000 7f408d104640 1 -- 172.21.15.137:0/1590236586 wait complete. 2024-04-26T22:01:00.160 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:01:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.257+0000 7f6d136e1640 1 Processor -- start 2024-04-26T22:01:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.257+0000 7f6d136e1640 1 -- start start 2024-04-26T22:01:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d136e1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d0c0b44e0 0x7f6d0c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d136e1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d0c06d2b0 0x7f6d0c06d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d136e1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d0c0b4a10 con 0x7f6d0c15f1e0 2024-04-26T22:01:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d136e1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6d0c06eeb0 con 0x7f6d0c0b44e0 2024-04-26T22:01:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d136e1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0c0b4cf0 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d10c7c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6d0c0b44e0 0x7f6d0c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d1147d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6d0c15f1e0 0x7f6d0c0ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41676/0 (socket says 172.21.15.137:41676) 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d1147d640 1 -- 172.21.15.137:0/2052911367 learned_addr learned my addr 172.21.15.137:0/2052911367 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d11c7e640 1 --2- 172.21.15.137:0/2052911367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d0c06d2b0 0x7f6d0c06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d10c7c640 1 -- 172.21.15.137:0/2052911367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d0c06d2b0 msgr2=0x7f6d0c06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d10c7c640 1 --2- 172.21.15.137:0/2052911367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d0c06d2b0 0x7f6d0c06d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d10c7c640 1 -- 172.21.15.137:0/2052911367 >> v1:172.21.15.137:6789/0 conn(0x7f6d0c15f1e0 legacy=0x7f6d0c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.258+0000 7f6d10c7c640 1 -- 172.21.15.137:0/2052911367 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c0b4fd0 con 0x7f6d0c0b44e0 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.259+0000 7f6d10c7c640 1 --2- 172.21.15.137:0/2052911367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c0b44e0 0x7f6d0c06e970 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0097a0 tx=0x7f6cfc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b6316949f4b807 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.259+0000 7f6d03fff640 1 -- 172.21.15.137:0/2052911367 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc037070 con 0x7f6d0c0b44e0 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.259+0000 7f6d03fff640 1 -- 172.21.15.137:0/2052911367 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cfc032440 con 0x7f6d0c0b44e0 2024-04-26T22:01:00.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.259+0000 7f6d03fff640 1 -- 172.21.15.137:0/2052911367 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc032810 con 0x7f6d0c0b44e0 2024-04-26T22:01:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.260+0000 7f6d136e1640 1 -- 172.21.15.137:0/2052911367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c0b44e0 msgr2=0x7f6d0c06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.260+0000 7f6d136e1640 1 --2- 172.21.15.137:0/2052911367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c0b44e0 0x7f6d0c06e970 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0097a0 tx=0x7f6cfc02a180 comp rx=0 tx=0).stop 2024-04-26T22:01:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.260+0000 7f6d136e1640 1 -- 172.21.15.137:0/2052911367 shutdown_connections 2024-04-26T22:01:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.260+0000 7f6d136e1640 1 --2- 172.21.15.137:0/2052911367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d0c06d2b0 0x7f6d0c06d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.260+0000 7f6d136e1640 1 --2- 172.21.15.137:0/2052911367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c0b44e0 0x7f6d0c06e970 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.260+0000 7f6d136e1640 1 -- 172.21.15.137:0/2052911367 >> 172.21.15.137:0/2052911367 conn(0x7f6d0c0728a0 msgr2=0x7f6d0c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.260+0000 7f6d136e1640 1 -- 172.21.15.137:0/2052911367 shutdown_connections 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.260+0000 7f6d136e1640 1 -- 172.21.15.137:0/2052911367 wait complete. 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.261+0000 7f6d136e1640 1 Processor -- start 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.261+0000 7f6d136e1640 1 -- start start 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d136e1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c06d2b0 0x7f6d0c157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d136e1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d0c0b44e0 0x7f6d0c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d136e1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d0c15f1e0 0x7f6d0c1e8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d136e1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c15f5c0 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d136e1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c0b5590 con 0x7f6d0c0b44e0 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d136e1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0c1583c0 con 0x7f6d0c15f1e0 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d1147d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c06d2b0 0x7f6d0c157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d1147d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c06d2b0 0x7f6d0c157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34270/0 (socket says 172.21.15.137:34270) 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d1147d640 1 -- 172.21.15.137:0/3458831336 learned_addr learned my addr 172.21.15.137:0/3458831336 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d1147d640 1 -- 172.21.15.137:0/3458831336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d0c15f1e0 msgr2=0x7f6d0c1e8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d1147d640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d0c15f1e0 0x7f6d0c1e8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d1147d640 1 -- 172.21.15.137:0/3458831336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d0c0b44e0 msgr2=0x7f6d0c1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d1147d640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d0c0b44e0 0x7f6d0c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d1147d640 1 -- 172.21.15.137:0/3458831336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c1508e0 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d1147d640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c06d2b0 0x7f6d0c157680 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800caa0 tx=0x7f6d0800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d01ffb640 1 -- 172.21.15.137:0/3458831336 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08017070 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d01ffb640 1 -- 172.21.15.137:0/3458831336 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0800ac00 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0c158610 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.262+0000 7f6d01ffb640 1 -- 172.21.15.137:0/3458831336 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08012400 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.263+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0c156e80 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.264+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d0c06a290 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.264+0000 7f6d01ffb640 1 -- 172.21.15.137:0/3458831336 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d0801a070 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.264+0000 7f6d01ffb640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf006c8f0 0x7f6cf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.264+0000 7f6d01ffb640 1 -- 172.21.15.137:0/3458831336 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f6d0808b960 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.264+0000 7f6d10c7c640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf006c8f0 0x7f6cf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.265+0000 7f6d10c7c640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf006c8f0 0x7f6cf006edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc034000 tx=0x7f6cfc02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.269+0000 7f6d01ffb640 1 -- 172.21.15.137:0/3458831336 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6d08059cc0 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.478+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6d0c1e91d0 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.479 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:01:00.479+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:01:00.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.482+0000 7f6d01ffb640 1 -- 172.21.15.137:0/3458831336 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) ==== 161+0+0 (secure 0 0 0) 0x7f6d080595c0 con 0x7f6d0c06d2b0 2024-04-26T22:01:00.482 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.484+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf006c8f0 msgr2=0x7f6cf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.484+0000 7f6d136e1640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf006c8f0 0x7f6cf006edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc034000 tx=0x7f6cfc02c000 comp rx=0 tx=0).stop 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.484+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c06d2b0 msgr2=0x7f6d0c157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.484+0000 7f6d136e1640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c06d2b0 0x7f6d0c157680 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800caa0 tx=0x7f6d0800cf60 comp rx=0 tx=0).stop 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.485+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 shutdown_connections 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.485+0000 7f6d136e1640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6cf006c8f0 0x7f6cf006edb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.485+0000 7f6d136e1640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6d0c15f1e0 0x7f6d0c1e8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.485+0000 7f6d136e1640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d0c0b44e0 0x7f6d0c1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.485+0000 7f6d136e1640 1 --2- 172.21.15.137:0/3458831336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6d0c06d2b0 0x7f6d0c157680 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.485+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 >> 172.21.15.137:0/3458831336 conn(0x7f6d0c0728a0 msgr2=0x7f6d0c070860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.485+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 shutdown_connections 2024-04-26T22:01:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.485+0000 7f6d136e1640 1 -- 172.21.15.137:0/3458831336 wait complete. 2024-04-26T22:01:00.488 INFO:tasks.ceph.mds.c.smithi137.stderr: -6039> 2024-04-26T22:00:18.135+0000 7f136523a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:01:00.491 INFO:tasks.ceph.mds.c.smithi137.stderr: -3160> 2024-04-26T22:00:24.070+0000 7f1361232640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={4988=0-4194304@1} caps={4988=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=4988 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55a4e4520680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T22:01:00.496 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:01:00.518 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:01:00.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.595+0000 7fae0f7bf640 1 Processor -- start 2024-04-26T22:01:00.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.596+0000 7fae0f7bf640 1 -- start start 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.596+0000 7fae0f7bf640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fae080d3820 0x7fae080b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.596+0000 7fae0f7bf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fae080b60b0 0x7fae080d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.596+0000 7fae0f7bf640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae080d3c90 con 0x7fae0815f680 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.596+0000 7fae0f7bf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fae0815fa60 con 0x7fae080b60b0 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.596+0000 7fae0f7bf640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fae080d3f50 con 0x7fae080d3820 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.596+0000 7fae0dd5c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fae080b60b0 0x7fae080d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.596+0000 7fae0d55b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fae0815f680 0x7fae08163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41682/0 (socket says 172.21.15.137:41682) 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.596+0000 7fae0d55b640 1 -- 172.21.15.137:0/342564729 learned_addr learned my addr 172.21.15.137:0/342564729 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.597+0000 7fae0dd5c640 1 -- 172.21.15.137:0/342564729 >> v2:172.21.15.170:3300/0 conn(0x7fae080d3820 msgr2=0x7fae080b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.597+0000 7fae0dd5c640 1 --2- 172.21.15.137:0/342564729 >> v2:172.21.15.170:3300/0 conn(0x7fae080d3820 0x7fae080b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.597+0000 7fae0dd5c640 1 -- 172.21.15.137:0/342564729 >> v1:172.21.15.137:6789/0 conn(0x7fae0815f680 legacy=0x7fae08163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.597+0000 7fae0dd5c640 1 -- 172.21.15.137:0/342564729 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae080b5090 con 0x7fae080b60b0 2024-04-26T22:01:00.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.597+0000 7fae0dd5c640 1 --2- 172.21.15.137:0/342564729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 0x7fae080d4f20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fae08163040 tx=0x7fae0002a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d21ba50ae4c3ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:00.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.597+0000 7fadfffff640 1 -- 172.21.15.137:0/342564729 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00037070 con 0x7fae080b60b0 2024-04-26T22:01:00.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fadfffff640 1 -- 172.21.15.137:0/342564729 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0002ad30 con 0x7fae080b60b0 2024-04-26T22:01:00.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fadfffff640 1 -- 172.21.15.137:0/342564729 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00032660 con 0x7fae080b60b0 2024-04-26T22:01:00.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fae0f7bf640 1 -- 172.21.15.137:0/342564729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 msgr2=0x7fae080d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fae0f7bf640 1 --2- 172.21.15.137:0/342564729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 0x7fae080d4f20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fae08163040 tx=0x7fae0002a0a0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fae0f7bf640 1 -- 172.21.15.137:0/342564729 shutdown_connections 2024-04-26T22:01:00.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fae0f7bf640 1 --2- 172.21.15.137:0/342564729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 0x7fae080d4f20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fae0f7bf640 1 --2- 172.21.15.137:0/342564729 >> v2:172.21.15.170:3300/0 conn(0x7fae080d3820 0x7fae080b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fae0f7bf640 1 -- 172.21.15.137:0/342564729 >> 172.21.15.137:0/342564729 conn(0x7fae0808eca0 msgr2=0x7fae0809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:00.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fae0f7bf640 1 -- 172.21.15.137:0/342564729 shutdown_connections 2024-04-26T22:01:00.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.598+0000 7fae0f7bf640 1 -- 172.21.15.137:0/342564729 wait complete. 2024-04-26T22:01:00.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.599+0000 7fae0f7bf640 1 Processor -- start 2024-04-26T22:01:00.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.599+0000 7fae0f7bf640 1 -- start start 2024-04-26T22:01:00.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0f7bf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 0x7fae081532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0f7bf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae080d3820 0x7fae080ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0f7bf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae0815f680 0x7fae08162150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0f7bf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fae080d55e0 con 0x7fae080b60b0 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0f7bf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fae080d5460 con 0x7fae0815f680 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0f7bf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fae080d5760 con 0x7fae080d3820 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0d55b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 0x7fae081532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0d55b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 0x7fae081532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34302/0 (socket says 172.21.15.137:34302) 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0d55b640 1 -- 172.21.15.137:0/1349159488 learned_addr learned my addr 172.21.15.137:0/1349159488 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0dd5c640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae0815f680 0x7fae08162150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0cd5a640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae080d3820 0x7fae080ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0d55b640 1 -- 172.21.15.137:0/1349159488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae080d3820 msgr2=0x7fae080ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0d55b640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae080d3820 0x7fae080ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0d55b640 1 -- 172.21.15.137:0/1349159488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae0815f680 msgr2=0x7fae08162150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0d55b640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae0815f680 0x7fae08162150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.600+0000 7fae0d55b640 1 -- 172.21.15.137:0/1349159488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae081537e0 con 0x7fae080b60b0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.601+0000 7fae0d55b640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 0x7fae081532a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c8e0 tx=0x7fae0400cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.601+0000 7fadfdffb640 1 -- 172.21.15.137:0/1349159488 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04018070 con 0x7fae080b60b0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.601+0000 7fadfdffb640 1 -- 172.21.15.137:0/1349159488 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0400a640 con 0x7fae080b60b0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.601+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae080cda10 con 0x7fae080b60b0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.601+0000 7fadfdffb640 1 -- 172.21.15.137:0/1349159488 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0400aa70 con 0x7fae080b60b0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.601+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae080cdfd0 con 0x7fae080b60b0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.602+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae080ce6e0 con 0x7fae080b60b0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.602+0000 7fadfdffb640 1 -- 172.21.15.137:0/1349159488 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae0401b070 con 0x7fae080b60b0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.603+0000 7fadfdffb640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadec06c8f0 0x7fadec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.603+0000 7fadfdffb640 1 -- 172.21.15.137:0/1349159488 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5853+0+0 (secure 0 0 0) 0x7fae0408b3c0 con 0x7fae080b60b0 2024-04-26T22:01:00.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.603+0000 7fae0cd5a640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadec06c8f0 0x7fadec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:00.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.603+0000 7fae0cd5a640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadec06c8f0 0x7fadec06edb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fae080b4b40 tx=0x7fadf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:00.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.607+0000 7fadfdffb640 1 -- 172.21.15.137:0/1349159488 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fae04059760 con 0x7fae080b60b0 2024-04-26T22:01:00.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:00.821+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fae0806a290 con 0x7fae080b60b0 2024-04-26T22:01:01.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.489+0000 7fadfdffb640 1 -- 172.21.15.137:0/1349159488 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7fae04059060 con 0x7fae080b60b0 2024-04-26T22:01:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadec06c8f0 msgr2=0x7fadec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadec06c8f0 0x7fadec06edb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fae080b4b40 tx=0x7fadf8008040 comp rx=0 tx=0).stop 2024-04-26T22:01:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 msgr2=0x7fae081532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 0x7fae081532a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c8e0 tx=0x7fae0400cda0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 shutdown_connections 2024-04-26T22:01:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadec06c8f0 0x7fadec06edb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae0815f680 0x7fae08162150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae080d3820 0x7fae080ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 --2- 172.21.15.137:0/1349159488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae080b60b0 0x7fae081532a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.491+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 >> 172.21.15.137:0/1349159488 conn(0x7fae0808eca0 msgr2=0x7fae081639b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.492+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 shutdown_connections 2024-04-26T22:01:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.492+0000 7fae0f7bf640 1 -- 172.21.15.137:0/1349159488 wait complete. 2024-04-26T22:01:01.504 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:01:01.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.648+0000 7fd31cc6b640 1 Processor -- start 2024-04-26T22:01:01.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.648+0000 7fd31cc6b640 1 -- start start 2024-04-26T22:01:01.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.649+0000 7fd31cc6b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd3180d18a0 0x7fd318166d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:01.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.649+0000 7fd31cc6b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3180d0140 con 0x7fd31806e330 2024-04-26T22:01:01.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.649+0000 7fd31cc6b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31806e830 con 0x7fd3181454c0 2024-04-26T22:01:01.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.649+0000 7fd31cc6b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd3180721a0 con 0x7fd3180d18a0 2024-04-26T22:01:01.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.649+0000 7fd315d9b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd31806e330 0x7fd3180d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41690/0 (socket says 172.21.15.137:41690) 2024-04-26T22:01:01.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.649+0000 7fd315d9b640 1 -- 172.21.15.137:0/918254873 learned_addr learned my addr 172.21.15.137:0/918254873 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:01.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.649+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015829930 0 0) 0x7fd3180d0140 con 0x7fd31806e330 2024-04-26T22:01:01.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.649+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd300003520 con 0x7fd31806e330 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.649+0000 7fd316d9d640 1 --2- 172.21.15.137:0/918254873 >> v2:172.21.15.170:3300/0 conn(0x7fd3180d18a0 0x7fd318166d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2041040197 0 0) 0x7fd300003520 con 0x7fd31806e330 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 >> v2:172.21.15.170:3300/0 conn(0x7fd3180d18a0 msgr2=0x7fd318166d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 --2- 172.21.15.137:0/918254873 >> v2:172.21.15.170:3300/0 conn(0x7fd3180d18a0 0x7fd318166d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 >> v1:172.21.15.170:6789/0 conn(0x7fd3181454c0 legacy=0x7fd3180d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31806eb10 con 0x7fd31806e330 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fd308001670 con 0x7fd31806e330 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 >> v1:172.21.15.137:6789/0 conn(0x7fd31806e330 legacy=0x7fd3180d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd300003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd300004800 0x7fd300004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3000051c0 0x7fd30000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd30000c030 con 0x7fd3000039b0 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd30000c1e0 con 0x7fd300004800 2024-04-26T22:01:01.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd30000c3e0 con 0x7fd3000051c0 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31659c640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd300003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd315d9b640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd300004800 0x7fd300004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd316d9d640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3000051c0 0x7fd30000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31659c640 1 -- 172.21.15.137:0/918254873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3000051c0 msgr2=0x7fd30000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31659c640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3000051c0 0x7fd30000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31659c640 1 -- 172.21.15.137:0/918254873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd300004800 msgr2=0x7fd300004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31659c640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd300004800 0x7fd300004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd31659c640 1 -- 172.21.15.137:0/918254873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd300003520 con 0x7fd3000039b0 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd316d9d640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3000051c0 0x7fd30000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.650+0000 7fd316d9d640 1 -- 172.21.15.137:0/918254873 reap_dead start 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.651+0000 7fd31659c640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd300003dd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd30c001750 tx=0x7fd300005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04a004233888aaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.651+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c001370 con 0x7fd3000039b0 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.651+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c0052d0 con 0x7fd3000039b0 2024-04-26T22:01:01.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.651+0000 7fd31559a640 1 -- 172.21.15.137:0/918254873 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c02abc0 con 0x7fd3000039b0 2024-04-26T22:01:01.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.652+0000 7fd31cc6b640 1 -- 172.21.15.137:0/918254873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 msgr2=0x7fd300003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:01.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.652+0000 7fd31cc6b640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd300003dd0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd30c001750 tx=0x7fd300005830 comp rx=0 tx=0).stop 2024-04-26T22:01:01.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.652+0000 7fd31cc6b640 1 -- 172.21.15.137:0/918254873 shutdown_connections 2024-04-26T22:01:01.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.652+0000 7fd31cc6b640 1 --2- 172.21.15.137:0/918254873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd300003dd0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.652+0000 7fd31cc6b640 1 -- 172.21.15.137:0/918254873 >> 172.21.15.137:0/918254873 conn(0x7fd31806c690 msgr2=0x7fd31806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:01.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.652+0000 7fd31cc6b640 1 -- 172.21.15.137:0/918254873 shutdown_connections 2024-04-26T22:01:01.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.652+0000 7fd31cc6b640 1 -- 172.21.15.137:0/918254873 wait complete. 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.653+0000 7fd31cc6b640 1 Processor -- start 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.653+0000 7fd31cc6b640 1 -- start start 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31cc6b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd31815e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31cc6b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd31815b7f0 0x7fd31815bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31cc6b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd31814e9b0 0x7fd31814ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31cc6b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd31806f0d0 con 0x7fd3000039b0 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31cc6b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180ceca0 con 0x7fd31814e9b0 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31cc6b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd31815d8a0 con 0x7fd31815b7f0 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd31815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd31815e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34318/0 (socket says 172.21.15.137:34318) 2024-04-26T22:01:01.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31659c640 1 -- 172.21.15.137:0/1853144873 learned_addr learned my addr 172.21.15.137:0/1853144873 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd315d9b640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd31815b7f0 0x7fd31815bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd316d9d640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd31814e9b0 0x7fd31814ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31659c640 1 -- 172.21.15.137:0/1853144873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd31815b7f0 msgr2=0x7fd31815bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31659c640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd31815b7f0 0x7fd31815bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31659c640 1 -- 172.21.15.137:0/1853144873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd31814e9b0 msgr2=0x7fd31814ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31659c640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd31814e9b0 0x7fd31814ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31659c640 1 -- 172.21.15.137:0/1853144873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31815c1b0 con 0x7fd3000039b0 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31659c640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd31815e320 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd30c02a570 tx=0x7fd30c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd306ffd640 1 -- 172.21.15.137:0/1853144873 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c03f030 con 0x7fd3000039b0 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd306ffd640 1 -- 172.21.15.137:0/1853144873 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c005480 con 0x7fd3000039b0 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31813a920 con 0x7fd3000039b0 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.654+0000 7fd306ffd640 1 -- 172.21.15.137:0/1853144873 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c037040 con 0x7fd3000039b0 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.655+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31813aea0 con 0x7fd3000039b0 2024-04-26T22:01:01.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.656+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31806a290 con 0x7fd3000039b0 2024-04-26T22:01:01.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.656+0000 7fd306ffd640 1 -- 172.21.15.137:0/1853144873 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd30c042070 con 0x7fd3000039b0 2024-04-26T22:01:01.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.656+0000 7fd306ffd640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd2f806c920 0x7fd2f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:01.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.656+0000 7fd306ffd640 1 -- 172.21.15.137:0/1853144873 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5853+0+0 (secure 0 0 0) 0x7fd30c0ab1a0 con 0x7fd3000039b0 2024-04-26T22:01:01.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.656+0000 7fd315d9b640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd2f806c920 0x7fd2f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:01.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.657+0000 7fd315d9b640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd2f806c920 0x7fd2f806ede0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd318074780 tx=0x7fd308009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:01.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.661+0000 7fd306ffd640 1 -- 172.21.15.137:0/1853144873 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd30c0794b0 con 0x7fd3000039b0 2024-04-26T22:01:01.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:01.836+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd3180cd5a0 con 0x7fd3000039b0 2024-04-26T22:01:02.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.490+0000 7fd306ffd640 1 -- 172.21.15.137:0/1853144873 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) ==== 181+0+0 (secure 0 0 0) 0x7fd30c078db0 con 0x7fd3000039b0 2024-04-26T22:01:02.491 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:01:02.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.493+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd2f806c920 msgr2=0x7fd2f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:02.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.493+0000 7fd31cc6b640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd2f806c920 0x7fd2f806ede0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd318074780 tx=0x7fd308009040 comp rx=0 tx=0).stop 2024-04-26T22:01:02.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 msgr2=0x7fd31815e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:02.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd31815e320 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd30c02a570 tx=0x7fd30c001120 comp rx=0 tx=0).stop 2024-04-26T22:01:02.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 shutdown_connections 2024-04-26T22:01:02.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd2f806c920 0x7fd2f806ede0 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd318074780 tx=0x7fd308009040 comp rx=0 tx=0).stop 2024-04-26T22:01:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd31814e9b0 0x7fd31814ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd31815b7f0 0x7fd31815bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 --2- 172.21.15.137:0/1853144873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd3000039b0 0x7fd31815e320 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 >> 172.21.15.137:0/1853144873 conn(0x7fd31806c690 msgr2=0x7fd3180b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 shutdown_connections 2024-04-26T22:01:02.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.494+0000 7fd31cc6b640 1 -- 172.21.15.137:0/1853144873 wait complete. 2024-04-26T22:01:02.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:01:02.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.613+0000 7f88409b6640 1 Processor -- start 2024-04-26T22:01:02.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.613+0000 7f88409b6640 1 -- start start 2024-04-26T22:01:02.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f88409b6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f883c1437f0 0x7f883c06f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:02.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f88409b6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c0d1190 0x7f883c0d1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:02.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f88409b6640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f883c1612e0 con 0x7f883c160e70 2024-04-26T22:01:02.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f88409b6640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f883c073440 con 0x7f883c1437f0 2024-04-26T22:01:02.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f88409b6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f883c161570 con 0x7f883c0d1190 2024-04-26T22:01:02.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f883a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f883c1437f0 0x7f883c06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f8839d9b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f883c160e70 0x7f883c144120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41698/0 (socket says 172.21.15.137:41698) 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f883a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f883c1437f0 0x7f883c06f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34322/0 (socket says 172.21.15.137:34322) 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f8839d9b640 1 -- 172.21.15.137:0/3417925060 learned_addr learned my addr 172.21.15.137:0/3417925060 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f883ad9d640 1 --2- 172.21.15.137:0/3417925060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c0d1190 0x7f883c0d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f883a59c640 1 -- 172.21.15.137:0/3417925060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c0d1190 msgr2=0x7f883c0d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.614+0000 7f883a59c640 1 --2- 172.21.15.137:0/3417925060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c0d1190 0x7f883c0d1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.615+0000 7f883a59c640 1 -- 172.21.15.137:0/3417925060 >> v1:172.21.15.137:6789/0 conn(0x7f883c160e70 legacy=0x7f883c144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.615+0000 7f883a59c640 1 -- 172.21.15.137:0/3417925060 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883c161850 con 0x7f883c1437f0 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.615+0000 7f883ad9d640 1 --2- 172.21.15.137:0/3417925060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c0d1190 0x7f883c0d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.615+0000 7f883a59c640 1 --2- 172.21.15.137:0/3417925060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c1437f0 0x7f883c06f600 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f882c009d90 tx=0x7f882c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184e07de74957c66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.615+0000 7f883959a640 1 -- 172.21.15.137:0/3417925060 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c007740 con 0x7f883c1437f0 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.615+0000 7f883959a640 1 -- 172.21.15.137:0/3417925060 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882c0078e0 con 0x7f883c1437f0 2024-04-26T22:01:02.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.615+0000 7f883959a640 1 -- 172.21.15.137:0/3417925060 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c007cb0 con 0x7f883c1437f0 2024-04-26T22:01:02.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.616+0000 7f88409b6640 1 -- 172.21.15.137:0/3417925060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c1437f0 msgr2=0x7f883c06f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:02.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.616+0000 7f88409b6640 1 --2- 172.21.15.137:0/3417925060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c1437f0 0x7f883c06f600 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f882c009d90 tx=0x7f882c02a660 comp rx=0 tx=0).stop 2024-04-26T22:01:02.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.616+0000 7f88409b6640 1 -- 172.21.15.137:0/3417925060 shutdown_connections 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.616+0000 7f88409b6640 1 --2- 172.21.15.137:0/3417925060 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c0d1190 0x7f883c0d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.616+0000 7f88409b6640 1 --2- 172.21.15.137:0/3417925060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c1437f0 0x7f883c06f600 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.616+0000 7f88409b6640 1 -- 172.21.15.137:0/3417925060 >> 172.21.15.137:0/3417925060 conn(0x7f883c06c690 msgr2=0x7f883c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.616+0000 7f88409b6640 1 -- 172.21.15.137:0/3417925060 shutdown_connections 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.616+0000 7f88409b6640 1 -- 172.21.15.137:0/3417925060 wait complete. 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.617+0000 7f88409b6640 1 Processor -- start 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.617+0000 7f88409b6640 1 -- start start 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f88409b6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883c0d1190 0x7f883c0af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f88409b6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c1437f0 0x7f883c1397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f88409b6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c160e70 0x7f883c141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f88409b6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f883c143bd0 con 0x7f883c160e70 2024-04-26T22:01:02.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f88409b6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f883c0736a0 con 0x7f883c0d1190 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f88409b6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f883c143d50 con 0x7f883c1437f0 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c160e70 0x7f883c141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c160e70 0x7f883c141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34330/0 (socket says 172.21.15.137:34330) 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883ad9d640 1 -- 172.21.15.137:0/2003521310 learned_addr learned my addr 172.21.15.137:0/2003521310 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883a59c640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883c0d1190 0x7f883c0af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f8839d9b640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c1437f0 0x7f883c1397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883ad9d640 1 -- 172.21.15.137:0/2003521310 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c1437f0 msgr2=0x7f883c1397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883ad9d640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c1437f0 0x7f883c1397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883ad9d640 1 -- 172.21.15.137:0/2003521310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883c0d1190 msgr2=0x7f883c0af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883ad9d640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883c0d1190 0x7f883c0af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883ad9d640 1 -- 172.21.15.137:0/2003521310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883c0af880 con 0x7f883c160e70 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.618+0000 7f883ad9d640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c160e70 0x7f883c141d50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f883400c7f0 tx=0x7f883400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.619+0000 7f882affd640 1 -- 172.21.15.137:0/2003521310 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834015070 con 0x7f883c160e70 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.619+0000 7f882affd640 1 -- 172.21.15.137:0/2003521310 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8834007820 con 0x7f883c160e70 2024-04-26T22:01:02.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.619+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883c0afb60 con 0x7f883c160e70 2024-04-26T22:01:02.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.619+0000 7f882affd640 1 -- 172.21.15.137:0/2003521310 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834007c10 con 0x7f883c160e70 2024-04-26T22:01:02.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.619+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f883c0b0120 con 0x7f883c160e70 2024-04-26T22:01:02.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.620+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883c06a290 con 0x7f883c160e70 2024-04-26T22:01:02.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.620+0000 7f882affd640 1 -- 172.21.15.137:0/2003521310 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8834018070 con 0x7f883c160e70 2024-04-26T22:01:02.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.620+0000 7f882affd640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f881c06c8f0 0x7f881c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:02.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.620+0000 7f882affd640 1 -- 172.21.15.137:0/2003521310 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5415+0+0 (secure 0 0 0) 0x7f883408bb00 con 0x7f883c160e70 2024-04-26T22:01:02.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.620+0000 7f883a59c640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f881c06c8f0 0x7f881c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:02.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.621+0000 7f883a59c640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f881c06c8f0 0x7f881c06edb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f882c034000 tx=0x7f882c02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:02.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.625+0000 7f882affd640 1 -- 172.21.15.137:0/2003521310 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f883405a0e0 con 0x7f883c160e70 2024-04-26T22:01:02.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:02.801+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f883c06eb80 con 0x7f883c160e70 2024-04-26T22:01:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.495+0000 7f882affd640 1 -- 172.21.15.137:0/2003521310 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) ==== 169+0+0 (secure 0 0 0) 0x7f88340599e0 con 0x7f883c160e70 2024-04-26T22:01:03.495 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T22:01:03.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f881c06c8f0 msgr2=0x7f881c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f881c06c8f0 0x7f881c06edb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f882c034000 tx=0x7f882c02f000 comp rx=0 tx=0).stop 2024-04-26T22:01:03.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c160e70 msgr2=0x7f883c141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c160e70 0x7f883c141d50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f883400c7f0 tx=0x7f883400ccb0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 shutdown_connections 2024-04-26T22:01:03.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f881c06c8f0 0x7f881c06edb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f883c160e70 0x7f883c141d50 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f883c1437f0 0x7f883c1397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 --2- 172.21.15.137:0/2003521310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f883c0d1190 0x7f883c0af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.497+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 >> 172.21.15.137:0/2003521310 conn(0x7f883c06c690 msgr2=0x7f883c0b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:03.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.498+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 shutdown_connections 2024-04-26T22:01:03.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.498+0000 7f88409b6640 1 -- 172.21.15.137:0/2003521310 wait complete. 2024-04-26T22:01:03.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T22:01:03.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.611+0000 7f6300be4640 1 Processor -- start 2024-04-26T22:01:03.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.611+0000 7f6300be4640 1 -- start start 2024-04-26T22:01:03.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.611+0000 7f6300be4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f62fc1631f0 0x7f62fc0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.611+0000 7f6300be4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62fc0d1170 0x7f62fc1635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.611+0000 7f6300be4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62fc09c790 con 0x7f62fc0b3300 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.611+0000 7f6300be4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f62fc0d15f0 con 0x7f62fc0d1170 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.611+0000 7f6300be4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f62fc163ec0 con 0x7f62fc1631f0 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.612+0000 7f62f1d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62fc0d1170 0x7f62fc1635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.612+0000 7f62f1d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f62fc0d1170 0x7f62fc1635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34342/0 (socket says 172.21.15.137:34342) 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.612+0000 7f62f1d9b640 1 -- 172.21.15.137:0/4105240165 learned_addr learned my addr 172.21.15.137:0/4105240165 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.612+0000 7f62fa59c640 1 --2- 172.21.15.137:0/4105240165 >> v2:172.21.15.170:3300/0 conn(0x7f62fc1631f0 0x7f62fc0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.612+0000 7f62f1d9b640 1 -- 172.21.15.137:0/4105240165 >> v2:172.21.15.170:3300/0 conn(0x7f62fc1631f0 msgr2=0x7f62fc0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.612+0000 7f62f1d9b640 1 --2- 172.21.15.137:0/4105240165 >> v2:172.21.15.170:3300/0 conn(0x7f62fc1631f0 0x7f62fc0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.612+0000 7f62f1d9b640 1 -- 172.21.15.137:0/4105240165 >> v1:172.21.15.170:6789/0 conn(0x7f62fc0b3300 legacy=0x7f62fc0b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:03.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.612+0000 7f62f1d9b640 1 -- 172.21.15.137:0/4105240165 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc0d1a40 con 0x7f62fc0d1170 2024-04-26T22:01:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.612+0000 7f62f1d9b640 1 --2- 172.21.15.137:0/4105240165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc0d1170 0x7f62fc1635d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0d2ef0 tx=0x7f62e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e84f4c9dbb387f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f62f9d9b640 1 -- 172.21.15.137:0/4105240165 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4037070 con 0x7f62fc0d1170 2024-04-26T22:01:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f62f9d9b640 1 -- 172.21.15.137:0/4105240165 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4032440 con 0x7f62fc0d1170 2024-04-26T22:01:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f62f9d9b640 1 -- 172.21.15.137:0/4105240165 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4032810 con 0x7f62fc0d1170 2024-04-26T22:01:03.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f6300be4640 1 -- 172.21.15.137:0/4105240165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc0d1170 msgr2=0x7f62fc1635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f6300be4640 1 --2- 172.21.15.137:0/4105240165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc0d1170 0x7f62fc1635d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f62fc0d2ef0 tx=0x7f62e402a1a0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f6300be4640 1 -- 172.21.15.137:0/4105240165 shutdown_connections 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f6300be4640 1 --2- 172.21.15.137:0/4105240165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc0d1170 0x7f62fc1635d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f6300be4640 1 --2- 172.21.15.137:0/4105240165 >> v2:172.21.15.170:3300/0 conn(0x7f62fc1631f0 0x7f62fc0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f6300be4640 1 -- 172.21.15.137:0/4105240165 >> 172.21.15.137:0/4105240165 conn(0x7f62fc09ba40 msgr2=0x7f62fc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f6300be4640 1 -- 172.21.15.137:0/4105240165 shutdown_connections 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.613+0000 7f6300be4640 1 -- 172.21.15.137:0/4105240165 wait complete. 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.615+0000 7f6300be4640 1 Processor -- start 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.615+0000 7f6300be4640 1 -- start start 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.615+0000 7f6300be4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62fc0b3300 0x7f62fc070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.615+0000 7f6300be4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62fc0d1170 0x7f62fc15f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.615+0000 7f6300be4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc1631f0 0x7f62fc15fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.615+0000 7f6300be4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc0d0230 con 0x7f62fc1631f0 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.615+0000 7f6300be4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc0d2000 con 0x7f62fc0d1170 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.615+0000 7f6300be4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f62fc14cf30 con 0x7f62fc0b3300 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.615+0000 7f62fad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc1631f0 0x7f62fc15fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc1631f0 0x7f62fc15fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34348/0 (socket says 172.21.15.137:34348) 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fad9d640 1 -- 172.21.15.137:0/2783139675 learned_addr learned my addr 172.21.15.137:0/2783139675 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62f1d9b640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62fc0d1170 0x7f62fc15f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fa59c640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62fc0b3300 0x7f62fc070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fad9d640 1 -- 172.21.15.137:0/2783139675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62fc0b3300 msgr2=0x7f62fc070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fad9d640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62fc0b3300 0x7f62fc070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fad9d640 1 -- 172.21.15.137:0/2783139675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62fc0d1170 msgr2=0x7f62fc15f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fad9d640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62fc0d1170 0x7f62fc15f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fad9d640 1 -- 172.21.15.137:0/2783139675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc160090 con 0x7f62fc1631f0 2024-04-26T22:01:03.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fa59c640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62fc0b3300 0x7f62fc070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:03.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62fad9d640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc1631f0 0x7f62fc15fb50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f62f400c780 tx=0x7f62f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:03.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62f37fe640 1 -- 172.21.15.137:0/2783139675 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f4004b60 con 0x7f62fc1631f0 2024-04-26T22:01:03.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62f37fe640 1 -- 172.21.15.137:0/2783139675 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f4004d00 con 0x7f62fc1631f0 2024-04-26T22:01:03.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62fc160320 con 0x7f62fc1631f0 2024-04-26T22:01:03.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f62f37fe640 1 -- 172.21.15.137:0/2783139675 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f400aa90 con 0x7f62fc1631f0 2024-04-26T22:01:03.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.616+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62fc09f0e0 con 0x7f62fc1631f0 2024-04-26T22:01:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.617+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62fc06a290 con 0x7f62fc1631f0 2024-04-26T22:01:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.618+0000 7f62f37fe640 1 -- 172.21.15.137:0/2783139675 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62f400ac30 con 0x7f62fc1631f0 2024-04-26T22:01:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.618+0000 7f62f37fe640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f62dc06c8f0 0x7f62dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.618+0000 7f62f37fe640 1 -- 172.21.15.137:0/2783139675 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f62f408baf0 con 0x7f62fc1631f0 2024-04-26T22:01:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.618+0000 7f62fa59c640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f62dc06c8f0 0x7f62dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.618+0000 7f62fa59c640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f62dc06c8f0 0x7f62dc06edb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f62ec006fd0 tx=0x7f62ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:03.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.622+0000 7f62f37fe640 1 -- 172.21.15.137:0/2783139675 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f62f4020070 con 0x7f62fc1631f0 2024-04-26T22:01:03.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.798+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f62fc0b8f10 con 0x7f62fc1631f0 2024-04-26T22:01:03.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.801+0000 7f62f37fe640 1 -- 172.21.15.137:0/2783139675 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f62f405a220 con 0x7f62fc1631f0 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f62dc06c8f0 msgr2=0x7f62dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f62dc06c8f0 0x7f62dc06edb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f62ec006fd0 tx=0x7f62ec008040 comp rx=0 tx=0).stop 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc1631f0 msgr2=0x7f62fc15fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc1631f0 0x7f62fc15fb50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f62f400c780 tx=0x7f62f400cc40 comp rx=0 tx=0).stop 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 shutdown_connections 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f62dc06c8f0 0x7f62dc06edb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f62fc1631f0 0x7f62fc15fb50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62fc0d1170 0x7f62fc15f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 --2- 172.21.15.137:0/2783139675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f62fc0b3300 0x7f62fc070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.803+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 >> 172.21.15.137:0/2783139675 conn(0x7f62fc09ba40 msgr2=0x7f62fc06e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.804+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 shutdown_connections 2024-04-26T22:01:03.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.804+0000 7f6300be4640 1 -- 172.21.15.137:0/2783139675 wait complete. 2024-04-26T22:01:03.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-26T22:01:03.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.914+0000 7effa6fe2640 1 Processor -- start 2024-04-26T22:01:03.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.915+0000 7effa6fe2640 1 -- start start 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.915+0000 7effa6fe2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7effa00d0b20 0x7effa00ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.915+0000 7effa6fe2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa00cda60 con 0x7effa015d360 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.915+0000 7effa6fe2640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa00d1100 con 0x7effa00d1510 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.915+0000 7effa6fe2640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7effa015d740 con 0x7effa00d0b20 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.915+0000 7eff9ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7effa00d0b20 0x7effa00ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.915+0000 7effa4d7e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7effa015d360 0x7effa009c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41710/0 (socket says 172.21.15.137:41710) 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.915+0000 7effa4d7e640 1 -- 172.21.15.137:0/4066116642 learned_addr learned my addr 172.21.15.137:0/4066116642 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.916+0000 7eff9ffff640 1 -- 172.21.15.137:0/4066116642 >> v1:172.21.15.170:6789/0 conn(0x7effa00d1510 legacy=0x7effa0070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.916+0000 7eff9ffff640 1 -- 172.21.15.137:0/4066116642 >> v1:172.21.15.137:6789/0 conn(0x7effa015d360 legacy=0x7effa009c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.916+0000 7eff9ffff640 1 -- 172.21.15.137:0/4066116642 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa00cdd00 con 0x7effa00d0b20 2024-04-26T22:01:03.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.916+0000 7eff9f7fe640 1 -- 172.21.15.137:0/4066116642 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3434206755 0 0) 0x7effa00cda60 con 0x7effa015d360 2024-04-26T22:01:03.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.916+0000 7eff9ffff640 1 --2- 172.21.15.137:0/4066116642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d0b20 0x7effa00ce7e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0097a0 tx=0x7eff8c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4d6809949f9dca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:03.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7eff9f7fe640 1 -- 172.21.15.137:0/4066116642 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c037070 con 0x7effa00d0b20 2024-04-26T22:01:03.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7eff9f7fe640 1 -- 172.21.15.137:0/4066116642 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8c032440 con 0x7effa00d0b20 2024-04-26T22:01:03.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7eff9f7fe640 1 -- 172.21.15.137:0/4066116642 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c032810 con 0x7effa00d0b20 2024-04-26T22:01:03.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7effa6fe2640 1 -- 172.21.15.137:0/4066116642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d0b20 msgr2=0x7effa00ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7effa6fe2640 1 --2- 172.21.15.137:0/4066116642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d0b20 0x7effa00ce7e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0097a0 tx=0x7eff8c02a230 comp rx=0 tx=0).stop 2024-04-26T22:01:03.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7effa6fe2640 1 -- 172.21.15.137:0/4066116642 shutdown_connections 2024-04-26T22:01:03.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7effa6fe2640 1 --2- 172.21.15.137:0/4066116642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d0b20 0x7effa00ce7e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7effa6fe2640 1 -- 172.21.15.137:0/4066116642 >> 172.21.15.137:0/4066116642 conn(0x7effa00b4a40 msgr2=0x7effa00b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:03.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7effa6fe2640 1 -- 172.21.15.137:0/4066116642 shutdown_connections 2024-04-26T22:01:03.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.917+0000 7effa6fe2640 1 -- 172.21.15.137:0/4066116642 wait complete. 2024-04-26T22:01:03.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.918+0000 7effa6fe2640 1 Processor -- start 2024-04-26T22:01:03.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.918+0000 7effa6fe2640 1 -- start start 2024-04-26T22:01:03.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7effa6fe2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7effa00d0b20 0x7effa015fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7effa6fe2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d1510 0x7effa0151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7effa6fe2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effa015d360 0x7effa015e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7effa6fe2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7effa00ceea0 con 0x7effa00d1510 2024-04-26T22:01:03.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7effa6fe2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7effa00ced20 con 0x7effa015d360 2024-04-26T22:01:03.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7effa6fe2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7effa0070a20 con 0x7effa00d0b20 2024-04-26T22:01:03.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d1510 0x7effa0151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d1510 0x7effa0151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34358/0 (socket says 172.21.15.137:34358) 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7eff9ffff640 1 -- 172.21.15.137:0/154101975 learned_addr learned my addr 172.21.15.137:0/154101975 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7effa4d7e640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7effa00d0b20 0x7effa015fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.919+0000 7effa557f640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effa015d360 0x7effa015e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7eff9ffff640 1 -- 172.21.15.137:0/154101975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7effa00d0b20 msgr2=0x7effa015fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7eff9ffff640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7effa00d0b20 0x7effa015fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7eff9ffff640 1 -- 172.21.15.137:0/154101975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effa015d360 msgr2=0x7effa015e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7eff9ffff640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effa015d360 0x7effa015e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7eff9ffff640 1 -- 172.21.15.137:0/154101975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa015ee40 con 0x7effa00d1510 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7eff9ffff640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d1510 0x7effa0151560 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7eff8c035040 tx=0x7eff8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7eff9d7fa640 1 -- 172.21.15.137:0/154101975 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c037050 con 0x7effa00d1510 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7eff9d7fa640 1 -- 172.21.15.137:0/154101975 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8c038040 con 0x7effa00d1510 2024-04-26T22:01:03.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa015f120 con 0x7effa00d1510 2024-04-26T22:01:03.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7eff9d7fa640 1 -- 172.21.15.137:0/154101975 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c004470 con 0x7effa00d1510 2024-04-26T22:01:03.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.920+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa015f6e0 con 0x7effa00d1510 2024-04-26T22:01:03.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.921+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa00693d0 con 0x7effa00d1510 2024-04-26T22:01:03.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.921+0000 7eff9d7fa640 1 -- 172.21.15.137:0/154101975 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff8c030880 con 0x7effa00d1510 2024-04-26T22:01:03.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.922+0000 7eff9d7fa640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff8406c920 0x7eff8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:03.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.922+0000 7eff9d7fa640 1 -- 172.21.15.137:0/154101975 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7eff8c0ac290 con 0x7effa00d1510 2024-04-26T22:01:03.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.922+0000 7effa4d7e640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff8406c920 0x7eff8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:03.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.922+0000 7effa4d7e640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff8406c920 0x7eff8406ede0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7eff94000f60 tx=0x7eff94007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:03.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:03.926+0000 7eff9d7fa640 1 -- 172.21.15.137:0/154101975 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7eff8c07a400 con 0x7effa00d1510 2024-04-26T22:01:04.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.170+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) -- 0x7effa00b47f0 con 0x7effa00d1510 2024-04-26T22:01:04.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.496+0000 7eff9d7fa640 1 -- 172.21.15.137:0/154101975 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v144) ==== 149+0+0 (secure 0 0 0) 0x7eff8c07e700 con 0x7effa00d1510 2024-04-26T22:01:04.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff8406c920 msgr2=0x7eff8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff8406c920 0x7eff8406ede0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7eff94000f60 tx=0x7eff94007e40 comp rx=0 tx=0).stop 2024-04-26T22:01:04.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d1510 msgr2=0x7effa0151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d1510 0x7effa0151560 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7eff8c035040 tx=0x7eff8c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 shutdown_connections 2024-04-26T22:01:04.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff8406c920 0x7eff8406ede0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7effa00d1510 0x7effa0151560 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7effa015d360 0x7effa015e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 --2- 172.21.15.137:0/154101975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7effa00d0b20 0x7effa015fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 >> 172.21.15.137:0/154101975 conn(0x7effa00b4a40 msgr2=0x7effa00b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:04.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 shutdown_connections 2024-04-26T22:01:04.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.499+0000 7effa6fe2640 1 -- 172.21.15.137:0/154101975 wait complete. 2024-04-26T22:01:04.510 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-04-26T22:01:04.510 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-26T22:01:04.510 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-26T22:01:04.511 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:01:04.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.609+0000 7f788e237640 1 Processor -- start 2024-04-26T22:01:04.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.609+0000 7f788e237640 1 -- start start 2024-04-26T22:01:04.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.609+0000 7f788e237640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815f370 0x7f78880cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.609+0000 7f788e237640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f78880d3ee0 0x7f78880b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.609+0000 7f788e237640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78880d03a0 con 0x7f788815f750 2024-04-26T22:01:04.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.609+0000 7f788e237640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f78880b4d10 con 0x7f78880d3ee0 2024-04-26T22:01:04.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.609+0000 7f788e237640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f78880d0680 con 0x7f788815f370 2024-04-26T22:01:04.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f7886ffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f788815f750 0x7f78880d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41714/0 (socket says 172.21.15.137:41714) 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f7886ffd640 1 -- 172.21.15.137:0/2779724515 learned_addr learned my addr 172.21.15.137:0/2779724515 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3061878102 0 0) 0x7f78880d03a0 con 0x7f788815f750 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7870003520 con 0x7f788815f750 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78877fe640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815f370 0x7f78880cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f7887fff640 1 --2- 172.21.15.137:0/2779724515 >> v2:172.21.15.170:3300/0 conn(0x7f78880d3ee0 0x7f78880b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 486221588 0 0) 0x7f7870003520 con 0x7f788815f750 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815f370 msgr2=0x7f78880cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815f370 0x7f78880cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 >> v2:172.21.15.170:3300/0 conn(0x7f78880d3ee0 msgr2=0x7f78880b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 --2- 172.21.15.137:0/2779724515 >> v2:172.21.15.170:3300/0 conn(0x7f78880d3ee0 0x7f78880b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78880d0960 con 0x7f788815f750 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f787c001670 con 0x7f788815f750 2024-04-26T22:01:04.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 >> v1:172.21.15.137:6789/0 conn(0x7f788815f750 legacy=0x7f78880d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815f370 0x7f78700039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7870004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7870004d40 0x7f78700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78880b4d10 con 0x7f7870003f30 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f78880d0680 con 0x7f7870004d40 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f787000ba10 con 0x7f788815f370 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f7886ffd640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7870004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f78877fe640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815f370 0x7f78700039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.610+0000 7f7887fff640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7870004d40 0x7f78700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.611+0000 7f7886ffd640 1 -- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815f370 msgr2=0x7f78700039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.611+0000 7f7886ffd640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815f370 0x7f78700039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.611+0000 7f7886ffd640 1 -- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7870004d40 msgr2=0x7f78700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.611+0000 7f7886ffd640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7870004d40 0x7f78700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.611+0000 7f7886ffd640 1 -- 172.21.15.137:0/2779724515 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7870003520 con 0x7f7870003f30 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.611+0000 7f7886ffd640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7870004800 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c2c0 tx=0x7f7870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1e55041a490312 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.611+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c007d50 con 0x7f7870003f30 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.611+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c02e070 con 0x7f7870003f30 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.611+0000 7f78867fc640 1 -- 172.21.15.137:0/2779724515 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c005d70 con 0x7f7870003f30 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.612+0000 7f788e237640 1 -- 172.21.15.137:0/2779724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 msgr2=0x7f7870004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.612+0000 7f788e237640 1 --2- 172.21.15.137:0/2779724515 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7870004800 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c2c0 tx=0x7f7870005830 comp rx=0 tx=0).stop 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.612+0000 7f7887fff640 1 -- 172.21.15.137:0/2779724515 reap_dead start 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.612+0000 7f788e237640 1 -- 172.21.15.137:0/2779724515 shutdown_connections 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.612+0000 7f788e237640 1 -- 172.21.15.137:0/2779724515 >> 172.21.15.137:0/2779724515 conn(0x7f788808ec10 msgr2=0x7f788809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.612+0000 7f788e237640 1 -- 172.21.15.137:0/2779724515 shutdown_connections 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.612+0000 7f788e237640 1 -- 172.21.15.137:0/2779724515 wait complete. 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.613+0000 7f788e237640 1 Processor -- start 2024-04-26T22:01:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.613+0000 7f788e237640 1 -- start start 2024-04-26T22:01:04.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f788e237640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7888156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f788e237640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880cc2c0 0x7f788815d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f788e237640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815dc60 0x7f78880b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f788e237640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f78880cfd70 con 0x7f7870003f30 2024-04-26T22:01:04.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f788e237640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f78880d0f20 con 0x7f78880cc2c0 2024-04-26T22:01:04.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f788e237640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f78880cfef0 con 0x7f788815dc60 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f78877fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7888156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f78877fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7888156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34372/0 (socket says 172.21.15.137:34372) 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f78877fe640 1 -- 172.21.15.137:0/507612611 learned_addr learned my addr 172.21.15.137:0/507612611 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f7887fff640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815dc60 0x7f78880b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f7886ffd640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880cc2c0 0x7f788815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f78877fe640 1 -- 172.21.15.137:0/507612611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815dc60 msgr2=0x7f78880b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f78877fe640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815dc60 0x7f78880b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f78877fe640 1 -- 172.21.15.137:0/507612611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880cc2c0 msgr2=0x7f788815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f78877fe640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880cc2c0 0x7f788815d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.614+0000 7f78877fe640 1 -- 172.21.15.137:0/507612611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78880b2ae0 con 0x7f7870003f30 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.615+0000 7f78877fe640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7888156470 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7878011a00 tx=0x7f7878011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.615+0000 7f786ffff640 1 -- 172.21.15.137:0/507612611 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787800faf0 con 0x7f7870003f30 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.615+0000 7f786ffff640 1 -- 172.21.15.137:0/507612611 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787800fc90 con 0x7f7870003f30 2024-04-26T22:01:04.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.615+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78880b2dc0 con 0x7f7870003f30 2024-04-26T22:01:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.615+0000 7f786ffff640 1 -- 172.21.15.137:0/507612611 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878014440 con 0x7f7870003f30 2024-04-26T22:01:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.615+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78880b95c0 con 0x7f7870003f30 2024-04-26T22:01:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.616+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f788806a290 con 0x7f7870003f30 2024-04-26T22:01:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.616+0000 7f786ffff640 1 -- 172.21.15.137:0/507612611 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7878012040 con 0x7f7870003f30 2024-04-26T22:01:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.617+0000 7f786ffff640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f787406c8f0 0x7f787406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.617+0000 7f786ffff640 1 -- 172.21.15.137:0/507612611 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f787808bbe0 con 0x7f7870003f30 2024-04-26T22:01:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.617+0000 7f7886ffd640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f787406c8f0 0x7f787406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.617+0000 7f7886ffd640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f787406c8f0 0x7f787406edb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f787c033000 tx=0x7f787c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:04.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.621+0000 7f786ffff640 1 -- 172.21.15.137:0/507612611 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7878019030 con 0x7f7870003f30 2024-04-26T22:01:04.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.797+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f788815ec90 con 0x7f7870003f30 2024-04-26T22:01:04.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.797+0000 7f786ffff640 1 -- 172.21.15.137:0/507612611 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+13032 (secure 0 0 0) 0x7f7878059d50 con 0x7f7870003f30 2024-04-26T22:01:04.798 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:04.798 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":51,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:01:03.492222+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/924509332":"2024-04-27T22:01:00.480151+0000","172.21.15.137:6836/924509332":"2024-04-27T22:01:00.480151+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.799+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f787406c8f0 msgr2=0x7f787406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.799+0000 7f788e237640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f787406c8f0 0x7f787406edb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f787c033000 tx=0x7f787c009030 comp rx=0 tx=0).stop 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.799+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 msgr2=0x7f7888156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.799+0000 7f788e237640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7888156470 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7878011a00 tx=0x7f7878011ec0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.800+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 shutdown_connections 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.800+0000 7f788e237640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f787406c8f0 0x7f787406edb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.800+0000 7f788e237640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f788815dc60 0x7f78880b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.800+0000 7f788e237640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78880cc2c0 0x7f788815d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.800+0000 7f788e237640 1 --2- 172.21.15.137:0/507612611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7870003f30 0x7f7888156470 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.800+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 >> 172.21.15.137:0/507612611 conn(0x7f788808ec10 msgr2=0x7f788806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.800+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 shutdown_connections 2024-04-26T22:01:04.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.800+0000 7f788e237640 1 -- 172.21.15.137:0/507612611 wait complete. 2024-04-26T22:01:04.811 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:01:04.812 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:01:04.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.911+0000 7fc64550a640 1 Processor -- start 2024-04-26T22:01:04.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.911+0000 7fc64550a640 1 -- start start 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc64550a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6400706a0 0x7fc64006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc64550a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc640070b30 con 0x7fc64015f2b0 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc64550a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc640070e10 con 0x7fc64006c9b0 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc64550a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc6400af610 con 0x7fc6400706a0 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63effd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc64015f2b0 0x7fc64006c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41722/0 (socket says 172.21.15.137:41722) 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63effd640 1 -- 172.21.15.137:0/3000957718 learned_addr learned my addr 172.21.15.137:0/3000957718 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63e7fc640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6400706a0 0x7fc64006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181646369 0 0) 0x7fc640070b30 con 0x7fc64015f2b0 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc628003520 con 0x7fc64015f2b0 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3623855736 0 0) 0x7fc628003520 con 0x7fc64015f2b0 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6400706a0 msgr2=0x7fc64006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:04.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6400706a0 0x7fc64006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 >> v1:172.21.15.170:6789/0 conn(0x7fc64006c9b0 legacy=0x7fc6400afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6400710f0 con 0x7fc64015f2b0 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fc6300019f0 con 0x7fc64015f2b0 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 >> v1:172.21.15.137:6789/0 conn(0x7fc64015f2b0 legacy=0x7fc64006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6280039e0 0x7fc628003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc628004800 0x7fc628004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.912+0000 7fc63dffb640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6280051c0 0x7fc62800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc62800bf00 con 0x7fc628004800 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc62800c080 con 0x7fc6280039e0 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc62800c200 con 0x7fc6280051c0 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63e7fc640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc628004800 0x7fc628004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63effd640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6280039e0 0x7fc628003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63f7fe640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6280051c0 0x7fc62800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63e7fc640 1 -- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6280051c0 msgr2=0x7fc62800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:04.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63e7fc640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6280051c0 0x7fc62800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63e7fc640 1 -- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6280039e0 msgr2=0x7fc628003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63e7fc640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6280039e0 0x7fc628003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.913+0000 7fc63e7fc640 1 -- 172.21.15.137:0/3000957718 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc628003520 con 0x7fc628004800 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc63e7fc640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc628004800 0x7fc628004c80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc634009ac0 tx=0x7fc628005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d597cb946b159e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634036070 con 0x7fc628004800 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634031400 con 0x7fc628004800 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc63dffb640 1 -- 172.21.15.137:0/3000957718 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634009690 con 0x7fc628004800 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc64550a640 1 -- 172.21.15.137:0/3000957718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc628004800 msgr2=0x7fc628004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc64550a640 1 --2- 172.21.15.137:0/3000957718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc628004800 0x7fc628004c80 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc634009ac0 tx=0x7fc628005830 comp rx=0 tx=0).stop 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc63f7fe640 1 -- 172.21.15.137:0/3000957718 reap_dead start 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc64550a640 1 -- 172.21.15.137:0/3000957718 shutdown_connections 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc64550a640 1 -- 172.21.15.137:0/3000957718 >> 172.21.15.137:0/3000957718 conn(0x7fc64006f050 msgr2=0x7fc64006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc64550a640 1 -- 172.21.15.137:0/3000957718 shutdown_connections 2024-04-26T22:01:04.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.914+0000 7fc64550a640 1 -- 172.21.15.137:0/3000957718 wait complete. 2024-04-26T22:01:04.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc64550a640 1 Processor -- start 2024-04-26T22:01:04.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc64550a640 1 -- start start 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc64550a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc628004800 0x7fc640158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc64550a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6400b2160 0x7fc640160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc64550a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6401e9e00 0x7fc6401ea290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc64550a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6400b1890 con 0x7fc6400b2160 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc64550a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc6400b4f40 con 0x7fc628004800 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc64550a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc64015f690 con 0x7fc6401e9e00 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc63e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6400b2160 0x7fc640160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc63e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6400b2160 0x7fc640160ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34394/0 (socket says 172.21.15.137:34394) 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc63e7fc640 1 -- 172.21.15.137:0/3611885382 learned_addr learned my addr 172.21.15.137:0/3611885382 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:04.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc63effd640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc628004800 0x7fc640158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.916+0000 7fc63f7fe640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6401e9e00 0x7fc6401ea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc63e7fc640 1 -- 172.21.15.137:0/3611885382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6401e9e00 msgr2=0x7fc6401ea290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc63e7fc640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6401e9e00 0x7fc6401ea290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc63e7fc640 1 -- 172.21.15.137:0/3611885382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc628004800 msgr2=0x7fc640158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc63e7fc640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc628004800 0x7fc640158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc63e7fc640 1 -- 172.21.15.137:0/3611885382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6401e90b0 con 0x7fc6400b2160 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc63e7fc640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6400b2160 0x7fc640160ef0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc634009be0 tx=0x7fc634004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc6277fe640 1 -- 172.21.15.137:0/3611885382 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634040020 con 0x7fc6400b2160 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc6277fe640 1 -- 172.21.15.137:0/3611885382 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc634003940 con 0x7fc6400b2160 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc6277fe640 1 -- 172.21.15.137:0/3611885382 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634036040 con 0x7fc6400b2160 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6401e9390 con 0x7fc6400b2160 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.917+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6401e9950 con 0x7fc6400b2160 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.918+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64006a290 con 0x7fc6400b2160 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.918+0000 7fc6277fe640 1 -- 172.21.15.137:0/3611885382 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc634043020 con 0x7fc6400b2160 2024-04-26T22:01:04.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.919+0000 7fc6277fe640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc62c06c970 0x7fc62c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:04.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.919+0000 7fc6277fe640 1 -- 172.21.15.137:0/3611885382 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fc6340abd70 con 0x7fc6400b2160 2024-04-26T22:01:04.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.919+0000 7fc63effd640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc62c06c970 0x7fc62c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:04.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.919+0000 7fc63effd640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc62c06c970 0x7fc62c06ee30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc6300013d0 tx=0x7fc630006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:04.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:04.923+0000 7fc6277fe640 1 -- 172.21.15.137:0/3611885382 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc63404a030 con 0x7fc6400b2160 2024-04-26T22:01:05.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.103+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc6401f82a0 con 0x7fc6400b2160 2024-04-26T22:01:05.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.104+0000 7fc6277fe640 1 -- 172.21.15.137:0/3611885382 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7fc634079e30 con 0x7fc6400b2160 2024-04-26T22:01:05.104 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:01:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc62c06c970 msgr2=0x7fc62c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc62c06c970 0x7fc62c06ee30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc6300013d0 tx=0x7fc630006040 comp rx=0 tx=0).stop 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6400b2160 msgr2=0x7fc640160ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6400b2160 0x7fc640160ef0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc634009be0 tx=0x7fc634004730 comp rx=0 tx=0).stop 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 shutdown_connections 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc62c06c970 0x7fc62c06ee30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6400b2160 0x7fc640160ef0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6401e9e00 0x7fc6401ea290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 --2- 172.21.15.137:0/3611885382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc628004800 0x7fc640158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 >> 172.21.15.137:0/3611885382 conn(0x7fc64006f050 msgr2=0x7fc64006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 shutdown_connections 2024-04-26T22:01:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.106+0000 7fc64550a640 1 -- 172.21.15.137:0/3611885382 wait complete. 2024-04-26T22:01:05.118 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-26T22:01:05.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.215+0000 7fb7fe4b0640 1 Processor -- start 2024-04-26T22:01:05.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.215+0000 7fb7fe4b0640 1 -- start start 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.216+0000 7fb7fe4b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f80733c0 0x7fb7f80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.216+0000 7fb7fe4b0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f815d510 con 0x7fb7f815d130 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.216+0000 7fb7fe4b0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f80d12c0 con 0x7fb7f806d9c0 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.216+0000 7fb7fe4b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f80b0e80 con 0x7fb7f80733c0 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.216+0000 7fb7f7fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb7f815d130 0x7fb7f806d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:41734/0 (socket says 172.21.15.137:41734) 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.216+0000 7fb7f7fff640 1 -- 172.21.15.137:0/4051205881 learned_addr learned my addr 172.21.15.137:0/4051205881 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.216+0000 7fb7fca4d640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f80733c0 0x7fb7f80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.216+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429109094 0 0) 0x7fb7f815d510 con 0x7fb7f815d130 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e0003520 con 0x7fb7f815d130 2024-04-26T22:01:05.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2977952985 0 0) 0x7fb7e0003520 con 0x7fb7f815d130 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f80733c0 msgr2=0x7fb7f80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f80733c0 0x7fb7f80b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 >> v1:172.21.15.170:6789/0 conn(0x7fb7f806d9c0 legacy=0x7fb7f80b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f80d0220 con 0x7fb7f815d130 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fb7e8001670 con 0x7fb7f815d130 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 >> v1:172.21.15.137:6789/0 conn(0x7fb7f815d130 legacy=0x7fb7f806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f80733c0 0x7fb7e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e0004d40 0x7fb7e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f80b0e80 con 0x7fb7e0003f20 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e000ba20 con 0x7fb7e0004d40 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e000bc20 con 0x7fb7f80733c0 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f77fe640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f7fff640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f80733c0 0x7fb7e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7fca4d640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e0004d40 0x7fb7e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f77fe640 1 -- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f80733c0 msgr2=0x7fb7e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f77fe640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f80733c0 0x7fb7e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f77fe640 1 -- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e0004d40 msgr2=0x7fb7e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f77fe640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e0004d40 0x7fb7e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7f77fe640 1 -- 172.21.15.137:0/4051205881 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e0003520 con 0x7fb7e0003f20 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.217+0000 7fb7fca4d640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e0004d40 0x7fb7e00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.218+0000 7fb7f77fe640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7e0004800 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec001830 tx=0x7fb7e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb30ec762531cb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.218+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec037070 con 0x7fb7e0003f20 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.218+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec02ab00 con 0x7fb7e0003f20 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.218+0000 7fb7f6ffd640 1 -- 172.21.15.137:0/4051205881 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec001430 con 0x7fb7e0003f20 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.219+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4051205881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 msgr2=0x7fb7e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.219+0000 7fb7fe4b0640 1 --2- 172.21.15.137:0/4051205881 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7e0004800 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec001830 tx=0x7fb7e0005830 comp rx=0 tx=0).stop 2024-04-26T22:01:05.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.219+0000 7fb7fca4d640 1 -- 172.21.15.137:0/4051205881 reap_dead start 2024-04-26T22:01:05.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.219+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4051205881 shutdown_connections 2024-04-26T22:01:05.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.219+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4051205881 >> 172.21.15.137:0/4051205881 conn(0x7fb7f80728a0 msgr2=0x7fb7f8072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:05.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.219+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4051205881 shutdown_connections 2024-04-26T22:01:05.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.219+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4051205881 wait complete. 2024-04-26T22:01:05.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.220+0000 7fb7fe4b0640 1 Processor -- start 2024-04-26T22:01:05.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.220+0000 7fb7fe4b0640 1 -- start start 2024-04-26T22:01:05.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7fe4b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7f81478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7fe4b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7f815e9e0 0x7fb7f814b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7fe4b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f814bd70 0x7fb7f80b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7fe4b0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f80d0ac0 con 0x7fb7e0003f20 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7fe4b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f80d07e0 con 0x7fb7f815e9e0 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7fe4b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f80d0da0 con 0x7fb7f814bd70 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7f81478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7f81478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34406/0 (socket says 172.21.15.137:34406) 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f7fff640 1 -- 172.21.15.137:0/4228389184 learned_addr learned my addr 172.21.15.137:0/4228389184 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f7fff640 1 -- 172.21.15.137:0/4228389184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f814bd70 msgr2=0x7fb7f80b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f7fff640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f814bd70 0x7fb7f80b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f7fff640 1 -- 172.21.15.137:0/4228389184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7f815e9e0 msgr2=0x7fb7f814b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f7fff640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7f815e9e0 0x7fb7f814b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f7fff640 1 -- 172.21.15.137:0/4228389184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f815ee70 con 0x7fb7e0003f20 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f7fff640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7f81478d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80072c0 tx=0x7fb7e8007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:05.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f4ff9640 1 -- 172.21.15.137:0/4228389184 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800f940 con 0x7fb7e0003f20 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f4ff9640 1 -- 172.21.15.137:0/4228389184 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e8018070 con 0x7fb7e0003f20 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7f4ff9640 1 -- 172.21.15.137:0/4228389184 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e800fd60 con 0x7fb7e0003f20 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f815ff00 con 0x7fb7e0003f20 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.221+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f80b5860 con 0x7fb7e0003f20 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.222+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f815fd30 con 0x7fb7e0003f20 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.223+0000 7fb7f4ff9640 1 -- 172.21.15.137:0/4228389184 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7e801d460 con 0x7fb7e0003f20 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.223+0000 7fb7f4ff9640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb7e406c8f0 0x7fb7e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.223+0000 7fb7f4ff9640 1 -- 172.21.15.137:0/4228389184 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fb7e808b900 con 0x7fb7e0003f20 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.223+0000 7fb7f77fe640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb7e406c8f0 0x7fb7e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.223+0000 7fb7f77fe640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb7e406c8f0 0x7fb7e406edb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec034000 tx=0x7fb7ec02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:05.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.227+0000 7fb7f4ff9640 1 -- 172.21.15.137:0/4228389184 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb7e8059fa0 con 0x7fb7e0003f20 2024-04-26T22:01:05.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.468+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7fb7f80b0ae0 con 0x7fb7e0003f20 2024-04-26T22:01:05.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.503+0000 7fb7f4ff9640 1 -- 172.21.15.137:0/4228389184 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v145) ==== 172+0+0 (secure 0 0 0) 0x7fb7e80598a0 con 0x7fb7e0003f20 2024-04-26T22:01:05.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb7e406c8f0 msgr2=0x7fb7e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb7e406c8f0 0x7fb7e406edb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec034000 tx=0x7fb7ec02e000 comp rx=0 tx=0).stop 2024-04-26T22:01:05.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 msgr2=0x7fb7f81478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7f81478d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80072c0 tx=0x7fb7e8007780 comp rx=0 tx=0).stop 2024-04-26T22:01:05.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 shutdown_connections 2024-04-26T22:01:05.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb7e406c8f0 0x7fb7e406edb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7f814bd70 0x7fb7f80b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7f815e9e0 0x7fb7f814b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 --2- 172.21.15.137:0/4228389184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7e0003f20 0x7fb7f81478d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 >> 172.21.15.137:0/4228389184 conn(0x7fb7f80728a0 msgr2=0x7fb7f8072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:05.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 shutdown_connections 2024-04-26T22:01:05.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.505+0000 7fb7fe4b0640 1 -- 172.21.15.137:0/4228389184 wait complete. 2024-04-26T22:01:05.516 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T22:01:05.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.617+0000 7f9cb0209640 1 Processor -- start 2024-04-26T22:01:05.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.617+0000 7f9cb0209640 1 -- start start 2024-04-26T22:01:05.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cb0209640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9ca80b2000 0x7f9ca806ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cb0209640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca80d1170 0x7f9ca80b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cb0209640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca809c790 con 0x7f9ca81631f0 2024-04-26T22:01:05.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cb0209640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca80d1600 con 0x7f9ca80b2000 2024-04-26T22:01:05.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cb0209640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca8163ec0 con 0x7f9ca80d1170 2024-04-26T22:01:05.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cadfa5640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9ca81631f0 0x7f9ca81635d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32790/0 (socket says 172.21.15.137:32790) 2024-04-26T22:01:05.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cadfa5640 1 -- 172.21.15.137:0/567735264 learned_addr learned my addr 172.21.15.137:0/567735264 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:05.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/567735264 >> v2:172.21.15.170:3300/0 conn(0x7f9ca80b2000 0x7f9ca806ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cae7a6640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca80d1170 0x7f9ca80b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697605380 0 0) 0x7f9ca809c790 con 0x7f9ca81631f0 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c94003520 con 0x7f9ca81631f0 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2436168101 0 0) 0x7f9c94003520 con 0x7f9ca81631f0 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca80d1170 msgr2=0x7f9ca80b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cacfa3640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca80d1170 0x7f9ca80b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 >> v2:172.21.15.170:3300/0 conn(0x7f9ca80b2000 msgr2=0x7f9ca806ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cacfa3640 1 --2- 172.21.15.137:0/567735264 >> v2:172.21.15.170:3300/0 conn(0x7f9ca80b2000 0x7f9ca806ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.618+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca80d1a40 con 0x7f9ca81631f0 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f9ca0001670 con 0x7f9ca81631f0 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/567735264 >> v2:172.21.15.170:3300/0 conn(0x7f9ca80b2000 0x7f9ca806ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 >> v1:172.21.15.137:6789/0 conn(0x7f9ca81631f0 legacy=0x7f9ca81635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cacfa3640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca80d1170 0x7f9c940039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cacfa3640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9c94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cacfa3640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c94004d40 0x7f9c940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca8163ec0 con 0x7f9c94003f30 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9400b9c0 con 0x7f9c94004d40 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9400bb90 con 0x7f9ca80d1170 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9c94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cadfa5640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca80d1170 0x7f9c940039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cae7a6640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c94004d40 0x7f9c940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cad7a4640 1 -- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca80d1170 msgr2=0x7f9c940039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca80d1170 0x7f9c940039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cad7a4640 1 -- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c94004d40 msgr2=0x7f9c940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9c94004d40 0x7f9c940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cad7a4640 1 -- 172.21.15.137:0/567735264 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c94003520 con 0x7f9c94003f30 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.619+0000 7f9cadfa5640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca80d1170 0x7f9c940039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:05.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9c94004800 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009cc0 tx=0x7f9c94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778d5a0a63f12969 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98036070 con 0x7f9c94003f30 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c98031400 con 0x7f9c94003f30 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cacfa3640 1 -- 172.21.15.137:0/567735264 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98009860 con 0x7f9c94003f30 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cb0209640 1 -- 172.21.15.137:0/567735264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 msgr2=0x7f9c94004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cb0209640 1 --2- 172.21.15.137:0/567735264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9c94004800 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009cc0 tx=0x7f9c94005830 comp rx=0 tx=0).stop 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cae7a6640 1 -- 172.21.15.137:0/567735264 reap_dead start 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cb0209640 1 -- 172.21.15.137:0/567735264 shutdown_connections 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cb0209640 1 -- 172.21.15.137:0/567735264 >> 172.21.15.137:0/567735264 conn(0x7f9ca809ba40 msgr2=0x7f9ca809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cb0209640 1 -- 172.21.15.137:0/567735264 shutdown_connections 2024-04-26T22:01:05.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.620+0000 7f9cb0209640 1 -- 172.21.15.137:0/567735264 wait complete. 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cb0209640 1 Processor -- start 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cb0209640 1 -- start start 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cb0209640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9ca80b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cb0209640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca814db30 0x7f9ca81e8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cb0209640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca81e93f0 0x7f9ca81e9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cb0209640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca80d0230 con 0x7f9c94003f30 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cb0209640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca80d2000 con 0x7f9ca814db30 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cb0209640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca814adf0 con 0x7f9ca81e93f0 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cadfa5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9ca80b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cadfa5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9ca80b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34312/0 (socket says 172.21.15.137:34312) 2024-04-26T22:01:05.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.622+0000 7f9cadfa5640 1 -- 172.21.15.137:0/3360793882 learned_addr learned my addr 172.21.15.137:0/3360793882 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca814db30 0x7f9ca81e8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cae7a6640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca81e93f0 0x7f9ca81e9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cadfa5640 1 -- 172.21.15.137:0/3360793882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca81e93f0 msgr2=0x7f9ca81e9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cadfa5640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca81e93f0 0x7f9ca81e9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cadfa5640 1 -- 172.21.15.137:0/3360793882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca814db30 msgr2=0x7f9ca81e8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cadfa5640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca814db30 0x7f9ca81e8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cadfa5640 1 -- 172.21.15.137:0/3360793882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca8161330 con 0x7f9c94003f30 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca814db30 0x7f9ca81e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cadfa5640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9ca80b0fe0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000fb0 tx=0x7f9ca000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9c9e7fc640 1 -- 172.21.15.137:0/3360793882 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca000ee60 con 0x7f9c94003f30 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9c9e7fc640 1 -- 172.21.15.137:0/3360793882 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca0018070 con 0x7f9c94003f30 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9c9e7fc640 1 -- 172.21.15.137:0/3360793882 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca000ca90 con 0x7f9c94003f30 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca814b040 con 0x7f9c94003f30 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.623+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca80b1520 con 0x7f9c94003f30 2024-04-26T22:01:05.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.624+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca806a290 con 0x7f9c94003f30 2024-04-26T22:01:05.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.624+0000 7f9c9e7fc640 1 -- 172.21.15.137:0/3360793882 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ca000cc30 con 0x7f9c94003f30 2024-04-26T22:01:05.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.625+0000 7f9c9e7fc640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c8c06c8f0 0x7f9c8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:05.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.625+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c8c06c8f0 0x7f9c8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:05.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.625+0000 7f9c9e7fc640 1 -- 172.21.15.137:0/3360793882 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7f9ca008b770 con 0x7f9c94003f30 2024-04-26T22:01:05.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.625+0000 7f9cad7a4640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c8c06c8f0 0x7f9c8c06edb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c98033000 tx=0x7f9c98008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:05.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.629+0000 7f9c9e7fc640 1 -- 172.21.15.137:0/3360793882 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9ca0059ea0 con 0x7f9c94003f30 2024-04-26T22:01:05.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.804+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9ca8163c00 con 0x7f9c94003f30 2024-04-26T22:01:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.809+0000 7f9c9e7fc640 1 -- 172.21.15.137:0/3360793882 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f9ca00597a0 con 0x7f9c94003f30 2024-04-26T22:01:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c8c06c8f0 msgr2=0x7f9c8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c8c06c8f0 0x7f9c8c06edb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9c98033000 tx=0x7f9c98008030 comp rx=0 tx=0).stop 2024-04-26T22:01:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 msgr2=0x7f9ca80b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9ca80b0fe0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000fb0 tx=0x7f9ca000ec10 comp rx=0 tx=0).stop 2024-04-26T22:01:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 shutdown_connections 2024-04-26T22:01:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9c8c06c8f0 0x7f9c8c06edb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ca81e93f0 0x7f9ca81e9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ca814db30 0x7f9ca81e8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 --2- 172.21.15.137:0/3360793882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9c94003f30 0x7f9ca80b0fe0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 >> 172.21.15.137:0/3360793882 conn(0x7f9ca809ba40 msgr2=0x7f9ca80ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 shutdown_connections 2024-04-26T22:01:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:05.811+0000 7f9cb0209640 1 -- 172.21.15.137:0/3360793882 wait complete. 2024-04-26T22:01:05.822 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:01:05.822 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:01:05.860 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:01:05.902 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:01:05.902 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:01:05.902 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:01:05.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:01:05.918 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:01:05.918 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:01:05.961 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:01:05.961 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:01:05.962 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:01:05.977 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:01:05.977 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:01:05.977 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:01:06.019 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:01:06.019 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T22:01:06.020 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:01:06.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.116+0000 7fdd848b0640 1 Processor -- start 2024-04-26T22:01:06.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.116+0000 7fdd848b0640 1 -- start start 2024-04-26T22:01:06.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.117+0000 7fdd848b0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdd8015f370 0x7fdd800cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.117+0000 7fdd848b0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd800d3ee0 0x7fdd800b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.117+0000 7fdd848b0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd800d03a0 con 0x7fdd8015f750 2024-04-26T22:01:06.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.117+0000 7fdd848b0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdd800b4d10 con 0x7fdd800d3ee0 2024-04-26T22:01:06.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.117+0000 7fdd848b0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdd800d0680 con 0x7fdd8015f370 2024-04-26T22:01:06.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.118+0000 7fdd7ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd800d3ee0 0x7fdd800b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.118+0000 7fdd7ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd800d3ee0 0x7fdd800b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34326/0 (socket says 172.21.15.137:34326) 2024-04-26T22:01:06.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.118+0000 7fdd7ed9d640 1 -- 172.21.15.137:0/972254417 learned_addr learned my addr 172.21.15.137:0/972254417 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:06.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.118+0000 7fdd7ed9d640 1 -- 172.21.15.137:0/972254417 >> v2:172.21.15.170:3300/0 conn(0x7fdd8015f370 msgr2=0x7fdd800cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:06.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.118+0000 7fdd7e59c640 1 --2- 172.21.15.137:0/972254417 >> v2:172.21.15.170:3300/0 conn(0x7fdd8015f370 0x7fdd800cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.118+0000 7fdd7ed9d640 1 --2- 172.21.15.137:0/972254417 >> v2:172.21.15.170:3300/0 conn(0x7fdd8015f370 0x7fdd800cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.118+0000 7fdd7ed9d640 1 -- 172.21.15.137:0/972254417 >> v1:172.21.15.170:6789/0 conn(0x7fdd8015f750 legacy=0x7fdd800d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:06.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.118+0000 7fdd7ed9d640 1 -- 172.21.15.137:0/972254417 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd800d0960 con 0x7fdd800d3ee0 2024-04-26T22:01:06.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd7ed9d640 1 --2- 172.21.15.137:0/972254417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 0x7fdd800b47d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdd800d2d10 tx=0x7fdd7802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ac24ae3c8aaa68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:06.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd7d59a640 1 -- 172.21.15.137:0/972254417 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78036070 con 0x7fdd800d3ee0 2024-04-26T22:01:06.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd7d59a640 1 -- 172.21.15.137:0/972254417 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd78031600 con 0x7fdd800d3ee0 2024-04-26T22:01:06.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd7d59a640 1 -- 172.21.15.137:0/972254417 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd780319d0 con 0x7fdd800d3ee0 2024-04-26T22:01:06.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd848b0640 1 -- 172.21.15.137:0/972254417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 msgr2=0x7fdd800b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd848b0640 1 --2- 172.21.15.137:0/972254417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 0x7fdd800b47d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdd800d2d10 tx=0x7fdd7802a6f0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd848b0640 1 -- 172.21.15.137:0/972254417 shutdown_connections 2024-04-26T22:01:06.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd848b0640 1 --2- 172.21.15.137:0/972254417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 0x7fdd800b47d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd848b0640 1 --2- 172.21.15.137:0/972254417 >> v2:172.21.15.170:3300/0 conn(0x7fdd8015f370 0x7fdd800cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd848b0640 1 -- 172.21.15.137:0/972254417 >> 172.21.15.137:0/972254417 conn(0x7fdd8008ec10 msgr2=0x7fdd8009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:06.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd848b0640 1 -- 172.21.15.137:0/972254417 shutdown_connections 2024-04-26T22:01:06.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.119+0000 7fdd848b0640 1 -- 172.21.15.137:0/972254417 wait complete. 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.121+0000 7fdd848b0640 1 Processor -- start 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.121+0000 7fdd848b0640 1 -- start start 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.121+0000 7fdd848b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 0x7fdd8015fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.121+0000 7fdd848b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd8015f370 0x7fdd800cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.121+0000 7fdd848b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd8015f750 0x7fdd800caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.121+0000 7fdd848b0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd800b51c0 con 0x7fdd800d3ee0 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.121+0000 7fdd848b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdd800d0f20 con 0x7fdd8015f750 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.121+0000 7fdd848b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdd800b5340 con 0x7fdd8015f370 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.121+0000 7fdd7e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 0x7fdd8015fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 0x7fdd8015fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34332/0 (socket says 172.21.15.137:34332) 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7e59c640 1 -- 172.21.15.137:0/2595378871 learned_addr learned my addr 172.21.15.137:0/2595378871 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7ed9d640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd8015f750 0x7fdd800caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7dd9b640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd8015f370 0x7fdd800cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7e59c640 1 -- 172.21.15.137:0/2595378871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd8015f370 msgr2=0x7fdd800cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7e59c640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd8015f370 0x7fdd800cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7e59c640 1 -- 172.21.15.137:0/2595378871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd8015f750 msgr2=0x7fdd800caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7e59c640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd8015f750 0x7fdd800caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7e59c640 1 -- 172.21.15.137:0/2595378871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd801f5390 con 0x7fdd800d3ee0 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd7e59c640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 0x7fdd8015fc40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800c820 tx=0x7fdd6800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd76ffd640 1 -- 172.21.15.137:0/2595378871 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68015070 con 0x7fdd800d3ee0 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd76ffd640 1 -- 172.21.15.137:0/2595378871 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd68004240 con 0x7fdd800d3ee0 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd76ffd640 1 -- 172.21.15.137:0/2595378871 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800ce10 con 0x7fdd800d3ee0 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd801f5670 con 0x7fdd800d3ee0 2024-04-26T22:01:06.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.122+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd801f5c30 con 0x7fdd800d3ee0 2024-04-26T22:01:06.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.123+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8006a290 con 0x7fdd800d3ee0 2024-04-26T22:01:06.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.124+0000 7fdd76ffd640 1 -- 172.21.15.137:0/2595378871 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd68007830 con 0x7fdd800d3ee0 2024-04-26T22:01:06.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.124+0000 7fdd76ffd640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd6006c8f0 0x7fdd6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.124+0000 7fdd76ffd640 1 -- 172.21.15.137:0/2595378871 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 4943+0+0 (secure 0 0 0) 0x7fdd6808b770 con 0x7fdd800d3ee0 2024-04-26T22:01:06.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.124+0000 7fdd7dd9b640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd6006c8f0 0x7fdd6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.124+0000 7fdd7dd9b640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd6006c8f0 0x7fdd6006edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdd70006fd0 tx=0x7fdd70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:06.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.128+0000 7fdd76ffd640 1 -- 172.21.15.137:0/2595378871 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdd68059ea0 con 0x7fdd800d3ee0 2024-04-26T22:01:06.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.337+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd800d15c0 con 0x7fdd800d3ee0 2024-04-26T22:01:06.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.338+0000 7fdd76ffd640 1 -- 172.21.15.137:0/2595378871 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+3881 (secure 0 0 0) 0x7fdd680597a0 con 0x7fdd800d3ee0 2024-04-26T22:01:06.338 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:06.338 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4910,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1453946915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":1453946915},{"type":"v1","addr":"172.21.15.170:6835","nonce":1453946915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5200,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3097952323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3097952323},{"type":"v1","addr":"172.21.15.170:6834","nonce":3097952323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5589,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3002187785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3002187785},{"type":"v1","addr":"172.21.15.137:6835","nonce":3002187785}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5979,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3117643430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3117643430},{"type":"v1","addr":"172.21.15.137:6837","nonce":3117643430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[]} 2024-04-26T22:01:06.339 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 22 2024-04-26T22:01:06.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd6006c8f0 msgr2=0x7fdd6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd6006c8f0 0x7fdd6006edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdd70006fd0 tx=0x7fdd70008040 comp rx=0 tx=0).stop 2024-04-26T22:01:06.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 msgr2=0x7fdd8015fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 0x7fdd8015fc40 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800c820 tx=0x7fdd6800cce0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 shutdown_connections 2024-04-26T22:01:06.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd6006c8f0 0x7fdd6006edb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd8015f750 0x7fdd800caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd8015f370 0x7fdd800cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 --2- 172.21.15.137:0/2595378871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd800d3ee0 0x7fdd8015fc40 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 >> 172.21.15.137:0/2595378871 conn(0x7fdd8008ec10 msgr2=0x7fdd8009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:06.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 shutdown_connections 2024-04-26T22:01:06.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.340+0000 7fdd848b0640 1 -- 172.21.15.137:0/2595378871 wait complete. 2024-04-26T22:01:06.351 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T22:01:06.351 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T22:01:06.351 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:01:06.351 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:01:06.352 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T22:01:06.352 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T22:01:06.352 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T22:01:06.352 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:01:06.352 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T22:01:06.352 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T22:01:06.352 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:01:06.352 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:01:06.353 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T22:01:06.353 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T22:01:06.353 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T22:01:06.353 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:01:06.361 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:01:06.361 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T22:01:06.362 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T22:01:06.363 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T22:01:06.364 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:01:06.364 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T22:01:06.365 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T22:01:06.365 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T22:01:06.405 INFO:tasks.ceph.mds.a:Started 2024-04-26T22:01:06.405 DEBUG:teuthology.parallel:result is None 2024-04-26T22:01:06.406 INFO:tasks.ceph.mds.c:Started 2024-04-26T22:01:06.406 DEBUG:teuthology.parallel:result is None 2024-04-26T22:01:06.407 INFO:tasks.ceph.mds.b:Started 2024-04-26T22:01:06.407 DEBUG:teuthology.parallel:result is None 2024-04-26T22:01:06.407 INFO:tasks.ceph.mds.d:Started 2024-04-26T22:01:06.408 DEBUG:teuthology.parallel:result is None 2024-04-26T22:01:06.408 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T22:01:06.478 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:01:06.479 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:01:06.486 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T22:01:06.486 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T22:01:06.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.510+0000 7f090a3f0640 1 Processor -- start 2024-04-26T22:01:06.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.510+0000 7f090a3f0640 1 -- start start 2024-04-26T22:01:06.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f090a3f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09040d0b20 0x7f09040ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f090a3f0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09040cda60 con 0x7f090415d360 2024-04-26T22:01:06.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f090a3f0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09040d1100 con 0x7f09040d1510 2024-04-26T22:01:06.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f090a3f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f090415d740 con 0x7f09040d0b20 2024-04-26T22:01:06.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f0903fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f090415d360 0x7f090409c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32816/0 (socket says 172.21.15.137:32816) 2024-04-26T22:01:06.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f0903fff640 1 -- 172.21.15.137:0/1448891753 learned_addr learned my addr 172.21.15.137:0/1448891753 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:06.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f09037fe640 1 --2- 172.21.15.137:0/1448891753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09040d0b20 0x7f09040ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f09037fe640 1 -- 172.21.15.137:0/1448891753 >> v1:172.21.15.170:6789/0 conn(0x7f09040d1510 legacy=0x7f0904070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f0902ffd640 1 -- 172.21.15.137:0/1448891753 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903267333 0 0) 0x7f09040d1100 con 0x7f09040d1510 2024-04-26T22:01:06.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f09037fe640 1 -- 172.21.15.137:0/1448891753 >> v1:172.21.15.137:6789/0 conn(0x7f090415d360 legacy=0x7f090409c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.511+0000 7f09037fe640 1 -- 172.21.15.137:0/1448891753 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09040cdd00 con 0x7f09040d0b20 2024-04-26T22:01:06.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.512+0000 7f09037fe640 1 --2- 172.21.15.137:0/1448891753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09040d0b20 0x7f09040ce7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08f80097d0 tx=0x7f08f802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f32aa6769d868d51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.512+0000 7f0902ffd640 1 -- 172.21.15.137:0/1448891753 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8037070 con 0x7f09040d0b20 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.512+0000 7f0902ffd640 1 -- 172.21.15.137:0/1448891753 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f8032440 con 0x7f09040d0b20 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.512+0000 7f0902ffd640 1 -- 172.21.15.137:0/1448891753 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8032810 con 0x7f09040d0b20 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.513+0000 7f090a3f0640 1 -- 172.21.15.137:0/1448891753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09040d0b20 msgr2=0x7f09040ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.513+0000 7f090a3f0640 1 --2- 172.21.15.137:0/1448891753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09040d0b20 0x7f09040ce7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f08f80097d0 tx=0x7f08f802a210 comp rx=0 tx=0).stop 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.513+0000 7f090a3f0640 1 -- 172.21.15.137:0/1448891753 shutdown_connections 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.513+0000 7f090a3f0640 1 --2- 172.21.15.137:0/1448891753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09040d0b20 0x7f09040ce7e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.513+0000 7f090a3f0640 1 -- 172.21.15.137:0/1448891753 >> 172.21.15.137:0/1448891753 conn(0x7f09040b4a40 msgr2=0x7f09040b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.513+0000 7f090a3f0640 1 -- 172.21.15.137:0/1448891753 shutdown_connections 2024-04-26T22:01:06.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.513+0000 7f090a3f0640 1 -- 172.21.15.137:0/1448891753 wait complete. 2024-04-26T22:01:06.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.515+0000 7f090a3f0640 1 Processor -- start 2024-04-26T22:01:06.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.515+0000 7f090a3f0640 1 -- start start 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f090a3f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09040d0b20 0x7f09040c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f090a3f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09040d1510 0x7f09040b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f090a3f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f090415d360 0x7f09040b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f090a3f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09040ceea0 con 0x7f09040d0b20 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f090a3f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f09040ced20 con 0x7f09040d1510 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f090a3f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0904070a20 con 0x7f090415d360 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f0903fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09040d0b20 0x7f09040c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f09037fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09040d1510 0x7f09040b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f090898d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f090415d360 0x7f09040b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f09037fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09040d1510 0x7f09040b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34306/0 (socket says 172.21.15.137:34306) 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f09037fe640 1 -- 172.21.15.137:0/205484505 learned_addr learned my addr 172.21.15.137:0/205484505 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f0903fff640 1 -- 172.21.15.137:0/205484505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f090415d360 msgr2=0x7f09040b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f0903fff640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f090415d360 0x7f09040b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f0903fff640 1 -- 172.21.15.137:0/205484505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09040d1510 msgr2=0x7f09040b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:06.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f0903fff640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09040d1510 0x7f09040b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:06.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f0903fff640 1 -- 172.21.15.137:0/205484505 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09040b0d10 con 0x7f09040d0b20 2024-04-26T22:01:06.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f090898d640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f090415d360 0x7f09040b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:01:06.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.516+0000 7f09037fe640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09040d1510 0x7f09040b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:01:06.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.517+0000 7f0903fff640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09040d0b20 0x7f09040c5dc0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f08f4000f60 tx=0x7f08f400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:06.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.518+0000 7f0900ff9640 1 -- 172.21.15.137:0/205484505 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4005ce0 con 0x7f09040d0b20 2024-04-26T22:01:06.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.518+0000 7f0900ff9640 1 -- 172.21.15.137:0/205484505 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f4015030 con 0x7f09040d0b20 2024-04-26T22:01:06.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.518+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09040b0ff0 con 0x7f09040d0b20 2024-04-26T22:01:06.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.518+0000 7f0900ff9640 1 -- 172.21.15.137:0/205484505 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4007310 con 0x7f09040d0b20 2024-04-26T22:01:06.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.518+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09040b15b0 con 0x7f09040d0b20 2024-04-26T22:01:06.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.519+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09040693d0 con 0x7f09040d0b20 2024-04-26T22:01:06.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.519+0000 7f0900ff9640 1 -- 172.21.15.137:0/205484505 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08f40074b0 con 0x7f09040d0b20 2024-04-26T22:01:06.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.520+0000 7f0900ff9640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08f006c920 0x7f08f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:06.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.520+0000 7f0900ff9640 1 -- 172.21.15.137:0/205484505 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 4943+0+0 (secure 0 0 0) 0x7f08f408ee20 con 0x7f09040d0b20 2024-04-26T22:01:06.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.520+0000 7f09037fe640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08f006c920 0x7f08f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:06.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.520+0000 7f09037fe640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08f006c920 0x7f08f006ede0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f08f8000c00 tx=0x7f08f802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:06.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.524+0000 7f0900ff9640 1 -- 172.21.15.137:0/205484505 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f08f405cf00 con 0x7f09040d0b20 2024-04-26T22:01:06.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:06.715+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0904074880 con 0x7f09040d0b20 2024-04-26T22:01:07.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.520+0000 7f0900ff9640 1 -- 172.21.15.137:0/205484505 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) ==== 97+0+0 (secure 0 0 0) 0x7f08f4061200 con 0x7f09040d0b20 2024-04-26T22:01:07.520 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T22:01:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08f006c920 msgr2=0x7f08f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08f006c920 0x7f08f006ede0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f08f8000c00 tx=0x7f08f802e000 comp rx=0 tx=0).stop 2024-04-26T22:01:07.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09040d0b20 msgr2=0x7f09040c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09040d0b20 0x7f09040c5dc0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f08f4000f60 tx=0x7f08f400c760 comp rx=0 tx=0).stop 2024-04-26T22:01:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 shutdown_connections 2024-04-26T22:01:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08f006c920 0x7f08f006ede0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f090415d360 0x7f09040b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09040d1510 0x7f09040b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 --2- 172.21.15.137:0/205484505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09040d0b20 0x7f09040c5dc0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 >> 172.21.15.137:0/205484505 conn(0x7f09040b4a40 msgr2=0x7f09040b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 shutdown_connections 2024-04-26T22:01:07.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.522+0000 7f090a3f0640 1 -- 172.21.15.137:0/205484505 wait complete. 2024-04-26T22:01:07.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T22:01:07.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.634+0000 7f0ded864640 1 Processor -- start 2024-04-26T22:01:07.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.634+0000 7f0ded864640 1 -- start start 2024-04-26T22:01:07.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.634+0000 7f0ded864640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0de815f370 0x7f0de80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:07.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.634+0000 7f0ded864640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de80d03a0 con 0x7f0de80d3ee0 2024-04-26T22:01:07.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.634+0000 7f0ded864640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de80d0680 con 0x7f0de815f750 2024-04-26T22:01:07.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.634+0000 7f0ded864640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0de80d0960 con 0x7f0de815f370 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de77fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0de80d3ee0 0x7f0de80b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32818/0 (socket says 172.21.15.137:32818) 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de77fe640 1 -- 172.21.15.137:0/2980698115 learned_addr learned my addr 172.21.15.137:0/2980698115 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384521678 0 0) 0x7f0de80d03a0 con 0x7f0de80d3ee0 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd4003520 con 0x7f0de80d3ee0 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de6ffd640 1 --2- 172.21.15.137:0/2980698115 >> v2:172.21.15.170:3300/0 conn(0x7f0de815f370 0x7f0de80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 535124887 0 0) 0x7f0dd4003520 con 0x7f0de80d3ee0 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 >> v2:172.21.15.170:3300/0 conn(0x7f0de815f370 msgr2=0x7f0de80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 --2- 172.21.15.137:0/2980698115 >> v2:172.21.15.170:3300/0 conn(0x7f0de815f370 0x7f0de80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 >> v1:172.21.15.170:6789/0 conn(0x7f0de815f750 legacy=0x7f0de80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de80d0c40 con 0x7f0de80d3ee0 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f0de0001670 con 0x7f0de80d3ee0 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 >> v1:172.21.15.137:6789/0 conn(0x7f0de80d3ee0 legacy=0x7f0de80b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0dd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:07.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd4004800 0x7f0dd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dd40051c0 0x7f0dd400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0de80d0960 con 0x7f0dd40039b0 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd400c060 con 0x7f0dd4004800 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd400c260 con 0x7f0dd40051c0 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de6ffd640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0dd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de67fc640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd4004800 0x7f0dd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de77fe640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dd40051c0 0x7f0dd400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de6ffd640 1 -- 172.21.15.137:0/2980698115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dd40051c0 msgr2=0x7f0dd400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de6ffd640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0dd40051c0 0x7f0dd400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de6ffd640 1 -- 172.21.15.137:0/2980698115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd4004800 msgr2=0x7f0dd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.635+0000 7f0de6ffd640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd4004800 0x7f0dd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.636+0000 7f0de6ffd640 1 -- 172.21.15.137:0/2980698115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd4003520 con 0x7f0dd40039b0 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.636+0000 7f0de77fe640 1 -- 172.21.15.137:0/2980698115 reap_dead start 2024-04-26T22:01:07.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.636+0000 7f0de67fc640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0dd4004800 0x7f0dd4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.636+0000 7f0de6ffd640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0dd4003dd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009fc0 tx=0x7f0dd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c579de98f225fe47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.636+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8009c10 con 0x7f0dd40039b0 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.636+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd8036070 con 0x7f0dd40039b0 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.636+0000 7f0de5ffb640 1 -- 172.21.15.137:0/2980698115 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8031880 con 0x7f0dd40039b0 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.637+0000 7f0ded864640 1 -- 172.21.15.137:0/2980698115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 msgr2=0x7f0dd4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.637+0000 7f0ded864640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0dd4003dd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009fc0 tx=0x7f0dd4005830 comp rx=0 tx=0).stop 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.637+0000 7f0ded864640 1 -- 172.21.15.137:0/2980698115 shutdown_connections 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.637+0000 7f0ded864640 1 --2- 172.21.15.137:0/2980698115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0dd4003dd0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.637+0000 7f0ded864640 1 -- 172.21.15.137:0/2980698115 >> 172.21.15.137:0/2980698115 conn(0x7f0de808ec10 msgr2=0x7f0de809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.637+0000 7f0ded864640 1 -- 172.21.15.137:0/2980698115 shutdown_connections 2024-04-26T22:01:07.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.637+0000 7f0ded864640 1 -- 172.21.15.137:0/2980698115 wait complete. 2024-04-26T22:01:07.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.638+0000 7f0ded864640 1 Processor -- start 2024-04-26T22:01:07.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.638+0000 7f0ded864640 1 -- start start 2024-04-26T22:01:07.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0ded864640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0de8153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:07.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0ded864640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de815fc40 0x7f0de81600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:07.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0ded864640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0de80b28f0 0x7f0de80b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:07.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0ded864640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0de80cfef0 con 0x7f0dd40039b0 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0ded864640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0de80cfd70 con 0x7f0de815fc40 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0ded864640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0de80d0070 con 0x7f0de80b28f0 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0de8153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0de8153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34414/0 (socket says 172.21.15.137:34414) 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de6ffd640 1 -- 172.21.15.137:0/2612678801 learned_addr learned my addr 172.21.15.137:0/2612678801 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de67fc640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de815fc40 0x7f0de81600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de77fe640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0de80b28f0 0x7f0de80b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de6ffd640 1 -- 172.21.15.137:0/2612678801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0de80b28f0 msgr2=0x7f0de80b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de6ffd640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0de80b28f0 0x7f0de80b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de6ffd640 1 -- 172.21.15.137:0/2612678801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de815fc40 msgr2=0x7f0de81600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de6ffd640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de815fc40 0x7f0de81600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de6ffd640 1 -- 172.21.15.137:0/2612678801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de81f8710 con 0x7f0dd40039b0 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.639+0000 7f0de6ffd640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0de8153770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800e230 tx=0x7f0dd8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.640+0000 7f0ddffff640 1 -- 172.21.15.137:0/2612678801 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8009c10 con 0x7f0dd40039b0 2024-04-26T22:01:07.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.640+0000 7f0ddffff640 1 -- 172.21.15.137:0/2612678801 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd8003990 con 0x7f0dd40039b0 2024-04-26T22:01:07.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.640+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de81607b0 con 0x7f0dd40039b0 2024-04-26T22:01:07.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.640+0000 7f0ddffff640 1 -- 172.21.15.137:0/2612678801 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8003d80 con 0x7f0dd40039b0 2024-04-26T22:01:07.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.640+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de8161480 con 0x7f0dd40039b0 2024-04-26T22:01:07.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.641+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de806a290 con 0x7f0dd40039b0 2024-04-26T22:01:07.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.641+0000 7f0ddffff640 1 -- 172.21.15.137:0/2612678801 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0dd8005d10 con 0x7f0dd40039b0 2024-04-26T22:01:07.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.641+0000 7f0ddffff640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0dc806c8f0 0x7f0dc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:07.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.642+0000 7f0de67fc640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0dc806c8f0 0x7f0dc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:07.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.642+0000 7f0ddffff640 1 -- 172.21.15.137:0/2612678801 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f0dd80aca60 con 0x7f0dd40039b0 2024-04-26T22:01:07.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.642+0000 7f0de67fc640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0dc806c8f0 0x7f0dc806edb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0000c00 tx=0x7f0dd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:07.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.646+0000 7f0ddffff640 1 -- 172.21.15.137:0/2612678801 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0dd807b1e0 con 0x7f0dd40039b0 2024-04-26T22:01:07.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.890+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0de80b5b70 con 0x7f0dd40039b0 2024-04-26T22:01:07.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.891+0000 7f0ddffff640 1 -- 172.21.15.137:0/2612678801 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f0dd807aae0 con 0x7f0dd40039b0 2024-04-26T22:01:07.891 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:07.891 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:01:07.891 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmKffkBRAAh7EvvT0pmNbLKtJsBH/25Q==", 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.892 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmd5UHERAAykWO/C56qwLwimzH2f6mcA==", 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmMbCsDBAANF98tMtCSOy4TVN7I498cw==", 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:01:07.893 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmQ47KFxAAsreL970BTH5yQLOol942iQ==", 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.894 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBcIyxmY2T8NhAAMyJ5OP3dhuqMymrlUG4q2A==", 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBfIyxmNfGnNRAAp+tTaVBwfAMUsyqRSgoRvw==", 2024-04-26T22:01:07.895 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBiIyxm3Q1yMxAAf7f6Me7uKYzM+Fp+2FCQsA==", 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.896 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlIyxmFcj2MRAAL/yPxOwtgMnfbmr0YUZs6Q==", 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBpIyxmaaAqORAAfowCddy0wT/LptWvqD4CDw==", 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:01:07.897 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBsIyxmJaOFNhAAqjJAuU/SoVnjIAYCODWMnA==", 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBvIyxmRkINNBAAjfFLMQ9/XMLLU8ZAoUxvkQ==", 2024-04-26T22:01:07.898 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQByIyxmeF1gMRAAH0t727lSCZgkTgJ0ZXyA6g==", 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.899 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ==", 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow r", 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxms4U0JBAAMZ056L4EP1qzX2KVx8JiEg==", 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:01:07.900 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmUnswIRAA5nYDanYzHiEVk98/041RHA==", 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.901 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmHOORKRAA6Agn7TqBPywtop3Eo8+yFQ==", 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxm7ue6JhAAyLiai4CKXmiB00fCAfp2WA==", 2024-04-26T22:01:07.902 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmFBrPAhAAfrkQvzF5SSyb5iQ0zr0eww==", 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:01:07.903 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxmlrq3OhAA9Fd+zmECU9xK/pWp2Hg9kg==", 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:01:07.904 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.905 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:07.905 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T22:01:07.905 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:01:07.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0dc806c8f0 msgr2=0x7f0dc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:07.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0dc806c8f0 0x7f0dc806edb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0000c00 tx=0x7f0dd0009040 comp rx=0 tx=0).stop 2024-04-26T22:01:07.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 msgr2=0x7f0de8153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:07.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0de8153770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800e230 tx=0x7f0dd8009750 comp rx=0 tx=0).stop 2024-04-26T22:01:07.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 shutdown_connections 2024-04-26T22:01:07.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0dc806c8f0 0x7f0dc806edb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0de80b28f0 0x7f0de80b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0de815fc40 0x7f0de81600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 --2- 172.21.15.137:0/2612678801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0dd40039b0 0x7f0de8153770 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:07.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 >> 172.21.15.137:0/2612678801 conn(0x7f0de808ec10 msgr2=0x7f0de80d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:07.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 shutdown_connections 2024-04-26T22:01:07.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:07.893+0000 7f0ded864640 1 -- 172.21.15.137:0/2612678801 wait complete. 2024-04-26T22:01:07.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:01:08.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.004+0000 7f23cc693640 1 Processor -- start 2024-04-26T22:01:08.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.004+0000 7f23cc693640 1 -- start start 2024-04-26T22:01:08.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.005+0000 7f23cc693640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c415f1e0 0x7f23c406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.005+0000 7f23cc693640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f23c406d2b0 0x7f23c406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.005+0000 7f23cc693640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c40b4a10 con 0x7f23c40b44e0 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.005+0000 7f23cc693640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f23c406dc60 con 0x7f23c406d2b0 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.005+0000 7f23cc693640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f23c406eeb0 con 0x7f23c415f1e0 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.005+0000 7f23ca42f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c415f1e0 0x7f23c406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.005+0000 7f23cac30640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f23c406d2b0 0x7f23c406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.005+0000 7f23cac30640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f23c406d2b0 0x7f23c406d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34330/0 (socket says 172.21.15.137:34330) 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.005+0000 7f23cac30640 1 -- 172.21.15.137:0/1271149813 learned_addr learned my addr 172.21.15.137:0/1271149813 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.006+0000 7f23cac30640 1 -- 172.21.15.137:0/1271149813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c415f1e0 msgr2=0x7f23c406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.006+0000 7f23cac30640 1 --2- 172.21.15.137:0/1271149813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c415f1e0 0x7f23c406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.006+0000 7f23cac30640 1 -- 172.21.15.137:0/1271149813 >> v1:172.21.15.170:6789/0 conn(0x7f23c40b44e0 legacy=0x7f23c40ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.006+0000 7f23cac30640 1 -- 172.21.15.137:0/1271149813 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c40b4cf0 con 0x7f23c406d2b0 2024-04-26T22:01:08.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.006+0000 7f23c942d640 1 -- 172.21.15.137:0/1271149813 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353656318 0 0) 0x7f23c40b4a10 con 0x7f23c40b44e0 2024-04-26T22:01:08.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.006+0000 7f23cac30640 1 --2- 172.21.15.137:0/1271149813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c406d2b0 0x7f23c406d720 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009e50 tx=0x7f23bc02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f73ab6c38282aebe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.006+0000 7f23c942d640 1 -- 172.21.15.137:0/1271149813 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc036070 con 0x7f23c406d2b0 2024-04-26T22:01:08.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.006+0000 7f23c942d640 1 -- 172.21.15.137:0/1271149813 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23bc031600 con 0x7f23c406d2b0 2024-04-26T22:01:08.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.006+0000 7f23c942d640 1 -- 172.21.15.137:0/1271149813 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0319d0 con 0x7f23c406d2b0 2024-04-26T22:01:08.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.007+0000 7f23cc693640 1 -- 172.21.15.137:0/1271149813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c406d2b0 msgr2=0x7f23c406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.007+0000 7f23cc693640 1 --2- 172.21.15.137:0/1271149813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c406d2b0 0x7f23c406d720 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f23bc009e50 tx=0x7f23bc02a710 comp rx=0 tx=0).stop 2024-04-26T22:01:08.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.007+0000 7f23cc693640 1 -- 172.21.15.137:0/1271149813 shutdown_connections 2024-04-26T22:01:08.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.007+0000 7f23cc693640 1 --2- 172.21.15.137:0/1271149813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c406d2b0 0x7f23c406d720 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.007+0000 7f23cc693640 1 --2- 172.21.15.137:0/1271149813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c415f1e0 0x7f23c406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.007+0000 7f23cc693640 1 -- 172.21.15.137:0/1271149813 >> 172.21.15.137:0/1271149813 conn(0x7f23c40728a0 msgr2=0x7f23c4072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:08.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.007+0000 7f23cc693640 1 -- 172.21.15.137:0/1271149813 shutdown_connections 2024-04-26T22:01:08.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.007+0000 7f23cc693640 1 -- 172.21.15.137:0/1271149813 wait complete. 2024-04-26T22:01:08.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.008+0000 7f23cc693640 1 Processor -- start 2024-04-26T22:01:08.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.008+0000 7f23cc693640 1 -- start start 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23cc693640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c406d2b0 0x7f23c415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23cc693640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c40b44e0 0x7f23c4147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23cc693640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c415f1e0 0x7f23c4151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23cc693640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40b5590 con 0x7f23c40b44e0 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23cc693640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f23c40b52b0 con 0x7f23c415f1e0 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23cc693640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f23c415f5c0 con 0x7f23c406d2b0 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23c9c2e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c40b44e0 0x7f23c4147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23c9c2e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c40b44e0 0x7f23c4147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34418/0 (socket says 172.21.15.137:34418) 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23c9c2e640 1 -- 172.21.15.137:0/926739539 learned_addr learned my addr 172.21.15.137:0/926739539 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23cac30640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c415f1e0 0x7f23c4151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23ca42f640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c406d2b0 0x7f23c415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23c9c2e640 1 -- 172.21.15.137:0/926739539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c406d2b0 msgr2=0x7f23c415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23c9c2e640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c406d2b0 0x7f23c415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23c9c2e640 1 -- 172.21.15.137:0/926739539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c415f1e0 msgr2=0x7f23c4151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23c9c2e640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c415f1e0 0x7f23c4151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.009+0000 7f23c9c2e640 1 -- 172.21.15.137:0/926739539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c4151ff0 con 0x7f23c40b44e0 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.010+0000 7f23c9c2e640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c40b44e0 0x7f23c4147210 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f23b400c4e0 tx=0x7f23b400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.010+0000 7f23baffd640 1 -- 172.21.15.137:0/926739539 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4017070 con 0x7f23c40b44e0 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.010+0000 7f23baffd640 1 -- 172.21.15.137:0/926739539 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b40035f0 con 0x7f23c40b44e0 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.010+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c41522d0 con 0x7f23c40b44e0 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.010+0000 7f23baffd640 1 -- 172.21.15.137:0/926739539 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b40039e0 con 0x7f23c40b44e0 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.010+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c4152890 con 0x7f23c40b44e0 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.011+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c406a290 con 0x7f23c40b44e0 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.011+0000 7f23baffd640 1 -- 172.21.15.137:0/926739539 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23b401a070 con 0x7f23c40b44e0 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.012+0000 7f23baffd640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23a806c8f0 0x7f23a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.012+0000 7f23ca42f640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23a806c8f0 0x7f23a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.012+0000 7f23baffd640 1 -- 172.21.15.137:0/926739539 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f23b408aa70 con 0x7f23c40b44e0 2024-04-26T22:01:08.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.012+0000 7f23ca42f640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23a806c8f0 0x7f23a806edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009b40 tx=0x7f23c0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.016+0000 7f23baffd640 1 -- 172.21.15.137:0/926739539 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f23b4058c30 con 0x7f23c40b44e0 2024-04-26T22:01:08.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.197+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23c4070060 con 0x7f23c40b44e0 2024-04-26T22:01:08.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.198+0000 7f23baffd640 1 -- 172.21.15.137:0/926739539 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+12903 (secure 0 0 0) 0x7f23b405cf30 con 0x7f23c40b44e0 2024-04-26T22:01:08.198 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:08.198 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":56,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:01:07.517805+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23a806c8f0 msgr2=0x7f23a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23a806c8f0 0x7f23a806edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009b40 tx=0x7f23c0009190 comp rx=0 tx=0).stop 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c40b44e0 msgr2=0x7f23c4147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c40b44e0 0x7f23c4147210 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f23b400c4e0 tx=0x7f23b400c9a0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 shutdown_connections 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23a806c8f0 0x7f23a806edb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23c40b44e0 0x7f23c4147210 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23c415f1e0 0x7f23c4151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 --2- 172.21.15.137:0/926739539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23c406d2b0 0x7f23c415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 >> 172.21.15.137:0/926739539 conn(0x7f23c40728a0 msgr2=0x7f23c40af050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:08.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 shutdown_connections 2024-04-26T22:01:08.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.200+0000 7f23cc693640 1 -- 172.21.15.137:0/926739539 wait complete. 2024-04-26T22:01:08.211 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:01:08.211 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:01:08.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.311+0000 7f96fbe7e640 1 Processor -- start 2024-04-26T22:01:08.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.311+0000 7f96fbe7e640 1 -- start start 2024-04-26T22:01:08.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96fbe7e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 0x7f96f415bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96fbe7e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96f415c530 con 0x7f96f415f4f0 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96fbe7e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96f415c810 con 0x7f96f4074200 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96fbe7e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f96f415caf0 con 0x7f96f415b930 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f9419640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f96f415f4f0 0x7f96f4073af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32834/0 (socket says 172.21.15.137:32834) 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f9419640 1 -- 172.21.15.137:0/326352102 learned_addr learned my addr 172.21.15.137:0/326352102 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f9c1a640 1 --2- 172.21.15.137:0/326352102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 0x7f96f415bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f8c18640 1 -- 172.21.15.137:0/326352102 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257095367 0 0) 0x7f96f415c530 con 0x7f96f415f4f0 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f8c18640 1 -- 172.21.15.137:0/326352102 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96e0003520 con 0x7f96f415f4f0 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f8c18640 1 -- 172.21.15.137:0/326352102 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2971121198 0 0) 0x7f96f415c810 con 0x7f96f4074200 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f8c18640 1 -- 172.21.15.137:0/326352102 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96f415c530 con 0x7f96f4074200 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f8c18640 1 -- 172.21.15.137:0/326352102 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219680945 0 0) 0x7f96e0003520 con 0x7f96f415f4f0 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f9c1a640 1 -- 172.21.15.137:0/326352102 >> v1:172.21.15.170:6789/0 conn(0x7f96f4074200 legacy=0x7f96f40cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f9c1a640 1 -- 172.21.15.137:0/326352102 >> v1:172.21.15.137:6789/0 conn(0x7f96f415f4f0 legacy=0x7f96f4073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.312+0000 7f96f9c1a640 1 -- 172.21.15.137:0/326352102 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f415cdd0 con 0x7f96f415b930 2024-04-26T22:01:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.313+0000 7f96f9c1a640 1 --2- 172.21.15.137:0/326352102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 0x7f96f415bd10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f96f00097d0 tx=0x7f96f002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9da533941b2853ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.313+0000 7f96f8c18640 1 -- 172.21.15.137:0/326352102 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f0037070 con 0x7f96f415b930 2024-04-26T22:01:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.313+0000 7f96f8c18640 1 -- 172.21.15.137:0/326352102 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f002ac30 con 0x7f96f415b930 2024-04-26T22:01:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.313+0000 7f96f8c18640 1 -- 172.21.15.137:0/326352102 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e4001670 con 0x7f96f415b930 2024-04-26T22:01:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.314+0000 7f96fbe7e640 1 -- 172.21.15.137:0/326352102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 msgr2=0x7f96f415bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.314+0000 7f96fbe7e640 1 --2- 172.21.15.137:0/326352102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 0x7f96f415bd10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f96f00097d0 tx=0x7f96f002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.314+0000 7f96fbe7e640 1 -- 172.21.15.137:0/326352102 shutdown_connections 2024-04-26T22:01:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.314+0000 7f96fbe7e640 1 --2- 172.21.15.137:0/326352102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 0x7f96f415bd10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.314+0000 7f96fbe7e640 1 -- 172.21.15.137:0/326352102 >> 172.21.15.137:0/326352102 conn(0x7f96f40cd8a0 msgr2=0x7f96f40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:08.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.314+0000 7f96fbe7e640 1 -- 172.21.15.137:0/326352102 shutdown_connections 2024-04-26T22:01:08.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.314+0000 7f96fbe7e640 1 -- 172.21.15.137:0/326352102 wait complete. 2024-04-26T22:01:08.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.315+0000 7f96fbe7e640 1 Processor -- start 2024-04-26T22:01:08.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.315+0000 7f96fbe7e640 1 -- start start 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96fbe7e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f4074200 0x7f96f414d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96fbe7e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 0x7f96f414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96fbe7e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96f415f4f0 0x7f96f414f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96fbe7e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f96f406fdd0 con 0x7f96f4074200 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96fbe7e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f96f415c250 con 0x7f96f415f4f0 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96fbe7e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f96f406f340 con 0x7f96f415b930 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96f9c1a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f4074200 0x7f96f414d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96f9c1a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f4074200 0x7f96f414d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34426/0 (socket says 172.21.15.137:34426) 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96f9c1a640 1 -- 172.21.15.137:0/2478534898 learned_addr learned my addr 172.21.15.137:0/2478534898 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96f9c1a640 1 -- 172.21.15.137:0/2478534898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 msgr2=0x7f96f414f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96f9c1a640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 0x7f96f414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96f9c1a640 1 -- 172.21.15.137:0/2478534898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96f415f4f0 msgr2=0x7f96f414f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96f9c1a640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96f415f4f0 0x7f96f414f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96f9c1a640 1 -- 172.21.15.137:0/2478534898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f414b7f0 con 0x7f96f4074200 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96f9c1a640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f4074200 0x7f96f414d400 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f96f0035040 tx=0x7f96f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.316+0000 7f96ea7fc640 1 -- 172.21.15.137:0/2478534898 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f0037050 con 0x7f96f4074200 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.317+0000 7f96ea7fc640 1 -- 172.21.15.137:0/2478534898 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f0043070 con 0x7f96f4074200 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.317+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f414df50 con 0x7f96f4074200 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.317+0000 7f96ea7fc640 1 -- 172.21.15.137:0/2478534898 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f0006e10 con 0x7f96f4074200 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.317+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f414a580 con 0x7f96f4074200 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.317+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f414dd70 con 0x7f96f4074200 2024-04-26T22:01:08.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.318+0000 7f96ea7fc640 1 -- 172.21.15.137:0/2478534898 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96f003ca30 con 0x7f96f4074200 2024-04-26T22:01:08.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.318+0000 7f96ea7fc640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96d806c8f0 0x7f96d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.318+0000 7f96ea7fc640 1 -- 172.21.15.137:0/2478534898 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f96f00ac300 con 0x7f96f4074200 2024-04-26T22:01:08.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.318+0000 7f96f9419640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96d806c8f0 0x7f96d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.319+0000 7f96f9419640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96d806c8f0 0x7f96d806edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f96f40ab880 tx=0x7f96e4000f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.323+0000 7f96ea7fc640 1 -- 172.21.15.137:0/2478534898 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f96f414dd70 con 0x7f96f4074200 2024-04-26T22:01:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.496+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96f406a290 con 0x7f96f4074200 2024-04-26T22:01:08.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.496+0000 7f96ea7fc640 1 -- 172.21.15.137:0/2478534898 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) ==== 93+0+10 (secure 0 0 0) 0x7f96f007ab20 con 0x7f96f4074200 2024-04-26T22:01:08.496 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:01:08.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96d806c8f0 msgr2=0x7f96d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96d806c8f0 0x7f96d806edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f96f40ab880 tx=0x7f96e4000f90 comp rx=0 tx=0).stop 2024-04-26T22:01:08.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f4074200 msgr2=0x7f96f414d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f4074200 0x7f96f414d400 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f96f0035040 tx=0x7f96f00046c0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 shutdown_connections 2024-04-26T22:01:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f96d806c8f0 0x7f96d806edb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96f415f4f0 0x7f96f414f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f96f415b930 0x7f96f414f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 --2- 172.21.15.137:0/2478534898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f96f4074200 0x7f96f414d400 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 >> 172.21.15.137:0/2478534898 conn(0x7f96f40cd8a0 msgr2=0x7f96f4154940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 shutdown_connections 2024-04-26T22:01:08.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.498+0000 7f96fbe7e640 1 -- 172.21.15.137:0/2478534898 wait complete. 2024-04-26T22:01:08.510 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T22:01:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.607+0000 7f14fbd0a640 1 Processor -- start 2024-04-26T22:01:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.608+0000 7f14fbd0a640 1 -- start start 2024-04-26T22:01:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.608+0000 7f14fbd0a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f14f415f370 0x7f14f40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.608+0000 7f14fbd0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 0x7f14f40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.608+0000 7f14fbd0a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f40d03a0 con 0x7f14f415f750 2024-04-26T22:01:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.608+0000 7f14fbd0a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f14f40b4d10 con 0x7f14f415f370 2024-04-26T22:01:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.608+0000 7f14fbd0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f14f40d0680 con 0x7f14f40d3ee0 2024-04-26T22:01:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14f9aa6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f14f415f370 0x7f14f40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14f9aa6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f14f415f370 0x7f14f40cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34430/0 (socket says 172.21.15.137:34430) 2024-04-26T22:01:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14f92a5640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f14f415f750 0x7f14f40d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32844/0 (socket says 172.21.15.137:32844) 2024-04-26T22:01:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14f9aa6640 1 -- 172.21.15.137:0/1942564931 learned_addr learned my addr 172.21.15.137:0/1942564931 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14fa2a7640 1 --2- 172.21.15.137:0/1942564931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 0x7f14f40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14f9aa6640 1 -- 172.21.15.137:0/1942564931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 msgr2=0x7f14f40b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14f9aa6640 1 --2- 172.21.15.137:0/1942564931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 0x7f14f40b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14f9aa6640 1 -- 172.21.15.137:0/1942564931 >> v1:172.21.15.137:6789/0 conn(0x7f14f415f750 legacy=0x7f14f40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14f9aa6640 1 -- 172.21.15.137:0/1942564931 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f40d0960 con 0x7f14f415f370 2024-04-26T22:01:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.609+0000 7f14f8aa4640 1 -- 172.21.15.137:0/1942564931 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443834744 0 0) 0x7f14f40d03a0 con 0x7f14f415f750 2024-04-26T22:01:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14f9aa6640 1 --2- 172.21.15.137:0/1942564931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 0x7f14f40cfd70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009870 tx=0x7f14f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510c8ccdd9af7748 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14f8aa4640 1 -- 172.21.15.137:0/1942564931 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0037070 con 0x7f14f415f370 2024-04-26T22:01:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14f8aa4640 1 -- 172.21.15.137:0/1942564931 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f0032440 con 0x7f14f415f370 2024-04-26T22:01:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14f8aa4640 1 -- 172.21.15.137:0/1942564931 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f0032810 con 0x7f14f415f370 2024-04-26T22:01:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14fbd0a640 1 -- 172.21.15.137:0/1942564931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 msgr2=0x7f14f40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14fbd0a640 1 --2- 172.21.15.137:0/1942564931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 0x7f14f40cfd70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009870 tx=0x7f14f002a270 comp rx=0 tx=0).stop 2024-04-26T22:01:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14fbd0a640 1 -- 172.21.15.137:0/1942564931 shutdown_connections 2024-04-26T22:01:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14fbd0a640 1 --2- 172.21.15.137:0/1942564931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 0x7f14f40b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14fbd0a640 1 --2- 172.21.15.137:0/1942564931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 0x7f14f40cfd70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14fbd0a640 1 -- 172.21.15.137:0/1942564931 >> 172.21.15.137:0/1942564931 conn(0x7f14f408ec10 msgr2=0x7f14f409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14fbd0a640 1 -- 172.21.15.137:0/1942564931 shutdown_connections 2024-04-26T22:01:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.610+0000 7f14fbd0a640 1 -- 172.21.15.137:0/1942564931 wait complete. 2024-04-26T22:01:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.611+0000 7f14fbd0a640 1 Processor -- start 2024-04-26T22:01:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.611+0000 7f14fbd0a640 1 -- start start 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14fbd0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 0x7f14f40cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14fbd0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 0x7f14f415b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14fbd0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14f415f750 0x7f14f40b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14fbd0a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f14f40b51c0 con 0x7f14f415f370 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14fbd0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f14f40d0f20 con 0x7f14f415f750 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14fbd0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f14f40b5340 con 0x7f14f40d3ee0 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14f92a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 0x7f14f415b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14f92a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 0x7f14f415b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34440/0 (socket says 172.21.15.137:34440) 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14f92a5640 1 -- 172.21.15.137:0/84601315 learned_addr learned my addr 172.21.15.137:0/84601315 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14f9aa6640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 0x7f14f40cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.612+0000 7f14fa2a7640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14f415f750 0x7f14f40b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14f92a5640 1 -- 172.21.15.137:0/84601315 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 msgr2=0x7f14f40cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14f92a5640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 0x7f14f40cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14f92a5640 1 -- 172.21.15.137:0/84601315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14f415f750 msgr2=0x7f14f40b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14f92a5640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14f415f750 0x7f14f40b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14f92a5640 1 -- 172.21.15.137:0/84601315 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f40b1e20 con 0x7f14f415f370 2024-04-26T22:01:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14f9aa6640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 0x7f14f40cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14f92a5640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 0x7f14f415b8a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f14e400c430 tx=0x7f14e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14ea7fc640 1 -- 172.21.15.137:0/84601315 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e40074e0 con 0x7f14f415f370 2024-04-26T22:01:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14ea7fc640 1 -- 172.21.15.137:0/84601315 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e40047e0 con 0x7f14f415f370 2024-04-26T22:01:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f40b20e0 con 0x7f14f415f370 2024-04-26T22:01:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14ea7fc640 1 -- 172.21.15.137:0/84601315 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4004bd0 con 0x7f14f415f370 2024-04-26T22:01:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.613+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f40b26a0 con 0x7f14f415f370 2024-04-26T22:01:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.614+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f406a290 con 0x7f14f415f370 2024-04-26T22:01:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.614+0000 7f14ea7fc640 1 -- 172.21.15.137:0/84601315 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14e4011070 con 0x7f14f415f370 2024-04-26T22:01:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.615+0000 7f14ea7fc640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14d806c8f0 0x7f14d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.615+0000 7f14ea7fc640 1 -- 172.21.15.137:0/84601315 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f14e408b3d0 con 0x7f14f415f370 2024-04-26T22:01:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.615+0000 7f14f9aa6640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14d806c8f0 0x7f14d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.615+0000 7f14f9aa6640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14d806c8f0 0x7f14d806edb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f14f0034000 tx=0x7f14f002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.619+0000 7f14ea7fc640 1 -- 172.21.15.137:0/84601315 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f14e4059be0 con 0x7f14f415f370 2024-04-26T22:01:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.795+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f14f415bde0 con 0x7f14f415f370 2024-04-26T22:01:08.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.796+0000 7f14ea7fc640 1 -- 172.21.15.137:0/84601315 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) ==== 84+0+65 (secure 0 0 0) 0x7f14e40594e0 con 0x7f14f415f370 2024-04-26T22:01:08.796 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:08.796 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:01:08.797 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:08.797 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T22:01:08.797 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T22:01:08.797 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:08.797 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:01:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14d806c8f0 msgr2=0x7f14d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14d806c8f0 0x7f14d806edb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f14f0034000 tx=0x7f14f002e000 comp rx=0 tx=0).stop 2024-04-26T22:01:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 msgr2=0x7f14f415b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 0x7f14f415b8a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f14e400c430 tx=0x7f14e400c8f0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 shutdown_connections 2024-04-26T22:01:08.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14d806c8f0 0x7f14d806edb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14f415f370 0x7f14f415b8a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14f415f750 0x7f14f40b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 --2- 172.21.15.137:0/84601315 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14f40d3ee0 0x7f14f40cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 >> 172.21.15.137:0/84601315 conn(0x7f14f408ec10 msgr2=0x7f14f40d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 shutdown_connections 2024-04-26T22:01:08.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.798+0000 7f14fbd0a640 1 -- 172.21.15.137:0/84601315 wait complete. 2024-04-26T22:01:08.809 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T22:01:08.809 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T22:01:08.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.911+0000 7f8c4ff7f640 1 Processor -- start 2024-04-26T22:01:08.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.911+0000 7f8c4ff7f640 1 -- start start 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4ff7f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c480cee20 0x7f8c4806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4ff7f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8c480d3a30 0x7f8c4809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4ff7f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c480d1240 con 0x7f8c4809bf80 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4ff7f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4809c3f0 con 0x7f8c480cee20 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4ff7f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8c480d1e10 con 0x7f8c480d3a30 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4dd1b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c480cee20 0x7f8c4806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4e51c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8c4809bf80 0x7f8c481630d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32846/0 (socket says 172.21.15.137:32846) 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4e51c640 1 -- 172.21.15.137:0/1034567982 learned_addr learned my addr 172.21.15.137:0/1034567982 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4d51a640 1 --2- 172.21.15.137:0/1034567982 >> v2:172.21.15.170:3300/0 conn(0x7f8c480d3a30 0x7f8c4809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4dd1b640 1 -- 172.21.15.137:0/1034567982 >> v2:172.21.15.170:3300/0 conn(0x7f8c480d3a30 msgr2=0x7f8c4809ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:08.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4dd1b640 1 --2- 172.21.15.137:0/1034567982 >> v2:172.21.15.170:3300/0 conn(0x7f8c480d3a30 0x7f8c4809ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4dd1b640 1 -- 172.21.15.137:0/1034567982 >> v1:172.21.15.137:6789/0 conn(0x7f8c4809bf80 legacy=0x7f8c481630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4dd1b640 1 -- 172.21.15.137:0/1034567982 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c480d14e0 con 0x7f8c480cee20 2024-04-26T22:01:08.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4cd19640 1 -- 172.21.15.137:0/1034567982 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23002670 0 0) 0x7f8c480d1240 con 0x7f8c4809bf80 2024-04-26T22:01:08.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.912+0000 7f8c4d51a640 1 --2- 172.21.15.137:0/1034567982 >> v2:172.21.15.170:3300/0 conn(0x7f8c480d3a30 0x7f8c4809ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:08.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4dd1b640 1 --2- 172.21.15.137:0/1034567982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c480cee20 0x7f8c4806d5c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8c48073960 tx=0x7f8c4402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01a304e8e4d8824 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4cd19640 1 -- 172.21.15.137:0/1034567982 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44037070 con 0x7f8c480cee20 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4cd19640 1 -- 172.21.15.137:0/1034567982 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c44032440 con 0x7f8c480cee20 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4cd19640 1 -- 172.21.15.137:0/1034567982 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44032810 con 0x7f8c480cee20 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/1034567982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c480cee20 msgr2=0x7f8c4806d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4ff7f640 1 --2- 172.21.15.137:0/1034567982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c480cee20 0x7f8c4806d5c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8c48073960 tx=0x7f8c4402a1a0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/1034567982 shutdown_connections 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4ff7f640 1 --2- 172.21.15.137:0/1034567982 >> v2:172.21.15.170:3300/0 conn(0x7f8c480d3a30 0x7f8c4809ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4ff7f640 1 --2- 172.21.15.137:0/1034567982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c480cee20 0x7f8c4806d5c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.913+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/1034567982 >> 172.21.15.137:0/1034567982 conn(0x7f8c480d2f10 msgr2=0x7f8c480d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.914+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/1034567982 shutdown_connections 2024-04-26T22:01:08.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.914+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/1034567982 wait complete. 2024-04-26T22:01:08.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4ff7f640 1 Processor -- start 2024-04-26T22:01:08.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4ff7f640 1 -- start start 2024-04-26T22:01:08.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4ff7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4809bf80 0x7f8c480ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4ff7f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c480cee20 0x7f8c48151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4ff7f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c480d3a30 0x7f8c481f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4ff7f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4809c7a0 con 0x7f8c4809bf80 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4ff7f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480d1aa0 con 0x7f8c480d3a30 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4ff7f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8c480cf200 con 0x7f8c480cee20 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4dd1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4809bf80 0x7f8c480ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.915+0000 7f8c4dd1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4809bf80 0x7f8c480ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34466/0 (socket says 172.21.15.137:34466) 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4dd1b640 1 -- 172.21.15.137:0/3374399986 learned_addr learned my addr 172.21.15.137:0/3374399986 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4e51c640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c480d3a30 0x7f8c481f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4d51a640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c480cee20 0x7f8c48151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4dd1b640 1 -- 172.21.15.137:0/3374399986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c480cee20 msgr2=0x7f8c48151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4dd1b640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c480cee20 0x7f8c48151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4dd1b640 1 -- 172.21.15.137:0/3374399986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c480d3a30 msgr2=0x7f8c481f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4dd1b640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c480d3a30 0x7f8c481f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4dd1b640 1 -- 172.21.15.137:0/3374399986 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c48152850 con 0x7f8c4809bf80 2024-04-26T22:01:08.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4dd1b640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4809bf80 0x7f8c480ca580 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8c44000c00 tx=0x7f8c440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c3e7fc640 1 -- 172.21.15.137:0/3374399986 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44037050 con 0x7f8c4809bf80 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c3e7fc640 1 -- 172.21.15.137:0/3374399986 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c44038040 con 0x7f8c4809bf80 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c3e7fc640 1 -- 172.21.15.137:0/3374399986 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44004470 con 0x7f8c4809bf80 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c48152b30 con 0x7f8c4809bf80 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.916+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c481f8480 con 0x7f8c4809bf80 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.917+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c4806a290 con 0x7f8c4809bf80 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.917+0000 7f8c3e7fc640 1 -- 172.21.15.137:0/3374399986 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c44030900 con 0x7f8c4809bf80 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.918+0000 7f8c3e7fc640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c2c06c8f0 0x7f8c2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.918+0000 7f8c3e7fc640 1 -- 172.21.15.137:0/3374399986 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f8c440ac2d0 con 0x7f8c4809bf80 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.918+0000 7f8c4d51a640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c2c06c8f0 0x7f8c2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:08.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.918+0000 7f8c4d51a640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c2c06c8f0 0x7f8c2c06edb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8c48155f30 tx=0x7f8c38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:08.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:08.922+0000 7f8c3e7fc640 1 -- 172.21.15.137:0/3374399986 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8c4407aae0 con 0x7f8c4809bf80 2024-04-26T22:01:09.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.097+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8c480b4820 con 0x7f8c4809bf80 2024-04-26T22:01:09.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.525+0000 7f8c3e7fc640 1 -- 172.21.15.137:0/3374399986 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) ==== 138+0+0 (secure 0 0 0) 0x7f8c4407a3e0 con 0x7f8c4809bf80 2024-04-26T22:01:09.525 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T22:01:09.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.527+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c2c06c8f0 msgr2=0x7f8c2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:09.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.527+0000 7f8c4ff7f640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c2c06c8f0 0x7f8c2c06edb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8c48155f30 tx=0x7f8c38008040 comp rx=0 tx=0).stop 2024-04-26T22:01:09.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.527+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4809bf80 msgr2=0x7f8c480ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:09.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.527+0000 7f8c4ff7f640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4809bf80 0x7f8c480ca580 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8c44000c00 tx=0x7f8c440046c0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.528+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 shutdown_connections 2024-04-26T22:01:09.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.528+0000 7f8c4ff7f640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c2c06c8f0 0x7f8c2c06edb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.528+0000 7f8c4ff7f640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c480d3a30 0x7f8c481f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.528+0000 7f8c4ff7f640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c480cee20 0x7f8c48151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.528+0000 7f8c4ff7f640 1 --2- 172.21.15.137:0/3374399986 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c4809bf80 0x7f8c480ca580 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.528+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 >> 172.21.15.137:0/3374399986 conn(0x7f8c480d2f10 msgr2=0x7f8c480c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:09.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.528+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 shutdown_connections 2024-04-26T22:01:09.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.528+0000 7f8c4ff7f640 1 -- 172.21.15.137:0/3374399986 wait complete. 2024-04-26T22:01:09.542 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T22:01:09.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.645+0000 7fac62647640 1 Processor -- start 2024-04-26T22:01:09.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.645+0000 7fac62647640 1 -- start start 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.646+0000 7fac62647640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fac5c0d2170 0x7fac5c0d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.646+0000 7fac62647640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fac5c0b6050 0x7fac5c0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.646+0000 7fac62647640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c0d33d0 con 0x7fac5c162a40 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.646+0000 7fac62647640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c0b49a0 con 0x7fac5c0b6050 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.646+0000 7fac62647640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c0d36b0 con 0x7fac5c0d2170 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.646+0000 7fac60be4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fac5c0b6050 0x7fac5c0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.646+0000 7fac5bfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fac5c162a40 0x7fac5c0d1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32850/0 (socket says 172.21.15.137:32850) 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.646+0000 7fac60be4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fac5c0b6050 0x7fac5c0cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34470/0 (socket says 172.21.15.137:34470) 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.646+0000 7fac5bfff640 1 -- 172.21.15.137:0/1150337707 learned_addr learned my addr 172.21.15.137:0/1150337707 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac5b7fe640 1 --2- 172.21.15.137:0/1150337707 >> v2:172.21.15.170:3300/0 conn(0x7fac5c0d2170 0x7fac5c0d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac60be4640 1 -- 172.21.15.137:0/1150337707 >> v2:172.21.15.170:3300/0 conn(0x7fac5c0d2170 msgr2=0x7fac5c0d2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:09.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac60be4640 1 --2- 172.21.15.137:0/1150337707 >> v2:172.21.15.170:3300/0 conn(0x7fac5c0d2170 0x7fac5c0d2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac60be4640 1 -- 172.21.15.137:0/1150337707 >> v1:172.21.15.137:6789/0 conn(0x7fac5c162a40 legacy=0x7fac5c0d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:09.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac60be4640 1 -- 172.21.15.137:0/1150337707 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c0d3990 con 0x7fac5c0b6050 2024-04-26T22:01:09.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac5b7fe640 1 --2- 172.21.15.137:0/1150337707 >> v2:172.21.15.170:3300/0 conn(0x7fac5c0d2170 0x7fac5c0d2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac60be4640 1 --2- 172.21.15.137:0/1150337707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0b6050 0x7fac5c0cffe0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fac5c08f0e0 tx=0x7fac5402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9a11bd599e7187 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac5affd640 1 -- 172.21.15.137:0/1150337707 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54007740 con 0x7fac5c0b6050 2024-04-26T22:01:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac5affd640 1 -- 172.21.15.137:0/1150337707 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac540078e0 con 0x7fac5c0b6050 2024-04-26T22:01:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.647+0000 7fac5affd640 1 -- 172.21.15.137:0/1150337707 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54007cb0 con 0x7fac5c0b6050 2024-04-26T22:01:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.648+0000 7fac62647640 1 -- 172.21.15.137:0/1150337707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0b6050 msgr2=0x7fac5c0cffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:09.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.648+0000 7fac62647640 1 --2- 172.21.15.137:0/1150337707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0b6050 0x7fac5c0cffe0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fac5c08f0e0 tx=0x7fac5402a680 comp rx=0 tx=0).stop 2024-04-26T22:01:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.648+0000 7fac62647640 1 -- 172.21.15.137:0/1150337707 shutdown_connections 2024-04-26T22:01:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.648+0000 7fac62647640 1 --2- 172.21.15.137:0/1150337707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0b6050 0x7fac5c0cffe0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.648+0000 7fac62647640 1 --2- 172.21.15.137:0/1150337707 >> v2:172.21.15.170:3300/0 conn(0x7fac5c0d2170 0x7fac5c0d2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.648+0000 7fac62647640 1 -- 172.21.15.137:0/1150337707 >> 172.21.15.137:0/1150337707 conn(0x7fac5c09e560 msgr2=0x7fac5c0d5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.648+0000 7fac62647640 1 -- 172.21.15.137:0/1150337707 shutdown_connections 2024-04-26T22:01:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.648+0000 7fac62647640 1 -- 172.21.15.137:0/1150337707 wait complete. 2024-04-26T22:01:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.649+0000 7fac62647640 1 Processor -- start 2024-04-26T22:01:09.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.649+0000 7fac62647640 1 -- start start 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac62647640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b6050 0x7fac5c0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac62647640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0d2170 0x7fac5c0b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac62647640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c162a40 0x7fac5c15a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac62647640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c162e20 con 0x7fac5c0d2170 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac62647640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0d3f50 con 0x7fac5c162a40 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac62647640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c0b6630 con 0x7fac5c0b6050 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0d2170 0x7fac5c0b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0d2170 0x7fac5c0b9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34474/0 (socket says 172.21.15.137:34474) 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5b7fe640 1 -- 172.21.15.137:0/3047649075 learned_addr learned my addr 172.21.15.137:0/3047649075 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:09.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac60be4640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c162a40 0x7fac5c15a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5bfff640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b6050 0x7fac5c0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5b7fe640 1 -- 172.21.15.137:0/3047649075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b6050 msgr2=0x7fac5c0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5b7fe640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b6050 0x7fac5c0c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5b7fe640 1 -- 172.21.15.137:0/3047649075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c162a40 msgr2=0x7fac5c15a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5b7fe640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c162a40 0x7fac5c15a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5b7fe640 1 -- 172.21.15.137:0/3047649075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c0c9b20 con 0x7fac5c0d2170 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.650+0000 7fac5bfff640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b6050 0x7fac5c0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.651+0000 7fac5b7fe640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0d2170 0x7fac5c0b9d80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c7f0 tx=0x7fac5000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.651+0000 7fac58ff9640 1 -- 172.21.15.137:0/3047649075 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50015070 con 0x7fac5c0d2170 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.651+0000 7fac58ff9640 1 -- 172.21.15.137:0/3047649075 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac50007a30 con 0x7fac5c0d2170 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.651+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c0c9e00 con 0x7fac5c0d2170 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.651+0000 7fac58ff9640 1 -- 172.21.15.137:0/3047649075 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50007e00 con 0x7fac5c0d2170 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.651+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c0ca3c0 con 0x7fac5c0d2170 2024-04-26T22:01:09.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.652+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c069ae0 con 0x7fac5c0d2170 2024-04-26T22:01:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.652+0000 7fac58ff9640 1 -- 172.21.15.137:0/3047649075 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac50018070 con 0x7fac5c0d2170 2024-04-26T22:01:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.653+0000 7fac58ff9640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4806c8f0 0x7fac4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.653+0000 7fac58ff9640 1 -- 172.21.15.137:0/3047649075 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5227+0+0 (secure 0 0 0) 0x7fac5008b940 con 0x7fac5c0d2170 2024-04-26T22:01:09.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.653+0000 7fac5bfff640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4806c8f0 0x7fac4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:09.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.653+0000 7fac5bfff640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4806c8f0 0x7fac4806edb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fac4c000f60 tx=0x7fac4c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:09.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.657+0000 7fac58ff9640 1 -- 172.21.15.137:0/3047649075 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fac5c069ae0 con 0x7fac5c0d2170 2024-04-26T22:01:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:09.833+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fac5c06a290 con 0x7fac5c0d2170 2024-04-26T22:01:10.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.530+0000 7fac58ff9640 1 -- 172.21.15.137:0/3047649075 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) ==== 170+0+0 (secure 0 0 0) 0x7fac50059860 con 0x7fac5c0d2170 2024-04-26T22:01:10.531 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T22:01:10.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.534+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4806c8f0 msgr2=0x7fac4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:10.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.534+0000 7fac62647640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4806c8f0 0x7fac4806edb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fac4c000f60 tx=0x7fac4c009040 comp rx=0 tx=0).stop 2024-04-26T22:01:10.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.534+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0d2170 msgr2=0x7fac5c0b9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:10.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.535+0000 7fac62647640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0d2170 0x7fac5c0b9d80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c7f0 tx=0x7fac5000cbf0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.536+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 shutdown_connections 2024-04-26T22:01:10.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.536+0000 7fac62647640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fac4806c8f0 0x7fac4806edb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.536+0000 7fac62647640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fac5c0d2170 0x7fac5c0b9d80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.536+0000 7fac62647640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac5c162a40 0x7fac5c15a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.536+0000 7fac62647640 1 --2- 172.21.15.137:0/3047649075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fac5c0b6050 0x7fac5c0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.536+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 >> 172.21.15.137:0/3047649075 conn(0x7fac5c09e560 msgr2=0x7fac5c0b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:10.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.536+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 shutdown_connections 2024-04-26T22:01:10.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.536+0000 7fac62647640 1 -- 172.21.15.137:0/3047649075 wait complete. 2024-04-26T22:01:10.562 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T22:01:10.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.666+0000 7f9a7b8f9640 1 Processor -- start 2024-04-26T22:01:10.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.667+0000 7f9a7b8f9640 1 -- start start 2024-04-26T22:01:10.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.667+0000 7f9a7b8f9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9a7415f680 0x7f9a740d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.667+0000 7f9a7b8f9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9a740d4f20 0x7f9a740d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.667+0000 7f9a7b8f9640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a740d58c0 con 0x7f9a74163aa0 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.667+0000 7f9a7b8f9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9a7415fa60 con 0x7f9a740d4f20 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.667+0000 7f9a7b8f9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9a740d3f50 con 0x7f9a7415f680 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a79e96640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9a740d4f20 0x7f9a740d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a78e94640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9a74163aa0 0x7f9a740b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32866/0 (socket says 172.21.15.137:32866) 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a78e94640 1 -- 172.21.15.137:0/2691786886 learned_addr learned my addr 172.21.15.137:0/2691786886 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a79695640 1 --2- 172.21.15.137:0/2691786886 >> v2:172.21.15.170:3300/0 conn(0x7f9a7415f680 0x7f9a740d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a79e96640 1 -- 172.21.15.137:0/2691786886 >> v2:172.21.15.170:3300/0 conn(0x7f9a7415f680 msgr2=0x7f9a740d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:10.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a79e96640 1 --2- 172.21.15.137:0/2691786886 >> v2:172.21.15.170:3300/0 conn(0x7f9a7415f680 0x7f9a740d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a79e96640 1 -- 172.21.15.137:0/2691786886 >> v1:172.21.15.137:6789/0 conn(0x7f9a74163aa0 legacy=0x7f9a740b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a6bfff640 1 -- 172.21.15.137:0/2691786886 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779618367 0 0) 0x7f9a740d58c0 con 0x7f9a74163aa0 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a79e96640 1 -- 172.21.15.137:0/2691786886 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a740b5090 con 0x7f9a740d4f20 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.668+0000 7f9a79695640 1 --2- 172.21.15.137:0/2691786886 >> v2:172.21.15.170:3300/0 conn(0x7f9a7415f680 0x7f9a740d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a79e96640 1 --2- 172.21.15.137:0/2691786886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a740d4f20 0x7f9a740d5380 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9a740d6370 tx=0x7f9a6c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605c319788088761 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a6bfff640 1 -- 172.21.15.137:0/2691786886 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c007740 con 0x7f9a740d4f20 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a6bfff640 1 -- 172.21.15.137:0/2691786886 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c0078e0 con 0x7f9a740d4f20 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a6bfff640 1 -- 172.21.15.137:0/2691786886 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c007cb0 con 0x7f9a740d4f20 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/2691786886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a740d4f20 msgr2=0x7f9a740d5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a7b8f9640 1 --2- 172.21.15.137:0/2691786886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a740d4f20 0x7f9a740d5380 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9a740d6370 tx=0x7f9a6c02a680 comp rx=0 tx=0).stop 2024-04-26T22:01:10.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/2691786886 shutdown_connections 2024-04-26T22:01:10.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a7b8f9640 1 --2- 172.21.15.137:0/2691786886 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a740d4f20 0x7f9a740d5380 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a7b8f9640 1 --2- 172.21.15.137:0/2691786886 >> v2:172.21.15.170:3300/0 conn(0x7f9a7415f680 0x7f9a740d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/2691786886 >> 172.21.15.137:0/2691786886 conn(0x7f9a7408eca0 msgr2=0x7f9a7409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:10.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/2691786886 shutdown_connections 2024-04-26T22:01:10.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.669+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/2691786886 wait complete. 2024-04-26T22:01:10.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.670+0000 7f9a7b8f9640 1 Processor -- start 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a7b8f9640 1 -- start start 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a7b8f9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a740d4f20 0x7f9a7414ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a7b8f9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a7415f680 0x7f9a7415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a7b8f9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a74163aa0 0x7f9a7415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a7b8f9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74163f30 con 0x7f9a74163aa0 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a7b8f9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9a740b6280 con 0x7f9a7415f680 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a7b8f9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9a740cfd80 con 0x7f9a740d4f20 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a79e96640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a74163aa0 0x7f9a7415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a79e96640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a74163aa0 0x7f9a7415ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34488/0 (socket says 172.21.15.137:34488) 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a79e96640 1 -- 172.21.15.137:0/1595071918 learned_addr learned my addr 172.21.15.137:0/1595071918 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a78e94640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a7415f680 0x7f9a7415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.671+0000 7f9a79695640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a740d4f20 0x7f9a7414ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:10.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a79e96640 1 -- 172.21.15.137:0/1595071918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a740d4f20 msgr2=0x7f9a7414ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a79e96640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a740d4f20 0x7f9a7414ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a79e96640 1 -- 172.21.15.137:0/1595071918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a7415f680 msgr2=0x7f9a7415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a79e96640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a7415f680 0x7f9a7415d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a79e96640 1 -- 172.21.15.137:0/1595071918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a740cdfe0 con 0x7f9a74163aa0 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a79e96640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a74163aa0 0x7f9a7415ddd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009e50 tx=0x7f9a6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a69ffb640 1 -- 172.21.15.137:0/1595071918 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c040070 con 0x7f9a74163aa0 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a69ffb640 1 -- 172.21.15.137:0/1595071918 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c031cc0 con 0x7f9a74163aa0 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a740ce2c0 con 0x7f9a74163aa0 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a69ffb640 1 -- 172.21.15.137:0/1595071918 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c045680 con 0x7f9a74163aa0 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.672+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a740ca4d0 con 0x7f9a74163aa0 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.673+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a740ceda0 con 0x7f9a74163aa0 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.674+0000 7f9a69ffb640 1 -- 172.21.15.137:0/1595071918 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a6c039040 con 0x7f9a74163aa0 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.674+0000 7f9a69ffb640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9a5806c8f0 0x7f9a5806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.674+0000 7f9a69ffb640 1 -- 172.21.15.137:0/1595071918 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5609+0+0 (secure 0 0 0) 0x7f9a6c0ad3e0 con 0x7f9a74163aa0 2024-04-26T22:01:10.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.674+0000 7f9a79695640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9a5806c8f0 0x7f9a5806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:10.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.675+0000 7f9a79695640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9a5806c8f0 0x7f9a5806edb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400ab60 tx=0x7f9a64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:10.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.679+0000 7f9a69ffb640 1 -- 172.21.15.137:0/1595071918 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9a740ceda0 con 0x7f9a74163aa0 2024-04-26T22:01:10.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:10.892+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9a7406a290 con 0x7f9a74163aa0 2024-04-26T22:01:11.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.540+0000 7f9a69ffb640 1 -- 172.21.15.137:0/1595071918 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v24) ==== 172+0+0 (secure 0 0 0) 0x7f9a6c07b2e0 con 0x7f9a74163aa0 2024-04-26T22:01:11.540 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 8 and data pool 9 2024-04-26T22:01:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.547+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9a5806c8f0 msgr2=0x7f9a5806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.547+0000 7f9a7b8f9640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9a5806c8f0 0x7f9a5806edb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400ab60 tx=0x7f9a64008040 comp rx=0 tx=0).stop 2024-04-26T22:01:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.547+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a74163aa0 msgr2=0x7f9a7415ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.547+0000 7f9a7b8f9640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a74163aa0 0x7f9a7415ddd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009e50 tx=0x7f9a6c004a40 comp rx=0 tx=0).stop 2024-04-26T22:01:11.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.548+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 shutdown_connections 2024-04-26T22:01:11.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.548+0000 7f9a7b8f9640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9a5806c8f0 0x7f9a5806edb0 secure :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400ab60 tx=0x7f9a64008040 comp rx=0 tx=0).stop 2024-04-26T22:01:11.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.548+0000 7f9a7b8f9640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9a74163aa0 0x7f9a7415ddd0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.548+0000 7f9a7b8f9640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a7415f680 0x7f9a7415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.548+0000 7f9a7b8f9640 1 --2- 172.21.15.137:0/1595071918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9a740d4f20 0x7f9a7414ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.548+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 >> 172.21.15.137:0/1595071918 conn(0x7f9a7408eca0 msgr2=0x7f9a740d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:11.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.553+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 shutdown_connections 2024-04-26T22:01:11.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.555+0000 7f9a7b8f9640 1 -- 172.21.15.137:0/1595071918 wait complete. 2024-04-26T22:01:11.571 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:01:11.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.669+0000 7eff98df0640 1 Processor -- start 2024-04-26T22:01:11.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.669+0000 7eff98df0640 1 -- start start 2024-04-26T22:01:11.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.669+0000 7eff98df0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff9413ff70 0x7eff94146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.669+0000 7eff98df0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff940d05b0 con 0x7eff940cff20 2024-04-26T22:01:11.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.669+0000 7eff98df0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff940d0890 con 0x7eff94140350 2024-04-26T22:01:11.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.669+0000 7eff98df0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7eff9406e450 con 0x7eff9413ff70 2024-04-26T22:01:11.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.670+0000 7eff9259c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff9413ff70 0x7eff94146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.670+0000 7eff92d9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7eff940cff20 0x7eff9406ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32868/0 (socket says 172.21.15.137:32868) 2024-04-26T22:01:11.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.670+0000 7eff92d9d640 1 -- 172.21.15.137:0/1558832524 learned_addr learned my addr 172.21.15.137:0/1558832524 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:11.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.670+0000 7eff91d9b640 1 -- 172.21.15.137:0/1558832524 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858557056 0 0) 0x7eff940d05b0 con 0x7eff940cff20 2024-04-26T22:01:11.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.670+0000 7eff91d9b640 1 -- 172.21.15.137:0/1558832524 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff80003520 con 0x7eff940cff20 2024-04-26T22:01:11.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.670+0000 7eff9259c640 1 -- 172.21.15.137:0/1558832524 >> v1:172.21.15.170:6789/0 conn(0x7eff94140350 legacy=0x7eff940cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.670+0000 7eff9259c640 1 -- 172.21.15.137:0/1558832524 >> v1:172.21.15.137:6789/0 conn(0x7eff940cff20 legacy=0x7eff9406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.670+0000 7eff9259c640 1 -- 172.21.15.137:0/1558832524 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9406e730 con 0x7eff9413ff70 2024-04-26T22:01:11.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff9259c640 1 --2- 172.21.15.137:0/1558832524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff9413ff70 0x7eff94146080 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7eff840097a0 tx=0x7eff8402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58025d172653502b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:11.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff91d9b640 1 -- 172.21.15.137:0/1558832524 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84037070 con 0x7eff9413ff70 2024-04-26T22:01:11.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff91d9b640 1 -- 172.21.15.137:0/1558832524 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff84032440 con 0x7eff9413ff70 2024-04-26T22:01:11.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff91d9b640 1 -- 172.21.15.137:0/1558832524 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84032810 con 0x7eff9413ff70 2024-04-26T22:01:11.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff98df0640 1 -- 172.21.15.137:0/1558832524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff9413ff70 msgr2=0x7eff94146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff98df0640 1 --2- 172.21.15.137:0/1558832524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff9413ff70 0x7eff94146080 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7eff840097a0 tx=0x7eff8402a1a0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff98df0640 1 -- 172.21.15.137:0/1558832524 shutdown_connections 2024-04-26T22:01:11.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff98df0640 1 --2- 172.21.15.137:0/1558832524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff9413ff70 0x7eff94146080 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff98df0640 1 -- 172.21.15.137:0/1558832524 >> 172.21.15.137:0/1558832524 conn(0x7eff940d0d30 msgr2=0x7eff940d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:11.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff98df0640 1 -- 172.21.15.137:0/1558832524 shutdown_connections 2024-04-26T22:01:11.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.671+0000 7eff98df0640 1 -- 172.21.15.137:0/1558832524 wait complete. 2024-04-26T22:01:11.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.673+0000 7eff98df0640 1 Processor -- start 2024-04-26T22:01:11.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.673+0000 7eff98df0640 1 -- start start 2024-04-26T22:01:11.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.673+0000 7eff98df0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff940cff20 0x7eff940af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.673+0000 7eff98df0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff9413ff70 0x7eff940aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.673+0000 7eff98df0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff94140350 0x7eff941f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.673+0000 7eff98df0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff94146990 con 0x7eff940cff20 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.673+0000 7eff98df0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7eff94146810 con 0x7eff94140350 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.673+0000 7eff98df0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7eff9406f360 con 0x7eff9413ff70 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.673+0000 7eff9259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff940cff20 0x7eff940af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff9259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff940cff20 0x7eff940af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34506/0 (socket says 172.21.15.137:34506) 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff9259c640 1 -- 172.21.15.137:0/501347934 learned_addr learned my addr 172.21.15.137:0/501347934 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff9259c640 1 -- 172.21.15.137:0/501347934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff9413ff70 msgr2=0x7eff940aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff9259c640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff9413ff70 0x7eff940aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff9259c640 1 -- 172.21.15.137:0/501347934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff94140350 msgr2=0x7eff941f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff9259c640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff94140350 0x7eff941f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff9259c640 1 -- 172.21.15.137:0/501347934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9413cdf0 con 0x7eff940cff20 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff9259c640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff940cff20 0x7eff940af670 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7eff84035040 tx=0x7eff840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:11.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff8affd640 1 -- 172.21.15.137:0/501347934 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84037040 con 0x7eff940cff20 2024-04-26T22:01:11.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff8affd640 1 -- 172.21.15.137:0/501347934 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff84030500 con 0x7eff940cff20 2024-04-26T22:01:11.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff9413d0d0 con 0x7eff940cff20 2024-04-26T22:01:11.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff8affd640 1 -- 172.21.15.137:0/501347934 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84030910 con 0x7eff940cff20 2024-04-26T22:01:11.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.674+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9413d690 con 0x7eff940cff20 2024-04-26T22:01:11.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.675+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff9406a290 con 0x7eff940cff20 2024-04-26T22:01:11.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.676+0000 7eff8affd640 1 -- 172.21.15.137:0/501347934 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff84044020 con 0x7eff940cff20 2024-04-26T22:01:11.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.676+0000 7eff8affd640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff7406c8f0 0x7eff7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.676+0000 7eff8affd640 1 -- 172.21.15.137:0/501347934 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7eff840abdb0 con 0x7eff940cff20 2024-04-26T22:01:11.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.676+0000 7eff8bfff640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff7406c8f0 0x7eff7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.677+0000 7eff8bfff640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff7406c8f0 0x7eff7406edb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7eff7c000f60 tx=0x7eff7c0079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:11.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.681+0000 7eff8affd640 1 -- 172.21.15.137:0/501347934 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7eff8407a270 con 0x7eff940cff20 2024-04-26T22:01:11.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.857+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff940b65c0 con 0x7eff940cff20 2024-04-26T22:01:11.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.859+0000 7eff8affd640 1 -- 172.21.15.137:0/501347934 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16690 (secure 0 0 0) 0x7eff84079b70 con 0x7eff940cff20 2024-04-26T22:01:11.859 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:11.859 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":59,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:01:10.893774+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:01:09.101906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T22:01:09.837941+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:01:11.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff7406c8f0 msgr2=0x7eff7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff7406c8f0 0x7eff7406edb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7eff7c000f60 tx=0x7eff7c0079d0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff940cff20 msgr2=0x7eff940af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff940cff20 0x7eff940af670 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7eff84035040 tx=0x7eff840046c0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 shutdown_connections 2024-04-26T22:01:11.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff7406c8f0 0x7eff7406edb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff94140350 0x7eff941f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff9413ff70 0x7eff940aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 --2- 172.21.15.137:0/501347934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff940cff20 0x7eff940af670 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 >> 172.21.15.137:0/501347934 conn(0x7eff940d0d30 msgr2=0x7eff940b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:11.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 shutdown_connections 2024-04-26T22:01:11.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.861+0000 7eff98df0640 1 -- 172.21.15.137:0/501347934 wait complete. 2024-04-26T22:01:11.872 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:01:11.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.969+0000 7f8a03a6d640 1 Processor -- start 2024-04-26T22:01:11.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.970+0000 7f8a03a6d640 1 -- start start 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.970+0000 7f8a03a6d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f89fc148a30 0x7f89fc073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.970+0000 7f8a03a6d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89fc160640 0x7f89fc1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.970+0000 7f8a03a6d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc163be0 0x7f89fc0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.970+0000 7f8a03a6d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f89fc0cfa80 con 0x7f89fc160640 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.970+0000 7f8a03a6d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f89fc0cfd60 con 0x7f89fc148a30 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.970+0000 7f8a03a6d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89fc0d0040 con 0x7f89fc163be0 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.970+0000 7f8a01008640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89fc160640 0x7f89fc1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a01008640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89fc160640 0x7f89fc1636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34522/0 (socket says 172.21.15.137:34522) 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a01008640 1 -- 172.21.15.137:0/590427174 learned_addr learned my addr 172.21.15.137:0/590427174 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a01809640 1 --2- 172.21.15.137:0/590427174 >> v2:172.21.15.170:3300/0 conn(0x7f89fc148a30 0x7f89fc073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a0200a640 1 --2- 172.21.15.137:0/590427174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc163be0 0x7f89fc0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a01008640 1 -- 172.21.15.137:0/590427174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc163be0 msgr2=0x7f89fc0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:11.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a01008640 1 --2- 172.21.15.137:0/590427174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc163be0 0x7f89fc0b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a01008640 1 -- 172.21.15.137:0/590427174 >> v2:172.21.15.170:3300/0 conn(0x7f89fc148a30 msgr2=0x7f89fc073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:11.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a01008640 1 --2- 172.21.15.137:0/590427174 >> v2:172.21.15.170:3300/0 conn(0x7f89fc148a30 0x7f89fc073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a01008640 1 -- 172.21.15.137:0/590427174 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc162ea0 con 0x7f89fc160640 2024-04-26T22:01:11.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.971+0000 7f8a01008640 1 --2- 172.21.15.137:0/590427174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc160640 0x7f89fc1636a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0cf6d0 tx=0x7f89ec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845890559377cc83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:11.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a00807640 1 -- 172.21.15.137:0/590427174 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec037070 con 0x7f89fc160640 2024-04-26T22:01:11.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a00807640 1 -- 172.21.15.137:0/590427174 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89ec032440 con 0x7f89fc160640 2024-04-26T22:01:11.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a00807640 1 -- 172.21.15.137:0/590427174 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ec032810 con 0x7f89fc160640 2024-04-26T22:01:11.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a03a6d640 1 -- 172.21.15.137:0/590427174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc160640 msgr2=0x7f89fc1636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/590427174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc160640 0x7f89fc1636a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0cf6d0 tx=0x7f89ec02a140 comp rx=0 tx=0).stop 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a03a6d640 1 -- 172.21.15.137:0/590427174 shutdown_connections 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/590427174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc163be0 0x7f89fc0b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/590427174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc160640 0x7f89fc1636a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/590427174 >> v2:172.21.15.170:3300/0 conn(0x7f89fc148a30 0x7f89fc073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a03a6d640 1 -- 172.21.15.137:0/590427174 >> 172.21.15.137:0/590427174 conn(0x7f89fc0ce8b0 msgr2=0x7f89fc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a03a6d640 1 -- 172.21.15.137:0/590427174 shutdown_connections 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.972+0000 7f8a03a6d640 1 -- 172.21.15.137:0/590427174 wait complete. 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.973+0000 7f8a03a6d640 1 Processor -- start 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.973+0000 7f8a03a6d640 1 -- start start 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a03a6d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc148a30 0x7f89fc142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a03a6d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc160640 0x7f89fc0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a03a6d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89fc163be0 0x7f89fc1f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a03a6d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc074590 con 0x7f89fc148a30 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a03a6d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f89fc074410 con 0x7f89fc163be0 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a03a6d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89fc148e10 con 0x7f89fc160640 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a01809640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc148a30 0x7f89fc142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a01809640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc148a30 0x7f89fc142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34538/0 (socket says 172.21.15.137:34538) 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a01809640 1 -- 172.21.15.137:0/997502793 learned_addr learned my addr 172.21.15.137:0/997502793 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a0200a640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89fc163be0 0x7f89fc1f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.974+0000 7f8a01008640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc160640 0x7f89fc0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f8a01809640 1 -- 172.21.15.137:0/997502793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc160640 msgr2=0x7f89fc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f8a01809640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc160640 0x7f89fc0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f8a01809640 1 -- 172.21.15.137:0/997502793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89fc163be0 msgr2=0x7f89fc1f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f8a01809640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89fc163be0 0x7f89fc1f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f8a01809640 1 -- 172.21.15.137:0/997502793 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89fc0b54f0 con 0x7f89fc148a30 2024-04-26T22:01:11.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f8a01809640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc148a30 0x7f89fc142940 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f89f800e8a0 tx=0x7f89f800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f89f27fc640 1 -- 172.21.15.137:0/997502793 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8017070 con 0x7f89fc148a30 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f89f27fc640 1 -- 172.21.15.137:0/997502793 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f800c940 con 0x7f89fc148a30 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89fc0b57d0 con 0x7f89fc148a30 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f89f27fc640 1 -- 172.21.15.137:0/997502793 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f800cd30 con 0x7f89fc148a30 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.975+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89fc0b5d90 con 0x7f89fc148a30 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.976+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89fc162640 con 0x7f89fc148a30 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.976+0000 7f89f27fc640 1 -- 172.21.15.137:0/997502793 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89f801a070 con 0x7f89fc148a30 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.977+0000 7f89f27fc640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f89e006c8f0 0x7f89e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.977+0000 7f89f27fc640 1 -- 172.21.15.137:0/997502793 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7f89f808bcf0 con 0x7f89fc148a30 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.977+0000 7f8a01008640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f89e006c8f0 0x7f89e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:11.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.977+0000 7f8a01008640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f89e006c8f0 0x7f89e006edb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f89ec034000 tx=0x7f89ec02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:11.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:11.981+0000 7f89f27fc640 1 -- 172.21.15.137:0/997502793 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f89fc162640 con 0x7f89fc148a30 2024-04-26T22:01:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.157+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89fc163610 con 0x7f89fc148a30 2024-04-26T22:01:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.159+0000 7f89f27fc640 1 -- 172.21.15.137:0/997502793 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16690 (secure 0 0 0) 0x7f89fc163610 con 0x7f89fc148a30 2024-04-26T22:01:12.159 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:12.159 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":59,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:01:10.893774+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:01:09.101906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T22:01:09.837941+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.160+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f89e006c8f0 msgr2=0x7f89e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.160+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f89e006c8f0 0x7f89e006edb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f89ec034000 tx=0x7f89ec02e000 comp rx=0 tx=0).stop 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.160+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc148a30 msgr2=0x7f89fc142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.160+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc148a30 0x7f89fc142940 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f89f800e8a0 tx=0x7f89f800ed60 comp rx=0 tx=0).stop 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.160+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 shutdown_connections 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.160+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f89e006c8f0 0x7f89e006edb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.160+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89fc163be0 0x7f89fc1f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.161+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89fc160640 0x7f89fc0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.161+0000 7f8a03a6d640 1 --2- 172.21.15.137:0/997502793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89fc148a30 0x7f89fc142940 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.161+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 >> 172.21.15.137:0/997502793 conn(0x7f89fc0ce8b0 msgr2=0x7f89fc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.161+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 shutdown_connections 2024-04-26T22:01:12.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.161+0000 7f8a03a6d640 1 -- 172.21.15.137:0/997502793 wait complete. 2024-04-26T22:01:12.172 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T22:01:12.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.271+0000 7fcea50bb640 1 Processor -- start 2024-04-26T22:01:12.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.271+0000 7fcea50bb640 1 -- start start 2024-04-26T22:01:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.272+0000 7fcea50bb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcea00d4f20 0x7fcea00d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.272+0000 7fcea50bb640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea00d3c90 con 0x7fcea00d3820 2024-04-26T22:01:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.272+0000 7fcea50bb640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea00d58c0 con 0x7fcea015f680 2024-04-26T22:01:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.272+0000 7fcea50bb640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcea015fa60 con 0x7fcea00d4f20 2024-04-26T22:01:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.272+0000 7fce9f59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcea00d4f20 0x7fcea00d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.272+0000 7fce9f59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcea00d4f20 0x7fcea00d5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34550/0 (socket says 172.21.15.137:34550) 2024-04-26T22:01:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.272+0000 7fce9e59c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcea00d3820 0x7fcea00b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32880/0 (socket says 172.21.15.137:32880) 2024-04-26T22:01:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.272+0000 7fce9f59e640 1 -- 172.21.15.137:0/2138367903 learned_addr learned my addr 172.21.15.137:0/2138367903 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.273+0000 7fce9f59e640 1 -- 172.21.15.137:0/2138367903 >> v1:172.21.15.170:6789/0 conn(0x7fcea015f680 legacy=0x7fcea0163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.273+0000 7fce9f59e640 1 -- 172.21.15.137:0/2138367903 >> v1:172.21.15.137:6789/0 conn(0x7fcea00d3820 legacy=0x7fcea00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.273+0000 7fce9f59e640 1 -- 172.21.15.137:0/2138367903 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea00d3f50 con 0x7fcea00d4f20 2024-04-26T22:01:12.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.273+0000 7fce9dd9b640 1 -- 172.21.15.137:0/2138367903 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181360324 0 0) 0x7fcea00d3c90 con 0x7fcea00d3820 2024-04-26T22:01:12.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.273+0000 7fce9f59e640 1 --2- 172.21.15.137:0/2138367903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d4f20 0x7fcea00d5380 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fce98009870 tx=0x7fce9802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7badc1da2a6e9fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:12.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.273+0000 7fce9dd9b640 1 -- 172.21.15.137:0/2138367903 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98037070 con 0x7fcea00d4f20 2024-04-26T22:01:12.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.273+0000 7fce9dd9b640 1 -- 172.21.15.137:0/2138367903 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9802ae50 con 0x7fcea00d4f20 2024-04-26T22:01:12.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.273+0000 7fce9dd9b640 1 -- 172.21.15.137:0/2138367903 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98032860 con 0x7fcea00d4f20 2024-04-26T22:01:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.274+0000 7fcea50bb640 1 -- 172.21.15.137:0/2138367903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d4f20 msgr2=0x7fcea00d5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.274+0000 7fcea50bb640 1 --2- 172.21.15.137:0/2138367903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d4f20 0x7fcea00d5380 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fce98009870 tx=0x7fce9802a300 comp rx=0 tx=0).stop 2024-04-26T22:01:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.274+0000 7fcea50bb640 1 -- 172.21.15.137:0/2138367903 shutdown_connections 2024-04-26T22:01:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.274+0000 7fcea50bb640 1 --2- 172.21.15.137:0/2138367903 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d4f20 0x7fcea00d5380 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.274+0000 7fcea50bb640 1 -- 172.21.15.137:0/2138367903 >> 172.21.15.137:0/2138367903 conn(0x7fcea008eca0 msgr2=0x7fcea009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.274+0000 7fcea50bb640 1 -- 172.21.15.137:0/2138367903 shutdown_connections 2024-04-26T22:01:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.274+0000 7fcea50bb640 1 -- 172.21.15.137:0/2138367903 wait complete. 2024-04-26T22:01:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.275+0000 7fcea50bb640 1 Processor -- start 2024-04-26T22:01:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.275+0000 7fcea50bb640 1 -- start start 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fcea50bb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d3820 0x7fcea015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fcea50bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcea00d4f20 0x7fcea0160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fcea50bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcea015f680 0x7fcea00ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fcea50bb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcea00b6280 con 0x7fcea00d3820 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fcea50bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcea00b5370 con 0x7fcea00d4f20 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fcea50bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcea00cfd80 con 0x7fcea015f680 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fce9ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d3820 0x7fcea015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fce9ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d3820 0x7fcea015c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34554/0 (socket says 172.21.15.137:34554) 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fce9ed9d640 1 -- 172.21.15.137:0/3783392324 learned_addr learned my addr 172.21.15.137:0/3783392324 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fce9e59c640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcea00d4f20 0x7fcea0160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.276+0000 7fce9f59e640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcea015f680 0x7fcea00ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fce9ed9d640 1 -- 172.21.15.137:0/3783392324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcea015f680 msgr2=0x7fcea00ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fce9ed9d640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcea015f680 0x7fcea00ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fce9ed9d640 1 -- 172.21.15.137:0/3783392324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcea00d4f20 msgr2=0x7fcea0160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fce9ed9d640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcea00d4f20 0x7fcea0160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fce9ed9d640 1 -- 172.21.15.137:0/3783392324 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea015cd30 con 0x7fcea00d3820 2024-04-26T22:01:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fce9ed9d640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d3820 0x7fcea015c7f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c730 tx=0x7fce9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fce877fe640 1 -- 172.21.15.137:0/3783392324 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce90003b70 con 0x7fcea00d3820 2024-04-26T22:01:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fce877fe640 1 -- 172.21.15.137:0/3783392324 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce90003d30 con 0x7fcea00d3820 2024-04-26T22:01:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea0161530 con 0x7fcea00d3820 2024-04-26T22:01:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fce877fe640 1 -- 172.21.15.137:0/3783392324 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9000aa90 con 0x7fcea00d3820 2024-04-26T22:01:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.277+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea0161af0 con 0x7fcea00d3820 2024-04-26T22:01:12.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.278+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea006a290 con 0x7fcea00d3820 2024-04-26T22:01:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.278+0000 7fce877fe640 1 -- 172.21.15.137:0/3783392324 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce9000ac30 con 0x7fcea00d3820 2024-04-26T22:01:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.279+0000 7fce877fe640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce8c06c8f0 0x7fce8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.279+0000 7fce877fe640 1 -- 172.21.15.137:0/3783392324 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fce9008b850 con 0x7fcea00d3820 2024-04-26T22:01:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.279+0000 7fce9e59c640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce8c06c8f0 0x7fce8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.279+0000 7fce9e59c640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce8c06c8f0 0x7fce8c06edb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcea0163c30 tx=0x7fce94007f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:12.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.283+0000 7fce877fe640 1 -- 172.21.15.137:0/3783392324 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcea015cd30 con 0x7fcea00d3820 2024-04-26T22:01:12.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.497+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcea015ec60 con 0x7fcea00d3820 2024-04-26T22:01:12.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.541+0000 7fce877fe640 1 -- 172.21.15.137:0/3783392324 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fce900596c0 con 0x7fcea00d3820 2024-04-26T22:01:12.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce8c06c8f0 msgr2=0x7fce8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce8c06c8f0 0x7fce8c06edb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcea0163c30 tx=0x7fce94007f00 comp rx=0 tx=0).stop 2024-04-26T22:01:12.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d3820 msgr2=0x7fcea015c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d3820 0x7fcea015c7f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fce9000c730 tx=0x7fce9000cbf0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 shutdown_connections 2024-04-26T22:01:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fce8c06c8f0 0x7fce8c06edb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcea015f680 0x7fcea00ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcea00d4f20 0x7fcea0160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 --2- 172.21.15.137:0/3783392324 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcea00d3820 0x7fcea015c7f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 >> 172.21.15.137:0/3783392324 conn(0x7fcea008eca0 msgr2=0x7fcea00d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 shutdown_connections 2024-04-26T22:01:12.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.543+0000 7fcea50bb640 1 -- 172.21.15.137:0/3783392324 wait complete. 2024-04-26T22:01:12.554 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T22:01:12.555 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T22:01:12.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.654+0000 7f89b452b640 1 Processor -- start 2024-04-26T22:01:12.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.654+0000 7f89b452b640 1 -- start start 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b452b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89ac15e7e0 0x7f89ac0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b452b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89ac161080 0x7f89ac1614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b452b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac0cdd40 con 0x7f89ac161cb0 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b452b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f89ac0d2280 con 0x7f89ac15e7e0 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b452b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac161a10 con 0x7f89ac161080 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b22c7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89ac15e7e0 0x7f89ac0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b1ac6640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f89ac161cb0 0x7f89ac0d1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32882/0 (socket says 172.21.15.137:32882) 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b1ac6640 1 -- 172.21.15.137:0/2489190866 learned_addr learned my addr 172.21.15.137:0/2489190866 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b22c7640 1 -- 172.21.15.137:0/2489190866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89ac161080 msgr2=0x7f89ac1614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b22c7640 1 --2- 172.21.15.137:0/2489190866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89ac161080 0x7f89ac1614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.655+0000 7f89b22c7640 1 -- 172.21.15.137:0/2489190866 >> v1:172.21.15.137:6789/0 conn(0x7f89ac161cb0 legacy=0x7f89ac0d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.656+0000 7f89b22c7640 1 -- 172.21.15.137:0/2489190866 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac0cdfe0 con 0x7f89ac15e7e0 2024-04-26T22:01:12.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.656+0000 7f89b12c5640 1 -- 172.21.15.137:0/2489190866 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961596595 0 0) 0x7f89ac0cdd40 con 0x7f89ac161cb0 2024-04-26T22:01:12.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.656+0000 7f89b22c7640 1 --2- 172.21.15.137:0/2489190866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac15e7e0 0x7f89ac0ceda0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f89a80097a0 tx=0x7f89a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d962d3d869144ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:12.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.656+0000 7f89b12c5640 1 -- 172.21.15.137:0/2489190866 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8037070 con 0x7f89ac15e7e0 2024-04-26T22:01:12.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.656+0000 7f89b12c5640 1 -- 172.21.15.137:0/2489190866 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a8032440 con 0x7f89ac15e7e0 2024-04-26T22:01:12.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.656+0000 7f89b12c5640 1 -- 172.21.15.137:0/2489190866 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a8032810 con 0x7f89ac15e7e0 2024-04-26T22:01:12.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.657+0000 7f89b452b640 1 -- 172.21.15.137:0/2489190866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac15e7e0 msgr2=0x7f89ac0ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.657+0000 7f89b452b640 1 --2- 172.21.15.137:0/2489190866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac15e7e0 0x7f89ac0ceda0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f89a80097a0 tx=0x7f89a802a180 comp rx=0 tx=0).stop 2024-04-26T22:01:12.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.657+0000 7f89b452b640 1 -- 172.21.15.137:0/2489190866 shutdown_connections 2024-04-26T22:01:12.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.657+0000 7f89b452b640 1 --2- 172.21.15.137:0/2489190866 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89ac161080 0x7f89ac1614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.657+0000 7f89b452b640 1 --2- 172.21.15.137:0/2489190866 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac15e7e0 0x7f89ac0ceda0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.657+0000 7f89b452b640 1 -- 172.21.15.137:0/2489190866 >> 172.21.15.137:0/2489190866 conn(0x7f89ac09ba40 msgr2=0x7f89ac09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:12.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.657+0000 7f89b452b640 1 -- 172.21.15.137:0/2489190866 shutdown_connections 2024-04-26T22:01:12.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.657+0000 7f89b452b640 1 -- 172.21.15.137:0/2489190866 wait complete. 2024-04-26T22:01:12.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.658+0000 7f89b452b640 1 Processor -- start 2024-04-26T22:01:12.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.658+0000 7f89b452b640 1 -- start start 2024-04-26T22:01:12.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b452b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89ac15e7e0 0x7f89ac0cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b452b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89ac161080 0x7f89ac0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b452b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac161cb0 0x7f89ac0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b452b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0ce880 con 0x7f89ac161cb0 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b452b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0ce5a0 con 0x7f89ac161080 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b452b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac0cf2e0 con 0x7f89ac15e7e0 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b2ac8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac161cb0 0x7f89ac0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b2ac8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac161cb0 0x7f89ac0c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34568/0 (socket says 172.21.15.137:34568) 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b2ac8640 1 -- 172.21.15.137:0/169471988 learned_addr learned my addr 172.21.15.137:0/169471988 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b22c7640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89ac15e7e0 0x7f89ac0cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b1ac6640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89ac161080 0x7f89ac0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b2ac8640 1 -- 172.21.15.137:0/169471988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89ac15e7e0 msgr2=0x7f89ac0cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b2ac8640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89ac15e7e0 0x7f89ac0cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b2ac8640 1 -- 172.21.15.137:0/169471988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89ac161080 msgr2=0x7f89ac0c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b2ac8640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89ac161080 0x7f89ac0c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b2ac8640 1 -- 172.21.15.137:0/169471988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac0c66c0 con 0x7f89ac161cb0 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b1ac6640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89ac161080 0x7f89ac0c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:12.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.659+0000 7f89b2ac8640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac161cb0 0x7f89ac0c8b00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f89a400b970 tx=0x7f89a400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.660+0000 7f89a2ffd640 1 -- 172.21.15.137:0/169471988 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4019070 con 0x7f89ac161cb0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.660+0000 7f89a2ffd640 1 -- 172.21.15.137:0/169471988 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a400cb60 con 0x7f89ac161cb0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.660+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac0c69a0 con 0x7f89ac161cb0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.660+0000 7f89a2ffd640 1 -- 172.21.15.137:0/169471988 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4014440 con 0x7f89ac161cb0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.660+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac0c6f60 con 0x7f89ac161cb0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.661+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ac074760 con 0x7f89ac161cb0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.661+0000 7f89a2ffd640 1 -- 172.21.15.137:0/169471988 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f89a401c070 con 0x7f89ac161cb0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.661+0000 7f89a2ffd640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.662+0000 7f89a2ffd640 1 -- 172.21.15.137:0/169471988 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f89a408b880 con 0x7f89ac161cb0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.662+0000 7f89b22c7640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:12.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.662+0000 7f89b22c7640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f89a8034000 tx=0x7f89a802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:12.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.666+0000 7f89a2ffd640 1 -- 172.21.15.137:0/169471988 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f89ac074760 con 0x7f89ac161cb0 2024-04-26T22:01:12.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:12.885+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f89ac06a290 con 0x7f89ac161cb0 2024-04-26T22:01:13.038 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:01:13.040 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:01:13.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.551+0000 7f89a2ffd640 1 -- 172.21.15.137:0/169471988 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f89a4059cb0 con 0x7f89ac161cb0 2024-04-26T22:01:13.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 msgr2=0x7f899006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:13.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f89a8034000 tx=0x7f89a802e000 comp rx=0 tx=0).stop 2024-04-26T22:01:13.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac161cb0 msgr2=0x7f89ac0c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac161cb0 0x7f89ac0c8b00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f89a400b970 tx=0x7f89a400be30 comp rx=0 tx=0).stop 2024-04-26T22:01:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 shutdown_connections 2024-04-26T22:01:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89ac161cb0 0x7f89ac0c8b00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89ac161080 0x7f89ac0c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 --2- 172.21.15.137:0/169471988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89ac15e7e0 0x7f89ac0cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 >> 172.21.15.137:0/169471988 conn(0x7f89ac09ba40 msgr2=0x7f89ac0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 shutdown_connections 2024-04-26T22:01:13.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.553+0000 7f89b452b640 1 -- 172.21.15.137:0/169471988 wait complete. 2024-04-26T22:01:13.565 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T22:01:13.566 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:01:13.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.664+0000 7f4743408640 1 Processor -- start 2024-04-26T22:01:13.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.665+0000 7f4743408640 1 -- start start 2024-04-26T22:01:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.665+0000 7f4743408640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f473c15f370 0x7f473c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.665+0000 7f4743408640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.665+0000 7f4743408640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473c0d03a0 con 0x7f473c15f750 2024-04-26T22:01:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.665+0000 7f4743408640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f473c0b4d10 con 0x7f473c15f370 2024-04-26T22:01:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.665+0000 7f4743408640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f473c0d0680 con 0x7f473c0d3ee0 2024-04-26T22:01:13.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47419a5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47411a4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f473c15f370 0x7f473c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47411a4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f473c15f370 0x7f473c0cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34492/0 (socket says 172.21.15.137:34492) 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47419a5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:52156/0 (socket says 172.21.15.137:52156) 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47409a3640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f473c15f750 0x7f473c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:36520/0 (socket says 172.21.15.137:36520) 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47411a4640 1 -- 172.21.15.137:0/3168409815 learned_addr learned my addr 172.21.15.137:0/3168409815 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47411a4640 1 -- 172.21.15.137:0/3168409815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 msgr2=0x7f473c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47411a4640 1 --2- 172.21.15.137:0/3168409815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47411a4640 1 -- 172.21.15.137:0/3168409815 >> v1:172.21.15.170:6789/0 conn(0x7f473c15f750 legacy=0x7f473c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47411a4640 1 -- 172.21.15.137:0/3168409815 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c0d0960 con 0x7f473c15f370 2024-04-26T22:01:13.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.666+0000 7f47419a5640 1 --2- 172.21.15.137:0/3168409815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.667+0000 7f47411a4640 1 --2- 172.21.15.137:0/3168409815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f473c15f370 0x7f473c0cfd70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4734009e50 tx=0x7f473402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1c0ca87e9619b5e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.667+0000 7f4733fff640 1 -- 172.21.15.137:0/3168409815 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734036070 con 0x7f473c15f370 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.667+0000 7f4733fff640 1 -- 172.21.15.137:0/3168409815 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4734031600 con 0x7f473c15f370 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.667+0000 7f4733fff640 1 -- 172.21.15.137:0/3168409815 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47340319d0 con 0x7f473c15f370 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.667+0000 7f4743408640 1 -- 172.21.15.137:0/3168409815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f473c15f370 msgr2=0x7f473c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.667+0000 7f4743408640 1 --2- 172.21.15.137:0/3168409815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f473c15f370 0x7f473c0cfd70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4734009e50 tx=0x7f473402a710 comp rx=0 tx=0).stop 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.668+0000 7f4743408640 1 -- 172.21.15.137:0/3168409815 shutdown_connections 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.668+0000 7f4743408640 1 --2- 172.21.15.137:0/3168409815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.668+0000 7f4743408640 1 --2- 172.21.15.137:0/3168409815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f473c15f370 0x7f473c0cfd70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.668+0000 7f4743408640 1 -- 172.21.15.137:0/3168409815 >> 172.21.15.137:0/3168409815 conn(0x7f473c08ec10 msgr2=0x7f473c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.668+0000 7f4743408640 1 -- 172.21.15.137:0/3168409815 shutdown_connections 2024-04-26T22:01:13.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.668+0000 7f4743408640 1 -- 172.21.15.137:0/3168409815 wait complete. 2024-04-26T22:01:13.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.669+0000 7f4743408640 1 Processor -- start 2024-04-26T22:01:13.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.669+0000 7f4743408640 1 -- start start 2024-04-26T22:01:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.669+0000 7f4743408640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c15d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:13.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.669+0000 7f4743408640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f473c15f370 0x7f473c0b9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.669+0000 7f4743408640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f473c15f750 0x7f473c0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.669+0000 7f4743408640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f473c0b51c0 con 0x7f473c15f750 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.669+0000 7f4743408640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f473c0d0f20 con 0x7f473c15f370 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.669+0000 7f4743408640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f473c0b5340 con 0x7f473c0d3ee0 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47419a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f473c15f750 0x7f473c0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47419a5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f473c15f750 0x7f473c0ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34584/0 (socket says 172.21.15.137:34584) 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47419a5640 1 -- 172.21.15.137:0/3723619213 learned_addr learned my addr 172.21.15.137:0/3723619213 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47411a4640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c15d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47409a3640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f473c15f370 0x7f473c0b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47419a5640 1 -- 172.21.15.137:0/3723619213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 msgr2=0x7f473c15d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47419a5640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c15d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47419a5640 1 -- 172.21.15.137:0/3723619213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f473c15f370 msgr2=0x7f473c0b9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47419a5640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f473c15f370 0x7f473c0b9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47419a5640 1 -- 172.21.15.137:0/3723619213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473c0c9e10 con 0x7f473c15f750 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f47419a5640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f473c15f750 0x7f473c0ca040 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f473800e930 tx=0x7f473800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f4731ffb640 1 -- 172.21.15.137:0/3723619213 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738017070 con 0x7f473c15f750 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f4731ffb640 1 -- 172.21.15.137:0/3723619213 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473800ca00 con 0x7f473c15f750 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473c0c9290 con 0x7f473c15f750 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.670+0000 7f4731ffb640 1 -- 172.21.15.137:0/3723619213 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473800cdd0 con 0x7f473c15f750 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.671+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473c0c9850 con 0x7f473c15f750 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.671+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f473c0d6160 con 0x7f473c15f750 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.672+0000 7f4731ffb640 1 -- 172.21.15.137:0/3723619213 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4738013470 con 0x7f473c15f750 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.672+0000 7f4731ffb640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472006c8f0 0x7f472006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.672+0000 7f4731ffb640 1 -- 172.21.15.137:0/3723619213 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f473808b9a0 con 0x7f473c15f750 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.672+0000 7f47411a4640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472006c8f0 0x7f472006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:13.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.673+0000 7f47411a4640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472006c8f0 0x7f472006edb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4734033000 tx=0x7f4734009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:13.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.676+0000 7f4731ffb640 1 -- 172.21.15.137:0/3723619213 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f473c0d6160 con 0x7f473c15f750 2024-04-26T22:01:13.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.886+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f473c06a290 con 0x7f473c15f750 2024-04-26T22:01:13.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.887+0000 7f4731ffb640 1 -- 172.21.15.137:0/3723619213 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5193 (secure 0 0 0) 0x7f47380597c0 con 0x7f473c15f750 2024-04-26T22:01:13.887 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:13.887 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:01:10.893739+0000","modified":"2024-04-26T22:01:12.886844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/4265926631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":4265926631},{"type":"v1","addr":"172.21.15.137:6837","nonce":4265926631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6060,"qdb_cluster":[6060]},"id":4}]} 2024-04-26T22:01:13.887 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 26 2024-04-26T22:01:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.888+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472006c8f0 msgr2=0x7f472006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.888+0000 7f4743408640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472006c8f0 0x7f472006edb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4734033000 tx=0x7f4734009000 comp rx=0 tx=0).stop 2024-04-26T22:01:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.888+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f473c15f750 msgr2=0x7f473c0ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.888+0000 7f4743408640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f473c15f750 0x7f473c0ca040 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f473800e930 tx=0x7f473800edf0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.889+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 shutdown_connections 2024-04-26T22:01:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.889+0000 7f4743408640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472006c8f0 0x7f472006edb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.889+0000 7f4743408640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f473c15f750 0x7f473c0ca040 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.889+0000 7f4743408640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f473c15f370 0x7f473c0b9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.889+0000 7f4743408640 1 --2- 172.21.15.137:0/3723619213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f473c0d3ee0 0x7f473c15d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.889+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 >> 172.21.15.137:0/3723619213 conn(0x7f473c08ec10 msgr2=0x7f473c0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.889+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 shutdown_connections 2024-04-26T22:01:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.889+0000 7f4743408640 1 -- 172.21.15.137:0/3723619213 wait complete. 2024-04-26T22:01:13.900 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:01:13.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.997+0000 7f8111df0640 1 Processor -- start 2024-04-26T22:01:13.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.997+0000 7f8111df0640 1 -- start start 2024-04-26T22:01:14.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.997+0000 7f8111df0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0d3ee0 0x7f810c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.997+0000 7f8111df0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f810c15f750 0x7f810c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f8111df0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f810c0d03a0 con 0x7f810c15f370 2024-04-26T22:01:14.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f8111df0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f810c0b4d10 con 0x7f810c15f750 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f8111df0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f810c0d0680 con 0x7f810c0d3ee0 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f810c15f370 0x7f810c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32886/0 (socket says 172.21.15.137:32886) 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810b7fe640 1 -- 172.21.15.137:0/1699896071 learned_addr learned my addr 172.21.15.137:0/1699896071 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f8103fff640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0d3ee0 0x7f810c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810bfff640 1 --2- 172.21.15.137:0/1699896071 >> v2:172.21.15.170:3300/0 conn(0x7f810c15f750 0x7f810c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144174108 0 0) 0x7f810c0d03a0 con 0x7f810c15f370 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80f8003520 con 0x7f810c15f370 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1115843787 0 0) 0x7f80f8003520 con 0x7f810c15f370 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0d3ee0 msgr2=0x7f810c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0d3ee0 0x7f810c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 >> v2:172.21.15.170:3300/0 conn(0x7f810c15f750 msgr2=0x7f810c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 --2- 172.21.15.137:0/1699896071 >> v2:172.21.15.170:3300/0 conn(0x7f810c15f750 0x7f810c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c0d0960 con 0x7f810c15f370 2024-04-26T22:01:14.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f80fc001670 con 0x7f810c15f370 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 >> v1:172.21.15.137:6789/0 conn(0x7f810c15f370 legacy=0x7f810c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f80f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0d3ee0 0x7f80f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80f8004d40 0x7f80f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0b4d10 con 0x7f80f80039b0 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0d0680 con 0x7f80f8004d40 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f80f800b9c0 con 0x7f810c0d3ee0 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810b7fe640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f80f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f8103fff640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0d3ee0 0x7f80f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.998+0000 7f810bfff640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80f8004d40 0x7f80f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.999+0000 7f810b7fe640 1 -- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0d3ee0 msgr2=0x7f80f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.999+0000 7f810b7fe640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0d3ee0 0x7f80f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.999+0000 7f810b7fe640 1 -- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80f8004d40 msgr2=0x7f80f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:14.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.999+0000 7f810b7fe640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80f8004d40 0x7f80f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.999+0000 7f810b7fe640 1 -- 172.21.15.137:0/1699896071 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f8003520 con 0x7f80f80039b0 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:13.999+0000 7f810b7fe640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f80f8003dd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f80fc007fd0 tx=0x7f80f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ccfb3dbfd1accf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc007d50 con 0x7f80f80039b0 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80fc005ad0 con 0x7f80f80039b0 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f810affd640 1 -- 172.21.15.137:0/1699896071 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc007070 con 0x7f80f80039b0 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f8111df0640 1 -- 172.21.15.137:0/1699896071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 msgr2=0x7f80f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f8111df0640 1 --2- 172.21.15.137:0/1699896071 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f80f8003dd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f80fc007fd0 tx=0x7f80f8005830 comp rx=0 tx=0).stop 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f810bfff640 1 -- 172.21.15.137:0/1699896071 reap_dead start 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f8111df0640 1 -- 172.21.15.137:0/1699896071 shutdown_connections 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f8111df0640 1 -- 172.21.15.137:0/1699896071 >> 172.21.15.137:0/1699896071 conn(0x7f810c08ec10 msgr2=0x7f810c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f8111df0640 1 -- 172.21.15.137:0/1699896071 shutdown_connections 2024-04-26T22:01:14.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.000+0000 7f8111df0640 1 -- 172.21.15.137:0/1699896071 wait complete. 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.001+0000 7f8111df0640 1 Processor -- start 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.001+0000 7f8111df0640 1 -- start start 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f8111df0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f810c0ba790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f8111df0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810c0cccd0 0x7f810c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f8111df0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0ce780 0x7f810c0cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f8111df0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0cfd70 con 0x7f80f80039b0 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f8111df0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0d0f20 con 0x7f810c0cccd0 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f8111df0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f810c0cfef0 con 0x7f810c0ce780 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f810b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f810c0ba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f810b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f810c0ba790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34600/0 (socket says 172.21.15.137:34600) 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f810b7fe640 1 -- 172.21.15.137:0/4112034840 learned_addr learned my addr 172.21.15.137:0/4112034840 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f8103fff640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810c0cccd0 0x7f810c0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f810bfff640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0ce780 0x7f810c0cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f810b7fe640 1 -- 172.21.15.137:0/4112034840 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0ce780 msgr2=0x7f810c0cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f810b7fe640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0ce780 0x7f810c0cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f810b7fe640 1 -- 172.21.15.137:0/4112034840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810c0cccd0 msgr2=0x7f810c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f810b7fe640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810c0cccd0 0x7f810c0b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.002+0000 7f810b7fe640 1 -- 172.21.15.137:0/4112034840 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c0b3690 con 0x7f80f80039b0 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.003+0000 7f810b7fe640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f810c0ba790 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00c300 tx=0x7f810c0d0b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.003+0000 7f8108ff9640 1 -- 172.21.15.137:0/4112034840 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc042020 con 0x7f80f80039b0 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.003+0000 7f8108ff9640 1 -- 172.21.15.137:0/4112034840 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80fc004bf0 con 0x7f80f80039b0 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.003+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810c0b3930 con 0x7f80f80039b0 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.003+0000 7f8108ff9640 1 -- 172.21.15.137:0/4112034840 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc007070 con 0x7f80f80039b0 2024-04-26T22:01:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.003+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810c0b3ef0 con 0x7f80f80039b0 2024-04-26T22:01:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.004+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f810c06a290 con 0x7f80f80039b0 2024-04-26T22:01:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.004+0000 7f8108ff9640 1 -- 172.21.15.137:0/4112034840 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80fc045020 con 0x7f80f80039b0 2024-04-26T22:01:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.005+0000 7f8108ff9640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80ec06c920 0x7f80ec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.005+0000 7f8103fff640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80ec06c920 0x7f80ec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.005+0000 7f8108ff9640 1 -- 172.21.15.137:0/4112034840 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f80fc0ac0b0 con 0x7f80f80039b0 2024-04-26T22:01:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.005+0000 7f8103fff640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80ec06c920 0x7f80ec06ede0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f810c0c97b0 tx=0x7f80f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.009+0000 7f8108ff9640 1 -- 172.21.15.137:0/4112034840 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f80fc07a4e0 con 0x7f80f80039b0 2024-04-26T22:01:14.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.187+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f810c0d5120 con 0x7f80f80039b0 2024-04-26T22:01:14.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.188+0000 7f8108ff9640 1 -- 172.21.15.137:0/4112034840 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16677 (secure 0 0 0) 0x7f80fc046e40 con 0x7f80f80039b0 2024-04-26T22:01:14.188 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:14.188 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:01:12.541348+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:01:09.101906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T22:01:09.837941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80ec06c920 msgr2=0x7f80ec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80ec06c920 0x7f80ec06ede0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f810c0c97b0 tx=0x7f80f4008040 comp rx=0 tx=0).stop 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 msgr2=0x7f810c0ba790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f810c0ba790 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00c300 tx=0x7f810c0d0b30 comp rx=0 tx=0).stop 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 shutdown_connections 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80ec06c920 0x7f80ec06ede0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f810c0ce780 0x7f810c0cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f810c0cccd0 0x7f810c0b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 --2- 172.21.15.137:0/4112034840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80f80039b0 0x7f810c0ba790 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 >> 172.21.15.137:0/4112034840 conn(0x7f810c08ec10 msgr2=0x7f810c0b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 shutdown_connections 2024-04-26T22:01:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.190+0000 7f8111df0640 1 -- 172.21.15.137:0/4112034840 wait complete. 2024-04-26T22:01:14.201 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T22:01:14.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:01:14.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.299+0000 7f13f8c85640 1 Processor -- start 2024-04-26T22:01:14.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.299+0000 7f13f8c85640 1 -- start start 2024-04-26T22:01:14.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.300+0000 7f13f8c85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f4145980 0x7f13f4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.300+0000 7f13f8c85640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f13f40b3de0 0x7f13f40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.300+0000 7f13f8c85640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13f40b4260 con 0x7f13f40b5fd0 2024-04-26T22:01:14.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.300+0000 7f13f8c85640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f13f40b6440 con 0x7f13f40b3de0 2024-04-26T22:01:14.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.300+0000 7f13f8c85640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f13f40b5140 con 0x7f13f4145980 2024-04-26T22:01:14.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.301+0000 7f13f259c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f4145980 0x7f13f4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.301+0000 7f13f259c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f4145980 0x7f13f4160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:52200/0 (socket says 172.21.15.137:52200) 2024-04-26T22:01:14.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.301+0000 7f13f259c640 1 -- 172.21.15.137:0/795352488 learned_addr learned my addr 172.21.15.137:0/795352488 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:14.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.301+0000 7f13f1d9b640 1 --2- 172.21.15.137:0/795352488 >> v2:172.21.15.170:3300/0 conn(0x7f13f40b3de0 0x7f13f40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.301+0000 7f13f259c640 1 -- 172.21.15.137:0/795352488 >> v2:172.21.15.170:3300/0 conn(0x7f13f40b3de0 msgr2=0x7f13f40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:14.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.301+0000 7f13f259c640 1 --2- 172.21.15.137:0/795352488 >> v2:172.21.15.170:3300/0 conn(0x7f13f40b3de0 0x7f13f40b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.301+0000 7f13f259c640 1 -- 172.21.15.137:0/795352488 >> v1:172.21.15.170:6789/0 conn(0x7f13f40b5fd0 legacy=0x7f13f415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.301+0000 7f13f259c640 1 -- 172.21.15.137:0/795352488 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f40b4530 con 0x7f13f4145980 2024-04-26T22:01:14.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.302+0000 7f13f259c640 1 --2- 172.21.15.137:0/795352488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f4145980 0x7f13f4160630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009870 tx=0x7f13e802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58a7d9f4050e3e11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.302+0000 7f13f159a640 1 -- 172.21.15.137:0/795352488 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8037070 con 0x7f13f4145980 2024-04-26T22:01:14.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.302+0000 7f13f159a640 1 -- 172.21.15.137:0/795352488 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e8032440 con 0x7f13f4145980 2024-04-26T22:01:14.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.302+0000 7f13f159a640 1 -- 172.21.15.137:0/795352488 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8032810 con 0x7f13f4145980 2024-04-26T22:01:14.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.302+0000 7f13f8c85640 1 -- 172.21.15.137:0/795352488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f4145980 msgr2=0x7f13f4160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.302+0000 7f13f8c85640 1 --2- 172.21.15.137:0/795352488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f4145980 0x7f13f4160630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009870 tx=0x7f13e802a1c0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.303+0000 7f13f8c85640 1 -- 172.21.15.137:0/795352488 shutdown_connections 2024-04-26T22:01:14.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.303+0000 7f13f8c85640 1 --2- 172.21.15.137:0/795352488 >> v2:172.21.15.170:3300/0 conn(0x7f13f40b3de0 0x7f13f40b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.303+0000 7f13f8c85640 1 --2- 172.21.15.137:0/795352488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f4145980 0x7f13f4160630 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.303+0000 7f13f8c85640 1 -- 172.21.15.137:0/795352488 >> 172.21.15.137:0/795352488 conn(0x7f13f40d0d30 msgr2=0x7f13f40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:14.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.303+0000 7f13f8c85640 1 -- 172.21.15.137:0/795352488 shutdown_connections 2024-04-26T22:01:14.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.303+0000 7f13f8c85640 1 -- 172.21.15.137:0/795352488 wait complete. 2024-04-26T22:01:14.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.304+0000 7f13f8c85640 1 Processor -- start 2024-04-26T22:01:14.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.304+0000 7f13f8c85640 1 -- start start 2024-04-26T22:01:14.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f8c85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f40b3de0 0x7f13f415cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f8c85640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13f40b5fd0 0x7f13f415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f8c85640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13f4145980 0x7f13f40cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f8c85640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f13f40b4dd0 con 0x7f13f40b5fd0 2024-04-26T22:01:14.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f8c85640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f13f40b4af0 con 0x7f13f4145980 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f8c85640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f13f40730e0 con 0x7f13f40b3de0 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f1d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13f40b5fd0 0x7f13f415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f1d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13f40b5fd0 0x7f13f415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34614/0 (socket says 172.21.15.137:34614) 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f1d9b640 1 -- 172.21.15.137:0/3526603567 learned_addr learned my addr 172.21.15.137:0/3526603567 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f259c640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f40b3de0 0x7f13f415cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f2d9d640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13f4145980 0x7f13f40cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f1d9b640 1 -- 172.21.15.137:0/3526603567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f40b3de0 msgr2=0x7f13f415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f1d9b640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f40b3de0 0x7f13f415cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f1d9b640 1 -- 172.21.15.137:0/3526603567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13f4145980 msgr2=0x7f13f40cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f1d9b640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13f4145980 0x7f13f40cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f1d9b640 1 -- 172.21.15.137:0/3526603567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f415d2d0 con 0x7f13f40b5fd0 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f1d9b640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13f40b5fd0 0x7f13f415b5e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f13e4010bc0 tx=0x7f13e400e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13e2ffd640 1 -- 172.21.15.137:0/3526603567 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e401e070 con 0x7f13f40b5fd0 2024-04-26T22:01:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13e2ffd640 1 -- 172.21.15.137:0/3526603567 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e4011650 con 0x7f13f40b5fd0 2024-04-26T22:01:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f40cd720 con 0x7f13f40b5fd0 2024-04-26T22:01:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13e2ffd640 1 -- 172.21.15.137:0/3526603567 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4011a40 con 0x7f13f40b5fd0 2024-04-26T22:01:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.305+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f415e090 con 0x7f13f40b5fd0 2024-04-26T22:01:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.306+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f406a290 con 0x7f13f40b5fd0 2024-04-26T22:01:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.307+0000 7f13e2ffd640 1 -- 172.21.15.137:0/3526603567 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13e4021070 con 0x7f13f40b5fd0 2024-04-26T22:01:14.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.307+0000 7f13e2ffd640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13d406c920 0x7f13d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.307+0000 7f13e2ffd640 1 -- 172.21.15.137:0/3526603567 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f13e408dcd0 con 0x7f13f40b5fd0 2024-04-26T22:01:14.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.307+0000 7f13f259c640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13d406c920 0x7f13d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.308+0000 7f13f259c640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13d406c920 0x7f13d406ede0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f13e8034000 tx=0x7f13e802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.312+0000 7f13e2ffd640 1 -- 172.21.15.137:0/3526603567 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f13e405bb40 con 0x7f13f40b5fd0 2024-04-26T22:01:14.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.483+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13f4073cc0 con 0x7f13d406c920 2024-04-26T22:01:14.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.488+0000 7f13e2ffd640 1 -- 172.21.15.137:0/3526603567 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238805 (secure 0 0 0) 0x7f13f4073cc0 con 0x7f13d406c920 2024-04-26T22:01:14.491 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:14.492 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:01:14.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13d406c920 msgr2=0x7f13d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13d406c920 0x7f13d406ede0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f13e8034000 tx=0x7f13e802e000 comp rx=0 tx=0).stop 2024-04-26T22:01:14.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13f40b5fd0 msgr2=0x7f13f415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13f40b5fd0 0x7f13f415b5e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f13e4010bc0 tx=0x7f13e400e730 comp rx=0 tx=0).stop 2024-04-26T22:01:14.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 shutdown_connections 2024-04-26T22:01:14.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f13d406c920 0x7f13d406ede0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f13f40b5fd0 0x7f13f415b5e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13f4145980 0x7f13f40cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 --2- 172.21.15.137:0/3526603567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f13f40b3de0 0x7f13f415cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 >> 172.21.15.137:0/3526603567 conn(0x7f13f40d0d30 msgr2=0x7f13f4143390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:14.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 shutdown_connections 2024-04-26T22:01:14.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.491+0000 7f13f8c85640 1 -- 172.21.15.137:0/3526603567 wait complete. 2024-04-26T22:01:14.502 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-04-26T22:01:12.724210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":22,"acting":22,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":239200,"kb_used_data":6364,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735520,"statfs":{"total":773094113280,"available":772849172480,"internally_reserved":0,"allocated":6516736,"data_stored":3366132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000623"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705849+0000","last_change":"2024-04-26T22:01:11.549050+0000","last_active":"2024-04-26T22:01:12.705849+0000","last_peered":"2024-04-26T22:01:12.705849+0000","last_clean":"2024-04-26T22:01:12.705849+0000","last_became_active":"2024-04-26T22:01:11.548782+0000","last_became_peered":"2024-04-26T22:01:11.548782+0000","last_unstale":"2024-04-26T22:01:12.705849+0000","last_undegraded":"2024-04-26T22:01:12.705849+0000","last_fullsized":"2024-04-26T22:01:12.705849+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:40.080159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.706225+0000","last_change":"2024-04-26T22:01:11.549388+0000","last_active":"2024-04-26T22:01:12.706225+0000","last_peered":"2024-04-26T22:01:12.706225+0000","last_clean":"2024-04-26T22:01:12.706225+0000","last_became_active":"2024-04-26T22:01:11.549129+0000","last_became_peered":"2024-04-26T22:01:11.549129+0000","last_unstale":"2024-04-26T22:01:12.706225+0000","last_undegraded":"2024-04-26T22:01:12.706225+0000","last_fullsized":"2024-04-26T22:01:12.706225+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:28.847892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.706185+0000","last_change":"2024-04-26T22:01:11.545829+0000","last_active":"2024-04-26T22:01:12.706185+0000","last_peered":"2024-04-26T22:01:12.706185+0000","last_clean":"2024-04-26T22:01:12.706185+0000","last_became_active":"2024-04-26T22:01:11.545102+0000","last_became_peered":"2024-04-26T22:01:11.545102+0000","last_unstale":"2024-04-26T22:01:12.706185+0000","last_undegraded":"2024-04-26T22:01:12.706185+0000","last_fullsized":"2024-04-26T22:01:12.706185+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:34.096236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705995+0000","last_change":"2024-04-26T22:01:11.551625+0000","last_active":"2024-04-26T22:01:12.705995+0000","last_peered":"2024-04-26T22:01:12.705995+0000","last_clean":"2024-04-26T22:01:12.705995+0000","last_became_active":"2024-04-26T22:01:11.551384+0000","last_became_peered":"2024-04-26T22:01:11.551384+0000","last_unstale":"2024-04-26T22:01:12.705995+0000","last_undegraded":"2024-04-26T22:01:12.705995+0000","last_fullsized":"2024-04-26T22:01:12.705995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:46.749405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705479+0000","last_change":"2024-04-26T22:01:10.550815+0000","last_active":"2024-04-26T22:01:12.705479+0000","last_peered":"2024-04-26T22:01:12.705479+0000","last_clean":"2024-04-26T22:01:12.705479+0000","last_became_active":"2024-04-26T22:01:10.550551+0000","last_became_peered":"2024-04-26T22:01:10.550551+0000","last_unstale":"2024-04-26T22:01:12.705479+0000","last_undegraded":"2024-04-26T22:01:12.705479+0000","last_fullsized":"2024-04-26T22:01:12.705479+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:17.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.706206+0000","last_change":"2024-04-26T22:01:10.549663+0000","last_active":"2024-04-26T22:01:12.706206+0000","last_peered":"2024-04-26T22:01:12.706206+0000","last_clean":"2024-04-26T22:01:12.706206+0000","last_became_active":"2024-04-26T22:01:10.549304+0000","last_became_peered":"2024-04-26T22:01:10.549304+0000","last_unstale":"2024-04-26T22:01:12.706206+0000","last_undegraded":"2024-04-26T22:01:12.706206+0000","last_fullsized":"2024-04-26T22:01:12.706206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:41:56.790585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.706002+0000","last_change":"2024-04-26T22:01:11.550740+0000","last_active":"2024-04-26T22:01:12.706002+0000","last_peered":"2024-04-26T22:01:12.706002+0000","last_clean":"2024-04-26T22:01:12.706002+0000","last_became_active":"2024-04-26T22:01:11.550487+0000","last_became_peered":"2024-04-26T22:01:11.550487+0000","last_unstale":"2024-04-26T22:01:12.706002+0000","last_undegraded":"2024-04-26T22:01:12.706002+0000","last_fullsized":"2024-04-26T22:01:12.706002+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:34.371095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705576+0000","last_change":"2024-04-26T22:01:10.546852+0000","last_active":"2024-04-26T22:01:12.705576+0000","last_peered":"2024-04-26T22:01:12.705576+0000","last_clean":"2024-04-26T22:01:12.705576+0000","last_became_active":"2024-04-26T22:01:10.546562+0000","last_became_peered":"2024-04-26T22:01:10.546562+0000","last_unstale":"2024-04-26T22:01:12.705576+0000","last_undegraded":"2024-04-26T22:01:12.705576+0000","last_fullsized":"2024-04-26T22:01:12.705576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:01.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704946+0000","last_change":"2024-04-26T22:01:11.549731+0000","last_active":"2024-04-26T22:01:12.704946+0000","last_peered":"2024-04-26T22:01:12.704946+0000","last_clean":"2024-04-26T22:01:12.704946+0000","last_became_active":"2024-04-26T22:01:11.549421+0000","last_became_peered":"2024-04-26T22:01:11.549421+0000","last_unstale":"2024-04-26T22:01:12.704946+0000","last_undegraded":"2024-04-26T22:01:12.704946+0000","last_fullsized":"2024-04-26T22:01:12.704946+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:46.300566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705184+0000","last_change":"2024-04-26T22:01:10.552983+0000","last_active":"2024-04-26T22:01:12.705184+0000","last_peered":"2024-04-26T22:01:12.705184+0000","last_clean":"2024-04-26T22:01:12.705184+0000","last_became_active":"2024-04-26T22:01:10.552699+0000","last_became_peered":"2024-04-26T22:01:10.552699+0000","last_unstale":"2024-04-26T22:01:12.705184+0000","last_undegraded":"2024-04-26T22:01:12.705184+0000","last_fullsized":"2024-04-26T22:01:12.705184+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:05.869606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:10.526811+0000","last_change":"2024-04-26T22:01:10.526811+0000","last_active":"2024-04-26T22:01:10.526811+0000","last_peered":"2024-04-26T22:01:10.526811+0000","last_clean":"2024-04-26T22:01:10.526811+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:10.526811+0000","last_undegraded":"2024-04-26T22:01:10.526811+0000","last_fullsized":"2024-04-26T22:01:10.526811+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:01:09.522595+0000","last_change":"2024-04-26T22:01:09.522595+0000","last_active":"2024-04-26T22:01:09.522595+0000","last_peered":"2024-04-26T22:01:09.522595+0000","last_clean":"2024-04-26T22:01:09.522595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:01:09.522595+0000","last_undegraded":"2024-04-26T22:01:09.522595+0000","last_fullsized":"2024-04-26T22:01:09.522595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":241,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-04-26T22:01:07.523217+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:01:07.523217+0000","last_peered":"2024-04-26T22:01:07.523217+0000","last_clean":"2024-04-26T22:01:07.523217+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:01:07.523217+0000","last_undegraded":"2024-04-26T22:01:07.523217+0000","last_fullsized":"2024-04-26T22:01:07.523217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1253376,"data_stored":860533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31828,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":659456,"data_stored":270165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31824,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":659456,"data_stored":270165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31832,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":659456,"data_stored":270165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":659456,"data_stored":270165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":270165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":712704,"data_stored":294241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28244,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343596,"statfs":{"total":96636764160,"available":96607842304,"internally_reserved":0,"allocated":1253376,"data_stored":860533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:01:14.507 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:01:14.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.642+0000 7f6531ba4640 1 Processor -- start 2024-04-26T22:01:14.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.643+0000 7f6531ba4640 1 -- start start 2024-04-26T22:01:14.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.643+0000 7f6531ba4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f652c15f750 0x7f652c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.643+0000 7f6531ba4640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c0d03a0 con 0x7f652c15f370 2024-04-26T22:01:14.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.643+0000 7f6531ba4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f652c0d0680 con 0x7f652c0d3ee0 2024-04-26T22:01:14.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.643+0000 7f6531ba4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f652c0d0960 con 0x7f652c15f750 2024-04-26T22:01:14.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.643+0000 7f652b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f652c15f370 0x7f652c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32898/0 (socket says 172.21.15.137:32898) 2024-04-26T22:01:14.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.643+0000 7f652b7fe640 1 -- 172.21.15.137:0/1983120829 learned_addr learned my addr 172.21.15.137:0/1983120829 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:14.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652bfff640 1 --2- 172.21.15.137:0/1983120829 >> v2:172.21.15.170:3300/0 conn(0x7f652c15f750 0x7f652c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155352038 0 0) 0x7f652c0d03a0 con 0x7f652c15f370 2024-04-26T22:01:14.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6514003520 con 0x7f652c15f370 2024-04-26T22:01:14.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1352792616 0 0) 0x7f6514003520 con 0x7f652c15f370 2024-04-26T22:01:14.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 >> v2:172.21.15.170:3300/0 conn(0x7f652c15f750 msgr2=0x7f652c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:14.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 --2- 172.21.15.137:0/1983120829 >> v2:172.21.15.170:3300/0 conn(0x7f652c15f750 0x7f652c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 >> v1:172.21.15.170:6789/0 conn(0x7f652c0d3ee0 legacy=0x7f652c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c0d0c40 con 0x7f652c15f370 2024-04-26T22:01:14.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f651c001670 con 0x7f652c15f370 2024-04-26T22:01:14.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 >> v1:172.21.15.137:6789/0 conn(0x7f652c15f370 legacy=0x7f652c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65140039b0 0x7f6514003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6514004800 0x7f6514004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f651400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f652c0d0960 con 0x7f65140051c0 2024-04-26T22:01:14.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f651400c060 con 0x7f65140039b0 2024-04-26T22:01:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f651400c260 con 0x7f6514004800 2024-04-26T22:01:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652bfff640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f651400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652b7fe640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65140039b0 0x7f6514003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652affd640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6514004800 0x7f6514004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652bfff640 1 -- 172.21.15.137:0/1983120829 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6514004800 msgr2=0x7f6514004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652bfff640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6514004800 0x7f6514004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652bfff640 1 -- 172.21.15.137:0/1983120829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65140039b0 msgr2=0x7f6514003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652bfff640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65140039b0 0x7f6514003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.644+0000 7f652bfff640 1 -- 172.21.15.137:0/1983120829 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6514003520 con 0x7f65140051c0 2024-04-26T22:01:14.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.645+0000 7f652bfff640 1 -- 172.21.15.137:0/1983120829 reap_dead start 2024-04-26T22:01:14.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.645+0000 7f652bfff640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f651400b9c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6524009fc0 tx=0x7f6514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fa8f5791c89495 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.645+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524035020 con 0x7f65140051c0 2024-04-26T22:01:14.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.645+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6524003b90 con 0x7f65140051c0 2024-04-26T22:01:14.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.645+0000 7f652a7fc640 1 -- 172.21.15.137:0/1983120829 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524009c10 con 0x7f65140051c0 2024-04-26T22:01:14.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.646+0000 7f6531ba4640 1 -- 172.21.15.137:0/1983120829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 msgr2=0x7f651400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.646+0000 7f6531ba4640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f651400b9c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6524009fc0 tx=0x7f6514005830 comp rx=0 tx=0).stop 2024-04-26T22:01:14.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.646+0000 7f6531ba4640 1 -- 172.21.15.137:0/1983120829 shutdown_connections 2024-04-26T22:01:14.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.646+0000 7f6531ba4640 1 --2- 172.21.15.137:0/1983120829 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f651400b9c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.646+0000 7f6531ba4640 1 -- 172.21.15.137:0/1983120829 >> 172.21.15.137:0/1983120829 conn(0x7f652c08ec10 msgr2=0x7f652c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:14.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.646+0000 7f6531ba4640 1 -- 172.21.15.137:0/1983120829 shutdown_connections 2024-04-26T22:01:14.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.646+0000 7f6531ba4640 1 -- 172.21.15.137:0/1983120829 wait complete. 2024-04-26T22:01:14.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.647+0000 7f6531ba4640 1 Processor -- start 2024-04-26T22:01:14.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.647+0000 7f6531ba4640 1 -- start start 2024-04-26T22:01:14.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6531ba4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f652c0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6531ba4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f652c14f1c0 0x7f652c151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6531ba4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f652c0ce930 0x7f652c14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6531ba4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f652c0cfef0 con 0x7f65140051c0 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6531ba4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f652c0cfd70 con 0x7f652c0ce930 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6531ba4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f652c0d0070 con 0x7f652c14f1c0 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f652c0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f652c0cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34622/0 (socket says 172.21.15.137:34622) 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652b7fe640 1 -- 172.21.15.137:0/2941519779 learned_addr learned my addr 172.21.15.137:0/2941519779 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652bfff640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f652c0ce930 0x7f652c14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652affd640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f652c14f1c0 0x7f652c151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652b7fe640 1 -- 172.21.15.137:0/2941519779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f652c14f1c0 msgr2=0x7f652c151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652b7fe640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f652c14f1c0 0x7f652c151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652b7fe640 1 -- 172.21.15.137:0/2941519779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f652c0ce930 msgr2=0x7f652c14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652b7fe640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f652c0ce930 0x7f652c14e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652b7fe640 1 -- 172.21.15.137:0/2941519779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652c0b8000 con 0x7f65140051c0 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652bfff640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f652c0ce930 0x7f652c14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f652b7fe640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f652c0cb670 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f651c007370 tx=0x7f651c007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6513fff640 1 -- 172.21.15.137:0/2941519779 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c01a070 con 0x7f65140051c0 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6513fff640 1 -- 172.21.15.137:0/2941519779 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651c00f940 con 0x7f65140051c0 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652c0cde50 con 0x7f65140051c0 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.648+0000 7f6513fff640 1 -- 172.21.15.137:0/2941519779 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651c00fd30 con 0x7f65140051c0 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.649+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f652c0ce410 con 0x7f65140051c0 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.649+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652c06e7f0 con 0x7f65140051c0 2024-04-26T22:01:14.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.650+0000 7f6513fff640 1 -- 172.21.15.137:0/2941519779 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f651c01d070 con 0x7f65140051c0 2024-04-26T22:01:14.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.650+0000 7f6513fff640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f651806c920 0x7f651806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.650+0000 7f6513fff640 1 -- 172.21.15.137:0/2941519779 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f651c08b4b0 con 0x7f65140051c0 2024-04-26T22:01:14.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.650+0000 7f652affd640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f651806c920 0x7f651806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.651+0000 7f652affd640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f651806c920 0x7f651806ede0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6520000c00 tx=0x7f6520009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.654+0000 7f6513fff640 1 -- 172.21.15.137:0/2941519779 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f652c06e7f0 con 0x7f65140051c0 2024-04-26T22:01:14.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.826+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f652c06a290 con 0x7f651806c920 2024-04-26T22:01:14.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.832+0000 7f6513fff640 1 -- 172.21.15.137:0/2941519779 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251953 (secure 0 0 0) 0x7f652c06a290 con 0x7f651806c920 2024-04-26T22:01:14.835 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:14.836 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:01:14.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f651806c920 msgr2=0x7f651806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f651806c920 0x7f651806ede0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6520000c00 tx=0x7f6520009040 comp rx=0 tx=0).stop 2024-04-26T22:01:14.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 msgr2=0x7f652c0cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f652c0cb670 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f651c007370 tx=0x7f651c007830 comp rx=0 tx=0).stop 2024-04-26T22:01:14.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 shutdown_connections 2024-04-26T22:01:14.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f651806c920 0x7f651806ede0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f652c0ce930 0x7f652c14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f652c14f1c0 0x7f652c151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 --2- 172.21.15.137:0/2941519779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65140051c0 0x7f652c0cb670 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 >> 172.21.15.137:0/2941519779 conn(0x7f652c08ec10 msgr2=0x7f652c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:14.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 shutdown_connections 2024-04-26T22:01:14.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.835+0000 7f6531ba4640 1 -- 172.21.15.137:0/2941519779 wait complete. 2024-04-26T22:01:14.846 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-26T22:01:14.724508+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243736,"kb_used_data":6772,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730984,"statfs":{"total":773094113280,"available":772844527616,"internally_reserved":0,"allocated":6934528,"data_stored":3545064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.197323"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704794+0000","last_change":"2024-04-26T22:01:11.551504+0000","last_active":"2024-04-26T22:01:12.704794+0000","last_peered":"2024-04-26T22:01:12.704794+0000","last_clean":"2024-04-26T22:01:12.704794+0000","last_became_active":"2024-04-26T22:01:11.551247+0000","last_became_peered":"2024-04-26T22:01:11.551247+0000","last_unstale":"2024-04-26T22:01:12.704794+0000","last_undegraded":"2024-04-26T22:01:12.704794+0000","last_fullsized":"2024-04-26T22:01:12.704794+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:55:45.549565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.703934+0000","last_change":"2024-04-26T22:01:11.558169+0000","last_active":"2024-04-26T22:01:12.703934+0000","last_peered":"2024-04-26T22:01:12.703934+0000","last_clean":"2024-04-26T22:01:12.703934+0000","last_became_active":"2024-04-26T22:01:11.557870+0000","last_became_peered":"2024-04-26T22:01:11.557870+0000","last_unstale":"2024-04-26T22:01:12.703934+0000","last_undegraded":"2024-04-26T22:01:12.703934+0000","last_fullsized":"2024-04-26T22:01:12.703934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:39:38.205228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550613+0000","last_change":"2024-04-26T22:01:11.553576+0000","last_active":"2024-04-26T22:01:12.550613+0000","last_peered":"2024-04-26T22:01:12.550613+0000","last_clean":"2024-04-26T22:01:12.550613+0000","last_became_active":"2024-04-26T22:01:11.553250+0000","last_became_peered":"2024-04-26T22:01:11.553250+0000","last_unstale":"2024-04-26T22:01:12.550613+0000","last_undegraded":"2024-04-26T22:01:12.550613+0000","last_fullsized":"2024-04-26T22:01:12.550613+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:22.193754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552781+0000","last_change":"2024-04-26T22:01:11.554257+0000","last_active":"2024-04-26T22:01:12.552781+0000","last_peered":"2024-04-26T22:01:12.552781+0000","last_clean":"2024-04-26T22:01:12.552781+0000","last_became_active":"2024-04-26T22:01:11.553973+0000","last_became_peered":"2024-04-26T22:01:11.553973+0000","last_unstale":"2024-04-26T22:01:12.552781+0000","last_undegraded":"2024-04-26T22:01:12.552781+0000","last_fullsized":"2024-04-26T22:01:12.552781+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:55.913611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704430+0000","last_change":"2024-04-26T22:01:11.550453+0000","last_active":"2024-04-26T22:01:12.704430+0000","last_peered":"2024-04-26T22:01:12.704430+0000","last_clean":"2024-04-26T22:01:12.704430+0000","last_became_active":"2024-04-26T22:01:11.550185+0000","last_became_peered":"2024-04-26T22:01:11.550185+0000","last_unstale":"2024-04-26T22:01:12.704430+0000","last_undegraded":"2024-04-26T22:01:12.704430+0000","last_fullsized":"2024-04-26T22:01:12.704430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:53:00.234313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.703829+0000","last_change":"2024-04-26T22:01:11.549700+0000","last_active":"2024-04-26T22:01:12.703829+0000","last_peered":"2024-04-26T22:01:12.703829+0000","last_clean":"2024-04-26T22:01:12.703829+0000","last_became_active":"2024-04-26T22:01:11.549444+0000","last_became_peered":"2024-04-26T22:01:11.549444+0000","last_unstale":"2024-04-26T22:01:12.703829+0000","last_undegraded":"2024-04-26T22:01:12.703829+0000","last_fullsized":"2024-04-26T22:01:12.703829+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:01.435819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550291+0000","last_change":"2024-04-26T22:01:11.550084+0000","last_active":"2024-04-26T22:01:12.550291+0000","last_peered":"2024-04-26T22:01:12.550291+0000","last_clean":"2024-04-26T22:01:12.550291+0000","last_became_active":"2024-04-26T22:01:11.549775+0000","last_became_peered":"2024-04-26T22:01:11.549775+0000","last_unstale":"2024-04-26T22:01:12.550291+0000","last_undegraded":"2024-04-26T22:01:12.550291+0000","last_fullsized":"2024-04-26T22:01:12.550291+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:16.724273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.703997+0000","last_change":"2024-04-26T22:01:11.555166+0000","last_active":"2024-04-26T22:01:12.703997+0000","last_peered":"2024-04-26T22:01:12.703997+0000","last_clean":"2024-04-26T22:01:12.703997+0000","last_became_active":"2024-04-26T22:01:11.554817+0000","last_became_peered":"2024-04-26T22:01:11.554817+0000","last_unstale":"2024-04-26T22:01:12.703997+0000","last_undegraded":"2024-04-26T22:01:12.703997+0000","last_fullsized":"2024-04-26T22:01:12.703997+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:24.868338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550759+0000","last_change":"2024-04-26T22:01:11.550997+0000","last_active":"2024-04-26T22:01:12.550759+0000","last_peered":"2024-04-26T22:01:12.550759+0000","last_clean":"2024-04-26T22:01:12.550759+0000","last_became_active":"2024-04-26T22:01:11.549225+0000","last_became_peered":"2024-04-26T22:01:11.549225+0000","last_unstale":"2024-04-26T22:01:12.550759+0000","last_undegraded":"2024-04-26T22:01:12.550759+0000","last_fullsized":"2024-04-26T22:01:12.550759+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:41.988015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705849+0000","last_change":"2024-04-26T22:01:11.549050+0000","last_active":"2024-04-26T22:01:12.705849+0000","last_peered":"2024-04-26T22:01:12.705849+0000","last_clean":"2024-04-26T22:01:12.705849+0000","last_became_active":"2024-04-26T22:01:11.548782+0000","last_became_peered":"2024-04-26T22:01:11.548782+0000","last_unstale":"2024-04-26T22:01:12.705849+0000","last_undegraded":"2024-04-26T22:01:12.705849+0000","last_fullsized":"2024-04-26T22:01:12.705849+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:40.080159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.706225+0000","last_change":"2024-04-26T22:01:11.549388+0000","last_active":"2024-04-26T22:01:12.706225+0000","last_peered":"2024-04-26T22:01:12.706225+0000","last_clean":"2024-04-26T22:01:12.706225+0000","last_became_active":"2024-04-26T22:01:11.549129+0000","last_became_peered":"2024-04-26T22:01:11.549129+0000","last_unstale":"2024-04-26T22:01:12.706225+0000","last_undegraded":"2024-04-26T22:01:12.706225+0000","last_fullsized":"2024-04-26T22:01:12.706225+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:28.847892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552860+0000","last_change":"2024-04-26T22:01:11.551577+0000","last_active":"2024-04-26T22:01:12.552860+0000","last_peered":"2024-04-26T22:01:12.552860+0000","last_clean":"2024-04-26T22:01:12.552860+0000","last_became_active":"2024-04-26T22:01:11.551154+0000","last_became_peered":"2024-04-26T22:01:11.551154+0000","last_unstale":"2024-04-26T22:01:12.552860+0000","last_undegraded":"2024-04-26T22:01:12.552860+0000","last_fullsized":"2024-04-26T22:01:12.552860+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:45.774633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704259+0000","last_change":"2024-04-26T22:01:11.557474+0000","last_active":"2024-04-26T22:01:12.704259+0000","last_peered":"2024-04-26T22:01:12.704259+0000","last_clean":"2024-04-26T22:01:12.704259+0000","last_became_active":"2024-04-26T22:01:11.557166+0000","last_became_peered":"2024-04-26T22:01:11.557166+0000","last_unstale":"2024-04-26T22:01:12.704259+0000","last_undegraded":"2024-04-26T22:01:12.704259+0000","last_fullsized":"2024-04-26T22:01:12.704259+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:46.749405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551424+0000","last_change":"2024-04-26T22:01:11.546691+0000","last_active":"2024-04-26T22:01:12.551424+0000","last_peered":"2024-04-26T22:01:12.551424+0000","last_clean":"2024-04-26T22:01:12.551424+0000","last_became_active":"2024-04-26T22:01:11.545458+0000","last_became_peered":"2024-04-26T22:01:11.545458+0000","last_unstale":"2024-04-26T22:01:12.551424+0000","last_undegraded":"2024-04-26T22:01:12.551424+0000","last_fullsized":"2024-04-26T22:01:12.551424+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:56.302996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550527+0000","last_change":"2024-04-26T22:01:11.548553+0000","last_active":"2024-04-26T22:01:12.550527+0000","last_peered":"2024-04-26T22:01:12.550527+0000","last_clean":"2024-04-26T22:01:12.550527+0000","last_became_active":"2024-04-26T22:01:11.548228+0000","last_became_peered":"2024-04-26T22:01:11.548228+0000","last_unstale":"2024-04-26T22:01:12.550527+0000","last_undegraded":"2024-04-26T22:01:12.550527+0000","last_fullsized":"2024-04-26T22:01:12.550527+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:21.280222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.703716+0000","last_change":"2024-04-26T22:01:11.550798+0000","last_active":"2024-04-26T22:01:12.703716+0000","last_peered":"2024-04-26T22:01:12.703716+0000","last_clean":"2024-04-26T22:01:12.703716+0000","last_became_active":"2024-04-26T22:01:11.550508+0000","last_became_peered":"2024-04-26T22:01:11.550508+0000","last_unstale":"2024-04-26T22:01:12.703716+0000","last_undegraded":"2024-04-26T22:01:12.703716+0000","last_fullsized":"2024-04-26T22:01:12.703716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:15.345613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704285+0000","last_change":"2024-04-26T22:01:11.548772+0000","last_active":"2024-04-26T22:01:12.704285+0000","last_peered":"2024-04-26T22:01:12.704285+0000","last_clean":"2024-04-26T22:01:12.704285+0000","last_became_active":"2024-04-26T22:01:11.548504+0000","last_became_peered":"2024-04-26T22:01:11.548504+0000","last_unstale":"2024-04-26T22:01:12.704285+0000","last_undegraded":"2024-04-26T22:01:12.704285+0000","last_fullsized":"2024-04-26T22:01:12.704285+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:10.644503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551385+0000","last_change":"2024-04-26T22:01:11.562143+0000","last_active":"2024-04-26T22:01:12.551385+0000","last_peered":"2024-04-26T22:01:12.551385+0000","last_clean":"2024-04-26T22:01:12.551385+0000","last_became_active":"2024-04-26T22:01:11.561850+0000","last_became_peered":"2024-04-26T22:01:11.561850+0000","last_unstale":"2024-04-26T22:01:12.551385+0000","last_undegraded":"2024-04-26T22:01:12.551385+0000","last_fullsized":"2024-04-26T22:01:12.551385+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:01.435819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705304+0000","last_change":"2024-04-26T22:01:11.552564+0000","last_active":"2024-04-26T22:01:12.705304+0000","last_peered":"2024-04-26T22:01:12.705304+0000","last_clean":"2024-04-26T22:01:12.705304+0000","last_became_active":"2024-04-26T22:01:11.552299+0000","last_became_peered":"2024-04-26T22:01:11.552299+0000","last_unstale":"2024-04-26T22:01:12.705304+0000","last_undegraded":"2024-04-26T22:01:12.705304+0000","last_fullsized":"2024-04-26T22:01:12.705304+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:33.351140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.703836+0000","last_change":"2024-04-26T22:01:11.563178+0000","last_active":"2024-04-26T22:01:12.703836+0000","last_peered":"2024-04-26T22:01:12.703836+0000","last_clean":"2024-04-26T22:01:12.703836+0000","last_became_active":"2024-04-26T22:01:11.562931+0000","last_became_peered":"2024-04-26T22:01:11.562931+0000","last_unstale":"2024-04-26T22:01:12.703836+0000","last_undegraded":"2024-04-26T22:01:12.703836+0000","last_fullsized":"2024-04-26T22:01:12.703836+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:12:38.296837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550446+0000","last_change":"2024-04-26T22:01:11.547744+0000","last_active":"2024-04-26T22:01:12.550446+0000","last_peered":"2024-04-26T22:01:12.550446+0000","last_clean":"2024-04-26T22:01:12.550446+0000","last_became_active":"2024-04-26T22:01:11.547399+0000","last_became_peered":"2024-04-26T22:01:11.547399+0000","last_unstale":"2024-04-26T22:01:12.550446+0000","last_undegraded":"2024-04-26T22:01:12.550446+0000","last_fullsized":"2024-04-26T22:01:12.550446+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:25.846743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704175+0000","last_change":"2024-04-26T22:01:11.554514+0000","last_active":"2024-04-26T22:01:12.704175+0000","last_peered":"2024-04-26T22:01:12.704175+0000","last_clean":"2024-04-26T22:01:12.704175+0000","last_became_active":"2024-04-26T22:01:11.554175+0000","last_became_peered":"2024-04-26T22:01:11.554175+0000","last_unstale":"2024-04-26T22:01:12.704175+0000","last_undegraded":"2024-04-26T22:01:12.704175+0000","last_fullsized":"2024-04-26T22:01:12.704175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:09.758041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550904+0000","last_change":"2024-04-26T22:01:11.554948+0000","last_active":"2024-04-26T22:01:12.550904+0000","last_peered":"2024-04-26T22:01:12.550904+0000","last_clean":"2024-04-26T22:01:12.550904+0000","last_became_active":"2024-04-26T22:01:11.554560+0000","last_became_peered":"2024-04-26T22:01:11.554560+0000","last_unstale":"2024-04-26T22:01:12.550904+0000","last_undegraded":"2024-04-26T22:01:12.550904+0000","last_fullsized":"2024-04-26T22:01:12.550904+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:22.317600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704217+0000","last_change":"2024-04-26T22:01:11.560421+0000","last_active":"2024-04-26T22:01:12.704217+0000","last_peered":"2024-04-26T22:01:12.704217+0000","last_clean":"2024-04-26T22:01:12.704217+0000","last_became_active":"2024-04-26T22:01:11.560132+0000","last_became_peered":"2024-04-26T22:01:11.560132+0000","last_unstale":"2024-04-26T22:01:12.704217+0000","last_undegraded":"2024-04-26T22:01:12.704217+0000","last_fullsized":"2024-04-26T22:01:12.704217+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:46.300566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704995+0000","last_change":"2024-04-26T22:01:11.544443+0000","last_active":"2024-04-26T22:01:12.704995+0000","last_peered":"2024-04-26T22:01:12.704995+0000","last_clean":"2024-04-26T22:01:12.704995+0000","last_became_active":"2024-04-26T22:01:11.544183+0000","last_became_peered":"2024-04-26T22:01:11.544183+0000","last_unstale":"2024-04-26T22:01:12.704995+0000","last_undegraded":"2024-04-26T22:01:12.704995+0000","last_fullsized":"2024-04-26T22:01:12.704995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:55:57.223731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552960+0000","last_change":"2024-04-26T22:01:11.551340+0000","last_active":"2024-04-26T22:01:12.552960+0000","last_peered":"2024-04-26T22:01:12.552960+0000","last_clean":"2024-04-26T22:01:12.552960+0000","last_became_active":"2024-04-26T22:01:11.551052+0000","last_became_peered":"2024-04-26T22:01:11.551052+0000","last_unstale":"2024-04-26T22:01:12.552960+0000","last_undegraded":"2024-04-26T22:01:12.552960+0000","last_fullsized":"2024-04-26T22:01:12.552960+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:43.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704756+0000","last_change":"2024-04-26T22:01:11.559392+0000","last_active":"2024-04-26T22:01:12.704756+0000","last_peered":"2024-04-26T22:01:12.704756+0000","last_clean":"2024-04-26T22:01:12.704756+0000","last_became_active":"2024-04-26T22:01:11.556773+0000","last_became_peered":"2024-04-26T22:01:11.556773+0000","last_unstale":"2024-04-26T22:01:12.704756+0000","last_undegraded":"2024-04-26T22:01:12.704756+0000","last_fullsized":"2024-04-26T22:01:12.704756+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:28.224327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704650+0000","last_change":"2024-04-26T22:01:11.551111+0000","last_active":"2024-04-26T22:01:12.704650+0000","last_peered":"2024-04-26T22:01:12.704650+0000","last_clean":"2024-04-26T22:01:12.704650+0000","last_became_active":"2024-04-26T22:01:11.550831+0000","last_became_peered":"2024-04-26T22:01:11.550831+0000","last_unstale":"2024-04-26T22:01:12.704650+0000","last_undegraded":"2024-04-26T22:01:12.704650+0000","last_fullsized":"2024-04-26T22:01:12.704650+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:19.113691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705087+0000","last_change":"2024-04-26T22:01:11.549454+0000","last_active":"2024-04-26T22:01:12.705087+0000","last_peered":"2024-04-26T22:01:12.705087+0000","last_clean":"2024-04-26T22:01:12.705087+0000","last_became_active":"2024-04-26T22:01:11.549184+0000","last_became_peered":"2024-04-26T22:01:11.549184+0000","last_unstale":"2024-04-26T22:01:12.705087+0000","last_undegraded":"2024-04-26T22:01:12.705087+0000","last_fullsized":"2024-04-26T22:01:12.705087+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:54.903039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550536+0000","last_change":"2024-04-26T22:01:11.553784+0000","last_active":"2024-04-26T22:01:12.550536+0000","last_peered":"2024-04-26T22:01:12.550536+0000","last_clean":"2024-04-26T22:01:12.550536+0000","last_became_active":"2024-04-26T22:01:11.553494+0000","last_became_peered":"2024-04-26T22:01:11.553494+0000","last_unstale":"2024-04-26T22:01:12.550536+0000","last_undegraded":"2024-04-26T22:01:12.550536+0000","last_fullsized":"2024-04-26T22:01:12.550536+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:55.913611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.703651+0000","last_change":"2024-04-26T22:01:11.543779+0000","last_active":"2024-04-26T22:01:12.703651+0000","last_peered":"2024-04-26T22:01:12.703651+0000","last_clean":"2024-04-26T22:01:12.703651+0000","last_became_active":"2024-04-26T22:01:11.543489+0000","last_became_peered":"2024-04-26T22:01:11.543489+0000","last_unstale":"2024-04-26T22:01:12.703651+0000","last_undegraded":"2024-04-26T22:01:12.703651+0000","last_fullsized":"2024-04-26T22:01:12.703651+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:34.169758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.703854+0000","last_change":"2024-04-26T22:01:11.550144+0000","last_active":"2024-04-26T22:01:12.703854+0000","last_peered":"2024-04-26T22:01:12.703854+0000","last_clean":"2024-04-26T22:01:12.703854+0000","last_became_active":"2024-04-26T22:01:11.549878+0000","last_became_peered":"2024-04-26T22:01:11.549878+0000","last_unstale":"2024-04-26T22:01:12.703854+0000","last_undegraded":"2024-04-26T22:01:12.703854+0000","last_fullsized":"2024-04-26T22:01:12.703854+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:52.001754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705286+0000","last_change":"2024-04-26T22:01:11.560233+0000","last_active":"2024-04-26T22:01:12.705286+0000","last_peered":"2024-04-26T22:01:12.705286+0000","last_clean":"2024-04-26T22:01:12.705286+0000","last_became_active":"2024-04-26T22:01:11.559997+0000","last_became_peered":"2024-04-26T22:01:11.559997+0000","last_unstale":"2024-04-26T22:01:12.705286+0000","last_undegraded":"2024-04-26T22:01:12.705286+0000","last_fullsized":"2024-04-26T22:01:12.705286+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:23.089333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704158+0000","last_change":"2024-04-26T22:01:10.547317+0000","last_active":"2024-04-26T22:01:12.704158+0000","last_peered":"2024-04-26T22:01:12.704158+0000","last_clean":"2024-04-26T22:01:12.704158+0000","last_became_active":"2024-04-26T22:01:10.546559+0000","last_became_peered":"2024-04-26T22:01:10.546559+0000","last_unstale":"2024-04-26T22:01:12.704158+0000","last_undegraded":"2024-04-26T22:01:12.704158+0000","last_fullsized":"2024-04-26T22:01:12.704158+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:40.983799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.706185+0000","last_change":"2024-04-26T22:01:11.545829+0000","last_active":"2024-04-26T22:01:12.706185+0000","last_peered":"2024-04-26T22:01:12.706185+0000","last_clean":"2024-04-26T22:01:12.706185+0000","last_became_active":"2024-04-26T22:01:11.545102+0000","last_became_peered":"2024-04-26T22:01:11.545102+0000","last_unstale":"2024-04-26T22:01:12.706185+0000","last_undegraded":"2024-04-26T22:01:12.706185+0000","last_fullsized":"2024-04-26T22:01:12.706185+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:34.096236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704460+0000","last_change":"2024-04-26T22:01:10.543121+0000","last_active":"2024-04-26T22:01:12.704460+0000","last_peered":"2024-04-26T22:01:12.704460+0000","last_clean":"2024-04-26T22:01:12.704460+0000","last_became_active":"2024-04-26T22:01:10.542829+0000","last_became_peered":"2024-04-26T22:01:10.542829+0000","last_unstale":"2024-04-26T22:01:12.704460+0000","last_undegraded":"2024-04-26T22:01:12.704460+0000","last_fullsized":"2024-04-26T22:01:12.704460+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:21.189538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704800+0000","last_change":"2024-04-26T22:01:11.553166+0000","last_active":"2024-04-26T22:01:12.704800+0000","last_peered":"2024-04-26T22:01:12.704800+0000","last_clean":"2024-04-26T22:01:12.704800+0000","last_became_active":"2024-04-26T22:01:11.552902+0000","last_became_peered":"2024-04-26T22:01:11.552902+0000","last_unstale":"2024-04-26T22:01:12.704800+0000","last_undegraded":"2024-04-26T22:01:12.704800+0000","last_fullsized":"2024-04-26T22:01:12.704800+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:02:14.963632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705109+0000","last_change":"2024-04-26T22:01:10.547762+0000","last_active":"2024-04-26T22:01:12.705109+0000","last_peered":"2024-04-26T22:01:12.705109+0000","last_clean":"2024-04-26T22:01:12.705109+0000","last_became_active":"2024-04-26T22:01:10.547450+0000","last_became_peered":"2024-04-26T22:01:10.547450+0000","last_unstale":"2024-04-26T22:01:12.705109+0000","last_undegraded":"2024-04-26T22:01:12.705109+0000","last_fullsized":"2024-04-26T22:01:12.705109+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:24.306917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704883+0000","last_change":"2024-04-26T22:01:11.557152+0000","last_active":"2024-04-26T22:01:12.704883+0000","last_peered":"2024-04-26T22:01:12.704883+0000","last_clean":"2024-04-26T22:01:12.704883+0000","last_became_active":"2024-04-26T22:01:11.556464+0000","last_became_peered":"2024-04-26T22:01:11.556464+0000","last_unstale":"2024-04-26T22:01:12.704883+0000","last_undegraded":"2024-04-26T22:01:12.704883+0000","last_fullsized":"2024-04-26T22:01:12.704883+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:54.558612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552932+0000","last_change":"2024-04-26T22:01:10.545857+0000","last_active":"2024-04-26T22:01:12.552932+0000","last_peered":"2024-04-26T22:01:12.552932+0000","last_clean":"2024-04-26T22:01:12.552932+0000","last_became_active":"2024-04-26T22:01:10.545539+0000","last_became_peered":"2024-04-26T22:01:10.545539+0000","last_unstale":"2024-04-26T22:01:12.552932+0000","last_undegraded":"2024-04-26T22:01:12.552932+0000","last_fullsized":"2024-04-26T22:01:12.552932+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:17.648276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704333+0000","last_change":"2024-04-26T22:01:11.554986+0000","last_active":"2024-04-26T22:01:12.704333+0000","last_peered":"2024-04-26T22:01:12.704333+0000","last_clean":"2024-04-26T22:01:12.704333+0000","last_became_active":"2024-04-26T22:01:11.554708+0000","last_became_peered":"2024-04-26T22:01:11.554708+0000","last_unstale":"2024-04-26T22:01:12.704333+0000","last_undegraded":"2024-04-26T22:01:12.704333+0000","last_fullsized":"2024-04-26T22:01:12.704333+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:26:27.916144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550415+0000","last_change":"2024-04-26T22:01:10.550667+0000","last_active":"2024-04-26T22:01:12.550415+0000","last_peered":"2024-04-26T22:01:12.550415+0000","last_clean":"2024-04-26T22:01:12.550415+0000","last_became_active":"2024-04-26T22:01:10.550338+0000","last_became_peered":"2024-04-26T22:01:10.550338+0000","last_unstale":"2024-04-26T22:01:12.550415+0000","last_undegraded":"2024-04-26T22:01:12.550415+0000","last_fullsized":"2024-04-26T22:01:12.550415+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:33.366879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704989+0000","last_change":"2024-04-26T22:01:11.560783+0000","last_active":"2024-04-26T22:01:12.704989+0000","last_peered":"2024-04-26T22:01:12.704989+0000","last_clean":"2024-04-26T22:01:12.704989+0000","last_became_active":"2024-04-26T22:01:11.560456+0000","last_became_peered":"2024-04-26T22:01:11.560456+0000","last_unstale":"2024-04-26T22:01:12.704989+0000","last_undegraded":"2024-04-26T22:01:12.704989+0000","last_fullsized":"2024-04-26T22:01:12.704989+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:26:29.102133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.703925+0000","last_change":"2024-04-26T22:01:10.547414+0000","last_active":"2024-04-26T22:01:12.703925+0000","last_peered":"2024-04-26T22:01:12.703925+0000","last_clean":"2024-04-26T22:01:12.703925+0000","last_became_active":"2024-04-26T22:01:10.547121+0000","last_became_peered":"2024-04-26T22:01:10.547121+0000","last_unstale":"2024-04-26T22:01:12.703925+0000","last_undegraded":"2024-04-26T22:01:12.703925+0000","last_fullsized":"2024-04-26T22:01:12.703925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:20.276006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704243+0000","last_change":"2024-04-26T22:01:11.547460+0000","last_active":"2024-04-26T22:01:12.704243+0000","last_peered":"2024-04-26T22:01:12.704243+0000","last_clean":"2024-04-26T22:01:12.704243+0000","last_became_active":"2024-04-26T22:01:11.547184+0000","last_became_peered":"2024-04-26T22:01:11.547184+0000","last_unstale":"2024-04-26T22:01:12.704243+0000","last_undegraded":"2024-04-26T22:01:12.704243+0000","last_fullsized":"2024-04-26T22:01:12.704243+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:40.080159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552398+0000","last_change":"2024-04-26T22:01:10.548673+0000","last_active":"2024-04-26T22:01:12.552398+0000","last_peered":"2024-04-26T22:01:12.552398+0000","last_clean":"2024-04-26T22:01:12.552398+0000","last_became_active":"2024-04-26T22:01:10.548170+0000","last_became_peered":"2024-04-26T22:01:10.548170+0000","last_unstale":"2024-04-26T22:01:12.552398+0000","last_undegraded":"2024-04-26T22:01:12.552398+0000","last_fullsized":"2024-04-26T22:01:12.552398+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:03:19.520343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704441+0000","last_change":"2024-04-26T22:01:11.552856+0000","last_active":"2024-04-26T22:01:12.704441+0000","last_peered":"2024-04-26T22:01:12.704441+0000","last_clean":"2024-04-26T22:01:12.704441+0000","last_became_active":"2024-04-26T22:01:11.552544+0000","last_became_peered":"2024-04-26T22:01:11.552544+0000","last_unstale":"2024-04-26T22:01:12.704441+0000","last_undegraded":"2024-04-26T22:01:12.704441+0000","last_fullsized":"2024-04-26T22:01:12.704441+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:30.598200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550262+0000","last_change":"2024-04-26T22:01:10.553946+0000","last_active":"2024-04-26T22:01:12.550262+0000","last_peered":"2024-04-26T22:01:12.550262+0000","last_clean":"2024-04-26T22:01:12.550262+0000","last_became_active":"2024-04-26T22:01:10.553607+0000","last_became_peered":"2024-04-26T22:01:10.553607+0000","last_unstale":"2024-04-26T22:01:12.550262+0000","last_undegraded":"2024-04-26T22:01:12.550262+0000","last_fullsized":"2024-04-26T22:01:12.550262+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:39.075943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551181+0000","last_change":"2024-04-26T22:01:11.541425+0000","last_active":"2024-04-26T22:01:12.551181+0000","last_peered":"2024-04-26T22:01:12.551181+0000","last_clean":"2024-04-26T22:01:12.551181+0000","last_became_active":"2024-04-26T22:01:11.541161+0000","last_became_peered":"2024-04-26T22:01:11.541161+0000","last_unstale":"2024-04-26T22:01:12.551181+0000","last_undegraded":"2024-04-26T22:01:12.551181+0000","last_fullsized":"2024-04-26T22:01:12.551181+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:32:25.311133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551940+0000","last_change":"2024-04-26T22:01:10.548195+0000","last_active":"2024-04-26T22:01:12.551940+0000","last_peered":"2024-04-26T22:01:12.551940+0000","last_clean":"2024-04-26T22:01:12.551940+0000","last_became_active":"2024-04-26T22:01:10.547906+0000","last_became_peered":"2024-04-26T22:01:10.547906+0000","last_unstale":"2024-04-26T22:01:12.551940+0000","last_undegraded":"2024-04-26T22:01:12.551940+0000","last_fullsized":"2024-04-26T22:01:12.551940+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:27.843676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551861+0000","last_change":"2024-04-26T22:01:11.546211+0000","last_active":"2024-04-26T22:01:12.551861+0000","last_peered":"2024-04-26T22:01:12.551861+0000","last_clean":"2024-04-26T22:01:12.551861+0000","last_became_active":"2024-04-26T22:01:11.543610+0000","last_became_peered":"2024-04-26T22:01:11.543610+0000","last_unstale":"2024-04-26T22:01:12.551861+0000","last_undegraded":"2024-04-26T22:01:12.551861+0000","last_fullsized":"2024-04-26T22:01:12.551861+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:51.119348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704559+0000","last_change":"2024-04-26T22:01:10.552863+0000","last_active":"2024-04-26T22:01:12.704559+0000","last_peered":"2024-04-26T22:01:12.704559+0000","last_clean":"2024-04-26T22:01:12.704559+0000","last_became_active":"2024-04-26T22:01:10.552381+0000","last_became_peered":"2024-04-26T22:01:10.552381+0000","last_unstale":"2024-04-26T22:01:12.704559+0000","last_undegraded":"2024-04-26T22:01:12.704559+0000","last_fullsized":"2024-04-26T22:01:12.704559+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:42.177365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705995+0000","last_change":"2024-04-26T22:01:11.551625+0000","last_active":"2024-04-26T22:01:12.705995+0000","last_peered":"2024-04-26T22:01:12.705995+0000","last_clean":"2024-04-26T22:01:12.705995+0000","last_became_active":"2024-04-26T22:01:11.551384+0000","last_became_peered":"2024-04-26T22:01:11.551384+0000","last_unstale":"2024-04-26T22:01:12.705995+0000","last_undegraded":"2024-04-26T22:01:12.705995+0000","last_fullsized":"2024-04-26T22:01:12.705995+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:46.749405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551042+0000","last_change":"2024-04-26T22:01:10.547878+0000","last_active":"2024-04-26T22:01:12.551042+0000","last_peered":"2024-04-26T22:01:12.551042+0000","last_clean":"2024-04-26T22:01:12.551042+0000","last_became_active":"2024-04-26T22:01:10.547582+0000","last_became_peered":"2024-04-26T22:01:10.547582+0000","last_unstale":"2024-04-26T22:01:12.551042+0000","last_undegraded":"2024-04-26T22:01:12.551042+0000","last_fullsized":"2024-04-26T22:01:12.551042+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:33.092020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550782+0000","last_change":"2024-04-26T22:01:11.545270+0000","last_active":"2024-04-26T22:01:12.550782+0000","last_peered":"2024-04-26T22:01:12.550782+0000","last_clean":"2024-04-26T22:01:12.550782+0000","last_became_active":"2024-04-26T22:01:11.544992+0000","last_became_peered":"2024-04-26T22:01:11.544992+0000","last_unstale":"2024-04-26T22:01:12.550782+0000","last_undegraded":"2024-04-26T22:01:12.550782+0000","last_fullsized":"2024-04-26T22:01:12.550782+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:32.356492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551178+0000","last_change":"2024-04-26T22:01:10.551558+0000","last_active":"2024-04-26T22:01:12.551178+0000","last_peered":"2024-04-26T22:01:12.551178+0000","last_clean":"2024-04-26T22:01:12.551178+0000","last_became_active":"2024-04-26T22:01:10.551276+0000","last_became_peered":"2024-04-26T22:01:10.551276+0000","last_unstale":"2024-04-26T22:01:12.551178+0000","last_undegraded":"2024-04-26T22:01:12.551178+0000","last_fullsized":"2024-04-26T22:01:12.551178+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:33.092020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552483+0000","last_change":"2024-04-26T22:01:11.560438+0000","last_active":"2024-04-26T22:01:12.552483+0000","last_peered":"2024-04-26T22:01:12.552483+0000","last_clean":"2024-04-26T22:01:12.552483+0000","last_became_active":"2024-04-26T22:01:11.559475+0000","last_became_peered":"2024-04-26T22:01:11.559475+0000","last_unstale":"2024-04-26T22:01:12.552483+0000","last_undegraded":"2024-04-26T22:01:12.552483+0000","last_fullsized":"2024-04-26T22:01:12.552483+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:52:53.736659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704937+0000","last_change":"2024-04-26T22:01:10.552624+0000","last_active":"2024-04-26T22:01:12.704937+0000","last_peered":"2024-04-26T22:01:12.704937+0000","last_clean":"2024-04-26T22:01:12.704937+0000","last_became_active":"2024-04-26T22:01:10.552273+0000","last_became_peered":"2024-04-26T22:01:10.552273+0000","last_unstale":"2024-04-26T22:01:12.704937+0000","last_undegraded":"2024-04-26T22:01:12.704937+0000","last_fullsized":"2024-04-26T22:01:12.704937+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:21.313384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550596+0000","last_change":"2024-04-26T22:01:11.549169+0000","last_active":"2024-04-26T22:01:12.550596+0000","last_peered":"2024-04-26T22:01:12.550596+0000","last_clean":"2024-04-26T22:01:12.550596+0000","last_became_active":"2024-04-26T22:01:11.548906+0000","last_became_peered":"2024-04-26T22:01:11.548906+0000","last_unstale":"2024-04-26T22:01:12.550596+0000","last_undegraded":"2024-04-26T22:01:12.550596+0000","last_fullsized":"2024-04-26T22:01:12.550596+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:44:45.774633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704006+0000","last_change":"2024-04-26T22:01:10.542923+0000","last_active":"2024-04-26T22:01:12.704006+0000","last_peered":"2024-04-26T22:01:12.704006+0000","last_clean":"2024-04-26T22:01:12.704006+0000","last_became_active":"2024-04-26T22:01:10.542660+0000","last_became_peered":"2024-04-26T22:01:10.542660+0000","last_unstale":"2024-04-26T22:01:12.704006+0000","last_undegraded":"2024-04-26T22:01:12.704006+0000","last_fullsized":"2024-04-26T22:01:12.704006+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:09.646420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550242+0000","last_change":"2024-04-26T22:01:11.544798+0000","last_active":"2024-04-26T22:01:12.550242+0000","last_peered":"2024-04-26T22:01:12.550242+0000","last_clean":"2024-04-26T22:01:12.550242+0000","last_became_active":"2024-04-26T22:01:11.544199+0000","last_became_peered":"2024-04-26T22:01:11.544199+0000","last_unstale":"2024-04-26T22:01:12.550242+0000","last_undegraded":"2024-04-26T22:01:12.550242+0000","last_fullsized":"2024-04-26T22:01:12.550242+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:52.280512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552489+0000","last_change":"2024-04-26T22:01:10.545574+0000","last_active":"2024-04-26T22:01:12.552489+0000","last_peered":"2024-04-26T22:01:12.552489+0000","last_clean":"2024-04-26T22:01:12.552489+0000","last_became_active":"2024-04-26T22:01:10.545295+0000","last_became_peered":"2024-04-26T22:01:10.545295+0000","last_unstale":"2024-04-26T22:01:12.552489+0000","last_undegraded":"2024-04-26T22:01:12.552489+0000","last_fullsized":"2024-04-26T22:01:12.552489+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:18.441048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551063+0000","last_change":"2024-04-26T22:01:11.555682+0000","last_active":"2024-04-26T22:01:12.551063+0000","last_peered":"2024-04-26T22:01:12.551063+0000","last_clean":"2024-04-26T22:01:12.551063+0000","last_became_active":"2024-04-26T22:01:11.555385+0000","last_became_peered":"2024-04-26T22:01:11.555385+0000","last_unstale":"2024-04-26T22:01:12.551063+0000","last_undegraded":"2024-04-26T22:01:12.551063+0000","last_fullsized":"2024-04-26T22:01:12.551063+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:15.345613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551444+0000","last_change":"2024-04-26T22:01:10.547401+0000","last_active":"2024-04-26T22:01:12.551444+0000","last_peered":"2024-04-26T22:01:12.551444+0000","last_clean":"2024-04-26T22:01:12.551444+0000","last_became_active":"2024-04-26T22:01:10.546714+0000","last_became_peered":"2024-04-26T22:01:10.546714+0000","last_unstale":"2024-04-26T22:01:12.551444+0000","last_undegraded":"2024-04-26T22:01:12.551444+0000","last_fullsized":"2024-04-26T22:01:12.551444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:17.648276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551571+0000","last_change":"2024-04-26T22:01:11.553764+0000","last_active":"2024-04-26T22:01:12.551571+0000","last_peered":"2024-04-26T22:01:12.551571+0000","last_clean":"2024-04-26T22:01:12.551571+0000","last_became_active":"2024-04-26T22:01:11.553423+0000","last_became_peered":"2024-04-26T22:01:11.553423+0000","last_unstale":"2024-04-26T22:01:12.551571+0000","last_undegraded":"2024-04-26T22:01:12.551571+0000","last_fullsized":"2024-04-26T22:01:12.551571+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:36:52.001754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704389+0000","last_change":"2024-04-26T22:01:10.552266+0000","last_active":"2024-04-26T22:01:12.704389+0000","last_peered":"2024-04-26T22:01:12.704389+0000","last_clean":"2024-04-26T22:01:12.704389+0000","last_became_active":"2024-04-26T22:01:10.551995+0000","last_became_peered":"2024-04-26T22:01:10.551995+0000","last_unstale":"2024-04-26T22:01:12.704389+0000","last_undegraded":"2024-04-26T22:01:12.704389+0000","last_fullsized":"2024-04-26T22:01:12.704389+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:59:14.341397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552959+0000","last_change":"2024-04-26T22:01:11.561735+0000","last_active":"2024-04-26T22:01:12.552959+0000","last_peered":"2024-04-26T22:01:12.552959+0000","last_clean":"2024-04-26T22:01:12.552959+0000","last_became_active":"2024-04-26T22:01:11.561307+0000","last_became_peered":"2024-04-26T22:01:11.561307+0000","last_unstale":"2024-04-26T22:01:12.552959+0000","last_undegraded":"2024-04-26T22:01:12.552959+0000","last_fullsized":"2024-04-26T22:01:12.552959+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:32.356492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705294+0000","last_change":"2024-04-26T22:01:10.550833+0000","last_active":"2024-04-26T22:01:12.705294+0000","last_peered":"2024-04-26T22:01:12.705294+0000","last_clean":"2024-04-26T22:01:12.705294+0000","last_became_active":"2024-04-26T22:01:10.550568+0000","last_became_peered":"2024-04-26T22:01:10.550568+0000","last_unstale":"2024-04-26T22:01:12.705294+0000","last_undegraded":"2024-04-26T22:01:12.705294+0000","last_fullsized":"2024-04-26T22:01:12.705294+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:27.680718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704237+0000","last_change":"2024-04-26T22:01:11.555337+0000","last_active":"2024-04-26T22:01:12.704237+0000","last_peered":"2024-04-26T22:01:12.704237+0000","last_clean":"2024-04-26T22:01:12.704237+0000","last_became_active":"2024-04-26T22:01:11.554931+0000","last_became_peered":"2024-04-26T22:01:11.554931+0000","last_unstale":"2024-04-26T22:01:12.704237+0000","last_undegraded":"2024-04-26T22:01:12.704237+0000","last_fullsized":"2024-04-26T22:01:12.704237+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:52.989549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552879+0000","last_change":"2024-04-26T22:01:10.545891+0000","last_active":"2024-04-26T22:01:12.552879+0000","last_peered":"2024-04-26T22:01:12.552879+0000","last_clean":"2024-04-26T22:01:12.552879+0000","last_became_active":"2024-04-26T22:01:10.545579+0000","last_became_peered":"2024-04-26T22:01:10.545579+0000","last_unstale":"2024-04-26T22:01:12.552879+0000","last_undegraded":"2024-04-26T22:01:12.552879+0000","last_fullsized":"2024-04-26T22:01:12.552879+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:33:27.843676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550934+0000","last_change":"2024-04-26T22:01:11.545585+0000","last_active":"2024-04-26T22:01:12.550934+0000","last_peered":"2024-04-26T22:01:12.550934+0000","last_clean":"2024-04-26T22:01:12.550934+0000","last_became_active":"2024-04-26T22:01:11.544553+0000","last_became_peered":"2024-04-26T22:01:11.544553+0000","last_unstale":"2024-04-26T22:01:12.550934+0000","last_undegraded":"2024-04-26T22:01:12.550934+0000","last_fullsized":"2024-04-26T22:01:12.550934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:53.243737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704832+0000","last_change":"2024-04-26T22:01:10.550643+0000","last_active":"2024-04-26T22:01:12.704832+0000","last_peered":"2024-04-26T22:01:12.704832+0000","last_clean":"2024-04-26T22:01:12.704832+0000","last_became_active":"2024-04-26T22:01:10.550388+0000","last_became_peered":"2024-04-26T22:01:10.550388+0000","last_unstale":"2024-04-26T22:01:12.704832+0000","last_undegraded":"2024-04-26T22:01:12.704832+0000","last_fullsized":"2024-04-26T22:01:12.704832+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:15.720057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552484+0000","last_change":"2024-04-26T22:01:11.559651+0000","last_active":"2024-04-26T22:01:12.552484+0000","last_peered":"2024-04-26T22:01:12.552484+0000","last_clean":"2024-04-26T22:01:12.552484+0000","last_became_active":"2024-04-26T22:01:11.559381+0000","last_became_peered":"2024-04-26T22:01:11.559381+0000","last_unstale":"2024-04-26T22:01:12.552484+0000","last_undegraded":"2024-04-26T22:01:12.552484+0000","last_fullsized":"2024-04-26T22:01:12.552484+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:25.846743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705097+0000","last_change":"2024-04-26T22:01:10.549882+0000","last_active":"2024-04-26T22:01:12.705097+0000","last_peered":"2024-04-26T22:01:12.705097+0000","last_clean":"2024-04-26T22:01:12.705097+0000","last_became_active":"2024-04-26T22:01:10.549628+0000","last_became_peered":"2024-04-26T22:01:10.549628+0000","last_unstale":"2024-04-26T22:01:12.705097+0000","last_undegraded":"2024-04-26T22:01:12.705097+0000","last_fullsized":"2024-04-26T22:01:12.705097+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:54:52.239521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704618+0000","last_change":"2024-04-26T22:01:11.551509+0000","last_active":"2024-04-26T22:01:12.704618+0000","last_peered":"2024-04-26T22:01:12.704618+0000","last_clean":"2024-04-26T22:01:12.704618+0000","last_became_active":"2024-04-26T22:01:11.551206+0000","last_became_peered":"2024-04-26T22:01:11.551206+0000","last_unstale":"2024-04-26T22:01:12.704618+0000","last_undegraded":"2024-04-26T22:01:12.704618+0000","last_fullsized":"2024-04-26T22:01:12.704618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:30:30.989167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705479+0000","last_change":"2024-04-26T22:01:10.550815+0000","last_active":"2024-04-26T22:01:12.705479+0000","last_peered":"2024-04-26T22:01:12.705479+0000","last_clean":"2024-04-26T22:01:12.705479+0000","last_became_active":"2024-04-26T22:01:10.550551+0000","last_became_peered":"2024-04-26T22:01:10.550551+0000","last_unstale":"2024-04-26T22:01:12.705479+0000","last_undegraded":"2024-04-26T22:01:12.705479+0000","last_fullsized":"2024-04-26T22:01:12.705479+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:13:17.300764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704345+0000","last_change":"2024-04-26T22:01:11.547913+0000","last_active":"2024-04-26T22:01:12.704345+0000","last_peered":"2024-04-26T22:01:12.704345+0000","last_clean":"2024-04-26T22:01:12.704345+0000","last_became_active":"2024-04-26T22:01:11.547643+0000","last_became_peered":"2024-04-26T22:01:11.547643+0000","last_unstale":"2024-04-26T22:01:12.704345+0000","last_undegraded":"2024-04-26T22:01:12.704345+0000","last_fullsized":"2024-04-26T22:01:12.704345+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:51.119348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552418+0000","last_change":"2024-04-26T22:01:10.553915+0000","last_active":"2024-04-26T22:01:12.552418+0000","last_peered":"2024-04-26T22:01:12.552418+0000","last_clean":"2024-04-26T22:01:12.552418+0000","last_became_active":"2024-04-26T22:01:10.553595+0000","last_became_peered":"2024-04-26T22:01:10.553595+0000","last_unstale":"2024-04-26T22:01:12.552418+0000","last_undegraded":"2024-04-26T22:01:12.552418+0000","last_fullsized":"2024-04-26T22:01:12.552418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:33.092020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552934+0000","last_change":"2024-04-26T22:01:11.552577+0000","last_active":"2024-04-26T22:01:12.552934+0000","last_peered":"2024-04-26T22:01:12.552934+0000","last_clean":"2024-04-26T22:01:12.552934+0000","last_became_active":"2024-04-26T22:01:11.552233+0000","last_became_peered":"2024-04-26T22:01:11.552233+0000","last_unstale":"2024-04-26T22:01:12.552934+0000","last_undegraded":"2024-04-26T22:01:12.552934+0000","last_fullsized":"2024-04-26T22:01:12.552934+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:22.193754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.706206+0000","last_change":"2024-04-26T22:01:10.549663+0000","last_active":"2024-04-26T22:01:12.706206+0000","last_peered":"2024-04-26T22:01:12.706206+0000","last_clean":"2024-04-26T22:01:12.706206+0000","last_became_active":"2024-04-26T22:01:10.549304+0000","last_became_peered":"2024-04-26T22:01:10.549304+0000","last_unstale":"2024-04-26T22:01:12.706206+0000","last_undegraded":"2024-04-26T22:01:12.706206+0000","last_fullsized":"2024-04-26T22:01:12.706206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:41:56.790585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.553026+0000","last_change":"2024-04-26T22:01:11.550122+0000","last_active":"2024-04-26T22:01:12.553026+0000","last_peered":"2024-04-26T22:01:12.553026+0000","last_clean":"2024-04-26T22:01:12.553026+0000","last_became_active":"2024-04-26T22:01:11.549548+0000","last_became_peered":"2024-04-26T22:01:11.549548+0000","last_unstale":"2024-04-26T22:01:12.553026+0000","last_undegraded":"2024-04-26T22:01:12.553026+0000","last_fullsized":"2024-04-26T22:01:12.553026+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:22.317600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705364+0000","last_change":"2024-04-26T22:01:10.546590+0000","last_active":"2024-04-26T22:01:12.705364+0000","last_peered":"2024-04-26T22:01:12.705364+0000","last_clean":"2024-04-26T22:01:12.705364+0000","last_became_active":"2024-04-26T22:01:10.546317+0000","last_became_peered":"2024-04-26T22:01:10.546317+0000","last_unstale":"2024-04-26T22:01:12.705364+0000","last_undegraded":"2024-04-26T22:01:12.705364+0000","last_fullsized":"2024-04-26T22:01:12.705364+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:55.298780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.706002+0000","last_change":"2024-04-26T22:01:11.550740+0000","last_active":"2024-04-26T22:01:12.706002+0000","last_peered":"2024-04-26T22:01:12.706002+0000","last_clean":"2024-04-26T22:01:12.706002+0000","last_became_active":"2024-04-26T22:01:11.550487+0000","last_became_peered":"2024-04-26T22:01:11.550487+0000","last_unstale":"2024-04-26T22:01:12.706002+0000","last_undegraded":"2024-04-26T22:01:12.706002+0000","last_fullsized":"2024-04-26T22:01:12.706002+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:48:34.371095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704168+0000","last_change":"2024-04-26T22:01:10.545284+0000","last_active":"2024-04-26T22:01:12.704168+0000","last_peered":"2024-04-26T22:01:12.704168+0000","last_clean":"2024-04-26T22:01:12.704168+0000","last_became_active":"2024-04-26T22:01:10.544988+0000","last_became_peered":"2024-04-26T22:01:10.544988+0000","last_unstale":"2024-04-26T22:01:12.704168+0000","last_undegraded":"2024-04-26T22:01:12.704168+0000","last_fullsized":"2024-04-26T22:01:12.704168+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:18:56.104474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705017+0000","last_change":"2024-04-26T22:01:11.558805+0000","last_active":"2024-04-26T22:01:12.705017+0000","last_peered":"2024-04-26T22:01:12.705017+0000","last_clean":"2024-04-26T22:01:12.705017+0000","last_became_active":"2024-04-26T22:01:11.556896+0000","last_became_peered":"2024-04-26T22:01:11.556896+0000","last_unstale":"2024-04-26T22:01:12.705017+0000","last_undegraded":"2024-04-26T22:01:12.705017+0000","last_fullsized":"2024-04-26T22:01:12.705017+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:52:46.545408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.552984+0000","last_change":"2024-04-26T22:01:10.547693+0000","last_active":"2024-04-26T22:01:12.552984+0000","last_peered":"2024-04-26T22:01:12.552984+0000","last_clean":"2024-04-26T22:01:12.552984+0000","last_became_active":"2024-04-26T22:01:10.547396+0000","last_became_peered":"2024-04-26T22:01:10.547396+0000","last_unstale":"2024-04-26T22:01:12.552984+0000","last_undegraded":"2024-04-26T22:01:12.552984+0000","last_fullsized":"2024-04-26T22:01:12.552984+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:41.968426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704472+0000","last_change":"2024-04-26T22:01:11.559389+0000","last_active":"2024-04-26T22:01:12.704472+0000","last_peered":"2024-04-26T22:01:12.704472+0000","last_clean":"2024-04-26T22:01:12.704472+0000","last_became_active":"2024-04-26T22:01:11.558795+0000","last_became_peered":"2024-04-26T22:01:11.558795+0000","last_unstale":"2024-04-26T22:01:12.704472+0000","last_undegraded":"2024-04-26T22:01:12.704472+0000","last_fullsized":"2024-04-26T22:01:12.704472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:53.854331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705576+0000","last_change":"2024-04-26T22:01:10.546852+0000","last_active":"2024-04-26T22:01:12.705576+0000","last_peered":"2024-04-26T22:01:12.705576+0000","last_clean":"2024-04-26T22:01:12.705576+0000","last_became_active":"2024-04-26T22:01:10.546562+0000","last_became_peered":"2024-04-26T22:01:10.546562+0000","last_unstale":"2024-04-26T22:01:12.705576+0000","last_undegraded":"2024-04-26T22:01:12.705576+0000","last_fullsized":"2024-04-26T22:01:12.705576+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:53:01.560590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.550763+0000","last_change":"2024-04-26T22:01:11.560484+0000","last_active":"2024-04-26T22:01:12.550763+0000","last_peered":"2024-04-26T22:01:12.550763+0000","last_clean":"2024-04-26T22:01:12.550763+0000","last_became_active":"2024-04-26T22:01:11.560205+0000","last_became_peered":"2024-04-26T22:01:11.560205+0000","last_unstale":"2024-04-26T22:01:12.550763+0000","last_undegraded":"2024-04-26T22:01:12.550763+0000","last_fullsized":"2024-04-26T22:01:12.550763+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:44:43.181581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551518+0000","last_change":"2024-04-26T22:01:10.551489+0000","last_active":"2024-04-26T22:01:12.551518+0000","last_peered":"2024-04-26T22:01:12.551518+0000","last_clean":"2024-04-26T22:01:12.551518+0000","last_became_active":"2024-04-26T22:01:10.551190+0000","last_became_peered":"2024-04-26T22:01:10.551190+0000","last_unstale":"2024-04-26T22:01:12.551518+0000","last_undegraded":"2024-04-26T22:01:12.551518+0000","last_fullsized":"2024-04-26T22:01:12.551518+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:45.745189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704946+0000","last_change":"2024-04-26T22:01:11.549731+0000","last_active":"2024-04-26T22:01:12.704946+0000","last_peered":"2024-04-26T22:01:12.704946+0000","last_clean":"2024-04-26T22:01:12.704946+0000","last_became_active":"2024-04-26T22:01:11.549421+0000","last_became_peered":"2024-04-26T22:01:11.549421+0000","last_unstale":"2024-04-26T22:01:12.704946+0000","last_undegraded":"2024-04-26T22:01:12.704946+0000","last_fullsized":"2024-04-26T22:01:12.704946+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:46.300566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.705184+0000","last_change":"2024-04-26T22:01:10.552983+0000","last_active":"2024-04-26T22:01:12.705184+0000","last_peered":"2024-04-26T22:01:12.705184+0000","last_clean":"2024-04-26T22:01:12.705184+0000","last_became_active":"2024-04-26T22:01:10.552699+0000","last_became_peered":"2024-04-26T22:01:10.552699+0000","last_unstale":"2024-04-26T22:01:12.705184+0000","last_undegraded":"2024-04-26T22:01:12.705184+0000","last_fullsized":"2024-04-26T22:01:12.705184+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:05.869606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704733+0000","last_change":"2024-04-26T22:01:11.549329+0000","last_active":"2024-04-26T22:01:12.704733+0000","last_peered":"2024-04-26T22:01:12.704733+0000","last_clean":"2024-04-26T22:01:12.704733+0000","last_became_active":"2024-04-26T22:01:11.549029+0000","last_became_peered":"2024-04-26T22:01:11.549029+0000","last_unstale":"2024-04-26T22:01:12.704733+0000","last_undegraded":"2024-04-26T22:01:12.704733+0000","last_fullsized":"2024-04-26T22:01:12.704733+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:04:15.985000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704625+0000","last_change":"2024-04-26T22:01:10.548789+0000","last_active":"2024-04-26T22:01:12.704625+0000","last_peered":"2024-04-26T22:01:12.704625+0000","last_clean":"2024-04-26T22:01:12.704625+0000","last_became_active":"2024-04-26T22:01:10.548517+0000","last_became_peered":"2024-04-26T22:01:10.548517+0000","last_unstale":"2024-04-26T22:01:12.704625+0000","last_undegraded":"2024-04-26T22:01:12.704625+0000","last_fullsized":"2024-04-26T22:01:12.704625+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:02:31.352276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704536+0000","last_change":"2024-04-26T22:01:11.560638+0000","last_active":"2024-04-26T22:01:12.704536+0000","last_peered":"2024-04-26T22:01:12.704536+0000","last_clean":"2024-04-26T22:01:12.704536+0000","last_became_active":"2024-04-26T22:01:11.560368+0000","last_became_peered":"2024-04-26T22:01:11.560368+0000","last_unstale":"2024-04-26T22:01:12.704536+0000","last_undegraded":"2024-04-26T22:01:12.704536+0000","last_fullsized":"2024-04-26T22:01:12.704536+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:10.526811+0000","last_clean_scrub_stamp":"2024-04-26T22:01:10.526811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:23:43.236096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.704075+0000","last_change":"2024-04-26T22:01:10.546949+0000","last_active":"2024-04-26T22:01:12.704075+0000","last_peered":"2024-04-26T22:01:12.704075+0000","last_clean":"2024-04-26T22:01:12.704075+0000","last_became_active":"2024-04-26T22:01:10.546670+0000","last_became_peered":"2024-04-26T22:01:10.546670+0000","last_unstale":"2024-04-26T22:01:12.704075+0000","last_undegraded":"2024-04-26T22:01:12.704075+0000","last_fullsized":"2024-04-26T22:01:12.704075+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:01:09.522595+0000","last_clean_scrub_stamp":"2024-04-26T22:01:09.522595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:41:56.790585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-26T22:01:12.551513+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:01:12.551513+0000","last_peered":"2024-04-26T22:01:12.551513+0000","last_clean":"2024-04-26T22:01:12.551513+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:01:12.551513+0000","last_undegraded":"2024-04-26T22:01:12.551513+0000","last_fullsized":"2024-04-26T22:01:12.551513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1310720,"data_stored":884679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":708608,"data_stored":294151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":716800,"data_stored":294803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":733184,"data_stored":302063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27720,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344120,"statfs":{"total":96636764160,"available":96608378880,"internally_reserved":0,"allocated":716800,"data_stored":294207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":712704,"data_stored":294241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":886713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:01:14.850 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T22:01:14.851 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T22:01:14.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.991+0000 7f6dd96c5640 1 Processor -- start 2024-04-26T22:01:14.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.991+0000 7f6dd96c5640 1 -- start start 2024-04-26T22:01:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.991+0000 7f6dd96c5640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6dd40b1ea0 0x7f6dd40d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.991+0000 7f6dd96c5640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd40b2580 con 0x7f6dd415f6e0 2024-04-26T22:01:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.991+0000 7f6dd96c5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd40b2860 con 0x7f6dd40d56a0 2024-04-26T22:01:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.991+0000 7f6dd96c5640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd40b2330 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.992+0000 7f6dd27fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6dd40b1ea0 0x7f6dd40d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.992+0000 7f6dd27fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6dd40b1ea0 0x7f6dd40d5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34636/0 (socket says 172.21.15.137:34636) 2024-04-26T22:01:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.992+0000 7f6dd27fc640 1 -- 172.21.15.137:0/2741776240 learned_addr learned my addr 172.21.15.137:0/2741776240 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.992+0000 7f6dd2ffd640 1 --1- 172.21.15.137:0/2741776240 >> v1:172.21.15.137:6789/0 conn(0x7f6dd415f6e0 0x7f6dd40d3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:32914/0 (socket says 172.21.15.137:32914) 2024-04-26T22:01:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.992+0000 7f6dd27fc640 1 -- 172.21.15.137:0/2741776240 >> v1:172.21.15.170:6789/0 conn(0x7f6dd40d56a0 legacy=0x7f6dd40b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:14.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.992+0000 7f6dd27fc640 1 -- 172.21.15.137:0/2741776240 >> v1:172.21.15.137:6789/0 conn(0x7f6dd415f6e0 legacy=0x7f6dd40d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.992+0000 7f6dd27fc640 1 -- 172.21.15.137:0/2741776240 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd40b2b40 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd27fc640 1 --2- 172.21.15.137:0/2741776240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 0x7f6dd40d5160 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009870 tx=0x7f6dc802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835bed460303100 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd1ffb640 1 -- 172.21.15.137:0/2741776240 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8037070 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd1ffb640 1 -- 172.21.15.137:0/2741776240 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8032440 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd1ffb640 1 -- 172.21.15.137:0/2741776240 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8032810 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd96c5640 1 -- 172.21.15.137:0/2741776240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 msgr2=0x7f6dd40d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd96c5640 1 --2- 172.21.15.137:0/2741776240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 0x7f6dd40d5160 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009870 tx=0x7f6dc802a2a0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd96c5640 1 -- 172.21.15.137:0/2741776240 shutdown_connections 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd96c5640 1 --2- 172.21.15.137:0/2741776240 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 0x7f6dd40d5160 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd96c5640 1 -- 172.21.15.137:0/2741776240 >> 172.21.15.137:0/2741776240 conn(0x7f6dd408ec20 msgr2=0x7f6dd409e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd96c5640 1 -- 172.21.15.137:0/2741776240 shutdown_connections 2024-04-26T22:01:14.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.993+0000 7f6dd96c5640 1 -- 172.21.15.137:0/2741776240 wait complete. 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd96c5640 1 Processor -- start 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd96c5640 1 -- start start 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd96c5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 0x7f6dd41f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd96c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd40d56a0 0x7f6dd40b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd96c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd415f6e0 0x7f6dd41f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd96c5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd40b3d30 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd96c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd40d5ad0 con 0x7f6dd40d56a0 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd96c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd40b3eb0 con 0x7f6dd415f6e0 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 0x7f6dd41f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 0x7f6dd41f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34640/0 (socket says 172.21.15.137:34640) 2024-04-26T22:01:14.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.995+0000 7f6dd2ffd640 1 -- 172.21.15.137:0/1979099850 learned_addr learned my addr 172.21.15.137:0/1979099850 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd27fc640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd40d56a0 0x7f6dd40b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd37fe640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd415f6e0 0x7f6dd41f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd2ffd640 1 -- 172.21.15.137:0/1979099850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd415f6e0 msgr2=0x7f6dd41f8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd2ffd640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd415f6e0 0x7f6dd41f8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd2ffd640 1 -- 172.21.15.137:0/1979099850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd40d56a0 msgr2=0x7f6dd40b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd2ffd640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd40d56a0 0x7f6dd40b7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd2ffd640 1 -- 172.21.15.137:0/1979099850 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd414f120 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd27fc640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd40d56a0 0x7f6dd40b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd2ffd640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 0x7f6dd41f5220 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c3c0 tx=0x7f6dc400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dbb7fe640 1 -- 172.21.15.137:0/1979099850 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40074e0 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dbb7fe640 1 -- 172.21.15.137:0/1979099850 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc4007680 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd40bad00 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dbb7fe640 1 -- 172.21.15.137:0/1979099850 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4004a00 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.996+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd41f5760 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.997+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd406a290 con 0x7f6dd40b1ea0 2024-04-26T22:01:14.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.997+0000 7f6dbb7fe640 1 -- 172.21.15.137:0/1979099850 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6dc401a020 con 0x7f6dd40b1ea0 2024-04-26T22:01:15.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.998+0000 7f6dbb7fe640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6dc006c8f0 0x7f6dc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:15.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.998+0000 7f6dd27fc640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6dc006c8f0 0x7f6dc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:15.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.998+0000 7f6dbb7fe640 1 -- 172.21.15.137:0/1979099850 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f6dc408b310 con 0x7f6dd40b1ea0 2024-04-26T22:01:15.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:14.998+0000 7f6dd27fc640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6dc006c8f0 0x7f6dc006edb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8034000 tx=0x7f6dc802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:15.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.002+0000 7f6dbb7fe640 1 -- 172.21.15.137:0/1979099850 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6dc4059740 con 0x7f6dd40b1ea0 2024-04-26T22:01:15.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.249+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6dd40b3810 con 0x7f6dd40b1ea0 2024-04-26T22:01:15.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.251+0000 7f6dbb7fe640 1 -- 172.21.15.137:0/1979099850 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f6dc408b130 con 0x7f6dd40b1ea0 2024-04-26T22:01:15.251 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T22:01:15.251 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ== 2024-04-26T22:01:15.251 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T22:01:15.251 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T22:01:15.251 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T22:01:15.252 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T22:01:15.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6dc006c8f0 msgr2=0x7f6dc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:15.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6dc006c8f0 0x7f6dc006edb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8034000 tx=0x7f6dc802e000 comp rx=0 tx=0).stop 2024-04-26T22:01:15.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 msgr2=0x7f6dd41f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:15.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 0x7f6dd41f5220 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c3c0 tx=0x7f6dc400c880 comp rx=0 tx=0).stop 2024-04-26T22:01:15.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 shutdown_connections 2024-04-26T22:01:15.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6dc006c8f0 0x7f6dc006edb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dd415f6e0 0x7f6dd41f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dd40d56a0 0x7f6dd40b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 --2- 172.21.15.137:0/1979099850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dd40b1ea0 0x7f6dd41f5220 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 >> 172.21.15.137:0/1979099850 conn(0x7f6dd408ec20 msgr2=0x7f6dd40b62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:15.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 shutdown_connections 2024-04-26T22:01:15.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.254+0000 7f6dd96c5640 1 -- 172.21.15.137:0/1979099850 wait complete. 2024-04-26T22:01:15.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.362+0000 7fab82322640 1 Processor -- start 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.362+0000 7fab82322640 1 -- start start 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.362+0000 7fab82322640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fab7c0d11b0 0x7fab7c06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.362+0000 7fab82322640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fab7c06e2c0 0x7fab7c15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.362+0000 7fab82322640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab7c0d1740 con 0x7fab7c0cf2e0 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.362+0000 7fab82322640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fab7c06e710 con 0x7fab7c0d11b0 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.362+0000 7fab82322640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fab7c0d1a20 con 0x7fab7c06e2c0 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.363+0000 7fab7b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fab7c0d11b0 0x7fab7c06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.363+0000 7fab7b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fab7c0d11b0 0x7fab7c06dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34654/0 (socket says 172.21.15.137:34654) 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.363+0000 7fab7b7fe640 1 -- 172.21.15.137:0/4130317415 learned_addr learned my addr 172.21.15.137:0/4130317415 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.363+0000 7fab7b7fe640 1 -- 172.21.15.137:0/4130317415 >> v2:172.21.15.170:3300/0 conn(0x7fab7c06e2c0 msgr2=0x7fab7c15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.363+0000 7fab7b7fe640 1 --2- 172.21.15.137:0/4130317415 >> v2:172.21.15.170:3300/0 conn(0x7fab7c06e2c0 0x7fab7c15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.363+0000 7fab7b7fe640 1 -- 172.21.15.137:0/4130317415 >> v1:172.21.15.170:6789/0 conn(0x7fab7c0cf2e0 legacy=0x7fab7c06d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.363+0000 7fab7b7fe640 1 -- 172.21.15.137:0/4130317415 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c0d1d00 con 0x7fab7c0d11b0 2024-04-26T22:01:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.363+0000 7fab7b7fe640 1 --2- 172.21.15.137:0/4130317415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c0d11b0 0x7fab7c06dd80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fab70009870 tx=0x7fab7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe045e19a9a5fdf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab7affd640 1 -- 172.21.15.137:0/4130317415 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70037070 con 0x7fab7c0d11b0 2024-04-26T22:01:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab7affd640 1 -- 172.21.15.137:0/4130317415 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab70032440 con 0x7fab7c0d11b0 2024-04-26T22:01:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab7affd640 1 -- 172.21.15.137:0/4130317415 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70032810 con 0x7fab7c0d11b0 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab82322640 1 -- 172.21.15.137:0/4130317415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c0d11b0 msgr2=0x7fab7c06dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab82322640 1 --2- 172.21.15.137:0/4130317415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c0d11b0 0x7fab7c06dd80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fab70009870 tx=0x7fab7002a270 comp rx=0 tx=0).stop 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab82322640 1 -- 172.21.15.137:0/4130317415 shutdown_connections 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab82322640 1 --2- 172.21.15.137:0/4130317415 >> v2:172.21.15.170:3300/0 conn(0x7fab7c06e2c0 0x7fab7c15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab82322640 1 --2- 172.21.15.137:0/4130317415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c0d11b0 0x7fab7c06dd80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab82322640 1 -- 172.21.15.137:0/4130317415 >> 172.21.15.137:0/4130317415 conn(0x7fab7c0b4a60 msgr2=0x7fab7c0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab82322640 1 -- 172.21.15.137:0/4130317415 shutdown_connections 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.364+0000 7fab82322640 1 -- 172.21.15.137:0/4130317415 wait complete. 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.365+0000 7fab82322640 1 Processor -- start 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab82322640 1 -- start start 2024-04-26T22:01:15.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab82322640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c06e2c0 0x7fab7c1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab82322640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab7c0cf2e0 0x7fab7c1e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab82322640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab7c0d11b0 0x7fab7c1ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab82322640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c0cf6c0 con 0x7fab7c06e2c0 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab82322640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c0d22c0 con 0x7fab7c0cf2e0 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab82322640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fab7c0cf840 con 0x7fab7c0d11b0 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab7bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c06e2c0 0x7fab7c1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab7bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c06e2c0 0x7fab7c1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:34670/0 (socket says 172.21.15.137:34670) 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.366+0000 7fab7bfff640 1 -- 172.21.15.137:0/180365407 learned_addr learned my addr 172.21.15.137:0/180365407 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab7b7fe640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab7c0cf2e0 0x7fab7c1e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab808bf640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab7c0d11b0 0x7fab7c1ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab7bfff640 1 -- 172.21.15.137:0/180365407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab7c0d11b0 msgr2=0x7fab7c1ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab7bfff640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab7c0d11b0 0x7fab7c1ea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab7bfff640 1 -- 172.21.15.137:0/180365407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab7c0cf2e0 msgr2=0x7fab7c1e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:15.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab7bfff640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab7c0cf2e0 0x7fab7c1e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab7bfff640 1 -- 172.21.15.137:0/180365407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c0b8970 con 0x7fab7c06e2c0 2024-04-26T22:01:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab808bf640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab7c0d11b0 0x7fab7c1ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab7bfff640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c06e2c0 0x7fab7c1532a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00b3e0 tx=0x7fab6c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab78ff9640 1 -- 172.21.15.137:0/180365407 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c015020 con 0x7fab7c06e2c0 2024-04-26T22:01:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab78ff9640 1 -- 172.21.15.137:0/180365407 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab6c011850 con 0x7fab7c06e2c0 2024-04-26T22:01:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab78ff9640 1 -- 172.21.15.137:0/180365407 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011c40 con 0x7fab7c06e2c0 2024-04-26T22:01:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c0c71a0 con 0x7fab7c06e2c0 2024-04-26T22:01:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.367+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c0c9af0 con 0x7fab7c06e2c0 2024-04-26T22:01:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.368+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab7c06a290 con 0x7fab7c06e2c0 2024-04-26T22:01:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.368+0000 7fab78ff9640 1 -- 172.21.15.137:0/180365407 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fab6c018020 con 0x7fab7c06e2c0 2024-04-26T22:01:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.369+0000 7fab78ff9640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab6806c8f0 0x7fab6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.369+0000 7fab78ff9640 1 -- 172.21.15.137:0/180365407 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fab6c08ba80 con 0x7fab7c06e2c0 2024-04-26T22:01:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.369+0000 7fab7b7fe640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab6806c8f0 0x7fab6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.369+0000 7fab7b7fe640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab6806c8f0 0x7fab6806edb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fab70034000 tx=0x7fab7002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:15.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.373+0000 7fab78ff9640 1 -- 172.21.15.137:0/180365407 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fab6c01f020 con 0x7fab7c06e2c0 2024-04-26T22:01:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.589+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab7c0b8ef0 con 0x7fab7c06e2c0 2024-04-26T22:01:15.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.589+0000 7fab78ff9640 1 -- 172.21.15.137:0/180365407 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5193 (secure 0 0 0) 0x7fab6c059f40 con 0x7fab7c06e2c0 2024-04-26T22:01:15.589 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:15.590 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:01:10.893739+0000","modified":"2024-04-26T22:01:12.886844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/4265926631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":4265926631},{"type":"v1","addr":"172.21.15.137:6837","nonce":4265926631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6060,"qdb_cluster":[6060]},"id":4}]} 2024-04-26T22:01:15.590 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 26 2024-04-26T22:01:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab6806c8f0 msgr2=0x7fab6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab6806c8f0 0x7fab6806edb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fab70034000 tx=0x7fab7002e000 comp rx=0 tx=0).stop 2024-04-26T22:01:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c06e2c0 msgr2=0x7fab7c1532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c06e2c0 0x7fab7c1532a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00b3e0 tx=0x7fab6c00b8a0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 shutdown_connections 2024-04-26T22:01:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fab6806c8f0 0x7fab6806edb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fab7c0d11b0 0x7fab7c1ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab7c0cf2e0 0x7fab7c1e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 --2- 172.21.15.137:0/180365407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fab7c06e2c0 0x7fab7c1532a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:15.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.591+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 >> 172.21.15.137:0/180365407 conn(0x7fab7c0b4a60 msgr2=0x7fab7c0712c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:15.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.592+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 shutdown_connections 2024-04-26T22:01:15.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:15.592+0000 7fab82322640 1 -- 172.21.15.137:0/180365407 wait complete. 2024-04-26T22:01:16.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:01:10.893739+0000', 'modified': '2024-04-26T22:01:12.886844+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6060}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6060': {'gid': 6060, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6837/4265926631', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6836', 'nonce': 4265926631}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 4265926631}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6060, 'qdb_cluster': [6060]} 2024-04-26T22:01:16.005 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:01:16.005 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T22:01:16.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.103+0000 7fa00eefc640 1 Processor -- start 2024-04-26T22:01:16.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.103+0000 7fa00eefc640 1 -- start start 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.104+0000 7fa00eefc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa0080b2310 0x7fa008167cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.104+0000 7fa00eefc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa00809c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.104+0000 7fa00eefc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa008070520 con 0x7fa0080c5f20 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.104+0000 7fa00eefc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa008070800 con 0x7fa0080b2310 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.104+0000 7fa00eefc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa00809bb50 con 0x7fa0080cd5a0 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa00d499640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa00809c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa007fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa0080b2310 0x7fa008167cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa00d499640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa00809c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:48984/0 (socket says 172.21.15.137:48984) 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa00d499640 1 -- 172.21.15.137:0/281975337 learned_addr learned my addr 172.21.15.137:0/281975337 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa0077fe640 1 -- 172.21.15.137:0/281975337 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107899876 0 0) 0x7fa008070520 con 0x7fa0080c5f20 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa0077fe640 1 -- 172.21.15.137:0/281975337 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ff0003520 con 0x7fa0080c5f20 2024-04-26T22:01:16.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa00d499640 1 -- 172.21.15.137:0/281975337 >> v2:172.21.15.170:3300/0 conn(0x7fa0080b2310 msgr2=0x7fa008167cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa00d499640 1 --2- 172.21.15.137:0/281975337 >> v2:172.21.15.170:3300/0 conn(0x7fa0080b2310 0x7fa008167cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa00d499640 1 -- 172.21.15.137:0/281975337 >> v1:172.21.15.170:6789/0 conn(0x7fa0080c5f20 legacy=0x7fa0080c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa00d499640 1 -- 172.21.15.137:0/281975337 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa008072340 con 0x7fa0080cd5a0 2024-04-26T22:01:16.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.105+0000 7fa007fff640 1 --2- 172.21.15.137:0/281975337 >> v2:172.21.15.170:3300/0 conn(0x7fa0080b2310 0x7fa008167cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:01:16.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa00d499640 1 --2- 172.21.15.137:0/281975337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa00809c070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa000009e50 tx=0x7fa00002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e54648633d7ac35 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa0077fe640 1 -- 172.21.15.137:0/281975337 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000036070 con 0x7fa0080cd5a0 2024-04-26T22:01:16.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa0077fe640 1 -- 172.21.15.137:0/281975337 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa000031600 con 0x7fa0080cd5a0 2024-04-26T22:01:16.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa0077fe640 1 -- 172.21.15.137:0/281975337 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0000319b0 con 0x7fa0080cd5a0 2024-04-26T22:01:16.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa00eefc640 1 -- 172.21.15.137:0/281975337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 msgr2=0x7fa00809c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa00eefc640 1 --2- 172.21.15.137:0/281975337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa00809c070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa000009e50 tx=0x7fa00002a680 comp rx=0 tx=0).stop 2024-04-26T22:01:16.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa00eefc640 1 -- 172.21.15.137:0/281975337 shutdown_connections 2024-04-26T22:01:16.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa00eefc640 1 --2- 172.21.15.137:0/281975337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa00809c070 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa00eefc640 1 --2- 172.21.15.137:0/281975337 >> v2:172.21.15.170:3300/0 conn(0x7fa0080b2310 0x7fa008167cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa00eefc640 1 -- 172.21.15.137:0/281975337 >> 172.21.15.137:0/281975337 conn(0x7fa0080b4a40 msgr2=0x7fa0080b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:16.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa00eefc640 1 -- 172.21.15.137:0/281975337 shutdown_connections 2024-04-26T22:01:16.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.106+0000 7fa00eefc640 1 -- 172.21.15.137:0/281975337 wait complete. 2024-04-26T22:01:16.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.107+0000 7fa00eefc640 1 Processor -- start 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.108+0000 7fa00eefc640 1 -- start start 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.108+0000 7fa00eefc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0080b2310 0x7fa008164d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.108+0000 7fa00eefc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0080c5f20 0x7fa00815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.108+0000 7fa00eefc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa0080d2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.108+0000 7fa00eefc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa008164b60 con 0x7fa0080b2310 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.108+0000 7fa00eefc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081649e0 con 0x7fa0080c5f20 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.108+0000 7fa00eefc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa0080cda30 con 0x7fa0080cd5a0 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00cc98640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0080b2310 0x7fa008164d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00cc98640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0080b2310 0x7fa008164d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49556/0 (socket says 172.21.15.137:49556) 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00cc98640 1 -- 172.21.15.137:0/3836401291 learned_addr learned my addr 172.21.15.137:0/3836401291 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00d499640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa0080d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa007fff640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0080c5f20 0x7fa00815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00cc98640 1 -- 172.21.15.137:0/3836401291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 msgr2=0x7fa0080d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00cc98640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa0080d2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00cc98640 1 -- 172.21.15.137:0/3836401291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0080c5f20 msgr2=0x7fa00815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00cc98640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0080c5f20 0x7fa00815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00cc98640 1 -- 172.21.15.137:0/3836401291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0081652b0 con 0x7fa0080b2310 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00cc98640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0080b2310 0x7fa008164d70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800c500 tx=0x7f9ff800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa0057fa640 1 -- 172.21.15.137:0/3836401291 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80052d0 con 0x7fa0080b2310 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa0057fa640 1 -- 172.21.15.137:0/3836401291 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff8005490 con 0x7fa0080b2310 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00eefc640 1 -- 172.21.15.137:0/3836401291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0080b6730 con 0x7fa0080b2310 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa0057fa640 1 -- 172.21.15.137:0/3836401291 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8012870 con 0x7fa0080b2310 2024-04-26T22:01:16.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.109+0000 7fa00eefc640 1 -- 172.21.15.137:0/3836401291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa008165810 con 0x7fa0080b2310 2024-04-26T22:01:16.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.111+0000 7fa0057fa640 1 -- 172.21.15.137:0/3836401291 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ff8012a10 con 0x7fa0080b2310 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.111+0000 7fa0057fa640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ff406c8f0 0x7f9ff406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.112+0000 7fa0057fa640 1 -- 172.21.15.137:0/3836401291 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f9ff808b690 con 0x7fa0080b2310 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.112+0000 7fa007fff640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ff406c8f0 0x7f9ff406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.112+0000 7fa007fff640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ff406c8f0 0x7f9ff406edb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009560 tx=0x7f9ffc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.112+0000 7fa011c11740 1 Processor -- start 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.112+0000 7fa011c11740 1 -- start start 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa011c11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e8c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa011c11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 0x5653b4eaa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa011c11740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e62120 0x5653b4ea83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa011c11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5653b4dc6740 con 0x5653b4e8c440 2024-04-26T22:01:16.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa011c11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5653b4d623a0 con 0x5653b4ea9ce0 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa011c11740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5653b4dc2700 con 0x5653b4e62120 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa00cc98640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e8c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa00cc98640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e8c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49566/0 (socket says 172.21.15.137:49566) 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa00cc98640 1 -- 172.21.15.137:0/1523935724 learned_addr learned my addr 172.21.15.137:0/1523935724 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa00cc98640 1 -- 172.21.15.137:0/1523935724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e62120 msgr2=0x5653b4ea83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa00cc98640 1 --2- 172.21.15.137:0/1523935724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e62120 0x5653b4ea83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa00cc98640 1 -- 172.21.15.137:0/1523935724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 msgr2=0x5653b4eaa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa00cc98640 1 --2- 172.21.15.137:0/1523935724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 0x5653b4eaa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa00cc98640 1 -- 172.21.15.137:0/1523935724 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b4d7e750 con 0x5653b4e8c440 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.113+0000 7fa00cc98640 1 --2- 172.21.15.137:0/1523935724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e8c820 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8089c70 tx=0x7f9ff80595c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf97c5dfac23f688 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7f9fee7fc640 1 -- 172.21.15.137:0/1523935724 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8057780 con 0x5653b4e8c440 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7f9fee7fc640 1 -- 172.21.15.137:0/1523935724 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff8012d00 con 0x5653b4e8c440 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7f9fee7fc640 1 -- 172.21.15.137:0/1523935724 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8071bb0 con 0x5653b4e8c440 2024-04-26T22:01:16.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7fa011c11740 1 -- 172.21.15.137:0/1523935724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 msgr2=0x5653b4e8c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7fa011c11740 1 --2- 172.21.15.137:0/1523935724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e8c820 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8089c70 tx=0x7f9ff80595c0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7fa011c11740 1 -- 172.21.15.137:0/1523935724 shutdown_connections 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7fa011c11740 1 --2- 172.21.15.137:0/1523935724 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e62120 0x5653b4ea83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7fa011c11740 1 --2- 172.21.15.137:0/1523935724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 0x5653b4eaa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7fa011c11740 1 --2- 172.21.15.137:0/1523935724 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e8c820 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7fa011c11740 1 -- 172.21.15.137:0/1523935724 >> 172.21.15.137:0/1523935724 conn(0x5653b4e5ea50 msgr2=0x5653b4ea7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7fa011c11740 1 -- 172.21.15.137:0/1523935724 shutdown_connections 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.114+0000 7fa011c11740 1 -- 172.21.15.137:0/1523935724 wait complete. 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.115+0000 7fa011c11740 1 -- start start 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.115+0000 7fa011c11740 1 Processor -- start 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa011c11740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 0x5653b4e8f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa011c11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4eba570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa011c11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 0x5653b4eaa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa011c11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5653b4e62ec0 con 0x5653b4ea9ce0 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa011c11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5653b4d4dfe0 con 0x5653b4e9e300 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa011c11740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5653b4e5c980 con 0x5653b4e8c440 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa011c11740 10 client.0 _ll_register_callbacks cb 0x5653b4d64150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa007fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4eba570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa007fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4eba570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49576/0 (socket says 172.21.15.137:49576) 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa007fff640 1 -- 172.21.15.137:0/3110209110 learned_addr learned my addr 172.21.15.137:0/3110209110 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa00cc98640 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 0x5653b4e8f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa00d499640 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 0x5653b4eaa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa007fff640 1 -- 172.21.15.137:0/3110209110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 msgr2=0x5653b4e8f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa007fff640 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 0x5653b4e8f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa007fff640 1 -- 172.21.15.137:0/3110209110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 msgr2=0x5653b4eaa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa007fff640 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 0x5653b4eaa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa007fff640 1 -- 172.21.15.137:0/3110209110 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b4ad82d0 con 0x5653b4ea9ce0 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7fa007fff640 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4eba570 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0045c0 tx=0x7f9ffc0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fc98dff343112 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.116+0000 7f9fe77fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7f9fe77fe640 1 -- 172.21.15.137:0/3110209110 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc003de0 con 0x5653b4ea9ce0 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7f9fe77fe640 1 -- 172.21.15.137:0/3110209110 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f9ffc014440 con 0x5653b4ea9ce0 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa011c11740 1 -- 172.21.15.137:0/3110209110 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff8012d00 con 0x5653b4ea9ce0 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7f9fe77fe640 1 -- 172.21.15.137:0/3110209110 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9ffc02e050 con 0x5653b4ea9ce0 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa011c11740 10 client.6201 fetch_fsmap learned FSMap version 26 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa011c11740 1 -- 172.21.15.137:0/3110209110 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5653b4ba26b0 con 0x5653b4ea9ce0 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7f9fe77fe640 1 -- 172.21.15.137:0/3110209110 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff8012d00 con 0x5653b4ea9ce0 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7f9fe77fe640 1 -- 172.21.15.137:0/3110209110 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f9ffc031020 con 0x5653b4ea9ce0 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa011c11740 10 client.6201 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa011c11740 10 client.6201 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa011c11740 20 client.6201 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa011c11740 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5653b4e8d280 0x5653b4eb79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa011c11740 4 client.6201 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:01:16.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa011c11740 1 -- 172.21.15.137:0/3110209110 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653b4dd4350 con 0x5653b4e8d280 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa00cc98640 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5653b4e8d280 0x5653b4eb79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7f9fe77fe640 10 client.6201 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.117+0000 7fa00cc98640 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5653b4e8d280 0x5653b4eb79e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbe680b6c482ae6c server_cookie=9f0788ef53429266 in_seq=0 out_seq=0 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7f9fe77fe640 1 -- 172.21.15.137:0/3110209110 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5653b4dd4350 con 0x5653b4e8d280 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7f9fe77fe640 10 client.6201 handle_command_reply: tid=0 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 client.6201 shutdown 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 -- 172.21.15.137:0/3110209110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 msgr2=0x5653b4eba570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4eba570 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0045c0 tx=0x7f9ffc0045f0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 -- 172.21.15.137:0/3110209110 shutdown_connections 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5653b4e8d280 0x5653b4eb79e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4eba570 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 0x5653b4eaa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 --2- 172.21.15.137:0/3110209110 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 0x5653b4e8f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7f9fe77fe640 0 client.6201 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:16.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 -- 172.21.15.137:0/3110209110 >> 172.21.15.137:0/3110209110 conn(0x5653b4e62120 msgr2=0x5653b4ea68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:16.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 -- 172.21.15.137:0/3110209110 shutdown_connections 2024-04-26T22:01:16.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.118+0000 7fa011c11740 1 -- 172.21.15.137:0/3110209110 wait complete. 2024-04-26T22:01:16.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.119+0000 7fa011c11740 20 client.6201 trim_cache size 0 max 16384 2024-04-26T22:01:16.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.136+0000 7fa011c11740 1 Processor -- start 2024-04-26T22:01:16.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.136+0000 7fa011c11740 1 -- start start 2024-04-26T22:01:16.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa011c11740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 0x5653b4f185e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa011c11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 0x5653b4e8efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa011c11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4e8f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa011c11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa008204a90 con 0x5653b4ea9ce0 2024-04-26T22:01:16.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa011c11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081609e0 con 0x5653b4e9e300 2024-04-26T22:01:16.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa011c11740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa0080b7c00 con 0x5653b4e8c440 2024-04-26T22:01:16.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa00d499640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4e8f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa00d499640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4e8f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49578/0 (socket says 172.21.15.137:49578) 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa00d499640 1 -- 172.21.15.137:0/3458812255 learned_addr learned my addr 172.21.15.137:0/3458812255 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa00cc98640 1 --2- 172.21.15.137:0/3458812255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 0x5653b4f185e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa007fff640 1 --2- 172.21.15.137:0/3458812255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 0x5653b4e8efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa00d499640 1 -- 172.21.15.137:0/3458812255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 msgr2=0x5653b4f185e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa00d499640 1 --2- 172.21.15.137:0/3458812255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 0x5653b4f185e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa00d499640 1 -- 172.21.15.137:0/3458812255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 msgr2=0x5653b4e8efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa00d499640 1 --2- 172.21.15.137:0/3458812255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 0x5653b4e8efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.137+0000 7fa00d499640 1 -- 172.21.15.137:0/3458812255 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653b4ea11b0 con 0x5653b4ea9ce0 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa00d499640 1 --2- 172.21.15.137:0/3458812255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4e8f510 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa000009e50 tx=0x7fa00002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caac07481d775331 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7f9fedffb640 1 -- 172.21.15.137:0/3458812255 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000036040 con 0x5653b4ea9ce0 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7f9fedffb640 1 -- 172.21.15.137:0/3458812255 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa000049680 con 0x5653b4ea9ce0 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7f9fedffb640 1 -- 172.21.15.137:0/3458812255 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000049a50 con 0x5653b4ea9ce0 2024-04-26T22:01:16.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa011c11740 1 -- 172.21.15.137:0/3458812255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 msgr2=0x5653b4e8f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa011c11740 1 --2- 172.21.15.137:0/3458812255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4e8f510 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa000009e50 tx=0x7fa00002c000 comp rx=0 tx=0).stop 2024-04-26T22:01:16.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa011c11740 1 -- 172.21.15.137:0/3458812255 shutdown_connections 2024-04-26T22:01:16.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa011c11740 1 --2- 172.21.15.137:0/3458812255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4ea9ce0 0x5653b4e8f510 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa011c11740 1 --2- 172.21.15.137:0/3458812255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4e9e300 0x5653b4e8efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa011c11740 1 --2- 172.21.15.137:0/3458812255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e8c440 0x5653b4f185e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa011c11740 1 -- 172.21.15.137:0/3458812255 >> 172.21.15.137:0/3458812255 conn(0x5653b4e62120 msgr2=0x5653b4e57ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:16.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa011c11740 1 -- 172.21.15.137:0/3458812255 shutdown_connections 2024-04-26T22:01:16.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.138+0000 7fa011c11740 1 -- 172.21.15.137:0/3458812255 wait complete. 2024-04-26T22:01:16.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.139+0000 7fa011c11740 1 -- start start 2024-04-26T22:01:16.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.139+0000 7fa011c11740 1 Processor -- start 2024-04-26T22:01:16.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa011c11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e60490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa011c11740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e9e300 0x5653b4eb6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa011c11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 0x5653b4e9cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa011c11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5653b4e8d100 con 0x5653b4e8c440 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa011c11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5653b4e9f2a0 con 0x5653b4ea9ce0 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa011c11740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5653b4e8d6f0 con 0x5653b4e9e300 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa011c11740 10 client.0 _ll_register_callbacks cb 0x7f9ffc0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00cc98640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e60490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00cc98640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e60490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49584/0 (socket says 172.21.15.137:49584) 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00cc98640 1 -- 172.21.15.137:0/610187207 learned_addr learned my addr 172.21.15.137:0/610187207 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa007fff640 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e9e300 0x5653b4eb6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00d499640 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 0x5653b4e9cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00cc98640 1 -- 172.21.15.137:0/610187207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e9e300 msgr2=0x5653b4eb6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00cc98640 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e9e300 0x5653b4eb6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00cc98640 1 -- 172.21.15.137:0/610187207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 msgr2=0x5653b4e9cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00cc98640 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 0x5653b4e9cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00cc98640 1 -- 172.21.15.137:0/610187207 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653b4eb7180 con 0x5653b4e8c440 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00d499640 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 0x5653b4e9cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7fa00cc98640 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e60490 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8012fd0 tx=0x7f9ff8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4801c283bad14d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.140+0000 7f9fe77fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7f9fe77fe640 1 -- 172.21.15.137:0/610187207 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8076060 con 0x5653b4e8c440 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7f9fe77fe640 1 -- 172.21.15.137:0/610187207 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f9ff8055af0 con 0x5653b4e8c440 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 1 -- 172.21.15.137:0/610187207 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa000049680 con 0x5653b4e8c440 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7f9fe77fe640 1 -- 172.21.15.137:0/610187207 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9ff8012d00 con 0x5653b4e8c440 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 10 client.6207 fetch_fsmap learned FSMap version 26 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 1 -- 172.21.15.137:0/610187207 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5653b4e8a920 con 0x5653b4e8c440 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7f9fe77fe640 1 -- 172.21.15.137:0/610187207 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa000049680 con 0x5653b4e8c440 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7f9fe77fe640 1 -- 172.21.15.137:0/610187207 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f9ff8077250 con 0x5653b4e8c440 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 10 client.6207 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 10 client.6207 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:01:16.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 20 client.6207 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5653b4eca250 0x5653b4eca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 4 client.6207 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 1 -- 172.21.15.137:0/610187207 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "status"}) -- 0x5653b4dce1c0 con 0x5653b4eca250 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa007fff640 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5653b4eca250 0x5653b4eca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7f9fe77fe640 10 client.6207 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa007fff640 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5653b4eca250 0x5653b4eca630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fd16417b8c1545b server_cookie=db453430cbb99a92 in_seq=0 out_seq=0 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7f9fe77fe640 1 -- 172.21.15.137:0/610187207 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5653b4dce1c0 con 0x5653b4eca250 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7f9fe77fe640 10 client.6207 handle_command_reply: tid=0 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.141+0000 7fa011c11740 1 client.6207 shutdown 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 -- 172.21.15.137:0/610187207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 msgr2=0x5653b4e60490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e60490 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8012fd0 tx=0x7f9ff8000bc0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 -- 172.21.15.137:0/610187207 shutdown_connections 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5653b4eca250 0x5653b4eca630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653b4ea9ce0 0x5653b4e9cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653b4e9e300 0x5653b4eb6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7f9fe77fe640 0 client.6207 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:16.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 --2- 172.21.15.137:0/610187207 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653b4e8c440 0x5653b4e60490 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 -- 172.21.15.137:0/610187207 >> 172.21.15.137:0/610187207 conn(0x5653b4e62120 msgr2=0x5653b4ea88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:16.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 -- 172.21.15.137:0/610187207 shutdown_connections 2024-04-26T22:01:16.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 1 -- 172.21.15.137:0/610187207 wait complete. 2024-04-26T22:01:16.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa011c11740 20 client.6207 trim_cache size 0 max 16384 2024-04-26T22:01:16.149 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:01:16.149 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:01:16.149 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 6060, 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.6000925759999998, 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 26, 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 60, 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 60, 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 9.6611366810000003 2024-04-26T22:01:16.150 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:01:16.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 -- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ff406c8f0 msgr2=0x7f9ff406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ff406c8f0 0x7f9ff406edb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009560 tx=0x7f9ffc009190 comp rx=0 tx=0).stop 2024-04-26T22:01:16.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 -- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0080b2310 msgr2=0x7fa008164d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0080b2310 0x7fa008164d70 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800c500 tx=0x7f9ff800c9c0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 -- 172.21.15.137:0/3836401291 shutdown_connections 2024-04-26T22:01:16.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9ff406c8f0 0x7f9ff406edb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0080cd5a0 0x7fa0080d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0080c5f20 0x7fa00815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 --2- 172.21.15.137:0/3836401291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0080b2310 0x7fa008164d70 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 -- 172.21.15.137:0/3836401291 >> 172.21.15.137:0/3836401291 conn(0x7fa0080b4a40 msgr2=0x7fa00809bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:16.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 -- 172.21.15.137:0/3836401291 shutdown_connections 2024-04-26T22:01:16.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.142+0000 7fa00eefc640 1 -- 172.21.15.137:0/3836401291 wait complete. 2024-04-26T22:01:16.153 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:01:16.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.250+0000 7f343ffda640 1 Processor -- start 2024-04-26T22:01:16.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.250+0000 7f343ffda640 1 -- start start 2024-04-26T22:01:16.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343ffda640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3438145980 0x7f3438160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343ffda640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34380b61a0 0x7f34380720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343ffda640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34380b4260 con 0x7f34380b3de0 2024-04-26T22:01:16.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343ffda640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f34380b5140 con 0x7f3438145980 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343ffda640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f34380b4530 con 0x7f34380b61a0 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343e577640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34380b61a0 0x7f34380720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343e577640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34380b61a0 0x7f34380720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:49018/0 (socket says 172.21.15.137:49018) 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343dd76640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3438145980 0x7f3438160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343e577640 1 -- 172.21.15.137:0/3099526607 learned_addr learned my addr 172.21.15.137:0/3099526607 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343dd76640 1 -- 172.21.15.137:0/3099526607 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34380b61a0 msgr2=0x7f34380720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343dd76640 1 --2- 172.21.15.137:0/3099526607 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34380b61a0 0x7f34380720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343dd76640 1 -- 172.21.15.137:0/3099526607 >> v1:172.21.15.170:6789/0 conn(0x7f34380b3de0 legacy=0x7f34380b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343dd76640 1 -- 172.21.15.137:0/3099526607 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34380b4810 con 0x7f3438145980 2024-04-26T22:01:16.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.251+0000 7f343e577640 1 --2- 172.21.15.137:0/3099526607 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34380b61a0 0x7f34380720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:01:16.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.252+0000 7f343dd76640 1 --2- 172.21.15.137:0/3099526607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3438145980 0x7f3438160630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f34340097a0 tx=0x7f343402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73ae28f98f514386 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.252+0000 7f343cd74640 1 -- 172.21.15.137:0/3099526607 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434037070 con 0x7f3438145980 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.252+0000 7f343cd74640 1 -- 172.21.15.137:0/3099526607 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f343402ae50 con 0x7f3438145980 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.252+0000 7f343cd74640 1 -- 172.21.15.137:0/3099526607 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434032660 con 0x7f3438145980 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.253+0000 7f343ffda640 1 -- 172.21.15.137:0/3099526607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3438145980 msgr2=0x7f3438160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.253+0000 7f343ffda640 1 --2- 172.21.15.137:0/3099526607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3438145980 0x7f3438160630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f34340097a0 tx=0x7f343402a100 comp rx=0 tx=0).stop 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.253+0000 7f343ffda640 1 -- 172.21.15.137:0/3099526607 shutdown_connections 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.253+0000 7f343ffda640 1 --2- 172.21.15.137:0/3099526607 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34380b61a0 0x7f34380720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.253+0000 7f343ffda640 1 --2- 172.21.15.137:0/3099526607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3438145980 0x7f3438160630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.253+0000 7f343ffda640 1 -- 172.21.15.137:0/3099526607 >> 172.21.15.137:0/3099526607 conn(0x7f34380d0d30 msgr2=0x7f34380d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:16.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.253+0000 7f343ffda640 1 -- 172.21.15.137:0/3099526607 shutdown_connections 2024-04-26T22:01:16.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.253+0000 7f343ffda640 1 -- 172.21.15.137:0/3099526607 wait complete. 2024-04-26T22:01:16.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.254+0000 7f343ffda640 1 Processor -- start 2024-04-26T22:01:16.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.254+0000 7f343ffda640 1 -- start start 2024-04-26T22:01:16.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343ffda640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34380b3de0 0x7f343815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343ffda640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34380b61a0 0x7f3438144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343ffda640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3438145980 0x7f3438140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343ffda640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3438072610 con 0x7f34380b3de0 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343ffda640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f34380b4dd0 con 0x7f34380b61a0 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343ffda640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3438072790 con 0x7f3438145980 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343dd76640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34380b3de0 0x7f343815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343dd76640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34380b3de0 0x7f343815ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49598/0 (socket says 172.21.15.137:49598) 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343dd76640 1 -- 172.21.15.137:0/2577481395 learned_addr learned my addr 172.21.15.137:0/2577481395 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343e577640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3438145980 0x7f3438140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343d575640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34380b61a0 0x7f3438144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343dd76640 1 -- 172.21.15.137:0/2577481395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3438145980 msgr2=0x7f3438140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343dd76640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3438145980 0x7f3438140970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343dd76640 1 -- 172.21.15.137:0/2577481395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34380b61a0 msgr2=0x7f3438144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343dd76640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34380b61a0 0x7f3438144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343dd76640 1 -- 172.21.15.137:0/2577481395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343813f8d0 con 0x7f34380b3de0 2024-04-26T22:01:16.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343dd76640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34380b3de0 0x7f343815ac50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f343402a140 tx=0x7f34340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f342e7fc640 1 -- 172.21.15.137:0/2577481395 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434041070 con 0x7f34380b3de0 2024-04-26T22:01:16.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f342e7fc640 1 -- 172.21.15.137:0/2577481395 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f343403c670 con 0x7f34380b3de0 2024-04-26T22:01:16.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343813fbb0 con 0x7f34380b3de0 2024-04-26T22:01:16.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f342e7fc640 1 -- 172.21.15.137:0/2577481395 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434037040 con 0x7f34380b3de0 2024-04-26T22:01:16.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.255+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3438140170 con 0x7f34380b3de0 2024-04-26T22:01:16.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.256+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343806a290 con 0x7f34380b3de0 2024-04-26T22:01:16.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.257+0000 7f342e7fc640 1 -- 172.21.15.137:0/2577481395 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3434044070 con 0x7f34380b3de0 2024-04-26T22:01:16.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.257+0000 7f342e7fc640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f341c06c920 0x7f341c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:16.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.257+0000 7f342e7fc640 1 -- 172.21.15.137:0/2577481395 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f34340ac050 con 0x7f34380b3de0 2024-04-26T22:01:16.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.257+0000 7f343d575640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f341c06c920 0x7f341c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:16.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.258+0000 7f343d575640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f341c06c920 0x7f341c06ede0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3438142900 tx=0x7f3428009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:16.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.262+0000 7f342e7fc640 1 -- 172.21.15.137:0/2577481395 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3434079e30 con 0x7f34380b3de0 2024-04-26T22:01:16.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.475+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3438073cc0 con 0x7f34380b3de0 2024-04-26T22:01:16.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.475+0000 7f342e7fc640 1 -- 172.21.15.137:0/2577481395 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+73 (secure 0 0 0) 0x7f343407e130 con 0x7f34380b3de0 2024-04-26T22:01:16.475 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f341c06c920 msgr2=0x7f341c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f341c06c920 0x7f341c06ede0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3438142900 tx=0x7f3428009040 comp rx=0 tx=0).stop 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34380b3de0 msgr2=0x7f343815ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34380b3de0 0x7f343815ac50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f343402a140 tx=0x7f34340046c0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 shutdown_connections 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f341c06c920 0x7f341c06ede0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3438145980 0x7f3438140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34380b61a0 0x7f3438144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 --2- 172.21.15.137:0/2577481395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34380b3de0 0x7f343815ac50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 >> 172.21.15.137:0/2577481395 conn(0x7f34380d0d30 msgr2=0x7f34380b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 shutdown_connections 2024-04-26T22:01:16.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16.477+0000 7f343ffda640 1 -- 172.21.15.137:0/2577481395 wait complete. 2024-04-26T22:01:16.488 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:01:16.488 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:01:16.488 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:01:16.489 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:01:16.489 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:01:16.489 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:01:16.489 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:01:16.489 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:01:16.489 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:01:16.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:16.489 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:01:16.504 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:01:16.504 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:01:16.505 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42630sec preferred_lft 42630sec 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:01:16.506 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:01:16.507 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:01:16.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:16.508 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:01:16.567 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:01:16.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:16.569 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:01:16.624 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:01:16.624 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:01:16.624 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:01:16.624 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:01:16.624 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:01:16.624 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:01:16.624 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:01:16.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:01:16.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:01:16.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:01:16.625 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:01:16.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:01:16.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:01:16.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:16.749 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:01:16.763 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:01:16.763 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:01:16.763 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:01:16.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:16.763 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:01:16.813 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:01:16.814+0000 7fa5f1d96640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:01:16.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:01:16.827 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:01:16.882 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:01:16.882 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:01:16.882 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:01:16.937 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:01:16.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:16.937 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:01:17.018 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:01:17.019 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:01:17.026 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:01:17.026 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:01:17.026 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:01:17.026 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:01:17.026 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:01:17.027 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:01:17.027 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:01:17.027 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:01:17.027 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:01:17.027 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:01:17.029 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:01:17.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:17.029 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:01:17.094 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:01:17.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:01:17.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:01:17.193 INFO:teuthology.orchestra.run.smithi137.stdout:client6213 2024-04-26T22:01:17.194 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:01:17.194 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:01:17.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:17.209 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-04-26T22:01:17.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:17.268 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-04-26T22:01:17.325 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:01:17.325 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:01:17.325 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:01:17.325 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:01:17.325 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-04-26T22:01:17.325 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:01:17.429 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627777 2024-04-26T22:01:17.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:01:17.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:01:17.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.576+0000 7f89a9f38640 1 Processor -- start 2024-04-26T22:01:17.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.577+0000 7f89a9f38640 1 -- start start 2024-04-26T22:01:17.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.577+0000 7f89a9f38640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89a40d3ee0 0x7f89a40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:17.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.577+0000 7f89a9f38640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f89a415f750 0x7f89a40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:17.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.577+0000 7f89a9f38640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a40d03a0 con 0x7f89a415f370 2024-04-26T22:01:17.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.577+0000 7f89a9f38640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f89a40b4d10 con 0x7f89a40d3ee0 2024-04-26T22:01:17.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.577+0000 7f89a9f38640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f89a40d0680 con 0x7f89a415f750 2024-04-26T22:01:17.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.577+0000 7f89a2ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89a40d3ee0 0x7f89a40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:17.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a37fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f89a415f370 0x7f89a40d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42426/0 (socket says 172.21.15.137:42426) 2024-04-26T22:01:17.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a2ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89a40d3ee0 0x7f89a40cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49610/0 (socket says 172.21.15.137:49610) 2024-04-26T22:01:17.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a37fe640 1 -- 172.21.15.137:0/3312794377 learned_addr learned my addr 172.21.15.137:0/3312794377 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:17.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a2ffd640 1 -- 172.21.15.137:0/3312794377 >> v2:172.21.15.170:3300/0 conn(0x7f89a415f750 msgr2=0x7f89a40b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:17.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a3fff640 1 --2- 172.21.15.137:0/3312794377 >> v2:172.21.15.170:3300/0 conn(0x7f89a415f750 0x7f89a40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:17.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a27fc640 1 -- 172.21.15.137:0/3312794377 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3325785315 0 0) 0x7f89a40d03a0 con 0x7f89a415f370 2024-04-26T22:01:17.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a2ffd640 1 --2- 172.21.15.137:0/3312794377 >> v2:172.21.15.170:3300/0 conn(0x7f89a415f750 0x7f89a40b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a2ffd640 1 -- 172.21.15.137:0/3312794377 >> v1:172.21.15.137:6789/0 conn(0x7f89a415f370 legacy=0x7f89a40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:17.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a2ffd640 1 -- 172.21.15.137:0/3312794377 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40d0960 con 0x7f89a40d3ee0 2024-04-26T22:01:17.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.578+0000 7f89a2ffd640 1 --2- 172.21.15.137:0/3312794377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a40d3ee0 0x7f89a40cfd70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f89980097a0 tx=0x7f899802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2cff9e0bd21900 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:17.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a27fc640 1 -- 172.21.15.137:0/3312794377 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998037070 con 0x7f89a40d3ee0 2024-04-26T22:01:17.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a27fc640 1 -- 172.21.15.137:0/3312794377 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8998032440 con 0x7f89a40d3ee0 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a27fc640 1 -- 172.21.15.137:0/3312794377 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998032810 con 0x7f89a40d3ee0 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a9f38640 1 -- 172.21.15.137:0/3312794377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a40d3ee0 msgr2=0x7f89a40cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a9f38640 1 --2- 172.21.15.137:0/3312794377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a40d3ee0 0x7f89a40cfd70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f89980097a0 tx=0x7f899802a1e0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a9f38640 1 -- 172.21.15.137:0/3312794377 shutdown_connections 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a9f38640 1 --2- 172.21.15.137:0/3312794377 >> v2:172.21.15.170:3300/0 conn(0x7f89a415f750 0x7f89a40b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a9f38640 1 --2- 172.21.15.137:0/3312794377 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a40d3ee0 0x7f89a40cfd70 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a9f38640 1 -- 172.21.15.137:0/3312794377 >> 172.21.15.137:0/3312794377 conn(0x7f89a408ec10 msgr2=0x7f89a409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a9f38640 1 -- 172.21.15.137:0/3312794377 shutdown_connections 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.579+0000 7f89a9f38640 1 -- 172.21.15.137:0/3312794377 wait complete. 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.580+0000 7f89a9f38640 1 Processor -- start 2024-04-26T22:01:17.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a9f38640 1 -- start start 2024-04-26T22:01:17.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a9f38640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40d3ee0 0x7f89a40cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:17.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a9f38640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a415f370 0x7f89a4155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:17.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a9f38640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a415f750 0x7f89a40c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:17.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a9f38640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f89a40b51c0 con 0x7f89a415f750 2024-04-26T22:01:17.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a9f38640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f89a40d0f20 con 0x7f89a40d3ee0 2024-04-26T22:01:17.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a9f38640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89a40b5340 con 0x7f89a415f370 2024-04-26T22:01:17.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a415f750 0x7f89a40c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a415f750 0x7f89a40c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49614/0 (socket says 172.21.15.137:49614) 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.581+0000 7f89a3fff640 1 -- 172.21.15.137:0/713315487 learned_addr learned my addr 172.21.15.137:0/713315487 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a37fe640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40d3ee0 0x7f89a40cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a2ffd640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a415f370 0x7f89a4155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a3fff640 1 -- 172.21.15.137:0/713315487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a415f370 msgr2=0x7f89a4155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a3fff640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a415f370 0x7f89a4155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a3fff640 1 -- 172.21.15.137:0/713315487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40d3ee0 msgr2=0x7f89a40cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a3fff640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40d3ee0 0x7f89a40cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a3fff640 1 -- 172.21.15.137:0/713315487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a41609b0 con 0x7f89a415f750 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a3fff640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a415f750 0x7f89a40c9570 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f899c00cc30 tx=0x7f899c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f898bfff640 1 -- 172.21.15.137:0/713315487 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c00ce40 con 0x7f89a415f750 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f898bfff640 1 -- 172.21.15.137:0/713315487 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c003990 con 0x7f89a415f750 2024-04-26T22:01:17.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a40ce300 con 0x7f89a415f750 2024-04-26T22:01:17.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f898bfff640 1 -- 172.21.15.137:0/713315487 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c003d40 con 0x7f89a415f750 2024-04-26T22:01:17.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.582+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a40ce8c0 con 0x7f89a415f750 2024-04-26T22:01:17.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.583+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a406a290 con 0x7f89a415f750 2024-04-26T22:01:17.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.584+0000 7f898bfff640 1 -- 172.21.15.137:0/713315487 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f899c003ee0 con 0x7f89a415f750 2024-04-26T22:01:17.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.584+0000 7f898bfff640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:17.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.584+0000 7f89a37fe640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:17.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.584+0000 7f898bfff640 1 -- 172.21.15.137:0/713315487 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f899c08be60 con 0x7f89a415f750 2024-04-26T22:01:17.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.585+0000 7f89a37fe640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8994000f60 tx=0x7f8994007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:17.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.589+0000 7f898bfff640 1 -- 172.21.15.137:0/713315487 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f899c014030 con 0x7f89a415f750 2024-04-26T22:01:17.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.800+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89a4162e60 con 0x7f89a415f750 2024-04-26T22:01:17.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.801+0000 7f898bfff640 1 -- 172.21.15.137:0/713315487 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+5193 (secure 0 0 0) 0x7f899c059cd0 con 0x7f89a415f750 2024-04-26T22:01:17.801 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:17.801 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:01:10.893739+0000","modified":"2024-04-26T22:01:12.886844+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/4265926631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":4265926631},{"type":"v1","addr":"172.21.15.137:6837","nonce":4265926631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6060,"qdb_cluster":[6060]},"id":4}]} 2024-04-26T22:01:17.801 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 26 2024-04-26T22:01:17.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 msgr2=0x7f899006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:17.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8994000f60 tx=0x7f8994007d50 comp rx=0 tx=0).stop 2024-04-26T22:01:17.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a415f750 msgr2=0x7f89a40c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:17.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a415f750 0x7f89a40c9570 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f899c00cc30 tx=0x7f899c00a5c0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 shutdown_connections 2024-04-26T22:01:17.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f899006c920 0x7f899006ede0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89a415f750 0x7f89a40c9570 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89a415f370 0x7f89a4155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 --2- 172.21.15.137:0/713315487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f89a40d3ee0 0x7f89a40cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.802+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 >> 172.21.15.137:0/713315487 conn(0x7f89a408ec10 msgr2=0x7f89a415e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:17.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.803+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 shutdown_connections 2024-04-26T22:01:17.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.803+0000 7f89a9f38640 1 -- 172.21.15.137:0/713315487 wait complete. 2024-04-26T22:01:17.814 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-26T22:01:17.940 INFO:teuthology.orchestra.run.smithi137.stdout:{"message":"","return_code":0} 2024-04-26T22:01:17.941 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T22:01:17.941 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-26T22:01:17.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.983+0000 7f48f780bf40 1 Processor -- start 2024-04-26T22:01:17.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.983+0000 7f48f780bf40 1 -- start start 2024-04-26T22:01:17.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f780bf40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48dc003bd0 0x563aa7be2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:17.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f780bf40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563aa7bdfff0 0x563aa7be26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:17.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f780bf40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 0x563aa7cc47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:17.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f780bf40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563aa7b88e40 con 0x7f48dc003bd0 2024-04-26T22:01:17.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f780bf40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563aa7b8ce80 con 0x563aa7bdf2a0 2024-04-26T22:01:17.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f780bf40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563aa7c11c60 con 0x563aa7bdfff0 2024-04-26T22:01:17.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4698640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48dc003bd0 0x563aa7be2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:17.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4698640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48dc003bd0 0x563aa7be2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49628/0 (socket says 172.21.15.137:49628) 2024-04-26T22:01:17.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4698640 1 -- 172.21.15.137:0/311771415 learned_addr learned my addr 172.21.15.137:0/311771415 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:17.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f3e97640 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563aa7bdfff0 0x563aa7be26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:17.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4e99640 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 0x563aa7cc47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:17.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4698640 1 -- 172.21.15.137:0/311771415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563aa7bdfff0 msgr2=0x563aa7be26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:17.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4698640 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563aa7bdfff0 0x563aa7be26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4698640 1 -- 172.21.15.137:0/311771415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 msgr2=0x563aa7cc47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:17.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4698640 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 0x563aa7cc47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4698640 1 -- 172.21.15.137:0/311771415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa7cadb30 con 0x7f48dc003bd0 2024-04-26T22:01:17.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4e99640 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 0x563aa7cc47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:17.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.984+0000 7f48f4698640 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48dc003bd0 0x563aa7be2170 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f48e400a7e0 tx=0x7f48e4005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacdf6ae04c7b8d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:17.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f2e95640 1 -- 172.21.15.137:0/311771415 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4017030 con 0x7f48dc003bd0 2024-04-26T22:01:17.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f2e95640 1 -- 172.21.15.137:0/311771415 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e4010ab0 con 0x7f48dc003bd0 2024-04-26T22:01:17.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f2e95640 1 -- 172.21.15.137:0/311771415 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e4010ca0 con 0x7f48dc003bd0 2024-04-26T22:01:17.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f780bf40 1 -- 172.21.15.137:0/311771415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48dc003bd0 msgr2=0x563aa7be2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:17.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f780bf40 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48dc003bd0 0x563aa7be2170 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f48e400a7e0 tx=0x7f48e4005d80 comp rx=0 tx=0).stop 2024-04-26T22:01:17.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f780bf40 1 -- 172.21.15.137:0/311771415 shutdown_connections 2024-04-26T22:01:17.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f780bf40 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 0x563aa7cc47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f780bf40 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563aa7bdfff0 0x563aa7be26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f780bf40 1 --2- 172.21.15.137:0/311771415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48dc003bd0 0x563aa7be2170 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:17.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f780bf40 1 -- 172.21.15.137:0/311771415 >> 172.21.15.137:0/311771415 conn(0x563aa7c2bfd0 msgr2=0x563aa7c20d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:17.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f780bf40 1 -- 172.21.15.137:0/311771415 shutdown_connections 2024-04-26T22:01:17.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.985+0000 7f48f780bf40 1 -- 172.21.15.137:0/311771415 wait complete. 2024-04-26T22:01:18.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.986+0000 7f48f780bf40 1 Processor -- start 2024-04-26T22:01:18.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.986+0000 7f48f780bf40 1 -- start start 2024-04-26T22:01:18.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.986+0000 7f48f780bf40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 0x563aa7caf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.986+0000 7f48f780bf40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563aa7bdfff0 0x563aa7ca1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.986+0000 7f48f780bf40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48dc003bd0 0x563aa7ca5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.986+0000 7f48f780bf40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563aa7c271b0 con 0x563aa7bdfff0 2024-04-26T22:01:18.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.986+0000 7f48f780bf40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563aa7c26ed0 con 0x563aa7bdf2a0 2024-04-26T22:01:18.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.986+0000 7f48f780bf40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563aa7c27490 con 0x7f48dc003bd0 2024-04-26T22:01:18.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.986+0000 7f48f3e97640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563aa7bdfff0 0x563aa7ca1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f3e97640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563aa7bdfff0 0x563aa7ca1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49634/0 (socket says 172.21.15.137:49634) 2024-04-26T22:01:18.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f3e97640 1 -- 172.21.15.137:0/462697796 learned_addr learned my addr 172.21.15.137:0/462697796 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f4698640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 0x563aa7caf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f4e99640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48dc003bd0 0x563aa7ca5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f3e97640 1 -- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48dc003bd0 msgr2=0x563aa7ca5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f3e97640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f48dc003bd0 0x563aa7ca5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f3e97640 1 -- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 msgr2=0x563aa7caf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f3e97640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563aa7bdf2a0 0x563aa7caf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f3e97640 1 -- 172.21.15.137:0/462697796 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa7ca4930 con 0x563aa7bdfff0 2024-04-26T22:01:18.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f3e97640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563aa7bdfff0 0x563aa7ca1c00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f48e8001b70 tx=0x7f48e800f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f1e93640 1 -- 172.21.15.137:0/462697796 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8016020 con 0x563aa7bdfff0 2024-04-26T22:01:18.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f1e93640 1 -- 172.21.15.137:0/462697796 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e8001c60 con 0x563aa7bdfff0 2024-04-26T22:01:18.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f1e93640 1 -- 172.21.15.137:0/462697796 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e80126a0 con 0x563aa7bdfff0 2024-04-26T22:01:18.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563aa7cb1f70 con 0x563aa7bdfff0 2024-04-26T22:01:18.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.987+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aa7cb2530 con 0x563aa7bdfff0 2024-04-26T22:01:18.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.988+0000 7f48f1e93640 1 -- 172.21.15.137:0/462697796 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48e8019020 con 0x563aa7bdfff0 2024-04-26T22:01:18.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.989+0000 7f48f1e93640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48e006b300 0x7f48e006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.989+0000 7f48f1e93640 1 -- 172.21.15.137:0/462697796 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f48e808ad70 con 0x563aa7bdfff0 2024-04-26T22:01:18.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.989+0000 7f48f4698640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48e006b300 0x7f48e006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.989+0000 7f48f780bf40 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x563aa7ca44a0 0x563aa7d4fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.989+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) -- 0x563aa7cacfe0 con 0x563aa7ca44a0 2024-04-26T22:01:18.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.989+0000 7f48f4698640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48e006b300 0x7f48e006d7c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f48e400a7e0 tx=0x7f48e4015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.989+0000 7f48f4e99640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x563aa7ca44a0 0x563aa7d4fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f4e99640 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x563aa7ca44a0 0x563aa7d4fc90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f4e99640 1 -- 172.21.15.137:0/462697796 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) ==== 164+0+94 (crc 0 0 0) 0x7f48ec001470 con 0x563aa7ca44a0 2024-04-26T22:01:18.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x563aa7ca44a0 msgr2=0x563aa7d4fc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x563aa7ca44a0 0x563aa7d4fc90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48e006b300 msgr2=0x7f48e006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48e006b300 0x7f48e006d7c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f48e400a7e0 tx=0x7f48e4015000 comp rx=0 tx=0).stop 2024-04-26T22:01:18.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563aa7bdfff0 msgr2=0x563aa7ca1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 --2- 172.21.15.137:0/462697796 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563aa7bdfff0 0x563aa7ca1c00 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f48e8001b70 tx=0x7f48e800f6b0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f4e99640 1 -- 172.21.15.137:0/462697796 reap_dead start 2024-04-26T22:01:18.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 shutdown_connections 2024-04-26T22:01:18.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 >> 172.21.15.137:0/462697796 conn(0x563aa7c2bfd0 msgr2=0x563aa7c20d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 shutdown_connections 2024-04-26T22:01:18.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:17.990+0000 7f48f780bf40 1 -- 172.21.15.137:0/462697796 wait complete. 2024-04-26T22:01:18.007 INFO:teuthology.orchestra.run.smithi137.stdout:Xfiledir_test 2024-04-26T22:01:18.007 DEBUG:teuthology.orchestra.run.smithi137:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-26T22:01:18.092 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511627777, 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: "ancestors": [ 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: "dirino": 1099511627776, 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: "dname": "file", 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: "version": 2 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: "dirino": 1, 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: "dname": "dir_test", 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: "version": 4 2024-04-26T22:01:18.093 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:18.094 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-26T22:01:18.094 INFO:teuthology.orchestra.run.smithi137.stdout: "pool": 9, 2024-04-26T22:01:18.094 INFO:teuthology.orchestra.run.smithi137.stdout: "old_pools": [] 2024-04-26T22:01:18.094 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:01:18.094 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:18.095 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-04-26T22:01:18.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.180+0000 7fe0f44d1f40 1 Processor -- start 2024-04-26T22:01:18.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.180+0000 7fe0f44d1f40 1 -- start start 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f44d1f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cec9270 0x55f92cf70bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f44d1f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf718a0 0x55f92cf6f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f44d1f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cf71c80 0x55f92cf6fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f44d1f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f92cec47e0 con 0x55f92cf71c80 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f44d1f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f92ce41e40 con 0x55f92cec9270 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f44d1f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f92cee29c0 con 0x55f92cf718a0 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f27ce640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cf71c80 0x55f92cf6fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f27ce640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cf71c80 0x55f92cf6fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49642/0 (socket says 172.21.15.137:49642) 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f27ce640 1 -- 172.21.15.137:0/4243860153 learned_addr learned my addr 172.21.15.137:0/4243860153 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f27ce640 1 -- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf718a0 msgr2=0x55f92cf6f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f1fcd640 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cec9270 0x55f92cf70bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f17cc640 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf718a0 0x55f92cf6f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f27ce640 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf718a0 0x55f92cf6f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f27ce640 1 -- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cec9270 msgr2=0x55f92cf70bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f27ce640 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cec9270 0x55f92cf70bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f27ce640 1 -- 172.21.15.137:0/4243860153 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92cec60e0 con 0x55f92cf71c80 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f1fcd640 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cec9270 0x55f92cf70bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f17cc640 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf718a0 0x55f92cf6f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0f27ce640 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cf71c80 0x55f92cf6fa60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009920 tx=0x7fe0ec005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc8b8f888ae071a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0e3fff640 1 -- 172.21.15.137:0/4243860153 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0089b0 con 0x55f92cf71c80 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0e3fff640 1 -- 172.21.15.137:0/4243860153 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec008b50 con 0x55f92cf71c80 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.181+0000 7fe0e3fff640 1 -- 172.21.15.137:0/4243860153 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec013420 con 0x55f92cf71c80 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/4243860153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cf71c80 msgr2=0x55f92cf6fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cf71c80 0x55f92cf6fa60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009920 tx=0x7fe0ec005a00 comp rx=0 tx=0).stop 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/4243860153 shutdown_connections 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cf71c80 0x55f92cf6fa60 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf718a0 0x55f92cf6f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 --2- 172.21.15.137:0/4243860153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cec9270 0x55f92cf70bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/4243860153 >> 172.21.15.137:0/4243860153 conn(0x55f92cee4fe0 msgr2=0x55f92cf6e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/4243860153 shutdown_connections 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/4243860153 wait complete. 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 Processor -- start 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.182+0000 7fe0f44d1f40 1 -- start start 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f44d1f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cec9270 0x55f92ce9bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f44d1f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cf718a0 0x55f92cf6f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f44d1f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf71c80 0x55f92cf60830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f44d1f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f92cec6680 con 0x55f92cec9270 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f44d1f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f92cec63a0 con 0x55f92cf718a0 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f44d1f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f92cf706d0 con 0x55f92cf71c80 2024-04-26T22:01:18.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f1fcd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cec9270 0x55f92ce9bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f1fcd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cec9270 0x55f92ce9bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49656/0 (socket says 172.21.15.137:49656) 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f1fcd640 1 -- 172.21.15.137:0/361943024 learned_addr learned my addr 172.21.15.137:0/361943024 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f17cc640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cf718a0 0x55f92cf6f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f27ce640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf71c80 0x55f92cf60830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f1fcd640 1 -- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf71c80 msgr2=0x55f92cf60830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f1fcd640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f92cf71c80 0x55f92cf60830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f1fcd640 1 -- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cf718a0 msgr2=0x55f92cf6f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f1fcd640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f92cf718a0 0x55f92cf6f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.183+0000 7fe0f1fcd640 1 -- 172.21.15.137:0/361943024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92ce989a0 con 0x55f92cec9270 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.184+0000 7fe0f1fcd640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cec9270 0x55f92ce9bd60 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40259e0 tx=0x7fe0e4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.184+0000 7fe0e2ffd640 1 -- 172.21.15.137:0/361943024 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4056040 con 0x55f92cec9270 2024-04-26T22:01:18.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.184+0000 7fe0e2ffd640 1 -- 172.21.15.137:0/361943024 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e4067480 con 0x55f92cec9270 2024-04-26T22:01:18.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.184+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f92ce983e0 con 0x55f92cec9270 2024-04-26T22:01:18.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.184+0000 7fe0e2ffd640 1 -- 172.21.15.137:0/361943024 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4005a80 con 0x55f92cec9270 2024-04-26T22:01:18.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.184+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92cf6ddc0 con 0x55f92cec9270 2024-04-26T22:01:18.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.185+0000 7fe0e2ffd640 1 -- 172.21.15.137:0/361943024 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0e4059020 con 0x55f92cec9270 2024-04-26T22:01:18.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.185+0000 7fe0e2ffd640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe0d406b300 0x7fe0d406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.186+0000 7fe0e2ffd640 1 -- 172.21.15.137:0/361943024 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe0e40ce620 con 0x55f92cec9270 2024-04-26T22:01:18.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.186+0000 7fe0f17cc640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe0d406b300 0x7fe0d406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.186+0000 7fe0f44d1f40 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f92d012c50 0x55f92d015040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.186+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) -- 0x55f92cf60d70 con 0x55f92d012c50 2024-04-26T22:01:18.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.186+0000 7fe0f17cc640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe0d406b300 0x7fe0d406d7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55f92cee3120 tx=0x7fe0e8001780 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.186+0000 7fe0f27ce640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f92d012c50 0x55f92d015040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.186+0000 7fe0f27ce640 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f92d012c50 0x55f92d015040 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f27ce640 1 -- 172.21.15.137:0/361943024 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v60'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe0ec0087b0 con 0x55f92d012c50 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f92d012c50 msgr2=0x55f92d015040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f92d012c50 0x55f92d015040 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe0d406b300 msgr2=0x7fe0d406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe0d406b300 0x7fe0d406d7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55f92cee3120 tx=0x7fe0e8001780 comp rx=0 tx=0).stop 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cec9270 msgr2=0x55f92ce9bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 --2- 172.21.15.137:0/361943024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f92cec9270 0x55f92ce9bd60 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40259e0 tx=0x7fe0e4003330 comp rx=0 tx=0).stop 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f27ce640 1 -- 172.21.15.137:0/361943024 reap_dead start 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 shutdown_connections 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 >> 172.21.15.137:0/361943024 conn(0x55f92cee4fe0 msgr2=0x55f92cee1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 shutdown_connections 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.188+0000 7fe0f44d1f40 1 -- 172.21.15.137:0/361943024 wait complete. 2024-04-26T22:01:18.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:18.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-04-26T22:01:18.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.295+0000 7fb75d90a640 1 Processor -- start 2024-04-26T22:01:18.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.295+0000 7fb75d90a640 1 -- start start 2024-04-26T22:01:18.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb75d90a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7580cee20 0x7fb75806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb75d90a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb75809c150 0x7fb75815eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb75d90a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7580d1240 con 0x7fb7580d3a30 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb75d90a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb7580d1e10 con 0x7fb75809c150 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb75d90a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7580d14e0 con 0x7fb7580cee20 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb7567fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb7580d3a30 0x7fb75809ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42454/0 (socket says 172.21.15.137:42454) 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb7567fc640 1 -- 172.21.15.137:0/3868064785 learned_addr learned my addr 172.21.15.137:0/3868064785 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb7577fe640 1 --2- 172.21.15.137:0/3868064785 >> v2:172.21.15.170:3300/0 conn(0x7fb75809c150 0x7fb75815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb756ffd640 1 --2- 172.21.15.137:0/3868064785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7580cee20 0x7fb75806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb755ffb640 1 -- 172.21.15.137:0/3868064785 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811945926 0 0) 0x7fb7580d1240 con 0x7fb7580d3a30 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.296+0000 7fb755ffb640 1 -- 172.21.15.137:0/3868064785 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb740003520 con 0x7fb7580d3a30 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.297+0000 7fb756ffd640 1 -- 172.21.15.137:0/3868064785 >> v2:172.21.15.170:3300/0 conn(0x7fb75809c150 msgr2=0x7fb75815eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.297+0000 7fb755ffb640 1 -- 172.21.15.137:0/3868064785 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4167720399 0 0) 0x7fb740003520 con 0x7fb7580d3a30 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.297+0000 7fb756ffd640 1 --2- 172.21.15.137:0/3868064785 >> v2:172.21.15.170:3300/0 conn(0x7fb75809c150 0x7fb75815eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.297+0000 7fb756ffd640 1 -- 172.21.15.137:0/3868064785 >> v1:172.21.15.137:6789/0 conn(0x7fb7580d3a30 legacy=0x7fb75809ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.297+0000 7fb756ffd640 1 -- 172.21.15.137:0/3868064785 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7580d17c0 con 0x7fb7580cee20 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.297+0000 7fb756ffd640 1 --2- 172.21.15.137:0/3868064785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7580cee20 0x7fb75806d5c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb748009d90 tx=0x7fb74802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a7d34699a0df30 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.297+0000 7fb755ffb640 1 -- 172.21.15.137:0/3868064785 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74c001670 con 0x7fb7580cee20 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.297+0000 7fb755ffb640 1 -- 172.21.15.137:0/3868064785 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb748007540 con 0x7fb7580cee20 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.297+0000 7fb755ffb640 1 -- 172.21.15.137:0/3868064785 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7480078f0 con 0x7fb7580cee20 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.298+0000 7fb75d90a640 1 -- 172.21.15.137:0/3868064785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7580cee20 msgr2=0x7fb75806d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.298+0000 7fb75d90a640 1 --2- 172.21.15.137:0/3868064785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7580cee20 0x7fb75806d5c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb748009d90 tx=0x7fb74802a680 comp rx=0 tx=0).stop 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.298+0000 7fb75d90a640 1 -- 172.21.15.137:0/3868064785 shutdown_connections 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.298+0000 7fb75d90a640 1 --2- 172.21.15.137:0/3868064785 >> v2:172.21.15.170:3300/0 conn(0x7fb75809c150 0x7fb75815eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.298+0000 7fb75d90a640 1 --2- 172.21.15.137:0/3868064785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb7580cee20 0x7fb75806d5c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.298+0000 7fb75d90a640 1 -- 172.21.15.137:0/3868064785 >> 172.21.15.137:0/3868064785 conn(0x7fb7580d2f10 msgr2=0x7fb7580d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.298+0000 7fb75d90a640 1 -- 172.21.15.137:0/3868064785 shutdown_connections 2024-04-26T22:01:18.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.298+0000 7fb75d90a640 1 -- 172.21.15.137:0/3868064785 wait complete. 2024-04-26T22:01:18.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.299+0000 7fb75d90a640 1 Processor -- start 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.299+0000 7fb75d90a640 1 -- start start 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb75d90a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb75809c150 0x7fb7581d97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb75d90a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580cee20 0x7fb7581d9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb75d90a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7580d3a30 0x7fb7581f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb75d90a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7580cf200 con 0x7fb7580d3a30 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb75d90a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb75809c7a0 con 0x7fb7580cee20 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb75d90a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7580cf380 con 0x7fb75809c150 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb7577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7580d3a30 0x7fb7581f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb7577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7580d3a30 0x7fb7581f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49662/0 (socket says 172.21.15.137:49662) 2024-04-26T22:01:18.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb7577fe640 1 -- 172.21.15.137:0/44723697 learned_addr learned my addr 172.21.15.137:0/44723697 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb7567fc640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580cee20 0x7fb7581d9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.300+0000 7fb756ffd640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb75809c150 0x7fb7581d97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb7577fe640 1 -- 172.21.15.137:0/44723697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb75809c150 msgr2=0x7fb7581d97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb7577fe640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb75809c150 0x7fb7581d97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb7577fe640 1 -- 172.21.15.137:0/44723697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580cee20 msgr2=0x7fb7581d9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb7577fe640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580cee20 0x7fb7581d9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb7577fe640 1 -- 172.21.15.137:0/44723697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75809fac0 con 0x7fb7580d3a30 2024-04-26T22:01:18.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb756ffd640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb75809c150 0x7fb7581d97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:18.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb7577fe640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7580d3a30 0x7fb7581f5a90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb75000e850 tx=0x7fb75000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb73ffff640 1 -- 172.21.15.137:0/44723697 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750017070 con 0x7fb7580d3a30 2024-04-26T22:01:18.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb73ffff640 1 -- 172.21.15.137:0/44723697 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75000c940 con 0x7fb7580d3a30 2024-04-26T22:01:18.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb75d90a640 1 -- 172.21.15.137:0/44723697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75809fda0 con 0x7fb7580d3a30 2024-04-26T22:01:18.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb73ffff640 1 -- 172.21.15.137:0/44723697 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75000cd30 con 0x7fb7580d3a30 2024-04-26T22:01:18.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.301+0000 7fb75d90a640 1 -- 172.21.15.137:0/44723697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7580a0360 con 0x7fb7580d3a30 2024-04-26T22:01:18.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.303+0000 7fb73ffff640 1 -- 172.21.15.137:0/44723697 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb75001a070 con 0x7fb7580d3a30 2024-04-26T22:01:18.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.303+0000 7fb73ffff640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb74406c8f0 0x7fb74406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.303+0000 7fb73ffff640 1 -- 172.21.15.137:0/44723697 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb75008bd80 con 0x7fb7580d3a30 2024-04-26T22:01:18.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.303+0000 7fb756ffd640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb74406c8f0 0x7fb74406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.304+0000 7fb756ffd640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb74406c8f0 0x7fb74406edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb748034000 tx=0x7fb74802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.304+0000 7fb76061d740 1 Processor -- start 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.304+0000 7fb76061d740 1 -- start start 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb76061d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f91110 0x562bb7f94890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb76061d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fb0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb76061d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fb16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb76061d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562bb7ece980 con 0x562bb7fb1250 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb76061d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562bb7e88990 con 0x562bb7f91110 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb76061d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562bb7eca940 con 0x562bb7f94dd0 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fb16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fb16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49672/0 (socket says 172.21.15.137:49672) 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7577fe640 1 -- 172.21.15.137:0/798454226 learned_addr learned my addr 172.21.15.137:0/798454226 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb756ffd640 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f91110 0x562bb7f94890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7567fc640 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fb0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7577fe640 1 -- 172.21.15.137:0/798454226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 msgr2=0x562bb7fb0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7577fe640 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fb0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7577fe640 1 -- 172.21.15.137:0/798454226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f91110 msgr2=0x562bb7f94890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7577fe640 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f91110 0x562bb7f94890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7577fe640 1 -- 172.21.15.137:0/798454226 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bb7e93cd0 con 0x562bb7fb1250 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.305+0000 7fb7567fc640 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fb0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb7577fe640 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fb16b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb7500621f0 tx=0x7fb750059af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d8b387808387dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb73d7fa640 1 -- 172.21.15.137:0/798454226 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750021040 con 0x562bb7fb1250 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb73d7fa640 1 -- 172.21.15.137:0/798454226 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb750057ef0 con 0x562bb7fb1250 2024-04-26T22:01:18.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb73d7fa640 1 -- 172.21.15.137:0/798454226 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750059040 con 0x562bb7fb1250 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb76061d740 1 -- 172.21.15.137:0/798454226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 msgr2=0x562bb7fb16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb76061d740 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fb16b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb7500621f0 tx=0x7fb750059af0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb76061d740 1 -- 172.21.15.137:0/798454226 shutdown_connections 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb76061d740 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fb16b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb76061d740 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fb0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb76061d740 1 --2- 172.21.15.137:0/798454226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f91110 0x562bb7f94890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb76061d740 1 -- 172.21.15.137:0/798454226 >> 172.21.15.137:0/798454226 conn(0x562bb7f67380 msgr2=0x562bb7f680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb76061d740 1 -- 172.21.15.137:0/798454226 shutdown_connections 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.306+0000 7fb76061d740 1 -- 172.21.15.137:0/798454226 wait complete. 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.307+0000 7fb76061d740 1 -- start start 2024-04-26T22:01:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.307+0000 7fb76061d740 1 Processor -- start 2024-04-26T22:01:18.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb76061d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f94dd0 0x562bb7fa9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb76061d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 0x562bb7faa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb76061d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 0x562bb7f96ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb76061d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562bb7f651b0 con 0x562bb7f94dd0 2024-04-26T22:01:18.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb76061d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562bb7e55e50 con 0x562bb7f83420 2024-04-26T22:01:18.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb76061d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562bb7f65490 con 0x562bb7fb1250 2024-04-26T22:01:18.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb76061d740 10 client.0 _ll_register_callbacks cb 0x562bb7e79fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:18.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb756ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f94dd0 0x562bb7fa9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb756ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f94dd0 0x562bb7fa9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49680/0 (socket says 172.21.15.137:49680) 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb756ffd640 1 -- 172.21.15.137:0/2541558136 learned_addr learned my addr 172.21.15.137:0/2541558136 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb7577fe640 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 0x562bb7f96ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb7567fc640 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 0x562bb7faa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb756ffd640 1 -- 172.21.15.137:0/2541558136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 msgr2=0x562bb7faa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb756ffd640 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 0x562bb7faa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb756ffd640 1 -- 172.21.15.137:0/2541558136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 msgr2=0x562bb7f96ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb756ffd640 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 0x562bb7f96ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb756ffd640 1 -- 172.21.15.137:0/2541558136 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bb7cac7b0 con 0x562bb7f94dd0 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb756ffd640 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f94dd0 0x562bb7fa9e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb74802ac70 tx=0x7fb748004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05d569b1e501215 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb7367fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb7367fc640 1 -- 172.21.15.137:0/2541558136 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748007800 con 0x562bb7f94dd0 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb7367fc640 1 -- 172.21.15.137:0/2541558136 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb7480079a0 con 0x562bb7f94dd0 2024-04-26T22:01:18.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.308+0000 7fb76061d740 1 -- 172.21.15.137:0/2541558136 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb750057ef0 con 0x562bb7f94dd0 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb7367fc640 1 -- 172.21.15.137:0/2541558136 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb748007ba0 con 0x562bb7f94dd0 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb76061d740 10 client.6252 fetch_fsmap learned FSMap version 26 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb76061d740 1 -- 172.21.15.137:0/2541558136 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x562bb7d0cf40 con 0x562bb7f94dd0 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb7367fc640 1 -- 172.21.15.137:0/2541558136 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb750057ef0 con 0x562bb7f94dd0 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb7367fc640 1 -- 172.21.15.137:0/2541558136 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7fb74805e080 con 0x562bb7f94dd0 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb76061d740 10 client.6252 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb76061d740 10 client.6252 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb76061d740 20 client.6252 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb76061d740 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x562bb7f97020 0x562bb7fcdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb76061d740 4 client.6252 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb76061d740 1 -- 172.21.15.137:0/2541558136 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bb7edc590 con 0x562bb7f97020 2024-04-26T22:01:18.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb7567fc640 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x562bb7f97020 0x562bb7fcdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb7567fc640 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x562bb7f97020 0x562bb7fcdd30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57cb37035de6122a server_cookie=cd88077e052b07bc in_seq=0 out_seq=0 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.309+0000 7fb7367fc640 10 client.6252 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb7367fc640 1 -- 172.21.15.137:0/2541558136 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562bb7edc590 con 0x562bb7f97020 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb7367fc640 10 client.6252 handle_command_reply: tid=0 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 client.6252 shutdown 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 -- 172.21.15.137:0/2541558136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f94dd0 msgr2=0x562bb7fa9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f94dd0 0x562bb7fa9e50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb74802ac70 tx=0x7fb748004ab0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 -- 172.21.15.137:0/2541558136 shutdown_connections 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x562bb7f97020 0x562bb7fcdd30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 0x562bb7f96ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 0x562bb7faa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb7367fc640 0 client.6252 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 --2- 172.21.15.137:0/2541558136 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f94dd0 0x562bb7fa9e50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 -- 172.21.15.137:0/2541558136 >> 172.21.15.137:0/2541558136 conn(0x562bb7f91110 msgr2=0x562bb7f63fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 -- 172.21.15.137:0/2541558136 shutdown_connections 2024-04-26T22:01:18.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 1 -- 172.21.15.137:0/2541558136 wait complete. 2024-04-26T22:01:18.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.310+0000 7fb76061d740 20 client.6252 trim_cache size 0 max 16384 2024-04-26T22:01:18.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.327+0000 7fb76061d740 1 Processor -- start 2024-04-26T22:01:18.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb76061d740 1 -- start start 2024-04-26T22:01:18.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb76061d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 0x562bb7f680b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb76061d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fd3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb76061d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fd35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb76061d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb758201700 con 0x562bb7fb1250 2024-04-26T22:01:18.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb76061d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb75809f680 con 0x562bb7f83420 2024-04-26T22:01:18.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb76061d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7581eabb0 con 0x562bb7f94dd0 2024-04-26T22:01:18.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb7577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fd35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb7577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fd35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49694/0 (socket says 172.21.15.137:49694) 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.328+0000 7fb7577fe640 1 -- 172.21.15.137:0/2592585693 learned_addr learned my addr 172.21.15.137:0/2592585693 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb756ffd640 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 0x562bb7f680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb7567fc640 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fd3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb7577fe640 1 -- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 msgr2=0x562bb7fd3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb7577fe640 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fd3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb7577fe640 1 -- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 msgr2=0x562bb7f680b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb7577fe640 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 0x562bb7f680b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb7577fe640 1 -- 172.21.15.137:0/2592585693 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bb7ba00a0 con 0x562bb7fb1250 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb756ffd640 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 0x562bb7f680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb7567fc640 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fd3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb7577fe640 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fd35d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb75008a390 tx=0x7fb75001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984363ccff8f27fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb73cff9640 1 -- 172.21.15.137:0/2592585693 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750021040 con 0x562bb7fb1250 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb73cff9640 1 -- 172.21.15.137:0/2592585693 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb750079070 con 0x562bb7fb1250 2024-04-26T22:01:18.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.329+0000 7fb73cff9640 1 -- 172.21.15.137:0/2592585693 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750056260 con 0x562bb7fb1250 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 -- 172.21.15.137:0/2592585693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 msgr2=0x562bb7fd35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fd35d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb75008a390 tx=0x7fb75001e000 comp rx=0 tx=0).stop 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 -- 172.21.15.137:0/2592585693 shutdown_connections 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7fb1250 0x562bb7fd35d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7f94dd0 0x562bb7fd3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 --2- 172.21.15.137:0/2592585693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f83420 0x562bb7f680b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 -- 172.21.15.137:0/2592585693 >> 172.21.15.137:0/2592585693 conn(0x562bb7f91110 msgr2=0x562bb7fb2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 -- 172.21.15.137:0/2592585693 shutdown_connections 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 -- 172.21.15.137:0/2592585693 wait complete. 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 -- start start 2024-04-26T22:01:18.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.330+0000 7fb76061d740 1 Processor -- start 2024-04-26T22:01:18.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb76061d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f83420 0x562bb7fc2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb76061d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f94dd0 0x562bb7f8b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb76061d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 0x562bb7fd1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb76061d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562bb7fa9c40 con 0x562bb7f83420 2024-04-26T22:01:18.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb76061d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb75809f030 con 0x562bb7f94dd0 2024-04-26T22:01:18.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb76061d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562bb7e7a4e0 con 0x562bb7fb1250 2024-04-26T22:01:18.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb76061d740 10 client.0 _ll_register_callbacks cb 0x7fb750009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:18.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb756ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f83420 0x562bb7fc2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb756ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f83420 0x562bb7fc2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49698/0 (socket says 172.21.15.137:49698) 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb756ffd640 1 -- 172.21.15.137:0/3410765065 learned_addr learned my addr 172.21.15.137:0/3410765065 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb7577fe640 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 0x562bb7fd1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb7567fc640 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f94dd0 0x562bb7f8b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb756ffd640 1 -- 172.21.15.137:0/3410765065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 msgr2=0x562bb7fd1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb756ffd640 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 0x562bb7fd1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb756ffd640 1 -- 172.21.15.137:0/3410765065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f94dd0 msgr2=0x562bb7f8b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb756ffd640 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f94dd0 0x562bb7f8b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.331+0000 7fb756ffd640 1 -- 172.21.15.137:0/3410765065 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bb7fb39c0 con 0x562bb7f83420 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb756ffd640 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f83420 0x562bb7fc2ff0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb7480042c0 tx=0x7fb748009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b93c93278ae5438 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb7367fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:18.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb7367fc640 1 -- 172.21.15.137:0/3410765065 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74806b060 con 0x562bb7f83420 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb7367fc640 1 -- 172.21.15.137:0/3410765065 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb748007800 con 0x562bb7f83420 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb76061d740 1 -- 172.21.15.137:0/3410765065 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb750079070 con 0x562bb7f83420 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb7367fc640 1 -- 172.21.15.137:0/3410765065 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb748062040 con 0x562bb7f83420 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb76061d740 10 client.6258 fetch_fsmap learned FSMap version 26 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb76061d740 1 -- 172.21.15.137:0/3410765065 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x562bb7f69c20 con 0x562bb7f83420 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb7367fc640 1 -- 172.21.15.137:0/3410765065 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb750079070 con 0x562bb7f83420 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb7367fc640 1 -- 172.21.15.137:0/3410765065 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7fb74803d550 con 0x562bb7f83420 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb76061d740 10 client.6258 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb76061d740 10 client.6258 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb76061d740 20 client.6258 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb76061d740 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x562bb7f8be00 0x562bb7fd2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb76061d740 4 client.6258 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb76061d740 1 -- 172.21.15.137:0/3410765065 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x562bb7ed6400 con 0x562bb7f8be00 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.332+0000 7fb7567fc640 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x562bb7f8be00 0x562bb7fd2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb7367fc640 10 client.6258 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb7567fc640 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x562bb7f8be00 0x562bb7fd2290 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af7d2ea1c91549a server_cookie=b74c55af0bec1acb in_seq=0 out_seq=0 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb7367fc640 1 -- 172.21.15.137:0/3410765065 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562bb7ed6400 con 0x562bb7f8be00 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb7367fc640 10 client.6258 handle_command_reply: tid=0 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 client.6258 shutdown 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 -- 172.21.15.137:0/3410765065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f83420 msgr2=0x562bb7fc2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f83420 0x562bb7fc2ff0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb7480042c0 tx=0x7fb748009750 comp rx=0 tx=0).stop 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 -- 172.21.15.137:0/3410765065 shutdown_connections 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x562bb7f8be00 0x562bb7fd2290 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562bb7fb1250 0x562bb7fd1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562bb7f94dd0 0x562bb7f8b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 --2- 172.21.15.137:0/3410765065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562bb7f83420 0x562bb7fc2ff0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 -- 172.21.15.137:0/3410765065 >> 172.21.15.137:0/3410765065 conn(0x562bb7f91110 msgr2=0x562bb7fd2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb7367fc640 0 client.6258 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.333+0000 7fb76061d740 1 -- 172.21.15.137:0/3410765065 shutdown_connections 2024-04-26T22:01:18.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb76061d740 1 -- 172.21.15.137:0/3410765065 wait complete. 2024-04-26T22:01:18.341 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fa5edd8e640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={6213=0-4194304@1} caps={6213=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6213 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x558821c62680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T22:01:18.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb76061d740 20 client.6258 trim_cache size 0 max 16384 2024-04-26T22:01:18.341 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:01:18.342 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:01:18.342 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "89b2fbbc-37a8-4156-ae77-d6a6ca19433e", 2024-04-26T22:01:18.342 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:01:18.342 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 -- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb74406c8f0 msgr2=0x7fb74406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb74406c8f0 0x7fb74406edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb748034000 tx=0x7fb74802f000 comp rx=0 tx=0).stop 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 -- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7580d3a30 msgr2=0x7fb7581f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7580d3a30 0x7fb7581f5a90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb75000e850 tx=0x7fb75000ed10 comp rx=0 tx=0).stop 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 -- 172.21.15.137:0/44723697 shutdown_connections 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb74406c8f0 0x7fb74406edb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7580d3a30 0x7fb7581f5a90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580cee20 0x7fb7581d9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 --2- 172.21.15.137:0/44723697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb75809c150 0x7fb7581d97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 -- 172.21.15.137:0/44723697 >> 172.21.15.137:0/44723697 conn(0x7fb7580d2f10 msgr2=0x7fb7580d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 -- 172.21.15.137:0/44723697 shutdown_connections 2024-04-26T22:01:18.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.334+0000 7fb75d90a640 1 -- 172.21.15.137:0/44723697 wait complete. 2024-04-26T22:01:18.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:18.345 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-26T22:01:18.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.444+0000 7f43e6a86640 1 Processor -- start 2024-04-26T22:01:18.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.444+0000 7f43e6a86640 1 -- start start 2024-04-26T22:01:18.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e6a86640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f43e015b930 0x7f43e015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e6a86640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f43e015f4f0 0x7f43e0073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e6a86640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43e0074030 0x7f43e00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e6a86640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f43e015c530 con 0x7f43e015b930 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e6a86640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f43e015c810 con 0x7f43e015f4f0 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e6a86640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f43e015caf0 con 0x7f43e0074030 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e4822640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f43e015b930 0x7f43e015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e4822640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f43e015b930 0x7f43e015bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49704/0 (socket says 172.21.15.137:49704) 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e4822640 1 -- 172.21.15.137:0/3085570970 learned_addr learned my addr 172.21.15.137:0/3085570970 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e5023640 1 --2- 172.21.15.137:0/3085570970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43e0074030 0x7f43e00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43dffff640 1 --2- 172.21.15.137:0/3085570970 >> v2:172.21.15.170:3300/0 conn(0x7f43e015f4f0 0x7f43e0073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e4822640 1 -- 172.21.15.137:0/3085570970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43e0074030 msgr2=0x7f43e00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e4822640 1 --2- 172.21.15.137:0/3085570970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43e0074030 0x7f43e00720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e4822640 1 -- 172.21.15.137:0/3085570970 >> v2:172.21.15.170:3300/0 conn(0x7f43e015f4f0 msgr2=0x7f43e0073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e4822640 1 --2- 172.21.15.137:0/3085570970 >> v2:172.21.15.170:3300/0 conn(0x7f43e015f4f0 0x7f43e0073af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43e4822640 1 -- 172.21.15.137:0/3085570970 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e015cdd0 con 0x7f43e015b930 2024-04-26T22:01:18.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.445+0000 7f43dffff640 1 --2- 172.21.15.137:0/3085570970 >> v2:172.21.15.170:3300/0 conn(0x7f43e015f4f0 0x7f43e0073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:18.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.446+0000 7f43e4822640 1 --2- 172.21.15.137:0/3085570970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e015b930 0x7f43e015bd10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b3c10 tx=0x7f43d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79918e051fc1a309 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.446+0000 7f43df7fe640 1 -- 172.21.15.137:0/3085570970 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4037070 con 0x7f43e015b930 2024-04-26T22:01:18.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.446+0000 7f43df7fe640 1 -- 172.21.15.137:0/3085570970 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d4032440 con 0x7f43e015b930 2024-04-26T22:01:18.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.446+0000 7f43df7fe640 1 -- 172.21.15.137:0/3085570970 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4032810 con 0x7f43e015b930 2024-04-26T22:01:18.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.447+0000 7f43e6a86640 1 -- 172.21.15.137:0/3085570970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e015b930 msgr2=0x7f43e015bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.447+0000 7f43e6a86640 1 --2- 172.21.15.137:0/3085570970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e015b930 0x7f43e015bd10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b3c10 tx=0x7f43d402a1e0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.447+0000 7f43e6a86640 1 -- 172.21.15.137:0/3085570970 shutdown_connections 2024-04-26T22:01:18.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.447+0000 7f43e6a86640 1 --2- 172.21.15.137:0/3085570970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43e0074030 0x7f43e00720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.447+0000 7f43e6a86640 1 --2- 172.21.15.137:0/3085570970 >> v2:172.21.15.170:3300/0 conn(0x7f43e015f4f0 0x7f43e0073af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.447+0000 7f43e6a86640 1 --2- 172.21.15.137:0/3085570970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e015b930 0x7f43e015bd10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.447+0000 7f43e6a86640 1 -- 172.21.15.137:0/3085570970 >> 172.21.15.137:0/3085570970 conn(0x7f43e00cd8a0 msgr2=0x7f43e00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.447+0000 7f43e6a86640 1 -- 172.21.15.137:0/3085570970 shutdown_connections 2024-04-26T22:01:18.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.447+0000 7f43e6a86640 1 -- 172.21.15.137:0/3085570970 wait complete. 2024-04-26T22:01:18.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.448+0000 7f43e6a86640 1 Processor -- start 2024-04-26T22:01:18.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.448+0000 7f43e6a86640 1 -- start start 2024-04-26T22:01:18.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e6a86640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e0074030 0x7f43e015ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e6a86640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43e015b930 0x7f43e00b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e6a86640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43e015f4f0 0x7f43e00b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e6a86640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f43e006fdd0 con 0x7f43e0074030 2024-04-26T22:01:18.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e6a86640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f43e015c250 con 0x7f43e015f4f0 2024-04-26T22:01:18.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e6a86640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f43e006f340 con 0x7f43e015b930 2024-04-26T22:01:18.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e4822640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e0074030 0x7f43e015ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e4822640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e0074030 0x7f43e015ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49708/0 (socket says 172.21.15.137:49708) 2024-04-26T22:01:18.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e4822640 1 -- 172.21.15.137:0/2964688036 learned_addr learned my addr 172.21.15.137:0/2964688036 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e4822640 1 -- 172.21.15.137:0/2964688036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43e015b930 msgr2=0x7f43e00b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e4822640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43e015b930 0x7f43e00b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e4822640 1 -- 172.21.15.137:0/2964688036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43e015f4f0 msgr2=0x7f43e00b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e5023640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43e015f4f0 0x7f43e00b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e4822640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43e015f4f0 0x7f43e00b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e4822640 1 -- 172.21.15.137:0/2964688036 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e01556e0 con 0x7f43e0074030 2024-04-26T22:01:18.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43e4822640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e0074030 0x7f43e015ec60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f43d402a220 tx=0x7f43d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.449+0000 7f43dd7fa640 1 -- 172.21.15.137:0/2964688036 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4041030 con 0x7f43e0074030 2024-04-26T22:01:18.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.450+0000 7f43dd7fa640 1 -- 172.21.15.137:0/2964688036 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d4030440 con 0x7f43e0074030 2024-04-26T22:01:18.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.450+0000 7f43e6a86640 1 -- 172.21.15.137:0/2964688036 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e01559c0 con 0x7f43e0074030 2024-04-26T22:01:18.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.450+0000 7f43dd7fa640 1 -- 172.21.15.137:0/2964688036 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4037040 con 0x7f43e0074030 2024-04-26T22:01:18.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.450+0000 7f43e6a86640 1 -- 172.21.15.137:0/2964688036 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e0155f80 con 0x7f43e0074030 2024-04-26T22:01:18.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.451+0000 7f43dd7fa640 1 -- 172.21.15.137:0/2964688036 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43d4044070 con 0x7f43e0074030 2024-04-26T22:01:18.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.452+0000 7f43dd7fa640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43c406c8f0 0x7f43c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.452+0000 7f43dd7fa640 1 -- 172.21.15.137:0/2964688036 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f43d40abfa0 con 0x7f43e0074030 2024-04-26T22:01:18.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.452+0000 7f43dffff640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43c406c8f0 0x7f43c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.452+0000 7f43dffff640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43c406c8f0 0x7f43c406edb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f43cc006f00 tx=0x7f43cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e979b740 1 Processor -- start 2024-04-26T22:01:18.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e979b740 1 -- start start 2024-04-26T22:01:18.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e979b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f8411360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e979b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f840be10 0x5644f840fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e979b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f8410500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e979b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5644f8375d80 con 0x5644f84100c0 2024-04-26T22:01:18.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e979b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5644f832f8b0 con 0x5644f840be10 2024-04-26T22:01:18.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e979b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5644f8371d40 con 0x5644f8410f80 2024-04-26T22:01:18.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e5023640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f8410500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e5023640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f8410500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49716/0 (socket says 172.21.15.137:49716) 2024-04-26T22:01:18.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e5023640 1 -- 172.21.15.137:0/3551748218 learned_addr learned my addr 172.21.15.137:0/3551748218 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43e4822640 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f8411360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.453+0000 7f43dffff640 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f840be10 0x5644f840fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e5023640 1 -- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 msgr2=0x5644f8411360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e5023640 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f8411360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e5023640 1 -- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f840be10 msgr2=0x5644f840fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e5023640 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f840be10 0x5644f840fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e5023640 1 -- 172.21.15.137:0/3551748218 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f8300a40 con 0x5644f84100c0 2024-04-26T22:01:18.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e4822640 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f8411360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:18.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43dffff640 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f840be10 0x5644f840fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:18.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e5023640 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f8410500 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f43d80074c0 tx=0x7f43d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd34d94b5c86dc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43ca7fc640 1 -- 172.21.15.137:0/3551748218 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8003990 con 0x5644f84100c0 2024-04-26T22:01:18.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43ca7fc640 1 -- 172.21.15.137:0/3551748218 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d8003b30 con 0x5644f84100c0 2024-04-26T22:01:18.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43ca7fc640 1 -- 172.21.15.137:0/3551748218 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8004020 con 0x5644f84100c0 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e979b740 1 -- 172.21.15.137:0/3551748218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 msgr2=0x5644f8410500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e979b740 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f8410500 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f43d80074c0 tx=0x7f43d8009750 comp rx=0 tx=0).stop 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.454+0000 7f43e979b740 1 -- 172.21.15.137:0/3551748218 shutdown_connections 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.455+0000 7f43e979b740 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f8410500 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.455+0000 7f43e979b740 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f840be10 0x5644f840fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.455+0000 7f43e979b740 1 --2- 172.21.15.137:0/3551748218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f8411360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.455+0000 7f43e979b740 1 -- 172.21.15.137:0/3551748218 >> 172.21.15.137:0/3551748218 conn(0x5644f840e080 msgr2=0x5644f8456b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.455+0000 7f43e979b740 1 -- 172.21.15.137:0/3551748218 shutdown_connections 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.455+0000 7f43e979b740 1 -- 172.21.15.137:0/3551748218 wait complete. 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.455+0000 7f43e979b740 1 -- start start 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.455+0000 7f43e979b740 1 Processor -- start 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e979b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f842ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e979b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f8458690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e979b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f845bf40 0x5644f842cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e979b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5644f843cb10 con 0x5644f84100c0 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e979b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5644f82fcd10 con 0x5644f845bf40 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e979b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5644f843bf90 con 0x5644f8410f80 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e979b740 10 client.0 _ll_register_callbacks cb 0x5644f8329210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e4822640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f842ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e4822640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f842ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49722/0 (socket says 172.21.15.137:49722) 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e4822640 1 -- 172.21.15.137:0/2900625814 learned_addr learned my addr 172.21.15.137:0/2900625814 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43dffff640 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f8458690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e5023640 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f845bf40 0x5644f842cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e4822640 1 -- 172.21.15.137:0/2900625814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 msgr2=0x5644f8458690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e4822640 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f8458690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e4822640 1 -- 172.21.15.137:0/2900625814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f845bf40 msgr2=0x5644f842cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e4822640 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f845bf40 0x5644f842cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.456+0000 7f43e4822640 1 -- 172.21.15.137:0/2900625814 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644f81517d0 con 0x5644f84100c0 2024-04-26T22:01:18.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e4822640 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f842ea90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f43d4076130 tx=0x7f43d407a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99cbeb97ceb6d6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43bf7fe640 1 -- 172.21.15.137:0/2900625814 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40828b0 con 0x5644f84100c0 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43bf7fe640 1 -- 172.21.15.137:0/2900625814 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f43d403add0 con 0x5644f84100c0 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e979b740 1 -- 172.21.15.137:0/2900625814 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d8003b30 con 0x5644f84100c0 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43bf7fe640 1 -- 172.21.15.137:0/2900625814 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f43d4092070 con 0x5644f84100c0 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e979b740 10 client.6270 fetch_fsmap learned FSMap version 26 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e979b740 1 -- 172.21.15.137:0/2900625814 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5644f80873f0 con 0x5644f84100c0 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43bf7fe640 1 -- 172.21.15.137:0/2900625814 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d8003b30 con 0x5644f84100c0 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43bf7fe640 1 -- 172.21.15.137:0/2900625814 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f43d403a030 con 0x5644f84100c0 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e979b740 10 client.6270 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e979b740 10 client.6270 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e979b740 20 client.6270 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e979b740 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644f842ba70 0x5644f845c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e979b740 4 client.6270 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43e979b740 1 -- 172.21.15.137:0/2900625814 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644f8383990 con 0x5644f842ba70 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.457+0000 7f43dffff640 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644f842ba70 0x5644f845c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43bf7fe640 10 client.6270 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43dffff640 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644f842ba70 0x5644f845c3c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cfd3aa9d63948b6 server_cookie=16be2fa9655ddc7a in_seq=0 out_seq=0 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43bf7fe640 1 -- 172.21.15.137:0/2900625814 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5644f8383990 con 0x5644f842ba70 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43bf7fe640 10 client.6270 handle_command_reply: tid=0 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 client.6270 shutdown 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 -- 172.21.15.137:0/2900625814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 msgr2=0x5644f842ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f842ea90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f43d4076130 tx=0x7f43d407a510 comp rx=0 tx=0).stop 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 -- 172.21.15.137:0/2900625814 shutdown_connections 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644f842ba70 0x5644f845c3c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f845bf40 0x5644f842cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f8458690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43bf7fe640 0 client.6270 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:18.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 --2- 172.21.15.137:0/2900625814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f84100c0 0x5644f842ea90 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 -- 172.21.15.137:0/2900625814 >> 172.21.15.137:0/2900625814 conn(0x5644f840be10 msgr2=0x5644f840b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 -- 172.21.15.137:0/2900625814 shutdown_connections 2024-04-26T22:01:18.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.458+0000 7f43e979b740 1 -- 172.21.15.137:0/2900625814 wait complete. 2024-04-26T22:01:18.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.459+0000 7f43e979b740 20 client.6270 trim_cache size 0 max 16384 2024-04-26T22:01:18.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.475+0000 7f43e979b740 1 Processor -- start 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e979b740 1 -- start start 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e979b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 0x5644f840b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e979b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f840ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e979b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f842cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e979b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f43e0201920 con 0x5644f845bf40 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e979b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f43e00af8d0 con 0x5644f84100c0 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e979b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f43e00aec30 con 0x5644f8410f80 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e5023640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f842cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e5023640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f842cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49730/0 (socket says 172.21.15.137:49730) 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43e5023640 1 -- 172.21.15.137:0/426591832 learned_addr learned my addr 172.21.15.137:0/426591832 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.476+0000 7f43dffff640 1 --2- 172.21.15.137:0/426591832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f840ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e4822640 1 --2- 172.21.15.137:0/426591832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 0x5644f840b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e5023640 1 -- 172.21.15.137:0/426591832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 msgr2=0x5644f840ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e5023640 1 --2- 172.21.15.137:0/426591832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f840ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e5023640 1 -- 172.21.15.137:0/426591832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 msgr2=0x5644f840b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e5023640 1 --2- 172.21.15.137:0/426591832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 0x5644f840b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e5023640 1 -- 172.21.15.137:0/426591832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f840d320 con 0x5644f845bf40 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e5023640 1 --2- 172.21.15.137:0/426591832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f842cb30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f43d8007490 tx=0x7f43d800d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0c309c226788c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43c9ffb640 1 -- 172.21.15.137:0/426591832 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8003990 con 0x5644f845bf40 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43c9ffb640 1 -- 172.21.15.137:0/426591832 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d8003b50 con 0x5644f845bf40 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43c9ffb640 1 -- 172.21.15.137:0/426591832 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8004040 con 0x5644f845bf40 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e979b740 1 -- 172.21.15.137:0/426591832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 msgr2=0x5644f842cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e979b740 1 --2- 172.21.15.137:0/426591832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f842cb30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f43d8007490 tx=0x7f43d800d070 comp rx=0 tx=0).stop 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e979b740 1 -- 172.21.15.137:0/426591832 shutdown_connections 2024-04-26T22:01:18.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e979b740 1 --2- 172.21.15.137:0/426591832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f842cb30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e979b740 1 --2- 172.21.15.137:0/426591832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f840ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.477+0000 7f43e979b740 1 --2- 172.21.15.137:0/426591832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 0x5644f840b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.478+0000 7f43e979b740 1 -- 172.21.15.137:0/426591832 >> 172.21.15.137:0/426591832 conn(0x5644f840be10 msgr2=0x5644f842e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.478+0000 7f43e979b740 1 -- 172.21.15.137:0/426591832 shutdown_connections 2024-04-26T22:01:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.478+0000 7f43e979b740 1 -- 172.21.15.137:0/426591832 wait complete. 2024-04-26T22:01:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.478+0000 7f43e979b740 1 -- start start 2024-04-26T22:01:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.478+0000 7f43e979b740 1 Processor -- start 2024-04-26T22:01:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e979b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 0x5644f8434d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e979b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f842cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e979b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f84b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e979b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5644f8412d20 con 0x5644f845bf40 2024-04-26T22:01:18.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e979b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f43e00af280 con 0x5644f84100c0 2024-04-26T22:01:18.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e979b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5644f8434ad0 con 0x5644f8410f80 2024-04-26T22:01:18.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e979b740 10 client.0 _ll_register_callbacks cb 0x7f43d40095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:18.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e5023640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f84b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e5023640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f84b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49732/0 (socket says 172.21.15.137:49732) 2024-04-26T22:01:18.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e5023640 1 -- 172.21.15.137:0/4050375091 learned_addr learned my addr 172.21.15.137:0/4050375091 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:18.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43dffff640 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f842cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e4822640 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 0x5644f8434d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e5023640 1 -- 172.21.15.137:0/4050375091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 msgr2=0x5644f842cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e5023640 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f842cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e5023640 1 -- 172.21.15.137:0/4050375091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 msgr2=0x5644f8434d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:18.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e5023640 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 0x5644f8434d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.479+0000 7f43e5023640 1 -- 172.21.15.137:0/4050375091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644f80470f0 con 0x5644f845bf40 2024-04-26T22:01:18.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e5023640 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f84b4570 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f43d8022040 tx=0x7f43d8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8be35841c86b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:18.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43bf7fe640 1 -- 172.21.15.137:0/4050375091 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d8038060 con 0x5644f845bf40 2024-04-26T22:01:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43bf7fe640 1 -- 172.21.15.137:0/4050375091 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f43d8033470 con 0x5644f845bf40 2024-04-26T22:01:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e979b740 1 -- 172.21.15.137:0/4050375091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d8003b50 con 0x5644f845bf40 2024-04-26T22:01:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43bf7fe640 1 -- 172.21.15.137:0/4050375091 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f43d803e050 con 0x5644f845bf40 2024-04-26T22:01:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e979b740 10 client.6276 fetch_fsmap learned FSMap version 26 2024-04-26T22:01:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e979b740 1 -- 172.21.15.137:0/4050375091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) -- 0x5644f83364b0 con 0x5644f845bf40 2024-04-26T22:01:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43bf7fe640 1 -- 172.21.15.137:0/4050375091 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d8003b50 con 0x5644f845bf40 2024-04-26T22:01:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43bf7fe640 1 -- 172.21.15.137:0/4050375091 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 26) ==== 3494+0+0 (secure 0 0 0) 0x7f43d8041020 con 0x5644f845bf40 2024-04-26T22:01:18.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e979b740 10 client.6276 fetch_fsmap finished waiting for FSMap version 26 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e979b740 10 client.6276 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e979b740 20 client.6276 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e979b740 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644f8433920 0x5644f84b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e979b740 4 client.6276 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e979b740 1 -- 172.21.15.137:0/4050375091 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5644f845bab0 con 0x5644f8433920 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.480+0000 7f43e4822640 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644f8433920 0x5644f84b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43bf7fe640 10 client.6276 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e4822640 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644f8433920 0x5644f84b4ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=348085d4f1a367b9 server_cookie=d44e9909170b41dd in_seq=0 out_seq=0 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43bf7fe640 1 -- 172.21.15.137:0/4050375091 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+253 (crc 0 0 0) 0x5644f845bab0 con 0x5644f8433920 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43bf7fe640 10 client.6276 handle_command_reply: tid=0 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 client.6276 shutdown 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 -- 172.21.15.137:0/4050375091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 msgr2=0x5644f84b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f84b4570 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f43d8022040 tx=0x7f43d8004ab0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 -- 172.21.15.137:0/4050375091 shutdown_connections 2024-04-26T22:01:18.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644f8433920 0x5644f84b4ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644f845bf40 0x5644f84b4570 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644f8410f80 0x5644f842cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 --2- 172.21.15.137:0/4050375091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644f84100c0 0x5644f8434d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43bf7fe640 0 client.6276 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 -- 172.21.15.137:0/4050375091 >> 172.21.15.137:0/4050375091 conn(0x5644f840be10 msgr2=0x5644f8429690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 -- 172.21.15.137:0/4050375091 shutdown_connections 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 1 -- 172.21.15.137:0/4050375091 wait complete. 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.481+0000 7f43e979b740 20 client.6276 trim_cache size 0 max 16384 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:01:18.490 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T22:01:18.491 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-26T22:01:18.491 INFO:teuthology.orchestra.run.smithi137.stdout: "89b2fbbc-37a8-4156-ae77-d6a6ca19433e": { 2024-04-26T22:01:18.491 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-04-26T22:01:18.491 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "89b2fbbc-37a8-4156-ae77-d6a6ca19433e", 2024-04-26T22:01:18.491 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive" 2024-04-26T22:01:18.491 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:18.491 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:18.491 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:01:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 -- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43c406c8f0 msgr2=0x7f43c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43c406c8f0 0x7f43c406edb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f43cc006f00 tx=0x7f43cc008040 comp rx=0 tx=0).stop 2024-04-26T22:01:18.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 -- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e0074030 msgr2=0x7f43e015ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e0074030 0x7f43e015ec60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f43d402a220 tx=0x7f43d40046c0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 -- 172.21.15.137:0/2964688036 shutdown_connections 2024-04-26T22:01:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f43c406c8f0 0x7f43c406edb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43e015f4f0 0x7f43e00b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f43e015b930 0x7f43e00b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 --2- 172.21.15.137:0/2964688036 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f43e0074030 0x7f43e015ec60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 -- 172.21.15.137:0/2964688036 >> 172.21.15.137:0/2964688036 conn(0x7f43e00cd8a0 msgr2=0x7f43e0159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 -- 172.21.15.137:0/2964688036 shutdown_connections 2024-04-26T22:01:18.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:18.482+0000 7f43e6a86640 1 -- 172.21.15.137:0/2964688036 wait complete. 2024-04-26T22:01:18.493 INFO:tasks.cephfs.filesystem:scrub status for tag:89b2fbbc-37a8-4156-ae77-d6a6ca19433e - {'path': '/', 'tag': '89b2fbbc-37a8-4156-ae77-d6a6ca19433e', 'options': 'recursive'} 2024-04-26T22:01:23.618 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:01:23.617+0000 7f8ac040b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T22:01:43.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:01:43.188 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:01:48.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:48.495 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-26T22:01:48.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.605+0000 7fa916b9d640 1 Processor -- start 2024-04-26T22:01:48.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.605+0000 7fa916b9d640 1 -- start start 2024-04-26T22:01:48.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.606+0000 7fa916b9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa9100b2420 0x7fa91009c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.606+0000 7fa916b9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9100d1940 0x7fa9100702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa916b9d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9100cee60 con 0x7fa91015d340 2024-04-26T22:01:48.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa916b9d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa9100ce9d0 con 0x7fa9100d1940 2024-04-26T22:01:48.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa916b9d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa9100d0ff0 con 0x7fa9100b2420 2024-04-26T22:01:48.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa91513a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9100d1940 0x7fa9100702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa914939640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa91015d340 0x7fa9100d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52628/0 (socket says 172.21.15.137:52628) 2024-04-26T22:01:48.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa914939640 1 -- 172.21.15.137:0/2364063696 learned_addr learned my addr 172.21.15.137:0/2364063696 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:48.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa90ffff640 1 --2- 172.21.15.137:0/2364063696 >> v2:172.21.15.170:3300/0 conn(0x7fa9100b2420 0x7fa91009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa90f7fe640 1 -- 172.21.15.137:0/2364063696 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803331515 0 0) 0x7fa9100cee60 con 0x7fa91015d340 2024-04-26T22:01:48.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa90f7fe640 1 -- 172.21.15.137:0/2364063696 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8fc003520 con 0x7fa91015d340 2024-04-26T22:01:48.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa91513a640 1 -- 172.21.15.137:0/2364063696 >> v2:172.21.15.170:3300/0 conn(0x7fa9100b2420 msgr2=0x7fa91009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa91513a640 1 --2- 172.21.15.137:0/2364063696 >> v2:172.21.15.170:3300/0 conn(0x7fa9100b2420 0x7fa91009c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa91513a640 1 -- 172.21.15.137:0/2364063696 >> v1:172.21.15.137:6789/0 conn(0x7fa91015d340 legacy=0x7fa9100d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.607+0000 7fa91513a640 1 -- 172.21.15.137:0/2364063696 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9100d0d10 con 0x7fa9100d1940 2024-04-26T22:01:48.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.608+0000 7fa91513a640 1 --2- 172.21.15.137:0/2364063696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9100d1940 0x7fa9100702a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa9100d0aa0 tx=0x7fa8f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de605ebf9873331 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.608+0000 7fa90f7fe640 1 -- 172.21.15.137:0/2364063696 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8037070 con 0x7fa9100d1940 2024-04-26T22:01:48.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.608+0000 7fa90f7fe640 1 -- 172.21.15.137:0/2364063696 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f8032440 con 0x7fa9100d1940 2024-04-26T22:01:48.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.608+0000 7fa90f7fe640 1 -- 172.21.15.137:0/2364063696 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8032810 con 0x7fa9100d1940 2024-04-26T22:01:48.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.609+0000 7fa916b9d640 1 -- 172.21.15.137:0/2364063696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9100d1940 msgr2=0x7fa9100702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.609+0000 7fa916b9d640 1 --2- 172.21.15.137:0/2364063696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9100d1940 0x7fa9100702a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa9100d0aa0 tx=0x7fa8f802a1a0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.609+0000 7fa916b9d640 1 -- 172.21.15.137:0/2364063696 shutdown_connections 2024-04-26T22:01:48.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.609+0000 7fa916b9d640 1 --2- 172.21.15.137:0/2364063696 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9100d1940 0x7fa9100702a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.609+0000 7fa916b9d640 1 --2- 172.21.15.137:0/2364063696 >> v2:172.21.15.170:3300/0 conn(0x7fa9100b2420 0x7fa91009c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.609+0000 7fa916b9d640 1 -- 172.21.15.137:0/2364063696 >> 172.21.15.137:0/2364063696 conn(0x7fa91009ba40 msgr2=0x7fa91009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:48.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.609+0000 7fa916b9d640 1 -- 172.21.15.137:0/2364063696 shutdown_connections 2024-04-26T22:01:48.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.609+0000 7fa916b9d640 1 -- 172.21.15.137:0/2364063696 wait complete. 2024-04-26T22:01:48.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.610+0000 7fa916b9d640 1 Processor -- start 2024-04-26T22:01:48.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.610+0000 7fa916b9d640 1 -- start start 2024-04-26T22:01:48.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa916b9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9100d1940 0x7fa9100ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa916b9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa91015d340 0x7fa9101f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa916b9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9100a0320 0x7fa910156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa916b9d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100b2090 con 0x7fa91015d340 2024-04-26T22:01:48.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa916b9d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa91015d720 con 0x7fa9100a0320 2024-04-26T22:01:48.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa916b9d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa9100b2210 con 0x7fa9100d1940 2024-04-26T22:01:48.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa91015d340 0x7fa9101f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa91015d340 0x7fa9101f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55062/0 (socket says 172.21.15.137:55062) 2024-04-26T22:01:48.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90ffff640 1 -- 172.21.15.137:0/2991044615 learned_addr learned my addr 172.21.15.137:0/2991044615 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:48.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa91513a640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9100a0320 0x7fa910156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa914939640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9100d1940 0x7fa9100ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90ffff640 1 -- 172.21.15.137:0/2991044615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9100d1940 msgr2=0x7fa9100ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90ffff640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9100d1940 0x7fa9100ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90ffff640 1 -- 172.21.15.137:0/2991044615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9100a0320 msgr2=0x7fa910156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90ffff640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9100a0320 0x7fa910156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90ffff640 1 -- 172.21.15.137:0/2991044615 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa910158240 con 0x7fa91015d340 2024-04-26T22:01:48.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa91513a640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9100a0320 0x7fa910156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:48.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90ffff640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa91015d340 0x7fa9101f36f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa90000e9b0 tx=0x7fa90000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.611+0000 7fa90d7fa640 1 -- 172.21.15.137:0/2991044615 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900017070 con 0x7fa91015d340 2024-04-26T22:01:48.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.612+0000 7fa90d7fa640 1 -- 172.21.15.137:0/2991044615 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90000c9a0 con 0x7fa91015d340 2024-04-26T22:01:48.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.612+0000 7fa916b9d640 1 -- 172.21.15.137:0/2991044615 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa910158520 con 0x7fa91015d340 2024-04-26T22:01:48.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.612+0000 7fa90d7fa640 1 -- 172.21.15.137:0/2991044615 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90000cd90 con 0x7fa91015d340 2024-04-26T22:01:48.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.612+0000 7fa916b9d640 1 -- 172.21.15.137:0/2991044615 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa910158ae0 con 0x7fa91015d340 2024-04-26T22:01:48.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.613+0000 7fa90d7fa640 1 -- 172.21.15.137:0/2991044615 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa90001a070 con 0x7fa91015d340 2024-04-26T22:01:48.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.613+0000 7fa90d7fa640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8f006c920 0x7fa8f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.613+0000 7fa90d7fa640 1 -- 172.21.15.137:0/2991044615 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fa90008ba30 con 0x7fa91015d340 2024-04-26T22:01:48.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.614+0000 7fa914939640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8f006c920 0x7fa8f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.614+0000 7fa914939640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8f006c920 0x7fa8f006ede0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa9080012e0 tx=0x7fa908009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.614+0000 7fa91998d740 1 Processor -- start 2024-04-26T22:01:48.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.614+0000 7fa91998d740 1 -- start start 2024-04-26T22:01:48.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa91998d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efecd7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa91998d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 0x561efeca6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa91998d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efeca7350 0x561efecaa850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa91998d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561efec10d80 con 0x561efecd6d30 2024-04-26T22:01:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa91998d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561efebca8b0 con 0x561efeca7350 2024-04-26T22:01:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa91998d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561efec0cd40 con 0x561efecf26f0 2024-04-26T22:01:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa914939640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efecd7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa914939640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efecd7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55070/0 (socket says 172.21.15.137:55070) 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa914939640 1 -- 172.21.15.137:0/3846719676 learned_addr learned my addr 172.21.15.137:0/3846719676 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa90ffff640 1 --2- 172.21.15.137:0/3846719676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 0x561efeca6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa91513a640 1 --2- 172.21.15.137:0/3846719676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efeca7350 0x561efecaa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa914939640 1 -- 172.21.15.137:0/3846719676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 msgr2=0x561efeca6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa914939640 1 --2- 172.21.15.137:0/3846719676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 0x561efeca6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.615+0000 7fa914939640 1 -- 172.21.15.137:0/3846719676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efeca7350 msgr2=0x561efecaa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa914939640 1 --2- 172.21.15.137:0/3846719676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efeca7350 0x561efecaa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa914939640 1 -- 172.21.15.137:0/3846719676 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561efeb9ba40 con 0x561efecd6d30 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa914939640 1 --2- 172.21.15.137:0/3846719676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efecd7110 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa90800def0 tx=0x7fa908010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ae9cf50ccc06c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa9067fc640 1 -- 172.21.15.137:0/3846719676 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908012820 con 0x561efecd6d30 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa9067fc640 1 -- 172.21.15.137:0/3846719676 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9080129c0 con 0x561efecd6d30 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa9067fc640 1 -- 172.21.15.137:0/3846719676 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908012d70 con 0x561efecd6d30 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa91998d740 1 -- 172.21.15.137:0/3846719676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 msgr2=0x561efecd7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa91998d740 1 --2- 172.21.15.137:0/3846719676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efecd7110 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fa90800def0 tx=0x7fa908010000 comp rx=0 tx=0).stop 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa91998d740 1 -- 172.21.15.137:0/3846719676 shutdown_connections 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa91998d740 1 --2- 172.21.15.137:0/3846719676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efeca7350 0x561efecaa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa91998d740 1 --2- 172.21.15.137:0/3846719676 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 0x561efeca6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa91998d740 1 --2- 172.21.15.137:0/3846719676 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efecd7110 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.616+0000 7fa91998d740 1 -- 172.21.15.137:0/3846719676 >> 172.21.15.137:0/3846719676 conn(0x561efeca9080 msgr2=0x561efecf1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.617+0000 7fa91998d740 1 -- 172.21.15.137:0/3846719676 shutdown_connections 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.617+0000 7fa91998d740 1 -- 172.21.15.137:0/3846719676 wait complete. 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.617+0000 7fa91998d740 1 -- start start 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.617+0000 7fa91998d740 1 Processor -- start 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa91998d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeceff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa91998d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 0x561efecaae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa91998d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 0x561efecab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa91998d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561efecac840 con 0x561efecd6d30 2024-04-26T22:01:48.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa91998d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561efeb97d10 con 0x561efecf26f0 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa91998d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561efecacae0 con 0x561efed09370 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa91998d740 10 client.0 _ll_register_callbacks cb 0x561efebc4210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa914939640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeceff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa914939640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeceff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55086/0 (socket says 172.21.15.137:55086) 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa914939640 1 -- 172.21.15.137:0/4007838611 learned_addr learned my addr 172.21.15.137:0/4007838611 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa90ffff640 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 0x561efecaae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.618+0000 7fa91513a640 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 0x561efecab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa914939640 1 -- 172.21.15.137:0/4007838611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 msgr2=0x561efecab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa914939640 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 0x561efecab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa914939640 1 -- 172.21.15.137:0/4007838611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 msgr2=0x561efecaae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa914939640 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 0x561efecaae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa914939640 1 -- 172.21.15.137:0/4007838611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561efe9ec7d0 con 0x561efecd6d30 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa914939640 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeceff80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa908009010 tx=0x7fa908007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa07af8c3515912 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa8ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/4007838611 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908005030 con 0x561efecd6d30 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/4007838611 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fa90802a990 con 0x561efecd6d30 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa91998d740 1 -- 172.21.15.137:0/4007838611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9080129c0 con 0x561efecd6d30 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/4007838611 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa908033070 con 0x561efecd6d30 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa91998d740 10 client.6291 fetch_fsmap learned FSMap version 27 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa91998d740 1 -- 172.21.15.137:0/4007838611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x561efe9223f0 con 0x561efecd6d30 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/4007838611 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9080129c0 con 0x561efecd6d30 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/4007838611 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fa90802b020 con 0x561efecd6d30 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa91998d740 10 client.6291 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa91998d740 10 client.6291 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa91998d740 20 client.6291 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:48.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa91998d740 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561efecda0f0 0x561efecd7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa91998d740 4 client.6291 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.619+0000 7fa91998d740 1 -- 172.21.15.137:0/4007838611 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561efec1e990 con 0x561efecda0f0 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.620+0000 7fa90ffff640 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561efecda0f0 0x561efecd7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.620+0000 7fa8ef7fe640 10 client.6291 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.620+0000 7fa90ffff640 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561efecda0f0 0x561efecd7ef0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b850a4520b683ff4 server_cookie=8ee2beb555245f13 in_seq=0 out_seq=0 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.620+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/4007838611 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561efec1e990 con 0x561efecda0f0 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.620+0000 7fa8ef7fe640 10 client.6291 handle_command_reply: tid=0 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.620+0000 7fa91998d740 1 client.6291 shutdown 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 -- 172.21.15.137:0/4007838611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 msgr2=0x561efeceff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeceff80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa908009010 tx=0x7fa908007000 comp rx=0 tx=0).stop 2024-04-26T22:01:48.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 -- 172.21.15.137:0/4007838611 shutdown_connections 2024-04-26T22:01:48.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561efecda0f0 0x561efecd7ef0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 0x561efecab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 0x561efecaae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa8ef7fe640 0 client.6291 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:48.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 --2- 172.21.15.137:0/4007838611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeceff80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 -- 172.21.15.137:0/4007838611 >> 172.21.15.137:0/4007838611 conn(0x561efeca7350 msgr2=0x561efeca5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:48.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 -- 172.21.15.137:0/4007838611 shutdown_connections 2024-04-26T22:01:48.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 1 -- 172.21.15.137:0/4007838611 wait complete. 2024-04-26T22:01:48.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.621+0000 7fa91998d740 20 client.6291 trim_cache size 0 max 16384 2024-04-26T22:01:48.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.638+0000 7fa91998d740 1 Processor -- start 2024-04-26T22:01:48.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.638+0000 7fa91998d740 1 -- start start 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa91998d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeca5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa91998d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 0x561efeca6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa91998d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 0x561efecd3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa91998d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9101fd3e0 con 0x561efecd6d30 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa91998d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa91006e5c0 con 0x561efecf26f0 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa91998d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa9101f6e00 con 0x561efed09370 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa914939640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeca5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa914939640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeca5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55088/0 (socket says 172.21.15.137:55088) 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa914939640 1 -- 172.21.15.137:0/2688691896 learned_addr learned my addr 172.21.15.137:0/2688691896 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa90ffff640 1 --2- 172.21.15.137:0/2688691896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 0x561efeca6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa91513a640 1 --2- 172.21.15.137:0/2688691896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 0x561efecd3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa914939640 1 -- 172.21.15.137:0/2688691896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 msgr2=0x561efecd3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa914939640 1 --2- 172.21.15.137:0/2688691896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 0x561efecd3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa914939640 1 -- 172.21.15.137:0/2688691896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 msgr2=0x561efeca6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa914939640 1 --2- 172.21.15.137:0/2688691896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 0x561efeca6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa914939640 1 -- 172.21.15.137:0/2688691896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561efe8e20f0 con 0x561efecd6d30 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa914939640 1 --2- 172.21.15.137:0/2688691896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeca5cc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa90800da50 tx=0x7fa908011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0de5660a67bc021 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa905ffb640 1 -- 172.21.15.137:0/2688691896 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908012930 con 0x561efecd6d30 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa905ffb640 1 -- 172.21.15.137:0/2688691896 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9080079e0 con 0x561efecd6d30 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.639+0000 7fa905ffb640 1 -- 172.21.15.137:0/2688691896 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908012070 con 0x561efecd6d30 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.640+0000 7fa91998d740 1 -- 172.21.15.137:0/2688691896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 msgr2=0x561efeca5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.640+0000 7fa91998d740 1 --2- 172.21.15.137:0/2688691896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeca5cc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa90800da50 tx=0x7fa908011000 comp rx=0 tx=0).stop 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.640+0000 7fa91998d740 1 -- 172.21.15.137:0/2688691896 shutdown_connections 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.640+0000 7fa91998d740 1 --2- 172.21.15.137:0/2688691896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efed09370 0x561efecd3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.640+0000 7fa91998d740 1 --2- 172.21.15.137:0/2688691896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecf26f0 0x561efeca6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.640+0000 7fa91998d740 1 --2- 172.21.15.137:0/2688691896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efecd6d30 0x561efeca5cc0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.640+0000 7fa91998d740 1 -- 172.21.15.137:0/2688691896 >> 172.21.15.137:0/2688691896 conn(0x561efeca7350 msgr2=0x561efecefc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:48.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.640+0000 7fa91998d740 1 -- 172.21.15.137:0/2688691896 shutdown_connections 2024-04-26T22:01:48.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.640+0000 7fa91998d740 1 -- 172.21.15.137:0/2688691896 wait complete. 2024-04-26T22:01:48.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.641+0000 7fa91998d740 1 -- start start 2024-04-26T22:01:48.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.641+0000 7fa91998d740 1 Processor -- start 2024-04-26T22:01:48.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.641+0000 7fa91998d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecd6d30 0x561efed6ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.641+0000 7fa91998d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 0x561efed6f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.641+0000 7fa91998d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efed09370 0x561efecd5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.641+0000 7fa91998d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9100cab70 con 0x561efed09370 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.641+0000 7fa91998d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561efecd99e0 con 0x561efecd6d30 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.641+0000 7fa91998d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561efed6fab0 con 0x561efecf26f0 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.641+0000 7fa91998d740 10 client.0 _ll_register_callbacks cb 0x7fa8f8035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91513a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efed09370 0x561efecd5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91513a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efed09370 0x561efecd5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55104/0 (socket says 172.21.15.137:55104) 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91513a640 1 -- 172.21.15.137:0/2251843261 learned_addr learned my addr 172.21.15.137:0/2251843261 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa90ffff640 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 0x561efed6f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa914939640 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecd6d30 0x561efed6ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91513a640 1 -- 172.21.15.137:0/2251843261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 msgr2=0x561efed6f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91513a640 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 0x561efed6f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91513a640 1 -- 172.21.15.137:0/2251843261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecd6d30 msgr2=0x561efed6ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91513a640 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecd6d30 0x561efed6ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91513a640 1 -- 172.21.15.137:0/2251843261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561efebd14b0 con 0x561efed09370 2024-04-26T22:01:48.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91513a640 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efed09370 0x561efecd5d90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8035040 tx=0x7fa8f802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb66880943434eba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa8ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/2251843261 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8037040 con 0x561efed09370 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/2251843261 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fa8f8047ac0 con 0x561efed09370 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91998d740 1 -- 172.21.15.137:0/2251843261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9080079e0 con 0x561efed09370 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/2251843261 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa8f8047cc0 con 0x561efed09370 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91998d740 10 client.6297 fetch_fsmap learned FSMap version 27 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa91998d740 1 -- 172.21.15.137:0/2251843261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x561efed6f7f0 con 0x561efed09370 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.642+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/2251843261 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9080079e0 con 0x561efed09370 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/2251843261 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fa8f804e050 con 0x561efed09370 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 10 client.6297 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 10 client.6297 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 20 client.6297 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561efeca9e50 0x561efecd62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 4 client.6297 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 -- 172.21.15.137:0/2251843261 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561efec18800 con 0x561efeca9e50 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa914939640 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561efeca9e50 0x561efecd62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa8ef7fe640 10 client.6297 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa914939640 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561efeca9e50 0x561efecd62d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d162c0990f1d5e7e server_cookie=57040de83a4b5e90 in_seq=0 out_seq=0 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa8ef7fe640 1 -- 172.21.15.137:0/2251843261 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561efec18800 con 0x561efeca9e50 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa8ef7fe640 10 client.6297 handle_command_reply: tid=0 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 client.6297 shutdown 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 -- 172.21.15.137:0/2251843261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efed09370 msgr2=0x561efecd5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efed09370 0x561efecd5d90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8035040 tx=0x7fa8f802c070 comp rx=0 tx=0).stop 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 -- 172.21.15.137:0/2251843261 shutdown_connections 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561efeca9e50 0x561efecd62d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561efed09370 0x561efecd5d90 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561efecf26f0 0x561efed6f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 --2- 172.21.15.137:0/2251843261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561efecd6d30 0x561efed6ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa8ef7fe640 0 client.6297 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:48.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.643+0000 7fa91998d740 1 -- 172.21.15.137:0/2251843261 >> 172.21.15.137:0/2251843261 conn(0x561efeca7350 msgr2=0x561efeca2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:48.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa91998d740 1 -- 172.21.15.137:0/2251843261 shutdown_connections 2024-04-26T22:01:48.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa91998d740 1 -- 172.21.15.137:0/2251843261 wait complete. 2024-04-26T22:01:48.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa91998d740 20 client.6297 trim_cache size 0 max 16384 2024-04-26T22:01:48.651 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:01:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:01:48.651 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:01:48.651 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:01:48.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 -- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8f006c920 msgr2=0x7fa8f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8f006c920 0x7fa8f006ede0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa9080012e0 tx=0x7fa908009040 comp rx=0 tx=0).stop 2024-04-26T22:01:48.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 -- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa91015d340 msgr2=0x7fa9101f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa91015d340 0x7fa9101f36f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa90000e9b0 tx=0x7fa90000ee70 comp rx=0 tx=0).stop 2024-04-26T22:01:48.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 -- 172.21.15.137:0/2991044615 shutdown_connections 2024-04-26T22:01:48.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8f006c920 0x7fa8f006ede0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa91015d340 0x7fa9101f36f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9100a0320 0x7fa910156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 --2- 172.21.15.137:0/2991044615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9100d1940 0x7fa9100ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 -- 172.21.15.137:0/2991044615 >> 172.21.15.137:0/2991044615 conn(0x7fa91009ba40 msgr2=0x7fa9100b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:48.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 -- 172.21.15.137:0/2991044615 shutdown_connections 2024-04-26T22:01:48.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.644+0000 7fa916b9d640 1 -- 172.21.15.137:0/2991044615 wait complete. 2024-04-26T22:01:48.655 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:01:48.655 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:01:48.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.752+0000 7f5a0ed89640 1 Processor -- start 2024-04-26T22:01:48.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.752+0000 7f5a0ed89640 1 -- start start 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.753+0000 7f5a0ed89640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5a080d1370 0x7f5a080cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.753+0000 7f5a0ed89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1750 0x7f5a080b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.753+0000 7f5a0ed89640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a080b0620 con 0x7f5a080b28c0 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.753+0000 7f5a0ed89640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5a08074070 con 0x7f5a080d1370 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.753+0000 7f5a0ed89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5a08074350 con 0x7f5a080d1750 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.753+0000 7f5a0d326640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1750 0x7f5a080b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.753+0000 7f5a0d326640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1750 0x7f5a080b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:50552/0 (socket says 172.21.15.137:50552) 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.753+0000 7f5a0cb25640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5a080d1370 0x7f5a080cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.753+0000 7f5a0d326640 1 -- 172.21.15.137:0/4223532530 learned_addr learned my addr 172.21.15.137:0/4223532530 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.754+0000 7f5a0d326640 1 -- 172.21.15.137:0/4223532530 >> v2:172.21.15.170:3300/0 conn(0x7f5a080d1370 msgr2=0x7f5a080cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:48.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.754+0000 7f5a0d326640 1 --2- 172.21.15.137:0/4223532530 >> v2:172.21.15.170:3300/0 conn(0x7f5a080d1370 0x7f5a080cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.754+0000 7f5a0d326640 1 -- 172.21.15.137:0/4223532530 >> v1:172.21.15.170:6789/0 conn(0x7f5a080b28c0 legacy=0x7f5a080ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.754+0000 7f5a0d326640 1 -- 172.21.15.137:0/4223532530 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a08074630 con 0x7f5a080d1750 2024-04-26T22:01:48.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a0d326640 1 --2- 172.21.15.137:0/4223532530 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1750 0x7f5a080b0dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009e50 tx=0x7f5a0002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21345b0b63b99789 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a077fe640 1 -- 172.21.15.137:0/4223532530 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00036070 con 0x7f5a080d1750 2024-04-26T22:01:48.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a077fe640 1 -- 172.21.15.137:0/4223532530 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00031600 con 0x7f5a080d1750 2024-04-26T22:01:48.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a077fe640 1 -- 172.21.15.137:0/4223532530 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a000319d0 con 0x7f5a080d1750 2024-04-26T22:01:48.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a0ed89640 1 -- 172.21.15.137:0/4223532530 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1750 msgr2=0x7f5a080b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a0ed89640 1 --2- 172.21.15.137:0/4223532530 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1750 0x7f5a080b0dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009e50 tx=0x7f5a0002a680 comp rx=0 tx=0).stop 2024-04-26T22:01:48.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a0ed89640 1 -- 172.21.15.137:0/4223532530 shutdown_connections 2024-04-26T22:01:48.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a0ed89640 1 --2- 172.21.15.137:0/4223532530 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1750 0x7f5a080b0dd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a0ed89640 1 --2- 172.21.15.137:0/4223532530 >> v2:172.21.15.170:3300/0 conn(0x7f5a080d1370 0x7f5a080cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a0ed89640 1 -- 172.21.15.137:0/4223532530 >> 172.21.15.137:0/4223532530 conn(0x7f5a080b6800 msgr2=0x7f5a080738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:48.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a0ed89640 1 -- 172.21.15.137:0/4223532530 shutdown_connections 2024-04-26T22:01:48.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.755+0000 7f5a0ed89640 1 -- 172.21.15.137:0/4223532530 wait complete. 2024-04-26T22:01:48.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.756+0000 7f5a0ed89640 1 Processor -- start 2024-04-26T22:01:48.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.756+0000 7f5a0ed89640 1 -- start start 2024-04-26T22:01:48.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.757+0000 7f5a0ed89640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a080b28c0 0x7f5a08155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.757+0000 7f5a0ed89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1370 0x7f5a0809a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.757+0000 7f5a0ed89640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a080d1750 0x7f5a0809a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.757+0000 7f5a0ed89640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080b1310 con 0x7f5a080b28c0 2024-04-26T22:01:48.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.757+0000 7f5a0ed89640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080d1e70 con 0x7f5a080d1750 2024-04-26T22:01:48.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.757+0000 7f5a0ed89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5a080b1490 con 0x7f5a080d1370 2024-04-26T22:01:48.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.757+0000 7f5a0cb25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a080b28c0 0x7f5a08155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.757+0000 7f5a0cb25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a080b28c0 0x7f5a08155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55114/0 (socket says 172.21.15.137:55114) 2024-04-26T22:01:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.757+0000 7f5a0cb25640 1 -- 172.21.15.137:0/1823553736 learned_addr learned my addr 172.21.15.137:0/1823553736 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a0d326640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a080d1750 0x7f5a0809a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a07fff640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1370 0x7f5a0809a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a0cb25640 1 -- 172.21.15.137:0/1823553736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1370 msgr2=0x7f5a0809a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a0cb25640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1370 0x7f5a0809a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a0cb25640 1 -- 172.21.15.137:0/1823553736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a080d1750 msgr2=0x7f5a0809a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a0cb25640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a080d1750 0x7f5a0809a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a0cb25640 1 -- 172.21.15.137:0/1823553736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0809aee0 con 0x7f5a080b28c0 2024-04-26T22:01:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a0cb25640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a080b28c0 0x7f5a08155f60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f59f800e9b0 tx=0x7f59f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a057fa640 1 -- 172.21.15.137:0/1823553736 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8017070 con 0x7f5a080b28c0 2024-04-26T22:01:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a057fa640 1 -- 172.21.15.137:0/1823553736 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f800c9a0 con 0x7f5a080b28c0 2024-04-26T22:01:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a081549b0 con 0x7f5a080b28c0 2024-04-26T22:01:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a057fa640 1 -- 172.21.15.137:0/1823553736 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f800cd90 con 0x7f5a080b28c0 2024-04-26T22:01:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.758+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a081551f0 con 0x7f5a080b28c0 2024-04-26T22:01:48.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.759+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a0806a290 con 0x7f5a080b28c0 2024-04-26T22:01:48.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.760+0000 7f5a057fa640 1 -- 172.21.15.137:0/1823553736 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59f801a070 con 0x7f5a080b28c0 2024-04-26T22:01:48.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.760+0000 7f5a057fa640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f59f406c8f0 0x7f59f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:48.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.760+0000 7f5a057fa640 1 -- 172.21.15.137:0/1823553736 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f59f808bab0 con 0x7f5a080b28c0 2024-04-26T22:01:48.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.760+0000 7f5a07fff640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f59f406c8f0 0x7f59f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:48.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.761+0000 7f5a07fff640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f59f406c8f0 0x7f59f406edb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5a081f76c0 tx=0x7f59fc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:48.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.764+0000 7f5a057fa640 1 -- 172.21.15.137:0/1823553736 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5a081549b0 con 0x7f5a080b28c0 2024-04-26T22:01:48.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.977+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a080730e0 con 0x7f5a080b28c0 2024-04-26T22:01:48.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.977+0000 7f5a057fa640 1 -- 172.21.15.137:0/1823553736 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5193 (secure 0 0 0) 0x7f59f8059890 con 0x7f5a080b28c0 2024-04-26T22:01:48.978 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:48.978 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":27,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:01:10.893739+0000","modified":"2024-04-26T22:01:23.568736+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6837/4265926631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":4265926631},{"type":"v1","addr":"172.21.15.137:6837","nonce":4265926631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6060,"qdb_cluster":[6060]},"id":4}]} 2024-04-26T22:01:48.978 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 27 2024-04-26T22:01:48.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f59f406c8f0 msgr2=0x7f59f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f59f406c8f0 0x7f59f406edb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5a081f76c0 tx=0x7f59fc009040 comp rx=0 tx=0).stop 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a080b28c0 msgr2=0x7f5a08155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a080b28c0 0x7f5a08155f60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f59f800e9b0 tx=0x7f59f800ee70 comp rx=0 tx=0).stop 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 shutdown_connections 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f59f406c8f0 0x7f59f406edb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a080d1750 0x7f5a0809a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5a080d1370 0x7f5a0809a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 --2- 172.21.15.137:0/1823553736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5a080b28c0 0x7f5a08155f60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 >> 172.21.15.137:0/1823553736 conn(0x7f5a080b6800 msgr2=0x7f5a080b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.979+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 shutdown_connections 2024-04-26T22:01:48.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:48.980+0000 7f5a0ed89640 1 -- 172.21.15.137:0/1823553736 wait complete. 2024-04-26T22:01:48.990 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-26T22:01:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.089+0000 7f84e5ff0640 1 Processor -- start 2024-04-26T22:01:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.089+0000 7f84e5ff0640 1 -- start start 2024-04-26T22:01:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.089+0000 7f84e5ff0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f84e006f340 0x7f84e00b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.089+0000 7f84e5ff0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e00d0300 0x7f84e006f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.089+0000 7f84e5ff0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e006fc60 con 0x7f84e00b3e50 2024-04-26T22:01:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.089+0000 7f84e5ff0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f84e00b46a0 con 0x7f84e006f340 2024-04-26T22:01:49.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.089+0000 7f84e5ff0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f84e00b5db0 con 0x7f84e00d0300 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84dffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f84e00b3e50 0x7f84e00720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52640/0 (socket says 172.21.15.137:52640) 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84dffff640 1 -- 172.21.15.137:0/213967581 learned_addr learned my addr 172.21.15.137:0/213967581 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84df7fe640 1 --2- 172.21.15.137:0/213967581 >> v2:172.21.15.170:3300/0 conn(0x7f84e006f340 0x7f84e00b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84deffd640 1 --2- 172.21.15.137:0/213967581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e00d0300 0x7f84e006f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84de7fc640 1 -- 172.21.15.137:0/213967581 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149964452 0 0) 0x7f84e006fc60 con 0x7f84e00b3e50 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84de7fc640 1 -- 172.21.15.137:0/213967581 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84c8003520 con 0x7f84e00b3e50 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84deffd640 1 -- 172.21.15.137:0/213967581 >> v2:172.21.15.170:3300/0 conn(0x7f84e006f340 msgr2=0x7f84e00b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84deffd640 1 --2- 172.21.15.137:0/213967581 >> v2:172.21.15.170:3300/0 conn(0x7f84e006f340 0x7f84e00b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84deffd640 1 -- 172.21.15.137:0/213967581 >> v1:172.21.15.137:6789/0 conn(0x7f84e00b3e50 legacy=0x7f84e00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84deffd640 1 -- 172.21.15.137:0/213967581 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e00b6090 con 0x7f84e00d0300 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.090+0000 7f84df7fe640 1 --2- 172.21.15.137:0/213967581 >> v2:172.21.15.170:3300/0 conn(0x7f84e006f340 0x7f84e00b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.091+0000 7f84deffd640 1 --2- 172.21.15.137:0/213967581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e00d0300 0x7f84e006f720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84d40097a0 tx=0x7f84d402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ed9d845a4a51a01 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.091+0000 7f84de7fc640 1 -- 172.21.15.137:0/213967581 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4037070 con 0x7f84e00d0300 2024-04-26T22:01:49.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.091+0000 7f84de7fc640 1 -- 172.21.15.137:0/213967581 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d402adb0 con 0x7f84e00d0300 2024-04-26T22:01:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.091+0000 7f84de7fc640 1 -- 172.21.15.137:0/213967581 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4032660 con 0x7f84e00d0300 2024-04-26T22:01:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.091+0000 7f84e5ff0640 1 -- 172.21.15.137:0/213967581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e00d0300 msgr2=0x7f84e006f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.091+0000 7f84e5ff0640 1 --2- 172.21.15.137:0/213967581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e00d0300 0x7f84e006f720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84d40097a0 tx=0x7f84d402a060 comp rx=0 tx=0).stop 2024-04-26T22:01:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.092+0000 7f84e5ff0640 1 -- 172.21.15.137:0/213967581 shutdown_connections 2024-04-26T22:01:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.092+0000 7f84e5ff0640 1 --2- 172.21.15.137:0/213967581 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e00d0300 0x7f84e006f720 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.092+0000 7f84e5ff0640 1 --2- 172.21.15.137:0/213967581 >> v2:172.21.15.170:3300/0 conn(0x7f84e006f340 0x7f84e00b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.092+0000 7f84e5ff0640 1 -- 172.21.15.137:0/213967581 >> 172.21.15.137:0/213967581 conn(0x7f84e00cd8a0 msgr2=0x7f84e00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.092+0000 7f84e5ff0640 1 -- 172.21.15.137:0/213967581 shutdown_connections 2024-04-26T22:01:49.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.092+0000 7f84e5ff0640 1 -- 172.21.15.137:0/213967581 wait complete. 2024-04-26T22:01:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.093+0000 7f84e5ff0640 1 Processor -- start 2024-04-26T22:01:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.093+0000 7f84e5ff0640 1 -- start start 2024-04-26T22:01:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84e5ff0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e006f340 0x7f84e013a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84e5ff0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84e00b3e50 0x7f84e015d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84e5ff0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e00d0300 0x7f84e0142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84e5ff0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00b42e0 con 0x7f84e00d0300 2024-04-26T22:01:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84e5ff0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00b6650 con 0x7f84e00b3e50 2024-04-26T22:01:49.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84e5ff0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f84e00b4460 con 0x7f84e006f340 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84dffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e00d0300 0x7f84e0142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84dffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e00d0300 0x7f84e0142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55120/0 (socket says 172.21.15.137:55120) 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84dffff640 1 -- 172.21.15.137:0/775882333 learned_addr learned my addr 172.21.15.137:0/775882333 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84deffd640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84e00b3e50 0x7f84e015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84df7fe640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e006f340 0x7f84e013a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84dffff640 1 -- 172.21.15.137:0/775882333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e006f340 msgr2=0x7f84e013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84dffff640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e006f340 0x7f84e013a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84dffff640 1 -- 172.21.15.137:0/775882333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84e00b3e50 msgr2=0x7f84e015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84dffff640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84e00b3e50 0x7f84e015d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84dffff640 1 -- 172.21.15.137:0/775882333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e015cdd0 con 0x7f84e00d0300 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84dffff640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e00d0300 0x7f84e0142e50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f84d800cad0 tx=0x7f84d800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84c7fff640 1 -- 172.21.15.137:0/775882333 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8017070 con 0x7f84e00d0300 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84c7fff640 1 -- 172.21.15.137:0/775882333 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d800ac30 con 0x7f84e00d0300 2024-04-26T22:01:49.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84e5ff0640 1 -- 172.21.15.137:0/775882333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e015c810 con 0x7f84e00d0300 2024-04-26T22:01:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84c7fff640 1 -- 172.21.15.137:0/775882333 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8012400 con 0x7f84e00d0300 2024-04-26T22:01:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.094+0000 7f84e5ff0640 1 -- 172.21.15.137:0/775882333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e013e4f0 con 0x7f84e00d0300 2024-04-26T22:01:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.096+0000 7f84c7fff640 1 -- 172.21.15.137:0/775882333 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84d801a070 con 0x7f84e00d0300 2024-04-26T22:01:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.096+0000 7f84c7fff640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84cc06c8f0 0x7f84cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.096+0000 7f84c7fff640 1 -- 172.21.15.137:0/775882333 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f84d808b7c0 con 0x7f84e00d0300 2024-04-26T22:01:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.096+0000 7f84df7fe640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84cc06c8f0 0x7f84cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.097+0000 7f84df7fe640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84cc06c8f0 0x7f84cc06edb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009560 tx=0x7f84d0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.097+0000 7f84e8de9740 1 Processor -- start 2024-04-26T22:01:49.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.097+0000 7f84e8de9740 1 -- start start 2024-04-26T22:01:49.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 0x55d3910c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 0x55d3910c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d3910efc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84e8de9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d391029b80 con 0x55d3910ef7b0 2024-04-26T22:01:49.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84e8de9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d390fc54d0 con 0x55d3910c4cf0 2024-04-26T22:01:49.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84e8de9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d391025b40 con 0x55d3911013c0 2024-04-26T22:01:49.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84dffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d3910efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84dffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d3910efc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55128/0 (socket says 172.21.15.137:55128) 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84dffff640 1 -- 172.21.15.137:0/3935389469 learned_addr learned my addr 172.21.15.137:0/3935389469 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84df7fe640 1 --2- 172.21.15.137:0/3935389469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 0x55d3910c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.098+0000 7f84deffd640 1 --2- 172.21.15.137:0/3935389469 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 0x55d3910c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84dffff640 1 -- 172.21.15.137:0/3935389469 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 msgr2=0x55d3910c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84dffff640 1 --2- 172.21.15.137:0/3935389469 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 0x55d3910c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84dffff640 1 -- 172.21.15.137:0/3935389469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 msgr2=0x55d3910c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84dffff640 1 --2- 172.21.15.137:0/3935389469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 0x55d3910c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84dffff640 1 -- 172.21.15.137:0/3935389469 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d390ff2770 con 0x55d3910ef7b0 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84dffff640 1 --2- 172.21.15.137:0/3935389469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d3910efc30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f84d8089da0 tx=0x7f84d805d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaea1666717fdb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84c57fa640 1 -- 172.21.15.137:0/3935389469 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8055ca0 con 0x55d3910ef7b0 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84c57fa640 1 -- 172.21.15.137:0/3935389469 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d8061cd0 con 0x55d3910ef7b0 2024-04-26T22:01:49.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84c57fa640 1 -- 172.21.15.137:0/3935389469 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8055e40 con 0x55d3910ef7b0 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84e8de9740 1 -- 172.21.15.137:0/3935389469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 msgr2=0x55d3910efc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.099+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3935389469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d3910efc30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f84d8089da0 tx=0x7f84d805d9f0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.100+0000 7f84e8de9740 1 -- 172.21.15.137:0/3935389469 shutdown_connections 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.100+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3935389469 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d3910efc30 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.100+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3935389469 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 0x55d3910c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.100+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3935389469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 0x55d3910c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.100+0000 7f84e8de9740 1 -- 172.21.15.137:0/3935389469 >> 172.21.15.137:0/3935389469 conn(0x55d391059e90 msgr2=0x55d39110a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.100+0000 7f84e8de9740 1 -- 172.21.15.137:0/3935389469 shutdown_connections 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.100+0000 7f84e8de9740 1 -- 172.21.15.137:0/3935389469 wait complete. 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.100+0000 7f84e8de9740 1 -- start start 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.100+0000 7f84e8de9740 1 Processor -- start 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 0x55d3910f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 0x55d3910f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d3910eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84e8de9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d390fc2e70 con 0x55d3911013c0 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84e8de9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d3910ed300 con 0x55d3910ef7b0 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84e8de9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d3910f0920 con 0x55d3910c4cf0 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84e8de9740 10 client.0 _ll_register_callbacks cb 0x55d390fd3ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84dffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d3910eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84dffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d3910eeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55132/0 (socket says 172.21.15.137:55132) 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84dffff640 1 -- 172.21.15.137:0/1330198318 learned_addr learned my addr 172.21.15.137:0/1330198318 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84df7fe640 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 0x55d3910f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84deffd640 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 0x55d3910f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84dffff640 1 -- 172.21.15.137:0/1330198318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 msgr2=0x55d3910f03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84dffff640 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 0x55d3910f03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84dffff640 1 -- 172.21.15.137:0/1330198318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 msgr2=0x55d3910f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84dffff640 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 0x55d3910f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84dffff640 1 -- 172.21.15.137:0/1330198318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d390e077c0 con 0x55d3911013c0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84dffff640 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d3910eeb20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f84d80012e0 tx=0x7f84d8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22fa70b44439dbb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.101+0000 7f84be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84be7fc640 1 -- 172.21.15.137:0/1330198318 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8004b60 con 0x55d3911013c0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84be7fc640 1 -- 172.21.15.137:0/1330198318 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f84d8004d00 con 0x55d3911013c0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84e8de9740 1 -- 172.21.15.137:0/1330198318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d8061cd0 con 0x55d3911013c0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84be7fc640 1 -- 172.21.15.137:0/1330198318 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f84d8058a80 con 0x55d3911013c0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84e8de9740 10 client.6312 fetch_fsmap learned FSMap version 27 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84e8de9740 1 -- 172.21.15.137:0/1330198318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55d390e67f50 con 0x55d3911013c0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84be7fc640 1 -- 172.21.15.137:0/1330198318 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d8061cd0 con 0x55d3911013c0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84be7fc640 1 -- 172.21.15.137:0/1330198318 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f84d8058c20 con 0x55d3911013c0 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84e8de9740 10 client.6312 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84e8de9740 10 client.6312 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84e8de9740 20 client.6312 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x55d3910daaa0 0x55d3910eb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84e8de9740 4 client.6312 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84e8de9740 1 -- 172.21.15.137:0/1330198318 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d390fdd240 con 0x55d3910daaa0 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84df7fe640 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x55d3910daaa0 0x55d3910eb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84df7fe640 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x55d3910daaa0 0x55d3910eb950 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3f89cc47e194838 server_cookie=e02ac17cad625b90 in_seq=0 out_seq=0 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.102+0000 7f84be7fc640 10 client.6312 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84be7fc640 1 -- 172.21.15.137:0/1330198318 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d390fdd240 con 0x55d3910daaa0 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84be7fc640 10 client.6312 handle_command_reply: tid=0 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 client.6312 shutdown 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 -- 172.21.15.137:0/1330198318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 msgr2=0x55d3910eeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d3910eeb20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f84d80012e0 tx=0x7f84d8001250 comp rx=0 tx=0).stop 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 -- 172.21.15.137:0/1330198318 shutdown_connections 2024-04-26T22:01:49.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x55d3910daaa0 0x55d3910eb950 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d3910eeb20 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 0x55d3910f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84be7fc640 0 client.6312 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1330198318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 0x55d3910f03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 -- 172.21.15.137:0/1330198318 >> 172.21.15.137:0/1330198318 conn(0x55d391059e90 msgr2=0x55d3910ed700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 -- 172.21.15.137:0/1330198318 shutdown_connections 2024-04-26T22:01:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 1 -- 172.21.15.137:0/1330198318 wait complete. 2024-04-26T22:01:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.103+0000 7f84e8de9740 20 client.6312 trim_cache size 0 max 16384 2024-04-26T22:01:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.116+0000 7f84e8de9740 1 Processor -- start 2024-04-26T22:01:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.116+0000 7f84e8de9740 1 -- start start 2024-04-26T22:01:49.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.117+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 0x55d3910ed670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.117+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d39110d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.117+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 0x55d39110dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.117+0000 7f84e8de9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84e01fe5b0 con 0x55d3910ef7b0 2024-04-26T22:01:49.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.117+0000 7f84e8de9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f84e013f6f0 con 0x55d3910c4cf0 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.117+0000 7f84e8de9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f84e0151ef0 con 0x55d3911013c0 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.117+0000 7f84deffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d39110d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.117+0000 7f84deffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d39110d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55146/0 (socket says 172.21.15.137:55146) 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.117+0000 7f84deffd640 1 -- 172.21.15.137:0/1058435545 learned_addr learned my addr 172.21.15.137:0/1058435545 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84df7fe640 1 --2- 172.21.15.137:0/1058435545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 0x55d3910ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84dffff640 1 --2- 172.21.15.137:0/1058435545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 0x55d39110dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84deffd640 1 -- 172.21.15.137:0/1058435545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 msgr2=0x55d39110dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84deffd640 1 --2- 172.21.15.137:0/1058435545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 0x55d39110dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84deffd640 1 -- 172.21.15.137:0/1058435545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 msgr2=0x55d3910ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84deffd640 1 --2- 172.21.15.137:0/1058435545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 0x55d3910ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84deffd640 1 -- 172.21.15.137:0/1058435545 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d390cfb0b0 con 0x55d3910ef7b0 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84deffd640 1 --2- 172.21.15.137:0/1058435545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d39110d760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f84d40098c0 tx=0x7f84d402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a440eddbb47ec99f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84c4ff9640 1 -- 172.21.15.137:0/1058435545 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d404b070 con 0x55d3910ef7b0 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84c4ff9640 1 -- 172.21.15.137:0/1058435545 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d4032640 con 0x55d3910ef7b0 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.118+0000 7f84c4ff9640 1 -- 172.21.15.137:0/1058435545 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4037040 con 0x55d3910ef7b0 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 -- 172.21.15.137:0/1058435545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 msgr2=0x55d39110d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1058435545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d39110d760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f84d40098c0 tx=0x7f84d402e000 comp rx=0 tx=0).stop 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 -- 172.21.15.137:0/1058435545 shutdown_connections 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1058435545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3910ef7b0 0x55d39110d760 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1058435545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3911013c0 0x55d39110dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 --2- 172.21.15.137:0/1058435545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910c4cf0 0x55d3910ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 -- 172.21.15.137:0/1058435545 >> 172.21.15.137:0/1058435545 conn(0x55d391059e90 msgr2=0x55d39110c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 -- 172.21.15.137:0/1058435545 shutdown_connections 2024-04-26T22:01:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 -- 172.21.15.137:0/1058435545 wait complete. 2024-04-26T22:01:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 -- start start 2024-04-26T22:01:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.119+0000 7f84e8de9740 1 Processor -- start 2024-04-26T22:01:49.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 0x55d39112d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 0x55d39118b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84e8de9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d39118bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84e8de9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d390fc2e70 con 0x55d3911013c0 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84e8de9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d3910ed300 con 0x55d3910ef7b0 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84e8de9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d3910d8b00 con 0x55d3910c4cf0 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84e8de9740 10 client.0 _ll_register_callbacks cb 0x7f84d0009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84dffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d39118bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84dffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d39118bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55148/0 (socket says 172.21.15.137:55148) 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84dffff640 1 -- 172.21.15.137:0/3202306033 learned_addr learned my addr 172.21.15.137:0/3202306033 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84df7fe640 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 0x55d39112d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84deffd640 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 0x55d39118b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84dffff640 1 -- 172.21.15.137:0/3202306033 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 msgr2=0x55d39112d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84dffff640 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 0x55d39112d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84dffff640 1 -- 172.21.15.137:0/3202306033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 msgr2=0x55d39118b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84dffff640 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 0x55d39118b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.120+0000 7f84dffff640 1 -- 172.21.15.137:0/3202306033 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3910d7ea0 con 0x55d3911013c0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84dffff640 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d39118bde0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f84d8059330 tx=0x7f84d80559d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ac8204f86938ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84be7fc640 1 -- 172.21.15.137:0/3202306033 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8061cd0 con 0x55d3911013c0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84be7fc640 1 -- 172.21.15.137:0/3202306033 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f84d8088070 con 0x55d3911013c0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84e8de9740 1 -- 172.21.15.137:0/3202306033 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84d4032640 con 0x55d3911013c0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84be7fc640 1 -- 172.21.15.137:0/3202306033 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f84d8055590 con 0x55d3911013c0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84e8de9740 10 client.6318 fetch_fsmap learned FSMap version 27 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84e8de9740 1 -- 172.21.15.137:0/3202306033 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55d3910d7ea0 con 0x55d3911013c0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84be7fc640 1 -- 172.21.15.137:0/3202306033 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d4032640 con 0x55d3911013c0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84be7fc640 1 -- 172.21.15.137:0/3202306033 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f84d8083170 con 0x55d3911013c0 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84e8de9740 10 client.6318 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84e8de9740 10 client.6318 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:01:49.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84e8de9740 20 client.6318 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x55d391190230 0x55d391123650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84e8de9740 4 client.6318 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84e8de9740 1 -- 172.21.15.137:0/3202306033 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55d391037790 con 0x55d391190230 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.121+0000 7f84df7fe640 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x55d391190230 0x55d391123650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84be7fc640 10 client.6318 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84df7fe640 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x55d391190230 0x55d391123650 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74e0d0aad3c59290 server_cookie=376420f93fd1f0bd in_seq=0 out_seq=0 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84be7fc640 1 -- 172.21.15.137:0/3202306033 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+141 (crc 0 0 0) 0x55d391037790 con 0x55d391190230 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84be7fc640 10 client.6318 handle_command_reply: tid=0 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 client.6318 shutdown 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 -- 172.21.15.137:0/3202306033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 msgr2=0x55d39118bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d39118bde0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f84d8059330 tx=0x7f84d80559d0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 -- 172.21.15.137:0/3202306033 shutdown_connections 2024-04-26T22:01:49.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x55d391190230 0x55d391123650 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d3911013c0 0x55d39118bde0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84be7fc640 0 client.6318 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3910ef7b0 0x55d39118b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 --2- 172.21.15.137:0/3202306033 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d3910c4cf0 0x55d39112d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 -- 172.21.15.137:0/3202306033 >> 172.21.15.137:0/3202306033 conn(0x55d391059e90 msgr2=0x55d3910ed670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 -- 172.21.15.137:0/3202306033 shutdown_connections 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 1 -- 172.21.15.137:0/3202306033 wait complete. 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e8de9740 20 client.6318 trim_cache size 0 max 16384 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:49.129 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:01:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:01:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-26T22:01:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 3150573752, 2024-04-26T22:01:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511627777, 2024-04-26T22:01:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/dir_test/file" 2024-04-26T22:01:49.130 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:49.130 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:01:49.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e5ff0640 1 -- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84cc06c8f0 msgr2=0x7f84cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e5ff0640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84cc06c8f0 0x7f84cc06edb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009560 tx=0x7f84d0009190 comp rx=0 tx=0).stop 2024-04-26T22:01:49.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e5ff0640 1 -- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e00d0300 msgr2=0x7f84e0142e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.122+0000 7f84e5ff0640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e00d0300 0x7f84e0142e50 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f84d800cad0 tx=0x7f84d800cf90 comp rx=0 tx=0).stop 2024-04-26T22:01:49.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.123+0000 7f84e5ff0640 1 -- 172.21.15.137:0/775882333 shutdown_connections 2024-04-26T22:01:49.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.123+0000 7f84e5ff0640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84cc06c8f0 0x7f84cc06edb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.123+0000 7f84e5ff0640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84e00d0300 0x7f84e0142e50 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.123+0000 7f84e5ff0640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84e00b3e50 0x7f84e015d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.123+0000 7f84e5ff0640 1 --2- 172.21.15.137:0/775882333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84e006f340 0x7f84e013a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.123+0000 7f84e5ff0640 1 -- 172.21.15.137:0/775882333 >> 172.21.15.137:0/775882333 conn(0x7f84e00cd8a0 msgr2=0x7f84e00cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.123+0000 7f84e5ff0640 1 -- 172.21.15.137:0/775882333 shutdown_connections 2024-04-26T22:01:49.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.123+0000 7f84e5ff0640 1 -- 172.21.15.137:0/775882333 wait complete. 2024-04-26T22:01:49.133 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T22:01:49.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.229+0000 7ff0a4d78640 1 Processor -- start 2024-04-26T22:01:49.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.229+0000 7ff0a4d78640 1 -- start start 2024-04-26T22:01:49.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff0a4d78640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff0a01469f0 0x7ff0a00ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff0a4d78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00cd420 0x7ff0a00d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff0a4d78640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a0160f40 con 0x7ff0a00d1240 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff0a4d78640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a00b5960 con 0x7ff0a01469f0 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff0a4d78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a0161ac0 con 0x7ff0a00cd420 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff09dd9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00cd420 0x7ff0a00d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff09e59c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff0a01469f0 0x7ff0a00ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff09dd9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00cd420 0x7ff0a00d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:50630/0 (socket says 172.21.15.137:50630) 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff09dd9b640 1 -- 172.21.15.137:0/2137432480 learned_addr learned my addr 172.21.15.137:0/2137432480 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff09d59a640 1 -- 172.21.15.137:0/2137432480 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546767696 0 0) 0x7ff0a0160f40 con 0x7ff0a00d1240 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff09dd9b640 1 -- 172.21.15.137:0/2137432480 >> v2:172.21.15.170:3300/0 conn(0x7ff0a01469f0 msgr2=0x7ff0a00ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff09dd9b640 1 --2- 172.21.15.137:0/2137432480 >> v2:172.21.15.170:3300/0 conn(0x7ff0a01469f0 0x7ff0a00ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.230+0000 7ff09dd9b640 1 -- 172.21.15.137:0/2137432480 >> v1:172.21.15.170:6789/0 conn(0x7ff0a00d1240 legacy=0x7ff0a006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.231+0000 7ff09dd9b640 1 -- 172.21.15.137:0/2137432480 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a0161220 con 0x7ff0a00cd420 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.231+0000 7ff09dd9b640 1 --2- 172.21.15.137:0/2137432480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00cd420 0x7ff0a00d0d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff094009870 tx=0x7ff09402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11fcad907fdb715f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.231+0000 7ff09d59a640 1 -- 172.21.15.137:0/2137432480 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094037070 con 0x7ff0a00cd420 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.231+0000 7ff09d59a640 1 -- 172.21.15.137:0/2137432480 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff094032440 con 0x7ff0a00cd420 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.231+0000 7ff09d59a640 1 -- 172.21.15.137:0/2137432480 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094032810 con 0x7ff0a00cd420 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.232+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2137432480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00cd420 msgr2=0x7ff0a00d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.232+0000 7ff0a4d78640 1 --2- 172.21.15.137:0/2137432480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00cd420 0x7ff0a00d0d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff094009870 tx=0x7ff09402a270 comp rx=0 tx=0).stop 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.232+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2137432480 shutdown_connections 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.232+0000 7ff0a4d78640 1 --2- 172.21.15.137:0/2137432480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00cd420 0x7ff0a00d0d00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.232+0000 7ff0a4d78640 1 --2- 172.21.15.137:0/2137432480 >> v2:172.21.15.170:3300/0 conn(0x7ff0a01469f0 0x7ff0a00ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.232+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2137432480 >> 172.21.15.137:0/2137432480 conn(0x7ff0a00cd830 msgr2=0x7ff0a00cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.232+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2137432480 shutdown_connections 2024-04-26T22:01:49.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.232+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2137432480 wait complete. 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.233+0000 7ff0a4d78640 1 Processor -- start 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.233+0000 7ff0a4d78640 1 -- start start 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff0a4d78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a00cd420 0x7ff0a013f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff0a4d78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00d1240 0x7ff0a0143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff0a4d78640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a01469f0 0x7ff0a0144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff0a4d78640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a0072020 con 0x7ff0a01469f0 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff0a4d78640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a01617e0 con 0x7ff0a00cd420 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff0a4d78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a00b6de0 con 0x7ff0a00d1240 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff09ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a01469f0 0x7ff0a0144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff09ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a01469f0 0x7ff0a0144500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55150/0 (socket says 172.21.15.137:55150) 2024-04-26T22:01:49.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff09ed9d640 1 -- 172.21.15.137:0/2596991220 learned_addr learned my addr 172.21.15.137:0/2596991220 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff09dd9b640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00d1240 0x7ff0a0143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff09e59c640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a00cd420 0x7ff0a013f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff09ed9d640 1 -- 172.21.15.137:0/2596991220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00d1240 msgr2=0x7ff0a0143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff09ed9d640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00d1240 0x7ff0a0143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.234+0000 7ff09ed9d640 1 -- 172.21.15.137:0/2596991220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a00cd420 msgr2=0x7ff0a013f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.235+0000 7ff09ed9d640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a00cd420 0x7ff0a013f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.235+0000 7ff09ed9d640 1 -- 172.21.15.137:0/2596991220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a01f65f0 con 0x7ff0a01469f0 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.235+0000 7ff09ed9d640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a01469f0 0x7ff0a0144500 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff09800c780 tx=0x7ff09800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.235+0000 7ff08effd640 1 -- 172.21.15.137:0/2596991220 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098003da0 con 0x7ff0a01469f0 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.235+0000 7ff08effd640 1 -- 172.21.15.137:0/2596991220 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09800ce30 con 0x7ff0a01469f0 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.235+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a01f6890 con 0x7ff0a01469f0 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.235+0000 7ff08effd640 1 -- 172.21.15.137:0/2596991220 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098005290 con 0x7ff0a01469f0 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.235+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a01f6e50 con 0x7ff0a01469f0 2024-04-26T22:01:49.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.236+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a006a290 con 0x7ff0a01469f0 2024-04-26T22:01:49.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.236+0000 7ff08effd640 1 -- 172.21.15.137:0/2596991220 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff098005430 con 0x7ff0a01469f0 2024-04-26T22:01:49.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.237+0000 7ff08effd640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff08006c8f0 0x7ff08006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.237+0000 7ff08effd640 1 -- 172.21.15.137:0/2596991220 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7ff09808b8c0 con 0x7ff0a01469f0 2024-04-26T22:01:49.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.237+0000 7ff09e59c640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff08006c8f0 0x7ff08006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.237+0000 7ff09e59c640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff08006c8f0 0x7ff08006edb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff090009aa0 tx=0x7ff090009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.241+0000 7ff08effd640 1 -- 172.21.15.137:0/2596991220 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff0980596a0 con 0x7ff0a01469f0 2024-04-26T22:01:49.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.457+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff0a00b60a0 con 0x7ff0a01469f0 2024-04-26T22:01:49.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.457+0000 7ff08effd640 1 -- 172.21.15.137:0/2596991220 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7ff09805d9a0 con 0x7ff0a01469f0 2024-04-26T22:01:49.458 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:01:49.458 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-26T22:01:49.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff08006c8f0 msgr2=0x7ff08006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff08006c8f0 0x7ff08006edb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff090009aa0 tx=0x7ff090009190 comp rx=0 tx=0).stop 2024-04-26T22:01:49.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a01469f0 msgr2=0x7ff0a0144500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a01469f0 0x7ff0a0144500 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff09800c780 tx=0x7ff09800cc40 comp rx=0 tx=0).stop 2024-04-26T22:01:49.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 shutdown_connections 2024-04-26T22:01:49.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff08006c8f0 0x7ff08006edb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff0a01469f0 0x7ff0a0144500 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff0a00d1240 0x7ff0a0143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 --2- 172.21.15.137:0/2596991220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a00cd420 0x7ff0a013f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.459+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 >> 172.21.15.137:0/2596991220 conn(0x7ff0a00cd830 msgr2=0x7ff0a00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.460+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 shutdown_connections 2024-04-26T22:01:49.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.460+0000 7ff0a4d78640 1 -- 172.21.15.137:0/2596991220 wait complete. 2024-04-26T22:01:49.474 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-26T22:01:49.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:49.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-04-26T22:01:49.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.575+0000 7f6877a3e640 1 Processor -- start 2024-04-26T22:01:49.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.575+0000 7f6877a3e640 1 -- start start 2024-04-26T22:01:49.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f6877a3e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700cee20 0x7f687006d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f6877a3e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f687009c150 0x7f687015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f6877a3e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68700d1240 con 0x7f68700d3a30 2024-04-26T22:01:49.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f6877a3e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f68700d1e10 con 0x7f687009c150 2024-04-26T22:01:49.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f6877a3e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f68700d14e0 con 0x7f68700cee20 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f6875fdb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f687009c150 0x7f687015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f6874fd9640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f68700d3a30 0x7f687009ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52648/0 (socket says 172.21.15.137:52648) 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f6874fd9640 1 -- 172.21.15.137:0/3031531184 learned_addr learned my addr 172.21.15.137:0/3031531184 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f68757da640 1 --2- 172.21.15.137:0/3031531184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700cee20 0x7f687006d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.576+0000 7f6875fdb640 1 -- 172.21.15.137:0/3031531184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700cee20 msgr2=0x7f687006d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.577+0000 7f6875fdb640 1 --2- 172.21.15.137:0/3031531184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700cee20 0x7f687006d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.577+0000 7f6875fdb640 1 -- 172.21.15.137:0/3031531184 >> v1:172.21.15.137:6789/0 conn(0x7f68700d3a30 legacy=0x7f687009ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.577+0000 7f6867fff640 1 -- 172.21.15.137:0/3031531184 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317875290 0 0) 0x7f68700d1240 con 0x7f68700d3a30 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.577+0000 7f6875fdb640 1 -- 172.21.15.137:0/3031531184 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68700d17c0 con 0x7f687009c150 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.577+0000 7f68757da640 1 --2- 172.21.15.137:0/3031531184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700cee20 0x7f687006d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.577+0000 7f6875fdb640 1 --2- 172.21.15.137:0/3031531184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f687009c150 0x7f687015eb80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f686802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34e8c5586881cec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.577+0000 7f6867fff640 1 -- 172.21.15.137:0/3031531184 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868007740 con 0x7f687009c150 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.577+0000 7f6867fff640 1 -- 172.21.15.137:0/3031531184 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68680078e0 con 0x7f687009c150 2024-04-26T22:01:49.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.577+0000 7f6867fff640 1 -- 172.21.15.137:0/3031531184 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868007cb0 con 0x7f687009c150 2024-04-26T22:01:49.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.578+0000 7f6877a3e640 1 -- 172.21.15.137:0/3031531184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f687009c150 msgr2=0x7f687015eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.578+0000 7f6877a3e640 1 --2- 172.21.15.137:0/3031531184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f687009c150 0x7f687015eb80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6868009d90 tx=0x7f686802a6f0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.578+0000 7f6877a3e640 1 -- 172.21.15.137:0/3031531184 shutdown_connections 2024-04-26T22:01:49.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.578+0000 7f6877a3e640 1 --2- 172.21.15.137:0/3031531184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f687009c150 0x7f687015eb80 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.578+0000 7f6877a3e640 1 --2- 172.21.15.137:0/3031531184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700cee20 0x7f687006d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.578+0000 7f6877a3e640 1 -- 172.21.15.137:0/3031531184 >> 172.21.15.137:0/3031531184 conn(0x7f68700d2f10 msgr2=0x7f68700d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.578+0000 7f6877a3e640 1 -- 172.21.15.137:0/3031531184 shutdown_connections 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.578+0000 7f6877a3e640 1 -- 172.21.15.137:0/3031531184 wait complete. 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.579+0000 7f6877a3e640 1 Processor -- start 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.579+0000 7f6877a3e640 1 -- start start 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6877a3e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f687009c150 0x7f68700cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6877a3e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68700cee20 0x7f687015f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6877a3e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700d3a30 0x7f68700c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6877a3e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f68700cf200 con 0x7f68700cee20 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6877a3e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f687009c7a0 con 0x7f687009c150 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6877a3e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f68700cf380 con 0x7f68700d3a30 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6874fd9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68700cee20 0x7f687015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6874fd9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68700cee20 0x7f687015f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55170/0 (socket says 172.21.15.137:55170) 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6874fd9640 1 -- 172.21.15.137:0/642423582 learned_addr learned my addr 172.21.15.137:0/642423582 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6875fdb640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700d3a30 0x7f68700c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f68757da640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f687009c150 0x7f68700cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6874fd9640 1 -- 172.21.15.137:0/642423582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700d3a30 msgr2=0x7f68700c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6874fd9640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700d3a30 0x7f68700c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6874fd9640 1 -- 172.21.15.137:0/642423582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f687009c150 msgr2=0x7f68700cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6874fd9640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f687009c150 0x7f68700cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6874fd9640 1 -- 172.21.15.137:0/642423582 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68700c7fd0 con 0x7f68700cee20 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.580+0000 7f6874fd9640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68700cee20 0x7f687015f930 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f686000c420 tx=0x7f686000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.581+0000 7f6865ffb640 1 -- 172.21.15.137:0/642423582 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600074e0 con 0x7f68700cee20 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.581+0000 7f6865ffb640 1 -- 172.21.15.137:0/642423582 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68600047e0 con 0x7f68700cee20 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.581+0000 7f6877a3e640 1 -- 172.21.15.137:0/642423582 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68700c8250 con 0x7f68700cee20 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.581+0000 7f6865ffb640 1 -- 172.21.15.137:0/642423582 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860004c10 con 0x7f68700cee20 2024-04-26T22:01:49.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.581+0000 7f6877a3e640 1 -- 172.21.15.137:0/642423582 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68700c8810 con 0x7f68700cee20 2024-04-26T22:01:49.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.582+0000 7f6865ffb640 1 -- 172.21.15.137:0/642423582 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6860011070 con 0x7f68700cee20 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.582+0000 7f6865ffb640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685406c8f0 0x7f685406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.583+0000 7f6865ffb640 1 -- 172.21.15.137:0/642423582 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f686008b720 con 0x7f68700cee20 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.583+0000 7f68757da640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685406c8f0 0x7f685406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.583+0000 7f68757da640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685406c8f0 0x7f685406edb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f686c006fd0 tx=0x7f686c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f687a832740 1 Processor -- start 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f687a832740 1 -- start start 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f687a832740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 0x558366169400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f687a832740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558366163f30 0x558366167c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f687a832740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661685a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f687a832740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5583660cea10 con 0x558366168160 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f687a832740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55836606a7d0 con 0x558366169020 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f687a832740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5583660ca9d0 con 0x558366163f30 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f6875fdb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f6875fdb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55186/0 (socket says 172.21.15.137:55186) 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.584+0000 7f6875fdb640 1 -- 172.21.15.137:0/2150615321 learned_addr learned my addr 172.21.15.137:0/2150615321 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f6874fd9640 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558366163f30 0x558366167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f68757da640 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 0x558366169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f6875fdb640 1 -- 172.21.15.137:0/2150615321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558366163f30 msgr2=0x558366167c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f6875fdb640 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558366163f30 0x558366167c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f6875fdb640 1 -- 172.21.15.137:0/2150615321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 msgr2=0x558366169400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f6875fdb640 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 0x558366169400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f6875fdb640 1 -- 172.21.15.137:0/2150615321 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558365eac940 con 0x558366168160 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f68757da640 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 0x558366169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f6875fdb640 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661685a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f686802a730 tx=0x7f686802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f71991c58308bb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f685affd640 1 -- 172.21.15.137:0/2150615321 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868003d90 con 0x558366168160 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f685affd640 1 -- 172.21.15.137:0/2150615321 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6868041070 con 0x558366168160 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.585+0000 7f685affd640 1 -- 172.21.15.137:0/2150615321 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868004240 con 0x558366168160 2024-04-26T22:01:49.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 -- 172.21.15.137:0/2150615321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 msgr2=0x5583661685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661685a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f686802a730 tx=0x7f686802e000 comp rx=0 tx=0).stop 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 -- 172.21.15.137:0/2150615321 shutdown_connections 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661685a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558366163f30 0x558366167c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 --2- 172.21.15.137:0/2150615321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 0x558366169400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 -- 172.21.15.137:0/2150615321 >> 172.21.15.137:0/2150615321 conn(0x5583661663b0 msgr2=0x5583661aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 -- 172.21.15.137:0/2150615321 shutdown_connections 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 -- 172.21.15.137:0/2150615321 wait complete. 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 -- start start 2024-04-26T22:01:49.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.586+0000 7f687a832740 1 Processor -- start 2024-04-26T22:01:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f687a832740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 0x5583661b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f687a832740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x5583661afce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f687a832740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f687a832740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558366194bb0 con 0x558366169020 2024-04-26T22:01:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f687a832740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5583660684a0 con 0x558366168160 2024-04-26T22:01:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f687a832740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558366194030 con 0x5583661b6f30 2024-04-26T22:01:49.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f687a832740 10 client.0 _ll_register_callbacks cb 0x558366076dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f6874fd9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x5583661afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f6874fd9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x5583661afce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55194/0 (socket says 172.21.15.137:55194) 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f6874fd9640 1 -- 172.21.15.137:0/446032306 learned_addr learned my addr 172.21.15.137:0/446032306 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f68757da640 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 0x5583661b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.587+0000 7f6875fdb640 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f6874fd9640 1 -- 172.21.15.137:0/446032306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 msgr2=0x5583661b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f6874fd9640 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f6874fd9640 1 -- 172.21.15.137:0/446032306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 msgr2=0x5583661b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f6874fd9640 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 0x5583661b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f6874fd9640 1 -- 172.21.15.137:0/446032306 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558365f0d0d0 con 0x558366169020 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f6874fd9640 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x5583661afce0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f68600593e0 tx=0x7f686000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23a95f7dfb0ba3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f684ffff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:49.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f684ffff640 1 -- 172.21.15.137:0/446032306 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686006de60 con 0x558366169020 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f687a832740 1 -- 172.21.15.137:0/446032306 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6868041070 con 0x558366169020 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f684ffff640 1 -- 172.21.15.137:0/446032306 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f68600588a0 con 0x558366169020 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f684ffff640 1 -- 172.21.15.137:0/446032306 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6860078050 con 0x558366169020 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f687a832740 10 client.6336 fetch_fsmap learned FSMap version 27 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f687a832740 1 -- 172.21.15.137:0/446032306 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x558365da0230 con 0x558366169020 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f684ffff640 1 -- 172.21.15.137:0/446032306 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6868041070 con 0x558366169020 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f684ffff640 1 -- 172.21.15.137:0/446032306 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f68600551a0 con 0x558366169020 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f687a832740 10 client.6336 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f687a832740 10 client.6336 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f687a832740 20 client.6336 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f687a832740 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x558366189ad0 0x558366189ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f687a832740 4 client.6336 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f687a832740 1 -- 172.21.15.137:0/446032306 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583660a23a0 con 0x558366189ad0 2024-04-26T22:01:49.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.588+0000 7f68757da640 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x558366189ad0 0x558366189ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f684ffff640 10 client.6336 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f68757da640 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x558366189ad0 0x558366189ef0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78495e70508aa1a6 server_cookie=66f457034b2961b7 in_seq=0 out_seq=0 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f684ffff640 1 -- 172.21.15.137:0/446032306 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5583660a23a0 con 0x558366189ad0 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f684ffff640 10 client.6336 handle_command_reply: tid=0 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f687a832740 1 client.6336 shutdown 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f687a832740 1 -- 172.21.15.137:0/446032306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 msgr2=0x5583661afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f687a832740 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x5583661afce0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f68600593e0 tx=0x7f686000f000 comp rx=0 tx=0).stop 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f687a832740 1 -- 172.21.15.137:0/446032306 shutdown_connections 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f687a832740 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x558366189ad0 0x558366189ef0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f687a832740 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x5583661afce0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f687a832740 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f687a832740 1 --2- 172.21.15.137:0/446032306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 0x5583661b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.589+0000 7f684ffff640 0 client.6336 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.590+0000 7f687a832740 1 -- 172.21.15.137:0/446032306 >> 172.21.15.137:0/446032306 conn(0x558366163f30 msgr2=0x558366163570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.590+0000 7f687a832740 1 -- 172.21.15.137:0/446032306 shutdown_connections 2024-04-26T22:01:49.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.590+0000 7f687a832740 1 -- 172.21.15.137:0/446032306 wait complete. 2024-04-26T22:01:49.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.590+0000 7f687a832740 20 client.6336 trim_cache size 0 max 16384 2024-04-26T22:01:49.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.607+0000 7f687a832740 1 Processor -- start 2024-04-26T22:01:49.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.607+0000 7f687a832740 1 -- start start 2024-04-26T22:01:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f687a832740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 0x5583661b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f687a832740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x558366220d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f687a832740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f687a832740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6870201700 con 0x558366169020 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f687a832740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f68701617a0 con 0x558366168160 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f687a832740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6870160b00 con 0x5583661b6f30 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f6874fd9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x558366220d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f6874fd9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x558366220d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55204/0 (socket says 172.21.15.137:55204) 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f6874fd9640 1 -- 172.21.15.137:0/3866250380 learned_addr learned my addr 172.21.15.137:0/3866250380 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f6875fdb640 1 --2- 172.21.15.137:0/3866250380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f68757da640 1 --2- 172.21.15.137:0/3866250380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 0x5583661b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f6874fd9640 1 -- 172.21.15.137:0/3866250380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 msgr2=0x5583661abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f6874fd9640 1 --2- 172.21.15.137:0/3866250380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f6874fd9640 1 -- 172.21.15.137:0/3866250380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 msgr2=0x5583661b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f6874fd9640 1 --2- 172.21.15.137:0/3866250380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 0x5583661b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.608+0000 7f6874fd9640 1 -- 172.21.15.137:0/3866250380 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583661656b0 con 0x558366169020 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f6874fd9640 1 --2- 172.21.15.137:0/3866250380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x558366220d20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f68600558b0 tx=0x7f6860070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f58ddf8296b2fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f685a7fc640 1 -- 172.21.15.137:0/3866250380 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686006de60 con 0x558366169020 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f685a7fc640 1 -- 172.21.15.137:0/3866250380 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6860088070 con 0x558366169020 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f685a7fc640 1 -- 172.21.15.137:0/3866250380 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860059b50 con 0x558366169020 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f687a832740 1 -- 172.21.15.137:0/3866250380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 msgr2=0x558366220d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f687a832740 1 --2- 172.21.15.137:0/3866250380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x558366220d20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f68600558b0 tx=0x7f6860070000 comp rx=0 tx=0).stop 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f687a832740 1 -- 172.21.15.137:0/3866250380 shutdown_connections 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f687a832740 1 --2- 172.21.15.137:0/3866250380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366169020 0x558366220d20 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f687a832740 1 --2- 172.21.15.137:0/3866250380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f687a832740 1 --2- 172.21.15.137:0/3866250380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366168160 0x5583661b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f687a832740 1 -- 172.21.15.137:0/3866250380 >> 172.21.15.137:0/3866250380 conn(0x558366163f30 msgr2=0x558366193190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f687a832740 1 -- 172.21.15.137:0/3866250380 shutdown_connections 2024-04-26T22:01:49.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.609+0000 7f687a832740 1 -- 172.21.15.137:0/3866250380 wait complete. 2024-04-26T22:01:49.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.610+0000 7f687a832740 1 -- start start 2024-04-26T22:01:49.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.610+0000 7f687a832740 1 Processor -- start 2024-04-26T22:01:49.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f687a832740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661ac260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f687a832740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 0x55836621cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f687a832740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661c1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f687a832740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5583661b05a0 con 0x558366168160 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f687a832740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6870161150 con 0x558366169020 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f687a832740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558366188fc0 con 0x5583661b6f30 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f687a832740 10 client.0 _ll_register_callbacks cb 0x7f6860059310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f68757da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f68757da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661ac260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55218/0 (socket says 172.21.15.137:55218) 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f68757da640 1 -- 172.21.15.137:0/2372627777 learned_addr learned my addr 172.21.15.137:0/2372627777 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f6874fd9640 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 0x55836621cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f6875fdb640 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661c1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f68757da640 1 -- 172.21.15.137:0/2372627777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 msgr2=0x5583661c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f68757da640 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661c1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f68757da640 1 -- 172.21.15.137:0/2372627777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 msgr2=0x55836621cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f68757da640 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 0x55836621cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.611+0000 7f68757da640 1 -- 172.21.15.137:0/2372627777 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558366168df0 con 0x558366168160 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.612+0000 7f68757da640 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661ac260 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f686c010e60 tx=0x7f686c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e69a83dbba477e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.612+0000 7f684ffff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.612+0000 7f684ffff640 1 -- 172.21.15.137:0/2372627777 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c01c030 con 0x558366168160 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.612+0000 7f684ffff640 1 -- 172.21.15.137:0/2372627777 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f686c015670 con 0x558366168160 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.612+0000 7f687a832740 1 -- 172.21.15.137:0/2372627777 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6860088070 con 0x558366168160 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.612+0000 7f684ffff640 1 -- 172.21.15.137:0/2372627777 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f686c03a050 con 0x558366168160 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.612+0000 7f687a832740 10 client.6342 fetch_fsmap learned FSMap version 27 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.612+0000 7f687a832740 1 -- 172.21.15.137:0/2372627777 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55836621d600 con 0x558366168160 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.612+0000 7f684ffff640 1 -- 172.21.15.137:0/2372627777 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6860088070 con 0x558366168160 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f684ffff640 1 -- 172.21.15.137:0/2372627777 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f686c03d020 con 0x558366168160 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f687a832740 10 client.6342 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f687a832740 10 client.6342 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f687a832740 20 client.6342 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f687a832740 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5583661bd5c0 0x5583661bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f687a832740 4 client.6342 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-04-26T22:01:49.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f687a832740 1 -- 172.21.15.137:0/2372627777 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) -- 0x5583660dc620 con 0x5583661bd5c0 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f6874fd9640 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5583661bd5c0 0x5583661bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f684ffff640 10 client.6342 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.613+0000 7f6874fd9640 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5583661bd5c0 0x5583661bd9a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ea8e1b9e85420ed server_cookie=c24ef3431150f22b in_seq=0 out_seq=0 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f684ffff640 1 -- 172.21.15.137:0/2372627777 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5583660dc620 con 0x5583661bd5c0 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f684ffff640 10 client.6342 handle_command_reply: tid=0 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 client.6342 shutdown 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 -- 172.21.15.137:0/2372627777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 msgr2=0x5583661ac260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661ac260 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f686c010e60 tx=0x7f686c004730 comp rx=0 tx=0).stop 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 -- 172.21.15.137:0/2372627777 shutdown_connections 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5583661bd5c0 0x5583661bd9a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5583661b6f30 0x5583661c1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558366169020 0x55836621cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 --2- 172.21.15.137:0/2372627777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558366168160 0x5583661ac260 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f684ffff640 0 client.6342 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 -- 172.21.15.137:0/2372627777 >> 172.21.15.137:0/2372627777 conn(0x558366163f30 msgr2=0x558366220d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.619 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:01:49.614+0000 7fa5edd8e640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={6213=0-4194304@1} caps={6213=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6213 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x558821c62680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T22:01:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 -- 172.21.15.137:0/2372627777 shutdown_connections 2024-04-26T22:01:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 1 -- 172.21.15.137:0/2372627777 wait complete. 2024-04-26T22:01:49.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.614+0000 7f687a832740 20 client.6342 trim_cache size 0 max 16384 2024-04-26T22:01:49.620 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:01:49.620 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:01:49.620 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "2afb9664-8cfa-45ce-80cf-ca3e61280971", 2024-04-26T22:01:49.620 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:01:49.620 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:01:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 -- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685406c8f0 msgr2=0x7f685406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685406c8f0 0x7f685406edb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f686c006fd0 tx=0x7f686c008040 comp rx=0 tx=0).stop 2024-04-26T22:01:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 -- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68700cee20 msgr2=0x7f687015f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68700cee20 0x7f687015f930 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f686000c420 tx=0x7f686000c8e0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 -- 172.21.15.137:0/642423582 shutdown_connections 2024-04-26T22:01:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f685406c8f0 0x7f685406edb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f68700cee20 0x7f687015f930 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f68700d3a30 0x7f68700c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 --2- 172.21.15.137:0/642423582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f687009c150 0x7f68700cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 -- 172.21.15.137:0/642423582 >> 172.21.15.137:0/642423582 conn(0x7f68700d2f10 msgr2=0x7f68700b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 -- 172.21.15.137:0/642423582 shutdown_connections 2024-04-26T22:01:49.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.615+0000 7f6877a3e640 1 -- 172.21.15.137:0/642423582 wait complete. 2024-04-26T22:01:49.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:01:49.626 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-26T22:01:49.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.724+0000 7fba05015640 1 Processor -- start 2024-04-26T22:01:49.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.724+0000 7fba05015640 1 -- start start 2024-04-26T22:01:49.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fba05015640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba000711a0 0x7fba000b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fba05015640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fba0015c550 0x7fba0015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fba05015640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba000b6020 0x7fba000b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fba05015640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fba00071580 con 0x7fba000b6020 2024-04-26T22:01:49.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fba05015640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fba000b4fe0 con 0x7fba0015c550 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fba05015640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fba0015d070 con 0x7fba000711a0 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fb9ff59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba000b6020 0x7fba000b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fb9ff59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba000b6020 0x7fba000b64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55224/0 (socket says 172.21.15.137:55224) 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fb9ff59e640 1 -- 172.21.15.137:0/514987424 learned_addr learned my addr 172.21.15.137:0/514987424 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/514987424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba000711a0 0x7fba000b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.725+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/514987424 >> v2:172.21.15.170:3300/0 conn(0x7fba0015c550 0x7fba0015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9ff59e640 1 -- 172.21.15.137:0/514987424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba000711a0 msgr2=0x7fba000b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/514987424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba000711a0 0x7fba000b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9ff59e640 1 -- 172.21.15.137:0/514987424 >> v2:172.21.15.170:3300/0 conn(0x7fba0015c550 msgr2=0x7fba0015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/514987424 >> v2:172.21.15.170:3300/0 conn(0x7fba0015c550 0x7fba0015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9ff59e640 1 -- 172.21.15.137:0/514987424 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0015d350 con 0x7fba000b6020 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/514987424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba000711a0 0x7fba000b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/514987424 >> v2:172.21.15.170:3300/0 conn(0x7fba0015c550 0x7fba0015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:01:49.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/514987424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000b6020 0x7fba000b64b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fba000b46d0 tx=0x7fb9f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e93d319bbf6eaa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9fdd9b640 1 -- 172.21.15.137:0/514987424 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8037070 con 0x7fba000b6020 2024-04-26T22:01:49.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9fdd9b640 1 -- 172.21.15.137:0/514987424 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f8032440 con 0x7fba000b6020 2024-04-26T22:01:49.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.726+0000 7fb9fdd9b640 1 -- 172.21.15.137:0/514987424 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8032810 con 0x7fba000b6020 2024-04-26T22:01:49.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.727+0000 7fba05015640 1 -- 172.21.15.137:0/514987424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000b6020 msgr2=0x7fba000b64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.727+0000 7fba05015640 1 --2- 172.21.15.137:0/514987424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000b6020 0x7fba000b64b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fba000b46d0 tx=0x7fb9f802a1e0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.727+0000 7fba05015640 1 -- 172.21.15.137:0/514987424 shutdown_connections 2024-04-26T22:01:49.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.727+0000 7fba05015640 1 --2- 172.21.15.137:0/514987424 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000b6020 0x7fba000b64b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.727+0000 7fba05015640 1 --2- 172.21.15.137:0/514987424 >> v2:172.21.15.170:3300/0 conn(0x7fba0015c550 0x7fba0015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.727+0000 7fba05015640 1 --2- 172.21.15.137:0/514987424 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba000711a0 0x7fba000b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.727+0000 7fba05015640 1 -- 172.21.15.137:0/514987424 >> 172.21.15.137:0/514987424 conn(0x7fba000b3b60 msgr2=0x7fba000b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.727+0000 7fba05015640 1 -- 172.21.15.137:0/514987424 shutdown_connections 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.727+0000 7fba05015640 1 -- 172.21.15.137:0/514987424 wait complete. 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.728+0000 7fba05015640 1 Processor -- start 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.728+0000 7fba05015640 1 -- start start 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fba05015640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000711a0 0x7fba001e3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fba05015640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba000b6020 0x7fba0014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fba05015640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0015c550 0x7fba0014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fba05015640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba00073350 con 0x7fba000711a0 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fba05015640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fba000b5d00 con 0x7fba000b6020 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fba05015640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fba000734d0 con 0x7fba0015c550 2024-04-26T22:01:49.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fb9fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000711a0 0x7fba001e3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fb9fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000711a0 0x7fba001e3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55232/0 (socket says 172.21.15.137:55232) 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fb9fed9d640 1 -- 172.21.15.137:0/3993107715 learned_addr learned my addr 172.21.15.137:0/3993107715 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba000b6020 0x7fba0014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.729+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0015c550 0x7fba0014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fb9fed9d640 1 -- 172.21.15.137:0/3993107715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0015c550 msgr2=0x7fba0014f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0015c550 0x7fba0014f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fb9fed9d640 1 -- 172.21.15.137:0/3993107715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba000b6020 msgr2=0x7fba0014ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba000b6020 0x7fba0014ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fb9fed9d640 1 -- 172.21.15.137:0/3993107715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba001e3ab0 con 0x7fba000711a0 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000711a0 0x7fba001e3420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0007e10 tx=0x7fb9f000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fb9e77fe640 1 -- 172.21.15.137:0/3993107715 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f001a070 con 0x7fba000711a0 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fb9e77fe640 1 -- 172.21.15.137:0/3993107715 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f0003b90 con 0x7fba000711a0 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fb9e77fe640 1 -- 172.21.15.137:0/3993107715 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0004030 con 0x7fba000711a0 2024-04-26T22:01:49.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fba05015640 1 -- 172.21.15.137:0/3993107715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba001e3d90 con 0x7fba000711a0 2024-04-26T22:01:49.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.730+0000 7fba05015640 1 -- 172.21.15.137:0/3993107715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba001e4350 con 0x7fba000711a0 2024-04-26T22:01:49.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.731+0000 7fb9e77fe640 1 -- 172.21.15.137:0/3993107715 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9f001d070 con 0x7fba000711a0 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.732+0000 7fb9e77fe640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9ec06c8f0 0x7fb9ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.732+0000 7fb9e77fe640 1 -- 172.21.15.137:0/3993107715 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb9f008bc40 con 0x7fba000711a0 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.732+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9ec06c8f0 0x7fb9ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.732+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9ec06c8f0 0x7fb9ec06edb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fba001e54c0 tx=0x7fb9f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.733+0000 7fba07e0a740 1 Processor -- start 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.733+0000 7fba07e0a740 1 -- start start 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e78f80 0x5644c6e79360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e73e10 0x5644c6e77b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 0x5644c6e78500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fba07e0a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5644c6dddd80 con 0x5644c6e78f80 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fba07e0a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5644c6d978b0 con 0x5644c6e73e10 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fba07e0a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5644c6dd9d40 con 0x5644c6e780c0 2024-04-26T22:01:49.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e78f80 0x5644c6e79360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e78f80 0x5644c6e79360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55240/0 (socket says 172.21.15.137:55240) 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fed9d640 1 -- 172.21.15.137:0/3667004300 learned_addr learned my addr 172.21.15.137:0/3667004300 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/3667004300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e73e10 0x5644c6e77b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/3667004300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 0x5644c6e78500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fed9d640 1 -- 172.21.15.137:0/3667004300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 msgr2=0x5644c6e78500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/3667004300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 0x5644c6e78500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fed9d640 1 -- 172.21.15.137:0/3667004300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e73e10 msgr2=0x5644c6e77b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/3667004300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e73e10 0x5644c6e77b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fed9d640 1 -- 172.21.15.137:0/3667004300 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c6d68a40 con 0x5644c6e78f80 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/3667004300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e78f80 0x5644c6e79360 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0062020 tx=0x7fb9f0059620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7bc5b011f3e92c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9e4ff9640 1 -- 172.21.15.137:0/3667004300 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0062550 con 0x5644c6e78f80 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9e4ff9640 1 -- 172.21.15.137:0/3667004300 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f0057d20 con 0x5644c6e78f80 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.734+0000 7fb9e4ff9640 1 -- 172.21.15.137:0/3667004300 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0060070 con 0x5644c6e78f80 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.735+0000 7fba07e0a740 1 -- 172.21.15.137:0/3667004300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e78f80 msgr2=0x5644c6e79360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.735+0000 7fba07e0a740 1 --2- 172.21.15.137:0/3667004300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e78f80 0x5644c6e79360 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0062020 tx=0x7fb9f0059620 comp rx=0 tx=0).stop 2024-04-26T22:01:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.735+0000 7fba07e0a740 1 -- 172.21.15.137:0/3667004300 shutdown_connections 2024-04-26T22:01:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.735+0000 7fba07e0a740 1 --2- 172.21.15.137:0/3667004300 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 0x5644c6e78500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.735+0000 7fba07e0a740 1 --2- 172.21.15.137:0/3667004300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e73e10 0x5644c6e77b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.735+0000 7fba07e0a740 1 --2- 172.21.15.137:0/3667004300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e78f80 0x5644c6e79360 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.735+0000 7fba07e0a740 1 -- 172.21.15.137:0/3667004300 >> 172.21.15.137:0/3667004300 conn(0x5644c6e76080 msgr2=0x5644c6ebeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.735+0000 7fba07e0a740 1 -- 172.21.15.137:0/3667004300 shutdown_connections 2024-04-26T22:01:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.735+0000 7fba07e0a740 1 -- 172.21.15.137:0/3667004300 wait complete. 2024-04-26T22:01:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.736+0000 7fba07e0a740 1 -- start start 2024-04-26T22:01:49.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.736+0000 7fba07e0a740 1 Processor -- start 2024-04-26T22:01:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.736+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e780c0 0x5644c6ec4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.736+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 0x5644c6ec1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.736+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6ec1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.736+0000 7fba07e0a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5644c6ea4b10 con 0x5644c6ec4880 2024-04-26T22:01:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fba07e0a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5644c6d64d10 con 0x5644c6e780c0 2024-04-26T22:01:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fba07e0a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5644c6ea3f90 con 0x5644c6e78f80 2024-04-26T22:01:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fba07e0a740 10 client.0 _ll_register_callbacks cb 0x5644c6d91210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:49.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ff59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6ec1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ff59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6ec1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55250/0 (socket says 172.21.15.137:55250) 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ff59e640 1 -- 172.21.15.137:0/2072900708 learned_addr learned my addr 172.21.15.137:0/2072900708 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e780c0 0x5644c6ec4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 0x5644c6ec1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ff59e640 1 -- 172.21.15.137:0/2072900708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 msgr2=0x5644c6ec1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 0x5644c6ec1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ff59e640 1 -- 172.21.15.137:0/2072900708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e780c0 msgr2=0x5644c6ec4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e780c0 0x5644c6ec4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ff59e640 1 -- 172.21.15.137:0/2072900708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c6bb97d0 con 0x5644c6ec4880 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6ec1d60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009960 tx=0x7fb9f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bf0ba500322a13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2072900708 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8037040 con 0x5644c6ec4880 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2072900708 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb9f8046410 con 0x5644c6ec4880 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fba07e0a740 1 -- 172.21.15.137:0/2072900708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9f0057d20 con 0x5644c6ec4880 2024-04-26T22:01:49.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2072900708 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb9f804e050 con 0x5644c6ec4880 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fba07e0a740 10 client.6354 fetch_fsmap learned FSMap version 27 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fba07e0a740 1 -- 172.21.15.137:0/2072900708 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5644c6aef3f0 con 0x5644c6ec4880 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.737+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2072900708 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f0057d20 con 0x5644c6ec4880 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2072900708 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fb9f8051020 con 0x5644c6ec4880 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fba07e0a740 10 client.6354 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fba07e0a740 10 client.6354 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fba07e0a740 20 client.6354 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644c6ec36e0 0x5644c6ec3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fba07e0a740 4 client.6354 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fba07e0a740 1 -- 172.21.15.137:0/2072900708 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644c6deb990 con 0x5644c6ec36e0 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644c6ec36e0 0x5644c6ec3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fb9ddffb640 10 client.6354 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.738+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644c6ec36e0 0x5644c6ec3ae0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46cabb0fb4545031 server_cookie=3baaa1c11019454a in_seq=0 out_seq=0 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2072900708 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5644c6deb990 con 0x5644c6ec36e0 2024-04-26T22:01:49.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fb9ddffb640 10 client.6354 handle_command_reply: tid=0 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 client.6354 shutdown 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 -- 172.21.15.137:0/2072900708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 msgr2=0x5644c6ec1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6ec1d60 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009960 tx=0x7fb9f8004730 comp rx=0 tx=0).stop 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 -- 172.21.15.137:0/2072900708 shutdown_connections 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644c6ec36e0 0x5644c6ec3ae0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6ec1d60 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 0x5644c6ec1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fb9ddffb640 0 client.6354 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2072900708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e780c0 0x5644c6ec4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 -- 172.21.15.137:0/2072900708 >> 172.21.15.137:0/2072900708 conn(0x5644c6e73e10 msgr2=0x5644c6e73550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 -- 172.21.15.137:0/2072900708 shutdown_connections 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 1 -- 172.21.15.137:0/2072900708 wait complete. 2024-04-26T22:01:49.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.739+0000 7fba07e0a740 20 client.6354 trim_cache size 0 max 16384 2024-04-26T22:01:49.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.756+0000 7fba07e0a740 1 Processor -- start 2024-04-26T22:01:49.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.756+0000 7fba07e0a740 1 -- start start 2024-04-26T22:01:49.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 0x5644c6e79830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e78f80 0x5644c6f37a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6f37f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fba07e0a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba001fd560 con 0x5644c6ec4880 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fba07e0a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fba0006d0e0 con 0x5644c6e78f80 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fba07e0a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fba0006c440 con 0x5644c6e780c0 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9ff59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6f37f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9ff59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6f37f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55258/0 (socket says 172.21.15.137:55258) 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9ff59e640 1 -- 172.21.15.137:0/26999591 learned_addr learned my addr 172.21.15.137:0/26999591 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e78f80 0x5644c6f37a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 0x5644c6e79830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9ff59e640 1 -- 172.21.15.137:0/26999591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 msgr2=0x5644c6e79830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 0x5644c6e79830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9ff59e640 1 -- 172.21.15.137:0/26999591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e78f80 msgr2=0x5644c6f37a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e78f80 0x5644c6f37a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9ff59e640 1 -- 172.21.15.137:0/26999591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c6aaf0f0 con 0x5644c6ec4880 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 0x5644c6e79830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6f37f50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8006f40 tx=0x7fb9f803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e85db8e72211cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9dffff640 1 -- 172.21.15.137:0/26999591 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8037040 con 0x5644c6ec4880 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9dffff640 1 -- 172.21.15.137:0/26999591 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f8046460 con 0x5644c6ec4880 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.757+0000 7fb9dffff640 1 -- 172.21.15.137:0/26999591 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8004270 con 0x5644c6ec4880 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 -- 172.21.15.137:0/26999591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 msgr2=0x5644c6f37f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6f37f50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8006f40 tx=0x7fb9f803d000 comp rx=0 tx=0).stop 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 -- 172.21.15.137:0/26999591 shutdown_connections 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6ec4880 0x5644c6f37f50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6e78f80 0x5644c6f37a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 --2- 172.21.15.137:0/26999591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e780c0 0x5644c6e79830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 -- 172.21.15.137:0/26999591 >> 172.21.15.137:0/26999591 conn(0x5644c6e73e10 msgr2=0x5644c6ebea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 -- 172.21.15.137:0/26999591 shutdown_connections 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 -- 172.21.15.137:0/26999591 wait complete. 2024-04-26T22:01:49.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 -- start start 2024-04-26T22:01:49.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.758+0000 7fba07e0a740 1 Processor -- start 2024-04-26T22:01:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e780c0 0x5644c6ee2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 0x5644c6ee2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fba07e0a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6ec4880 0x5644c6e9bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fba07e0a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5644c6e98280 con 0x5644c6e780c0 2024-04-26T22:01:49.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fba07e0a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fba0006ca90 con 0x5644c6ec4880 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fba07e0a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5644c6e97180 con 0x5644c6e78f80 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fba07e0a740 10 client.0 _ll_register_callbacks cb 0x7fb9f80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e780c0 0x5644c6ee2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e780c0 0x5644c6ee2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55264/0 (socket says 172.21.15.137:55264) 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9fed9d640 1 -- 172.21.15.137:0/2315448243 learned_addr learned my addr 172.21.15.137:0/2315448243 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 0x5644c6ee2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9ff59e640 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6ec4880 0x5644c6e9bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9fed9d640 1 -- 172.21.15.137:0/2315448243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 msgr2=0x5644c6ee2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 0x5644c6ee2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9fed9d640 1 -- 172.21.15.137:0/2315448243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6ec4880 msgr2=0x5644c6e9bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6ec4880 0x5644c6e9bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.759+0000 7fb9fed9d640 1 -- 172.21.15.137:0/2315448243 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c6d9e4b0 con 0x5644c6e780c0 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9fed9d640 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e780c0 0x5644c6ee2970 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0062020 tx=0x7fb9f005b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f9ac62e765676 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:01:49.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2315448243 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0057d20 con 0x5644c6e780c0 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2315448243 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb9f0056090 con 0x5644c6e780c0 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fba07e0a740 1 -- 172.21.15.137:0/2315448243 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9f8046460 con 0x5644c6e780c0 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2315448243 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb9f0060070 con 0x5644c6e780c0 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fba07e0a740 10 client.6360 fetch_fsmap learned FSMap version 27 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fba07e0a740 1 -- 172.21.15.137:0/2315448243 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x5644c6f3c8c0 con 0x5644c6e780c0 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2315448243 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f8046460 con 0x5644c6e780c0 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2315448243 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7fb9f0059c80 con 0x5644c6e780c0 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fba07e0a740 10 client.6360 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fba07e0a740 10 client.6360 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fba07e0a740 20 client.6360 populate_metadata read hostname 'smithi137' 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644c6ee33f0 0x5644c6e9c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fba07e0a740 4 client.6360 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fba07e0a740 1 -- 172.21.15.137:0/2315448243 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5644c6ebe8d0 con 0x5644c6ee33f0 2024-04-26T22:01:49.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644c6ee33f0 0x5644c6e9c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9fe59c640 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644c6ee33f0 0x5644c6e9c110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1876263a07b71582 server_cookie=9ce9158ca169ce41 in_seq=0 out_seq=0 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.760+0000 7fb9ddffb640 10 client.6360 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fb9ddffb640 1 -- 172.21.15.137:0/2315448243 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x5644c6ebe8d0 con 0x5644c6ee33f0 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fb9ddffb640 10 client.6360 handle_command_reply: tid=0 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 client.6360 shutdown 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 -- 172.21.15.137:0/2315448243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e780c0 msgr2=0x5644c6ee2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e780c0 0x5644c6ee2970 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0062020 tx=0x7fb9f005b000 comp rx=0 tx=0).stop 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 -- 172.21.15.137:0/2315448243 shutdown_connections 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644c6ee33f0 0x5644c6e9c110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644c6ec4880 0x5644c6e9bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644c6e78f80 0x5644c6ee2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fb9ddffb640 0 client.6360 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 --2- 172.21.15.137:0/2315448243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644c6e780c0 0x5644c6ee2970 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 -- 172.21.15.137:0/2315448243 >> 172.21.15.137:0/2315448243 conn(0x5644c6e73e10 msgr2=0x5644c6ea42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 -- 172.21.15.137:0/2315448243 shutdown_connections 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 1 -- 172.21.15.137:0/2315448243 wait complete. 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba07e0a740 20 client.6360 trim_cache size 0 max 16384 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stdout: "2afb9664-8cfa-45ce-80cf-ca3e61280971": { 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "2afb9664-8cfa-45ce-80cf-ca3e61280971", 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,repair,force" 2024-04-26T22:01:49.768 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:49.769 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:01:49.769 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:01:49.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 -- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9ec06c8f0 msgr2=0x7fb9ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9ec06c8f0 0x7fb9ec06edb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fba001e54c0 tx=0x7fb9f4008040 comp rx=0 tx=0).stop 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 -- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000711a0 msgr2=0x7fba001e3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000711a0 0x7fba001e3420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0007e10 tx=0x7fb9f000d4a0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 -- 172.21.15.137:0/3993107715 shutdown_connections 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9ec06c8f0 0x7fb9ec06edb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0015c550 0x7fba0014f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba000b6020 0x7fba0014ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 --2- 172.21.15.137:0/3993107715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba000711a0 0x7fba001e3420 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 -- 172.21.15.137:0/3993107715 >> 172.21.15.137:0/3993107715 conn(0x7fba000b3b60 msgr2=0x7fba000cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.761+0000 7fba05015640 1 -- 172.21.15.137:0/3993107715 shutdown_connections 2024-04-26T22:01:49.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:01:49.762+0000 7fba05015640 1 -- 172.21.15.137:0/3993107715 wait complete. 2024-04-26T22:01:49.772 INFO:tasks.cephfs.filesystem:scrub status for tag:2afb9664-8cfa-45ce-80cf-ca3e61280971 - {'path': '/', 'tag': '2afb9664-8cfa-45ce-80cf-ca3e61280971', 'options': 'recursive,repair,force'} 2024-04-26T22:02:13.283 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:02:13.286 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:02:19.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:19.774 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-26T22:02:19.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.885+0000 7faa2e7f0640 1 Processor -- start 2024-04-26T22:02:19.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.885+0000 7faa2e7f0640 1 -- start start 2024-04-26T22:02:19.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa2e7f0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faa2815f260 0x7faa2806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa2e7f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa280b4e00 0x7faa280ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa2e7f0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2815f640 con 0x7faa28070560 2024-04-26T22:02:19.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa2e7f0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faa2806c2a0 con 0x7faa2815f260 2024-04-26T22:02:19.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa2e7f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faa2806c580 con 0x7faa280b4e00 2024-04-26T22:02:19.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa27fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faa2815f260 0x7faa2806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa27fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faa2815f260 0x7faa2806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44380/0 (socket says 172.21.15.137:44380) 2024-04-26T22:02:19.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa27fff640 1 -- 172.21.15.137:0/3673307969 learned_addr learned my addr 172.21.15.137:0/3673307969 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/3673307969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa280b4e00 0x7faa280ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa27fff640 1 -- 172.21.15.137:0/3673307969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa280b4e00 msgr2=0x7faa280ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa27fff640 1 --2- 172.21.15.137:0/3673307969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa280b4e00 0x7faa280ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa27fff640 1 -- 172.21.15.137:0/3673307969 >> v1:172.21.15.170:6789/0 conn(0x7faa28070560 legacy=0x7faa280b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.886+0000 7faa27fff640 1 -- 172.21.15.137:0/3673307969 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2806c860 con 0x7faa2815f260 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.887+0000 7faa27fff640 1 --2- 172.21.15.137:0/3673307969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa2815f260 0x7faa2806d620 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7faa18009870 tx=0x7faa1802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5fa26081bfc702 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.887+0000 7faa26ffd640 1 -- 172.21.15.137:0/3673307969 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18037070 con 0x7faa2815f260 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.887+0000 7faa26ffd640 1 -- 172.21.15.137:0/3673307969 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa18032440 con 0x7faa2815f260 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.887+0000 7faa26ffd640 1 -- 172.21.15.137:0/3673307969 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18032810 con 0x7faa2815f260 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.888+0000 7faa2e7f0640 1 -- 172.21.15.137:0/3673307969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa2815f260 msgr2=0x7faa2806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.888+0000 7faa2e7f0640 1 --2- 172.21.15.137:0/3673307969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa2815f260 0x7faa2806d620 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7faa18009870 tx=0x7faa1802a210 comp rx=0 tx=0).stop 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.888+0000 7faa2e7f0640 1 -- 172.21.15.137:0/3673307969 shutdown_connections 2024-04-26T22:02:19.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.888+0000 7faa2e7f0640 1 --2- 172.21.15.137:0/3673307969 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa280b4e00 0x7faa280ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.888+0000 7faa2e7f0640 1 --2- 172.21.15.137:0/3673307969 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa2815f260 0x7faa2806d620 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.888+0000 7faa2e7f0640 1 -- 172.21.15.137:0/3673307969 >> 172.21.15.137:0/3673307969 conn(0x7faa280d1660 msgr2=0x7faa280d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:19.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.888+0000 7faa2e7f0640 1 -- 172.21.15.137:0/3673307969 shutdown_connections 2024-04-26T22:02:19.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.888+0000 7faa2e7f0640 1 -- 172.21.15.137:0/3673307969 wait complete. 2024-04-26T22:02:19.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.889+0000 7faa2e7f0640 1 Processor -- start 2024-04-26T22:02:19.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.889+0000 7faa2e7f0640 1 -- start start 2024-04-26T22:02:19.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa2e7f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa28070560 0x7faa2815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa2e7f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa280b4e00 0x7faa280ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa2e7f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa2815f260 0x7faa28159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa2e7f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa2806d100 con 0x7faa28070560 2024-04-26T22:02:19.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa2e7f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faa2806ce20 con 0x7faa280b4e00 2024-04-26T22:02:19.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa2e7f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faa2806db60 con 0x7faa2815f260 2024-04-26T22:02:19.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa27fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa28070560 0x7faa2815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa27fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa28070560 0x7faa2815f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44394/0 (socket says 172.21.15.137:44394) 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa27fff640 1 -- 172.21.15.137:0/2316845965 learned_addr learned my addr 172.21.15.137:0/2316845965 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa277fe640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa280b4e00 0x7faa280ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa2815f260 0x7faa28159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa27fff640 1 -- 172.21.15.137:0/2316845965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa2815f260 msgr2=0x7faa28159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa27fff640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa2815f260 0x7faa28159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa27fff640 1 -- 172.21.15.137:0/2316845965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa280b4e00 msgr2=0x7faa280ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa27fff640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa280b4e00 0x7faa280ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa27fff640 1 -- 172.21.15.137:0/2316845965 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa280d09f0 con 0x7faa28070560 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.890+0000 7faa277fe640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa280b4e00 0x7faa280ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.891+0000 7faa27fff640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa28070560 0x7faa2815f810 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7faa18009870 tx=0x7faa180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:19.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.891+0000 7faa24ff9640 1 -- 172.21.15.137:0/2316845965 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18041070 con 0x7faa28070560 2024-04-26T22:02:19.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.891+0000 7faa24ff9640 1 -- 172.21.15.137:0/2316845965 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1803c870 con 0x7faa28070560 2024-04-26T22:02:19.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.891+0000 7faa2e7f0640 1 -- 172.21.15.137:0/2316845965 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa280d0cd0 con 0x7faa28070560 2024-04-26T22:02:19.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.891+0000 7faa24ff9640 1 -- 172.21.15.137:0/2316845965 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa18037040 con 0x7faa28070560 2024-04-26T22:02:19.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.891+0000 7faa2e7f0640 1 -- 172.21.15.137:0/2316845965 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa280ce7c0 con 0x7faa28070560 2024-04-26T22:02:19.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.892+0000 7faa24ff9640 1 -- 172.21.15.137:0/2316845965 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa18044070 con 0x7faa28070560 2024-04-26T22:02:19.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.893+0000 7faa24ff9640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faa1406c8f0 0x7faa1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.893+0000 7faa24ff9640 1 -- 172.21.15.137:0/2316845965 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7faa180ac660 con 0x7faa28070560 2024-04-26T22:02:19.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.893+0000 7faa277fe640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faa1406c8f0 0x7faa1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.893+0000 7faa277fe640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faa1406c8f0 0x7faa1406edb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faa28154e60 tx=0x7faa1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.894+0000 7faa315e4740 1 Processor -- start 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.894+0000 7faa315e4740 1 -- start start 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.894+0000 7faa315e4740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2bf80 0x561774a2c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.894+0000 7faa315e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a26e10 0x561774a2ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.894+0000 7faa315e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2b0c0 0x561774a2b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.894+0000 7faa315e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561774990d80 con 0x561774a26e10 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.894+0000 7faa315e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56177494a8b0 con 0x561774a2b0c0 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.894+0000 7faa315e4740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56177498cd40 con 0x561774a2bf80 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa277fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a26e10 0x561774a2ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa277fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a26e10 0x561774a2ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44406/0 (socket says 172.21.15.137:44406) 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa277fe640 1 -- 172.21.15.137:0/2644510975 learned_addr learned my addr 172.21.15.137:0/2644510975 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2b0c0 0x561774a2b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa27fff640 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2bf80 0x561774a2c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa277fe640 1 -- 172.21.15.137:0/2644510975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2bf80 msgr2=0x561774a2c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa277fe640 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2bf80 0x561774a2c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa277fe640 1 -- 172.21.15.137:0/2644510975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2b0c0 msgr2=0x561774a2b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa277fe640 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2b0c0 0x561774a2b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa277fe640 1 -- 172.21.15.137:0/2644510975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56177491ba40 con 0x561774a26e10 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2b0c0 0x561774a2b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa277fe640 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a26e10 0x561774a2ab80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00da30 tx=0x7faa1c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcd2a7066072a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa0dffb640 1 -- 172.21.15.137:0/2644510975 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c024070 con 0x561774a26e10 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa0dffb640 1 -- 172.21.15.137:0/2644510975 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c0149a0 con 0x561774a26e10 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.895+0000 7faa0dffb640 1 -- 172.21.15.137:0/2644510975 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c014d90 con 0x561774a26e10 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 -- 172.21.15.137:0/2644510975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a26e10 msgr2=0x561774a2ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a26e10 0x561774a2ab80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00da30 tx=0x7faa1c010000 comp rx=0 tx=0).stop 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 -- 172.21.15.137:0/2644510975 shutdown_connections 2024-04-26T22:02:19.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a26e10 0x561774a2ab80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2b0c0 0x561774a2b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 --2- 172.21.15.137:0/2644510975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2bf80 0x561774a2c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 -- 172.21.15.137:0/2644510975 >> 172.21.15.137:0/2644510975 conn(0x561774a29080 msgr2=0x561774a71b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 -- 172.21.15.137:0/2644510975 shutdown_connections 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 -- 172.21.15.137:0/2644510975 wait complete. 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.896+0000 7faa315e4740 1 -- start start 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.897+0000 7faa315e4740 1 Processor -- start 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.897+0000 7faa315e4740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a46cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.897+0000 7faa315e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a2bf80 0x561774a77070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.897+0000 7faa315e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a73da0 0x561774a775b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.897+0000 7faa315e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561774a57b10 con 0x561774a2bf80 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.897+0000 7faa315e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561774917d10 con 0x561774a73da0 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.897+0000 7faa315e4740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561774a56f90 con 0x561774a2b0c0 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.897+0000 7faa315e4740 10 client.0 _ll_register_callbacks cb 0x561774944210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa277fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a2bf80 0x561774a77070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa277fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a2bf80 0x561774a77070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44416/0 (socket says 172.21.15.137:44416) 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa277fe640 1 -- 172.21.15.137:0/2198892707 learned_addr learned my addr 172.21.15.137:0/2198892707 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa27fff640 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a46cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a73da0 0x561774a775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa277fe640 1 -- 172.21.15.137:0/2198892707 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 msgr2=0x561774a46cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa277fe640 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a46cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa277fe640 1 -- 172.21.15.137:0/2198892707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a73da0 msgr2=0x561774a775b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa277fe640 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a73da0 0x561774a775b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa277fe640 1 -- 172.21.15.137:0/2198892707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56177476c7d0 con 0x561774a2bf80 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa27fff640 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a46cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa277fe640 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a2bf80 0x561774a77070 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009010 tx=0x7faa1c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b69ae6840f0cc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa06ffd640 1 -- 172.21.15.137:0/2198892707 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c02d070 con 0x561774a2bf80 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa06ffd640 1 -- 172.21.15.137:0/2198892707 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7faa1c029480 con 0x561774a2bf80 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa315e4740 1 -- 172.21.15.137:0/2198892707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa1c0149a0 con 0x561774a2bf80 2024-04-26T22:02:19.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa06ffd640 1 -- 172.21.15.137:0/2198892707 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa1c038050 con 0x561774a2bf80 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa315e4740 10 client.6372 fetch_fsmap learned FSMap version 28 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.898+0000 7faa315e4740 1 -- 172.21.15.137:0/2198892707 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x5617746a23f0 con 0x561774a2bf80 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa06ffd640 1 -- 172.21.15.137:0/2198892707 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c0149a0 con 0x561774a2bf80 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa06ffd640 1 -- 172.21.15.137:0/2198892707 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7faa1c0296e0 con 0x561774a2bf80 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa315e4740 10 client.6372 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa315e4740 10 client.6372 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa315e4740 20 client.6372 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa315e4740 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561774a70da0 0x561774a74c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa315e4740 4 client.6372 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa315e4740 1 -- 172.21.15.137:0/2198892707 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56177499e990 con 0x561774a70da0 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa27fff640 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561774a70da0 0x561774a74c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa06ffd640 10 client.6372 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.899+0000 7faa27fff640 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561774a70da0 0x561774a74c10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4b301787594226 server_cookie=ecebd6c2ab1560e1 in_seq=0 out_seq=0 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa06ffd640 1 -- 172.21.15.137:0/2198892707 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56177499e990 con 0x561774a70da0 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa06ffd640 10 client.6372 handle_command_reply: tid=0 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 client.6372 shutdown 2024-04-26T22:02:19.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 -- 172.21.15.137:0/2198892707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a2bf80 msgr2=0x561774a77070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a2bf80 0x561774a77070 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009010 tx=0x7faa1c0036f0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 -- 172.21.15.137:0/2198892707 shutdown_connections 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561774a70da0 0x561774a74c10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a2bf80 0x561774a77070 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a73da0 0x561774a775b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa06ffd640 0 client.6372 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 --2- 172.21.15.137:0/2198892707 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a46cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 -- 172.21.15.137:0/2198892707 >> 172.21.15.137:0/2198892707 conn(0x561774a26e10 msgr2=0x561774a26550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 -- 172.21.15.137:0/2198892707 shutdown_connections 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 1 -- 172.21.15.137:0/2198892707 wait complete. 2024-04-26T22:02:19.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.900+0000 7faa315e4740 20 client.6372 trim_cache size 0 max 16384 2024-04-26T22:02:19.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.917+0000 7faa315e4740 1 Processor -- start 2024-04-26T22:02:19.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa315e4740 1 -- start start 2024-04-26T22:02:19.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa315e4740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a75720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa315e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 0x561774a712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa315e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a22680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa315e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faa28201a40 con 0x561774a73da0 2024-04-26T22:02:19.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa315e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faa28162140 con 0x561774a2bf80 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa315e4740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faa281614a0 con 0x561774a2b0c0 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa2cd8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a22680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa2cd8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a22680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44426/0 (socket says 172.21.15.137:44426) 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.918+0000 7faa2cd8d640 1 -- 172.21.15.137:0/1694344364 learned_addr learned my addr 172.21.15.137:0/1694344364 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa277fe640 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 0x561774a712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa2cd8d640 1 -- 172.21.15.137:0/1694344364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 msgr2=0x561774a75720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa27fff640 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a75720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a75720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa2cd8d640 1 -- 172.21.15.137:0/1694344364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 msgr2=0x561774a712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 0x561774a712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa2cd8d640 1 -- 172.21.15.137:0/1694344364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617746620f0 con 0x561774a73da0 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa277fe640 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 0x561774a712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:19.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a22680 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7faa28163ec0 tx=0x7faa200107e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8444a2f95dfc37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa0d7fa640 1 -- 172.21.15.137:0/1694344364 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2001d070 con 0x561774a73da0 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa0d7fa640 1 -- 172.21.15.137:0/1694344364 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa20008e20 con 0x561774a73da0 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.919+0000 7faa0d7fa640 1 -- 172.21.15.137:0/1694344364 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2000e8a0 con 0x561774a73da0 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 -- 172.21.15.137:0/1694344364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 msgr2=0x561774a22680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a22680 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7faa28163ec0 tx=0x7faa200107e0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 -- 172.21.15.137:0/1694344364 shutdown_connections 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a22680 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 0x561774a712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 --2- 172.21.15.137:0/1694344364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a75720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 -- 172.21.15.137:0/1694344364 >> 172.21.15.137:0/1694344364 conn(0x561774a26e10 msgr2=0x561774a56f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 -- 172.21.15.137:0/1694344364 shutdown_connections 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 -- 172.21.15.137:0/1694344364 wait complete. 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 -- start start 2024-04-26T22:02:19.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.920+0000 7faa315e4740 1 Processor -- start 2024-04-26T22:02:19.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa315e4740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a55da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa315e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 0x561774a562e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa315e4740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a440e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa315e4740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56177499e990 con 0x561774a73da0 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa315e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faa28161af0 con 0x561774a2bf80 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa315e4740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561774a779e0 con 0x561774a2b0c0 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa315e4740 10 client.0 _ll_register_callbacks cb 0x7faa1c022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa2cd8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa2cd8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44430/0 (socket says 172.21.15.137:44430) 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa2cd8d640 1 -- 172.21.15.137:0/3775061762 learned_addr learned my addr 172.21.15.137:0/3775061762 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa27fff640 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a55da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa277fe640 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 0x561774a562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa2cd8d640 1 -- 172.21.15.137:0/3775061762 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 msgr2=0x561774a55da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a55da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa2cd8d640 1 -- 172.21.15.137:0/3775061762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 msgr2=0x561774a562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 0x561774a562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.921+0000 7faa2cd8d640 1 -- 172.21.15.137:0/3775061762 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617749514b0 con 0x561774a73da0 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa2cd8d640 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a440e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faa20010820 tx=0x7faa20004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaf8c50ff906b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa06ffd640 1 -- 172.21.15.137:0/3775061762 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20028020 con 0x561774a73da0 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa06ffd640 1 -- 172.21.15.137:0/3775061762 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7faa2000e680 con 0x561774a73da0 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa315e4740 1 -- 172.21.15.137:0/3775061762 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa20008e20 con 0x561774a73da0 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa06ffd640 1 -- 172.21.15.137:0/3775061762 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa20032050 con 0x561774a73da0 2024-04-26T22:02:19.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa315e4740 10 client.6378 fetch_fsmap learned FSMap version 28 2024-04-26T22:02:19.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa315e4740 1 -- 172.21.15.137:0/3775061762 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x561774a456b0 con 0x561774a73da0 2024-04-26T22:02:19.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa06ffd640 1 -- 172.21.15.137:0/3775061762 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa20008e20 con 0x561774a73da0 2024-04-26T22:02:19.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa06ffd640 1 -- 172.21.15.137:0/3775061762 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7faa20035020 con 0x561774a73da0 2024-04-26T22:02:19.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa315e4740 10 client.6378 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T22:02:19.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa315e4740 10 client.6378 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-26T22:02:19.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa315e4740 20 client.6378 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:19.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa315e4740 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561774ad3ef0 0x561774a44620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:19.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa315e4740 4 client.6378 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:02:19.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa315e4740 1 -- 172.21.15.137:0/3775061762 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561774a76be0 con 0x561774ad3ef0 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.922+0000 7faa27fff640 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561774ad3ef0 0x561774a44620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa06ffd640 10 client.6378 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa27fff640 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561774ad3ef0 0x561774a44620 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d00d35a4e66d440 server_cookie=843449b678d80568 in_seq=0 out_seq=0 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa06ffd640 1 -- 172.21.15.137:0/3775061762 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561774a76be0 con 0x561774ad3ef0 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa06ffd640 10 client.6378 handle_command_reply: tid=0 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 client.6378 shutdown 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 -- 172.21.15.137:0/3775061762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 msgr2=0x561774a440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a440e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faa20010820 tx=0x7faa20004ab0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 -- 172.21.15.137:0/3775061762 shutdown_connections 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x561774ad3ef0 0x561774a44620 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561774a73da0 0x561774a440e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa06ffd640 0 client.6378 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:02:19.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561774a2bf80 0x561774a562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 --2- 172.21.15.137:0/3775061762 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561774a2b0c0 0x561774a55da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 -- 172.21.15.137:0/3775061762 >> 172.21.15.137:0/3775061762 conn(0x561774a26e10 msgr2=0x561774a56f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:19.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 -- 172.21.15.137:0/3775061762 shutdown_connections 2024-04-26T22:02:19.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 1 -- 172.21.15.137:0/3775061762 wait complete. 2024-04-26T22:02:19.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.923+0000 7faa315e4740 20 client.6378 trim_cache size 0 max 16384 2024-04-26T22:02:19.932 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:02:19.932 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:02:19.932 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:02:19.932 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:02:19.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 -- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faa1406c8f0 msgr2=0x7faa1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:19.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faa1406c8f0 0x7faa1406edb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faa28154e60 tx=0x7faa1c009040 comp rx=0 tx=0).stop 2024-04-26T22:02:19.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 -- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa28070560 msgr2=0x7faa2815f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:19.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa28070560 0x7faa2815f810 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7faa18009870 tx=0x7faa180046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 -- 172.21.15.137:0/2316845965 shutdown_connections 2024-04-26T22:02:19.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faa1406c8f0 0x7faa1406edb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faa2815f260 0x7faa28159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa280b4e00 0x7faa280ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 --2- 172.21.15.137:0/2316845965 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faa28070560 0x7faa2815f810 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:19.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 -- 172.21.15.137:0/2316845965 >> 172.21.15.137:0/2316845965 conn(0x7faa280d1660 msgr2=0x7faa280afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:19.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 -- 172.21.15.137:0/2316845965 shutdown_connections 2024-04-26T22:02:19.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:19.924+0000 7faa2e7f0640 1 -- 172.21.15.137:0/2316845965 wait complete. 2024-04-26T22:02:19.935 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:02:19.936 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:20.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.031+0000 7fdc17252640 1 Processor -- start 2024-04-26T22:02:20.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.031+0000 7fdc17252640 1 -- start start 2024-04-26T22:02:20.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc17252640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdc1013ff70 0x7fdc10146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc17252640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc100cff20 0x7fdc101465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc17252640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc100d05b0 con 0x7fdc10140350 2024-04-26T22:02:20.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc17252640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdc100d0890 con 0x7fdc1013ff70 2024-04-26T22:02:20.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc17252640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1006e450 con 0x7fdc100cff20 2024-04-26T22:02:20.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc14fee640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdc1013ff70 0x7fdc10146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc0ffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdc10140350 0x7fdc100cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47054/0 (socket says 172.21.15.137:47054) 2024-04-26T22:02:20.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc0ffff640 1 -- 172.21.15.137:0/3397400115 learned_addr learned my addr 172.21.15.137:0/3397400115 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:20.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc157ef640 1 --2- 172.21.15.137:0/3397400115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc100cff20 0x7fdc101465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc14fee640 1 -- 172.21.15.137:0/3397400115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc100cff20 msgr2=0x7fdc101465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc14fee640 1 --2- 172.21.15.137:0/3397400115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc100cff20 0x7fdc101465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc14fee640 1 -- 172.21.15.137:0/3397400115 >> v1:172.21.15.137:6789/0 conn(0x7fdc10140350 legacy=0x7fdc100cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc14fee640 1 -- 172.21.15.137:0/3397400115 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1006e730 con 0x7fdc1013ff70 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc0f7fe640 1 -- 172.21.15.137:0/3397400115 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611088184 0 0) 0x7fdc100d05b0 con 0x7fdc10140350 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.032+0000 7fdc157ef640 1 --2- 172.21.15.137:0/3397400115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc100cff20 0x7fdc101465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.033+0000 7fdc14fee640 1 --2- 172.21.15.137:0/3397400115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1013ff70 0x7fdc10146080 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdc000097a0 tx=0x7fdc0002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3730a4e8d873a243 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.033+0000 7fdc0f7fe640 1 -- 172.21.15.137:0/3397400115 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00037070 con 0x7fdc1013ff70 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.033+0000 7fdc0f7fe640 1 -- 172.21.15.137:0/3397400115 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc0002ae50 con 0x7fdc1013ff70 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.033+0000 7fdc0f7fe640 1 -- 172.21.15.137:0/3397400115 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00032660 con 0x7fdc1013ff70 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.034+0000 7fdc17252640 1 -- 172.21.15.137:0/3397400115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1013ff70 msgr2=0x7fdc10146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.034+0000 7fdc17252640 1 --2- 172.21.15.137:0/3397400115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1013ff70 0x7fdc10146080 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdc000097a0 tx=0x7fdc0002a100 comp rx=0 tx=0).stop 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.034+0000 7fdc17252640 1 -- 172.21.15.137:0/3397400115 shutdown_connections 2024-04-26T22:02:20.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.034+0000 7fdc17252640 1 --2- 172.21.15.137:0/3397400115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc100cff20 0x7fdc101465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.034+0000 7fdc17252640 1 --2- 172.21.15.137:0/3397400115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc1013ff70 0x7fdc10146080 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.034+0000 7fdc17252640 1 -- 172.21.15.137:0/3397400115 >> 172.21.15.137:0/3397400115 conn(0x7fdc100d0d30 msgr2=0x7fdc100d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.034+0000 7fdc17252640 1 -- 172.21.15.137:0/3397400115 shutdown_connections 2024-04-26T22:02:20.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.034+0000 7fdc17252640 1 -- 172.21.15.137:0/3397400115 wait complete. 2024-04-26T22:02:20.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.035+0000 7fdc17252640 1 Processor -- start 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.035+0000 7fdc17252640 1 -- start start 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc17252640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc100cff20 0x7fdc1013e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc17252640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1013ff70 0x7fdc101f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc17252640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc10140350 0x7fdc100734a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc17252640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1006efe0 con 0x7fdc100cff20 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc17252640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1006ee60 con 0x7fdc1013ff70 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc17252640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1006f160 con 0x7fdc10140350 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc14fee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc100cff20 0x7fdc1013e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc14fee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc100cff20 0x7fdc1013e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44462/0 (socket says 172.21.15.137:44462) 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc14fee640 1 -- 172.21.15.137:0/399299043 learned_addr learned my addr 172.21.15.137:0/399299043 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc0ffff640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1013ff70 0x7fdc101f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc157ef640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc10140350 0x7fdc100734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc14fee640 1 -- 172.21.15.137:0/399299043 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc10140350 msgr2=0x7fdc100734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc14fee640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc10140350 0x7fdc100734a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc14fee640 1 -- 172.21.15.137:0/399299043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1013ff70 msgr2=0x7fdc101f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc14fee640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1013ff70 0x7fdc101f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc14fee640 1 -- 172.21.15.137:0/399299043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc10158a00 con 0x7fdc100cff20 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc0ffff640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1013ff70 0x7fdc101f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.036+0000 7fdc14fee640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc100cff20 0x7fdc1013e800 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fdc000097a0 tx=0x7fdc000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.037+0000 7fdc0d7fa640 1 -- 172.21.15.137:0/399299043 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00037040 con 0x7fdc100cff20 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.037+0000 7fdc0d7fa640 1 -- 172.21.15.137:0/399299043 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc00004030 con 0x7fdc100cff20 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.037+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc10158ce0 con 0x7fdc100cff20 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.037+0000 7fdc0d7fa640 1 -- 172.21.15.137:0/399299043 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00004420 con 0x7fdc100cff20 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.037+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc101592a0 con 0x7fdc100cff20 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.038+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1006a290 con 0x7fdc100cff20 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.038+0000 7fdc0d7fa640 1 -- 172.21.15.137:0/399299043 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdc00003610 con 0x7fdc100cff20 2024-04-26T22:02:20.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.038+0000 7fdc0d7fa640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdbfc06c8f0 0x7fdbfc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.038+0000 7fdc0d7fa640 1 -- 172.21.15.137:0/399299043 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fdc000ac900 con 0x7fdc100cff20 2024-04-26T22:02:20.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.038+0000 7fdc0ffff640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdbfc06c8f0 0x7fdbfc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.039+0000 7fdc0ffff640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdbfc06c8f0 0x7fdbfc06edb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdc101f8cb0 tx=0x7fdc04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.043+0000 7fdc0d7fa640 1 -- 172.21.15.137:0/399299043 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdc0007adc0 con 0x7fdc100cff20 2024-04-26T22:02:20.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.255+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc100b45e0 con 0x7fdc100cff20 2024-04-26T22:02:20.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.255+0000 7fdc0d7fa640 1 -- 172.21.15.137:0/399299043 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5194 (secure 0 0 0) 0x7fdc0007a6c0 con 0x7fdc100cff20 2024-04-26T22:02:20.257 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:20.257 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:01:10.893739+0000","modified":"2024-04-26T22:01:51.570195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.137:6837/4265926631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":4265926631},{"type":"v1","addr":"172.21.15.137:6837","nonce":4265926631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6060,"qdb_cluster":[6060]},"id":4}]} 2024-04-26T22:02:20.257 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 28 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdbfc06c8f0 msgr2=0x7fdbfc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdbfc06c8f0 0x7fdbfc06edb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdc101f8cb0 tx=0x7fdc04009040 comp rx=0 tx=0).stop 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc100cff20 msgr2=0x7fdc1013e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc100cff20 0x7fdc1013e800 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fdc000097a0 tx=0x7fdc000046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 shutdown_connections 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdbfc06c8f0 0x7fdbfc06edb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdc10140350 0x7fdc100734a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc1013ff70 0x7fdc101f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 --2- 172.21.15.137:0/399299043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdc100cff20 0x7fdc1013e800 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 >> 172.21.15.137:0/399299043 conn(0x7fdc100d0d30 msgr2=0x7fdc100d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 shutdown_connections 2024-04-26T22:02:20.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.258+0000 7fdc17252640 1 -- 172.21.15.137:0/399299043 wait complete. 2024-04-26T22:02:20.269 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-26T22:02:20.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.367+0000 7f376a647640 1 Processor -- start 2024-04-26T22:02:20.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.367+0000 7f376a647640 1 -- start start 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.367+0000 7f376a647640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3764074200 0x7f3764166670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.367+0000 7f376a647640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f376415c530 con 0x7f376415b930 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.367+0000 7f376a647640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f376415c810 con 0x7f376415f4f0 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.367+0000 7f376a647640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f376415caf0 con 0x7f3764074200 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.368+0000 7f3768be4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3764074200 0x7f3764166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.368+0000 7f3763fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f376415b930 0x7f376415bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47070/0 (socket says 172.21.15.137:47070) 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.368+0000 7f3763fff640 1 -- 172.21.15.137:0/1392412981 learned_addr learned my addr 172.21.15.137:0/1392412981 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.368+0000 7f3768be4640 1 -- 172.21.15.137:0/1392412981 >> v1:172.21.15.170:6789/0 conn(0x7f376415f4f0 legacy=0x7f3764073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.368+0000 7f3768be4640 1 -- 172.21.15.137:0/1392412981 >> v1:172.21.15.137:6789/0 conn(0x7f376415b930 legacy=0x7f376415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.368+0000 7f3768be4640 1 -- 172.21.15.137:0/1392412981 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376415cdd0 con 0x7f3764074200 2024-04-26T22:02:20.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.368+0000 7f3762ffd640 1 -- 172.21.15.137:0/1392412981 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734149208 0 0) 0x7f376415c530 con 0x7f376415b930 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f3768be4640 1 --2- 172.21.15.137:0/1392412981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764074200 0x7f3764166670 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f375c009c80 tx=0x7f375c02b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6422168863ab57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f3762ffd640 1 -- 172.21.15.137:0/1392412981 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c007740 con 0x7f3764074200 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f3762ffd640 1 -- 172.21.15.137:0/1392412981 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c0078e0 con 0x7f3764074200 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f3762ffd640 1 -- 172.21.15.137:0/1392412981 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c007cb0 con 0x7f3764074200 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f376a647640 1 -- 172.21.15.137:0/1392412981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764074200 msgr2=0x7f3764166670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f376a647640 1 --2- 172.21.15.137:0/1392412981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764074200 0x7f3764166670 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f375c009c80 tx=0x7f375c02b800 comp rx=0 tx=0).stop 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f376a647640 1 -- 172.21.15.137:0/1392412981 shutdown_connections 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f376a647640 1 --2- 172.21.15.137:0/1392412981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3764074200 0x7f3764166670 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f376a647640 1 -- 172.21.15.137:0/1392412981 >> 172.21.15.137:0/1392412981 conn(0x7f37640cd8a0 msgr2=0x7f37640cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f376a647640 1 -- 172.21.15.137:0/1392412981 shutdown_connections 2024-04-26T22:02:20.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.369+0000 7f376a647640 1 -- 172.21.15.137:0/1392412981 wait complete. 2024-04-26T22:02:20.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f376a647640 1 Processor -- start 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f376a647640 1 -- start start 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f376a647640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3764074200 0x7f37641507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f376a647640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f376415b930 0x7f37640af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f376a647640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f376415f4f0 0x7f37640afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f376a647640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f37640d0270 con 0x7f376415f4f0 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f376a647640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f376406fdd0 con 0x7f376415b930 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f376a647640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f37640d03f0 con 0x7f3764074200 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f3768be4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f376415f4f0 0x7f37640afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f3768be4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f376415f4f0 0x7f37640afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44480/0 (socket says 172.21.15.137:44480) 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.371+0000 7f3768be4640 1 -- 172.21.15.137:0/3395168349 learned_addr learned my addr 172.21.15.137:0/3395168349 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f37637fe640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f376415b930 0x7f37640af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f3768be4640 1 -- 172.21.15.137:0/3395168349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3764074200 msgr2=0x7f37641507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f3768be4640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3764074200 0x7f37641507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f3768be4640 1 -- 172.21.15.137:0/3395168349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f376415b930 msgr2=0x7f37640af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f3768be4640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f376415b930 0x7f37640af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f3768be4640 1 -- 172.21.15.137:0/3395168349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37640c6d60 con 0x7f376415f4f0 2024-04-26T22:02:20.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f37637fe640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f376415b930 0x7f37640af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:20.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f3768be4640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f376415f4f0 0x7f37640afec0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f375c009da0 tx=0x7f375c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f3760ff9640 1 -- 172.21.15.137:0/3395168349 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c033c30 con 0x7f376415f4f0 2024-04-26T22:02:20.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f3760ff9640 1 -- 172.21.15.137:0/3395168349 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c033dd0 con 0x7f376415f4f0 2024-04-26T22:02:20.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f376a647640 1 -- 172.21.15.137:0/3395168349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37640c7040 con 0x7f376415f4f0 2024-04-26T22:02:20.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f3760ff9640 1 -- 172.21.15.137:0/3395168349 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c003b90 con 0x7f376415f4f0 2024-04-26T22:02:20.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.372+0000 7f376a647640 1 -- 172.21.15.137:0/3395168349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37640ad880 con 0x7f376415f4f0 2024-04-26T22:02:20.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.374+0000 7f3760ff9640 1 -- 172.21.15.137:0/3395168349 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f375c004030 con 0x7f376415f4f0 2024-04-26T22:02:20.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.374+0000 7f3760ff9640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f375006c920 0x7f375006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.374+0000 7f3760ff9640 1 -- 172.21.15.137:0/3395168349 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f375c0aca60 con 0x7f376415f4f0 2024-04-26T22:02:20.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.375+0000 7f3763fff640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f375006c920 0x7f375006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.375+0000 7f3763fff640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f375006c920 0x7f375006ede0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3754007fd0 tx=0x7f3754007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.375+0000 7f376d363740 1 Processor -- start 2024-04-26T22:02:20.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.375+0000 7f376d363740 1 -- start start 2024-04-26T22:02:20.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f376d363740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x564471781e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f376d363740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717800d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f376d363740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717aac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f376d363740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5644716e4b80 con 0x5644717aa7b0 2024-04-26T22:02:20.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f376d363740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5644716804d0 con 0x56447177fcf0 2024-04-26T22:02:20.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f376d363740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5644716e0b40 con 0x5644717bc3c0 2024-04-26T22:02:20.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3768be4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3768be4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44490/0 (socket says 172.21.15.137:44490) 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3768be4640 1 -- 172.21.15.137:0/140567905 learned_addr learned my addr 172.21.15.137:0/140567905 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3768be4640 1 -- 172.21.15.137:0/140567905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 msgr2=0x5644717800d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3768be4640 1 --2- 172.21.15.137:0/140567905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717800d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3768be4640 1 -- 172.21.15.137:0/140567905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 msgr2=0x564471781e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3768be4640 1 --2- 172.21.15.137:0/140567905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x564471781e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3768be4640 1 -- 172.21.15.137:0/140567905 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644716ad770 con 0x5644717aa7b0 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3768be4640 1 --2- 172.21.15.137:0/140567905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717aac30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f375c076c80 tx=0x7f375c007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b09103633ec59b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3749ffb640 1 -- 172.21.15.137:0/140567905 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c07ebd0 con 0x5644717aa7b0 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3749ffb640 1 -- 172.21.15.137:0/140567905 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c083400 con 0x5644717aa7b0 2024-04-26T22:02:20.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.376+0000 7f3749ffb640 1 -- 172.21.15.137:0/140567905 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c003d30 con 0x5644717aa7b0 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.377+0000 7f376d363740 1 -- 172.21.15.137:0/140567905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 msgr2=0x5644717aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.377+0000 7f376d363740 1 --2- 172.21.15.137:0/140567905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717aac30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f375c076c80 tx=0x7f375c007840 comp rx=0 tx=0).stop 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.377+0000 7f376d363740 1 -- 172.21.15.137:0/140567905 shutdown_connections 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.377+0000 7f376d363740 1 --2- 172.21.15.137:0/140567905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717aac30 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.377+0000 7f376d363740 1 --2- 172.21.15.137:0/140567905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717800d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.377+0000 7f376d363740 1 --2- 172.21.15.137:0/140567905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x564471781e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.377+0000 7f376d363740 1 -- 172.21.15.137:0/140567905 >> 172.21.15.137:0/140567905 conn(0x564471714e90 msgr2=0x5644717c57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.377+0000 7f376d363740 1 -- 172.21.15.137:0/140567905 shutdown_connections 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.377+0000 7f376d363740 1 -- 172.21.15.137:0/140567905 wait complete. 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.378+0000 7f376d363740 1 -- start start 2024-04-26T22:02:20.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.378+0000 7f376d363740 1 Processor -- start 2024-04-26T22:02:20.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56447177fcf0 0x5644717ab370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644717aa7b0 0x5644717ae060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717bc3c0 0x5644717d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56447167de70 con 0x5644717bc3c0 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5644717a8300 con 0x5644717aa7b0 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5644717ae5a0 con 0x56447177fcf0 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 10 client.0 _ll_register_callbacks cb 0x56447168eea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3768be4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717bc3c0 0x5644717d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3768be4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717bc3c0 0x5644717d55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44494/0 (socket says 172.21.15.137:44494) 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3768be4640 1 -- 172.21.15.137:0/3418262686 learned_addr learned my addr 172.21.15.137:0/3418262686 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f37637fe640 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644717aa7b0 0x5644717ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3768be4640 1 -- 172.21.15.137:0/3418262686 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56447177fcf0 msgr2=0x5644717ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3768be4640 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56447177fcf0 0x5644717ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3768be4640 1 -- 172.21.15.137:0/3418262686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644717aa7b0 msgr2=0x5644717ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3768be4640 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644717aa7b0 0x5644717ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3768be4640 1 -- 172.21.15.137:0/3418262686 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644714c27c0 con 0x5644717bc3c0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3768be4640 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717bc3c0 0x5644717d55e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f375c076c80 tx=0x7f375c034f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21135845f5c3b9d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3742ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3742ffd640 1 -- 172.21.15.137:0/3418262686 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c097030 con 0x5644717bc3c0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3742ffd640 1 -- 172.21.15.137:0/3418262686 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f375c003d30 con 0x5644717bc3c0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 1 -- 172.21.15.137:0/3418262686 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f375c083400 con 0x5644717bc3c0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3742ffd640 1 -- 172.21.15.137:0/3418262686 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f375c082f70 con 0x5644717bc3c0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 10 client.6402 fetch_fsmap learned FSMap version 28 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f376d363740 1 -- 172.21.15.137:0/3418262686 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x564471522f50 con 0x5644717bc3c0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.379+0000 7f3742ffd640 1 -- 172.21.15.137:0/3418262686 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c083400 con 0x5644717bc3c0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f3742ffd640 1 -- 172.21.15.137:0/3418262686 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7f375c032070 con 0x5644717bc3c0 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f376d363740 10 client.6402 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T22:02:20.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f376d363740 10 client.6402 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f376d363740 20 client.6402 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f376d363740 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644717be340 0x5644717e2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f376d363740 4 client.6402 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f376d363740 1 -- 172.21.15.137:0/3418262686 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564471698240 con 0x5644717be340 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f3763fff640 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644717be340 0x5644717e2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f3742ffd640 10 client.6402 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.380+0000 7f3763fff640 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644717be340 0x5644717e2ec0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25bb54274436f246 server_cookie=89b66339a38173ec in_seq=0 out_seq=0 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f3742ffd640 1 -- 172.21.15.137:0/3418262686 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564471698240 con 0x5644717be340 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f3742ffd640 10 client.6402 handle_command_reply: tid=0 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 client.6402 shutdown 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 -- 172.21.15.137:0/3418262686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717bc3c0 msgr2=0x5644717d55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717bc3c0 0x5644717d55e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f375c076c80 tx=0x7f375c034f90 comp rx=0 tx=0).stop 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 -- 172.21.15.137:0/3418262686 shutdown_connections 2024-04-26T22:02:20.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x5644717be340 0x5644717e2ec0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717bc3c0 0x5644717d55e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5644717aa7b0 0x5644717ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f3742ffd640 0 client.6402 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:02:20.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 --2- 172.21.15.137:0/3418262686 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56447177fcf0 0x5644717ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 -- 172.21.15.137:0/3418262686 >> 172.21.15.137:0/3418262686 conn(0x564471714e90 msgr2=0x5644717a5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 -- 172.21.15.137:0/3418262686 shutdown_connections 2024-04-26T22:02:20.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 1 -- 172.21.15.137:0/3418262686 wait complete. 2024-04-26T22:02:20.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.381+0000 7f376d363740 20 client.6402 trim_cache size 0 max 16384 2024-04-26T22:02:20.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.394+0000 7f376d363740 1 Processor -- start 2024-04-26T22:02:20.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.394+0000 7f376d363740 1 -- start start 2024-04-26T22:02:20.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x5644717ae600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717e8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f37641fe6e0 con 0x5644717aa7b0 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f37641f6f80 con 0x56447177fcf0 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f37640aed40 con 0x5644717bc3c0 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37637fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37637fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717e8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44498/0 (socket says 172.21.15.137:44498) 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37637fe640 1 -- 172.21.15.137:0/1960765190 learned_addr learned my addr 172.21.15.137:0/1960765190 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37637fe640 1 -- 172.21.15.137:0/1960765190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 msgr2=0x5644717ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f3763fff640 1 --2- 172.21.15.137:0/1960765190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x5644717ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f3768be4640 1 --2- 172.21.15.137:0/1960765190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37637fe640 1 --2- 172.21.15.137:0/1960765190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717ad710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37637fe640 1 -- 172.21.15.137:0/1960765190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 msgr2=0x5644717ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37637fe640 1 --2- 172.21.15.137:0/1960765190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x5644717ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37637fe640 1 -- 172.21.15.137:0/1960765190 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644713b60b0 con 0x5644717aa7b0 2024-04-26T22:02:20.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37637fe640 1 --2- 172.21.15.137:0/1960765190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717e8890 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3758001510 tx=0x7f37580019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26670e4456179658 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37497fa640 1 -- 172.21.15.137:0/1960765190 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37580035f0 con 0x5644717aa7b0 2024-04-26T22:02:20.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37497fa640 1 -- 172.21.15.137:0/1960765190 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3758003790 con 0x5644717aa7b0 2024-04-26T22:02:20.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f37497fa640 1 -- 172.21.15.137:0/1960765190 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758003b60 con 0x5644717aa7b0 2024-04-26T22:02:20.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 -- 172.21.15.137:0/1960765190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 msgr2=0x5644717e8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 --2- 172.21.15.137:0/1960765190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717e8890 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3758001510 tx=0x7f37580019d0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 -- 172.21.15.137:0/1960765190 shutdown_connections 2024-04-26T22:02:20.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 --2- 172.21.15.137:0/1960765190 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717e8890 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 --2- 172.21.15.137:0/1960765190 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 --2- 172.21.15.137:0/1960765190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x5644717ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 -- 172.21.15.137:0/1960765190 >> 172.21.15.137:0/1960765190 conn(0x564471714e90 msgr2=0x5644717ab160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 -- 172.21.15.137:0/1960765190 shutdown_connections 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.396+0000 7f376d363740 1 -- 172.21.15.137:0/1960765190 wait complete. 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.397+0000 7f376d363740 1 -- start start 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.397+0000 7f376d363740 1 Processor -- start 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f376d363740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x5644717a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f376d363740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717ad710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f376d363740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717d7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f376d363740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56447167de70 con 0x5644717aa7b0 2024-04-26T22:02:20.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f376d363740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5644717a8300 con 0x56447177fcf0 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f376d363740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5644717ad300 con 0x5644717bc3c0 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f376d363740 10 client.0 _ll_register_callbacks cb 0x7f375c07a3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f37637fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f37637fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717ad710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44512/0 (socket says 172.21.15.137:44512) 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f37637fe640 1 -- 172.21.15.137:0/3971810292 learned_addr learned my addr 172.21.15.137:0/3971810292 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f3763fff640 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x5644717a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f3768be4640 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717d7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f37637fe640 1 -- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 msgr2=0x5644717d7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f37637fe640 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717d7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f37637fe640 1 -- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 msgr2=0x5644717a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f37637fe640 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x5644717a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f37637fe640 1 -- 172.21.15.137:0/3971810292 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644717adc50 con 0x5644717aa7b0 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f3763fff640 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x5644717a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f3768be4640 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717d7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f37637fe640 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717ad710 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3758013000 tx=0x7f3758000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb0817c3d499993 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f3742ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f3742ffd640 1 -- 172.21.15.137:0/3971810292 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758013950 con 0x5644717aa7b0 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f3742ffd640 1 -- 172.21.15.137:0/3971810292 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f3758013af0 con 0x5644717aa7b0 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.398+0000 7f376d363740 1 -- 172.21.15.137:0/3971810292 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3758003790 con 0x5644717aa7b0 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f3742ffd640 1 -- 172.21.15.137:0/3971810292 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f375802e050 con 0x5644717aa7b0 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f376d363740 10 client.6408 fetch_fsmap learned FSMap version 28 2024-04-26T22:02:20.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f376d363740 1 -- 172.21.15.137:0/3971810292 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x564471842da0 con 0x5644717aa7b0 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f3742ffd640 1 -- 172.21.15.137:0/3971810292 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3758003790 con 0x5644717aa7b0 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f3742ffd640 1 -- 172.21.15.137:0/3971810292 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 28) ==== 3494+0+0 (secure 0 0 0) 0x7f3758031020 con 0x5644717aa7b0 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f376d363740 10 client.6408 fetch_fsmap finished waiting for FSMap version 28 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f376d363740 10 client.6408 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f376d363740 20 client.6408 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f376d363740 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x56447177e380 0x56447177e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f376d363740 4 client.6408 mds_command: new command op to 6060 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f376d363740 1 -- 172.21.15.137:0/3971810292 --> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x5644716f2790 con 0x56447177e380 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f3763fff640 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x56447177e380 0x56447177e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f3742ffd640 10 client.6408 ms_handle_connect on v2:172.21.15.137:6836/4265926631 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f3763fff640 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x56447177e380 0x56447177e760 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d6fd9c93ec87730 server_cookie=7ef081d843f91c89 in_seq=0 out_seq=0 2024-04-26T22:02:20.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f3742ffd640 1 -- 172.21.15.137:0/3971810292 <== mds.0 v2:172.21.15.137:6836/4265926631 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5644716f2790 con 0x56447177e380 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f3742ffd640 10 client.6408 handle_command_reply: tid=0 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.399+0000 7f376d363740 1 client.6408 shutdown 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 -- 172.21.15.137:0/3971810292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 msgr2=0x5644717ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717ad710 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3758013000 tx=0x7f3758000ed0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 -- 172.21.15.137:0/3971810292 shutdown_connections 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.137:6836/4265926631,v1:172.21.15.137:6837/4265926631] conn(0x56447177e380 0x56447177e760 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5644717aa7b0 0x5644717ad710 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5644717bc3c0 0x5644717d7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 --2- 172.21.15.137:0/3971810292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56447177fcf0 0x5644717a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f3742ffd640 0 client.6408 ms_handle_reset on v2:172.21.15.137:6836/4265926631 2024-04-26T22:02:20.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 -- 172.21.15.137:0/3971810292 >> 172.21.15.137:0/3971810292 conn(0x564471714e90 msgr2=0x5644717762f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 -- 172.21.15.137:0/3971810292 shutdown_connections 2024-04-26T22:02:20.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 1 -- 172.21.15.137:0/3971810292 wait complete. 2024-04-26T22:02:20.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376d363740 20 client.6408 trim_cache size 0 max 16384 2024-04-26T22:02:20.409 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:20.409 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-26T22:02:20.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 -- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f375006c920 msgr2=0x7f375006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f375006c920 0x7f375006ede0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3754007fd0 tx=0x7f3754007900 comp rx=0 tx=0).stop 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 -- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f376415f4f0 msgr2=0x7f37640afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f376415f4f0 0x7f37640afec0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f375c009da0 tx=0x7f375c004a40 comp rx=0 tx=0).stop 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 -- 172.21.15.137:0/3395168349 shutdown_connections 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f375006c920 0x7f375006ede0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f376415f4f0 0x7f37640afec0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f376415b930 0x7f37640af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 --2- 172.21.15.137:0/3395168349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3764074200 0x7f37641507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 -- 172.21.15.137:0/3395168349 >> 172.21.15.137:0/3395168349 conn(0x7f37640cd8a0 msgr2=0x7f37640b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 -- 172.21.15.137:0/3395168349 shutdown_connections 2024-04-26T22:02:20.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.400+0000 7f376a647640 1 -- 172.21.15.137:0/3395168349 wait complete. 2024-04-26T22:02:20.412 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T22:02:20.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.506+0000 7f656ea47640 1 Processor -- start 2024-04-26T22:02:20.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f656ea47640 1 -- start start 2024-04-26T22:02:20.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f656ea47640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f65680d17d0 0x7f656815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f656ea47640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d0b50 0x7f6568161400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f656ea47640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65680d1000 con 0x7f65680d1bb0 2024-04-26T22:02:20.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f656ea47640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f65680d12c0 con 0x7f65680d17d0 2024-04-26T22:02:20.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f656ea47640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f656809c510 con 0x7f65680d0b50 2024-04-26T22:02:20.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f6567fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f65680d17d0 0x7f656815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f6567fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f65680d17d0 0x7f656815e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44524/0 (socket says 172.21.15.137:44524) 2024-04-26T22:02:20.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f6567fff640 1 -- 172.21.15.137:0/3421524870 learned_addr learned my addr 172.21.15.137:0/3421524870 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:20.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f6567fff640 1 -- 172.21.15.137:0/3421524870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d0b50 msgr2=0x7f6568161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f656cfe4640 1 --2- 172.21.15.137:0/3421524870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d0b50 0x7f6568161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f6567fff640 1 --2- 172.21.15.137:0/3421524870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d0b50 0x7f6568161400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f6567fff640 1 -- 172.21.15.137:0/3421524870 >> v1:172.21.15.170:6789/0 conn(0x7f65680d1bb0 legacy=0x7f6568160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:20.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f6567fff640 1 -- 172.21.15.137:0/3421524870 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656809c9a0 con 0x7f65680d17d0 2024-04-26T22:02:20.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f6567fff640 1 --2- 172.21.15.137:0/3421524870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d17d0 0x7f656815e2b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6558009870 tx=0x7f655802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25c0f6d0a83f03d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.508+0000 7f6566ffd640 1 -- 172.21.15.137:0/3421524870 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558037070 con 0x7f65680d17d0 2024-04-26T22:02:20.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f6566ffd640 1 -- 172.21.15.137:0/3421524870 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6558032440 con 0x7f65680d17d0 2024-04-26T22:02:20.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f6566ffd640 1 -- 172.21.15.137:0/3421524870 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558032810 con 0x7f65680d17d0 2024-04-26T22:02:20.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f656ea47640 1 -- 172.21.15.137:0/3421524870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d17d0 msgr2=0x7f656815e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f656ea47640 1 --2- 172.21.15.137:0/3421524870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d17d0 0x7f656815e2b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6558009870 tx=0x7f655802a210 comp rx=0 tx=0).stop 2024-04-26T22:02:20.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f656ea47640 1 -- 172.21.15.137:0/3421524870 shutdown_connections 2024-04-26T22:02:20.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f656ea47640 1 --2- 172.21.15.137:0/3421524870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d0b50 0x7f6568161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f656ea47640 1 --2- 172.21.15.137:0/3421524870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d17d0 0x7f656815e2b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f656ea47640 1 -- 172.21.15.137:0/3421524870 >> 172.21.15.137:0/3421524870 conn(0x7f65680b4ab0 msgr2=0x7f65680b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f656ea47640 1 -- 172.21.15.137:0/3421524870 shutdown_connections 2024-04-26T22:02:20.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.509+0000 7f656ea47640 1 -- 172.21.15.137:0/3421524870 wait complete. 2024-04-26T22:02:20.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.510+0000 7f656ea47640 1 Processor -- start 2024-04-26T22:02:20.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.510+0000 7f656ea47640 1 -- start start 2024-04-26T22:02:20.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f656ea47640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d0b50 0x7f656814c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f656ea47640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d17d0 0x7f656815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f656ea47640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65680d1bb0 0x7f656814bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f656ea47640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f656809c1a0 con 0x7f65680d0b50 2024-04-26T22:02:20.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f656ea47640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f656809bec0 con 0x7f65680d1bb0 2024-04-26T22:02:20.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f656ea47640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f65680ceb10 con 0x7f65680d17d0 2024-04-26T22:02:20.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f6567fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d0b50 0x7f656814c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f6567fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d0b50 0x7f656814c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44530/0 (socket says 172.21.15.137:44530) 2024-04-26T22:02:20.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f6567fff640 1 -- 172.21.15.137:0/1658389726 learned_addr learned my addr 172.21.15.137:0/1658389726 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.511+0000 7f65677fe640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d17d0 0x7f656815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f6567fff640 1 -- 172.21.15.137:0/1658389726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d17d0 msgr2=0x7f656815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f656cfe4640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65680d1bb0 0x7f656814bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f6567fff640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d17d0 0x7f656815c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f6567fff640 1 -- 172.21.15.137:0/1658389726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65680d1bb0 msgr2=0x7f656814bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f6567fff640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65680d1bb0 0x7f656814bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f6567fff640 1 -- 172.21.15.137:0/1658389726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656815c970 con 0x7f65680d0b50 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f656cfe4640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65680d1bb0 0x7f656814bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f6567fff640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d0b50 0x7f656814c900 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f65580097c0 tx=0x7f65580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f6564ff9640 1 -- 172.21.15.137:0/1658389726 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558041020 con 0x7f65680d0b50 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f6564ff9640 1 -- 172.21.15.137:0/1658389726 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6558030970 con 0x7f65680d0b50 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656815cc50 con 0x7f65680d0b50 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f6564ff9640 1 -- 172.21.15.137:0/1658389726 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558037040 con 0x7f65680d0b50 2024-04-26T22:02:20.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.512+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65680b6030 con 0x7f65680d0b50 2024-04-26T22:02:20.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.513+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65680693d0 con 0x7f65680d0b50 2024-04-26T22:02:20.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.514+0000 7f6564ff9640 1 -- 172.21.15.137:0/1658389726 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6558044020 con 0x7f65680d0b50 2024-04-26T22:02:20.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.514+0000 7f6564ff9640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655406c8f0 0x7f655406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:20.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.514+0000 7f6564ff9640 1 -- 172.21.15.137:0/1658389726 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f65580ac430 con 0x7f65680d0b50 2024-04-26T22:02:20.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.514+0000 7f65677fe640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655406c8f0 0x7f655406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:20.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.514+0000 7f65677fe640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655406c8f0 0x7f655406edb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f65680a1090 tx=0x7f655c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:20.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.518+0000 7f6564ff9640 1 -- 172.21.15.137:0/1658389726 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f655804b030 con 0x7f65680d0b50 2024-04-26T22:02:20.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.731+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f65680b55d0 con 0x7f65680d0b50 2024-04-26T22:02:20.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.732+0000 7f6564ff9640 1 -- 172.21.15.137:0/1658389726 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f655807a8f0 con 0x7f65680d0b50 2024-04-26T22:02:20.732 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:20.732 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T22:02:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655406c8f0 msgr2=0x7f655406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655406c8f0 0x7f655406edb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f65680a1090 tx=0x7f655c008040 comp rx=0 tx=0).stop 2024-04-26T22:02:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d0b50 msgr2=0x7f656814c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:20.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d0b50 0x7f656814c900 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f65580097c0 tx=0x7f65580046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 shutdown_connections 2024-04-26T22:02:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655406c8f0 0x7f655406edb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65680d1bb0 0x7f656814bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65680d17d0 0x7f656815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 --2- 172.21.15.137:0/1658389726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65680d0b50 0x7f656814c900 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 >> 172.21.15.137:0/1658389726 conn(0x7f65680b4ab0 msgr2=0x7f656815e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 shutdown_connections 2024-04-26T22:02:20.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:20.734+0000 7f656ea47640 1 -- 172.21.15.137:0/1658389726 wait complete. 2024-04-26T22:02:20.745 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-26T22:02:20.745 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:02:20.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:02:20.784 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:02:20.825 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:02:20.825 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:02:20.825 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:20.825 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:20.841 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:20.842 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:20.897 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:21.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.033+0000 7f0f14746640 1 Processor -- start 2024-04-26T22:02:21.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.033+0000 7f0f14746640 1 -- start start 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.034+0000 7f0f14746640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0f0c15d120 0x7f0f0c0cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.034+0000 7f0f14746640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0f0c0d3570 0x7f0f0c0b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.034+0000 7f0f14746640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f0c0b3a50 con 0x7f0f0c0cdfd0 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.034+0000 7f0f14746640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0f0c0b3d30 con 0x7f0f0c0d3570 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.034+0000 7f0f14746640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0f0c0d0c80 con 0x7f0f0c15d120 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.034+0000 7f0f12ce3640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0f0c0d3570 0x7f0f0c0b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.034+0000 7f0f11ce1640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0f0c0cdfd0 0x7f0f0c0d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47082/0 (socket says 172.21.15.137:47082) 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.034+0000 7f0f11ce1640 1 -- 172.21.15.137:0/3265277567 learned_addr learned my addr 172.21.15.137:0/3265277567 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.035+0000 7f0f124e2640 1 --2- 172.21.15.137:0/3265277567 >> v2:172.21.15.170:3300/0 conn(0x7f0f0c15d120 0x7f0f0c0cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.035+0000 7f0f12ce3640 1 -- 172.21.15.137:0/3265277567 >> v2:172.21.15.170:3300/0 conn(0x7f0f0c15d120 msgr2=0x7f0f0c0cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:21.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.035+0000 7f0f12ce3640 1 --2- 172.21.15.137:0/3265277567 >> v2:172.21.15.170:3300/0 conn(0x7f0f0c15d120 0x7f0f0c0cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.035+0000 7f0f12ce3640 1 -- 172.21.15.137:0/3265277567 >> v1:172.21.15.137:6789/0 conn(0x7f0f0c0cdfd0 legacy=0x7f0f0c0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.035+0000 7f0f114e0640 1 -- 172.21.15.137:0/3265277567 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022458615 0 0) 0x7f0f0c0b3a50 con 0x7f0f0c0cdfd0 2024-04-26T22:02:21.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.035+0000 7f0f12ce3640 1 -- 172.21.15.137:0/3265277567 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c0d0f60 con 0x7f0f0c0d3570 2024-04-26T22:02:21.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.035+0000 7f0f12ce3640 1 --2- 172.21.15.137:0/3265277567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c0d3570 0x7f0f0c0b2ce0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c09c650 tx=0x7f0f0402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573c5fc39c761917 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.035+0000 7f0f114e0640 1 -- 172.21.15.137:0/3265277567 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04037070 con 0x7f0f0c0d3570 2024-04-26T22:02:21.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f114e0640 1 -- 172.21.15.137:0/3265277567 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f04032440 con 0x7f0f0c0d3570 2024-04-26T22:02:21.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f114e0640 1 -- 172.21.15.137:0/3265277567 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0402ae60 con 0x7f0f0c0d3570 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f14746640 1 -- 172.21.15.137:0/3265277567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c0d3570 msgr2=0x7f0f0c0b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f14746640 1 --2- 172.21.15.137:0/3265277567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c0d3570 0x7f0f0c0b2ce0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c09c650 tx=0x7f0f0402a110 comp rx=0 tx=0).stop 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f14746640 1 -- 172.21.15.137:0/3265277567 shutdown_connections 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f14746640 1 --2- 172.21.15.137:0/3265277567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c0d3570 0x7f0f0c0b2ce0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f14746640 1 --2- 172.21.15.137:0/3265277567 >> v2:172.21.15.170:3300/0 conn(0x7f0f0c15d120 0x7f0f0c0cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f14746640 1 -- 172.21.15.137:0/3265277567 >> 172.21.15.137:0/3265277567 conn(0x7f0f0c09ba40 msgr2=0x7f0f0c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f14746640 1 -- 172.21.15.137:0/3265277567 shutdown_connections 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.036+0000 7f0f14746640 1 -- 172.21.15.137:0/3265277567 wait complete. 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.037+0000 7f0f14746640 1 Processor -- start 2024-04-26T22:02:21.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.037+0000 7f0f14746640 1 -- start start 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f14746640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0c0cdfd0 0x7f0f0c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f14746640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f0c0d3570 0x7f0f0c0cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f14746640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c15d120 0x7f0f0c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f14746640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c0b33a0 con 0x7f0f0c15d120 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f14746640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c0b3220 con 0x7f0f0c0d3570 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f14746640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0c0b3520 con 0x7f0f0c0cdfd0 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f12ce3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c15d120 0x7f0f0c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f12ce3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c15d120 0x7f0f0c0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44544/0 (socket says 172.21.15.137:44544) 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f12ce3640 1 -- 172.21.15.137:0/3870695895 learned_addr learned my addr 172.21.15.137:0/3870695895 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:21.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f11ce1640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f0c0d3570 0x7f0f0c0cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.038+0000 7f0f124e2640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0c0cdfd0 0x7f0f0c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f12ce3640 1 -- 172.21.15.137:0/3870695895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0c0cdfd0 msgr2=0x7f0f0c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f12ce3640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0c0cdfd0 0x7f0f0c06d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f12ce3640 1 -- 172.21.15.137:0/3870695895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f0c0d3570 msgr2=0x7f0f0c0cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f12ce3640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f0c0d3570 0x7f0f0c0cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f12ce3640 1 -- 172.21.15.137:0/3870695895 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c15e4c0 con 0x7f0f0c15d120 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f124e2640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0c0cdfd0 0x7f0f0c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f12ce3640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c15d120 0x7f0f0c0cc6f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0f04035040 tx=0x7f0f040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f02ffd640 1 -- 172.21.15.137:0/3870695895 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04037050 con 0x7f0f0c15d120 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f02ffd640 1 -- 172.21.15.137:0/3870695895 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f04038040 con 0x7f0f0c15d120 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0c06d8f0 con 0x7f0f0c15d120 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f02ffd640 1 -- 172.21.15.137:0/3870695895 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04006e10 con 0x7f0f0c15d120 2024-04-26T22:02:21.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.039+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0c06de70 con 0x7f0f0c15d120 2024-04-26T22:02:21.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.040+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0c06a290 con 0x7f0f0c15d120 2024-04-26T22:02:21.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.040+0000 7f0f02ffd640 1 -- 172.21.15.137:0/3870695895 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f04030980 con 0x7f0f0c15d120 2024-04-26T22:02:21.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.041+0000 7f0f02ffd640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ef006c8f0 0x7f0ef006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.041+0000 7f0f02ffd640 1 -- 172.21.15.137:0/3870695895 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f0f040ac4e0 con 0x7f0f0c15d120 2024-04-26T22:02:21.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.041+0000 7f0f124e2640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ef006c8f0 0x7f0ef006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.041+0000 7f0f124e2640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ef006c8f0 0x7f0ef006edb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009a80 tx=0x7f0f080039d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.045+0000 7f0f02ffd640 1 -- 172.21.15.137:0/3870695895 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f0c15e4c0 con 0x7f0f0c15d120 2024-04-26T22:02:21.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.219+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f0c0c67e0 con 0x7f0f0c15d120 2024-04-26T22:02:21.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.220+0000 7f0f02ffd640 1 -- 172.21.15.137:0/3870695895 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16677 (secure 0 0 0) 0x7f0f04032e20 con 0x7f0f0c15d120 2024-04-26T22:02:21.221 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:21.221 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:01:12.541348+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:01:09.101906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T22:01:09.837941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:21.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ef006c8f0 msgr2=0x7f0ef006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ef006c8f0 0x7f0ef006edb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009a80 tx=0x7f0f080039d0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c15d120 msgr2=0x7f0f0c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c15d120 0x7f0f0c0cc6f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0f04035040 tx=0x7f0f040046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 shutdown_connections 2024-04-26T22:02:21.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ef006c8f0 0x7f0ef006edb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f0c15d120 0x7f0f0c0cc6f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f0c0d3570 0x7f0f0c0cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 --2- 172.21.15.137:0/3870695895 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f0c0cdfd0 0x7f0f0c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 >> 172.21.15.137:0/3870695895 conn(0x7f0f0c09ba40 msgr2=0x7f0f0c0d24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:21.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 shutdown_connections 2024-04-26T22:02:21.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.222+0000 7f0f14746640 1 -- 172.21.15.137:0/3870695895 wait complete. 2024-04-26T22:02:21.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:01:09.101906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:01:09.837941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:02:21.235 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:02:21.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fe25c6640 1 Processor -- start 2024-04-26T22:02:21.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fe25c6640 1 -- start start 2024-04-26T22:02:21.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fe25c6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3fdc15f680 0x7f3fdc0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fe25c6640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3fdc0d4f20 0x7f3fdc0d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fe25c6640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fdc0d58c0 con 0x7f3fdc163aa0 2024-04-26T22:02:21.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fe25c6640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3fdc15fa60 con 0x7f3fdc15f680 2024-04-26T22:02:21.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fe25c6640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3fdc0d3f50 con 0x7f3fdc0d4f20 2024-04-26T22:02:21.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fdbfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3fdc15f680 0x7f3fdc0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fdbfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3fdc15f680 0x7f3fdc0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44554/0 (socket says 172.21.15.137:44554) 2024-04-26T22:02:21.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.335+0000 7f3fdbfff640 1 -- 172.21.15.137:0/18636912 learned_addr learned my addr 172.21.15.137:0/18636912 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:21.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.336+0000 7f3fe0b63640 1 --2- 172.21.15.137:0/18636912 >> v2:172.21.15.170:3300/0 conn(0x7f3fdc0d4f20 0x7f3fdc0d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.336+0000 7f3fdbfff640 1 -- 172.21.15.137:0/18636912 >> v2:172.21.15.170:3300/0 conn(0x7f3fdc0d4f20 msgr2=0x7f3fdc0d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:21.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.336+0000 7f3fdbfff640 1 --2- 172.21.15.137:0/18636912 >> v2:172.21.15.170:3300/0 conn(0x7f3fdc0d4f20 0x7f3fdc0d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.336+0000 7f3fdbfff640 1 -- 172.21.15.137:0/18636912 >> v1:172.21.15.170:6789/0 conn(0x7f3fdc163aa0 legacy=0x7f3fdc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:21.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.336+0000 7f3fdbfff640 1 -- 172.21.15.137:0/18636912 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc0b5090 con 0x7f3fdc15f680 2024-04-26T22:02:21.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.336+0000 7f3fe0b63640 1 --2- 172.21.15.137:0/18636912 >> v2:172.21.15.170:3300/0 conn(0x7f3fdc0d4f20 0x7f3fdc0d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:21.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.336+0000 7f3fdbfff640 1 --2- 172.21.15.137:0/18636912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc15f680 0x7f3fdc0d3820 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0cf840 tx=0x7f3fcc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91df05954a557ee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fdaffd640 1 -- 172.21.15.137:0/18636912 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc037070 con 0x7f3fdc15f680 2024-04-26T22:02:21.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fdaffd640 1 -- 172.21.15.137:0/18636912 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fcc032440 con 0x7f3fdc15f680 2024-04-26T22:02:21.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fdaffd640 1 -- 172.21.15.137:0/18636912 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc032810 con 0x7f3fdc15f680 2024-04-26T22:02:21.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fe25c6640 1 -- 172.21.15.137:0/18636912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc15f680 msgr2=0x7f3fdc0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fe25c6640 1 --2- 172.21.15.137:0/18636912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc15f680 0x7f3fdc0d3820 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0cf840 tx=0x7f3fcc02a230 comp rx=0 tx=0).stop 2024-04-26T22:02:21.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fe25c6640 1 -- 172.21.15.137:0/18636912 shutdown_connections 2024-04-26T22:02:21.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fe25c6640 1 --2- 172.21.15.137:0/18636912 >> v2:172.21.15.170:3300/0 conn(0x7f3fdc0d4f20 0x7f3fdc0d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fe25c6640 1 --2- 172.21.15.137:0/18636912 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc15f680 0x7f3fdc0d3820 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fe25c6640 1 -- 172.21.15.137:0/18636912 >> 172.21.15.137:0/18636912 conn(0x7f3fdc08eca0 msgr2=0x7f3fdc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:21.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fe25c6640 1 -- 172.21.15.137:0/18636912 shutdown_connections 2024-04-26T22:02:21.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.337+0000 7f3fe25c6640 1 -- 172.21.15.137:0/18636912 wait complete. 2024-04-26T22:02:21.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.338+0000 7f3fe25c6640 1 Processor -- start 2024-04-26T22:02:21.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe25c6640 1 -- start start 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe25c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fdc0d4f20 0x7f3fdc0cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe25c6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3fdc15f680 0x7f3fdc0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe25c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc163aa0 0x7f3fdc153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe25c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc163f30 con 0x7f3fdc163aa0 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe25c6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc0b6280 con 0x7f3fdc0d4f20 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe25c6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc0cfd80 con 0x7f3fdc15f680 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe0b63640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc163aa0 0x7f3fdc153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe0b63640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc163aa0 0x7f3fdc153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44566/0 (socket says 172.21.15.137:44566) 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.339+0000 7f3fe0b63640 1 -- 172.21.15.137:0/682912623 learned_addr learned my addr 172.21.15.137:0/682912623 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:21.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fdbfff640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fdc0d4f20 0x7f3fdc0cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fdb7fe640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3fdc15f680 0x7f3fdc0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fe0b63640 1 -- 172.21.15.137:0/682912623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3fdc15f680 msgr2=0x7f3fdc0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fe0b63640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3fdc15f680 0x7f3fdc0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fe0b63640 1 -- 172.21.15.137:0/682912623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fdc0d4f20 msgr2=0x7f3fdc0cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fe0b63640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fdc0d4f20 0x7f3fdc0cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fe0b63640 1 -- 172.21.15.137:0/682912623 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc161660 con 0x7f3fdc163aa0 2024-04-26T22:02:21.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fdb7fe640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3fdc15f680 0x7f3fdc0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:21.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fe0b63640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc163aa0 0x7f3fdc153410 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400cf20 tx=0x7f3fd400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fd8ff9640 1 -- 172.21.15.137:0/682912623 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd401a070 con 0x7f3fdc163aa0 2024-04-26T22:02:21.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fd8ff9640 1 -- 172.21.15.137:0/682912623 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd400d840 con 0x7f3fdc163aa0 2024-04-26T22:02:21.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc161940 con 0x7f3fdc163aa0 2024-04-26T22:02:21.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fd8ff9640 1 -- 172.21.15.137:0/682912623 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400dc30 con 0x7f3fdc163aa0 2024-04-26T22:02:21.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.340+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc161f00 con 0x7f3fdc163aa0 2024-04-26T22:02:21.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.341+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fdc0d5380 con 0x7f3fdc163aa0 2024-04-26T22:02:21.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.341+0000 7f3fd8ff9640 1 -- 172.21.15.137:0/682912623 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3fd401d070 con 0x7f3fdc163aa0 2024-04-26T22:02:21.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.342+0000 7f3fd8ff9640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fc806c8f0 0x7f3fc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.342+0000 7f3fd8ff9640 1 -- 172.21.15.137:0/682912623 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f3fd408c470 con 0x7f3fdc163aa0 2024-04-26T22:02:21.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.342+0000 7f3fdbfff640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fc806c8f0 0x7f3fc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.342+0000 7f3fdbfff640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fc806c8f0 0x7f3fc806edb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc034000 tx=0x7f3fcc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.346+0000 7f3fd8ff9640 1 -- 172.21.15.137:0/682912623 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3fdc0d5380 con 0x7f3fdc163aa0 2024-04-26T22:02:21.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.523+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3fdc06a290 con 0x7f3fdc163aa0 2024-04-26T22:02:21.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.523+0000 7f3fd8ff9640 1 -- 172.21.15.137:0/682912623 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f3fd405a800 con 0x7f3fdc163aa0 2024-04-26T22:02:21.523 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:02:21.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fc806c8f0 msgr2=0x7f3fc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fc806c8f0 0x7f3fc806edb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc034000 tx=0x7f3fcc02e000 comp rx=0 tx=0).stop 2024-04-26T22:02:21.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc163aa0 msgr2=0x7f3fdc153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc163aa0 0x7f3fdc153410 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400cf20 tx=0x7f3fd400a7d0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 shutdown_connections 2024-04-26T22:02:21.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fc806c8f0 0x7f3fc806edb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3fdc163aa0 0x7f3fdc153410 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3fdc15f680 0x7f3fdc0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 --2- 172.21.15.137:0/682912623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fdc0d4f20 0x7f3fdc0cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 >> 172.21.15.137:0/682912623 conn(0x7f3fdc08eca0 msgr2=0x7f3fdc15e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:21.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 shutdown_connections 2024-04-26T22:02:21.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.525+0000 7f3fe25c6640 1 -- 172.21.15.137:0/682912623 wait complete. 2024-04-26T22:02:21.536 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:02:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.638+0000 7fb505a3f640 1 Processor -- start 2024-04-26T22:02:21.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.638+0000 7fb505a3f640 1 -- start start 2024-04-26T22:02:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.639+0000 7fb505a3f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.639+0000 7fb505a3f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb50006ea30 0x7fb5000b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.639+0000 7fb505a3f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50009c790 con 0x7fb5000d1170 2024-04-26T22:02:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.639+0000 7fb505a3f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb50006eec0 con 0x7fb50006ea30 2024-04-26T22:02:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.639+0000 7fb505a3f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb5000d15f0 con 0x7fb5001631f0 2024-04-26T22:02:21.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.639+0000 7fb4ff7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb50006ea30 0x7fb5000b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.639+0000 7fb4fe7fc640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb5000d1170 0x7fb5001635d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:46728/0 (socket says 172.21.15.137:46728) 2024-04-26T22:02:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.639+0000 7fb4fe7fc640 1 -- 172.21.15.137:0/3407079577 learned_addr learned my addr 172.21.15.137:0/3407079577 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.639+0000 7fb4feffd640 1 --2- 172.21.15.137:0/3407079577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.640+0000 7fb4feffd640 1 -- 172.21.15.137:0/3407079577 >> v2:172.21.15.170:3300/0 conn(0x7fb50006ea30 msgr2=0x7fb5000b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.640+0000 7fb4feffd640 1 --2- 172.21.15.137:0/3407079577 >> v2:172.21.15.170:3300/0 conn(0x7fb50006ea30 0x7fb5000b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.640+0000 7fb4feffd640 1 -- 172.21.15.137:0/3407079577 >> v1:172.21.15.170:6789/0 conn(0x7fb5000d1170 legacy=0x7fb5001635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.640+0000 7fb4feffd640 1 -- 172.21.15.137:0/3407079577 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb500163ec0 con 0x7fb5001631f0 2024-04-26T22:02:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.640+0000 7fb4feffd640 1 --2- 172.21.15.137:0/3407079577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000b2000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009d90 tx=0x7fb4f002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=966cdb4fafb3baf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.640+0000 7fb4fdffb640 1 -- 172.21.15.137:0/3407079577 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0031600 con 0x7fb5001631f0 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb4fdffb640 1 -- 172.21.15.137:0/3407079577 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f00317a0 con 0x7fb5001631f0 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb4fdffb640 1 -- 172.21.15.137:0/3407079577 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0031b70 con 0x7fb5001631f0 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb505a3f640 1 -- 172.21.15.137:0/3407079577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 msgr2=0x7fb5000b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb505a3f640 1 --2- 172.21.15.137:0/3407079577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000b2000 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009d90 tx=0x7fb4f002a5d0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb505a3f640 1 -- 172.21.15.137:0/3407079577 shutdown_connections 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb505a3f640 1 --2- 172.21.15.137:0/3407079577 >> v2:172.21.15.170:3300/0 conn(0x7fb50006ea30 0x7fb5000b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb505a3f640 1 --2- 172.21.15.137:0/3407079577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000b2000 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb505a3f640 1 -- 172.21.15.137:0/3407079577 >> 172.21.15.137:0/3407079577 conn(0x7fb50009ba40 msgr2=0x7fb50009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb505a3f640 1 -- 172.21.15.137:0/3407079577 shutdown_connections 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.641+0000 7fb505a3f640 1 -- 172.21.15.137:0/3407079577 wait complete. 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.642+0000 7fb505a3f640 1 Processor -- start 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.642+0000 7fb505a3f640 1 -- start start 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb505a3f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb50006ea30 0x7fb500156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb505a3f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5000d1170 0x7fb5001545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb505a3f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb505a3f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb5000d2000 con 0x7fb5000d1170 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb505a3f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb5000d1d20 con 0x7fb50006ea30 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb505a3f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb5000d0230 con 0x7fb5001631f0 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb4fe7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5000d1170 0x7fb5001545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb4fe7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5000d1170 0x7fb5001545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44580/0 (socket says 172.21.15.137:44580) 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb4fe7fc640 1 -- 172.21.15.137:0/2553621539 learned_addr learned my addr 172.21.15.137:0/2553621539 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb4feffd640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb50006ea30 0x7fb500156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.643+0000 7fb4ff7fe640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4fe7fc640 1 -- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 msgr2=0x7fb5000c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4fe7fc640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4fe7fc640 1 -- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb50006ea30 msgr2=0x7fb500156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4fe7fc640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb50006ea30 0x7fb500156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4fe7fc640 1 -- 172.21.15.137:0/2553621539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb500157bd0 con 0x7fb5000d1170 2024-04-26T22:02:21.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4feffd640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb50006ea30 0x7fb500156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:21.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4ff7fe640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:21.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4fe7fc640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5000d1170 0x7fb5001545d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400c4a0 tx=0x7fb4f400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4e7fff640 1 -- 172.21.15.137:0/2553621539 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4017070 con 0x7fb5000d1170 2024-04-26T22:02:21.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4e7fff640 1 -- 172.21.15.137:0/2553621539 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f4005ce0 con 0x7fb5000d1170 2024-04-26T22:02:21.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb500157eb0 con 0x7fb5000d1170 2024-04-26T22:02:21.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb4e7fff640 1 -- 172.21.15.137:0/2553621539 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4007270 con 0x7fb5000d1170 2024-04-26T22:02:21.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.644+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb500158470 con 0x7fb5000d1170 2024-04-26T22:02:21.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.645+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb50006a290 con 0x7fb5000d1170 2024-04-26T22:02:21.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.645+0000 7fb4e7fff640 1 -- 172.21.15.137:0/2553621539 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4f401a070 con 0x7fb5000d1170 2024-04-26T22:02:21.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.646+0000 7fb4e7fff640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb4ec06c8f0 0x7fb4ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.646+0000 7fb4e7fff640 1 -- 172.21.15.137:0/2553621539 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb4f408adf0 con 0x7fb5000d1170 2024-04-26T22:02:21.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.646+0000 7fb4feffd640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb4ec06c8f0 0x7fb4ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.646+0000 7fb4feffd640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb4ec06c8f0 0x7fb4ec06edb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009d90 tx=0x7fb4f002f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.650+0000 7fb4e7fff640 1 -- 172.21.15.137:0/2553621539 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb4f4058bd0 con 0x7fb5000d1170 2024-04-26T22:02:21.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.827+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb5000c6870 con 0x7fb5000d1170 2024-04-26T22:02:21.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.828+0000 7fb4e7fff640 1 -- 172.21.15.137:0/2553621539 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) ==== 104+0+11 (secure 0 0 0) 0x7fb4f405ced0 con 0x7fb5000d1170 2024-04-26T22:02:21.828 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:02:21.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb4ec06c8f0 msgr2=0x7fb4ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb4ec06c8f0 0x7fb4ec06edb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009d90 tx=0x7fb4f002f000 comp rx=0 tx=0).stop 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5000d1170 msgr2=0x7fb5001545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5000d1170 0x7fb5001545d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400c4a0 tx=0x7fb4f400c960 comp rx=0 tx=0).stop 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 shutdown_connections 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb4ec06c8f0 0x7fb4ec06edb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5000d1170 0x7fb5001545d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5001631f0 0x7fb5000c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 --2- 172.21.15.137:0/2553621539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb50006ea30 0x7fb500156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 >> 172.21.15.137:0/2553621539 conn(0x7fb50009ba40 msgr2=0x7fb5000b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 shutdown_connections 2024-04-26T22:02:21.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.830+0000 7fb505a3f640 1 -- 172.21.15.137:0/2553621539 wait complete. 2024-04-26T22:02:21.841 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:02:21.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.941+0000 7fd5fc847640 1 Processor -- start 2024-04-26T22:02:21.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.941+0000 7fd5fc847640 1 -- start start 2024-04-26T22:02:21.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5fc847640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f815f260 0x7fd5f806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5fc847640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd5f8070560 0x7fd5f80b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5fc847640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f815f640 con 0x7fd5f806ebe0 2024-04-26T22:02:21.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5fc847640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f806c2a0 con 0x7fd5f8070560 2024-04-26T22:02:21.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5fc847640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f806c580 con 0x7fd5f815f260 2024-04-26T22:02:21.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5f659c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f815f260 0x7fd5f806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5f5d9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd5f8070560 0x7fd5f80b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5f659c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f815f260 0x7fd5f806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:54020/0 (socket says 172.21.15.137:54020) 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5f659c640 1 -- 172.21.15.137:0/2165312238 learned_addr learned my addr 172.21.15.137:0/2165312238 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.942+0000 7fd5f6d9d640 1 --1- 172.21.15.137:0/2165312238 >> v1:172.21.15.170:6789/0 conn(0x7fd5f806ebe0 0x7fd5f80ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:46738/0 (socket says 172.21.15.137:46738) 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.943+0000 7fd5f659c640 1 -- 172.21.15.137:0/2165312238 >> v2:172.21.15.170:3300/0 conn(0x7fd5f8070560 msgr2=0x7fd5f80b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.943+0000 7fd5f659c640 1 --2- 172.21.15.137:0/2165312238 >> v2:172.21.15.170:3300/0 conn(0x7fd5f8070560 0x7fd5f80b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.943+0000 7fd5f659c640 1 -- 172.21.15.137:0/2165312238 >> v1:172.21.15.170:6789/0 conn(0x7fd5f806ebe0 legacy=0x7fd5f80ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.943+0000 7fd5f659c640 1 -- 172.21.15.137:0/2165312238 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f806c860 con 0x7fd5f815f260 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.943+0000 7fd5f5d9b640 1 --2- 172.21.15.137:0/2165312238 >> v2:172.21.15.170:3300/0 conn(0x7fd5f8070560 0x7fd5f80b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:02:21.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.943+0000 7fd5f659c640 1 --2- 172.21.15.137:0/2165312238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f815f260 0x7fd5f806d620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009e50 tx=0x7fd5e802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=546e4904573fc601 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5f559a640 1 -- 172.21.15.137:0/2165312238 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8036070 con 0x7fd5f815f260 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5f559a640 1 -- 172.21.15.137:0/2165312238 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e8031600 con 0x7fd5f815f260 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5f559a640 1 -- 172.21.15.137:0/2165312238 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80319d0 con 0x7fd5f815f260 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5fc847640 1 -- 172.21.15.137:0/2165312238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f815f260 msgr2=0x7fd5f806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5fc847640 1 --2- 172.21.15.137:0/2165312238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f815f260 0x7fd5f806d620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009e50 tx=0x7fd5e802a710 comp rx=0 tx=0).stop 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5fc847640 1 -- 172.21.15.137:0/2165312238 shutdown_connections 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5fc847640 1 --2- 172.21.15.137:0/2165312238 >> v2:172.21.15.170:3300/0 conn(0x7fd5f8070560 0x7fd5f80b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5fc847640 1 --2- 172.21.15.137:0/2165312238 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f815f260 0x7fd5f806d620 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5fc847640 1 -- 172.21.15.137:0/2165312238 >> 172.21.15.137:0/2165312238 conn(0x7fd5f80d1660 msgr2=0x7fd5f80d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5fc847640 1 -- 172.21.15.137:0/2165312238 shutdown_connections 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.944+0000 7fd5fc847640 1 -- 172.21.15.137:0/2165312238 wait complete. 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5fc847640 1 Processor -- start 2024-04-26T22:02:21.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5fc847640 1 -- start start 2024-04-26T22:02:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5fc847640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f806ebe0 0x7fd5f8160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5fc847640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8070560 0x7fd5f81527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5fc847640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5f815f260 0x7fd5f81541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5fc847640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f806d100 con 0x7fd5f8070560 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5fc847640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f806ce20 con 0x7fd5f815f260 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5fc847640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f806db60 con 0x7fd5f806ebe0 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5f5d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8070560 0x7fd5f81527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5f5d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8070560 0x7fd5f81527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44594/0 (socket says 172.21.15.137:44594) 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.946+0000 7fd5f5d9b640 1 -- 172.21.15.137:0/1817520839 learned_addr learned my addr 172.21.15.137:0/1817520839 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5f659c640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f806ebe0 0x7fd5f8160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5f6d9d640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5f815f260 0x7fd5f81541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5f5d9b640 1 -- 172.21.15.137:0/1817520839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f806ebe0 msgr2=0x7fd5f8160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5f5d9b640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f806ebe0 0x7fd5f8160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5f5d9b640 1 -- 172.21.15.137:0/1817520839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5f815f260 msgr2=0x7fd5f81541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5f5d9b640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5f815f260 0x7fd5f81541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:21.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5f5d9b640 1 -- 172.21.15.137:0/1817520839 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f815fca0 con 0x7fd5f8070560 2024-04-26T22:02:21.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5f5d9b640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8070560 0x7fd5f81527e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00e900 tx=0x7fd5ec00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5e6ffd640 1 -- 172.21.15.137:0/1817520839 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec017070 con 0x7fd5f8070560 2024-04-26T22:02:21.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5e6ffd640 1 -- 172.21.15.137:0/1817520839 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00ca00 con 0x7fd5f8070560 2024-04-26T22:02:21.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f815ff80 con 0x7fd5f8070560 2024-04-26T22:02:21.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5e6ffd640 1 -- 172.21.15.137:0/1817520839 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00cdf0 con 0x7fd5f8070560 2024-04-26T22:02:21.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.947+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f8160540 con 0x7fd5f8070560 2024-04-26T22:02:21.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.948+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f806a290 con 0x7fd5f8070560 2024-04-26T22:02:21.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.949+0000 7fd5e6ffd640 1 -- 172.21.15.137:0/1817520839 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5ec01a070 con 0x7fd5f8070560 2024-04-26T22:02:21.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.949+0000 7fd5e6ffd640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd5d806c8f0 0x7fd5d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:21.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.949+0000 7fd5e6ffd640 1 -- 172.21.15.137:0/1817520839 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fd5ec08b680 con 0x7fd5f8070560 2024-04-26T22:02:21.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.949+0000 7fd5f659c640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd5d806c8f0 0x7fd5d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:21.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.950+0000 7fd5f659c640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd5d806c8f0 0x7fd5d806edb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8033000 tx=0x7fd5e8009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:21.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:21.953+0000 7fd5e6ffd640 1 -- 172.21.15.137:0/1817520839 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd5ec059ab0 con 0x7fd5f8070560 2024-04-26T22:02:22.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.127+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd5f80cdbb0 con 0x7fd5f8070560 2024-04-26T22:02:22.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.128+0000 7fd5e6ffd640 1 -- 172.21.15.137:0/1817520839 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) ==== 100+0+11 (secure 0 0 0) 0x7fd5ec0593b0 con 0x7fd5f8070560 2024-04-26T22:02:22.128 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:02:22.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd5d806c8f0 msgr2=0x7fd5d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd5d806c8f0 0x7fd5d806edb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8033000 tx=0x7fd5e8009000 comp rx=0 tx=0).stop 2024-04-26T22:02:22.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8070560 msgr2=0x7fd5f81527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8070560 0x7fd5f81527e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00e900 tx=0x7fd5ec00edc0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 shutdown_connections 2024-04-26T22:02:22.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd5d806c8f0 0x7fd5d806edb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd5f8070560 0x7fd5f81527e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5f815f260 0x7fd5f81541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 --2- 172.21.15.137:0/1817520839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd5f806ebe0 0x7fd5f8160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 >> 172.21.15.137:0/1817520839 conn(0x7fd5f80d1660 msgr2=0x7fd5f80b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:22.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 shutdown_connections 2024-04-26T22:02:22.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.130+0000 7fd5fc847640 1 -- 172.21.15.137:0/1817520839 wait complete. 2024-04-26T22:02:22.140 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:02:22.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.237+0000 7f2afddf7640 1 Processor -- start 2024-04-26T22:02:22.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.237+0000 7f2afddf7640 1 -- start start 2024-04-26T22:02:22.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.238+0000 7f2afddf7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2af815d0c0 0x7f2af815fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.238+0000 7f2afddf7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af80d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.238+0000 7f2afddf7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af8160780 con 0x7f2af8160200 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.238+0000 7f2afddf7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2af8160a60 con 0x7f2af815d0c0 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.238+0000 7f2afddf7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2af80cff90 con 0x7f2af806f590 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.238+0000 7f2aeeffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2af8160200 0x7f2af806ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47084/0 (socket says 172.21.15.137:47084) 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.238+0000 7f2aeeffd640 1 -- 172.21.15.137:0/2713244567 learned_addr learned my addr 172.21.15.137:0/2713244567 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.239+0000 7f2af7fff640 1 --2- 172.21.15.137:0/2713244567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af80d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.239+0000 7f2af77fe640 1 --2- 172.21.15.137:0/2713244567 >> v2:172.21.15.170:3300/0 conn(0x7f2af815d0c0 0x7f2af815fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.239+0000 7f2af6ffd640 1 -- 172.21.15.137:0/2713244567 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102868181 0 0) 0x7f2af8160780 con 0x7f2af8160200 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.239+0000 7f2af6ffd640 1 -- 172.21.15.137:0/2713244567 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ae4003520 con 0x7f2af8160200 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.239+0000 7f2af7fff640 1 -- 172.21.15.137:0/2713244567 >> v2:172.21.15.170:3300/0 conn(0x7f2af815d0c0 msgr2=0x7f2af815fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.239+0000 7f2af7fff640 1 --2- 172.21.15.137:0/2713244567 >> v2:172.21.15.170:3300/0 conn(0x7f2af815d0c0 0x7f2af815fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.239+0000 7f2af7fff640 1 -- 172.21.15.137:0/2713244567 >> v1:172.21.15.137:6789/0 conn(0x7f2af8160200 legacy=0x7f2af806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.239+0000 7f2af7fff640 1 -- 172.21.15.137:0/2713244567 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af80d0270 con 0x7f2af806f590 2024-04-26T22:02:22.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2af7fff640 1 --2- 172.21.15.137:0/2713244567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af80d0790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009d90 tx=0x7f2af002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50bf75035039f6f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:22.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2af6ffd640 1 -- 172.21.15.137:0/2713244567 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0007740 con 0x7f2af806f590 2024-04-26T22:02:22.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2af6ffd640 1 -- 172.21.15.137:0/2713244567 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af00078e0 con 0x7f2af806f590 2024-04-26T22:02:22.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2af6ffd640 1 -- 172.21.15.137:0/2713244567 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0007cb0 con 0x7f2af806f590 2024-04-26T22:02:22.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2afddf7640 1 -- 172.21.15.137:0/2713244567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 msgr2=0x7f2af80d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2afddf7640 1 --2- 172.21.15.137:0/2713244567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af80d0790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009d90 tx=0x7f2af002a660 comp rx=0 tx=0).stop 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2afddf7640 1 -- 172.21.15.137:0/2713244567 shutdown_connections 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2afddf7640 1 --2- 172.21.15.137:0/2713244567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af80d0790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2afddf7640 1 --2- 172.21.15.137:0/2713244567 >> v2:172.21.15.170:3300/0 conn(0x7f2af815d0c0 0x7f2af815fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2afddf7640 1 -- 172.21.15.137:0/2713244567 >> 172.21.15.137:0/2713244567 conn(0x7f2af80b3b10 msgr2=0x7f2af80b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2afddf7640 1 -- 172.21.15.137:0/2713244567 shutdown_connections 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.240+0000 7f2afddf7640 1 -- 172.21.15.137:0/2713244567 wait complete. 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.242+0000 7f2afddf7640 1 Processor -- start 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.242+0000 7f2afddf7640 1 -- start start 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.242+0000 7f2afddf7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.242+0000 7f2afddf7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2af815d0c0 0x7f2af81f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.242+0000 7f2afddf7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af8160200 0x7f2af815b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.242+0000 7f2afddf7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2af815d620 con 0x7f2af815d0c0 2024-04-26T22:02:22.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.242+0000 7f2afddf7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2af815d4a0 con 0x7f2af8160200 2024-04-26T22:02:22.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.242+0000 7f2afddf7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2af80d0cd0 con 0x7f2af806f590 2024-04-26T22:02:22.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2aeeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2af815d0c0 0x7f2af81f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2aeeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2af815d0c0 0x7f2af81f84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44602/0 (socket says 172.21.15.137:44602) 2024-04-26T22:02:22.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2aeeffd640 1 -- 172.21.15.137:0/843228185 learned_addr learned my addr 172.21.15.137:0/843228185 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:22.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2af7fff640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af8160200 0x7f2af815b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2af77fe640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2aeeffd640 1 -- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 msgr2=0x7f2af81540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2aeeffd640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af81540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2aeeffd640 1 -- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af8160200 msgr2=0x7f2af815b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2aeeffd640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af8160200 0x7f2af815b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2aeeffd640 1 -- 172.21.15.137:0/843228185 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af81f8b80 con 0x7f2af815d0c0 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2af7fff640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af8160200 0x7f2af815b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2af77fe640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af81540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2aeeffd640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2af815d0c0 0x7f2af81f84f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000c3e0 tx=0x7f2ae000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2af4ff9640 1 -- 172.21.15.137:0/843228185 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0017070 con 0x7f2af815d0c0 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2af4ff9640 1 -- 172.21.15.137:0/843228185 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae0005ce0 con 0x7f2af815d0c0 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af81f8e60 con 0x7f2af815d0c0 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2af4ff9640 1 -- 172.21.15.137:0/843228185 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00072d0 con 0x7f2af815d0c0 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.243+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af80aef90 con 0x7f2af815d0c0 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.244+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af806a290 con 0x7f2af815d0c0 2024-04-26T22:02:22.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.245+0000 7f2af4ff9640 1 -- 172.21.15.137:0/843228185 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ae001a070 con 0x7f2af815d0c0 2024-04-26T22:02:22.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.245+0000 7f2af4ff9640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2ad806c920 0x7f2ad806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.245+0000 7f2af77fe640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2ad806c920 0x7f2ad806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.245+0000 7f2af4ff9640 1 -- 172.21.15.137:0/843228185 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f2ae008ae90 con 0x7f2af815d0c0 2024-04-26T22:02:22.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.246+0000 7f2af77fe640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2ad806c920 0x7f2ad806ede0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009ac0 tx=0x7f2ae8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:22.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.250+0000 7f2af4ff9640 1 -- 172.21.15.137:0/843228185 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2af806a290 con 0x7f2af815d0c0 2024-04-26T22:02:22.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.435+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2af80693d0 con 0x7f2af815d0c0 2024-04-26T22:02:22.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.436+0000 7f2af4ff9640 1 -- 172.21.15.137:0/843228185 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) ==== 80+0+0 (secure 0 0 0) 0x7f2ae0058bd0 con 0x7f2af815d0c0 2024-04-26T22:02:22.436 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T22:02:22.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2ad806c920 msgr2=0x7f2ad806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2ad806c920 0x7f2ad806ede0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009ac0 tx=0x7f2ae8008040 comp rx=0 tx=0).stop 2024-04-26T22:02:22.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2af815d0c0 msgr2=0x7f2af81f84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2af815d0c0 0x7f2af81f84f0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000c3e0 tx=0x7f2ae000c8a0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 shutdown_connections 2024-04-26T22:02:22.438 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2ad806c920 0x7f2ad806ede0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2af815d0c0 0x7f2af81f84f0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2af8160200 0x7f2af815b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 --2- 172.21.15.137:0/843228185 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2af806f590 0x7f2af81540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 >> 172.21.15.137:0/843228185 conn(0x7f2af80b3b10 msgr2=0x7f2af815f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:22.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 shutdown_connections 2024-04-26T22:02:22.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.438+0000 7f2afddf7640 1 -- 172.21.15.137:0/843228185 wait complete. 2024-04-26T22:02:22.448 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:02:22.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:22.449 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:22.488 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:02:22.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:22.489 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:02:22.543 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:02:22.544 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:02:22.544 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:22.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:02:22.561 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:02:22.561 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:22.561 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:22.599 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:02:22.599 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:02:22.599 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:02:22.599 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:22.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:02:22.618 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:22.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.736+0000 7f238d3e2640 1 Processor -- start 2024-04-26T22:02:22.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.736+0000 7f238d3e2640 1 -- start start 2024-04-26T22:02:22.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f238d3e2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f238815f680 0x7f23880d5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f238d3e2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815fa60 0x7f23880b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f238d3e2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f23880b2440 0x7f23880d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f238d3e2640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f23880d3b80 con 0x7f238815f680 2024-04-26T22:02:22.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f238d3e2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f23880d3e60 con 0x7f23880b2440 2024-04-26T22:02:22.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f238d3e2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f23880d4140 con 0x7f238815fa60 2024-04-26T22:02:22.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f2386ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f238815f680 0x7f23880d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f2386ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f238815f680 0x7f23880d5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44616/0 (socket says 172.21.15.137:44616) 2024-04-26T22:02:22.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f2386ffd640 1 -- 172.21.15.137:0/4232687304 learned_addr learned my addr 172.21.15.137:0/4232687304 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f237ffff640 1 --2- 172.21.15.137:0/4232687304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815fa60 0x7f23880b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f23877fe640 1 --2- 172.21.15.137:0/4232687304 >> v2:172.21.15.170:3300/0 conn(0x7f23880b2440 0x7f23880d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f2386ffd640 1 -- 172.21.15.137:0/4232687304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815fa60 msgr2=0x7f23880b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f2386ffd640 1 --2- 172.21.15.137:0/4232687304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815fa60 0x7f23880b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f2386ffd640 1 -- 172.21.15.137:0/4232687304 >> v2:172.21.15.170:3300/0 conn(0x7f23880b2440 msgr2=0x7f23880d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f2386ffd640 1 --2- 172.21.15.137:0/4232687304 >> v2:172.21.15.170:3300/0 conn(0x7f23880b2440 0x7f23880d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.737+0000 7f2386ffd640 1 -- 172.21.15.137:0/4232687304 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23880d0270 con 0x7f238815f680 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.738+0000 7f2386ffd640 1 --2- 172.21.15.137:0/4232687304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f238815f680 0x7f23880d5e50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f23880cc2d0 tx=0x7f237802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44836c6a0e78e184 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.738+0000 7f23867fc640 1 -- 172.21.15.137:0/4232687304 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378037070 con 0x7f238815f680 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.738+0000 7f23867fc640 1 -- 172.21.15.137:0/4232687304 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2378032440 con 0x7f238815f680 2024-04-26T22:02:22.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.738+0000 7f23867fc640 1 -- 172.21.15.137:0/4232687304 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378032810 con 0x7f238815f680 2024-04-26T22:02:22.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.739+0000 7f238d3e2640 1 -- 172.21.15.137:0/4232687304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f238815f680 msgr2=0x7f23880d5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.739+0000 7f238d3e2640 1 --2- 172.21.15.137:0/4232687304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f238815f680 0x7f23880d5e50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f23880cc2d0 tx=0x7f237802a1e0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.739+0000 7f238d3e2640 1 -- 172.21.15.137:0/4232687304 shutdown_connections 2024-04-26T22:02:22.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.739+0000 7f238d3e2640 1 --2- 172.21.15.137:0/4232687304 >> v2:172.21.15.170:3300/0 conn(0x7f23880b2440 0x7f23880d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.739+0000 7f238d3e2640 1 --2- 172.21.15.137:0/4232687304 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815fa60 0x7f23880b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.739+0000 7f238d3e2640 1 --2- 172.21.15.137:0/4232687304 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f238815f680 0x7f23880d5e50 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.739+0000 7f238d3e2640 1 -- 172.21.15.137:0/4232687304 >> 172.21.15.137:0/4232687304 conn(0x7f238809e5a0 msgr2=0x7f23880d5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.739+0000 7f238d3e2640 1 -- 172.21.15.137:0/4232687304 shutdown_connections 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.739+0000 7f238d3e2640 1 -- 172.21.15.137:0/4232687304 wait complete. 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.740+0000 7f238d3e2640 1 Processor -- start 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.740+0000 7f238d3e2640 1 -- start start 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f238d3e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23880b2440 0x7f23880ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f238d3e2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815f680 0x7f2388156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f238d3e2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f238815fa60 0x7f23880b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f238d3e2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f23880b4290 con 0x7f23880b2440 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f238d3e2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f23880d4420 con 0x7f238815fa60 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f238d3e2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f23880b4410 con 0x7f238815f680 2024-04-26T22:02:22.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f2386ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23880b2440 0x7f23880ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f2386ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23880b2440 0x7f23880ccd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44628/0 (socket says 172.21.15.137:44628) 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f2386ffd640 1 -- 172.21.15.137:0/131863 learned_addr learned my addr 172.21.15.137:0/131863 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f237ffff640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815f680 0x7f2388156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f23877fe640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f238815fa60 0x7f23880b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f2386ffd640 1 -- 172.21.15.137:0/131863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815f680 msgr2=0x7f2388156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f2386ffd640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815f680 0x7f2388156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f2386ffd640 1 -- 172.21.15.137:0/131863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f238815fa60 msgr2=0x7f23880b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f2386ffd640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f238815fa60 0x7f23880b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f2386ffd640 1 -- 172.21.15.137:0/131863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2388156cd0 con 0x7f23880b2440 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f237ffff640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815f680 0x7f2388156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.741+0000 7f2386ffd640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23880b2440 0x7f23880ccd00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2378000c00 tx=0x7f23780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.742+0000 7f237f7fe640 1 -- 172.21.15.137:0/131863 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378041070 con 0x7f23880b2440 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.742+0000 7f237f7fe640 1 -- 172.21.15.137:0/131863 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237803c870 con 0x7f23880b2440 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.742+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23880b6120 con 0x7f23880b2440 2024-04-26T22:02:22.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.742+0000 7f237f7fe640 1 -- 172.21.15.137:0/131863 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378037040 con 0x7f23880b2440 2024-04-26T22:02:22.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.742+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23880cd6c0 con 0x7f23880b2440 2024-04-26T22:02:22.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.743+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238806a290 con 0x7f23880b2440 2024-04-26T22:02:22.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.743+0000 7f237f7fe640 1 -- 172.21.15.137:0/131863 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2378044070 con 0x7f23880b2440 2024-04-26T22:02:22.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.743+0000 7f237f7fe640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f236806c8f0 0x7f236806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:22.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.743+0000 7f237f7fe640 1 -- 172.21.15.137:0/131863 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f23780ac6e0 con 0x7f23880b2440 2024-04-26T22:02:22.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.743+0000 7f237ffff640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f236806c8f0 0x7f236806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:22.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.744+0000 7f237ffff640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f236806c8f0 0x7f236806edb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f23880d2570 tx=0x7f2370008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:22.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.748+0000 7f237f7fe640 1 -- 172.21.15.137:0/131863 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2388156cd0 con 0x7f23880b2440 2024-04-26T22:02:22.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.961+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23880b3ab0 con 0x7f23880b2440 2024-04-26T22:02:22.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.961+0000 7f237f7fe640 1 -- 172.21.15.137:0/131863 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5194 (secure 0 0 0) 0x7f237807ac30 con 0x7f23880b2440 2024-04-26T22:02:22.962 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:22.962 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:01:10.893739+0000","modified":"2024-04-26T22:01:51.570195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.137:6837/4265926631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":4265926631},{"type":"v1","addr":"172.21.15.137:6837","nonce":4265926631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6060,"qdb_cluster":[6060]},"id":4}]} 2024-04-26T22:02:22.962 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 28 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f236806c8f0 msgr2=0x7f236806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f236806c8f0 0x7f236806edb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f23880d2570 tx=0x7f2370008040 comp rx=0 tx=0).stop 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23880b2440 msgr2=0x7f23880ccd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23880b2440 0x7f23880ccd00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2378000c00 tx=0x7f23780046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 shutdown_connections 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f236806c8f0 0x7f236806edb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f238815fa60 0x7f23880b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f238815f680 0x7f2388156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 --2- 172.21.15.137:0/131863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23880b2440 0x7f23880ccd00 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.963+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 >> 172.21.15.137:0/131863 conn(0x7f238809e5a0 msgr2=0x7f238806e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.964+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 shutdown_connections 2024-04-26T22:02:22.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:22.964+0000 7f238d3e2640 1 -- 172.21.15.137:0/131863 wait complete. 2024-04-26T22:02:22.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:23.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.071+0000 7fe48abf7640 1 Processor -- start 2024-04-26T22:02:23.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.071+0000 7fe48abf7640 1 -- start start 2024-04-26T22:02:23.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe48abf7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe4840742c0 0x7fe48415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe48abf7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe484161850 0x7fe48415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe48abf7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48415e2e0 con 0x7fe484146980 2024-04-26T22:02:23.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe48abf7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe48415e5c0 con 0x7fe4840742c0 2024-04-26T22:02:23.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe48abf7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe4841613c0 con 0x7fe484161850 2024-04-26T22:02:23.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe488993640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe484146980 0x7fe484073bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47096/0 (socket says 172.21.15.137:47096) 2024-04-26T22:02:23.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe488993640 1 -- 172.21.15.137:0/2188579229 learned_addr learned my addr 172.21.15.137:0/2188579229 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:23.074 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900719386 0 0) 0x7fe48415e2e0 con 0x7fe484146980 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe483fff640 1 --2- 172.21.15.137:0/2188579229 >> v2:172.21.15.170:3300/0 conn(0x7fe4840742c0 0x7fe48415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe474003520 con 0x7fe484146980 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe489194640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe484161850 0x7fe48415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3148912350 0 0) 0x7fe474003520 con 0x7fe484146980 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe484161850 msgr2=0x7fe48415dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe484161850 0x7fe48415dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 >> v2:172.21.15.170:3300/0 conn(0x7fe4840742c0 msgr2=0x7fe48415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 --2- 172.21.15.137:0/2188579229 >> v2:172.21.15.170:3300/0 conn(0x7fe4840742c0 0x7fe48415d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe484160d70 con 0x7fe484146980 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fe478001670 con 0x7fe484146980 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 >> v1:172.21.15.137:6789/0 conn(0x7fe484146980 legacy=0x7fe484073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4740039b0 0x7fe474003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004800 0x7fe474004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe484161850 0x7fe4740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe48415e5c0 con 0x7fe4740039b0 2024-04-26T22:02:23.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe4841613c0 con 0x7fe474004800 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.072+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe47400b9c0 con 0x7fe484161850 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe488993640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4740039b0 0x7fe474003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe483fff640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004800 0x7fe474004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe489194640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe484161850 0x7fe4740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe488993640 1 -- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe484161850 msgr2=0x7fe4740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe488993640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe484161850 0x7fe4740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe488993640 1 -- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004800 msgr2=0x7fe474004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe488993640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004800 0x7fe474004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe488993640 1 -- 172.21.15.137:0/2188579229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe474003520 con 0x7fe4740039b0 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe483fff640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe474004800 0x7fe474004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.073+0000 7fe488993640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4740039b0 0x7fe474003dd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe478001050 tx=0x7fe474005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b705362f923ec127 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47802e070 con 0x7fe4740039b0 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe478005af0 con 0x7fe4740039b0 2024-04-26T22:02:23.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe4837fe640 1 -- 172.21.15.137:0/2188579229 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478007d70 con 0x7fe4740039b0 2024-04-26T22:02:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe48abf7640 1 -- 172.21.15.137:0/2188579229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4740039b0 msgr2=0x7fe474003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe48abf7640 1 --2- 172.21.15.137:0/2188579229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4740039b0 0x7fe474003dd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe478001050 tx=0x7fe474005830 comp rx=0 tx=0).stop 2024-04-26T22:02:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe489194640 1 -- 172.21.15.137:0/2188579229 reap_dead start 2024-04-26T22:02:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe48abf7640 1 -- 172.21.15.137:0/2188579229 shutdown_connections 2024-04-26T22:02:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe48abf7640 1 -- 172.21.15.137:0/2188579229 >> 172.21.15.137:0/2188579229 conn(0x7fe4840ce8b0 msgr2=0x7fe4840cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe48abf7640 1 -- 172.21.15.137:0/2188579229 shutdown_connections 2024-04-26T22:02:23.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.074+0000 7fe48abf7640 1 -- 172.21.15.137:0/2188579229 wait complete. 2024-04-26T22:02:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.075+0000 7fe48abf7640 1 Processor -- start 2024-04-26T22:02:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.075+0000 7fe48abf7640 1 -- start start 2024-04-26T22:02:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe48abf7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4740039b0 0x7fe48413c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe48abf7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe48415ba10 0x7fe48415c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe48abf7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe48415c770 0x7fe4840b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe48abf7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe484146d60 con 0x7fe48415ba10 2024-04-26T22:02:23.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe48abf7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe4840b5120 con 0x7fe48415c770 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe48abf7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe48415dbf0 con 0x7fe4740039b0 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe483fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe48415ba10 0x7fe48415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe483fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe48415ba10 0x7fe48415c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44634/0 (socket says 172.21.15.137:44634) 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe483fff640 1 -- 172.21.15.137:0/308856629 learned_addr learned my addr 172.21.15.137:0/308856629 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe489194640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe48415c770 0x7fe4840b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe488993640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4740039b0 0x7fe48413c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.076+0000 7fe483fff640 1 -- 172.21.15.137:0/308856629 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4740039b0 msgr2=0x7fe48413c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe483fff640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4740039b0 0x7fe48413c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe483fff640 1 -- 172.21.15.137:0/308856629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe48415c770 msgr2=0x7fe4840b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe483fff640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe48415c770 0x7fe4840b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe483fff640 1 -- 172.21.15.137:0/308856629 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48413ca10 con 0x7fe48415ba10 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe489194640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe48415c770 0x7fe4840b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe483fff640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe48415ba10 0x7fe48415c230 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe470011540 tx=0x7fe470011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe4817fa640 1 -- 172.21.15.137:0/308856629 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470015870 con 0x7fe48415ba10 2024-04-26T22:02:23.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe4817fa640 1 -- 172.21.15.137:0/308856629 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe470015a10 con 0x7fe48415ba10 2024-04-26T22:02:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4841e7270 con 0x7fe48415ba10 2024-04-26T22:02:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe4817fa640 1 -- 172.21.15.137:0/308856629 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470015dc0 con 0x7fe48415ba10 2024-04-26T22:02:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.077+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4840b1f70 con 0x7fe48415ba10 2024-04-26T22:02:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.078+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48406a290 con 0x7fe48415ba10 2024-04-26T22:02:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.078+0000 7fe4817fa640 1 -- 172.21.15.137:0/308856629 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe47000f460 con 0x7fe48415ba10 2024-04-26T22:02:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.079+0000 7fe4817fa640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe46806c8f0 0x7fe46806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.079+0000 7fe4817fa640 1 -- 172.21.15.137:0/308856629 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe47008c3f0 con 0x7fe48415ba10 2024-04-26T22:02:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.079+0000 7fe488993640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe46806c8f0 0x7fe46806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.079+0000 7fe488993640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe46806c8f0 0x7fe46806edb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe478033000 tx=0x7fe478009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.083+0000 7fe4817fa640 1 -- 172.21.15.137:0/308856629 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe470019030 con 0x7fe48415ba10 2024-04-26T22:02:23.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.260+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe48415d160 con 0x7fe48415ba10 2024-04-26T22:02:23.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.261+0000 7fe4817fa640 1 -- 172.21.15.137:0/308856629 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16677 (secure 0 0 0) 0x7fe47005a820 con 0x7fe48415ba10 2024-04-26T22:02:23.261 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:23.261 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:01:12.541348+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:01:09.101906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T22:01:09.837941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:23.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe46806c8f0 msgr2=0x7fe46806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe46806c8f0 0x7fe46806edb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe478033000 tx=0x7fe478009030 comp rx=0 tx=0).stop 2024-04-26T22:02:23.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe48415ba10 msgr2=0x7fe48415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe48415ba10 0x7fe48415c230 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe470011540 tx=0x7fe470011a00 comp rx=0 tx=0).stop 2024-04-26T22:02:23.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 shutdown_connections 2024-04-26T22:02:23.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe46806c8f0 0x7fe46806edb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe48415ba10 0x7fe48415c230 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe48415c770 0x7fe4840b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 --2- 172.21.15.137:0/308856629 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4740039b0 0x7fe48413c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 >> 172.21.15.137:0/308856629 conn(0x7fe4840ce8b0 msgr2=0x7fe4840cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:23.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 shutdown_connections 2024-04-26T22:02:23.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.263+0000 7fe48abf7640 1 -- 172.21.15.137:0/308856629 wait complete. 2024-04-26T22:02:23.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:01:09.101906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:01:09.837941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:02:23.274 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:02:23.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.373+0000 7f4314512640 1 Processor -- start 2024-04-26T22:02:23.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.373+0000 7f4314512640 1 -- start start 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.374+0000 7f4314512640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f430c15d340 0x7f430c09c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.374+0000 7f4314512640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c0d1940 0x7f430c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.374+0000 7f4314512640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430c0cee60 con 0x7f430c0b2420 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.374+0000 7f4314512640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f430c0ce9d0 con 0x7f430c15d340 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.374+0000 7f4314512640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f430c0d0ff0 con 0x7f430c0d1940 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.374+0000 7f4311aad640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f430c0b2420 0x7f430c0d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47108/0 (socket says 172.21.15.137:47108) 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.374+0000 7f4311aad640 1 -- 172.21.15.137:0/125439958 learned_addr learned my addr 172.21.15.137:0/125439958 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f4312aaf640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c0d1940 0x7f430c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43122ae640 1 --2- 172.21.15.137:0/125439958 >> v2:172.21.15.170:3300/0 conn(0x7f430c15d340 0x7f430c09c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620815983 0 0) 0x7f430c0cee60 con 0x7f430c0b2420 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f8003520 con 0x7f430c0b2420 2024-04-26T22:02:23.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3999034068 0 0) 0x7f42f8003520 con 0x7f430c0b2420 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c0d1940 msgr2=0x7f430c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c0d1940 0x7f430c0702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 >> v2:172.21.15.170:3300/0 conn(0x7f430c15d340 msgr2=0x7f430c09c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 --2- 172.21.15.137:0/125439958 >> v2:172.21.15.170:3300/0 conn(0x7f430c15d340 0x7f430c09c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c0d0d10 con 0x7f430c0b2420 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f42fc001670 con 0x7f430c0b2420 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 >> v1:172.21.15.137:6789/0 conn(0x7f430c0b2420 legacy=0x7f430c0d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c0d1940 0x7f42f80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f8003f30 0x7f42f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42f8004d40 0x7f42f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f430c0ce9d0 con 0x7f42f8004d40 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f430c0d0ff0 con 0x7f42f8003f30 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42f800b9c0 con 0x7f430c0d1940 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f4312aaf640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42f8004d40 0x7f42f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f43122ae640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c0d1940 0x7f42f80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f4311aad640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f8003f30 0x7f42f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f4312aaf640 1 -- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c0d1940 msgr2=0x7f42f80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f4312aaf640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c0d1940 0x7f42f80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f4312aaf640 1 -- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f8003f30 msgr2=0x7f42f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f4312aaf640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f8003f30 0x7f42f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.375+0000 7f4312aaf640 1 -- 172.21.15.137:0/125439958 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f8003520 con 0x7f42f8004d40 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.376+0000 7f4312aaf640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42f8004d40 0x7f42f80051c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4304009a90 tx=0x7f42f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a26a59f75ee33bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.376+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304036070 con 0x7f42f8004d40 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.376+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4304031400 con 0x7f42f8004d40 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.376+0000 7f43112ac640 1 -- 172.21.15.137:0/125439958 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304009690 con 0x7f42f8004d40 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.377+0000 7f4314512640 1 -- 172.21.15.137:0/125439958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42f8004d40 msgr2=0x7f42f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.377+0000 7f4314512640 1 --2- 172.21.15.137:0/125439958 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42f8004d40 0x7f42f80051c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4304009a90 tx=0x7f42f8005830 comp rx=0 tx=0).stop 2024-04-26T22:02:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.377+0000 7f4312aaf640 1 -- 172.21.15.137:0/125439958 reap_dead start 2024-04-26T22:02:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.377+0000 7f4314512640 1 -- 172.21.15.137:0/125439958 shutdown_connections 2024-04-26T22:02:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.377+0000 7f4314512640 1 -- 172.21.15.137:0/125439958 >> 172.21.15.137:0/125439958 conn(0x7f430c09ba40 msgr2=0x7f430c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.377+0000 7f4314512640 1 -- 172.21.15.137:0/125439958 shutdown_connections 2024-04-26T22:02:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.377+0000 7f4314512640 1 -- 172.21.15.137:0/125439958 wait complete. 2024-04-26T22:02:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.378+0000 7f4314512640 1 Processor -- start 2024-04-26T22:02:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.378+0000 7f4314512640 1 -- start start 2024-04-26T22:02:23.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4314512640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f8004d40 0x7f430c14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4314512640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c1582d0 0x7f430c0a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4314512640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f430c09ce30 0x7f430c09d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4314512640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f430c0b2090 con 0x7f430c09ce30 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4314512640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f430c15d720 con 0x7f42f8004d40 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4314512640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f430c0b2210 con 0x7f430c1582d0 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4312aaf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f430c09ce30 0x7f430c09d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4312aaf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f430c09ce30 0x7f430c09d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44650/0 (socket says 172.21.15.137:44650) 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4312aaf640 1 -- 172.21.15.137:0/124236765 learned_addr learned my addr 172.21.15.137:0/124236765 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f43122ae640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f8004d40 0x7f430c14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4311aad640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c1582d0 0x7f430c0a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4312aaf640 1 -- 172.21.15.137:0/124236765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c1582d0 msgr2=0x7f430c0a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4312aaf640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c1582d0 0x7f430c0a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4312aaf640 1 -- 172.21.15.137:0/124236765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f8004d40 msgr2=0x7f430c14c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4312aaf640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f8004d40 0x7f430c14c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4312aaf640 1 -- 172.21.15.137:0/124236765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c1587b0 con 0x7f430c09ce30 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4312aaf640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f430c09ce30 0x7f430c09d2c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4304034040 tx=0x7f4304004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4302ffd640 1 -- 172.21.15.137:0/124236765 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304036040 con 0x7f430c09ce30 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4302ffd640 1 -- 172.21.15.137:0/124236765 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4304004500 con 0x7f430c09ce30 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4302ffd640 1 -- 172.21.15.137:0/124236765 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304003a40 con 0x7f430c09ce30 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430c158a90 con 0x7f430c09ce30 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.379+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430c1f62d0 con 0x7f430c09ce30 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.380+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430c0d08c0 con 0x7f430c09ce30 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.381+0000 7f4302ffd640 1 -- 172.21.15.137:0/124236765 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4304043030 con 0x7f430c09ce30 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.381+0000 7f4302ffd640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42f006c8f0 0x7f42f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.381+0000 7f4302ffd640 1 -- 172.21.15.137:0/124236765 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f43040aade0 con 0x7f430c09ce30 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.381+0000 7f43122ae640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42f006c8f0 0x7f42f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.382+0000 7f43122ae640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42f006c8f0 0x7f42f006edb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4308007520 tx=0x7f430800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.386+0000 7f4302ffd640 1 -- 172.21.15.137:0/124236765 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f430c0d08c0 con 0x7f430c09ce30 2024-04-26T22:02:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.566+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f430c0693d0 con 0x7f430c09ce30 2024-04-26T22:02:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.566+0000 7f4302ffd640 1 -- 172.21.15.137:0/124236765 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7f43040792a0 con 0x7f430c09ce30 2024-04-26T22:02:23.566 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:02:23.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42f006c8f0 msgr2=0x7f42f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42f006c8f0 0x7f42f006edb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4308007520 tx=0x7f430800b040 comp rx=0 tx=0).stop 2024-04-26T22:02:23.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f430c09ce30 msgr2=0x7f430c09d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f430c09ce30 0x7f430c09d2c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4304034040 tx=0x7f4304004730 comp rx=0 tx=0).stop 2024-04-26T22:02:23.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 shutdown_connections 2024-04-26T22:02:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42f006c8f0 0x7f42f006edb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f430c09ce30 0x7f430c09d2c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f430c1582d0 0x7f430c0a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 --2- 172.21.15.137:0/124236765 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42f8004d40 0x7f430c14c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 >> 172.21.15.137:0/124236765 conn(0x7f430c09ba40 msgr2=0x7f430c0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 shutdown_connections 2024-04-26T22:02:23.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.568+0000 7f4314512640 1 -- 172.21.15.137:0/124236765 wait complete. 2024-04-26T22:02:23.579 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:02:23.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.679+0000 7f6e6df46640 1 Processor -- start 2024-04-26T22:02:23.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.679+0000 7f6e6df46640 1 -- start start 2024-04-26T22:02:23.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.679+0000 7f6e6df46640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e68143840 0x7f6e680b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.679+0000 7f6e6df46640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6e680b4520 0x7f6e680b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.679+0000 7f6e6df46640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e6815dca0 con 0x7f6e680b53f0 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.679+0000 7f6e6df46640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6e68143c20 con 0x7f6e68143840 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.679+0000 7f6e6df46640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6e6815df80 con 0x7f6e680b4520 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.680+0000 7f6e677fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e68143840 0x7f6e680b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.680+0000 7f6e677fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e68143840 0x7f6e680b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44652/0 (socket says 172.21.15.137:44652) 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.680+0000 7f6e677fe640 1 -- 172.21.15.137:0/3087600700 learned_addr learned my addr 172.21.15.137:0/3087600700 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.680+0000 7f6e66ffd640 1 --2- 172.21.15.137:0/3087600700 >> v2:172.21.15.170:3300/0 conn(0x7f6e680b4520 0x7f6e680b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.680+0000 7f6e677fe640 1 -- 172.21.15.137:0/3087600700 >> v2:172.21.15.170:3300/0 conn(0x7f6e680b4520 msgr2=0x7f6e680b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.680+0000 7f6e677fe640 1 --2- 172.21.15.137:0/3087600700 >> v2:172.21.15.170:3300/0 conn(0x7f6e680b4520 0x7f6e680b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.680+0000 7f6e677fe640 1 -- 172.21.15.137:0/3087600700 >> v1:172.21.15.137:6789/0 conn(0x7f6e680b53f0 legacy=0x7f6e68160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.680+0000 7f6e677fe640 1 -- 172.21.15.137:0/3087600700 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6815e260 con 0x7f6e68143840 2024-04-26T22:02:23.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.680+0000 7f6e667fc640 1 -- 172.21.15.137:0/3087600700 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010371004 0 0) 0x7f6e6815dca0 con 0x7f6e680b53f0 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e677fe640 1 --2- 172.21.15.137:0/3087600700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68143840 0x7f6e680b3fe0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6e680b0a90 tx=0x7f6e5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a03d6595bcd14e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e667fc640 1 -- 172.21.15.137:0/3087600700 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58037070 con 0x7f6e68143840 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e667fc640 1 -- 172.21.15.137:0/3087600700 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e58032440 con 0x7f6e68143840 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e667fc640 1 -- 172.21.15.137:0/3087600700 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58032810 con 0x7f6e68143840 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e6df46640 1 -- 172.21.15.137:0/3087600700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68143840 msgr2=0x7f6e680b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e6df46640 1 --2- 172.21.15.137:0/3087600700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68143840 0x7f6e680b3fe0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6e680b0a90 tx=0x7f6e5802a270 comp rx=0 tx=0).stop 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e6df46640 1 -- 172.21.15.137:0/3087600700 shutdown_connections 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e6df46640 1 --2- 172.21.15.137:0/3087600700 >> v2:172.21.15.170:3300/0 conn(0x7f6e680b4520 0x7f6e680b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e6df46640 1 --2- 172.21.15.137:0/3087600700 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e68143840 0x7f6e680b3fe0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e6df46640 1 -- 172.21.15.137:0/3087600700 >> 172.21.15.137:0/3087600700 conn(0x7f6e680cd8a0 msgr2=0x7f6e680cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e6df46640 1 -- 172.21.15.137:0/3087600700 shutdown_connections 2024-04-26T22:02:23.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.681+0000 7f6e6df46640 1 -- 172.21.15.137:0/3087600700 wait complete. 2024-04-26T22:02:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.682+0000 7f6e6df46640 1 Processor -- start 2024-04-26T22:02:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.683+0000 7f6e6df46640 1 -- start start 2024-04-26T22:02:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.683+0000 7f6e6df46640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e680b4520 0x7f6e6813d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.683+0000 7f6e6df46640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e680b53f0 0x7f6e6813d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.683+0000 7f6e6df46640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e68143840 0x7f6e6815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.683+0000 7f6e6df46640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6815da40 con 0x7f6e680b4520 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.683+0000 7f6e6df46640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6815d8c0 con 0x7f6e68143840 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.683+0000 7f6e6df46640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6e680d0000 con 0x7f6e680b53f0 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.683+0000 7f6e677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e680b4520 0x7f6e6813d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e680b4520 0x7f6e6813d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44658/0 (socket says 172.21.15.137:44658) 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e677fe640 1 -- 172.21.15.137:0/428376176 learned_addr learned my addr 172.21.15.137:0/428376176 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e66ffd640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e680b53f0 0x7f6e6813d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e67fff640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e68143840 0x7f6e6815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e677fe640 1 -- 172.21.15.137:0/428376176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e680b53f0 msgr2=0x7f6e6813d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e677fe640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e680b53f0 0x7f6e6813d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e677fe640 1 -- 172.21.15.137:0/428376176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e68143840 msgr2=0x7f6e6815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e677fe640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e68143840 0x7f6e6815a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e677fe640 1 -- 172.21.15.137:0/428376176 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e681440f0 con 0x7f6e680b4520 2024-04-26T22:02:23.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e677fe640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e680b4520 0x7f6e6813d1f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6e58000c00 tx=0x7f6e580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e4ffff640 1 -- 172.21.15.137:0/428376176 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58037040 con 0x7f6e680b4520 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e4ffff640 1 -- 172.21.15.137:0/428376176 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e58004030 con 0x7f6e680b4520 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e681443d0 con 0x7f6e680b4520 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e4ffff640 1 -- 172.21.15.137:0/428376176 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58004400 con 0x7f6e680b4520 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.684+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e68144990 con 0x7f6e680b4520 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.685+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e680d0b80 con 0x7f6e680b4520 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.686+0000 7f6e4ffff640 1 -- 172.21.15.137:0/428376176 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e5803a070 con 0x7f6e680b4520 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.686+0000 7f6e4ffff640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6e5406c8f0 0x7f6e5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.686+0000 7f6e4ffff640 1 -- 172.21.15.137:0/428376176 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f6e580ac0c0 con 0x7f6e680b4520 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.686+0000 7f6e66ffd640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6e5406c8f0 0x7f6e5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.687+0000 7f6e66ffd640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6e5406c8f0 0x7f6e5406edb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6e681430e0 tx=0x7f6e5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.690+0000 7f6e4ffff640 1 -- 172.21.15.137:0/428376176 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6e680d0b80 con 0x7f6e680b4520 2024-04-26T22:02:23.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.868+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6e6806a290 con 0x7f6e680b4520 2024-04-26T22:02:23.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.868+0000 7f6e4ffff640 1 -- 172.21.15.137:0/428376176 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) ==== 104+0+11 (secure 0 0 0) 0x7f6e58041020 con 0x7f6e680b4520 2024-04-26T22:02:23.868 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:02:23.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6e5406c8f0 msgr2=0x7f6e5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6e5406c8f0 0x7f6e5406edb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6e681430e0 tx=0x7f6e5c008040 comp rx=0 tx=0).stop 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e680b4520 msgr2=0x7f6e6813d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e680b4520 0x7f6e6813d1f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6e58000c00 tx=0x7f6e580046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 shutdown_connections 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6e5406c8f0 0x7f6e5406edb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e68143840 0x7f6e6815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e680b53f0 0x7f6e6813d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 --2- 172.21.15.137:0/428376176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e680b4520 0x7f6e6813d1f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 >> 172.21.15.137:0/428376176 conn(0x7f6e680cd8a0 msgr2=0x7f6e6815fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 shutdown_connections 2024-04-26T22:02:23.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.870+0000 7f6e6df46640 1 -- 172.21.15.137:0/428376176 wait complete. 2024-04-26T22:02:23.881 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:02:23.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.980+0000 7ff98b425640 1 Processor -- start 2024-04-26T22:02:23.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.981+0000 7ff98b425640 1 -- start start 2024-04-26T22:02:23.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.981+0000 7ff98b425640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.981+0000 7ff98b425640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9840d3f50 con 0x7ff984163aa0 2024-04-26T22:02:23.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.981+0000 7ff98b425640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9840b5090 con 0x7ff9840d4f20 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.981+0000 7ff98b425640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff98415fa60 con 0x7ff98415f680 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff9889c0640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff984163aa0 0x7ff9840b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47114/0 (socket says 172.21.15.137:47114) 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff9889c0640 1 -- 172.21.15.137:0/1745917313 learned_addr learned my addr 172.21.15.137:0/1745917313 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff9891c1640 1 --2- 172.21.15.137:0/1745917313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff97bfff640 1 -- 172.21.15.137:0/1745917313 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493681359 0 0) 0x7ff9840d3f50 con 0x7ff984163aa0 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff97bfff640 1 -- 172.21.15.137:0/1745917313 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff970003520 con 0x7ff984163aa0 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff97bfff640 1 -- 172.21.15.137:0/1745917313 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137077791 0 0) 0x7ff9840b5090 con 0x7ff9840d4f20 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff97bfff640 1 -- 172.21.15.137:0/1745917313 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9840d3f50 con 0x7ff9840d4f20 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff97bfff640 1 -- 172.21.15.137:0/1745917313 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3094566979 0 0) 0x7ff970003520 con 0x7ff984163aa0 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff9891c1640 1 -- 172.21.15.137:0/1745917313 >> v1:172.21.15.170:6789/0 conn(0x7ff9840d4f20 legacy=0x7ff9840d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff9891c1640 1 -- 172.21.15.137:0/1745917313 >> v1:172.21.15.137:6789/0 conn(0x7ff984163aa0 legacy=0x7ff9840b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.982+0000 7ff9891c1640 1 -- 172.21.15.137:0/1745917313 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9840b5370 con 0x7ff98415f680 2024-04-26T22:02:23.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.983+0000 7ff9891c1640 1 --2- 172.21.15.137:0/1745917313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840d3820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9800097d0 tx=0x7ff98002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75e44dc167ca3f9b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.983+0000 7ff97bfff640 1 -- 172.21.15.137:0/1745917313 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980037070 con 0x7ff98415f680 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.983+0000 7ff97bfff640 1 -- 172.21.15.137:0/1745917313 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98002ac30 con 0x7ff98415f680 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.983+0000 7ff97bfff640 1 -- 172.21.15.137:0/1745917313 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974001670 con 0x7ff98415f680 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.984+0000 7ff98b425640 1 -- 172.21.15.137:0/1745917313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 msgr2=0x7ff9840d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.984+0000 7ff98b425640 1 --2- 172.21.15.137:0/1745917313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840d3820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff9800097d0 tx=0x7ff98002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.984+0000 7ff98b425640 1 -- 172.21.15.137:0/1745917313 shutdown_connections 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.984+0000 7ff98b425640 1 --2- 172.21.15.137:0/1745917313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840d3820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.984+0000 7ff98b425640 1 -- 172.21.15.137:0/1745917313 >> 172.21.15.137:0/1745917313 conn(0x7ff98408eca0 msgr2=0x7ff98409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.984+0000 7ff98b425640 1 -- 172.21.15.137:0/1745917313 shutdown_connections 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.984+0000 7ff98b425640 1 -- 172.21.15.137:0/1745917313 wait complete. 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.985+0000 7ff98b425640 1 Processor -- start 2024-04-26T22:02:23.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.985+0000 7ff98b425640 1 -- start start 2024-04-26T22:02:23.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.985+0000 7ff98b425640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9840d4f20 0x7ff98415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.985+0000 7ff98b425640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff98b425640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff984163aa0 0x7ff9841506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff98b425640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9840cfd80 con 0x7ff9840d4f20 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff98b425640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff984163f00 con 0x7ff984163aa0 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff98b425640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff9840cff00 con 0x7ff98415f680 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9891c1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9840d4f20 0x7ff98415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9891c1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9840d4f20 0x7ff98415a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44670/0 (socket says 172.21.15.137:44670) 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9891c1640 1 -- 172.21.15.137:0/2800406794 learned_addr learned my addr 172.21.15.137:0/2800406794 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9889c0640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9899c2640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff984163aa0 0x7ff9841506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9891c1640 1 -- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 msgr2=0x7ff9840c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9891c1640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9891c1640 1 -- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff984163aa0 msgr2=0x7ff9841506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9891c1640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff984163aa0 0x7ff9841506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:23.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9891c1640 1 -- 172.21.15.137:0/2800406794 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9840cf190 con 0x7ff9840d4f20 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9899c2640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff984163aa0 0x7ff9841506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9889c0640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff9891c1640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9840d4f20 0x7ff98415a590 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff9800097d0 tx=0x7ff9800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff979ffb640 1 -- 172.21.15.137:0/2800406794 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980042020 con 0x7ff9840d4f20 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff979ffb640 1 -- 172.21.15.137:0/2800406794 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98003d670 con 0x7ff9840d4f20 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff984150c00 con 0x7ff9840d4f20 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff979ffb640 1 -- 172.21.15.137:0/2800406794 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980037040 con 0x7ff9840d4f20 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.986+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff984160b80 con 0x7ff9840d4f20 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.987+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98406a290 con 0x7ff9840d4f20 2024-04-26T22:02:23.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.988+0000 7ff979ffb640 1 -- 172.21.15.137:0/2800406794 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff980045020 con 0x7ff9840d4f20 2024-04-26T22:02:23.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.988+0000 7ff979ffb640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff96806c920 0x7ff96806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:23.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.988+0000 7ff979ffb640 1 -- 172.21.15.137:0/2800406794 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7ff9800ac330 con 0x7ff9840d4f20 2024-04-26T22:02:23.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.988+0000 7ff9889c0640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff96806c920 0x7ff96806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:23.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.989+0000 7ff9889c0640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff96806c920 0x7ff96806ede0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff9740017e0 tx=0x7ff974009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:23.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:23.992+0000 7ff979ffb640 1 -- 172.21.15.137:0/2800406794 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff98004c030 con 0x7ff9840d4f20 2024-04-26T22:02:24.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.166+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff98406ec20 con 0x7ff9840d4f20 2024-04-26T22:02:24.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.166+0000 7ff979ffb640 1 -- 172.21.15.137:0/2800406794 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) ==== 100+0+11 (secure 0 0 0) 0x7ff984150c00 con 0x7ff9840d4f20 2024-04-26T22:02:24.166 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff96806c920 msgr2=0x7ff96806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff96806c920 0x7ff96806ede0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff9740017e0 tx=0x7ff974009040 comp rx=0 tx=0).stop 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9840d4f20 msgr2=0x7ff98415a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9840d4f20 0x7ff98415a590 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff9800097d0 tx=0x7ff9800046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 shutdown_connections 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff96806c920 0x7ff96806ede0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff984163aa0 0x7ff9841506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff98415f680 0x7ff9840c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 --2- 172.21.15.137:0/2800406794 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9840d4f20 0x7ff98415a590 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 >> 172.21.15.137:0/2800406794 conn(0x7ff98408eca0 msgr2=0x7ff9840d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:24.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 shutdown_connections 2024-04-26T22:02:24.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.168+0000 7ff98b425640 1 -- 172.21.15.137:0/2800406794 wait complete. 2024-04-26T22:02:24.179 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.276+0000 7fbd3cebd640 1 Processor -- start 2024-04-26T22:02:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.276+0000 7fbd3cebd640 1 -- start start 2024-04-26T22:02:24.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd3cebd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd380b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd3cebd640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd380b4530 con 0x7fbd380b61a0 2024-04-26T22:02:24.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd3cebd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd380b4810 con 0x7fbd38145980 2024-04-26T22:02:24.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd3cebd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbd38160ac0 con 0x7fbd38160630 2024-04-26T22:02:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd2dd9b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbd380b61a0 0x7fbd380720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47120/0 (socket says 172.21.15.137:47120) 2024-04-26T22:02:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd2dd9b640 1 -- 172.21.15.137:0/2339696563 learned_addr learned my addr 172.21.15.137:0/2339696563 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd36d9d640 1 --2- 172.21.15.137:0/2339696563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd380b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd35d9b640 1 -- 172.21.15.137:0/2339696563 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425986079 0 0) 0x7fbd380b4530 con 0x7fbd380b61a0 2024-04-26T22:02:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd35d9b640 1 -- 172.21.15.137:0/2339696563 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd24003520 con 0x7fbd380b61a0 2024-04-26T22:02:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd35d9b640 1 -- 172.21.15.137:0/2339696563 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144413237 0 0) 0x7fbd380b4810 con 0x7fbd38145980 2024-04-26T22:02:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd36d9d640 1 -- 172.21.15.137:0/2339696563 >> v1:172.21.15.170:6789/0 conn(0x7fbd38145980 legacy=0x7fbd380b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd36d9d640 1 -- 172.21.15.137:0/2339696563 >> v1:172.21.15.137:6789/0 conn(0x7fbd380b61a0 legacy=0x7fbd380720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.277+0000 7fbd36d9d640 1 -- 172.21.15.137:0/2339696563 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd380b4af0 con 0x7fbd38160630 2024-04-26T22:02:24.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.278+0000 7fbd36d9d640 1 --2- 172.21.15.137:0/2339696563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd380b3de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009dc0 tx=0x7fbd3002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9386901300a1c15c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:24.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.278+0000 7fbd35d9b640 1 -- 172.21.15.137:0/2339696563 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3002ae60 con 0x7fbd38160630 2024-04-26T22:02:24.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.278+0000 7fbd35d9b640 1 -- 172.21.15.137:0/2339696563 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd30007740 con 0x7fbd38160630 2024-04-26T22:02:24.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.278+0000 7fbd35d9b640 1 -- 172.21.15.137:0/2339696563 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30007af0 con 0x7fbd38160630 2024-04-26T22:02:24.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.278+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2339696563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 msgr2=0x7fbd380b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.279+0000 7fbd3cebd640 1 --2- 172.21.15.137:0/2339696563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd380b3de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd30009dc0 tx=0x7fbd3002a640 comp rx=0 tx=0).stop 2024-04-26T22:02:24.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.279+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2339696563 shutdown_connections 2024-04-26T22:02:24.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.279+0000 7fbd3cebd640 1 --2- 172.21.15.137:0/2339696563 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd380b3de0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.279+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2339696563 >> 172.21.15.137:0/2339696563 conn(0x7fbd380d0d30 msgr2=0x7fbd380d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:24.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.279+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2339696563 shutdown_connections 2024-04-26T22:02:24.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.279+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2339696563 wait complete. 2024-04-26T22:02:24.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.280+0000 7fbd3cebd640 1 Processor -- start 2024-04-26T22:02:24.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.280+0000 7fbd3cebd640 1 -- start start 2024-04-26T22:02:24.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3cebd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd380b61a0 0x7fbd3815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3cebd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38145980 0x7fbd380b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3cebd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd3813f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3cebd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd380727e0 con 0x7fbd380b61a0 2024-04-26T22:02:24.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3cebd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbd380b5140 con 0x7fbd38145980 2024-04-26T22:02:24.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3cebd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbd38072960 con 0x7fbd38160630 2024-04-26T22:02:24.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd380b61a0 0x7fbd3815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd380b61a0 0x7fbd3815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44676/0 (socket says 172.21.15.137:44676) 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3659c640 1 -- 172.21.15.137:0/2126324557 learned_addr learned my addr 172.21.15.137:0/2126324557 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd2dd9b640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38145980 0x7fbd380b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd36d9d640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd3813f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3659c640 1 -- 172.21.15.137:0/2126324557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 msgr2=0x7fbd3813f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3659c640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd3813f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3659c640 1 -- 172.21.15.137:0/2126324557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38145980 msgr2=0x7fbd380b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3659c640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38145980 0x7fbd380b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3659c640 1 -- 172.21.15.137:0/2126324557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3813be30 con 0x7fbd380b61a0 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd36d9d640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd3813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd3659c640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd380b61a0 0x7fbd3815b230 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800c4b0 tx=0x7fbd2800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd2f7fe640 1 -- 172.21.15.137:0/2126324557 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28017070 con 0x7fbd380b61a0 2024-04-26T22:02:24.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.281+0000 7fbd2f7fe640 1 -- 172.21.15.137:0/2126324557 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd28005480 con 0x7fbd380b61a0 2024-04-26T22:02:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.282+0000 7fbd2f7fe640 1 -- 172.21.15.137:0/2126324557 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd28003830 con 0x7fbd380b61a0 2024-04-26T22:02:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.282+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3813c110 con 0x7fbd380b61a0 2024-04-26T22:02:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.282+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3813c6d0 con 0x7fbd380b61a0 2024-04-26T22:02:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.282+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3806a290 con 0x7fbd380b61a0 2024-04-26T22:02:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.283+0000 7fbd2f7fe640 1 -- 172.21.15.137:0/2126324557 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd2801a070 con 0x7fbd380b61a0 2024-04-26T22:02:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.283+0000 7fbd2f7fe640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd1806c8f0 0x7fbd1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.283+0000 7fbd2dd9b640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd1806c8f0 0x7fbd1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.283+0000 7fbd2f7fe640 1 -- 172.21.15.137:0/2126324557 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fbd2808aed0 con 0x7fbd380b61a0 2024-04-26T22:02:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.284+0000 7fbd2dd9b640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd1806c8f0 0x7fbd1806edb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbd381f65e0 tx=0x7fbd20000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:24.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.288+0000 7fbd2f7fe640 1 -- 172.21.15.137:0/2126324557 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbd28058c20 con 0x7fbd380b61a0 2024-04-26T22:02:24.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.502+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd38073cc0 con 0x7fbd380b61a0 2024-04-26T22:02:24.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.502+0000 7fbd2f7fe640 1 -- 172.21.15.137:0/2126324557 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5194 (secure 0 0 0) 0x7fbd2805cf20 con 0x7fbd380b61a0 2024-04-26T22:02:24.502 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:24.502 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:01:10.893739+0000","modified":"2024-04-26T22:01:51.570195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.137:6837/4265926631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":4265926631},{"type":"v1","addr":"172.21.15.137:6837","nonce":4265926631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6060,"qdb_cluster":[6060]},"id":4}]} 2024-04-26T22:02:24.503 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 28 2024-04-26T22:02:24.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd1806c8f0 msgr2=0x7fbd1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd1806c8f0 0x7fbd1806edb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbd381f65e0 tx=0x7fbd20000bc0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd380b61a0 msgr2=0x7fbd3815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd380b61a0 0x7fbd3815b230 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800c4b0 tx=0x7fbd2800c970 comp rx=0 tx=0).stop 2024-04-26T22:02:24.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 shutdown_connections 2024-04-26T22:02:24.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd1806c8f0 0x7fbd1806edb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd38160630 0x7fbd3813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd38145980 0x7fbd380b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 --2- 172.21.15.137:0/2126324557 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd380b61a0 0x7fbd3815b230 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 >> 172.21.15.137:0/2126324557 conn(0x7fbd380d0d30 msgr2=0x7fbd3815f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:24.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 shutdown_connections 2024-04-26T22:02:24.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.504+0000 7fbd3cebd640 1 -- 172.21.15.137:0/2126324557 wait complete. 2024-04-26T22:02:24.515 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:24.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.610+0000 7fcf0c140640 1 Processor -- start 2024-04-26T22:02:24.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.611+0000 7fcf0c140640 1 -- start start 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.611+0000 7fcf0c140640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcf041489a0 0x7fcf040ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.611+0000 7fcf0c140640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040cfcb0 con 0x7fcf04071900 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.611+0000 7fcf0c140640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040cff90 con 0x7fcf040aedf0 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.611+0000 7fcf0c140640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcf040d0270 con 0x7fcf041489a0 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.611+0000 7fcf096db640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcf04071900 0x7fcf0406fa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47128/0 (socket says 172.21.15.137:47128) 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.611+0000 7fcf096db640 1 -- 172.21.15.137:0/2179751353 learned_addr learned my addr 172.21.15.137:0/2179751353 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.612+0000 7fcf09edc640 1 --2- 172.21.15.137:0/2179751353 >> v2:172.21.15.170:3300/0 conn(0x7fcf041489a0 0x7fcf040ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.612+0000 7fcf08eda640 1 -- 172.21.15.137:0/2179751353 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65529203 0 0) 0x7fcf040cfcb0 con 0x7fcf04071900 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.612+0000 7fcf08eda640 1 -- 172.21.15.137:0/2179751353 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcef0003520 con 0x7fcf04071900 2024-04-26T22:02:24.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.612+0000 7fcf09edc640 1 -- 172.21.15.137:0/2179751353 >> v1:172.21.15.170:6789/0 conn(0x7fcf040aedf0 legacy=0x7fcf040d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.612+0000 7fcf09edc640 1 -- 172.21.15.137:0/2179751353 >> v1:172.21.15.137:6789/0 conn(0x7fcf04071900 legacy=0x7fcf0406fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.612+0000 7fcf08eda640 1 -- 172.21.15.137:0/2179751353 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2809970208 0 0) 0x7fcef0003520 con 0x7fcf04071900 2024-04-26T22:02:24.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.612+0000 7fcf09edc640 1 -- 172.21.15.137:0/2179751353 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf040d0550 con 0x7fcf041489a0 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.613+0000 7fcf09edc640 1 --2- 172.21.15.137:0/2179751353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf041489a0 0x7fcf040ae8b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009d90 tx=0x7fcefc02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae3dbc89f555ddcf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.613+0000 7fcf08eda640 1 -- 172.21.15.137:0/2179751353 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4001670 con 0x7fcf041489a0 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.613+0000 7fcf08eda640 1 -- 172.21.15.137:0/2179751353 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcefc007540 con 0x7fcf041489a0 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.613+0000 7fcf08eda640 1 -- 172.21.15.137:0/2179751353 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcefc007910 con 0x7fcf041489a0 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.613+0000 7fcf0c140640 1 -- 172.21.15.137:0/2179751353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf041489a0 msgr2=0x7fcf040ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.613+0000 7fcf0c140640 1 --2- 172.21.15.137:0/2179751353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf041489a0 0x7fcf040ae8b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009d90 tx=0x7fcefc02a680 comp rx=0 tx=0).stop 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.613+0000 7fcf0c140640 1 -- 172.21.15.137:0/2179751353 shutdown_connections 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.613+0000 7fcf0c140640 1 --2- 172.21.15.137:0/2179751353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf041489a0 0x7fcf040ae8b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.613+0000 7fcf0c140640 1 -- 172.21.15.137:0/2179751353 >> 172.21.15.137:0/2179751353 conn(0x7fcf040d1e30 msgr2=0x7fcf040d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:24.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.614+0000 7fcf0c140640 1 -- 172.21.15.137:0/2179751353 shutdown_connections 2024-04-26T22:02:24.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.614+0000 7fcf0c140640 1 -- 172.21.15.137:0/2179751353 wait complete. 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.615+0000 7fcf0c140640 1 Processor -- start 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.615+0000 7fcf0c140640 1 -- start start 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.615+0000 7fcf0c140640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf040aedf0 0x7fcf041eab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.615+0000 7fcf0c140640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf041489a0 0x7fcf0413e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.615+0000 7fcf0c140640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf0414b760 0x7fcf0413e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.615+0000 7fcf0c140640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf04070140 con 0x7fcf0414b760 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.615+0000 7fcf0c140640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf04148d80 con 0x7fcf041489a0 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.615+0000 7fcf0c140640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcf040702c0 con 0x7fcf040aedf0 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0a6dd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf0414b760 0x7fcf0413e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0a6dd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf0414b760 0x7fcf0413e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44678/0 (socket says 172.21.15.137:44678) 2024-04-26T22:02:24.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0a6dd640 1 -- 172.21.15.137:0/1884232151 learned_addr learned my addr 172.21.15.137:0/1884232151 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf09edc640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf040aedf0 0x7fcf041eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf096db640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf041489a0 0x7fcf0413e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0a6dd640 1 -- 172.21.15.137:0/1884232151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf040aedf0 msgr2=0x7fcf041eab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0a6dd640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf040aedf0 0x7fcf041eab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0a6dd640 1 -- 172.21.15.137:0/1884232151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf041489a0 msgr2=0x7fcf0413e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0a6dd640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf041489a0 0x7fcf0413e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0a6dd640 1 -- 172.21.15.137:0/1884232151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf040b15f0 con 0x7fcf0414b760 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0a6dd640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf0414b760 0x7fcf0413e9a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcf00001eb0 tx=0x7fcf0000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcefa7fc640 1 -- 172.21.15.137:0/1884232151 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00017070 con 0x7fcf0414b760 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcefa7fc640 1 -- 172.21.15.137:0/1884232151 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf000052d0 con 0x7fcf0414b760 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf04145490 con 0x7fcf0414b760 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcefa7fc640 1 -- 172.21.15.137:0/1884232151 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00003810 con 0x7fcf0414b760 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.616+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf040b1b70 con 0x7fcf0414b760 2024-04-26T22:02:24.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.617+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf040693d0 con 0x7fcf0414b760 2024-04-26T22:02:24.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.618+0000 7fcefa7fc640 1 -- 172.21.15.137:0/1884232151 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf0001a070 con 0x7fcf0414b760 2024-04-26T22:02:24.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.618+0000 7fcefa7fc640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcee806c8f0 0x7fcee806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.618+0000 7fcf09edc640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcee806c8f0 0x7fcee806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.618+0000 7fcefa7fc640 1 -- 172.21.15.137:0/1884232151 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fcf0008ad70 con 0x7fcf0414b760 2024-04-26T22:02:24.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.619+0000 7fcf09edc640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcee806c8f0 0x7fcee806edb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcefc034000 tx=0x7fcefc02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:24.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.623+0000 7fcefa7fc640 1 -- 172.21.15.137:0/1884232151 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcf00058be0 con 0x7fcf0414b760 2024-04-26T22:02:24.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.797+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf040d2cf0 con 0x7fcf0414b760 2024-04-26T22:02:24.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.798+0000 7fcefa7fc640 1 -- 172.21.15.137:0/1884232151 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16677 (secure 0 0 0) 0x7fcf0005cee0 con 0x7fcf0414b760 2024-04-26T22:02:24.799 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:24.799 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:01:12.541348+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:01:09.101906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T22:01:09.837941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcee806c8f0 msgr2=0x7fcee806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcee806c8f0 0x7fcee806edb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fcefc034000 tx=0x7fcefc02f000 comp rx=0 tx=0).stop 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf0414b760 msgr2=0x7fcf0413e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf0414b760 0x7fcf0413e9a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fcf00001eb0 tx=0x7fcf0000c890 comp rx=0 tx=0).stop 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 shutdown_connections 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcee806c8f0 0x7fcee806edb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf0414b760 0x7fcf0413e9a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf041489a0 0x7fcf0413e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 --2- 172.21.15.137:0/1884232151 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf040aedf0 0x7fcf041eab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 >> 172.21.15.137:0/1884232151 conn(0x7fcf040d1e30 msgr2=0x7fcf040b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 shutdown_connections 2024-04-26T22:02:24.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.800+0000 7fcf0c140640 1 -- 172.21.15.137:0/1884232151 wait complete. 2024-04-26T22:02:24.812 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:02:24.812 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:24.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.908+0000 7fda237c6640 1 Processor -- start 2024-04-26T22:02:24.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.908+0000 7fda237c6640 1 -- start start 2024-04-26T22:02:24.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda237c6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda1c06d9c0 0x7fda1c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda237c6640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1c15d510 con 0x7fda1c0733c0 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda237c6640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1c0d12c0 con 0x7fda1c15d130 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda237c6640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fda1c0b0e80 con 0x7fda1c06d9c0 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda20d61640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda1c06d9c0 0x7fda1c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda21d63640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fda1c0733c0 0x7fda1c0b4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47132/0 (socket says 172.21.15.137:47132) 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda20d61640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fda1c06d9c0 0x7fda1c0b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44688/0 (socket says 172.21.15.137:44688) 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda21d63640 1 -- 172.21.15.137:0/1249373653 learned_addr learned my addr 172.21.15.137:0/1249373653 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda20d61640 1 -- 172.21.15.137:0/1249373653 >> v1:172.21.15.170:6789/0 conn(0x7fda1c15d130 legacy=0x7fda1c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda20d61640 1 -- 172.21.15.137:0/1249373653 >> v1:172.21.15.137:6789/0 conn(0x7fda1c0733c0 legacy=0x7fda1c0b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda13fff640 1 -- 172.21.15.137:0/1249373653 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450314084 0 0) 0x7fda1c15d510 con 0x7fda1c0733c0 2024-04-26T22:02:24.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.909+0000 7fda20d61640 1 -- 172.21.15.137:0/1249373653 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c0d0220 con 0x7fda1c06d9c0 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.910+0000 7fda20d61640 1 --2- 172.21.15.137:0/1249373653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 0x7fda1c0b44e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097a0 tx=0x7fda0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d95b5e989824f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.910+0000 7fda13fff640 1 -- 172.21.15.137:0/1249373653 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c037070 con 0x7fda1c06d9c0 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.910+0000 7fda13fff640 1 -- 172.21.15.137:0/1249373653 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c032440 con 0x7fda1c06d9c0 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.910+0000 7fda13fff640 1 -- 172.21.15.137:0/1249373653 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c032810 con 0x7fda1c06d9c0 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.911+0000 7fda237c6640 1 -- 172.21.15.137:0/1249373653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 msgr2=0x7fda1c0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.911+0000 7fda237c6640 1 --2- 172.21.15.137:0/1249373653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 0x7fda1c0b44e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0097a0 tx=0x7fda0c02a1e0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.911+0000 7fda237c6640 1 -- 172.21.15.137:0/1249373653 shutdown_connections 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.911+0000 7fda237c6640 1 --2- 172.21.15.137:0/1249373653 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 0x7fda1c0b44e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.911+0000 7fda237c6640 1 -- 172.21.15.137:0/1249373653 >> 172.21.15.137:0/1249373653 conn(0x7fda1c0728a0 msgr2=0x7fda1c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.911+0000 7fda237c6640 1 -- 172.21.15.137:0/1249373653 shutdown_connections 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.911+0000 7fda237c6640 1 -- 172.21.15.137:0/1249373653 wait complete. 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.912+0000 7fda237c6640 1 Processor -- start 2024-04-26T22:02:24.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.912+0000 7fda237c6640 1 -- start start 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda237c6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 0x7fda1c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda237c6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda1c0733c0 0x7fda1c148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda237c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c15d130 0x7fda1c06f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda237c6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c0d0ac0 con 0x7fda1c06d9c0 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda237c6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fda1c0d07e0 con 0x7fda1c15d130 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda237c6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fda1c0d0da0 con 0x7fda1c0733c0 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda21562640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 0x7fda1c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda21562640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 0x7fda1c15d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44696/0 (socket says 172.21.15.137:44696) 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda21562640 1 -- 172.21.15.137:0/82841616 learned_addr learned my addr 172.21.15.137:0/82841616 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda21562640 1 -- 172.21.15.137:0/82841616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda1c0733c0 msgr2=0x7fda1c148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda21562640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda1c0733c0 0x7fda1c148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda21562640 1 -- 172.21.15.137:0/82841616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c15d130 msgr2=0x7fda1c06f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda21562640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c15d130 0x7fda1c06f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:24.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda21562640 1 -- 172.21.15.137:0/82841616 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1c0707b0 con 0x7fda1c06d9c0 2024-04-26T22:02:24.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda21562640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 0x7fda1c15d710 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c7f0 tx=0x7fda1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:24.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda11ffb640 1 -- 172.21.15.137:0/82841616 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18016020 con 0x7fda1c06d9c0 2024-04-26T22:02:24.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda11ffb640 1 -- 172.21.15.137:0/82841616 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1800aa50 con 0x7fda1c06d9c0 2024-04-26T22:02:24.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1c0704d0 con 0x7fda1c06d9c0 2024-04-26T22:02:24.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.913+0000 7fda11ffb640 1 -- 172.21.15.137:0/82841616 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1800ae40 con 0x7fda1c06d9c0 2024-04-26T22:02:24.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.914+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda1c0aecc0 con 0x7fda1c06d9c0 2024-04-26T22:02:24.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.915+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda1c06a290 con 0x7fda1c06d9c0 2024-04-26T22:02:24.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.915+0000 7fda11ffb640 1 -- 172.21.15.137:0/82841616 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda18019020 con 0x7fda1c06d9c0 2024-04-26T22:02:24.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.915+0000 7fda11ffb640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda0006c8f0 0x7fda0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:24.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.915+0000 7fda20d61640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda0006c8f0 0x7fda0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:24.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.916+0000 7fda11ffb640 1 -- 172.21.15.137:0/82841616 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fda1808b800 con 0x7fda1c06d9c0 2024-04-26T22:02:24.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.916+0000 7fda20d61640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda0006c8f0 0x7fda0006edb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fda0c034000 tx=0x7fda0c02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:24.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:24.920+0000 7fda11ffb640 1 -- 172.21.15.137:0/82841616 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fda18020070 con 0x7fda1c06d9c0 2024-04-26T22:02:25.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.133+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda1c068700 con 0x7fda1c06d9c0 2024-04-26T22:02:25.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.133+0000 7fda11ffb640 1 -- 172.21.15.137:0/82841616 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5194 (secure 0 0 0) 0x7fda18059cc0 con 0x7fda1c06d9c0 2024-04-26T22:02:25.133 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:25.134 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:01:10.893739+0000","modified":"2024-04-26T22:01:51.570195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.137:6837/4265926631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":4265926631},{"type":"v1","addr":"172.21.15.137:6837","nonce":4265926631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6060,"qdb_cluster":[6060]},"id":4}]} 2024-04-26T22:02:25.134 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 28 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda0006c8f0 msgr2=0x7fda0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda0006c8f0 0x7fda0006edb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fda0c034000 tx=0x7fda0c02c000 comp rx=0 tx=0).stop 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 msgr2=0x7fda1c15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 0x7fda1c15d710 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c7f0 tx=0x7fda1800ccb0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 shutdown_connections 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda0006c8f0 0x7fda0006edb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda1c15d130 0x7fda1c06f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fda1c0733c0 0x7fda1c148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 --2- 172.21.15.137:0/82841616 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fda1c06d9c0 0x7fda1c15d710 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 >> 172.21.15.137:0/82841616 conn(0x7fda1c0728a0 msgr2=0x7fda1c160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.135+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 shutdown_connections 2024-04-26T22:02:25.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.136+0000 7fda237c6640 1 -- 172.21.15.137:0/82841616 wait complete. 2024-04-26T22:02:25.146 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:25.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.243+0000 7f2c0c7ec640 1 Processor -- start 2024-04-26T22:02:25.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.243+0000 7f2c0c7ec640 1 -- start start 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c0c7ec640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2c04148a30 0x7f2c04073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c0c7ec640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c04160640 0x7f2c041636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c0c7ec640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c040cfa80 con 0x7f2c04163be0 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c0c7ec640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2c040cfd60 con 0x7f2c04160640 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c0c7ec640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2c040d0040 con 0x7f2c04148a30 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c09d87640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c04160640 0x7f2c041636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c09d87640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c04160640 0x7f2c041636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44698/0 (socket says 172.21.15.137:44698) 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c0ad89640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2c04163be0 0x7f2c040b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47148/0 (socket says 172.21.15.137:47148) 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c09d87640 1 -- 172.21.15.137:0/3223652180 learned_addr learned my addr 172.21.15.137:0/3223652180 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c0a588640 1 --2- 172.21.15.137:0/3223652180 >> v2:172.21.15.170:3300/0 conn(0x7f2c04148a30 0x7f2c04073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c09d87640 1 -- 172.21.15.137:0/3223652180 >> v2:172.21.15.170:3300/0 conn(0x7f2c04148a30 msgr2=0x7f2c04073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:25.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c09d87640 1 --2- 172.21.15.137:0/3223652180 >> v2:172.21.15.170:3300/0 conn(0x7f2c04148a30 0x7f2c04073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c09d87640 1 -- 172.21.15.137:0/3223652180 >> v1:172.21.15.137:6789/0 conn(0x7f2c04163be0 legacy=0x7f2c040b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c09d87640 1 -- 172.21.15.137:0/3223652180 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c04162ea0 con 0x7f2c04160640 2024-04-26T22:02:25.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.244+0000 7f2c09586640 1 -- 172.21.15.137:0/3223652180 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017238949 0 0) 0x7f2c040cfa80 con 0x7f2c04163be0 2024-04-26T22:02:25.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.245+0000 7f2c09d87640 1 --2- 172.21.15.137:0/3223652180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 0x7f2c041636a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2c040cf6d0 tx=0x7f2bf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c49fb86a95f3c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:25.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.245+0000 7f2c09586640 1 -- 172.21.15.137:0/3223652180 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4037070 con 0x7f2c04160640 2024-04-26T22:02:25.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.245+0000 7f2c09586640 1 -- 172.21.15.137:0/3223652180 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf4032440 con 0x7f2c04160640 2024-04-26T22:02:25.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.245+0000 7f2c09586640 1 -- 172.21.15.137:0/3223652180 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4032810 con 0x7f2c04160640 2024-04-26T22:02:25.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.245+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3223652180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 msgr2=0x7f2c041636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.245+0000 7f2c0c7ec640 1 --2- 172.21.15.137:0/3223652180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 0x7f2c041636a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2c040cf6d0 tx=0x7f2bf402a1e0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.246+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3223652180 shutdown_connections 2024-04-26T22:02:25.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.246+0000 7f2c0c7ec640 1 --2- 172.21.15.137:0/3223652180 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 0x7f2c041636a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.246+0000 7f2c0c7ec640 1 --2- 172.21.15.137:0/3223652180 >> v2:172.21.15.170:3300/0 conn(0x7f2c04148a30 0x7f2c04073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.246+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3223652180 >> 172.21.15.137:0/3223652180 conn(0x7f2c040ce8b0 msgr2=0x7f2c040cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.246+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3223652180 shutdown_connections 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.246+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3223652180 wait complete. 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.247+0000 7f2c0c7ec640 1 Processor -- start 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.247+0000 7f2c0c7ec640 1 -- start start 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.247+0000 7f2c0c7ec640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c04148a30 0x7f2c040c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.247+0000 7f2c0c7ec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 0x7f2c040afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.247+0000 7f2c0c7ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c04163be0 0x7f2c040b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.247+0000 7f2c0c7ec640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c04074590 con 0x7f2c04160640 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.247+0000 7f2c0c7ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2c04074410 con 0x7f2c04163be0 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.247+0000 7f2c0c7ec640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2c04148e10 con 0x7f2c04148a30 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c09d87640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 0x7f2c040afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c09d87640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 0x7f2c040afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44700/0 (socket says 172.21.15.137:44700) 2024-04-26T22:02:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c09d87640 1 -- 172.21.15.137:0/3344851880 learned_addr learned my addr 172.21.15.137:0/3344851880 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c0a588640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c04148a30 0x7f2c040c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c0ad89640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c04163be0 0x7f2c040b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c09d87640 1 -- 172.21.15.137:0/3344851880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c04148a30 msgr2=0x7f2c040c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c09d87640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c04148a30 0x7f2c040c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c09d87640 1 -- 172.21.15.137:0/3344851880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c04163be0 msgr2=0x7f2c040b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c09d87640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c04163be0 0x7f2c040b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c09d87640 1 -- 172.21.15.137:0/3344851880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c040b5790 con 0x7f2c04160640 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c0ad89640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c04163be0 0x7f2c040b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c09d87640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 0x7f2c040afea0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2bf402a220 tx=0x7f2bf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2bfaffd640 1 -- 172.21.15.137:0/3344851880 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4037040 con 0x7f2c04160640 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2bfaffd640 1 -- 172.21.15.137:0/3344851880 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf4042070 con 0x7f2c04160640 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c040b5a70 con 0x7f2c04160640 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2bfaffd640 1 -- 172.21.15.137:0/3344851880 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4030880 con 0x7f2c04160640 2024-04-26T22:02:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.248+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c040b6030 con 0x7f2c04160640 2024-04-26T22:02:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.249+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c040693d0 con 0x7f2c04160640 2024-04-26T22:02:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.250+0000 7f2bfaffd640 1 -- 172.21.15.137:0/3344851880 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2bf4030a20 con 0x7f2c04160640 2024-04-26T22:02:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.250+0000 7f2bfaffd640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2be806c8f0 0x7f2be806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.250+0000 7f2bfaffd640 1 -- 172.21.15.137:0/3344851880 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f2bf40ac350 con 0x7f2c04160640 2024-04-26T22:02:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.250+0000 7f2c0a588640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2be806c8f0 0x7f2be806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.250+0000 7f2c0a588640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2be806c8f0 0x7f2be806edb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009aa0 tx=0x7f2c00009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:25.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.254+0000 7f2bfaffd640 1 -- 172.21.15.137:0/3344851880 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2c040693d0 con 0x7f2c04160640 2024-04-26T22:02:25.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.467+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c040739f0 con 0x7f2c04160640 2024-04-26T22:02:25.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.467+0000 7f2bfaffd640 1 -- 172.21.15.137:0/3344851880 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5194 (secure 0 0 0) 0x7f2bf407a780 con 0x7f2c04160640 2024-04-26T22:02:25.467 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:25.468 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":28,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:01:10.893739+0000","modified":"2024-04-26T22:01:51.570195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6060":{"gid":6060,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":13,"addr":"172.21.15.137:6837/4265926631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":4265926631},{"type":"v1","addr":"172.21.15.137:6837","nonce":4265926631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6060,"qdb_cluster":[6060]},"id":4}]} 2024-04-26T22:02:25.468 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 28 2024-04-26T22:02:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2be806c8f0 msgr2=0x7f2be806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2be806c8f0 0x7f2be806edb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009aa0 tx=0x7f2c00009190 comp rx=0 tx=0).stop 2024-04-26T22:02:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 msgr2=0x7f2c040afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 0x7f2c040afea0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2bf402a220 tx=0x7f2bf40046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 shutdown_connections 2024-04-26T22:02:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2be806c8f0 0x7f2be806edb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c04160640 0x7f2c040afea0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c04163be0 0x7f2c040b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 --2- 172.21.15.137:0/3344851880 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c04148a30 0x7f2c040c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 >> 172.21.15.137:0/3344851880 conn(0x7f2c040ce8b0 msgr2=0x7f2c040cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:25.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.469+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 shutdown_connections 2024-04-26T22:02:25.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.470+0000 7f2c0c7ec640 1 -- 172.21.15.137:0/3344851880 wait complete. 2024-04-26T22:02:25.480 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:25.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.577+0000 7fbd6ff78640 1 Processor -- start 2024-04-26T22:02:25.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.577+0000 7fbd6ff78640 1 -- start start 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6ff78640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbd6815f370 0x7fbd680cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6ff78640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbd6815f750 0x7fbd680b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6ff78640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd680d03a0 con 0x7fbd680d37d0 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6ff78640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbd680b4d10 con 0x7fbd6815f370 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6ff78640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbd680d0680 con 0x7fbd6815f750 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6dd14640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbd6815f370 0x7fbd680cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6e515640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbd680d37d0 0x7fbd680d1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52756/0 (socket says 172.21.15.137:52756) 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6e515640 1 -- 172.21.15.137:0/1449751060 learned_addr learned my addr 172.21.15.137:0/1449751060 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6d513640 1 --2- 172.21.15.137:0/1449751060 >> v2:172.21.15.170:3300/0 conn(0x7fbd6815f750 0x7fbd680b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6dd14640 1 -- 172.21.15.137:0/1449751060 >> v2:172.21.15.170:3300/0 conn(0x7fbd6815f750 msgr2=0x7fbd680b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:25.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6dd14640 1 --2- 172.21.15.137:0/1449751060 >> v2:172.21.15.170:3300/0 conn(0x7fbd6815f750 0x7fbd680b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6dd14640 1 -- 172.21.15.137:0/1449751060 >> v1:172.21.15.137:6789/0 conn(0x7fbd680d37d0 legacy=0x7fbd680d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6dd14640 1 -- 172.21.15.137:0/1449751060 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd680d0960 con 0x7fbd6815f370 2024-04-26T22:02:25.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.578+0000 7fbd6cd12640 1 -- 172.21.15.137:0/1449751060 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772771850 0 0) 0x7fbd680d03a0 con 0x7fbd680d37d0 2024-04-26T22:02:25.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.579+0000 7fbd6dd14640 1 --2- 172.21.15.137:0/1449751060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f370 0x7fbd680cfd70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbd680d02b0 tx=0x7fbd6402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6c2a4106e6473a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:25.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.579+0000 7fbd6cd12640 1 -- 172.21.15.137:0/1449751060 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64037070 con 0x7fbd6815f370 2024-04-26T22:02:25.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.579+0000 7fbd6cd12640 1 -- 172.21.15.137:0/1449751060 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd64032440 con 0x7fbd6815f370 2024-04-26T22:02:25.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.579+0000 7fbd6cd12640 1 -- 172.21.15.137:0/1449751060 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64032810 con 0x7fbd6815f370 2024-04-26T22:02:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.579+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1449751060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f370 msgr2=0x7fbd680cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.579+0000 7fbd6ff78640 1 --2- 172.21.15.137:0/1449751060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f370 0x7fbd680cfd70 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbd680d02b0 tx=0x7fbd6402a1a0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.580+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1449751060 shutdown_connections 2024-04-26T22:02:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.580+0000 7fbd6ff78640 1 --2- 172.21.15.137:0/1449751060 >> v2:172.21.15.170:3300/0 conn(0x7fbd6815f750 0x7fbd680b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.580+0000 7fbd6ff78640 1 --2- 172.21.15.137:0/1449751060 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f370 0x7fbd680cfd70 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.580+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1449751060 >> 172.21.15.137:0/1449751060 conn(0x7fbd6808ec10 msgr2=0x7fbd6809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.580+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1449751060 shutdown_connections 2024-04-26T22:02:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.580+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1449751060 wait complete. 2024-04-26T22:02:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.581+0000 7fbd6ff78640 1 Processor -- start 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.581+0000 7fbd6ff78640 1 -- start start 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.581+0000 7fbd6ff78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd680d37d0 0x7fbd6815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.581+0000 7fbd6ff78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd6815f370 0x7fbd68162460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.581+0000 7fbd6ff78640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f750 0x7fbd6815c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.581+0000 7fbd6ff78640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbd680b61d0 con 0x7fbd6815f750 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.581+0000 7fbd6ff78640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbd680d0f20 con 0x7fbd6815f370 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.581+0000 7fbd6ff78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbd680b6350 con 0x7fbd680d37d0 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6e515640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f750 0x7fbd6815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6e515640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f750 0x7fbd6815c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43846/0 (socket says 172.21.15.137:43846) 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6e515640 1 -- 172.21.15.137:0/1035586211 learned_addr learned my addr 172.21.15.137:0/1035586211 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6d513640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd6815f370 0x7fbd68162460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6dd14640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd680d37d0 0x7fbd6815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6e515640 1 -- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd680d37d0 msgr2=0x7fbd6815a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6e515640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd680d37d0 0x7fbd6815a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6e515640 1 -- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd6815f370 msgr2=0x7fbd68162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6e515640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd6815f370 0x7fbd68162460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6e515640 1 -- 172.21.15.137:0/1035586211 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd68161540 con 0x7fbd6815f750 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6d513640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd6815f370 0x7fbd68162460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6dd14640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd680d37d0 0x7fbd6815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6e515640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f750 0x7fbd6815c130 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000c700 tx=0x7fbd6000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd5e7fc640 1 -- 172.21.15.137:0/1035586211 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60018070 con 0x7fbd6815f750 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd5e7fc640 1 -- 172.21.15.137:0/1035586211 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6000ce10 con 0x7fbd6815f750 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd5e7fc640 1 -- 172.21.15.137:0/1035586211 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6000a860 con 0x7fbd6815f750 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd681617e0 con 0x7fbd6815f750 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.582+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6815a5a0 con 0x7fbd6815f750 2024-04-26T22:02:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.583+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd680c8d20 con 0x7fbd6815f750 2024-04-26T22:02:25.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.584+0000 7fbd5e7fc640 1 -- 172.21.15.137:0/1035586211 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbd6001b070 con 0x7fbd6815f750 2024-04-26T22:02:25.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.584+0000 7fbd5e7fc640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd4c06c8f0 0x7fbd4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.584+0000 7fbd5e7fc640 1 -- 172.21.15.137:0/1035586211 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fbd6008b150 con 0x7fbd6815f750 2024-04-26T22:02:25.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.584+0000 7fbd6dd14640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd4c06c8f0 0x7fbd4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.584+0000 7fbd6dd14640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd4c06c8f0 0x7fbd4c06edb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd64034000 tx=0x7fbd6402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:25.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.588+0000 7fbd5e7fc640 1 -- 172.21.15.137:0/1035586211 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbd60059580 con 0x7fbd6815f750 2024-04-26T22:02:25.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.764+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd6806a290 con 0x7fbd6815f750 2024-04-26T22:02:25.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.765+0000 7fbd5e7fc640 1 -- 172.21.15.137:0/1035586211 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16677 (secure 0 0 0) 0x7fbd60058e80 con 0x7fbd6815f750 2024-04-26T22:02:25.766 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:25.766 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:01:12.541348+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:01:09.101906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-26T22:01:09.837941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:25.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd4c06c8f0 msgr2=0x7fbd4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd4c06c8f0 0x7fbd4c06edb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fbd64034000 tx=0x7fbd6402e000 comp rx=0 tx=0).stop 2024-04-26T22:02:25.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f750 msgr2=0x7fbd6815c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f750 0x7fbd6815c130 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000c700 tx=0x7fbd6000cbc0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 shutdown_connections 2024-04-26T22:02:25.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbd4c06c8f0 0x7fbd4c06edb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbd6815f750 0x7fbd6815c130 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd6815f370 0x7fbd68162460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 --2- 172.21.15.137:0/1035586211 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbd680d37d0 0x7fbd6815a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 >> 172.21.15.137:0/1035586211 conn(0x7fbd6808ec10 msgr2=0x7fbd6806dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:25.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 shutdown_connections 2024-04-26T22:02:25.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.768+0000 7fbd6ff78640 1 -- 172.21.15.137:0/1035586211 wait complete. 2024-04-26T22:02:25.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:02:25.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.877+0000 7f309f6b8640 1 Processor -- start 2024-04-26T22:02:25.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.878+0000 7f309f6b8640 1 -- start start 2024-04-26T22:02:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.878+0000 7f309f6b8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30980b61a0 0x7f3098160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.878+0000 7f309f6b8640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30980b4530 con 0x7f3098145980 2024-04-26T22:02:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f309f6b8640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30980b4810 con 0x7f30980b3de0 2024-04-26T22:02:25.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f309f6b8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f30980b5140 con 0x7f30980b61a0 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f309d454640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3098145980 0x7f30980b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52760/0 (socket says 172.21.15.137:52760) 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f309d454640 1 -- 172.21.15.137:0/2910551906 learned_addr learned my addr 172.21.15.137:0/2910551906 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f309cc53640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30980b61a0 0x7f3098160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765277129 0 0) 0x7f30980b4530 con 0x7f3098145980 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3084003520 con 0x7f3098145980 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 991758252 0 0) 0x7f3084003520 con 0x7f3098145980 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30980b61a0 msgr2=0x7f3098160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30980b61a0 0x7f3098160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 >> v1:172.21.15.170:6789/0 conn(0x7f30980b3de0 legacy=0x7f30980720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30980b4af0 con 0x7f3098145980 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f3094001670 con 0x7f3098145980 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 >> v1:172.21.15.137:6789/0 conn(0x7f3098145980 legacy=0x7f30980b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30840039e0 0x7f3084003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30980b61a0 0x7f3084004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f30840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f30980b5140 con 0x7f3084004d40 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f308400ba70 con 0x7f30840039e0 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f308400bc70 con 0x7f30980b61a0 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f309dc55640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f30840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f309cc53640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30980b61a0 0x7f3084004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.879+0000 7f309d454640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30840039e0 0x7f3084003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.880+0000 7f309dc55640 1 -- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30980b61a0 msgr2=0x7f3084004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.880+0000 7f309dc55640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30980b61a0 0x7f3084004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.880+0000 7f309dc55640 1 -- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30840039e0 msgr2=0x7f3084003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.880+0000 7f309dc55640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30840039e0 0x7f3084003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.880+0000 7f309dc55640 1 -- 172.21.15.137:0/2910551906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3084003520 con 0x7f3084004d40 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.880+0000 7f309dc55640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f30840051c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3090001af0 tx=0x7f3084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e77f7f1f29945a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.880+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090001b30 con 0x7f3084004d40 2024-04-26T22:02:25.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.880+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3090033620 con 0x7f3084004d40 2024-04-26T22:02:25.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.880+0000 7f308ffff640 1 -- 172.21.15.137:0/2910551906 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090033a10 con 0x7f3084004d40 2024-04-26T22:02:25.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.881+0000 7f309f6b8640 1 -- 172.21.15.137:0/2910551906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 msgr2=0x7f30840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.881+0000 7f309f6b8640 1 --2- 172.21.15.137:0/2910551906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f30840051c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3090001af0 tx=0x7f3084005830 comp rx=0 tx=0).stop 2024-04-26T22:02:25.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.881+0000 7f309dc55640 1 -- 172.21.15.137:0/2910551906 reap_dead start 2024-04-26T22:02:25.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.881+0000 7f309f6b8640 1 -- 172.21.15.137:0/2910551906 shutdown_connections 2024-04-26T22:02:25.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.881+0000 7f309f6b8640 1 -- 172.21.15.137:0/2910551906 >> 172.21.15.137:0/2910551906 conn(0x7f30980d0d30 msgr2=0x7f30980d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:25.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.881+0000 7f309f6b8640 1 -- 172.21.15.137:0/2910551906 shutdown_connections 2024-04-26T22:02:25.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.881+0000 7f309f6b8640 1 -- 172.21.15.137:0/2910551906 wait complete. 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.882+0000 7f309f6b8640 1 Processor -- start 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.882+0000 7f309f6b8640 1 -- start start 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309f6b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f3098138e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309f6b8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30981f0e90 0x7f3098143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309f6b8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098144210 0x7f3098139520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309f6b8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3098160630 con 0x7f3084004d40 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309f6b8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f30980b4240 con 0x7f30981f0e90 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309f6b8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f30981607b0 con 0x7f3098144210 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309d454640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f3098138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309d454640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f3098138e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43856/0 (socket says 172.21.15.137:43856) 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309d454640 1 -- 172.21.15.137:0/2405232265 learned_addr learned my addr 172.21.15.137:0/2405232265 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:25.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309dc55640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098144210 0x7f3098139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309cc53640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30981f0e90 0x7f3098143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309d454640 1 -- 172.21.15.137:0/2405232265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098144210 msgr2=0x7f3098139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309d454640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098144210 0x7f3098139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309d454640 1 -- 172.21.15.137:0/2405232265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30981f0e90 msgr2=0x7f3098143cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309d454640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30981f0e90 0x7f3098143cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.883+0000 7f309d454640 1 -- 172.21.15.137:0/2405232265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30980b1760 con 0x7f3084004d40 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.884+0000 7f309d454640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f3098138e00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3094007340 tx=0x7f3094007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.884+0000 7f308dffb640 1 -- 172.21.15.137:0/2405232265 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309400f860 con 0x7f3084004d40 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.884+0000 7f308dffb640 1 -- 172.21.15.137:0/2405232265 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3094018070 con 0x7f3084004d40 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.884+0000 7f308dffb640 1 -- 172.21.15.137:0/2405232265 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309400fc80 con 0x7f3084004d40 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.884+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30980b1a40 con 0x7f3084004d40 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.884+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30981f1310 con 0x7f3084004d40 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.885+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309806a290 con 0x7f3084004d40 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.885+0000 7f308dffb640 1 -- 172.21.15.137:0/2405232265 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f309401d460 con 0x7f3084004d40 2024-04-26T22:02:25.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.886+0000 7f308dffb640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c920 0x7f307c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:25.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.886+0000 7f308dffb640 1 -- 172.21.15.137:0/2405232265 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f309408bab0 con 0x7f3084004d40 2024-04-26T22:02:25.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.886+0000 7f309cc53640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c920 0x7f307c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:25.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.886+0000 7f309cc53640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c920 0x7f307c06ede0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f30980b3480 tx=0x7f3088008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:25.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:25.890+0000 7f308dffb640 1 -- 172.21.15.137:0/2405232265 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3094059f70 con 0x7f3084004d40 2024-04-26T22:02:26.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.105+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3098073cc0 con 0x7f3084004d40 2024-04-26T22:02:26.105 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:02:26.106+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:02:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.109+0000 7f308dffb640 1 -- 172.21.15.137:0/2405232265 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f3094059870 con 0x7f3084004d40 2024-04-26T22:02:26.109 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:02:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c920 msgr2=0x7f307c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c920 0x7f307c06ede0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f30980b3480 tx=0x7f3088008040 comp rx=0 tx=0).stop 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 msgr2=0x7f3098138e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f3098138e00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3094007340 tx=0x7f3094007800 comp rx=0 tx=0).stop 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 shutdown_connections 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c920 0x7f307c06ede0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098144210 0x7f3098139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30981f0e90 0x7f3098143cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 --2- 172.21.15.137:0/2405232265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004d40 0x7f3098138e00 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 >> 172.21.15.137:0/2405232265 conn(0x7f30980d0d30 msgr2=0x7f30980cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 shutdown_connections 2024-04-26T22:02:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.111+0000 7f309f6b8640 1 -- 172.21.15.137:0/2405232265 wait complete. 2024-04-26T22:02:26.116 INFO:tasks.ceph.mds.a.smithi137.stderr: -7479> 2024-04-26T22:01:16.814+0000 7fa5f1d96640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:02:26.121 INFO:tasks.ceph.mds.a.smithi137.stderr: -4800> 2024-04-26T22:01:18.334+0000 7fa5edd8e640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={6213=0-4194304@1} caps={6213=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6213 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x558821c62680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T22:02:26.123 INFO:tasks.ceph.mds.a.smithi137.stderr: -3006> 2024-04-26T22:01:49.614+0000 7fa5edd8e640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={6213=0-4194304@1} caps={6213=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6213 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x558821c62680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T22:02:26.126 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:02:26.152 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:02:26.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.226+0000 7fabf7dda640 1 Processor -- start 2024-04-26T22:02:26.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.226+0000 7fabf7dda640 1 -- start start 2024-04-26T22:02:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.227+0000 7fabf7dda640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf006c9b0 0x7fabf006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.227+0000 7fabf7dda640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf0070b30 con 0x7fabf015f2b0 2024-04-26T22:02:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.227+0000 7fabf7dda640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf0070e10 con 0x7fabf00706a0 2024-04-26T22:02:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.227+0000 7fabf7dda640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fabf00af610 con 0x7fabf006c9b0 2024-04-26T22:02:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.227+0000 7fabf5b76640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fabf015f2b0 0x7fabf006c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52776/0 (socket says 172.21.15.137:52776) 2024-04-26T22:02:26.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.227+0000 7fabf5b76640 1 -- 172.21.15.137:0/3818379547 learned_addr learned my addr 172.21.15.137:0/3818379547 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf6377640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf006c9b0 0x7fabf006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3992641373 0 0) 0x7fabf0070b30 con 0x7fabf015f2b0 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabdc003520 con 0x7fabf015f2b0 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2241318001 0 0) 0x7fabdc003520 con 0x7fabf015f2b0 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf006c9b0 msgr2=0x7fabf006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf006c9b0 0x7fabf006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 >> v1:172.21.15.170:6789/0 conn(0x7fabf00706a0 legacy=0x7fabf00afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf00710f0 con 0x7fabf015f2b0 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fabe0001670 con 0x7fabf015f2b0 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 >> v1:172.21.15.137:6789/0 conn(0x7fabf015f2b0 legacy=0x7fabf006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabdc0039e0 0x7fabdc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf006c9b0 0x7fabdc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc004d40 0x7fabdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:26.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc00ba70 con 0x7fabdc004d40 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc00bc20 con 0x7fabdc0039e0 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc00be20 con 0x7fabf006c9b0 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf6377640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc004d40 0x7fabdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf5b76640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabdc0039e0 0x7fabdc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf5375640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf006c9b0 0x7fabdc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf6377640 1 -- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf006c9b0 msgr2=0x7fabdc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf6377640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf006c9b0 0x7fabdc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf6377640 1 -- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabdc0039e0 msgr2=0x7fabdc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf6377640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabdc0039e0 0x7fabdc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.228+0000 7fabf6377640 1 -- 172.21.15.137:0/3818379547 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc003520 con 0x7fabdc004d40 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.229+0000 7fabf6377640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc004d40 0x7fabdc0051c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fabf00b68a0 tx=0x7fabdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e56d9c7b6c931a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.229+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8037070 con 0x7fabdc004d40 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.229+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe802e050 con 0x7fabdc004d40 2024-04-26T22:02:26.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.229+0000 7fabf4b74640 1 -- 172.21.15.137:0/3818379547 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8009c10 con 0x7fabdc004d40 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.230+0000 7fabf7dda640 1 -- 172.21.15.137:0/3818379547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc004d40 msgr2=0x7fabdc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.230+0000 7fabf7dda640 1 --2- 172.21.15.137:0/3818379547 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabdc004d40 0x7fabdc0051c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fabf00b68a0 tx=0x7fabdc005830 comp rx=0 tx=0).stop 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.230+0000 7fabf6377640 1 -- 172.21.15.137:0/3818379547 reap_dead start 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.230+0000 7fabf7dda640 1 -- 172.21.15.137:0/3818379547 shutdown_connections 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.230+0000 7fabf7dda640 1 -- 172.21.15.137:0/3818379547 >> 172.21.15.137:0/3818379547 conn(0x7fabf006f050 msgr2=0x7fabf006f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.230+0000 7fabf7dda640 1 -- 172.21.15.137:0/3818379547 shutdown_connections 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.230+0000 7fabf7dda640 1 -- 172.21.15.137:0/3818379547 wait complete. 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.231+0000 7fabf7dda640 1 Processor -- start 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.231+0000 7fabf7dda640 1 -- start start 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf7dda640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0146a50 0x7fabf00b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf7dda640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf01f53a0 0x7fabf00b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:26.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf7dda640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0157630 0x7fabf0157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf7dda640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fabf00b1890 con 0x7fabf01f53a0 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf7dda640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fabf00b4f40 con 0x7fabf0157630 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf7dda640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fabf015f690 con 0x7fabf0146a50 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5375640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf01f53a0 0x7fabf00b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5375640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf01f53a0 0x7fabf00b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43896/0 (socket says 172.21.15.137:43896) 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5375640 1 -- 172.21.15.137:0/1732152056 learned_addr learned my addr 172.21.15.137:0/1732152056 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf6377640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0157630 0x7fabf0157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5b76640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0146a50 0x7fabf00b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5375640 1 -- 172.21.15.137:0/1732152056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0146a50 msgr2=0x7fabf00b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5375640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0146a50 0x7fabf00b2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5375640 1 -- 172.21.15.137:0/1732152056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0157630 msgr2=0x7fabf0157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5375640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0157630 0x7fabf0157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5375640 1 -- 172.21.15.137:0/1732152056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf01583f0 con 0x7fabf01f53a0 2024-04-26T22:02:26.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf6377640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0157630 0x7fabf0157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf5375640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf01f53a0 0x7fabf00b2fa0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fabec00f820 tx=0x7fabec00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabe67fc640 1 -- 172.21.15.137:0/1732152056 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec0050d0 con 0x7fabf01f53a0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabe67fc640 1 -- 172.21.15.137:0/1732152056 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabec018070 con 0x7fabf01f53a0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf0154930 con 0x7fabf01f53a0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabe67fc640 1 -- 172.21.15.137:0/1732152056 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec005490 con 0x7fabf01f53a0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.232+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf0154ef0 con 0x7fabf01f53a0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.233+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf006a290 con 0x7fabf01f53a0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.234+0000 7fabe67fc640 1 -- 172.21.15.137:0/1732152056 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabec00d730 con 0x7fabf01f53a0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.234+0000 7fabe67fc640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fabd406c8f0 0x7fabd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.234+0000 7fabf5b76640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fabd406c8f0 0x7fabd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.234+0000 7fabe67fc640 1 -- 172.21.15.137:0/1732152056 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7fabec08b9e0 con 0x7fabf01f53a0 2024-04-26T22:02:26.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.235+0000 7fabf5b76640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fabd406c8f0 0x7fabd406edb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fabe0004840 tx=0x7fabe0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:26.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.239+0000 7fabe67fc640 1 -- 172.21.15.137:0/1732152056 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fabec059e40 con 0x7fabf01f53a0 2024-04-26T22:02:26.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:26.456+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fabf015c640 con 0x7fabf01f53a0 2024-04-26T22:02:27.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.115+0000 7fabe67fc640 1 -- 172.21.15.137:0/1732152056 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7fabec059740 con 0x7fabf01f53a0 2024-04-26T22:02:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fabd406c8f0 msgr2=0x7fabd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fabd406c8f0 0x7fabd406edb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fabe0004840 tx=0x7fabe0009040 comp rx=0 tx=0).stop 2024-04-26T22:02:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf01f53a0 msgr2=0x7fabf00b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf01f53a0 0x7fabf00b2fa0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fabec00f820 tx=0x7fabec00fce0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 shutdown_connections 2024-04-26T22:02:27.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fabd406c8f0 0x7fabd406edb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fabf01f53a0 0x7fabf00b2fa0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf0157630 0x7fabf0157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 --2- 172.21.15.137:0/1732152056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fabf0146a50 0x7fabf00b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 >> 172.21.15.137:0/1732152056 conn(0x7fabf006f050 msgr2=0x7fabf0159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:27.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 shutdown_connections 2024-04-26T22:02:27.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.118+0000 7fabf7dda640 1 -- 172.21.15.137:0/1732152056 wait complete. 2024-04-26T22:02:27.130 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:02:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.274+0000 7f1e41940640 1 Processor -- start 2024-04-26T22:02:27.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.274+0000 7f1e41940640 1 -- start start 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.274+0000 7f1e41940640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1e3c0d2140 0x7f1e3c0d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e41940640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 0x7f1e3c0cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e41940640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3c0d33a0 con 0x7f1e3c162a10 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e41940640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1e3c0b4970 con 0x7f1e3c0d2140 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e41940640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3c0d3680 con 0x7f1e3c0b6020 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e3a7fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1e3c0d2140 0x7f1e3c0d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e3a7fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1e3c0d2140 0x7f1e3c0d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43908/0 (socket says 172.21.15.137:43908) 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e3a7fc640 1 -- 172.21.15.137:0/2362058104 learned_addr learned my addr 172.21.15.137:0/2362058104 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e3b7fe640 1 --2- 172.21.15.137:0/2362058104 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 0x7f1e3c0cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e3a7fc640 1 -- 172.21.15.137:0/2362058104 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 msgr2=0x7f1e3c0cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e3a7fc640 1 --2- 172.21.15.137:0/2362058104 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 0x7f1e3c0cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e3a7fc640 1 -- 172.21.15.137:0/2362058104 >> v1:172.21.15.170:6789/0 conn(0x7f1e3c162a10 legacy=0x7f1e3c0d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.275+0000 7f1e3a7fc640 1 -- 172.21.15.137:0/2362058104 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3c0d3960 con 0x7f1e3c0d2140 2024-04-26T22:02:27.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e3a7fc640 1 --2- 172.21.15.137:0/2362058104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c0d2140 0x7f1e3c0d2dc0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009870 tx=0x7f1e3002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5656f85d770130 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:27.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e39ffb640 1 -- 172.21.15.137:0/2362058104 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30037070 con 0x7f1e3c0d2140 2024-04-26T22:02:27.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e39ffb640 1 -- 172.21.15.137:0/2362058104 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e30032440 con 0x7f1e3c0d2140 2024-04-26T22:02:27.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e39ffb640 1 -- 172.21.15.137:0/2362058104 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30032810 con 0x7f1e3c0d2140 2024-04-26T22:02:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e41940640 1 -- 172.21.15.137:0/2362058104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c0d2140 msgr2=0x7f1e3c0d2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e41940640 1 --2- 172.21.15.137:0/2362058104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c0d2140 0x7f1e3c0d2dc0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009870 tx=0x7f1e3002a210 comp rx=0 tx=0).stop 2024-04-26T22:02:27.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e41940640 1 -- 172.21.15.137:0/2362058104 shutdown_connections 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e41940640 1 --2- 172.21.15.137:0/2362058104 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 0x7f1e3c0cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e41940640 1 --2- 172.21.15.137:0/2362058104 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c0d2140 0x7f1e3c0d2dc0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e41940640 1 -- 172.21.15.137:0/2362058104 >> 172.21.15.137:0/2362058104 conn(0x7f1e3c09e530 msgr2=0x7f1e3c0d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e41940640 1 -- 172.21.15.137:0/2362058104 shutdown_connections 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.276+0000 7f1e41940640 1 -- 172.21.15.137:0/2362058104 wait complete. 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.277+0000 7f1e41940640 1 Processor -- start 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e41940640 1 -- start start 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e41940640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 0x7f1e3c0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e41940640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c0d2140 0x7f1e3c15c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e41940640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c162a10 0x7f1e3c157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e41940640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c162df0 con 0x7f1e3c162a10 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e41940640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3c0d3f20 con 0x7f1e3c0d2140 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e41940640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3c0b6600 con 0x7f1e3c0b6020 2024-04-26T22:02:27.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e3b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c162a10 0x7f1e3c157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e3b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c162a10 0x7f1e3c157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43914/0 (socket says 172.21.15.137:43914) 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.278+0000 7f1e3b7fe640 1 -- 172.21.15.137:0/3064613896 learned_addr learned my addr 172.21.15.137:0/3064613896 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e3a7fc640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c0d2140 0x7f1e3c15c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e3affd640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 0x7f1e3c0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e3b7fe640 1 -- 172.21.15.137:0/3064613896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 msgr2=0x7f1e3c0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e3b7fe640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 0x7f1e3c0b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e3b7fe640 1 -- 172.21.15.137:0/3064613896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c0d2140 msgr2=0x7f1e3c15c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e3b7fe640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c0d2140 0x7f1e3c15c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e3b7fe640 1 -- 172.21.15.137:0/3064613896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3c0c9f70 con 0x7f1e3c162a10 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e3b7fe640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c162a10 0x7f1e3c157280 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400cc30 tx=0x7f1e3400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e23fff640 1 -- 172.21.15.137:0/3064613896 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3400ce40 con 0x7f1e3c162a10 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e23fff640 1 -- 172.21.15.137:0/3064613896 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e34003990 con 0x7f1e3c162a10 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e23fff640 1 -- 172.21.15.137:0/3064613896 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e34003d40 con 0x7f1e3c162a10 2024-04-26T22:02:27.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3c15b580 con 0x7f1e3c162a10 2024-04-26T22:02:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.279+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e3c15bb40 con 0x7f1e3c162a10 2024-04-26T22:02:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.280+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3c06a290 con 0x7f1e3c162a10 2024-04-26T22:02:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.280+0000 7f1e23fff640 1 -- 172.21.15.137:0/3064613896 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1e34003ee0 con 0x7f1e3c162a10 2024-04-26T22:02:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.281+0000 7f1e23fff640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e2806c8f0 0x7f1e2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.281+0000 7f1e23fff640 1 -- 172.21.15.137:0/3064613896 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5795+0+0 (secure 0 0 0) 0x7f1e3408c070 con 0x7f1e3c162a10 2024-04-26T22:02:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.281+0000 7f1e3affd640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e2806c8f0 0x7f1e2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.281+0000 7f1e3affd640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e2806c8f0 0x7f1e2806edb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c004ea0 tx=0x7f1e2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.285+0000 7f1e23fff640 1 -- 172.21.15.137:0/3064613896 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1e34014030 con 0x7f1e3c162a10 2024-04-26T22:02:27.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:27.459+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1e3c0b6ac0 con 0x7f1e3c162a10 2024-04-26T22:02:28.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.116+0000 7f1e23fff640 1 -- 172.21.15.137:0/3064613896 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) ==== 181+0+0 (secure 0 0 0) 0x7f1e3405a440 con 0x7f1e3c162a10 2024-04-26T22:02:28.117 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:02:28.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e2806c8f0 msgr2=0x7f1e2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:28.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e2806c8f0 0x7f1e2806edb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c004ea0 tx=0x7f1e2c009040 comp rx=0 tx=0).stop 2024-04-26T22:02:28.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c162a10 msgr2=0x7f1e3c157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:28.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c162a10 0x7f1e3c157280 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400cc30 tx=0x7f1e3400a5c0 comp rx=0 tx=0).stop 2024-04-26T22:02:28.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 shutdown_connections 2024-04-26T22:02:28.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e2806c8f0 0x7f1e2806edb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:28.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e3c162a10 0x7f1e3c157280 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:28.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3c0d2140 0x7f1e3c15c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:28.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 --2- 172.21.15.137:0/3064613896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3c0b6020 0x7f1e3c0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:28.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 >> 172.21.15.137:0/3064613896 conn(0x7f1e3c09e530 msgr2=0x7f1e3c06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:28.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 shutdown_connections 2024-04-26T22:02:28.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.119+0000 7f1e41940640 1 -- 172.21.15.137:0/3064613896 wait complete. 2024-04-26T22:02:28.131 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:02:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.234+0000 7fc321b91640 1 Processor -- start 2024-04-26T22:02:28.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.234+0000 7fc321b91640 1 -- start start 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc321b91640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc31c1454c0 0x7fc31c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc321b91640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31c06e830 con 0x7fc31c06e330 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc321b91640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31c06eb10 con 0x7fc31c0d18a0 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc321b91640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc31c0721a0 con 0x7fc31c1454c0 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc31b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc31c1454c0 0x7fc31c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc31affd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc31c06e330 0x7fc31c0d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52784/0 (socket says 172.21.15.137:52784) 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc31affd640 1 -- 172.21.15.137:0/2426424545 learned_addr learned my addr 172.21.15.137:0/2426424545 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc31b7fe640 1 -- 172.21.15.137:0/2426424545 >> v1:172.21.15.170:6789/0 conn(0x7fc31c0d18a0 legacy=0x7fc31c0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc31b7fe640 1 -- 172.21.15.137:0/2426424545 >> v1:172.21.15.137:6789/0 conn(0x7fc31c06e330 legacy=0x7fc31c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:28.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc31a7fc640 1 -- 172.21.15.137:0/2426424545 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685855390 0 0) 0x7fc31c06e830 con 0x7fc31c06e330 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.235+0000 7fc31b7fe640 1 -- 172.21.15.137:0/2426424545 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c06edf0 con 0x7fc31c1454c0 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.236+0000 7fc31b7fe640 1 --2- 172.21.15.137:0/2426424545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 0x7fc31c0d05a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc3100097a0 tx=0x7fc31002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f9ad5b65e29d4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.236+0000 7fc31a7fc640 1 -- 172.21.15.137:0/2426424545 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310037070 con 0x7fc31c1454c0 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.236+0000 7fc31a7fc640 1 -- 172.21.15.137:0/2426424545 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc310032440 con 0x7fc31c1454c0 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.236+0000 7fc31a7fc640 1 -- 172.21.15.137:0/2426424545 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310032810 con 0x7fc31c1454c0 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.236+0000 7fc321b91640 1 -- 172.21.15.137:0/2426424545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 msgr2=0x7fc31c0d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.236+0000 7fc321b91640 1 --2- 172.21.15.137:0/2426424545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 0x7fc31c0d05a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc3100097a0 tx=0x7fc31002a1e0 comp rx=0 tx=0).stop 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.236+0000 7fc321b91640 1 -- 172.21.15.137:0/2426424545 shutdown_connections 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.236+0000 7fc321b91640 1 --2- 172.21.15.137:0/2426424545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 0x7fc31c0d05a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.236+0000 7fc321b91640 1 -- 172.21.15.137:0/2426424545 >> 172.21.15.137:0/2426424545 conn(0x7fc31c06c690 msgr2=0x7fc31c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.237+0000 7fc321b91640 1 -- 172.21.15.137:0/2426424545 shutdown_connections 2024-04-26T22:02:28.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.237+0000 7fc321b91640 1 -- 172.21.15.137:0/2426424545 wait complete. 2024-04-26T22:02:28.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.238+0000 7fc321b91640 1 Processor -- start 2024-04-26T22:02:28.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.238+0000 7fc321b91640 1 -- start start 2024-04-26T22:02:28.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.238+0000 7fc321b91640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc31c06e330 0x7fc31c1f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:28.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.238+0000 7fc321b91640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc31c0d18a0 0x7fc31c0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:28.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc321b91640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 0x7fc31c073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:28.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc321b91640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c0d0ae0 con 0x7fc31c1454c0 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc321b91640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c0ceca0 con 0x7fc31c0d18a0 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc321b91640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc31c15d8a0 con 0x7fc31c06e330 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 0x7fc31c073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 0x7fc31c073380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43932/0 (socket says 172.21.15.137:43932) 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31bfff640 1 -- 172.21.15.137:0/4078842436 learned_addr learned my addr 172.21.15.137:0/4078842436 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31affd640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc31c0d18a0 0x7fc31c0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31b7fe640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc31c06e330 0x7fc31c1f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31bfff640 1 -- 172.21.15.137:0/4078842436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc31c06e330 msgr2=0x7fc31c1f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31bfff640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc31c06e330 0x7fc31c1f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31bfff640 1 -- 172.21.15.137:0/4078842436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc31c0d18a0 msgr2=0x7fc31c0ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:28.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31bfff640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc31c0d18a0 0x7fc31c0ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:28.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31bfff640 1 -- 172.21.15.137:0/4078842436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c156ef0 con 0x7fc31c1454c0 2024-04-26T22:02:28.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31b7fe640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc31c06e330 0x7fc31c1f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:28.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc31bfff640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 0x7fc31c073380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc31400ea50 tx=0x7fc31400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:28.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc303fff640 1 -- 172.21.15.137:0/4078842436 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314004730 con 0x7fc31c1454c0 2024-04-26T22:02:28.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc303fff640 1 -- 172.21.15.137:0/4078842436 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc314011470 con 0x7fc31c1454c0 2024-04-26T22:02:28.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31c1571d0 con 0x7fc31c1454c0 2024-04-26T22:02:28.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc303fff640 1 -- 172.21.15.137:0/4078842436 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc314011860 con 0x7fc31c1454c0 2024-04-26T22:02:28.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.239+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc31c0af0a0 con 0x7fc31c1454c0 2024-04-26T22:02:28.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.240+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31c0b5a30 con 0x7fc31c1454c0 2024-04-26T22:02:28.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.241+0000 7fc303fff640 1 -- 172.21.15.137:0/4078842436 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc314011a00 con 0x7fc31c1454c0 2024-04-26T22:02:28.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.241+0000 7fc303fff640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc30806c8f0 0x7fc30806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:28.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.241+0000 7fc31b7fe640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc30806c8f0 0x7fc30806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:28.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.241+0000 7fc303fff640 1 -- 172.21.15.137:0/4078842436 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5357+0+0 (secure 0 0 0) 0x7fc31408e310 con 0x7fc31c1454c0 2024-04-26T22:02:28.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.242+0000 7fc31b7fe640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc30806c8f0 0x7fc30806edb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc310034000 tx=0x7fc31002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:28.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.246+0000 7fc303fff640 1 -- 172.21.15.137:0/4078842436 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc31c0b5a30 con 0x7fc31c1454c0 2024-04-26T22:02:28.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:28.421+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc31c0d12e0 con 0x7fc31c1454c0 2024-04-26T22:02:29.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.121+0000 7fc303fff640 1 -- 172.21.15.137:0/4078842436 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) ==== 169+0+0 (secure 0 0 0) 0x7fc314016030 con 0x7fc31c1454c0 2024-04-26T22:02:29.121 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T22:02:29.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc30806c8f0 msgr2=0x7fc30806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc30806c8f0 0x7fc30806edb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc310034000 tx=0x7fc31002e000 comp rx=0 tx=0).stop 2024-04-26T22:02:29.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 msgr2=0x7fc31c073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 0x7fc31c073380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc31400ea50 tx=0x7fc31400ef10 comp rx=0 tx=0).stop 2024-04-26T22:02:29.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 shutdown_connections 2024-04-26T22:02:29.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc30806c8f0 0x7fc30806edb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc31c1454c0 0x7fc31c073380 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc31c0d18a0 0x7fc31c0ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 --2- 172.21.15.137:0/4078842436 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc31c06e330 0x7fc31c1f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 >> 172.21.15.137:0/4078842436 conn(0x7fc31c06c690 msgr2=0x7fc31c0b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:29.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 shutdown_connections 2024-04-26T22:02:29.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.124+0000 7fc321b91640 1 -- 172.21.15.137:0/4078842436 wait complete. 2024-04-26T22:02:29.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T22:02:29.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.241+0000 7fb3cdb7f640 1 Processor -- start 2024-04-26T22:02:29.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.241+0000 7fb3cdb7f640 1 -- start start 2024-04-26T22:02:29.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3cdb7f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c815f260 0x7fb3c806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3cdb7f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb3c80b4e00 0x7fb3c80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3cdb7f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c815f640 con 0x7fb3c8070560 2024-04-26T22:02:29.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3cdb7f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c806c2a0 con 0x7fb3c80b4e00 2024-04-26T22:02:29.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3cdb7f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c806c580 con 0x7fb3c815f260 2024-04-26T22:02:29.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c815f260 0x7fb3c806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3c7fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb3c80b4e00 0x7fb3c80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c815f260 0x7fb3c806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:47010/0 (socket says 172.21.15.137:47010) 2024-04-26T22:02:29.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3c77fe640 1 -- 172.21.15.137:0/1957070646 learned_addr learned my addr 172.21.15.137:0/1957070646 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:29.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3c6ffd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb3c8070560 0x7fb3c80b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:55278/0 (socket says 172.21.15.137:55278) 2024-04-26T22:02:29.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.242+0000 7fb3c7fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb3c80b4e00 0x7fb3c80ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:46918/0 (socket says 172.21.15.137:46918) 2024-04-26T22:02:29.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.243+0000 7fb3c7fff640 1 -- 172.21.15.137:0/1957070646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c815f260 msgr2=0x7fb3c806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:29.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.243+0000 7fb3c7fff640 1 --2- 172.21.15.137:0/1957070646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c815f260 0x7fb3c806d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.243+0000 7fb3c7fff640 1 -- 172.21.15.137:0/1957070646 >> v1:172.21.15.170:6789/0 conn(0x7fb3c8070560 legacy=0x7fb3c80b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.243+0000 7fb3c7fff640 1 -- 172.21.15.137:0/1957070646 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c806c860 con 0x7fb3c80b4e00 2024-04-26T22:02:29.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.243+0000 7fb3c77fe640 1 --2- 172.21.15.137:0/1957070646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c815f260 0x7fb3c806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:02:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3c7fff640 1 --2- 172.21.15.137:0/1957070646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c80b4e00 0x7fb3c80ae8b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009d90 tx=0x7fb3c002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71ab4b740321e85f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:29.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3c67fc640 1 -- 172.21.15.137:0/1957070646 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0007740 con 0x7fb3c80b4e00 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3c67fc640 1 -- 172.21.15.137:0/1957070646 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c00078e0 con 0x7fb3c80b4e00 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3c67fc640 1 -- 172.21.15.137:0/1957070646 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0007cb0 con 0x7fb3c80b4e00 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/1957070646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c80b4e00 msgr2=0x7fb3c80ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3cdb7f640 1 --2- 172.21.15.137:0/1957070646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c80b4e00 0x7fb3c80ae8b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009d90 tx=0x7fb3c002a660 comp rx=0 tx=0).stop 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/1957070646 shutdown_connections 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3cdb7f640 1 --2- 172.21.15.137:0/1957070646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c80b4e00 0x7fb3c80ae8b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3cdb7f640 1 --2- 172.21.15.137:0/1957070646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c815f260 0x7fb3c806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/1957070646 >> 172.21.15.137:0/1957070646 conn(0x7fb3c80d1660 msgr2=0x7fb3c80d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/1957070646 shutdown_connections 2024-04-26T22:02:29.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.244+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/1957070646 wait complete. 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.245+0000 7fb3cdb7f640 1 Processor -- start 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.246+0000 7fb3cdb7f640 1 -- start start 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.246+0000 7fb3cdb7f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c8070560 0x7fb3c81513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.246+0000 7fb3cdb7f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c80b4e00 0x7fb3c815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.246+0000 7fb3cdb7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3c815f260 0x7fb3c80d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.246+0000 7fb3cdb7f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c806d100 con 0x7fb3c815f260 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.246+0000 7fb3cdb7f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c806ce20 con 0x7fb3c8070560 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.246+0000 7fb3cdb7f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c806db60 con 0x7fb3c80b4e00 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.246+0000 7fb3c7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3c815f260 0x7fb3c80d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3c815f260 0x7fb3c80d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43944/0 (socket says 172.21.15.137:43944) 2024-04-26T22:02:29.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c7fff640 1 -- 172.21.15.137:0/3775807860 learned_addr learned my addr 172.21.15.137:0/3775807860 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c77fe640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c8070560 0x7fb3c81513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c6ffd640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c80b4e00 0x7fb3c815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c7fff640 1 -- 172.21.15.137:0/3775807860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c80b4e00 msgr2=0x7fb3c815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c7fff640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c80b4e00 0x7fb3c815f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c7fff640 1 -- 172.21.15.137:0/3775807860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c8070560 msgr2=0x7fb3c81513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c7fff640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c8070560 0x7fb3c81513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c7fff640 1 -- 172.21.15.137:0/3775807860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c815ff10 con 0x7fb3c815f260 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3c7fff640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3c815f260 0x7fb3c80d0a10 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009eb0 tx=0x7fb3c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3affff640 1 -- 172.21.15.137:0/3775807860 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c003f070 con 0x7fb3c815f260 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c81601f0 con 0x7fb3c815f260 2024-04-26T22:02:29.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3affff640 1 -- 172.21.15.137:0/3775807860 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c0031bc0 con 0x7fb3c815f260 2024-04-26T22:02:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3affff640 1 -- 172.21.15.137:0/3775807860 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0009450 con 0x7fb3c815f260 2024-04-26T22:02:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.247+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c81607b0 con 0x7fb3c815f260 2024-04-26T22:02:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.248+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c806a290 con 0x7fb3c815f260 2024-04-26T22:02:29.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.249+0000 7fb3affff640 1 -- 172.21.15.137:0/3775807860 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3c003b410 con 0x7fb3c815f260 2024-04-26T22:02:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.249+0000 7fb3affff640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb3b406c8f0 0x7fb3b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.249+0000 7fb3affff640 1 -- 172.21.15.137:0/3775807860 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fb3c00acee0 con 0x7fb3c815f260 2024-04-26T22:02:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.249+0000 7fb3c77fe640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb3b406c8f0 0x7fb3b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.249+0000 7fb3c77fe640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb3b406c8f0 0x7fb3b406edb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8006ca0 tx=0x7fb3b8009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:29.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.253+0000 7fb3affff640 1 -- 172.21.15.137:0/3775807860 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb3c007af40 con 0x7fb3c815f260 2024-04-26T22:02:29.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.427+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb3c80cdc80 con 0x7fb3c815f260 2024-04-26T22:02:29.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.430+0000 7fb3affff640 1 -- 172.21.15.137:0/3775807860 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7fb3c007f240 con 0x7fb3c815f260 2024-04-26T22:02:29.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb3b406c8f0 msgr2=0x7fb3b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb3b406c8f0 0x7fb3b406edb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8006ca0 tx=0x7fb3b8009240 comp rx=0 tx=0).stop 2024-04-26T22:02:29.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3c815f260 msgr2=0x7fb3c80d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3c815f260 0x7fb3c80d0a10 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009eb0 tx=0x7fb3c0004a40 comp rx=0 tx=0).stop 2024-04-26T22:02:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 shutdown_connections 2024-04-26T22:02:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb3b406c8f0 0x7fb3b406edb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb3c815f260 0x7fb3c80d0a10 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb3c80b4e00 0x7fb3c815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 --2- 172.21.15.137:0/3775807860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c8070560 0x7fb3c81513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 >> 172.21.15.137:0/3775807860 conn(0x7fb3c80d1660 msgr2=0x7fb3c80af920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 shutdown_connections 2024-04-26T22:02:29.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.432+0000 7fb3cdb7f640 1 -- 172.21.15.137:0/3775807860 wait complete. 2024-04-26T22:02:29.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-26T22:02:29.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.539+0000 7f5f150ea640 1 Processor -- start 2024-04-26T22:02:29.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.539+0000 7f5f150ea640 1 -- start start 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f150ea640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5f10070d20 0x7f5f10071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f150ea640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5f1009c400 0x7f5f10162f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f150ea640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f100d14c0 con 0x7f5f10070520 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f150ea640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5f100d1290 con 0x7f5f10070d20 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f150ea640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5f10071640 con 0x7f5f1009c400 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f0ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5f10070d20 0x7f5f10071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f0f59e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5f10070520 0x7f5f10163470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52790/0 (socket says 172.21.15.137:52790) 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f0f59e640 1 -- 172.21.15.137:0/1443839047 learned_addr learned my addr 172.21.15.137:0/1443839047 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f0ed9d640 1 -- 172.21.15.137:0/1443839047 >> v2:172.21.15.170:3300/0 conn(0x7f5f1009c400 msgr2=0x7f5f10162f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.540+0000 7f5f0e59c640 1 --2- 172.21.15.137:0/1443839047 >> v2:172.21.15.170:3300/0 conn(0x7f5f1009c400 0x7f5f10162f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.541+0000 7f5f0ed9d640 1 --2- 172.21.15.137:0/1443839047 >> v2:172.21.15.170:3300/0 conn(0x7f5f1009c400 0x7f5f10162f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.541+0000 7f5f0ed9d640 1 -- 172.21.15.137:0/1443839047 >> v1:172.21.15.137:6789/0 conn(0x7f5f10070520 legacy=0x7f5f10163470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.541+0000 7f5f0dd9b640 1 -- 172.21.15.137:0/1443839047 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 142761390 0 0) 0x7f5f100d14c0 con 0x7f5f10070520 2024-04-26T22:02:29.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.541+0000 7f5f0ed9d640 1 -- 172.21.15.137:0/1443839047 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f100ce5b0 con 0x7f5f10070d20 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.541+0000 7f5f0ed9d640 1 --2- 172.21.15.137:0/1443839047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 0x7f5f10071100 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5f100d0cb0 tx=0x7f5f0002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8315897e69978a6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.541+0000 7f5f0dd9b640 1 -- 172.21.15.137:0/1443839047 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00007740 con 0x7f5f10070d20 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.541+0000 7f5f0dd9b640 1 -- 172.21.15.137:0/1443839047 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f000078e0 con 0x7f5f10070d20 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.541+0000 7f5f0dd9b640 1 -- 172.21.15.137:0/1443839047 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00007cb0 con 0x7f5f10070d20 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.542+0000 7f5f150ea640 1 -- 172.21.15.137:0/1443839047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 msgr2=0x7f5f10071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.542+0000 7f5f150ea640 1 --2- 172.21.15.137:0/1443839047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 0x7f5f10071100 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5f100d0cb0 tx=0x7f5f0002a680 comp rx=0 tx=0).stop 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.542+0000 7f5f150ea640 1 -- 172.21.15.137:0/1443839047 shutdown_connections 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.542+0000 7f5f150ea640 1 --2- 172.21.15.137:0/1443839047 >> v2:172.21.15.170:3300/0 conn(0x7f5f1009c400 0x7f5f10162f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.542+0000 7f5f150ea640 1 --2- 172.21.15.137:0/1443839047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 0x7f5f10071100 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.542+0000 7f5f150ea640 1 -- 172.21.15.137:0/1443839047 >> 172.21.15.137:0/1443839047 conn(0x7f5f100b4a40 msgr2=0x7f5f100b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.542+0000 7f5f150ea640 1 -- 172.21.15.137:0/1443839047 shutdown_connections 2024-04-26T22:02:29.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.542+0000 7f5f150ea640 1 -- 172.21.15.137:0/1443839047 wait complete. 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.543+0000 7f5f150ea640 1 Processor -- start 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.543+0000 7f5f150ea640 1 -- start start 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f150ea640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f10070520 0x7f5f1015c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f150ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 0x7f5f100c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f150ea640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f1009c400 0x7f5f10161390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f150ea640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f100d1d20 con 0x7f5f10070d20 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f150ea640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5f100d1a40 con 0x7f5f10070520 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f150ea640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5f100d2000 con 0x7f5f1009c400 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f0e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 0x7f5f100c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f0e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 0x7f5f100c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43966/0 (socket says 172.21.15.137:43966) 2024-04-26T22:02:29.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f0e59c640 1 -- 172.21.15.137:0/3854720446 learned_addr learned my addr 172.21.15.137:0/3854720446 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f0f59e640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f1009c400 0x7f5f10161390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f0ed9d640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f10070520 0x7f5f1015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.544+0000 7f5f0e59c640 1 -- 172.21.15.137:0/3854720446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f1009c400 msgr2=0x7f5f10161390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5f0e59c640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f1009c400 0x7f5f10161390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5f0e59c640 1 -- 172.21.15.137:0/3854720446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f10070520 msgr2=0x7f5f1015c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5f0e59c640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f10070520 0x7f5f1015c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5f0e59c640 1 -- 172.21.15.137:0/3854720446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f100ca1a0 con 0x7f5f10070d20 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5f0e59c640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 0x7f5f100c6a40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400c820 tx=0x7f5f0400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5ef77fe640 1 -- 172.21.15.137:0/3854720446 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f04015070 con 0x7f5f10070d20 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5ef77fe640 1 -- 172.21.15.137:0/3854720446 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f04004240 con 0x7f5f10070d20 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f100ca480 con 0x7f5f10070d20 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5ef77fe640 1 -- 172.21.15.137:0/3854720446 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400ce10 con 0x7f5f10070d20 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.545+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f100caa40 con 0x7f5f10070d20 2024-04-26T22:02:29.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.546+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f100693d0 con 0x7f5f10070d20 2024-04-26T22:02:29.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.546+0000 7f5ef77fe640 1 -- 172.21.15.137:0/3854720446 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f04007830 con 0x7f5f10070d20 2024-04-26T22:02:29.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.547+0000 7f5ef77fe640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5efc06c8f0 0x7f5efc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:29.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.547+0000 7f5ef77fe640 1 -- 172.21.15.137:0/3854720446 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f5f0408b6c0 con 0x7f5f10070d20 2024-04-26T22:02:29.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.547+0000 7f5f0ed9d640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5efc06c8f0 0x7f5efc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:29.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.547+0000 7f5f0ed9d640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5efc06c8f0 0x7f5efc06edb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5f00034000 tx=0x7f5f00033040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:29.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.551+0000 7f5ef77fe640 1 -- 172.21.15.137:0/3854720446 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5f04059e80 con 0x7f5f10070d20 2024-04-26T22:02:29.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:29.809+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) -- 0x7f5f10074880 con 0x7f5f10070d20 2024-04-26T22:02:30.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.122+0000 7f5ef77fe640 1 -- 172.21.15.137:0/3854720446 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v200) ==== 169+0+0 (secure 0 0 0) 0x7f5f04059780 con 0x7f5f10070d20 2024-04-26T22:02:30.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5efc06c8f0 msgr2=0x7f5efc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5efc06c8f0 0x7f5efc06edb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5f00034000 tx=0x7f5f00033040 comp rx=0 tx=0).stop 2024-04-26T22:02:30.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 msgr2=0x7f5f100c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 0x7f5f100c6a40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400c820 tx=0x7f5f0400cce0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 shutdown_connections 2024-04-26T22:02:30.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5efc06c8f0 0x7f5efc06edb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f10070d20 0x7f5f100c6a40 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f1009c400 0x7f5f10161390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 --2- 172.21.15.137:0/3854720446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f10070520 0x7f5f1015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 >> 172.21.15.137:0/3854720446 conn(0x7f5f100b4a40 msgr2=0x7f5f100cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:30.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 shutdown_connections 2024-04-26T22:02:30.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.125+0000 7f5f150ea640 1 -- 172.21.15.137:0/3854720446 wait complete. 2024-04-26T22:02:30.136 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-26T22:02:30.137 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-26T22:02:30.137 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-26T22:02:30.137 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:30.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.234+0000 7ffb2fadc640 1 Processor -- start 2024-04-26T22:02:30.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.234+0000 7ffb2fadc640 1 -- start start 2024-04-26T22:02:30.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.235+0000 7ffb2fadc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb28160630 0x7ffb280b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.235+0000 7ffb2fadc640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb280b4530 con 0x7ffb28145980 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.235+0000 7ffb2fadc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb280b4810 con 0x7ffb280b61a0 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.235+0000 7ffb2fadc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ffb28160ac0 con 0x7ffb28160630 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.235+0000 7ffb2e079640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb28160630 0x7ffb280b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.235+0000 7ffb2d878640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ffb28145980 0x7ffb280b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52792/0 (socket says 172.21.15.137:52792) 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.235+0000 7ffb2e079640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ffb28160630 0x7ffb280b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43978/0 (socket says 172.21.15.137:43978) 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.235+0000 7ffb2d878640 1 -- 172.21.15.137:0/2141752877 learned_addr learned my addr 172.21.15.137:0/2141752877 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.236+0000 7ffb2e079640 1 -- 172.21.15.137:0/2141752877 >> v1:172.21.15.170:6789/0 conn(0x7ffb280b61a0 legacy=0x7ffb280720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.236+0000 7ffb2e079640 1 -- 172.21.15.137:0/2141752877 >> v1:172.21.15.137:6789/0 conn(0x7ffb28145980 legacy=0x7ffb280b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.236+0000 7ffb2e079640 1 -- 172.21.15.137:0/2141752877 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb280b4af0 con 0x7ffb28160630 2024-04-26T22:02:30.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.236+0000 7ffb2c876640 1 -- 172.21.15.137:0/2141752877 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196289986 0 0) 0x7ffb280b4530 con 0x7ffb28145980 2024-04-26T22:02:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.236+0000 7ffb2e079640 1 --2- 172.21.15.137:0/2141752877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb28160630 0x7ffb280b3de0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009d90 tx=0x7ffb2002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af90f5606d7a10ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.236+0000 7ffb2c876640 1 -- 172.21.15.137:0/2141752877 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20007740 con 0x7ffb28160630 2024-04-26T22:02:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.236+0000 7ffb2c876640 1 -- 172.21.15.137:0/2141752877 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb200078e0 con 0x7ffb28160630 2024-04-26T22:02:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.236+0000 7ffb2c876640 1 -- 172.21.15.137:0/2141752877 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20007cb0 con 0x7ffb28160630 2024-04-26T22:02:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.237+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2141752877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb28160630 msgr2=0x7ffb280b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.237+0000 7ffb2fadc640 1 --2- 172.21.15.137:0/2141752877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb28160630 0x7ffb280b3de0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009d90 tx=0x7ffb2002a660 comp rx=0 tx=0).stop 2024-04-26T22:02:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.237+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2141752877 shutdown_connections 2024-04-26T22:02:30.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.237+0000 7ffb2fadc640 1 --2- 172.21.15.137:0/2141752877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb28160630 0x7ffb280b3de0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.237+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2141752877 >> 172.21.15.137:0/2141752877 conn(0x7ffb280d0d30 msgr2=0x7ffb280d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:30.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.237+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2141752877 shutdown_connections 2024-04-26T22:02:30.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.237+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2141752877 wait complete. 2024-04-26T22:02:30.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.238+0000 7ffb2fadc640 1 Processor -- start 2024-04-26T22:02:30.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.238+0000 7ffb2fadc640 1 -- start start 2024-04-26T22:02:30.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2fadc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb280b61a0 0x7ffb2813fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2fadc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb28145980 0x7ffb28140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2fadc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb28160630 0x7ffb280b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2fadc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280727e0 con 0x7ffb280b61a0 2024-04-26T22:02:30.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2fadc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280b5140 con 0x7ffb28160630 2024-04-26T22:02:30.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2fadc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffb28072960 con 0x7ffb28145980 2024-04-26T22:02:30.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d878640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb280b61a0 0x7ffb2813fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d878640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb280b61a0 0x7ffb2813fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43984/0 (socket says 172.21.15.137:43984) 2024-04-26T22:02:30.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d878640 1 -- 172.21.15.137:0/2382095935 learned_addr learned my addr 172.21.15.137:0/2382095935 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2e079640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb28160630 0x7ffb280b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d077640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb28145980 0x7ffb28140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d878640 1 -- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb28145980 msgr2=0x7ffb28140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d878640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb28145980 0x7ffb28140330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d878640 1 -- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb28160630 msgr2=0x7ffb280b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d878640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb28160630 0x7ffb280b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d878640 1 -- 172.21.15.137:0/2382095935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb280b3c90 con 0x7ffb280b61a0 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d077640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb28145980 0x7ffb28140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2e079640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb28160630 0x7ffb280b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.239+0000 7ffb2d878640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb280b61a0 0x7ffb2813fdf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800c4a0 tx=0x7ffb1800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.240+0000 7ffb267fc640 1 -- 172.21.15.137:0/2382095935 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18018070 con 0x7ffb280b61a0 2024-04-26T22:02:30.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.240+0000 7ffb267fc640 1 -- 172.21.15.137:0/2382095935 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb180074e0 con 0x7ffb280b61a0 2024-04-26T22:02:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.240+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb281f64d0 con 0x7ffb280b61a0 2024-04-26T22:02:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.240+0000 7ffb267fc640 1 -- 172.21.15.137:0/2382095935 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18004a20 con 0x7ffb280b61a0 2024-04-26T22:02:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.240+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb281f6a90 con 0x7ffb280b61a0 2024-04-26T22:02:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.240+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb2806a290 con 0x7ffb280b61a0 2024-04-26T22:02:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.241+0000 7ffb267fc640 1 -- 172.21.15.137:0/2382095935 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb1801b070 con 0x7ffb280b61a0 2024-04-26T22:02:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.241+0000 7ffb267fc640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffb1406c920 0x7ffb1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.242+0000 7ffb267fc640 1 -- 172.21.15.137:0/2382095935 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7ffb1808aba0 con 0x7ffb280b61a0 2024-04-26T22:02:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.242+0000 7ffb2d077640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffb1406c920 0x7ffb1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.242+0000 7ffb2d077640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffb1406c920 0x7ffb1406ede0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffb280afa40 tx=0x7ffb1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:30.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.246+0000 7ffb267fc640 1 -- 172.21.15.137:0/2382095935 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffb180592d0 con 0x7ffb280b61a0 2024-04-26T22:02:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.420+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb2813d470 con 0x7ffb280b61a0 2024-04-26T22:02:30.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.421+0000 7ffb267fc640 1 -- 172.21.15.137:0/2382095935 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+13034 (secure 0 0 0) 0x7ffb18058bd0 con 0x7ffb280b61a0 2024-04-26T22:02:30.421 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:30.421 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":63,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:02:29.118207+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/4265926631":"2024-04-27T22:02:26.106819+0000","172.21.15.137:6836/4265926631":"2024-04-27T22:02:26.106819+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.422+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffb1406c920 msgr2=0x7ffb1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.422+0000 7ffb2fadc640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffb1406c920 0x7ffb1406ede0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffb280afa40 tx=0x7ffb1c009040 comp rx=0 tx=0).stop 2024-04-26T22:02:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.422+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb280b61a0 msgr2=0x7ffb2813fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.422+0000 7ffb2fadc640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb280b61a0 0x7ffb2813fdf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800c4a0 tx=0x7ffb1800c960 comp rx=0 tx=0).stop 2024-04-26T22:02:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.423+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 shutdown_connections 2024-04-26T22:02:30.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.423+0000 7ffb2fadc640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffb1406c920 0x7ffb1406ede0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.423+0000 7ffb2fadc640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb28160630 0x7ffb280b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.423+0000 7ffb2fadc640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffb28145980 0x7ffb28140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.423+0000 7ffb2fadc640 1 --2- 172.21.15.137:0/2382095935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffb280b61a0 0x7ffb2813fdf0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.423+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 >> 172.21.15.137:0/2382095935 conn(0x7ffb280d0d30 msgr2=0x7ffb2815d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.423+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 shutdown_connections 2024-04-26T22:02:30.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.423+0000 7ffb2fadc640 1 -- 172.21.15.137:0/2382095935 wait complete. 2024-04-26T22:02:30.434 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:02:30.434 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:02:30.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.534+0000 7fd8f990a640 1 Processor -- start 2024-04-26T22:02:30.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.534+0000 7fd8f990a640 1 -- start start 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f990a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd8f415f680 0x7fd8f40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f990a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd8f4163aa0 0x7fd8f40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f990a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f40d3f50 con 0x7fd8f40b60b0 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f990a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f415fa60 con 0x7fd8f415f680 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f990a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f40b5090 con 0x7fd8f4163aa0 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f2ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd8f415f680 0x7fd8f40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f37fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd8f40b60b0 0x7fd8f40d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52800/0 (socket says 172.21.15.137:52800) 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f37fe640 1 -- 172.21.15.137:0/834468414 learned_addr learned my addr 172.21.15.137:0/834468414 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f2ffd640 1 -- 172.21.15.137:0/834468414 >> v2:172.21.15.170:3300/0 conn(0x7fd8f4163aa0 msgr2=0x7fd8f40b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:30.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f27fc640 1 --2- 172.21.15.137:0/834468414 >> v2:172.21.15.170:3300/0 conn(0x7fd8f4163aa0 0x7fd8f40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f2ffd640 1 --2- 172.21.15.137:0/834468414 >> v2:172.21.15.170:3300/0 conn(0x7fd8f4163aa0 0x7fd8f40b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f1ffb640 1 -- 172.21.15.137:0/834468414 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825174658 0 0) 0x7fd8f40d3f50 con 0x7fd8f40b60b0 2024-04-26T22:02:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f2ffd640 1 -- 172.21.15.137:0/834468414 >> v1:172.21.15.137:6789/0 conn(0x7fd8f40b60b0 legacy=0x7fd8f40d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.535+0000 7fd8f2ffd640 1 -- 172.21.15.137:0/834468414 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f40b5370 con 0x7fd8f415f680 2024-04-26T22:02:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.536+0000 7fd8f2ffd640 1 --2- 172.21.15.137:0/834468414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 0x7fd8f40d3820 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4163040 tx=0x7fd8e402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd74a41413b10d04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.536+0000 7fd8f1ffb640 1 -- 172.21.15.137:0/834468414 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4037070 con 0x7fd8f415f680 2024-04-26T22:02:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.536+0000 7fd8f1ffb640 1 -- 172.21.15.137:0/834468414 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e4032440 con 0x7fd8f415f680 2024-04-26T22:02:30.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.536+0000 7fd8f1ffb640 1 -- 172.21.15.137:0/834468414 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4032810 con 0x7fd8f415f680 2024-04-26T22:02:30.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.537+0000 7fd8f990a640 1 -- 172.21.15.137:0/834468414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 msgr2=0x7fd8f40d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.537+0000 7fd8f990a640 1 --2- 172.21.15.137:0/834468414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 0x7fd8f40d3820 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fd8f4163040 tx=0x7fd8e402a1a0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.537+0000 7fd8f990a640 1 -- 172.21.15.137:0/834468414 shutdown_connections 2024-04-26T22:02:30.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.537+0000 7fd8f990a640 1 --2- 172.21.15.137:0/834468414 >> v2:172.21.15.170:3300/0 conn(0x7fd8f4163aa0 0x7fd8f40b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.537+0000 7fd8f990a640 1 --2- 172.21.15.137:0/834468414 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 0x7fd8f40d3820 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.537+0000 7fd8f990a640 1 -- 172.21.15.137:0/834468414 >> 172.21.15.137:0/834468414 conn(0x7fd8f408eca0 msgr2=0x7fd8f409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:30.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.537+0000 7fd8f990a640 1 -- 172.21.15.137:0/834468414 shutdown_connections 2024-04-26T22:02:30.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.537+0000 7fd8f990a640 1 -- 172.21.15.137:0/834468414 wait complete. 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.538+0000 7fd8f990a640 1 Processor -- start 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.538+0000 7fd8f990a640 1 -- start start 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f990a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8f40b60b0 0x7fd8f41620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f990a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 0x7fd8f41625e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f990a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8f4163aa0 0x7fd8f4162eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f990a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f40d57b0 con 0x7fd8f415f680 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f990a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f40d5630 con 0x7fd8f40b60b0 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f990a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f40d5930 con 0x7fd8f4163aa0 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f27fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 0x7fd8f41625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f27fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 0x7fd8f41625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44016/0 (socket says 172.21.15.137:44016) 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f27fc640 1 -- 172.21.15.137:0/2718703905 learned_addr learned my addr 172.21.15.137:0/2718703905 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f2ffd640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8f40b60b0 0x7fd8f41620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f37fe640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8f4163aa0 0x7fd8f4162eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f27fc640 1 -- 172.21.15.137:0/2718703905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8f4163aa0 msgr2=0x7fd8f4162eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f27fc640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8f4163aa0 0x7fd8f4162eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f27fc640 1 -- 172.21.15.137:0/2718703905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8f40b60b0 msgr2=0x7fd8f41620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f27fc640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8f40b60b0 0x7fd8f41620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f27fc640 1 -- 172.21.15.137:0/2718703905 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f40ce390 con 0x7fd8f415f680 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f2ffd640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8f40b60b0 0x7fd8f41620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f27fc640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 0x7fd8f41625e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c7f0 tx=0x7fd8e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8dbfff640 1 -- 172.21.15.137:0/2718703905 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8015070 con 0x7fd8f415f680 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8dbfff640 1 -- 172.21.15.137:0/2718703905 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e8004220 con 0x7fd8f415f680 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f40ce670 con 0x7fd8f415f680 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8dbfff640 1 -- 172.21.15.137:0/2718703905 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8007620 con 0x7fd8f415f680 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.539+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f40cec30 con 0x7fd8f415f680 2024-04-26T22:02:30.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.540+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f406a290 con 0x7fd8f415f680 2024-04-26T22:02:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.541+0000 7fd8dbfff640 1 -- 172.21.15.137:0/2718703905 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8e80079d0 con 0x7fd8f415f680 2024-04-26T22:02:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.541+0000 7fd8dbfff640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8e006c8f0 0x7fd8e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.541+0000 7fd8dbfff640 1 -- 172.21.15.137:0/2718703905 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fd8e808b820 con 0x7fd8f415f680 2024-04-26T22:02:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.541+0000 7fd8f2ffd640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8e006c8f0 0x7fd8e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.542+0000 7fd8f2ffd640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8e006c8f0 0x7fd8e006edb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4034000 tx=0x7fd8e402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:30.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.545+0000 7fd8dbfff640 1 -- 172.21.15.137:0/2718703905 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd8e8059fe0 con 0x7fd8f415f680 2024-04-26T22:02:30.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.720+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd8f415d190 con 0x7fd8f415f680 2024-04-26T22:02:30.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.721+0000 7fd8dbfff640 1 -- 172.21.15.137:0/2718703905 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) ==== 93+0+10 (secure 0 0 0) 0x7fd8e805ee20 con 0x7fd8f415f680 2024-04-26T22:02:30.721 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:02:30.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8e006c8f0 msgr2=0x7fd8e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8e006c8f0 0x7fd8e006edb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4034000 tx=0x7fd8e402e000 comp rx=0 tx=0).stop 2024-04-26T22:02:30.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 msgr2=0x7fd8f41625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 0x7fd8f41625e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c7f0 tx=0x7fd8e800ccb0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 shutdown_connections 2024-04-26T22:02:30.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd8e006c8f0 0x7fd8e006edb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8f415f680 0x7fd8f41625e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8f4163aa0 0x7fd8f4162eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 --2- 172.21.15.137:0/2718703905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8f40b60b0 0x7fd8f41620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 >> 172.21.15.137:0/2718703905 conn(0x7fd8f408eca0 msgr2=0x7fd8f40b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:30.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 shutdown_connections 2024-04-26T22:02:30.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.723+0000 7fd8f990a640 1 -- 172.21.15.137:0/2718703905 wait complete. 2024-04-26T22:02:30.734 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-26T22:02:30.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.830+0000 7f19b00dc640 1 Processor -- start 2024-04-26T22:02:30.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.831+0000 7f19b00dc640 1 -- start start 2024-04-26T22:02:30.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.831+0000 7f19b00dc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f19a815f370 0x7f19a80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.831+0000 7f19b00dc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f19a815f750 0x7f19a80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.831+0000 7f19b00dc640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19a80d03a0 con 0x7f19a80d37d0 2024-04-26T22:02:30.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.831+0000 7f19b00dc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f19a80b4d10 con 0x7f19a815f750 2024-04-26T22:02:30.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.831+0000 7f19b00dc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f19a80d0680 con 0x7f19a815f370 2024-04-26T22:02:30.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.832+0000 7f19ad677640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f19a815f750 0x7f19a80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.832+0000 7f19ae679640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f19a80d37d0 0x7f19a80d1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52816/0 (socket says 172.21.15.137:52816) 2024-04-26T22:02:30.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.832+0000 7f19ae679640 1 -- 172.21.15.137:0/850373056 learned_addr learned my addr 172.21.15.137:0/850373056 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:30.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.832+0000 7f19ade78640 1 --2- 172.21.15.137:0/850373056 >> v2:172.21.15.170:3300/0 conn(0x7f19a815f370 0x7f19a80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.832+0000 7f19ad677640 1 -- 172.21.15.137:0/850373056 >> v2:172.21.15.170:3300/0 conn(0x7f19a815f370 msgr2=0x7f19a80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.832+0000 7f19ad677640 1 --2- 172.21.15.137:0/850373056 >> v2:172.21.15.170:3300/0 conn(0x7f19a815f370 0x7f19a80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.832+0000 7f19ad677640 1 -- 172.21.15.137:0/850373056 >> v1:172.21.15.137:6789/0 conn(0x7f19a80d37d0 legacy=0x7f19a80d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.832+0000 7f19ace76640 1 -- 172.21.15.137:0/850373056 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770334539 0 0) 0x7f19a80d03a0 con 0x7f19a80d37d0 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.832+0000 7f19ad677640 1 -- 172.21.15.137:0/850373056 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a80d0960 con 0x7f19a815f750 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19ad677640 1 --2- 172.21.15.137:0/850373056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 0x7f19a80b47d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f19a80d2d10 tx=0x7f19a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c46bfe7a0e3f3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19ace76640 1 -- 172.21.15.137:0/850373056 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4037070 con 0x7f19a815f750 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19ace76640 1 -- 172.21.15.137:0/850373056 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a4032440 con 0x7f19a815f750 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19ace76640 1 -- 172.21.15.137:0/850373056 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4032810 con 0x7f19a815f750 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19b00dc640 1 -- 172.21.15.137:0/850373056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 msgr2=0x7f19a80b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19b00dc640 1 --2- 172.21.15.137:0/850373056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 0x7f19a80b47d0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f19a80d2d10 tx=0x7f19a402a1a0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19b00dc640 1 -- 172.21.15.137:0/850373056 shutdown_connections 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19b00dc640 1 --2- 172.21.15.137:0/850373056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 0x7f19a80b47d0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19b00dc640 1 --2- 172.21.15.137:0/850373056 >> v2:172.21.15.170:3300/0 conn(0x7f19a815f370 0x7f19a80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19b00dc640 1 -- 172.21.15.137:0/850373056 >> 172.21.15.137:0/850373056 conn(0x7f19a808ec10 msgr2=0x7f19a809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:30.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19b00dc640 1 -- 172.21.15.137:0/850373056 shutdown_connections 2024-04-26T22:02:30.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.833+0000 7f19b00dc640 1 -- 172.21.15.137:0/850373056 wait complete. 2024-04-26T22:02:30.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.834+0000 7f19b00dc640 1 Processor -- start 2024-04-26T22:02:30.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19b00dc640 1 -- start start 2024-04-26T22:02:30.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19b00dc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19a80d37d0 0x7f19a8162b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19b00dc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19a815f370 0x7f19a815fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19b00dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 0x7f19a81f8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19b00dc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f19a80b61d0 con 0x7f19a815f750 2024-04-26T22:02:30.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19b00dc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f19a80d0f20 con 0x7f19a815f370 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19b00dc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f19a80b6350 con 0x7f19a80d37d0 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19ae679640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 0x7f19a81f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19ae679640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 0x7f19a81f8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44038/0 (socket says 172.21.15.137:44038) 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19ae679640 1 -- 172.21.15.137:0/877895215 learned_addr learned my addr 172.21.15.137:0/877895215 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19ade78640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19a80d37d0 0x7f19a8162b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.835+0000 7f19ad677640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19a815f370 0x7f19a815fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f19ae679640 1 -- 172.21.15.137:0/877895215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19a80d37d0 msgr2=0x7f19a8162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f19ae679640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19a80d37d0 0x7f19a8162b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f19ae679640 1 -- 172.21.15.137:0/877895215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19a815f370 msgr2=0x7f19a815fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f19ae679640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19a815f370 0x7f19a815fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f19ae679640 1 -- 172.21.15.137:0/877895215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a8161aa0 con 0x7f19a815f750 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f19ae679640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 0x7f19a81f8490 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c700 tx=0x7f19a000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f199e7fc640 1 -- 172.21.15.137:0/877895215 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0018070 con 0x7f19a815f750 2024-04-26T22:02:30.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f199e7fc640 1 -- 172.21.15.137:0/877895215 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a000ce10 con 0x7f19a815f750 2024-04-26T22:02:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f199e7fc640 1 -- 172.21.15.137:0/877895215 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a000a880 con 0x7f19a815f750 2024-04-26T22:02:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a8161d80 con 0x7f19a815f750 2024-04-26T22:02:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.836+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a8162340 con 0x7f19a815f750 2024-04-26T22:02:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.837+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a806a290 con 0x7f19a815f750 2024-04-26T22:02:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.837+0000 7f199e7fc640 1 -- 172.21.15.137:0/877895215 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f19a001b070 con 0x7f19a815f750 2024-04-26T22:02:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.838+0000 7f199e7fc640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f198c06c8f0 0x7f198c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.838+0000 7f199e7fc640 1 -- 172.21.15.137:0/877895215 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f19a008ac90 con 0x7f19a815f750 2024-04-26T22:02:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.838+0000 7f19ade78640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f198c06c8f0 0x7f198c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:30.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.838+0000 7f19ade78640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f198c06c8f0 0x7f198c06edb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1998006fd0 tx=0x7f1998008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:30.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:30.842+0000 7f199e7fc640 1 -- 172.21.15.137:0/877895215 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f19a0058e00 con 0x7f19a815f750 2024-04-26T22:02:31.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.082+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f19a80759d0 con 0x7f19a815f750 2024-04-26T22:02:31.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.128+0000 7f199e7fc640 1 -- 172.21.15.137:0/877895215 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v201) ==== 169+0+0 (secure 0 0 0) 0x7f19a005d100 con 0x7f19a815f750 2024-04-26T22:02:31.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f198c06c8f0 msgr2=0x7f198c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f198c06c8f0 0x7f198c06edb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1998006fd0 tx=0x7f1998008040 comp rx=0 tx=0).stop 2024-04-26T22:02:31.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 msgr2=0x7f19a81f8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 0x7f19a81f8490 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c700 tx=0x7f19a000cbc0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 shutdown_connections 2024-04-26T22:02:31.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f198c06c8f0 0x7f198c06edb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f19a815f750 0x7f19a81f8490 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f19a815f370 0x7f19a815fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 --2- 172.21.15.137:0/877895215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f19a80d37d0 0x7f19a8162b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 >> 172.21.15.137:0/877895215 conn(0x7f19a808ec10 msgr2=0x7f19a80d2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:31.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 shutdown_connections 2024-04-26T22:02:31.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.131+0000 7f19b00dc640 1 -- 172.21.15.137:0/877895215 wait complete. 2024-04-26T22:02:31.142 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T22:02:31.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.241+0000 7f4c450b0640 1 Processor -- start 2024-04-26T22:02:31.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.241+0000 7f4c450b0640 1 -- start start 2024-04-26T22:02:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.242+0000 7f4c450b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c400d3820 0x7f4c400b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.242+0000 7f4c450b0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4c400b60b0 0x7f4c400d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.242+0000 7f4c450b0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c400d3f50 con 0x7f4c4015f680 2024-04-26T22:02:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.242+0000 7f4c450b0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4c4015fa60 con 0x7f4c400b60b0 2024-04-26T22:02:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.242+0000 7f4c450b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4c400b5090 con 0x7f4c400d3820 2024-04-26T22:02:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.242+0000 7f4c3ed9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4c4015f680 0x7f4c40163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52828/0 (socket says 172.21.15.137:52828) 2024-04-26T22:02:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.242+0000 7f4c3ed9d640 1 -- 172.21.15.137:0/2487663861 learned_addr learned my addr 172.21.15.137:0/2487663861 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 911919717 0 0) 0x7f4c400d3f50 con 0x7f4c4015f680 2024-04-26T22:02:31.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3f59e640 1 --2- 172.21.15.137:0/2487663861 >> v2:172.21.15.170:3300/0 conn(0x7f4c400b60b0 0x7f4c400d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c28003520 con 0x7f4c4015f680 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3e59c640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c400d3820 0x7f4c400b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3148094142 0 0) 0x7f4c28003520 con 0x7f4c4015f680 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c400d3820 msgr2=0x7f4c400b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c400d3820 0x7f4c400b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 >> v2:172.21.15.170:3300/0 conn(0x7f4c400b60b0 msgr2=0x7f4c400d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 --2- 172.21.15.137:0/2487663861 >> v2:172.21.15.170:3300/0 conn(0x7f4c400b60b0 0x7f4c400d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c400b5370 con 0x7f4c4015f680 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f4c30001670 con 0x7f4c4015f680 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 >> v1:172.21.15.137:6789/0 conn(0x7f4c4015f680 legacy=0x7f4c40163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c400d3820 0x7f4c280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c28004d40 0x7f4c280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4015fa60 con 0x7f4c28003f30 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400b5090 con 0x7f4c28004d40 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2800b9c0 con 0x7f4c400d3820 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3e59c640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3ed9d640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c400d3820 0x7f4c280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3f59e640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c28004d40 0x7f4c280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3e59c640 1 -- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c400d3820 msgr2=0x7f4c280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3e59c640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c400d3820 0x7f4c280039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3e59c640 1 -- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c28004d40 msgr2=0x7f4c280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3e59c640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c28004d40 0x7f4c280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3e59c640 1 -- 172.21.15.137:0/2487663861 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c28003520 con 0x7f4c28003f30 2024-04-26T22:02:31.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.243+0000 7f4c3ed9d640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c400d3820 0x7f4c280039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.244+0000 7f4c3e59c640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c28004800 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009ac0 tx=0x7f4c28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5424e61db46d3b95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.244+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34036070 con 0x7f4c28003f30 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.244+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c34031400 con 0x7f4c28003f30 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.244+0000 7f4c3dd9b640 1 -- 172.21.15.137:0/2487663861 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34009690 con 0x7f4c28003f30 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.245+0000 7f4c450b0640 1 -- 172.21.15.137:0/2487663861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 msgr2=0x7f4c28004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.245+0000 7f4c450b0640 1 --2- 172.21.15.137:0/2487663861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c28004800 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009ac0 tx=0x7f4c28005830 comp rx=0 tx=0).stop 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.245+0000 7f4c3f59e640 1 -- 172.21.15.137:0/2487663861 reap_dead start 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.245+0000 7f4c450b0640 1 -- 172.21.15.137:0/2487663861 shutdown_connections 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.245+0000 7f4c450b0640 1 -- 172.21.15.137:0/2487663861 >> 172.21.15.137:0/2487663861 conn(0x7f4c4008eca0 msgr2=0x7f4c4009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.245+0000 7f4c450b0640 1 -- 172.21.15.137:0/2487663861 shutdown_connections 2024-04-26T22:02:31.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.245+0000 7f4c450b0640 1 -- 172.21.15.137:0/2487663861 wait complete. 2024-04-26T22:02:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.246+0000 7f4c450b0640 1 Processor -- start 2024-04-26T22:02:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.246+0000 7f4c450b0640 1 -- start start 2024-04-26T22:02:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c450b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c4014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c450b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c400cc420 0x7f4c400ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c450b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c40162230 0x7f4c400c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c450b0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400b5cf0 con 0x7f4c28003f30 2024-04-26T22:02:31.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c450b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4c400b5b70 con 0x7f4c400cc420 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c450b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4c400b5e70 con 0x7f4c40162230 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c4014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c4014d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44064/0 (socket says 172.21.15.137:44064) 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3ed9d640 1 -- 172.21.15.137:0/1652544634 learned_addr learned my addr 172.21.15.137:0/1652544634 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3e59c640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c400cc420 0x7f4c400ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3f59e640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c40162230 0x7f4c400c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3ed9d640 1 -- 172.21.15.137:0/1652544634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c40162230 msgr2=0x7f4c400c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3ed9d640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c40162230 0x7f4c400c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3ed9d640 1 -- 172.21.15.137:0/1652544634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c400cc420 msgr2=0x7f4c400ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3ed9d640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c400cc420 0x7f4c400ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3ed9d640 1 -- 172.21.15.137:0/1652544634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c40161470 con 0x7f4c28003f30 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.247+0000 7f4c3ed9d640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c4014d700 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000e780 tx=0x7f4c3000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.248+0000 7f4c277fe640 1 -- 172.21.15.137:0/1652544634 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000c870 con 0x7f4c28003f30 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.248+0000 7f4c277fe640 1 -- 172.21.15.137:0/1652544634 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c30018070 con 0x7f4c28003f30 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.248+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c40161750 con 0x7f4c28003f30 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.248+0000 7f4c277fe640 1 -- 172.21.15.137:0/1652544634 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000cc50 con 0x7f4c28003f30 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.248+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c40161d10 con 0x7f4c28003f30 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.249+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4006a290 con 0x7f4c28003f30 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.249+0000 7f4c277fe640 1 -- 172.21.15.137:0/1652544634 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c3001d460 con 0x7f4c28003f30 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.250+0000 7f4c277fe640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c2c06c8f0 0x7f4c2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.250+0000 7f4c3e59c640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c2c06c8f0 0x7f4c2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.250+0000 7f4c277fe640 1 -- 172.21.15.137:0/1652544634 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7f4c3008b770 con 0x7f4c28003f30 2024-04-26T22:02:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.250+0000 7f4c3e59c640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c2c06c8f0 0x7f4c2c06edb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c34033000 tx=0x7f4c34008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.254+0000 7f4c277fe640 1 -- 172.21.15.137:0/1652544634 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4c30059ea0 con 0x7f4c28003f30 2024-04-26T22:02:31.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.430+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4c40161ee0 con 0x7f4c28003f30 2024-04-26T22:02:31.432 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.433+0000 7f4c277fe640 1 -- 172.21.15.137:0/1652544634 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f4c300597a0 con 0x7f4c28003f30 2024-04-26T22:02:31.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c2c06c8f0 msgr2=0x7f4c2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c2c06c8f0 0x7f4c2c06edb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4c34033000 tx=0x7f4c34008030 comp rx=0 tx=0).stop 2024-04-26T22:02:31.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 msgr2=0x7f4c4014d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c4014d700 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000e780 tx=0x7f4c3000ec40 comp rx=0 tx=0).stop 2024-04-26T22:02:31.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 shutdown_connections 2024-04-26T22:02:31.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c2c06c8f0 0x7f4c2c06edb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c40162230 0x7f4c400c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c400cc420 0x7f4c400ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 --2- 172.21.15.137:0/1652544634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c28003f30 0x7f4c4014d700 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 >> 172.21.15.137:0/1652544634 conn(0x7f4c4008eca0 msgr2=0x7f4c400b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:31.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 shutdown_connections 2024-04-26T22:02:31.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.435+0000 7f4c450b0640 1 -- 172.21.15.137:0/1652544634 wait complete. 2024-04-26T22:02:31.446 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:02:31.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:02:31.481 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:02:31.521 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:02:31.521 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:31.521 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:31.536 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:02:31.536 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:02:31.536 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:31.578 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:02:31.578 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:31.578 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:31.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:02:31.593 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:02:31.593 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:31.635 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:02:31.635 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T22:02:31.636 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:31.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.732+0000 7fe70759d640 1 Processor -- start 2024-04-26T22:02:31.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.733+0000 7fe70759d640 1 -- start start 2024-04-26T22:02:31.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.733+0000 7fe70759d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70006c2a0 0x7fe70006c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.733+0000 7fe70759d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe7000d0690 0x7fe7000d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.733+0000 7fe70759d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7000b6b80 con 0x7fe70015d3b0 2024-04-26T22:02:31.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.733+0000 7fe70759d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe7000aedf0 con 0x7fe7000d0690 2024-04-26T22:02:31.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.733+0000 7fe70759d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe70006cc40 con 0x7fe70006c2a0 2024-04-26T22:02:31.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe705339640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe70015d3b0 0x7fe7000735d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52842/0 (socket says 172.21.15.137:52842) 2024-04-26T22:02:31.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe705339640 1 -- 172.21.15.137:0/203988684 learned_addr learned my addr 172.21.15.137:0/203988684 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:31.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe704b38640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70006c2a0 0x7fe70006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe705b3a640 1 --2- 172.21.15.137:0/203988684 >> v2:172.21.15.170:3300/0 conn(0x7fe7000d0690 0x7fe7000d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808182213 0 0) 0x7fe7000b6b80 con 0x7fe70015d3b0 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec003520 con 0x7fe70015d3b0 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1966737804 0 0) 0x7fe6ec003520 con 0x7fe70015d3b0 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70006c2a0 msgr2=0x7fe70006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70006c2a0 0x7fe70006c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 >> v2:172.21.15.170:3300/0 conn(0x7fe7000d0690 msgr2=0x7fe7000d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 --2- 172.21.15.137:0/203988684 >> v2:172.21.15.170:3300/0 conn(0x7fe7000d0690 0x7fe7000d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7000b6e60 con 0x7fe70015d3b0 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fe6f8001670 con 0x7fe70015d3b0 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 >> v1:172.21.15.137:6789/0 conn(0x7fe70015d3b0 legacy=0x7fe7000735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70006c2a0 0x7fe6ec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6ec003f30 0x7fe6ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe6ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec00b9c0 con 0x7fe6ec004d40 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec00bb40 con 0x7fe6ec003f30 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec00bd10 con 0x7fe70006c2a0 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe705b3a640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe6ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe704b38640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6ec003f30 0x7fe6ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.734+0000 7fe705339640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70006c2a0 0x7fe6ec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.735+0000 7fe705b3a640 1 -- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70006c2a0 msgr2=0x7fe6ec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.735+0000 7fe705b3a640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70006c2a0 0x7fe6ec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.735+0000 7fe705b3a640 1 -- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6ec003f30 msgr2=0x7fe6ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.735+0000 7fe705b3a640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6ec003f30 0x7fe6ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.735+0000 7fe705b3a640 1 -- 172.21.15.137:0/203988684 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec003520 con 0x7fe6ec004d40 2024-04-26T22:02:31.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.735+0000 7fe705b3a640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe6ec0051c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00e170 tx=0x7fe6ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9019a87cc9584b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.735+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc034020 con 0x7fe6ec004d40 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.735+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6fc030430 con 0x7fe6ec004d40 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.735+0000 7fe6f7fff640 1 -- 172.21.15.137:0/203988684 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc009c10 con 0x7fe6ec004d40 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.736+0000 7fe70759d640 1 -- 172.21.15.137:0/203988684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 msgr2=0x7fe6ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.736+0000 7fe70759d640 1 --2- 172.21.15.137:0/203988684 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe6ec0051c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00e170 tx=0x7fe6ec005830 comp rx=0 tx=0).stop 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.736+0000 7fe705b3a640 1 -- 172.21.15.137:0/203988684 reap_dead start 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.736+0000 7fe70759d640 1 -- 172.21.15.137:0/203988684 shutdown_connections 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.736+0000 7fe70759d640 1 -- 172.21.15.137:0/203988684 >> 172.21.15.137:0/203988684 conn(0x7fe7000b3b10 msgr2=0x7fe7000b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.736+0000 7fe70759d640 1 -- 172.21.15.137:0/203988684 shutdown_connections 2024-04-26T22:02:31.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.736+0000 7fe70759d640 1 -- 172.21.15.137:0/203988684 wait complete. 2024-04-26T22:02:31.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.737+0000 7fe70759d640 1 Processor -- start 2024-04-26T22:02:31.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.737+0000 7fe70759d640 1 -- start start 2024-04-26T22:02:31.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe70759d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe7001f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe70759d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70014b800 0x7fe7001f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe70759d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe70014bc60 0x7fe70015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe70759d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7000d0170 con 0x7fe6ec004d40 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe70759d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7000b6930 con 0x7fe70014bc60 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe70759d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe70015d790 con 0x7fe70014b800 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705339640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe7001f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705339640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe7001f5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44096/0 (socket says 172.21.15.137:44096) 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705339640 1 -- 172.21.15.137:0/652477415 learned_addr learned my addr 172.21.15.137:0/652477415 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705b3a640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe70014bc60 0x7fe70015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe704b38640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70014b800 0x7fe7001f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705339640 1 -- 172.21.15.137:0/652477415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70014b800 msgr2=0x7fe7001f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705339640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70014b800 0x7fe7001f6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705339640 1 -- 172.21.15.137:0/652477415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe70014bc60 msgr2=0x7fe70015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705339640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe70014bc60 0x7fe70015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705339640 1 -- 172.21.15.137:0/652477415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7001f6180 con 0x7fe6ec004d40 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705b3a640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe70014bc60 0x7fe70015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe705339640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe7001f5c40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8007310 tx=0x7fe6f80077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe6f5ffb640 1 -- 172.21.15.137:0/652477415 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800fa00 con 0x7fe6ec004d40 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe6f5ffb640 1 -- 172.21.15.137:0/652477415 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f8018070 con 0x7fe6ec004d40 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70006f200 con 0x7fe6ec004d40 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.738+0000 7fe6f5ffb640 1 -- 172.21.15.137:0/652477415 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800fe00 con 0x7fe6ec004d40 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.739+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70006faa0 con 0x7fe6ec004d40 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.740+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe70006f5f0 con 0x7fe6ec004d40 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.740+0000 7fe6f5ffb640 1 -- 172.21.15.137:0/652477415 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6f801d460 con 0x7fe6ec004d40 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.740+0000 7fe6f5ffb640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6e406c8f0 0x7fe6e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.740+0000 7fe6f5ffb640 1 -- 172.21.15.137:0/652477415 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 4943+0+0 (secure 0 0 0) 0x7fe6f808ba70 con 0x7fe6ec004d40 2024-04-26T22:02:31.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.740+0000 7fe704b38640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6e406c8f0 0x7fe6e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.741+0000 7fe704b38640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6e406c8f0 0x7fe6e406edb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe7000b6d20 tx=0x7fe6f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:31.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.745+0000 7fe6f5ffb640 1 -- 172.21.15.137:0/652477415 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe7001f6180 con 0x7fe6ec004d40 2024-04-26T22:02:31.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.960+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7000693d0 con 0x7fe6ec004d40 2024-04-26T22:02:31.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.961+0000 7fe6f5ffb640 1 -- 172.21.15.137:0/652477415 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3881 (secure 0 0 0) 0x7fe6f805a1a0 con 0x7fe6ec004d40 2024-04-26T22:02:31.961 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:31.961 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5174,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3036679344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3036679344},{"type":"v1","addr":"172.21.15.170:6835","nonce":3036679344}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5527,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/1827743367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1827743367},{"type":"v1","addr":"172.21.15.170:6834","nonce":1827743367}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6835/3376261888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3376261888},{"type":"v1","addr":"172.21.15.137:6835","nonce":3376261888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":6525,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3250016189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6836","nonce":3250016189},{"type":"v1","addr":"172.21.15.137:6837","nonce":3250016189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[]} 2024-04-26T22:02:31.961 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 30 2024-04-26T22:02:31.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6e406c8f0 msgr2=0x7fe6e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6e406c8f0 0x7fe6e406edb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe7000b6d20 tx=0x7fe6f0008040 comp rx=0 tx=0).stop 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 msgr2=0x7fe7001f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe7001f5c40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8007310 tx=0x7fe6f80077d0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 shutdown_connections 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6e406c8f0 0x7fe6e406edb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe70014bc60 0x7fe70015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe70014b800 0x7fe7001f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 --2- 172.21.15.137:0/652477415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6ec004d40 0x7fe7001f5c40 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 >> 172.21.15.137:0/652477415 conn(0x7fe7000b3b10 msgr2=0x7fe700155a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 shutdown_connections 2024-04-26T22:02:31.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:31.963+0000 7fe70759d640 1 -- 172.21.15.137:0/652477415 wait complete. 2024-04-26T22:02:31.974 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T22:02:31.975 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T22:02:31.975 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:02:31.975 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:02:31.975 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T22:02:31.975 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T22:02:31.975 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T22:02:31.975 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:02:31.976 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T22:02:31.976 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T22:02:31.976 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:02:31.976 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:02:31.976 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T22:02:31.976 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T22:02:31.976 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T22:02:31.976 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:02:31.984 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:02:31.985 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T22:02:31.985 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T22:02:31.986 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T22:02:31.987 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T22:02:31.988 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T22:02:31.988 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:02:31.989 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T22:02:32.027 INFO:tasks.ceph.mds.a:Started 2024-04-26T22:02:32.028 DEBUG:teuthology.parallel:result is None 2024-04-26T22:02:32.028 INFO:tasks.ceph.mds.c:Started 2024-04-26T22:02:32.028 DEBUG:teuthology.parallel:result is None 2024-04-26T22:02:32.031 INFO:tasks.ceph.mds.d:Started 2024-04-26T22:02:32.031 DEBUG:teuthology.parallel:result is None 2024-04-26T22:02:32.031 INFO:tasks.ceph.mds.b:Started 2024-04-26T22:02:32.032 DEBUG:teuthology.parallel:result is None 2024-04-26T22:02:32.032 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T22:02:32.101 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:02:32.101 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:02:32.109 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T22:02:32.110 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T22:02:32.111 INFO:tasks.ceph.mds.b.smithi170.stderr:2024-04-26T22:02:32.111+0000 7fdc6daab640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6834/0: (98) Address already in use 2024-04-26T22:02:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.134+0000 7f8a37b0a640 1 Processor -- start 2024-04-26T22:02:32.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.134+0000 7f8a37b0a640 1 -- start start 2024-04-26T22:02:32.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a37b0a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8a300b0980 0x7f8a30160560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a37b0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300b0d60 0x7f8a3006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a37b0a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8a3006d7f0 0x7f8a300b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a37b0a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8a3006dc40 con 0x7f8a300b0980 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a37b0a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8a300ce890 con 0x7f8a3006d7f0 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a37b0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8a300cd9e0 con 0x7f8a300b0d60 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a358a6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8a300b0980 0x7f8a30160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a358a6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8a300b0980 0x7f8a30160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44146/0 (socket says 172.21.15.137:44146) 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a358a6640 1 -- 172.21.15.137:0/1361857520 learned_addr learned my addr 172.21.15.137:0/1361857520 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a360a7640 1 --2- 172.21.15.137:0/1361857520 >> v2:172.21.15.170:3300/0 conn(0x7f8a3006d7f0 0x7f8a300b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.135+0000 7f8a350a5640 1 --2- 172.21.15.137:0/1361857520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300b0d60 0x7f8a3006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a358a6640 1 -- 172.21.15.137:0/1361857520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300b0d60 msgr2=0x7f8a3006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:32.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a358a6640 1 --2- 172.21.15.137:0/1361857520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300b0d60 0x7f8a3006d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a358a6640 1 -- 172.21.15.137:0/1361857520 >> v2:172.21.15.170:3300/0 conn(0x7f8a3006d7f0 msgr2=0x7f8a300b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a358a6640 1 --2- 172.21.15.137:0/1361857520 >> v2:172.21.15.170:3300/0 conn(0x7f8a3006d7f0 0x7f8a300b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a358a6640 1 -- 172.21.15.137:0/1361857520 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a30160aa0 con 0x7f8a300b0980 2024-04-26T22:02:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a350a5640 1 --2- 172.21.15.137:0/1361857520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300b0d60 0x7f8a3006d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a358a6640 1 --2- 172.21.15.137:0/1361857520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0980 0x7f8a30160560 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8a300b1410 tx=0x7f8a2c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2452eb3cee9149e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a348a4640 1 -- 172.21.15.137:0/1361857520 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c032790 con 0x7f8a300b0980 2024-04-26T22:02:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a348a4640 1 -- 172.21.15.137:0/1361857520 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2c038070 con 0x7f8a300b0980 2024-04-26T22:02:32.138 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.136+0000 7f8a348a4640 1 -- 172.21.15.137:0/1361857520 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c032b50 con 0x7f8a300b0980 2024-04-26T22:02:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.137+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1361857520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0980 msgr2=0x7f8a30160560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.137+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1361857520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0980 0x7f8a30160560 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8a300b1410 tx=0x7f8a2c02c890 comp rx=0 tx=0).stop 2024-04-26T22:02:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.137+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1361857520 shutdown_connections 2024-04-26T22:02:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.137+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1361857520 >> v2:172.21.15.170:3300/0 conn(0x7f8a3006d7f0 0x7f8a300b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.137+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1361857520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a300b0d60 0x7f8a3006d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.137+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1361857520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0980 0x7f8a30160560 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.137+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1361857520 >> 172.21.15.137:0/1361857520 conn(0x7f8a30072cf0 msgr2=0x7f8a30073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.137+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1361857520 shutdown_connections 2024-04-26T22:02:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.137+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1361857520 wait complete. 2024-04-26T22:02:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.139+0000 7f8a37b0a640 1 Processor -- start 2024-04-26T22:02:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.139+0000 7f8a37b0a640 1 -- start start 2024-04-26T22:02:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a37b0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a3006d7f0 0x7f8a3006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a37b0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a300b0980 0x7f8a3015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a37b0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0d60 0x7f8a300d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a37b0a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8a300ce240 con 0x7f8a300b0d60 2024-04-26T22:02:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a37b0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8a300cdf60 con 0x7f8a300b0980 2024-04-26T22:02:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a37b0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8a300ce520 con 0x7f8a3006d7f0 2024-04-26T22:02:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a360a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0d60 0x7f8a300d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a360a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0d60 0x7f8a300d02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44154/0 (socket says 172.21.15.137:44154) 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a360a7640 1 -- 172.21.15.137:0/1298914927 learned_addr learned my addr 172.21.15.137:0/1298914927 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a358a6640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a3006d7f0 0x7f8a3006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a350a5640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a300b0980 0x7f8a3015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a360a7640 1 -- 172.21.15.137:0/1298914927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a3006d7f0 msgr2=0x7f8a3006f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a360a7640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a3006d7f0 0x7f8a3006f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a360a7640 1 -- 172.21.15.137:0/1298914927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a300b0980 msgr2=0x7f8a3015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a360a7640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a300b0980 0x7f8a3015d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.140+0000 7f8a360a7640 1 -- 172.21.15.137:0/1298914927 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3006fe80 con 0x7f8a300b0d60 2024-04-26T22:02:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.141+0000 7f8a360a7640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0d60 0x7f8a300d02e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009d30 tx=0x7f8a2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.143+0000 7f8a267fc640 1 -- 172.21.15.137:0/1298914927 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28018020 con 0x7f8a300b0d60 2024-04-26T22:02:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.143+0000 7f8a267fc640 1 -- 172.21.15.137:0/1298914927 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a28014480 con 0x7f8a300b0d60 2024-04-26T22:02:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.143+0000 7f8a267fc640 1 -- 172.21.15.137:0/1298914927 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28014870 con 0x7f8a300b0d60 2024-04-26T22:02:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.143+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a30070160 con 0x7f8a300b0d60 2024-04-26T22:02:32.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.143+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a30070720 con 0x7f8a300b0d60 2024-04-26T22:02:32.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.144+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a300693d0 con 0x7f8a300b0d60 2024-04-26T22:02:32.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.144+0000 7f8a267fc640 1 -- 172.21.15.137:0/1298914927 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a28005d10 con 0x7f8a300b0d60 2024-04-26T22:02:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.145+0000 7f8a267fc640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8a1406c8f0 0x7f8a1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.145+0000 7f8a267fc640 1 -- 172.21.15.137:0/1298914927 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 4943+0+0 (secure 0 0 0) 0x7f8a2808c220 con 0x7f8a300b0d60 2024-04-26T22:02:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.145+0000 7f8a358a6640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8a1406c8f0 0x7f8a1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.145+0000 7f8a358a6640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8a1406c8f0 0x7f8a1406edb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c037000 tx=0x7f8a2c032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:32.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.149+0000 7f8a267fc640 1 -- 172.21.15.137:0/1298914927 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8a28022070 con 0x7f8a300b0d60 2024-04-26T22:02:32.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-26T22:02:32.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:32.333+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8a300b62e0 con 0x7f8a300b0d60 2024-04-26T22:02:33.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.142+0000 7f8a267fc640 1 -- 172.21.15.137:0/1298914927 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) ==== 97+0+0 (secure 0 0 0) 0x7f8a28010040 con 0x7f8a300b0d60 2024-04-26T22:02:33.142 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T22:02:33.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8a1406c8f0 msgr2=0x7f8a1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8a1406c8f0 0x7f8a1406edb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c037000 tx=0x7f8a2c032000 comp rx=0 tx=0).stop 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0d60 msgr2=0x7f8a300d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0d60 0x7f8a300d02e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009d30 tx=0x7f8a2800c490 comp rx=0 tx=0).stop 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 shutdown_connections 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8a1406c8f0 0x7f8a1406edb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8a300b0d60 0x7f8a300d02e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a300b0980 0x7f8a3015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 --2- 172.21.15.137:0/1298914927 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8a3006d7f0 0x7f8a3006f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 >> 172.21.15.137:0/1298914927 conn(0x7f8a30072cf0 msgr2=0x7f8a300b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 shutdown_connections 2024-04-26T22:02:33.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.145+0000 7f8a37b0a640 1 -- 172.21.15.137:0/1298914927 wait complete. 2024-04-26T22:02:33.158 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T22:02:33.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.258+0000 7f040c693640 1 Processor -- start 2024-04-26T22:02:33.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.258+0000 7f040c693640 1 -- start start 2024-04-26T22:02:33.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.259+0000 7f040c693640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f040415f1e0 0x7f040406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.259+0000 7f040c693640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04040b4a10 con 0x7f04040b44e0 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.259+0000 7f040c693640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04040b4cf0 con 0x7f040406d2b0 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.259+0000 7f040c693640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f040406eeb0 con 0x7f040415f1e0 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.259+0000 7f040a42f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f040415f1e0 0x7f040406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.259+0000 7f0409c2e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f04040b44e0 0x7f04040ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52878/0 (socket says 172.21.15.137:52878) 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.259+0000 7f0409c2e640 1 -- 172.21.15.137:0/278704399 learned_addr learned my addr 172.21.15.137:0/278704399 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.260+0000 7f040a42f640 1 -- 172.21.15.137:0/278704399 >> v1:172.21.15.170:6789/0 conn(0x7f040406d2b0 legacy=0x7f04040b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.260+0000 7f040a42f640 1 -- 172.21.15.137:0/278704399 >> v1:172.21.15.137:6789/0 conn(0x7f04040b44e0 legacy=0x7f04040ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.260+0000 7f040a42f640 1 -- 172.21.15.137:0/278704399 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04040b4fd0 con 0x7f040415f1e0 2024-04-26T22:02:33.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.260+0000 7f040942d640 1 -- 172.21.15.137:0/278704399 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264601615 0 0) 0x7f04040b4a10 con 0x7f04040b44e0 2024-04-26T22:02:33.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.260+0000 7f040a42f640 1 --2- 172.21.15.137:0/278704399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040415f1e0 0x7f040406e970 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0400009d90 tx=0x7f040002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8186a0a3555d728 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.260+0000 7f040942d640 1 -- 172.21.15.137:0/278704399 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400007740 con 0x7f040415f1e0 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.260+0000 7f040942d640 1 -- 172.21.15.137:0/278704399 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04000078e0 con 0x7f040415f1e0 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.260+0000 7f040942d640 1 -- 172.21.15.137:0/278704399 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400007cb0 con 0x7f040415f1e0 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.261+0000 7f040c693640 1 -- 172.21.15.137:0/278704399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040415f1e0 msgr2=0x7f040406e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.261+0000 7f040c693640 1 --2- 172.21.15.137:0/278704399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040415f1e0 0x7f040406e970 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0400009d90 tx=0x7f040002a6f0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.261+0000 7f040c693640 1 -- 172.21.15.137:0/278704399 shutdown_connections 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.261+0000 7f040c693640 1 --2- 172.21.15.137:0/278704399 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040415f1e0 0x7f040406e970 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.261+0000 7f040c693640 1 -- 172.21.15.137:0/278704399 >> 172.21.15.137:0/278704399 conn(0x7f04040728a0 msgr2=0x7f0404072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.261+0000 7f040c693640 1 -- 172.21.15.137:0/278704399 shutdown_connections 2024-04-26T22:02:33.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.261+0000 7f040c693640 1 -- 172.21.15.137:0/278704399 wait complete. 2024-04-26T22:02:33.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.262+0000 7f040c693640 1 Processor -- start 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.262+0000 7f040c693640 1 -- start start 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040c693640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040406d2b0 0x7f040406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040c693640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04040b44e0 0x7f04040702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040c693640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040415f1e0 0x7f04041f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040c693640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f040415f5c0 con 0x7f040406d2b0 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040c693640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f04040b5590 con 0x7f04040b44e0 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040c693640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04041f5d00 con 0x7f040415f1e0 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040a42f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040406d2b0 0x7f040406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040a42f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040406d2b0 0x7f040406fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44178/0 (socket says 172.21.15.137:44178) 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040a42f640 1 -- 172.21.15.137:0/3538011266 learned_addr learned my addr 172.21.15.137:0/3538011266 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040a42f640 1 -- 172.21.15.137:0/3538011266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040415f1e0 msgr2=0x7f04041f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040a42f640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040415f1e0 0x7f04041f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040a42f640 1 -- 172.21.15.137:0/3538011266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04040b44e0 msgr2=0x7f04040702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040a42f640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04040b44e0 0x7f04040702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040a42f640 1 -- 172.21.15.137:0/3538011266 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04041609c0 con 0x7f040406d2b0 2024-04-26T22:02:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.263+0000 7f040a42f640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040406d2b0 0x7f040406fd60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0400009eb0 tx=0x7f0400004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.264+0000 7f03faffd640 1 -- 172.21.15.137:0/3538011266 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040003f070 con 0x7f040406d2b0 2024-04-26T22:02:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.264+0000 7f03faffd640 1 -- 172.21.15.137:0/3538011266 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0400031d00 con 0x7f040406d2b0 2024-04-26T22:02:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.264+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0404160ca0 con 0x7f040406d2b0 2024-04-26T22:02:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.264+0000 7f03faffd640 1 -- 172.21.15.137:0/3538011266 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400044660 con 0x7f040406d2b0 2024-04-26T22:02:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.264+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0404161260 con 0x7f040406d2b0 2024-04-26T22:02:33.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.265+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040406a290 con 0x7f040406d2b0 2024-04-26T22:02:33.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.265+0000 7f03faffd640 1 -- 172.21.15.137:0/3538011266 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f040003b410 con 0x7f040406d2b0 2024-04-26T22:02:33.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.266+0000 7f03faffd640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03e806c970 0x7f03e806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.266+0000 7f03faffd640 1 -- 172.21.15.137:0/3538011266 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4857+0+0 (secure 0 0 0) 0x7f04000ad020 con 0x7f040406d2b0 2024-04-26T22:02:33.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.266+0000 7f0409c2e640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03e806c970 0x7f03e806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.266+0000 7f0409c2e640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03e806c970 0x7f03e806ee30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f03f4007fd0 tx=0x7f03f4007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:33.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.270+0000 7f03faffd640 1 -- 172.21.15.137:0/3538011266 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f040007b2c0 con 0x7f040406d2b0 2024-04-26T22:02:33.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.514+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f04040aebf0 con 0x7f040406d2b0 2024-04-26T22:02:33.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.514+0000 7f03faffd640 1 -- 172.21.15.137:0/3538011266 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f040007f5c0 con 0x7f040406d2b0 2024-04-26T22:02:33.514 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:33.514 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:02:33.514 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmKffkBRAAh7EvvT0pmNbLKtJsBH/25Q==", 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmd5UHERAAykWO/C56qwLwimzH2f6mcA==", 2024-04-26T22:02:33.515 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmMbCsDBAANF98tMtCSOy4TVN7I498cw==", 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:02:33.516 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmQ47KFxAAsreL970BTH5yQLOol942iQ==", 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T22:02:33.517 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBcIyxmY2T8NhAAMyJ5OP3dhuqMymrlUG4q2A==", 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBfIyxmNfGnNRAAp+tTaVBwfAMUsyqRSgoRvw==", 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:02:33.518 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBiIyxm3Q1yMxAAf7f6Me7uKYzM+Fp+2FCQsA==", 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlIyxmFcj2MRAAL/yPxOwtgMnfbmr0YUZs6Q==", 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBpIyxmaaAqORAAfowCddy0wT/LptWvqD4CDw==", 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBsIyxmJaOFNhAAqjJAuU/SoVnjIAYCODWMnA==", 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBvIyxmRkINNBAAjfFLMQ9/XMLLU8ZAoUxvkQ==", 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:02:33.521 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQByIyxmeF1gMRAAH0t727lSCZgkTgJ0ZXyA6g==", 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T22:02:33.522 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ==", 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow r", 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxms4U0JBAAMZ056L4EP1qzX2KVx8JiEg==", 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:02:33.523 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmUnswIRAA5nYDanYzHiEVk98/041RHA==", 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T22:02:33.524 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmHOORKRAA6Agn7TqBPywtop3Eo8+yFQ==", 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxm7ue6JhAAyLiai4CKXmiB00fCAfp2WA==", 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.525 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmFBrPAhAAfrkQvzF5SSyb5iQ0zr0eww==", 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxmlrq3OhAA9Fd+zmECU9xK/pWp2Hg9kg==", 2024-04-26T22:02:33.526 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:02:33.527 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:02:33.527 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:02:33.527 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:02:33.527 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.527 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:33.527 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T22:02:33.527 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:02:33.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03e806c970 msgr2=0x7f03e806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03e806c970 0x7f03e806ee30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f03f4007fd0 tx=0x7f03f4007900 comp rx=0 tx=0).stop 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040406d2b0 msgr2=0x7f040406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040406d2b0 0x7f040406fd60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0400009eb0 tx=0x7f0400004a40 comp rx=0 tx=0).stop 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 shutdown_connections 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03e806c970 0x7f03e806ee30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f040415f1e0 0x7f04041f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04040b44e0 0x7f04040702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 --2- 172.21.15.137:0/3538011266 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f040406d2b0 0x7f040406fd60 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 >> 172.21.15.137:0/3538011266 conn(0x7f04040728a0 msgr2=0x7f040406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 shutdown_connections 2024-04-26T22:02:33.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.516+0000 7f040c693640 1 -- 172.21.15.137:0/3538011266 wait complete. 2024-04-26T22:02:33.530 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.627+0000 7fbc48ff0640 1 Processor -- start 2024-04-26T22:02:33.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.627+0000 7fbc48ff0640 1 -- start start 2024-04-26T22:02:33.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.627+0000 7fbc48ff0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbc44145980 0x7fbc44160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.627+0000 7fbc48ff0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbc440b61a0 0x7fbc440720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.627+0000 7fbc48ff0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc440b4260 con 0x7fbc440b3de0 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.627+0000 7fbc48ff0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbc440b5140 con 0x7fbc440b61a0 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.627+0000 7fbc48ff0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbc440b4530 con 0x7fbc44145980 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.628+0000 7fbc42d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbc440b61a0 0x7fbc440720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.628+0000 7fbc42d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbc440b61a0 0x7fbc440720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44182/0 (socket says 172.21.15.137:44182) 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.628+0000 7fbc42d9d640 1 -- 172.21.15.137:0/1897573849 learned_addr learned my addr 172.21.15.137:0/1897573849 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.628+0000 7fbc42d9d640 1 -- 172.21.15.137:0/1897573849 >> v2:172.21.15.170:3300/0 conn(0x7fbc44145980 msgr2=0x7fbc44160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.628+0000 7fbc42d9d640 1 --2- 172.21.15.137:0/1897573849 >> v2:172.21.15.170:3300/0 conn(0x7fbc44145980 0x7fbc44160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.628+0000 7fbc42d9d640 1 -- 172.21.15.137:0/1897573849 >> v1:172.21.15.170:6789/0 conn(0x7fbc440b3de0 legacy=0x7fbc440b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.628+0000 7fbc42d9d640 1 -- 172.21.15.137:0/1897573849 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc440b4810 con 0x7fbc440b61a0 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc42d9d640 1 --2- 172.21.15.137:0/1897573849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 0x7fbc440720d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbc4406ff10 tx=0x7fbc3c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f6c01a3ba3e214 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc41d9b640 1 -- 172.21.15.137:0/1897573849 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c036070 con 0x7fbc440b61a0 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc41d9b640 1 -- 172.21.15.137:0/1897573849 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc3c031600 con 0x7fbc440b61a0 2024-04-26T22:02:33.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc41d9b640 1 -- 172.21.15.137:0/1897573849 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0319d0 con 0x7fbc440b61a0 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc48ff0640 1 -- 172.21.15.137:0/1897573849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 msgr2=0x7fbc440720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc48ff0640 1 --2- 172.21.15.137:0/1897573849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 0x7fbc440720d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fbc4406ff10 tx=0x7fbc3c02a660 comp rx=0 tx=0).stop 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc48ff0640 1 -- 172.21.15.137:0/1897573849 shutdown_connections 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc48ff0640 1 --2- 172.21.15.137:0/1897573849 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 0x7fbc440720d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc48ff0640 1 --2- 172.21.15.137:0/1897573849 >> v2:172.21.15.170:3300/0 conn(0x7fbc44145980 0x7fbc44160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc48ff0640 1 -- 172.21.15.137:0/1897573849 >> 172.21.15.137:0/1897573849 conn(0x7fbc440d0d30 msgr2=0x7fbc440d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc48ff0640 1 -- 172.21.15.137:0/1897573849 shutdown_connections 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.629+0000 7fbc48ff0640 1 -- 172.21.15.137:0/1897573849 wait complete. 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc48ff0640 1 Processor -- start 2024-04-26T22:02:33.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc48ff0640 1 -- start start 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc48ff0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc440b3de0 0x7fbc440abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc48ff0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 0x7fbc440b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc48ff0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc44145980 0x7fbc4415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc48ff0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44072610 con 0x7fbc440b61a0 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc48ff0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbc440b4dd0 con 0x7fbc44145980 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc48ff0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbc44072790 con 0x7fbc440b3de0 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc3bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 0x7fbc440b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc3bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 0x7fbc440b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44196/0 (socket says 172.21.15.137:44196) 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.631+0000 7fbc3bfff640 1 -- 172.21.15.137:0/2638043007 learned_addr learned my addr 172.21.15.137:0/2638043007 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc4259c640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc440b3de0 0x7fbc440abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc42d9d640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc44145980 0x7fbc4415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc3bfff640 1 -- 172.21.15.137:0/2638043007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc440b3de0 msgr2=0x7fbc440abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc3bfff640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc440b3de0 0x7fbc440abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc3bfff640 1 -- 172.21.15.137:0/2638043007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc44145980 msgr2=0x7fbc4415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc3bfff640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc44145980 0x7fbc4415b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc3bfff640 1 -- 172.21.15.137:0/2638043007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc441f6980 con 0x7fbc440b61a0 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc4259c640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc440b3de0 0x7fbc440abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc3bfff640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 0x7fbc440b2780 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c440 tx=0x7fbc2c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc3affd640 1 -- 172.21.15.137:0/2638043007 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c017070 con 0x7fbc440b61a0 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc3affd640 1 -- 172.21.15.137:0/2638043007 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2c0035f0 con 0x7fbc440b61a0 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc441f6c60 con 0x7fbc440b61a0 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc3affd640 1 -- 172.21.15.137:0/2638043007 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c0039e0 con 0x7fbc440b61a0 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.632+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc441f7220 con 0x7fbc440b61a0 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.633+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4406a290 con 0x7fbc440b61a0 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.633+0000 7fbc3affd640 1 -- 172.21.15.137:0/2638043007 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc2c01a070 con 0x7fbc440b61a0 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.634+0000 7fbc3affd640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbc2406c8f0 0x7fbc2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.634+0000 7fbc3affd640 1 -- 172.21.15.137:0/2638043007 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4857+0+0 (secure 0 0 0) 0x7fbc2c08abb0 con 0x7fbc440b61a0 2024-04-26T22:02:33.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.634+0000 7fbc4259c640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbc2406c8f0 0x7fbc2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.634+0000 7fbc4259c640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbc2406c8f0 0x7fbc2406edb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbc4415f420 tx=0x7fbc34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:33.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.638+0000 7fbc3affd640 1 -- 172.21.15.137:0/2638043007 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbc2c059330 con 0x7fbc440b61a0 2024-04-26T22:02:33.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.816+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc44073cc0 con 0x7fbc440b61a0 2024-04-26T22:02:33.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.817+0000 7fbc3affd640 1 -- 172.21.15.137:0/2638043007 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+12903 (secure 0 0 0) 0x7fbc2c0010c0 con 0x7fbc440b61a0 2024-04-26T22:02:33.817 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:33.817 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":68,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:02:33.141792+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbc2406c8f0 msgr2=0x7fbc2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbc2406c8f0 0x7fbc2406edb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbc4415f420 tx=0x7fbc34008040 comp rx=0 tx=0).stop 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 msgr2=0x7fbc440b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 0x7fbc440b2780 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00c440 tx=0x7fbc2c00c900 comp rx=0 tx=0).stop 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 shutdown_connections 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbc2406c8f0 0x7fbc2406edb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc440b61a0 0x7fbc440b2780 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc44145980 0x7fbc4415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 --2- 172.21.15.137:0/2638043007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc440b3de0 0x7fbc440abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.819+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 >> 172.21.15.137:0/2638043007 conn(0x7fbc440d0d30 msgr2=0x7fbc440d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.820+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 shutdown_connections 2024-04-26T22:02:33.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.820+0000 7fbc48ff0640 1 -- 172.21.15.137:0/2638043007 wait complete. 2024-04-26T22:02:33.831 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:02:33.831 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:02:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.931+0000 7fd48d23f640 1 Processor -- start 2024-04-26T22:02:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.932+0000 7fd48d23f640 1 -- start start 2024-04-26T22:02:33.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.932+0000 7fd48d23f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd48815f680 0x7fd4880d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.932+0000 7fd48d23f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd488163aa0 0x7fd4880b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.932+0000 7fd48d23f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4880d3f50 con 0x7fd4880b60b0 2024-04-26T22:02:33.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.932+0000 7fd48d23f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd48815fa60 con 0x7fd488163aa0 2024-04-26T22:02:33.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.932+0000 7fd48d23f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd4880b5090 con 0x7fd48815f680 2024-04-26T22:02:33.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.932+0000 7fd48659c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd488163aa0 0x7fd4880b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.932+0000 7fd48759e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd4880b60b0 0x7fd4880d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52890/0 (socket says 172.21.15.137:52890) 2024-04-26T22:02:33.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.932+0000 7fd48759e640 1 -- 172.21.15.137:0/3880070982 learned_addr learned my addr 172.21.15.137:0/3880070982 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:33.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.933+0000 7fd486d9d640 1 --2- 172.21.15.137:0/3880070982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd48815f680 0x7fd4880d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.933+0000 7fd48659c640 1 -- 172.21.15.137:0/3880070982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd48815f680 msgr2=0x7fd4880d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:33.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.933+0000 7fd48659c640 1 --2- 172.21.15.137:0/3880070982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd48815f680 0x7fd4880d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.933+0000 7fd48659c640 1 -- 172.21.15.137:0/3880070982 >> v1:172.21.15.137:6789/0 conn(0x7fd4880b60b0 legacy=0x7fd4880d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.933+0000 7fd485d9b640 1 -- 172.21.15.137:0/3880070982 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597435575 0 0) 0x7fd4880d3f50 con 0x7fd4880b60b0 2024-04-26T22:02:33.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.933+0000 7fd48659c640 1 -- 172.21.15.137:0/3880070982 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4880b5370 con 0x7fd488163aa0 2024-04-26T22:02:33.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.933+0000 7fd48659c640 1 --2- 172.21.15.137:0/3880070982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd488163aa0 0x7fd4880b5b70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd4780097a0 tx=0x7fd47802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c16b70efe3e5845 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:33.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd485d9b640 1 -- 172.21.15.137:0/3880070982 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478037070 con 0x7fd488163aa0 2024-04-26T22:02:33.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd485d9b640 1 -- 172.21.15.137:0/3880070982 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd478032440 con 0x7fd488163aa0 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd485d9b640 1 -- 172.21.15.137:0/3880070982 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478032810 con 0x7fd488163aa0 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd48d23f640 1 -- 172.21.15.137:0/3880070982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd488163aa0 msgr2=0x7fd4880b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd48d23f640 1 --2- 172.21.15.137:0/3880070982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd488163aa0 0x7fd4880b5b70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd4780097a0 tx=0x7fd47802a180 comp rx=0 tx=0).stop 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd48d23f640 1 -- 172.21.15.137:0/3880070982 shutdown_connections 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd48d23f640 1 --2- 172.21.15.137:0/3880070982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd488163aa0 0x7fd4880b5b70 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd48d23f640 1 --2- 172.21.15.137:0/3880070982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd48815f680 0x7fd4880d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd48d23f640 1 -- 172.21.15.137:0/3880070982 >> 172.21.15.137:0/3880070982 conn(0x7fd48808eca0 msgr2=0x7fd48809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd48d23f640 1 -- 172.21.15.137:0/3880070982 shutdown_connections 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.934+0000 7fd48d23f640 1 -- 172.21.15.137:0/3880070982 wait complete. 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48d23f640 1 Processor -- start 2024-04-26T22:02:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48d23f640 1 -- start start 2024-04-26T22:02:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48d23f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4880b60b0 0x7fd4880cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48d23f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd48815f680 0x7fd4880ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48d23f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd488163aa0 0x7fd4880cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48d23f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd4880d57b0 con 0x7fd48815f680 2024-04-26T22:02:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48d23f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd4880d5630 con 0x7fd4880b60b0 2024-04-26T22:02:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48d23f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd4880d5930 con 0x7fd488163aa0 2024-04-26T22:02:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd48815f680 0x7fd4880ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd48815f680 0x7fd4880ce530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44214/0 (socket says 172.21.15.137:44214) 2024-04-26T22:02:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.936+0000 7fd48659c640 1 -- 172.21.15.137:0/342800973 learned_addr learned my addr 172.21.15.137:0/342800973 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd48759e640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd488163aa0 0x7fd4880cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd486d9d640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4880b60b0 0x7fd4880cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd48659c640 1 -- 172.21.15.137:0/342800973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd488163aa0 msgr2=0x7fd4880cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd48659c640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd488163aa0 0x7fd4880cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd48659c640 1 -- 172.21.15.137:0/342800973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4880b60b0 msgr2=0x7fd4880cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd48659c640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4880b60b0 0x7fd4880cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd48659c640 1 -- 172.21.15.137:0/342800973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4880caae0 con 0x7fd48815f680 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd486d9d640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4880b60b0 0x7fd4880cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd48659c640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd48815f680 0x7fd4880ce530 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd4780097a0 tx=0x7fd4780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd46f7fe640 1 -- 172.21.15.137:0/342800973 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478037050 con 0x7fd48815f680 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd46f7fe640 1 -- 172.21.15.137:0/342800973 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd478038040 con 0x7fd48815f680 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd46f7fe640 1 -- 172.21.15.137:0/342800973 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478004490 con 0x7fd48815f680 2024-04-26T22:02:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4880cadc0 con 0x7fd48815f680 2024-04-26T22:02:33.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.937+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4880cb380 con 0x7fd48815f680 2024-04-26T22:02:33.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.938+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48806a290 con 0x7fd48815f680 2024-04-26T22:02:33.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.939+0000 7fd46f7fe640 1 -- 172.21.15.137:0/342800973 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd478030980 con 0x7fd48815f680 2024-04-26T22:02:33.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.939+0000 7fd46f7fe640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd47406c8f0 0x7fd47406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:33.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.939+0000 7fd46f7fe640 1 -- 172.21.15.137:0/342800973 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4857+0+0 (secure 0 0 0) 0x7fd4780ac570 con 0x7fd48815f680 2024-04-26T22:02:33.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.939+0000 7fd486d9d640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd47406c8f0 0x7fd47406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:33.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.939+0000 7fd486d9d640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd47406c8f0 0x7fd47406edb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00a9d0 tx=0x7fd47c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:33.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:33.943+0000 7fd46f7fe640 1 -- 172.21.15.137:0/342800973 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd47807ae10 con 0x7fd48815f680 2024-04-26T22:02:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.118+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd488068460 con 0x7fd48815f680 2024-04-26T22:02:34.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.119+0000 7fd46f7fe640 1 -- 172.21.15.137:0/342800973 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7fd47807a710 con 0x7fd48815f680 2024-04-26T22:02:34.119 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:02:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd47406c8f0 msgr2=0x7fd47406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd47406c8f0 0x7fd47406edb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00a9d0 tx=0x7fd47c008040 comp rx=0 tx=0).stop 2024-04-26T22:02:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd48815f680 msgr2=0x7fd4880ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd48815f680 0x7fd4880ce530 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd4780097a0 tx=0x7fd4780046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 shutdown_connections 2024-04-26T22:02:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd47406c8f0 0x7fd47406edb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd48815f680 0x7fd4880ce530 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd488163aa0 0x7fd4880cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 --2- 172.21.15.137:0/342800973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4880b60b0 0x7fd4880cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 >> 172.21.15.137:0/342800973 conn(0x7fd48808eca0 msgr2=0x7fd4880b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:34.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 shutdown_connections 2024-04-26T22:02:34.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.121+0000 7fd48d23f640 1 -- 172.21.15.137:0/342800973 wait complete. 2024-04-26T22:02:34.132 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T22:02:34.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.228+0000 7fb69aecc640 1 Processor -- start 2024-04-26T22:02:34.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.228+0000 7fb69aecc640 1 -- start start 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb69aecc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb69413ff70 0x7fb694146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb69aecc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb6940cff20 0x7fb6941465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb69aecc640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6940d05b0 con 0x7fb694140350 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb69aecc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb6940d0890 con 0x7fb69413ff70 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb69aecc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb69406e450 con 0x7fb6940cff20 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb698c68640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb69413ff70 0x7fb694146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb693fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb694140350 0x7fb6940cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52900/0 (socket says 172.21.15.137:52900) 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb698c68640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb69413ff70 0x7fb694146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44228/0 (socket says 172.21.15.137:44228) 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb693fff640 1 -- 172.21.15.137:0/3061507907 learned_addr learned my addr 172.21.15.137:0/3061507907 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb698c68640 1 -- 172.21.15.137:0/3061507907 >> v2:172.21.15.170:3300/0 conn(0x7fb6940cff20 msgr2=0x7fb6941465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb698c68640 1 --2- 172.21.15.137:0/3061507907 >> v2:172.21.15.170:3300/0 conn(0x7fb6940cff20 0x7fb6941465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb698c68640 1 -- 172.21.15.137:0/3061507907 >> v1:172.21.15.137:6789/0 conn(0x7fb694140350 legacy=0x7fb6940cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb698c68640 1 -- 172.21.15.137:0/3061507907 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69406e730 con 0x7fb69413ff70 2024-04-26T22:02:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.229+0000 7fb6937fe640 1 -- 172.21.15.137:0/3061507907 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2739919398 0 0) 0x7fb6940d05b0 con 0x7fb694140350 2024-04-26T22:02:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.230+0000 7fb698c68640 1 --2- 172.21.15.137:0/3061507907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb69413ff70 0x7fb694146080 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb6940cec30 tx=0x7fb68802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae2692a21459034 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.230+0000 7fb6937fe640 1 -- 172.21.15.137:0/3061507907 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688037070 con 0x7fb69413ff70 2024-04-26T22:02:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.230+0000 7fb6937fe640 1 -- 172.21.15.137:0/3061507907 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb688032440 con 0x7fb69413ff70 2024-04-26T22:02:34.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.230+0000 7fb6937fe640 1 -- 172.21.15.137:0/3061507907 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68802ae60 con 0x7fb69413ff70 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.230+0000 7fb69aecc640 1 -- 172.21.15.137:0/3061507907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb69413ff70 msgr2=0x7fb694146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.230+0000 7fb69aecc640 1 --2- 172.21.15.137:0/3061507907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb69413ff70 0x7fb694146080 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb6940cec30 tx=0x7fb68802a110 comp rx=0 tx=0).stop 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.231+0000 7fb69aecc640 1 -- 172.21.15.137:0/3061507907 shutdown_connections 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.231+0000 7fb69aecc640 1 --2- 172.21.15.137:0/3061507907 >> v2:172.21.15.170:3300/0 conn(0x7fb6940cff20 0x7fb6941465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.231+0000 7fb69aecc640 1 --2- 172.21.15.137:0/3061507907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb69413ff70 0x7fb694146080 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.231+0000 7fb69aecc640 1 -- 172.21.15.137:0/3061507907 >> 172.21.15.137:0/3061507907 conn(0x7fb6940d0d30 msgr2=0x7fb6940d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.231+0000 7fb69aecc640 1 -- 172.21.15.137:0/3061507907 shutdown_connections 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.231+0000 7fb69aecc640 1 -- 172.21.15.137:0/3061507907 wait complete. 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.232+0000 7fb69aecc640 1 Processor -- start 2024-04-26T22:02:34.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.232+0000 7fb69aecc640 1 -- start start 2024-04-26T22:02:34.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb69aecc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6940cff20 0x7fb69413c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb69aecc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69413ff70 0x7fb69413b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb69aecc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb694140350 0x7fb6940b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb69aecc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb69406efe0 con 0x7fb694140350 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb69aecc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb69406ee60 con 0x7fb6940cff20 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb69aecc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb69406f160 con 0x7fb69413ff70 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb699469640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb694140350 0x7fb6940b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb699469640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb694140350 0x7fb6940b61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44234/0 (socket says 172.21.15.137:44234) 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb699469640 1 -- 172.21.15.137:0/2967160261 learned_addr learned my addr 172.21.15.137:0/2967160261 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb699469640 1 -- 172.21.15.137:0/2967160261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69413ff70 msgr2=0x7fb69413b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb699469640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69413ff70 0x7fb69413b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb699469640 1 -- 172.21.15.137:0/2967160261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6940cff20 msgr2=0x7fb69413c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb699469640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6940cff20 0x7fb69413c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb699469640 1 -- 172.21.15.137:0/2967160261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6941587f0 con 0x7fb694140350 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb699469640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb694140350 0x7fb6940b61b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00b9a0 tx=0x7fb68c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb6917fa640 1 -- 172.21.15.137:0/2967160261 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c019070 con 0x7fb694140350 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb6917fa640 1 -- 172.21.15.137:0/2967160261 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c00cbc0 con 0x7fb694140350 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb6917fa640 1 -- 172.21.15.137:0/2967160261 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c014440 con 0x7fb694140350 2024-04-26T22:02:34.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb694158ad0 con 0x7fb694140350 2024-04-26T22:02:34.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.233+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb694159090 con 0x7fb694140350 2024-04-26T22:02:34.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.234+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69406a290 con 0x7fb694140350 2024-04-26T22:02:34.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.235+0000 7fb6917fa640 1 -- 172.21.15.137:0/2967160261 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb68c01c070 con 0x7fb694140350 2024-04-26T22:02:34.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.235+0000 7fb6917fa640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb67806c920 0x7fb67806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.235+0000 7fb698c68640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb67806c920 0x7fb67806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:34.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.235+0000 7fb6917fa640 1 -- 172.21.15.137:0/2967160261 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4857+0+0 (secure 0 0 0) 0x7fb68c08b520 con 0x7fb694140350 2024-04-26T22:02:34.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.236+0000 7fb698c68640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb67806c920 0x7fb67806ede0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb688034000 tx=0x7fb68802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:34.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.240+0000 7fb6917fa640 1 -- 172.21.15.137:0/2967160261 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb68c059ca0 con 0x7fb694140350 2024-04-26T22:02:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.415+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb69413c1a0 con 0x7fb694140350 2024-04-26T22:02:34.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.415+0000 7fb6917fa640 1 -- 172.21.15.137:0/2967160261 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7fb68c0595a0 con 0x7fb694140350 2024-04-26T22:02:34.416 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:34.416 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:02:34.416 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:02:34.416 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T22:02:34.416 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T22:02:34.416 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:34.416 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.417+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb67806c920 msgr2=0x7fb67806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.417+0000 7fb69aecc640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb67806c920 0x7fb67806ede0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb688034000 tx=0x7fb68802c000 comp rx=0 tx=0).stop 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.417+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb694140350 msgr2=0x7fb6940b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.417+0000 7fb69aecc640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb694140350 0x7fb6940b61b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00b9a0 tx=0x7fb68c00be60 comp rx=0 tx=0).stop 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.418+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 shutdown_connections 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.418+0000 7fb69aecc640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb67806c920 0x7fb67806ede0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.418+0000 7fb69aecc640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb694140350 0x7fb6940b61b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.418+0000 7fb69aecc640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb69413ff70 0x7fb69413b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.418+0000 7fb69aecc640 1 --2- 172.21.15.137:0/2967160261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6940cff20 0x7fb69413c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.418+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 >> 172.21.15.137:0/2967160261 conn(0x7fb6940d0d30 msgr2=0x7fb694140730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.418+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 shutdown_connections 2024-04-26T22:02:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.418+0000 7fb69aecc640 1 -- 172.21.15.137:0/2967160261 wait complete. 2024-04-26T22:02:34.430 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T22:02:34.430 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T22:02:34.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.531+0000 7f74ba591640 1 Processor -- start 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.531+0000 7f74ba591640 1 -- start start 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74ba591640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f74b40b4620 0x7f74b40b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74ba591640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f74b40cdef0 0x7f74b406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74ba591640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b40b4a00 con 0x7f74b415bed0 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74ba591640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f74b406ff10 con 0x7f74b40b4620 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74ba591640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f74b4141e10 con 0x7f74b40cdef0 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74b3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f74b40b4620 0x7f74b40b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74b3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f74b40b4620 0x7f74b40b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44240/0 (socket says 172.21.15.137:44240) 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74b37fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f74b415bed0 0x7f74b40cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52910/0 (socket says 172.21.15.137:52910) 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74b3fff640 1 -- 172.21.15.137:0/3003264379 learned_addr learned my addr 172.21.15.137:0/3003264379 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74b3fff640 1 -- 172.21.15.137:0/3003264379 >> v2:172.21.15.170:3300/0 conn(0x7f74b40cdef0 msgr2=0x7f74b406f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74b3fff640 1 --2- 172.21.15.137:0/3003264379 >> v2:172.21.15.170:3300/0 conn(0x7f74b40cdef0 0x7f74b406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74b3fff640 1 -- 172.21.15.137:0/3003264379 >> v1:172.21.15.137:6789/0 conn(0x7f74b415bed0 legacy=0x7f74b40cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.532+0000 7f74b3fff640 1 -- 172.21.15.137:0/3003264379 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b4141200 con 0x7f74b40b4620 2024-04-26T22:02:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74b3fff640 1 --2- 172.21.15.137:0/3003264379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40b4620 0x7f74b40b5eb0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f74b40d0d50 tx=0x7f74a402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0b939507de467d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:34.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74b2ffd640 1 -- 172.21.15.137:0/3003264379 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4036020 con 0x7f74b40b4620 2024-04-26T22:02:34.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74b2ffd640 1 -- 172.21.15.137:0/3003264379 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a4032640 con 0x7f74b40b4620 2024-04-26T22:02:34.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74b2ffd640 1 -- 172.21.15.137:0/3003264379 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4032a10 con 0x7f74b40b4620 2024-04-26T22:02:34.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74ba591640 1 -- 172.21.15.137:0/3003264379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40b4620 msgr2=0x7f74b40b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74ba591640 1 --2- 172.21.15.137:0/3003264379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40b4620 0x7f74b40b5eb0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f74b40d0d50 tx=0x7f74a402c940 comp rx=0 tx=0).stop 2024-04-26T22:02:34.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74ba591640 1 -- 172.21.15.137:0/3003264379 shutdown_connections 2024-04-26T22:02:34.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74ba591640 1 --2- 172.21.15.137:0/3003264379 >> v2:172.21.15.170:3300/0 conn(0x7f74b40cdef0 0x7f74b406f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74ba591640 1 --2- 172.21.15.137:0/3003264379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40b4620 0x7f74b40b5eb0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.533+0000 7f74ba591640 1 -- 172.21.15.137:0/3003264379 >> 172.21.15.137:0/3003264379 conn(0x7f74b406c690 msgr2=0x7f74b406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:34.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.534+0000 7f74ba591640 1 -- 172.21.15.137:0/3003264379 shutdown_connections 2024-04-26T22:02:34.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.534+0000 7f74ba591640 1 -- 172.21.15.137:0/3003264379 wait complete. 2024-04-26T22:02:34.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.535+0000 7f74ba591640 1 Processor -- start 2024-04-26T22:02:34.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.535+0000 7f74ba591640 1 -- start start 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74ba591640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b40b4620 0x7f74b413f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74ba591640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40cdef0 0x7f74b40cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74ba591640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74b415bed0 0x7f74b40d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74ba591640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4141aa0 con 0x7f74b40cdef0 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74ba591640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41417c0 con 0x7f74b40b4620 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74ba591640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f74b40d1190 con 0x7f74b415bed0 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40cdef0 0x7f74b40cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40cdef0 0x7f74b40cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44254/0 (socket says 172.21.15.137:44254) 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b37fe640 1 -- 172.21.15.137:0/2571674910 learned_addr learned my addr 172.21.15.137:0/2571674910 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:34.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b37fe640 1 -- 172.21.15.137:0/2571674910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74b415bed0 msgr2=0x7f74b40d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b37fe640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74b415bed0 0x7f74b40d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b37fe640 1 -- 172.21.15.137:0/2571674910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b40b4620 msgr2=0x7f74b413f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b37fe640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b40b4620 0x7f74b413f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b37fe640 1 -- 172.21.15.137:0/2571674910 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b40aafc0 con 0x7f74b40cdef0 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b37fe640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40cdef0 0x7f74b40cfde0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c3c0 tx=0x7f74a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b0ff9640 1 -- 172.21.15.137:0/2571674910 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a80074e0 con 0x7f74b40cdef0 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b0ff9640 1 -- 172.21.15.137:0/2571674910 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a8007680 con 0x7f74b40cdef0 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b40ab2a0 con 0x7f74b40cdef0 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74b0ff9640 1 -- 172.21.15.137:0/2571674910 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8004a00 con 0x7f74b40cdef0 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.536+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b40ab860 con 0x7f74b40cdef0 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.537+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b406a290 con 0x7f74b40cdef0 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.538+0000 7f74b0ff9640 1 -- 172.21.15.137:0/2571674910 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74a801a020 con 0x7f74b40cdef0 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.538+0000 7f74b0ff9640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f74a006c8f0 0x7f74a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:34.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.538+0000 7f74b0ff9640 1 -- 172.21.15.137:0/2571674910 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 4857+0+0 (secure 0 0 0) 0x7f74a808b030 con 0x7f74b40cdef0 2024-04-26T22:02:34.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.538+0000 7f74b3fff640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f74a006c8f0 0x7f74a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:34.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.538+0000 7f74b3fff640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f74a006c8f0 0x7f74a006edb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74a4037000 tx=0x7f74a4031000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:34.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.542+0000 7f74b0ff9640 1 -- 172.21.15.137:0/2571674910 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f74a8059720 con 0x7f74b40cdef0 2024-04-26T22:02:34.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:34.717+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f74b406f7b0 con 0x7f74b40cdef0 2024-04-26T22:02:35.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.147+0000 7f74b0ff9640 1 -- 172.21.15.137:0/2571674910 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7f74a8059020 con 0x7f74b40cdef0 2024-04-26T22:02:35.147 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T22:02:35.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f74a006c8f0 msgr2=0x7f74a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:35.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f74a006c8f0 0x7f74a006edb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74a4037000 tx=0x7f74a4031000 comp rx=0 tx=0).stop 2024-04-26T22:02:35.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40cdef0 msgr2=0x7f74b40cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:35.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40cdef0 0x7f74b40cfde0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c3c0 tx=0x7f74a800c880 comp rx=0 tx=0).stop 2024-04-26T22:02:35.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 shutdown_connections 2024-04-26T22:02:35.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f74a006c8f0 0x7f74a006edb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:35.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f74b40cdef0 0x7f74b40cfde0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:35.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74b415bed0 0x7f74b40d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:35.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 --2- 172.21.15.137:0/2571674910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74b40b4620 0x7f74b413f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:35.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 >> 172.21.15.137:0/2571674910 conn(0x7f74b406c690 msgr2=0x7f74b40cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:35.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 shutdown_connections 2024-04-26T22:02:35.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.150+0000 7f74ba591640 1 -- 172.21.15.137:0/2571674910 wait complete. 2024-04-26T22:02:35.164 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T22:02:35.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.268+0000 7f834bb4e640 1 Processor -- start 2024-04-26T22:02:35.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.268+0000 7f834bb4e640 1 -- start start 2024-04-26T22:02:35.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.269+0000 7f834bb4e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 0x7f8344160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.269+0000 7f834bb4e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83440b3ac0 0x7f834406db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.269+0000 7f834bb4e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83440b46f0 con 0x7f83440b3620 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.269+0000 7f834bb4e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f834406d3b0 con 0x7f83440b3ac0 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.269+0000 7f834bb4e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f83440d1f60 con 0x7f834409c150 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.269+0000 7f834a0eb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83440b3ac0 0x7f834406db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.269+0000 7f83498ea640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f83440b3620 0x7f834409ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:52924/0 (socket says 172.21.15.137:52924) 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.269+0000 7f83498ea640 1 -- 172.21.15.137:0/1422887668 learned_addr learned my addr 172.21.15.137:0/1422887668 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.269+0000 7f834a0eb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83440b3ac0 0x7f834406db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44262/0 (socket says 172.21.15.137:44262) 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f83488e8640 1 -- 172.21.15.137:0/1422887668 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2888114463 0 0) 0x7f8340001490 con 0x7f83440b3620 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f83488e8640 1 -- 172.21.15.137:0/1422887668 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8330003520 con 0x7f83440b3620 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f83490e9640 1 --2- 172.21.15.137:0/1422887668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 0x7f8344160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f834a0eb640 1 -- 172.21.15.137:0/1422887668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 msgr2=0x7f8344160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:35.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f834a0eb640 1 --2- 172.21.15.137:0/1422887668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 0x7f8344160f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f834a0eb640 1 -- 172.21.15.137:0/1422887668 >> v1:172.21.15.137:6789/0 conn(0x7f83440b3620 legacy=0x7f834409ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f834a0eb640 1 -- 172.21.15.137:0/1422887668 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83440d2240 con 0x7f83440b3ac0 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f834a0eb640 1 --2- 172.21.15.137:0/1422887668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 0x7f834406db00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f833c0097a0 tx=0x7f833c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58a4ce93f5985ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f83488e8640 1 -- 172.21.15.137:0/1422887668 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c037070 con 0x7f83440b3ac0 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f83488e8640 1 -- 172.21.15.137:0/1422887668 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833c032440 con 0x7f83440b3ac0 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.270+0000 7f83488e8640 1 -- 172.21.15.137:0/1422887668 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c0327f0 con 0x7f83440b3ac0 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.271+0000 7f834bb4e640 1 -- 172.21.15.137:0/1422887668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 msgr2=0x7f834406db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.271+0000 7f834bb4e640 1 --2- 172.21.15.137:0/1422887668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 0x7f834406db00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f833c0097a0 tx=0x7f833c02a180 comp rx=0 tx=0).stop 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.271+0000 7f834bb4e640 1 -- 172.21.15.137:0/1422887668 shutdown_connections 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.271+0000 7f834bb4e640 1 --2- 172.21.15.137:0/1422887668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 0x7f834406db00 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.271+0000 7f834bb4e640 1 --2- 172.21.15.137:0/1422887668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 0x7f8344160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.271+0000 7f834bb4e640 1 -- 172.21.15.137:0/1422887668 >> 172.21.15.137:0/1422887668 conn(0x7f83440b4ab0 msgr2=0x7f83440b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.271+0000 7f834bb4e640 1 -- 172.21.15.137:0/1422887668 shutdown_connections 2024-04-26T22:02:35.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.271+0000 7f834bb4e640 1 -- 172.21.15.137:0/1422887668 wait complete. 2024-04-26T22:02:35.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.272+0000 7f834bb4e640 1 Processor -- start 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.272+0000 7f834bb4e640 1 -- start start 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834bb4e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 0x7f83440a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834bb4e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83440b3620 0x7f83440c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834bb4e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 0x7f83440c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834bb4e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83440b3ff0 con 0x7f83440b3ac0 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834bb4e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f834406d600 con 0x7f83440b3620 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834bb4e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f83440b4170 con 0x7f834409c150 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834a0eb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 0x7f83440c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834a0eb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 0x7f83440c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44268/0 (socket says 172.21.15.137:44268) 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834a0eb640 1 -- 172.21.15.137:0/2203386029 learned_addr learned my addr 172.21.15.137:0/2203386029 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f83498ea640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 0x7f83440a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f83490e9640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83440b3620 0x7f83440c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834a0eb640 1 -- 172.21.15.137:0/2203386029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 msgr2=0x7f83440a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:35.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834a0eb640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 0x7f83440a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834a0eb640 1 -- 172.21.15.137:0/2203386029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83440b3620 msgr2=0x7f83440c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834a0eb640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83440b3620 0x7f83440c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834a0eb640 1 -- 172.21.15.137:0/2203386029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83440a0c40 con 0x7f83440b3ac0 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f83498ea640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 0x7f83440a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f834a0eb640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 0x7f83440c90e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f833c035040 tx=0x7f833c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.273+0000 7f833a7fc640 1 -- 172.21.15.137:0/2203386029 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c037040 con 0x7f83440b3ac0 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.274+0000 7f833a7fc640 1 -- 172.21.15.137:0/2203386029 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f833c042070 con 0x7f83440b3ac0 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.274+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834415b510 con 0x7f83440b3ac0 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.274+0000 7f833a7fc640 1 -- 172.21.15.137:0/2203386029 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c0044e0 con 0x7f83440b3ac0 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.274+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834415bab0 con 0x7f83440b3ac0 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.274+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f834406a290 con 0x7f83440b3ac0 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.275+0000 7f833a7fc640 1 -- 172.21.15.137:0/2203386029 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f833c032830 con 0x7f83440b3ac0 2024-04-26T22:02:35.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.275+0000 7f833a7fc640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f832806c8f0 0x7f832806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:35.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.276+0000 7f833a7fc640 1 -- 172.21.15.137:0/2203386029 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5227+0+0 (secure 0 0 0) 0x7f833c0acc60 con 0x7f83440b3ac0 2024-04-26T22:02:35.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.276+0000 7f83498ea640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f832806c8f0 0x7f832806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:35.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.276+0000 7f83498ea640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f832806c8f0 0x7f832806edb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8340001630 tx=0x7f8340009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:35.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.280+0000 7f833a7fc640 1 -- 172.21.15.137:0/2203386029 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f833c07b3e0 con 0x7f83440b3ac0 2024-04-26T22:02:35.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:35.458+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f83440745c0 con 0x7f83440b3ac0 2024-04-26T22:02:36.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.149+0000 7f833a7fc640 1 -- 172.21.15.137:0/2203386029 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) ==== 170+0+0 (secure 0 0 0) 0x7f833c07ace0 con 0x7f83440b3ac0 2024-04-26T22:02:36.149 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T22:02:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f832806c8f0 msgr2=0x7f832806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f832806c8f0 0x7f832806edb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8340001630 tx=0x7f8340009040 comp rx=0 tx=0).stop 2024-04-26T22:02:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 msgr2=0x7f83440c90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 0x7f83440c90e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f833c035040 tx=0x7f833c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 shutdown_connections 2024-04-26T22:02:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f832806c8f0 0x7f832806edb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83440b3ac0 0x7f83440c90e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83440b3620 0x7f83440c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 --2- 172.21.15.137:0/2203386029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f834409c150 0x7f83440a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 >> 172.21.15.137:0/2203386029 conn(0x7f83440b4ab0 msgr2=0x7f8344070380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 shutdown_connections 2024-04-26T22:02:36.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.153+0000 7f834bb4e640 1 -- 172.21.15.137:0/2203386029 wait complete. 2024-04-26T22:02:36.178 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T22:02:36.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.281+0000 7f42dcd89640 1 Processor -- start 2024-04-26T22:02:36.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.281+0000 7f42dcd89640 1 -- start start 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42dcd89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8143840 0x7f42d80b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42dcd89640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d815dca0 con 0x7f42d80b55c0 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42dcd89640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d815df80 con 0x7f42d80b4520 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42dcd89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42d8143c20 con 0x7f42d8143840 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d6d9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f42d80b55c0 0x7f42d80ceff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48342/0 (socket says 172.21.15.137:48342) 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d6d9d640 1 -- 172.21.15.137:0/3463164513 learned_addr learned my addr 172.21.15.137:0/3463164513 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902493015 0 0) 0x7f42d815dca0 con 0x7f42d80b55c0 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c4003520 con 0x7f42d80b55c0 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d659c640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8143840 0x7f42d80b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:36.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1337049877 0 0) 0x7f42c4003520 con 0x7f42d80b55c0 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8143840 msgr2=0x7f42d80b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d5d9b640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8143840 0x7f42d80b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 >> v1:172.21.15.170:6789/0 conn(0x7f42d80b4520 legacy=0x7f42d80b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d815e260 con 0x7f42d80b55c0 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.282+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f42d00019f0 con 0x7f42d80b55c0 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 >> v1:172.21.15.137:6789/0 conn(0x7f42d80b55c0 legacy=0x7f42d80ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d5d9b640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c40039e0 0x7f42c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d5d9b640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8143840 0x7f42c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d5d9b640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42c4004d40 0x7f42c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42d8143c20 con 0x7f42c4004d40 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42c400ba70 con 0x7f42c40039e0 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42c400bc70 con 0x7f42d8143840 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d6d9d640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42c4004d40 0x7f42c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42cffff640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8143840 0x7f42c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:36.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d659c640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c40039e0 0x7f42c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d6d9d640 1 -- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8143840 msgr2=0x7f42c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d6d9d640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8143840 0x7f42c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d6d9d640 1 -- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c40039e0 msgr2=0x7f42c4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d6d9d640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c40039e0 0x7f42c4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42d6d9d640 1 -- 172.21.15.137:0/3463164513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c4003520 con 0x7f42c4004d40 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.283+0000 7f42cffff640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d8143840 0x7f42c4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42d6d9d640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42c4004d40 0x7f42c40051c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f42d00013d0 tx=0x7f42c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbed237c2bb7c572 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d000a480 con 0x7f42c4004d40 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d002f070 con 0x7f42c4004d40 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42d5d9b640 1 -- 172.21.15.137:0/3463164513 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d002bc70 con 0x7f42c4004d40 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42dcd89640 1 -- 172.21.15.137:0/3463164513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42c4004d40 msgr2=0x7f42c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42dcd89640 1 --2- 172.21.15.137:0/3463164513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42c4004d40 0x7f42c40051c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f42d00013d0 tx=0x7f42c4005830 comp rx=0 tx=0).stop 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42d6d9d640 1 -- 172.21.15.137:0/3463164513 reap_dead start 2024-04-26T22:02:36.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42dcd89640 1 -- 172.21.15.137:0/3463164513 shutdown_connections 2024-04-26T22:02:36.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42dcd89640 1 -- 172.21.15.137:0/3463164513 >> 172.21.15.137:0/3463164513 conn(0x7f42d80cd8a0 msgr2=0x7f42d80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:36.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42dcd89640 1 -- 172.21.15.137:0/3463164513 shutdown_connections 2024-04-26T22:02:36.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.284+0000 7f42dcd89640 1 -- 172.21.15.137:0/3463164513 wait complete. 2024-04-26T22:02:36.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.286+0000 7f42dcd89640 1 Processor -- start 2024-04-26T22:02:36.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.286+0000 7f42dcd89640 1 -- start start 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.286+0000 7f42dcd89640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d40 0x7f42d81f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.286+0000 7f42dcd89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d80af5c0 0x7f42d80b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.286+0000 7f42dcd89640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d813e150 0x7f42d813e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.286+0000 7f42dcd89640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42d815da40 con 0x7f42d813e150 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.286+0000 7f42dcd89640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42d815d8c0 con 0x7f42c4004d40 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.286+0000 7f42dcd89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42d80b3fe0 con 0x7f42d80af5c0 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d813e150 0x7f42d813e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d813e150 0x7f42d813e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45674/0 (socket says 172.21.15.137:45674) 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d6d9d640 1 -- 172.21.15.137:0/2895048041 learned_addr learned my addr 172.21.15.137:0/2895048041 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d659c640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d40 0x7f42d81f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42cffff640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d80af5c0 0x7f42d80b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d6d9d640 1 -- 172.21.15.137:0/2895048041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d80af5c0 msgr2=0x7f42d80b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d6d9d640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d80af5c0 0x7f42d80b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d6d9d640 1 -- 172.21.15.137:0/2895048041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d40 msgr2=0x7f42d81f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d6d9d640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d40 0x7f42d81f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d6d9d640 1 -- 172.21.15.137:0/2895048041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d81f77d0 con 0x7f42d813e150 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42d6d9d640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d813e150 0x7f42d813e590 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f42d000a920 tx=0x7f42d8074490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42ceffd640 1 -- 172.21.15.137:0/2895048041 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0001370 con 0x7f42d813e150 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42ceffd640 1 -- 172.21.15.137:0/2895048041 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d002bc20 con 0x7f42d813e150 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d81f6f30 con 0x7f42d813e150 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42ceffd640 1 -- 172.21.15.137:0/2895048041 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0001ff0 con 0x7f42d813e150 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.287+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d81f74f0 con 0x7f42d813e150 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.288+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d806a290 con 0x7f42d813e150 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.289+0000 7f42ceffd640 1 -- 172.21.15.137:0/2895048041 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42d0046060 con 0x7f42d813e150 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.289+0000 7f42ceffd640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42b806c8f0 0x7f42b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.289+0000 7f42ceffd640 1 -- 172.21.15.137:0/2895048041 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5609+0+0 (secure 0 0 0) 0x7f42d00ab7f0 con 0x7f42d813e150 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.289+0000 7f42d659c640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42b806c8f0 0x7f42b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:36.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.289+0000 7f42d659c640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42b806c8f0 0x7f42b806edb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009b00 tx=0x7f42c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:36.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.293+0000 7f42ceffd640 1 -- 172.21.15.137:0/2895048041 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f42d0079c80 con 0x7f42d813e150 2024-04-26T22:02:36.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:36.505+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f42d80ce420 con 0x7f42d813e150 2024-04-26T22:02:37.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.168+0000 7f42ceffd640 1 -- 172.21.15.137:0/2895048041 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v32) ==== 174+0+0 (secure 0 0 0) 0x7f42d0079580 con 0x7f42d813e150 2024-04-26T22:02:37.168 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 10 and data pool 11 2024-04-26T22:02:37.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.181+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42b806c8f0 msgr2=0x7f42b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.181+0000 7f42dcd89640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42b806c8f0 0x7f42b806edb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009b00 tx=0x7f42c8008040 comp rx=0 tx=0).stop 2024-04-26T22:02:37.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.181+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d813e150 msgr2=0x7f42d813e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.181+0000 7f42dcd89640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d813e150 0x7f42d813e590 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f42d000a920 tx=0x7f42d8074490 comp rx=0 tx=0).stop 2024-04-26T22:02:37.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.184+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 shutdown_connections 2024-04-26T22:02:37.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.184+0000 7f42dcd89640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42b806c8f0 0x7f42b806edb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.184+0000 7f42dcd89640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42d813e150 0x7f42d813e590 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.184+0000 7f42dcd89640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42d80af5c0 0x7f42d80b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.184+0000 7f42dcd89640 1 --2- 172.21.15.137:0/2895048041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42c4004d40 0x7f42d81f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.184+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 >> 172.21.15.137:0/2895048041 conn(0x7f42d80cd8a0 msgr2=0x7f42d815d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:37.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.186+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 shutdown_connections 2024-04-26T22:02:37.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.186+0000 7f42dcd89640 1 -- 172.21.15.137:0/2895048041 wait complete. 2024-04-26T22:02:37.202 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:37.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.302+0000 7f1b9bfb7640 1 Processor -- start 2024-04-26T22:02:37.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.303+0000 7f1b9bfb7640 1 -- start start 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.303+0000 7f1b9bfb7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b940d3ee0 0x7f1b940cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.303+0000 7f1b9bfb7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b9415f750 0x7f1b940b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.303+0000 7f1b9bfb7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b940d03a0 con 0x7f1b9415f370 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.303+0000 7f1b9bfb7640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1b940b4d10 con 0x7f1b940d3ee0 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.303+0000 7f1b9bfb7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1b940d0680 con 0x7f1b9415f750 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.303+0000 7f1b99552640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b940d3ee0 0x7f1b940cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.303+0000 7f1b99552640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1b940d3ee0 0x7f1b940cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45690/0 (socket says 172.21.15.137:45690) 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.303+0000 7f1b99552640 1 -- 172.21.15.137:0/2432620682 learned_addr learned my addr 172.21.15.137:0/2432620682 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.304+0000 7f1b99552640 1 -- 172.21.15.137:0/2432620682 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b9415f750 msgr2=0x7f1b940b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.304+0000 7f1b99552640 1 --2- 172.21.15.137:0/2432620682 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b9415f750 0x7f1b940b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.304+0000 7f1b99552640 1 -- 172.21.15.137:0/2432620682 >> v1:172.21.15.170:6789/0 conn(0x7f1b9415f370 legacy=0x7f1b940d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:37.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.304+0000 7f1b99552640 1 -- 172.21.15.137:0/2432620682 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b940d0960 con 0x7f1b940d3ee0 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.304+0000 7f1b99552640 1 --2- 172.21.15.137:0/2432620682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b940d3ee0 0x7f1b940cfd70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009870 tx=0x7f1b8402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2461c7748e0ccc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b98d51640 1 -- 172.21.15.137:0/2432620682 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84037070 con 0x7f1b940d3ee0 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b98d51640 1 -- 172.21.15.137:0/2432620682 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b84032440 con 0x7f1b940d3ee0 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b98d51640 1 -- 172.21.15.137:0/2432620682 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84032810 con 0x7f1b940d3ee0 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/2432620682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b940d3ee0 msgr2=0x7f1b940cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b9bfb7640 1 --2- 172.21.15.137:0/2432620682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b940d3ee0 0x7f1b940cfd70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009870 tx=0x7f1b8402a210 comp rx=0 tx=0).stop 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/2432620682 shutdown_connections 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b9bfb7640 1 --2- 172.21.15.137:0/2432620682 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b9415f750 0x7f1b940b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b9bfb7640 1 --2- 172.21.15.137:0/2432620682 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b940d3ee0 0x7f1b940cfd70 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/2432620682 >> 172.21.15.137:0/2432620682 conn(0x7f1b9408ec10 msgr2=0x7f1b9409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/2432620682 shutdown_connections 2024-04-26T22:02:37.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.305+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/2432620682 wait complete. 2024-04-26T22:02:37.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.306+0000 7f1b9bfb7640 1 Processor -- start 2024-04-26T22:02:37.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.306+0000 7f1b9bfb7640 1 -- start start 2024-04-26T22:02:37.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9bfb7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b940d3ee0 0x7f1b940cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9bfb7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b9415f370 0x7f1b940ba840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9bfb7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b9415f750 0x7f1b94153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9bfb7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1b940b51c0 con 0x7f1b9415f750 2024-04-26T22:02:37.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9bfb7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1b940d0f20 con 0x7f1b9415f370 2024-04-26T22:02:37.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9bfb7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1b940b5340 con 0x7f1b940d3ee0 2024-04-26T22:02:37.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9a554640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b9415f750 0x7f1b94153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9a554640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b9415f750 0x7f1b94153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45706/0 (socket says 172.21.15.137:45706) 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9a554640 1 -- 172.21.15.137:0/4105289117 learned_addr learned my addr 172.21.15.137:0/4105289117 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b99552640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b9415f370 0x7f1b940ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b99d53640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b940d3ee0 0x7f1b940cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9a554640 1 -- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b940d3ee0 msgr2=0x7f1b940cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9a554640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b940d3ee0 0x7f1b940cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9a554640 1 -- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b9415f370 msgr2=0x7f1b940ba840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9a554640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b9415f370 0x7f1b940ba840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b9a554640 1 -- 172.21.15.137:0/4105289117 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b94153a80 con 0x7f1b9415f750 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b99d53640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b940d3ee0 0x7f1b940cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.307+0000 7f1b99552640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b9415f370 0x7f1b940ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.308+0000 7f1b9a554640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b9415f750 0x7f1b94153540 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00b410 tx=0x7f1b8c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:37.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.308+0000 7f1b8a7fc640 1 -- 172.21.15.137:0/4105289117 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c015020 con 0x7f1b9415f750 2024-04-26T22:02:37.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.308+0000 7f1b8a7fc640 1 -- 172.21.15.137:0/4105289117 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8c011850 con 0x7f1b9415f750 2024-04-26T22:02:37.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.308+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b940b97a0 con 0x7f1b9415f750 2024-04-26T22:02:37.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.308+0000 7f1b8a7fc640 1 -- 172.21.15.137:0/4105289117 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c011c40 con 0x7f1b9415f750 2024-04-26T22:02:37.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.308+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b940b9d60 con 0x7f1b9415f750 2024-04-26T22:02:37.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.309+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9406a290 con 0x7f1b9415f750 2024-04-26T22:02:37.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.309+0000 7f1b8a7fc640 1 -- 172.21.15.137:0/4105289117 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b8c018020 con 0x7f1b9415f750 2024-04-26T22:02:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.310+0000 7f1b8a7fc640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1b7806c8f0 0x7f1b7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.310+0000 7f1b8a7fc640 1 -- 172.21.15.137:0/4105289117 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f1b8c08b9a0 con 0x7f1b9415f750 2024-04-26T22:02:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.310+0000 7f1b99d53640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1b7806c8f0 0x7f1b7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.310+0000 7f1b99d53640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1b7806c8f0 0x7f1b7806edb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1b90001dc0 tx=0x7f1b90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:37.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.314+0000 7f1b8a7fc640 1 -- 172.21.15.137:0/4105289117 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1b8c01f020 con 0x7f1b9415f750 2024-04-26T22:02:37.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.490+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b9406d280 con 0x7f1b9415f750 2024-04-26T22:02:37.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.491+0000 7f1b8a7fc640 1 -- 172.21.15.137:0/4105289117 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16693 (secure 0 0 0) 0x7f1b8c0172c0 con 0x7f1b9415f750 2024-04-26T22:02:37.491 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:37.492 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":71,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:02:36.507263+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:02:34.722395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T22:02:35.462679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1b7806c8f0 msgr2=0x7f1b7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1b7806c8f0 0x7f1b7806edb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1b90001dc0 tx=0x7f1b90009040 comp rx=0 tx=0).stop 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b9415f750 msgr2=0x7f1b94153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b9415f750 0x7f1b94153540 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00b410 tx=0x7f1b8c00b8d0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 shutdown_connections 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1b7806c8f0 0x7f1b7806edb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1b9415f750 0x7f1b94153540 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b9415f370 0x7f1b940ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 --2- 172.21.15.137:0/4105289117 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1b940d3ee0 0x7f1b940cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 >> 172.21.15.137:0/4105289117 conn(0x7f1b9408ec10 msgr2=0x7f1b940b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:37.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 shutdown_connections 2024-04-26T22:02:37.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.493+0000 7f1b9bfb7640 1 -- 172.21.15.137:0/4105289117 wait complete. 2024-04-26T22:02:37.504 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:37.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.600+0000 7fcbe7712640 1 Processor -- start 2024-04-26T22:02:37.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.601+0000 7fcbe7712640 1 -- start start 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.601+0000 7fcbe7712640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcbe015f370 0x7fcbe00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.601+0000 7fcbe7712640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcbe00d3ee0 0x7fcbe00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.601+0000 7fcbe7712640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe00d03a0 con 0x7fcbe015f750 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.601+0000 7fcbe7712640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe00b4d10 con 0x7fcbe015f370 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.601+0000 7fcbe7712640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe00d0680 con 0x7fcbe00d3ee0 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.602+0000 7fcbe54ae640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcbe015f370 0x7fcbe00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.602+0000 7fcbe4cad640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcbe015f750 0x7fcbe00d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48344/0 (socket says 172.21.15.137:48344) 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.602+0000 7fcbe4cad640 1 -- 172.21.15.137:0/3403259705 learned_addr learned my addr 172.21.15.137:0/3403259705 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.602+0000 7fcbe54ae640 1 -- 172.21.15.137:0/3403259705 >> v2:172.21.15.170:3300/0 conn(0x7fcbe00d3ee0 msgr2=0x7fcbe00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.602+0000 7fcbe54ae640 1 --2- 172.21.15.137:0/3403259705 >> v2:172.21.15.170:3300/0 conn(0x7fcbe00d3ee0 0x7fcbe00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.602+0000 7fcbe54ae640 1 -- 172.21.15.137:0/3403259705 >> v1:172.21.15.137:6789/0 conn(0x7fcbe015f750 legacy=0x7fcbe00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.602+0000 7fcbe54ae640 1 -- 172.21.15.137:0/3403259705 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe00d0960 con 0x7fcbe015f370 2024-04-26T22:02:37.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.602+0000 7fcbd7fff640 1 -- 172.21.15.137:0/3403259705 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3373590290 0 0) 0x7fcbe00d03a0 con 0x7fcbe015f750 2024-04-26T22:02:37.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbe54ae640 1 --2- 172.21.15.137:0/3403259705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 0x7fcbe00cfd70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00c8cf0 tx=0x7fcbd002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2655542a3ebc7cc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:37.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbd7fff640 1 -- 172.21.15.137:0/3403259705 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0037070 con 0x7fcbe015f370 2024-04-26T22:02:37.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbd7fff640 1 -- 172.21.15.137:0/3403259705 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd0032440 con 0x7fcbe015f370 2024-04-26T22:02:37.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbd7fff640 1 -- 172.21.15.137:0/3403259705 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0032810 con 0x7fcbe015f370 2024-04-26T22:02:37.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbe7712640 1 -- 172.21.15.137:0/3403259705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 msgr2=0x7fcbe00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbe7712640 1 --2- 172.21.15.137:0/3403259705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 0x7fcbe00cfd70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00c8cf0 tx=0x7fcbd002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbe7712640 1 -- 172.21.15.137:0/3403259705 shutdown_connections 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbe7712640 1 --2- 172.21.15.137:0/3403259705 >> v2:172.21.15.170:3300/0 conn(0x7fcbe00d3ee0 0x7fcbe00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbe7712640 1 --2- 172.21.15.137:0/3403259705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 0x7fcbe00cfd70 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbe7712640 1 -- 172.21.15.137:0/3403259705 >> 172.21.15.137:0/3403259705 conn(0x7fcbe008ec10 msgr2=0x7fcbe009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbe7712640 1 -- 172.21.15.137:0/3403259705 shutdown_connections 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.603+0000 7fcbe7712640 1 -- 172.21.15.137:0/3403259705 wait complete. 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.604+0000 7fcbe7712640 1 Processor -- start 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.604+0000 7fcbe7712640 1 -- start start 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe7712640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe00d3ee0 0x7fcbe0162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe7712640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 0x7fcbe00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe7712640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe015f750 0x7fcbe015fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe7712640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00b51c0 con 0x7fcbe015f370 2024-04-26T22:02:37.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe7712640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d0f20 con 0x7fcbe015f750 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe7712640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe00b5340 con 0x7fcbe00d3ee0 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe4cad640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 0x7fcbe00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe4cad640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 0x7fcbe00cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45726/0 (socket says 172.21.15.137:45726) 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe4cad640 1 -- 172.21.15.137:0/1905843313 learned_addr learned my addr 172.21.15.137:0/1905843313 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe54ae640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe00d3ee0 0x7fcbe0162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe5caf640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe015f750 0x7fcbe015fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe4cad640 1 -- 172.21.15.137:0/1905843313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe00d3ee0 msgr2=0x7fcbe0162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe4cad640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe00d3ee0 0x7fcbe0162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe4cad640 1 -- 172.21.15.137:0/1905843313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe015f750 msgr2=0x7fcbe015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.605+0000 7fcbe4cad640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe015f750 0x7fcbe015fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.606+0000 7fcbe4cad640 1 -- 172.21.15.137:0/1905843313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe0162e50 con 0x7fcbe015f370 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.606+0000 7fcbe4cad640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 0x7fcbe00cd310 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00c430 tx=0x7fcbdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.606+0000 7fcbd5ffb640 1 -- 172.21.15.137:0/1905843313 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0074e0 con 0x7fcbe015f370 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.606+0000 7fcbd5ffb640 1 -- 172.21.15.137:0/1905843313 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0047e0 con 0x7fcbe015f370 2024-04-26T22:02:37.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.606+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe00cddd0 con 0x7fcbe015f370 2024-04-26T22:02:37.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.606+0000 7fcbd5ffb640 1 -- 172.21.15.137:0/1905843313 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc004bd0 con 0x7fcbe015f370 2024-04-26T22:02:37.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.606+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe00ce390 con 0x7fcbe015f370 2024-04-26T22:02:37.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.607+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe006a290 con 0x7fcbe015f370 2024-04-26T22:02:37.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.607+0000 7fcbd5ffb640 1 -- 172.21.15.137:0/1905843313 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcbdc011070 con 0x7fcbe015f370 2024-04-26T22:02:37.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.608+0000 7fcbd5ffb640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcbc406c8f0 0x7fcbc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.608+0000 7fcbd5ffb640 1 -- 172.21.15.137:0/1905843313 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7fcbdc08b780 con 0x7fcbe015f370 2024-04-26T22:02:37.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.608+0000 7fcbe54ae640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcbc406c8f0 0x7fcbc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.608+0000 7fcbe54ae640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcbc406c8f0 0x7fcbc406edb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0034000 tx=0x7fcbd002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:37.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.612+0000 7fcbd5ffb640 1 -- 172.21.15.137:0/1905843313 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcbdc00e280 con 0x7fcbe015f370 2024-04-26T22:02:37.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.789+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbe009e8b0 con 0x7fcbe015f370 2024-04-26T22:02:37.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.790+0000 7fcbd5ffb640 1 -- 172.21.15.137:0/1905843313 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16693 (secure 0 0 0) 0x7fcbdc059bb0 con 0x7fcbe015f370 2024-04-26T22:02:37.790 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:37.790 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":71,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:02:36.507263+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:02:34.722395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T22:02:35.462679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:37.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcbc406c8f0 msgr2=0x7fcbc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcbc406c8f0 0x7fcbc406edb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0034000 tx=0x7fcbd002e000 comp rx=0 tx=0).stop 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 msgr2=0x7fcbe00cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 0x7fcbe00cd310 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00c430 tx=0x7fcbdc00c8f0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 shutdown_connections 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcbc406c8f0 0x7fcbc406edb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcbe015f370 0x7fcbe00cd310 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcbe015f750 0x7fcbe015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 --2- 172.21.15.137:0/1905843313 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcbe00d3ee0 0x7fcbe0162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 >> 172.21.15.137:0/1905843313 conn(0x7fcbe008ec10 msgr2=0x7fcbe006e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 shutdown_connections 2024-04-26T22:02:37.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.792+0000 7fcbe7712640 1 -- 172.21.15.137:0/1905843313 wait complete. 2024-04-26T22:02:37.803 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T22:02:37.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.902+0000 7f1479f40640 1 Processor -- start 2024-04-26T22:02:37.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.903+0000 7f1479f40640 1 -- start start 2024-04-26T22:02:37.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.903+0000 7f1479f40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1474143840 0x7f14740b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.903+0000 7f1479f40640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f14740b55c0 0x7f14740ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.903+0000 7f1479f40640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f147415dca0 con 0x7f14740b4520 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.903+0000 7f1479f40640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1474143c20 con 0x7f14740b55c0 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.903+0000 7f1479f40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f147415df80 con 0x7f1474143840 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.904+0000 7f1473fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f14740b55c0 0x7f14740ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.904+0000 7f1473fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f14740b55c0 0x7f14740ceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45738/0 (socket says 172.21.15.137:45738) 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.904+0000 7f1473fff640 1 -- 172.21.15.137:0/1211499934 learned_addr learned my addr 172.21.15.137:0/1211499934 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.904+0000 7f14737fe640 1 --2- 172.21.15.137:0/1211499934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1474143840 0x7f14740b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.904+0000 7f1473fff640 1 -- 172.21.15.137:0/1211499934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1474143840 msgr2=0x7f14740b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.904+0000 7f1473fff640 1 --2- 172.21.15.137:0/1211499934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1474143840 0x7f14740b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.904+0000 7f1473fff640 1 -- 172.21.15.137:0/1211499934 >> v1:172.21.15.170:6789/0 conn(0x7f14740b4520 legacy=0x7f14740b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.904+0000 7f1473fff640 1 -- 172.21.15.137:0/1211499934 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147415e260 con 0x7f14740b55c0 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.904+0000 7f1473fff640 1 --2- 172.21.15.137:0/1211499934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14740b55c0 0x7f14740ceff0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f146c009e50 tx=0x7f146c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b503ef13582f04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:37.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f14727fc640 1 -- 172.21.15.137:0/1211499934 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c036070 con 0x7f14740b55c0 2024-04-26T22:02:37.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f14727fc640 1 -- 172.21.15.137:0/1211499934 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c031600 con 0x7f14740b55c0 2024-04-26T22:02:37.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f14727fc640 1 -- 172.21.15.137:0/1211499934 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c0319d0 con 0x7f14740b55c0 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f1479f40640 1 -- 172.21.15.137:0/1211499934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14740b55c0 msgr2=0x7f14740ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f1479f40640 1 --2- 172.21.15.137:0/1211499934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14740b55c0 0x7f14740ceff0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f146c009e50 tx=0x7f146c02a710 comp rx=0 tx=0).stop 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f1479f40640 1 -- 172.21.15.137:0/1211499934 shutdown_connections 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f1479f40640 1 --2- 172.21.15.137:0/1211499934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f14740b55c0 0x7f14740ceff0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f1479f40640 1 --2- 172.21.15.137:0/1211499934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1474143840 0x7f14740b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f1479f40640 1 -- 172.21.15.137:0/1211499934 >> 172.21.15.137:0/1211499934 conn(0x7f14740cd8a0 msgr2=0x7f14740cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f1479f40640 1 -- 172.21.15.137:0/1211499934 shutdown_connections 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.905+0000 7f1479f40640 1 -- 172.21.15.137:0/1211499934 wait complete. 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.906+0000 7f1479f40640 1 Processor -- start 2024-04-26T22:02:37.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1479f40640 1 -- start start 2024-04-26T22:02:37.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1479f40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14740b4520 0x7f1474141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1479f40640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14740b55c0 0x7f147415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1479f40640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1474143840 0x7f14741f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1479f40640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f147415da40 con 0x7f1474143840 2024-04-26T22:02:37.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1479f40640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f147415d8c0 con 0x7f14740b55c0 2024-04-26T22:02:37.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1479f40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f14740cf530 con 0x7f14740b4520 2024-04-26T22:02:37.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1473fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1474143840 0x7f14741f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1473fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1474143840 0x7f14741f32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45752/0 (socket says 172.21.15.137:45752) 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1473fff640 1 -- 172.21.15.137:0/3131290681 learned_addr learned my addr 172.21.15.137:0/3131290681 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f14737fe640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14740b4520 0x7f1474141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.907+0000 7f1472ffd640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14740b55c0 0x7f147415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f1473fff640 1 -- 172.21.15.137:0/3131290681 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14740b4520 msgr2=0x7f1474141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f1473fff640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14740b4520 0x7f1474141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f1473fff640 1 -- 172.21.15.137:0/3131290681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14740b55c0 msgr2=0x7f147415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f1473fff640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14740b55c0 0x7f147415a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f1473fff640 1 -- 172.21.15.137:0/3131290681 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147415ab20 con 0x7f1474143840 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f1473fff640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1474143840 0x7f14741f32a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f146c009e50 tx=0x7f146c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f145bfff640 1 -- 172.21.15.137:0/3131290681 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c036050 con 0x7f1474143840 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f145bfff640 1 -- 172.21.15.137:0/3131290681 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f146c042070 con 0x7f1474143840 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147413e620 con 0x7f1474143840 2024-04-26T22:02:37.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f145bfff640 1 -- 172.21.15.137:0/3131290681 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c009510 con 0x7f1474143840 2024-04-26T22:02:37.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.908+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f147413ebe0 con 0x7f1474143840 2024-04-26T22:02:37.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.909+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147406a290 con 0x7f1474143840 2024-04-26T22:02:37.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.910+0000 7f145bfff640 1 -- 172.21.15.137:0/3131290681 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f146c007bd0 con 0x7f1474143840 2024-04-26T22:02:37.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.910+0000 7f145bfff640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f146006c8f0 0x7f146006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:37.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.910+0000 7f145bfff640 1 -- 172.21.15.137:0/3131290681 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5709+0+0 (secure 0 0 0) 0x7f146c0ac870 con 0x7f1474143840 2024-04-26T22:02:37.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.910+0000 7f14737fe640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f146006c8f0 0x7f146006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:37.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.910+0000 7f14737fe640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f146006c8f0 0x7f146006edb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1464006fd0 tx=0x7f1464008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:37.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:37.914+0000 7f145bfff640 1 -- 172.21.15.137:0/3131290681 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f146c07a650 con 0x7f1474143840 2024-04-26T22:02:38.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.128+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f14740ce420 con 0x7f1474143840 2024-04-26T22:02:38.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.169+0000 7f145bfff640 1 -- 172.21.15.137:0/3131290681 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) ==== 118+0+0 (secure 0 0 0) 0x7f146c07e950 con 0x7f1474143840 2024-04-26T22:02:38.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f146006c8f0 msgr2=0x7f146006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:38.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f146006c8f0 0x7f146006edb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1464006fd0 tx=0x7f1464008040 comp rx=0 tx=0).stop 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1474143840 msgr2=0x7f14741f32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1474143840 0x7f14741f32a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f146c009e50 tx=0x7f146c004a40 comp rx=0 tx=0).stop 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 shutdown_connections 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f146006c8f0 0x7f146006edb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1474143840 0x7f14741f32a0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14740b55c0 0x7f147415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 --2- 172.21.15.137:0/3131290681 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f14740b4520 0x7f1474141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 >> 172.21.15.137:0/3131290681 conn(0x7f14740cd8a0 msgr2=0x7f14740b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 shutdown_connections 2024-04-26T22:02:38.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.171+0000 7f1479f40640 1 -- 172.21.15.137:0/3131290681 wait complete. 2024-04-26T22:02:38.183 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T22:02:38.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T22:02:38.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.283+0000 7fbac0991640 1 Processor -- start 2024-04-26T22:02:38.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.283+0000 7fbac0991640 1 -- start start 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbac0991640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbabc15e7e0 0x7fbabc0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbac0991640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbabc0cdd40 con 0x7fbabc161080 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbac0991640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbabc0cdfe0 con 0x7fbabc161cb0 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbac0991640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbabc0d2280 con 0x7fbabc15e7e0 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbaba59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbabc15e7e0 0x7fbabc0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbabad9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbabc161080 0x7fbabc161490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48346/0 (socket says 172.21.15.137:48346) 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbabad9d640 1 -- 172.21.15.137:0/303735567 learned_addr learned my addr 172.21.15.137:0/303735567 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbaba59c640 1 -- 172.21.15.137:0/303735567 >> v1:172.21.15.170:6789/0 conn(0x7fbabc161cb0 legacy=0x7fbabc0d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbaba59c640 1 -- 172.21.15.137:0/303735567 >> v1:172.21.15.137:6789/0 conn(0x7fbabc161080 legacy=0x7fbabc161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:38.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.284+0000 7fbaba59c640 1 -- 172.21.15.137:0/303735567 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbabc0ce2c0 con 0x7fbabc15e7e0 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.285+0000 7fbaba59c640 1 --2- 172.21.15.137:0/303735567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc15e7e0 0x7fbabc0ceda0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0097a0 tx=0x7fbaac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19155cd52eae7199 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.285+0000 7fbab959a640 1 -- 172.21.15.137:0/303735567 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac037070 con 0x7fbabc15e7e0 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.285+0000 7fbab959a640 1 -- 172.21.15.137:0/303735567 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaac032440 con 0x7fbabc15e7e0 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.285+0000 7fbab959a640 1 -- 172.21.15.137:0/303735567 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac032810 con 0x7fbabc15e7e0 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.285+0000 7fbac0991640 1 -- 172.21.15.137:0/303735567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc15e7e0 msgr2=0x7fbabc0ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.285+0000 7fbac0991640 1 --2- 172.21.15.137:0/303735567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc15e7e0 0x7fbabc0ceda0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0097a0 tx=0x7fbaac02a1e0 comp rx=0 tx=0).stop 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.285+0000 7fbac0991640 1 -- 172.21.15.137:0/303735567 shutdown_connections 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.285+0000 7fbac0991640 1 --2- 172.21.15.137:0/303735567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc15e7e0 0x7fbabc0ceda0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.285+0000 7fbac0991640 1 -- 172.21.15.137:0/303735567 >> 172.21.15.137:0/303735567 conn(0x7fbabc09ba40 msgr2=0x7fbabc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.286+0000 7fbac0991640 1 -- 172.21.15.137:0/303735567 shutdown_connections 2024-04-26T22:02:38.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.286+0000 7fbac0991640 1 -- 172.21.15.137:0/303735567 wait complete. 2024-04-26T22:02:38.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.287+0000 7fbac0991640 1 Processor -- start 2024-04-26T22:02:38.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.287+0000 7fbac0991640 1 -- start start 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.287+0000 7fbac0991640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbabc15e7e0 0x7fbabc0a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.287+0000 7fbac0991640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbabc161080 0x7fbabc071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbac0991640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc161cb0 0x7fbabc156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbac0991640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc0cf2e0 con 0x7fbabc161cb0 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbac0991640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc0ce880 con 0x7fbabc15e7e0 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbac0991640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbabc0d1f60 con 0x7fbabc161080 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbabad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc161cb0 0x7fbabc156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbabad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc161cb0 0x7fbabc156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45768/0 (socket says 172.21.15.137:45768) 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbabad9d640 1 -- 172.21.15.137:0/3671677725 learned_addr learned my addr 172.21.15.137:0/3671677725 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbabad9d640 1 -- 172.21.15.137:0/3671677725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbabc161080 msgr2=0x7fbabc071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbabad9d640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbabc161080 0x7fbabc071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbabad9d640 1 -- 172.21.15.137:0/3671677725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbabc15e7e0 msgr2=0x7fbabc0a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbabad9d640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbabc15e7e0 0x7fbabc0a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:38.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbabad9d640 1 -- 172.21.15.137:0/3671677725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbabc15ced0 con 0x7fbabc161cb0 2024-04-26T22:02:38.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbabad9d640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc161cb0 0x7fbabc156030 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fbab400cae0 tx=0x7fbab400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:38.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbaaaffd640 1 -- 172.21.15.137:0/3671677725 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4017070 con 0x7fbabc161cb0 2024-04-26T22:02:38.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbaaaffd640 1 -- 172.21.15.137:0/3671677725 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab400ac40 con 0x7fbabc161cb0 2024-04-26T22:02:38.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbabc15d150 con 0x7fbabc161cb0 2024-04-26T22:02:38.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbaaaffd640 1 -- 172.21.15.137:0/3671677725 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4012400 con 0x7fbabc161cb0 2024-04-26T22:02:38.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.288+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbabc15d9b0 con 0x7fbabc161cb0 2024-04-26T22:02:38.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.289+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbabc15d500 con 0x7fbabc161cb0 2024-04-26T22:02:38.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.290+0000 7fbaaaffd640 1 -- 172.21.15.137:0/3671677725 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbab401a070 con 0x7fbabc161cb0 2024-04-26T22:02:38.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.290+0000 7fbaaaffd640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba9c06c8f0 0x7fba9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:38.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.290+0000 7fbaba59c640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba9c06c8f0 0x7fba9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:38.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.290+0000 7fbaaaffd640 1 -- 172.21.15.137:0/3671677725 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fbab408b8e0 con 0x7fbabc161cb0 2024-04-26T22:02:38.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.291+0000 7fbaba59c640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba9c06c8f0 0x7fba9c06edb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbaac034000 tx=0x7fbaac02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:38.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.295+0000 7fbaaaffd640 1 -- 172.21.15.137:0/3671677725 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbabc15ced0 con 0x7fbabc161cb0 2024-04-26T22:02:38.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:38.506+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbabc15dbb0 con 0x7fbabc161cb0 2024-04-26T22:02:38.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-26T22:02:39.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.179+0000 7fbaaaffd640 1 -- 172.21.15.137:0/3671677725 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7fbabc15dbb0 con 0x7fbabc161cb0 2024-04-26T22:02:39.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba9c06c8f0 msgr2=0x7fba9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba9c06c8f0 0x7fba9c06edb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbaac034000 tx=0x7fbaac02c000 comp rx=0 tx=0).stop 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc161cb0 msgr2=0x7fbabc156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc161cb0 0x7fbabc156030 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fbab400cae0 tx=0x7fbab400a060 comp rx=0 tx=0).stop 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 shutdown_connections 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fba9c06c8f0 0x7fba9c06edb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbabc161cb0 0x7fbabc156030 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbabc161080 0x7fbabc071870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 --2- 172.21.15.137:0/3671677725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbabc15e7e0 0x7fbabc0a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 >> 172.21.15.137:0/3671677725 conn(0x7fbabc09ba40 msgr2=0x7fbabc159260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 shutdown_connections 2024-04-26T22:02:39.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.181+0000 7fbac0991640 1 -- 172.21.15.137:0/3671677725 wait complete. 2024-04-26T22:02:39.194 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T22:02:39.194 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:39.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.295+0000 7f3b2cb5f640 1 Processor -- start 2024-04-26T22:02:39.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.295+0000 7f3b2cb5f640 1 -- start start 2024-04-26T22:02:39.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b2cb5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280cf2e0 0x7f3b2806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b2cb5f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3b280d11b0 0x7f3b2806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b2cb5f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b280d1740 con 0x7f3b2806e2c0 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b2cb5f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3b2806e750 con 0x7f3b280d11b0 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b2cb5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3b280d1a20 con 0x7f3b280cf2e0 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b25d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3b280d11b0 0x7f3b2806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b25d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3b280d11b0 0x7f3b2806dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45770/0 (socket says 172.21.15.137:45770) 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b25d9b640 1 -- 172.21.15.137:0/1256425075 learned_addr learned my addr 172.21.15.137:0/1256425075 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b2659c640 1 --2- 172.21.15.137:0/1256425075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280cf2e0 0x7f3b2806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b25d9b640 1 -- 172.21.15.137:0/1256425075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280cf2e0 msgr2=0x7f3b2806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b25d9b640 1 --2- 172.21.15.137:0/1256425075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280cf2e0 0x7f3b2806d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b25d9b640 1 -- 172.21.15.137:0/1256425075 >> v1:172.21.15.170:6789/0 conn(0x7f3b2806e2c0 legacy=0x7f3b2815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:39.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b25d9b640 1 -- 172.21.15.137:0/1256425075 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b280d1d00 con 0x7f3b280d11b0 2024-04-26T22:02:39.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.296+0000 7f3b2659c640 1 --2- 172.21.15.137:0/1256425075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280cf2e0 0x7f3b2806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:39.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.297+0000 7f3b25d9b640 1 --2- 172.21.15.137:0/1256425075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b280d11b0 0x7f3b2806dd80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009870 tx=0x7f3b1c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a596e50494d237d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:39.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.297+0000 7f3b2559a640 1 -- 172.21.15.137:0/1256425075 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c037070 con 0x7f3b280d11b0 2024-04-26T22:02:39.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.297+0000 7f3b2559a640 1 -- 172.21.15.137:0/1256425075 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1c032440 con 0x7f3b280d11b0 2024-04-26T22:02:39.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.297+0000 7f3b2559a640 1 -- 172.21.15.137:0/1256425075 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c032810 con 0x7f3b280d11b0 2024-04-26T22:02:39.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.298+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/1256425075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b280d11b0 msgr2=0x7f3b2806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.298+0000 7f3b2cb5f640 1 --2- 172.21.15.137:0/1256425075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b280d11b0 0x7f3b2806dd80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009870 tx=0x7f3b1c02a210 comp rx=0 tx=0).stop 2024-04-26T22:02:39.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.298+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/1256425075 shutdown_connections 2024-04-26T22:02:39.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.298+0000 7f3b2cb5f640 1 --2- 172.21.15.137:0/1256425075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b280d11b0 0x7f3b2806dd80 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.298+0000 7f3b2cb5f640 1 --2- 172.21.15.137:0/1256425075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280cf2e0 0x7f3b2806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.298+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/1256425075 >> 172.21.15.137:0/1256425075 conn(0x7f3b280b4a60 msgr2=0x7f3b280b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:39.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.298+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/1256425075 shutdown_connections 2024-04-26T22:02:39.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.298+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/1256425075 wait complete. 2024-04-26T22:02:39.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.299+0000 7f3b2cb5f640 1 Processor -- start 2024-04-26T22:02:39.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.299+0000 7f3b2cb5f640 1 -- start start 2024-04-26T22:02:39.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2cb5f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b2806e2c0 0x7f3b28160b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2cb5f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b280cf2e0 0x7f3b2809ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2cb5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280d11b0 0x7f3b2809efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2cb5f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2806da10 con 0x7f3b2806e2c0 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2cb5f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3b280d22c0 con 0x7f3b280cf2e0 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2cb5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3b280cf6c0 con 0x7f3b280d11b0 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b2806e2c0 0x7f3b28160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b2806e2c0 0x7f3b28160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45776/0 (socket says 172.21.15.137:45776) 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2659c640 1 -- 172.21.15.137:0/497397934 learned_addr learned my addr 172.21.15.137:0/497397934 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b25d9b640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b280cf2e0 0x7f3b2809ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b26d9d640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280d11b0 0x7f3b2809efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2659c640 1 -- 172.21.15.137:0/497397934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280d11b0 msgr2=0x7f3b2809efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2659c640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280d11b0 0x7f3b2809efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2659c640 1 -- 172.21.15.137:0/497397934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b280cf2e0 msgr2=0x7f3b2809ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2659c640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b280cf2e0 0x7f3b2809ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2659c640 1 -- 172.21.15.137:0/497397934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b280c9320 con 0x7f3b2806e2c0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.300+0000 7f3b2659c640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b2806e2c0 0x7f3b28160b20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c7f0 tx=0x7f3b1800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.301+0000 7f3b16ffd640 1 -- 172.21.15.137:0/497397934 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18015070 con 0x7f3b2806e2c0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.301+0000 7f3b16ffd640 1 -- 172.21.15.137:0/497397934 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b18007a30 con 0x7f3b2806e2c0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.301+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2809d9e0 con 0x7f3b2806e2c0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.301+0000 7f3b16ffd640 1 -- 172.21.15.137:0/497397934 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18007e00 con 0x7f3b2806e2c0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.301+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b280c6c20 con 0x7f3b2806e2c0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.302+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2809df00 con 0x7f3b2806e2c0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.302+0000 7f3b16ffd640 1 -- 172.21.15.137:0/497397934 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b18018070 con 0x7f3b2806e2c0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.302+0000 7f3b16ffd640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3b0806c920 0x7f3b0806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.303+0000 7f3b16ffd640 1 -- 172.21.15.137:0/497397934 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f3b1808bb30 con 0x7f3b2806e2c0 2024-04-26T22:02:39.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.303+0000 7f3b25d9b640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3b0806c920 0x7f3b0806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.303+0000 7f3b25d9b640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3b0806c920 0x7f3b0806ede0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c034000 tx=0x7f3b1c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:39.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.307+0000 7f3b16ffd640 1 -- 172.21.15.137:0/497397934 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3b2809df00 con 0x7f3b2806e2c0 2024-04-26T22:02:39.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.518+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b2806a290 con 0x7f3b2806e2c0 2024-04-26T22:02:39.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.518+0000 7f3b16ffd640 1 -- 172.21.15.137:0/497397934 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5195 (secure 0 0 0) 0x7f3b18059f60 con 0x7f3b2806e2c0 2024-04-26T22:02:39.518 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:39.518 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:02:38.507657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1566574554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1566574554},{"type":"v1","addr":"172.21.15.137:6837","nonce":1566574554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":5}]} 2024-04-26T22:02:39.519 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 34 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3b0806c920 msgr2=0x7f3b0806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3b0806c920 0x7f3b0806ede0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c034000 tx=0x7f3b1c02e000 comp rx=0 tx=0).stop 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b2806e2c0 msgr2=0x7f3b28160b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b2806e2c0 0x7f3b28160b20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800c7f0 tx=0x7f3b1800cbf0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 shutdown_connections 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3b0806c920 0x7f3b0806ede0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3b280d11b0 0x7f3b2809efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b280cf2e0 0x7f3b2809ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 --2- 172.21.15.137:0/497397934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3b2806e2c0 0x7f3b28160b20 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.520+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 >> 172.21.15.137:0/497397934 conn(0x7f3b280b4a60 msgr2=0x7f3b28162d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:39.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.521+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 shutdown_connections 2024-04-26T22:02:39.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.521+0000 7f3b2cb5f640 1 -- 172.21.15.137:0/497397934 wait complete. 2024-04-26T22:02:39.532 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.629+0000 7fdaabbbd640 1 Processor -- start 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.629+0000 7fdaabbbd640 1 -- start start 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaabbbd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa40d11b0 0x7fdaa406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaabbbd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdaa406e2c0 0x7fdaa415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaabbbd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa40d1740 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaabbbd640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa406e750 con 0x7fdaa406e2c0 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaabbbd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa40d1a20 con 0x7fdaa40d11b0 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaaa15a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdaa406e2c0 0x7fdaa415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaaa15a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdaa406e2c0 0x7fdaa415ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45790/0 (socket says 172.21.15.137:45790) 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaaa15a640 1 -- 172.21.15.137:0/600555327 learned_addr learned my addr 172.21.15.137:0/600555327 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:39.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaa9158640 1 --2- 172.21.15.137:0/600555327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa40d11b0 0x7fdaa406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaaa15a640 1 -- 172.21.15.137:0/600555327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa40d11b0 msgr2=0x7fdaa406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:39.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaaa15a640 1 --2- 172.21.15.137:0/600555327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa40d11b0 0x7fdaa406dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaaa15a640 1 -- 172.21.15.137:0/600555327 >> v1:172.21.15.170:6789/0 conn(0x7fdaa40cf2e0 legacy=0x7fdaa406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.630+0000 7fdaaa15a640 1 -- 172.21.15.137:0/600555327 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa40d1d00 con 0x7fdaa406e2c0 2024-04-26T22:02:39.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaaa15a640 1 --2- 172.21.15.137:0/600555327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa406e2c0 0x7fdaa415ebe0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009e50 tx=0x7fdaa002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acae60cfa5f4e8cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:39.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaa8957640 1 -- 172.21.15.137:0/600555327 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0036070 con 0x7fdaa406e2c0 2024-04-26T22:02:39.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaa8957640 1 -- 172.21.15.137:0/600555327 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa0031600 con 0x7fdaa406e2c0 2024-04-26T22:02:39.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaa8957640 1 -- 172.21.15.137:0/600555327 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00319d0 con 0x7fdaa406e2c0 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaabbbd640 1 -- 172.21.15.137:0/600555327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa406e2c0 msgr2=0x7fdaa415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaabbbd640 1 --2- 172.21.15.137:0/600555327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa406e2c0 0x7fdaa415ebe0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009e50 tx=0x7fdaa002a710 comp rx=0 tx=0).stop 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaabbbd640 1 -- 172.21.15.137:0/600555327 shutdown_connections 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaabbbd640 1 --2- 172.21.15.137:0/600555327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa406e2c0 0x7fdaa415ebe0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaabbbd640 1 --2- 172.21.15.137:0/600555327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa40d11b0 0x7fdaa406dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaabbbd640 1 -- 172.21.15.137:0/600555327 >> 172.21.15.137:0/600555327 conn(0x7fdaa40b4a60 msgr2=0x7fdaa40b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaabbbd640 1 -- 172.21.15.137:0/600555327 shutdown_connections 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.631+0000 7fdaabbbd640 1 -- 172.21.15.137:0/600555327 wait complete. 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaabbbd640 1 Processor -- start 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaabbbd640 1 -- start start 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaabbbd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa406e2c0 0x7fdaa41585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaabbbd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa40cf2e0 0x7fdaa409cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaabbbd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaa40d11b0 0x7fdaa40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaabbbd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40cf6c0 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaabbbd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40d22c0 con 0x7fdaa40d11b0 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaabbbd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa40cf840 con 0x7fdaa406e2c0 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaa9158640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa40cf2e0 0x7fdaa409cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaa9158640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa40cf2e0 0x7fdaa409cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45792/0 (socket says 172.21.15.137:45792) 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.633+0000 7fdaa9158640 1 -- 172.21.15.137:0/3432050855 learned_addr learned my addr 172.21.15.137:0/3432050855 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaaa15a640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaa40d11b0 0x7fdaa40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaa9959640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa406e2c0 0x7fdaa41585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaa9158640 1 -- 172.21.15.137:0/3432050855 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa406e2c0 msgr2=0x7fdaa41585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaa9158640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa406e2c0 0x7fdaa41585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaa9158640 1 -- 172.21.15.137:0/3432050855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaa40d11b0 msgr2=0x7fdaa40b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaa9158640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaa40d11b0 0x7fdaa40b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaa9158640 1 -- 172.21.15.137:0/3432050855 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa409d880 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaa9158640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa40cf2e0 0x7fdaa409cea0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fda9400d5f0 tx=0x7fda9400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:39.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fda9a7fc640 1 -- 172.21.15.137:0/3432050855 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940125f0 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fda9a7fc640 1 -- 172.21.15.137:0/3432050855 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94019070 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa409db60 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fda9a7fc640 1 -- 172.21.15.137:0/3432050855 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda940129d0 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.634+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa409e120 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.635+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa406a290 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.635+0000 7fda9a7fc640 1 -- 172.21.15.137:0/3432050855 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda94012b70 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.636+0000 7fda9a7fc640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda8806c8f0 0x7fda8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.636+0000 7fda9a7fc640 1 -- 172.21.15.137:0/3432050855 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fda9408bf60 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.636+0000 7fdaa9959640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda8806c8f0 0x7fda8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.636+0000 7fdaa9959640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda8806c8f0 0x7fda8806edb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda9c007fd0 tx=0x7fda9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:39.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.640+0000 7fda9a7fc640 1 -- 172.21.15.137:0/3432050855 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fda9405a390 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.817+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdaa40b8ef0 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.818+0000 7fda9a7fc640 1 -- 172.21.15.137:0/3432050855 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16680 (secure 0 0 0) 0x7fda94059c90 con 0x7fdaa40cf2e0 2024-04-26T22:02:39.818 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:39.818 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":72,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:02:38.169115+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:02:34.722395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T22:02:35.462679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:39.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda8806c8f0 msgr2=0x7fda8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda8806c8f0 0x7fda8806edb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fda9c007fd0 tx=0x7fda9c009040 comp rx=0 tx=0).stop 2024-04-26T22:02:39.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa40cf2e0 msgr2=0x7fdaa409cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa40cf2e0 0x7fdaa409cea0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fda9400d5f0 tx=0x7fda9400dab0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 shutdown_connections 2024-04-26T22:02:39.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fda8806c8f0 0x7fda8806edb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdaa40cf2e0 0x7fdaa409cea0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdaa40d11b0 0x7fdaa40b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 --2- 172.21.15.137:0/3432050855 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdaa406e2c0 0x7fdaa41585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 >> 172.21.15.137:0/3432050855 conn(0x7fdaa40b4a60 msgr2=0x7fdaa40b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:39.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 shutdown_connections 2024-04-26T22:02:39.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.820+0000 7fdaabbbd640 1 -- 172.21.15.137:0/3432050855 wait complete. 2024-04-26T22:02:39.833 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T22:02:39.833 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:02:39.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.930+0000 7f1f4e5af640 1 Processor -- start 2024-04-26T22:02:39.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.930+0000 7f1f4e5af640 1 -- start start 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.931+0000 7f1f4e5af640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f48070d20 0x7f1f48071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.931+0000 7f1f4e5af640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1f48070520 0x7f1f48163640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.931+0000 7f1f4e5af640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f480d14c0 con 0x7f1f4809c400 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.931+0000 7f1f4e5af640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1f480d1290 con 0x7f1f48070d20 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.931+0000 7f1f4e5af640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1f48071640 con 0x7f1f48070520 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.931+0000 7f1f47fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f48070d20 0x7f1f48071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.931+0000 7f1f47fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f48070d20 0x7f1f48071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45794/0 (socket says 172.21.15.137:45794) 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.931+0000 7f1f47fff640 1 -- 172.21.15.137:0/665981612 learned_addr learned my addr 172.21.15.137:0/665981612 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.932+0000 7f1f47fff640 1 -- 172.21.15.137:0/665981612 >> v2:172.21.15.170:3300/0 conn(0x7f1f48070520 msgr2=0x7f1f48163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.932+0000 7f1f47fff640 1 --2- 172.21.15.137:0/665981612 >> v2:172.21.15.170:3300/0 conn(0x7f1f48070520 0x7f1f48163640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.932+0000 7f1f47fff640 1 -- 172.21.15.137:0/665981612 >> v1:172.21.15.170:6789/0 conn(0x7f1f4809c400 legacy=0x7f1f48162f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:39.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.932+0000 7f1f47fff640 1 -- 172.21.15.137:0/665981612 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f480ce5b0 con 0x7f1f48070d20 2024-04-26T22:02:39.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.932+0000 7f1f47fff640 1 --2- 172.21.15.137:0/665981612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 0x7f1f48071100 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1f480cf980 tx=0x7f1f3802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc4853edf0354e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.932+0000 7f1f46ffd640 1 -- 172.21.15.137:0/665981612 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f38037070 con 0x7f1f48070d20 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.932+0000 7f1f46ffd640 1 -- 172.21.15.137:0/665981612 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f38032440 con 0x7f1f48070d20 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.933+0000 7f1f46ffd640 1 -- 172.21.15.137:0/665981612 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f38032810 con 0x7f1f48070d20 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.933+0000 7f1f4e5af640 1 -- 172.21.15.137:0/665981612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 msgr2=0x7f1f48071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.933+0000 7f1f4e5af640 1 --2- 172.21.15.137:0/665981612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 0x7f1f48071100 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1f480cf980 tx=0x7f1f3802a230 comp rx=0 tx=0).stop 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.933+0000 7f1f4e5af640 1 -- 172.21.15.137:0/665981612 shutdown_connections 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.933+0000 7f1f4e5af640 1 --2- 172.21.15.137:0/665981612 >> v2:172.21.15.170:3300/0 conn(0x7f1f48070520 0x7f1f48163640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.933+0000 7f1f4e5af640 1 --2- 172.21.15.137:0/665981612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 0x7f1f48071100 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.933+0000 7f1f4e5af640 1 -- 172.21.15.137:0/665981612 >> 172.21.15.137:0/665981612 conn(0x7f1f480b4a40 msgr2=0x7f1f480b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.933+0000 7f1f4e5af640 1 -- 172.21.15.137:0/665981612 shutdown_connections 2024-04-26T22:02:39.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.933+0000 7f1f4e5af640 1 -- 172.21.15.137:0/665981612 wait complete. 2024-04-26T22:02:39.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.934+0000 7f1f4e5af640 1 Processor -- start 2024-04-26T22:02:39.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.934+0000 7f1f4e5af640 1 -- start start 2024-04-26T22:02:39.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f4e5af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f48070520 0x7f1f480c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f4e5af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 0x7f1f480c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f4e5af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f4809c400 0x7f1f48155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f4e5af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f480d1d20 con 0x7f1f48070d20 2024-04-26T22:02:39.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f4e5af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1f480d1a40 con 0x7f1f4809c400 2024-04-26T22:02:39.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f4e5af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1f480d2000 con 0x7f1f48070520 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 0x7f1f480c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f477fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 0x7f1f480c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45802/0 (socket says 172.21.15.137:45802) 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f477fe640 1 -- 172.21.15.137:0/2099370726 learned_addr learned my addr 172.21.15.137:0/2099370726 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f47fff640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f48070520 0x7f1f480c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f4cb4c640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f4809c400 0x7f1f48155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f477fe640 1 -- 172.21.15.137:0/2099370726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f48070520 msgr2=0x7f1f480c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f477fe640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f48070520 0x7f1f480c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.935+0000 7f1f477fe640 1 -- 172.21.15.137:0/2099370726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f4809c400 msgr2=0x7f1f48155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.936+0000 7f1f477fe640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f4809c400 0x7f1f48155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.936+0000 7f1f477fe640 1 -- 172.21.15.137:0/2099370726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f480b5ff0 con 0x7f1f48070d20 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.936+0000 7f1f4cb4c640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f4809c400 0x7f1f48155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.936+0000 7f1f477fe640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 0x7f1f480c7450 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c410 tx=0x7f1f3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.936+0000 7f1f44ff9640 1 -- 172.21.15.137:0/2099370726 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c017070 con 0x7f1f48070d20 2024-04-26T22:02:39.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.936+0000 7f1f44ff9640 1 -- 172.21.15.137:0/2099370726 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c0035f0 con 0x7f1f48070d20 2024-04-26T22:02:39.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.936+0000 7f1f44ff9640 1 -- 172.21.15.137:0/2099370726 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c003a20 con 0x7f1f48070d20 2024-04-26T22:02:39.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.936+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f481559c0 con 0x7f1f48070d20 2024-04-26T22:02:39.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.936+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f480b6290 con 0x7f1f48070d20 2024-04-26T22:02:39.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.937+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f480693d0 con 0x7f1f48070d20 2024-04-26T22:02:39.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.937+0000 7f1f44ff9640 1 -- 172.21.15.137:0/2099370726 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f3c01a070 con 0x7f1f48070d20 2024-04-26T22:02:39.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.938+0000 7f1f44ff9640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f3406c8f0 0x7f1f3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:39.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.938+0000 7f1f44ff9640 1 -- 172.21.15.137:0/2099370726 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f1f3c08af60 con 0x7f1f48070d20 2024-04-26T22:02:39.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.938+0000 7f1f47fff640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f3406c8f0 0x7f1f3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:39.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.938+0000 7f1f47fff640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f3406c8f0 0x7f1f3406edb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1f38034000 tx=0x7f1f3802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:39.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:39.942+0000 7f1f44ff9640 1 -- 172.21.15.137:0/2099370726 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1f3c059420 con 0x7f1f48070d20 2024-04-26T22:02:40.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.111+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f48074880 con 0x7f1f3406c8f0 2024-04-26T22:02:40.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.117+0000 7f1f44ff9640 1 -- 172.21.15.137:0/2099370726 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251999 (secure 0 0 0) 0x7f1f48074880 con 0x7f1f3406c8f0 2024-04-26T22:02:40.120 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:40.121 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:02:40.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f3406c8f0 msgr2=0x7f1f3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f3406c8f0 0x7f1f3406edb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1f38034000 tx=0x7f1f3802e000 comp rx=0 tx=0).stop 2024-04-26T22:02:40.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 msgr2=0x7f1f480c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 0x7f1f480c7450 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00c410 tx=0x7f1f3c00c8d0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 shutdown_connections 2024-04-26T22:02:40.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f3406c8f0 0x7f1f3406edb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f48070d20 0x7f1f480c7450 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f4809c400 0x7f1f48155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 --2- 172.21.15.137:0/2099370726 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f48070520 0x7f1f480c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 >> 172.21.15.137:0/2099370726 conn(0x7f1f480b4a40 msgr2=0x7f1f480cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:40.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 shutdown_connections 2024-04-26T22:02:40.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.120+0000 7f1f4e5af640 1 -- 172.21.15.137:0/2099370726 wait complete. 2024-04-26T22:02:40.131 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-26T22:02:38.744864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249032,"kb_used_data":7896,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725688,"statfs":{"total":773094113280,"available":772839104512,"internally_reserved":0,"allocated":8085504,"data_stored":4057374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000666"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188024+0000","last_change":"2024-04-26T22:02:37.181848+0000","last_active":"2024-04-26T22:02:37.188024+0000","last_peered":"2024-04-26T22:02:37.188024+0000","last_clean":"2024-04-26T22:02:37.188024+0000","last_became_active":"2024-04-26T22:02:37.181061+0000","last_became_peered":"2024-04-26T22:02:37.181061+0000","last_unstale":"2024-04-26T22:02:37.188024+0000","last_undegraded":"2024-04-26T22:02:37.188024+0000","last_fullsized":"2024-04-26T22:02:37.188024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:32.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193325+0000","last_change":"2024-04-26T22:02:37.188597+0000","last_active":"2024-04-26T22:02:37.193325+0000","last_peered":"2024-04-26T22:02:37.193325+0000","last_clean":"2024-04-26T22:02:37.193325+0000","last_became_active":"2024-04-26T22:02:37.187300+0000","last_became_peered":"2024-04-26T22:02:37.187300+0000","last_unstale":"2024-04-26T22:02:37.193325+0000","last_undegraded":"2024-04-26T22:02:37.193325+0000","last_fullsized":"2024-04-26T22:02:37.193325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:54.723897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184484+0000","last_change":"2024-04-26T22:02:37.181859+0000","last_active":"2024-04-26T22:02:37.184484+0000","last_peered":"2024-04-26T22:02:37.184484+0000","last_clean":"2024-04-26T22:02:37.184484+0000","last_became_active":"2024-04-26T22:02:37.181578+0000","last_became_peered":"2024-04-26T22:02:37.181578+0000","last_unstale":"2024-04-26T22:02:37.184484+0000","last_undegraded":"2024-04-26T22:02:37.184484+0000","last_fullsized":"2024-04-26T22:02:37.184484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:15.828918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187009+0000","last_change":"2024-04-26T22:02:37.183695+0000","last_active":"2024-04-26T22:02:37.187009+0000","last_peered":"2024-04-26T22:02:37.187009+0000","last_clean":"2024-04-26T22:02:37.187009+0000","last_became_active":"2024-04-26T22:02:37.183445+0000","last_became_peered":"2024-04-26T22:02:37.183445+0000","last_unstale":"2024-04-26T22:02:37.187009+0000","last_undegraded":"2024-04-26T22:02:37.187009+0000","last_fullsized":"2024-04-26T22:02:37.187009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:39.736671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182345+0000","last_change":"2024-04-26T22:02:37.176840+0000","last_active":"2024-04-26T22:02:37.182345+0000","last_peered":"2024-04-26T22:02:37.182345+0000","last_clean":"2024-04-26T22:02:37.182345+0000","last_became_active":"2024-04-26T22:02:37.176583+0000","last_became_peered":"2024-04-26T22:02:37.176583+0000","last_unstale":"2024-04-26T22:02:37.182345+0000","last_undegraded":"2024-04-26T22:02:37.182345+0000","last_fullsized":"2024-04-26T22:02:37.182345+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:50.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182244+0000","last_change":"2024-04-26T22:02:37.180588+0000","last_active":"2024-04-26T22:02:37.182244+0000","last_peered":"2024-04-26T22:02:37.182244+0000","last_clean":"2024-04-26T22:02:37.182244+0000","last_became_active":"2024-04-26T22:02:37.180244+0000","last_became_peered":"2024-04-26T22:02:37.180244+0000","last_unstale":"2024-04-26T22:02:37.182244+0000","last_undegraded":"2024-04-26T22:02:37.182244+0000","last_fullsized":"2024-04-26T22:02:37.182244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:53.537908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182602+0000","last_change":"2024-04-26T22:02:37.180698+0000","last_active":"2024-04-26T22:02:37.182602+0000","last_peered":"2024-04-26T22:02:37.182602+0000","last_clean":"2024-04-26T22:02:37.182602+0000","last_became_active":"2024-04-26T22:02:37.180421+0000","last_became_peered":"2024-04-26T22:02:37.180421+0000","last_unstale":"2024-04-26T22:02:37.182602+0000","last_undegraded":"2024-04-26T22:02:37.182602+0000","last_fullsized":"2024-04-26T22:02:37.182602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:56.978460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184490+0000","last_change":"2024-04-26T22:02:37.182862+0000","last_active":"2024-04-26T22:02:37.184490+0000","last_peered":"2024-04-26T22:02:37.184490+0000","last_clean":"2024-04-26T22:02:37.184490+0000","last_became_active":"2024-04-26T22:02:37.182589+0000","last_became_peered":"2024-04-26T22:02:37.182589+0000","last_unstale":"2024-04-26T22:02:37.184490+0000","last_undegraded":"2024-04-26T22:02:37.184490+0000","last_fullsized":"2024-04-26T22:02:37.184490+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:08.857860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193337+0000","last_change":"2024-04-26T22:02:37.188394+0000","last_active":"2024-04-26T22:02:37.193337+0000","last_peered":"2024-04-26T22:02:37.193337+0000","last_clean":"2024-04-26T22:02:37.193337+0000","last_became_active":"2024-04-26T22:02:37.187798+0000","last_became_peered":"2024-04-26T22:02:37.187798+0000","last_unstale":"2024-04-26T22:02:37.193337+0000","last_undegraded":"2024-04-26T22:02:37.193337+0000","last_fullsized":"2024-04-26T22:02:37.193337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:08.803345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186302+0000","last_change":"2024-04-26T22:02:37.180307+0000","last_active":"2024-04-26T22:02:37.186302+0000","last_peered":"2024-04-26T22:02:37.186302+0000","last_clean":"2024-04-26T22:02:37.186302+0000","last_became_active":"2024-04-26T22:02:37.179655+0000","last_became_peered":"2024-04-26T22:02:37.179655+0000","last_unstale":"2024-04-26T22:02:37.186302+0000","last_undegraded":"2024-04-26T22:02:37.186302+0000","last_fullsized":"2024-04-26T22:02:37.186302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:56.978460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188769+0000","last_change":"2024-04-26T22:02:37.186020+0000","last_active":"2024-04-26T22:02:37.188769+0000","last_peered":"2024-04-26T22:02:37.188769+0000","last_clean":"2024-04-26T22:02:37.188769+0000","last_became_active":"2024-04-26T22:02:37.185661+0000","last_became_peered":"2024-04-26T22:02:37.185661+0000","last_unstale":"2024-04-26T22:02:37.188769+0000","last_undegraded":"2024-04-26T22:02:37.188769+0000","last_fullsized":"2024-04-26T22:02:37.188769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:47.784443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.179478+0000","last_change":"2024-04-26T22:02:37.178103+0000","last_active":"2024-04-26T22:02:37.179478+0000","last_peered":"2024-04-26T22:02:37.179478+0000","last_clean":"2024-04-26T22:02:37.179478+0000","last_became_active":"2024-04-26T22:02:37.177762+0000","last_became_peered":"2024-04-26T22:02:37.177762+0000","last_unstale":"2024-04-26T22:02:37.179478+0000","last_undegraded":"2024-04-26T22:02:37.179478+0000","last_fullsized":"2024-04-26T22:02:37.179478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:22.164899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188073+0000","last_change":"2024-04-26T22:02:37.184576+0000","last_active":"2024-04-26T22:02:37.188073+0000","last_peered":"2024-04-26T22:02:37.188073+0000","last_clean":"2024-04-26T22:02:37.188073+0000","last_became_active":"2024-04-26T22:02:37.184246+0000","last_became_peered":"2024-04-26T22:02:37.184246+0000","last_unstale":"2024-04-26T22:02:37.188073+0000","last_undegraded":"2024-04-26T22:02:37.188073+0000","last_fullsized":"2024-04-26T22:02:37.188073+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:50.586308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.185114+0000","last_change":"2024-04-26T22:02:37.180582+0000","last_active":"2024-04-26T22:02:37.185114+0000","last_peered":"2024-04-26T22:02:37.185114+0000","last_clean":"2024-04-26T22:02:37.185114+0000","last_became_active":"2024-04-26T22:02:37.180328+0000","last_became_peered":"2024-04-26T22:02:37.180328+0000","last_unstale":"2024-04-26T22:02:37.185114+0000","last_undegraded":"2024-04-26T22:02:37.185114+0000","last_fullsized":"2024-04-26T22:02:37.185114+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:54.306698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187456+0000","last_change":"2024-04-26T22:02:37.182079+0000","last_active":"2024-04-26T22:02:37.187456+0000","last_peered":"2024-04-26T22:02:37.187456+0000","last_clean":"2024-04-26T22:02:37.187456+0000","last_became_active":"2024-04-26T22:02:37.181815+0000","last_became_peered":"2024-04-26T22:02:37.181815+0000","last_unstale":"2024-04-26T22:02:37.187456+0000","last_undegraded":"2024-04-26T22:02:37.187456+0000","last_fullsized":"2024-04-26T22:02:37.187456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:02.125950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186662+0000","last_change":"2024-04-26T22:02:37.185040+0000","last_active":"2024-04-26T22:02:37.186662+0000","last_peered":"2024-04-26T22:02:37.186662+0000","last_clean":"2024-04-26T22:02:37.186662+0000","last_became_active":"2024-04-26T22:02:37.184743+0000","last_became_peered":"2024-04-26T22:02:37.184743+0000","last_unstale":"2024-04-26T22:02:37.186662+0000","last_undegraded":"2024-04-26T22:02:37.186662+0000","last_fullsized":"2024-04-26T22:02:37.186662+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:23.224579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193308+0000","last_change":"2024-04-26T22:02:37.188311+0000","last_active":"2024-04-26T22:02:37.193308+0000","last_peered":"2024-04-26T22:02:37.193308+0000","last_clean":"2024-04-26T22:02:37.193308+0000","last_became_active":"2024-04-26T22:02:37.187082+0000","last_became_peered":"2024-04-26T22:02:37.187082+0000","last_unstale":"2024-04-26T22:02:37.193308+0000","last_undegraded":"2024-04-26T22:02:37.193308+0000","last_fullsized":"2024-04-26T22:02:37.193308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:47.815518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186973+0000","last_change":"2024-04-26T22:02:37.182426+0000","last_active":"2024-04-26T22:02:37.186973+0000","last_peered":"2024-04-26T22:02:37.186973+0000","last_clean":"2024-04-26T22:02:37.186973+0000","last_became_active":"2024-04-26T22:02:37.182170+0000","last_became_peered":"2024-04-26T22:02:37.182170+0000","last_unstale":"2024-04-26T22:02:37.186973+0000","last_undegraded":"2024-04-26T22:02:37.186973+0000","last_fullsized":"2024-04-26T22:02:37.186973+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:57.629529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187503+0000","last_change":"2024-04-26T22:02:37.185203+0000","last_active":"2024-04-26T22:02:37.187503+0000","last_peered":"2024-04-26T22:02:37.187503+0000","last_clean":"2024-04-26T22:02:37.187503+0000","last_became_active":"2024-04-26T22:02:37.184880+0000","last_became_peered":"2024-04-26T22:02:37.184880+0000","last_unstale":"2024-04-26T22:02:37.187503+0000","last_undegraded":"2024-04-26T22:02:37.187503+0000","last_fullsized":"2024-04-26T22:02:37.187503+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:41.606764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.179836+0000","last_change":"2024-04-26T22:02:37.178909+0000","last_active":"2024-04-26T22:02:37.179836+0000","last_peered":"2024-04-26T22:02:37.179836+0000","last_clean":"2024-04-26T22:02:37.179836+0000","last_became_active":"2024-04-26T22:02:37.178538+0000","last_became_peered":"2024-04-26T22:02:37.178538+0000","last_unstale":"2024-04-26T22:02:37.179836+0000","last_undegraded":"2024-04-26T22:02:37.179836+0000","last_fullsized":"2024-04-26T22:02:37.179836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:45.955846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186103+0000","last_change":"2024-04-26T22:02:37.178483+0000","last_active":"2024-04-26T22:02:37.186103+0000","last_peered":"2024-04-26T22:02:37.186103+0000","last_clean":"2024-04-26T22:02:37.186103+0000","last_became_active":"2024-04-26T22:02:37.178173+0000","last_became_peered":"2024-04-26T22:02:37.178173+0000","last_unstale":"2024-04-26T22:02:37.186103+0000","last_undegraded":"2024-04-26T22:02:37.186103+0000","last_fullsized":"2024-04-26T22:02:37.186103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:16.553577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186442+0000","last_change":"2024-04-26T22:02:37.181656+0000","last_active":"2024-04-26T22:02:37.186442+0000","last_peered":"2024-04-26T22:02:37.186442+0000","last_clean":"2024-04-26T22:02:37.186442+0000","last_became_active":"2024-04-26T22:02:37.180821+0000","last_became_peered":"2024-04-26T22:02:37.180821+0000","last_unstale":"2024-04-26T22:02:37.186442+0000","last_undegraded":"2024-04-26T22:02:37.186442+0000","last_fullsized":"2024-04-26T22:02:37.186442+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:21.372359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186888+0000","last_change":"2024-04-26T22:02:37.183420+0000","last_active":"2024-04-26T22:02:37.186888+0000","last_peered":"2024-04-26T22:02:37.186888+0000","last_clean":"2024-04-26T22:02:37.186888+0000","last_became_active":"2024-04-26T22:02:37.182248+0000","last_became_peered":"2024-04-26T22:02:37.182248+0000","last_unstale":"2024-04-26T22:02:37.186888+0000","last_undegraded":"2024-04-26T22:02:37.186888+0000","last_fullsized":"2024-04-26T22:02:37.186888+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:18.964219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188741+0000","last_change":"2024-04-26T22:02:37.184205+0000","last_active":"2024-04-26T22:02:37.188741+0000","last_peered":"2024-04-26T22:02:37.188741+0000","last_clean":"2024-04-26T22:02:37.188741+0000","last_became_active":"2024-04-26T22:02:37.183923+0000","last_became_peered":"2024-04-26T22:02:37.183923+0000","last_unstale":"2024-04-26T22:02:37.188741+0000","last_undegraded":"2024-04-26T22:02:37.188741+0000","last_fullsized":"2024-04-26T22:02:37.188741+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:18.185820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.174190+0000","last_change":"2024-04-26T22:02:37.172184+0000","last_active":"2024-04-26T22:02:37.174190+0000","last_peered":"2024-04-26T22:02:37.174190+0000","last_clean":"2024-04-26T22:02:37.174190+0000","last_became_active":"2024-04-26T22:02:37.171904+0000","last_became_peered":"2024-04-26T22:02:37.171904+0000","last_unstale":"2024-04-26T22:02:37.174190+0000","last_undegraded":"2024-04-26T22:02:37.174190+0000","last_fullsized":"2024-04-26T22:02:37.174190+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:54.723897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187996+0000","last_change":"2024-04-26T22:02:37.183530+0000","last_active":"2024-04-26T22:02:37.187996+0000","last_peered":"2024-04-26T22:02:37.187996+0000","last_clean":"2024-04-26T22:02:37.187996+0000","last_became_active":"2024-04-26T22:02:37.183241+0000","last_became_peered":"2024-04-26T22:02:37.183241+0000","last_unstale":"2024-04-26T22:02:37.187996+0000","last_undegraded":"2024-04-26T22:02:37.187996+0000","last_fullsized":"2024-04-26T22:02:37.187996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.964876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184505+0000","last_change":"2024-04-26T22:02:37.181373+0000","last_active":"2024-04-26T22:02:37.184505+0000","last_peered":"2024-04-26T22:02:37.184505+0000","last_clean":"2024-04-26T22:02:37.184505+0000","last_became_active":"2024-04-26T22:02:37.180554+0000","last_became_peered":"2024-04-26T22:02:37.180554+0000","last_unstale":"2024-04-26T22:02:37.184505+0000","last_undegraded":"2024-04-26T22:02:37.184505+0000","last_fullsized":"2024-04-26T22:02:37.184505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:15.058710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186493+0000","last_change":"2024-04-26T22:02:37.179960+0000","last_active":"2024-04-26T22:02:37.186493+0000","last_peered":"2024-04-26T22:02:37.186493+0000","last_clean":"2024-04-26T22:02:37.186493+0000","last_became_active":"2024-04-26T22:02:37.179418+0000","last_became_peered":"2024-04-26T22:02:37.179418+0000","last_unstale":"2024-04-26T22:02:37.186493+0000","last_undegraded":"2024-04-26T22:02:37.186493+0000","last_fullsized":"2024-04-26T22:02:37.186493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:32.315572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184355+0000","last_change":"2024-04-26T22:02:37.181841+0000","last_active":"2024-04-26T22:02:37.184355+0000","last_peered":"2024-04-26T22:02:37.184355+0000","last_clean":"2024-04-26T22:02:37.184355+0000","last_became_active":"2024-04-26T22:02:37.181332+0000","last_became_peered":"2024-04-26T22:02:37.181332+0000","last_unstale":"2024-04-26T22:02:37.184355+0000","last_undegraded":"2024-04-26T22:02:37.184355+0000","last_fullsized":"2024-04-26T22:02:37.184355+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:44.551426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188027+0000","last_change":"2024-04-26T22:02:37.183376+0000","last_active":"2024-04-26T22:02:37.188027+0000","last_peered":"2024-04-26T22:02:37.188027+0000","last_clean":"2024-04-26T22:02:37.188027+0000","last_became_active":"2024-04-26T22:02:37.182896+0000","last_became_peered":"2024-04-26T22:02:37.182896+0000","last_unstale":"2024-04-26T22:02:37.188027+0000","last_undegraded":"2024-04-26T22:02:37.188027+0000","last_fullsized":"2024-04-26T22:02:37.188027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:38.453382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188056+0000","last_change":"2024-04-26T22:02:37.183348+0000","last_active":"2024-04-26T22:02:37.188056+0000","last_peered":"2024-04-26T22:02:37.188056+0000","last_clean":"2024-04-26T22:02:37.188056+0000","last_became_active":"2024-04-26T22:02:37.183036+0000","last_became_peered":"2024-04-26T22:02:37.183036+0000","last_unstale":"2024-04-26T22:02:37.188056+0000","last_undegraded":"2024-04-26T22:02:37.188056+0000","last_fullsized":"2024-04-26T22:02:37.188056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:23.224579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193501+0000","last_change":"2024-04-26T22:02:37.189673+0000","last_active":"2024-04-26T22:02:37.193501+0000","last_peered":"2024-04-26T22:02:37.193501+0000","last_clean":"2024-04-26T22:02:37.193501+0000","last_became_active":"2024-04-26T22:02:37.187748+0000","last_became_peered":"2024-04-26T22:02:37.187748+0000","last_unstale":"2024-04-26T22:02:37.193501+0000","last_undegraded":"2024-04-26T22:02:37.193501+0000","last_fullsized":"2024-04-26T22:02:37.193501+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:20.524803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188181+0000","last_change":"2024-04-26T22:02:37.183454+0000","last_active":"2024-04-26T22:02:37.188181+0000","last_peered":"2024-04-26T22:02:37.188181+0000","last_clean":"2024-04-26T22:02:37.188181+0000","last_became_active":"2024-04-26T22:02:37.183168+0000","last_became_peered":"2024-04-26T22:02:37.183168+0000","last_unstale":"2024-04-26T22:02:37.188181+0000","last_undegraded":"2024-04-26T22:02:37.188181+0000","last_fullsized":"2024-04-26T22:02:37.188181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:44.196327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.196395+0000","last_change":"2024-04-26T22:02:36.162320+0000","last_active":"2024-04-26T22:02:37.196395+0000","last_peered":"2024-04-26T22:02:37.196395+0000","last_clean":"2024-04-26T22:02:37.196395+0000","last_became_active":"2024-04-26T22:02:36.162006+0000","last_became_peered":"2024-04-26T22:02:36.162006+0000","last_unstale":"2024-04-26T22:02:37.196395+0000","last_undegraded":"2024-04-26T22:02:37.196395+0000","last_fullsized":"2024-04-26T22:02:37.196395+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:22.220580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.190841+0000","last_change":"2024-04-26T22:02:37.188132+0000","last_active":"2024-04-26T22:02:37.190841+0000","last_peered":"2024-04-26T22:02:37.190841+0000","last_clean":"2024-04-26T22:02:37.190841+0000","last_became_active":"2024-04-26T22:02:37.186489+0000","last_became_peered":"2024-04-26T22:02:37.186489+0000","last_unstale":"2024-04-26T22:02:37.190841+0000","last_undegraded":"2024-04-26T22:02:37.190841+0000","last_fullsized":"2024-04-26T22:02:37.190841+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:11.396397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193612+0000","last_change":"2024-04-26T22:02:36.169450+0000","last_active":"2024-04-26T22:02:37.193612+0000","last_peered":"2024-04-26T22:02:37.193612+0000","last_clean":"2024-04-26T22:02:37.193612+0000","last_became_active":"2024-04-26T22:02:36.169145+0000","last_became_peered":"2024-04-26T22:02:36.169145+0000","last_unstale":"2024-04-26T22:02:37.193612+0000","last_undegraded":"2024-04-26T22:02:37.193612+0000","last_fullsized":"2024-04-26T22:02:37.193612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:39.441154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.183810+0000","last_change":"2024-04-26T22:02:37.182313+0000","last_active":"2024-04-26T22:02:37.183810+0000","last_peered":"2024-04-26T22:02:37.183810+0000","last_clean":"2024-04-26T22:02:37.183810+0000","last_became_active":"2024-04-26T22:02:37.182017+0000","last_became_peered":"2024-04-26T22:02:37.182017+0000","last_unstale":"2024-04-26T22:02:37.183810+0000","last_undegraded":"2024-04-26T22:02:37.183810+0000","last_fullsized":"2024-04-26T22:02:37.183810+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:19.476094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.194100+0000","last_change":"2024-04-26T22:02:36.169769+0000","last_active":"2024-04-26T22:02:37.194100+0000","last_peered":"2024-04-26T22:02:37.194100+0000","last_clean":"2024-04-26T22:02:37.194100+0000","last_became_active":"2024-04-26T22:02:36.169483+0000","last_became_peered":"2024-04-26T22:02:36.169483+0000","last_unstale":"2024-04-26T22:02:37.194100+0000","last_undegraded":"2024-04-26T22:02:37.194100+0000","last_fullsized":"2024-04-26T22:02:37.194100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:07.853861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.185895+0000","last_change":"2024-04-26T22:02:37.179959+0000","last_active":"2024-04-26T22:02:37.185895+0000","last_peered":"2024-04-26T22:02:37.185895+0000","last_clean":"2024-04-26T22:02:37.185895+0000","last_became_active":"2024-04-26T22:02:37.179418+0000","last_became_peered":"2024-04-26T22:02:37.179418+0000","last_unstale":"2024-04-26T22:02:37.185895+0000","last_undegraded":"2024-04-26T22:02:37.185895+0000","last_fullsized":"2024-04-26T22:02:37.185895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:06.401717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.194232+0000","last_change":"2024-04-26T22:02:36.168608+0000","last_active":"2024-04-26T22:02:37.194232+0000","last_peered":"2024-04-26T22:02:37.194232+0000","last_clean":"2024-04-26T22:02:37.194232+0000","last_became_active":"2024-04-26T22:02:36.168312+0000","last_became_peered":"2024-04-26T22:02:36.168312+0000","last_unstale":"2024-04-26T22:02:37.194232+0000","last_undegraded":"2024-04-26T22:02:37.194232+0000","last_fullsized":"2024-04-26T22:02:37.194232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:44:49.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182575+0000","last_change":"2024-04-26T22:02:37.181416+0000","last_active":"2024-04-26T22:02:37.182575+0000","last_peered":"2024-04-26T22:02:37.182575+0000","last_clean":"2024-04-26T22:02:37.182575+0000","last_became_active":"2024-04-26T22:02:37.181144+0000","last_became_peered":"2024-04-26T22:02:37.181144+0000","last_unstale":"2024-04-26T22:02:37.182575+0000","last_undegraded":"2024-04-26T22:02:37.182575+0000","last_fullsized":"2024-04-26T22:02:37.182575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:21.372359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.190076+0000","last_change":"2024-04-26T22:02:36.172309+0000","last_active":"2024-04-26T22:02:37.190076+0000","last_peered":"2024-04-26T22:02:37.190076+0000","last_clean":"2024-04-26T22:02:37.190076+0000","last_became_active":"2024-04-26T22:02:36.171900+0000","last_became_peered":"2024-04-26T22:02:36.171900+0000","last_unstale":"2024-04-26T22:02:37.190076+0000","last_undegraded":"2024-04-26T22:02:37.190076+0000","last_fullsized":"2024-04-26T22:02:37.190076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:03.142445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.177464+0000","last_change":"2024-04-26T22:02:37.174833+0000","last_active":"2024-04-26T22:02:37.177464+0000","last_peered":"2024-04-26T22:02:37.177464+0000","last_clean":"2024-04-26T22:02:37.177464+0000","last_became_active":"2024-04-26T22:02:37.174335+0000","last_became_peered":"2024-04-26T22:02:37.174335+0000","last_unstale":"2024-04-26T22:02:37.177464+0000","last_undegraded":"2024-04-26T22:02:37.177464+0000","last_fullsized":"2024-04-26T22:02:37.177464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:20.524803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193919+0000","last_change":"2024-04-26T22:02:36.172094+0000","last_active":"2024-04-26T22:02:37.193919+0000","last_peered":"2024-04-26T22:02:37.193919+0000","last_clean":"2024-04-26T22:02:37.193919+0000","last_became_active":"2024-04-26T22:02:36.171831+0000","last_became_peered":"2024-04-26T22:02:36.171831+0000","last_unstale":"2024-04-26T22:02:37.193919+0000","last_undegraded":"2024-04-26T22:02:37.193919+0000","last_fullsized":"2024-04-26T22:02:37.193919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:51.622208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184202+0000","last_change":"2024-04-26T22:02:37.179092+0000","last_active":"2024-04-26T22:02:37.184202+0000","last_peered":"2024-04-26T22:02:37.184202+0000","last_clean":"2024-04-26T22:02:37.184202+0000","last_became_active":"2024-04-26T22:02:37.178804+0000","last_became_peered":"2024-04-26T22:02:37.178804+0000","last_unstale":"2024-04-26T22:02:37.184202+0000","last_undegraded":"2024-04-26T22:02:37.184202+0000","last_fullsized":"2024-04-26T22:02:37.184202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:21.924760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.164519+0000","last_change":"2024-04-26T22:02:36.166702+0000","last_active":"2024-04-26T22:02:37.164519+0000","last_peered":"2024-04-26T22:02:37.164519+0000","last_clean":"2024-04-26T22:02:37.164519+0000","last_became_active":"2024-04-26T22:02:36.165513+0000","last_became_peered":"2024-04-26T22:02:36.165513+0000","last_unstale":"2024-04-26T22:02:37.164519+0000","last_undegraded":"2024-04-26T22:02:37.164519+0000","last_fullsized":"2024-04-26T22:02:37.164519+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:19.176377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.178788+0000","last_change":"2024-04-26T22:02:37.177898+0000","last_active":"2024-04-26T22:02:37.178788+0000","last_peered":"2024-04-26T22:02:37.178788+0000","last_clean":"2024-04-26T22:02:37.178788+0000","last_became_active":"2024-04-26T22:02:37.177576+0000","last_became_peered":"2024-04-26T22:02:37.177576+0000","last_unstale":"2024-04-26T22:02:37.178788+0000","last_undegraded":"2024-04-26T22:02:37.178788+0000","last_fullsized":"2024-04-26T22:02:37.178788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:47.784443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.170040+0000","last_change":"2024-04-26T22:02:36.172852+0000","last_active":"2024-04-26T22:02:37.170040+0000","last_peered":"2024-04-26T22:02:37.170040+0000","last_clean":"2024-04-26T22:02:37.170040+0000","last_became_active":"2024-04-26T22:02:36.172565+0000","last_became_peered":"2024-04-26T22:02:36.172565+0000","last_unstale":"2024-04-26T22:02:37.170040+0000","last_undegraded":"2024-04-26T22:02:37.170040+0000","last_fullsized":"2024-04-26T22:02:37.170040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:41.342038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.180067+0000","last_change":"2024-04-26T22:02:37.177761+0000","last_active":"2024-04-26T22:02:37.180067+0000","last_peered":"2024-04-26T22:02:37.180067+0000","last_clean":"2024-04-26T22:02:37.180067+0000","last_became_active":"2024-04-26T22:02:37.177479+0000","last_became_peered":"2024-04-26T22:02:37.177479+0000","last_unstale":"2024-04-26T22:02:37.180067+0000","last_undegraded":"2024-04-26T22:02:37.180067+0000","last_fullsized":"2024-04-26T22:02:37.180067+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:16.553577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.167229+0000","last_change":"2024-04-26T22:02:36.166607+0000","last_active":"2024-04-26T22:02:37.167229+0000","last_peered":"2024-04-26T22:02:37.167229+0000","last_clean":"2024-04-26T22:02:37.167229+0000","last_became_active":"2024-04-26T22:02:36.166362+0000","last_became_peered":"2024-04-26T22:02:36.166362+0000","last_unstale":"2024-04-26T22:02:37.167229+0000","last_undegraded":"2024-04-26T22:02:37.167229+0000","last_fullsized":"2024-04-26T22:02:37.167229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:18.472095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188001+0000","last_change":"2024-04-26T22:02:37.180657+0000","last_active":"2024-04-26T22:02:37.188001+0000","last_peered":"2024-04-26T22:02:37.188001+0000","last_clean":"2024-04-26T22:02:37.188001+0000","last_became_active":"2024-04-26T22:02:37.180394+0000","last_became_peered":"2024-04-26T22:02:37.180394+0000","last_unstale":"2024-04-26T22:02:37.188001+0000","last_undegraded":"2024-04-26T22:02:37.188001+0000","last_fullsized":"2024-04-26T22:02:37.188001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:27.718715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.175659+0000","last_change":"2024-04-26T22:02:36.162588+0000","last_active":"2024-04-26T22:02:37.175659+0000","last_peered":"2024-04-26T22:02:37.175659+0000","last_clean":"2024-04-26T22:02:37.175659+0000","last_became_active":"2024-04-26T22:02:36.162322+0000","last_became_peered":"2024-04-26T22:02:36.162322+0000","last_unstale":"2024-04-26T22:02:37.175659+0000","last_undegraded":"2024-04-26T22:02:37.175659+0000","last_fullsized":"2024-04-26T22:02:37.175659+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:34.375805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193511+0000","last_change":"2024-04-26T22:02:37.189739+0000","last_active":"2024-04-26T22:02:37.193511+0000","last_peered":"2024-04-26T22:02:37.193511+0000","last_clean":"2024-04-26T22:02:37.193511+0000","last_became_active":"2024-04-26T22:02:37.188570+0000","last_became_peered":"2024-04-26T22:02:37.188570+0000","last_unstale":"2024-04-26T22:02:37.193511+0000","last_undegraded":"2024-04-26T22:02:37.193511+0000","last_fullsized":"2024-04-26T22:02:37.193511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:14.261554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.190446+0000","last_change":"2024-04-26T22:02:36.170819+0000","last_active":"2024-04-26T22:02:37.190446+0000","last_peered":"2024-04-26T22:02:37.190446+0000","last_clean":"2024-04-26T22:02:37.190446+0000","last_became_active":"2024-04-26T22:02:36.170107+0000","last_became_peered":"2024-04-26T22:02:36.170107+0000","last_unstale":"2024-04-26T22:02:37.190446+0000","last_undegraded":"2024-04-26T22:02:37.190446+0000","last_fullsized":"2024-04-26T22:02:37.190446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:18.657902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187528+0000","last_change":"2024-04-26T22:02:37.185182+0000","last_active":"2024-04-26T22:02:37.187528+0000","last_peered":"2024-04-26T22:02:37.187528+0000","last_clean":"2024-04-26T22:02:37.187528+0000","last_became_active":"2024-04-26T22:02:37.184896+0000","last_became_peered":"2024-04-26T22:02:37.184896+0000","last_unstale":"2024-04-26T22:02:37.187528+0000","last_undegraded":"2024-04-26T22:02:37.187528+0000","last_fullsized":"2024-04-26T22:02:37.187528+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:13.757206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.195911+0000","last_change":"2024-04-26T22:02:36.166953+0000","last_active":"2024-04-26T22:02:37.195911+0000","last_peered":"2024-04-26T22:02:37.195911+0000","last_clean":"2024-04-26T22:02:37.195911+0000","last_became_active":"2024-04-26T22:02:36.166522+0000","last_became_peered":"2024-04-26T22:02:36.166522+0000","last_unstale":"2024-04-26T22:02:37.195911+0000","last_undegraded":"2024-04-26T22:02:37.195911+0000","last_fullsized":"2024-04-26T22:02:37.195911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:47.707098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.180268+0000","last_change":"2024-04-26T22:02:37.178646+0000","last_active":"2024-04-26T22:02:37.180268+0000","last_peered":"2024-04-26T22:02:37.180268+0000","last_clean":"2024-04-26T22:02:37.180268+0000","last_became_active":"2024-04-26T22:02:37.178338+0000","last_became_peered":"2024-04-26T22:02:37.178338+0000","last_unstale":"2024-04-26T22:02:37.180268+0000","last_undegraded":"2024-04-26T22:02:37.180268+0000","last_fullsized":"2024-04-26T22:02:37.180268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:43.686935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193479+0000","last_change":"2024-04-26T22:02:36.163519+0000","last_active":"2024-04-26T22:02:37.193479+0000","last_peered":"2024-04-26T22:02:37.193479+0000","last_clean":"2024-04-26T22:02:37.193479+0000","last_became_active":"2024-04-26T22:02:36.163237+0000","last_became_peered":"2024-04-26T22:02:36.163237+0000","last_unstale":"2024-04-26T22:02:37.193479+0000","last_undegraded":"2024-04-26T22:02:37.193479+0000","last_fullsized":"2024-04-26T22:02:37.193479+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:39.581397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.179477+0000","last_change":"2024-04-26T22:02:37.175933+0000","last_active":"2024-04-26T22:02:37.179477+0000","last_peered":"2024-04-26T22:02:37.179477+0000","last_clean":"2024-04-26T22:02:37.179477+0000","last_became_active":"2024-04-26T22:02:37.175060+0000","last_became_peered":"2024-04-26T22:02:37.175060+0000","last_unstale":"2024-04-26T22:02:37.179477+0000","last_undegraded":"2024-04-26T22:02:37.179477+0000","last_fullsized":"2024-04-26T22:02:37.179477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:14.261554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.170916+0000","last_change":"2024-04-26T22:02:36.169435+0000","last_active":"2024-04-26T22:02:37.170916+0000","last_peered":"2024-04-26T22:02:37.170916+0000","last_clean":"2024-04-26T22:02:37.170916+0000","last_became_active":"2024-04-26T22:02:36.169145+0000","last_became_peered":"2024-04-26T22:02:36.169145+0000","last_unstale":"2024-04-26T22:02:37.170916+0000","last_undegraded":"2024-04-26T22:02:37.170916+0000","last_fullsized":"2024-04-26T22:02:37.170916+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:21.160900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188104+0000","last_change":"2024-04-26T22:02:37.183584+0000","last_active":"2024-04-26T22:02:37.188104+0000","last_peered":"2024-04-26T22:02:37.188104+0000","last_clean":"2024-04-26T22:02:37.188104+0000","last_became_active":"2024-04-26T22:02:37.183295+0000","last_became_peered":"2024-04-26T22:02:37.183295+0000","last_unstale":"2024-04-26T22:02:37.188104+0000","last_undegraded":"2024-04-26T22:02:37.188104+0000","last_fullsized":"2024-04-26T22:02:37.188104+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:45.187056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.172830+0000","last_change":"2024-04-26T22:02:36.170744+0000","last_active":"2024-04-26T22:02:37.172830+0000","last_peered":"2024-04-26T22:02:37.172830+0000","last_clean":"2024-04-26T22:02:37.172830+0000","last_became_active":"2024-04-26T22:02:36.170360+0000","last_became_peered":"2024-04-26T22:02:36.170360+0000","last_unstale":"2024-04-26T22:02:37.172830+0000","last_undegraded":"2024-04-26T22:02:37.172830+0000","last_fullsized":"2024-04-26T22:02:37.172830+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:53.719898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.189438+0000","last_change":"2024-04-26T22:02:37.186769+0000","last_active":"2024-04-26T22:02:37.189438+0000","last_peered":"2024-04-26T22:02:37.189438+0000","last_clean":"2024-04-26T22:02:37.189438+0000","last_became_active":"2024-04-26T22:02:37.186462+0000","last_became_peered":"2024-04-26T22:02:37.186462+0000","last_unstale":"2024-04-26T22:02:37.189438+0000","last_undegraded":"2024-04-26T22:02:37.189438+0000","last_fullsized":"2024-04-26T22:02:37.189438+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:21.535375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.195161+0000","last_change":"2024-04-26T22:02:36.163531+0000","last_active":"2024-04-26T22:02:37.195161+0000","last_peered":"2024-04-26T22:02:37.195161+0000","last_clean":"2024-04-26T22:02:37.195161+0000","last_became_active":"2024-04-26T22:02:36.163259+0000","last_became_peered":"2024-04-26T22:02:36.163259+0000","last_unstale":"2024-04-26T22:02:37.195161+0000","last_undegraded":"2024-04-26T22:02:37.195161+0000","last_fullsized":"2024-04-26T22:02:37.195161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:40.602765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.176285+0000","last_change":"2024-04-26T22:02:37.174937+0000","last_active":"2024-04-26T22:02:37.176285+0000","last_peered":"2024-04-26T22:02:37.176285+0000","last_clean":"2024-04-26T22:02:37.176285+0000","last_became_active":"2024-04-26T22:02:37.174661+0000","last_became_peered":"2024-04-26T22:02:37.174661+0000","last_unstale":"2024-04-26T22:02:37.176285+0000","last_undegraded":"2024-04-26T22:02:37.176285+0000","last_fullsized":"2024-04-26T22:02:37.176285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:14.261554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.192639+0000","last_change":"2024-04-26T22:02:36.170929+0000","last_active":"2024-04-26T22:02:37.192639+0000","last_peered":"2024-04-26T22:02:37.192639+0000","last_clean":"2024-04-26T22:02:37.192639+0000","last_became_active":"2024-04-26T22:02:36.170423+0000","last_became_peered":"2024-04-26T22:02:36.170423+0000","last_unstale":"2024-04-26T22:02:37.192639+0000","last_undegraded":"2024-04-26T22:02:37.192639+0000","last_fullsized":"2024-04-26T22:02:37.192639+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:38.732672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.174695+0000","last_change":"2024-04-26T22:02:37.173164+0000","last_active":"2024-04-26T22:02:37.174695+0000","last_peered":"2024-04-26T22:02:37.174695+0000","last_clean":"2024-04-26T22:02:37.174695+0000","last_became_active":"2024-04-26T22:02:37.172894+0000","last_became_peered":"2024-04-26T22:02:37.172894+0000","last_unstale":"2024-04-26T22:02:37.174695+0000","last_undegraded":"2024-04-26T22:02:37.174695+0000","last_fullsized":"2024-04-26T22:02:37.174695+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.964876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.194125+0000","last_change":"2024-04-26T22:02:36.165100+0000","last_active":"2024-04-26T22:02:37.194125+0000","last_peered":"2024-04-26T22:02:37.194125+0000","last_clean":"2024-04-26T22:02:37.194125+0000","last_became_active":"2024-04-26T22:02:36.164856+0000","last_became_peered":"2024-04-26T22:02:36.164856+0000","last_unstale":"2024-04-26T22:02:37.194125+0000","last_undegraded":"2024-04-26T22:02:37.194125+0000","last_fullsized":"2024-04-26T22:02:37.194125+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:55.215965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.179455+0000","last_change":"2024-04-26T22:02:37.177744+0000","last_active":"2024-04-26T22:02:37.179455+0000","last_peered":"2024-04-26T22:02:37.179455+0000","last_clean":"2024-04-26T22:02:37.179455+0000","last_became_active":"2024-04-26T22:02:37.177479+0000","last_became_peered":"2024-04-26T22:02:37.177479+0000","last_unstale":"2024-04-26T22:02:37.179455+0000","last_undegraded":"2024-04-26T22:02:37.179455+0000","last_fullsized":"2024-04-26T22:02:37.179455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:52.626207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.190083+0000","last_change":"2024-04-26T22:02:36.168865+0000","last_active":"2024-04-26T22:02:37.190083+0000","last_peered":"2024-04-26T22:02:37.190083+0000","last_clean":"2024-04-26T22:02:37.190083+0000","last_became_active":"2024-04-26T22:02:36.167280+0000","last_became_peered":"2024-04-26T22:02:36.167280+0000","last_unstale":"2024-04-26T22:02:37.190083+0000","last_undegraded":"2024-04-26T22:02:37.190083+0000","last_fullsized":"2024-04-26T22:02:37.190083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:02.822992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188824+0000","last_change":"2024-04-26T22:02:37.186129+0000","last_active":"2024-04-26T22:02:37.188824+0000","last_peered":"2024-04-26T22:02:37.188824+0000","last_clean":"2024-04-26T22:02:37.188824+0000","last_became_active":"2024-04-26T22:02:37.185814+0000","last_became_peered":"2024-04-26T22:02:37.185814+0000","last_unstale":"2024-04-26T22:02:37.188824+0000","last_undegraded":"2024-04-26T22:02:37.188824+0000","last_fullsized":"2024-04-26T22:02:37.188824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:19.358422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.167478+0000","last_change":"2024-04-26T22:02:36.167302+0000","last_active":"2024-04-26T22:02:37.167478+0000","last_peered":"2024-04-26T22:02:37.167478+0000","last_clean":"2024-04-26T22:02:37.167478+0000","last_became_active":"2024-04-26T22:02:36.167005+0000","last_became_peered":"2024-04-26T22:02:36.167005+0000","last_unstale":"2024-04-26T22:02:37.167478+0000","last_undegraded":"2024-04-26T22:02:37.167478+0000","last_fullsized":"2024-04-26T22:02:37.167478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:37.449383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184336+0000","last_change":"2024-04-26T22:02:37.181610+0000","last_active":"2024-04-26T22:02:37.184336+0000","last_peered":"2024-04-26T22:02:37.184336+0000","last_clean":"2024-04-26T22:02:37.184336+0000","last_became_active":"2024-04-26T22:02:37.180842+0000","last_became_peered":"2024-04-26T22:02:37.180842+0000","last_unstale":"2024-04-26T22:02:37.184336+0000","last_undegraded":"2024-04-26T22:02:37.184336+0000","last_fullsized":"2024-04-26T22:02:37.184336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:54.228805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.171076+0000","last_change":"2024-04-26T22:02:36.171442+0000","last_active":"2024-04-26T22:02:37.171076+0000","last_peered":"2024-04-26T22:02:37.171076+0000","last_clean":"2024-04-26T22:02:37.171076+0000","last_became_active":"2024-04-26T22:02:36.171169+0000","last_became_peered":"2024-04-26T22:02:36.171169+0000","last_unstale":"2024-04-26T22:02:37.171076+0000","last_undegraded":"2024-04-26T22:02:37.171076+0000","last_fullsized":"2024-04-26T22:02:37.171076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:56.625530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188063+0000","last_change":"2024-04-26T22:02:37.184918+0000","last_active":"2024-04-26T22:02:37.188063+0000","last_peered":"2024-04-26T22:02:37.188063+0000","last_clean":"2024-04-26T22:02:37.188063+0000","last_became_active":"2024-04-26T22:02:37.184676+0000","last_became_peered":"2024-04-26T22:02:37.184676+0000","last_unstale":"2024-04-26T22:02:37.188063+0000","last_undegraded":"2024-04-26T22:02:37.188063+0000","last_fullsized":"2024-04-26T22:02:37.188063+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:17.363517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.172996+0000","last_change":"2024-04-26T22:02:36.167057+0000","last_active":"2024-04-26T22:02:37.172996+0000","last_peered":"2024-04-26T22:02:37.172996+0000","last_clean":"2024-04-26T22:02:37.172996+0000","last_became_active":"2024-04-26T22:02:36.166777+0000","last_became_peered":"2024-04-26T22:02:36.166777+0000","last_unstale":"2024-04-26T22:02:37.172996+0000","last_undegraded":"2024-04-26T22:02:37.172996+0000","last_fullsized":"2024-04-26T22:02:37.172996+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:19.520804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187149+0000","last_change":"2024-04-26T22:02:37.183400+0000","last_active":"2024-04-26T22:02:37.187149+0000","last_peered":"2024-04-26T22:02:37.187149+0000","last_clean":"2024-04-26T22:02:37.187149+0000","last_became_active":"2024-04-26T22:02:37.183122+0000","last_became_peered":"2024-04-26T22:02:37.183122+0000","last_unstale":"2024-04-26T22:02:37.187149+0000","last_undegraded":"2024-04-26T22:02:37.187149+0000","last_fullsized":"2024-04-26T22:02:37.187149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:29.775211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.168315+0000","last_change":"2024-04-26T22:02:36.170216+0000","last_active":"2024-04-26T22:02:37.168315+0000","last_peered":"2024-04-26T22:02:37.168315+0000","last_clean":"2024-04-26T22:02:37.168315+0000","last_became_active":"2024-04-26T22:02:36.169877+0000","last_became_peered":"2024-04-26T22:02:36.169877+0000","last_unstale":"2024-04-26T22:02:37.168315+0000","last_undegraded":"2024-04-26T22:02:37.168315+0000","last_fullsized":"2024-04-26T22:02:37.168315+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:43.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186980+0000","last_change":"2024-04-26T22:02:37.181439+0000","last_active":"2024-04-26T22:02:37.186980+0000","last_peered":"2024-04-26T22:02:37.186980+0000","last_clean":"2024-04-26T22:02:37.186980+0000","last_became_active":"2024-04-26T22:02:37.181139+0000","last_became_peered":"2024-04-26T22:02:37.181139+0000","last_unstale":"2024-04-26T22:02:37.186980+0000","last_undegraded":"2024-04-26T22:02:37.186980+0000","last_fullsized":"2024-04-26T22:02:37.186980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:08.123570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.191461+0000","last_change":"2024-04-26T22:02:36.170258+0000","last_active":"2024-04-26T22:02:37.191461+0000","last_peered":"2024-04-26T22:02:37.191461+0000","last_clean":"2024-04-26T22:02:37.191461+0000","last_became_active":"2024-04-26T22:02:36.169979+0000","last_became_peered":"2024-04-26T22:02:36.169979+0000","last_unstale":"2024-04-26T22:02:37.191461+0000","last_undegraded":"2024-04-26T22:02:37.191461+0000","last_fullsized":"2024-04-26T22:02:37.191461+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:02.914602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.180097+0000","last_change":"2024-04-26T22:02:37.178533+0000","last_active":"2024-04-26T22:02:37.180097+0000","last_peered":"2024-04-26T22:02:37.180097+0000","last_clean":"2024-04-26T22:02:37.180097+0000","last_became_active":"2024-04-26T22:02:37.178273+0000","last_became_peered":"2024-04-26T22:02:37.178273+0000","last_unstale":"2024-04-26T22:02:37.180097+0000","last_undegraded":"2024-04-26T22:02:37.180097+0000","last_fullsized":"2024-04-26T22:02:37.180097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:32.315572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.172333+0000","last_change":"2024-04-26T22:02:36.170507+0000","last_active":"2024-04-26T22:02:37.172333+0000","last_peered":"2024-04-26T22:02:37.172333+0000","last_clean":"2024-04-26T22:02:37.172333+0000","last_became_active":"2024-04-26T22:02:36.170199+0000","last_became_peered":"2024-04-26T22:02:36.170199+0000","last_unstale":"2024-04-26T22:02:37.172333+0000","last_undegraded":"2024-04-26T22:02:37.172333+0000","last_fullsized":"2024-04-26T22:02:37.172333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:40.602765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188783+0000","last_change":"2024-04-26T22:02:37.185705+0000","last_active":"2024-04-26T22:02:37.188783+0000","last_peered":"2024-04-26T22:02:37.188783+0000","last_clean":"2024-04-26T22:02:37.188783+0000","last_became_active":"2024-04-26T22:02:37.185415+0000","last_became_peered":"2024-04-26T22:02:37.185415+0000","last_unstale":"2024-04-26T22:02:37.188783+0000","last_undegraded":"2024-04-26T22:02:37.188783+0000","last_fullsized":"2024-04-26T22:02:37.188783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:40.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.171574+0000","last_change":"2024-04-26T22:02:36.170447+0000","last_active":"2024-04-26T22:02:37.171574+0000","last_peered":"2024-04-26T22:02:37.171574+0000","last_clean":"2024-04-26T22:02:37.171574+0000","last_became_active":"2024-04-26T22:02:36.170154+0000","last_became_peered":"2024-04-26T22:02:36.170154+0000","last_unstale":"2024-04-26T22:02:37.171574+0000","last_undegraded":"2024-04-26T22:02:37.171574+0000","last_fullsized":"2024-04-26T22:02:37.171574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:06.605779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.185872+0000","last_change":"2024-04-26T22:02:37.179695+0000","last_active":"2024-04-26T22:02:37.185872+0000","last_peered":"2024-04-26T22:02:37.185872+0000","last_clean":"2024-04-26T22:02:37.185872+0000","last_became_active":"2024-04-26T22:02:37.179032+0000","last_became_peered":"2024-04-26T22:02:37.179032+0000","last_unstale":"2024-04-26T22:02:37.185872+0000","last_undegraded":"2024-04-26T22:02:37.185872+0000","last_fullsized":"2024-04-26T22:02:37.185872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:56.150899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.168496+0000","last_change":"2024-04-26T22:02:36.172277+0000","last_active":"2024-04-26T22:02:37.168496+0000","last_peered":"2024-04-26T22:02:37.168496+0000","last_clean":"2024-04-26T22:02:37.168496+0000","last_became_active":"2024-04-26T22:02:36.172002+0000","last_became_peered":"2024-04-26T22:02:36.172002+0000","last_unstale":"2024-04-26T22:02:37.168496+0000","last_undegraded":"2024-04-26T22:02:37.168496+0000","last_fullsized":"2024-04-26T22:02:37.168496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:17.181821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.189417+0000","last_change":"2024-04-26T22:02:37.186619+0000","last_active":"2024-04-26T22:02:37.189417+0000","last_peered":"2024-04-26T22:02:37.189417+0000","last_clean":"2024-04-26T22:02:37.189417+0000","last_became_active":"2024-04-26T22:02:37.186314+0000","last_became_peered":"2024-04-26T22:02:37.186314+0000","last_unstale":"2024-04-26T22:02:37.189417+0000","last_undegraded":"2024-04-26T22:02:37.189417+0000","last_fullsized":"2024-04-26T22:02:37.189417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:51.468507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.171174+0000","last_change":"2024-04-26T22:02:36.167008+0000","last_active":"2024-04-26T22:02:37.171174+0000","last_peered":"2024-04-26T22:02:37.171174+0000","last_clean":"2024-04-26T22:02:37.171174+0000","last_became_active":"2024-04-26T22:02:36.166683+0000","last_became_peered":"2024-04-26T22:02:36.166683+0000","last_unstale":"2024-04-26T22:02:37.171174+0000","last_undegraded":"2024-04-26T22:02:37.171174+0000","last_fullsized":"2024-04-26T22:02:37.171174+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:45.897987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193587+0000","last_change":"2024-04-26T22:02:37.190397+0000","last_active":"2024-04-26T22:02:37.193587+0000","last_peered":"2024-04-26T22:02:37.193587+0000","last_clean":"2024-04-26T22:02:37.193587+0000","last_became_active":"2024-04-26T22:02:37.190129+0000","last_became_peered":"2024-04-26T22:02:37.190129+0000","last_unstale":"2024-04-26T22:02:37.193587+0000","last_undegraded":"2024-04-26T22:02:37.193587+0000","last_fullsized":"2024-04-26T22:02:37.193587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:16.553577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.164581+0000","last_change":"2024-04-26T22:02:36.166458+0000","last_active":"2024-04-26T22:02:37.164581+0000","last_peered":"2024-04-26T22:02:37.164581+0000","last_clean":"2024-04-26T22:02:37.164581+0000","last_became_active":"2024-04-26T22:02:36.165563+0000","last_became_peered":"2024-04-26T22:02:36.165563+0000","last_unstale":"2024-04-26T22:02:37.164581+0000","last_undegraded":"2024-04-26T22:02:37.164581+0000","last_fullsized":"2024-04-26T22:02:37.164581+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.163173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187414+0000","last_change":"2024-04-26T22:02:37.185975+0000","last_active":"2024-04-26T22:02:37.187414+0000","last_peered":"2024-04-26T22:02:37.187414+0000","last_clean":"2024-04-26T22:02:37.187414+0000","last_became_active":"2024-04-26T22:02:37.185691+0000","last_became_peered":"2024-04-26T22:02:37.185691+0000","last_unstale":"2024-04-26T22:02:37.187414+0000","last_undegraded":"2024-04-26T22:02:37.187414+0000","last_fullsized":"2024-04-26T22:02:37.187414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:03.918601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.166156+0000","last_change":"2024-04-26T22:02:36.168602+0000","last_active":"2024-04-26T22:02:37.166156+0000","last_peered":"2024-04-26T22:02:37.166156+0000","last_clean":"2024-04-26T22:02:37.166156+0000","last_became_active":"2024-04-26T22:02:36.168217+0000","last_became_peered":"2024-04-26T22:02:36.168217+0000","last_unstale":"2024-04-26T22:02:37.166156+0000","last_undegraded":"2024-04-26T22:02:37.166156+0000","last_fullsized":"2024-04-26T22:02:37.166156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:52.533909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182271+0000","last_change":"2024-04-26T22:02:37.181125+0000","last_active":"2024-04-26T22:02:37.182271+0000","last_peered":"2024-04-26T22:02:37.182271+0000","last_clean":"2024-04-26T22:02:37.182271+0000","last_became_active":"2024-04-26T22:02:37.180854+0000","last_became_peered":"2024-04-26T22:02:37.180854+0000","last_unstale":"2024-04-26T22:02:37.182271+0000","last_undegraded":"2024-04-26T22:02:37.182271+0000","last_fullsized":"2024-04-26T22:02:37.182271+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:56.219964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.176766+0000","last_change":"2024-04-26T22:02:36.171482+0000","last_active":"2024-04-26T22:02:37.176766+0000","last_peered":"2024-04-26T22:02:37.176766+0000","last_clean":"2024-04-26T22:02:37.176766+0000","last_became_active":"2024-04-26T22:02:36.170106+0000","last_became_peered":"2024-04-26T22:02:36.170106+0000","last_unstale":"2024-04-26T22:02:37.176766+0000","last_undegraded":"2024-04-26T22:02:37.176766+0000","last_fullsized":"2024-04-26T22:02:37.176766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:35.262268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187865+0000","last_change":"2024-04-26T22:02:37.184729+0000","last_active":"2024-04-26T22:02:37.187865+0000","last_peered":"2024-04-26T22:02:37.187865+0000","last_clean":"2024-04-26T22:02:37.187865+0000","last_became_active":"2024-04-26T22:02:37.183912+0000","last_became_peered":"2024-04-26T22:02:37.183912+0000","last_unstale":"2024-04-26T22:02:37.187865+0000","last_undegraded":"2024-04-26T22:02:37.187865+0000","last_fullsized":"2024-04-26T22:02:37.187865+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:02.904902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.194279+0000","last_change":"2024-04-26T22:02:36.170795+0000","last_active":"2024-04-26T22:02:37.194279+0000","last_peered":"2024-04-26T22:02:37.194279+0000","last_clean":"2024-04-26T22:02:37.194279+0000","last_became_active":"2024-04-26T22:02:36.169721+0000","last_became_peered":"2024-04-26T22:02:36.169721+0000","last_unstale":"2024-04-26T22:02:37.194279+0000","last_undegraded":"2024-04-26T22:02:37.194279+0000","last_fullsized":"2024-04-26T22:02:37.194279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:17.607314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":272,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.166185+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:02:37.166185+0000","last_peered":"2024-04-26T22:02:37.166185+0000","last_clean":"2024-04-26T22:02:37.166185+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:02:37.166185+0000","last_undegraded":"2024-04-26T22:02:37.166185+0000","last_fullsized":"2024-04-26T22:02:37.166185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1445888,"data_stored":946259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":872448,"data_stored":362758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":362756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":355891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":355891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":355891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":364894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":953034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:02:40.136 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:02:40.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.269+0000 7fbcf5ecf640 1 Processor -- start 2024-04-26T22:02:40.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.269+0000 7fbcf5ecf640 1 -- start start 2024-04-26T22:02:40.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.269+0000 7fbcf5ecf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbcf015f1e0 0x7fbcf006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.269+0000 7fbcf5ecf640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbcf00b44e0 0x7fbcf00ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.269+0000 7fbcf5ecf640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf00b4a10 con 0x7fbcf006d2b0 2024-04-26T22:02:40.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.269+0000 7fbcf5ecf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf006eeb0 con 0x7fbcf015f1e0 2024-04-26T22:02:40.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.269+0000 7fbcf5ecf640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf00b4cf0 con 0x7fbcf00b44e0 2024-04-26T22:02:40.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbcef7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbcf015f1e0 0x7fbcf006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbceffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbcf006d2b0 0x7fbcf00b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48358/0 (socket says 172.21.15.137:48358) 2024-04-26T22:02:40.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbceffff640 1 -- 172.21.15.137:0/3872595137 learned_addr learned my addr 172.21.15.137:0/3872595137 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:40.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbceeffd640 1 --2- 172.21.15.137:0/3872595137 >> v2:172.21.15.170:3300/0 conn(0x7fbcf00b44e0 0x7fbcf00ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbcef7fe640 1 -- 172.21.15.137:0/3872595137 >> v2:172.21.15.170:3300/0 conn(0x7fbcf00b44e0 msgr2=0x7fbcf00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:40.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbcef7fe640 1 --2- 172.21.15.137:0/3872595137 >> v2:172.21.15.170:3300/0 conn(0x7fbcf00b44e0 0x7fbcf00ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbcef7fe640 1 -- 172.21.15.137:0/3872595137 >> v1:172.21.15.137:6789/0 conn(0x7fbcf006d2b0 legacy=0x7fbcf00b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbcee7fc640 1 -- 172.21.15.137:0/3872595137 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792260997 0 0) 0x7fbcf00b4a10 con 0x7fbcf006d2b0 2024-04-26T22:02:40.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbcef7fe640 1 -- 172.21.15.137:0/3872595137 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf00b4fd0 con 0x7fbcf015f1e0 2024-04-26T22:02:40.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.270+0000 7fbceeffd640 1 --2- 172.21.15.137:0/3872595137 >> v2:172.21.15.170:3300/0 conn(0x7fbcf00b44e0 0x7fbcf00ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcef7fe640 1 --2- 172.21.15.137:0/3872595137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf015f1e0 0x7fbcf006e970 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fbcf006e5c0 tx=0x7fbce002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21a05c1cc7bba8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcee7fc640 1 -- 172.21.15.137:0/3872595137 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0037070 con 0x7fbcf015f1e0 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcee7fc640 1 -- 172.21.15.137:0/3872595137 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce0032440 con 0x7fbcf015f1e0 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcee7fc640 1 -- 172.21.15.137:0/3872595137 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0032810 con 0x7fbcf015f1e0 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/3872595137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf015f1e0 msgr2=0x7fbcf006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcf5ecf640 1 --2- 172.21.15.137:0/3872595137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf015f1e0 0x7fbcf006e970 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fbcf006e5c0 tx=0x7fbce002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/3872595137 shutdown_connections 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcf5ecf640 1 --2- 172.21.15.137:0/3872595137 >> v2:172.21.15.170:3300/0 conn(0x7fbcf00b44e0 0x7fbcf00ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcf5ecf640 1 --2- 172.21.15.137:0/3872595137 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf015f1e0 0x7fbcf006e970 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/3872595137 >> 172.21.15.137:0/3872595137 conn(0x7fbcf00728a0 msgr2=0x7fbcf0072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/3872595137 shutdown_connections 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.271+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/3872595137 wait complete. 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.272+0000 7fbcf5ecf640 1 Processor -- start 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbcf5ecf640 1 -- start start 2024-04-26T22:02:40.280 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbcf5ecf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcf006d2b0 0x7fbcf0145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbcf5ecf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf00b44e0 0x7fbcf01f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbcf5ecf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcf015f1e0 0x7fbcf0161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbcf5ecf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf00aedf0 con 0x7fbcf00b44e0 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbcf5ecf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf00b5590 con 0x7fbcf015f1e0 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbcf5ecf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf015f5c0 con 0x7fbcf006d2b0 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbceeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf00b44e0 0x7fbcf01f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbceeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf00b44e0 0x7fbcf01f8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45828/0 (socket says 172.21.15.137:45828) 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.273+0000 7fbceeffd640 1 -- 172.21.15.137:0/2435501338 learned_addr learned my addr 172.21.15.137:0/2435501338 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbceffff640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcf015f1e0 0x7fbcf0161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbcef7fe640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcf006d2b0 0x7fbcf0145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbceeffd640 1 -- 172.21.15.137:0/2435501338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcf006d2b0 msgr2=0x7fbcf0145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbceeffd640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcf006d2b0 0x7fbcf0145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbceeffd640 1 -- 172.21.15.137:0/2435501338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcf015f1e0 msgr2=0x7fbcf0161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbceeffd640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcf015f1e0 0x7fbcf0161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbceeffd640 1 -- 172.21.15.137:0/2435501338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf01f9200 con 0x7fbcf00b44e0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbceeffd640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf00b44e0 0x7fbcf01f8890 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbce400c7f0 tx=0x7fbce400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbcd7fff640 1 -- 172.21.15.137:0/2435501338 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4015070 con 0x7fbcf00b44e0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbcd7fff640 1 -- 172.21.15.137:0/2435501338 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce4007a30 con 0x7fbcf00b44e0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf01f94e0 con 0x7fbcf00b44e0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbcd7fff640 1 -- 172.21.15.137:0/2435501338 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4007e00 con 0x7fbcf00b44e0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.274+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf015c8f0 con 0x7fbcf00b44e0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.275+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf006a290 con 0x7fbcf00b44e0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.275+0000 7fbcd7fff640 1 -- 172.21.15.137:0/2435501338 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbce4018070 con 0x7fbcf00b44e0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.276+0000 7fbcd7fff640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcdc06c8f0 0x7fbcdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.276+0000 7fbcef7fe640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcdc06c8f0 0x7fbcdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.276+0000 7fbcd7fff640 1 -- 172.21.15.137:0/2435501338 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fbce408baa0 con 0x7fbcf00b44e0 2024-04-26T22:02:40.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.276+0000 7fbcef7fe640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcdc06c8f0 0x7fbcdc06edb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbce0034000 tx=0x7fbce002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:40.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.280+0000 7fbcd7fff640 1 -- 172.21.15.137:0/2435501338 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbce4059f60 con 0x7fbcf00b44e0 2024-04-26T22:02:40.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.451+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcf0154d30 con 0x7fbcdc06c8f0 2024-04-26T22:02:40.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.457+0000 7fbcd7fff640 1 -- 172.21.15.137:0/2435501338 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251999 (secure 0 0 0) 0x7fbcf0154d30 con 0x7fbcdc06c8f0 2024-04-26T22:02:40.459 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:40.461 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:02:40.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcdc06c8f0 msgr2=0x7fbcdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcdc06c8f0 0x7fbcdc06edb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbce0034000 tx=0x7fbce002e000 comp rx=0 tx=0).stop 2024-04-26T22:02:40.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf00b44e0 msgr2=0x7fbcf01f8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf00b44e0 0x7fbcf01f8890 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbce400c7f0 tx=0x7fbce400cbf0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 shutdown_connections 2024-04-26T22:02:40.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcdc06c8f0 0x7fbcdc06edb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbcf00b44e0 0x7fbcf01f8890 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcf015f1e0 0x7fbcf0161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 --2- 172.21.15.137:0/2435501338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbcf006d2b0 0x7fbcf0145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 >> 172.21.15.137:0/2435501338 conn(0x7fbcf00728a0 msgr2=0x7fbcf0070650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:40.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 shutdown_connections 2024-04-26T22:02:40.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.460+0000 7fbcf5ecf640 1 -- 172.21.15.137:0/2435501338 wait complete. 2024-04-26T22:02:40.471 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-26T22:02:38.744864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249032,"kb_used_data":7896,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725688,"statfs":{"total":773094113280,"available":772839104512,"internally_reserved":0,"allocated":8085504,"data_stored":4057374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000666"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188024+0000","last_change":"2024-04-26T22:02:37.181848+0000","last_active":"2024-04-26T22:02:37.188024+0000","last_peered":"2024-04-26T22:02:37.188024+0000","last_clean":"2024-04-26T22:02:37.188024+0000","last_became_active":"2024-04-26T22:02:37.181061+0000","last_became_peered":"2024-04-26T22:02:37.181061+0000","last_unstale":"2024-04-26T22:02:37.188024+0000","last_undegraded":"2024-04-26T22:02:37.188024+0000","last_fullsized":"2024-04-26T22:02:37.188024+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:32.169496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193325+0000","last_change":"2024-04-26T22:02:37.188597+0000","last_active":"2024-04-26T22:02:37.193325+0000","last_peered":"2024-04-26T22:02:37.193325+0000","last_clean":"2024-04-26T22:02:37.193325+0000","last_became_active":"2024-04-26T22:02:37.187300+0000","last_became_peered":"2024-04-26T22:02:37.187300+0000","last_unstale":"2024-04-26T22:02:37.193325+0000","last_undegraded":"2024-04-26T22:02:37.193325+0000","last_fullsized":"2024-04-26T22:02:37.193325+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:54.723897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184484+0000","last_change":"2024-04-26T22:02:37.181859+0000","last_active":"2024-04-26T22:02:37.184484+0000","last_peered":"2024-04-26T22:02:37.184484+0000","last_clean":"2024-04-26T22:02:37.184484+0000","last_became_active":"2024-04-26T22:02:37.181578+0000","last_became_peered":"2024-04-26T22:02:37.181578+0000","last_unstale":"2024-04-26T22:02:37.184484+0000","last_undegraded":"2024-04-26T22:02:37.184484+0000","last_fullsized":"2024-04-26T22:02:37.184484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:15.828918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187009+0000","last_change":"2024-04-26T22:02:37.183695+0000","last_active":"2024-04-26T22:02:37.187009+0000","last_peered":"2024-04-26T22:02:37.187009+0000","last_clean":"2024-04-26T22:02:37.187009+0000","last_became_active":"2024-04-26T22:02:37.183445+0000","last_became_peered":"2024-04-26T22:02:37.183445+0000","last_unstale":"2024-04-26T22:02:37.187009+0000","last_undegraded":"2024-04-26T22:02:37.187009+0000","last_fullsized":"2024-04-26T22:02:37.187009+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:39.736671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182345+0000","last_change":"2024-04-26T22:02:37.176840+0000","last_active":"2024-04-26T22:02:37.182345+0000","last_peered":"2024-04-26T22:02:37.182345+0000","last_clean":"2024-04-26T22:02:37.182345+0000","last_became_active":"2024-04-26T22:02:37.176583+0000","last_became_peered":"2024-04-26T22:02:37.176583+0000","last_unstale":"2024-04-26T22:02:37.182345+0000","last_undegraded":"2024-04-26T22:02:37.182345+0000","last_fullsized":"2024-04-26T22:02:37.182345+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:33:50.932896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182244+0000","last_change":"2024-04-26T22:02:37.180588+0000","last_active":"2024-04-26T22:02:37.182244+0000","last_peered":"2024-04-26T22:02:37.182244+0000","last_clean":"2024-04-26T22:02:37.182244+0000","last_became_active":"2024-04-26T22:02:37.180244+0000","last_became_peered":"2024-04-26T22:02:37.180244+0000","last_unstale":"2024-04-26T22:02:37.182244+0000","last_undegraded":"2024-04-26T22:02:37.182244+0000","last_fullsized":"2024-04-26T22:02:37.182244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:53.537908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182602+0000","last_change":"2024-04-26T22:02:37.180698+0000","last_active":"2024-04-26T22:02:37.182602+0000","last_peered":"2024-04-26T22:02:37.182602+0000","last_clean":"2024-04-26T22:02:37.182602+0000","last_became_active":"2024-04-26T22:02:37.180421+0000","last_became_peered":"2024-04-26T22:02:37.180421+0000","last_unstale":"2024-04-26T22:02:37.182602+0000","last_undegraded":"2024-04-26T22:02:37.182602+0000","last_fullsized":"2024-04-26T22:02:37.182602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:56.978460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184490+0000","last_change":"2024-04-26T22:02:37.182862+0000","last_active":"2024-04-26T22:02:37.184490+0000","last_peered":"2024-04-26T22:02:37.184490+0000","last_clean":"2024-04-26T22:02:37.184490+0000","last_became_active":"2024-04-26T22:02:37.182589+0000","last_became_peered":"2024-04-26T22:02:37.182589+0000","last_unstale":"2024-04-26T22:02:37.184490+0000","last_undegraded":"2024-04-26T22:02:37.184490+0000","last_fullsized":"2024-04-26T22:02:37.184490+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:08.857860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193337+0000","last_change":"2024-04-26T22:02:37.188394+0000","last_active":"2024-04-26T22:02:37.193337+0000","last_peered":"2024-04-26T22:02:37.193337+0000","last_clean":"2024-04-26T22:02:37.193337+0000","last_became_active":"2024-04-26T22:02:37.187798+0000","last_became_peered":"2024-04-26T22:02:37.187798+0000","last_unstale":"2024-04-26T22:02:37.193337+0000","last_undegraded":"2024-04-26T22:02:37.193337+0000","last_fullsized":"2024-04-26T22:02:37.193337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:08.803345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186302+0000","last_change":"2024-04-26T22:02:37.180307+0000","last_active":"2024-04-26T22:02:37.186302+0000","last_peered":"2024-04-26T22:02:37.186302+0000","last_clean":"2024-04-26T22:02:37.186302+0000","last_became_active":"2024-04-26T22:02:37.179655+0000","last_became_peered":"2024-04-26T22:02:37.179655+0000","last_unstale":"2024-04-26T22:02:37.186302+0000","last_undegraded":"2024-04-26T22:02:37.186302+0000","last_fullsized":"2024-04-26T22:02:37.186302+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:42:56.978460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188769+0000","last_change":"2024-04-26T22:02:37.186020+0000","last_active":"2024-04-26T22:02:37.188769+0000","last_peered":"2024-04-26T22:02:37.188769+0000","last_clean":"2024-04-26T22:02:37.188769+0000","last_became_active":"2024-04-26T22:02:37.185661+0000","last_became_peered":"2024-04-26T22:02:37.185661+0000","last_unstale":"2024-04-26T22:02:37.188769+0000","last_undegraded":"2024-04-26T22:02:37.188769+0000","last_fullsized":"2024-04-26T22:02:37.188769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:47.784443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.179478+0000","last_change":"2024-04-26T22:02:37.178103+0000","last_active":"2024-04-26T22:02:37.179478+0000","last_peered":"2024-04-26T22:02:37.179478+0000","last_clean":"2024-04-26T22:02:37.179478+0000","last_became_active":"2024-04-26T22:02:37.177762+0000","last_became_peered":"2024-04-26T22:02:37.177762+0000","last_unstale":"2024-04-26T22:02:37.179478+0000","last_undegraded":"2024-04-26T22:02:37.179478+0000","last_fullsized":"2024-04-26T22:02:37.179478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:22.164899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188073+0000","last_change":"2024-04-26T22:02:37.184576+0000","last_active":"2024-04-26T22:02:37.188073+0000","last_peered":"2024-04-26T22:02:37.188073+0000","last_clean":"2024-04-26T22:02:37.188073+0000","last_became_active":"2024-04-26T22:02:37.184246+0000","last_became_peered":"2024-04-26T22:02:37.184246+0000","last_unstale":"2024-04-26T22:02:37.188073+0000","last_undegraded":"2024-04-26T22:02:37.188073+0000","last_fullsized":"2024-04-26T22:02:37.188073+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:17:50.586308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.185114+0000","last_change":"2024-04-26T22:02:37.180582+0000","last_active":"2024-04-26T22:02:37.185114+0000","last_peered":"2024-04-26T22:02:37.185114+0000","last_clean":"2024-04-26T22:02:37.185114+0000","last_became_active":"2024-04-26T22:02:37.180328+0000","last_became_peered":"2024-04-26T22:02:37.180328+0000","last_unstale":"2024-04-26T22:02:37.185114+0000","last_undegraded":"2024-04-26T22:02:37.185114+0000","last_fullsized":"2024-04-26T22:02:37.185114+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:06:54.306698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187456+0000","last_change":"2024-04-26T22:02:37.182079+0000","last_active":"2024-04-26T22:02:37.187456+0000","last_peered":"2024-04-26T22:02:37.187456+0000","last_clean":"2024-04-26T22:02:37.187456+0000","last_became_active":"2024-04-26T22:02:37.181815+0000","last_became_peered":"2024-04-26T22:02:37.181815+0000","last_unstale":"2024-04-26T22:02:37.187456+0000","last_undegraded":"2024-04-26T22:02:37.187456+0000","last_fullsized":"2024-04-26T22:02:37.187456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:11:02.125950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186662+0000","last_change":"2024-04-26T22:02:37.185040+0000","last_active":"2024-04-26T22:02:37.186662+0000","last_peered":"2024-04-26T22:02:37.186662+0000","last_clean":"2024-04-26T22:02:37.186662+0000","last_became_active":"2024-04-26T22:02:37.184743+0000","last_became_peered":"2024-04-26T22:02:37.184743+0000","last_unstale":"2024-04-26T22:02:37.186662+0000","last_undegraded":"2024-04-26T22:02:37.186662+0000","last_fullsized":"2024-04-26T22:02:37.186662+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:23.224579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193308+0000","last_change":"2024-04-26T22:02:37.188311+0000","last_active":"2024-04-26T22:02:37.193308+0000","last_peered":"2024-04-26T22:02:37.193308+0000","last_clean":"2024-04-26T22:02:37.193308+0000","last_became_active":"2024-04-26T22:02:37.187082+0000","last_became_peered":"2024-04-26T22:02:37.187082+0000","last_unstale":"2024-04-26T22:02:37.193308+0000","last_undegraded":"2024-04-26T22:02:37.193308+0000","last_fullsized":"2024-04-26T22:02:37.193308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:47.815518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186973+0000","last_change":"2024-04-26T22:02:37.182426+0000","last_active":"2024-04-26T22:02:37.186973+0000","last_peered":"2024-04-26T22:02:37.186973+0000","last_clean":"2024-04-26T22:02:37.186973+0000","last_became_active":"2024-04-26T22:02:37.182170+0000","last_became_peered":"2024-04-26T22:02:37.182170+0000","last_unstale":"2024-04-26T22:02:37.186973+0000","last_undegraded":"2024-04-26T22:02:37.186973+0000","last_fullsized":"2024-04-26T22:02:37.186973+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:57.629529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187503+0000","last_change":"2024-04-26T22:02:37.185203+0000","last_active":"2024-04-26T22:02:37.187503+0000","last_peered":"2024-04-26T22:02:37.187503+0000","last_clean":"2024-04-26T22:02:37.187503+0000","last_became_active":"2024-04-26T22:02:37.184880+0000","last_became_peered":"2024-04-26T22:02:37.184880+0000","last_unstale":"2024-04-26T22:02:37.187503+0000","last_undegraded":"2024-04-26T22:02:37.187503+0000","last_fullsized":"2024-04-26T22:02:37.187503+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:41.606764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.179836+0000","last_change":"2024-04-26T22:02:37.178909+0000","last_active":"2024-04-26T22:02:37.179836+0000","last_peered":"2024-04-26T22:02:37.179836+0000","last_clean":"2024-04-26T22:02:37.179836+0000","last_became_active":"2024-04-26T22:02:37.178538+0000","last_became_peered":"2024-04-26T22:02:37.178538+0000","last_unstale":"2024-04-26T22:02:37.179836+0000","last_undegraded":"2024-04-26T22:02:37.179836+0000","last_fullsized":"2024-04-26T22:02:37.179836+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:34:45.955846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186103+0000","last_change":"2024-04-26T22:02:37.178483+0000","last_active":"2024-04-26T22:02:37.186103+0000","last_peered":"2024-04-26T22:02:37.186103+0000","last_clean":"2024-04-26T22:02:37.186103+0000","last_became_active":"2024-04-26T22:02:37.178173+0000","last_became_peered":"2024-04-26T22:02:37.178173+0000","last_unstale":"2024-04-26T22:02:37.186103+0000","last_undegraded":"2024-04-26T22:02:37.186103+0000","last_fullsized":"2024-04-26T22:02:37.186103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:16.553577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186442+0000","last_change":"2024-04-26T22:02:37.181656+0000","last_active":"2024-04-26T22:02:37.186442+0000","last_peered":"2024-04-26T22:02:37.186442+0000","last_clean":"2024-04-26T22:02:37.186442+0000","last_became_active":"2024-04-26T22:02:37.180821+0000","last_became_peered":"2024-04-26T22:02:37.180821+0000","last_unstale":"2024-04-26T22:02:37.186442+0000","last_undegraded":"2024-04-26T22:02:37.186442+0000","last_fullsized":"2024-04-26T22:02:37.186442+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:21.372359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186888+0000","last_change":"2024-04-26T22:02:37.183420+0000","last_active":"2024-04-26T22:02:37.186888+0000","last_peered":"2024-04-26T22:02:37.186888+0000","last_clean":"2024-04-26T22:02:37.186888+0000","last_became_active":"2024-04-26T22:02:37.182248+0000","last_became_peered":"2024-04-26T22:02:37.182248+0000","last_unstale":"2024-04-26T22:02:37.186888+0000","last_undegraded":"2024-04-26T22:02:37.186888+0000","last_fullsized":"2024-04-26T22:02:37.186888+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:41:18.964219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188741+0000","last_change":"2024-04-26T22:02:37.184205+0000","last_active":"2024-04-26T22:02:37.188741+0000","last_peered":"2024-04-26T22:02:37.188741+0000","last_clean":"2024-04-26T22:02:37.188741+0000","last_became_active":"2024-04-26T22:02:37.183923+0000","last_became_peered":"2024-04-26T22:02:37.183923+0000","last_unstale":"2024-04-26T22:02:37.188741+0000","last_undegraded":"2024-04-26T22:02:37.188741+0000","last_fullsized":"2024-04-26T22:02:37.188741+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:18.185820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.174190+0000","last_change":"2024-04-26T22:02:37.172184+0000","last_active":"2024-04-26T22:02:37.174190+0000","last_peered":"2024-04-26T22:02:37.174190+0000","last_clean":"2024-04-26T22:02:37.174190+0000","last_became_active":"2024-04-26T22:02:37.171904+0000","last_became_peered":"2024-04-26T22:02:37.171904+0000","last_unstale":"2024-04-26T22:02:37.174190+0000","last_undegraded":"2024-04-26T22:02:37.174190+0000","last_fullsized":"2024-04-26T22:02:37.174190+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:54.723897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187996+0000","last_change":"2024-04-26T22:02:37.183530+0000","last_active":"2024-04-26T22:02:37.187996+0000","last_peered":"2024-04-26T22:02:37.187996+0000","last_clean":"2024-04-26T22:02:37.187996+0000","last_became_active":"2024-04-26T22:02:37.183241+0000","last_became_peered":"2024-04-26T22:02:37.183241+0000","last_unstale":"2024-04-26T22:02:37.187996+0000","last_undegraded":"2024-04-26T22:02:37.187996+0000","last_fullsized":"2024-04-26T22:02:37.187996+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.964876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184505+0000","last_change":"2024-04-26T22:02:37.181373+0000","last_active":"2024-04-26T22:02:37.184505+0000","last_peered":"2024-04-26T22:02:37.184505+0000","last_clean":"2024-04-26T22:02:37.184505+0000","last_became_active":"2024-04-26T22:02:37.180554+0000","last_became_peered":"2024-04-26T22:02:37.180554+0000","last_unstale":"2024-04-26T22:02:37.184505+0000","last_undegraded":"2024-04-26T22:02:37.184505+0000","last_fullsized":"2024-04-26T22:02:37.184505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:15.058710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186493+0000","last_change":"2024-04-26T22:02:37.179960+0000","last_active":"2024-04-26T22:02:37.186493+0000","last_peered":"2024-04-26T22:02:37.186493+0000","last_clean":"2024-04-26T22:02:37.186493+0000","last_became_active":"2024-04-26T22:02:37.179418+0000","last_became_peered":"2024-04-26T22:02:37.179418+0000","last_unstale":"2024-04-26T22:02:37.186493+0000","last_undegraded":"2024-04-26T22:02:37.186493+0000","last_fullsized":"2024-04-26T22:02:37.186493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:32.315572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184355+0000","last_change":"2024-04-26T22:02:37.181841+0000","last_active":"2024-04-26T22:02:37.184355+0000","last_peered":"2024-04-26T22:02:37.184355+0000","last_clean":"2024-04-26T22:02:37.184355+0000","last_became_active":"2024-04-26T22:02:37.181332+0000","last_became_peered":"2024-04-26T22:02:37.181332+0000","last_unstale":"2024-04-26T22:02:37.184355+0000","last_undegraded":"2024-04-26T22:02:37.184355+0000","last_fullsized":"2024-04-26T22:02:37.184355+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:44.551426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188027+0000","last_change":"2024-04-26T22:02:37.183376+0000","last_active":"2024-04-26T22:02:37.188027+0000","last_peered":"2024-04-26T22:02:37.188027+0000","last_clean":"2024-04-26T22:02:37.188027+0000","last_became_active":"2024-04-26T22:02:37.182896+0000","last_became_peered":"2024-04-26T22:02:37.182896+0000","last_unstale":"2024-04-26T22:02:37.188027+0000","last_undegraded":"2024-04-26T22:02:37.188027+0000","last_fullsized":"2024-04-26T22:02:37.188027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:38.453382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188056+0000","last_change":"2024-04-26T22:02:37.183348+0000","last_active":"2024-04-26T22:02:37.188056+0000","last_peered":"2024-04-26T22:02:37.188056+0000","last_clean":"2024-04-26T22:02:37.188056+0000","last_became_active":"2024-04-26T22:02:37.183036+0000","last_became_peered":"2024-04-26T22:02:37.183036+0000","last_unstale":"2024-04-26T22:02:37.188056+0000","last_undegraded":"2024-04-26T22:02:37.188056+0000","last_fullsized":"2024-04-26T22:02:37.188056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:23.224579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193501+0000","last_change":"2024-04-26T22:02:37.189673+0000","last_active":"2024-04-26T22:02:37.193501+0000","last_peered":"2024-04-26T22:02:37.193501+0000","last_clean":"2024-04-26T22:02:37.193501+0000","last_became_active":"2024-04-26T22:02:37.187748+0000","last_became_peered":"2024-04-26T22:02:37.187748+0000","last_unstale":"2024-04-26T22:02:37.193501+0000","last_undegraded":"2024-04-26T22:02:37.193501+0000","last_fullsized":"2024-04-26T22:02:37.193501+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:20.524803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188181+0000","last_change":"2024-04-26T22:02:37.183454+0000","last_active":"2024-04-26T22:02:37.188181+0000","last_peered":"2024-04-26T22:02:37.188181+0000","last_clean":"2024-04-26T22:02:37.188181+0000","last_became_active":"2024-04-26T22:02:37.183168+0000","last_became_peered":"2024-04-26T22:02:37.183168+0000","last_unstale":"2024-04-26T22:02:37.188181+0000","last_undegraded":"2024-04-26T22:02:37.188181+0000","last_fullsized":"2024-04-26T22:02:37.188181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:44.196327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.196395+0000","last_change":"2024-04-26T22:02:36.162320+0000","last_active":"2024-04-26T22:02:37.196395+0000","last_peered":"2024-04-26T22:02:37.196395+0000","last_clean":"2024-04-26T22:02:37.196395+0000","last_became_active":"2024-04-26T22:02:36.162006+0000","last_became_peered":"2024-04-26T22:02:36.162006+0000","last_unstale":"2024-04-26T22:02:37.196395+0000","last_undegraded":"2024-04-26T22:02:37.196395+0000","last_fullsized":"2024-04-26T22:02:37.196395+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:22.220580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.190841+0000","last_change":"2024-04-26T22:02:37.188132+0000","last_active":"2024-04-26T22:02:37.190841+0000","last_peered":"2024-04-26T22:02:37.190841+0000","last_clean":"2024-04-26T22:02:37.190841+0000","last_became_active":"2024-04-26T22:02:37.186489+0000","last_became_peered":"2024-04-26T22:02:37.186489+0000","last_unstale":"2024-04-26T22:02:37.190841+0000","last_undegraded":"2024-04-26T22:02:37.190841+0000","last_fullsized":"2024-04-26T22:02:37.190841+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:11.396397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193612+0000","last_change":"2024-04-26T22:02:36.169450+0000","last_active":"2024-04-26T22:02:37.193612+0000","last_peered":"2024-04-26T22:02:37.193612+0000","last_clean":"2024-04-26T22:02:37.193612+0000","last_became_active":"2024-04-26T22:02:36.169145+0000","last_became_peered":"2024-04-26T22:02:36.169145+0000","last_unstale":"2024-04-26T22:02:37.193612+0000","last_undegraded":"2024-04-26T22:02:37.193612+0000","last_fullsized":"2024-04-26T22:02:37.193612+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:39.441154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.183810+0000","last_change":"2024-04-26T22:02:37.182313+0000","last_active":"2024-04-26T22:02:37.183810+0000","last_peered":"2024-04-26T22:02:37.183810+0000","last_clean":"2024-04-26T22:02:37.183810+0000","last_became_active":"2024-04-26T22:02:37.182017+0000","last_became_peered":"2024-04-26T22:02:37.182017+0000","last_unstale":"2024-04-26T22:02:37.183810+0000","last_undegraded":"2024-04-26T22:02:37.183810+0000","last_fullsized":"2024-04-26T22:02:37.183810+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:19.476094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.194100+0000","last_change":"2024-04-26T22:02:36.169769+0000","last_active":"2024-04-26T22:02:37.194100+0000","last_peered":"2024-04-26T22:02:37.194100+0000","last_clean":"2024-04-26T22:02:37.194100+0000","last_became_active":"2024-04-26T22:02:36.169483+0000","last_became_peered":"2024-04-26T22:02:36.169483+0000","last_unstale":"2024-04-26T22:02:37.194100+0000","last_undegraded":"2024-04-26T22:02:37.194100+0000","last_fullsized":"2024-04-26T22:02:37.194100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:25:07.853861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.185895+0000","last_change":"2024-04-26T22:02:37.179959+0000","last_active":"2024-04-26T22:02:37.185895+0000","last_peered":"2024-04-26T22:02:37.185895+0000","last_clean":"2024-04-26T22:02:37.185895+0000","last_became_active":"2024-04-26T22:02:37.179418+0000","last_became_peered":"2024-04-26T22:02:37.179418+0000","last_unstale":"2024-04-26T22:02:37.185895+0000","last_undegraded":"2024-04-26T22:02:37.185895+0000","last_fullsized":"2024-04-26T22:02:37.185895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:06.401717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.194232+0000","last_change":"2024-04-26T22:02:36.168608+0000","last_active":"2024-04-26T22:02:37.194232+0000","last_peered":"2024-04-26T22:02:37.194232+0000","last_clean":"2024-04-26T22:02:37.194232+0000","last_became_active":"2024-04-26T22:02:36.168312+0000","last_became_peered":"2024-04-26T22:02:36.168312+0000","last_unstale":"2024-04-26T22:02:37.194232+0000","last_undegraded":"2024-04-26T22:02:37.194232+0000","last_fullsized":"2024-04-26T22:02:37.194232+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:44:49.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182575+0000","last_change":"2024-04-26T22:02:37.181416+0000","last_active":"2024-04-26T22:02:37.182575+0000","last_peered":"2024-04-26T22:02:37.182575+0000","last_clean":"2024-04-26T22:02:37.182575+0000","last_became_active":"2024-04-26T22:02:37.181144+0000","last_became_peered":"2024-04-26T22:02:37.181144+0000","last_unstale":"2024-04-26T22:02:37.182575+0000","last_undegraded":"2024-04-26T22:02:37.182575+0000","last_fullsized":"2024-04-26T22:02:37.182575+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:27:21.372359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.190076+0000","last_change":"2024-04-26T22:02:36.172309+0000","last_active":"2024-04-26T22:02:37.190076+0000","last_peered":"2024-04-26T22:02:37.190076+0000","last_clean":"2024-04-26T22:02:37.190076+0000","last_became_active":"2024-04-26T22:02:36.171900+0000","last_became_peered":"2024-04-26T22:02:36.171900+0000","last_unstale":"2024-04-26T22:02:37.190076+0000","last_undegraded":"2024-04-26T22:02:37.190076+0000","last_fullsized":"2024-04-26T22:02:37.190076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:03.142445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.177464+0000","last_change":"2024-04-26T22:02:37.174833+0000","last_active":"2024-04-26T22:02:37.177464+0000","last_peered":"2024-04-26T22:02:37.177464+0000","last_clean":"2024-04-26T22:02:37.177464+0000","last_became_active":"2024-04-26T22:02:37.174335+0000","last_became_peered":"2024-04-26T22:02:37.174335+0000","last_unstale":"2024-04-26T22:02:37.177464+0000","last_undegraded":"2024-04-26T22:02:37.177464+0000","last_fullsized":"2024-04-26T22:02:37.177464+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:20.524803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193919+0000","last_change":"2024-04-26T22:02:36.172094+0000","last_active":"2024-04-26T22:02:37.193919+0000","last_peered":"2024-04-26T22:02:37.193919+0000","last_clean":"2024-04-26T22:02:37.193919+0000","last_became_active":"2024-04-26T22:02:36.171831+0000","last_became_peered":"2024-04-26T22:02:36.171831+0000","last_unstale":"2024-04-26T22:02:37.193919+0000","last_undegraded":"2024-04-26T22:02:37.193919+0000","last_fullsized":"2024-04-26T22:02:37.193919+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:51.622208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184202+0000","last_change":"2024-04-26T22:02:37.179092+0000","last_active":"2024-04-26T22:02:37.184202+0000","last_peered":"2024-04-26T22:02:37.184202+0000","last_clean":"2024-04-26T22:02:37.184202+0000","last_became_active":"2024-04-26T22:02:37.178804+0000","last_became_peered":"2024-04-26T22:02:37.178804+0000","last_unstale":"2024-04-26T22:02:37.184202+0000","last_undegraded":"2024-04-26T22:02:37.184202+0000","last_fullsized":"2024-04-26T22:02:37.184202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:10:21.924760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.164519+0000","last_change":"2024-04-26T22:02:36.166702+0000","last_active":"2024-04-26T22:02:37.164519+0000","last_peered":"2024-04-26T22:02:37.164519+0000","last_clean":"2024-04-26T22:02:37.164519+0000","last_became_active":"2024-04-26T22:02:36.165513+0000","last_became_peered":"2024-04-26T22:02:36.165513+0000","last_unstale":"2024-04-26T22:02:37.164519+0000","last_undegraded":"2024-04-26T22:02:37.164519+0000","last_fullsized":"2024-04-26T22:02:37.164519+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:09:19.176377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.178788+0000","last_change":"2024-04-26T22:02:37.177898+0000","last_active":"2024-04-26T22:02:37.178788+0000","last_peered":"2024-04-26T22:02:37.178788+0000","last_clean":"2024-04-26T22:02:37.178788+0000","last_became_active":"2024-04-26T22:02:37.177576+0000","last_became_peered":"2024-04-26T22:02:37.177576+0000","last_unstale":"2024-04-26T22:02:37.178788+0000","last_undegraded":"2024-04-26T22:02:37.178788+0000","last_fullsized":"2024-04-26T22:02:37.178788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:28:47.784443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.170040+0000","last_change":"2024-04-26T22:02:36.172852+0000","last_active":"2024-04-26T22:02:37.170040+0000","last_peered":"2024-04-26T22:02:37.170040+0000","last_clean":"2024-04-26T22:02:37.170040+0000","last_became_active":"2024-04-26T22:02:36.172565+0000","last_became_peered":"2024-04-26T22:02:36.172565+0000","last_unstale":"2024-04-26T22:02:37.170040+0000","last_undegraded":"2024-04-26T22:02:37.170040+0000","last_fullsized":"2024-04-26T22:02:37.170040+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:41.342038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.180067+0000","last_change":"2024-04-26T22:02:37.177761+0000","last_active":"2024-04-26T22:02:37.180067+0000","last_peered":"2024-04-26T22:02:37.180067+0000","last_clean":"2024-04-26T22:02:37.180067+0000","last_became_active":"2024-04-26T22:02:37.177479+0000","last_became_peered":"2024-04-26T22:02:37.177479+0000","last_unstale":"2024-04-26T22:02:37.180067+0000","last_undegraded":"2024-04-26T22:02:37.180067+0000","last_fullsized":"2024-04-26T22:02:37.180067+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:16.553577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.167229+0000","last_change":"2024-04-26T22:02:36.166607+0000","last_active":"2024-04-26T22:02:37.167229+0000","last_peered":"2024-04-26T22:02:37.167229+0000","last_clean":"2024-04-26T22:02:37.167229+0000","last_became_active":"2024-04-26T22:02:36.166362+0000","last_became_peered":"2024-04-26T22:02:36.166362+0000","last_unstale":"2024-04-26T22:02:37.167229+0000","last_undegraded":"2024-04-26T22:02:37.167229+0000","last_fullsized":"2024-04-26T22:02:37.167229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:44:18.472095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188001+0000","last_change":"2024-04-26T22:02:37.180657+0000","last_active":"2024-04-26T22:02:37.188001+0000","last_peered":"2024-04-26T22:02:37.188001+0000","last_clean":"2024-04-26T22:02:37.188001+0000","last_became_active":"2024-04-26T22:02:37.180394+0000","last_became_peered":"2024-04-26T22:02:37.180394+0000","last_unstale":"2024-04-26T22:02:37.188001+0000","last_undegraded":"2024-04-26T22:02:37.188001+0000","last_fullsized":"2024-04-26T22:02:37.188001+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:27.718715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.175659+0000","last_change":"2024-04-26T22:02:36.162588+0000","last_active":"2024-04-26T22:02:37.175659+0000","last_peered":"2024-04-26T22:02:37.175659+0000","last_clean":"2024-04-26T22:02:37.175659+0000","last_became_active":"2024-04-26T22:02:36.162322+0000","last_became_peered":"2024-04-26T22:02:36.162322+0000","last_unstale":"2024-04-26T22:02:37.175659+0000","last_undegraded":"2024-04-26T22:02:37.175659+0000","last_fullsized":"2024-04-26T22:02:37.175659+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:34.375805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193511+0000","last_change":"2024-04-26T22:02:37.189739+0000","last_active":"2024-04-26T22:02:37.193511+0000","last_peered":"2024-04-26T22:02:37.193511+0000","last_clean":"2024-04-26T22:02:37.193511+0000","last_became_active":"2024-04-26T22:02:37.188570+0000","last_became_peered":"2024-04-26T22:02:37.188570+0000","last_unstale":"2024-04-26T22:02:37.193511+0000","last_undegraded":"2024-04-26T22:02:37.193511+0000","last_fullsized":"2024-04-26T22:02:37.193511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:14.261554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.190446+0000","last_change":"2024-04-26T22:02:36.170819+0000","last_active":"2024-04-26T22:02:37.190446+0000","last_peered":"2024-04-26T22:02:37.190446+0000","last_clean":"2024-04-26T22:02:37.190446+0000","last_became_active":"2024-04-26T22:02:36.170107+0000","last_became_peered":"2024-04-26T22:02:36.170107+0000","last_unstale":"2024-04-26T22:02:37.190446+0000","last_undegraded":"2024-04-26T22:02:37.190446+0000","last_fullsized":"2024-04-26T22:02:37.190446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:18.657902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187528+0000","last_change":"2024-04-26T22:02:37.185182+0000","last_active":"2024-04-26T22:02:37.187528+0000","last_peered":"2024-04-26T22:02:37.187528+0000","last_clean":"2024-04-26T22:02:37.187528+0000","last_became_active":"2024-04-26T22:02:37.184896+0000","last_became_peered":"2024-04-26T22:02:37.184896+0000","last_unstale":"2024-04-26T22:02:37.187528+0000","last_undegraded":"2024-04-26T22:02:37.187528+0000","last_fullsized":"2024-04-26T22:02:37.187528+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:13.757206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.195911+0000","last_change":"2024-04-26T22:02:36.166953+0000","last_active":"2024-04-26T22:02:37.195911+0000","last_peered":"2024-04-26T22:02:37.195911+0000","last_clean":"2024-04-26T22:02:37.195911+0000","last_became_active":"2024-04-26T22:02:36.166522+0000","last_became_peered":"2024-04-26T22:02:36.166522+0000","last_unstale":"2024-04-26T22:02:37.195911+0000","last_undegraded":"2024-04-26T22:02:37.195911+0000","last_fullsized":"2024-04-26T22:02:37.195911+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:01:47.707098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.180268+0000","last_change":"2024-04-26T22:02:37.178646+0000","last_active":"2024-04-26T22:02:37.180268+0000","last_peered":"2024-04-26T22:02:37.180268+0000","last_clean":"2024-04-26T22:02:37.180268+0000","last_became_active":"2024-04-26T22:02:37.178338+0000","last_became_peered":"2024-04-26T22:02:37.178338+0000","last_unstale":"2024-04-26T22:02:37.180268+0000","last_undegraded":"2024-04-26T22:02:37.180268+0000","last_fullsized":"2024-04-26T22:02:37.180268+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:20:43.686935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193479+0000","last_change":"2024-04-26T22:02:36.163519+0000","last_active":"2024-04-26T22:02:37.193479+0000","last_peered":"2024-04-26T22:02:37.193479+0000","last_clean":"2024-04-26T22:02:37.193479+0000","last_became_active":"2024-04-26T22:02:36.163237+0000","last_became_peered":"2024-04-26T22:02:36.163237+0000","last_unstale":"2024-04-26T22:02:37.193479+0000","last_undegraded":"2024-04-26T22:02:37.193479+0000","last_fullsized":"2024-04-26T22:02:37.193479+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:39.581397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.179477+0000","last_change":"2024-04-26T22:02:37.175933+0000","last_active":"2024-04-26T22:02:37.179477+0000","last_peered":"2024-04-26T22:02:37.179477+0000","last_clean":"2024-04-26T22:02:37.179477+0000","last_became_active":"2024-04-26T22:02:37.175060+0000","last_became_peered":"2024-04-26T22:02:37.175060+0000","last_unstale":"2024-04-26T22:02:37.179477+0000","last_undegraded":"2024-04-26T22:02:37.179477+0000","last_fullsized":"2024-04-26T22:02:37.179477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:14.261554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.170916+0000","last_change":"2024-04-26T22:02:36.169435+0000","last_active":"2024-04-26T22:02:37.170916+0000","last_peered":"2024-04-26T22:02:37.170916+0000","last_clean":"2024-04-26T22:02:37.170916+0000","last_became_active":"2024-04-26T22:02:36.169145+0000","last_became_peered":"2024-04-26T22:02:36.169145+0000","last_unstale":"2024-04-26T22:02:37.170916+0000","last_undegraded":"2024-04-26T22:02:37.170916+0000","last_fullsized":"2024-04-26T22:02:37.170916+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:56:21.160900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188104+0000","last_change":"2024-04-26T22:02:37.183584+0000","last_active":"2024-04-26T22:02:37.188104+0000","last_peered":"2024-04-26T22:02:37.188104+0000","last_clean":"2024-04-26T22:02:37.188104+0000","last_became_active":"2024-04-26T22:02:37.183295+0000","last_became_peered":"2024-04-26T22:02:37.183295+0000","last_unstale":"2024-04-26T22:02:37.188104+0000","last_undegraded":"2024-04-26T22:02:37.188104+0000","last_fullsized":"2024-04-26T22:02:37.188104+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:45.187056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.172830+0000","last_change":"2024-04-26T22:02:36.170744+0000","last_active":"2024-04-26T22:02:37.172830+0000","last_peered":"2024-04-26T22:02:37.172830+0000","last_clean":"2024-04-26T22:02:37.172830+0000","last_became_active":"2024-04-26T22:02:36.170360+0000","last_became_peered":"2024-04-26T22:02:36.170360+0000","last_unstale":"2024-04-26T22:02:37.172830+0000","last_undegraded":"2024-04-26T22:02:37.172830+0000","last_fullsized":"2024-04-26T22:02:37.172830+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:53.719898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.189438+0000","last_change":"2024-04-26T22:02:37.186769+0000","last_active":"2024-04-26T22:02:37.189438+0000","last_peered":"2024-04-26T22:02:37.189438+0000","last_clean":"2024-04-26T22:02:37.189438+0000","last_became_active":"2024-04-26T22:02:37.186462+0000","last_became_peered":"2024-04-26T22:02:37.186462+0000","last_unstale":"2024-04-26T22:02:37.189438+0000","last_undegraded":"2024-04-26T22:02:37.189438+0000","last_fullsized":"2024-04-26T22:02:37.189438+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:21.535375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.195161+0000","last_change":"2024-04-26T22:02:36.163531+0000","last_active":"2024-04-26T22:02:37.195161+0000","last_peered":"2024-04-26T22:02:37.195161+0000","last_clean":"2024-04-26T22:02:37.195161+0000","last_became_active":"2024-04-26T22:02:36.163259+0000","last_became_peered":"2024-04-26T22:02:36.163259+0000","last_unstale":"2024-04-26T22:02:37.195161+0000","last_undegraded":"2024-04-26T22:02:37.195161+0000","last_fullsized":"2024-04-26T22:02:37.195161+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:40.602765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.176285+0000","last_change":"2024-04-26T22:02:37.174937+0000","last_active":"2024-04-26T22:02:37.176285+0000","last_peered":"2024-04-26T22:02:37.176285+0000","last_clean":"2024-04-26T22:02:37.176285+0000","last_became_active":"2024-04-26T22:02:37.174661+0000","last_became_peered":"2024-04-26T22:02:37.174661+0000","last_unstale":"2024-04-26T22:02:37.176285+0000","last_undegraded":"2024-04-26T22:02:37.176285+0000","last_fullsized":"2024-04-26T22:02:37.176285+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:49:14.261554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.192639+0000","last_change":"2024-04-26T22:02:36.170929+0000","last_active":"2024-04-26T22:02:37.192639+0000","last_peered":"2024-04-26T22:02:37.192639+0000","last_clean":"2024-04-26T22:02:37.192639+0000","last_became_active":"2024-04-26T22:02:36.170423+0000","last_became_peered":"2024-04-26T22:02:36.170423+0000","last_unstale":"2024-04-26T22:02:37.192639+0000","last_undegraded":"2024-04-26T22:02:37.192639+0000","last_fullsized":"2024-04-26T22:02:37.192639+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:38.732672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.174695+0000","last_change":"2024-04-26T22:02:37.173164+0000","last_active":"2024-04-26T22:02:37.174695+0000","last_peered":"2024-04-26T22:02:37.174695+0000","last_clean":"2024-04-26T22:02:37.174695+0000","last_became_active":"2024-04-26T22:02:37.172894+0000","last_became_peered":"2024-04-26T22:02:37.172894+0000","last_unstale":"2024-04-26T22:02:37.174695+0000","last_undegraded":"2024-04-26T22:02:37.174695+0000","last_fullsized":"2024-04-26T22:02:37.174695+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.964876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.194125+0000","last_change":"2024-04-26T22:02:36.165100+0000","last_active":"2024-04-26T22:02:37.194125+0000","last_peered":"2024-04-26T22:02:37.194125+0000","last_clean":"2024-04-26T22:02:37.194125+0000","last_became_active":"2024-04-26T22:02:36.164856+0000","last_became_peered":"2024-04-26T22:02:36.164856+0000","last_unstale":"2024-04-26T22:02:37.194125+0000","last_undegraded":"2024-04-26T22:02:37.194125+0000","last_fullsized":"2024-04-26T22:02:37.194125+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:55.215965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.179455+0000","last_change":"2024-04-26T22:02:37.177744+0000","last_active":"2024-04-26T22:02:37.179455+0000","last_peered":"2024-04-26T22:02:37.179455+0000","last_clean":"2024-04-26T22:02:37.179455+0000","last_became_active":"2024-04-26T22:02:37.177479+0000","last_became_peered":"2024-04-26T22:02:37.177479+0000","last_unstale":"2024-04-26T22:02:37.179455+0000","last_undegraded":"2024-04-26T22:02:37.179455+0000","last_fullsized":"2024-04-26T22:02:37.179455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:52.626207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.190083+0000","last_change":"2024-04-26T22:02:36.168865+0000","last_active":"2024-04-26T22:02:37.190083+0000","last_peered":"2024-04-26T22:02:37.190083+0000","last_clean":"2024-04-26T22:02:37.190083+0000","last_became_active":"2024-04-26T22:02:36.167280+0000","last_became_peered":"2024-04-26T22:02:36.167280+0000","last_unstale":"2024-04-26T22:02:37.190083+0000","last_undegraded":"2024-04-26T22:02:37.190083+0000","last_fullsized":"2024-04-26T22:02:37.190083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:02.822992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188824+0000","last_change":"2024-04-26T22:02:37.186129+0000","last_active":"2024-04-26T22:02:37.188824+0000","last_peered":"2024-04-26T22:02:37.188824+0000","last_clean":"2024-04-26T22:02:37.188824+0000","last_became_active":"2024-04-26T22:02:37.185814+0000","last_became_peered":"2024-04-26T22:02:37.185814+0000","last_unstale":"2024-04-26T22:02:37.188824+0000","last_undegraded":"2024-04-26T22:02:37.188824+0000","last_fullsized":"2024-04-26T22:02:37.188824+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:19.358422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.167478+0000","last_change":"2024-04-26T22:02:36.167302+0000","last_active":"2024-04-26T22:02:37.167478+0000","last_peered":"2024-04-26T22:02:37.167478+0000","last_clean":"2024-04-26T22:02:37.167478+0000","last_became_active":"2024-04-26T22:02:36.167005+0000","last_became_peered":"2024-04-26T22:02:36.167005+0000","last_unstale":"2024-04-26T22:02:37.167478+0000","last_undegraded":"2024-04-26T22:02:37.167478+0000","last_fullsized":"2024-04-26T22:02:37.167478+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:37.449383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.184336+0000","last_change":"2024-04-26T22:02:37.181610+0000","last_active":"2024-04-26T22:02:37.184336+0000","last_peered":"2024-04-26T22:02:37.184336+0000","last_clean":"2024-04-26T22:02:37.184336+0000","last_became_active":"2024-04-26T22:02:37.180842+0000","last_became_peered":"2024-04-26T22:02:37.180842+0000","last_unstale":"2024-04-26T22:02:37.184336+0000","last_undegraded":"2024-04-26T22:02:37.184336+0000","last_fullsized":"2024-04-26T22:02:37.184336+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:54.228805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.171076+0000","last_change":"2024-04-26T22:02:36.171442+0000","last_active":"2024-04-26T22:02:37.171076+0000","last_peered":"2024-04-26T22:02:37.171076+0000","last_clean":"2024-04-26T22:02:37.171076+0000","last_became_active":"2024-04-26T22:02:36.171169+0000","last_became_peered":"2024-04-26T22:02:36.171169+0000","last_unstale":"2024-04-26T22:02:37.171076+0000","last_undegraded":"2024-04-26T22:02:37.171076+0000","last_fullsized":"2024-04-26T22:02:37.171076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:56.625530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188063+0000","last_change":"2024-04-26T22:02:37.184918+0000","last_active":"2024-04-26T22:02:37.188063+0000","last_peered":"2024-04-26T22:02:37.188063+0000","last_clean":"2024-04-26T22:02:37.188063+0000","last_became_active":"2024-04-26T22:02:37.184676+0000","last_became_peered":"2024-04-26T22:02:37.184676+0000","last_unstale":"2024-04-26T22:02:37.188063+0000","last_undegraded":"2024-04-26T22:02:37.188063+0000","last_fullsized":"2024-04-26T22:02:37.188063+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:17.363517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.172996+0000","last_change":"2024-04-26T22:02:36.167057+0000","last_active":"2024-04-26T22:02:37.172996+0000","last_peered":"2024-04-26T22:02:37.172996+0000","last_clean":"2024-04-26T22:02:37.172996+0000","last_became_active":"2024-04-26T22:02:36.166777+0000","last_became_peered":"2024-04-26T22:02:36.166777+0000","last_unstale":"2024-04-26T22:02:37.172996+0000","last_undegraded":"2024-04-26T22:02:37.172996+0000","last_fullsized":"2024-04-26T22:02:37.172996+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:19.520804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187149+0000","last_change":"2024-04-26T22:02:37.183400+0000","last_active":"2024-04-26T22:02:37.187149+0000","last_peered":"2024-04-26T22:02:37.187149+0000","last_clean":"2024-04-26T22:02:37.187149+0000","last_became_active":"2024-04-26T22:02:37.183122+0000","last_became_peered":"2024-04-26T22:02:37.183122+0000","last_unstale":"2024-04-26T22:02:37.187149+0000","last_undegraded":"2024-04-26T22:02:37.187149+0000","last_fullsized":"2024-04-26T22:02:37.187149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:59:29.775211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.168315+0000","last_change":"2024-04-26T22:02:36.170216+0000","last_active":"2024-04-26T22:02:37.168315+0000","last_peered":"2024-04-26T22:02:37.168315+0000","last_clean":"2024-04-26T22:02:37.168315+0000","last_became_active":"2024-04-26T22:02:36.169877+0000","last_became_peered":"2024-04-26T22:02:36.169877+0000","last_unstale":"2024-04-26T22:02:37.168315+0000","last_undegraded":"2024-04-26T22:02:37.168315+0000","last_fullsized":"2024-04-26T22:02:37.168315+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:43.192328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.186980+0000","last_change":"2024-04-26T22:02:37.181439+0000","last_active":"2024-04-26T22:02:37.186980+0000","last_peered":"2024-04-26T22:02:37.186980+0000","last_clean":"2024-04-26T22:02:37.186980+0000","last_became_active":"2024-04-26T22:02:37.181139+0000","last_became_peered":"2024-04-26T22:02:37.181139+0000","last_unstale":"2024-04-26T22:02:37.186980+0000","last_undegraded":"2024-04-26T22:02:37.186980+0000","last_fullsized":"2024-04-26T22:02:37.186980+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:08:08.123570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.191461+0000","last_change":"2024-04-26T22:02:36.170258+0000","last_active":"2024-04-26T22:02:37.191461+0000","last_peered":"2024-04-26T22:02:37.191461+0000","last_clean":"2024-04-26T22:02:37.191461+0000","last_became_active":"2024-04-26T22:02:36.169979+0000","last_became_peered":"2024-04-26T22:02:36.169979+0000","last_unstale":"2024-04-26T22:02:37.191461+0000","last_undegraded":"2024-04-26T22:02:37.191461+0000","last_fullsized":"2024-04-26T22:02:37.191461+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:02.914602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.180097+0000","last_change":"2024-04-26T22:02:37.178533+0000","last_active":"2024-04-26T22:02:37.180097+0000","last_peered":"2024-04-26T22:02:37.180097+0000","last_clean":"2024-04-26T22:02:37.180097+0000","last_became_active":"2024-04-26T22:02:37.178273+0000","last_became_peered":"2024-04-26T22:02:37.178273+0000","last_unstale":"2024-04-26T22:02:37.180097+0000","last_undegraded":"2024-04-26T22:02:37.180097+0000","last_fullsized":"2024-04-26T22:02:37.180097+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:06:32.315572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.172333+0000","last_change":"2024-04-26T22:02:36.170507+0000","last_active":"2024-04-26T22:02:37.172333+0000","last_peered":"2024-04-26T22:02:37.172333+0000","last_clean":"2024-04-26T22:02:37.172333+0000","last_became_active":"2024-04-26T22:02:36.170199+0000","last_became_peered":"2024-04-26T22:02:36.170199+0000","last_unstale":"2024-04-26T22:02:37.172333+0000","last_undegraded":"2024-04-26T22:02:37.172333+0000","last_fullsized":"2024-04-26T22:02:37.172333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:40.602765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.188783+0000","last_change":"2024-04-26T22:02:37.185705+0000","last_active":"2024-04-26T22:02:37.188783+0000","last_peered":"2024-04-26T22:02:37.188783+0000","last_clean":"2024-04-26T22:02:37.188783+0000","last_became_active":"2024-04-26T22:02:37.185415+0000","last_became_peered":"2024-04-26T22:02:37.185415+0000","last_unstale":"2024-04-26T22:02:37.188783+0000","last_undegraded":"2024-04-26T22:02:37.188783+0000","last_fullsized":"2024-04-26T22:02:37.188783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:40.445153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.171574+0000","last_change":"2024-04-26T22:02:36.170447+0000","last_active":"2024-04-26T22:02:37.171574+0000","last_peered":"2024-04-26T22:02:37.171574+0000","last_clean":"2024-04-26T22:02:37.171574+0000","last_became_active":"2024-04-26T22:02:36.170154+0000","last_became_peered":"2024-04-26T22:02:36.170154+0000","last_unstale":"2024-04-26T22:02:37.171574+0000","last_undegraded":"2024-04-26T22:02:37.171574+0000","last_fullsized":"2024-04-26T22:02:37.171574+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:06.605779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.185872+0000","last_change":"2024-04-26T22:02:37.179695+0000","last_active":"2024-04-26T22:02:37.185872+0000","last_peered":"2024-04-26T22:02:37.185872+0000","last_clean":"2024-04-26T22:02:37.185872+0000","last_became_active":"2024-04-26T22:02:37.179032+0000","last_became_peered":"2024-04-26T22:02:37.179032+0000","last_unstale":"2024-04-26T22:02:37.185872+0000","last_undegraded":"2024-04-26T22:02:37.185872+0000","last_fullsized":"2024-04-26T22:02:37.185872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:56.150899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.168496+0000","last_change":"2024-04-26T22:02:36.172277+0000","last_active":"2024-04-26T22:02:37.168496+0000","last_peered":"2024-04-26T22:02:37.168496+0000","last_clean":"2024-04-26T22:02:37.168496+0000","last_became_active":"2024-04-26T22:02:36.172002+0000","last_became_peered":"2024-04-26T22:02:36.172002+0000","last_unstale":"2024-04-26T22:02:37.168496+0000","last_undegraded":"2024-04-26T22:02:37.168496+0000","last_fullsized":"2024-04-26T22:02:37.168496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:23:17.181821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.189417+0000","last_change":"2024-04-26T22:02:37.186619+0000","last_active":"2024-04-26T22:02:37.189417+0000","last_peered":"2024-04-26T22:02:37.189417+0000","last_clean":"2024-04-26T22:02:37.189417+0000","last_became_active":"2024-04-26T22:02:37.186314+0000","last_became_peered":"2024-04-26T22:02:37.186314+0000","last_unstale":"2024-04-26T22:02:37.189417+0000","last_undegraded":"2024-04-26T22:02:37.189417+0000","last_fullsized":"2024-04-26T22:02:37.189417+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:51.468507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.171174+0000","last_change":"2024-04-26T22:02:36.167008+0000","last_active":"2024-04-26T22:02:37.171174+0000","last_peered":"2024-04-26T22:02:37.171174+0000","last_clean":"2024-04-26T22:02:37.171174+0000","last_became_active":"2024-04-26T22:02:36.166683+0000","last_became_peered":"2024-04-26T22:02:36.166683+0000","last_unstale":"2024-04-26T22:02:37.171174+0000","last_undegraded":"2024-04-26T22:02:37.171174+0000","last_fullsized":"2024-04-26T22:02:37.171174+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:45.897987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.193587+0000","last_change":"2024-04-26T22:02:37.190397+0000","last_active":"2024-04-26T22:02:37.193587+0000","last_peered":"2024-04-26T22:02:37.193587+0000","last_clean":"2024-04-26T22:02:37.193587+0000","last_became_active":"2024-04-26T22:02:37.190129+0000","last_became_peered":"2024-04-26T22:02:37.190129+0000","last_unstale":"2024-04-26T22:02:37.193587+0000","last_undegraded":"2024-04-26T22:02:37.193587+0000","last_fullsized":"2024-04-26T22:02:37.193587+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:16.553577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.164581+0000","last_change":"2024-04-26T22:02:36.166458+0000","last_active":"2024-04-26T22:02:37.164581+0000","last_peered":"2024-04-26T22:02:37.164581+0000","last_clean":"2024-04-26T22:02:37.164581+0000","last_became_active":"2024-04-26T22:02:36.165563+0000","last_became_peered":"2024-04-26T22:02:36.165563+0000","last_unstale":"2024-04-26T22:02:37.164581+0000","last_undegraded":"2024-04-26T22:02:37.164581+0000","last_fullsized":"2024-04-26T22:02:37.164581+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:11.163173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187414+0000","last_change":"2024-04-26T22:02:37.185975+0000","last_active":"2024-04-26T22:02:37.187414+0000","last_peered":"2024-04-26T22:02:37.187414+0000","last_clean":"2024-04-26T22:02:37.187414+0000","last_became_active":"2024-04-26T22:02:37.185691+0000","last_became_peered":"2024-04-26T22:02:37.185691+0000","last_unstale":"2024-04-26T22:02:37.187414+0000","last_undegraded":"2024-04-26T22:02:37.187414+0000","last_fullsized":"2024-04-26T22:02:37.187414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:03.918601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.166156+0000","last_change":"2024-04-26T22:02:36.168602+0000","last_active":"2024-04-26T22:02:37.166156+0000","last_peered":"2024-04-26T22:02:37.166156+0000","last_clean":"2024-04-26T22:02:37.166156+0000","last_became_active":"2024-04-26T22:02:36.168217+0000","last_became_peered":"2024-04-26T22:02:36.168217+0000","last_unstale":"2024-04-26T22:02:37.166156+0000","last_undegraded":"2024-04-26T22:02:37.166156+0000","last_fullsized":"2024-04-26T22:02:37.166156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:27:52.533909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.182271+0000","last_change":"2024-04-26T22:02:37.181125+0000","last_active":"2024-04-26T22:02:37.182271+0000","last_peered":"2024-04-26T22:02:37.182271+0000","last_clean":"2024-04-26T22:02:37.182271+0000","last_became_active":"2024-04-26T22:02:37.180854+0000","last_became_peered":"2024-04-26T22:02:37.180854+0000","last_unstale":"2024-04-26T22:02:37.182271+0000","last_undegraded":"2024-04-26T22:02:37.182271+0000","last_fullsized":"2024-04-26T22:02:37.182271+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:02:56.219964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.176766+0000","last_change":"2024-04-26T22:02:36.171482+0000","last_active":"2024-04-26T22:02:37.176766+0000","last_peered":"2024-04-26T22:02:37.176766+0000","last_clean":"2024-04-26T22:02:37.176766+0000","last_became_active":"2024-04-26T22:02:36.170106+0000","last_became_peered":"2024-04-26T22:02:36.170106+0000","last_unstale":"2024-04-26T22:02:37.176766+0000","last_undegraded":"2024-04-26T22:02:37.176766+0000","last_fullsized":"2024-04-26T22:02:37.176766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:52:35.262268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.187865+0000","last_change":"2024-04-26T22:02:37.184729+0000","last_active":"2024-04-26T22:02:37.187865+0000","last_peered":"2024-04-26T22:02:37.187865+0000","last_clean":"2024-04-26T22:02:37.187865+0000","last_became_active":"2024-04-26T22:02:37.183912+0000","last_became_peered":"2024-04-26T22:02:37.183912+0000","last_unstale":"2024-04-26T22:02:37.187865+0000","last_undegraded":"2024-04-26T22:02:37.187865+0000","last_fullsized":"2024-04-26T22:02:37.187865+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:36.148575+0000","last_clean_scrub_stamp":"2024-04-26T22:02:36.148575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:27:02.904902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.194279+0000","last_change":"2024-04-26T22:02:36.170795+0000","last_active":"2024-04-26T22:02:37.194279+0000","last_peered":"2024-04-26T22:02:37.194279+0000","last_clean":"2024-04-26T22:02:37.194279+0000","last_became_active":"2024-04-26T22:02:36.169721+0000","last_became_peered":"2024-04-26T22:02:36.169721+0000","last_unstale":"2024-04-26T22:02:37.194279+0000","last_undegraded":"2024-04-26T22:02:37.194279+0000","last_fullsized":"2024-04-26T22:02:37.194279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:02:35.144576+0000","last_clean_scrub_stamp":"2024-04-26T22:02:35.144576+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:17.607314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":272,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T22:02:37.166185+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:02:37.166185+0000","last_peered":"2024-04-26T22:02:37.166185+0000","last_clean":"2024-04-26T22:02:37.166185+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:02:37.166185+0000","last_undegraded":"2024-04-26T22:02:37.166185+0000","last_fullsized":"2024-04-26T22:02:37.166185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1445888,"data_stored":946259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36196,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335644,"statfs":{"total":96636764160,"available":96599699456,"internally_reserved":0,"allocated":872448,"data_stored":362758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":868352,"data_stored":362756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":355891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":355891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":355891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":364894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1458176,"data_stored":953034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:02:40.475 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T22:02:40.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T22:02:40.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.614+0000 7f169882a640 1 Processor -- start 2024-04-26T22:02:40.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.614+0000 7f169882a640 1 -- start start 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.615+0000 7f169882a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16940b3de0 0x7f169415d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.615+0000 7f169882a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16940b4480 con 0x7f16941459a0 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.615+0000 7f169882a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16940b4760 con 0x7f16940b6300 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.615+0000 7f169882a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f16940b4a40 con 0x7f16940b3de0 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.616+0000 7f1692d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16940b3de0 0x7f169415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.616+0000 7f169259c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f16941459a0 0x7f16940b5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48368/0 (socket says 172.21.15.137:48368) 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.616+0000 7f1692d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f16940b3de0 0x7f169415d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45832/0 (socket says 172.21.15.137:45832) 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.616+0000 7f169259c640 1 -- 172.21.15.137:0/1333103496 learned_addr learned my addr 172.21.15.137:0/1333103496 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.616+0000 7f1692d9d640 1 -- 172.21.15.137:0/1333103496 >> v1:172.21.15.170:6789/0 conn(0x7f16940b6300 legacy=0x7f16940720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.616+0000 7f1692d9d640 1 -- 172.21.15.137:0/1333103496 >> v1:172.21.15.137:6789/0 conn(0x7f16941459a0 legacy=0x7f16940b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.616+0000 7f1692d9d640 1 -- 172.21.15.137:0/1333103496 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16940b4d20 con 0x7f16940b3de0 2024-04-26T22:02:40.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.616+0000 7f169159a640 1 -- 172.21.15.137:0/1333103496 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301510865 0 0) 0x7f16940b4480 con 0x7f16941459a0 2024-04-26T22:02:40.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.616+0000 7f1692d9d640 1 --2- 172.21.15.137:0/1333103496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16940b3de0 0x7f169415d030 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097a0 tx=0x7f168c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c49a3981c0114b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:40.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169159a640 1 -- 172.21.15.137:0/1333103496 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c037070 con 0x7f16940b3de0 2024-04-26T22:02:40.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169159a640 1 -- 172.21.15.137:0/1333103496 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c032440 con 0x7f16940b3de0 2024-04-26T22:02:40.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169159a640 1 -- 172.21.15.137:0/1333103496 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c032810 con 0x7f16940b3de0 2024-04-26T22:02:40.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169882a640 1 -- 172.21.15.137:0/1333103496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16940b3de0 msgr2=0x7f169415d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169882a640 1 --2- 172.21.15.137:0/1333103496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16940b3de0 0x7f169415d030 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097a0 tx=0x7f168c02a230 comp rx=0 tx=0).stop 2024-04-26T22:02:40.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169882a640 1 -- 172.21.15.137:0/1333103496 shutdown_connections 2024-04-26T22:02:40.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169882a640 1 --2- 172.21.15.137:0/1333103496 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16940b3de0 0x7f169415d030 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169882a640 1 -- 172.21.15.137:0/1333103496 >> 172.21.15.137:0/1333103496 conn(0x7f16940d0d30 msgr2=0x7f16940d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:40.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169882a640 1 -- 172.21.15.137:0/1333103496 shutdown_connections 2024-04-26T22:02:40.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.617+0000 7f169882a640 1 -- 172.21.15.137:0/1333103496 wait complete. 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f169882a640 1 Processor -- start 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f169882a640 1 -- start start 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f169882a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16940b3de0 0x7f16940b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f169882a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16940b6300 0x7f16941f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f169882a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16941459a0 0x7f16941f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f169882a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1694072980 con 0x7f16941459a0 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f169882a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1694072800 con 0x7f16940b6300 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f169882a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1694072b00 con 0x7f16940b3de0 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f1692d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16941459a0 0x7f16941f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f1692d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16941459a0 0x7f16941f7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45846/0 (socket says 172.21.15.137:45846) 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.619+0000 7f1692d9d640 1 -- 172.21.15.137:0/2797627130 learned_addr learned my addr 172.21.15.137:0/2797627130 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1691d9b640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16940b6300 0x7f16941f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f169259c640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16940b3de0 0x7f16940b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1692d9d640 1 -- 172.21.15.137:0/2797627130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16940b3de0 msgr2=0x7f16940b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1692d9d640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16940b3de0 0x7f16940b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1692d9d640 1 -- 172.21.15.137:0/2797627130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16940b6300 msgr2=0x7f16941f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1692d9d640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16940b6300 0x7f16941f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1692d9d640 1 -- 172.21.15.137:0/2797627130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1694139a90 con 0x7f16941459a0 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1692d9d640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16941459a0 0x7f16941f7420 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097a0 tx=0x7f168c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1682ffd640 1 -- 172.21.15.137:0/2797627130 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c037050 con 0x7f16941459a0 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1682ffd640 1 -- 172.21.15.137:0/2797627130 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168c038040 con 0x7f16941459a0 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16940b28e0 con 0x7f16941459a0 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f1682ffd640 1 -- 172.21.15.137:0/2797627130 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c004490 con 0x7f16941459a0 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.620+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16940b2ea0 con 0x7f16941459a0 2024-04-26T22:02:40.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.621+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16940b31b0 con 0x7f16941459a0 2024-04-26T22:02:40.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.621+0000 7f1682ffd640 1 -- 172.21.15.137:0/2797627130 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f168c030980 con 0x7f16941459a0 2024-04-26T22:02:40.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.622+0000 7f1682ffd640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f167406c8f0 0x7f167406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.622+0000 7f1682ffd640 1 -- 172.21.15.137:0/2797627130 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f168c0ac870 con 0x7f16941459a0 2024-04-26T22:02:40.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.622+0000 7f169259c640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f167406c8f0 0x7f167406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.622+0000 7f169259c640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f167406c8f0 0x7f167406edb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f16840012e0 tx=0x7f1684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:40.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.626+0000 7f1682ffd640 1 -- 172.21.15.137:0/2797627130 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f168c032e20 con 0x7f16941459a0 2024-04-26T22:02:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.870+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f169406a290 con 0x7f16941459a0 2024-04-26T22:02:40.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.872+0000 7f1682ffd640 1 -- 172.21.15.137:0/2797627130 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f168c07adc0 con 0x7f16941459a0 2024-04-26T22:02:40.873 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T22:02:40.873 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ== 2024-04-26T22:02:40.873 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T22:02:40.873 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T22:02:40.873 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T22:02:40.873 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.874+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f167406c8f0 msgr2=0x7f167406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.874+0000 7f169882a640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f167406c8f0 0x7f167406edb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f16840012e0 tx=0x7f1684009040 comp rx=0 tx=0).stop 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.874+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16941459a0 msgr2=0x7f16941f7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.874+0000 7f169882a640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16941459a0 0x7f16941f7420 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f168c0097a0 tx=0x7f168c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.875+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 shutdown_connections 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.875+0000 7f169882a640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f167406c8f0 0x7f167406edb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.875+0000 7f169882a640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f16941459a0 0x7f16941f7420 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.875+0000 7f169882a640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f16940b6300 0x7f16941f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.875+0000 7f169882a640 1 --2- 172.21.15.137:0/2797627130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f16940b3de0 0x7f16940b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.875+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 >> 172.21.15.137:0/2797627130 conn(0x7f16940d0d30 msgr2=0x7f16941444e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.875+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 shutdown_connections 2024-04-26T22:02:40.875 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.875+0000 7f169882a640 1 -- 172.21.15.137:0/2797627130 wait complete. 2024-04-26T22:02:40.886 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:40.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.982+0000 7fadc947e640 1 Processor -- start 2024-04-26T22:02:40.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.982+0000 7fadc947e640 1 -- start start 2024-04-26T22:02:40.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.983+0000 7fadc947e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 0x7fadc4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.983+0000 7fadc947e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fadc40b3de0 0x7fadc40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.983+0000 7fadc947e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc40b4260 con 0x7fadc40b5fd0 2024-04-26T22:02:40.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.983+0000 7fadc947e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fadc40b6440 con 0x7fadc40b3de0 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.983+0000 7fadc947e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fadc40b5140 con 0x7fadc4145980 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc27fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fadc40b3de0 0x7fadc40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc2ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 0x7fadc4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc27fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fadc40b3de0 0x7fadc40b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:36824/0 (socket says 172.21.15.137:36824) 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc2ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 0x7fadc4160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:48548/0 (socket says 172.21.15.137:48548) 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc37fe640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fadc40b5fd0 0x7fadc415c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:57468/0 (socket says 172.21.15.137:57468) 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc27fc640 1 -- 172.21.15.137:0/1147659974 learned_addr learned my addr 172.21.15.137:0/1147659974 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc27fc640 1 -- 172.21.15.137:0/1147659974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 msgr2=0x7fadc4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc27fc640 1 --2- 172.21.15.137:0/1147659974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 0x7fadc4160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc27fc640 1 -- 172.21.15.137:0/1147659974 >> v1:172.21.15.170:6789/0 conn(0x7fadc40b5fd0 legacy=0x7fadc415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc27fc640 1 -- 172.21.15.137:0/1147659974 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc40b4530 con 0x7fadc40b3de0 2024-04-26T22:02:40.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.984+0000 7fadc1ffb640 1 -- 172.21.15.137:0/1147659974 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1169435948 0 0) 0x7fadc40b4260 con 0x7fadc40b5fd0 2024-04-26T22:02:40.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.985+0000 7fadc27fc640 1 --2- 172.21.15.137:0/1147659974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadc40b3de0 0x7fadc40b5a90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fadb800bb10 tx=0x7fadb802c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=263ecda4b1634994 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:40.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.985+0000 7fadc1ffb640 1 -- 172.21.15.137:0/1147659974 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8032790 con 0x7fadc40b3de0 2024-04-26T22:02:40.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.985+0000 7fadc1ffb640 1 -- 172.21.15.137:0/1147659974 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb8038070 con 0x7fadc40b3de0 2024-04-26T22:02:40.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.985+0000 7fadc1ffb640 1 -- 172.21.15.137:0/1147659974 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8032b50 con 0x7fadc40b3de0 2024-04-26T22:02:40.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.985+0000 7fadc947e640 1 -- 172.21.15.137:0/1147659974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadc40b3de0 msgr2=0x7fadc40b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.985+0000 7fadc947e640 1 --2- 172.21.15.137:0/1147659974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadc40b3de0 0x7fadc40b5a90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fadb800bb10 tx=0x7fadb802c890 comp rx=0 tx=0).stop 2024-04-26T22:02:40.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.986+0000 7fadc947e640 1 -- 172.21.15.137:0/1147659974 shutdown_connections 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.986+0000 7fadc947e640 1 --2- 172.21.15.137:0/1147659974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadc40b3de0 0x7fadc40b5a90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.986+0000 7fadc947e640 1 --2- 172.21.15.137:0/1147659974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 0x7fadc4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.986+0000 7fadc947e640 1 -- 172.21.15.137:0/1147659974 >> 172.21.15.137:0/1147659974 conn(0x7fadc40d0d30 msgr2=0x7fadc40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.986+0000 7fadc947e640 1 -- 172.21.15.137:0/1147659974 shutdown_connections 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.986+0000 7fadc947e640 1 -- 172.21.15.137:0/1147659974 wait complete. 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.987+0000 7fadc947e640 1 Processor -- start 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.987+0000 7fadc947e640 1 -- start start 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.987+0000 7fadc947e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadc40b3de0 0x7fadc415c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.987+0000 7fadc947e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadc40b5fd0 0x7fadc4143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.987+0000 7fadc947e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 0x7fadc413fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.987+0000 7fadc947e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40b4dd0 con 0x7fadc40b3de0 2024-04-26T22:02:40.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.987+0000 7fadc947e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40b4af0 con 0x7fadc40b5fd0 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.987+0000 7fadc947e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fadc40730e0 con 0x7fadc4145980 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadc40b3de0 0x7fadc415c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadc40b3de0 0x7fadc415c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45860/0 (socket says 172.21.15.137:45860) 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc2ffd640 1 -- 172.21.15.137:0/194419486 learned_addr learned my addr 172.21.15.137:0/194419486 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc27fc640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadc40b5fd0 0x7fadc4143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc37fe640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 0x7fadc413fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc2ffd640 1 -- 172.21.15.137:0/194419486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 msgr2=0x7fadc413fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc2ffd640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 0x7fadc413fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc2ffd640 1 -- 172.21.15.137:0/194419486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadc40b5fd0 msgr2=0x7fadc4143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc2ffd640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadc40b5fd0 0x7fadc4143df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc2ffd640 1 -- 172.21.15.137:0/194419486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc413d5f0 con 0x7fadc40b3de0 2024-04-26T22:02:40.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc2ffd640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadc40b3de0 0x7fadc415c4d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fadb400efc0 tx=0x7fadb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:40.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadab7fe640 1 -- 172.21.15.137:0/194419486 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4018020 con 0x7fadc40b3de0 2024-04-26T22:02:40.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadab7fe640 1 -- 172.21.15.137:0/194419486 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb4014480 con 0x7fadc40b3de0 2024-04-26T22:02:40.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc413d8d0 con 0x7fadc40b3de0 2024-04-26T22:02:40.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadab7fe640 1 -- 172.21.15.137:0/194419486 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4014850 con 0x7fadc40b3de0 2024-04-26T22:02:40.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.988+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc415ec00 con 0x7fadc40b3de0 2024-04-26T22:02:40.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.989+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc406a290 con 0x7fadc40b3de0 2024-04-26T22:02:40.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.990+0000 7fadab7fe640 1 -- 172.21.15.137:0/194419486 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fadb4005d10 con 0x7fadc40b3de0 2024-04-26T22:02:40.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.990+0000 7fadab7fe640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb006c8f0 0x7fadb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:40.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.990+0000 7fadab7fe640 1 -- 172.21.15.137:0/194419486 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fadb408c580 con 0x7fadc40b3de0 2024-04-26T22:02:40.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.990+0000 7fadc27fc640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb006c8f0 0x7fadb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:40.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.991+0000 7fadc27fc640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb006c8f0 0x7fadb006edb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fadb8037000 tx=0x7fadb8032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:40.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:40.995+0000 7fadab7fe640 1 -- 172.21.15.137:0/194419486 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fadb4022070 con 0x7fadc40b3de0 2024-04-26T22:02:41.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.207+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadc4073cc0 con 0x7fadc40b3de0 2024-04-26T22:02:41.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.208+0000 7fadab7fe640 1 -- 172.21.15.137:0/194419486 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5195 (secure 0 0 0) 0x7fadb4010040 con 0x7fadc40b3de0 2024-04-26T22:02:41.208 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:41.208 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:02:38.507657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1566574554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1566574554},{"type":"v1","addr":"172.21.15.137:6837","nonce":1566574554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":5}]} 2024-04-26T22:02:41.208 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 34 2024-04-26T22:02:41.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb006c8f0 msgr2=0x7fadb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb006c8f0 0x7fadb006edb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fadb8037000 tx=0x7fadb8032000 comp rx=0 tx=0).stop 2024-04-26T22:02:41.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadc40b3de0 msgr2=0x7fadc415c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadc40b3de0 0x7fadc415c4d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fadb400efc0 tx=0x7fadb400c490 comp rx=0 tx=0).stop 2024-04-26T22:02:41.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 shutdown_connections 2024-04-26T22:02:41.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb006c8f0 0x7fadb006edb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadc4145980 0x7fadc413fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadc40b5fd0 0x7fadc4143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 --2- 172.21.15.137:0/194419486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadc40b3de0 0x7fadc415c4d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 >> 172.21.15.137:0/194419486 conn(0x7fadc40d0d30 msgr2=0x7fadc40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:41.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 shutdown_connections 2024-04-26T22:02:41.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.210+0000 7fadc947e640 1 -- 172.21.15.137:0/194419486 wait complete. 2024-04-26T22:02:41.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:02:36.507203+0000', 'modified': '2024-04-26T22:02:38.507657+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6612}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6612': {'gid': 6612, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.137:6837/1566574554', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 1566574554}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 1566574554}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6612, 'qdb_cluster': [6612]} 2024-04-26T22:02:41.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:02:41.624 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T22:02:41.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.724+0000 7fe338299640 1 Processor -- start 2024-04-26T22:02:41.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.724+0000 7fe338299640 1 -- start start 2024-04-26T22:02:41.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.725+0000 7fe338299640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe33013ff70 0x7fe330146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.725+0000 7fe338299640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3300d05b0 con 0x7fe3300cff20 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.725+0000 7fe338299640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3300d0890 con 0x7fe330140350 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.725+0000 7fe338299640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe3300d0390 con 0x7fe33013ff70 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe336836640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe3300cff20 0x7fe33006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48376/0 (socket says 172.21.15.137:48376) 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe336836640 1 -- 172.21.15.137:0/772444808 learned_addr learned my addr 172.21.15.137:0/772444808 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750340211 0 0) 0x7fe3300d05b0 con 0x7fe3300cff20 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe336035640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe33013ff70 0x7fe330146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe31c003520 con 0x7fe3300cff20 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1987793554 0 0) 0x7fe31c003520 con 0x7fe3300cff20 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe33013ff70 msgr2=0x7fe330146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe33013ff70 0x7fe330146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 >> v1:172.21.15.170:6789/0 conn(0x7fe330140350 legacy=0x7fe3300cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33006e450 con 0x7fe3300cff20 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fe3280019f0 con 0x7fe3300cff20 2024-04-26T22:02:41.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 >> v1:172.21.15.137:6789/0 conn(0x7fe3300cff20 legacy=0x7fe33006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe31c0039e0 0x7fe31c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe33013ff70 0x7fe31c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe31c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe3300d0390 con 0x7fe31c004d40 2024-04-26T22:02:41.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe31c00bba0 con 0x7fe31c0039e0 2024-04-26T22:02:41.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe31c00bda0 con 0x7fe33013ff70 2024-04-26T22:02:41.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe336836640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe31c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe336035640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe31c0039e0 0x7fe31c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.726+0000 7fe335834640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe33013ff70 0x7fe31c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.727+0000 7fe336836640 1 -- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe33013ff70 msgr2=0x7fe31c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.727+0000 7fe336836640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe33013ff70 0x7fe31c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.727+0000 7fe336836640 1 -- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe31c0039e0 msgr2=0x7fe31c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.727+0000 7fe336836640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe31c0039e0 0x7fe31c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.727+0000 7fe336836640 1 -- 172.21.15.137:0/772444808 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c003520 con 0x7fe31c004d40 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.727+0000 7fe336836640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe31c0051c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe32800a840 tx=0x7fe31c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacedd501b0f9bb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.727+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32800a460 con 0x7fe31c004d40 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.727+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32802f070 con 0x7fe31c004d40 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.727+0000 7fe335033640 1 -- 172.21.15.137:0/772444808 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32802bcb0 con 0x7fe31c004d40 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.728+0000 7fe338299640 1 -- 172.21.15.137:0/772444808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 msgr2=0x7fe31c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.728+0000 7fe338299640 1 --2- 172.21.15.137:0/772444808 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe31c0051c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fe32800a840 tx=0x7fe31c005830 comp rx=0 tx=0).stop 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.728+0000 7fe336836640 1 -- 172.21.15.137:0/772444808 reap_dead start 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.728+0000 7fe338299640 1 -- 172.21.15.137:0/772444808 shutdown_connections 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.728+0000 7fe338299640 1 -- 172.21.15.137:0/772444808 >> 172.21.15.137:0/772444808 conn(0x7fe3300d0d30 msgr2=0x7fe3300d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.728+0000 7fe338299640 1 -- 172.21.15.137:0/772444808 shutdown_connections 2024-04-26T22:02:41.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.728+0000 7fe338299640 1 -- 172.21.15.137:0/772444808 wait complete. 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.729+0000 7fe338299640 1 Processor -- start 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.729+0000 7fe338299640 1 -- start start 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe338299640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe3300aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe338299640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe330137fa0 0x7fe330136140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe338299640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe330144b70 0x7fe330144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe338299640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe330146200 con 0x7fe31c004d40 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe338299640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe330146080 con 0x7fe330137fa0 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe338299640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe330146380 con 0x7fe330144b70 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe336035640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe3300aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe336035640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe3300aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45890/0 (socket says 172.21.15.137:45890) 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe336035640 1 -- 172.21.15.137:0/901996633 learned_addr learned my addr 172.21.15.137:0/901996633 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe336035640 1 -- 172.21.15.137:0/901996633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe330144b70 msgr2=0x7fe330144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe336035640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe330144b70 0x7fe330144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe336035640 1 -- 172.21.15.137:0/901996633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe330137fa0 msgr2=0x7fe330136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe336035640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe330137fa0 0x7fe330136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe336035640 1 -- 172.21.15.137:0/901996633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3300aa9e0 con 0x7fe31c004d40 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe336035640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe3300aa4a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fe32400b7f0 tx=0x7fe32400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe322ffd640 1 -- 172.21.15.137:0/901996633 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324018070 con 0x7fe31c004d40 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe322ffd640 1 -- 172.21.15.137:0/901996633 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3240107b0 con 0x7fe31c004d40 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe338299640 1 -- 172.21.15.137:0/901996633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3301587d0 con 0x7fe31c004d40 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe322ffd640 1 -- 172.21.15.137:0/901996633 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324010b80 con 0x7fe31c004d40 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.730+0000 7fe338299640 1 -- 172.21.15.137:0/901996633 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe330158a60 con 0x7fe31c004d40 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.732+0000 7fe322ffd640 1 -- 172.21.15.137:0/901996633 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe32401b070 con 0x7fe31c004d40 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.733+0000 7fe322ffd640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe31406c920 0x7fe31406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.733+0000 7fe335834640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe31406c920 0x7fe31406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.733+0000 7fe322ffd640 1 -- 172.21.15.137:0/901996633 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fe32408c130 con 0x7fe31c004d40 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.733+0000 7fe335834640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe31406c920 0x7fe31406ede0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe330145870 tx=0x7fe32c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.734+0000 7fe33afb9740 1 Processor -- start 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.734+0000 7fe33afb9740 1 -- start start 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.734+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb59820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb76ce0 0x56369bb77230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb2f120 0x56369bb753a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe33afb9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56369ba93740 con 0x56369bb59440 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe33afb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56369ba2f3a0 con 0x56369bb76ce0 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe33afb9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56369ba8f700 con 0x56369bb2f120 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe336035640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb59820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe336035640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb59820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45900/0 (socket says 172.21.15.137:45900) 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe336035640 1 -- 172.21.15.137:0/1841000024 learned_addr learned my addr 172.21.15.137:0/1841000024 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe336035640 1 -- 172.21.15.137:0/1841000024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb2f120 msgr2=0x56369bb753a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe336035640 1 --2- 172.21.15.137:0/1841000024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb2f120 0x56369bb753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe336035640 1 -- 172.21.15.137:0/1841000024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb76ce0 msgr2=0x56369bb77230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe336035640 1 --2- 172.21.15.137:0/1841000024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb76ce0 0x56369bb77230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe336035640 1 -- 172.21.15.137:0/1841000024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369ba4b750 con 0x56369bb59440 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe336035640 1 --2- 172.21.15.137:0/1841000024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb59820 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fe324056220 tx=0x7fe324059a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc323f66bcfb2912 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe313fff640 1 -- 172.21.15.137:0/1841000024 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324022070 con 0x56369bb59440 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe313fff640 1 -- 172.21.15.137:0/1841000024 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32405e170 con 0x56369bb59440 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.735+0000 7fe313fff640 1 -- 172.21.15.137:0/1841000024 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3240629a0 con 0x56369bb59440 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.736+0000 7fe33afb9740 1 -- 172.21.15.137:0/1841000024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 msgr2=0x56369bb59820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.736+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1841000024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb59820 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fe324056220 tx=0x7fe324059a00 comp rx=0 tx=0).stop 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.736+0000 7fe33afb9740 1 -- 172.21.15.137:0/1841000024 shutdown_connections 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.736+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1841000024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb2f120 0x56369bb753a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.736+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1841000024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb76ce0 0x56369bb77230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.736+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1841000024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb59820 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.736+0000 7fe33afb9740 1 -- 172.21.15.137:0/1841000024 >> 172.21.15.137:0/1841000024 conn(0x56369bb2ba50 msgr2=0x56369bb74250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.736+0000 7fe33afb9740 1 -- 172.21.15.137:0/1841000024 shutdown_connections 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.736+0000 7fe33afb9740 1 -- 172.21.15.137:0/1841000024 wait complete. 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.737+0000 7fe33afb9740 1 -- start start 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.737+0000 7fe33afb9740 1 Processor -- start 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.737+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb57400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.737+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb76ce0 0x56369bb6c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 0x56369bb6ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe33afb9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56369bb2fec0 con 0x56369bb59440 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe33afb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56369ba1afe0 con 0x56369bb76ce0 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe33afb9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56369bb29980 con 0x56369bb6b370 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe33afb9740 10 client.0 _ll_register_callbacks cb 0x56369ba31150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336035640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb57400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336035640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb57400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45914/0 (socket says 172.21.15.137:45914) 2024-04-26T22:02:41.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336035640 1 -- 172.21.15.137:0/61778685 learned_addr learned my addr 172.21.15.137:0/61778685 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336836640 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 0x56369bb6ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe335834640 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb76ce0 0x56369bb6c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336035640 1 -- 172.21.15.137:0/61778685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 msgr2=0x56369bb6ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336035640 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 0x56369bb6ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336035640 1 -- 172.21.15.137:0/61778685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb76ce0 msgr2=0x56369bb6c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336035640 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb76ce0 0x56369bb6c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336035640 1 -- 172.21.15.137:0/61778685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56369b7a52d0 con 0x56369bb59440 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe336035640 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb57400 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe324062470 tx=0x7fe32408c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c551f8a1fbf0a31 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe3117fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe3117fa640 1 -- 172.21.15.137:0/61778685 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324072180 con 0x56369bb59440 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe3117fa640 1 -- 172.21.15.137:0/61778685 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fe324072320 con 0x56369bb59440 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe33afb9740 1 -- 172.21.15.137:0/61778685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe32405e170 con 0x56369bb59440 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe3117fa640 1 -- 172.21.15.137:0/61778685 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe324059210 con 0x56369bb59440 2024-04-26T22:02:41.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe33afb9740 10 client.6771 fetch_fsmap learned FSMap version 34 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe33afb9740 1 -- 172.21.15.137:0/61778685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x56369b86f6b0 con 0x56369bb59440 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe3117fa640 1 -- 172.21.15.137:0/61778685 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32405e170 con 0x56369bb59440 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.738+0000 7fe3117fa640 1 -- 172.21.15.137:0/61778685 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7fe3240593b0 con 0x56369bb59440 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.739+0000 7fe33afb9740 10 client.6771 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.739+0000 7fe33afb9740 10 client.6771 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.739+0000 7fe33afb9740 20 client.6771 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.739+0000 7fe33afb9740 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] conn(0x56369bb721e0 0x56369bb87af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.739+0000 7fe33afb9740 4 client.6771 mds_command: new command op to 6612 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.739+0000 7fe33afb9740 1 -- 172.21.15.137:0/61778685 --> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56369baa1350 con 0x56369bb721e0 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.739+0000 7fe335834640 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] conn(0x56369bb721e0 0x56369bb87af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.739+0000 7fe335834640 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] conn(0x56369bb721e0 0x56369bb87af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35a79b0fc6ccbcf6 server_cookie=dd89b1da7fd3ac64 in_seq=0 out_seq=0 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.739+0000 7fe3117fa640 10 client.6771 ms_handle_connect on v2:172.21.15.137:6835/1566574554 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe3117fa640 1 -- 172.21.15.137:0/61778685 <== mds.0 v2:172.21.15.137:6835/1566574554 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56369baa1350 con 0x56369bb721e0 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe3117fa640 10 client.6771 handle_command_reply: tid=0 2024-04-26T22:02:41.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 client.6771 shutdown 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 -- 172.21.15.137:0/61778685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 msgr2=0x56369bb57400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb57400 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fe324062470 tx=0x7fe32408c040 comp rx=0 tx=0).stop 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 -- 172.21.15.137:0/61778685 shutdown_connections 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] conn(0x56369bb721e0 0x56369bb87af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 0x56369bb6ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb76ce0 0x56369bb6c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 --2- 172.21.15.137:0/61778685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb59440 0x56369bb57400 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe3117fa640 0 client.6771 ms_handle_reset on v2:172.21.15.137:6835/1566574554 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 -- 172.21.15.137:0/61778685 >> 172.21.15.137:0/61778685 conn(0x56369bb2f120 msgr2=0x56369bb78060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:41.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 -- 172.21.15.137:0/61778685 shutdown_connections 2024-04-26T22:02:41.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 1 -- 172.21.15.137:0/61778685 wait complete. 2024-04-26T22:02:41.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.740+0000 7fe33afb9740 20 client.6771 trim_cache size 0 max 16384 2024-04-26T22:02:41.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.758+0000 7fe33afb9740 1 Processor -- start 2024-04-26T22:02:41.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.758+0000 7fe33afb9740 1 -- start start 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 0x56369bb28860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 0x56369bb2dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb76ce0 0x56369bb2e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe33afb9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe330202070 con 0x56369bb76ce0 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe33afb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe330201090 con 0x56369bb59440 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe33afb9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe330072d90 con 0x56369bb6b370 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe336836640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb76ce0 0x56369bb2e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe336836640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb76ce0 0x56369bb2e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45928/0 (socket says 172.21.15.137:45928) 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe336836640 1 -- 172.21.15.137:0/2170535269 learned_addr learned my addr 172.21.15.137:0/2170535269 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:41.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe336035640 1 --2- 172.21.15.137:0/2170535269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 0x56369bb28860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe335834640 1 --2- 172.21.15.137:0/2170535269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 0x56369bb2dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe336836640 1 -- 172.21.15.137:0/2170535269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 msgr2=0x56369bb2dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe336836640 1 --2- 172.21.15.137:0/2170535269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 0x56369bb2dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe336836640 1 -- 172.21.15.137:0/2170535269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 msgr2=0x56369bb28860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe336836640 1 --2- 172.21.15.137:0/2170535269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 0x56369bb28860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.759+0000 7fe336836640 1 -- 172.21.15.137:0/2170535269 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369bb29250 con 0x56369bb76ce0 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe336836640 1 --2- 172.21.15.137:0/2170535269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb76ce0 0x56369bb2e110 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe32802b500 tx=0x7fe3300d0780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1401b1e72686f7f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe3137fe640 1 -- 172.21.15.137:0/2170535269 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3280017b0 con 0x56369bb76ce0 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe3137fe640 1 -- 172.21.15.137:0/2170535269 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32802f070 con 0x56369bb76ce0 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe3137fe640 1 -- 172.21.15.137:0/2170535269 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32802b850 con 0x56369bb76ce0 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe33afb9740 1 -- 172.21.15.137:0/2170535269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb76ce0 msgr2=0x56369bb2e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe33afb9740 1 --2- 172.21.15.137:0/2170535269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb76ce0 0x56369bb2e110 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fe32802b500 tx=0x7fe3300d0780 comp rx=0 tx=0).stop 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe33afb9740 1 -- 172.21.15.137:0/2170535269 shutdown_connections 2024-04-26T22:02:41.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe33afb9740 1 --2- 172.21.15.137:0/2170535269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb76ce0 0x56369bb2e110 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe33afb9740 1 --2- 172.21.15.137:0/2170535269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb6b370 0x56369bb2dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe33afb9740 1 --2- 172.21.15.137:0/2170535269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 0x56369bb28860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe33afb9740 1 -- 172.21.15.137:0/2170535269 >> 172.21.15.137:0/2170535269 conn(0x56369bb2f120 msgr2=0x56369bb745d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:41.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe33afb9740 1 -- 172.21.15.137:0/2170535269 shutdown_connections 2024-04-26T22:02:41.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.760+0000 7fe33afb9740 1 -- 172.21.15.137:0/2170535269 wait complete. 2024-04-26T22:02:41.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.761+0000 7fe33afb9740 1 -- start start 2024-04-26T22:02:41.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.761+0000 7fe33afb9740 1 Processor -- start 2024-04-26T22:02:41.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 0x56369bbd7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb6b370 0x56369bb5c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe33afb9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb76ce0 0x56369bb56430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe33afb9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56369ba1afe0 con 0x56369bb6b370 2024-04-26T22:02:41.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe33afb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe330159cf0 con 0x56369bb59440 2024-04-26T22:02:41.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe33afb9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56369bb2fec0 con 0x56369bb76ce0 2024-04-26T22:02:41.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe33afb9740 10 client.0 _ll_register_callbacks cb 0x7fe324059900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:41.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe335834640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb6b370 0x56369bb5c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe335834640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb6b370 0x56369bb5c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45936/0 (socket says 172.21.15.137:45936) 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe335834640 1 -- 172.21.15.137:0/1529813442 learned_addr learned my addr 172.21.15.137:0/1529813442 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe336836640 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb76ce0 0x56369bb56430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe336035640 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 0x56369bbd7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe335834640 1 -- 172.21.15.137:0/1529813442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb76ce0 msgr2=0x56369bb56430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe335834640 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb76ce0 0x56369bb56430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe335834640 1 -- 172.21.15.137:0/1529813442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 msgr2=0x56369bbd7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe335834640 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 0x56369bbd7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe335834640 1 -- 172.21.15.137:0/1529813442 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56369bb6a740 con 0x56369bb6b370 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe336035640 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 0x56369bbd7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe335834640 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb6b370 0x56369bb5c110 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00f8e0 tx=0x7fe32c007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2328bf1e06450c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.762+0000 7fe3117fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe3117fa640 1 -- 172.21.15.137:0/1529813442 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c015cc0 con 0x56369bb6b370 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe3117fa640 1 -- 172.21.15.137:0/1529813442 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fe32c010040 con 0x56369bb6b370 2024-04-26T22:02:41.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe33afb9740 1 -- 172.21.15.137:0/1529813442 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe32802f070 con 0x56369bb6b370 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe3117fa640 1 -- 172.21.15.137:0/1529813442 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe32c015e60 con 0x56369bb6b370 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe33afb9740 10 client.6777 fetch_fsmap learned FSMap version 34 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe33afb9740 1 -- 172.21.15.137:0/1529813442 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x56369bb75680 con 0x56369bb6b370 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe3117fa640 1 -- 172.21.15.137:0/1529813442 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32802f070 con 0x56369bb6b370 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe3117fa640 1 -- 172.21.15.137:0/1529813442 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 34) ==== 3494+0+0 (secure 0 0 0) 0x7fe32c0243c0 con 0x56369bb6b370 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe33afb9740 10 client.6777 fetch_fsmap finished waiting for FSMap version 34 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe33afb9740 10 client.6777 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe33afb9740 20 client.6777 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] conn(0x56369bb56ab0 0x56369bb55290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe33afb9740 4 client.6777 mds_command: new command op to 6612 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe33afb9740 1 -- 172.21.15.137:0/1529813442 --> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] -- command(tid 0: {"prefix": "status"}) -- 0x56369ba9b1c0 con 0x56369bb56ab0 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe336035640 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] conn(0x56369bb56ab0 0x56369bb55290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.763+0000 7fe3117fa640 10 client.6777 ms_handle_connect on v2:172.21.15.137:6835/1566574554 2024-04-26T22:02:41.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe336035640 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] conn(0x56369bb56ab0 0x56369bb55290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaabd461c35d0b88 server_cookie=2b639be0038f5e8e in_seq=0 out_seq=0 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe3117fa640 1 -- 172.21.15.137:0/1529813442 <== mds.0 v2:172.21.15.137:6835/1566574554 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56369ba9b1c0 con 0x56369bb56ab0 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe3117fa640 10 client.6777 handle_command_reply: tid=0 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 client.6777 shutdown 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 -- 172.21.15.137:0/1529813442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb6b370 msgr2=0x56369bb5c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb6b370 0x56369bb5c110 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00f8e0 tx=0x7fe32c007c80 comp rx=0 tx=0).stop 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 -- 172.21.15.137:0/1529813442 shutdown_connections 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.137:6835/1566574554,v1:172.21.15.137:6837/1566574554] conn(0x56369bb56ab0 0x56369bb55290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56369bb6b370 0x56369bb5c110 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe3117fa640 0 client.6777 ms_handle_reset on v2:172.21.15.137:6835/1566574554 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56369bb76ce0 0x56369bb56430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 --2- 172.21.15.137:0/1529813442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56369bb59440 0x56369bbd7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 -- 172.21.15.137:0/1529813442 >> 172.21.15.137:0/1529813442 conn(0x56369bb2f120 msgr2=0x56369bb745d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:41.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 -- 172.21.15.137:0/1529813442 shutdown_connections 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 1 -- 172.21.15.137:0/1529813442 wait complete. 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.764+0000 7fe33afb9740 20 client.6777 trim_cache size 0 max 16384 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 6612, 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:02:41.771 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.5935981379999999, 2024-04-26T22:02:41.772 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 34, 2024-04-26T22:02:41.772 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 72, 2024-04-26T22:02:41.772 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 72, 2024-04-26T22:02:41.772 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 9.6613499259999998 2024-04-26T22:02:41.772 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 -- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe31406c920 msgr2=0x7fe31406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe31406c920 0x7fe31406ede0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe330145870 tx=0x7fe32c009040 comp rx=0 tx=0).stop 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 -- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 msgr2=0x7fe3300aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe3300aa4a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fe32400b7f0 tx=0x7fe32400bcb0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 -- 172.21.15.137:0/901996633 shutdown_connections 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe31406c920 0x7fe31406ede0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe330144b70 0x7fe330144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe330137fa0 0x7fe330136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 --2- 172.21.15.137:0/901996633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe31c004d40 0x7fe3300aa4a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 -- 172.21.15.137:0/901996633 >> 172.21.15.137:0/901996633 conn(0x7fe3300d0d30 msgr2=0x7fe33015f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 -- 172.21.15.137:0/901996633 shutdown_connections 2024-04-26T22:02:41.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.765+0000 7fe338299640 1 -- 172.21.15.137:0/901996633 wait complete. 2024-04-26T22:02:41.778 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:02:41.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.879+0000 7f18ff89b640 1 Processor -- start 2024-04-26T22:02:41.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.880+0000 7f18ff89b640 1 -- start start 2024-04-26T22:02:41.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.880+0000 7f18ff89b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f18f815f750 0x7f18f80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.880+0000 7f18ff89b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f80d03a0 con 0x7f18f80d3ee0 2024-04-26T22:02:41.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.880+0000 7f18ff89b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f80d0680 con 0x7f18f815f370 2024-04-26T22:02:41.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.880+0000 7f18ff89b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f18f80d0960 con 0x7f18f815f750 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.880+0000 7f18fce36640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f18f80d3ee0 0x7f18f80b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48388/0 (socket says 172.21.15.137:48388) 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fce36640 1 -- 172.21.15.137:0/3977093425 learned_addr learned my addr 172.21.15.137:0/3977093425 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277555699 0 0) 0x7f18f80d03a0 con 0x7f18f80d3ee0 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fde38640 1 --2- 172.21.15.137:0/3977093425 >> v2:172.21.15.170:3300/0 conn(0x7f18f815f750 0x7f18f80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18e4003520 con 0x7f18f80d3ee0 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2509323414 0 0) 0x7f18e4003520 con 0x7f18f80d3ee0 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 >> v2:172.21.15.170:3300/0 conn(0x7f18f815f750 msgr2=0x7f18f80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 --2- 172.21.15.137:0/3977093425 >> v2:172.21.15.170:3300/0 conn(0x7f18f815f750 0x7f18f80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 >> v1:172.21.15.170:6789/0 conn(0x7f18f815f370 legacy=0x7f18f80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f80d0c40 con 0x7f18f80d3ee0 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f18f4001670 con 0x7f18f80d3ee0 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 >> v1:172.21.15.137:6789/0 conn(0x7f18f80d3ee0 legacy=0x7f18f80b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40039b0 0x7f18e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18e4004800 0x7f18e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18e40051c0 0x7f18e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18f80d0960 con 0x7f18e40051c0 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f18e400c060 con 0x7f18e40039b0 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f18e400c260 con 0x7f18e4004800 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fde38640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18e40051c0 0x7f18e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fd637640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40039b0 0x7f18e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fce36640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18e4004800 0x7f18e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fde38640 1 -- 172.21.15.137:0/3977093425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18e4004800 msgr2=0x7f18e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fde38640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18e4004800 0x7f18e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fde38640 1 -- 172.21.15.137:0/3977093425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40039b0 msgr2=0x7f18e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:41.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fde38640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40039b0 0x7f18e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.881+0000 7f18fde38640 1 -- 172.21.15.137:0/3977093425 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e4003520 con 0x7f18e40051c0 2024-04-26T22:02:41.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.882+0000 7f18fde38640 1 -- 172.21.15.137:0/3977093425 reap_dead start 2024-04-26T22:02:41.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.882+0000 7f18fde38640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18e40051c0 0x7f18e400b9c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009fc0 tx=0x7f18e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764c42dcb8442c79 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.882+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0035020 con 0x7f18e40051c0 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.882+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f0003b90 con 0x7f18e40051c0 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.882+0000 7f18effff640 1 -- 172.21.15.137:0/3977093425 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0009c10 con 0x7f18e40051c0 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.883+0000 7f18ff89b640 1 -- 172.21.15.137:0/3977093425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18e40051c0 msgr2=0x7f18e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.883+0000 7f18ff89b640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18e40051c0 0x7f18e400b9c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009fc0 tx=0x7f18e4005830 comp rx=0 tx=0).stop 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.883+0000 7f18ff89b640 1 -- 172.21.15.137:0/3977093425 shutdown_connections 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.883+0000 7f18ff89b640 1 --2- 172.21.15.137:0/3977093425 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18e40051c0 0x7f18e400b9c0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.883+0000 7f18ff89b640 1 -- 172.21.15.137:0/3977093425 >> 172.21.15.137:0/3977093425 conn(0x7f18f808ec10 msgr2=0x7f18f809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.883+0000 7f18ff89b640 1 -- 172.21.15.137:0/3977093425 shutdown_connections 2024-04-26T22:02:41.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.883+0000 7f18ff89b640 1 -- 172.21.15.137:0/3977093425 wait complete. 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.884+0000 7f18ff89b640 1 Processor -- start 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.884+0000 7f18ff89b640 1 -- start start 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18ff89b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40051c0 0x7f18f815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18ff89b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18f80b9fc0 0x7f18f80ba420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18ff89b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cd060 0x7f18f80cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18ff89b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18f80cfef0 con 0x7f18f80cd060 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18ff89b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f18f80cfd70 con 0x7f18e40051c0 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18ff89b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f18f80d0070 con 0x7f18f80b9fc0 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fde38640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cd060 0x7f18f80cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fde38640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cd060 0x7f18f80cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45958/0 (socket says 172.21.15.137:45958) 2024-04-26T22:02:41.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fde38640 1 -- 172.21.15.137:0/1090139933 learned_addr learned my addr 172.21.15.137:0/1090139933 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:41.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fd637640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40051c0 0x7f18f815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fce36640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18f80b9fc0 0x7f18f80ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fde38640 1 -- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18f80b9fc0 msgr2=0x7f18f80ba420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fde38640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18f80b9fc0 0x7f18f80ba420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fde38640 1 -- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40051c0 msgr2=0x7f18f815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:41.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fde38640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40051c0 0x7f18f815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:41.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fde38640 1 -- 172.21.15.137:0/1090139933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f80cdc70 con 0x7f18f80cd060 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fd637640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40051c0 0x7f18f815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fce36640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18f80b9fc0 0x7f18f80ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18fde38640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cd060 0x7f18f80cd4e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f18f002af10 tx=0x7f18f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.885+0000 7f18edffb640 1 -- 172.21.15.137:0/1090139933 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f003f030 con 0x7f18f80cd060 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.886+0000 7f18edffb640 1 -- 172.21.15.137:0/1090139933 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f0003990 con 0x7f18f80cd060 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.886+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f81f52b0 con 0x7f18f80cd060 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.886+0000 7f18edffb640 1 -- 172.21.15.137:0/1090139933 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0035070 con 0x7f18f80cd060 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.886+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f81f5870 con 0x7f18f80cd060 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.887+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f806a290 con 0x7f18f80cd060 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.887+0000 7f18edffb640 1 -- 172.21.15.137:0/1090139933 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f18f0042030 con 0x7f18f80cd060 2024-04-26T22:02:41.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.887+0000 7f18edffb640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f18dc06c8f0 0x7f18dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:41.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.888+0000 7f18fd637640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f18dc06c8f0 0x7f18dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:41.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.888+0000 7f18edffb640 1 -- 172.21.15.137:0/1090139933 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f18f00ac270 con 0x7f18f80cd060 2024-04-26T22:02:41.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.888+0000 7f18fd637640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f18dc06c8f0 0x7f18dc06edb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f18e8005580 tx=0x7f18e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:41.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:41.892+0000 7f18edffb640 1 -- 172.21.15.137:0/1090139933 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f18f007a0e0 con 0x7f18f80cd060 2024-04-26T22:02:42.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.102+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f18f80ba960 con 0x7f18f80cd060 2024-04-26T22:02:42.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.102+0000 7f18edffb640 1 -- 172.21.15.137:0/1090139933 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) ==== 53+0+73 (secure 0 0 0) 0x7f18f80ba960 con 0x7f18f80cd060 2024-04-26T22:02:42.103 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:02:42.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f18dc06c8f0 msgr2=0x7f18dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f18dc06c8f0 0x7f18dc06edb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f18e8005580 tx=0x7f18e8009040 comp rx=0 tx=0).stop 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cd060 msgr2=0x7f18f80cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cd060 0x7f18f80cd4e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f18f002af10 tx=0x7f18f0009750 comp rx=0 tx=0).stop 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 shutdown_connections 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f18dc06c8f0 0x7f18dc06edb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18f80cd060 0x7f18f80cd4e0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18f80b9fc0 0x7f18f80ba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 --2- 172.21.15.137:0/1090139933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e40051c0 0x7f18f815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 >> 172.21.15.137:0/1090139933 conn(0x7f18f808ec10 msgr2=0x7f18f806df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 shutdown_connections 2024-04-26T22:02:42.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42.104+0000 7f18ff89b640 1 -- 172.21.15.137:0/1090139933 wait complete. 2024-04-26T22:02:42.115 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:02:42.115 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:02:42.115 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:02:42.115 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:02:42.115 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:42.115 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:02:42.116 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:02:42.116 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:02:42.116 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:02:42.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.116 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:02:42.131 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:02:42.131 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:02:42.131 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:02:42.131 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:42.131 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:02:42.131 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42544sec preferred_lft 42544sec 2024-04-26T22:02:42.132 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:02:42.133 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:42.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.134 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:02:42.196 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:02:42.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.198 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:02:42.255 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:02:42.256 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:02:42.256 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:02:42.256 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:02:42.256 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:02:42.256 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:02:42.256 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:02:42.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:02:42.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:02:42.256 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:02:42.257 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:02:42.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:02:42.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:02:42.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.380 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:02:42.395 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:02:42.395 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:02:42.395 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:02:42.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.396 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:02:42.439 INFO:tasks.ceph.mds.c.smithi137.stderr:2024-04-26T22:02:42.438+0000 7fc8af13b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:02:42.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:02:42.460 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:42.515 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:02:42.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:02:42.515 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:42.571 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:02:42.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.571 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:02:42.652 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:02:42.652 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:02:42.659 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:02:42.659 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:02:42.659 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:02:42.659 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:02:42.659 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:02:42.660 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:02:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:02:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:02:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:02:42.660 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:02:42.663 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:02:42.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.663 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:42.727 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:02:42.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:02:42.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:02:42.827 INFO:teuthology.orchestra.run.smithi137.stdout:client6786 2024-04-26T22:02:42.827 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:42.827 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:42.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.843 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-04-26T22:02:42.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.902 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-04-26T22:02:42.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:42.958 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-04-26T22:02:43.014 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:02:43.014 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:02:43.014 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:02:43.014 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:02:43.014 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-26T22:02:43.014 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:02:43.117 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627776 2024-04-26T22:02:43.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:02:43.127 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:43.127 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:43.182 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:43.183 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:43.238 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:43.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.376+0000 7f9db2499640 1 Processor -- start 2024-04-26T22:02:43.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.376+0000 7f9db2499640 1 -- start start 2024-04-26T22:02:43.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9db2499640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac0afe30 0x7f9dac16a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9db2499640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dac0aed90 con 0x7f9dac15f4a0 2024-04-26T22:02:43.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9db2499640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dac0af070 con 0x7f9dac0b47d0 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9db2499640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9dac15f880 con 0x7f9dac0afe30 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9dabfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9dac15f4a0 0x7f9dac0b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48398/0 (socket says 172.21.15.137:48398) 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9dabfff640 1 -- 172.21.15.137:0/1355255405 learned_addr learned my addr 172.21.15.137:0/1355255405 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743971945 0 0) 0x7f9dac0aed90 con 0x7f9dac15f4a0 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d94003520 con 0x7f9dac15f4a0 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9db0a36640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac0afe30 0x7f9dac16a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 945912390 0 0) 0x7f9d94003520 con 0x7f9dac15f4a0 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac0afe30 msgr2=0x7f9dac16a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac0afe30 0x7f9dac16a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 >> v1:172.21.15.170:6789/0 conn(0x7f9dac0b47d0 legacy=0x7f9dac0b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dac0af350 con 0x7f9dac15f4a0 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f9d9c001670 con 0x7f9dac15f4a0 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 >> v1:172.21.15.137:6789/0 conn(0x7f9dac15f4a0 legacy=0x7f9dac0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d940039e0 0x7f9d94003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d94004800 0x7f9d94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac0afe30 0x7f9d940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac15f880 con 0x7f9d940039e0 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9400baa0 con 0x7f9d94004800 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9400bca0 con 0x7f9dac0afe30 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9dabfff640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d940039e0 0x7f9d94003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9dab7fe640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d94004800 0x7f9d94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.377+0000 7f9db0a36640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac0afe30 0x7f9d940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.378+0000 7f9dabfff640 1 -- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac0afe30 msgr2=0x7f9d940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.378+0000 7f9dabfff640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac0afe30 0x7f9d940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.378+0000 7f9dabfff640 1 -- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d94004800 msgr2=0x7f9d94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.378+0000 7f9dabfff640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d94004800 0x7f9d94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.378+0000 7f9dabfff640 1 -- 172.21.15.137:0/1355255405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d94003520 con 0x7f9d940039e0 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.378+0000 7f9dabfff640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d940039e0 0x7f9d94003e00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00c210 tx=0x7f9d94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969ec88c4a884428 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:43.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.378+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c007d10 con 0x7f9d940039e0 2024-04-26T22:02:43.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.378+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9c005ad0 con 0x7f9d940039e0 2024-04-26T22:02:43.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.378+0000 7f9daaffd640 1 -- 172.21.15.137:0/1355255405 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c007070 con 0x7f9d940039e0 2024-04-26T22:02:43.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.379+0000 7f9db2499640 1 -- 172.21.15.137:0/1355255405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d940039e0 msgr2=0x7f9d94003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.379+0000 7f9db2499640 1 --2- 172.21.15.137:0/1355255405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d940039e0 0x7f9d94003e00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00c210 tx=0x7f9d94005830 comp rx=0 tx=0).stop 2024-04-26T22:02:43.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.379+0000 7f9db0a36640 1 -- 172.21.15.137:0/1355255405 reap_dead start 2024-04-26T22:02:43.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.379+0000 7f9db2499640 1 -- 172.21.15.137:0/1355255405 shutdown_connections 2024-04-26T22:02:43.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.379+0000 7f9db2499640 1 -- 172.21.15.137:0/1355255405 >> 172.21.15.137:0/1355255405 conn(0x7f9dac0b6800 msgr2=0x7f9dac0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:43.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.379+0000 7f9db2499640 1 -- 172.21.15.137:0/1355255405 shutdown_connections 2024-04-26T22:02:43.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.379+0000 7f9db2499640 1 -- 172.21.15.137:0/1355255405 wait complete. 2024-04-26T22:02:43.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.380+0000 7f9db2499640 1 Processor -- start 2024-04-26T22:02:43.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.380+0000 7f9db2499640 1 -- start start 2024-04-26T22:02:43.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db2499640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d940039e0 0x7f9dac15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db2499640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac1f56c0 0x7f9dac15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db2499640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac09d560 0x7f9dac09d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db2499640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac0aea80 con 0x7f9dac09d560 2024-04-26T22:02:43.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db2499640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac0af9a0 con 0x7f9d940039e0 2024-04-26T22:02:43.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db2499640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9dac0b6320 con 0x7f9dac1f56c0 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db0a36640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac09d560 0x7f9dac09d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db0a36640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac09d560 0x7f9dac09d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45976/0 (socket says 172.21.15.137:45976) 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db0a36640 1 -- 172.21.15.137:0/557699604 learned_addr learned my addr 172.21.15.137:0/557699604 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9dab7fe640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac1f56c0 0x7f9dac15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9dabfff640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d940039e0 0x7f9dac15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db0a36640 1 -- 172.21.15.137:0/557699604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac1f56c0 msgr2=0x7f9dac15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db0a36640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac1f56c0 0x7f9dac15a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db0a36640 1 -- 172.21.15.137:0/557699604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d940039e0 msgr2=0x7f9dac15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db0a36640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d940039e0 0x7f9dac15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9db0a36640 1 -- 172.21.15.137:0/557699604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dac09df20 con 0x7f9dac09d560 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.381+0000 7f9dabfff640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d940039e0 0x7f9dac15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.382+0000 7f9db0a36640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac09d560 0x7f9dac09d9e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f9da4007d80 tx=0x7f9da40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:43.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.382+0000 7f9da8ff9640 1 -- 172.21.15.137:0/557699604 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4003990 con 0x7f9dac09d560 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.382+0000 7f9da8ff9640 1 -- 172.21.15.137:0/557699604 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da401b070 con 0x7f9dac09d560 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.382+0000 7f9da8ff9640 1 -- 172.21.15.137:0/557699604 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4003b70 con 0x7f9dac09d560 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.382+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dac1f5b40 con 0x7f9dac09d560 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.382+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dac15d9a0 con 0x7f9dac09d560 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.383+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dac06a290 con 0x7f9dac09d560 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.383+0000 7f9da8ff9640 1 -- 172.21.15.137:0/557699604 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9da4005d10 con 0x7f9dac09d560 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.383+0000 7f9da8ff9640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d9806c8f0 0x7f9d9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.384+0000 7f9da8ff9640 1 -- 172.21.15.137:0/557699604 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f9da408be60 con 0x7f9dac09d560 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.384+0000 7f9dabfff640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d9806c8f0 0x7f9d9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.384+0000 7f9dabfff640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d9806c8f0 0x7f9d9806edb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c032000 tx=0x7f9d9c02d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:43.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.388+0000 7f9da8ff9640 1 -- 172.21.15.137:0/557699604 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9dac1f5b40 con 0x7f9dac09d560 2024-04-26T22:02:43.405 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:02:43.407 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:02:43.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.566+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9dac06d4b0 con 0x7f9dac09d560 2024-04-26T22:02:43.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.567+0000 7f9da8ff9640 1 -- 172.21.15.137:0/557699604 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16680 (secure 0 0 0) 0x7f9da405a290 con 0x7f9dac09d560 2024-04-26T22:02:43.567 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:43.568 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":72,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:02:38.169115+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:02:34.722395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T22:02:35.462679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:43.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d9806c8f0 msgr2=0x7f9d9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d9806c8f0 0x7f9d9806edb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c032000 tx=0x7f9d9c02d000 comp rx=0 tx=0).stop 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac09d560 msgr2=0x7f9dac09d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac09d560 0x7f9dac09d9e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f9da4007d80 tx=0x7f9da40115a0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 shutdown_connections 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d9806c8f0 0x7f9d9806edb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9dac09d560 0x7f9dac09d9e0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9dac1f56c0 0x7f9dac15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 --2- 172.21.15.137:0/557699604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d940039e0 0x7f9dac15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 >> 172.21.15.137:0/557699604 conn(0x7f9dac0b6800 msgr2=0x7f9dac160be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 shutdown_connections 2024-04-26T22:02:43.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.569+0000 7f9db2499640 1 -- 172.21.15.137:0/557699604 wait complete. 2024-04-26T22:02:43.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:02:34.722395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:02:35.462679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:02:43.581 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:02:43.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.681+0000 7f3a26a86640 1 Processor -- start 2024-04-26T22:02:43.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.681+0000 7f3a26a86640 1 -- start start 2024-04-26T22:02:43.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.681+0000 7f3a26a86640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a20143840 0x7f3a200b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a26a86640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a200b4520 0x7f3a200b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a26a86640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3a200b53f0 0x7f3a20160e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a26a86640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3a20143c20 con 0x7f3a20143840 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a26a86640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2015dca0 con 0x7f3a200b53f0 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a26a86640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2015df80 con 0x7f3a200b4520 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a24822640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a20143840 0x7f3a200b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a24822640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a20143840 0x7f3a200b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45982/0 (socket says 172.21.15.137:45982) 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a24822640 1 -- 172.21.15.137:0/4242770182 learned_addr learned my addr 172.21.15.137:0/4242770182 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a24822640 1 -- 172.21.15.137:0/4242770182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a200b4520 msgr2=0x7f3a200b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a24822640 1 --2- 172.21.15.137:0/4242770182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a200b4520 0x7f3a200b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a24822640 1 -- 172.21.15.137:0/4242770182 >> v2:172.21.15.170:3300/0 conn(0x7f3a200b53f0 msgr2=0x7f3a20160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a24822640 1 --2- 172.21.15.137:0/4242770182 >> v2:172.21.15.170:3300/0 conn(0x7f3a200b53f0 0x7f3a20160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.682+0000 7f3a24822640 1 -- 172.21.15.137:0/4242770182 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2015e260 con 0x7f3a20143840 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a24822640 1 --2- 172.21.15.137:0/4242770182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20143840 0x7f3a200b3fe0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3a20070480 tx=0x7f3a1802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adaa769a6e20d07 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:43.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a1f7fe640 1 -- 172.21.15.137:0/4242770182 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18036070 con 0x7f3a20143840 2024-04-26T22:02:43.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a1f7fe640 1 -- 172.21.15.137:0/4242770182 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18031600 con 0x7f3a20143840 2024-04-26T22:02:43.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a1f7fe640 1 -- 172.21.15.137:0/4242770182 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a180319d0 con 0x7f3a20143840 2024-04-26T22:02:43.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a26a86640 1 -- 172.21.15.137:0/4242770182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20143840 msgr2=0x7f3a200b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a26a86640 1 --2- 172.21.15.137:0/4242770182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20143840 0x7f3a200b3fe0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3a20070480 tx=0x7f3a1802a6a0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a26a86640 1 -- 172.21.15.137:0/4242770182 shutdown_connections 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a26a86640 1 --2- 172.21.15.137:0/4242770182 >> v2:172.21.15.170:3300/0 conn(0x7f3a200b53f0 0x7f3a20160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a26a86640 1 --2- 172.21.15.137:0/4242770182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a200b4520 0x7f3a200b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a26a86640 1 --2- 172.21.15.137:0/4242770182 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a20143840 0x7f3a200b3fe0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a26a86640 1 -- 172.21.15.137:0/4242770182 >> 172.21.15.137:0/4242770182 conn(0x7f3a200cd8a0 msgr2=0x7f3a200cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a26a86640 1 -- 172.21.15.137:0/4242770182 shutdown_connections 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.683+0000 7f3a26a86640 1 -- 172.21.15.137:0/4242770182 wait complete. 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.684+0000 7f3a26a86640 1 Processor -- start 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.684+0000 7f3a26a86640 1 -- start start 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.685+0000 7f3a26a86640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a200b4520 0x7f3a201f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.685+0000 7f3a26a86640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a200b53f0 0x7f3a20156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.685+0000 7f3a26a86640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a20143840 0x7f3a20139850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.685+0000 7f3a26a86640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2015da40 con 0x7f3a200b4520 2024-04-26T22:02:43.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.685+0000 7f3a26a86640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2015d8c0 con 0x7f3a20143840 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.685+0000 7f3a26a86640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a20161380 con 0x7f3a200b53f0 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.685+0000 7f3a24822640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a200b4520 0x7f3a201f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.685+0000 7f3a24822640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a200b4520 0x7f3a201f2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45994/0 (socket says 172.21.15.137:45994) 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.685+0000 7f3a24822640 1 -- 172.21.15.137:0/957046628 learned_addr learned my addr 172.21.15.137:0/957046628 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a24822640 1 -- 172.21.15.137:0/957046628 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a200b53f0 msgr2=0x7f3a20156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a24822640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a200b53f0 0x7f3a20156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a24822640 1 -- 172.21.15.137:0/957046628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a20143840 msgr2=0x7f3a20139850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a24822640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a20143840 0x7f3a20139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a24822640 1 -- 172.21.15.137:0/957046628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2013e320 con 0x7f3a200b4520 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a24822640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a200b4520 0x7f3a201f2d00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3a180093e0 tx=0x7f3a18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a1d7fa640 1 -- 172.21.15.137:0/957046628 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18041020 con 0x7f3a200b4520 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a1d7fa640 1 -- 172.21.15.137:0/957046628 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18007820 con 0x7f3a200b4520 2024-04-26T22:02:43.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2013e600 con 0x7f3a200b4520 2024-04-26T22:02:43.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a1d7fa640 1 -- 172.21.15.137:0/957046628 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18036040 con 0x7f3a200b4520 2024-04-26T22:02:43.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.686+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2013ebc0 con 0x7f3a200b4520 2024-04-26T22:02:43.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.687+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2006a290 con 0x7f3a200b4520 2024-04-26T22:02:43.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.687+0000 7f3a1d7fa640 1 -- 172.21.15.137:0/957046628 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a18044020 con 0x7f3a200b4520 2024-04-26T22:02:43.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.688+0000 7f3a1d7fa640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a0006c8f0 0x7f3a0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.688+0000 7f3a1d7fa640 1 -- 172.21.15.137:0/957046628 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f3a180ac930 con 0x7f3a200b4520 2024-04-26T22:02:43.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.688+0000 7f3a1ffff640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a0006c8f0 0x7f3a0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.688+0000 7f3a1ffff640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a0006c8f0 0x7f3a0006edb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3a2006fcd0 tx=0x7f3a08006c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:43.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.692+0000 7f3a1d7fa640 1 -- 172.21.15.137:0/957046628 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3a1804b030 con 0x7f3a200b4520 2024-04-26T22:02:43.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.870+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3a2013ef30 con 0x7f3a200b4520 2024-04-26T22:02:43.870 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.870+0000 7f3a1d7fa640 1 -- 172.21.15.137:0/957046628 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7f3a1807adf0 con 0x7f3a200b4520 2024-04-26T22:02:43.870 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:02:43.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a0006c8f0 msgr2=0x7f3a0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a0006c8f0 0x7f3a0006edb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3a2006fcd0 tx=0x7f3a08006c90 comp rx=0 tx=0).stop 2024-04-26T22:02:43.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a200b4520 msgr2=0x7f3a201f2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a200b4520 0x7f3a201f2d00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3a180093e0 tx=0x7f3a18004a40 comp rx=0 tx=0).stop 2024-04-26T22:02:43.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 shutdown_connections 2024-04-26T22:02:43.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a0006c8f0 0x7f3a0006edb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a20143840 0x7f3a20139850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a200b53f0 0x7f3a20156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 --2- 172.21.15.137:0/957046628 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a200b4520 0x7f3a201f2d00 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 >> 172.21.15.137:0/957046628 conn(0x7f3a200cd8a0 msgr2=0x7f3a2015e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:43.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 shutdown_connections 2024-04-26T22:02:43.873 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.872+0000 7f3a26a86640 1 -- 172.21.15.137:0/957046628 wait complete. 2024-04-26T22:02:43.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:02:43.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.982+0000 7f1a3bc3e640 1 Processor -- start 2024-04-26T22:02:43.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.983+0000 7f1a3bc3e640 1 -- start start 2024-04-26T22:02:43.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.983+0000 7f1a3bc3e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 0x7f1a340b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.983+0000 7f1a3bc3e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1a340d0300 0x7f1a3406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.983+0000 7f1a3bc3e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a3406fc60 con 0x7f1a340b3e50 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.983+0000 7f1a3bc3e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1a340b46a0 con 0x7f1a340d0300 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.983+0000 7f1a3bc3e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1a340b5db0 con 0x7f1a3406f340 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.983+0000 7f1a391d9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1a340d0300 0x7f1a3406f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.984+0000 7f1a391d9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1a340d0300 0x7f1a3406f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46008/0 (socket says 172.21.15.137:46008) 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.984+0000 7f1a391d9640 1 -- 172.21.15.137:0/2065249139 learned_addr learned my addr 172.21.15.137:0/2065249139 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.984+0000 7f1a399da640 1 --2- 172.21.15.137:0/2065249139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 0x7f1a340b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.984+0000 7f1a391d9640 1 -- 172.21.15.137:0/2065249139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 msgr2=0x7f1a340b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.984+0000 7f1a391d9640 1 --2- 172.21.15.137:0/2065249139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 0x7f1a340b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.984+0000 7f1a391d9640 1 -- 172.21.15.137:0/2065249139 >> v1:172.21.15.170:6789/0 conn(0x7f1a340b3e50 legacy=0x7f1a340720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.984+0000 7f1a391d9640 1 -- 172.21.15.137:0/2065249139 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a340b6090 con 0x7f1a340d0300 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.984+0000 7f1a399da640 1 --2- 172.21.15.137:0/2065249139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 0x7f1a340b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.984+0000 7f1a391d9640 1 --2- 172.21.15.137:0/2065249139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340d0300 0x7f1a3406f720 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009870 tx=0x7f1a2402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b3910d412351b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:43.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a389d8640 1 -- 172.21.15.137:0/2065249139 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24037070 con 0x7f1a340d0300 2024-04-26T22:02:43.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a389d8640 1 -- 172.21.15.137:0/2065249139 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a24032440 con 0x7f1a340d0300 2024-04-26T22:02:43.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a389d8640 1 -- 172.21.15.137:0/2065249139 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24032810 con 0x7f1a340d0300 2024-04-26T22:02:43.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/2065249139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340d0300 msgr2=0x7f1a3406f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a3bc3e640 1 --2- 172.21.15.137:0/2065249139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340d0300 0x7f1a3406f720 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009870 tx=0x7f1a2402a130 comp rx=0 tx=0).stop 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/2065249139 shutdown_connections 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a3bc3e640 1 --2- 172.21.15.137:0/2065249139 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340d0300 0x7f1a3406f720 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a3bc3e640 1 --2- 172.21.15.137:0/2065249139 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 0x7f1a340b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/2065249139 >> 172.21.15.137:0/2065249139 conn(0x7f1a340cd8a0 msgr2=0x7f1a340cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/2065249139 shutdown_connections 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.985+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/2065249139 wait complete. 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.986+0000 7f1a3bc3e640 1 Processor -- start 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a3bc3e640 1 -- start start 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a3bc3e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 0x7f1a3413d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a3bc3e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340b3e50 0x7f1a341e5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a3bc3e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a340d0300 0x7f1a3415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a3bc3e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1a340b42e0 con 0x7f1a340b3e50 2024-04-26T22:02:43.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a3bc3e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1a340b6650 con 0x7f1a340d0300 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a3bc3e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1a340b4460 con 0x7f1a3406f340 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a391d9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340b3e50 0x7f1a341e5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a391d9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340b3e50 0x7f1a341e5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46012/0 (socket says 172.21.15.137:46012) 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.987+0000 7f1a391d9640 1 -- 172.21.15.137:0/1236734370 learned_addr learned my addr 172.21.15.137:0/1236734370 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a399da640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 0x7f1a3413d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a391d9640 1 -- 172.21.15.137:0/1236734370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 msgr2=0x7f1a3413d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a3a1db640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a340d0300 0x7f1a3415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a391d9640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 0x7f1a3413d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a391d9640 1 -- 172.21.15.137:0/1236734370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a340d0300 msgr2=0x7f1a3415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a391d9640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a340d0300 0x7f1a3415eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a391d9640 1 -- 172.21.15.137:0/1236734370 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3413d690 con 0x7f1a340b3e50 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a3a1db640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a340d0300 0x7f1a3415eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:43.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a391d9640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340b3e50 0x7f1a341e5230 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1a240097c0 tx=0x7f1a240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:43.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a2a7fc640 1 -- 172.21.15.137:0/1236734370 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24037040 con 0x7f1a340b3e50 2024-04-26T22:02:43.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a2a7fc640 1 -- 172.21.15.137:0/1236734370 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a24042070 con 0x7f1a340b3e50 2024-04-26T22:02:43.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a341f4800 con 0x7f1a340b3e50 2024-04-26T22:02:43.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a2a7fc640 1 -- 172.21.15.137:0/1236734370 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24030900 con 0x7f1a340b3e50 2024-04-26T22:02:43.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.988+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a341f4dc0 con 0x7f1a340b3e50 2024-04-26T22:02:43.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.989+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3406a290 con 0x7f1a340b3e50 2024-04-26T22:02:43.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.989+0000 7f1a2a7fc640 1 -- 172.21.15.137:0/1236734370 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a24030aa0 con 0x7f1a340b3e50 2024-04-26T22:02:43.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.990+0000 7f1a2a7fc640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a1806c920 0x7f1a1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:43.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.990+0000 7f1a2a7fc640 1 -- 172.21.15.137:0/1236734370 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f1a240ac460 con 0x7f1a340b3e50 2024-04-26T22:02:43.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.990+0000 7f1a399da640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a1806c920 0x7f1a1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:43.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.990+0000 7f1a399da640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a1806c920 0x7f1a1806ede0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1a30006fd0 tx=0x7f1a30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:43.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:43.994+0000 7f1a2a7fc640 1 -- 172.21.15.137:0/1236734370 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1a2407a890 con 0x7f1a340b3e50 2024-04-26T22:02:44.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.172+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1a341f5530 con 0x7f1a340b3e50 2024-04-26T22:02:44.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.172+0000 7f1a2a7fc640 1 -- 172.21.15.137:0/1236734370 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) ==== 104+0+11 (secure 0 0 0) 0x7f1a2407a190 con 0x7f1a340b3e50 2024-04-26T22:02:44.172 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:02:44.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a1806c920 msgr2=0x7f1a1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a1806c920 0x7f1a1806ede0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1a30006fd0 tx=0x7f1a30008040 comp rx=0 tx=0).stop 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340b3e50 msgr2=0x7f1a341e5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340b3e50 0x7f1a341e5230 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1a240097c0 tx=0x7f1a240046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 shutdown_connections 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1a1806c920 0x7f1a1806ede0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1a340b3e50 0x7f1a341e5230 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1a340d0300 0x7f1a3415eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 --2- 172.21.15.137:0/1236734370 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1a3406f340 0x7f1a3413d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 >> 172.21.15.137:0/1236734370 conn(0x7f1a340cd8a0 msgr2=0x7f1a34140100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 shutdown_connections 2024-04-26T22:02:44.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.174+0000 7f1a3bc3e640 1 -- 172.21.15.137:0/1236734370 wait complete. 2024-04-26T22:02:44.185 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:02:44.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.285+0000 7f464031b640 1 Processor -- start 2024-04-26T22:02:44.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.285+0000 7f464031b640 1 -- start start 2024-04-26T22:02:44.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f464031b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f46380b4eb0 0x7f46380b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f464031b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f46380ceff0 0x7f46380cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f464031b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f463815dca0 con 0x7f4638143840 2024-04-26T22:02:44.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f464031b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4638143c20 con 0x7f46380b4eb0 2024-04-26T22:02:44.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f464031b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f463815df80 con 0x7f46380ceff0 2024-04-26T22:02:44.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f463d8b6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f46380b4eb0 0x7f46380b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:44.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f463d8b6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f46380b4eb0 0x7f46380b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46022/0 (socket says 172.21.15.137:46022) 2024-04-26T22:02:44.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f463d8b6640 1 -- 172.21.15.137:0/2321525860 learned_addr learned my addr 172.21.15.137:0/2321525860 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:44.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f463d8b6640 1 -- 172.21.15.137:0/2321525860 >> v2:172.21.15.170:3300/0 conn(0x7f46380ceff0 msgr2=0x7f46380cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:44.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f463d8b6640 1 --2- 172.21.15.137:0/2321525860 >> v2:172.21.15.170:3300/0 conn(0x7f46380ceff0 0x7f46380cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f463d8b6640 1 -- 172.21.15.137:0/2321525860 >> v1:172.21.15.170:6789/0 conn(0x7f4638143840 legacy=0x7f46380b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:44.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.286+0000 7f463d8b6640 1 -- 172.21.15.137:0/2321525860 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463815e260 con 0x7f46380b4eb0 2024-04-26T22:02:44.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f463d8b6640 1 --2- 172.21.15.137:0/2321525860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46380b4eb0 0x7f46380b5330 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f46380b70e0 tx=0x7f462802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f99ac5f45a3215c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:44.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f463d0b5640 1 -- 172.21.15.137:0/2321525860 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628037070 con 0x7f46380b4eb0 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f463d0b5640 1 -- 172.21.15.137:0/2321525860 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4628032440 con 0x7f46380b4eb0 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f463d0b5640 1 -- 172.21.15.137:0/2321525860 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4628032810 con 0x7f46380b4eb0 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f464031b640 1 -- 172.21.15.137:0/2321525860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46380b4eb0 msgr2=0x7f46380b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f464031b640 1 --2- 172.21.15.137:0/2321525860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46380b4eb0 0x7f46380b5330 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f46380b70e0 tx=0x7f462802a230 comp rx=0 tx=0).stop 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f464031b640 1 -- 172.21.15.137:0/2321525860 shutdown_connections 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f464031b640 1 --2- 172.21.15.137:0/2321525860 >> v2:172.21.15.170:3300/0 conn(0x7f46380ceff0 0x7f46380cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f464031b640 1 --2- 172.21.15.137:0/2321525860 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f46380b4eb0 0x7f46380b5330 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.287+0000 7f464031b640 1 -- 172.21.15.137:0/2321525860 >> 172.21.15.137:0/2321525860 conn(0x7f46380cd8a0 msgr2=0x7f46380cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.288+0000 7f464031b640 1 -- 172.21.15.137:0/2321525860 shutdown_connections 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.288+0000 7f464031b640 1 -- 172.21.15.137:0/2321525860 wait complete. 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f464031b640 1 Processor -- start 2024-04-26T22:02:44.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f464031b640 1 -- start start 2024-04-26T22:02:44.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f464031b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46380b4eb0 0x7f46381428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f464031b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46380ceff0 0x7f4638145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f464031b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4638143840 0x7f46381e8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f464031b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f463815d8c0 con 0x7f4638143840 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f464031b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f46380b46f0 con 0x7f46380b4eb0 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f464031b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f463815da40 con 0x7f46380ceff0 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f463e8b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4638143840 0x7f46381e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f463e8b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4638143840 0x7f46381e8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46024/0 (socket says 172.21.15.137:46024) 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.289+0000 7f463e8b8640 1 -- 172.21.15.137:0/1753435222 learned_addr learned my addr 172.21.15.137:0/1753435222 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f463d8b6640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46380ceff0 0x7f4638145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f463e0b7640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46380b4eb0 0x7f46381428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f463e8b8640 1 -- 172.21.15.137:0/1753435222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46380ceff0 msgr2=0x7f4638145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f463e8b8640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46380ceff0 0x7f4638145870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f463e8b8640 1 -- 172.21.15.137:0/1753435222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46380b4eb0 msgr2=0x7f46381428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f463e8b8640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46380b4eb0 0x7f46381428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f463e8b8640 1 -- 172.21.15.137:0/1753435222 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4638142e00 con 0x7f4638143840 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f463d8b6640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46380ceff0 0x7f4638145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f463e8b8640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4638143840 0x7f46381e8950 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f463000b970 tx=0x7f463000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f462effd640 1 -- 172.21.15.137:0/1753435222 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630019070 con 0x7f4638143840 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f462effd640 1 -- 172.21.15.137:0/1753435222 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f463000cb60 con 0x7f4638143840 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46381442d0 con 0x7f4638143840 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f462effd640 1 -- 172.21.15.137:0/1753435222 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4630014440 con 0x7f4638143840 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.290+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4638144890 con 0x7f4638143840 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.291+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f463806a290 con 0x7f4638143840 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.291+0000 7f462effd640 1 -- 172.21.15.137:0/1753435222 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f463001c070 con 0x7f4638143840 2024-04-26T22:02:44.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.292+0000 7f462effd640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f461c06c8f0 0x7f461c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.292+0000 7f463e0b7640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f461c06c8f0 0x7f461c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:44.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.292+0000 7f462effd640 1 -- 172.21.15.137:0/1753435222 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f463008b890 con 0x7f4638143840 2024-04-26T22:02:44.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.292+0000 7f463e0b7640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f461c06c8f0 0x7f461c06edb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4634006fd0 tx=0x7f4634008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:44.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.296+0000 7f462effd640 1 -- 172.21.15.137:0/1753435222 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4630059cc0 con 0x7f4638143840 2024-04-26T22:02:44.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.469+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f46380ce420 con 0x7f4638143840 2024-04-26T22:02:44.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.470+0000 7f462effd640 1 -- 172.21.15.137:0/1753435222 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) ==== 100+0+11 (secure 0 0 0) 0x7f46300595c0 con 0x7f4638143840 2024-04-26T22:02:44.470 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:02:44.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f461c06c8f0 msgr2=0x7f461c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f461c06c8f0 0x7f461c06edb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4634006fd0 tx=0x7f4634008040 comp rx=0 tx=0).stop 2024-04-26T22:02:44.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4638143840 msgr2=0x7f46381e8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4638143840 0x7f46381e8950 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f463000b970 tx=0x7f463000be30 comp rx=0 tx=0).stop 2024-04-26T22:02:44.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 shutdown_connections 2024-04-26T22:02:44.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f461c06c8f0 0x7f461c06edb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4638143840 0x7f46381e8950 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f46380ceff0 0x7f4638145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 --2- 172.21.15.137:0/1753435222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46380b4eb0 0x7f46381428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 >> 172.21.15.137:0/1753435222 conn(0x7f46380cd8a0 msgr2=0x7f46380cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:44.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 shutdown_connections 2024-04-26T22:02:44.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.472+0000 7f464031b640 1 -- 172.21.15.137:0/1753435222 wait complete. 2024-04-26T22:02:44.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:02:44.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.580+0000 7f83c3e25640 1 Processor -- start 2024-04-26T22:02:44.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.580+0000 7f83c3e25640 1 -- start start 2024-04-26T22:02:44.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.581+0000 7f83c3e25640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83bc0b61a0 0x7f83bc160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.581+0000 7f83c3e25640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f83bc0b3de0 0x7f83bc0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.581+0000 7f83c3e25640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83bc0b4270 con 0x7f83bc145980 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.581+0000 7f83c3e25640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f83bc0b5140 con 0x7f83bc0b61a0 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.581+0000 7f83c3e25640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f83bc0b4530 con 0x7f83bc0b3de0 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.581+0000 7f83c13c0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f83bc0b61a0 0x7f83bc160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.581+0000 7f83c1bc1640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f83bc145980 0x7f83bc0b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48410/0 (socket says 172.21.15.137:48410) 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.581+0000 7f83c1bc1640 1 -- 172.21.15.137:0/2537564130 learned_addr learned my addr 172.21.15.137:0/2537564130 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.581+0000 7f83c23c2640 1 --2- 172.21.15.137:0/2537564130 >> v2:172.21.15.170:3300/0 conn(0x7f83bc0b3de0 0x7f83bc0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.582+0000 7f83c13c0640 1 -- 172.21.15.137:0/2537564130 >> v2:172.21.15.170:3300/0 conn(0x7f83bc0b3de0 msgr2=0x7f83bc0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.582+0000 7f83c13c0640 1 --2- 172.21.15.137:0/2537564130 >> v2:172.21.15.170:3300/0 conn(0x7f83bc0b3de0 0x7f83bc0720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.582+0000 7f83c13c0640 1 -- 172.21.15.137:0/2537564130 >> v1:172.21.15.137:6789/0 conn(0x7f83bc145980 legacy=0x7f83bc0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.582+0000 7f83c13c0640 1 -- 172.21.15.137:0/2537564130 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc0b4810 con 0x7f83bc0b61a0 2024-04-26T22:02:44.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.582+0000 7f83c0bbf640 1 -- 172.21.15.137:0/2537564130 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3361471580 0 0) 0x7f83bc0b4270 con 0x7f83bc145980 2024-04-26T22:02:44.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.582+0000 7f83c13c0640 1 --2- 172.21.15.137:0/2537564130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 0x7f83bc160630 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0b52c0 tx=0x7f83ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ea051082405221 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:44.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.582+0000 7f83c0bbf640 1 -- 172.21.15.137:0/2537564130 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac037070 con 0x7f83bc0b61a0 2024-04-26T22:02:44.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.582+0000 7f83c0bbf640 1 -- 172.21.15.137:0/2537564130 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ac032440 con 0x7f83bc0b61a0 2024-04-26T22:02:44.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.582+0000 7f83c0bbf640 1 -- 172.21.15.137:0/2537564130 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac02ae60 con 0x7f83bc0b61a0 2024-04-26T22:02:44.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.583+0000 7f83c3e25640 1 -- 172.21.15.137:0/2537564130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 msgr2=0x7f83bc160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.583+0000 7f83c3e25640 1 --2- 172.21.15.137:0/2537564130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 0x7f83bc160630 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0b52c0 tx=0x7f83ac02a110 comp rx=0 tx=0).stop 2024-04-26T22:02:44.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.583+0000 7f83c3e25640 1 -- 172.21.15.137:0/2537564130 shutdown_connections 2024-04-26T22:02:44.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.583+0000 7f83c3e25640 1 --2- 172.21.15.137:0/2537564130 >> v2:172.21.15.170:3300/0 conn(0x7f83bc0b3de0 0x7f83bc0720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.583+0000 7f83c3e25640 1 --2- 172.21.15.137:0/2537564130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 0x7f83bc160630 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.583+0000 7f83c3e25640 1 -- 172.21.15.137:0/2537564130 >> 172.21.15.137:0/2537564130 conn(0x7f83bc0d0d30 msgr2=0x7f83bc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:44.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.583+0000 7f83c3e25640 1 -- 172.21.15.137:0/2537564130 shutdown_connections 2024-04-26T22:02:44.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.583+0000 7f83c3e25640 1 -- 172.21.15.137:0/2537564130 wait complete. 2024-04-26T22:02:44.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.584+0000 7f83c3e25640 1 Processor -- start 2024-04-26T22:02:44.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.584+0000 7f83c3e25640 1 -- start start 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c3e25640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83bc0b3de0 0x7f83bc1f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c3e25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 0x7f83bc13e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c3e25640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83bc145980 0x7f83bc13fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c3e25640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc072610 con 0x7f83bc0b61a0 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c3e25640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f83bc0b4dd0 con 0x7f83bc145980 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c3e25640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f83bc072790 con 0x7f83bc0b3de0 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c13c0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 0x7f83bc13e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c13c0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 0x7f83bc13e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46036/0 (socket says 172.21.15.137:46036) 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c13c0640 1 -- 172.21.15.137:0/1562403098 learned_addr learned my addr 172.21.15.137:0/1562403098 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c13c0640 1 -- 172.21.15.137:0/1562403098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83bc0b3de0 msgr2=0x7f83bc1f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c13c0640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83bc0b3de0 0x7f83bc1f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c13c0640 1 -- 172.21.15.137:0/1562403098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83bc145980 msgr2=0x7f83bc13fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c13c0640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83bc145980 0x7f83bc13fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c13c0640 1 -- 172.21.15.137:0/1562403098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83bc13ec30 con 0x7f83bc0b61a0 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.585+0000 7f83c13c0640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 0x7f83bc13e6f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000c00 tx=0x7f83ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.586+0000 7f83b27fc640 1 -- 172.21.15.137:0/1562403098 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac037040 con 0x7f83bc0b61a0 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.586+0000 7f83b27fc640 1 -- 172.21.15.137:0/1562403098 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ac042070 con 0x7f83bc0b61a0 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.586+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83bc15bcf0 con 0x7f83bc0b61a0 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.586+0000 7f83b27fc640 1 -- 172.21.15.137:0/1562403098 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac030bd0 con 0x7f83bc0b61a0 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.586+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83bc0b1f50 con 0x7f83bc0b61a0 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.587+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83bc06a290 con 0x7f83bc0b61a0 2024-04-26T22:02:44.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.587+0000 7f83b27fc640 1 -- 172.21.15.137:0/1562403098 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f83ac047460 con 0x7f83bc0b61a0 2024-04-26T22:02:44.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.588+0000 7f83b27fc640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f83a006c8f0 0x7f83a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:44.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.588+0000 7f83c1bc1640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f83a006c8f0 0x7f83a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:44.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.588+0000 7f83b27fc640 1 -- 172.21.15.137:0/1562403098 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f83ac0ac720 con 0x7f83bc0b61a0 2024-04-26T22:02:44.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.588+0000 7f83c1bc1640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f83a006c8f0 0x7f83a006edb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f83b8007fd0 tx=0x7f83b8007ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:44.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.592+0000 7f83b27fc640 1 -- 172.21.15.137:0/1562403098 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f83bc13ec30 con 0x7f83bc0b61a0 2024-04-26T22:02:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.781+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f83bc073cc0 con 0x7f83bc0b61a0 2024-04-26T22:02:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.781+0000 7f83b27fc640 1 -- 172.21.15.137:0/1562403098 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v72) ==== 80+0+0 (secure 0 0 0) 0x7f83ac032e20 con 0x7f83bc0b61a0 2024-04-26T22:02:44.781 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T22:02:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f83a006c8f0 msgr2=0x7f83a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f83a006c8f0 0x7f83a006edb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f83b8007fd0 tx=0x7f83b8007ce0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 msgr2=0x7f83bc13e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 0x7f83bc13e6f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000c00 tx=0x7f83ac0046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 shutdown_connections 2024-04-26T22:02:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f83a006c8f0 0x7f83a006edb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83bc0b61a0 0x7f83bc13e6f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83bc145980 0x7f83bc13fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 --2- 172.21.15.137:0/1562403098 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83bc0b3de0 0x7f83bc1f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:44.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 >> 172.21.15.137:0/1562403098 conn(0x7f83bc0d0d30 msgr2=0x7f83bc15d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:44.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 shutdown_connections 2024-04-26T22:02:44.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:44.783+0000 7f83c3e25640 1 -- 172.21.15.137:0/1562403098 wait complete. 2024-04-26T22:02:44.794 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:02:44.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:44.794 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:44.837 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:02:44.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:44.837 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:02:44.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.029+0000 7fa25647b640 1 Processor -- start 2024-04-26T22:02:45.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.029+0000 7fa25647b640 1 -- start start 2024-04-26T22:02:45.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.029+0000 7fa25647b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa2500b61a0 0x7fa250160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.029+0000 7fa25647b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa2500b3de0 0x7fa2500720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.029+0000 7fa25647b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2500b4270 con 0x7fa250145980 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.029+0000 7fa25647b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa2500b5140 con 0x7fa2500b61a0 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.029+0000 7fa25647b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa2500b4530 con 0x7fa2500b3de0 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.030+0000 7fa24f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa2500b61a0 0x7fa250160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.030+0000 7fa24ffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa250145980 0x7fa2500b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48426/0 (socket says 172.21.15.137:48426) 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.030+0000 7fa24ffff640 1 -- 172.21.15.137:0/355906067 learned_addr learned my addr 172.21.15.137:0/355906067 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.030+0000 7fa254a18640 1 --2- 172.21.15.137:0/355906067 >> v2:172.21.15.170:3300/0 conn(0x7fa2500b3de0 0x7fa2500720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.030+0000 7fa24f7fe640 1 -- 172.21.15.137:0/355906067 >> v2:172.21.15.170:3300/0 conn(0x7fa2500b3de0 msgr2=0x7fa2500720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.030+0000 7fa24f7fe640 1 --2- 172.21.15.137:0/355906067 >> v2:172.21.15.170:3300/0 conn(0x7fa2500b3de0 0x7fa2500720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.030+0000 7fa24f7fe640 1 -- 172.21.15.137:0/355906067 >> v1:172.21.15.137:6789/0 conn(0x7fa250145980 legacy=0x7fa2500b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.030+0000 7fa24f7fe640 1 -- 172.21.15.137:0/355906067 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2500b4810 con 0x7fa2500b61a0 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.030+0000 7fa24effd640 1 -- 172.21.15.137:0/355906067 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296397572 0 0) 0x7fa2500b4270 con 0x7fa250145980 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa24f7fe640 1 --2- 172.21.15.137:0/355906067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 0x7fa250160630 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa2500b52c0 tx=0x7fa24402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d15a27f7a6896d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa24effd640 1 -- 172.21.15.137:0/355906067 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244037070 con 0x7fa2500b61a0 2024-04-26T22:02:45.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa24effd640 1 -- 172.21.15.137:0/355906067 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa244032440 con 0x7fa2500b61a0 2024-04-26T22:02:45.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa24effd640 1 -- 172.21.15.137:0/355906067 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24402ae60 con 0x7fa2500b61a0 2024-04-26T22:02:45.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa25647b640 1 -- 172.21.15.137:0/355906067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 msgr2=0x7fa250160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa25647b640 1 --2- 172.21.15.137:0/355906067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 0x7fa250160630 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa2500b52c0 tx=0x7fa24402a110 comp rx=0 tx=0).stop 2024-04-26T22:02:45.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa25647b640 1 -- 172.21.15.137:0/355906067 shutdown_connections 2024-04-26T22:02:45.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa25647b640 1 --2- 172.21.15.137:0/355906067 >> v2:172.21.15.170:3300/0 conn(0x7fa2500b3de0 0x7fa2500720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa25647b640 1 --2- 172.21.15.137:0/355906067 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 0x7fa250160630 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa25647b640 1 -- 172.21.15.137:0/355906067 >> 172.21.15.137:0/355906067 conn(0x7fa2500d0d30 msgr2=0x7fa2500d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa25647b640 1 -- 172.21.15.137:0/355906067 shutdown_connections 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.031+0000 7fa25647b640 1 -- 172.21.15.137:0/355906067 wait complete. 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.032+0000 7fa25647b640 1 Processor -- start 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa25647b640 1 -- start start 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa25647b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2500b3de0 0x7fa2501f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa25647b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 0x7fa2500d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa25647b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa250145980 0x7fa2500b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa25647b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa250072610 con 0x7fa2500b61a0 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa25647b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa2500b4dd0 con 0x7fa2500b3de0 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa25647b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa250072790 con 0x7fa250145980 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa24f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 0x7fa2500d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa24f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 0x7fa2500d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46054/0 (socket says 172.21.15.137:46054) 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.033+0000 7fa24f7fe640 1 -- 172.21.15.137:0/3969038498 learned_addr learned my addr 172.21.15.137:0/3969038498 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:45.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24ffff640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2500b3de0 0x7fa2501f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24f7fe640 1 -- 172.21.15.137:0/3969038498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa250145980 msgr2=0x7fa2500b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24f7fe640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa250145980 0x7fa2500b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24f7fe640 1 -- 172.21.15.137:0/3969038498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2500b3de0 msgr2=0x7fa2501f8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24f7fe640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2500b3de0 0x7fa2501f8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24f7fe640 1 -- 172.21.15.137:0/3969038498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2501f8ad0 con 0x7fa2500b61a0 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24f7fe640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 0x7fa2500d01f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa244000c00 tx=0x7fa2440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24cff9640 1 -- 172.21.15.137:0/3969038498 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244037040 con 0x7fa2500b61a0 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24cff9640 1 -- 172.21.15.137:0/3969038498 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa244042070 con 0x7fa2500b61a0 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2501f8db0 con 0x7fa2500b61a0 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa24cff9640 1 -- 172.21.15.137:0/3969038498 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244030bd0 con 0x7fa2500b61a0 2024-04-26T22:02:45.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.034+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2500ce550 con 0x7fa2500b61a0 2024-04-26T22:02:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.035+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25006a290 con 0x7fa2500b61a0 2024-04-26T22:02:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.035+0000 7fa24cff9640 1 -- 172.21.15.137:0/3969038498 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa244047460 con 0x7fa2500b61a0 2024-04-26T22:02:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.036+0000 7fa24cff9640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa23c06c8f0 0x7fa23c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.036+0000 7fa24cff9640 1 -- 172.21.15.137:0/3969038498 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7fa2440ac720 con 0x7fa2500b61a0 2024-04-26T22:02:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.036+0000 7fa24ffff640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa23c06c8f0 0x7fa23c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.036+0000 7fa24ffff640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa23c06c8f0 0x7fa23c06edb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa240000f60 tx=0x7fa240009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.040+0000 7fa24cff9640 1 -- 172.21.15.137:0/3969038498 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa244032e20 con 0x7fa2500b61a0 2024-04-26T22:02:45.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.257+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa250073cc0 con 0x7fa2500b61a0 2024-04-26T22:02:45.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.258+0000 7fa24cff9640 1 -- 172.21.15.137:0/3969038498 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5195 (secure 0 0 0) 0x7fa24407ab50 con 0x7fa2500b61a0 2024-04-26T22:02:45.258 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:45.258 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":34,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:02:38.507657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6612},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6612":{"gid":6612,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.137:6837/1566574554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1566574554},{"type":"v1","addr":"172.21.15.137:6837","nonce":1566574554}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6612,"qdb_cluster":[6612]},"id":5}]} 2024-04-26T22:02:45.259 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 34 2024-04-26T22:02:45.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa23c06c8f0 msgr2=0x7fa23c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa23c06c8f0 0x7fa23c06edb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa240000f60 tx=0x7fa240009040 comp rx=0 tx=0).stop 2024-04-26T22:02:45.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 msgr2=0x7fa2500d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 0x7fa2500d01f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa244000c00 tx=0x7fa2440046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 shutdown_connections 2024-04-26T22:02:45.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa23c06c8f0 0x7fa23c06edb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2500b61a0 0x7fa2500d01f0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa250145980 0x7fa2500b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 --2- 172.21.15.137:0/3969038498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2500b3de0 0x7fa2501f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 >> 172.21.15.137:0/3969038498 conn(0x7fa2500d0d30 msgr2=0x7fa2500ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:45.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 shutdown_connections 2024-04-26T22:02:45.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.260+0000 7fa25647b640 1 -- 172.21.15.137:0/3969038498 wait complete. 2024-04-26T22:02:45.271 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-26T22:02:45.394 INFO:teuthology.orchestra.run.smithi137.stdout:{"message":"","return_code":0} 2024-04-26T22:02:45.395 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T22:02:45.395 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:02:45.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.492+0000 7f31751e7640 1 Processor -- start 2024-04-26T22:02:45.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.492+0000 7f31751e7640 1 -- start start 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.493+0000 7f31751e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f317006e490 0x7f317015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.493+0000 7f31751e7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31700d1740 con 0x7f31700d11b0 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.493+0000 7f31751e7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31700d1a20 con 0x7f31700cf2e0 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.493+0000 7f31751e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f31700d1d00 con 0x7f317006e490 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.493+0000 7f316e59c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f31700d11b0 0x7f317006dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48436/0 (socket says 172.21.15.137:48436) 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.493+0000 7f316e59c640 1 -- 172.21.15.137:0/548592513 learned_addr learned my addr 172.21.15.137:0/548592513 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.493+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700641066 0 0) 0x7f31700d1740 con 0x7f31700d11b0 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.493+0000 7f316f59e640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f317006e490 0x7f317015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.493+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3158003520 con 0x7f31700d11b0 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2446625936 0 0) 0x7f3158003520 con 0x7f31700d11b0 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f317006e490 msgr2=0x7f317015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:45.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f317006e490 0x7f317015ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 >> v1:172.21.15.170:6789/0 conn(0x7f31700cf2e0 legacy=0x7f317006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31700d1fe0 con 0x7f31700d11b0 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f3164001670 con 0x7f31700d11b0 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 >> v1:172.21.15.137:6789/0 conn(0x7f31700d11b0 legacy=0x7f317006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f317006e490 0x7f31580039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3158003f60 0x7f3158004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3158004d40 0x7f31580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31700d1d00 con 0x7f3158004d40 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f315800baa0 con 0x7f3158003f60 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f315800bca0 con 0x7f317006e490 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316f59e640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3158004d40 0x7f31580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316ed9d640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f317006e490 0x7f31580039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316e59c640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3158003f60 0x7f3158004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316f59e640 1 -- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f317006e490 msgr2=0x7f31580039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316f59e640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f317006e490 0x7f31580039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316f59e640 1 -- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3158003f60 msgr2=0x7f3158004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316f59e640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3158003f60 0x7f3158004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.494+0000 7f316f59e640 1 -- 172.21.15.137:0/548592513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3158003520 con 0x7f3158004d40 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.495+0000 7f316f59e640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3158004d40 0x7f31580051c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f317006e8a0 tx=0x7f3158005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8c669d231c183e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.495+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168036070 con 0x7f3158004d40 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.495+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3168031400 con 0x7f3158004d40 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.495+0000 7f316dd9b640 1 -- 172.21.15.137:0/548592513 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168009690 con 0x7f3158004d40 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.496+0000 7f31751e7640 1 -- 172.21.15.137:0/548592513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3158004d40 msgr2=0x7f31580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.496+0000 7f31751e7640 1 --2- 172.21.15.137:0/548592513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3158004d40 0x7f31580051c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f317006e8a0 tx=0x7f3158005830 comp rx=0 tx=0).stop 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.496+0000 7f316f59e640 1 -- 172.21.15.137:0/548592513 reap_dead start 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.496+0000 7f31751e7640 1 -- 172.21.15.137:0/548592513 shutdown_connections 2024-04-26T22:02:45.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.496+0000 7f31751e7640 1 -- 172.21.15.137:0/548592513 >> 172.21.15.137:0/548592513 conn(0x7f31700b4a60 msgr2=0x7f31700b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:45.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.496+0000 7f31751e7640 1 -- 172.21.15.137:0/548592513 shutdown_connections 2024-04-26T22:02:45.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.496+0000 7f31751e7640 1 -- 172.21.15.137:0/548592513 wait complete. 2024-04-26T22:02:45.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.497+0000 7f31751e7640 1 Processor -- start 2024-04-26T22:02:45.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.497+0000 7f31751e7640 1 -- start start 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f31751e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170153410 0x7f31701f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f31751e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31700715e0 0x7f3170071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f31751e7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31701f5550 0x7f31701f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f31751e7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31700cf840 con 0x7f31701f5550 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f31751e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f31700cf6c0 con 0x7f31700715e0 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f31751e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f31700ce660 con 0x7f3170153410 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316f59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31701f5550 0x7f31701f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316f59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31701f5550 0x7f31701f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:46068/0 (socket says 172.21.15.137:46068) 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316f59e640 1 -- 172.21.15.137:0/59994931 learned_addr learned my addr 172.21.15.137:0/59994931 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316e59c640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31700715e0 0x7f3170071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316ed9d640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170153410 0x7f31701f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316f59e640 1 -- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170153410 msgr2=0x7f31701f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316f59e640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170153410 0x7f31701f96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316f59e640 1 -- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31700715e0 msgr2=0x7f3170071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316f59e640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31700715e0 0x7f3170071a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316f59e640 1 -- 172.21.15.137:0/59994931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31701f6130 con 0x7f31701f5550 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316e59c640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31700715e0 0x7f3170071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316ed9d640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170153410 0x7f31701f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.498+0000 7f316f59e640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31701f5550 0x7f31701f59d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f316802ab10 tx=0x7f3168004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.499+0000 7f31577fe640 1 -- 172.21.15.137:0/59994931 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168036040 con 0x7f31701f5550 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.499+0000 7f31577fe640 1 -- 172.21.15.137:0/59994931 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316803b460 con 0x7f31701f5550 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.499+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31701f8bc0 con 0x7f31701f5550 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.499+0000 7f31577fe640 1 -- 172.21.15.137:0/59994931 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168009690 con 0x7f31701f5550 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.499+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31701f9180 con 0x7f31701f5550 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.500+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3170071fa0 con 0x7f31701f5550 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.500+0000 7f31577fe640 1 -- 172.21.15.137:0/59994931 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3168044070 con 0x7f31701f5550 2024-04-26T22:02:45.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.500+0000 7f31577fe640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f315c06c920 0x7f315c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.500+0000 7f31577fe640 1 -- 172.21.15.137:0/59994931 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5709+0+0 (secure 0 0 0) 0x7f31680ab5f0 con 0x7f31701f5550 2024-04-26T22:02:45.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.500+0000 7f316ed9d640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f315c06c920 0x7f315c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.501+0000 7f316ed9d640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f315c06c920 0x7f315c06ede0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3170069780 tx=0x7f3160009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.505+0000 7f31577fe640 1 -- 172.21.15.137:0/59994931 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3168079a20 con 0x7f31701f5550 2024-04-26T22:02:45.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.719+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f317006a290 con 0x7f31701f5550 2024-04-26T22:02:45.719 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:02:45.720+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:02:45.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.721+0000 7f31577fe640 1 -- 172.21.15.137:0/59994931 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f3168079320 con 0x7f31701f5550 2024-04-26T22:02:45.721 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f315c06c920 msgr2=0x7f315c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f315c06c920 0x7f315c06ede0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3170069780 tx=0x7f3160009040 comp rx=0 tx=0).stop 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31701f5550 msgr2=0x7f31701f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31701f5550 0x7f31701f59d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f316802ab10 tx=0x7f3168004730 comp rx=0 tx=0).stop 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 shutdown_connections 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f315c06c920 0x7f315c06ede0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31701f5550 0x7f31701f59d0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31700715e0 0x7f3170071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 --2- 172.21.15.137:0/59994931 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3170153410 0x7f31701f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 >> 172.21.15.137:0/59994931 conn(0x7f31700b4a60 msgr2=0x7f31700b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:45.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 shutdown_connections 2024-04-26T22:02:45.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.724+0000 7f31751e7640 1 -- 172.21.15.137:0/59994931 wait complete. 2024-04-26T22:02:45.726 INFO:tasks.ceph.mds.c.smithi137.stderr: -4467> 2024-04-26T22:02:42.438+0000 7fc8af13b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:02:45.735 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-26T22:02:45.755 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:02:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.779+0000 7f1fd5b01f40 1 Processor -- start 2024-04-26T22:02:45.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.779+0000 7f1fd5b01f40 1 -- start start 2024-04-26T22:02:45.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.779+0000 7f1fd5b01f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c914271550 0x55c9142b8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.779+0000 7f1fd5b01f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9142a1f10 0x55c914273810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.779+0000 7f1fd5b01f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c91434aae0 0x55c9142a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.779+0000 7f1fd5b01f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c914274690 con 0x55c91434aae0 2024-04-26T22:02:45.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.779+0000 7f1fd5b01f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c91421ae40 con 0x55c9142a1f10 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.779+0000 7f1fd5b01f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c914272060 con 0x55c914271550 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.779+0000 7f1fd3dfe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c91434aae0 0x55c9142a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd3dfe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c91434aae0 0x55c9142a1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50460/0 (socket says 172.21.15.137:50460) 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd3dfe640 1 -- 172.21.15.137:0/1236794406 learned_addr learned my addr 172.21.15.137:0/1236794406 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd2dfc640 1 --2- 172.21.15.137:0/1236794406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9142a1f10 0x55c914273810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd35fd640 1 --2- 172.21.15.137:0/1236794406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c914271550 0x55c9142b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd3dfe640 1 -- 172.21.15.137:0/1236794406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c914271550 msgr2=0x55c9142b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd3dfe640 1 --2- 172.21.15.137:0/1236794406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c914271550 0x55c9142b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd3dfe640 1 -- 172.21.15.137:0/1236794406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9142a1f10 msgr2=0x55c914273810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd3dfe640 1 --2- 172.21.15.137:0/1236794406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9142a1f10 0x55c914273810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd3dfe640 1 -- 172.21.15.137:0/1236794406 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9143dd8e0 con 0x55c91434aae0 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd3dfe640 1 --2- 172.21.15.137:0/1236794406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c91434aae0 0x55c9142a1300 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc002630 tx=0x7f1fcc002af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979d4b96d12885b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd1dfa640 1 -- 172.21.15.137:0/1236794406 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc016070 con 0x55c91434aae0 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd1dfa640 1 -- 172.21.15.137:0/1236794406 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc00d6b0 con 0x55c91434aae0 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.780+0000 7f1fd1dfa640 1 -- 172.21.15.137:0/1236794406 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00daa0 con 0x55c91434aae0 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/1236794406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c91434aae0 msgr2=0x55c9142a1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 --2- 172.21.15.137:0/1236794406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c91434aae0 0x55c9142a1300 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc002630 tx=0x7f1fcc002af0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/1236794406 shutdown_connections 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 --2- 172.21.15.137:0/1236794406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c91434aae0 0x55c9142a1300 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 --2- 172.21.15.137:0/1236794406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9142a1f10 0x55c914273810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 --2- 172.21.15.137:0/1236794406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c914271550 0x55c9142b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/1236794406 >> 172.21.15.137:0/1236794406 conn(0x55c914272660 msgr2=0x55c9142b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/1236794406 shutdown_connections 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/1236794406 wait complete. 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 Processor -- start 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.781+0000 7f1fd5b01f40 1 -- start start 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd5b01f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c914271550 0x55c9142bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd5b01f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9142a1f10 0x55c9142a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd5b01f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c91434aae0 0x55c914346c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd5b01f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c91429f210 con 0x55c9142a1f10 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd5b01f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c914271cb0 con 0x55c91434aae0 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd5b01f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c9143dd600 con 0x55c914271550 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd2dfc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9142a1f10 0x55c9142a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd2dfc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9142a1f10 0x55c9142a12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50472/0 (socket says 172.21.15.137:50472) 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd2dfc640 1 -- 172.21.15.137:0/4035206420 learned_addr learned my addr 172.21.15.137:0/4035206420 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd3dfe640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c91434aae0 0x55c914346c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd35fd640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c914271550 0x55c9142bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd2dfc640 1 -- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c914271550 msgr2=0x55c9142bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd2dfc640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c914271550 0x55c9142bcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd2dfc640 1 -- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c91434aae0 msgr2=0x55c914346c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd2dfc640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c91434aae0 0x55c914346c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd2dfc640 1 -- 172.21.15.137:0/4035206420 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9143495c0 con 0x55c9142a1f10 2024-04-26T22:02:45.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd3dfe640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c91434aae0 0x55c914346c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:45.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.782+0000 7f1fd2dfc640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9142a1f10 0x55c9142a12e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8008400 tx=0x7f1fc80084f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.783+0000 7f1fd0df8640 1 -- 172.21.15.137:0/4035206420 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8015660 con 0x55c9142a1f10 2024-04-26T22:02:45.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.783+0000 7f1fd0df8640 1 -- 172.21.15.137:0/4035206420 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc801a070 con 0x55c9142a1f10 2024-04-26T22:02:45.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.783+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c914345310 con 0x55c9142a1f10 2024-04-26T22:02:45.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.783+0000 7f1fd0df8640 1 -- 172.21.15.137:0/4035206420 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8015a00 con 0x55c9142a1f10 2024-04-26T22:02:45.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.783+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9143498a0 con 0x55c9142a1f10 2024-04-26T22:02:45.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.784+0000 7f1fd0df8640 1 -- 172.21.15.137:0/4035206420 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fc8013030 con 0x55c9142a1f10 2024-04-26T22:02:45.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.784+0000 7f1fd0df8640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1fc006b2d0 0x7f1fc006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.784+0000 7f1fd0df8640 1 -- 172.21.15.137:0/4035206420 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f1fc808a950 con 0x55c9142a1f10 2024-04-26T22:02:45.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.784+0000 7f1fd35fd640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1fc006b2d0 0x7f1fc006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.785+0000 7f1fd5b01f40 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9142b7dd0 0x55c9143476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.785+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73) -- 0x55c9142a1820 con 0x55c9142b7dd0 2024-04-26T22:02:45.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.785+0000 7f1fd35fd640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1fc006b2d0 0x7f1fc006d790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4057000 tx=0x7f1fc4052000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.785+0000 7f1fd3dfe640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9142b7dd0 0x55c9143476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.785+0000 7f1fd3dfe640 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9142b7dd0 0x55c9143476d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd3dfe640 1 -- 172.21.15.137:0/4035206420 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v73'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1fcc004030 con 0x55c9142b7dd0 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9142b7dd0 msgr2=0x55c9143476d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9142b7dd0 0x55c9143476d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1fc006b2d0 msgr2=0x7f1fc006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1fc006b2d0 0x7f1fc006d790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4057000 tx=0x7f1fc4052000 comp rx=0 tx=0).stop 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9142a1f10 msgr2=0x55c9142a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 --2- 172.21.15.137:0/4035206420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9142a1f10 0x55c9142a12e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8008400 tx=0x7f1fc80084f0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd3dfe640 1 -- 172.21.15.137:0/4035206420 reap_dead start 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 shutdown_connections 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 >> 172.21.15.137:0/4035206420 conn(0x55c914272660 msgr2=0x55c91434dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:45.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 shutdown_connections 2024-04-26T22:02:45.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.789+0000 7f1fd5b01f40 1 -- 172.21.15.137:0/4035206420 wait complete. 2024-04-26T22:02:45.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-26T22:02:45.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.933+0000 7f628f740640 1 Processor -- start 2024-04-26T22:02:45.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.934+0000 7f628f740640 1 -- start start 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.934+0000 7f628f740640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f628815f260 0x7f628806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.934+0000 7f628f740640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6288070560 0x7f62880b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.934+0000 7f628f740640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628815f640 con 0x7f628806ebe0 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.934+0000 7f628f740640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f628806c2a0 con 0x7f6288070560 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.934+0000 7f628f740640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f628806c580 con 0x7f628815f260 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f628ccdb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6288070560 0x7f62880b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f628dcdd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f628806ebe0 0x7f62880ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48582/0 (socket says 172.21.15.137:48582) 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f628ccdb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6288070560 0x7f62880b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50474/0 (socket says 172.21.15.137:50474) 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f628dcdd640 1 -- 172.21.15.137:0/40404971 learned_addr learned my addr 172.21.15.137:0/40404971 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f628ccdb640 1 -- 172.21.15.137:0/40404971 >> v2:172.21.15.170:3300/0 conn(0x7f628815f260 msgr2=0x7f628806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:45.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f628ccdb640 1 --2- 172.21.15.137:0/40404971 >> v2:172.21.15.170:3300/0 conn(0x7f628815f260 0x7f628806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f628ccdb640 1 -- 172.21.15.137:0/40404971 >> v1:172.21.15.137:6789/0 conn(0x7f628806ebe0 legacy=0x7f62880ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f627ffff640 1 -- 172.21.15.137:0/40404971 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190834573 0 0) 0x7f628815f640 con 0x7f628806ebe0 2024-04-26T22:02:45.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f628ccdb640 1 -- 172.21.15.137:0/40404971 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628806c860 con 0x7f6288070560 2024-04-26T22:02:45.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.935+0000 7f628ccdb640 1 --2- 172.21.15.137:0/40404971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 0x7f62880b46f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6288068a40 tx=0x7f627802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc7cdd986188dfd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f627ffff640 1 -- 172.21.15.137:0/40404971 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278037070 con 0x7f6288070560 2024-04-26T22:02:45.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f627ffff640 1 -- 172.21.15.137:0/40404971 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6278032440 con 0x7f6288070560 2024-04-26T22:02:45.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f627ffff640 1 -- 172.21.15.137:0/40404971 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627802ae60 con 0x7f6288070560 2024-04-26T22:02:45.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f628f740640 1 -- 172.21.15.137:0/40404971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 msgr2=0x7f62880b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f628f740640 1 --2- 172.21.15.137:0/40404971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 0x7f62880b46f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6288068a40 tx=0x7f627802a110 comp rx=0 tx=0).stop 2024-04-26T22:02:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f628f740640 1 -- 172.21.15.137:0/40404971 shutdown_connections 2024-04-26T22:02:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f628f740640 1 --2- 172.21.15.137:0/40404971 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 0x7f62880b46f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f628f740640 1 --2- 172.21.15.137:0/40404971 >> v2:172.21.15.170:3300/0 conn(0x7f628815f260 0x7f628806d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f628f740640 1 -- 172.21.15.137:0/40404971 >> 172.21.15.137:0/40404971 conn(0x7f62880d1660 msgr2=0x7f62880d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f628f740640 1 -- 172.21.15.137:0/40404971 shutdown_connections 2024-04-26T22:02:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.936+0000 7f628f740640 1 -- 172.21.15.137:0/40404971 wait complete. 2024-04-26T22:02:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.937+0000 7f628f740640 1 Processor -- start 2024-04-26T22:02:45.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.937+0000 7f628f740640 1 -- start start 2024-04-26T22:02:45.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628f740640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628806ebe0 0x7f6288153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628f740640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 0x7f628815f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628f740640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628815f260 0x7f62881549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628f740640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f628806d100 con 0x7f6288070560 2024-04-26T22:02:45.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628f740640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f628806ce20 con 0x7f628806ebe0 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628f740640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f628806db60 con 0x7f628815f260 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628ccdb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 0x7f628815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628ccdb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 0x7f628815f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50476/0 (socket says 172.21.15.137:50476) 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628ccdb640 1 -- 172.21.15.137:0/757437599 learned_addr learned my addr 172.21.15.137:0/757437599 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628dcdd640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628815f260 0x7f62881549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628ccdb640 1 -- 172.21.15.137:0/757437599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628815f260 msgr2=0x7f62881549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628ccdb640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628815f260 0x7f62881549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628d4dc640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628806ebe0 0x7f6288153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.938+0000 7f628ccdb640 1 -- 172.21.15.137:0/757437599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628806ebe0 msgr2=0x7f6288153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.939+0000 7f628ccdb640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628806ebe0 0x7f6288153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.939+0000 7f628ccdb640 1 -- 172.21.15.137:0/757437599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6288153870 con 0x7f6288070560 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.939+0000 7f628ccdb640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 0x7f628815f640 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6278035040 tx=0x7f62780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.939+0000 7f627dffb640 1 -- 172.21.15.137:0/757437599 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278037040 con 0x7f6288070560 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.939+0000 7f627dffb640 1 -- 172.21.15.137:0/757437599 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6278004230 con 0x7f6288070560 2024-04-26T22:02:45.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.939+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62880ce320 con 0x7f6288070560 2024-04-26T22:02:45.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.939+0000 7f627dffb640 1 -- 172.21.15.137:0/757437599 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278032e20 con 0x7f6288070560 2024-04-26T22:02:45.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.939+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62880ce8e0 con 0x7f6288070560 2024-04-26T22:02:45.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.940+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62880b5e00 con 0x7f6288070560 2024-04-26T22:02:45.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.940+0000 7f627dffb640 1 -- 172.21.15.137:0/757437599 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6278030770 con 0x7f6288070560 2024-04-26T22:02:45.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.941+0000 7f627dffb640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626c06c8f0 0x7f626c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:45.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.941+0000 7f627dffb640 1 -- 172.21.15.137:0/757437599 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f62780ace60 con 0x7f6288070560 2024-04-26T22:02:45.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.941+0000 7f628d4dc640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626c06c8f0 0x7f626c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:45.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.941+0000 7f628d4dc640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626c06c8f0 0x7f626c06edb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f62880b27a0 tx=0x7f6280007310 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:45.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:45.945+0000 7f627dffb640 1 -- 172.21.15.137:0/757437599 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f62880b5e00 con 0x7f6288070560 2024-04-26T22:02:46.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.161+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f628806a290 con 0x7f6288070560 2024-04-26T22:02:46.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.382+0000 7f627dffb640 1 -- 172.21.15.137:0/757437599 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v36) ==== 162+0+0 (secure 0 0 0) 0x7f627807b230 con 0x7f6288070560 2024-04-26T22:02:46.382 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-26T22:02:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626c06c8f0 msgr2=0x7f626c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626c06c8f0 0x7f626c06edb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f62880b27a0 tx=0x7f6280007310 comp rx=0 tx=0).stop 2024-04-26T22:02:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 msgr2=0x7f628815f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 0x7f628815f640 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6278035040 tx=0x7f62780046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 shutdown_connections 2024-04-26T22:02:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f626c06c8f0 0x7f626c06edb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6288070560 0x7f628815f640 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f628815f260 0x7f62881549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 --2- 172.21.15.137:0/757437599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f628806ebe0 0x7f6288153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 >> 172.21.15.137:0/757437599 conn(0x7f62880d1660 msgr2=0x7f62880afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 shutdown_connections 2024-04-26T22:02:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.385+0000 7f628f740640 1 -- 172.21.15.137:0/757437599 wait complete. 2024-04-26T22:02:46.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:46.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.494+0000 7f263fbda640 1 Processor -- start 2024-04-26T22:02:46.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.494+0000 7f263fbda640 1 -- start start 2024-04-26T22:02:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263fbda640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f26380b47d0 0x7f26380b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263fbda640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f26380afe30 0x7f26380b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263fbda640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26380aed90 con 0x7f263815f4a0 2024-04-26T22:02:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263fbda640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f263815f880 con 0x7f26380afe30 2024-04-26T22:02:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263fbda640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f26380af9a0 con 0x7f26380b47d0 2024-04-26T22:02:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263e177640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f26380afe30 0x7f26380b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263e177640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f26380afe30 0x7f26380b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50492/0 (socket says 172.21.15.137:50492) 2024-04-26T22:02:46.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263e177640 1 -- 172.21.15.137:0/3008605249 learned_addr learned my addr 172.21.15.137:0/3008605249 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:46.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263d175640 1 --2- 172.21.15.137:0/3008605249 >> v2:172.21.15.170:3300/0 conn(0x7f26380b47d0 0x7f26380b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:46.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263e177640 1 -- 172.21.15.137:0/3008605249 >> v2:172.21.15.170:3300/0 conn(0x7f26380b47d0 msgr2=0x7f26380b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:46.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263e177640 1 --2- 172.21.15.137:0/3008605249 >> v2:172.21.15.170:3300/0 conn(0x7f26380b47d0 0x7f26380b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263e177640 1 -- 172.21.15.137:0/3008605249 >> v1:172.21.15.170:6789/0 conn(0x7f263815f4a0 legacy=0x7f26380b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:46.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.495+0000 7f263e177640 1 -- 172.21.15.137:0/3008605249 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26380af070 con 0x7f26380afe30 2024-04-26T22:02:46.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263e177640 1 --2- 172.21.15.137:0/3008605249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 0x7f26380b09b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f2638070c10 tx=0x7f263002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9e26719f63cfe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:46.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263c974640 1 -- 172.21.15.137:0/3008605249 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630036070 con 0x7f26380afe30 2024-04-26T22:02:46.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263c974640 1 -- 172.21.15.137:0/3008605249 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2630031600 con 0x7f26380afe30 2024-04-26T22:02:46.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263c974640 1 -- 172.21.15.137:0/3008605249 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26300319d0 con 0x7f26380afe30 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263fbda640 1 -- 172.21.15.137:0/3008605249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 msgr2=0x7f26380b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263fbda640 1 --2- 172.21.15.137:0/3008605249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 0x7f26380b09b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f2638070c10 tx=0x7f263002a6f0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263fbda640 1 -- 172.21.15.137:0/3008605249 shutdown_connections 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263fbda640 1 --2- 172.21.15.137:0/3008605249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 0x7f26380b09b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263fbda640 1 --2- 172.21.15.137:0/3008605249 >> v2:172.21.15.170:3300/0 conn(0x7f26380b47d0 0x7f26380b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.496+0000 7f263fbda640 1 -- 172.21.15.137:0/3008605249 >> 172.21.15.137:0/3008605249 conn(0x7f26380b6800 msgr2=0x7f26380738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.497+0000 7f263fbda640 1 -- 172.21.15.137:0/3008605249 shutdown_connections 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.497+0000 7f263fbda640 1 -- 172.21.15.137:0/3008605249 wait complete. 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263fbda640 1 Processor -- start 2024-04-26T22:02:46.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263fbda640 1 -- start start 2024-04-26T22:02:46.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263fbda640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 0x7f26381e9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:46.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263fbda640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26380b47d0 0x7f2638161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:46.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263fbda640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263815f4a0 0x7f2638162060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:46.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263fbda640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26380aea80 con 0x7f26380afe30 2024-04-26T22:02:46.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263fbda640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f26380af630 con 0x7f263815f4a0 2024-04-26T22:02:46.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263fbda640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f26380b6320 con 0x7f26380b47d0 2024-04-26T22:02:46.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263d976640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 0x7f26381e9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.498+0000 7f263d976640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 0x7f26381e9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50494/0 (socket says 172.21.15.137:50494) 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263d976640 1 -- 172.21.15.137:0/524224030 learned_addr learned my addr 172.21.15.137:0/524224030 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263e177640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263815f4a0 0x7f2638162060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263d175640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26380b47d0 0x7f2638161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263d976640 1 -- 172.21.15.137:0/524224030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26380b47d0 msgr2=0x7f2638161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263d976640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26380b47d0 0x7f2638161b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263d976640 1 -- 172.21.15.137:0/524224030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263815f4a0 msgr2=0x7f2638162060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263d976640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263815f4a0 0x7f2638162060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263d976640 1 -- 172.21.15.137:0/524224030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2638154a20 con 0x7f26380afe30 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263d976640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 0x7f26381e9150 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f263400b3f0 tx=0x7f263400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f262e7fc640 1 -- 172.21.15.137:0/524224030 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634015020 con 0x7f26380afe30 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f262e7fc640 1 -- 172.21.15.137:0/524224030 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2634011830 con 0x7f26380afe30 2024-04-26T22:02:46.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2638154460 con 0x7f26380afe30 2024-04-26T22:02:46.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f262e7fc640 1 -- 172.21.15.137:0/524224030 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2634011c20 con 0x7f26380afe30 2024-04-26T22:02:46.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.499+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2638161600 con 0x7f26380afe30 2024-04-26T22:02:46.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.500+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263806a290 con 0x7f26380afe30 2024-04-26T22:02:46.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.500+0000 7f262e7fc640 1 -- 172.21.15.137:0/524224030 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2634018020 con 0x7f26380afe30 2024-04-26T22:02:46.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.501+0000 7f262e7fc640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f261c06c8f0 0x7f261c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:46.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.501+0000 7f263d175640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f261c06c8f0 0x7f261c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:46.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.501+0000 7f262e7fc640 1 -- 172.21.15.137:0/524224030 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f263408b750 con 0x7f26380afe30 2024-04-26T22:02:46.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.501+0000 7f263d175640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f261c06c8f0 0x7f261c06edb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f26380d1920 tx=0x7f2628008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:46.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.506+0000 7f262e7fc640 1 -- 172.21.15.137:0/524224030 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f263401f030 con 0x7f26380afe30 2024-04-26T22:02:46.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.716+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26380b5570 con 0x7f26380afe30 2024-04-26T22:02:46.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.717+0000 7f262e7fc640 1 -- 172.21.15.137:0/524224030 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5189 (secure 0 0 0) 0x7f2638154a20 con 0x7f26380afe30 2024-04-26T22:02:46.717 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:46.717 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":36,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:02:46.380247+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"c","rank":0,"incarnation":36,"state":"up:replay","state_seq":1,"addr":"172.21.15.137:6837/2422385986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2422385986},{"type":"v1","addr":"172.21.15.137:6837","nonce":2422385986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-04-26T22:02:46.717 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 36 2024-04-26T22:02:46.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f261c06c8f0 msgr2=0x7f261c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:46.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f261c06c8f0 0x7f261c06edb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f26380d1920 tx=0x7f2628008040 comp rx=0 tx=0).stop 2024-04-26T22:02:46.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 msgr2=0x7f26381e9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:46.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 0x7f26381e9150 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f263400b3f0 tx=0x7f263400b8b0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 shutdown_connections 2024-04-26T22:02:46.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f261c06c8f0 0x7f261c06edb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f263815f4a0 0x7f2638162060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26380b47d0 0x7f2638161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 --2- 172.21.15.137:0/524224030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26380afe30 0x7f26381e9150 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:46.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 >> 172.21.15.137:0/524224030 conn(0x7f26380b6800 msgr2=0x7f263806e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:46.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 shutdown_connections 2024-04-26T22:02:46.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:46.719+0000 7f263fbda640 1 -- 172.21.15.137:0/524224030 wait complete. 2024-04-26T22:02:47.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:02:36.507203+0000', 'modified': '2024-04-26T22:02:46.380247+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6843}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6843': {'gid': 6843, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.137:6837/2422385986', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 2422385986}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 2422385986}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:02:47.132 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6843:up:replay 2024-04-26T22:02:48.134 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:48.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.242+0000 7fded71f0640 1 Processor -- start 2024-04-26T22:02:48.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.243+0000 7fded71f0640 1 -- start start 2024-04-26T22:02:48.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.243+0000 7fded71f0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fded015f370 0x7fded00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:48.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.243+0000 7fded71f0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fded015f750 0x7fded00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:48.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.243+0000 7fded71f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00d37d0 0x7fded00d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:48.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.243+0000 7fded71f0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fded00b4d10 con 0x7fded015f370 2024-04-26T22:02:48.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.243+0000 7fded71f0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fded00d4160 con 0x7fded015f750 2024-04-26T22:02:48.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.243+0000 7fded71f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fded00d03a0 con 0x7fded00d37d0 2024-04-26T22:02:48.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.243+0000 7fded4f8c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fded015f370 0x7fded00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:48.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fded4f8c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fded015f370 0x7fded00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50496/0 (socket says 172.21.15.137:50496) 2024-04-26T22:02:48.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fded4f8c640 1 -- 172.21.15.137:0/832343863 learned_addr learned my addr 172.21.15.137:0/832343863 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:48.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fdecffff640 1 --2- 172.21.15.137:0/832343863 >> v2:172.21.15.170:3300/0 conn(0x7fded015f750 0x7fded00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fded578d640 1 --2- 172.21.15.137:0/832343863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00d37d0 0x7fded00d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fded4f8c640 1 -- 172.21.15.137:0/832343863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00d37d0 msgr2=0x7fded00d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fded4f8c640 1 --2- 172.21.15.137:0/832343863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00d37d0 0x7fded00d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fded4f8c640 1 -- 172.21.15.137:0/832343863 >> v2:172.21.15.170:3300/0 conn(0x7fded015f750 msgr2=0x7fded00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fded4f8c640 1 --2- 172.21.15.137:0/832343863 >> v2:172.21.15.170:3300/0 conn(0x7fded015f750 0x7fded00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fded4f8c640 1 -- 172.21.15.137:0/832343863 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded00d0680 con 0x7fded015f370 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fdecffff640 1 --2- 172.21.15.137:0/832343863 >> v2:172.21.15.170:3300/0 conn(0x7fded015f750 0x7fded00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.244+0000 7fded578d640 1 --2- 172.21.15.137:0/832343863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00d37d0 0x7fded00d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded4f8c640 1 --2- 172.21.15.137:0/832343863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f370 0x7fded00cfd70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fded00d02b0 tx=0x7fdeb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21289092d7b56728 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fdecf7fe640 1 -- 172.21.15.137:0/832343863 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8037070 con 0x7fded015f370 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fdecf7fe640 1 -- 172.21.15.137:0/832343863 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeb8032440 con 0x7fded015f370 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fdecf7fe640 1 -- 172.21.15.137:0/832343863 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8032810 con 0x7fded015f370 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded71f0640 1 -- 172.21.15.137:0/832343863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f370 msgr2=0x7fded00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded71f0640 1 --2- 172.21.15.137:0/832343863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f370 0x7fded00cfd70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fded00d02b0 tx=0x7fdeb802a1e0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded71f0640 1 -- 172.21.15.137:0/832343863 shutdown_connections 2024-04-26T22:02:48.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded71f0640 1 --2- 172.21.15.137:0/832343863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00d37d0 0x7fded00d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded71f0640 1 --2- 172.21.15.137:0/832343863 >> v2:172.21.15.170:3300/0 conn(0x7fded015f750 0x7fded00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded71f0640 1 --2- 172.21.15.137:0/832343863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f370 0x7fded00cfd70 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded71f0640 1 -- 172.21.15.137:0/832343863 >> 172.21.15.137:0/832343863 conn(0x7fded008ec10 msgr2=0x7fded009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:48.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded71f0640 1 -- 172.21.15.137:0/832343863 shutdown_connections 2024-04-26T22:02:48.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.245+0000 7fded71f0640 1 -- 172.21.15.137:0/832343863 wait complete. 2024-04-26T22:02:48.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.247+0000 7fded71f0640 1 Processor -- start 2024-04-26T22:02:48.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.247+0000 7fded71f0640 1 -- start start 2024-04-26T22:02:48.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded71f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded00d37d0 0x7fded00cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded71f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded015f370 0x7fded006cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded71f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f750 0x7fded006d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded71f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fded00d0f20 con 0x7fded015f750 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded71f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fded00d0c40 con 0x7fded00d37d0 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded71f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fded00d1bd0 con 0x7fded015f370 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded578d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f750 0x7fded006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded578d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f750 0x7fded006d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50504/0 (socket says 172.21.15.137:50504) 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded578d640 1 -- 172.21.15.137:0/575446070 learned_addr learned my addr 172.21.15.137:0/575446070 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded4f8c640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded00d37d0 0x7fded00cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fdecffff640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded015f370 0x7fded006cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded578d640 1 -- 172.21.15.137:0/575446070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded015f370 msgr2=0x7fded006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded578d640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded015f370 0x7fded006cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded578d640 1 -- 172.21.15.137:0/575446070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded00d37d0 msgr2=0x7fded00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:48.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded578d640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded00d37d0 0x7fded00cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded578d640 1 -- 172.21.15.137:0/575446070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded0160c30 con 0x7fded015f750 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded4f8c640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded00d37d0 0x7fded00cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded578d640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f750 0x7fded006d470 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fdec800c7f0 tx=0x7fdec800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fdecd7fa640 1 -- 172.21.15.137:0/575446070 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8015070 con 0x7fded015f750 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fdecd7fa640 1 -- 172.21.15.137:0/575446070 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec80077c0 con 0x7fded015f750 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded0160ed0 con 0x7fded015f750 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fdecd7fa640 1 -- 172.21.15.137:0/575446070 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8007bb0 con 0x7fded015f750 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.248+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded0161490 con 0x7fded015f750 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.249+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded006a290 con 0x7fded015f750 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.250+0000 7fdecd7fa640 1 -- 172.21.15.137:0/575446070 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdec8018070 con 0x7fded015f750 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.250+0000 7fdecd7fa640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdeb006c8f0 0x7fdeb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.251+0000 7fded4f8c640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdeb006c8f0 0x7fdeb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.251+0000 7fdecd7fa640 1 -- 172.21.15.137:0/575446070 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7fdec808bc60 con 0x7fded015f750 2024-04-26T22:02:48.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.251+0000 7fded4f8c640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdeb006c8f0 0x7fdeb006edb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8034000 tx=0x7fdeb802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:48.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.255+0000 7fdecd7fa640 1 -- 172.21.15.137:0/575446070 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdec805a0f0 con 0x7fded015f750 2024-04-26T22:02:48.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.466+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fded00d1330 con 0x7fded015f750 2024-04-26T22:02:48.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.466+0000 7fdecd7fa640 1 -- 172.21.15.137:0/575446070 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5189 (secure 0 0 0) 0x7fdec80599f0 con 0x7fded015f750 2024-04-26T22:02:48.467 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:48.467 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":38,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:02:47.390731+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"c","rank":0,"incarnation":36,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.137:6837/2422385986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2422385986},{"type":"v1","addr":"172.21.15.137:6837","nonce":2422385986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-04-26T22:02:48.467 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 38 2024-04-26T22:02:48.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.468+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdeb006c8f0 msgr2=0x7fdeb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:48.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.468+0000 7fded71f0640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdeb006c8f0 0x7fdeb006edb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8034000 tx=0x7fdeb802e000 comp rx=0 tx=0).stop 2024-04-26T22:02:48.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.468+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f750 msgr2=0x7fded006d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:48.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.468+0000 7fded71f0640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f750 0x7fded006d470 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fdec800c7f0 tx=0x7fdec800ccb0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.468+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 shutdown_connections 2024-04-26T22:02:48.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.468+0000 7fded71f0640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdeb006c8f0 0x7fdeb006edb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.468+0000 7fded71f0640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded015f750 0x7fded006d470 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.468+0000 7fded71f0640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded015f370 0x7fded006cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.468+0000 7fded71f0640 1 --2- 172.21.15.137:0/575446070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded00d37d0 0x7fded00cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:48.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.469+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 >> 172.21.15.137:0/575446070 conn(0x7fded008ec10 msgr2=0x7fded015e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:48.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.469+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 shutdown_connections 2024-04-26T22:02:48.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:48.469+0000 7fded71f0640 1 -- 172.21.15.137:0/575446070 wait complete. 2024-04-26T22:02:48.882 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:02:36.507203+0000', 'modified': '2024-04-26T22:02:47.390731+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6843}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6843': {'gid': 6843, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.137:6837/2422385986', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 2422385986}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 2422385986}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:02:48.882 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6843:up:rejoin 2024-04-26T22:02:49.883 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:02:49.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.993+0000 7f61b561d640 1 Processor -- start 2024-04-26T22:02:49.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.993+0000 7f61b561d640 1 -- start start 2024-04-26T22:02:49.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.994+0000 7f61b561d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b00d3ee0 0x7f61b00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:49.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.994+0000 7f61b561d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f61b015f750 0x7f61b00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:49.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.994+0000 7f61b561d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b00d03a0 con 0x7f61b015f370 2024-04-26T22:02:49.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.994+0000 7f61b561d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f61b00b4d10 con 0x7f61b015f750 2024-04-26T22:02:49.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.994+0000 7f61b561d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f61b00d0680 con 0x7f61b00d3ee0 2024-04-26T22:02:49.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.994+0000 7f61af7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f61b015f750 0x7f61b00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:49.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.994+0000 7f61ae7fc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b00d3ee0 0x7f61b00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:49.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.994+0000 7f61aeffd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f61b015f370 0x7f61b00d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42550/0 (socket says 172.21.15.137:42550) 2024-04-26T22:02:49.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.994+0000 7f61aeffd640 1 -- 172.21.15.137:0/2992185825 learned_addr learned my addr 172.21.15.137:0/2992185825 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:49.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.995+0000 7f61ae7fc640 1 -- 172.21.15.137:0/2992185825 >> v2:172.21.15.170:3300/0 conn(0x7f61b015f750 msgr2=0x7f61b00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:49.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.995+0000 7f61ae7fc640 1 --2- 172.21.15.137:0/2992185825 >> v2:172.21.15.170:3300/0 conn(0x7f61b015f750 0x7f61b00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:49.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.995+0000 7f61ae7fc640 1 -- 172.21.15.137:0/2992185825 >> v1:172.21.15.170:6789/0 conn(0x7f61b015f370 legacy=0x7f61b00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:49.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.995+0000 7f61ae7fc640 1 -- 172.21.15.137:0/2992185825 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b00d0960 con 0x7f61b00d3ee0 2024-04-26T22:02:49.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.995+0000 7f61af7fe640 1 --2- 172.21.15.137:0/2992185825 >> v2:172.21.15.170:3300/0 conn(0x7f61b015f750 0x7f61b00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:02:49.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.995+0000 7f61ae7fc640 1 --2- 172.21.15.137:0/2992185825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b00d3ee0 0x7f61b00cfd70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f61a40097a0 tx=0x7f61a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90cde811394827fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:49.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.995+0000 7f61adffb640 1 -- 172.21.15.137:0/2992185825 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4037070 con 0x7f61b00d3ee0 2024-04-26T22:02:49.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61adffb640 1 -- 172.21.15.137:0/2992185825 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a4032440 con 0x7f61b00d3ee0 2024-04-26T22:02:49.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61adffb640 1 -- 172.21.15.137:0/2992185825 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4032810 con 0x7f61b00d3ee0 2024-04-26T22:02:49.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61b561d640 1 -- 172.21.15.137:0/2992185825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b00d3ee0 msgr2=0x7f61b00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:49.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61b561d640 1 --2- 172.21.15.137:0/2992185825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b00d3ee0 0x7f61b00cfd70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f61a40097a0 tx=0x7f61a402a180 comp rx=0 tx=0).stop 2024-04-26T22:02:49.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61b561d640 1 -- 172.21.15.137:0/2992185825 shutdown_connections 2024-04-26T22:02:49.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61b561d640 1 --2- 172.21.15.137:0/2992185825 >> v2:172.21.15.170:3300/0 conn(0x7f61b015f750 0x7f61b00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:49.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61b561d640 1 --2- 172.21.15.137:0/2992185825 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b00d3ee0 0x7f61b00cfd70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:49.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61b561d640 1 -- 172.21.15.137:0/2992185825 >> 172.21.15.137:0/2992185825 conn(0x7f61b008ec10 msgr2=0x7f61b009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:49.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61b561d640 1 -- 172.21.15.137:0/2992185825 shutdown_connections 2024-04-26T22:02:49.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.996+0000 7f61b561d640 1 -- 172.21.15.137:0/2992185825 wait complete. 2024-04-26T22:02:49.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.997+0000 7f61b561d640 1 Processor -- start 2024-04-26T22:02:49.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.997+0000 7f61b561d640 1 -- start start 2024-04-26T22:02:50.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61b561d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61b00d3ee0 0x7f61b00cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61b561d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b015f370 0x7f61b01587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61b561d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b015f750 0x7f61b00cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61b561d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f61b00b51c0 con 0x7f61b00d3ee0 2024-04-26T22:02:50.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61b561d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f61b00d0f20 con 0x7f61b015f370 2024-04-26T22:02:50.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61b561d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f61b00b5340 con 0x7f61b015f750 2024-04-26T22:02:50.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61aeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61b00d3ee0 0x7f61b00cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61aeffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61b00d3ee0 0x7f61b00cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50514/0 (socket says 172.21.15.137:50514) 2024-04-26T22:02:50.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61aeffd640 1 -- 172.21.15.137:0/1788648534 learned_addr learned my addr 172.21.15.137:0/1788648534 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:50.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61ae7fc640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b015f370 0x7f61b01587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.998+0000 7f61af7fe640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b015f750 0x7f61b00cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61aeffd640 1 -- 172.21.15.137:0/1788648534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b015f750 msgr2=0x7f61b00cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61aeffd640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b015f750 0x7f61b00cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61aeffd640 1 -- 172.21.15.137:0/1788648534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b015f370 msgr2=0x7f61b01587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61aeffd640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b015f370 0x7f61b01587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61aeffd640 1 -- 172.21.15.137:0/1788648534 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b006deb0 con 0x7f61b00d3ee0 2024-04-26T22:02:50.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61aeffd640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61b00d3ee0 0x7f61b00cdcc0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c400 tx=0x7f61a000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61977fe640 1 -- 172.21.15.137:0/1788648534 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0017070 con 0x7f61b00d3ee0 2024-04-26T22:02:50.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61977fe640 1 -- 172.21.15.137:0/1788648534 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a0005ce0 con 0x7f61b00d3ee0 2024-04-26T22:02:50.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61977fe640 1 -- 172.21.15.137:0/1788648534 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a00072f0 con 0x7f61b00d3ee0 2024-04-26T22:02:50.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b00ce2c0 con 0x7f61b00d3ee0 2024-04-26T22:02:50.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:49.999+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b00ce880 con 0x7f61b00d3ee0 2024-04-26T22:02:50.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.000+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b006a290 con 0x7f61b00d3ee0 2024-04-26T22:02:50.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.000+0000 7f61977fe640 1 -- 172.21.15.137:0/1788648534 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f61a001a070 con 0x7f61b00d3ee0 2024-04-26T22:02:50.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.001+0000 7f61977fe640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f619c06c920 0x7f619c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.001+0000 7f61977fe640 1 -- 172.21.15.137:0/1788648534 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f61a008ada0 con 0x7f61b00d3ee0 2024-04-26T22:02:50.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.001+0000 7f61ae7fc640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f619c06c920 0x7f619c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.001+0000 7f61ae7fc640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f619c06c920 0x7f619c06ede0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f61a4034000 tx=0x7f61a402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.005+0000 7f61977fe640 1 -- 172.21.15.137:0/1788648534 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f61b006deb0 con 0x7f61b00d3ee0 2024-04-26T22:02:50.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.219+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61b006e120 con 0x7f61b00d3ee0 2024-04-26T22:02:50.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.219+0000 7f61977fe640 1 -- 172.21.15.137:0/1788648534 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5196 (secure 0 0 0) 0x7f61a0058bb0 con 0x7f61b00d3ee0 2024-04-26T22:02:50.220 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:50.220 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:02:49.394233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/2422385986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2422385986},{"type":"v1","addr":"172.21.15.137:6837","nonce":2422385986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6843,"qdb_cluster":[6843]},"id":5}]} 2024-04-26T22:02:50.220 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 39 2024-04-26T22:02:50.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f619c06c920 msgr2=0x7f619c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f619c06c920 0x7f619c06ede0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f61a4034000 tx=0x7f61a402e000 comp rx=0 tx=0).stop 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61b00d3ee0 msgr2=0x7f61b00cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61b00d3ee0 0x7f61b00cdcc0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c400 tx=0x7f61a000c800 comp rx=0 tx=0).stop 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 shutdown_connections 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f619c06c920 0x7f619c06ede0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f61b015f750 0x7f61b00cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61b015f370 0x7f61b01587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 --2- 172.21.15.137:0/1788648534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f61b00d3ee0 0x7f61b00cdcc0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 >> 172.21.15.137:0/1788648534 conn(0x7f61b008ec10 msgr2=0x7f61b00d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 shutdown_connections 2024-04-26T22:02:50.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.221+0000 7f61b561d640 1 -- 172.21.15.137:0/1788648534 wait complete. 2024-04-26T22:02:50.635 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:02:36.507203+0000', 'modified': '2024-04-26T22:02:49.394233+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 73, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6843}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6843': {'gid': 6843, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.137:6837/2422385986', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 2422385986}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 2422385986}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6843, 'qdb_cluster': [6843]} 2024-04-26T22:02:50.636 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:02:50.636 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T22:02:50.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.734+0000 7f3127899640 1 Processor -- start 2024-04-26T22:02:50.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.735+0000 7f3127899640 1 -- start start 2024-04-26T22:02:50.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.735+0000 7f3127899640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f31200d3ee0 0x7f31200cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.735+0000 7f3127899640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31200d03a0 con 0x7f312015f370 2024-04-26T22:02:50.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.735+0000 7f3127899640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31200d0680 con 0x7f312015f750 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.735+0000 7f3127899640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f31200d0960 con 0x7f31200d3ee0 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3125635640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f312015f370 0x7f31200d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48588/0 (socket says 172.21.15.137:48588) 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3125635640 1 -- 172.21.15.137:0/3638464162 learned_addr learned my addr 172.21.15.137:0/3638464162 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3124e34640 1 --2- 172.21.15.137:0/3638464162 >> v2:172.21.15.170:3300/0 conn(0x7f31200d3ee0 0x7f31200cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283970176 0 0) 0x7f31200d03a0 con 0x7f312015f370 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f310c003520 con 0x7f312015f370 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2070324860 0 0) 0x7f310c003520 con 0x7f312015f370 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 >> v2:172.21.15.170:3300/0 conn(0x7f31200d3ee0 msgr2=0x7f31200cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 --2- 172.21.15.137:0/3638464162 >> v2:172.21.15.170:3300/0 conn(0x7f31200d3ee0 0x7f31200cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 >> v1:172.21.15.170:6789/0 conn(0x7f312015f750 legacy=0x7f31200b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31200d0c40 con 0x7f312015f370 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f311c0019f0 con 0x7f312015f370 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 >> v1:172.21.15.137:6789/0 conn(0x7f312015f370 legacy=0x7f31200d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310c0039b0 0x7f310c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f310c004800 0x7f310c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f310c0051c0 0x7f310c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31200d0960 con 0x7f310c0051c0 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f310c00c060 con 0x7f310c0039b0 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f310c00c260 con 0x7f310c004800 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3125e36640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f310c0051c0 0x7f310c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3125635640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310c0039b0 0x7f310c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.736+0000 7f3124e34640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f310c004800 0x7f310c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3125e36640 1 -- 172.21.15.137:0/3638464162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f310c004800 msgr2=0x7f310c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3125e36640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f310c004800 0x7f310c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3125e36640 1 -- 172.21.15.137:0/3638464162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310c0039b0 msgr2=0x7f310c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3125e36640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310c0039b0 0x7f310c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3125e36640 1 -- 172.21.15.137:0/3638464162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310c003520 con 0x7f310c0051c0 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3125e36640 1 -- 172.21.15.137:0/3638464162 reap_dead start 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3125e36640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f310c0051c0 0x7f310c00b9c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3118001750 tx=0x7f310c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cc8ede5a3f3af5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3118001370 con 0x7f310c0051c0 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31180052f0 con 0x7f310c0051c0 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.737+0000 7f3117fff640 1 -- 172.21.15.137:0/3638464162 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311802abe0 con 0x7f310c0051c0 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.738+0000 7f3127899640 1 -- 172.21.15.137:0/3638464162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f310c0051c0 msgr2=0x7f310c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.738+0000 7f3127899640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f310c0051c0 0x7f310c00b9c0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f3118001750 tx=0x7f310c005830 comp rx=0 tx=0).stop 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.738+0000 7f3127899640 1 -- 172.21.15.137:0/3638464162 shutdown_connections 2024-04-26T22:02:50.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.738+0000 7f3127899640 1 --2- 172.21.15.137:0/3638464162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f310c0051c0 0x7f310c00b9c0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.738+0000 7f3127899640 1 -- 172.21.15.137:0/3638464162 >> 172.21.15.137:0/3638464162 conn(0x7f312008ec10 msgr2=0x7f312009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:50.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.738+0000 7f3127899640 1 -- 172.21.15.137:0/3638464162 shutdown_connections 2024-04-26T22:02:50.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.738+0000 7f3127899640 1 -- 172.21.15.137:0/3638464162 wait complete. 2024-04-26T22:02:50.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.739+0000 7f3127899640 1 Processor -- start 2024-04-26T22:02:50.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.739+0000 7f3127899640 1 -- start start 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3127899640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310c0051c0 0x7f31200cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3127899640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31200cf000 0x7f3120160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3127899640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3120162100 0x7f31201625b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3127899640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31200cfef0 con 0x7f3120162100 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3127899640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f31200cfd70 con 0x7f310c0051c0 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3127899640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f31200d0070 con 0x7f31200cf000 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125e36640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3120162100 0x7f31201625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125e36640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3120162100 0x7f31201625b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50518/0 (socket says 172.21.15.137:50518) 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125e36640 1 -- 172.21.15.137:0/191151254 learned_addr learned my addr 172.21.15.137:0/191151254 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125e36640 1 -- 172.21.15.137:0/191151254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31200cf000 msgr2=0x7f3120160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125e36640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31200cf000 0x7f3120160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125e36640 1 -- 172.21.15.137:0/191151254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310c0051c0 msgr2=0x7f31200cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125635640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310c0051c0 0x7f31200cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125e36640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310c0051c0 0x7f31200cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125e36640 1 -- 172.21.15.137:0/191151254 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3120162af0 con 0x7f3120162100 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.740+0000 7f3125e36640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3120162100 0x7f31201625b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f311802a590 tx=0x7f3118001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.741+0000 7f3115ffb640 1 -- 172.21.15.137:0/191151254 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3118007a30 con 0x7f3120162100 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.741+0000 7f3115ffb640 1 -- 172.21.15.137:0/191151254 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31180054a0 con 0x7f3120162100 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.741+0000 7f3127899640 1 -- 172.21.15.137:0/191151254 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31200b3220 con 0x7f3120162100 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.741+0000 7f3115ffb640 1 -- 172.21.15.137:0/191151254 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3118004d80 con 0x7f3120162100 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.741+0000 7f3127899640 1 -- 172.21.15.137:0/191151254 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31200b37e0 con 0x7f3120162100 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.742+0000 7f3115ffb640 1 -- 172.21.15.137:0/191151254 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3118007030 con 0x7f3120162100 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.743+0000 7f3115ffb640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f310406c8f0 0x7f310406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.743+0000 7f3115ffb640 1 -- 172.21.15.137:0/191151254 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f31180aae80 con 0x7f3120162100 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.743+0000 7f3125635640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f310406c8f0 0x7f310406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.743+0000 7f3125635640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f310406c8f0 0x7f310406edb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f311c001b50 tx=0x7f311c006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f312a5b8740 1 Processor -- start 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f312a5b8740 1 -- start start 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51464d440 0x55b51464d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b51466b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b514623120 0x55b5146693a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f312a5b8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b514587740 con 0x55b514623120 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f312a5b8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b5145233a0 con 0x55b51466ace0 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f312a5b8740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b514583700 con 0x55b51464d440 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f3125e36640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b514623120 0x55b5146693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f3125e36640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b514623120 0x55b5146693a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50526/0 (socket says 172.21.15.137:50526) 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.744+0000 7f3125e36640 1 -- 172.21.15.137:0/316865244 learned_addr learned my addr 172.21.15.137:0/316865244 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f3125635640 1 --2- 172.21.15.137:0/316865244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51464d440 0x55b51464d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f3124e34640 1 --2- 172.21.15.137:0/316865244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b51466b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f3125e36640 1 -- 172.21.15.137:0/316865244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51464d440 msgr2=0x55b51464d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f3125e36640 1 --2- 172.21.15.137:0/316865244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51464d440 0x55b51464d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f3125e36640 1 -- 172.21.15.137:0/316865244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 msgr2=0x55b51466b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f3125e36640 1 --2- 172.21.15.137:0/316865244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b51466b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f3125e36640 1 -- 172.21.15.137:0/316865244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51453f750 con 0x55b514623120 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f3125e36640 1 --2- 172.21.15.137:0/316865244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b514623120 0x55b5146693a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f3118074fb0 tx=0x7f3118078790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb4ef3e56bc817e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f310affd640 1 -- 172.21.15.137:0/316865244 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3118004f20 con 0x55b514623120 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f310affd640 1 -- 172.21.15.137:0/316865244 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f311802ae20 con 0x55b514623120 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f310affd640 1 -- 172.21.15.137:0/316865244 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3118079250 con 0x55b514623120 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f312a5b8740 1 -- 172.21.15.137:0/316865244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b514623120 msgr2=0x55b5146693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f312a5b8740 1 --2- 172.21.15.137:0/316865244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b514623120 0x55b5146693a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f3118074fb0 tx=0x7f3118078790 comp rx=0 tx=0).stop 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f312a5b8740 1 -- 172.21.15.137:0/316865244 shutdown_connections 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f312a5b8740 1 --2- 172.21.15.137:0/316865244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b514623120 0x55b5146693a0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f312a5b8740 1 --2- 172.21.15.137:0/316865244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b51466b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f312a5b8740 1 --2- 172.21.15.137:0/316865244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51464d440 0x55b51464d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.745+0000 7f312a5b8740 1 -- 172.21.15.137:0/316865244 >> 172.21.15.137:0/316865244 conn(0x55b51461fa50 msgr2=0x55b514668250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.746+0000 7f312a5b8740 1 -- 172.21.15.137:0/316865244 shutdown_connections 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.746+0000 7f312a5b8740 1 -- 172.21.15.137:0/316865244 wait complete. 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.746+0000 7f312a5b8740 1 -- start start 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.746+0000 7f312a5b8740 1 Processor -- start 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51463bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b5146512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b514649fb0 0x55b51463c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f312a5b8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b5145233a0 con 0x55b51464d440 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f312a5b8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b51450efe0 con 0x55b51466ace0 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f312a5b8740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b514587740 con 0x55b514649fb0 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f312a5b8740 10 client.0 _ll_register_callbacks cb 0x55b514525150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f3125635640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51463bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f3125635640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51463bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50532/0 (socket says 172.21.15.137:50532) 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f3125635640 1 -- 172.21.15.137:0/491719205 learned_addr learned my addr 172.21.15.137:0/491719205 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f3124e34640 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b5146512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.747+0000 7f3125e36640 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b514649fb0 0x55b51463c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f3125635640 1 -- 172.21.15.137:0/491719205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b514649fb0 msgr2=0x55b51463c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f3125635640 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b514649fb0 0x55b51463c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f3125635640 1 -- 172.21.15.137:0/491719205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 msgr2=0x55b5146512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f3125635640 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b5146512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f3125635640 1 -- 172.21.15.137:0/491719205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5142992d0 con 0x55b51464d440 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f3125635640 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51463bc00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f311c015c80 tx=0x7f31200d0e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fc6a0b833b372a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f30fffff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f30fffff640 1 -- 172.21.15.137:0/491719205 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c028060 con 0x55b51464d440 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f30fffff640 1 -- 172.21.15.137:0/491719205 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f311c023b40 con 0x55b51464d440 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f312a5b8740 1 -- 172.21.15.137:0/491719205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f311802ae20 con 0x55b51464d440 2024-04-26T22:02:50.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f30fffff640 1 -- 172.21.15.137:0/491719205 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f311c007860 con 0x55b51464d440 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f312a5b8740 10 client.6888 fetch_fsmap learned FSMap version 39 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f312a5b8740 1 -- 172.21.15.137:0/491719205 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55b5143636b0 con 0x55b51464d440 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f30fffff640 1 -- 172.21.15.137:0/491719205 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f311802ae20 con 0x55b51464d440 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f30fffff640 1 -- 172.21.15.137:0/491719205 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f311c021070 con 0x55b51464d440 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f312a5b8740 10 client.6888 fetch_fsmap finished waiting for FSMap version 39 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f312a5b8740 10 client.6888 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f312a5b8740 20 client.6888 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f312a5b8740 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55b51464e860 0x55b51464ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f312a5b8740 4 client.6888 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.748+0000 7f312a5b8740 1 -- 172.21.15.137:0/491719205 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b514595350 con 0x55b51464e860 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.749+0000 7f3124e34640 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55b51464e860 0x55b51464ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.749+0000 7f30fffff640 10 client.6888 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:50.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.749+0000 7f3124e34640 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55b51464e860 0x55b51464ec40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b9fecebd2779e35 server_cookie=7d9c23ff358fef72 in_seq=0 out_seq=0 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.749+0000 7f30fffff640 1 -- 172.21.15.137:0/491719205 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b514595350 con 0x55b51464e860 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.749+0000 7f30fffff640 10 client.6888 handle_command_reply: tid=0 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.749+0000 7f312a5b8740 1 client.6888 shutdown 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 -- 172.21.15.137:0/491719205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 msgr2=0x55b51463bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51463bc00 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f311c015c80 tx=0x7f31200d0e10 comp rx=0 tx=0).stop 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 -- 172.21.15.137:0/491719205 shutdown_connections 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55b51464e860 0x55b51464ec40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b514649fb0 0x55b51463c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b5146512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f30fffff640 0 client.6888 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 --2- 172.21.15.137:0/491719205 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51463bc00 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 -- 172.21.15.137:0/491719205 >> 172.21.15.137:0/491719205 conn(0x55b514623120 msgr2=0x55b51466b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:50.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 -- 172.21.15.137:0/491719205 shutdown_connections 2024-04-26T22:02:50.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 1 -- 172.21.15.137:0/491719205 wait complete. 2024-04-26T22:02:50.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.750+0000 7f312a5b8740 20 client.6888 trim_cache size 0 max 16384 2024-04-26T22:02:50.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.768+0000 7f312a5b8740 1 Processor -- start 2024-04-26T22:02:50.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.768+0000 7f312a5b8740 1 -- start start 2024-04-26T22:02:50.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b514649fb0 0x55b514662b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b514681750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b514681c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f312a5b8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f31202010d0 con 0x55b51464d440 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f312a5b8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f31200ca8c0 con 0x55b51466ace0 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f312a5b8740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3120200a80 con 0x55b514649fb0 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f3124e34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b514681750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f3124e34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b514681750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50546/0 (socket says 172.21.15.137:50546) 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f3124e34640 1 -- 172.21.15.137:0/1744400867 learned_addr learned my addr 172.21.15.137:0/1744400867 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f3124e34640 1 -- 172.21.15.137:0/1744400867 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b514649fb0 msgr2=0x55b514662b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f3124e34640 1 --2- 172.21.15.137:0/1744400867 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b514649fb0 0x55b514662b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f3124e34640 1 -- 172.21.15.137:0/1744400867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 msgr2=0x55b514681c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f3124e34640 1 --2- 172.21.15.137:0/1744400867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b514681c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f3124e34640 1 -- 172.21.15.137:0/1744400867 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51461e300 con 0x55b51464d440 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f3124e34640 1 --2- 172.21.15.137:0/1744400867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b514681750 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f312008e680 tx=0x7f3110008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7649f44b0964c042 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f310a7fc640 1 -- 172.21.15.137:0/1744400867 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31100181d0 con 0x55b51464d440 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f310a7fc640 1 -- 172.21.15.137:0/1744400867 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3110025070 con 0x55b51464d440 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.769+0000 7f310a7fc640 1 -- 172.21.15.137:0/1744400867 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110004250 con 0x55b51464d440 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.770+0000 7f312a5b8740 1 -- 172.21.15.137:0/1744400867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 msgr2=0x55b514681750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.770+0000 7f312a5b8740 1 --2- 172.21.15.137:0/1744400867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b514681750 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f312008e680 tx=0x7f3110008040 comp rx=0 tx=0).stop 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.770+0000 7f312a5b8740 1 -- 172.21.15.137:0/1744400867 shutdown_connections 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.770+0000 7f312a5b8740 1 --2- 172.21.15.137:0/1744400867 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b514681750 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.770+0000 7f312a5b8740 1 --2- 172.21.15.137:0/1744400867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b51466ace0 0x55b514681c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.770+0000 7f312a5b8740 1 --2- 172.21.15.137:0/1744400867 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b514649fb0 0x55b514662b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.770+0000 7f312a5b8740 1 -- 172.21.15.137:0/1744400867 >> 172.21.15.137:0/1744400867 conn(0x55b514623120 msgr2=0x55b51463ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.770+0000 7f312a5b8740 1 -- 172.21.15.137:0/1744400867 shutdown_connections 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.770+0000 7f312a5b8740 1 -- 172.21.15.137:0/1744400867 wait complete. 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.771+0000 7f312a5b8740 1 -- start start 2024-04-26T22:02:50.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.771+0000 7f312a5b8740 1 Processor -- start 2024-04-26T22:02:50.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b514649fb0 0x55b5146c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51465e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51466ace0 0x55b51468ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55b514661bd0 con 0x55b51464d440 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55b51465fdf0 con 0x55b514649fb0 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55b514660790 con 0x55b51466ace0 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 10 client.0 _ll_register_callbacks cb 0x7f311c018040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3124e34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51465e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3124e34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51465e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50548/0 (socket says 172.21.15.137:50548) 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3124e34640 1 -- 172.21.15.137:0/3416167774 learned_addr learned my addr 172.21.15.137:0/3416167774 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3125e36640 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51466ace0 0x55b51468ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3125635640 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b514649fb0 0x55b5146c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3124e34640 1 -- 172.21.15.137:0/3416167774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51466ace0 msgr2=0x55b51468ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3124e34640 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51466ace0 0x55b51468ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3124e34640 1 -- 172.21.15.137:0/3416167774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b514649fb0 msgr2=0x55b5146c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3124e34640 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b514649fb0 0x55b5146c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3124e34640 1 -- 172.21.15.137:0/3416167774 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5146c89d0 con 0x55b51464d440 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3125e36640 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51466ace0 0x55b51468ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f3124e34640 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51465e480 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3110021000 tx=0x7f3110019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d997f80da9e04dbc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f30fffff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f30fffff640 1 -- 172.21.15.137:0/3416167774 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110004440 con 0x55b51464d440 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f30fffff640 1 -- 172.21.15.137:0/3416167774 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f31100189b0 con 0x55b51464d440 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 1 -- 172.21.15.137:0/3416167774 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3110025070 con 0x55b51464d440 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f30fffff640 1 -- 172.21.15.137:0/3416167774 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3110039050 con 0x55b51464d440 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 10 client.6894 fetch_fsmap learned FSMap version 39 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.772+0000 7f312a5b8740 1 -- 172.21.15.137:0/3416167774 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55b51465dfc0 con 0x55b51464d440 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f30fffff640 1 -- 172.21.15.137:0/3416167774 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3110025070 con 0x55b51464d440 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f30fffff640 1 -- 172.21.15.137:0/3416167774 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7f311003c020 con 0x55b51464d440 2024-04-26T22:02:50.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 10 client.6894 fetch_fsmap finished waiting for FSMap version 39 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 10 client.6894 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 20 client.6894 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55b51468b160 0x55b51461c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 4 client.6894 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 -- 172.21.15.137:0/3416167774 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "status"}) -- 0x55b51458f1c0 con 0x55b51468b160 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f3125635640 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55b51468b160 0x55b51461c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f30fffff640 10 client.6894 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f3125635640 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55b51468b160 0x55b51461c670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4374d8b64ae9977 server_cookie=fde33786a91bf896 in_seq=0 out_seq=0 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f30fffff640 1 -- 172.21.15.137:0/3416167774 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b51458f1c0 con 0x55b51468b160 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f30fffff640 10 client.6894 handle_command_reply: tid=0 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 client.6894 shutdown 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 -- 172.21.15.137:0/3416167774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 msgr2=0x55b51465e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51465e480 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3110021000 tx=0x7f3110019040 comp rx=0 tx=0).stop 2024-04-26T22:02:50.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 -- 172.21.15.137:0/3416167774 shutdown_connections 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55b51468b160 0x55b51461c670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55b51464d440 0x55b51465e480 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55b51466ace0 0x55b51468ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f30fffff640 0 client.6894 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 --2- 172.21.15.137:0/3416167774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b514649fb0 0x55b5146c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.773+0000 7f312a5b8740 1 -- 172.21.15.137:0/3416167774 >> 172.21.15.137:0/3416167774 conn(0x55b514623120 msgr2=0x55b51463ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f312a5b8740 1 -- 172.21.15.137:0/3416167774 shutdown_connections 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f312a5b8740 1 -- 172.21.15.137:0/3416167774 wait complete. 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f312a5b8740 20 client.6894 trim_cache size 0 max 16384 2024-04-26T22:02:50.780 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 6843, 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.3907473860000001, 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 39, 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 73, 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 73, 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 5.0165315140000004 2024-04-26T22:02:50.781 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:02:50.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 -- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f310406c8f0 msgr2=0x7f310406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f310406c8f0 0x7f310406edb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f311c001b50 tx=0x7f311c006040 comp rx=0 tx=0).stop 2024-04-26T22:02:50.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 -- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3120162100 msgr2=0x7f31201625b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3120162100 0x7f31201625b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f311802a590 tx=0x7f3118001120 comp rx=0 tx=0).stop 2024-04-26T22:02:50.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 -- 172.21.15.137:0/191151254 shutdown_connections 2024-04-26T22:02:50.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f310406c8f0 0x7f310406edb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3120162100 0x7f31201625b0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31200cf000 0x7f3120160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 --2- 172.21.15.137:0/191151254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f310c0051c0 0x7f31200cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 -- 172.21.15.137:0/191151254 >> 172.21.15.137:0/191151254 conn(0x7f312008ec10 msgr2=0x7f31200d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:50.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 -- 172.21.15.137:0/191151254 shutdown_connections 2024-04-26T22:02:50.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.774+0000 7f3127899640 1 -- 172.21.15.137:0/191151254 wait complete. 2024-04-26T22:02:50.785 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:02:50.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.882+0000 7f1e3d293640 1 Processor -- start 2024-04-26T22:02:50.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.882+0000 7f1e3d293640 1 -- start start 2024-04-26T22:02:50.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e3d293640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e380d3ee0 0x7f1e380cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e3d293640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f750 0x7f1e380b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e3d293640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e380d03a0 con 0x7f1e3815f370 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e3d293640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1e380b4d10 con 0x7f1e380d3ee0 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e3d293640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1e380d0680 con 0x7f1e3815f750 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e2ffff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e380d3ee0 0x7f1e380cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e377fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f750 0x7f1e380b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e377fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f750 0x7f1e380b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:35002/0 (socket says 172.21.15.137:35002) 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e2ffff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e380d3ee0 0x7f1e380cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:56674/0 (socket says 172.21.15.137:56674) 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e377fe640 1 -- 172.21.15.137:0/3439646636 learned_addr learned my addr 172.21.15.137:0/3439646636 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e36ffd640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1e3815f370 0x7f1e380d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:42574/0 (socket says 172.21.15.137:42574) 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e377fe640 1 -- 172.21.15.137:0/3439646636 >> v2:172.21.15.170:3300/0 conn(0x7f1e380d3ee0 msgr2=0x7f1e380cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e377fe640 1 --2- 172.21.15.137:0/3439646636 >> v2:172.21.15.170:3300/0 conn(0x7f1e380d3ee0 0x7f1e380cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e377fe640 1 -- 172.21.15.137:0/3439646636 >> v1:172.21.15.170:6789/0 conn(0x7f1e3815f370 legacy=0x7f1e380d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e377fe640 1 -- 172.21.15.137:0/3439646636 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e380d0960 con 0x7f1e3815f750 2024-04-26T22:02:50.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.883+0000 7f1e2ffff640 1 --2- 172.21.15.137:0/3439646636 >> v2:172.21.15.170:3300/0 conn(0x7f1e380d3ee0 0x7f1e380cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:02:50.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.884+0000 7f1e377fe640 1 --2- 172.21.15.137:0/3439646636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f750 0x7f1e380b47d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009e50 tx=0x7f1e3002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d9ac66a62468c5d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.884+0000 7f1e367fc640 1 -- 172.21.15.137:0/3439646636 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30036070 con 0x7f1e3815f750 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.884+0000 7f1e367fc640 1 -- 172.21.15.137:0/3439646636 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e30031600 con 0x7f1e3815f750 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.884+0000 7f1e367fc640 1 -- 172.21.15.137:0/3439646636 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e300319d0 con 0x7f1e3815f750 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.885+0000 7f1e3d293640 1 -- 172.21.15.137:0/3439646636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f750 msgr2=0x7f1e380b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.885+0000 7f1e3d293640 1 --2- 172.21.15.137:0/3439646636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f750 0x7f1e380b47d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009e50 tx=0x7f1e3002a710 comp rx=0 tx=0).stop 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.885+0000 7f1e3d293640 1 -- 172.21.15.137:0/3439646636 shutdown_connections 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.885+0000 7f1e3d293640 1 --2- 172.21.15.137:0/3439646636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f750 0x7f1e380b47d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.885+0000 7f1e3d293640 1 --2- 172.21.15.137:0/3439646636 >> v2:172.21.15.170:3300/0 conn(0x7f1e380d3ee0 0x7f1e380cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.885+0000 7f1e3d293640 1 -- 172.21.15.137:0/3439646636 >> 172.21.15.137:0/3439646636 conn(0x7f1e3808ec10 msgr2=0x7f1e3809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.885+0000 7f1e3d293640 1 -- 172.21.15.137:0/3439646636 shutdown_connections 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.885+0000 7f1e3d293640 1 -- 172.21.15.137:0/3439646636 wait complete. 2024-04-26T22:02:50.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.886+0000 7f1e3d293640 1 Processor -- start 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.886+0000 7f1e3d293640 1 -- start start 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e3d293640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e380d3ee0 0x7f1e380b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e3d293640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f370 0x7f1e3806de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e3d293640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3815f750 0x7f1e380cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e3d293640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1e380b51c0 con 0x7f1e380d3ee0 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e3d293640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1e380d0f20 con 0x7f1e3815f750 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e3d293640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1e380b5340 con 0x7f1e3815f370 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e36ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e380d3ee0 0x7f1e380b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e36ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e380d3ee0 0x7f1e380b7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50560/0 (socket says 172.21.15.137:50560) 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e36ffd640 1 -- 172.21.15.137:0/2883222115 learned_addr learned my addr 172.21.15.137:0/2883222115 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e36ffd640 1 -- 172.21.15.137:0/2883222115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f370 msgr2=0x7f1e3806de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e36ffd640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f370 0x7f1e3806de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e36ffd640 1 -- 172.21.15.137:0/2883222115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3815f750 msgr2=0x7f1e380cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:50.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e36ffd640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3815f750 0x7f1e380cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:50.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e36ffd640 1 -- 172.21.15.137:0/2883222115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e380cd960 con 0x7f1e380d3ee0 2024-04-26T22:02:50.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e36ffd640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e380d3ee0 0x7f1e380b7df0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800c400 tx=0x7f1e2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e2f7fe640 1 -- 172.21.15.137:0/2883222115 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e280074e0 con 0x7f1e380d3ee0 2024-04-26T22:02:50.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e2f7fe640 1 -- 172.21.15.137:0/2883222115 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e28007680 con 0x7f1e380d3ee0 2024-04-26T22:02:50.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e380cdc40 con 0x7f1e380d3ee0 2024-04-26T22:02:50.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e2f7fe640 1 -- 172.21.15.137:0/2883222115 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e28004a00 con 0x7f1e380d3ee0 2024-04-26T22:02:50.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.887+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e380ce200 con 0x7f1e380d3ee0 2024-04-26T22:02:50.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.888+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e3806a290 con 0x7f1e380d3ee0 2024-04-26T22:02:50.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.889+0000 7f1e2f7fe640 1 -- 172.21.15.137:0/2883222115 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1e2801a020 con 0x7f1e380d3ee0 2024-04-26T22:02:50.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.889+0000 7f1e2f7fe640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e1806c8f0 0x7f1e1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:50.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.889+0000 7f1e2f7fe640 1 -- 172.21.15.137:0/2883222115 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f1e2808b410 con 0x7f1e380d3ee0 2024-04-26T22:02:50.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.889+0000 7f1e2ffff640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e1806c8f0 0x7f1e1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:50.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.890+0000 7f1e2ffff640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e1806c8f0 0x7f1e1806edb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1e20006e80 tx=0x7f1e20006dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:50.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:50.894+0000 7f1e2f7fe640 1 -- 172.21.15.137:0/2883222115 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1e280597e0 con 0x7f1e380d3ee0 2024-04-26T22:02:51.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.103+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1e380b65b0 con 0x7f1e380d3ee0 2024-04-26T22:02:51.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.104+0000 7f1e2f7fe640 1 -- 172.21.15.137:0/2883222115 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) ==== 53+0+73 (secure 0 0 0) 0x7f1e280590e0 con 0x7f1e380d3ee0 2024-04-26T22:02:51.104 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:02:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e1806c8f0 msgr2=0x7f1e1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e1806c8f0 0x7f1e1806edb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1e20006e80 tx=0x7f1e20006dd0 comp rx=0 tx=0).stop 2024-04-26T22:02:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e380d3ee0 msgr2=0x7f1e380b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e380d3ee0 0x7f1e380b7df0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800c400 tx=0x7f1e2800c8c0 comp rx=0 tx=0).stop 2024-04-26T22:02:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 shutdown_connections 2024-04-26T22:02:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1e1806c8f0 0x7f1e1806edb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e3815f750 0x7f1e380cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:51.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1e3815f370 0x7f1e3806de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:51.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 --2- 172.21.15.137:0/2883222115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1e380d3ee0 0x7f1e380b7df0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:51.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 >> 172.21.15.137:0/2883222115 conn(0x7f1e3808ec10 msgr2=0x7f1e380d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:51.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 shutdown_connections 2024-04-26T22:02:51.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51.106+0000 7f1e3d293640 1 -- 172.21.15.137:0/2883222115 wait complete. 2024-04-26T22:02:51.117 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:02:51.117 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:02:51.117 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:02:51.117 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:02:51.117 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:51.117 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:02:51.117 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:02:51.117 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:02:51.117 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:02:51.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:51.117 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:02:51.132 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:02:51.133 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:02:51.134 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:02:51.135 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:02:51.135 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:51.135 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:02:51.135 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:02:51.135 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:02:51.135 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:02:51.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:51.135 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:02:51.195 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:02:51.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:51.196 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:02:51.252 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:02:51.252 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:02:51.252 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:02:51.252 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:02:51.252 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:02:51.252 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:02:51.253 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:02:51.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:02:51.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:02:51.253 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:02:51.253 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:02:51.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:02:51.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:02:51.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:51.376 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:02:51.388 INFO:tasks.ceph.mds.c.smithi137.stderr:2024-04-26T22:02:51.388+0000 7fdfeb306640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:02:51.390 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:02:51.390 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:02:51.390 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:02:51.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:51.390 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:02:51.453 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:02:51.453 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:51.509 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:02:51.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:02:51.509 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:51.563 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:02:51.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:51.563 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:02:51.644 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:02:51.645 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:02:51.652 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:02:51.652 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:02:51.652 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:02:51.652 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:02:51.652 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:02:51.653 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:02:51.653 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:02:51.653 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:02:51.653 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:02:51.653 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:02:51.655 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:02:51.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:51.655 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:51.718 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:02:51.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:02:51.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:02:51.814 INFO:teuthology.orchestra.run.smithi137.stdout:client5606 2024-04-26T22:02:51.814 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:51.814 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:51.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:51.829 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-04-26T22:02:51.884 INFO:teuthology.orchestra.run.smithi137.stdout:file_undamaged 2024-04-26T22:02:51.886 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:02:51.886 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:02:51.886 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:02:51.886 DEBUG:teuthology.orchestra.run.smithi137:> import json 2024-04-26T22:02:51.886 DEBUG:teuthology.orchestra.run.smithi137:> import sys 2024-04-26T22:02:51.886 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:02:51.886 DEBUG:teuthology.orchestra.run.smithi137:> try: 2024-04-26T22:02:51.886 DEBUG:teuthology.orchestra.run.smithi137:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-04-26T22:02:51.886 DEBUG:teuthology.orchestra.run.smithi137:> except OSError as e: 2024-04-26T22:02:51.887 DEBUG:teuthology.orchestra.run.smithi137:> sys.exit(e.errno) 2024-04-26T22:02:51.887 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:02:51.887 DEBUG:teuthology.orchestra.run.smithi137:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-26T22:02:51.887 DEBUG:teuthology.orchestra.run.smithi137:> print(json.dumps( 2024-04-26T22:02:51.887 DEBUG:teuthology.orchestra.run.smithi137:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-26T22:02:51.887 DEBUG:teuthology.orchestra.run.smithi137:> indent=2)) 2024-04-26T22:02:51.887 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:02:51.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:51 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-26T22:02:52.000 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-26T22:02:52.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:52.001 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-26T22:02:52.056 INFO:teuthology.orchestra.run.smithi137.stdout:2 2024-04-26T22:02:52.056 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:52.056 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:52.111 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:02:52.118 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:02:52.167 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:02:52.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.303+0000 7f1f229a4640 1 Processor -- start 2024-04-26T22:02:52.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.303+0000 7f1f229a4640 1 -- start start 2024-04-26T22:02:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f229a4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1f1c13ff70 0x7f1f1c146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f229a4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f1c140350 0x7f1f1c1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f229a4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c0cf810 0x7f1f1c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f229a4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1c0d05b0 con 0x7f1f1c140350 2024-04-26T22:02:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f229a4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1c0d0890 con 0x7f1f1c13ff70 2024-04-26T22:02:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f229a4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c06e450 con 0x7f1f1c0cf810 2024-04-26T22:02:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f1c140350 0x7f1f1c1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f1f1c140350 0x7f1f1c1465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50568/0 (socket says 172.21.15.137:50568) 2024-04-26T22:02:52.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1b7fe640 1 -- 172.21.15.137:0/1446768708 learned_addr learned my addr 172.21.15.137:0/1446768708 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f20f41640 1 --2- 172.21.15.137:0/1446768708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c0cf810 0x7f1f1c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1bfff640 1 --2- 172.21.15.137:0/1446768708 >> v2:172.21.15.170:3300/0 conn(0x7f1f1c13ff70 0x7f1f1c146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1b7fe640 1 -- 172.21.15.137:0/1446768708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c0cf810 msgr2=0x7f1f1c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1b7fe640 1 --2- 172.21.15.137:0/1446768708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c0cf810 0x7f1f1c0cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1b7fe640 1 -- 172.21.15.137:0/1446768708 >> v2:172.21.15.170:3300/0 conn(0x7f1f1c13ff70 msgr2=0x7f1f1c146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1b7fe640 1 --2- 172.21.15.137:0/1446768708 >> v2:172.21.15.170:3300/0 conn(0x7f1f1c13ff70 0x7f1f1c146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1b7fe640 1 -- 172.21.15.137:0/1446768708 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c06e730 con 0x7f1f1c140350 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f20f41640 1 --2- 172.21.15.137:0/1446768708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c0cf810 0x7f1f1c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.304+0000 7f1f1bfff640 1 --2- 172.21.15.137:0/1446768708 >> v2:172.21.15.170:3300/0 conn(0x7f1f1c13ff70 0x7f1f1c146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.305+0000 7f1f1b7fe640 1 --2- 172.21.15.137:0/1446768708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c140350 0x7f1f1c1465c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c074200 tx=0x7f1f1002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27a1df814a7633 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.305+0000 7f1f1affd640 1 -- 172.21.15.137:0/1446768708 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f10037070 con 0x7f1f1c140350 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.305+0000 7f1f1affd640 1 -- 172.21.15.137:0/1446768708 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f10032440 con 0x7f1f1c140350 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.305+0000 7f1f1affd640 1 -- 172.21.15.137:0/1446768708 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f10032810 con 0x7f1f1c140350 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.306+0000 7f1f229a4640 1 -- 172.21.15.137:0/1446768708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c140350 msgr2=0x7f1f1c1465c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.306+0000 7f1f229a4640 1 --2- 172.21.15.137:0/1446768708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c140350 0x7f1f1c1465c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c074200 tx=0x7f1f1002a140 comp rx=0 tx=0).stop 2024-04-26T22:02:52.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.306+0000 7f1f229a4640 1 -- 172.21.15.137:0/1446768708 shutdown_connections 2024-04-26T22:02:52.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.306+0000 7f1f229a4640 1 --2- 172.21.15.137:0/1446768708 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c0cf810 0x7f1f1c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.306+0000 7f1f229a4640 1 --2- 172.21.15.137:0/1446768708 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c140350 0x7f1f1c1465c0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.306+0000 7f1f229a4640 1 --2- 172.21.15.137:0/1446768708 >> v2:172.21.15.170:3300/0 conn(0x7f1f1c13ff70 0x7f1f1c146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.306+0000 7f1f229a4640 1 -- 172.21.15.137:0/1446768708 >> 172.21.15.137:0/1446768708 conn(0x7f1f1c0d0d30 msgr2=0x7f1f1c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:52.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.306+0000 7f1f229a4640 1 -- 172.21.15.137:0/1446768708 shutdown_connections 2024-04-26T22:02:52.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.306+0000 7f1f229a4640 1 -- 172.21.15.137:0/1446768708 wait complete. 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.307+0000 7f1f229a4640 1 Processor -- start 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.307+0000 7f1f229a4640 1 -- start start 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f229a4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c0cf810 0x7f1f1c144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f229a4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f1c13ff70 0x7f1f1c151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f229a4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c140350 0x7f1f1c13dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f229a4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c142a40 con 0x7f1f1c0cf810 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f229a4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1428c0 con 0x7f1f1c13ff70 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f229a4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c142bc0 con 0x7f1f1c140350 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c0cf810 0x7f1f1c144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c0cf810 0x7f1f1c144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50578/0 (socket says 172.21.15.137:50578) 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1bfff640 1 -- 172.21.15.137:0/3137032725 learned_addr learned my addr 172.21.15.137:0/3137032725 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1bfff640 1 -- 172.21.15.137:0/3137032725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c140350 msgr2=0x7f1f1c13dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1bfff640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c140350 0x7f1f1c13dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1bfff640 1 -- 172.21.15.137:0/3137032725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f1c13ff70 msgr2=0x7f1f1c151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1b7fe640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f1c13ff70 0x7f1f1c151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1bfff640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f1c13ff70 0x7f1f1c151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1bfff640 1 -- 172.21.15.137:0/3137032725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c144680 con 0x7f1f1c0cf810 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1b7fe640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f1c13ff70 0x7f1f1c151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f1bfff640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c0cf810 0x7f1f1c144f00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00c820 tx=0x7f1f0c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f18ff9640 1 -- 172.21.15.137:0/3137032725 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c015070 con 0x7f1f1c0cf810 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f18ff9640 1 -- 172.21.15.137:0/3137032725 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0c007a30 con 0x7f1f1c0cf810 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f18ff9640 1 -- 172.21.15.137:0/3137032725 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c007e00 con 0x7f1f1c0cf810 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c145440 con 0x7f1f1c0cf810 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.308+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c1438c0 con 0x7f1f1c0cf810 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.309+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c13bff0 con 0x7f1f1c0cf810 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.310+0000 7f1f18ff9640 1 -- 172.21.15.137:0/3137032725 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1f0c018070 con 0x7f1f1c0cf810 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.310+0000 7f1f18ff9640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f0806c8f0 0x7f1f0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.310+0000 7f1f1b7fe640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f0806c8f0 0x7f1f0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.310+0000 7f1f18ff9640 1 -- 172.21.15.137:0/3137032725 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f1f0c08baa0 con 0x7f1f1c0cf810 2024-04-26T22:02:52.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.311+0000 7f1f1b7fe640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f0806c8f0 0x7f1f0806edb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1f10034000 tx=0x7f1f1002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:52.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.315+0000 7f1f18ff9640 1 -- 172.21.15.137:0/3137032725 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1f1c13bff0 con 0x7f1f1c0cf810 2024-04-26T22:02:52.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.493+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f1c0d1500 con 0x7f1f1c0cf810 2024-04-26T22:02:52.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.494+0000 7f1f18ff9640 1 -- 172.21.15.137:0/3137032725 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+16811 (secure 0 0 0) 0x7f1f1c144680 con 0x7f1f1c0cf810 2024-04-26T22:02:52.494 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:02:52.495 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":73,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:02:45.720714+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:02:34.722395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T22:02:35.462679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/1566574554":"2024-04-27T22:02:45.720691+0000","172.21.15.137:6835/1566574554":"2024-04-27T22:02:45.720691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:02:52.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f0806c8f0 msgr2=0x7f1f0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f0806c8f0 0x7f1f0806edb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1f10034000 tx=0x7f1f1002e000 comp rx=0 tx=0).stop 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c0cf810 msgr2=0x7f1f1c144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c0cf810 0x7f1f1c144f00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00c820 tx=0x7f1f0c00cc20 comp rx=0 tx=0).stop 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 shutdown_connections 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f1f0806c8f0 0x7f1f0806edb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f1f1c140350 0x7f1f1c13dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1f1c13ff70 0x7f1f1c151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 --2- 172.21.15.137:0/3137032725 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f1f1c0cf810 0x7f1f1c144f00 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 >> 172.21.15.137:0/3137032725 conn(0x7f1f1c0d0d30 msgr2=0x7f1f1c0b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 shutdown_connections 2024-04-26T22:02:52.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.496+0000 7f1f229a4640 1 -- 172.21.15.137:0/3137032725 wait complete. 2024-04-26T22:02:52.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:02:34.722395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:02:35.462679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:02:52.508 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:02:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.607+0000 7f9001140640 1 Processor -- start 2024-04-26T22:02:52.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.607+0000 7f9001140640 1 -- start start 2024-04-26T22:02:52.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f9001140640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15f680 0x7f8ffc0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f9001140640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8ffc163aa0 0x7f8ffc0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f9001140640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ffc0d3f50 con 0x7f8ffc0b60b0 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f9001140640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc15fa60 con 0x7f8ffc163aa0 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f9001140640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc0b5090 con 0x7f8ffc15f680 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f8ffb59e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8ffc0b60b0 0x7f8ffc0d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48598/0 (socket says 172.21.15.137:48598) 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f8ffb59e640 1 -- 172.21.15.137:0/774187753 learned_addr learned my addr 172.21.15.137:0/774187753 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f8ffad9d640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15f680 0x7f8ffc0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f8ffa59c640 1 --2- 172.21.15.137:0/774187753 >> v2:172.21.15.170:3300/0 conn(0x7f8ffc163aa0 0x7f8ffc0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718525825 0 0) 0x7f8ffc0d3f50 con 0x7f8ffc0b60b0 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.608+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fe4003520 con 0x7f8ffc0b60b0 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2929409847 0 0) 0x7f8fe4003520 con 0x7f8ffc0b60b0 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15f680 msgr2=0x7f8ffc0d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15f680 0x7f8ffc0d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 >> v2:172.21.15.170:3300/0 conn(0x7f8ffc163aa0 msgr2=0x7f8ffc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 --2- 172.21.15.137:0/774187753 >> v2:172.21.15.170:3300/0 conn(0x7f8ffc163aa0 0x7f8ffc0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0b5370 con 0x7f8ffc0b60b0 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f8ff4001670 con 0x7f8ffc0b60b0 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffa59c640 1 --2- 172.21.15.137:0/774187753 >> v2:172.21.15.170:3300/0 conn(0x7f8ffc163aa0 0x7f8ffc0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 >> v1:172.21.15.137:6789/0 conn(0x7f8ffc0b60b0 legacy=0x7f8ffc0d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fe40039b0 0x7f8fe4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15f680 0x7f8fe4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe4004d40 0x7f8fe40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc15fa60 con 0x7f8fe4004d40 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc0b5090 con 0x7f8fe40039b0 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe400b9c0 con 0x7f8ffc15f680 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffb59e640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe4004d40 0x7f8fe40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffad9d640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fe40039b0 0x7f8fe4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffa59c640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15f680 0x7f8fe4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffb59e640 1 -- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15f680 msgr2=0x7f8fe4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:52.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffb59e640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15f680 0x7f8fe4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffb59e640 1 -- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fe40039b0 msgr2=0x7f8fe4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffb59e640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8fe40039b0 0x7f8fe4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffb59e640 1 -- 172.21.15.137:0/774187753 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe4003520 con 0x7f8fe4004d40 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.609+0000 7f8ffa59c640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15f680 0x7f8fe4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.610+0000 7f8ffb59e640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe4004d40 0x7f8fe40051c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4001050 tx=0x7f8fe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec98e1c79fbe1efe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.610+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff402e070 con 0x7f8fe4004d40 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.610+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4005af0 con 0x7f8fe4004d40 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.610+0000 7f8ff9d9b640 1 -- 172.21.15.137:0/774187753 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4007d70 con 0x7f8fe4004d40 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.610+0000 7f9001140640 1 -- 172.21.15.137:0/774187753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe4004d40 msgr2=0x7f8fe40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.610+0000 7f9001140640 1 --2- 172.21.15.137:0/774187753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8fe4004d40 0x7f8fe40051c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4001050 tx=0x7f8fe4005830 comp rx=0 tx=0).stop 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.610+0000 7f8ffb59e640 1 -- 172.21.15.137:0/774187753 reap_dead start 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.610+0000 7f9001140640 1 -- 172.21.15.137:0/774187753 shutdown_connections 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.610+0000 7f9001140640 1 -- 172.21.15.137:0/774187753 >> 172.21.15.137:0/774187753 conn(0x7f8ffc08eca0 msgr2=0x7f8ffc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:52.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.611+0000 7f9001140640 1 -- 172.21.15.137:0/774187753 shutdown_connections 2024-04-26T22:02:52.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.611+0000 7f9001140640 1 -- 172.21.15.137:0/774187753 wait complete. 2024-04-26T22:02:52.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.612+0000 7f9001140640 1 Processor -- start 2024-04-26T22:02:52.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.612+0000 7f9001140640 1 -- start start 2024-04-26T22:02:52.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f9001140640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc1537f0 0x7f8ffc15d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f9001140640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc153bd0 0x7f8ffc15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f9001140640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15dae0 0x7f8ffc15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f9001140640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc0d57b0 con 0x7f8ffc1537f0 2024-04-26T22:02:52.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f9001140640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc0d5630 con 0x7f8ffc153bd0 2024-04-26T22:02:52.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f9001140640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc0d5930 con 0x7f8ffc15dae0 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8ffad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc1537f0 0x7f8ffc15d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8ffad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc1537f0 0x7f8ffc15d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50604/0 (socket says 172.21.15.137:50604) 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8ffad9d640 1 -- 172.21.15.137:0/1695241812 learned_addr learned my addr 172.21.15.137:0/1695241812 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8ffad9d640 1 -- 172.21.15.137:0/1695241812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15dae0 msgr2=0x7f8ffc15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8ffad9d640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15dae0 0x7f8ffc15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8ffad9d640 1 -- 172.21.15.137:0/1695241812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc153bd0 msgr2=0x7f8ffc15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8ffad9d640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc153bd0 0x7f8ffc15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8ffad9d640 1 -- 172.21.15.137:0/1695241812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0d17a0 con 0x7f8ffc1537f0 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8ffad9d640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc1537f0 0x7f8ffc15d5a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009fc0 tx=0x7f8fec00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8fe37fe640 1 -- 172.21.15.137:0/1695241812 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec015430 con 0x7f8ffc1537f0 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8fe37fe640 1 -- 172.21.15.137:0/1695241812 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec0155d0 con 0x7f8ffc1537f0 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f8fe37fe640 1 -- 172.21.15.137:0/1695241812 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0159a0 con 0x7f8ffc1537f0 2024-04-26T22:02:52.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.613+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc0d1a80 con 0x7f8ffc1537f0 2024-04-26T22:02:52.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.614+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc0d2040 con 0x7f8ffc1537f0 2024-04-26T22:02:52.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.614+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc06a290 con 0x7f8ffc1537f0 2024-04-26T22:02:52.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.615+0000 7f8fe37fe640 1 -- 172.21.15.137:0/1695241812 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fec015b40 con 0x7f8ffc1537f0 2024-04-26T22:02:52.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.615+0000 7f8fe37fe640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fe806c920 0x7f8fe806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.615+0000 7f8fe37fe640 1 -- 172.21.15.137:0/1695241812 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f8fec08cd40 con 0x7f8ffc1537f0 2024-04-26T22:02:52.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.615+0000 7f8ffa59c640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fe806c920 0x7f8fe806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.616+0000 7f8ffa59c640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fe806c920 0x7f8fe806ede0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0a3200 tx=0x7f8ff0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:52.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.620+0000 7f8fe37fe640 1 -- 172.21.15.137:0/1695241812 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8fec019030 con 0x7f8ffc1537f0 2024-04-26T22:02:52.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.794+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8ffc0b4cd0 con 0x7f8ffc1537f0 2024-04-26T22:02:52.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.794+0000 7f8fe37fe640 1 -- 172.21.15.137:0/1695241812 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f8fec010040 con 0x7f8ffc1537f0 2024-04-26T22:02:52.794 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:02:52.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fe806c920 msgr2=0x7f8fe806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fe806c920 0x7f8fe806ede0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0a3200 tx=0x7f8ff0008040 comp rx=0 tx=0).stop 2024-04-26T22:02:52.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc1537f0 msgr2=0x7f8ffc15d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc1537f0 0x7f8ffc15d5a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009fc0 tx=0x7f8fec00f580 comp rx=0 tx=0).stop 2024-04-26T22:02:52.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 shutdown_connections 2024-04-26T22:02:52.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8fe806c920 0x7f8fe806ede0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ffc15dae0 0x7f8ffc15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ffc153bd0 0x7f8ffc15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 --2- 172.21.15.137:0/1695241812 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ffc1537f0 0x7f8ffc15d5a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 >> 172.21.15.137:0/1695241812 conn(0x7f8ffc08eca0 msgr2=0x7f8ffc15e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:52.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 shutdown_connections 2024-04-26T22:02:52.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.796+0000 7f9001140640 1 -- 172.21.15.137:0/1695241812 wait complete. 2024-04-26T22:02:52.807 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:02:52.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.906+0000 7f04a0540640 1 Processor -- start 2024-04-26T22:02:52.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.906+0000 7f04a0540640 1 -- start start 2024-04-26T22:02:52.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.907+0000 7f04a0540640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f049815f680 0x7f04980d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.907+0000 7f04a0540640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0498163aa0 0x7f04980b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.907+0000 7f04a0540640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04980d3f50 con 0x7f04980b60b0 2024-04-26T22:02:52.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.907+0000 7f04a0540640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f049815fa60 con 0x7f0498163aa0 2024-04-26T22:02:52.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.907+0000 7f04a0540640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04980b5090 con 0x7f049815f680 2024-04-26T22:02:52.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.908+0000 7f049dadb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0498163aa0 0x7f04980b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.908+0000 7f049e2dc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f049815f680 0x7f04980d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.908+0000 7f049e2dc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f049815f680 0x7f04980d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:35050/0 (socket says 172.21.15.137:35050) 2024-04-26T22:02:52.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.908+0000 7f049e2dc640 1 -- 172.21.15.137:0/2907105225 learned_addr learned my addr 172.21.15.137:0/2907105225 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:52.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.908+0000 7f049dadb640 1 -- 172.21.15.137:0/2907105225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f049815f680 msgr2=0x7f04980d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:52.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.908+0000 7f049dadb640 1 --2- 172.21.15.137:0/2907105225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f049815f680 0x7f04980d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.908+0000 7f049dadb640 1 -- 172.21.15.137:0/2907105225 >> v1:172.21.15.170:6789/0 conn(0x7f04980b60b0 legacy=0x7f04980d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.908+0000 7f049dadb640 1 -- 172.21.15.137:0/2907105225 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04980b5370 con 0x7f0498163aa0 2024-04-26T22:02:52.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.908+0000 7f049e2dc640 1 --2- 172.21.15.137:0/2907105225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f049815f680 0x7f04980d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:02:52.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.909+0000 7f049dadb640 1 --2- 172.21.15.137:0/2907105225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 0x7f04980b5b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f04880097a0 tx=0x7f048802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3867ad65dbb40ea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:52.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.909+0000 7f049d2da640 1 -- 172.21.15.137:0/2907105225 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488037070 con 0x7f0498163aa0 2024-04-26T22:02:52.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.909+0000 7f049d2da640 1 -- 172.21.15.137:0/2907105225 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488032440 con 0x7f0498163aa0 2024-04-26T22:02:52.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.909+0000 7f049d2da640 1 -- 172.21.15.137:0/2907105225 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488032810 con 0x7f0498163aa0 2024-04-26T22:02:52.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.909+0000 7f04a0540640 1 -- 172.21.15.137:0/2907105225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 msgr2=0x7f04980b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.910+0000 7f04a0540640 1 --2- 172.21.15.137:0/2907105225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 0x7f04980b5b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f04880097a0 tx=0x7f048802a180 comp rx=0 tx=0).stop 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.910+0000 7f04a0540640 1 -- 172.21.15.137:0/2907105225 shutdown_connections 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.910+0000 7f04a0540640 1 --2- 172.21.15.137:0/2907105225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 0x7f04980b5b70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.910+0000 7f04a0540640 1 --2- 172.21.15.137:0/2907105225 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f049815f680 0x7f04980d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.910+0000 7f04a0540640 1 -- 172.21.15.137:0/2907105225 >> 172.21.15.137:0/2907105225 conn(0x7f049808eca0 msgr2=0x7f049809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.910+0000 7f04a0540640 1 -- 172.21.15.137:0/2907105225 shutdown_connections 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.910+0000 7f04a0540640 1 -- 172.21.15.137:0/2907105225 wait complete. 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.911+0000 7f04a0540640 1 Processor -- start 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.911+0000 7f04a0540640 1 -- start start 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.911+0000 7f04a0540640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04980b60b0 0x7f04981605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.911+0000 7f04a0540640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f049815f680 0x7f04981e90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.911+0000 7f04a0540640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 0x7f0498153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.911+0000 7f04a0540640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04980d57b0 con 0x7f049815f680 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.911+0000 7f04a0540640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f04980d5630 con 0x7f0498163aa0 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.911+0000 7f04a0540640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04980d5930 con 0x7f04980b60b0 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049dadb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f049815f680 0x7f04981e90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049dadb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f049815f680 0x7f04981e90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50606/0 (socket says 172.21.15.137:50606) 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049dadb640 1 -- 172.21.15.137:0/1888348988 learned_addr learned my addr 172.21.15.137:0/1888348988 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049e2dc640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04980b60b0 0x7f04981605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049eadd640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 0x7f0498153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049dadb640 1 -- 172.21.15.137:0/1888348988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04980b60b0 msgr2=0x7f04981605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049dadb640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04980b60b0 0x7f04981605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049dadb640 1 -- 172.21.15.137:0/1888348988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 msgr2=0x7f0498153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049dadb640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 0x7f0498153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:52.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049dadb640 1 -- 172.21.15.137:0/1888348988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04981e9620 con 0x7f049815f680 2024-04-26T22:02:52.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049eadd640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 0x7f0498153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:52.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f049dadb640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f049815f680 0x7f04981e90e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f0488035040 tx=0x7f04880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:52.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f048effd640 1 -- 172.21.15.137:0/1888348988 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488041020 con 0x7f049815f680 2024-04-26T22:02:52.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f048effd640 1 -- 172.21.15.137:0/1888348988 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488030700 con 0x7f049815f680 2024-04-26T22:02:52.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0498160c80 con 0x7f049815f680 2024-04-26T22:02:52.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f048effd640 1 -- 172.21.15.137:0/1888348988 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488037040 con 0x7f049815f680 2024-04-26T22:02:52.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.912+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0498161240 con 0x7f049815f680 2024-04-26T22:02:52.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.913+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049806a290 con 0x7f049815f680 2024-04-26T22:02:52.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.914+0000 7f048effd640 1 -- 172.21.15.137:0/1888348988 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0488044020 con 0x7f049815f680 2024-04-26T22:02:52.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.914+0000 7f048effd640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f047c06c8f0 0x7f047c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:52.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.914+0000 7f049e2dc640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f047c06c8f0 0x7f047c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:52.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.915+0000 7f048effd640 1 -- 172.21.15.137:0/1888348988 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f04880ac3c0 con 0x7f049815f680 2024-04-26T22:02:52.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.915+0000 7f049e2dc640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f047c06c8f0 0x7f047c06edb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f04981f86c0 tx=0x7f049400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:52.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:52.919+0000 7f048effd640 1 -- 172.21.15.137:0/1888348988 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f048804b030 con 0x7f049815f680 2024-04-26T22:02:53.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.090+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f04980b2330 con 0x7f049815f680 2024-04-26T22:02:53.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.090+0000 7f048effd640 1 -- 172.21.15.137:0/1888348988 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) ==== 104+0+11 (secure 0 0 0) 0x7f048807a790 con 0x7f049815f680 2024-04-26T22:02:53.090 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:02:53.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f047c06c8f0 msgr2=0x7f047c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f047c06c8f0 0x7f047c06edb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f04981f86c0 tx=0x7f049400b040 comp rx=0 tx=0).stop 2024-04-26T22:02:53.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f049815f680 msgr2=0x7f04981e90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f049815f680 0x7f04981e90e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f0488035040 tx=0x7f04880046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 shutdown_connections 2024-04-26T22:02:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f047c06c8f0 0x7f047c06edb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f049815f680 0x7f04981e90e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0498163aa0 0x7f0498153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 --2- 172.21.15.137:0/1888348988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04980b60b0 0x7f04981605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 >> 172.21.15.137:0/1888348988 conn(0x7f049808eca0 msgr2=0x7f04980b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 shutdown_connections 2024-04-26T22:02:53.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.092+0000 7f04a0540640 1 -- 172.21.15.137:0/1888348988 wait complete. 2024-04-26T22:02:53.103 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:02:53.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.206+0000 7f4fb1f91640 1 Processor -- start 2024-04-26T22:02:53.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.206+0000 7f4fb1f91640 1 -- start start 2024-04-26T22:02:53.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.206+0000 7f4fb1f91640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4fac15f680 0x7f4fac0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.206+0000 7f4fb1f91640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac0d3f50 con 0x7f4fac163aa0 2024-04-26T22:02:53.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.206+0000 7f4fb1f91640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac0b5090 con 0x7f4fac0d4f20 2024-04-26T22:02:53.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.206+0000 7f4fb1f91640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4fac15fa60 con 0x7f4fac15f680 2024-04-26T22:02:53.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.207+0000 7f4fa3fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4fac163aa0 0x7f4fac0b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48604/0 (socket says 172.21.15.137:48604) 2024-04-26T22:02:53.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.207+0000 7f4fa3fff640 1 -- 172.21.15.137:0/2639943370 learned_addr learned my addr 172.21.15.137:0/2639943370 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:53.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.207+0000 7f4fab7fe640 1 --2- 172.21.15.137:0/2639943370 >> v2:172.21.15.170:3300/0 conn(0x7f4fac15f680 0x7f4fac0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.207+0000 7f4faaffd640 1 -- 172.21.15.137:0/2639943370 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102582438 0 0) 0x7f4fac0d3f50 con 0x7f4fac163aa0 2024-04-26T22:02:53.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.207+0000 7f4faaffd640 1 -- 172.21.15.137:0/2639943370 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f98003520 con 0x7f4fac163aa0 2024-04-26T22:02:53.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.207+0000 7f4faaffd640 1 -- 172.21.15.137:0/2639943370 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2786895232 0 0) 0x7f4f98003520 con 0x7f4fac163aa0 2024-04-26T22:02:53.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.207+0000 7f4fab7fe640 1 -- 172.21.15.137:0/2639943370 >> v1:172.21.15.170:6789/0 conn(0x7f4fac0d4f20 legacy=0x7f4fac0d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.207+0000 7f4fab7fe640 1 -- 172.21.15.137:0/2639943370 >> v1:172.21.15.137:6789/0 conn(0x7f4fac163aa0 legacy=0x7f4fac0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.207+0000 7f4fab7fe640 1 -- 172.21.15.137:0/2639943370 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac0b5370 con 0x7f4fac15f680 2024-04-26T22:02:53.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.208+0000 7f4fab7fe640 1 --2- 172.21.15.137:0/2639943370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fac15f680 0x7f4fac0d3820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0097a0 tx=0x7f4f9c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a618e9eec2ee343 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.208+0000 7f4faaffd640 1 -- 172.21.15.137:0/2639943370 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c037070 con 0x7f4fac15f680 2024-04-26T22:02:53.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.208+0000 7f4faaffd640 1 -- 172.21.15.137:0/2639943370 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f9c02ac50 con 0x7f4fac15f680 2024-04-26T22:02:53.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.208+0000 7f4faaffd640 1 -- 172.21.15.137:0/2639943370 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94001690 con 0x7f4fac15f680 2024-04-26T22:02:53.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.208+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2639943370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fac15f680 msgr2=0x7f4fac0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.208+0000 7f4fb1f91640 1 --2- 172.21.15.137:0/2639943370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fac15f680 0x7f4fac0d3820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0097a0 tx=0x7f4f9c02a1c0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.208+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2639943370 shutdown_connections 2024-04-26T22:02:53.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.208+0000 7f4fb1f91640 1 --2- 172.21.15.137:0/2639943370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fac15f680 0x7f4fac0d3820 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.208+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2639943370 >> 172.21.15.137:0/2639943370 conn(0x7f4fac08eca0 msgr2=0x7f4fac09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.209+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2639943370 shutdown_connections 2024-04-26T22:02:53.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.209+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2639943370 wait complete. 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fb1f91640 1 Processor -- start 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fb1f91640 1 -- start start 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fb1f91640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fac0d4f20 0x7f4fac159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fb1f91640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fac15f680 0x7f4fac0b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fb1f91640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fac163aa0 0x7f4fac0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fb1f91640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac0cfd80 con 0x7f4fac15f680 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fb1f91640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac163f30 con 0x7f4fac0d4f20 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fb1f91640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac0cff00 con 0x7f4fac163aa0 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fa3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fac15f680 0x7f4fac0b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fa3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fac15f680 0x7f4fac0b2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50618/0 (socket says 172.21.15.137:50618) 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.210+0000 7f4fa3fff640 1 -- 172.21.15.137:0/2430650591 learned_addr learned my addr 172.21.15.137:0/2430650591 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fab7fe640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fac0d4f20 0x7f4fac159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fabfff640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fac163aa0 0x7f4fac0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fa3fff640 1 -- 172.21.15.137:0/2430650591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fac163aa0 msgr2=0x7f4fac0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fa3fff640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fac163aa0 0x7f4fac0b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fa3fff640 1 -- 172.21.15.137:0/2430650591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fac0d4f20 msgr2=0x7f4fac159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fa3fff640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fac0d4f20 0x7f4fac159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fa3fff640 1 -- 172.21.15.137:0/2430650591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac161210 con 0x7f4fac15f680 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fabfff640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fac163aa0 0x7f4fac0b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fa3fff640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fac15f680 0x7f4fac0b2f00 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400c520 tx=0x7f4f9400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fa8ff9640 1 -- 172.21.15.137:0/2430650591 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94018070 con 0x7f4fac15f680 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fa8ff9640 1 -- 172.21.15.137:0/2430650591 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f940074e0 con 0x7f4fac15f680 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac15fe30 con 0x7f4fac15f680 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fa8ff9640 1 -- 172.21.15.137:0/2430650591 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f94004a20 con 0x7f4fac15f680 2024-04-26T22:02:53.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.211+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac1603f0 con 0x7f4fac15f680 2024-04-26T22:02:53.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.212+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fac06a290 con 0x7f4fac15f680 2024-04-26T22:02:53.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.213+0000 7f4fa8ff9640 1 -- 172.21.15.137:0/2430650591 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f9401b070 con 0x7f4fac15f680 2024-04-26T22:02:53.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.213+0000 7f4fa8ff9640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4f8c06c8f0 0x7f4f8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.213+0000 7f4fab7fe640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4f8c06c8f0 0x7f4f8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.213+0000 7f4fa8ff9640 1 -- 172.21.15.137:0/2430650591 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f4f9408afa0 con 0x7f4fac15f680 2024-04-26T22:02:53.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.214+0000 7f4fab7fe640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4f8c06c8f0 0x7f4f8c06edb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c034000 tx=0x7f4f9c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.218+0000 7f4fa8ff9640 1 -- 172.21.15.137:0/2430650591 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4f94059370 con 0x7f4fac15f680 2024-04-26T22:02:53.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.392+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4fac0baf40 con 0x7f4fac15f680 2024-04-26T22:02:53.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.392+0000 7f4fa8ff9640 1 -- 172.21.15.137:0/2430650591 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) ==== 100+0+11 (secure 0 0 0) 0x7f4f9405f020 con 0x7f4fac15f680 2024-04-26T22:02:53.392 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:02:53.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4f8c06c8f0 msgr2=0x7f4f8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4f8c06c8f0 0x7f4f8c06edb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c034000 tx=0x7f4f9c02e000 comp rx=0 tx=0).stop 2024-04-26T22:02:53.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fac15f680 msgr2=0x7f4fac0b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fac15f680 0x7f4fac0b2f00 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400c520 tx=0x7f4f9400c9e0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 shutdown_connections 2024-04-26T22:02:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4f8c06c8f0 0x7f4f8c06edb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fac15f680 0x7f4fac0b2f00 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fac163aa0 0x7f4fac0b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 --2- 172.21.15.137:0/2430650591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fac0d4f20 0x7f4fac159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 >> 172.21.15.137:0/2430650591 conn(0x7f4fac08eca0 msgr2=0x7f4fac0b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 shutdown_connections 2024-04-26T22:02:53.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.394+0000 7f4fb1f91640 1 -- 172.21.15.137:0/2430650591 wait complete. 2024-04-26T22:02:53.406 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:02:53.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.505+0000 7f0f82f0a640 1 Processor -- start 2024-04-26T22:02:53.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.505+0000 7f0f82f0a640 1 -- start start 2024-04-26T22:02:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f82f0a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0f7c0b44e0 0x7f0f7c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f82f0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c06d2b0 0x7f0f7c06d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f82f0a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7c0b4a10 con 0x7f0f7c15f1e0 2024-04-26T22:02:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f82f0a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7c06eeb0 con 0x7f0f7c0b44e0 2024-04-26T22:02:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f82f0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c0b4cf0 con 0x7f0f7c06d2b0 2024-04-26T22:02:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f80ca6640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0f7c15f1e0 0x7f0f7c0ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48608/0 (socket says 172.21.15.137:48608) 2024-04-26T22:02:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f80ca6640 1 -- 172.21.15.137:0/202452494 learned_addr learned my addr 172.21.15.137:0/202452494 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7bfff640 1 --2- 172.21.15.137:0/202452494 >> v2:172.21.15.170:3300/0 conn(0x7f0f7c0b44e0 0x7f0f7c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f814a7640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c06d2b0 0x7f0f7c06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285524361 0 0) 0x7f0f7c0b4a10 con 0x7f0f7c15f1e0 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f6c003520 con 0x7f0f7c15f1e0 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4141669599 0 0) 0x7f0f6c003520 con 0x7f0f7c15f1e0 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c06d2b0 msgr2=0x7f0f7c06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c06d2b0 0x7f0f7c06d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 >> v2:172.21.15.170:3300/0 conn(0x7f0f7c0b44e0 msgr2=0x7f0f7c06e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 --2- 172.21.15.137:0/202452494 >> v2:172.21.15.170:3300/0 conn(0x7f0f7c0b44e0 0x7f0f7c06e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c0b4fd0 con 0x7f0f7c15f1e0 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f0f70001670 con 0x7f0f7c15f1e0 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 >> v1:172.21.15.137:6789/0 conn(0x7f0f7c15f1e0 legacy=0x7f0f7c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f6c0039b0 0x7f0f6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c06d2b0 0x7f0f6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f6c004d40 0x7f0f6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c06eeb0 con 0x7f0f6c004d40 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c0b4cf0 con 0x7f0f6c0039b0 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c00b9c0 con 0x7f0f7c06d2b0 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.506+0000 7f0f814a7640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f6c004d40 0x7f0f6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.507+0000 7f0f80ca6640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f6c0039b0 0x7f0f6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.507+0000 7f0f7bfff640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c06d2b0 0x7f0f6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.507+0000 7f0f814a7640 1 -- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c06d2b0 msgr2=0x7f0f6c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.507+0000 7f0f814a7640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c06d2b0 0x7f0f6c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.507+0000 7f0f814a7640 1 -- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f6c0039b0 msgr2=0x7f0f6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.507+0000 7f0f814a7640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f6c0039b0 0x7f0f6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.507+0000 7f0f814a7640 1 -- 172.21.15.137:0/202452494 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c003520 con 0x7f0f6c004d40 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.507+0000 7f0f814a7640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f6c004d40 0x7f0f6c0051c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009fc0 tx=0x7f0f6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdbec937fa3a888 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74009c10 con 0x7f0f6c004d40 2024-04-26T22:02:53.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f74036070 con 0x7f0f6c004d40 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f7b7fe640 1 -- 172.21.15.137:0/202452494 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74031880 con 0x7f0f6c004d40 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f82f0a640 1 -- 172.21.15.137:0/202452494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f6c004d40 msgr2=0x7f0f6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f82f0a640 1 --2- 172.21.15.137:0/202452494 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f6c004d40 0x7f0f6c0051c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009fc0 tx=0x7f0f6c005830 comp rx=0 tx=0).stop 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f814a7640 1 -- 172.21.15.137:0/202452494 reap_dead start 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f82f0a640 1 -- 172.21.15.137:0/202452494 shutdown_connections 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f82f0a640 1 -- 172.21.15.137:0/202452494 >> 172.21.15.137:0/202452494 conn(0x7f0f7c0728a0 msgr2=0x7f0f7c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f82f0a640 1 -- 172.21.15.137:0/202452494 shutdown_connections 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.508+0000 7f0f82f0a640 1 -- 172.21.15.137:0/202452494 wait complete. 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.509+0000 7f0f82f0a640 1 Processor -- start 2024-04-26T22:02:53.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.509+0000 7f0f82f0a640 1 -- start start 2024-04-26T22:02:53.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f82f0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c150c40 0x7f0f7c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f82f0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c15aa20 0x7f0f7c1615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f82f0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f7c15b110 0x7f0f7c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f82f0a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c15f5c0 con 0x7f0f7c15b110 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f82f0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7c0b5590 con 0x7f0f7c150c40 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f82f0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7c15d7f0 con 0x7f0f7c15aa20 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f814a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f7c15b110 0x7f0f7c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f814a7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f7c15b110 0x7f0f7c15b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50626/0 (socket says 172.21.15.137:50626) 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f814a7640 1 -- 172.21.15.137:0/2727981873 learned_addr learned my addr 172.21.15.137:0/2727981873 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f7bfff640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c15aa20 0x7f0f7c1615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.510+0000 7f0f80ca6640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c150c40 0x7f0f7c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f814a7640 1 -- 172.21.15.137:0/2727981873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c15aa20 msgr2=0x7f0f7c1615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f814a7640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c15aa20 0x7f0f7c1615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f814a7640 1 -- 172.21.15.137:0/2727981873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c150c40 msgr2=0x7f0f7c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f814a7640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c150c40 0x7f0f7c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f814a7640 1 -- 172.21.15.137:0/2727981873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7c161de0 con 0x7f0f7c15b110 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f814a7640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f7c15b110 0x7f0f7c15b590 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400e230 tx=0x7f0f74009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f797fa640 1 -- 172.21.15.137:0/2727981873 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74009c10 con 0x7f0f7c15b110 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f797fa640 1 -- 172.21.15.137:0/2727981873 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f74031df0 con 0x7f0f7c15b110 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7c1620c0 con 0x7f0f7c15b110 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f797fa640 1 -- 172.21.15.137:0/2727981873 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74003bd0 con 0x7f0f7c15b110 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.511+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7c15cab0 con 0x7f0f7c15b110 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.512+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7c06ec70 con 0x7f0f7c15b110 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.512+0000 7f0f797fa640 1 -- 172.21.15.137:0/2727981873 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f74005d10 con 0x7f0f7c15b110 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.513+0000 7f0f797fa640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6006c920 0x7f0f6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.513+0000 7f0f797fa640 1 -- 172.21.15.137:0/2727981873 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7f0f740acc60 con 0x7f0f7c15b110 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.513+0000 7f0f80ca6640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6006c920 0x7f0f6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.513+0000 7f0f80ca6640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6006c920 0x7f0f6006ede0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0f70001050 tx=0x7f0f70007970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.517+0000 7f0f797fa640 1 -- 172.21.15.137:0/2727981873 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f7c06ec70 con 0x7f0f7c15b110 2024-04-26T22:02:53.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.705+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0f7c06a290 con 0x7f0f7c15b110 2024-04-26T22:02:53.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.705+0000 7f0f797fa640 1 -- 172.21.15.137:0/2727981873 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v73) ==== 80+0+124 (secure 0 0 0) 0x7f0f7404a060 con 0x7f0f7c15b110 2024-04-26T22:02:53.705 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6837/1566574554 2024-04-27T22:02:45.720691+0000 2024-04-26T22:02:53.705 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6835/1566574554 2024-04-27T22:02:45.720691+0000 2024-04-26T22:02:53.706 INFO:teuthology.orchestra.run.smithi137.stderr:listed 2 entries 2024-04-26T22:02:53.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6006c920 msgr2=0x7f0f6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6006c920 0x7f0f6006ede0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0f70001050 tx=0x7f0f70007970 comp rx=0 tx=0).stop 2024-04-26T22:02:53.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f7c15b110 msgr2=0x7f0f7c15b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f7c15b110 0x7f0f7c15b590 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400e230 tx=0x7f0f74009750 comp rx=0 tx=0).stop 2024-04-26T22:02:53.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 shutdown_connections 2024-04-26T22:02:53.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f6006c920 0x7f0f6006ede0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f7c15b110 0x7f0f7c15b590 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f7c15aa20 0x7f0f7c1615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 --2- 172.21.15.137:0/2727981873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f7c150c40 0x7f0f7c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 >> 172.21.15.137:0/2727981873 conn(0x7f0f7c0728a0 msgr2=0x7f0f7c1634c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 shutdown_connections 2024-04-26T22:02:53.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.707+0000 7f0f82f0a640 1 -- 172.21.15.137:0/2727981873 wait complete. 2024-04-26T22:02:53.718 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:02:53.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:53.718 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:02:53.744 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:02:53.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:53.745 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:02:53.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:53.800 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-04-26T22:02:53.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.941+0000 7fc06da7b640 1 Processor -- start 2024-04-26T22:02:53.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.942+0000 7fc06da7b640 1 -- start start 2024-04-26T22:02:53.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.942+0000 7fc06da7b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc068160700 0x7fc0680ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.942+0000 7fc06da7b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc06815f670 0x7fc0680cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.942+0000 7fc06da7b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0680d1320 con 0x7fc06806d2b0 2024-04-26T22:02:53.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.942+0000 7fc06da7b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc068160270 con 0x7fc06815f670 2024-04-26T22:02:53.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.942+0000 7fc06da7b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc06815fc20 con 0x7fc068160700 2024-04-26T22:02:53.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc0677fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc06806d2b0 0x7fc06806d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48616/0 (socket says 172.21.15.137:48616) 2024-04-26T22:02:53.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc0677fe640 1 -- 172.21.15.137:0/2464036420 learned_addr learned my addr 172.21.15.137:0/2464036420 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:53.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc067fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc06815f670 0x7fc0680cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc066ffd640 1 --2- 172.21.15.137:0/2464036420 >> v2:172.21.15.170:3300/0 conn(0x7fc068160700 0x7fc0680ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc0667fc640 1 -- 172.21.15.137:0/2464036420 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837307171 0 0) 0x7fc0680d1320 con 0x7fc06806d2b0 2024-04-26T22:02:53.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc0667fc640 1 -- 172.21.15.137:0/2464036420 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc050003520 con 0x7fc06806d2b0 2024-04-26T22:02:53.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc067fff640 1 -- 172.21.15.137:0/2464036420 >> v2:172.21.15.170:3300/0 conn(0x7fc068160700 msgr2=0x7fc0680ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc067fff640 1 --2- 172.21.15.137:0/2464036420 >> v2:172.21.15.170:3300/0 conn(0x7fc068160700 0x7fc0680ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc067fff640 1 -- 172.21.15.137:0/2464036420 >> v1:172.21.15.137:6789/0 conn(0x7fc06806d2b0 legacy=0x7fc06806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.943+0000 7fc067fff640 1 -- 172.21.15.137:0/2464036420 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06815ff00 con 0x7fc06815f670 2024-04-26T22:02:53.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc067fff640 1 --2- 172.21.15.137:0/2464036420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06815f670 0x7fc0680cf290 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc068074240 tx=0x7fc06002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb2f62ff3b61b04 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc0667fc640 1 -- 172.21.15.137:0/2464036420 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060007740 con 0x7fc06815f670 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc0667fc640 1 -- 172.21.15.137:0/2464036420 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0600078e0 con 0x7fc06815f670 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc0667fc640 1 -- 172.21.15.137:0/2464036420 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060007cb0 con 0x7fc06815f670 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc06da7b640 1 -- 172.21.15.137:0/2464036420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06815f670 msgr2=0x7fc0680cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc06da7b640 1 --2- 172.21.15.137:0/2464036420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06815f670 0x7fc0680cf290 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc068074240 tx=0x7fc06002a560 comp rx=0 tx=0).stop 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc06da7b640 1 -- 172.21.15.137:0/2464036420 shutdown_connections 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc06da7b640 1 --2- 172.21.15.137:0/2464036420 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06815f670 0x7fc0680cf290 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc06da7b640 1 --2- 172.21.15.137:0/2464036420 >> v2:172.21.15.170:3300/0 conn(0x7fc068160700 0x7fc0680ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc06da7b640 1 -- 172.21.15.137:0/2464036420 >> 172.21.15.137:0/2464036420 conn(0x7fc068072900 msgr2=0x7fc068072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc06da7b640 1 -- 172.21.15.137:0/2464036420 shutdown_connections 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.944+0000 7fc06da7b640 1 -- 172.21.15.137:0/2464036420 wait complete. 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.945+0000 7fc06da7b640 1 Processor -- start 2024-04-26T22:02:53.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc06da7b640 1 -- start start 2024-04-26T22:02:53.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc06da7b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06806d2b0 0x7fc0681532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc06da7b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815f670 0x7fc068151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc06da7b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068160700 0x7fc0680b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc06da7b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc068071270 con 0x7fc06806d2b0 2024-04-26T22:02:53.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc06da7b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc0680710f0 con 0x7fc06815f670 2024-04-26T22:02:53.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc06da7b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc0680cf7d0 con 0x7fc068160700 2024-04-26T22:02:53.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc0677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06806d2b0 0x7fc0681532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc0677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06806d2b0 0x7fc0681532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50650/0 (socket says 172.21.15.137:50650) 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.946+0000 7fc0677fe640 1 -- 172.21.15.137:0/1600216691 learned_addr learned my addr 172.21.15.137:0/1600216691 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc066ffd640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815f670 0x7fc068151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc067fff640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068160700 0x7fc0680b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc0677fe640 1 -- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068160700 msgr2=0x7fc0680b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc0677fe640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068160700 0x7fc0680b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc0677fe640 1 -- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815f670 msgr2=0x7fc068151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc0677fe640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815f670 0x7fc068151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc0677fe640 1 -- 172.21.15.137:0/1600216691 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc068152230 con 0x7fc06806d2b0 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc066ffd640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815f670 0x7fc068151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc067fff640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068160700 0x7fc0680b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:53.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc0677fe640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06806d2b0 0x7fc0681532d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c430 tx=0x7fc05800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc04ffff640 1 -- 172.21.15.137:0/1600216691 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058017070 con 0x7fc06806d2b0 2024-04-26T22:02:53.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc04ffff640 1 -- 172.21.15.137:0/1600216691 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058005ce0 con 0x7fc06806d2b0 2024-04-26T22:02:53.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc06da7b640 1 -- 172.21.15.137:0/1600216691 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc068152510 con 0x7fc06806d2b0 2024-04-26T22:02:53.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc04ffff640 1 -- 172.21.15.137:0/1600216691 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0580072f0 con 0x7fc06806d2b0 2024-04-26T22:02:53.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.947+0000 7fc06da7b640 1 -- 172.21.15.137:0/1600216691 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc068152ad0 con 0x7fc06806d2b0 2024-04-26T22:02:53.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.949+0000 7fc04ffff640 1 -- 172.21.15.137:0/1600216691 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc05801a070 con 0x7fc06806d2b0 2024-04-26T22:02:53.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.949+0000 7fc04ffff640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05406c8f0 0x7fc05406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.949+0000 7fc04ffff640 1 -- 172.21.15.137:0/1600216691 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7fc05808b000 con 0x7fc06806d2b0 2024-04-26T22:02:53.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.949+0000 7fc066ffd640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05406c8f0 0x7fc05406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.950+0000 7fc066ffd640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05406c8f0 0x7fc05406edb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc05c006fd0 tx=0x7fc05c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.950+0000 7fc070794740 1 Processor -- start 2024-04-26T22:02:53.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.950+0000 7fc070794740 1 -- start start 2024-04-26T22:02:53.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc070794740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad4d600 0x55d0cad00220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc070794740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 0x55d0cad2faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc070794740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad2ffe0 0x55d0cad04df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc070794740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d0cac69f80 con 0x55d0cad2ffe0 2024-04-26T22:02:53.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc070794740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d0cac05770 con 0x55d0cad30720 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc070794740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d0cac65f40 con 0x55d0cad4d600 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc067fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad2ffe0 0x55d0cad04df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc067fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad2ffe0 0x55d0cad04df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50656/0 (socket says 172.21.15.137:50656) 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc067fff640 1 -- 172.21.15.137:0/3201380405 learned_addr learned my addr 172.21.15.137:0/3201380405 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc066ffd640 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 0x55d0cad2faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc0677fe640 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad4d600 0x55d0cad00220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc067fff640 1 -- 172.21.15.137:0/3201380405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad4d600 msgr2=0x55d0cad00220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc067fff640 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad4d600 0x55d0cad00220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc067fff640 1 -- 172.21.15.137:0/3201380405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 msgr2=0x55d0cad2faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc067fff640 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 0x55d0cad2faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc067fff640 1 -- 172.21.15.137:0/3201380405 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0caa47a20 con 0x55d0cad2ffe0 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.951+0000 7fc066ffd640 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 0x55d0cad2faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.952+0000 7fc067fff640 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad2ffe0 0x55d0cad04df0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc06002ab50 tx=0x7fc06002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b516d97509ffb08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.952+0000 7fc04d7fa640 1 -- 172.21.15.137:0/3201380405 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060007840 con 0x55d0cad2ffe0 2024-04-26T22:02:53.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.952+0000 7fc04d7fa640 1 -- 172.21.15.137:0/3201380405 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc060040070 con 0x55d0cad2ffe0 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.952+0000 7fc04d7fa640 1 -- 172.21.15.137:0/3201380405 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060007be0 con 0x55d0cad2ffe0 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.952+0000 7fc070794740 1 -- 172.21.15.137:0/3201380405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad2ffe0 msgr2=0x55d0cad04df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.952+0000 7fc070794740 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad2ffe0 0x55d0cad04df0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc06002ab50 tx=0x7fc06002e000 comp rx=0 tx=0).stop 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.952+0000 7fc070794740 1 -- 172.21.15.137:0/3201380405 shutdown_connections 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.953+0000 7fc070794740 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad2ffe0 0x55d0cad04df0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.953+0000 7fc070794740 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 0x55d0cad2faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.953+0000 7fc070794740 1 --2- 172.21.15.137:0/3201380405 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad4d600 0x55d0cad00220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.953+0000 7fc070794740 1 -- 172.21.15.137:0/3201380405 >> 172.21.15.137:0/3201380405 conn(0x55d0cad02490 msgr2=0x55d0cad4aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.953+0000 7fc070794740 1 -- 172.21.15.137:0/3201380405 shutdown_connections 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.953+0000 7fc070794740 1 -- 172.21.15.137:0/3201380405 wait complete. 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.953+0000 7fc070794740 1 -- start start 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.953+0000 7fc070794740 1 Processor -- start 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc070794740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 0x55d0cad30c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc070794740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad1d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc070794740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad41760 0x55d0cad1d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc070794740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d0cad043b0 con 0x55d0cad4d600 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc070794740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d0cac03110 con 0x55d0cad30720 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc070794740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d0cad037a0 con 0x55d0cad41760 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc070794740 10 client.0 _ll_register_callbacks cb 0x55d0cac5f4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc066ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad1d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc066ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad1d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50666/0 (socket says 172.21.15.137:50666) 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc066ffd640 1 -- 172.21.15.137:0/2838172579 learned_addr learned my addr 172.21.15.137:0/2838172579 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc0677fe640 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 0x55d0cad30c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc067fff640 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad41760 0x55d0cad1d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc066ffd640 1 -- 172.21.15.137:0/2838172579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad41760 msgr2=0x55d0cad1d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc066ffd640 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad41760 0x55d0cad1d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc066ffd640 1 -- 172.21.15.137:0/2838172579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 msgr2=0x55d0cad30c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc066ffd640 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 0x55d0cad30c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc066ffd640 1 -- 172.21.15.137:0/2838172579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0ca93b310 con 0x55d0cad4d600 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc067fff640 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad41760 0x55d0cad1d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:53.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc066ffd640 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad1d0a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00eaa0 tx=0x7fc05c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df06950ed63a73f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.954+0000 7fc0467fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc0467fc640 1 -- 172.21.15.137:0/2838172579 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00f040 con 0x55d0cad4d600 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc0467fc640 1 -- 172.21.15.137:0/2838172579 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7fc05c003d90 con 0x55d0cad4d600 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc070794740 1 -- 172.21.15.137:0/2838172579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc060040070 con 0x55d0cad4d600 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc0467fc640 1 -- 172.21.15.137:0/2838172579 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc05c013430 con 0x55d0cad4d600 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc070794740 10 client.6939 fetch_fsmap learned FSMap version 39 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc070794740 1 -- 172.21.15.137:0/2838172579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55d0caaa81b0 con 0x55d0cad4d600 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc0467fc640 1 -- 172.21.15.137:0/2838172579 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc060040070 con 0x55d0cad4d600 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc0467fc640 1 -- 172.21.15.137:0/2838172579 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7fc05c02b050 con 0x55d0cad4d600 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc070794740 10 client.6939 fetch_fsmap finished waiting for FSMap version 39 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc070794740 10 client.6939 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc070794740 20 client.6939 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc070794740 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55d0cad65310 0x55d0cad67720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc070794740 4 client.6939 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:02:53.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc070794740 1 -- 172.21.15.137:0/2838172579 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0cac77b90 con 0x55d0cad65310 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc0677fe640 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55d0cad65310 0x55d0cad67720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc0677fe640 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55d0cad65310 0x55d0cad67720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ac76d2a0a83d253 server_cookie=79b35781f3a096a8 in_seq=0 out_seq=0 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.955+0000 7fc0467fc640 10 client.6939 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc0467fc640 1 -- 172.21.15.137:0/2838172579 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0cac77b90 con 0x55d0cad65310 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc0467fc640 10 client.6939 handle_command_reply: tid=0 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 client.6939 shutdown 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 -- 172.21.15.137:0/2838172579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 msgr2=0x55d0cad1d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad1d0a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00eaa0 tx=0x7fc05c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 -- 172.21.15.137:0/2838172579 shutdown_connections 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55d0cad65310 0x55d0cad67720 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad1d0a0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc0467fc640 0 client.6939 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad41760 0x55d0cad1d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 --2- 172.21.15.137:0/2838172579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad30720 0x55d0cad30c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 -- 172.21.15.137:0/2838172579 >> 172.21.15.137:0/2838172579 conn(0x55d0cad2ffe0 msgr2=0x55d0cacff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 -- 172.21.15.137:0/2838172579 shutdown_connections 2024-04-26T22:02:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 1 -- 172.21.15.137:0/2838172579 wait complete. 2024-04-26T22:02:53.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.956+0000 7fc070794740 20 client.6939 trim_cache size 0 max 16384 2024-04-26T22:02:53.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.974+0000 7fc070794740 1 Processor -- start 2024-04-26T22:02:53.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.974+0000 7fc070794740 1 -- start start 2024-04-26T22:02:53.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.974+0000 7fc070794740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 0x55d0cad63bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.974+0000 7fc070794740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad41760 0x55d0cad2fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc070794740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad4d600 0x55d0cad1d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc070794740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc068201640 con 0x55d0cad41760 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc070794740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681563f0 con 0x55d0cad4d600 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc070794740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc0680b5130 con 0x55d0cad30720 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc066ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad41760 0x55d0cad2fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc066ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad41760 0x55d0cad2fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50682/0 (socket says 172.21.15.137:50682) 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc066ffd640 1 -- 172.21.15.137:0/2100200583 learned_addr learned my addr 172.21.15.137:0/2100200583 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc0677fe640 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 0x55d0cad63bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc067fff640 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad4d600 0x55d0cad1d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc066ffd640 1 -- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 msgr2=0x55d0cad63bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc066ffd640 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 0x55d0cad63bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc066ffd640 1 -- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad4d600 msgr2=0x55d0cad1d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc066ffd640 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad4d600 0x55d0cad1d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc066ffd640 1 -- 172.21.15.137:0/2100200583 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0ca914490 con 0x55d0cad41760 2024-04-26T22:02:53.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc0677fe640 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 0x55d0cad63bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:53.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc067fff640 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad4d600 0x55d0cad1d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:53.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc066ffd640 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad41760 0x55d0cad2fa70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0092d0 tx=0x7fc05c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a2bd0cbdcab0c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc04cff9640 1 -- 172.21.15.137:0/2100200583 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c003d10 con 0x55d0cad41760 2024-04-26T22:02:53.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc04cff9640 1 -- 172.21.15.137:0/2100200583 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c032020 con 0x55d0cad41760 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.975+0000 7fc04cff9640 1 -- 172.21.15.137:0/2100200583 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c005b90 con 0x55d0cad41760 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 -- 172.21.15.137:0/2100200583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad41760 msgr2=0x55d0cad2fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad41760 0x55d0cad2fa70 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0092d0 tx=0x7fc05c01c000 comp rx=0 tx=0).stop 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 -- 172.21.15.137:0/2100200583 shutdown_connections 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad41760 0x55d0cad2fa70 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad4d600 0x55d0cad1d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 --2- 172.21.15.137:0/2100200583 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 0x55d0cad63bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 -- 172.21.15.137:0/2100200583 >> 172.21.15.137:0/2100200583 conn(0x55d0cad2ffe0 msgr2=0x55d0cad4ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 -- 172.21.15.137:0/2100200583 shutdown_connections 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 -- 172.21.15.137:0/2100200583 wait complete. 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.976+0000 7fc070794740 1 -- start start 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc070794740 1 Processor -- start 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc070794740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 0x55d0cad2d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc070794740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad41760 0x55d0cadc7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc070794740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad2c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc070794740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d0cad1cf90 con 0x55d0cad4d600 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc070794740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc068155da0 con 0x55d0cad41760 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc070794740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d0cad4b440 con 0x55d0cad30720 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc070794740 10 client.0 _ll_register_callbacks cb 0x7fc05c009200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc067fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad2c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc067fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad2c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50686/0 (socket says 172.21.15.137:50686) 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc067fff640 1 -- 172.21.15.137:0/3609277883 learned_addr learned my addr 172.21.15.137:0/3609277883 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc0677fe640 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 0x55d0cad2d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.977+0000 7fc066ffd640 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad41760 0x55d0cadc7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc067fff640 1 -- 172.21.15.137:0/3609277883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 msgr2=0x55d0cad2d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc067fff640 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 0x55d0cad2d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc067fff640 1 -- 172.21.15.137:0/3609277883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad41760 msgr2=0x55d0cadc7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:53.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc067fff640 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad41760 0x55d0cadc7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc067fff640 1 -- 172.21.15.137:0/3609277883 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0cad41380 con 0x55d0cad4d600 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc067fff640 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad2c6c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc060009e80 tx=0x7fc060004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2017ae57668a10 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc0467fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc0467fc640 1 -- 172.21.15.137:0/3609277883 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060054060 con 0x55d0cad4d600 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc0467fc640 1 -- 172.21.15.137:0/3609277883 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7fc060045670 con 0x55d0cad4d600 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc070794740 1 -- 172.21.15.137:0/3609277883 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc05c032020 con 0x55d0cad4d600 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc0467fc640 1 -- 172.21.15.137:0/3609277883 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc060003990 con 0x55d0cad4d600 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc070794740 10 client.6945 fetch_fsmap learned FSMap version 39 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc070794740 1 -- 172.21.15.137:0/3609277883 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x55d0cad40ac0 con 0x55d0cad4d600 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc0467fc640 1 -- 172.21.15.137:0/3609277883 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c032020 con 0x55d0cad4d600 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc0467fc640 1 -- 172.21.15.137:0/3609277883 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7fc06005d080 con 0x55d0cad4d600 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc070794740 10 client.6945 fetch_fsmap finished waiting for FSMap version 39 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc070794740 10 client.6945 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc070794740 20 client.6945 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:53.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc070794740 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55d0cad2cc00 0x55d0cad4dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc070794740 4 client.6945 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc070794740 1 -- 172.21.15.137:0/3609277883 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) -- 0x55d0cac71a00 con 0x55d0cad2cc00 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.978+0000 7fc0677fe640 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55d0cad2cc00 0x55d0cad4dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc0467fc640 10 client.6945 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc0677fe640 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55d0cad2cc00 0x55d0cad4dd20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86b262d638266991 server_cookie=c02d87b1d99c636c in_seq=0 out_seq=0 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc0467fc640 1 -- 172.21.15.137:0/3609277883 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d0cac71a00 con 0x55d0cad2cc00 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc0467fc640 10 client.6945 handle_command_reply: tid=0 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 client.6945 shutdown 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 -- 172.21.15.137:0/3609277883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 msgr2=0x55d0cad2c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad2c6c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fc060009e80 tx=0x7fc060004ab0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 -- 172.21.15.137:0/3609277883 shutdown_connections 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x55d0cad2cc00 0x55d0cad4dd20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d0cad4d600 0x55d0cad2c6c0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.986 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0cad41760 0x55d0cadc7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc0467fc640 0 client.6945 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 --2- 172.21.15.137:0/3609277883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d0cad30720 0x55d0cad2d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 -- 172.21.15.137:0/3609277883 >> 172.21.15.137:0/3609277883 conn(0x55d0cad2ffe0 msgr2=0x55d0cad056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 -- 172.21.15.137:0/3609277883 shutdown_connections 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.979+0000 7fc070794740 1 -- 172.21.15.137:0/3609277883 wait complete. 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc070794740 20 client.6945 trim_cache size 0 max 16384 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "c2290d95-23f5-4a97-9771-233990793994", 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:02:53.987 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:02:53.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 -- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05406c8f0 msgr2=0x7fc05406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05406c8f0 0x7fc05406edb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc05c006fd0 tx=0x7fc05c008040 comp rx=0 tx=0).stop 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 -- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06806d2b0 msgr2=0x7fc0681532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06806d2b0 0x7fc0681532d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c430 tx=0x7fc05800c8f0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 -- 172.21.15.137:0/1600216691 shutdown_connections 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05406c8f0 0x7fc05406edb0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc068160700 0x7fc0680b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06815f670 0x7fc068151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 --2- 172.21.15.137:0/1600216691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06806d2b0 0x7fc0681532d0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 -- 172.21.15.137:0/1600216691 >> 172.21.15.137:0/1600216691 conn(0x7fc068072900 msgr2=0x7fc0680cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 -- 172.21.15.137:0/1600216691 shutdown_connections 2024-04-26T22:02:53.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:53.980+0000 7fc06da7b640 1 -- 172.21.15.137:0/1600216691 wait complete. 2024-04-26T22:02:53.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:02:53.991 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-26T22:02:54.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.089+0000 7fb9f8751640 1 Processor -- start 2024-04-26T22:02:54.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.089+0000 7fb9f8751640 1 -- start start 2024-04-26T22:02:54.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.090+0000 7fb9f8751640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb9f0163b40 0x7fb9f006f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.090+0000 7fb9f8751640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f0073440 con 0x7fb9f006f880 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.090+0000 7fb9f8751640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f00723a0 con 0x7fb9f00b65f0 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.090+0000 7fb9f8751640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb9f0072680 con 0x7fb9f0163b40 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.090+0000 7fb9f6cee640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb9f006f880 0x7fb9f00ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:48630/0 (socket says 172.21.15.137:48630) 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.090+0000 7fb9f6cee640 1 -- 172.21.15.137:0/504765149 learned_addr learned my addr 172.21.15.137:0/504765149 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.090+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910533016 0 0) 0x7fb9f0073440 con 0x7fb9f006f880 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.090+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9dc003520 con 0x7fb9f006f880 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.090+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/504765149 >> v2:172.21.15.170:3300/0 conn(0x7fb9f0163b40 0x7fb9f006f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1982132642 0 0) 0x7fb9dc003520 con 0x7fb9f006f880 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 >> v2:172.21.15.170:3300/0 conn(0x7fb9f0163b40 msgr2=0x7fb9f006f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 --2- 172.21.15.137:0/504765149 >> v2:172.21.15.170:3300/0 conn(0x7fb9f0163b40 0x7fb9f006f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 >> v1:172.21.15.170:6789/0 conn(0x7fb9f00b65f0 legacy=0x7fb9f00b69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f0072960 con 0x7fb9f006f880 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fb9e80019f0 con 0x7fb9f006f880 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 >> v1:172.21.15.137:6789/0 conn(0x7fb9f006f880 legacy=0x7fb9f00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc0039b0 0x7fb9dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9dc004800 0x7fb9dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9dc0051c0 0x7fb9dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f0072680 con 0x7fb9dc004800 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc00c160 con 0x7fb9dc0039b0 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb9dc00c360 con 0x7fb9dc0051c0 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9dc004800 0x7fb9dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc0039b0 0x7fb9dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9dc0051c0 0x7fb9dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f5cec640 1 -- 172.21.15.137:0/504765149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9dc0051c0 msgr2=0x7fb9dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9dc0051c0 0x7fb9dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f5cec640 1 -- 172.21.15.137:0/504765149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc0039b0 msgr2=0x7fb9dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc0039b0 0x7fb9dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f5cec640 1 -- 172.21.15.137:0/504765149 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc003520 con 0x7fb9dc004800 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9dc0051c0 0x7fb9dc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.091+0000 7fb9f6cee640 1 -- 172.21.15.137:0/504765149 reap_dead start 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.092+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9dc004800 0x7fb9dc004c80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0076180 tx=0x7fb9dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c893b77f91afe34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.092+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0036070 con 0x7fb9dc004800 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.092+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e0031400 con 0x7fb9dc004800 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.092+0000 7fb9f54eb640 1 -- 172.21.15.137:0/504765149 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0009690 con 0x7fb9dc004800 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.092+0000 7fb9f8751640 1 -- 172.21.15.137:0/504765149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9dc004800 msgr2=0x7fb9dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.092+0000 7fb9f8751640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9dc004800 0x7fb9dc004c80 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0076180 tx=0x7fb9dc005830 comp rx=0 tx=0).stop 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.093+0000 7fb9f8751640 1 -- 172.21.15.137:0/504765149 shutdown_connections 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.093+0000 7fb9f8751640 1 --2- 172.21.15.137:0/504765149 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9dc004800 0x7fb9dc004c80 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.093+0000 7fb9f8751640 1 -- 172.21.15.137:0/504765149 >> 172.21.15.137:0/504765149 conn(0x7fb9f00cd8a0 msgr2=0x7fb9f00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:54.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.093+0000 7fb9f8751640 1 -- 172.21.15.137:0/504765149 shutdown_connections 2024-04-26T22:02:54.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.093+0000 7fb9f8751640 1 -- 172.21.15.137:0/504765149 wait complete. 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.094+0000 7fb9f8751640 1 Processor -- start 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.094+0000 7fb9f8751640 1 -- start start 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.094+0000 7fb9f8751640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc004800 0x7fb9f015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.094+0000 7fb9f8751640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9f014dcb0 0x7fb9f0166990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.094+0000 7fb9f8751640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9f01583a0 0x7fb9f0158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.094+0000 7fb9f8751640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f006f340 con 0x7fb9f01583a0 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.094+0000 7fb9f8751640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f006fd30 con 0x7fb9dc004800 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.094+0000 7fb9f8751640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f006f4c0 con 0x7fb9f014dcb0 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f6cee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9f01583a0 0x7fb9f0158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f6cee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9f01583a0 0x7fb9f0158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50700/0 (socket says 172.21.15.137:50700) 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f6cee640 1 -- 172.21.15.137:0/997494226 learned_addr learned my addr 172.21.15.137:0/997494226 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9f014dcb0 0x7fb9f0166990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f6cee640 1 -- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9f014dcb0 msgr2=0x7fb9f0166990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc004800 0x7fb9f015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9f014dcb0 0x7fb9f0166990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f6cee640 1 -- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc004800 msgr2=0x7fb9f015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc004800 0x7fb9f015f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f6cee640 1 -- 172.21.15.137:0/997494226 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f015f8d0 con 0x7fb9f01583a0 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9f014dcb0 0x7fb9f0166990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc004800 0x7fb9f015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9f01583a0 0x7fb9f0158820 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00b6120 tx=0x7fb9e800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:54.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9e6ffd640 1 -- 172.21.15.137:0/997494226 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e800eda0 con 0x7fb9f01583a0 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9e6ffd640 1 -- 172.21.15.137:0/997494226 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e8018070 con 0x7fb9f01583a0 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f8751640 1 -- 172.21.15.137:0/997494226 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f015fbb0 con 0x7fb9f01583a0 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9e6ffd640 1 -- 172.21.15.137:0/997494226 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8013660 con 0x7fb9f01583a0 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.095+0000 7fb9f8751640 1 -- 172.21.15.137:0/997494226 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f01644f0 con 0x7fb9f01583a0 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.097+0000 7fb9e6ffd640 1 -- 172.21.15.137:0/997494226 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9e8013800 con 0x7fb9f01583a0 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.097+0000 7fb9e6ffd640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9d406c8f0 0x7fb9d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.097+0000 7fb9e6ffd640 1 -- 172.21.15.137:0/997494226 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7fb9e808c020 con 0x7fb9f01583a0 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.097+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9d406c8f0 0x7fb9d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.098+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9d406c8f0 0x7fb9d406edb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000c00 tx=0x7fb9ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.098+0000 7fb9fb46b740 1 Processor -- start 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.098+0000 7fb9fb46b740 1 -- start start 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644df80 0x555df644e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df6448e10 0x555df644cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 0x555df644d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555df63b2d80 con 0x555df6448e10 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555df636c8b0 con 0x555df644d0c0 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555df63aed40 con 0x555df644df80 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f5cec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df6448e10 0x555df644cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f5cec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df6448e10 0x555df644cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50714/0 (socket says 172.21.15.137:50714) 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1740497029 learned_addr learned my addr 172.21.15.137:0/1740497029 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/1740497029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644df80 0x555df644e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/1740497029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 0x555df644d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1740497029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644df80 msgr2=0x555df644e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/1740497029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644df80 0x555df644e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1740497029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 msgr2=0x555df644d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/1740497029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 0x555df644d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.099+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1740497029 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df633da40 con 0x555df6448e10 2024-04-26T22:02:54.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/1740497029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df6448e10 0x555df644cb80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0000c00 tx=0x7fb9e002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fb54e8951b490c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9d3fff640 1 -- 172.21.15.137:0/1740497029 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0036040 con 0x555df6448e10 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9d3fff640 1 -- 172.21.15.137:0/1740497029 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e0031740 con 0x555df6448e10 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9d3fff640 1 -- 172.21.15.137:0/1740497029 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0031af0 con 0x555df6448e10 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740497029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df6448e10 msgr2=0x555df644cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740497029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df6448e10 0x555df644cb80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0000c00 tx=0x7fb9e002e000 comp rx=0 tx=0).stop 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740497029 shutdown_connections 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740497029 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df6448e10 0x555df644cb80 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740497029 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 0x555df644d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.100+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740497029 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644df80 0x555df644e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.101+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740497029 >> 172.21.15.137:0/1740497029 conn(0x555df644b080 msgr2=0x555df6493b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.101+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740497029 shutdown_connections 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.101+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740497029 wait complete. 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.101+0000 7fb9fb46b740 1 -- start start 2024-04-26T22:02:54.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.101+0000 7fb9fb46b740 1 Processor -- start 2024-04-26T22:02:54.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644d0c0 0x555df6499820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6497020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df64911f0 0x555df6497560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555df6479b10 con 0x555df644df80 2024-04-26T22:02:54.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555df6339d10 con 0x555df64911f0 2024-04-26T22:02:54.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555df6478f90 con 0x555df644d0c0 2024-04-26T22:02:54.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9fb46b740 10 client.0 _ll_register_callbacks cb 0x555df6366210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:54.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9f5cec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6497020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9f5cec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6497020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50718/0 (socket says 172.21.15.137:50718) 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1859361021 learned_addr learned my addr 172.21.15.137:0/1859361021 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644d0c0 0x555df6499820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.102+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df64911f0 0x555df6497560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1859361021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644d0c0 msgr2=0x555df6499820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644d0c0 0x555df6499820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1859361021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df64911f0 msgr2=0x555df6497560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df64911f0 0x555df6497560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1859361021 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555df618e7d0 con 0x555df644df80 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6497020 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009b80 tx=0x7fb9e002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a9eabc003c673e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1859361021 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0036040 con 0x555df644df80 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1859361021 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7fb9e0031d00 con 0x555df644df80 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1859361021 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9e0031740 con 0x555df644df80 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1859361021 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb9e003d460 con 0x555df644df80 2024-04-26T22:02:54.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9fb46b740 10 client.6957 fetch_fsmap learned FSMap version 39 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1859361021 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x555df60c43f0 con 0x555df644df80 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1859361021 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e0031740 con 0x555df644df80 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1859361021 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7fb9e003d600 con 0x555df644df80 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9fb46b740 10 client.6957 fetch_fsmap finished waiting for FSMap version 39 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9fb46b740 10 client.6957 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9fb46b740 20 client.6957 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555df64986e0 0x555df6498b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9fb46b740 4 client.6957 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.103+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1859361021 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555df63c0990 con 0x555df64986e0 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.104+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555df64986e0 0x555df6498b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.104+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555df64986e0 0x555df6498b20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db691374b157f05f server_cookie=c2721211143b43db in_seq=0 out_seq=0 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.104+0000 7fb9d17fa640 10 client.6957 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.104+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1859361021 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555df63c0990 con 0x555df64986e0 2024-04-26T22:02:54.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.104+0000 7fb9d17fa640 10 client.6957 handle_command_reply: tid=0 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.104+0000 7fb9fb46b740 1 client.6957 shutdown 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.104+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1859361021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 msgr2=0x555df6497020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.104+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6497020 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009b80 tx=0x7fb9e002c000 comp rx=0 tx=0).stop 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1859361021 shutdown_connections 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555df64986e0 0x555df6498b20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6497020 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df64911f0 0x555df6497560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1859361021 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644d0c0 0x555df6499820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9d17fa640 0 client.6957 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1859361021 >> 172.21.15.137:0/1859361021 conn(0x555df6448e10 msgr2=0x555df644ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1859361021 shutdown_connections 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1859361021 wait complete. 2024-04-26T22:02:54.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.105+0000 7fb9fb46b740 20 client.6957 trim_cache size 0 max 16384 2024-04-26T22:02:54.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.122+0000 7fb9fb46b740 1 Processor -- start 2024-04-26T22:02:54.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.122+0000 7fb9fb46b740 1 -- start start 2024-04-26T22:02:54.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644d0c0 0x555df6506c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644df80 0x555df648abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df64911f0 0x555df648b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f0206320 con 0x555df64911f0 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f0205320 con 0x555df644df80 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f0165c00 con 0x555df644d0c0 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9f6cee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df64911f0 0x555df648b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9f6cee640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df64911f0 0x555df648b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50732/0 (socket says 172.21.15.137:50732) 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9f6cee640 1 -- 172.21.15.137:0/1800407991 learned_addr learned my addr 172.21.15.137:0/1800407991 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9f6cee640 1 -- 172.21.15.137:0/1800407991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644d0c0 msgr2=0x555df6506c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/1800407991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644d0c0 0x555df6506c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9f6cee640 1 -- 172.21.15.137:0/1800407991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644df80 msgr2=0x555df648abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/1800407991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644df80 0x555df648abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9f6cee640 1 -- 172.21.15.137:0/1800407991 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df60840f0 con 0x555df64911f0 2024-04-26T22:02:54.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/1800407991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df64911f0 0x555df648b130 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb9e808a490 tx=0x7fb9e8001fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b184533386d62aaa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:54.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9d37fe640 1 -- 172.21.15.137:0/1800407991 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e805e0a0 con 0x555df64911f0 2024-04-26T22:02:54.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9d37fe640 1 -- 172.21.15.137:0/1800407991 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e8089070 con 0x555df64911f0 2024-04-26T22:02:54.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.123+0000 7fb9d37fe640 1 -- 172.21.15.137:0/1800407991 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80628d0 con 0x555df64911f0 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1800407991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df64911f0 msgr2=0x555df648b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1800407991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df64911f0 0x555df648b130 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fb9e808a490 tx=0x7fb9e8001fb0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1800407991 shutdown_connections 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1800407991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df64911f0 0x555df648b130 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1800407991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644df80 0x555df648abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1800407991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df644d0c0 0x555df6506c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1800407991 >> 172.21.15.137:0/1800407991 conn(0x555df6448e10 msgr2=0x555df6447cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1800407991 shutdown_connections 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1800407991 wait complete. 2024-04-26T22:02:54.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.124+0000 7fb9fb46b740 1 -- start start 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.125+0000 7fb9fb46b740 1 Processor -- start 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.125+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 0x555df6501d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.125+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6498ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.125+0000 7fb9fb46b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df64911f0 0x555df6499000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.125+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f0204cd0 con 0x555df644df80 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.125+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555df644a500 con 0x555df644d0c0 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.125+0000 7fb9fb46b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555df6478580 con 0x555df64911f0 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.125+0000 7fb9fb46b740 10 client.0 _ll_register_callbacks cb 0x7fb9e8007ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f5cec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6498ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f5cec640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6498ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:50746/0 (socket says 172.21.15.137:50746) 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1740339946 learned_addr learned my addr 172.21.15.137:0/1740339946 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df64911f0 0x555df6499000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 0x555df6501d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df64911f0 msgr2=0x555df6499000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df64911f0 0x555df6499000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 msgr2=0x555df6501d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 0x555df6501d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f5cec640 1 -- 172.21.15.137:0/1740339946 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555df63734b0 con 0x555df644df80 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 0x555df6501d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f6cee640 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df64911f0 0x555df6499000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9f5cec640 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6498ac0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0031770 tx=0x7fb9e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a054a509a8ef8b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1740339946 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0036040 con 0x555df644df80 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1740339946 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5795+0+0 (secure 0 0 0) 0x7fb9e003b630 con 0x555df644df80 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740339946 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9e8089070 con 0x555df644df80 2024-04-26T22:02:54.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1740339946 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb9e0065050 con 0x555df644df80 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9fb46b740 10 client.6963 fetch_fsmap learned FSMap version 39 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740339946 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x555df6492a40 con 0x555df644df80 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1740339946 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e8089070 con 0x555df644df80 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.126+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1740339946 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 39) ==== 3494+0+0 (secure 0 0 0) 0x7fb9e0068020 con 0x555df644df80 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 10 client.6963 fetch_fsmap finished waiting for FSMap version 39 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 10 client.6963 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 20 client.6963 populate_metadata read hostname 'smithi137' 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555df6504990 0x555df6493930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 4 client.6963 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740339946 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555df63ba800 con 0x555df6504990 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555df6504990 0x555df6493930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:02:54.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9d17fa640 10 client.6963 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9f64ed640 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555df6504990 0x555df6493930 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7272184d7793672 server_cookie=bea909321c9450dc in_seq=0 out_seq=0 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9d17fa640 1 -- 172.21.15.137:0/1740339946 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555df63ba800 con 0x555df6504990 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9d17fa640 10 client.6963 handle_command_reply: tid=0 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 client.6963 shutdown 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740339946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 msgr2=0x555df6498ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6498ac0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0031770 tx=0x7fb9e0004730 comp rx=0 tx=0).stop 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740339946 shutdown_connections 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555df6504990 0x555df6493930 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555df644df80 0x555df6498ac0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9d17fa640 0 client.6963 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555df64911f0 0x555df6499000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 --2- 172.21.15.137:0/1740339946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555df644d0c0 0x555df6501d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.127+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740339946 >> 172.21.15.137:0/1740339946 conn(0x555df6448e10 msgr2=0x555df64b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:54.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740339946 shutdown_connections 2024-04-26T22:02:54.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9fb46b740 1 -- 172.21.15.137:0/1740339946 wait complete. 2024-04-26T22:02:54.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9fb46b740 20 client.6963 trim_cache size 0 max 16384 2024-04-26T22:02:54.135 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:02:54.135 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T22:02:54.135 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-26T22:02:54.135 INFO:teuthology.orchestra.run.smithi137.stdout: "c2290d95-23f5-4a97-9771-233990793994": { 2024-04-26T22:02:54.135 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/subdir", 2024-04-26T22:02:54.135 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "c2290d95-23f5-4a97-9771-233990793994", 2024-04-26T22:02:54.135 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive" 2024-04-26T22:02:54.136 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:54.136 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:02:54.136 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 -- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9d406c8f0 msgr2=0x7fb9d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9d406c8f0 0x7fb9d406edb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000c00 tx=0x7fb9ec009040 comp rx=0 tx=0).stop 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 -- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9f01583a0 msgr2=0x7fb9f0158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9f01583a0 0x7fb9f0158820 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00b6120 tx=0x7fb9e800e530 comp rx=0 tx=0).stop 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 -- 172.21.15.137:0/997494226 shutdown_connections 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9d406c8f0 0x7fb9d406edb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9f01583a0 0x7fb9f0158820 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9f014dcb0 0x7fb9f0166990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 --2- 172.21.15.137:0/997494226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9dc004800 0x7fb9f015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 -- 172.21.15.137:0/997494226 >> 172.21.15.137:0/997494226 conn(0x7fb9f00cd8a0 msgr2=0x7fb9f0162de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 -- 172.21.15.137:0/997494226 shutdown_connections 2024-04-26T22:02:54.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:02:54.128+0000 7fb9f8751640 1 -- 172.21.15.137:0/997494226 wait complete. 2024-04-26T22:02:54.139 INFO:tasks.cephfs.filesystem:scrub status for tag:c2290d95-23f5-4a97-9771-233990793994 - {'path': '/subdir', 'tag': 'c2290d95-23f5-4a97-9771-233990793994', 'options': 'recursive'} 2024-04-26T22:02:56.412 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:02:56.413+0000 7f8ac040b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T22:03:13.501 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:03:13.504 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:03:24.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:24.140 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-26T22:03:24.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.252+0000 7fd6e4083640 1 Processor -- start 2024-04-26T22:03:24.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.252+0000 7fd6e4083640 1 -- start start 2024-04-26T22:03:24.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.253+0000 7fd6e4083640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd6dc0d0300 0x7fd6dc0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.253+0000 7fd6e4083640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6dc0b46a0 con 0x7fd6dc0b3e50 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.253+0000 7fd6e4083640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6dc0b5db0 con 0x7fd6dc06f340 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.253+0000 7fd6e4083640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd6dc0b6090 con 0x7fd6dc0d0300 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.253+0000 7fd6e2620640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd6dc0b3e50 0x7fd6dc0720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33212/0 (socket says 172.21.15.137:33212) 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.253+0000 7fd6e2620640 1 -- 172.21.15.137:0/1732645346 learned_addr learned my addr 172.21.15.137:0/1732645346 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e161e640 1 --2- 172.21.15.137:0/1732645346 >> v2:172.21.15.170:3300/0 conn(0x7fd6dc0d0300 0x7fd6dc0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3409783810 0 0) 0x7fd6dc0b46a0 con 0x7fd6dc0b3e50 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c8003520 con 0x7fd6dc0b3e50 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097465208 0 0) 0x7fd6dc0b5db0 con 0x7fd6dc06f340 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6dc0b46a0 con 0x7fd6dc06f340 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3045615287 0 0) 0x7fd6c8003520 con 0x7fd6dc0b3e50 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 >> v2:172.21.15.170:3300/0 conn(0x7fd6dc0d0300 msgr2=0x7fd6dc0b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 --2- 172.21.15.137:0/1732645346 >> v2:172.21.15.170:3300/0 conn(0x7fd6dc0d0300 0x7fd6dc0b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 >> v1:172.21.15.170:6789/0 conn(0x7fd6dc06f340 legacy=0x7fd6dc06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc0b6370 con 0x7fd6dc0b3e50 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e161e640 1 --2- 172.21.15.137:0/1732645346 >> v2:172.21.15.170:3300/0 conn(0x7fd6dc0d0300 0x7fd6dc0b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fd6d4001670 con 0x7fd6dc0b3e50 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 >> v1:172.21.15.137:6789/0 conn(0x7fd6dc0b3e50 legacy=0x7fd6dc0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6c8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6c8004800 0x7fd6c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c8005230 0x7fd6c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b6090 con 0x7fd6c8003b40 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c800c190 con 0x7fd6c8005230 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c800c390 con 0x7fd6c8004800 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6c8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e161e640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6c8004800 0x7fd6c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e2620640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c8005230 0x7fd6c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/1732645346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6c8004800 msgr2=0x7fd6c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6c8004800 0x7fd6c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/1732645346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c8005230 msgr2=0x7fd6c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c8005230 0x7fd6c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/1732645346 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c8003520 con 0x7fd6c8003b40 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.254+0000 7fd6e2620640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6c8005230 0x7fd6c800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.255+0000 7fd6e2620640 1 -- 172.21.15.137:0/1732645346 reap_dead start 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.255+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6c8003f40 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8001fd0 tx=0x7fd6c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13101b3d4098ad7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.255+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8001bf0 con 0x7fd6c8003b40 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.255+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d8003b70 con 0x7fd6c8003b40 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.255+0000 7fd6e0e1d640 1 -- 172.21.15.137:0/1732645346 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d80050d0 con 0x7fd6c8003b40 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.256+0000 7fd6e4083640 1 -- 172.21.15.137:0/1732645346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 msgr2=0x7fd6c8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.256+0000 7fd6e4083640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6c8003f40 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8001fd0 tx=0x7fd6c8005830 comp rx=0 tx=0).stop 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.256+0000 7fd6e4083640 1 -- 172.21.15.137:0/1732645346 shutdown_connections 2024-04-26T22:03:24.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.256+0000 7fd6e4083640 1 --2- 172.21.15.137:0/1732645346 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6c8003f40 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.256+0000 7fd6e4083640 1 -- 172.21.15.137:0/1732645346 >> 172.21.15.137:0/1732645346 conn(0x7fd6dc0cd8a0 msgr2=0x7fd6dc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.256+0000 7fd6e4083640 1 -- 172.21.15.137:0/1732645346 shutdown_connections 2024-04-26T22:03:24.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.256+0000 7fd6e4083640 1 -- 172.21.15.137:0/1732645346 wait complete. 2024-04-26T22:03:24.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.257+0000 7fd6e4083640 1 Processor -- start 2024-04-26T22:03:24.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.257+0000 7fd6e4083640 1 -- start start 2024-04-26T22:03:24.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e4083640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6dc1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e4083640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6dc1e7630 0x7fd6dc1e7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e4083640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6dc1e55a0 0x7fd6dc1e5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e4083640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b4460 con 0x7fd6c8003b40 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e4083640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b42e0 con 0x7fd6dc1e7630 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e4083640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc142a30 con 0x7fd6dc1e55a0 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e1e1f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6dc1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e1e1f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6dc1f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44840/0 (socket says 172.21.15.137:44840) 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/768802603 learned_addr learned my addr 172.21.15.137:0/768802603 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e161e640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6dc1e7630 0x7fd6dc1e7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e2620640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6dc1e55a0 0x7fd6dc1e5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/768802603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6dc1e55a0 msgr2=0x7fd6dc1e5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6dc1e55a0 0x7fd6dc1e5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/768802603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6dc1e7630 msgr2=0x7fd6dc1e7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6dc1e7630 0x7fd6dc1e7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/768802603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc0c60a0 con 0x7fd6c8003b40 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.258+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6dc1f49b0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8005040 tx=0x7fd6d8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.259+0000 7fd6d27fc640 1 -- 172.21.15.137:0/768802603 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8040070 con 0x7fd6c8003b40 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.259+0000 7fd6d27fc640 1 -- 172.21.15.137:0/768802603 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d8003970 con 0x7fd6c8003b40 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.259+0000 7fd6d27fc640 1 -- 172.21.15.137:0/768802603 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8001bf0 con 0x7fd6c8003b40 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.259+0000 7fd6e4083640 1 -- 172.21.15.137:0/768802603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6dc1e4b00 con 0x7fd6c8003b40 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.259+0000 7fd6e4083640 1 -- 172.21.15.137:0/768802603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6dc1e81a0 con 0x7fd6c8003b40 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.260+0000 7fd6d27fc640 1 -- 172.21.15.137:0/768802603 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6d803a040 con 0x7fd6c8003b40 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.260+0000 7fd6d27fc640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6c006c8f0 0x7fd6c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.261+0000 7fd6d27fc640 1 -- 172.21.15.137:0/768802603 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fd6d80ac5a0 con 0x7fd6c8003b40 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.261+0000 7fd6e161e640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6c006c8f0 0x7fd6c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.261+0000 7fd6e161e640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6c006c8f0 0x7fd6c006edb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc15aeb0 tx=0x7fd6cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.262+0000 7fd6e6da5740 1 Processor -- start 2024-04-26T22:03:24.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.262+0000 7fd6e6da5740 1 -- start start 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.262+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.262+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07c5e10 0x5600b07c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.262+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.262+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5600b072fd80 con 0x5600b07caf80 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.262+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5600b06e98b0 con 0x5600b07ca0c0 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.262+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5600b072bd40 con 0x5600b07c5e10 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.262+0000 7fd6e1e1f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e1e1f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44848/0 (socket says 172.21.15.137:44848) 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/1098447269 learned_addr learned my addr 172.21.15.137:0/1098447269 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e2620640 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e161e640 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07c5e10 0x5600b07c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/1098447269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07c5e10 msgr2=0x5600b07c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07c5e10 0x5600b07c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/1098447269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 msgr2=0x5600b07ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e1e1f640 1 -- 172.21.15.137:0/1098447269 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b06baa40 con 0x5600b07caf80 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e2620640 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07cb360 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80aaab0 tx=0x7fd6d8079df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6084b92bd2b187 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6bf7fe640 1 -- 172.21.15.137:0/1098447269 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8082fb0 con 0x5600b07caf80 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6bf7fe640 1 -- 172.21.15.137:0/1098447269 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d8078470 con 0x5600b07caf80 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.263+0000 7fd6bf7fe640 1 -- 172.21.15.137:0/1098447269 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8076a40 con 0x5600b07caf80 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1098447269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 msgr2=0x5600b07cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07cb360 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80aaab0 tx=0x7fd6d8079df0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1098447269 shutdown_connections 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07c5e10 0x5600b07c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1098447269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07cb360 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1098447269 >> 172.21.15.137:0/1098447269 conn(0x5600b07c8080 msgr2=0x5600b0810b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1098447269 shutdown_connections 2024-04-26T22:03:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1098447269 wait complete. 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 -- start start 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.264+0000 7fd6e6da5740 1 Processor -- start 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07e75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b080eba0 0x5600b080f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5600b06e98b0 con 0x5600b07caf80 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5600b06b6d10 con 0x5600b07ca0c0 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5600b072fd80 con 0x5600b080eba0 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e6da5740 10 client.0 _ll_register_callbacks cb 0x5600b06e3210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e161e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07e75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e161e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07e75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44858/0 (socket says 172.21.15.137:44858) 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.265+0000 7fd6e161e640 1 -- 172.21.15.137:0/1683906679 learned_addr learned my addr 172.21.15.137:0/1683906679 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e2620640 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b080eba0 0x5600b080f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e161e640 1 -- 172.21.15.137:0/1683906679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b080eba0 msgr2=0x5600b080f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e161e640 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b080eba0 0x5600b080f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e161e640 1 -- 172.21.15.137:0/1683906679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 msgr2=0x5600b07e64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e161e640 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07e64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e161e640 1 -- 172.21.15.137:0/1683906679 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b050b7d0 con 0x5600b07caf80 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e161e640 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07e75b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc016490 tx=0x7fd6cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3ac45d197c10ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6bcff9640 1 -- 172.21.15.137:0/1683906679 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc028070 con 0x5600b07caf80 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6bcff9640 1 -- 172.21.15.137:0/1683906679 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fd6cc024830 con 0x5600b07caf80 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1683906679 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6d8078470 con 0x5600b07caf80 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6bcff9640 1 -- 172.21.15.137:0/1683906679 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd6cc033050 con 0x5600b07caf80 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e6da5740 10 client.6975 fetch_fsmap learned FSMap version 40 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1683906679 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5600b04413f0 con 0x5600b07caf80 2024-04-26T22:03:24.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6bcff9640 1 -- 172.21.15.137:0/1683906679 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d8078470 con 0x5600b07caf80 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6bcff9640 1 -- 172.21.15.137:0/1683906679 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7fd6cc024a30 con 0x5600b07caf80 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e6da5740 10 client.6975 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.266+0000 7fd6e6da5740 10 client.6975 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6e6da5740 20 client.6975 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5600b0815ee0 0x5600b0816310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6e6da5740 4 client.6975 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1683906679 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600b073d990 con 0x5600b0815ee0 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5600b0815ee0 0x5600b0816310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6bcff9640 10 client.6975 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5600b0815ee0 0x5600b0816310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d256cde538775d16 server_cookie=ca6efe19501f9e5c in_seq=0 out_seq=0 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6bcff9640 1 -- 172.21.15.137:0/1683906679 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5600b073d990 con 0x5600b0815ee0 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6bcff9640 10 client.6975 handle_command_reply: tid=0 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.267+0000 7fd6e6da5740 1 client.6975 shutdown 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1683906679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 msgr2=0x5600b07e75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07e75b0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc016490 tx=0x7fd6cc004730 comp rx=0 tx=0).stop 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1683906679 shutdown_connections 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5600b0815ee0 0x5600b0816310 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07e75b0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b080eba0 0x5600b080f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/1683906679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b07ca0c0 0x5600b07e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6bcff9640 0 client.6975 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1683906679 >> 172.21.15.137:0/1683906679 conn(0x5600b07c5e10 msgr2=0x5600b07c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1683906679 shutdown_connections 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 1 -- 172.21.15.137:0/1683906679 wait complete. 2024-04-26T22:03:24.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.268+0000 7fd6e6da5740 20 client.6975 trim_cache size 0 max 16384 2024-04-26T22:03:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.285+0000 7fd6e6da5740 1 Processor -- start 2024-04-26T22:03:24.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.285+0000 7fd6e6da5740 1 -- start start 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 0x5600b07ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07f6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 0x5600b07cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc200060 con 0x5600b07caf80 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc1ff080 con 0x5600b080eba0 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc1f4310 con 0x5600b07ca0c0 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e161e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e161e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44870/0 (socket says 172.21.15.137:44870) 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e161e640 1 -- 172.21.15.137:0/3755724799 learned_addr learned my addr 172.21.15.137:0/3755724799 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 0x5600b07ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e161e640 1 -- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 msgr2=0x5600b07ebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e161e640 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 0x5600b07ebbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e2620640 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 0x5600b07cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e161e640 1 -- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 msgr2=0x5600b07cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e161e640 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 0x5600b07cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e161e640 1 -- 172.21.15.137:0/3755724799 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b04010f0 con 0x5600b07caf80 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 0x5600b07ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.286+0000 7fd6e2620640 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 0x5600b07cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e161e640 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07f6560 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc024fd0 tx=0x7fd6cc024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42551d35ba8e1c9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6beffd640 1 -- 172.21.15.137:0/3755724799 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc03c070 con 0x5600b07caf80 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6beffd640 1 -- 172.21.15.137:0/3755724799 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6cc01c040 con 0x5600b07caf80 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6beffd640 1 -- 172.21.15.137:0/3755724799 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc028040 con 0x5600b07caf80 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e6da5740 1 -- 172.21.15.137:0/3755724799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 msgr2=0x5600b07f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07f6560 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc024fd0 tx=0x7fd6cc024000 comp rx=0 tx=0).stop 2024-04-26T22:03:24.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e6da5740 1 -- 172.21.15.137:0/3755724799 shutdown_connections 2024-04-26T22:03:24.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b07f6560 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 0x5600b07cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/3755724799 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 0x5600b07ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e6da5740 1 -- 172.21.15.137:0/3755724799 >> 172.21.15.137:0/3755724799 conn(0x5600b07c5e10 msgr2=0x5600b07e6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e6da5740 1 -- 172.21.15.137:0/3755724799 shutdown_connections 2024-04-26T22:03:24.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.287+0000 7fd6e6da5740 1 -- 172.21.15.137:0/3755724799 wait complete. 2024-04-26T22:03:24.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.288+0000 7fd6e6da5740 1 -- start start 2024-04-26T22:03:24.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.288+0000 7fd6e6da5740 1 Processor -- start 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 0x5600b0883c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b08162c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e6da5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 0x5600b0816800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5600b07c1b40 con 0x5600b07caf80 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc1fea30 con 0x5600b080eba0 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e6da5740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5600b07f6aa0 con 0x5600b07ca0c0 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e6da5740 10 client.0 _ll_register_callbacks cb 0x7fd6cc013ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e161e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b08162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e161e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b08162c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44876/0 (socket says 172.21.15.137:44876) 2024-04-26T22:03:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e161e640 1 -- 172.21.15.137:0/2723477822 learned_addr learned my addr 172.21.15.137:0/2723477822 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 0x5600b0883c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e2620640 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 0x5600b0816800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e161e640 1 -- 172.21.15.137:0/2723477822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 msgr2=0x5600b0883c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e161e640 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 0x5600b0883c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e161e640 1 -- 172.21.15.137:0/2723477822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 msgr2=0x5600b0816800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e161e640 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 0x5600b0816800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e161e640 1 -- 172.21.15.137:0/2723477822 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b06f04b0 con 0x5600b07caf80 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6e161e640 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b08162c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009a00 tx=0x7fd6cc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d33421d2ba694a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.289+0000 7fd6bcff9640 1 -- 172.21.15.137:0/2723477822 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc03c040 con 0x5600b07caf80 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6bcff9640 1 -- 172.21.15.137:0/2723477822 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fd6cc004220 con 0x5600b07caf80 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e6da5740 1 -- 172.21.15.137:0/2723477822 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6cc01c040 con 0x5600b07caf80 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6bcff9640 1 -- 172.21.15.137:0/2723477822 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd6cc028040 con 0x5600b07caf80 2024-04-26T22:03:24.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e6da5740 10 client.6981 fetch_fsmap learned FSMap version 40 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e6da5740 1 -- 172.21.15.137:0/2723477822 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5600b07cbac0 con 0x5600b07caf80 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6bcff9640 1 -- 172.21.15.137:0/2723477822 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6cc01c040 con 0x5600b07caf80 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6bcff9640 1 -- 172.21.15.137:0/2723477822 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7fd6cc005990 con 0x5600b07caf80 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e6da5740 10 client.6981 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e6da5740 10 client.6981 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e6da5740 20 client.6981 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5600b07e6a10 0x5600b088d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e6da5740 4 client.6981 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e6da5740 1 -- 172.21.15.137:0/2723477822 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5600b0737800 con 0x5600b07e6a10 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5600b07e6a10 0x5600b088d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6bcff9640 10 client.6981 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.290+0000 7fd6e1e1f640 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5600b07e6a10 0x5600b088d3e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26b7d0d4c0ffc5f0 server_cookie=ab394a0c4f76484a in_seq=0 out_seq=0 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6bcff9640 1 -- 172.21.15.137:0/2723477822 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5600b0737800 con 0x5600b07e6a10 2024-04-26T22:03:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6bcff9640 10 client.6981 handle_command_reply: tid=0 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 client.6981 shutdown 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 -- 172.21.15.137:0/2723477822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 msgr2=0x5600b08162c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b08162c0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009a00 tx=0x7fd6cc018000 comp rx=0 tx=0).stop 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 -- 172.21.15.137:0/2723477822 shutdown_connections 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5600b07e6a10 0x5600b088d3e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5600b07caf80 0x5600b08162c0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5600b080eba0 0x5600b0816800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6bcff9640 0 client.6981 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 --2- 172.21.15.137:0/2723477822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5600b07ca0c0 0x5600b0883c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 -- 172.21.15.137:0/2723477822 >> 172.21.15.137:0/2723477822 conn(0x5600b07c5e10 msgr2=0x5600b080ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 -- 172.21.15.137:0/2723477822 shutdown_connections 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 1 -- 172.21.15.137:0/2723477822 wait complete. 2024-04-26T22:03:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e6da5740 20 client.6981 trim_cache size 0 max 16384 2024-04-26T22:03:24.298 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:03:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:03:24.298 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:03:24.298 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 -- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6c006c8f0 msgr2=0x7fd6c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6c006c8f0 0x7fd6c006edb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc15aeb0 tx=0x7fd6cc008040 comp rx=0 tx=0).stop 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 -- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 msgr2=0x7fd6dc1f49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6dc1f49b0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8005040 tx=0x7fd6d8001650 comp rx=0 tx=0).stop 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 -- 172.21.15.137:0/768802603 shutdown_connections 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6c006c8f0 0x7fd6c006edb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6dc1e55a0 0x7fd6dc1e5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6dc1e7630 0x7fd6dc1e7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 --2- 172.21.15.137:0/768802603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6c8003b40 0x7fd6dc1f49b0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.291+0000 7fd6e4083640 1 -- 172.21.15.137:0/768802603 >> 172.21.15.137:0/768802603 conn(0x7fd6dc0cd8a0 msgr2=0x7fd6dc06f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.292+0000 7fd6e4083640 1 -- 172.21.15.137:0/768802603 shutdown_connections 2024-04-26T22:03:24.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.292+0000 7fd6e4083640 1 -- 172.21.15.137:0/768802603 wait complete. 2024-04-26T22:03:24.302 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:03:24.303 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:03:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.399+0000 7f6c45ebd640 1 Processor -- start 2024-04-26T22:03:24.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.399+0000 7f6c45ebd640 1 -- start start 2024-04-26T22:03:24.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c45ebd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c4015f1e0 0x7f6c4006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c45ebd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6c4006d2b0 0x7f6c4006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c45ebd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c400b4a10 con 0x7f6c400b44e0 2024-04-26T22:03:24.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c45ebd640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6c4006dc60 con 0x7f6c4006d2b0 2024-04-26T22:03:24.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c45ebd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4006eeb0 con 0x7f6c4015f1e0 2024-04-26T22:03:24.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c3ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6c4006d2b0 0x7f6c4006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c3ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6c4006d2b0 0x7f6c4006d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44884/0 (socket says 172.21.15.137:44884) 2024-04-26T22:03:24.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c3ffff640 1 -- 172.21.15.137:0/2655818053 learned_addr learned my addr 172.21.15.137:0/2655818053 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c3ffff640 1 -- 172.21.15.137:0/2655818053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c4015f1e0 msgr2=0x7f6c4006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c3ffff640 1 --2- 172.21.15.137:0/2655818053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c4015f1e0 0x7f6c4006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c3ffff640 1 -- 172.21.15.137:0/2655818053 >> v1:172.21.15.170:6789/0 conn(0x7f6c400b44e0 legacy=0x7f6c400ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.400+0000 7f6c3ffff640 1 -- 172.21.15.137:0/2655818053 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c400b4cf0 con 0x7f6c4006d2b0 2024-04-26T22:03:24.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.401+0000 7f6c3ffff640 1 --2- 172.21.15.137:0/2655818053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c4006d2b0 0x7f6c4006d720 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009e50 tx=0x7f6c3802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac1039bc0a6abd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.401+0000 7f6c3effd640 1 -- 172.21.15.137:0/2655818053 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38036070 con 0x7f6c4006d2b0 2024-04-26T22:03:24.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.401+0000 7f6c3effd640 1 -- 172.21.15.137:0/2655818053 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c38031600 con 0x7f6c4006d2b0 2024-04-26T22:03:24.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.401+0000 7f6c3effd640 1 -- 172.21.15.137:0/2655818053 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c380319d0 con 0x7f6c4006d2b0 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.402+0000 7f6c45ebd640 1 -- 172.21.15.137:0/2655818053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c4006d2b0 msgr2=0x7f6c4006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.402+0000 7f6c45ebd640 1 --2- 172.21.15.137:0/2655818053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c4006d2b0 0x7f6c4006d720 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f6c38009e50 tx=0x7f6c3802a6c0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.402+0000 7f6c45ebd640 1 -- 172.21.15.137:0/2655818053 shutdown_connections 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.402+0000 7f6c45ebd640 1 --2- 172.21.15.137:0/2655818053 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c4006d2b0 0x7f6c4006d720 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.402+0000 7f6c45ebd640 1 --2- 172.21.15.137:0/2655818053 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c4015f1e0 0x7f6c4006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.402+0000 7f6c45ebd640 1 -- 172.21.15.137:0/2655818053 >> 172.21.15.137:0/2655818053 conn(0x7f6c400728a0 msgr2=0x7f6c40072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.402+0000 7f6c45ebd640 1 -- 172.21.15.137:0/2655818053 shutdown_connections 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.402+0000 7f6c45ebd640 1 -- 172.21.15.137:0/2655818053 wait complete. 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.403+0000 7f6c45ebd640 1 Processor -- start 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.403+0000 7f6c45ebd640 1 -- start start 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c45ebd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c4006d2b0 0x7f6c401470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c45ebd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c400b44e0 0x7f6c40152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c45ebd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c4015f1e0 0x7f6c401f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c45ebd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c400b5590 con 0x7f6c400b44e0 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c45ebd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6c400b52b0 con 0x7f6c4015f1e0 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c45ebd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4015f5c0 con 0x7f6c4006d2b0 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c400b44e0 0x7f6c40152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c400b44e0 0x7f6c40152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44900/0 (socket says 172.21.15.137:44900) 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c37fff640 1 -- 172.21.15.137:0/3436610291 learned_addr learned my addr 172.21.15.137:0/3436610291 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c37fff640 1 -- 172.21.15.137:0/3436610291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c4006d2b0 msgr2=0x7f6c401470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c37fff640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c4006d2b0 0x7f6c401470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c37fff640 1 -- 172.21.15.137:0/3436610291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c4015f1e0 msgr2=0x7f6c401f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c37fff640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c4015f1e0 0x7f6c401f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c37fff640 1 -- 172.21.15.137:0/3436610291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c40160580 con 0x7f6c400b44e0 2024-04-26T22:03:24.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c37fff640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c400b44e0 0x7f6c40152c20 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c430 tx=0x7f6c2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c3cff9640 1 -- 172.21.15.137:0/3436610291 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28011790 con 0x7f6c400b44e0 2024-04-26T22:03:24.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c3cff9640 1 -- 172.21.15.137:0/3436610291 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c28017070 con 0x7f6c400b44e0 2024-04-26T22:03:24.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c40160860 con 0x7f6c400b44e0 2024-04-26T22:03:24.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c3cff9640 1 -- 172.21.15.137:0/3436610291 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28011bb0 con 0x7f6c400b44e0 2024-04-26T22:03:24.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.404+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c40161100 con 0x7f6c400b44e0 2024-04-26T22:03:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.405+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c40161300 con 0x7f6c400b44e0 2024-04-26T22:03:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.406+0000 7f6c3cff9640 1 -- 172.21.15.137:0/3436610291 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c2801c460 con 0x7f6c400b44e0 2024-04-26T22:03:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.406+0000 7f6c3cff9640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2006c8f0 0x7f6c2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.406+0000 7f6c3cff9640 1 -- 172.21.15.137:0/3436610291 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f6c2808bb20 con 0x7f6c400b44e0 2024-04-26T22:03:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.406+0000 7f6c3f7fe640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2006c8f0 0x7f6c2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.407+0000 7f6c3f7fe640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2006c8f0 0x7f6c2006edb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6c400afae0 tx=0x7f6c30006bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.411+0000 7f6c3cff9640 1 -- 172.21.15.137:0/3436610291 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6c40161300 con 0x7f6c400b44e0 2024-04-26T22:03:24.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.624+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c40160a30 con 0x7f6c400b44e0 2024-04-26T22:03:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.624+0000 7f6c3cff9640 1 -- 172.21.15.137:0/3436610291 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5196 (secure 0 0 0) 0x7f6c28059ea0 con 0x7f6c400b44e0 2024-04-26T22:03:24.625 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:03:24.625 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:02:56.394368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":6,"addr":"172.21.15.137:6837/2422385986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2422385986},{"type":"v1","addr":"172.21.15.137:6837","nonce":2422385986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6843,"qdb_cluster":[6843]},"id":5}]} 2024-04-26T22:03:24.625 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 40 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2006c8f0 msgr2=0x7f6c2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2006c8f0 0x7f6c2006edb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6c400afae0 tx=0x7f6c30006bf0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c400b44e0 msgr2=0x7f6c40152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c400b44e0 0x7f6c40152c20 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800c430 tx=0x7f6c2800c8f0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 shutdown_connections 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2006c8f0 0x7f6c2006edb0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c400b44e0 0x7f6c40152c20 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c4015f1e0 0x7f6c401f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 --2- 172.21.15.137:0/3436610291 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c4006d2b0 0x7f6c401470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.626+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 >> 172.21.15.137:0/3436610291 conn(0x7f6c400728a0 msgr2=0x7f6c400708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.627+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 shutdown_connections 2024-04-26T22:03:24.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.627+0000 7f6c45ebd640 1 -- 172.21.15.137:0/3436610291 wait complete. 2024-04-26T22:03:24.638 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-26T22:03:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.736+0000 7f776359e640 1 Processor -- start 2024-04-26T22:03:24.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.736+0000 7f776359e640 1 -- start start 2024-04-26T22:03:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f776359e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f775c0707e0 0x7f775c070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f776359e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775c0b4d60 con 0x7f775c15d600 2024-04-26T22:03:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f776359e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775c071130 con 0x7f775c0aff30 2024-04-26T22:03:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f776359e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f775c0b0310 con 0x7f775c0707e0 2024-04-26T22:03:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f7762d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f775c0707e0 0x7f775c070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f7761d9b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f775c15d600 0x7f775c0b4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33214/0 (socket says 172.21.15.137:33214) 2024-04-26T22:03:24.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f7761d9b640 1 -- 172.21.15.137:0/1703797623 learned_addr learned my addr 172.21.15.137:0/1703797623 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:24.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f7762d9d640 1 -- 172.21.15.137:0/1703797623 >> v1:172.21.15.170:6789/0 conn(0x7f775c0aff30 legacy=0x7f775c0d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f7762d9d640 1 -- 172.21.15.137:0/1703797623 >> v1:172.21.15.137:6789/0 conn(0x7f775c15d600 legacy=0x7f775c0b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f7762d9d640 1 -- 172.21.15.137:0/1703797623 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c15dc30 con 0x7f775c0707e0 2024-04-26T22:03:24.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.737+0000 7f776159a640 1 -- 172.21.15.137:0/1703797623 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344701200 0 0) 0x7f775c0b4d60 con 0x7f775c15d600 2024-04-26T22:03:24.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f7762d9d640 1 --2- 172.21.15.137:0/1703797623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 0x7f775c070bf0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7758009d90 tx=0x7f775802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6872d452f3d98c60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776159a640 1 -- 172.21.15.137:0/1703797623 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758007740 con 0x7f775c0707e0 2024-04-26T22:03:24.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776159a640 1 -- 172.21.15.137:0/1703797623 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77580078e0 con 0x7f775c0707e0 2024-04-26T22:03:24.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776159a640 1 -- 172.21.15.137:0/1703797623 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758007cb0 con 0x7f775c0707e0 2024-04-26T22:03:24.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776359e640 1 -- 172.21.15.137:0/1703797623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 msgr2=0x7f775c070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776359e640 1 --2- 172.21.15.137:0/1703797623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 0x7f775c070bf0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7758009d90 tx=0x7f775802a6a0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776359e640 1 -- 172.21.15.137:0/1703797623 shutdown_connections 2024-04-26T22:03:24.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776359e640 1 --2- 172.21.15.137:0/1703797623 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 0x7f775c070bf0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776359e640 1 -- 172.21.15.137:0/1703797623 >> 172.21.15.137:0/1703797623 conn(0x7f775c072910 msgr2=0x7f775c072cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776359e640 1 -- 172.21.15.137:0/1703797623 shutdown_connections 2024-04-26T22:03:24.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.738+0000 7f776359e640 1 -- 172.21.15.137:0/1703797623 wait complete. 2024-04-26T22:03:24.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.740+0000 7f776359e640 1 Processor -- start 2024-04-26T22:03:24.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.740+0000 7f776359e640 1 -- start start 2024-04-26T22:03:24.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776359e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 0x7f775c156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776359e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f775c0aff30 0x7f775c14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776359e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f775c15d600 0x7f775c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776359e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f775c160c90 con 0x7f775c0707e0 2024-04-26T22:03:24.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776359e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f775c15e1f0 con 0x7f775c15d600 2024-04-26T22:03:24.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776359e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f775c15e4d0 con 0x7f775c0aff30 2024-04-26T22:03:24.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 0x7f775c156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 0x7f775c156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44918/0 (socket says 172.21.15.137:44918) 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776259c640 1 -- 172.21.15.137:0/748215146 learned_addr learned my addr 172.21.15.137:0/748215146 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776259c640 1 -- 172.21.15.137:0/748215146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f775c0aff30 msgr2=0x7f775c14ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776259c640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f775c0aff30 0x7f775c14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776259c640 1 -- 172.21.15.137:0/748215146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f775c15d600 msgr2=0x7f775c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f7762d9d640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f775c15d600 0x7f775c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776259c640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f775c15d600 0x7f775c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776259c640 1 -- 172.21.15.137:0/748215146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c1f88c0 con 0x7f775c0707e0 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f7762d9d640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f775c15d600 0x7f775c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776259c640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 0x7f775c156810 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f775000c410 tx=0x7f775000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f774effd640 1 -- 172.21.15.137:0/748215146 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750017070 con 0x7f775c0707e0 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f774effd640 1 -- 172.21.15.137:0/748215146 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77500035f0 con 0x7f775c0707e0 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776359e640 1 -- 172.21.15.137:0/748215146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c1f8ba0 con 0x7f775c0707e0 2024-04-26T22:03:24.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f774effd640 1 -- 172.21.15.137:0/748215146 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750003a20 con 0x7f775c0707e0 2024-04-26T22:03:24.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.741+0000 7f776359e640 1 -- 172.21.15.137:0/748215146 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c1f9160 con 0x7f775c0707e0 2024-04-26T22:03:24.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.743+0000 7f774effd640 1 -- 172.21.15.137:0/748215146 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f775001a070 con 0x7f775c0707e0 2024-04-26T22:03:24.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.743+0000 7f774effd640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f774006c8f0 0x7f774006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.744+0000 7f7761d9b640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f774006c8f0 0x7f774006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.744+0000 7f774effd640 1 -- 172.21.15.137:0/748215146 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f775008b050 con 0x7f775c0707e0 2024-04-26T22:03:24.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.744+0000 7f7761d9b640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f774006c8f0 0x7f774006edb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7754007fd0 tx=0x7f7754007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.744+0000 7f77675f2740 1 Processor -- start 2024-04-26T22:03:24.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f77675f2740 1 -- start start 2024-04-26T22:03:24.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f77675f2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf21ec0 0x56242bf24020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f77675f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf222a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f77675f2740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf4c980 0x56242bf4ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f77675f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56242be86b80 con 0x56242bf5e590 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f77675f2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56242be224d0 con 0x56242bf21ec0 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f77675f2740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56242be82b40 con 0x56242bf4c980 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f7761d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f7761d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf222a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44934/0 (socket says 172.21.15.137:44934) 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.745+0000 7f7761d9b640 1 -- 172.21.15.137:0/2097062287 learned_addr learned my addr 172.21.15.137:0/2097062287 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f776259c640 1 --2- 172.21.15.137:0/2097062287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf21ec0 0x56242bf24020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f7761d9b640 1 -- 172.21.15.137:0/2097062287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf4c980 msgr2=0x56242bf4ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f7761d9b640 1 --2- 172.21.15.137:0/2097062287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf4c980 0x56242bf4ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f7761d9b640 1 -- 172.21.15.137:0/2097062287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf21ec0 msgr2=0x56242bf24020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f7761d9b640 1 --2- 172.21.15.137:0/2097062287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf21ec0 0x56242bf24020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f7761d9b640 1 -- 172.21.15.137:0/2097062287 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56242be4f770 con 0x56242bf5e590 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f7761d9b640 1 --2- 172.21.15.137:0/2097062287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf222a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f77540074f0 tx=0x7f775400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84c054b4cb2469f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f773ffff640 1 -- 172.21.15.137:0/2097062287 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754016110 con 0x56242bf5e590 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f773ffff640 1 -- 172.21.15.137:0/2097062287 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7754005c80 con 0x56242bf5e590 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.746+0000 7f773ffff640 1 -- 172.21.15.137:0/2097062287 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77540162b0 con 0x56242bf5e590 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 -- 172.21.15.137:0/2097062287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 msgr2=0x56242bf222a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 --2- 172.21.15.137:0/2097062287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf222a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f77540074f0 tx=0x7f775400f000 comp rx=0 tx=0).stop 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 -- 172.21.15.137:0/2097062287 shutdown_connections 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 --2- 172.21.15.137:0/2097062287 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf222a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 --2- 172.21.15.137:0/2097062287 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf4c980 0x56242bf4ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 --2- 172.21.15.137:0/2097062287 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf21ec0 0x56242bf24020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 -- 172.21.15.137:0/2097062287 >> 172.21.15.137:0/2097062287 conn(0x56242beb6e90 msgr2=0x56242bf67980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 -- 172.21.15.137:0/2097062287 shutdown_connections 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 -- 172.21.15.137:0/2097062287 wait complete. 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 -- start start 2024-04-26T22:03:24.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.747+0000 7f77675f2740 1 Processor -- start 2024-04-26T22:03:24.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f77675f2740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf456a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f77675f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf4c980 0x56242bf47590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f77675f2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf5e590 0x56242bf49270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f77675f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56242be1fe70 con 0x56242bf4c980 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f77675f2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56242bf4a4d0 con 0x56242bf5e590 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f77675f2740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56242bf40f50 con 0x56242bf21ec0 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f77675f2740 10 client.0 _ll_register_callbacks cb 0x56242be30ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f7761d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf4c980 0x56242bf47590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f7761d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf4c980 0x56242bf47590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44950/0 (socket says 172.21.15.137:44950) 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f7761d9b640 1 -- 172.21.15.137:0/1862929668 learned_addr learned my addr 172.21.15.137:0/1862929668 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.748+0000 7f776259c640 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f7761d9b640 1 -- 172.21.15.137:0/1862929668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 msgr2=0x56242bf456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f7761d9b640 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf456a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f7761d9b640 1 -- 172.21.15.137:0/1862929668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf5e590 msgr2=0x56242bf49270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f7761d9b640 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf5e590 0x56242bf49270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f7761d9b640 1 -- 172.21.15.137:0/1862929668 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56242bc647c0 con 0x56242bf4c980 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f7761d9b640 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf4c980 0x56242bf47590 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f7754015000 tx=0x7f77540010f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d026909067232145 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f773d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f773d7fa640 1 -- 172.21.15.137:0/1862929668 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754016e10 con 0x56242bf4c980 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f773d7fa640 1 -- 172.21.15.137:0/1862929668 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f775401c040 con 0x56242bf4c980 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f77675f2740 1 -- 172.21.15.137:0/1862929668 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7754005c80 con 0x56242bf4c980 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f773d7fa640 1 -- 172.21.15.137:0/1862929668 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7754012440 con 0x56242bf4c980 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f77675f2740 10 client.7002 fetch_fsmap learned FSMap version 40 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f77675f2740 1 -- 172.21.15.137:0/1862929668 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x56242bcc4f50 con 0x56242bf4c980 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f773d7fa640 1 -- 172.21.15.137:0/1862929668 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7754005c80 con 0x56242bf4c980 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f773d7fa640 1 -- 172.21.15.137:0/1862929668 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f77540125e0 con 0x56242bf4c980 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f77675f2740 10 client.7002 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T22:03:24.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f77675f2740 10 client.7002 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f77675f2740 20 client.7002 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f77675f2740 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x56242bf7b2c0 0x56242bf7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f77675f2740 4 client.7002 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f77675f2740 1 -- 172.21.15.137:0/1862929668 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56242be3a240 con 0x56242bf7b2c0 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.749+0000 7f776259c640 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x56242bf7b2c0 0x56242bf7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f773d7fa640 10 client.7002 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f776259c640 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x56242bf7b2c0 0x56242bf7b6a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d7e05c7e378ddd server_cookie=d423323554e14e0e in_seq=0 out_seq=0 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f773d7fa640 1 -- 172.21.15.137:0/1862929668 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56242be3a240 con 0x56242bf7b2c0 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f773d7fa640 10 client.7002 handle_command_reply: tid=0 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f77675f2740 1 client.7002 shutdown 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f77675f2740 1 -- 172.21.15.137:0/1862929668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf4c980 msgr2=0x56242bf47590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f77675f2740 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf4c980 0x56242bf47590 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f7754015000 tx=0x7f77540010f0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f77675f2740 1 -- 172.21.15.137:0/1862929668 shutdown_connections 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f77675f2740 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x56242bf7b2c0 0x56242bf7b6a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f77675f2740 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf4c980 0x56242bf47590 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.750+0000 7f77675f2740 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf5e590 0x56242bf49270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.751+0000 7f773d7fa640 0 client.7002 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.751+0000 7f77675f2740 1 --2- 172.21.15.137:0/1862929668 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.751+0000 7f77675f2740 1 -- 172.21.15.137:0/1862929668 >> 172.21.15.137:0/1862929668 conn(0x56242beb6e90 msgr2=0x56242bf4a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.751+0000 7f77675f2740 1 -- 172.21.15.137:0/1862929668 shutdown_connections 2024-04-26T22:03:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.751+0000 7f77675f2740 1 -- 172.21.15.137:0/1862929668 wait complete. 2024-04-26T22:03:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.751+0000 7f77675f2740 20 client.7002 trim_cache size 0 max 16384 2024-04-26T22:03:24.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.764+0000 7f77675f2740 1 Processor -- start 2024-04-26T22:03:24.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.764+0000 7f77675f2740 1 -- start start 2024-04-26T22:03:24.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.764+0000 7f77675f2740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf81db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.764+0000 7f77675f2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf4c980 0x56242bf410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.764+0000 7f77675f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf41620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.764+0000 7f77675f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f775c070410 con 0x56242bf5e590 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.764+0000 7f77675f2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f775c06f770 con 0x56242bf4c980 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.764+0000 7f77675f2740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f775c06fdc0 con 0x56242bf21ec0 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f776259c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf81db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f776259c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf81db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:57980/0 (socket says 172.21.15.137:57980) 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f776259c640 1 -- 172.21.15.137:0/462521565 learned_addr learned my addr 172.21.15.137:0/462521565 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f7761d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf4c980 0x56242bf410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f7762d9d640 1 --2- 172.21.15.137:0/462521565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf41620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f776259c640 1 -- 172.21.15.137:0/462521565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf4c980 msgr2=0x56242bf410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f776259c640 1 --2- 172.21.15.137:0/462521565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf4c980 0x56242bf410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f776259c640 1 -- 172.21.15.137:0/462521565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 msgr2=0x56242bf41620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f776259c640 1 --2- 172.21.15.137:0/462521565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf41620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f776259c640 1 -- 172.21.15.137:0/462521565 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56242bb580b0 con 0x56242bf21ec0 2024-04-26T22:03:24.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f776259c640 1 --2- 172.21.15.137:0/462521565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf81db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7750058a60 tx=0x7f7750089430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8882870740d5f497 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f773f7fe640 1 -- 172.21.15.137:0/462521565 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750056e00 con 0x56242bf21ec0 2024-04-26T22:03:24.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f773f7fe640 1 -- 172.21.15.137:0/462521565 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7750057060 con 0x56242bf21ec0 2024-04-26T22:03:24.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.765+0000 7f773f7fe640 1 -- 172.21.15.137:0/462521565 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77500553d0 con 0x56242bf21ec0 2024-04-26T22:03:24.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.766+0000 7f77675f2740 1 -- 172.21.15.137:0/462521565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 msgr2=0x56242bf81db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.766+0000 7f77675f2740 1 --2- 172.21.15.137:0/462521565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf81db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7750058a60 tx=0x7f7750089430 comp rx=0 tx=0).stop 2024-04-26T22:03:24.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.766+0000 7f77675f2740 1 -- 172.21.15.137:0/462521565 shutdown_connections 2024-04-26T22:03:24.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.766+0000 7f77675f2740 1 --2- 172.21.15.137:0/462521565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf5e590 0x56242bf41620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.766+0000 7f77675f2740 1 --2- 172.21.15.137:0/462521565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf4c980 0x56242bf410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.766+0000 7f77675f2740 1 --2- 172.21.15.137:0/462521565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf21ec0 0x56242bf81db0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.766+0000 7f77675f2740 1 -- 172.21.15.137:0/462521565 >> 172.21.15.137:0/462521565 conn(0x56242beb6e90 msgr2=0x56242bf45680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.766+0000 7f77675f2740 1 -- 172.21.15.137:0/462521565 shutdown_connections 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.766+0000 7f77675f2740 1 -- 172.21.15.137:0/462521565 wait complete. 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.767+0000 7f77675f2740 1 -- start start 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.767+0000 7f77675f2740 1 Processor -- start 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.767+0000 7f77675f2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf21ec0 0x56242bf410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.767+0000 7f77675f2740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf4c980 0x56242bf41620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f77675f2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf5e590 0x56242bf5d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f77675f2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56242bf3e670 con 0x56242bf21ec0 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f77675f2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56242bf40c90 con 0x56242bf5e590 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f77675f2740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56242bf42b60 con 0x56242bf4c980 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f77675f2740 10 client.0 _ll_register_callbacks cb 0x7f77540073f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f776259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf21ec0 0x56242bf410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f776259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf21ec0 0x56242bf410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44974/0 (socket says 172.21.15.137:44974) 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f776259c640 1 -- 172.21.15.137:0/689571647 learned_addr learned my addr 172.21.15.137:0/689571647 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f7762d9d640 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf5e590 0x56242bf5d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f7761d9b640 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf4c980 0x56242bf41620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f776259c640 1 -- 172.21.15.137:0/689571647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf4c980 msgr2=0x56242bf41620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f776259c640 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf4c980 0x56242bf41620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f776259c640 1 -- 172.21.15.137:0/689571647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf5e590 msgr2=0x56242bf5d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f776259c640 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf5e590 0x56242bf5d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f776259c640 1 -- 172.21.15.137:0/689571647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56242bfe49f0 con 0x56242bf21ec0 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f776259c640 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf21ec0 0x56242bf410e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f77500551c0 tx=0x7f7754007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1b4e2f0ee76683 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f773d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f773d7fa640 1 -- 172.21.15.137:0/689571647 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77500782c0 con 0x56242bf21ec0 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f773d7fa640 1 -- 172.21.15.137:0/689571647 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f7750079de0 con 0x56242bf21ec0 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f77675f2740 1 -- 172.21.15.137:0/689571647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7750057060 con 0x56242bf21ec0 2024-04-26T22:03:24.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f773d7fa640 1 -- 172.21.15.137:0/689571647 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f77500553d0 con 0x56242bf21ec0 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f77675f2740 10 client.7008 fetch_fsmap learned FSMap version 40 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.768+0000 7f77675f2740 1 -- 172.21.15.137:0/689571647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x56242bf4ef10 con 0x56242bf21ec0 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f773d7fa640 1 -- 172.21.15.137:0/689571647 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7750057060 con 0x56242bf21ec0 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f773d7fa640 1 -- 172.21.15.137:0/689571647 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f7750003bc0 con 0x56242bf21ec0 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f77675f2740 10 client.7008 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f77675f2740 10 client.7008 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f77675f2740 20 client.7008 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f77675f2740 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x56242bf5d9e0 0x56242bf8a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f77675f2740 4 client.7008 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f77675f2740 1 -- 172.21.15.137:0/689571647 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x56242bf405f0 con 0x56242bf5d9e0 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f7761d9b640 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x56242bf5d9e0 0x56242bf8a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f773d7fa640 10 client.7008 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f7761d9b640 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x56242bf5d9e0 0x56242bf8a650 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56eb1ee0f0c56fcb server_cookie=efb13004f4ce3872 in_seq=0 out_seq=0 2024-04-26T22:03:24.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f773d7fa640 1 -- 172.21.15.137:0/689571647 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+236 (crc 0 0 0) 0x56242bf405f0 con 0x56242bf5d9e0 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f773d7fa640 10 client.7008 handle_command_reply: tid=0 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f77675f2740 1 client.7008 shutdown 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f77675f2740 1 -- 172.21.15.137:0/689571647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf21ec0 msgr2=0x56242bf410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.769+0000 7f77675f2740 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf21ec0 0x56242bf410e0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f77500551c0 tx=0x7f7754007000 comp rx=0 tx=0).stop 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f77675f2740 1 -- 172.21.15.137:0/689571647 shutdown_connections 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f77675f2740 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x56242bf5d9e0 0x56242bf8a650 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f77675f2740 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56242bf5e590 0x56242bf5d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f77675f2740 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56242bf4c980 0x56242bf41620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f77675f2740 1 --2- 172.21.15.137:0/689571647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56242bf21ec0 0x56242bf410e0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f773d7fa640 0 client.7008 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f77675f2740 1 -- 172.21.15.137:0/689571647 >> 172.21.15.137:0/689571647 conn(0x56242beb6e90 msgr2=0x56242bf4a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f77675f2740 1 -- 172.21.15.137:0/689571647 shutdown_connections 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f77675f2740 1 -- 172.21.15.137:0/689571647 wait complete. 2024-04-26T22:03:24.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f77675f2740 20 client.7008 trim_cache size 0 max 16384 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "dentry", 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 579372313, 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511627776, 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: "frag": "*", 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: "dname": "file_to_be_damaged", 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: "snap_id": "head", 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/subdir/file_to_be_damaged" 2024-04-26T22:03:24.777 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:03:24.778 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:03:24.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 -- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f774006c8f0 msgr2=0x7f774006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f774006c8f0 0x7f774006edb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7754007fd0 tx=0x7f7754007920 comp rx=0 tx=0).stop 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 -- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 msgr2=0x7f775c156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 0x7f775c156810 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f775000c410 tx=0x7f775000c8d0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 -- 172.21.15.137:0/748215146 shutdown_connections 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f774006c8f0 0x7f774006edb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f775c15d600 0x7f775c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f775c0aff30 0x7f775c14ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 --2- 172.21.15.137:0/748215146 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f775c0707e0 0x7f775c156810 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 -- 172.21.15.137:0/748215146 >> 172.21.15.137:0/748215146 conn(0x7f775c072910 msgr2=0x7f775c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 -- 172.21.15.137:0/748215146 shutdown_connections 2024-04-26T22:03:24.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.770+0000 7f776359e640 1 -- 172.21.15.137:0/748215146 wait complete. 2024-04-26T22:03:24.781 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T22:03:24.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.877+0000 7fe69c47e640 1 Processor -- start 2024-04-26T22:03:24.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.877+0000 7fe69c47e640 1 -- start start 2024-04-26T22:03:24.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.878+0000 7fe69c47e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe6940d5810 0x7fe6940b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.878+0000 7fe69c47e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6940b2550 con 0x7fe6940d2e20 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.878+0000 7fe69c47e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6940b2830 con 0x7fe69415f4d0 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.878+0000 7fe69c47e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe6940b6180 con 0x7fe6940d5810 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.878+0000 7fe69aa1b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe6940d2e20 0x7fe6940b35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33226/0 (socket says 172.21.15.137:33226) 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.878+0000 7fe69aa1b640 1 -- 172.21.15.137:0/3497848318 learned_addr learned my addr 172.21.15.137:0/3497848318 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699a19640 1 --2- 172.21.15.137:0/3497848318 >> v2:172.21.15.170:3300/0 conn(0x7fe6940d5810 0x7fe6940b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303015931 0 0) 0x7fe6940b2550 con 0x7fe6940d2e20 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe680003520 con 0x7fe6940d2e20 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 929522083 0 0) 0x7fe680003520 con 0x7fe6940d2e20 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 >> v2:172.21.15.170:3300/0 conn(0x7fe6940d5810 msgr2=0x7fe6940b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 --2- 172.21.15.137:0/3497848318 >> v2:172.21.15.170:3300/0 conn(0x7fe6940d5810 0x7fe6940b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 >> v1:172.21.15.170:6789/0 conn(0x7fe69415f4d0 legacy=0x7fe6940d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6940b2b10 con 0x7fe6940d2e20 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fe68c001670 con 0x7fe6940d2e20 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 >> v1:172.21.15.137:6789/0 conn(0x7fe6940d2e20 legacy=0x7fe6940b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe680003a00 0x7fe680003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe680004800 0x7fe680004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe680005210 0x7fe68000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6940b6180 con 0x7fe680005210 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe68000c160 con 0x7fe680003a00 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe68000c360 con 0x7fe680004800 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe69aa1b640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe680005210 0x7fe68000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe69a21a640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe680003a00 0x7fe680003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe699a19640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe680004800 0x7fe680004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe69aa1b640 1 -- 172.21.15.137:0/3497848318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe680004800 msgr2=0x7fe680004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe69aa1b640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe680004800 0x7fe680004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe69aa1b640 1 -- 172.21.15.137:0/3497848318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe680003a00 msgr2=0x7fe680003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:24.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe69aa1b640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe680003a00 0x7fe680003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.879+0000 7fe69aa1b640 1 -- 172.21.15.137:0/3497848318 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe680003520 con 0x7fe680005210 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.880+0000 7fe69aa1b640 1 -- 172.21.15.137:0/3497848318 reap_dead start 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.880+0000 7fe69aa1b640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe680005210 0x7fe68000b9c0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c160 tx=0x7fe680005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1651421b885186fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.880+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c007c60 con 0x7fe680005210 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.880+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe68c005ad0 con 0x7fe680005210 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.880+0000 7fe699218640 1 -- 172.21.15.137:0/3497848318 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c007070 con 0x7fe680005210 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.881+0000 7fe69c47e640 1 -- 172.21.15.137:0/3497848318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe680005210 msgr2=0x7fe68000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.881+0000 7fe69c47e640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe680005210 0x7fe68000b9c0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c160 tx=0x7fe680005830 comp rx=0 tx=0).stop 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.881+0000 7fe69c47e640 1 -- 172.21.15.137:0/3497848318 shutdown_connections 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.881+0000 7fe69c47e640 1 --2- 172.21.15.137:0/3497848318 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe680005210 0x7fe68000b9c0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.881+0000 7fe69c47e640 1 -- 172.21.15.137:0/3497848318 >> 172.21.15.137:0/3497848318 conn(0x7fe69408ebf0 msgr2=0x7fe69409e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.881+0000 7fe69c47e640 1 -- 172.21.15.137:0/3497848318 shutdown_connections 2024-04-26T22:03:24.884 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.881+0000 7fe69c47e640 1 -- 172.21.15.137:0/3497848318 wait complete. 2024-04-26T22:03:24.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.882+0000 7fe69c47e640 1 Processor -- start 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.882+0000 7fe69c47e640 1 -- start start 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69c47e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe680005210 0x7fe6940ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69c47e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe694157910 0x7fe6940b8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69c47e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6940b9420 0x7fe6940ba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69c47e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6940b1ee0 con 0x7fe6940b9420 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69c47e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe6940b30d0 con 0x7fe680005210 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69c47e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe6940b2060 con 0x7fe694157910 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69aa1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6940b9420 0x7fe6940ba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69aa1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6940b9420 0x7fe6940ba6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44994/0 (socket says 172.21.15.137:44994) 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69aa1b640 1 -- 172.21.15.137:0/525019336 learned_addr learned my addr 172.21.15.137:0/525019336 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:24.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69aa1b640 1 -- 172.21.15.137:0/525019336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe694157910 msgr2=0x7fe6940b8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69aa1b640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe694157910 0x7fe6940b8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69a21a640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe680005210 0x7fe6940ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69aa1b640 1 -- 172.21.15.137:0/525019336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe680005210 msgr2=0x7fe6940ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69aa1b640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe680005210 0x7fe6940ced10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69aa1b640 1 -- 172.21.15.137:0/525019336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6940b98a0 con 0x7fe6940b9420 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe69aa1b640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6940b9420 0x7fe6940ba6c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c280 tx=0x7fe68c001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe68affd640 1 -- 172.21.15.137:0/525019336 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0015c0 con 0x7fe6940b9420 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.883+0000 7fe68affd640 1 -- 172.21.15.137:0/525019336 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe68c040070 con 0x7fe6940b9420 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.884+0000 7fe68affd640 1 -- 172.21.15.137:0/525019336 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68c004a00 con 0x7fe6940b9420 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.884+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6940b9b80 con 0x7fe6940b9420 2024-04-26T22:03:24.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.884+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6940ba140 con 0x7fe6940b9420 2024-04-26T22:03:24.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.884+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe69406a290 con 0x7fe6940b9420 2024-04-26T22:03:24.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.885+0000 7fe68affd640 1 -- 172.21.15.137:0/525019336 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe68c03a070 con 0x7fe6940b9420 2024-04-26T22:03:24.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.885+0000 7fe68affd640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe67806c8f0 0x7fe67806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:24.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.885+0000 7fe68affd640 1 -- 172.21.15.137:0/525019336 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fe68c0ab4c0 con 0x7fe6940b9420 2024-04-26T22:03:24.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.885+0000 7fe69a21a640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe67806c8f0 0x7fe67806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:24.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.886+0000 7fe69a21a640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe67806c8f0 0x7fe67806edb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe690003e50 tx=0x7fe690009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:24.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:24.889+0000 7fe68affd640 1 -- 172.21.15.137:0/525019336 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe68c079840 con 0x7fe6940b9420 2024-04-26T22:03:25.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.101+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe6940cc390 con 0x7fe6940b9420 2024-04-26T22:03:25.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.101+0000 7fe68affd640 1 -- 172.21.15.137:0/525019336 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7fe68c079140 con 0x7fe6940b9420 2024-04-26T22:03:25.101 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:03:25.101 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-26T22:03:25.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe67806c8f0 msgr2=0x7fe67806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe67806c8f0 0x7fe67806edb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe690003e50 tx=0x7fe690009040 comp rx=0 tx=0).stop 2024-04-26T22:03:25.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6940b9420 msgr2=0x7fe6940ba6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6940b9420 0x7fe6940ba6c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00c280 tx=0x7fe68c001970 comp rx=0 tx=0).stop 2024-04-26T22:03:25.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 shutdown_connections 2024-04-26T22:03:25.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe67806c8f0 0x7fe67806edb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6940b9420 0x7fe6940ba6c0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe694157910 0x7fe6940b8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 --2- 172.21.15.137:0/525019336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe680005210 0x7fe6940ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 >> 172.21.15.137:0/525019336 conn(0x7fe69408ebf0 msgr2=0x7fe6940d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 shutdown_connections 2024-04-26T22:03:25.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.103+0000 7fe69c47e640 1 -- 172.21.15.137:0/525019336 wait complete. 2024-04-26T22:03:25.114 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-26T22:03:25.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:25.114 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-04-26T22:03:25.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.216+0000 7fd62a940640 1 Processor -- start 2024-04-26T22:03:25.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.216+0000 7fd62a940640 1 -- start start 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.217+0000 7fd62a940640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd62406f600 0x7fd624160e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.217+0000 7fd62a940640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd624161570 con 0x7fd6241437f0 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.217+0000 7fd62a940640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd624161850 con 0x7fd6240d1190 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.217+0000 7fd62a940640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd624073440 con 0x7fd62406f600 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.217+0000 7fd6237fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd62406f600 0x7fd624160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.217+0000 7fd623fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd6241437f0 0x7fd624144120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33234/0 (socket says 172.21.15.137:33234) 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.217+0000 7fd623fff640 1 -- 172.21.15.137:0/1815475328 learned_addr learned my addr 172.21.15.137:0/1815475328 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.218+0000 7fd6237fe640 1 -- 172.21.15.137:0/1815475328 >> v1:172.21.15.170:6789/0 conn(0x7fd6240d1190 legacy=0x7fd624073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.218+0000 7fd622ffd640 1 -- 172.21.15.137:0/1815475328 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157848679 0 0) 0x7fd624161570 con 0x7fd6241437f0 2024-04-26T22:03:25.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.218+0000 7fd6237fe640 1 -- 172.21.15.137:0/1815475328 >> v1:172.21.15.137:6789/0 conn(0x7fd6241437f0 legacy=0x7fd624144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.218+0000 7fd6237fe640 1 -- 172.21.15.137:0/1815475328 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd624161b30 con 0x7fd62406f600 2024-04-26T22:03:25.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.218+0000 7fd6237fe640 1 --2- 172.21.15.137:0/1815475328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62406f600 0x7fd624160e70 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fd6180097a0 tx=0x7fd61802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f488e33cbc61c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.218+0000 7fd622ffd640 1 -- 172.21.15.137:0/1815475328 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618037070 con 0x7fd62406f600 2024-04-26T22:03:25.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.218+0000 7fd622ffd640 1 -- 172.21.15.137:0/1815475328 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd618032440 con 0x7fd62406f600 2024-04-26T22:03:25.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.218+0000 7fd622ffd640 1 -- 172.21.15.137:0/1815475328 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618032810 con 0x7fd62406f600 2024-04-26T22:03:25.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.219+0000 7fd62a940640 1 -- 172.21.15.137:0/1815475328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62406f600 msgr2=0x7fd624160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.219+0000 7fd62a940640 1 --2- 172.21.15.137:0/1815475328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62406f600 0x7fd624160e70 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fd6180097a0 tx=0x7fd61802a1e0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.219+0000 7fd62a940640 1 -- 172.21.15.137:0/1815475328 shutdown_connections 2024-04-26T22:03:25.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.219+0000 7fd62a940640 1 --2- 172.21.15.137:0/1815475328 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd62406f600 0x7fd624160e70 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.219+0000 7fd62a940640 1 -- 172.21.15.137:0/1815475328 >> 172.21.15.137:0/1815475328 conn(0x7fd62406c690 msgr2=0x7fd62406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.219+0000 7fd62a940640 1 -- 172.21.15.137:0/1815475328 shutdown_connections 2024-04-26T22:03:25.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.219+0000 7fd62a940640 1 -- 172.21.15.137:0/1815475328 wait complete. 2024-04-26T22:03:25.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.220+0000 7fd62a940640 1 Processor -- start 2024-04-26T22:03:25.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.220+0000 7fd62a940640 1 -- start start 2024-04-26T22:03:25.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd62a940640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62406f600 0x7fd624136f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd62a940640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6240d1190 0x7fd624155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd62a940640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6241437f0 0x7fd624158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd62a940640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd624143d50 con 0x7fd6240d1190 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd62a940640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd624143bd0 con 0x7fd62406f600 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd62a940640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6240742d0 con 0x7fd6241437f0 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd6237fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6240d1190 0x7fd624155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd6237fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6240d1190 0x7fd624155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45020/0 (socket says 172.21.15.137:45020) 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd6237fe640 1 -- 172.21.15.137:0/1849705785 learned_addr learned my addr 172.21.15.137:0/1849705785 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd623fff640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62406f600 0x7fd624136f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd628edd640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6241437f0 0x7fd624158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd6237fe640 1 -- 172.21.15.137:0/1849705785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6241437f0 msgr2=0x7fd624158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd6237fe640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6241437f0 0x7fd624158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd6237fe640 1 -- 172.21.15.137:0/1849705785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62406f600 msgr2=0x7fd624136f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd6237fe640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62406f600 0x7fd624136f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd6237fe640 1 -- 172.21.15.137:0/1849705785 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6240b4180 con 0x7fd6240d1190 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.221+0000 7fd628edd640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6241437f0 0x7fd624158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.222+0000 7fd6237fe640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6240d1190 0x7fd624155b80 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd6180097a0 tx=0x7fd6180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.222+0000 7fd620ff9640 1 -- 172.21.15.137:0/1849705785 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618041070 con 0x7fd6240d1190 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.222+0000 7fd620ff9640 1 -- 172.21.15.137:0/1849705785 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd61803c870 con 0x7fd6240d1190 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.222+0000 7fd62a940640 1 -- 172.21.15.137:0/1849705785 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6240b4460 con 0x7fd6240d1190 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.222+0000 7fd620ff9640 1 -- 172.21.15.137:0/1849705785 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618037040 con 0x7fd6240d1190 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.222+0000 7fd62a940640 1 -- 172.21.15.137:0/1849705785 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6240b4a20 con 0x7fd6240d1190 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.223+0000 7fd620ff9640 1 -- 172.21.15.137:0/1849705785 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd618044070 con 0x7fd6240d1190 2024-04-26T22:03:25.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.224+0000 7fd620ff9640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd61006c8f0 0x7fd61006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.224+0000 7fd620ff9640 1 -- 172.21.15.137:0/1849705785 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fd6180ac660 con 0x7fd6240d1190 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.224+0000 7fd623fff640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd61006c8f0 0x7fd61006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.224+0000 7fd623fff640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd61006c8f0 0x7fd61006edb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd614000f60 tx=0x7fd614007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd62d65b740 1 Processor -- start 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd62d65b740 1 -- start start 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 0x5617aec61160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec90c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec911b0 0x5617aec65fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd62d65b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5617aebcbd00 con 0x5617aec918f0 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd62d65b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5617aeb67b20 con 0x5617aecae7d0 2024-04-26T22:03:25.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd62d65b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5617aebc7cc0 con 0x5617aec911b0 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd6237fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec90c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.225+0000 7fd6237fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec90c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45030/0 (socket says 172.21.15.137:45030) 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd6237fe640 1 -- 172.21.15.137:0/2918879150 learned_addr learned my addr 172.21.15.137:0/2918879150 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd6237fe640 1 -- 172.21.15.137:0/2918879150 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec911b0 msgr2=0x5617aec65fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd6237fe640 1 --2- 172.21.15.137:0/2918879150 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec911b0 0x5617aec65fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd6237fe640 1 -- 172.21.15.137:0/2918879150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 msgr2=0x5617aec61160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd6237fe640 1 --2- 172.21.15.137:0/2918879150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 0x5617aec61160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd6237fe640 1 -- 172.21.15.137:0/2918879150 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ae9a5a50 con 0x5617aec918f0 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd6237fe640 1 --2- 172.21.15.137:0/2918879150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec90c70 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd6180aaab0 tx=0x7fd618079eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4c64c21ba82992 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd609ffb640 1 -- 172.21.15.137:0/2918879150 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61804b050 con 0x5617aec918f0 2024-04-26T22:03:25.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd609ffb640 1 -- 172.21.15.137:0/2918879150 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd61807e840 con 0x5617aec918f0 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.226+0000 7fd609ffb640 1 -- 172.21.15.137:0/2918879150 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618083070 con 0x5617aec918f0 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 -- 172.21.15.137:0/2918879150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 msgr2=0x5617aec90c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2918879150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec90c70 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fd6180aaab0 tx=0x7fd618079eb0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 -- 172.21.15.137:0/2918879150 shutdown_connections 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2918879150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec90c70 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2918879150 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec911b0 0x5617aec65fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2918879150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 0x5617aec61160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 -- 172.21.15.137:0/2918879150 >> 172.21.15.137:0/2918879150 conn(0x5617aec633d0 msgr2=0x5617aecabc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 -- 172.21.15.137:0/2918879150 shutdown_connections 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 -- 172.21.15.137:0/2918879150 wait complete. 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 -- start start 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.227+0000 7fd62d65b740 1 Processor -- start 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec93670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 0x5617aec8fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 0x5617aec8fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd62d65b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5617aec65580 con 0x5617aec918f0 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd62d65b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5617aeb657d0 con 0x5617aecae7d0 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd62d65b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5617aec64970 con 0x5617aec8b850 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd62d65b740 10 client.0 _ll_register_callbacks cb 0x5617aeb53280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd623fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec93670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd623fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec93670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45036/0 (socket says 172.21.15.137:45036) 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.228+0000 7fd623fff640 1 -- 172.21.15.137:0/12112272 learned_addr learned my addr 172.21.15.137:0/12112272 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd6237fe640 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 0x5617aec8fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd628edd640 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 0x5617aec8fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd623fff640 1 -- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 msgr2=0x5617aec8fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd623fff640 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 0x5617aec8fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd623fff640 1 -- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 msgr2=0x5617aec8fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd623fff640 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 0x5617aec8fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd623fff640 1 -- 172.21.15.137:0/12112272 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ae89d3e0 con 0x5617aec918f0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd628edd640 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 0x5617aec8fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd6237fe640 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 0x5617aec8fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd623fff640 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec93670 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fd614007fa0 tx=0x7fd614001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0c65657f7c020d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd602ffd640 1 -- 172.21.15.137:0/12112272 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614015110 con 0x5617aec918f0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd602ffd640 1 -- 172.21.15.137:0/12112272 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fd614023b80 con 0x5617aec918f0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd62d65b740 1 -- 172.21.15.137:0/12112272 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd61807e840 con 0x5617aec918f0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd602ffd640 1 -- 172.21.15.137:0/12112272 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd614023d80 con 0x5617aec918f0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd62d65b740 10 client.7029 fetch_fsmap learned FSMap version 40 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd62d65b740 1 -- 172.21.15.137:0/12112272 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5617aea061e0 con 0x5617aec918f0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd602ffd640 1 -- 172.21.15.137:0/12112272 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd61807e840 con 0x5617aec918f0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd602ffd640 1 -- 172.21.15.137:0/12112272 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7fd61402a050 con 0x5617aec918f0 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd62d65b740 10 client.7029 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T22:03:25.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd62d65b740 10 client.7029 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd62d65b740 20 client.7029 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd62d65b740 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5617aec91de0 0x5617aec92230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd62d65b740 4 client.7029 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd62d65b740 1 -- 172.21.15.137:0/12112272 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617aebd9910 con 0x5617aec91de0 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.229+0000 7fd6237fe640 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5617aec91de0 0x5617aec92230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.230+0000 7fd602ffd640 10 client.7029 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.230+0000 7fd6237fe640 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5617aec91de0 0x5617aec92230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3dee7a14efa0300 server_cookie=dd07a1cbcc039c2e in_seq=0 out_seq=0 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.230+0000 7fd602ffd640 1 -- 172.21.15.137:0/12112272 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5617aebd9910 con 0x5617aec91de0 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.230+0000 7fd602ffd640 10 client.7029 handle_command_reply: tid=0 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.230+0000 7fd62d65b740 1 client.7029 shutdown 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.230+0000 7fd62d65b740 1 -- 172.21.15.137:0/12112272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 msgr2=0x5617aec93670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.230+0000 7fd62d65b740 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec93670 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fd614007fa0 tx=0x7fd614001080 comp rx=0 tx=0).stop 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.230+0000 7fd62d65b740 1 -- 172.21.15.137:0/12112272 shutdown_connections 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.231+0000 7fd62d65b740 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5617aec91de0 0x5617aec92230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.231+0000 7fd62d65b740 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 0x5617aec8fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.231+0000 7fd602ffd640 0 client.7029 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:25.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.231+0000 7fd62d65b740 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aecae7d0 0x5617aec8fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.231+0000 7fd62d65b740 1 --2- 172.21.15.137:0/12112272 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec918f0 0x5617aec93670 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.231+0000 7fd62d65b740 1 -- 172.21.15.137:0/12112272 >> 172.21.15.137:0/12112272 conn(0x5617aec911b0 msgr2=0x5617aecaf090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.231+0000 7fd62d65b740 1 -- 172.21.15.137:0/12112272 shutdown_connections 2024-04-26T22:03:25.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.231+0000 7fd62d65b740 1 -- 172.21.15.137:0/12112272 wait complete. 2024-04-26T22:03:25.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.231+0000 7fd62d65b740 20 client.7029 trim_cache size 0 max 16384 2024-04-26T22:03:25.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.248+0000 7fd62d65b740 1 Processor -- start 2024-04-26T22:03:25.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.248+0000 7fd62d65b740 1 -- start start 2024-04-26T22:03:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aeca1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 0x5617aecaf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aec918f0 0x5617aecacc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd62d65b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd624201a10 con 0x5617aec911b0 2024-04-26T22:03:25.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd62d65b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd624200ce0 con 0x5617aec918f0 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd62d65b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6240aeb40 con 0x5617aec8b850 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd623fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aeca1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd623fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aeca1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45046/0 (socket says 172.21.15.137:45046) 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd623fff640 1 -- 172.21.15.137:0/3454440851 learned_addr learned my addr 172.21.15.137:0/3454440851 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd623fff640 1 -- 172.21.15.137:0/3454440851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 msgr2=0x5617aecaf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd623fff640 1 --2- 172.21.15.137:0/3454440851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 0x5617aecaf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd623fff640 1 -- 172.21.15.137:0/3454440851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aec918f0 msgr2=0x5617aecacc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd623fff640 1 --2- 172.21.15.137:0/3454440851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aec918f0 0x5617aecacc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd623fff640 1 -- 172.21.15.137:0/3454440851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ae8764a0 con 0x5617aec911b0 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd623fff640 1 --2- 172.21.15.137:0/3454440851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aeca1da0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fd614024fd0 tx=0x7fd61401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17783bc74f84d37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd6097fa640 1 -- 172.21.15.137:0/3454440851 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd614015110 con 0x5617aec911b0 2024-04-26T22:03:25.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd6097fa640 1 -- 172.21.15.137:0/3454440851 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd614031020 con 0x5617aec911b0 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.249+0000 7fd6097fa640 1 -- 172.21.15.137:0/3454440851 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61402c6b0 con 0x5617aec911b0 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 -- 172.21.15.137:0/3454440851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 msgr2=0x5617aeca1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 --2- 172.21.15.137:0/3454440851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aeca1da0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fd614024fd0 tx=0x7fd61401d000 comp rx=0 tx=0).stop 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 -- 172.21.15.137:0/3454440851 shutdown_connections 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 --2- 172.21.15.137:0/3454440851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aec918f0 0x5617aecacc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 --2- 172.21.15.137:0/3454440851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec8b850 0x5617aecaf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 --2- 172.21.15.137:0/3454440851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aeca1da0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 -- 172.21.15.137:0/3454440851 >> 172.21.15.137:0/3454440851 conn(0x5617aec937d0 msgr2=0x5617aec8ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 -- 172.21.15.137:0/3454440851 shutdown_connections 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 -- 172.21.15.137:0/3454440851 wait complete. 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.250+0000 7fd62d65b740 1 -- start start 2024-04-26T22:03:25.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd62d65b740 1 Processor -- start 2024-04-26T22:03:25.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aec8b850 0x5617aecada40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aed0c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd62d65b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec918f0 0x5617aec8ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd62d65b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6240af190 con 0x5617aec911b0 2024-04-26T22:03:25.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd62d65b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5617aec8f8e0 con 0x5617aec8b850 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd62d65b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5617aecbf070 con 0x5617aec918f0 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd62d65b740 10 client.0 _ll_register_callbacks cb 0x7fd6140017d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd6237fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aed0c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd6237fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aed0c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45052/0 (socket says 172.21.15.137:45052) 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.251+0000 7fd6237fe640 1 -- 172.21.15.137:0/2483083608 learned_addr learned my addr 172.21.15.137:0/2483083608 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd628edd640 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec918f0 0x5617aec8ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd6237fe640 1 -- 172.21.15.137:0/2483083608 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec918f0 msgr2=0x5617aec8ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd623fff640 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aec8b850 0x5617aecada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd6237fe640 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec918f0 0x5617aec8ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd6237fe640 1 -- 172.21.15.137:0/2483083608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aec8b850 msgr2=0x5617aecada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd6237fe640 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aec8b850 0x5617aecada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd6237fe640 1 -- 172.21.15.137:0/2483083608 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617aecbf2c0 con 0x5617aec911b0 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd6237fe640 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aed0c090 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fd61807a190 tx=0x7fd6180aaa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b3de4f18c471b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd602ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd602ffd640 1 -- 172.21.15.137:0/2483083608 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61804b040 con 0x5617aec911b0 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd602ffd640 1 -- 172.21.15.137:0/2483083608 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fd618076b00 con 0x5617aec911b0 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd62d65b740 1 -- 172.21.15.137:0/2483083608 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd614031020 con 0x5617aec911b0 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd602ffd640 1 -- 172.21.15.137:0/2483083608 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd61803cc60 con 0x5617aec911b0 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd62d65b740 10 client.7035 fetch_fsmap learned FSMap version 40 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd62d65b740 1 -- 172.21.15.137:0/2483083608 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x5617aec8f620 con 0x5617aec911b0 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd602ffd640 1 -- 172.21.15.137:0/2483083608 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd614031020 con 0x5617aec911b0 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd602ffd640 1 -- 172.21.15.137:0/2483083608 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7fd618082be0 con 0x5617aec911b0 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd62d65b740 10 client.7035 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd62d65b740 10 client.7035 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd62d65b740 20 client.7035 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5617aecae7d0 0x5617aecc5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd62d65b740 4 client.7035 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-04-26T22:03:25.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd62d65b740 1 -- 172.21.15.137:0/2483083608 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) -- 0x5617aebd3780 con 0x5617aecae7d0 2024-04-26T22:03:25.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.252+0000 7fd623fff640 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5617aecae7d0 0x5617aecc5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd602ffd640 10 client.7035 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:25.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd623fff640 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5617aecae7d0 0x5617aecc5640 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df87cf7a9c716055 server_cookie=2f9a7ae7cf8cf331 in_seq=0 out_seq=0 2024-04-26T22:03:25.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd602ffd640 1 -- 172.21.15.137:0/2483083608 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5617aebd3780 con 0x5617aecae7d0 2024-04-26T22:03:25.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd602ffd640 10 client.7035 handle_command_reply: tid=0 2024-04-26T22:03:25.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd62d65b740 1 client.7035 shutdown 2024-04-26T22:03:25.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd62d65b740 1 -- 172.21.15.137:0/2483083608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 msgr2=0x5617aed0c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aed0c090 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fd61807a190 tx=0x7fd6180aaa40 comp rx=0 tx=0).stop 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd62d65b740 1 -- 172.21.15.137:0/2483083608 shutdown_connections 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5617aecae7d0 0x5617aecc5640 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5617aec911b0 0x5617aed0c090 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5617aec918f0 0x5617aec8ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd602ffd640 0 client.7035 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd62d65b740 1 --2- 172.21.15.137:0/2483083608 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5617aec8b850 0x5617aecada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.253+0000 7fd62d65b740 1 -- 172.21.15.137:0/2483083608 >> 172.21.15.137:0/2483083608 conn(0x5617aec937d0 msgr2=0x5617aecbb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62d65b740 1 -- 172.21.15.137:0/2483083608 shutdown_connections 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62d65b740 1 -- 172.21.15.137:0/2483083608 wait complete. 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62d65b740 20 client.7035 trim_cache size 0 max 16384 2024-04-26T22:03:25.260 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:03:25.261 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:03:25.261 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "482c1fdf-2cb5-4c61-86c1-bb24495b55e2", 2024-04-26T22:03:25.261 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:03:25.261 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 -- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd61006c8f0 msgr2=0x7fd61006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd61006c8f0 0x7fd61006edb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd614000f60 tx=0x7fd614007c00 comp rx=0 tx=0).stop 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 -- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6240d1190 msgr2=0x7fd624155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6240d1190 0x7fd624155b80 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fd6180097a0 tx=0x7fd6180046c0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 -- 172.21.15.137:0/1849705785 shutdown_connections 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd61006c8f0 0x7fd61006edb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6240d1190 0x7fd624155b80 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6241437f0 0x7fd624158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 --2- 172.21.15.137:0/1849705785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd62406f600 0x7fd624136f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 -- 172.21.15.137:0/1849705785 >> 172.21.15.137:0/1849705785 conn(0x7fd62406c690 msgr2=0x7fd62406ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 -- 172.21.15.137:0/1849705785 shutdown_connections 2024-04-26T22:03:25.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.254+0000 7fd62a940640 1 -- 172.21.15.137:0/1849705785 wait complete. 2024-04-26T22:03:25.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:25.265 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-26T22:03:25.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.363+0000 7f0d6f9e4640 1 Processor -- start 2024-04-26T22:03:25.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.363+0000 7f0d6f9e4640 1 -- start start 2024-04-26T22:03:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d6f9e4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 0x7f0d6806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d6f9e4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0d6806c9b0 0x7f0d680afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d6f9e4640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d68070b30 con 0x7f0d680706a0 2024-04-26T22:03:25.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d6f9e4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0d680af610 con 0x7f0d6806c9b0 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d6f9e4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0d680700b0 con 0x7f0d6815f2b0 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d6cf7f640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0d680706a0 0x7f0d6806c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:33240/0 (socket says 172.21.15.137:33240) 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d6cf7f640 1 -- 172.21.15.137:0/2774118647 learned_addr learned my addr 172.21.15.137:0/2774118647 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d6df81640 1 --2- 172.21.15.137:0/2774118647 >> v2:172.21.15.170:3300/0 conn(0x7f0d6806c9b0 0x7f0d680afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d6d780640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 0x7f0d6806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168008986 0 0) 0x7f0d68070b30 con 0x7f0d680706a0 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.364+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d54003520 con 0x7f0d680706a0 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2237014175 0 0) 0x7f0d54003520 con 0x7f0d680706a0 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 msgr2=0x7f0d6806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 0x7f0d6806fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 >> v2:172.21.15.170:3300/0 conn(0x7f0d6806c9b0 msgr2=0x7f0d680afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 --2- 172.21.15.137:0/2774118647 >> v2:172.21.15.170:3300/0 conn(0x7f0d6806c9b0 0x7f0d680afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d68070e10 con 0x7f0d680706a0 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6d780640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 0x7f0d6806fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f0d58001670 con 0x7f0d680706a0 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 >> v1:172.21.15.137:6789/0 conn(0x7f0d680706a0 legacy=0x7f0d6806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d540039b0 0x7f0d54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 0x7f0d54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d54004d40 0x7f0d540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d680700b0 con 0x7f0d54004d40 2024-04-26T22:03:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5400b9c0 con 0x7f0d540039b0 2024-04-26T22:03:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5400bb40 con 0x7f0d6815f2b0 2024-04-26T22:03:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6df81640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d54004d40 0x7f0d540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 0x7f0d54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6d780640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d540039b0 0x7f0d54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6df81640 1 -- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 msgr2=0x7f0d54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6df81640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 0x7f0d54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6df81640 1 -- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d540039b0 msgr2=0x7f0d54003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6df81640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d540039b0 0x7f0d54003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6df81640 1 -- 172.21.15.137:0/2774118647 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d54003520 con 0x7f0d54004d40 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6815f2b0 0x7f0d54004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.365+0000 7f0d6d780640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d540039b0 0x7f0d54003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.366+0000 7f0d6df81640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d54004d40 0x7f0d540051c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009a90 tx=0x7f0d54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5a7e9ac0f2ab03 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.366+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60036070 con 0x7f0d54004d40 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.366+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d60031400 con 0x7f0d54004d40 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.366+0000 7f0d5ffff640 1 -- 172.21.15.137:0/2774118647 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60009690 con 0x7f0d54004d40 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.366+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/2774118647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d54004d40 msgr2=0x7f0d540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.366+0000 7f0d6f9e4640 1 --2- 172.21.15.137:0/2774118647 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d54004d40 0x7f0d540051c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009a90 tx=0x7f0d54005830 comp rx=0 tx=0).stop 2024-04-26T22:03:25.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.366+0000 7f0d6df81640 1 -- 172.21.15.137:0/2774118647 reap_dead start 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.366+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/2774118647 shutdown_connections 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.366+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/2774118647 >> 172.21.15.137:0/2774118647 conn(0x7f0d6806f050 msgr2=0x7f0d6806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.367+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/2774118647 shutdown_connections 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.367+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/2774118647 wait complete. 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.368+0000 7f0d6f9e4640 1 Processor -- start 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.368+0000 7f0d6f9e4640 1 -- start start 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.368+0000 7f0d6f9e4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6814f3e0 0x7f0d68160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.368+0000 7f0d6f9e4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d6815f690 0x7f0d681621a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.368+0000 7f0d6f9e4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d680b6910 0x7f0d680b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.368+0000 7f0d6f9e4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d680b4f40 con 0x7f0d680b6910 2024-04-26T22:03:25.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.368+0000 7f0d6f9e4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0d680713d0 con 0x7f0d6815f690 2024-04-26T22:03:25.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.368+0000 7f0d6f9e4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0d680b1890 con 0x7f0d6814f3e0 2024-04-26T22:03:25.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6df81640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d680b6910 0x7f0d680b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6df81640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d680b6910 0x7f0d680b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45068/0 (socket says 172.21.15.137:45068) 2024-04-26T22:03:25.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6df81640 1 -- 172.21.15.137:0/3832071606 learned_addr learned my addr 172.21.15.137:0/3832071606 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6df81640 1 -- 172.21.15.137:0/3832071606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6814f3e0 msgr2=0x7f0d68160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6d780640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6814f3e0 0x7f0d68160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d6815f690 0x7f0d681621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6df81640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6814f3e0 0x7f0d68160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6df81640 1 -- 172.21.15.137:0/3832071606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d6815f690 msgr2=0x7f0d681621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6df81640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d6815f690 0x7f0d681621a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6df81640 1 -- 172.21.15.137:0/3832071606 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d68160ef0 con 0x7f0d680b6910 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6d780640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6814f3e0 0x7f0d68160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6df81640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d680b6910 0x7f0d680b6d90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009a90 tx=0x7f0d60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d5dffb640 1 -- 172.21.15.137:0/3832071606 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60036040 con 0x7f0d680b6910 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d5dffb640 1 -- 172.21.15.137:0/3832071606 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d60041070 con 0x7f0d680b6910 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d5dffb640 1 -- 172.21.15.137:0/3832071606 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60003a50 con 0x7f0d680b6910 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/3832071606 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d68161420 con 0x7f0d680b6910 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.369+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/3832071606 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d681616c0 con 0x7f0d680b6910 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.371+0000 7f0d5dffb640 1 -- 172.21.15.137:0/3832071606 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d60003bf0 con 0x7f0d680b6910 2024-04-26T22:03:25.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.371+0000 7f0d5dffb640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0d4c06c920 0x7f0d4c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.371+0000 7f0d5dffb640 1 -- 172.21.15.137:0/3832071606 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f0d600ab390 con 0x7f0d680b6910 2024-04-26T22:03:25.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.371+0000 7f0d6d780640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0d4c06c920 0x7f0d4c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.372+0000 7f0d6d780640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0d4c06c920 0x7f0d4c06ede0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0d64007380 tx=0x7f0d6400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.372+0000 7f0d727d3740 1 Processor -- start 2024-04-26T22:03:25.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.372+0000 7f0d727d3740 1 -- start start 2024-04-26T22:03:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 0x558a43f1c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f16e10 0x558a43f1ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f1b0c0 0x558a43f1b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d727d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a43e80d80 con 0x558a43f16e10 2024-04-26T22:03:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d727d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a43e3a8b0 con 0x558a43f1bf80 2024-04-26T22:03:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d727d3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a43e7cd40 con 0x558a43f1b0c0 2024-04-26T22:03:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6cf7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f16e10 0x558a43f1ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6cf7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f16e10 0x558a43f1ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45076/0 (socket says 172.21.15.137:45076) 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6cf7f640 1 -- 172.21.15.137:0/82042159 learned_addr learned my addr 172.21.15.137:0/82042159 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6df81640 1 --2- 172.21.15.137:0/82042159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f1b0c0 0x558a43f1b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6d780640 1 --2- 172.21.15.137:0/82042159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 0x558a43f1c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6cf7f640 1 -- 172.21.15.137:0/82042159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f1b0c0 msgr2=0x558a43f1b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/82042159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f1b0c0 0x558a43f1b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6cf7f640 1 -- 172.21.15.137:0/82042159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 msgr2=0x558a43f1c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/82042159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 0x558a43f1c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6cf7f640 1 -- 172.21.15.137:0/82042159 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a43e0ba40 con 0x558a43f16e10 2024-04-26T22:03:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.373+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/82042159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f16e10 0x558a43f1ab80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0d58001860 tx=0x7f0d58005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8979ada7810b417a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d4affd640 1 -- 172.21.15.137:0/82042159 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58019070 con 0x558a43f16e10 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d4affd640 1 -- 172.21.15.137:0/82042159 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5800fad0 con 0x558a43f16e10 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d4affd640 1 -- 172.21.15.137:0/82042159 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58010040 con 0x558a43f16e10 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d727d3740 1 -- 172.21.15.137:0/82042159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f16e10 msgr2=0x558a43f1ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d727d3740 1 --2- 172.21.15.137:0/82042159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f16e10 0x558a43f1ab80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0d58001860 tx=0x7f0d58005f00 comp rx=0 tx=0).stop 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d727d3740 1 -- 172.21.15.137:0/82042159 shutdown_connections 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d727d3740 1 --2- 172.21.15.137:0/82042159 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f16e10 0x558a43f1ab80 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d727d3740 1 --2- 172.21.15.137:0/82042159 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f1b0c0 0x558a43f1b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d727d3740 1 --2- 172.21.15.137:0/82042159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 0x558a43f1c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d727d3740 1 -- 172.21.15.137:0/82042159 >> 172.21.15.137:0/82042159 conn(0x558a43f19080 msgr2=0x558a43f61b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d727d3740 1 -- 172.21.15.137:0/82042159 shutdown_connections 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.374+0000 7f0d727d3740 1 -- 172.21.15.137:0/82042159 wait complete. 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.375+0000 7f0d727d3740 1 -- start start 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.375+0000 7f0d727d3740 1 Processor -- start 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1b0c0 0x558a43f686f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 0x558a43f63cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 0x558a43f64210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d727d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a43f47b10 con 0x558a43f1b0c0 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d727d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a43e07d10 con 0x558a43f1bf80 2024-04-26T22:03:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d727d3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a43f46f90 con 0x558a43f3fd70 2024-04-26T22:03:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d727d3740 10 client.0 _ll_register_callbacks cb 0x558a43e34210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6d780640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1b0c0 0x558a43f686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6d780640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1b0c0 0x558a43f686f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45082/0 (socket says 172.21.15.137:45082) 2024-04-26T22:03:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6d780640 1 -- 172.21.15.137:0/492129863 learned_addr learned my addr 172.21.15.137:0/492129863 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 0x558a43f63cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6df81640 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 0x558a43f64210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6d780640 1 -- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 msgr2=0x558a43f64210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6d780640 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 0x558a43f64210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6d780640 1 -- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 msgr2=0x558a43f63cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6d780640 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 0x558a43f63cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6d780640 1 -- 172.21.15.137:0/492129863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a43c5c7d0 con 0x558a43f1b0c0 2024-04-26T22:03:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6df81640 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 0x558a43f64210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 0x558a43f63cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d6d780640 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1b0c0 0x558a43f686f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0d64018f00 tx=0x7f0d64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b526f0b3ca70770a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d43fff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d43fff640 1 -- 172.21.15.137:0/492129863 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d640237f0 con 0x558a43f1b0c0 2024-04-26T22:03:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d43fff640 1 -- 172.21.15.137:0/492129863 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f0d64023990 con 0x558a43f1b0c0 2024-04-26T22:03:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.376+0000 7f0d727d3740 1 -- 172.21.15.137:0/492129863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d5800fad0 con 0x558a43f1b0c0 2024-04-26T22:03:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d43fff640 1 -- 172.21.15.137:0/492129863 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0d64031050 con 0x558a43f1b0c0 2024-04-26T22:03:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d727d3740 10 client.7047 fetch_fsmap learned FSMap version 40 2024-04-26T22:03:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d727d3740 1 -- 172.21.15.137:0/492129863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x558a43b923f0 con 0x558a43f1b0c0 2024-04-26T22:03:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d43fff640 1 -- 172.21.15.137:0/492129863 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d5800fad0 con 0x558a43f1b0c0 2024-04-26T22:03:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d43fff640 1 -- 172.21.15.137:0/492129863 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f0d64034020 con 0x558a43f1b0c0 2024-04-26T22:03:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d727d3740 10 client.7047 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T22:03:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d727d3740 10 client.7047 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:03:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d727d3740 20 client.7047 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d727d3740 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x558a43f67390 0x558a43f3c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d727d3740 4 client.7047 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d727d3740 1 -- 172.21.15.137:0/492129863 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a43e8e990 con 0x558a43f67390 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x558a43f67390 0x558a43f3c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d43fff640 10 client.7047 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.377+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x558a43f67390 0x558a43f3c680 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5f0a1c73a5ba894 server_cookie=850de6cf93233a81 in_seq=0 out_seq=0 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d43fff640 1 -- 172.21.15.137:0/492129863 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558a43e8e990 con 0x558a43f67390 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d43fff640 10 client.7047 handle_command_reply: tid=0 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 client.7047 shutdown 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 -- 172.21.15.137:0/492129863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1b0c0 msgr2=0x558a43f686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1b0c0 0x558a43f686f0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0d64018f00 tx=0x7f0d64004a40 comp rx=0 tx=0).stop 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 -- 172.21.15.137:0/492129863 shutdown_connections 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x558a43f67390 0x558a43f3c680 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 0x558a43f64210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d43fff640 0 client.7047 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1bf80 0x558a43f63cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 --2- 172.21.15.137:0/492129863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1b0c0 0x558a43f686f0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 -- 172.21.15.137:0/492129863 >> 172.21.15.137:0/492129863 conn(0x558a43f16e10 msgr2=0x558a43f1ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 -- 172.21.15.137:0/492129863 shutdown_connections 2024-04-26T22:03:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 1 -- 172.21.15.137:0/492129863 wait complete. 2024-04-26T22:03:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.378+0000 7f0d727d3740 20 client.7047 trim_cache size 0 max 16384 2024-04-26T22:03:25.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.395+0000 7f0d727d3740 1 Processor -- start 2024-04-26T22:03:25.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.395+0000 7f0d727d3740 1 -- start start 2024-04-26T22:03:25.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1b0c0 0x558a43f3e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f1bf80 0x558a43f17fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f3fd70 0x558a43f68500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d727d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0d682025f0 con 0x558a43f3fd70 2024-04-26T22:03:25.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d727d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0d68201630 con 0x558a43f1b0c0 2024-04-26T22:03:25.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d727d3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0d68200a90 con 0x558a43f1bf80 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d6df81640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f3fd70 0x558a43f68500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d6df81640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f3fd70 0x558a43f68500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45086/0 (socket says 172.21.15.137:45086) 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d6df81640 1 -- 172.21.15.137:0/2491683677 learned_addr learned my addr 172.21.15.137:0/2491683677 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d6df81640 1 -- 172.21.15.137:0/2491683677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f1bf80 msgr2=0x558a43f17fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d6df81640 1 --2- 172.21.15.137:0/2491683677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f1bf80 0x558a43f17fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d6df81640 1 -- 172.21.15.137:0/2491683677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1b0c0 msgr2=0x558a43f3e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.396+0000 7f0d6df81640 1 --2- 172.21.15.137:0/2491683677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1b0c0 0x558a43f3e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d6df81640 1 -- 172.21.15.137:0/2491683677 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a43b520f0 con 0x558a43f3fd70 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d6df81640 1 --2- 172.21.15.137:0/2491683677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f3fd70 0x558a43f68500 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f0d600a9810 tx=0x7f0d600798b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8013df533130157 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d4a7fc640 1 -- 172.21.15.137:0/2491683677 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d600773a0 con 0x558a43f3fd70 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d4a7fc640 1 -- 172.21.15.137:0/2491683677 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d60009690 con 0x558a43f3fd70 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d4a7fc640 1 -- 172.21.15.137:0/2491683677 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d600ab030 con 0x558a43f3fd70 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d727d3740 1 -- 172.21.15.137:0/2491683677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f3fd70 msgr2=0x558a43f68500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d727d3740 1 --2- 172.21.15.137:0/2491683677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f3fd70 0x558a43f68500 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f0d600a9810 tx=0x7f0d600798b0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d727d3740 1 -- 172.21.15.137:0/2491683677 shutdown_connections 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d727d3740 1 --2- 172.21.15.137:0/2491683677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f3fd70 0x558a43f68500 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d727d3740 1 --2- 172.21.15.137:0/2491683677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f1bf80 0x558a43f17fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d727d3740 1 --2- 172.21.15.137:0/2491683677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1b0c0 0x558a43f3e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d727d3740 1 -- 172.21.15.137:0/2491683677 >> 172.21.15.137:0/2491683677 conn(0x558a43f16e10 msgr2=0x558a43f65190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d727d3740 1 -- 172.21.15.137:0/2491683677 shutdown_connections 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.397+0000 7f0d727d3740 1 -- 172.21.15.137:0/2491683677 wait complete. 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.398+0000 7f0d727d3740 1 -- start start 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.398+0000 7f0d727d3740 1 Processor -- start 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1b0c0 0x558a43f68500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1bf80 0x558a43f68a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d727d3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 0x558a43f59080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d727d3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a43e3eff0 con 0x558a43f1bf80 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d727d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0d68200fe0 con 0x558a43f1b0c0 2024-04-26T22:03:25.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d727d3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a43e22440 con 0x558a43f3fd70 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d727d3740 10 client.0 _ll_register_callbacks cb 0x7f0d64009450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d6cf7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1bf80 0x558a43f68a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d6cf7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1bf80 0x558a43f68a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:45090/0 (socket says 172.21.15.137:45090) 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d6cf7f640 1 -- 172.21.15.137:0/121288722 learned_addr learned my addr 172.21.15.137:0/121288722 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d6cf7f640 1 -- 172.21.15.137:0/121288722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 msgr2=0x558a43f59080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 0x558a43f59080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d6cf7f640 1 -- 172.21.15.137:0/121288722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1b0c0 msgr2=0x558a43f68500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1b0c0 0x558a43f68500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d6cf7f640 1 -- 172.21.15.137:0/121288722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a43e414b0 con 0x558a43f1bf80 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d6cf7f640 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1bf80 0x558a43f68a40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0d58001970 tx=0x7f0d58001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941cb9a5834fbdcf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d43fff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:25.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d43fff640 1 -- 172.21.15.137:0/121288722 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d58024e60 con 0x558a43f1bf80 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d43fff640 1 -- 172.21.15.137:0/121288722 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f0d58024570 con 0x558a43f1bf80 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.399+0000 7f0d727d3740 1 -- 172.21.15.137:0/121288722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d60009690 con 0x558a43f1bf80 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d43fff640 1 -- 172.21.15.137:0/121288722 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f0d58034050 con 0x558a43f1bf80 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 10 client.7053 fetch_fsmap learned FSMap version 40 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 1 -- 172.21.15.137:0/121288722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x558a43f3cae0 con 0x558a43f1bf80 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d43fff640 1 -- 172.21.15.137:0/121288722 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d60009690 con 0x558a43f1bf80 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d43fff640 1 -- 172.21.15.137:0/121288722 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 40) ==== 3494+0+0 (secure 0 0 0) 0x7f0d58037020 con 0x558a43f1bf80 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 10 client.7053 fetch_fsmap finished waiting for FSMap version 40 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 10 client.7053 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 20 client.7053 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x558a43f5ae60 0x558a43f595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 4 client.7053 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 1 -- 172.21.15.137:0/121288722 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558a43e88800 con 0x558a43f5ae60 2024-04-26T22:03:25.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d6d780640 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x558a43f5ae60 0x558a43f595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d43fff640 10 client.7053 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d6d780640 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x558a43f5ae60 0x558a43f595c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d426d2c7b118afeb server_cookie=a53cc7815dab64f8 in_seq=0 out_seq=0 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d43fff640 1 -- 172.21.15.137:0/121288722 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+266 (crc 0 0 0) 0x558a43e88800 con 0x558a43f5ae60 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d43fff640 10 client.7053 handle_command_reply: tid=0 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 1 client.7053 shutdown 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 1 -- 172.21.15.137:0/121288722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1bf80 msgr2=0x558a43f68a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.400+0000 7f0d727d3740 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1bf80 0x558a43f68a40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f0d58001970 tx=0x7f0d58001a40 comp rx=0 tx=0).stop 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d727d3740 1 -- 172.21.15.137:0/121288722 shutdown_connections 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d727d3740 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x558a43f5ae60 0x558a43f595c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d727d3740 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a43f1bf80 0x558a43f68a40 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d727d3740 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a43f3fd70 0x558a43f59080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d43fff640 0 client.7053 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d727d3740 1 --2- 172.21.15.137:0/121288722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a43f1b0c0 0x558a43f68500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d727d3740 1 -- 172.21.15.137:0/121288722 >> 172.21.15.137:0/121288722 conn(0x558a43f16e10 msgr2=0x558a43f61650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d727d3740 1 -- 172.21.15.137:0/121288722 shutdown_connections 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d727d3740 1 -- 172.21.15.137:0/121288722 wait complete. 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d727d3740 20 client.7053 trim_cache size 0 max 16384 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stdout: "482c1fdf-2cb5-4c61-86c1-bb24495b55e2": { 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/subdir", 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "482c1fdf-2cb5-4c61-86c1-bb24495b55e2", 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,repair" 2024-04-26T22:03:25.410 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:03:25.411 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:03:25.411 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:03:25.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0d4c06c920 msgr2=0x7f0d4c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0d4c06c920 0x7f0d4c06ede0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0d64007380 tx=0x7f0d6400b040 comp rx=0 tx=0).stop 2024-04-26T22:03:25.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d680b6910 msgr2=0x7f0d680b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:25.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d680b6910 0x7f0d680b6d90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009a90 tx=0x7f0d60004730 comp rx=0 tx=0).stop 2024-04-26T22:03:25.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/3832071606 shutdown_connections 2024-04-26T22:03:25.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0d4c06c920 0x7f0d4c06ede0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0d680b6910 0x7f0d680b6d90 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d6815f690 0x7f0d681621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 --2- 172.21.15.137:0/3832071606 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0d6814f3e0 0x7f0d68160910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:25.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/3832071606 >> 172.21.15.137:0/3832071606 conn(0x7f0d6806f050 msgr2=0x7f0d680b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:25.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/3832071606 shutdown_connections 2024-04-26T22:03:25.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:25.401+0000 7f0d6f9e4640 1 -- 172.21.15.137:0/3832071606 wait complete. 2024-04-26T22:03:25.413 INFO:tasks.cephfs.filesystem:scrub status for tag:482c1fdf-2cb5-4c61-86c1-bb24495b55e2 - {'path': '/subdir', 'tag': '482c1fdf-2cb5-4c61-86c1-bb24495b55e2', 'options': 'recursive,repair'} 2024-04-26T22:03:43.631 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:03:43.635 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:03:55.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:55.414 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.527+0000 7f3321f78640 1 Processor -- start 2024-04-26T22:03:55.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.527+0000 7f3321f78640 1 -- start start 2024-04-26T22:03:55.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f3321f78640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f331c143840 0x7f331c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f3321f78640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f331c0b55c0 0x7f331c0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f3321f78640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c15dca0 con 0x7f331c0b4520 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f3321f78640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f331c143c20 con 0x7f331c143840 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f3321f78640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f331c15df80 con 0x7f331c0b55c0 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f331b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f331c143840 0x7f331c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f331b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f331c143840 0x7f331c0b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53596/0 (socket says 172.21.15.137:53596) 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f331b7fe640 1 -- 172.21.15.137:0/2356070840 learned_addr learned my addr 172.21.15.137:0/2356070840 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f331bfff640 1 --2- 172.21.15.137:0/2356070840 >> v2:172.21.15.170:3300/0 conn(0x7f331c0b55c0 0x7f331c0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f331b7fe640 1 -- 172.21.15.137:0/2356070840 >> v2:172.21.15.170:3300/0 conn(0x7f331c0b55c0 msgr2=0x7f331c0ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f331b7fe640 1 --2- 172.21.15.137:0/2356070840 >> v2:172.21.15.170:3300/0 conn(0x7f331c0b55c0 0x7f331c0ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f331b7fe640 1 -- 172.21.15.137:0/2356070840 >> v1:172.21.15.170:6789/0 conn(0x7f331c0b4520 legacy=0x7f331c0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.528+0000 7f331b7fe640 1 -- 172.21.15.137:0/2356070840 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c15e260 con 0x7f331c143840 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.529+0000 7f331b7fe640 1 --2- 172.21.15.137:0/2356070840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c143840 0x7f331c0b3fe0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f330c009870 tx=0x7f330c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545df577f7c6b9d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.529+0000 7f331a7fc640 1 -- 172.21.15.137:0/2356070840 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c037070 con 0x7f331c143840 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.529+0000 7f331a7fc640 1 -- 172.21.15.137:0/2356070840 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c032440 con 0x7f331c143840 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.529+0000 7f331a7fc640 1 -- 172.21.15.137:0/2356070840 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c032810 con 0x7f331c143840 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.530+0000 7f3321f78640 1 -- 172.21.15.137:0/2356070840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c143840 msgr2=0x7f331c0b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.530+0000 7f3321f78640 1 --2- 172.21.15.137:0/2356070840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c143840 0x7f331c0b3fe0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f330c009870 tx=0x7f330c02a2a0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.530+0000 7f3321f78640 1 -- 172.21.15.137:0/2356070840 shutdown_connections 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.530+0000 7f3321f78640 1 --2- 172.21.15.137:0/2356070840 >> v2:172.21.15.170:3300/0 conn(0x7f331c0b55c0 0x7f331c0ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.530+0000 7f3321f78640 1 --2- 172.21.15.137:0/2356070840 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c143840 0x7f331c0b3fe0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.530+0000 7f3321f78640 1 -- 172.21.15.137:0/2356070840 >> 172.21.15.137:0/2356070840 conn(0x7f331c0cd8a0 msgr2=0x7f331c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.530+0000 7f3321f78640 1 -- 172.21.15.137:0/2356070840 shutdown_connections 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.530+0000 7f3321f78640 1 -- 172.21.15.137:0/2356070840 wait complete. 2024-04-26T22:03:55.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.531+0000 7f3321f78640 1 Processor -- start 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.531+0000 7f3321f78640 1 -- start start 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f3321f78640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c0b4520 0x7f331c1f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f3321f78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f331c0b55c0 0x7f331c0aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f3321f78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f331c143840 0x7f331c0af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f3321f78640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f331c15da40 con 0x7f331c0b4520 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f3321f78640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f331c15d8c0 con 0x7f331c143840 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f3321f78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f331c0cf530 con 0x7f331c0b55c0 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c0b4520 0x7f331c1f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c0b4520 0x7f331c1f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53602/0 (socket says 172.21.15.137:53602) 2024-04-26T22:03:55.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331b7fe640 1 -- 172.21.15.137:0/3948025745 learned_addr learned my addr 172.21.15.137:0/3948025745 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331bfff640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f331c143840 0x7f331c0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331affd640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f331c0b55c0 0x7f331c0aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331b7fe640 1 -- 172.21.15.137:0/3948025745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f331c0b55c0 msgr2=0x7f331c0aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331b7fe640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f331c0b55c0 0x7f331c0aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331b7fe640 1 -- 172.21.15.137:0/3948025745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f331c143840 msgr2=0x7f331c0af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331b7fe640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f331c143840 0x7f331c0af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331b7fe640 1 -- 172.21.15.137:0/3948025745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c137700 con 0x7f331c0b4520 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.532+0000 7f331bfff640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f331c143840 0x7f331c0af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.533+0000 7f331b7fe640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c0b4520 0x7f331c1f2540 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f330c000c00 tx=0x7f330c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.533+0000 7f3303fff640 1 -- 172.21.15.137:0/3948025745 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c037040 con 0x7f331c0b4520 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.533+0000 7f3303fff640 1 -- 172.21.15.137:0/3948025745 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f330c042070 con 0x7f331c0b4520 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.533+0000 7f3321f78640 1 -- 172.21.15.137:0/3948025745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f331c0b04a0 con 0x7f331c0b4520 2024-04-26T22:03:55.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.533+0000 7f3303fff640 1 -- 172.21.15.137:0/3948025745 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c030880 con 0x7f331c0b4520 2024-04-26T22:03:55.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.533+0000 7f3321f78640 1 -- 172.21.15.137:0/3948025745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331c145200 con 0x7f331c0b4520 2024-04-26T22:03:55.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.535+0000 7f3303fff640 1 -- 172.21.15.137:0/3948025745 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f330c030a20 con 0x7f331c0b4520 2024-04-26T22:03:55.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.535+0000 7f3303fff640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f330806c8f0 0x7f330806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.535+0000 7f3303fff640 1 -- 172.21.15.137:0/3948025745 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f330c0ac450 con 0x7f331c0b4520 2024-04-26T22:03:55.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.535+0000 7f331affd640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f330806c8f0 0x7f330806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.536+0000 7f331affd640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f330806c8f0 0x7f330806edb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f331c15d870 tx=0x7f3310009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.536+0000 7f3324d6b740 1 Processor -- start 2024-04-26T22:03:55.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.536+0000 7f3324d6b740 1 -- start start 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f0798d30 0x5560f0799110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 0x5560f0768e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0769350 0x5560f076c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f3324d6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5560f06d2d80 con 0x5560f0769350 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f3324d6b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5560f068c8b0 con 0x5560f0798d30 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f3324d6b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5560f06ced40 con 0x5560f07b46f0 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0769350 0x5560f076c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0769350 0x5560f076c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53604/0 (socket says 172.21.15.137:53604) 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331bfff640 1 -- 172.21.15.137:0/1686275030 learned_addr learned my addr 172.21.15.137:0/1686275030 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331b7fe640 1 --2- 172.21.15.137:0/1686275030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f0798d30 0x5560f0799110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331affd640 1 --2- 172.21.15.137:0/1686275030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 0x5560f0768e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331bfff640 1 -- 172.21.15.137:0/1686275030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 msgr2=0x5560f0768e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331bfff640 1 --2- 172.21.15.137:0/1686275030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 0x5560f0768e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331bfff640 1 -- 172.21.15.137:0/1686275030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f0798d30 msgr2=0x5560f0799110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331bfff640 1 --2- 172.21.15.137:0/1686275030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f0798d30 0x5560f0799110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.537+0000 7f331bfff640 1 -- 172.21.15.137:0/1686275030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f065da40 con 0x5560f0769350 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.538+0000 7f331bfff640 1 --2- 172.21.15.137:0/1686275030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0769350 0x5560f076c850 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3314007650 tx=0x7f3314009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71782a874acd47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.538+0000 7f33017fa640 1 -- 172.21.15.137:0/1686275030 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331401a020 con 0x5560f0769350 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.538+0000 7f33017fa640 1 -- 172.21.15.137:0/1686275030 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3314016680 con 0x5560f0769350 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.538+0000 7f33017fa640 1 -- 172.21.15.137:0/1686275030 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3314016a50 con 0x5560f0769350 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.538+0000 7f3324d6b740 1 -- 172.21.15.137:0/1686275030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0769350 msgr2=0x5560f076c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.538+0000 7f3324d6b740 1 --2- 172.21.15.137:0/1686275030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0769350 0x5560f076c850 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3314007650 tx=0x7f3314009750 comp rx=0 tx=0).stop 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.539+0000 7f3324d6b740 1 -- 172.21.15.137:0/1686275030 shutdown_connections 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.539+0000 7f3324d6b740 1 --2- 172.21.15.137:0/1686275030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0769350 0x5560f076c850 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.539+0000 7f3324d6b740 1 --2- 172.21.15.137:0/1686275030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 0x5560f0768e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.539+0000 7f3324d6b740 1 --2- 172.21.15.137:0/1686275030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f0798d30 0x5560f0799110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.539+0000 7f3324d6b740 1 -- 172.21.15.137:0/1686275030 >> 172.21.15.137:0/1686275030 conn(0x5560f076b080 msgr2=0x5560f07b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.539+0000 7f3324d6b740 1 -- 172.21.15.137:0/1686275030 shutdown_connections 2024-04-26T22:03:55.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.539+0000 7f3324d6b740 1 -- 172.21.15.137:0/1686275030 wait complete. 2024-04-26T22:03:55.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.539+0000 7f3324d6b740 1 -- start start 2024-04-26T22:03:55.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.539+0000 7f3324d6b740 1 Processor -- start 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 0x5560f079b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b46f0 0x5560f07b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 0x5560f078c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f3324d6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5560f076e840 con 0x5560f07b46f0 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f3324d6b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5560f0659d10 con 0x5560f07b0cc0 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f3324d6b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5560f076eae0 con 0x5560f0798d30 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f3324d6b740 10 client.0 _ll_register_callbacks cb 0x5560f0686210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b46f0 0x5560f07b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b46f0 0x5560f07b0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53620/0 (socket says 172.21.15.137:53620) 2024-04-26T22:03:55.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331affd640 1 -- 172.21.15.137:0/837052975 learned_addr learned my addr 172.21.15.137:0/837052975 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331bfff640 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 0x5560f078c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331b7fe640 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 0x5560f079b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331affd640 1 -- 172.21.15.137:0/837052975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 msgr2=0x5560f079b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331affd640 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 0x5560f079b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331affd640 1 -- 172.21.15.137:0/837052975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 msgr2=0x5560f078c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331affd640 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 0x5560f078c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.540+0000 7f331affd640 1 -- 172.21.15.137:0/837052975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f04ae7d0 con 0x5560f07b46f0 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f331affd640 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b46f0 0x5560f07b0780 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3310000f60 tx=0x7f3310001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1262b13cd139c725 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f32fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f32fa7fc640 1 -- 172.21.15.137:0/837052975 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310027060 con 0x5560f07b46f0 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f32fa7fc640 1 -- 172.21.15.137:0/837052975 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f3310010040 con 0x5560f07b46f0 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f3324d6b740 1 -- 172.21.15.137:0/837052975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3314016680 con 0x5560f07b46f0 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f32fa7fc640 1 -- 172.21.15.137:0/837052975 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3310003d00 con 0x5560f07b46f0 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f3324d6b740 10 client.7065 fetch_fsmap learned FSMap version 41 2024-04-26T22:03:55.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f3324d6b740 1 -- 172.21.15.137:0/837052975 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x5560f03e43f0 con 0x5560f07b46f0 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f32fa7fc640 1 -- 172.21.15.137:0/837052975 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3314016680 con 0x5560f07b46f0 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f32fa7fc640 1 -- 172.21.15.137:0/837052975 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 41) ==== 3494+0+0 (secure 0 0 0) 0x7f3310013420 con 0x5560f07b46f0 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f3324d6b740 10 client.7065 fetch_fsmap finished waiting for FSMap version 41 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f3324d6b740 10 client.7065 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f3324d6b740 20 client.7065 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f3324d6b740 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5560f078caa0 0x5560f078ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f3324d6b740 4 client.7065 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f3324d6b740 1 -- 172.21.15.137:0/837052975 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560f06e0990 con 0x5560f078caa0 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.541+0000 7f331b7fe640 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5560f078caa0 0x5560f078ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f32fa7fc640 10 client.7065 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f331b7fe640 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5560f078caa0 0x5560f078ea00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=432ebc3c55d668da server_cookie=23802d67da49be21 in_seq=0 out_seq=0 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f32fa7fc640 1 -- 172.21.15.137:0/837052975 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5560f06e0990 con 0x5560f078caa0 2024-04-26T22:03:55.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f32fa7fc640 10 client.7065 handle_command_reply: tid=0 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 client.7065 shutdown 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 -- 172.21.15.137:0/837052975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b46f0 msgr2=0x5560f07b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b46f0 0x5560f07b0780 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3310000f60 tx=0x7f3310001120 comp rx=0 tx=0).stop 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 -- 172.21.15.137:0/837052975 shutdown_connections 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5560f078caa0 0x5560f078ea00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b46f0 0x5560f07b0780 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 0x5560f078c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f32fa7fc640 0 client.7065 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 --2- 172.21.15.137:0/837052975 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 0x5560f079b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 -- 172.21.15.137:0/837052975 >> 172.21.15.137:0/837052975 conn(0x5560f0769350 msgr2=0x5560f07b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 -- 172.21.15.137:0/837052975 shutdown_connections 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.542+0000 7f3324d6b740 1 -- 172.21.15.137:0/837052975 wait complete. 2024-04-26T22:03:55.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.543+0000 7f3324d6b740 20 client.7065 trim_cache size 0 max 16384 2024-04-26T22:03:55.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.560+0000 7f3324d6b740 1 Processor -- start 2024-04-26T22:03:55.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.560+0000 7f3324d6b740 1 -- start start 2024-04-26T22:03:55.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 0x5560f07db100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b0cc0 0x5560f07ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b46f0 0x5560f07add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f3324d6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f331c1fd670 con 0x5560f07b0cc0 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f3324d6b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f331c1fc690 con 0x5560f07b46f0 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f3324d6b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f331c146760 con 0x5560f0798d30 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b0cc0 0x5560f07ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b0cc0 0x5560f07ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53624/0 (socket says 172.21.15.137:53624) 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331affd640 1 -- 172.21.15.137:0/720597085 learned_addr learned my addr 172.21.15.137:0/720597085 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331bfff640 1 --2- 172.21.15.137:0/720597085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b46f0 0x5560f07add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331b7fe640 1 --2- 172.21.15.137:0/720597085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 0x5560f07db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331affd640 1 -- 172.21.15.137:0/720597085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 msgr2=0x5560f07db100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331affd640 1 --2- 172.21.15.137:0/720597085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 0x5560f07db100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331affd640 1 -- 172.21.15.137:0/720597085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b46f0 msgr2=0x5560f07add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331affd640 1 --2- 172.21.15.137:0/720597085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b46f0 0x5560f07add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331affd640 1 -- 172.21.15.137:0/720597085 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f03a40f0 con 0x5560f07b0cc0 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f331affd640 1 --2- 172.21.15.137:0/720597085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b0cc0 0x5560f07ad7c0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3310001eb0 tx=0x7f331001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8069d81d4b83b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f3300ff9640 1 -- 172.21.15.137:0/720597085 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310005390 con 0x5560f07b0cc0 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f3300ff9640 1 -- 172.21.15.137:0/720597085 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33100139c0 con 0x5560f07b0cc0 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.561+0000 7f3300ff9640 1 -- 172.21.15.137:0/720597085 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310013b70 con 0x5560f07b0cc0 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.562+0000 7f3324d6b740 1 -- 172.21.15.137:0/720597085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b0cc0 msgr2=0x5560f07ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.562+0000 7f3324d6b740 1 --2- 172.21.15.137:0/720597085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b0cc0 0x5560f07ad7c0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3310001eb0 tx=0x7f331001a000 comp rx=0 tx=0).stop 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.562+0000 7f3324d6b740 1 -- 172.21.15.137:0/720597085 shutdown_connections 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.562+0000 7f3324d6b740 1 --2- 172.21.15.137:0/720597085 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f07b0cc0 0x5560f07ad7c0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.562+0000 7f3324d6b740 1 --2- 172.21.15.137:0/720597085 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b46f0 0x5560f07add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.562+0000 7f3324d6b740 1 --2- 172.21.15.137:0/720597085 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f0798d30 0x5560f07db100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.562+0000 7f3324d6b740 1 -- 172.21.15.137:0/720597085 >> 172.21.15.137:0/720597085 conn(0x5560f0769350 msgr2=0x5560f07b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.562+0000 7f3324d6b740 1 -- 172.21.15.137:0/720597085 shutdown_connections 2024-04-26T22:03:55.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.562+0000 7f3324d6b740 1 -- 172.21.15.137:0/720597085 wait complete. 2024-04-26T22:03:55.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f3324d6b740 1 -- start start 2024-04-26T22:03:55.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f3324d6b740 1 Processor -- start 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0798d30 0x5560f0831330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 0x5560f0764520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f3324d6b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 0x5560f07b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f3324d6b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f331c074090 con 0x5560f0798d30 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f3324d6b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5560f078d040 con 0x5560f07b0cc0 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f3324d6b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5560f07b3f80 con 0x5560f07b46f0 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f3324d6b740 10 client.0 _ll_register_callbacks cb 0x7f3310001d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f331b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0798d30 0x5560f0831330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f331b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0798d30 0x5560f0831330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53640/0 (socket says 172.21.15.137:53640) 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.563+0000 7f331b7fe640 1 -- 172.21.15.137:0/2159836482 learned_addr learned my addr 172.21.15.137:0/2159836482 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:55.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f331affd640 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 0x5560f0764520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f331bfff640 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 0x5560f07b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f331b7fe640 1 -- 172.21.15.137:0/2159836482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 msgr2=0x5560f07b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f331b7fe640 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 0x5560f07b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f331b7fe640 1 -- 172.21.15.137:0/2159836482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 msgr2=0x5560f0764520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f331b7fe640 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 0x5560f0764520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f331b7fe640 1 -- 172.21.15.137:0/2159836482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f06934b0 con 0x5560f0798d30 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f331b7fe640 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0798d30 0x5560f0831330 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f330c07a0f0 tx=0x7f330c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f9ae9c5c89ed61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f32fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f32fa7fc640 1 -- 172.21.15.137:0/2159836482 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c07e510 con 0x5560f0798d30 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f32fa7fc640 1 -- 172.21.15.137:0/2159836482 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f330c030d10 con 0x5560f0798d30 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f3324d6b740 1 -- 172.21.15.137:0/2159836482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33100139c0 con 0x5560f0798d30 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f32fa7fc640 1 -- 172.21.15.137:0/2159836482 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f330c099050 con 0x5560f0798d30 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f3324d6b740 10 client.7071 fetch_fsmap learned FSMap version 41 2024-04-26T22:03:55.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f3324d6b740 1 -- 172.21.15.137:0/2159836482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x5560f07b3cc0 con 0x5560f0798d30 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f32fa7fc640 1 -- 172.21.15.137:0/2159836482 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33100139c0 con 0x5560f0798d30 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f32fa7fc640 1 -- 172.21.15.137:0/2159836482 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 41) ==== 3494+0+0 (secure 0 0 0) 0x7f330c03a070 con 0x5560f0798d30 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f3324d6b740 10 client.7071 fetch_fsmap finished waiting for FSMap version 41 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f3324d6b740 10 client.7071 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f3324d6b740 20 client.7071 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f3324d6b740 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5560f078b610 0x5560f07b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f3324d6b740 4 client.7071 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.564+0000 7f3324d6b740 1 -- 172.21.15.137:0/2159836482 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5560f06da800 con 0x5560f078b610 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f331affd640 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5560f078b610 0x5560f07b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f32fa7fc640 10 client.7071 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f331affd640 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5560f078b610 0x5560f07b36c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=babc73ec69ce130 server_cookie=ed7724a01c323bf7 in_seq=0 out_seq=0 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f32fa7fc640 1 -- 172.21.15.137:0/2159836482 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5560f06da800 con 0x5560f078b610 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f32fa7fc640 10 client.7071 handle_command_reply: tid=0 2024-04-26T22:03:55.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 client.7071 shutdown 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 -- 172.21.15.137:0/2159836482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0798d30 msgr2=0x5560f0831330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0798d30 0x5560f0831330 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f330c07a0f0 tx=0x7f330c009040 comp rx=0 tx=0).stop 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 -- 172.21.15.137:0/2159836482 shutdown_connections 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x5560f078b610 0x5560f07b36c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5560f07b46f0 0x5560f07b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560f07b0cc0 0x5560f0764520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 --2- 172.21.15.137:0/2159836482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5560f0798d30 0x5560f0831330 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f32fa7fc640 0 client.7071 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 -- 172.21.15.137:0/2159836482 >> 172.21.15.137:0/2159836482 conn(0x5560f0769350 msgr2=0x5560f07b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 -- 172.21.15.137:0/2159836482 shutdown_connections 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 1 -- 172.21.15.137:0/2159836482 wait complete. 2024-04-26T22:03:55.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.565+0000 7f3324d6b740 20 client.7071 trim_cache size 0 max 16384 2024-04-26T22:03:55.573 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:03:55.573 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:03:55.573 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:03:55.573 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 -- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f330806c8f0 msgr2=0x7f330806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f330806c8f0 0x7f330806edb0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f331c15d870 tx=0x7f3310009040 comp rx=0 tx=0).stop 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 -- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c0b4520 msgr2=0x7f331c1f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c0b4520 0x7f331c1f2540 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f330c000c00 tx=0x7f330c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 -- 172.21.15.137:0/3948025745 shutdown_connections 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f330806c8f0 0x7f330806edb0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f331c143840 0x7f331c0af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f331c0b55c0 0x7f331c0aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 --2- 172.21.15.137:0/3948025745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f331c0b4520 0x7f331c1f2540 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 -- 172.21.15.137:0/3948025745 >> 172.21.15.137:0/3948025745 conn(0x7f331c0cd8a0 msgr2=0x7f331c06f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 -- 172.21.15.137:0/3948025745 shutdown_connections 2024-04-26T22:03:55.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.566+0000 7f3321f78640 1 -- 172.21.15.137:0/3948025745 wait complete. 2024-04-26T22:03:55.577 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:03:55.577 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:03:55.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.673+0000 7f013399e640 1 Processor -- start 2024-04-26T22:03:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.674+0000 7f013399e640 1 -- start start 2024-04-26T22:03:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.674+0000 7f013399e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f012c15fa60 0x7f012c0d5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.674+0000 7f013399e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 0x7f012c0d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.674+0000 7f013399e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f012c0d3b80 con 0x7f012c15f680 2024-04-26T22:03:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.674+0000 7f013399e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f012c0d3e60 con 0x7f012c15fa60 2024-04-26T22:03:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.674+0000 7f013399e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f012c0d4140 con 0x7f012c0b4290 2024-04-26T22:03:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f0130f39640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f012c15fa60 0x7f012c0d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f013173a640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f012c15f680 0x7f012c0b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55912/0 (socket says 172.21.15.137:55912) 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f013173a640 1 -- 172.21.15.137:0/3769620144 learned_addr learned my addr 172.21.15.137:0/3769620144 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f0131f3b640 1 --2- 172.21.15.137:0/3769620144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 0x7f012c0d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f0130f39640 1 -- 172.21.15.137:0/3769620144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 msgr2=0x7f012c0d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f0130f39640 1 --2- 172.21.15.137:0/3769620144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 0x7f012c0d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f0130f39640 1 -- 172.21.15.137:0/3769620144 >> v1:172.21.15.137:6789/0 conn(0x7f012c15f680 legacy=0x7f012c0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f012bfff640 1 -- 172.21.15.137:0/3769620144 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202582256 0 0) 0x7f012c0d3b80 con 0x7f012c15f680 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f0130f39640 1 -- 172.21.15.137:0/3769620144 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c0d0270 con 0x7f012c15fa60 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.675+0000 7f0131f3b640 1 --2- 172.21.15.137:0/3769620144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 0x7f012c0d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f0130f39640 1 --2- 172.21.15.137:0/3769620144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 0x7f012c0d5e50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f01200097d0 tx=0x7f012002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c623ce1318d0a639 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f012bfff640 1 -- 172.21.15.137:0/3769620144 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120037070 con 0x7f012c15fa60 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f012bfff640 1 -- 172.21.15.137:0/3769620144 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0120032440 con 0x7f012c15fa60 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f012bfff640 1 -- 172.21.15.137:0/3769620144 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120032810 con 0x7f012c15fa60 2024-04-26T22:03:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f013399e640 1 -- 172.21.15.137:0/3769620144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 msgr2=0x7f012c0d5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f013399e640 1 --2- 172.21.15.137:0/3769620144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 0x7f012c0d5e50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f01200097d0 tx=0x7f012002a1c0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f013399e640 1 -- 172.21.15.137:0/3769620144 shutdown_connections 2024-04-26T22:03:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f013399e640 1 --2- 172.21.15.137:0/3769620144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 0x7f012c0d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f013399e640 1 --2- 172.21.15.137:0/3769620144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 0x7f012c0d5e50 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f013399e640 1 -- 172.21.15.137:0/3769620144 >> 172.21.15.137:0/3769620144 conn(0x7f012c09e5a0 msgr2=0x7f012c0d5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f013399e640 1 -- 172.21.15.137:0/3769620144 shutdown_connections 2024-04-26T22:03:55.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.676+0000 7f013399e640 1 -- 172.21.15.137:0/3769620144 wait complete. 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.677+0000 7f013399e640 1 Processor -- start 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.677+0000 7f013399e640 1 -- start start 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f013399e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 0x7f012c161a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f013399e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f012c15f680 0x7f012c1620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f013399e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 0x7f012c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f013399e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f012c0d4420 con 0x7f012c15fa60 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f013399e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f012c0b2610 con 0x7f012c15f680 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f013399e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f012c0d2130 con 0x7f012c0b4290 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0131f3b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 0x7f012c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0131f3b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 0x7f012c06d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53670/0 (socket says 172.21.15.137:53670) 2024-04-26T22:03:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0131f3b640 1 -- 172.21.15.137:0/4040561445 learned_addr learned my addr 172.21.15.137:0/4040561445 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f013173a640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 0x7f012c161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0130f39640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f012c15f680 0x7f012c1620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0131f3b640 1 -- 172.21.15.137:0/4040561445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 msgr2=0x7f012c161a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0131f3b640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 0x7f012c161a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0131f3b640 1 -- 172.21.15.137:0/4040561445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f012c15f680 msgr2=0x7f012c1620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0131f3b640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f012c15f680 0x7f012c1620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0131f3b640 1 -- 172.21.15.137:0/4040561445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c162b00 con 0x7f012c15fa60 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.678+0000 7f0130f39640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f012c15f680 0x7f012c1620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.679+0000 7f0131f3b640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 0x7f012c06d380 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f011c00cf20 tx=0x7f011c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.679+0000 7f0129ffb640 1 -- 172.21.15.137:0/4040561445 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c01a070 con 0x7f012c15fa60 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.679+0000 7f0129ffb640 1 -- 172.21.15.137:0/4040561445 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011c00d840 con 0x7f012c15fa60 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.679+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012c0cc470 con 0x7f012c15fa60 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.679+0000 7f0129ffb640 1 -- 172.21.15.137:0/4040561445 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c00dc30 con 0x7f012c15fa60 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.679+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012c0cc710 con 0x7f012c15fa60 2024-04-26T22:03:55.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.680+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f012c06a290 con 0x7f012c15fa60 2024-04-26T22:03:55.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.680+0000 7f0129ffb640 1 -- 172.21.15.137:0/4040561445 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f011c01d070 con 0x7f012c15fa60 2024-04-26T22:03:55.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.681+0000 7f0129ffb640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f011806c8f0 0x7f011806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:55.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.681+0000 7f0129ffb640 1 -- 172.21.15.137:0/4040561445 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f011c08c430 con 0x7f012c15fa60 2024-04-26T22:03:55.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.681+0000 7f013173a640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f011806c8f0 0x7f011806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:55.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.681+0000 7f013173a640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f011806c8f0 0x7f011806edb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0124000f60 tx=0x7f0124007b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:55.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.685+0000 7f0129ffb640 1 -- 172.21.15.137:0/4040561445 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f011c05a840 con 0x7f012c15fa60 2024-04-26T22:03:55.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.895+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f012c08f350 con 0x7f012c15fa60 2024-04-26T22:03:55.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.896+0000 7f0129ffb640 1 -- 172.21.15.137:0/4040561445 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5197 (secure 0 0 0) 0x7f011c05a140 con 0x7f012c15fa60 2024-04-26T22:03:55.896 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:03:55.896 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:03:28.395142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/2422385986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2422385986},{"type":"v1","addr":"172.21.15.137:6837","nonce":2422385986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6843,"qdb_cluster":[6843]},"id":5}]} 2024-04-26T22:03:55.896 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 41 2024-04-26T22:03:55.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f011806c8f0 msgr2=0x7f011806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f011806c8f0 0x7f011806edb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0124000f60 tx=0x7f0124007b50 comp rx=0 tx=0).stop 2024-04-26T22:03:55.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 msgr2=0x7f012c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:55.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 0x7f012c06d380 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f011c00cf20 tx=0x7f011c00a7d0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 shutdown_connections 2024-04-26T22:03:55.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f011806c8f0 0x7f011806edb0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f012c15fa60 0x7f012c06d380 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f012c15f680 0x7f012c1620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 --2- 172.21.15.137:0/4040561445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f012c0b4290 0x7f012c161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:55.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 >> 172.21.15.137:0/4040561445 conn(0x7f012c09e5a0 msgr2=0x7f012c0b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:55.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 shutdown_connections 2024-04-26T22:03:55.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:55.898+0000 7f013399e640 1 -- 172.21.15.137:0/4040561445 wait complete. 2024-04-26T22:03:55.909 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-26T22:03:56.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.006+0000 7f9414452640 1 Processor -- start 2024-04-26T22:03:56.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.006+0000 7f9414452640 1 -- start start 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.007+0000 7f9414452640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f940c0cd940 0x7f940c070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.007+0000 7f9414452640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f940c0d14d0 0x7f940c073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.007+0000 7f9414452640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f940c0cfec0 con 0x7f940c0d0c80 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.007+0000 7f9414452640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f940c0d07f0 con 0x7f940c0d14d0 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.007+0000 7f9414452640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f940c0d01a0 con 0x7f940c0cd940 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.008+0000 7f94119ed640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f940c0d14d0 0x7f940c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.008+0000 7f94119ed640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f940c0d14d0 0x7f940c073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53678/0 (socket says 172.21.15.137:53678) 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.008+0000 7f94119ed640 1 -- 172.21.15.137:0/3636653503 learned_addr learned my addr 172.21.15.137:0/3636653503 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.008+0000 7f94121ee640 1 --2- 172.21.15.137:0/3636653503 >> v2:172.21.15.170:3300/0 conn(0x7f940c0cd940 0x7f940c070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.008+0000 7f94119ed640 1 -- 172.21.15.137:0/3636653503 >> v2:172.21.15.170:3300/0 conn(0x7f940c0cd940 msgr2=0x7f940c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.008+0000 7f94119ed640 1 --2- 172.21.15.137:0/3636653503 >> v2:172.21.15.170:3300/0 conn(0x7f940c0cd940 0x7f940c070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.008+0000 7f94119ed640 1 -- 172.21.15.137:0/3636653503 >> v1:172.21.15.170:6789/0 conn(0x7f940c0d0c80 legacy=0x7f940c06f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.008+0000 7f94119ed640 1 -- 172.21.15.137:0/3636653503 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c0d0480 con 0x7f940c0d14d0 2024-04-26T22:03:56.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.008+0000 7f94121ee640 1 --2- 172.21.15.137:0/3636653503 >> v2:172.21.15.170:3300/0 conn(0x7f940c0cd940 0x7f940c070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:56.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f94119ed640 1 --2- 172.21.15.137:0/3636653503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d14d0 0x7f940c073090 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f940c0d2ed0 tx=0x7f940002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1cb7c9965970260 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f94111ec640 1 -- 172.21.15.137:0/3636653503 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400037070 con 0x7f940c0d14d0 2024-04-26T22:03:56.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f94111ec640 1 -- 172.21.15.137:0/3636653503 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9400032440 con 0x7f940c0d14d0 2024-04-26T22:03:56.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f94111ec640 1 -- 172.21.15.137:0/3636653503 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400032810 con 0x7f940c0d14d0 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f9414452640 1 -- 172.21.15.137:0/3636653503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d14d0 msgr2=0x7f940c073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f9414452640 1 --2- 172.21.15.137:0/3636653503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d14d0 0x7f940c073090 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f940c0d2ed0 tx=0x7f940002a230 comp rx=0 tx=0).stop 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f9414452640 1 -- 172.21.15.137:0/3636653503 shutdown_connections 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f9414452640 1 --2- 172.21.15.137:0/3636653503 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d14d0 0x7f940c073090 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f9414452640 1 --2- 172.21.15.137:0/3636653503 >> v2:172.21.15.170:3300/0 conn(0x7f940c0cd940 0x7f940c070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f9414452640 1 -- 172.21.15.137:0/3636653503 >> 172.21.15.137:0/3636653503 conn(0x7f940c0d1e40 msgr2=0x7f940c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f9414452640 1 -- 172.21.15.137:0/3636653503 shutdown_connections 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.009+0000 7f9414452640 1 -- 172.21.15.137:0/3636653503 wait complete. 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f9414452640 1 Processor -- start 2024-04-26T22:03:56.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f9414452640 1 -- start start 2024-04-26T22:03:56.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f9414452640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f940c0cd940 0x7f940c0c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f9414452640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d0c80 0x7f940c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f9414452640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f940c0d14d0 0x7f940c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f9414452640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0cdea0 con 0x7f940c0d0c80 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f9414452640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0cdd20 con 0x7f940c0cd940 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f9414452640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f940c0735d0 con 0x7f940c0d14d0 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f94119ed640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d0c80 0x7f940c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f94119ed640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d0c80 0x7f940c0c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53682/0 (socket says 172.21.15.137:53682) 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.011+0000 7f94119ed640 1 -- 172.21.15.137:0/2982349811 learned_addr learned my addr 172.21.15.137:0/2982349811 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f94121ee640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f940c0cd940 0x7f940c0c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f94129ef640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f940c0d14d0 0x7f940c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f94119ed640 1 -- 172.21.15.137:0/2982349811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f940c0d14d0 msgr2=0x7f940c15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f94119ed640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f940c0d14d0 0x7f940c15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f94119ed640 1 -- 172.21.15.137:0/2982349811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f940c0cd940 msgr2=0x7f940c0c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f94119ed640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f940c0cd940 0x7f940c0c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f94119ed640 1 -- 172.21.15.137:0/2982349811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940c0c5fe0 con 0x7f940c0d0c80 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f94121ee640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f940c0cd940 0x7f940c0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f94119ed640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d0c80 0x7f940c0c9920 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9400000c00 tx=0x7f94000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f940affd640 1 -- 172.21.15.137:0/2982349811 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400041020 con 0x7f940c0d0c80 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f940affd640 1 -- 172.21.15.137:0/2982349811 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9400030970 con 0x7f940c0d0c80 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f9414452640 1 -- 172.21.15.137:0/2982349811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940c0c62c0 con 0x7f940c0d0c80 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f940affd640 1 -- 172.21.15.137:0/2982349811 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400037040 con 0x7f940c0d0c80 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.012+0000 7f9414452640 1 -- 172.21.15.137:0/2982349811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940c0c6880 con 0x7f940c0d0c80 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.013+0000 7f940affd640 1 -- 172.21.15.137:0/2982349811 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9400044020 con 0x7f940c0d0c80 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.014+0000 7f940affd640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f93f806c8f0 0x7f93f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.014+0000 7f940affd640 1 -- 172.21.15.137:0/2982349811 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f94000ac280 con 0x7f940c0d0c80 2024-04-26T22:03:56.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.014+0000 7f94121ee640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f93f806c8f0 0x7f93f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.014+0000 7f94121ee640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f93f806c8f0 0x7f93f806edb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00e550 tx=0x7f93fc007ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.015+0000 7f941716a740 1 Processor -- start 2024-04-26T22:03:56.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.015+0000 7f941716a740 1 -- start start 2024-04-26T22:03:56.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f941716a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f941716a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e1370d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f941716a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e161c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f941716a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555e0e09bb80 con 0x555e0e1617b0 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f941716a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555e0e0374d0 con 0x555e0e1733c0 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f941716a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555e0e097b40 con 0x555e0e136cf0 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f94129ef640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f94129ef640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e161c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53694/0 (socket says 172.21.15.137:53694) 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f94129ef640 1 -- 172.21.15.137:0/2303815996 learned_addr learned my addr 172.21.15.137:0/2303815996 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f94121ee640 1 --2- 172.21.15.137:0/2303815996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f94119ed640 1 --2- 172.21.15.137:0/2303815996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e1370d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f94129ef640 1 -- 172.21.15.137:0/2303815996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 msgr2=0x555e0e138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.016+0000 7f94129ef640 1 --2- 172.21.15.137:0/2303815996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.017+0000 7f94129ef640 1 -- 172.21.15.137:0/2303815996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 msgr2=0x555e0e1370d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.017+0000 7f94129ef640 1 --2- 172.21.15.137:0/2303815996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e1370d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.017+0000 7f94129ef640 1 -- 172.21.15.137:0/2303815996 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e0e064770 con 0x555e0e1617b0 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.017+0000 7f94129ef640 1 --2- 172.21.15.137:0/2303815996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e161c30 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9404004d00 tx=0x7f94040051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd4affeeb8d2b98 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.017+0000 7f93f3fff640 1 -- 172.21.15.137:0/2303815996 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9404007030 con 0x555e0e1617b0 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.017+0000 7f93f3fff640 1 -- 172.21.15.137:0/2303815996 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9404018070 con 0x555e0e1617b0 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.017+0000 7f93f3fff640 1 -- 172.21.15.137:0/2303815996 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9404007450 con 0x555e0e1617b0 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.017+0000 7f941716a740 1 -- 172.21.15.137:0/2303815996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 msgr2=0x555e0e161c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 --2- 172.21.15.137:0/2303815996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e161c30 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f9404004d00 tx=0x7f94040051c0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 -- 172.21.15.137:0/2303815996 shutdown_connections 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 --2- 172.21.15.137:0/2303815996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e161c30 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 --2- 172.21.15.137:0/2303815996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e1370d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 --2- 172.21.15.137:0/2303815996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 -- 172.21.15.137:0/2303815996 >> 172.21.15.137:0/2303815996 conn(0x555e0e0cbe90 msgr2=0x555e0e17c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 -- 172.21.15.137:0/2303815996 shutdown_connections 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 -- 172.21.15.137:0/2303815996 wait complete. 2024-04-26T22:03:56.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 -- start start 2024-04-26T22:03:56.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.018+0000 7f941716a740 1 Processor -- start 2024-04-26T22:03:56.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f941716a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f941716a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e163490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f941716a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e175730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f941716a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555e0e034e70 con 0x555e0e1617b0 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f941716a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555e0e15f300 con 0x555e0e1733c0 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f941716a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555e0e162bb0 con 0x555e0e136cf0 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f941716a740 10 client.0 _ll_register_callbacks cb 0x555e0e045ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f94119ed640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e163490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f94119ed640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e163490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53708/0 (socket says 172.21.15.137:53708) 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f94119ed640 1 -- 172.21.15.137:0/815180852 learned_addr learned my addr 172.21.15.137:0/815180852 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f94129ef640 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e175730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.019+0000 7f94121ee640 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f94119ed640 1 -- 172.21.15.137:0/815180852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 msgr2=0x555e0e162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f94119ed640 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e162670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f94119ed640 1 -- 172.21.15.137:0/815180852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 msgr2=0x555e0e175730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f94119ed640 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e175730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f94119ed640 1 -- 172.21.15.137:0/815180852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e0de797c0 con 0x555e0e1617b0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f94119ed640 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e163490 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9400079f20 tx=0x7f94000ac170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da23389f142d387 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f93f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f93f17fa640 1 -- 172.21.15.137:0/815180852 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400092020 con 0x555e0e1617b0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f93f17fa640 1 -- 172.21.15.137:0/815180852 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f9400030d60 con 0x555e0e1617b0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f941716a740 1 -- 172.21.15.137:0/815180852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9404018070 con 0x555e0e1617b0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f93f17fa640 1 -- 172.21.15.137:0/815180852 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f940007e340 con 0x555e0e1617b0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f941716a740 10 client.7092 fetch_fsmap learned FSMap version 41 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f941716a740 1 -- 172.21.15.137:0/815180852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x555e0ded9f50 con 0x555e0e1617b0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f93f17fa640 1 -- 172.21.15.137:0/815180852 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9404018070 con 0x555e0e1617b0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f93f17fa640 1 -- 172.21.15.137:0/815180852 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 41) ==== 3494+0+0 (secure 0 0 0) 0x7f940003a030 con 0x555e0e1617b0 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f941716a740 10 client.7092 fetch_fsmap finished waiting for FSMap version 41 2024-04-26T22:03:56.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f941716a740 10 client.7092 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f941716a740 20 client.7092 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f941716a740 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555e0e18f940 0x555e0e18fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f941716a740 4 client.7092 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f941716a740 1 -- 172.21.15.137:0/815180852 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e0e04f240 con 0x555e0e18f940 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.020+0000 7f94121ee640 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555e0e18f940 0x555e0e18fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.021+0000 7f93f17fa640 10 client.7092 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.021+0000 7f94121ee640 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555e0e18f940 0x555e0e18fd20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b63f67e4a080bdae server_cookie=8c59dec38efaca85 in_seq=0 out_seq=0 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.021+0000 7f93f17fa640 1 -- 172.21.15.137:0/815180852 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555e0e04f240 con 0x555e0e18f940 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.021+0000 7f93f17fa640 10 client.7092 handle_command_reply: tid=0 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.021+0000 7f941716a740 1 client.7092 shutdown 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.021+0000 7f941716a740 1 -- 172.21.15.137:0/815180852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 msgr2=0x555e0e163490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.021+0000 7f941716a740 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e163490 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9400079f20 tx=0x7f94000ac170 comp rx=0 tx=0).stop 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f941716a740 1 -- 172.21.15.137:0/815180852 shutdown_connections 2024-04-26T22:03:56.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f941716a740 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555e0e18f940 0x555e0e18fd20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f941716a740 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e163490 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f941716a740 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e175730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f93f17fa640 0 client.7092 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:56.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f941716a740 1 --2- 172.21.15.137:0/815180852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e162670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f941716a740 1 -- 172.21.15.137:0/815180852 >> 172.21.15.137:0/815180852 conn(0x555e0e0cbe90 msgr2=0x555e0e17fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f941716a740 1 -- 172.21.15.137:0/815180852 shutdown_connections 2024-04-26T22:03:56.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f941716a740 1 -- 172.21.15.137:0/815180852 wait complete. 2024-04-26T22:03:56.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.022+0000 7f941716a740 20 client.7092 trim_cache size 0 max 16384 2024-04-26T22:03:56.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.035+0000 7f941716a740 1 Processor -- start 2024-04-26T22:03:56.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.035+0000 7f941716a740 1 -- start start 2024-04-26T22:03:56.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.035+0000 7f941716a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e136cf0 0x555e0e1a0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.035+0000 7f941716a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e1617b0 0x555e0e18e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.035+0000 7f941716a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1733c0 0x555e0e177fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.035+0000 7f941716a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f940c1f6c60 con 0x555e0e1733c0 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.035+0000 7f941716a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f940c0cac30 con 0x555e0e136cf0 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.035+0000 7f941716a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f940c1f6610 con 0x555e0e1617b0 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94129ef640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1733c0 0x555e0e177fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94129ef640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1733c0 0x555e0e177fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53710/0 (socket says 172.21.15.137:53710) 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94129ef640 1 -- 172.21.15.137:0/3745656416 learned_addr learned my addr 172.21.15.137:0/3745656416 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94121ee640 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e136cf0 0x555e0e1a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94119ed640 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e1617b0 0x555e0e18e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94129ef640 1 -- 172.21.15.137:0/3745656416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e1617b0 msgr2=0x555e0e18e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94129ef640 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e1617b0 0x555e0e18e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94129ef640 1 -- 172.21.15.137:0/3745656416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e136cf0 msgr2=0x555e0e1a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94129ef640 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e136cf0 0x555e0e1a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94129ef640 1 -- 172.21.15.137:0/3745656416 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e0e15d6d0 con 0x555e0e1733c0 2024-04-26T22:03:56.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94119ed640 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e1617b0 0x555e0e18e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f94129ef640 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1733c0 0x555e0e177fd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9404014000 tx=0x7f940400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19458ab7e4489f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f93f37fe640 1 -- 172.21.15.137:0/3745656416 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94040048f0 con 0x555e0e1733c0 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f93f37fe640 1 -- 172.21.15.137:0/3745656416 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9404022020 con 0x555e0e1733c0 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.036+0000 7f93f37fe640 1 -- 172.21.15.137:0/3745656416 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94040073f0 con 0x555e0e1733c0 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 -- 172.21.15.137:0/3745656416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1733c0 msgr2=0x555e0e177fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1733c0 0x555e0e177fd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9404014000 tx=0x7f940400a000 comp rx=0 tx=0).stop 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 -- 172.21.15.137:0/3745656416 shutdown_connections 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1733c0 0x555e0e177fd0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e1617b0 0x555e0e18e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 --2- 172.21.15.137:0/3745656416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e136cf0 0x555e0e1a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 -- 172.21.15.137:0/3745656416 >> 172.21.15.137:0/3745656416 conn(0x555e0e0cbe90 msgr2=0x555e0e178aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 -- 172.21.15.137:0/3745656416 shutdown_connections 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 -- 172.21.15.137:0/3745656416 wait complete. 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 -- start start 2024-04-26T22:03:56.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.037+0000 7f941716a740 1 Processor -- start 2024-04-26T22:03:56.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f941716a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e18e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f941716a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e18e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f941716a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e1640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f941716a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x555e0e15eb20 con 0x555e0e1617b0 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f941716a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x555e0e17d340 con 0x555e0e1733c0 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f941716a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x555e0e163c10 con 0x555e0e136cf0 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f941716a740 10 client.0 _ll_register_callbacks cb 0x7f9400006cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f94119ed640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e18e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f94119ed640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e18e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53718/0 (socket says 172.21.15.137:53718) 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f94119ed640 1 -- 172.21.15.137:0/2144758142 learned_addr learned my addr 172.21.15.137:0/2144758142 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f94121ee640 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e18e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.038+0000 7f94129ef640 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e1640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f94119ed640 1 -- 172.21.15.137:0/2144758142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 msgr2=0x555e0e18e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f94119ed640 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e18e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f94119ed640 1 -- 172.21.15.137:0/2144758142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 msgr2=0x555e0e1640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f94119ed640 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e1640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f94119ed640 1 -- 172.21.15.137:0/2144758142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e0dd6d0b0 con 0x555e0e1617b0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f94119ed640 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e18e950 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f9400035040 tx=0x7f9400009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d76b5f62385624 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f93f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f93f17fa640 1 -- 172.21.15.137:0/2144758142 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400092040 con 0x555e0e1617b0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f93f17fa640 1 -- 172.21.15.137:0/2144758142 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f94000795e0 con 0x555e0e1617b0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f941716a740 1 -- 172.21.15.137:0/2144758142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9404022020 con 0x555e0e1617b0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f93f17fa640 1 -- 172.21.15.137:0/2144758142 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f94000a1050 con 0x555e0e1617b0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f941716a740 10 client.7098 fetch_fsmap learned FSMap version 41 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f941716a740 1 -- 172.21.15.137:0/2144758142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) -- 0x555e0dd6d0b0 con 0x555e0e1617b0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f93f17fa640 1 -- 172.21.15.137:0/2144758142 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9404022020 con 0x555e0e1617b0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f93f17fa640 1 -- 172.21.15.137:0/2144758142 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 41) ==== 3494+0+0 (secure 0 0 0) 0x7f94000aab20 con 0x555e0e1617b0 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f941716a740 10 client.7098 fetch_fsmap finished waiting for FSMap version 41 2024-04-26T22:03:56.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f941716a740 10 client.7098 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f941716a740 20 client.7098 populate_metadata read hostname 'smithi137' 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f941716a740 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555e0e164630 0x555e0e164a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f941716a740 4 client.7098 mds_command: new command op to 6843 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f941716a740 1 -- 172.21.15.137:0/2144758142 --> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x555e0e0a9790 con 0x555e0e164630 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.039+0000 7f94121ee640 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555e0e164630 0x555e0e164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f94121ee640 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555e0e164630 0x555e0e164a10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a55fcbd3d300dc75 server_cookie=4ec0a403d79ecc89 in_seq=0 out_seq=0 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f93f17fa640 10 client.7098 ms_handle_connect on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f93f17fa640 1 -- 172.21.15.137:0/2144758142 <== mds.0 v2:172.21.15.137:6835/2422385986 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555e0e0a9790 con 0x555e0e164630 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f93f17fa640 10 client.7098 handle_command_reply: tid=0 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 client.7098 shutdown 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 -- 172.21.15.137:0/2144758142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 msgr2=0x555e0e18e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e18e950 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f9400035040 tx=0x7f9400009550 comp rx=0 tx=0).stop 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 -- 172.21.15.137:0/2144758142 shutdown_connections 2024-04-26T22:03:56.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.137:6835/2422385986,v1:172.21.15.137:6837/2422385986] conn(0x555e0e164630 0x555e0e164a10 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x555e0e1617b0 0x555e0e18e950 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f93f17fa640 0 client.7098 ms_handle_reset on v2:172.21.15.137:6835/2422385986 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555e0e1733c0 0x555e0e1640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 --2- 172.21.15.137:0/2144758142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x555e0e136cf0 0x555e0e18e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 -- 172.21.15.137:0/2144758142 >> 172.21.15.137:0/2144758142 conn(0x555e0e0cbe90 msgr2=0x555e0e1789a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 -- 172.21.15.137:0/2144758142 shutdown_connections 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 1 -- 172.21.15.137:0/2144758142 wait complete. 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.040+0000 7f941716a740 20 client.7098 trim_cache size 0 max 16384 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:03:56.047 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-26T22:03:56.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 -- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f93f806c8f0 msgr2=0x7f93f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f93f806c8f0 0x7f93f806edb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00e550 tx=0x7f93fc007ab0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 -- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d0c80 msgr2=0x7f940c0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d0c80 0x7f940c0c9920 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9400000c00 tx=0x7f94000046c0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 -- 172.21.15.137:0/2982349811 shutdown_connections 2024-04-26T22:03:56.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f93f806c8f0 0x7f93f806edb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f940c0d0c80 0x7f940c0c9920 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f940c0d14d0 0x7f940c15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 --2- 172.21.15.137:0/2982349811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f940c0cd940 0x7f940c0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 -- 172.21.15.137:0/2982349811 >> 172.21.15.137:0/2982349811 conn(0x7f940c0d1e40 msgr2=0x7f940c160db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 -- 172.21.15.137:0/2982349811 shutdown_connections 2024-04-26T22:03:56.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.041+0000 7f9414452640 1 -- 172.21.15.137:0/2982349811 wait complete. 2024-04-26T22:03:56.051 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T22:03:56.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.147+0000 7fe874d0a640 1 Processor -- start 2024-04-26T22:03:56.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.147+0000 7fe874d0a640 1 -- start start 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.148+0000 7fe874d0a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe870160970 0x7fe8700d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.148+0000 7fe874d0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 0x7fe8700d1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.148+0000 7fe874d0a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe870070e10 con 0x7fe8700717c0 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.148+0000 7fe874d0a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe8700710f0 con 0x7fe870160970 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.148+0000 7fe874d0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe8700713d0 con 0x7fe8700720d0 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86e59c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe870160970 0x7fe8700d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86dd9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 0x7fe8700d1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86e59c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe870160970 0x7fe8700d12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:52604/0 (socket says 172.21.15.137:52604) 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86e59c640 1 -- 172.21.15.137:0/879426094 learned_addr learned my addr 172.21.15.137:0/879426094 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86ed9d640 1 --1- 172.21.15.137:0/879426094 >> v1:172.21.15.170:6789/0 conn(0x7fe8700717c0 0x7fe87009ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:33218/0 (socket says 172.21.15.137:33218) 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86dd9b640 1 -- 172.21.15.137:0/879426094 >> v2:172.21.15.170:3300/0 conn(0x7fe870160970 msgr2=0x7fe8700d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86dd9b640 1 --2- 172.21.15.137:0/879426094 >> v2:172.21.15.170:3300/0 conn(0x7fe870160970 0x7fe8700d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86dd9b640 1 -- 172.21.15.137:0/879426094 >> v1:172.21.15.170:6789/0 conn(0x7fe8700717c0 legacy=0x7fe87009ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86dd9b640 1 -- 172.21.15.137:0/879426094 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8700b58a0 con 0x7fe8700720d0 2024-04-26T22:03:56.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.149+0000 7fe86e59c640 1 --2- 172.21.15.137:0/879426094 >> v2:172.21.15.170:3300/0 conn(0x7fe870160970 0x7fe8700d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:03:56.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe86dd9b640 1 --2- 172.21.15.137:0/879426094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 0x7fe8700d1820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe8580097a0 tx=0x7fe85802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f9ccd27004ffd01 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe86d59a640 1 -- 172.21.15.137:0/879426094 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858037070 con 0x7fe8700720d0 2024-04-26T22:03:56.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe86d59a640 1 -- 172.21.15.137:0/879426094 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe858032440 con 0x7fe8700720d0 2024-04-26T22:03:56.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe86d59a640 1 -- 172.21.15.137:0/879426094 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858032810 con 0x7fe8700720d0 2024-04-26T22:03:56.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe874d0a640 1 -- 172.21.15.137:0/879426094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 msgr2=0x7fe8700d1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe874d0a640 1 --2- 172.21.15.137:0/879426094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 0x7fe8700d1820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe8580097a0 tx=0x7fe85802a180 comp rx=0 tx=0).stop 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe874d0a640 1 -- 172.21.15.137:0/879426094 shutdown_connections 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe874d0a640 1 --2- 172.21.15.137:0/879426094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 0x7fe8700d1820 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe874d0a640 1 --2- 172.21.15.137:0/879426094 >> v2:172.21.15.170:3300/0 conn(0x7fe870160970 0x7fe8700d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.150+0000 7fe874d0a640 1 -- 172.21.15.137:0/879426094 >> 172.21.15.137:0/879426094 conn(0x7fe8700b4a10 msgr2=0x7fe8700b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.151+0000 7fe874d0a640 1 -- 172.21.15.137:0/879426094 shutdown_connections 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.151+0000 7fe874d0a640 1 -- 172.21.15.137:0/879426094 wait complete. 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.152+0000 7fe874d0a640 1 Processor -- start 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.152+0000 7fe874d0a640 1 -- start start 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.152+0000 7fe874d0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8700717c0 0x7fe87015cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.152+0000 7fe874d0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 0x7fe8700cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.152+0000 7fe874d0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe870160970 0x7fe8700b6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.152+0000 7fe874d0a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe8700b5530 con 0x7fe8700717c0 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.152+0000 7fe874d0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe870160d50 con 0x7fe870160970 2024-04-26T22:03:56.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.152+0000 7fe874d0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe8700ceef0 con 0x7fe8700720d0 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe86e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8700717c0 0x7fe87015cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe86e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8700717c0 0x7fe87015cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53732/0 (socket says 172.21.15.137:53732) 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe86e59c640 1 -- 172.21.15.137:0/1127676028 learned_addr learned my addr 172.21.15.137:0/1127676028 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe86e59c640 1 -- 172.21.15.137:0/1127676028 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 msgr2=0x7fe8700cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe86e59c640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 0x7fe8700cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe86e59c640 1 -- 172.21.15.137:0/1127676028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe870160970 msgr2=0x7fe8700b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe86e59c640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe870160970 0x7fe8700b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe86e59c640 1 -- 172.21.15.137:0/1127676028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87006e380 con 0x7fe8700717c0 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe86e59c640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8700717c0 0x7fe87015cde0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe868009e80 tx=0x7fe86800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe866ffd640 1 -- 172.21.15.137:0/1127676028 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86800ce60 con 0x7fe8700717c0 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe866ffd640 1 -- 172.21.15.137:0/1127676028 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe868019070 con 0x7fe8700717c0 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87006e660 con 0x7fe8700717c0 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe866ffd640 1 -- 172.21.15.137:0/1127676028 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868014680 con 0x7fe8700717c0 2024-04-26T22:03:56.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.153+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87006ec20 con 0x7fe8700717c0 2024-04-26T22:03:56.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.154+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87006a290 con 0x7fe8700717c0 2024-04-26T22:03:56.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.155+0000 7fe866ffd640 1 -- 172.21.15.137:0/1127676028 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe868005d10 con 0x7fe8700717c0 2024-04-26T22:03:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.155+0000 7fe866ffd640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85006c8f0 0x7fe85006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.155+0000 7fe866ffd640 1 -- 172.21.15.137:0/1127676028 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fe86808c0d0 con 0x7fe8700717c0 2024-04-26T22:03:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.155+0000 7fe86dd9b640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85006c8f0 0x7fe85006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.156+0000 7fe86dd9b640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85006c8f0 0x7fe85006edb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe858034000 tx=0x7fe85802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.159+0000 7fe866ffd640 1 -- 172.21.15.137:0/1127676028 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe868010040 con 0x7fe8700717c0 2024-04-26T22:03:56.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.374+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe8700d05f0 con 0x7fe8700717c0 2024-04-26T22:03:56.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.375+0000 7fe866ffd640 1 -- 172.21.15.137:0/1127676028 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe86805a450 con 0x7fe8700717c0 2024-04-26T22:03:56.375 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:03:56.375 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T22:03:56.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85006c8f0 msgr2=0x7fe85006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85006c8f0 0x7fe85006edb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe858034000 tx=0x7fe85802c000 comp rx=0 tx=0).stop 2024-04-26T22:03:56.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8700717c0 msgr2=0x7fe87015cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8700717c0 0x7fe87015cde0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe868009e80 tx=0x7fe86800c490 comp rx=0 tx=0).stop 2024-04-26T22:03:56.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 shutdown_connections 2024-04-26T22:03:56.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe85006c8f0 0x7fe85006edb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe870160970 0x7fe8700b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe8700720d0 0x7fe8700cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 --2- 172.21.15.137:0/1127676028 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe8700717c0 0x7fe87015cde0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 >> 172.21.15.137:0/1127676028 conn(0x7fe8700b4a10 msgr2=0x7fe8700cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 shutdown_connections 2024-04-26T22:03:56.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.377+0000 7fe874d0a640 1 -- 172.21.15.137:0/1127676028 wait complete. 2024-04-26T22:03:56.388 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-26T22:03:56.389 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:03:56.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.485+0000 7f98377c8640 1 Processor -- start 2024-04-26T22:03:56.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.485+0000 7f98377c8640 1 -- start start 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.486+0000 7f98377c8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f98300b61a0 0x7f9830160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.486+0000 7f98377c8640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98300b4270 con 0x7f98300b3de0 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.486+0000 7f98377c8640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98300b4530 con 0x7f9830145980 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.486+0000 7f98377c8640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f98300b5140 con 0x7f98300b61a0 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.486+0000 7f9835d65640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f98300b3de0 0x7f98300720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55924/0 (socket says 172.21.15.137:55924) 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.486+0000 7f9835d65640 1 -- 172.21.15.137:0/3545731826 learned_addr learned my addr 172.21.15.137:0/3545731826 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.486+0000 7f9834d63640 1 --2- 172.21.15.137:0/3545731826 >> v2:172.21.15.170:3300/0 conn(0x7f98300b61a0 0x7f9830160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.486+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216629318 0 0) 0x7f98300b4270 con 0x7f98300b3de0 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.486+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f981c003520 con 0x7f98300b3de0 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 94766419 0 0) 0x7f981c003520 con 0x7f98300b3de0 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 >> v2:172.21.15.170:3300/0 conn(0x7f98300b61a0 msgr2=0x7f9830160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 --2- 172.21.15.137:0/3545731826 >> v2:172.21.15.170:3300/0 conn(0x7f98300b61a0 0x7f9830160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 >> v1:172.21.15.170:6789/0 conn(0x7f9830145980 legacy=0x7f98300b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98300b4810 con 0x7f98300b3de0 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f9828001670 con 0x7f98300b3de0 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 >> v1:172.21.15.137:6789/0 conn(0x7f98300b3de0 legacy=0x7f98300720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f981c0039b0 0x7f981c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f981c004800 0x7f981c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f981c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98300b5140 con 0x7f981c0051c0 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f981c00c160 con 0x7f981c0039b0 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f981c00c360 con 0x7f981c004800 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9835d65640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f981c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9834d63640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f981c004800 0x7f981c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9835564640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f981c0039b0 0x7f981c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9835d65640 1 -- 172.21.15.137:0/3545731826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f981c004800 msgr2=0x7f981c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9835d65640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f981c004800 0x7f981c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9835d65640 1 -- 172.21.15.137:0/3545731826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f981c0039b0 msgr2=0x7f981c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9835d65640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f981c0039b0 0x7f981c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.487+0000 7f9835d65640 1 -- 172.21.15.137:0/3545731826 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c003520 con 0x7f981c0051c0 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f9835d65640 1 -- 172.21.15.137:0/3545731826 reap_dead start 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f9835d65640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f981c00b9c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f982800c240 tx=0x7f981c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c1a4a4af3a7a5c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828007cf0 con 0x7f981c0051c0 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98280058d0 con 0x7f981c0051c0 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f9827fff640 1 -- 172.21.15.137:0/3545731826 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828005ce0 con 0x7f981c0051c0 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f98377c8640 1 -- 172.21.15.137:0/3545731826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 msgr2=0x7f981c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f98377c8640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f981c00b9c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f982800c240 tx=0x7f981c005830 comp rx=0 tx=0).stop 2024-04-26T22:03:56.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f98377c8640 1 -- 172.21.15.137:0/3545731826 shutdown_connections 2024-04-26T22:03:56.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f98377c8640 1 --2- 172.21.15.137:0/3545731826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f981c00b9c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.488+0000 7f98377c8640 1 -- 172.21.15.137:0/3545731826 >> 172.21.15.137:0/3545731826 conn(0x7f98300d0d30 msgr2=0x7f98300d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.489+0000 7f98377c8640 1 -- 172.21.15.137:0/3545731826 shutdown_connections 2024-04-26T22:03:56.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.489+0000 7f98377c8640 1 -- 172.21.15.137:0/3545731826 wait complete. 2024-04-26T22:03:56.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f98377c8640 1 Processor -- start 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f98377c8640 1 -- start start 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f98377c8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f983015f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f98377c8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f983015fdc0 0x7f983015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f98377c8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983015b3e0 0x7f983015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f98377c8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9830160630 con 0x7f981c0051c0 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f98377c8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f98300b4dd0 con 0x7f983015b3e0 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f98377c8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f98301607b0 con 0x7f983015fdc0 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f9835564640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f983015f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f9835564640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f983015f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53750/0 (socket says 172.21.15.137:53750) 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.490+0000 7f9835564640 1 -- 172.21.15.137:0/2186461531 learned_addr learned my addr 172.21.15.137:0/2186461531 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9835d65640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983015b3e0 0x7f983015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9834d63640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f983015fdc0 0x7f983015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9835564640 1 -- 172.21.15.137:0/2186461531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f983015fdc0 msgr2=0x7f983015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9835564640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f983015fdc0 0x7f983015aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9835564640 1 -- 172.21.15.137:0/2186461531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983015b3e0 msgr2=0x7f983015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9835564640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983015b3e0 0x7f983015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9835564640 1 -- 172.21.15.137:0/2186461531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9830160240 con 0x7f981c0051c0 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9835564640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f983015f880 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f982c00f960 tx=0x7f982c00fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9825ffb640 1 -- 172.21.15.137:0/2186461531 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c003b80 con 0x7f981c0051c0 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9825ffb640 1 -- 172.21.15.137:0/2186461531 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c018070 con 0x7f981c0051c0 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f9825ffb640 1 -- 172.21.15.137:0/2186461531 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c00d7f0 con 0x7f981c0051c0 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983015d0d0 con 0x7f981c0051c0 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.491+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983015d690 con 0x7f981c0051c0 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.492+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983006a290 con 0x7f981c0051c0 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.493+0000 7f9825ffb640 1 -- 172.21.15.137:0/2186461531 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f982c00d990 con 0x7f981c0051c0 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.493+0000 7f9825ffb640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f981406c920 0x7f981406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:56.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.493+0000 7f9825ffb640 1 -- 172.21.15.137:0/2186461531 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f982c08bd60 con 0x7f981c0051c0 2024-04-26T22:03:56.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.493+0000 7f9834d63640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f981406c920 0x7f981406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:56.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.493+0000 7f9834d63640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f981406c920 0x7f981406ede0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f98300b3ac0 tx=0x7f9820008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:56.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.497+0000 7f9825ffb640 1 -- 172.21.15.137:0/2186461531 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f982c01a310 con 0x7f981c0051c0 2024-04-26T22:03:56.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.709+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9830073cc0 con 0x7f981c0051c0 2024-04-26T22:03:56.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.709+0000 7f9825ffb640 1 -- 172.21.15.137:0/2186461531 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) ==== 53+0+73 (secure 0 0 0) 0x7f982c05a0e0 con 0x7f981c0051c0 2024-04-26T22:03:56.709 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f981406c920 msgr2=0x7f981406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f981406c920 0x7f981406ede0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f98300b3ac0 tx=0x7f9820008040 comp rx=0 tx=0).stop 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 msgr2=0x7f983015f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f983015f880 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f982c00f960 tx=0x7f982c00fe20 comp rx=0 tx=0).stop 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 shutdown_connections 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f981406c920 0x7f981406ede0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f983015b3e0 0x7f983015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f983015fdc0 0x7f983015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 --2- 172.21.15.137:0/2186461531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f981c0051c0 0x7f983015f880 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 >> 172.21.15.137:0/2186461531 conn(0x7f98300d0d30 msgr2=0x7f98300b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:56.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 shutdown_connections 2024-04-26T22:03:56.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56.712+0000 7f98377c8640 1 -- 172.21.15.137:0/2186461531 wait complete. 2024-04-26T22:03:56.722 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:03:56.722 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:03:56.722 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:03:56.723 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:03:56.723 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:03:56.723 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:03:56.723 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:03:56.723 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:03:56.723 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:03:56.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:56.723 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:03:56.738 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:03:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:03:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:03:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:03:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:03:56.738 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:03:56.738 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42470sec preferred_lft 42470sec 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:03:56.739 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:03:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:03:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:03:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:03:56.740 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:03:56.741 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:03:56.741 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:03:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:03:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:03:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:03:56.742 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:03:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:03:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:03:56.742 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:03:56.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:56.742 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:03:56.801 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:03:56.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:56.803 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:03:56.858 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:03:56.858 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:03:56.858 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:03:56.858 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:03:56.859 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:03:56.859 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:03:56.859 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:03:56.859 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:03:56.859 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:03:56.859 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:03:56.859 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:03:56.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:03:56.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:03:56.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:56.982 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:03:56.996 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:03:56.996 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:03:56.996 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:03:56.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:56.997 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:03:57.060 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:03:57.060 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:03:57.115 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:03:57.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:03:57.116 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:03:57.170 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:03:57.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:57.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:03:57.252 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:03:57.252 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:03:57.259 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:03:57.259 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:03:57.259 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:03:57.259 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:03:57.259 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:03:57.259 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:03:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:03:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:03:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:03:57.260 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:03:57.261 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:03:57.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:57.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:03:57.325 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:03:57.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:03:57.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:03:57.421 INFO:teuthology.orchestra.run.smithi137.stdout:client6220 2024-04-26T22:03:57.421 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:03:57.421 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:03:57.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:57.437 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-26T22:03:57.492 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:03:57.492 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-26T22:03:57.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.575+0000 7f76bd283f40 1 Processor -- start 2024-04-26T22:03:57.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.575+0000 7f76bd283f40 1 -- start start 2024-04-26T22:03:57.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bd283f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af06b0690 0x563af06af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bd283f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0781260 0x563af06dd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bd283f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563af0787ab0 0x563af077e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bd283f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563af0656e40 con 0x563af06b0690 2024-04-26T22:03:57.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bd283f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563af065ae80 con 0x563af0787ab0 2024-04-26T22:03:57.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bd283f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563af06b0ac0 con 0x563af0781260 2024-04-26T22:03:57.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bad7d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af06b0690 0x563af06af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bad7d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af06b0690 0x563af06af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53774/0 (socket says 172.21.15.137:53774) 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bad7d640 1 -- 172.21.15.137:0/2278757364 learned_addr learned my addr 172.21.15.137:0/2278757364 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bb57e640 1 --2- 172.21.15.137:0/2278757364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563af0787ab0 0x563af077e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76ba57c640 1 --2- 172.21.15.137:0/2278757364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0781260 0x563af06dd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bad7d640 1 -- 172.21.15.137:0/2278757364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0781260 msgr2=0x563af06dd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bad7d640 1 --2- 172.21.15.137:0/2278757364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0781260 0x563af06dd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bad7d640 1 -- 172.21.15.137:0/2278757364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563af0787ab0 msgr2=0x563af077e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bad7d640 1 --2- 172.21.15.137:0/2278757364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563af0787ab0 0x563af077e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.576+0000 7f76bad7d640 1 -- 172.21.15.137:0/2278757364 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563af0775f60 con 0x563af06b0690 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bad7d640 1 --2- 172.21.15.137:0/2278757364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af06b0690 0x563af06af200 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00d6c0 tx=0x7f76ac00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6983d992f8b29f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76b957a640 1 -- 172.21.15.137:0/2278757364 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac014070 con 0x563af06b0690 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76b957a640 1 -- 172.21.15.137:0/2278757364 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac00b850 con 0x563af06b0690 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76b957a640 1 -- 172.21.15.137:0/2278757364 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00bc20 con 0x563af06b0690 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bd283f40 1 -- 172.21.15.137:0/2278757364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af06b0690 msgr2=0x563af06af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bd283f40 1 --2- 172.21.15.137:0/2278757364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af06b0690 0x563af06af200 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00d6c0 tx=0x7f76ac00db80 comp rx=0 tx=0).stop 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bd283f40 1 -- 172.21.15.137:0/2278757364 shutdown_connections 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bd283f40 1 --2- 172.21.15.137:0/2278757364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563af0787ab0 0x563af077e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bd283f40 1 --2- 172.21.15.137:0/2278757364 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0781260 0x563af06dd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bd283f40 1 --2- 172.21.15.137:0/2278757364 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af06b0690 0x563af06af200 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bd283f40 1 -- 172.21.15.137:0/2278757364 >> 172.21.15.137:0/2278757364 conn(0x563af06ae660 msgr2=0x563af06afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bd283f40 1 -- 172.21.15.137:0/2278757364 shutdown_connections 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.577+0000 7f76bd283f40 1 -- 172.21.15.137:0/2278757364 wait complete. 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.578+0000 7f76bd283f40 1 Processor -- start 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.578+0000 7f76bd283f40 1 -- start start 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.578+0000 7f76bd283f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563af06b0690 0x563af0771a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.578+0000 7f76bd283f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af0781260 0x563af0772ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.578+0000 7f76bd283f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0787ab0 0x563af07730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.578+0000 7f76bd283f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563af06af740 con 0x563af0781260 2024-04-26T22:03:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.578+0000 7f76bd283f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563af0775d10 con 0x563af06b0690 2024-04-26T22:03:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.578+0000 7f76bd283f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563af07758f0 con 0x563af0787ab0 2024-04-26T22:03:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76ba57c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af0781260 0x563af0772ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76ba57c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af0781260 0x563af0772ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53776/0 (socket says 172.21.15.137:53776) 2024-04-26T22:03:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76ba57c640 1 -- 172.21.15.137:0/3189834513 learned_addr learned my addr 172.21.15.137:0/3189834513 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76bad7d640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563af06b0690 0x563af0771a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76bb57e640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0787ab0 0x563af07730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76ba57c640 1 -- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0787ab0 msgr2=0x563af07730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76ba57c640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0787ab0 0x563af07730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76ba57c640 1 -- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563af06b0690 msgr2=0x563af0771a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76ba57c640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563af06b0690 0x563af0771a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76ba57c640 1 -- 172.21.15.137:0/3189834513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563af06db5a0 con 0x563af0781260 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76bb57e640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563af0787ab0 0x563af07730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76ba57c640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af0781260 0x563af0772ba0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f76b000dc50 tx=0x7f76b000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76a3fff640 1 -- 172.21.15.137:0/3189834513 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b000f650 con 0x563af0781260 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76a3fff640 1 -- 172.21.15.137:0/3189834513 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b000f7f0 con 0x563af0781260 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76a3fff640 1 -- 172.21.15.137:0/3189834513 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b000fbc0 con 0x563af0781260 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563af0773af0 con 0x563af0781260 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.579+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563af07737f0 con 0x563af0781260 2024-04-26T22:03:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.580+0000 7f76a3fff640 1 -- 172.21.15.137:0/3189834513 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76b0017400 con 0x563af0781260 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.581+0000 7f76a3fff640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f76a806b2d0 0x7f76a806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.581+0000 7f76a3fff640 1 -- 172.21.15.137:0/3189834513 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f76b008af60 con 0x563af0781260 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.581+0000 7f76bad7d640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f76a806b2d0 0x7f76a806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.581+0000 7f76bd283f40 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x563af06d9300 0x563af0786510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.581+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75) -- 0x563af06af9b0 con 0x563af06d9300 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.581+0000 7f76bb57e640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x563af06d9300 0x563af0786510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.581+0000 7f76bad7d640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f76a806b2d0 0x7f76a806d790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x563af0779b00 tx=0x7f76ac01c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.582+0000 7f76bb57e640 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x563af06d9300 0x563af0786510 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bb57e640 1 -- 172.21.15.137:0/3189834513 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v75'12 uv12 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f76b40547f0 con 0x563af06d9300 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x563af06d9300 msgr2=0x563af0786510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x563af06d9300 0x563af0786510 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f76a806b2d0 msgr2=0x7f76a806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f76a806b2d0 0x7f76a806d790 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x563af0779b00 tx=0x7f76ac01c040 comp rx=0 tx=0).stop 2024-04-26T22:03:57.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af0781260 msgr2=0x563af0772ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 --2- 172.21.15.137:0/3189834513 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563af0781260 0x563af0772ba0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f76b000dc50 tx=0x7f76b000b6c0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bb57e640 1 -- 172.21.15.137:0/3189834513 reap_dead start 2024-04-26T22:03:57.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 shutdown_connections 2024-04-26T22:03:57.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 >> 172.21.15.137:0/3189834513 conn(0x563af06ae660 msgr2=0x563af06aeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:57.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 shutdown_connections 2024-04-26T22:03:57.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.583+0000 7f76bd283f40 1 -- 172.21.15.137:0/3189834513 wait complete. 2024-04-26T22:03:57.589 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:03:57.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:03:57.669 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:03:57.708 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:03:57.708 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:03:57.708 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:03:57.708 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:03:57.725 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:03:57.725 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:03:57.780 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:03:57.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.916+0000 7f74695f0640 1 Processor -- start 2024-04-26T22:03:57.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.916+0000 7f74695f0640 1 -- start start 2024-04-26T22:03:57.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.917+0000 7f74695f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640d3ee0 0x7f74640cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.917+0000 7f74695f0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74640d03a0 con 0x7f746415f750 2024-04-26T22:03:57.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.917+0000 7f74695f0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74640d0680 con 0x7f746415f370 2024-04-26T22:03:57.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.917+0000 7f74695f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f74640d0960 con 0x7f74640d3ee0 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.917+0000 7f74637fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f746415f750 0x7f74640b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55928/0 (socket says 172.21.15.137:55928) 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.917+0000 7f74637fe640 1 -- 172.21.15.137:0/3218721778 learned_addr learned my addr 172.21.15.137:0/3218721778 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880784953 0 0) 0x7f74640d03a0 con 0x7f746415f750 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f744c003520 con 0x7f746415f750 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f74627fc640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640d3ee0 0x7f74640cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2307170089 0 0) 0x7f744c003520 con 0x7f746415f750 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640d3ee0 msgr2=0x7f74640cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640d3ee0 0x7f74640cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 >> v1:172.21.15.170:6789/0 conn(0x7f746415f370 legacy=0x7f74640d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74640d0c40 con 0x7f746415f750 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f745c0019f0 con 0x7f746415f750 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 >> v1:172.21.15.137:6789/0 conn(0x7f746415f750 legacy=0x7f74640b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640d3ee0 0x7f744c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f744c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744c004d40 0x7f744c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74640d0960 con 0x7f744c003f60 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f744c00baa0 con 0x7f744c004d40 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f744c00bca0 con 0x7f74640d3ee0 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f74627fc640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f744c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f7462ffd640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640d3ee0 0x7f744c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f74637fe640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744c004d40 0x7f744c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f74627fc640 1 -- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640d3ee0 msgr2=0x7f744c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f74627fc640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640d3ee0 0x7f744c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f74627fc640 1 -- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744c004d40 msgr2=0x7f744c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f74627fc640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744c004d40 0x7f744c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.918+0000 7f74627fc640 1 -- 172.21.15.137:0/3218721778 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744c003520 con 0x7f744c003f60 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.919+0000 7f74627fc640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f744c004800 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7458009ac0 tx=0x7f744c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb0cc7b37c1710e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.919+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458036070 con 0x7f744c003f60 2024-04-26T22:03:57.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.919+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7458031400 con 0x7f744c003f60 2024-04-26T22:03:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.919+0000 7f7461ffb640 1 -- 172.21.15.137:0/3218721778 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7458009690 con 0x7f744c003f60 2024-04-26T22:03:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.920+0000 7f74695f0640 1 -- 172.21.15.137:0/3218721778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 msgr2=0x7f744c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.920+0000 7f74695f0640 1 --2- 172.21.15.137:0/3218721778 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f744c004800 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7458009ac0 tx=0x7f744c005830 comp rx=0 tx=0).stop 2024-04-26T22:03:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.920+0000 7f74637fe640 1 -- 172.21.15.137:0/3218721778 reap_dead start 2024-04-26T22:03:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.920+0000 7f74695f0640 1 -- 172.21.15.137:0/3218721778 shutdown_connections 2024-04-26T22:03:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.920+0000 7f74695f0640 1 -- 172.21.15.137:0/3218721778 >> 172.21.15.137:0/3218721778 conn(0x7f746408ec10 msgr2=0x7f746409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.920+0000 7f74695f0640 1 -- 172.21.15.137:0/3218721778 shutdown_connections 2024-04-26T22:03:57.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.920+0000 7f74695f0640 1 -- 172.21.15.137:0/3218721778 wait complete. 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.921+0000 7f74695f0640 1 Processor -- start 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.921+0000 7f74695f0640 1 -- start start 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f74695f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f7464158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f74695f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74640cb450 0x7f74640d1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f74695f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640cb8b0 0x7f74640d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f74695f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74640cfef0 con 0x7f744c003f60 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f74695f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74640cfd70 con 0x7f74640cb450 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f74695f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f74640d0070 con 0x7f74640cb8b0 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f7462ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f7464158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f7462ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f7464158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53792/0 (socket says 172.21.15.137:53792) 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f7462ffd640 1 -- 172.21.15.137:0/1739894846 learned_addr learned my addr 172.21.15.137:0/1739894846 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f7462ffd640 1 -- 172.21.15.137:0/1739894846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640cb8b0 msgr2=0x7f74640d20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f7462ffd640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640cb8b0 0x7f74640d20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f7462ffd640 1 -- 172.21.15.137:0/1739894846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74640cb450 msgr2=0x7f74640d1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f7462ffd640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74640cb450 0x7f74640d1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f7462ffd640 1 -- 172.21.15.137:0/1739894846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7464161ff0 con 0x7f744c003f60 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f7462ffd640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f7464158750 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f745400f820 tx=0x7f745400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f744b7fe640 1 -- 172.21.15.137:0/1739894846 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74540050d0 con 0x7f744c003f60 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f744b7fe640 1 -- 172.21.15.137:0/1739894846 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7454018070 con 0x7f744c003f60 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7464162290 con 0x7f744c003f60 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f744b7fe640 1 -- 172.21.15.137:0/1739894846 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454005490 con 0x7f744c003f60 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.922+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7464162850 con 0x7f744c003f60 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.924+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74640c8ef0 con 0x7f744c003f60 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.924+0000 7f744b7fe640 1 -- 172.21.15.137:0/1739894846 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f745400d6b0 con 0x7f744c003f60 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.924+0000 7f744b7fe640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f745006c8f0 0x7f745006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.924+0000 7f74627fc640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f745006c8f0 0x7f745006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.924+0000 7f744b7fe640 1 -- 172.21.15.137:0/1739894846 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f745408b9a0 con 0x7f744c003f60 2024-04-26T22:03:57.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.925+0000 7f74627fc640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f745006c8f0 0x7f745006edb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7458033000 tx=0x7f745802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:57.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:57.929+0000 7f744b7fe640 1 -- 172.21.15.137:0/1739894846 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7454059db0 con 0x7f744c003f60 2024-04-26T22:03:58.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.107+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f746406a290 con 0x7f744c003f60 2024-04-26T22:03:58.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.109+0000 7f744b7fe640 1 -- 172.21.15.137:0/1739894846 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16956 (secure 0 0 0) 0x7f74540596b0 con 0x7f744c003f60 2024-04-26T22:03:58.109 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:03:58.109 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":75,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:03:23.459267+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:02:34.722395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T22:02:35.462679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.10","mappings":[{"from":6,"to":1}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/1566574554":"2024-04-27T22:02:45.720691+0000","172.21.15.137:6835/1566574554":"2024-04-27T22:02:45.720691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:03:58.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f745006c8f0 msgr2=0x7f745006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f745006c8f0 0x7f745006edb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7458033000 tx=0x7f745802e000 comp rx=0 tx=0).stop 2024-04-26T22:03:58.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 msgr2=0x7f7464158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f7464158750 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f745400f820 tx=0x7f745400fce0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 shutdown_connections 2024-04-26T22:03:58.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f745006c8f0 0x7f745006edb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74640cb8b0 0x7f74640d20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f74640cb450 0x7f74640d1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 --2- 172.21.15.137:0/1739894846 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f744c003f60 0x7f7464158750 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 >> 172.21.15.137:0/1739894846 conn(0x7f746408ec10 msgr2=0x7f74640d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:58.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 shutdown_connections 2024-04-26T22:03:58.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.111+0000 7f74695f0640 1 -- 172.21.15.137:0/1739894846 wait complete. 2024-04-26T22:03:58.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:02:34.722395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:02:35.462679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:03:58.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:03:58.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.222+0000 7f41cc3f7640 1 Processor -- start 2024-04-26T22:03:58.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.222+0000 7f41cc3f7640 1 -- start start 2024-04-26T22:03:58.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.223+0000 7f41cc3f7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f41c40b4eb0 0x7f41c40b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.223+0000 7f41cc3f7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40ceff0 0x7f41c40cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.223+0000 7f41cc3f7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c415dca0 con 0x7f41c4143840 2024-04-26T22:03:58.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.223+0000 7f41cc3f7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f41c4143c20 con 0x7f41c40b4eb0 2024-04-26T22:03:58.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.223+0000 7f41cc3f7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f41c415df80 con 0x7f41c40ceff0 2024-04-26T22:03:58.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41c9992640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f41c40b4eb0 0x7f41c40b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41ca994640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40ceff0 0x7f41c40cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41ca193640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f41c4143840 0x7f41c40b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:33266/0 (socket says 172.21.15.137:33266) 2024-04-26T22:03:58.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41ca193640 1 -- 172.21.15.137:0/2295648438 learned_addr learned my addr 172.21.15.137:0/2295648438 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:58.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41c9992640 1 -- 172.21.15.137:0/2295648438 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40ceff0 msgr2=0x7f41c40cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:58.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41c9992640 1 --2- 172.21.15.137:0/2295648438 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40ceff0 0x7f41c40cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41c9992640 1 -- 172.21.15.137:0/2295648438 >> v1:172.21.15.170:6789/0 conn(0x7f41c4143840 legacy=0x7f41c40b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41c9191640 1 -- 172.21.15.137:0/2295648438 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347614856 0 0) 0x7f41c415dca0 con 0x7f41c4143840 2024-04-26T22:03:58.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41c9992640 1 -- 172.21.15.137:0/2295648438 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c415e260 con 0x7f41c40b4eb0 2024-04-26T22:03:58.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.224+0000 7f41ca994640 1 --2- 172.21.15.137:0/2295648438 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40ceff0 0x7f41c40cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.225+0000 7f41c9992640 1 --2- 172.21.15.137:0/2295648438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40b4eb0 0x7f41c40b5330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f41b40097a0 tx=0x7f41b402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf4f27d76e82662 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.225+0000 7f41c9191640 1 -- 172.21.15.137:0/2295648438 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4037070 con 0x7f41c40b4eb0 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.225+0000 7f41c9191640 1 -- 172.21.15.137:0/2295648438 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b4032440 con 0x7f41c40b4eb0 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.225+0000 7f41c9191640 1 -- 172.21.15.137:0/2295648438 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4032810 con 0x7f41c40b4eb0 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.226+0000 7f41cc3f7640 1 -- 172.21.15.137:0/2295648438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40b4eb0 msgr2=0x7f41c40b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.226+0000 7f41cc3f7640 1 --2- 172.21.15.137:0/2295648438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40b4eb0 0x7f41c40b5330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f41b40097a0 tx=0x7f41b402a180 comp rx=0 tx=0).stop 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.226+0000 7f41cc3f7640 1 -- 172.21.15.137:0/2295648438 shutdown_connections 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.226+0000 7f41cc3f7640 1 --2- 172.21.15.137:0/2295648438 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40ceff0 0x7f41c40cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.226+0000 7f41cc3f7640 1 --2- 172.21.15.137:0/2295648438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40b4eb0 0x7f41c40b5330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.226+0000 7f41cc3f7640 1 -- 172.21.15.137:0/2295648438 >> 172.21.15.137:0/2295648438 conn(0x7f41c40cd8a0 msgr2=0x7f41c40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.226+0000 7f41cc3f7640 1 -- 172.21.15.137:0/2295648438 shutdown_connections 2024-04-26T22:03:58.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.226+0000 7f41cc3f7640 1 -- 172.21.15.137:0/2295648438 wait complete. 2024-04-26T22:03:58.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.227+0000 7f41cc3f7640 1 Processor -- start 2024-04-26T22:03:58.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.227+0000 7f41cc3f7640 1 -- start start 2024-04-26T22:03:58.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41cc3f7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40b4eb0 0x7f41c413fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41cc3f7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40ceff0 0x7f41c415c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41cc3f7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41c4143840 0x7f41c4132000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41cc3f7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41c415d8c0 con 0x7f41c4143840 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41cc3f7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f41c40b46f0 con 0x7f41c40ceff0 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41cc3f7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f41c415da40 con 0x7f41c40b4eb0 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca994640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41c4143840 0x7f41c4132000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca994640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41c4143840 0x7f41c4132000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53794/0 (socket says 172.21.15.137:53794) 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca994640 1 -- 172.21.15.137:0/708360842 learned_addr learned my addr 172.21.15.137:0/708360842 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41c9992640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40ceff0 0x7f41c415c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca193640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40b4eb0 0x7f41c413fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca994640 1 -- 172.21.15.137:0/708360842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40b4eb0 msgr2=0x7f41c413fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca994640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40b4eb0 0x7f41c413fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca994640 1 -- 172.21.15.137:0/708360842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40ceff0 msgr2=0x7f41c415c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca994640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40ceff0 0x7f41c415c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca994640 1 -- 172.21.15.137:0/708360842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c413cf30 con 0x7f41c4143840 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41c9992640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40ceff0 0x7f41c415c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41ca994640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41c4143840 0x7f41c4132000 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00e930 tx=0x7f41bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41baffd640 1 -- 172.21.15.137:0/708360842 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc017070 con 0x7f41c4143840 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c4140390 con 0x7f41c4143840 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41baffd640 1 -- 172.21.15.137:0/708360842 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41bc00ca00 con 0x7f41c4143840 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41baffd640 1 -- 172.21.15.137:0/708360842 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00cdd0 con 0x7f41c4143840 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.228+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c4145760 con 0x7f41c4143840 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.229+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c406a290 con 0x7f41c4143840 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.230+0000 7f41baffd640 1 -- 172.21.15.137:0/708360842 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41bc013470 con 0x7f41c4143840 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.230+0000 7f41baffd640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a806c920 0x7f41a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.230+0000 7f41baffd640 1 -- 172.21.15.137:0/708360842 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f41bc08b7a0 con 0x7f41c4143840 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.230+0000 7f41ca193640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a806c920 0x7f41a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.231+0000 7f41ca193640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a806c920 0x7f41a806ede0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f41c00012e0 tx=0x7f41c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.234+0000 7f41baffd640 1 -- 172.21.15.137:0/708360842 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f41bc059b60 con 0x7f41c4143840 2024-04-26T22:03:58.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.406+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f41c40ce420 con 0x7f41c4143840 2024-04-26T22:03:58.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.407+0000 7f41baffd640 1 -- 172.21.15.137:0/708360842 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f41bc059460 con 0x7f41c4143840 2024-04-26T22:03:58.407 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:03:58.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a806c920 msgr2=0x7f41a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a806c920 0x7f41a806ede0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f41c00012e0 tx=0x7f41c0009040 comp rx=0 tx=0).stop 2024-04-26T22:03:58.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41c4143840 msgr2=0x7f41c4132000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41c4143840 0x7f41c4132000 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00e930 tx=0x7f41bc00edf0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 shutdown_connections 2024-04-26T22:03:58.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a806c920 0x7f41a806ede0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41c4143840 0x7f41c4132000 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41c40ceff0 0x7f41c415c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 --2- 172.21.15.137:0/708360842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f41c40b4eb0 0x7f41c413fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 >> 172.21.15.137:0/708360842 conn(0x7f41c40cd8a0 msgr2=0x7f41c40b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:58.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 shutdown_connections 2024-04-26T22:03:58.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.409+0000 7f41cc3f7640 1 -- 172.21.15.137:0/708360842 wait complete. 2024-04-26T22:03:58.419 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:03:58.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.519+0000 7f3a91e25640 1 Processor -- start 2024-04-26T22:03:58.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.519+0000 7f3a91e25640 1 -- start start 2024-04-26T22:03:58.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a91e25640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c069ae0 0x7f3a8c0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a91e25640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a8c0b03e0 0x7f3a8c0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a91e25640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8c0aeb50 con 0x7f3a8c15f470 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a91e25640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3a8c0b0020 con 0x7f3a8c0b03e0 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a91e25640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8c0aee30 con 0x7f3a8c069ae0 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a8bfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a8c0b03e0 0x7f3a8c0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a8bfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3a8c0b03e0 0x7f3a8c0b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53804/0 (socket says 172.21.15.137:53804) 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a8bfff640 1 -- 172.21.15.137:0/648089084 learned_addr learned my addr 172.21.15.137:0/648089084 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a8affd640 1 --2- 172.21.15.137:0/648089084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c069ae0 0x7f3a8c0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a8bfff640 1 -- 172.21.15.137:0/648089084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c069ae0 msgr2=0x7f3a8c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a8bfff640 1 --2- 172.21.15.137:0/648089084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c069ae0 0x7f3a8c0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a8bfff640 1 -- 172.21.15.137:0/648089084 >> v1:172.21.15.170:6789/0 conn(0x7f3a8c15f470 legacy=0x7f3a8c0af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:58.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.520+0000 7f3a8bfff640 1 -- 172.21.15.137:0/648089084 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c0af110 con 0x7f3a8c0b03e0 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.521+0000 7f3a8bfff640 1 --2- 172.21.15.137:0/648089084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c0b03e0 0x7f3a8c0b4600 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009e50 tx=0x7f3a8402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07f056f04822151 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.521+0000 7f3a8a7fc640 1 -- 172.21.15.137:0/648089084 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84036070 con 0x7f3a8c0b03e0 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.521+0000 7f3a8a7fc640 1 -- 172.21.15.137:0/648089084 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a84031600 con 0x7f3a8c0b03e0 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.521+0000 7f3a8a7fc640 1 -- 172.21.15.137:0/648089084 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a840319d0 con 0x7f3a8c0b03e0 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.522+0000 7f3a91e25640 1 -- 172.21.15.137:0/648089084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c0b03e0 msgr2=0x7f3a8c0b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.522+0000 7f3a91e25640 1 --2- 172.21.15.137:0/648089084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c0b03e0 0x7f3a8c0b4600 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009e50 tx=0x7f3a8402a6c0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.522+0000 7f3a91e25640 1 -- 172.21.15.137:0/648089084 shutdown_connections 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.522+0000 7f3a91e25640 1 --2- 172.21.15.137:0/648089084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c0b03e0 0x7f3a8c0b4600 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.522+0000 7f3a91e25640 1 --2- 172.21.15.137:0/648089084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c069ae0 0x7f3a8c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.522+0000 7f3a91e25640 1 -- 172.21.15.137:0/648089084 >> 172.21.15.137:0/648089084 conn(0x7f3a8c073910 msgr2=0x7f3a8c073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:58.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.522+0000 7f3a91e25640 1 -- 172.21.15.137:0/648089084 shutdown_connections 2024-04-26T22:03:58.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.522+0000 7f3a91e25640 1 -- 172.21.15.137:0/648089084 wait complete. 2024-04-26T22:03:58.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.523+0000 7f3a91e25640 1 Processor -- start 2024-04-26T22:03:58.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.523+0000 7f3a91e25640 1 -- start start 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a91e25640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c069ae0 0x7f3a8c156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a91e25640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c0b03e0 0x7f3a8c09e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a91e25640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a8c15f470 0x7f3a8c09e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a91e25640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c0b6220 con 0x7f3a8c069ae0 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a91e25640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c0b09a0 con 0x7f3a8c15f470 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a91e25640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8c0b63a0 con 0x7f3a8c0b03e0 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c069ae0 0x7f3a8c156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c069ae0 0x7f3a8c156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53816/0 (socket says 172.21.15.137:53816) 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8b7fe640 1 -- 172.21.15.137:0/749208389 learned_addr learned my addr 172.21.15.137:0/749208389 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8bfff640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a8c15f470 0x7f3a8c09e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8affd640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c0b03e0 0x7f3a8c09e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8b7fe640 1 -- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c0b03e0 msgr2=0x7f3a8c09e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8b7fe640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c0b03e0 0x7f3a8c09e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8b7fe640 1 -- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a8c15f470 msgr2=0x7f3a8c09e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8b7fe640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a8c15f470 0x7f3a8c09e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8b7fe640 1 -- 172.21.15.137:0/749208389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c09f1d0 con 0x7f3a8c069ae0 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8bfff640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a8c15f470 0x7f3a8c09e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8affd640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c0b03e0 0x7f3a8c09e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a8b7fe640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c069ae0 0x7f3a8c156030 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00b3f0 tx=0x7f3a7c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a73fff640 1 -- 172.21.15.137:0/749208389 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c015020 con 0x7f3a8c069ae0 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a73fff640 1 -- 172.21.15.137:0/749208389 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a7c011830 con 0x7f3a8c069ae0 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a73fff640 1 -- 172.21.15.137:0/749208389 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c011c20 con 0x7f3a8c069ae0 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.524+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8c09ef50 con 0x7f3a8c069ae0 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.525+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8c158460 con 0x7f3a8c069ae0 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.526+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8c06a290 con 0x7f3a8c069ae0 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.526+0000 7f3a73fff640 1 -- 172.21.15.137:0/749208389 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3a7c018020 con 0x7f3a8c069ae0 2024-04-26T22:03:58.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.526+0000 7f3a73fff640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a7806c8f0 0x7f3a7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.526+0000 7f3a73fff640 1 -- 172.21.15.137:0/749208389 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f3a7c08b7b0 con 0x7f3a8c069ae0 2024-04-26T22:03:58.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.526+0000 7f3a8affd640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a7806c8f0 0x7f3a7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.527+0000 7f3a8affd640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a7806c8f0 0x7f3a7806edb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c074400 tx=0x7f3a80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.531+0000 7f3a73fff640 1 -- 172.21.15.137:0/749208389 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3a7c01f030 con 0x7f3a8c069ae0 2024-04-26T22:03:58.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.710+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3a8c0afc90 con 0x7f3a8c069ae0 2024-04-26T22:03:58.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.710+0000 7f3a73fff640 1 -- 172.21.15.137:0/749208389 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7f3a8c09ef50 con 0x7f3a8c069ae0 2024-04-26T22:03:58.710 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.712+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a7806c8f0 msgr2=0x7f3a7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.712+0000 7f3a91e25640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a7806c8f0 0x7f3a7806edb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c074400 tx=0x7f3a80008040 comp rx=0 tx=0).stop 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c069ae0 msgr2=0x7f3a8c156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c069ae0 0x7f3a8c156030 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00b3f0 tx=0x7f3a7c00b8b0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 shutdown_connections 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3a7806c8f0 0x7f3a7806edb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a8c15f470 0x7f3a8c09e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3a8c0b03e0 0x7f3a8c09e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 --2- 172.21.15.137:0/749208389 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3a8c069ae0 0x7f3a8c156030 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 >> 172.21.15.137:0/749208389 conn(0x7f3a8c073910 msgr2=0x7f3a8c0d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 shutdown_connections 2024-04-26T22:03:58.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.713+0000 7f3a91e25640 1 -- 172.21.15.137:0/749208389 wait complete. 2024-04-26T22:03:58.723 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:03:58.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.823+0000 7f860c997640 1 Processor -- start 2024-04-26T22:03:58.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.824+0000 7f860c997640 1 -- start start 2024-04-26T22:03:58.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.824+0000 7f860c997640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f860815d340 0x7f860809c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.824+0000 7f860c997640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f86080b2420 0x7f86080d1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.824+0000 7f860c997640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f86080d1770 0x7f86080cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.824+0000 7f860c997640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f86080d1be0 con 0x7f86080d1770 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.824+0000 7f860c997640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f86080ce9d0 con 0x7f86080b2420 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.824+0000 7f860c997640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f86080cee60 con 0x7f860815d340 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f8606d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f86080d1770 0x7f86080cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f8606d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f86080d1770 0x7f86080cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53824/0 (socket says 172.21.15.137:53824) 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f8606d9d640 1 -- 172.21.15.137:0/4084438970 learned_addr learned my addr 172.21.15.137:0/4084438970 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f8605d9b640 1 --2- 172.21.15.137:0/4084438970 >> v2:172.21.15.170:3300/0 conn(0x7f86080b2420 0x7f86080d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f860659c640 1 --2- 172.21.15.137:0/4084438970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f860815d340 0x7f860809c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f8606d9d640 1 -- 172.21.15.137:0/4084438970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f860815d340 msgr2=0x7f860809c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f8606d9d640 1 --2- 172.21.15.137:0/4084438970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f860815d340 0x7f860809c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f8606d9d640 1 -- 172.21.15.137:0/4084438970 >> v2:172.21.15.170:3300/0 conn(0x7f86080b2420 msgr2=0x7f86080d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:58.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f8606d9d640 1 --2- 172.21.15.137:0/4084438970 >> v2:172.21.15.170:3300/0 conn(0x7f86080b2420 0x7f86080d1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.825+0000 7f8606d9d640 1 -- 172.21.15.137:0/4084438970 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86080d0ff0 con 0x7f86080d1770 2024-04-26T22:03:58.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f8606d9d640 1 --2- 172.21.15.137:0/4084438970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86080d1770 0x7f86080cf970 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f86080732f0 tx=0x7f85f802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5938395993e4a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860559a640 1 -- 172.21.15.137:0/4084438970 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8036070 con 0x7f86080d1770 2024-04-26T22:03:58.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860559a640 1 -- 172.21.15.137:0/4084438970 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f8031600 con 0x7f86080d1770 2024-04-26T22:03:58.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860559a640 1 -- 172.21.15.137:0/4084438970 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f80319d0 con 0x7f86080d1770 2024-04-26T22:03:58.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860c997640 1 -- 172.21.15.137:0/4084438970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86080d1770 msgr2=0x7f86080cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860c997640 1 --2- 172.21.15.137:0/4084438970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86080d1770 0x7f86080cf970 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f86080732f0 tx=0x7f85f802a6a0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860c997640 1 -- 172.21.15.137:0/4084438970 shutdown_connections 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860c997640 1 --2- 172.21.15.137:0/4084438970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86080d1770 0x7f86080cf970 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860c997640 1 --2- 172.21.15.137:0/4084438970 >> v2:172.21.15.170:3300/0 conn(0x7f86080b2420 0x7f86080d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860c997640 1 --2- 172.21.15.137:0/4084438970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f860815d340 0x7f860809c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860c997640 1 -- 172.21.15.137:0/4084438970 >> 172.21.15.137:0/4084438970 conn(0x7f860809ba40 msgr2=0x7f860809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860c997640 1 -- 172.21.15.137:0/4084438970 shutdown_connections 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.826+0000 7f860c997640 1 -- 172.21.15.137:0/4084438970 wait complete. 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.828+0000 7f860c997640 1 Processor -- start 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.828+0000 7f860c997640 1 -- start start 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.828+0000 7f860c997640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86080d1770 0x7f860809f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.828+0000 7f860c997640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f860815d340 0x7f86081f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.828+0000 7f860c997640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86081f2e00 0x7f86081f3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.828+0000 7f860c997640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f860815d720 con 0x7f860815d340 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.828+0000 7f860c997640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f86080ce660 con 0x7f86080d1770 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.828+0000 7f860c997640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f86080b2090 con 0x7f86081f2e00 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8605d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f860815d340 0x7f86081f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8605d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f860815d340 0x7f86081f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53830/0 (socket says 172.21.15.137:53830) 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8605d9b640 1 -- 172.21.15.137:0/1242791362 learned_addr learned my addr 172.21.15.137:0/1242791362 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8606d9d640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86081f2e00 0x7f86081f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f860659c640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86080d1770 0x7f860809f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8605d9b640 1 -- 172.21.15.137:0/1242791362 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86081f2e00 msgr2=0x7f86081f3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8605d9b640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86081f2e00 0x7f86081f3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8605d9b640 1 -- 172.21.15.137:0/1242791362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86080d1770 msgr2=0x7f860809f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8605d9b640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86080d1770 0x7f860809f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8605d9b640 1 -- 172.21.15.137:0/1242791362 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86081f3290 con 0x7f860815d340 2024-04-26T22:03:58.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8606d9d640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86081f2e00 0x7f86081f3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:58.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f8605d9b640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f860815d340 0x7f86081f28c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f85f000d800 tx=0x7f85f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f85feffd640 1 -- 172.21.15.137:0/1242791362 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0018030 con 0x7f860815d340 2024-04-26T22:03:58.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f85feffd640 1 -- 172.21.15.137:0/1242791362 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f00096a0 con 0x7f860815d340 2024-04-26T22:03:58.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860809fa30 con 0x7f860815d340 2024-04-26T22:03:58.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f85feffd640 1 -- 172.21.15.137:0/1242791362 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0009870 con 0x7f860815d340 2024-04-26T22:03:58.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.829+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f860809fff0 con 0x7f860815d340 2024-04-26T22:03:58.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.830+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86080693d0 con 0x7f860815d340 2024-04-26T22:03:58.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.831+0000 7f85feffd640 1 -- 172.21.15.137:0/1242791362 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85f001b070 con 0x7f860815d340 2024-04-26T22:03:58.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.831+0000 7f85feffd640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85e806c8f0 0x7f85e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:58.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.831+0000 7f860659c640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85e806c8f0 0x7f85e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:58.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.831+0000 7f85feffd640 1 -- 172.21.15.137:0/1242791362 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f85f008be60 con 0x7f860815d340 2024-04-26T22:03:58.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.831+0000 7f860659c640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85e806c8f0 0x7f85e806edb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8600006fd0 tx=0x7f8600008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:58.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:58.835+0000 7f85feffd640 1 -- 172.21.15.137:0/1242791362 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f85f005a1e0 con 0x7f860815d340 2024-04-26T22:03:59.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.009+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f86080719d0 con 0x7f860815d340 2024-04-26T22:03:59.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.009+0000 7f85feffd640 1 -- 172.21.15.137:0/1242791362 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f85f0059ae0 con 0x7f860815d340 2024-04-26T22:03:59.009 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:03:59.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85e806c8f0 msgr2=0x7f85e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85e806c8f0 0x7f85e806edb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8600006fd0 tx=0x7f8600008040 comp rx=0 tx=0).stop 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f860815d340 msgr2=0x7f86081f28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f860815d340 0x7f86081f28c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f85f000d800 tx=0x7f85f000dcc0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 shutdown_connections 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85e806c8f0 0x7f85e806edb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f860815d340 0x7f86081f28c0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86081f2e00 0x7f86081f3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 --2- 172.21.15.137:0/1242791362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86080d1770 0x7f860809f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 >> 172.21.15.137:0/1242791362 conn(0x7f860809ba40 msgr2=0x7f86080702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 shutdown_connections 2024-04-26T22:03:59.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.011+0000 7f860c997640 1 -- 172.21.15.137:0/1242791362 wait complete. 2024-04-26T22:03:59.022 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:03:59.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.119+0000 7fdea7914640 1 Processor -- start 2024-04-26T22:03:59.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.119+0000 7fdea7914640 1 -- start start 2024-04-26T22:03:59.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.120+0000 7fdea7914640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea015f1e0 0x7fdea006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.120+0000 7fdea7914640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea00b4a10 con 0x7fdea00b44e0 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.120+0000 7fdea7914640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea00b4cf0 con 0x7fdea006d2b0 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.120+0000 7fdea7914640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdea006eeb0 con 0x7fdea015f1e0 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.120+0000 7fdea4eaf640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdea00b44e0 0x7fdea00ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55930/0 (socket says 172.21.15.137:55930) 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.120+0000 7fdea4eaf640 1 -- 172.21.15.137:0/842721992 learned_addr learned my addr 172.21.15.137:0/842721992 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.120+0000 7fdea56b0640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea015f1e0 0x7fdea006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.120+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1158708458 0 0) 0x7fdea00b4a10 con 0x7fdea00b44e0 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.120+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde8c003520 con 0x7fdea00b44e0 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3065967719 0 0) 0x7fde8c003520 con 0x7fdea00b44e0 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea015f1e0 msgr2=0x7fdea006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea015f1e0 0x7fdea006e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 >> v1:172.21.15.170:6789/0 conn(0x7fdea006d2b0 legacy=0x7fdea00b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea00b4fd0 con 0x7fdea00b44e0 2024-04-26T22:03:59.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fde90001670 con 0x7fdea00b44e0 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 >> v1:172.21.15.137:6789/0 conn(0x7fdea00b44e0 legacy=0x7fdea00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde8c0039e0 0x7fde8c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea015f1e0 0x7fde8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c004d40 0x7fde8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdea006eeb0 con 0x7fde8c0039e0 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fde8c00b9c0 con 0x7fde8c004d40 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fde8c00bbc0 con 0x7fdea015f1e0 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fdea56b0640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde8c0039e0 0x7fde8c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fdea4eaf640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea015f1e0 0x7fde8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fdea5eb1640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c004d40 0x7fde8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fdea56b0640 1 -- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea015f1e0 msgr2=0x7fde8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fdea56b0640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea015f1e0 0x7fde8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fdea56b0640 1 -- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c004d40 msgr2=0x7fde8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fdea56b0640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c004d40 0x7fde8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fdea56b0640 1 -- 172.21.15.137:0/842721992 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8c003520 con 0x7fde8c0039e0 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.121+0000 7fdea4eaf640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea015f1e0 0x7fde8c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fdea56b0640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde8c0039e0 0x7fde8c003dc0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fde98009ac0 tx=0x7fde8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4971c7e1f42dbf43 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98036070 con 0x7fde8c0039e0 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde98031400 con 0x7fde8c0039e0 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fde97fff640 1 -- 172.21.15.137:0/842721992 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98009690 con 0x7fde8c0039e0 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fdea7914640 1 -- 172.21.15.137:0/842721992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde8c0039e0 msgr2=0x7fde8c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fdea7914640 1 --2- 172.21.15.137:0/842721992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde8c0039e0 0x7fde8c003dc0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fde98009ac0 tx=0x7fde8c005830 comp rx=0 tx=0).stop 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fdea5eb1640 1 -- 172.21.15.137:0/842721992 reap_dead start 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fdea7914640 1 -- 172.21.15.137:0/842721992 shutdown_connections 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fdea7914640 1 -- 172.21.15.137:0/842721992 >> 172.21.15.137:0/842721992 conn(0x7fdea00728a0 msgr2=0x7fdea0072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fdea7914640 1 -- 172.21.15.137:0/842721992 shutdown_connections 2024-04-26T22:03:59.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.122+0000 7fdea7914640 1 -- 172.21.15.137:0/842721992 wait complete. 2024-04-26T22:03:59.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea7914640 1 Processor -- start 2024-04-26T22:03:59.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea7914640 1 -- start start 2024-04-26T22:03:59.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea7914640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c0039e0 0x7fdea015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea7914640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdea015c640 0x7fdea0160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea7914640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea01508c0 0x7fdea0160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea7914640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdea015f5c0 con 0x7fdea015c640 2024-04-26T22:03:59.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea7914640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdea00b5590 con 0x7fde8c0039e0 2024-04-26T22:03:59.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea7914640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdea0150e80 con 0x7fdea01508c0 2024-04-26T22:03:59.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea4eaf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdea015c640 0x7fdea0160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea4eaf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdea015c640 0x7fdea0160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53850/0 (socket says 172.21.15.137:53850) 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.124+0000 7fdea4eaf640 1 -- 172.21.15.137:0/2417162175 learned_addr learned my addr 172.21.15.137:0/2417162175 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea56b0640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c0039e0 0x7fdea015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea5eb1640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea01508c0 0x7fdea0160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea4eaf640 1 -- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea01508c0 msgr2=0x7fdea0160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea4eaf640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea01508c0 0x7fdea0160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea4eaf640 1 -- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c0039e0 msgr2=0x7fdea015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea4eaf640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c0039e0 0x7fdea015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea4eaf640 1 -- 172.21.15.137:0/2417162175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea01535f0 con 0x7fdea015c640 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea56b0640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c0039e0 0x7fdea015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea5eb1640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea01508c0 0x7fdea0160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea4eaf640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdea015c640 0x7fdea0160920 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fde9000e7e0 tx=0x7fde9000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fde95ffb640 1 -- 172.21.15.137:0/2417162175 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9000c8d0 con 0x7fdea015c640 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fde95ffb640 1 -- 172.21.15.137:0/2417162175 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde90018070 con 0x7fdea015c640 2024-04-26T22:03:59.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea01538d0 con 0x7fdea015c640 2024-04-26T22:03:59.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fde95ffb640 1 -- 172.21.15.137:0/2417162175 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9000cc90 con 0x7fdea015c640 2024-04-26T22:03:59.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.125+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea015bbe0 con 0x7fdea015c640 2024-04-26T22:03:59.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.126+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea015bde0 con 0x7fdea015c640 2024-04-26T22:03:59.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.126+0000 7fde95ffb640 1 -- 172.21.15.137:0/2417162175 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde9001d460 con 0x7fdea015c640 2024-04-26T22:03:59.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.127+0000 7fde95ffb640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde8406c920 0x7fde8406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.127+0000 7fde95ffb640 1 -- 172.21.15.137:0/2417162175 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fde9008b9d0 con 0x7fdea015c640 2024-04-26T22:03:59.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.127+0000 7fdea56b0640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde8406c920 0x7fde8406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.127+0000 7fdea56b0640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde8406c920 0x7fde8406ede0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fde98033000 tx=0x7fde98008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:59.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.131+0000 7fde95ffb640 1 -- 172.21.15.137:0/2417162175 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdea015bde0 con 0x7fdea015c640 2024-04-26T22:03:59.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.320+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdea006a290 con 0x7fdea015c640 2024-04-26T22:03:59.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.320+0000 7fde95ffb640 1 -- 172.21.15.137:0/2417162175 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v75) ==== 80+0+124 (secure 0 0 0) 0x7fde90059d50 con 0x7fdea015c640 2024-04-26T22:03:59.321 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6837/1566574554 2024-04-27T22:02:45.720691+0000 2024-04-26T22:03:59.321 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6835/1566574554 2024-04-27T22:02:45.720691+0000 2024-04-26T22:03:59.321 INFO:teuthology.orchestra.run.smithi137.stderr:listed 2 entries 2024-04-26T22:03:59.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde8406c920 msgr2=0x7fde8406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde8406c920 0x7fde8406ede0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fde98033000 tx=0x7fde98008030 comp rx=0 tx=0).stop 2024-04-26T22:03:59.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdea015c640 msgr2=0x7fdea0160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdea015c640 0x7fdea0160920 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fde9000e7e0 tx=0x7fde9000eca0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 shutdown_connections 2024-04-26T22:03:59.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde8406c920 0x7fde8406ede0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdea015c640 0x7fdea0160920 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdea01508c0 0x7fdea0160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 --2- 172.21.15.137:0/2417162175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde8c0039e0 0x7fdea015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 >> 172.21.15.137:0/2417162175 conn(0x7fdea00728a0 msgr2=0x7fdea006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:59.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 shutdown_connections 2024-04-26T22:03:59.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.323+0000 7fdea7914640 1 -- 172.21.15.137:0/2417162175 wait complete. 2024-04-26T22:03:59.333 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:03:59.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:59.334 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:03:59.360 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:03:59.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:03:59.360 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:03:59.415 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:03:59.415 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:03:59.415 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:03:59.436 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:03:59.436 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:03:59.436 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:03:59.436 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:03:59.473 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:03:59.473 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:03:59.474 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:03:59.474 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:03:59.498 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:03:59.499 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:03:59.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.626+0000 7ff5abc85640 1 Processor -- start 2024-04-26T22:03:59.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.627+0000 7ff5abc85640 1 -- start start 2024-04-26T22:03:59.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.627+0000 7ff5abc85640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff5a40d3ee0 0x7ff5a40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.627+0000 7ff5abc85640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff5a415f750 0x7ff5a40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.627+0000 7ff5abc85640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a40d03a0 con 0x7ff5a415f370 2024-04-26T22:03:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.627+0000 7ff5abc85640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a40b4d10 con 0x7ff5a415f750 2024-04-26T22:03:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.627+0000 7ff5abc85640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a40d0680 con 0x7ff5a40d3ee0 2024-04-26T22:03:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.628+0000 7ff5aa222640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff5a415f750 0x7ff5a40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.628+0000 7ff5a9a21640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff5a415f370 0x7ff5a40d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55946/0 (socket says 172.21.15.137:55946) 2024-04-26T22:03:59.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.628+0000 7ff5a9a21640 1 -- 172.21.15.137:0/605726843 learned_addr learned my addr 172.21.15.137:0/605726843 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:59.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.628+0000 7ff5aa222640 1 -- 172.21.15.137:0/605726843 >> v2:172.21.15.170:3300/0 conn(0x7ff5a40d3ee0 msgr2=0x7ff5a40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:59.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.628+0000 7ff5aa222640 1 --2- 172.21.15.137:0/605726843 >> v2:172.21.15.170:3300/0 conn(0x7ff5a40d3ee0 0x7ff5a40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.628+0000 7ff5aa222640 1 -- 172.21.15.137:0/605726843 >> v1:172.21.15.137:6789/0 conn(0x7ff5a415f370 legacy=0x7ff5a40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.628+0000 7ff5aa222640 1 -- 172.21.15.137:0/605726843 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a40d0960 con 0x7ff5a415f750 2024-04-26T22:03:59.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.628+0000 7ff5a8a1f640 1 -- 172.21.15.137:0/605726843 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820046667 0 0) 0x7ff5a40d03a0 con 0x7ff5a415f370 2024-04-26T22:03:59.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.628+0000 7ff5aa222640 1 --2- 172.21.15.137:0/605726843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f750 0x7ff5a40b47d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0097a0 tx=0x7ff59c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c9ac191f5d3449 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:59.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5a8a1f640 1 -- 172.21.15.137:0/605726843 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c037070 con 0x7ff5a415f750 2024-04-26T22:03:59.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5a8a1f640 1 -- 172.21.15.137:0/605726843 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff59c032440 con 0x7ff5a415f750 2024-04-26T22:03:59.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5a8a1f640 1 -- 172.21.15.137:0/605726843 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c032810 con 0x7ff5a415f750 2024-04-26T22:03:59.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5abc85640 1 -- 172.21.15.137:0/605726843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f750 msgr2=0x7ff5a40b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5abc85640 1 --2- 172.21.15.137:0/605726843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f750 0x7ff5a40b47d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0097a0 tx=0x7ff59c02a200 comp rx=0 tx=0).stop 2024-04-26T22:03:59.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5abc85640 1 -- 172.21.15.137:0/605726843 shutdown_connections 2024-04-26T22:03:59.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5abc85640 1 --2- 172.21.15.137:0/605726843 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f750 0x7ff5a40b47d0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5abc85640 1 --2- 172.21.15.137:0/605726843 >> v2:172.21.15.170:3300/0 conn(0x7ff5a40d3ee0 0x7ff5a40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5abc85640 1 -- 172.21.15.137:0/605726843 >> 172.21.15.137:0/605726843 conn(0x7ff5a408ec10 msgr2=0x7ff5a409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:59.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5abc85640 1 -- 172.21.15.137:0/605726843 shutdown_connections 2024-04-26T22:03:59.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.629+0000 7ff5abc85640 1 -- 172.21.15.137:0/605726843 wait complete. 2024-04-26T22:03:59.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.630+0000 7ff5abc85640 1 Processor -- start 2024-04-26T22:03:59.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.630+0000 7ff5abc85640 1 -- start start 2024-04-26T22:03:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5abc85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5a40d3ee0 0x7ff5a40ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5abc85640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f370 0x7ff5a415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5abc85640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5a415f750 0x7ff5a40b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5abc85640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a40b51c0 con 0x7ff5a415f370 2024-04-26T22:03:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5abc85640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a40d0f20 con 0x7ff5a415f750 2024-04-26T22:03:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5abc85640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a40b5340 con 0x7ff5a40d3ee0 2024-04-26T22:03:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5a9220640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f370 0x7ff5a415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5a9220640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f370 0x7ff5a415bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53864/0 (socket says 172.21.15.137:53864) 2024-04-26T22:03:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5a9220640 1 -- 172.21.15.137:0/3100606422 learned_addr learned my addr 172.21.15.137:0/3100606422 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5aa222640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5a415f750 0x7ff5a40b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.631+0000 7ff5a9a21640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5a40d3ee0 0x7ff5a40ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5a9220640 1 -- 172.21.15.137:0/3100606422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5a40d3ee0 msgr2=0x7ff5a40ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5a9220640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5a40d3ee0 0x7ff5a40ba0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5a9220640 1 -- 172.21.15.137:0/3100606422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5a415f750 msgr2=0x7ff5a40b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5a9220640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5a415f750 0x7ff5a40b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5a9220640 1 -- 172.21.15.137:0/3100606422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a40ba6f0 con 0x7ff5a415f370 2024-04-26T22:03:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5a9220640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f370 0x7ff5a415bb10 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff59800b990 tx=0x7ff59800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5a27fc640 1 -- 172.21.15.137:0/3100606422 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598019070 con 0x7ff5a415f370 2024-04-26T22:03:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5a27fc640 1 -- 172.21.15.137:0/3100606422 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff59800cbc0 con 0x7ff5a415f370 2024-04-26T22:03:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a40ba9d0 con 0x7ff5a415f370 2024-04-26T22:03:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5a27fc640 1 -- 172.21.15.137:0/3100606422 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598014440 con 0x7ff5a415f370 2024-04-26T22:03:59.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.632+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a40b3ee0 con 0x7ff5a415f370 2024-04-26T22:03:59.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.633+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a406a290 con 0x7ff5a415f370 2024-04-26T22:03:59.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.633+0000 7ff5a27fc640 1 -- 172.21.15.137:0/3100606422 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff59801c070 con 0x7ff5a415f370 2024-04-26T22:03:59.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.634+0000 7ff5a27fc640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff59006c920 0x7ff59006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.634+0000 7ff5a27fc640 1 -- 172.21.15.137:0/3100606422 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7ff59808b780 con 0x7ff5a415f370 2024-04-26T22:03:59.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.634+0000 7ff5a9a21640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff59006c920 0x7ff59006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.634+0000 7ff5a9a21640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff59006c920 0x7ff59006ede0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff594000f60 tx=0x7ff594007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:59.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.638+0000 7ff5a27fc640 1 -- 172.21.15.137:0/3100606422 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff598059540 con 0x7ff5a415f370 2024-04-26T22:03:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.850+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5a409e5d0 con 0x7ff5a415f370 2024-04-26T22:03:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.851+0000 7ff5a27fc640 1 -- 172.21.15.137:0/3100606422 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5197 (secure 0 0 0) 0x7ff59805d840 con 0x7ff5a415f370 2024-04-26T22:03:59.852 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:03:59.852 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:03:28.395142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/2422385986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2422385986},{"type":"v1","addr":"172.21.15.137:6837","nonce":2422385986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6843,"qdb_cluster":[6843]},"id":5}]} 2024-04-26T22:03:59.852 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 41 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff59006c920 msgr2=0x7ff59006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff59006c920 0x7ff59006ede0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff594000f60 tx=0x7ff594007d50 comp rx=0 tx=0).stop 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f370 msgr2=0x7ff5a415bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f370 0x7ff5a415bb10 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff59800b990 tx=0x7ff59800be50 comp rx=0 tx=0).stop 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 shutdown_connections 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff59006c920 0x7ff59006ede0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff5a415f370 0x7ff5a415bb10 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff5a415f750 0x7ff5a40b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 --2- 172.21.15.137:0/3100606422 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff5a40d3ee0 0x7ff5a40ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 >> 172.21.15.137:0/3100606422 conn(0x7ff5a408ec10 msgr2=0x7ff5a415e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:59.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 shutdown_connections 2024-04-26T22:03:59.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.853+0000 7ff5abc85640 1 -- 172.21.15.137:0/3100606422 wait complete. 2024-04-26T22:03:59.864 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:03:59.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.959+0000 7f75f647e640 1 Processor -- start 2024-04-26T22:03:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.959+0000 7f75f647e640 1 -- start start 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.960+0000 7f75f647e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f75f015f750 0x7f75f00b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.960+0000 7f75f647e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f00d51a0 0x7f75f00d5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.960+0000 7f75f647e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f00d2440 con 0x7f75f00d3320 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.960+0000 7f75f647e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f75f00d0030 con 0x7f75f015f750 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.960+0000 7f75f647e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f75f00d2720 con 0x7f75f00d51a0 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.960+0000 7f75ef7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f75f00d3320 0x7f75f00d3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55952/0 (socket says 172.21.15.137:55952) 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.960+0000 7f75ef7fe640 1 -- 172.21.15.137:0/1164475605 learned_addr learned my addr 172.21.15.137:0/1164475605 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.961+0000 7f75f4a1b640 1 --2- 172.21.15.137:0/1164475605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f00d51a0 0x7f75f00d5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.961+0000 7f75effff640 1 --2- 172.21.15.137:0/1164475605 >> v2:172.21.15.170:3300/0 conn(0x7f75f015f750 0x7f75f00b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.961+0000 7f75eeffd640 1 -- 172.21.15.137:0/1164475605 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 138221145 0 0) 0x7f75f00d2440 con 0x7f75f00d3320 2024-04-26T22:03:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.961+0000 7f75eeffd640 1 -- 172.21.15.137:0/1164475605 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75d8003520 con 0x7f75f00d3320 2024-04-26T22:03:59.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.961+0000 7f75f4a1b640 1 -- 172.21.15.137:0/1164475605 >> v2:172.21.15.170:3300/0 conn(0x7f75f015f750 msgr2=0x7f75f00b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:03:59.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.961+0000 7f75f4a1b640 1 --2- 172.21.15.137:0/1164475605 >> v2:172.21.15.170:3300/0 conn(0x7f75f015f750 0x7f75f00b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.961+0000 7f75f4a1b640 1 -- 172.21.15.137:0/1164475605 >> v1:172.21.15.137:6789/0 conn(0x7f75f00d3320 legacy=0x7f75f00d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.961+0000 7f75f4a1b640 1 -- 172.21.15.137:0/1164475605 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f00d2a00 con 0x7f75f00d51a0 2024-04-26T22:03:59.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75f4a1b640 1 --2- 172.21.15.137:0/1164475605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f00d51a0 0x7f75f00d5650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009d90 tx=0x7f75e802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a67c80c1d9c946 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:59.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75eeffd640 1 -- 172.21.15.137:0/1164475605 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8007740 con 0x7f75f00d51a0 2024-04-26T22:03:59.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75eeffd640 1 -- 172.21.15.137:0/1164475605 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e80078e0 con 0x7f75f00d51a0 2024-04-26T22:03:59.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75eeffd640 1 -- 172.21.15.137:0/1164475605 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8007c90 con 0x7f75f00d51a0 2024-04-26T22:03:59.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75f647e640 1 -- 172.21.15.137:0/1164475605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f00d51a0 msgr2=0x7f75f00d5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75f647e640 1 --2- 172.21.15.137:0/1164475605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f00d51a0 0x7f75f00d5650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009d90 tx=0x7f75e802a660 comp rx=0 tx=0).stop 2024-04-26T22:03:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75f647e640 1 -- 172.21.15.137:0/1164475605 shutdown_connections 2024-04-26T22:03:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75f647e640 1 --2- 172.21.15.137:0/1164475605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f00d51a0 0x7f75f00d5650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75f647e640 1 --2- 172.21.15.137:0/1164475605 >> v2:172.21.15.170:3300/0 conn(0x7f75f015f750 0x7f75f00b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75f647e640 1 -- 172.21.15.137:0/1164475605 >> 172.21.15.137:0/1164475605 conn(0x7f75f008ec20 msgr2=0x7f75f009e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:03:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75f647e640 1 -- 172.21.15.137:0/1164475605 shutdown_connections 2024-04-26T22:03:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.962+0000 7f75f647e640 1 -- 172.21.15.137:0/1164475605 wait complete. 2024-04-26T22:03:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.963+0000 7f75f647e640 1 Processor -- start 2024-04-26T22:03:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75f647e640 1 -- start start 2024-04-26T22:03:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75f647e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75f00d3320 0x7f75f014c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75f647e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f00d51a0 0x7f75f00cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75f647e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f015f750 0x7f75f00cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75f647e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f75f00d0890 con 0x7f75f00d51a0 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75f647e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f75f00d0710 con 0x7f75f00d3320 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75f647e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f75f00d0a10 con 0x7f75f015f750 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75ef7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f00d51a0 0x7f75f00cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75ef7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f00d51a0 0x7f75f00cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53866/0 (socket says 172.21.15.137:53866) 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.964+0000 7f75ef7fe640 1 -- 172.21.15.137:0/4108374524 learned_addr learned my addr 172.21.15.137:0/4108374524 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75f4a1b640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f015f750 0x7f75f00cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75effff640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75f00d3320 0x7f75f014c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75ef7fe640 1 -- 172.21.15.137:0/4108374524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f015f750 msgr2=0x7f75f00cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75ef7fe640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f015f750 0x7f75f00cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75ef7fe640 1 -- 172.21.15.137:0/4108374524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75f00d3320 msgr2=0x7f75f014c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:03:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75ef7fe640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75f00d3320 0x7f75f014c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75ef7fe640 1 -- 172.21.15.137:0/4108374524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f015b3f0 con 0x7f75f00d51a0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75ef7fe640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f00d51a0 0x7f75f00cc2e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f75e400c400 tx=0x7f75e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75ecff9640 1 -- 172.21.15.137:0/4108374524 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4017070 con 0x7f75f00d51a0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75ecff9640 1 -- 172.21.15.137:0/4108374524 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e4005d00 con 0x7f75f00d51a0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75ecff9640 1 -- 172.21.15.137:0/4108374524 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4007310 con 0x7f75f00d51a0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f015b6d0 con 0x7f75f00d51a0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.965+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f015bc90 con 0x7f75f00d51a0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.966+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f00693d0 con 0x7f75f00d51a0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.966+0000 7f75ecff9640 1 -- 172.21.15.137:0/4108374524 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75e401a070 con 0x7f75f00d51a0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.967+0000 7f75ecff9640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f75dc06c8f0 0x7f75dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.967+0000 7f75ecff9640 1 -- 172.21.15.137:0/4108374524 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f75e408b010 con 0x7f75f00d51a0 2024-04-26T22:03:59.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.967+0000 7f75effff640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f75dc06c8f0 0x7f75dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:03:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.967+0000 7f75effff640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f75dc06c8f0 0x7f75dc06edb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009a30 tx=0x7f75e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:03:59.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:03:59.971+0000 7f75ecff9640 1 -- 172.21.15.137:0/4108374524 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f75e4059420 con 0x7f75f00d51a0 2024-04-26T22:04:00.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.144+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75f00d60c0 con 0x7f75f00d51a0 2024-04-26T22:04:00.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.146+0000 7f75ecff9640 1 -- 172.21.15.137:0/4108374524 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16956 (secure 0 0 0) 0x7f75e4058d20 con 0x7f75f00d51a0 2024-04-26T22:04:00.146 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:00.146 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":75,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:03:23.459267+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:02:34.722395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T22:02:35.462679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.10","mappings":[{"from":6,"to":1}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/1566574554":"2024-04-27T22:02:45.720691+0000","172.21.15.137:6835/1566574554":"2024-04-27T22:02:45.720691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:00.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f75dc06c8f0 msgr2=0x7f75dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f75dc06c8f0 0x7f75dc06edb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009a30 tx=0x7f75e0008040 comp rx=0 tx=0).stop 2024-04-26T22:04:00.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f00d51a0 msgr2=0x7f75f00cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f00d51a0 0x7f75f00cc2e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f75e400c400 tx=0x7f75e400c8c0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 shutdown_connections 2024-04-26T22:04:00.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f75dc06c8f0 0x7f75dc06edb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f75f00d51a0 0x7f75f00cc2e0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75f015f750 0x7f75f00cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 --2- 172.21.15.137:0/4108374524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75f00d3320 0x7f75f014c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 >> 172.21.15.137:0/4108374524 conn(0x7f75f008ec20 msgr2=0x7f75f00b5530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 shutdown_connections 2024-04-26T22:04:00.149 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.148+0000 7f75f647e640 1 -- 172.21.15.137:0/4108374524 wait complete. 2024-04-26T22:04:00.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:02:34.722395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:02:35.462679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:04:00.160 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:04:00.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.261+0000 7f315c883640 1 Processor -- start 2024-04-26T22:04:00.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.261+0000 7f315c883640 1 -- start start 2024-04-26T22:04:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f315c883640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f315815d010 0x7f31580cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f315c883640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31580b5930 0x7f31580d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f315c883640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f31580cdd40 0x7f31580ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f315c883640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f31580b4890 con 0x7f31580cdd40 2024-04-26T22:04:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f315c883640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f31580b4b70 con 0x7f315815d010 2024-04-26T22:04:00.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f315c883640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f31580b4e50 con 0x7f31580b5930 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f3156d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f31580cdd40 0x7f31580ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f3156d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f31580cdd40 0x7f31580ce1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53868/0 (socket says 172.21.15.137:53868) 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f3156d9d640 1 -- 172.21.15.137:0/478710415 learned_addr learned my addr 172.21.15.137:0/478710415 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f3156d9d640 1 -- 172.21.15.137:0/478710415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31580b5930 msgr2=0x7f31580d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f3156d9d640 1 --2- 172.21.15.137:0/478710415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31580b5930 0x7f31580d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f3156d9d640 1 -- 172.21.15.137:0/478710415 >> v2:172.21.15.170:3300/0 conn(0x7f315815d010 msgr2=0x7f31580cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f3156d9d640 1 --2- 172.21.15.137:0/478710415 >> v2:172.21.15.170:3300/0 conn(0x7f315815d010 0x7f31580cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.262+0000 7f3156d9d640 1 -- 172.21.15.137:0/478710415 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31580b5130 con 0x7f31580cdd40 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f3156d9d640 1 --2- 172.21.15.137:0/478710415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580cdd40 0x7f31580ce1d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f3158068990 tx=0x7f315002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f74afecedd9aed server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f3155d9b640 1 -- 172.21.15.137:0/478710415 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150036070 con 0x7f31580cdd40 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f3155d9b640 1 -- 172.21.15.137:0/478710415 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3150031600 con 0x7f31580cdd40 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f3155d9b640 1 -- 172.21.15.137:0/478710415 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31500319d0 con 0x7f31580cdd40 2024-04-26T22:04:00.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f315c883640 1 -- 172.21.15.137:0/478710415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580cdd40 msgr2=0x7f31580ce1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f315c883640 1 --2- 172.21.15.137:0/478710415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580cdd40 0x7f31580ce1d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f3158068990 tx=0x7f315002a6a0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f315c883640 1 -- 172.21.15.137:0/478710415 shutdown_connections 2024-04-26T22:04:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f315c883640 1 --2- 172.21.15.137:0/478710415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580cdd40 0x7f31580ce1d0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f315c883640 1 --2- 172.21.15.137:0/478710415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f31580b5930 0x7f31580d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f315c883640 1 --2- 172.21.15.137:0/478710415 >> v2:172.21.15.170:3300/0 conn(0x7f315815d010 0x7f31580cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.263+0000 7f315c883640 1 -- 172.21.15.137:0/478710415 >> 172.21.15.137:0/478710415 conn(0x7f31580d1660 msgr2=0x7f31580d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.264+0000 7f315c883640 1 -- 172.21.15.137:0/478710415 shutdown_connections 2024-04-26T22:04:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.264+0000 7f315c883640 1 -- 172.21.15.137:0/478710415 wait complete. 2024-04-26T22:04:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.265+0000 7f315c883640 1 Processor -- start 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.265+0000 7f315c883640 1 -- start start 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.265+0000 7f315c883640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580b5930 0x7f315813ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.265+0000 7f315c883640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31580cdd40 0x7f3158157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315c883640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315815d010 0x7f3158157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315c883640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3158160c10 con 0x7f31580b5930 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315c883640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f315815d3f0 con 0x7f31580cdd40 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315c883640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3158160d90 con 0x7f315815d010 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580b5930 0x7f315813ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580b5930 0x7f315813ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53882/0 (socket says 172.21.15.137:53882) 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315659c640 1 -- 172.21.15.137:0/3834801406 learned_addr learned my addr 172.21.15.137:0/3834801406 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f3156d9d640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315815d010 0x7f3158157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f314ffff640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31580cdd40 0x7f3158157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315659c640 1 -- 172.21.15.137:0/3834801406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315815d010 msgr2=0x7f3158157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315659c640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315815d010 0x7f3158157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315659c640 1 -- 172.21.15.137:0/3834801406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31580cdd40 msgr2=0x7f3158157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315659c640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31580cdd40 0x7f3158157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315659c640 1 -- 172.21.15.137:0/3834801406 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3158140480 con 0x7f31580b5930 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f314ffff640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31580cdd40 0x7f3158157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315659c640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580b5930 0x7f315813ff40 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f314800b410 tx=0x7f314800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f314effd640 1 -- 172.21.15.137:0/3834801406 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148015020 con 0x7f31580b5930 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f314effd640 1 -- 172.21.15.137:0/3834801406 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3148011850 con 0x7f31580b5930 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f314effd640 1 -- 172.21.15.137:0/3834801406 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148011c40 con 0x7f31580b5930 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31581f6d50 con 0x7f31580b5930 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.266+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31581f7310 con 0x7f31580b5930 2024-04-26T22:04:00.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.267+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315806a290 con 0x7f31580b5930 2024-04-26T22:04:00.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.268+0000 7f314effd640 1 -- 172.21.15.137:0/3834801406 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3148018020 con 0x7f31580b5930 2024-04-26T22:04:00.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.268+0000 7f314effd640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f313806c8f0 0x7f313806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.268+0000 7f314effd640 1 -- 172.21.15.137:0/3834801406 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f314808baf0 con 0x7f31580b5930 2024-04-26T22:04:00.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.268+0000 7f314ffff640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f313806c8f0 0x7f313806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.268+0000 7f314ffff640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f313806c8f0 0x7f313806edb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3140006fd0 tx=0x7f3140008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:00.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.272+0000 7f314effd640 1 -- 172.21.15.137:0/3834801406 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f314801f020 con 0x7f31580b5930 2024-04-26T22:04:00.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.445+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f31580682b0 con 0x7f31580b5930 2024-04-26T22:04:00.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.445+0000 7f314effd640 1 -- 172.21.15.137:0/3834801406 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f31480172c0 con 0x7f31580b5930 2024-04-26T22:04:00.445 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:04:00.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f313806c8f0 msgr2=0x7f313806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f313806c8f0 0x7f313806edb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3140006fd0 tx=0x7f3140008040 comp rx=0 tx=0).stop 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580b5930 msgr2=0x7f315813ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580b5930 0x7f315813ff40 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f314800b410 tx=0x7f314800b8d0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 shutdown_connections 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f313806c8f0 0x7f313806edb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f315815d010 0x7f3158157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31580cdd40 0x7f3158157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 --2- 172.21.15.137:0/3834801406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f31580b5930 0x7f315813ff40 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 >> 172.21.15.137:0/3834801406 conn(0x7f31580d1660 msgr2=0x7f31580b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 shutdown_connections 2024-04-26T22:04:00.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.447+0000 7f315c883640 1 -- 172.21.15.137:0/3834801406 wait complete. 2024-04-26T22:04:00.458 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:04:00.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.558+0000 7f605421d640 1 Processor -- start 2024-04-26T22:04:00.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.559+0000 7f605421d640 1 -- start start 2024-04-26T22:04:00.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.559+0000 7f605421d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f604c0b4eb0 0x7f604c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.559+0000 7f605421d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c0ceff0 0x7f604c0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.559+0000 7f605421d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f604c15dca0 con 0x7f604c143840 2024-04-26T22:04:00.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.559+0000 7f605421d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f604c143c20 con 0x7f604c0b4eb0 2024-04-26T22:04:00.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.559+0000 7f605421d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f604c15df80 con 0x7f604c0ceff0 2024-04-26T22:04:00.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.559+0000 7f6051fb9640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f604c143840 0x7f604c0b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55960/0 (socket says 172.21.15.137:55960) 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6051fb9640 1 -- 172.21.15.137:0/1357883189 learned_addr learned my addr 172.21.15.137:0/1357883189 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f60527ba640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c0ceff0 0x7f604c0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f60517b8640 1 --2- 172.21.15.137:0/1357883189 >> v2:172.21.15.170:3300/0 conn(0x7f604c0b4eb0 0x7f604c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405941507 0 0) 0x7f604c15dca0 con 0x7f604c143840 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6038003520 con 0x7f604c143840 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3364849210 0 0) 0x7f6038003520 con 0x7f604c143840 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c0ceff0 msgr2=0x7f604c0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c0ceff0 0x7f604c0cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 >> v2:172.21.15.170:3300/0 conn(0x7f604c0b4eb0 msgr2=0x7f604c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 --2- 172.21.15.137:0/1357883189 >> v2:172.21.15.170:3300/0 conn(0x7f604c0b4eb0 0x7f604c0b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c15e260 con 0x7f604c143840 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6044001670 con 0x7f604c143840 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 >> v1:172.21.15.137:6789/0 conn(0x7f604c143840 legacy=0x7f604c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f6038003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6038004800 0x7f6038004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c0ceff0 0x7f60380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f604c143c20 con 0x7f60380039b0 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f604c15df80 con 0x7f6038004800 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f603800b9c0 con 0x7f604c0ceff0 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6051fb9640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f6038003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f60517b8640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6038004800 0x7f6038004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f60527ba640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c0ceff0 0x7f60380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6051fb9640 1 -- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c0ceff0 msgr2=0x7f60380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6051fb9640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c0ceff0 0x7f60380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6051fb9640 1 -- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6038004800 msgr2=0x7f6038004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6051fb9640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6038004800 0x7f6038004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f6051fb9640 1 -- 172.21.15.137:0/1357883189 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6038003520 con 0x7f60380039b0 2024-04-26T22:04:00.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f60517b8640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6038004800 0x7f6038004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.560+0000 7f60527ba640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c0ceff0 0x7f60380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.561+0000 7f6051fb9640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f6038003dd0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f604400c210 tx=0x7f6038005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbf3cb0b557e765 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.561+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044007d50 con 0x7f60380039b0 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.561+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6044005ad0 con 0x7f60380039b0 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.561+0000 7f6050fb7640 1 -- 172.21.15.137:0/1357883189 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044007070 con 0x7f60380039b0 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.562+0000 7f605421d640 1 -- 172.21.15.137:0/1357883189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 msgr2=0x7f6038003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.562+0000 7f605421d640 1 --2- 172.21.15.137:0/1357883189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f6038003dd0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f604400c210 tx=0x7f6038005830 comp rx=0 tx=0).stop 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.562+0000 7f60527ba640 1 -- 172.21.15.137:0/1357883189 reap_dead start 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.562+0000 7f605421d640 1 -- 172.21.15.137:0/1357883189 shutdown_connections 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.562+0000 7f605421d640 1 -- 172.21.15.137:0/1357883189 >> 172.21.15.137:0/1357883189 conn(0x7f604c0cd8a0 msgr2=0x7f604c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.562+0000 7f605421d640 1 -- 172.21.15.137:0/1357883189 shutdown_connections 2024-04-26T22:04:00.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.562+0000 7f605421d640 1 -- 172.21.15.137:0/1357883189 wait complete. 2024-04-26T22:04:00.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.563+0000 7f605421d640 1 Processor -- start 2024-04-26T22:04:00.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.563+0000 7f605421d640 1 -- start start 2024-04-26T22:04:00.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f605421d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f604c143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f605421d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c15d240 0x7f604c15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f605421d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f604c06f1d0 0x7f604c06f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f605421d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f604c15d8c0 con 0x7f60380039b0 2024-04-26T22:04:00.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f605421d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f604c0b46f0 con 0x7f604c06f1d0 2024-04-26T22:04:00.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f605421d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f604c15da40 con 0x7f604c15d240 2024-04-26T22:04:00.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f6051fb9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f604c143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f6051fb9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f604c143da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53886/0 (socket says 172.21.15.137:53886) 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f6051fb9640 1 -- 172.21.15.137:0/4281936945 learned_addr learned my addr 172.21.15.137:0/4281936945 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f60527ba640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f604c06f1d0 0x7f604c06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f60517b8640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c15d240 0x7f604c15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f6051fb9640 1 -- 172.21.15.137:0/4281936945 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c15d240 msgr2=0x7f604c15ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f6051fb9640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c15d240 0x7f604c15ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f6051fb9640 1 -- 172.21.15.137:0/4281936945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f604c06f1d0 msgr2=0x7f604c06f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f6051fb9640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f604c06f1d0 0x7f604c06f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f6051fb9640 1 -- 172.21.15.137:0/4281936945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c15d6c0 con 0x7f60380039b0 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f60527ba640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f604c06f1d0 0x7f604c06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f6051fb9640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f604c143da0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f604400c330 tx=0x7f6044001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f60427fc640 1 -- 172.21.15.137:0/4281936945 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044042070 con 0x7f60380039b0 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f60427fc640 1 -- 172.21.15.137:0/4281936945 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6044007480 con 0x7f60380039b0 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604c144430 con 0x7f60380039b0 2024-04-26T22:04:00.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.564+0000 7f60427fc640 1 -- 172.21.15.137:0/4281936945 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6044001c90 con 0x7f60380039b0 2024-04-26T22:04:00.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.565+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f604c1449f0 con 0x7f60380039b0 2024-04-26T22:04:00.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.565+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f604c06a290 con 0x7f60380039b0 2024-04-26T22:04:00.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.566+0000 7f60427fc640 1 -- 172.21.15.137:0/4281936945 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6044045070 con 0x7f60380039b0 2024-04-26T22:04:00.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.566+0000 7f60427fc640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f603006c8f0 0x7f603006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.566+0000 7f60427fc640 1 -- 172.21.15.137:0/4281936945 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f60440acab0 con 0x7f60380039b0 2024-04-26T22:04:00.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.566+0000 7f60517b8640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f603006c8f0 0x7f603006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.567+0000 7f60517b8640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f603006c8f0 0x7f603006edb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f604c142960 tx=0x7f603c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:00.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.571+0000 7f60427fc640 1 -- 172.21.15.137:0/4281936945 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f604404c020 con 0x7f60380039b0 2024-04-26T22:04:00.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.745+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f604c0ce420 con 0x7f60380039b0 2024-04-26T22:04:00.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.745+0000 7f60427fc640 1 -- 172.21.15.137:0/4281936945 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7f604c15d6c0 con 0x7f60380039b0 2024-04-26T22:04:00.745 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:04:00.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f603006c8f0 msgr2=0x7f603006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f603006c8f0 0x7f603006edb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f604c142960 tx=0x7f603c008040 comp rx=0 tx=0).stop 2024-04-26T22:04:00.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 msgr2=0x7f604c143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f604c143da0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f604400c330 tx=0x7f6044001a40 comp rx=0 tx=0).stop 2024-04-26T22:04:00.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 shutdown_connections 2024-04-26T22:04:00.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f603006c8f0 0x7f603006edb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f604c06f1d0 0x7f604c06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f604c15d240 0x7f604c15ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 --2- 172.21.15.137:0/4281936945 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380039b0 0x7f604c143da0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 >> 172.21.15.137:0/4281936945 conn(0x7f604c0cd8a0 msgr2=0x7f604c1414f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:00.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 shutdown_connections 2024-04-26T22:04:00.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.747+0000 7f605421d640 1 -- 172.21.15.137:0/4281936945 wait complete. 2024-04-26T22:04:00.758 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:04:00.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.857+0000 7f7ccda45640 1 Processor -- start 2024-04-26T22:04:00.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.858+0000 7f7ccda45640 1 -- start start 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.858+0000 7f7ccda45640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7cc815d520 0x7f7cc8161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.858+0000 7f7ccda45640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7cc80cfd40 0x7f7cc8073090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.858+0000 7f7ccda45640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc8070b00 con 0x7f7cc80735d0 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.858+0000 7f7ccda45640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc8161dd0 con 0x7f7cc815d520 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.858+0000 7f7ccda45640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc8073a20 con 0x7f7cc80cfd40 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.858+0000 7f7cc6ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7cc815d520 0x7f7cc8161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.858+0000 7f7cc77fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7cc80735d0 0x7f7cc806f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55964/0 (socket says 172.21.15.137:55964) 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.858+0000 7f7cc77fe640 1 -- 172.21.15.137:0/1571040016 learned_addr learned my addr 172.21.15.137:0/1571040016 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.859+0000 7f7cbffff640 1 --2- 172.21.15.137:0/1571040016 >> v2:172.21.15.170:3300/0 conn(0x7f7cc80cfd40 0x7f7cc8073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.859+0000 7f7cc6ffd640 1 -- 172.21.15.137:0/1571040016 >> v2:172.21.15.170:3300/0 conn(0x7f7cc80cfd40 msgr2=0x7f7cc8073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:00.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.859+0000 7f7cc6ffd640 1 --2- 172.21.15.137:0/1571040016 >> v2:172.21.15.170:3300/0 conn(0x7f7cc80cfd40 0x7f7cc8073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.859+0000 7f7cc6ffd640 1 -- 172.21.15.137:0/1571040016 >> v1:172.21.15.137:6789/0 conn(0x7f7cc80735d0 legacy=0x7f7cc806f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.859+0000 7f7cc6ffd640 1 -- 172.21.15.137:0/1571040016 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc8070de0 con 0x7f7cc815d520 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.859+0000 7f7cc6ffd640 1 --2- 172.21.15.137:0/1571040016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc815d520 0x7f7cc8161890 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80ce7a0 tx=0x7f7cb802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6b40c91928358d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7cc67fc640 1 -- 172.21.15.137:0/1571040016 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8037070 con 0x7f7cc815d520 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7cc67fc640 1 -- 172.21.15.137:0/1571040016 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb8032440 con 0x7f7cc815d520 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7cc67fc640 1 -- 172.21.15.137:0/1571040016 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb802ae60 con 0x7f7cc815d520 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7ccda45640 1 -- 172.21.15.137:0/1571040016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc815d520 msgr2=0x7f7cc8161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7ccda45640 1 --2- 172.21.15.137:0/1571040016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc815d520 0x7f7cc8161890 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80ce7a0 tx=0x7f7cb802a110 comp rx=0 tx=0).stop 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7ccda45640 1 -- 172.21.15.137:0/1571040016 shutdown_connections 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7ccda45640 1 --2- 172.21.15.137:0/1571040016 >> v2:172.21.15.170:3300/0 conn(0x7f7cc80cfd40 0x7f7cc8073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7ccda45640 1 --2- 172.21.15.137:0/1571040016 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc815d520 0x7f7cc8161890 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7ccda45640 1 -- 172.21.15.137:0/1571040016 >> 172.21.15.137:0/1571040016 conn(0x7f7cc80d1e40 msgr2=0x7f7cc80d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7ccda45640 1 -- 172.21.15.137:0/1571040016 shutdown_connections 2024-04-26T22:04:00.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.860+0000 7f7ccda45640 1 -- 172.21.15.137:0/1571040016 wait complete. 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.861+0000 7f7ccda45640 1 Processor -- start 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7ccda45640 1 -- start start 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7ccda45640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7cc80735d0 0x7f7cc80b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7ccda45640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc80cfd40 0x7f7cc80b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7ccda45640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc8155530 0x7f7cc80b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7ccda45640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc8070790 con 0x7f7cc8155530 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7ccda45640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc806da10 con 0x7f7cc80cfd40 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7ccda45640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc80d18a0 con 0x7f7cc80735d0 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7cc77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc8155530 0x7f7cc80b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7cc77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc8155530 0x7f7cc80b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53892/0 (socket says 172.21.15.137:53892) 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7cc77fe640 1 -- 172.21.15.137:0/1536234293 learned_addr learned my addr 172.21.15.137:0/1536234293 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:00.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7cbffff640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc80cfd40 0x7f7cc80b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.862+0000 7f7cc6ffd640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7cc80735d0 0x7f7cc80b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7cc77fe640 1 -- 172.21.15.137:0/1536234293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7cc80735d0 msgr2=0x7f7cc80b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7cc77fe640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7cc80735d0 0x7f7cc80b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7cc77fe640 1 -- 172.21.15.137:0/1536234293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc80cfd40 msgr2=0x7f7cc80b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7cc77fe640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc80cfd40 0x7f7cc80b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7cc77fe640 1 -- 172.21.15.137:0/1536234293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc80b3000 con 0x7f7cc8155530 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7cc77fe640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc8155530 0x7f7cc80b36d0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000ca80 tx=0x7f7cc000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7cc4ff9640 1 -- 172.21.15.137:0/1536234293 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0017070 con 0x7f7cc8155530 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7cc4ff9640 1 -- 172.21.15.137:0/1536234293 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc000ac30 con 0x7f7cc8155530 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7cc4ff9640 1 -- 172.21.15.137:0/1536234293 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0012600 con 0x7f7cc8155530 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc80b4fd0 con 0x7f7cc8155530 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.863+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc80b5590 con 0x7f7cc8155530 2024-04-26T22:04:00.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.864+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc80693d0 con 0x7f7cc8155530 2024-04-26T22:04:00.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.864+0000 7f7cc4ff9640 1 -- 172.21.15.137:0/1536234293 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7cc001a070 con 0x7f7cc8155530 2024-04-26T22:04:00.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.865+0000 7f7cc4ff9640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ca806c8f0 0x7f7ca806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:00.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.865+0000 7f7cc4ff9640 1 -- 172.21.15.137:0/1536234293 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f7cc008b790 con 0x7f7cc8155530 2024-04-26T22:04:00.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.865+0000 7f7cc6ffd640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ca806c8f0 0x7f7ca806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:00.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.865+0000 7f7cc6ffd640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ca806c8f0 0x7f7ca806edb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8034000 tx=0x7f7cb802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:00.869 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:00.869+0000 7f7cc4ff9640 1 -- 172.21.15.137:0/1536234293 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7cc000ae20 con 0x7f7cc8155530 2024-04-26T22:04:01.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.043+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7cc80b7dc0 con 0x7f7cc8155530 2024-04-26T22:04:01.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.044+0000 7f7cc4ff9640 1 -- 172.21.15.137:0/1536234293 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f7cc0059550 con 0x7f7cc8155530 2024-04-26T22:04:01.044 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.045+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ca806c8f0 msgr2=0x7f7ca806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.045+0000 7f7ccda45640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ca806c8f0 0x7f7ca806edb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8034000 tx=0x7f7cb802e000 comp rx=0 tx=0).stop 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.045+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc8155530 msgr2=0x7f7cc80b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.045+0000 7f7ccda45640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc8155530 0x7f7cc80b36d0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000ca80 tx=0x7f7cc000cf40 comp rx=0 tx=0).stop 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.045+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 shutdown_connections 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.046+0000 7f7ccda45640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ca806c8f0 0x7f7ca806edb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.046+0000 7f7ccda45640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7cc8155530 0x7f7cc80b36d0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.046+0000 7f7ccda45640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc80cfd40 0x7f7cc80b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.046+0000 7f7ccda45640 1 --2- 172.21.15.137:0/1536234293 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7cc80735d0 0x7f7cc80b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.046+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 >> 172.21.15.137:0/1536234293 conn(0x7f7cc80d1e40 msgr2=0x7f7cc815ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:01.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.046+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 shutdown_connections 2024-04-26T22:04:01.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.046+0000 7f7ccda45640 1 -- 172.21.15.137:0/1536234293 wait complete. 2024-04-26T22:04:01.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:01.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.152+0000 7fa4cacf8640 1 Processor -- start 2024-04-26T22:04:01.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.152+0000 7fa4cacf8640 1 -- start start 2024-04-26T22:04:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4cacf8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa4c415b4e0 0x7fa4c4071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4cacf8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c415b8c0 0x7fa4c40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4cacf8640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c40733e0 con 0x7fa4c4073820 2024-04-26T22:04:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4cacf8640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa4c40ce230 con 0x7fa4c415b4e0 2024-04-26T22:04:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4cacf8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c4072f00 con 0x7fa4c415b8c0 2024-04-26T22:04:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4c8a94640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa4c415b4e0 0x7fa4c4071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4c8a94640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa4c415b4e0 0x7fa4c4071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53906/0 (socket says 172.21.15.137:53906) 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4c8a94640 1 -- 172.21.15.137:0/628851368 learned_addr learned my addr 172.21.15.137:0/628851368 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4c3fff640 1 --2- 172.21.15.137:0/628851368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c415b8c0 0x7fa4c40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4c8a94640 1 -- 172.21.15.137:0/628851368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c415b8c0 msgr2=0x7fa4c40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4c8a94640 1 --2- 172.21.15.137:0/628851368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c415b8c0 0x7fa4c40cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4c8a94640 1 -- 172.21.15.137:0/628851368 >> v1:172.21.15.170:6789/0 conn(0x7fa4c4073820 legacy=0x7fa4c406ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4c8a94640 1 -- 172.21.15.137:0/628851368 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c4072660 con 0x7fa4c415b4e0 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.153+0000 7fa4c3fff640 1 --2- 172.21.15.137:0/628851368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c415b8c0 0x7fa4c40cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.154+0000 7fa4c8a94640 1 --2- 172.21.15.137:0/628851368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b4e0 0x7fa4c4071fd0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbacd1f5af72a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.154+0000 7fa4c37fe640 1 -- 172.21.15.137:0/628851368 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8037070 con 0x7fa4c415b4e0 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.154+0000 7fa4c37fe640 1 -- 172.21.15.137:0/628851368 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b8032440 con 0x7fa4c415b4e0 2024-04-26T22:04:01.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.154+0000 7fa4c37fe640 1 -- 172.21.15.137:0/628851368 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8032810 con 0x7fa4c415b4e0 2024-04-26T22:04:01.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.155+0000 7fa4cacf8640 1 -- 172.21.15.137:0/628851368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b4e0 msgr2=0x7fa4c4071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.155+0000 7fa4cacf8640 1 --2- 172.21.15.137:0/628851368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b4e0 0x7fa4c4071fd0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b802a210 comp rx=0 tx=0).stop 2024-04-26T22:04:01.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.155+0000 7fa4cacf8640 1 -- 172.21.15.137:0/628851368 shutdown_connections 2024-04-26T22:04:01.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.155+0000 7fa4cacf8640 1 --2- 172.21.15.137:0/628851368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c415b8c0 0x7fa4c40cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.155+0000 7fa4cacf8640 1 --2- 172.21.15.137:0/628851368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b4e0 0x7fa4c4071fd0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.155+0000 7fa4cacf8640 1 -- 172.21.15.137:0/628851368 >> 172.21.15.137:0/628851368 conn(0x7fa4c40d0d30 msgr2=0x7fa4c40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:01.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.155+0000 7fa4cacf8640 1 -- 172.21.15.137:0/628851368 shutdown_connections 2024-04-26T22:04:01.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.155+0000 7fa4cacf8640 1 -- 172.21.15.137:0/628851368 wait complete. 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.156+0000 7fa4cacf8640 1 Processor -- start 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.156+0000 7fa4cacf8640 1 -- start start 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4cacf8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c4073820 0x7fa4c4145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4cacf8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4c415b4e0 0x7fa4c40ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4cacf8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b8c0 0x7fa4c41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4cacf8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c40b3e80 con 0x7fa4c415b8c0 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4cacf8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4072c20 con 0x7fa4c415b4e0 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4cacf8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c406f2c0 con 0x7fa4c4073820 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c9295640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b8c0 0x7fa4c41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c9295640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b8c0 0x7fa4c41563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53916/0 (socket says 172.21.15.137:53916) 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c9295640 1 -- 172.21.15.137:0/4027863221 learned_addr learned my addr 172.21.15.137:0/4027863221 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c3fff640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4c415b4e0 0x7fa4c40ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c8a94640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c4073820 0x7fa4c4145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c9295640 1 -- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c4073820 msgr2=0x7fa4c4145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c9295640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c4073820 0x7fa4c4145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c9295640 1 -- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4c415b4e0 msgr2=0x7fa4c40ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c9295640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4c415b4e0 0x7fa4c40ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c9295640 1 -- 172.21.15.137:0/4027863221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c414ccd0 con 0x7fa4c415b8c0 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c8a94640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c4073820 0x7fa4c4145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c3fff640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4c415b4e0 0x7fa4c40ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.157+0000 7fa4c9295640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b8c0 0x7fa4c41563e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c780 tx=0x7fa4bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.158+0000 7fa4c17fa640 1 -- 172.21.15.137:0/4027863221 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc004b60 con 0x7fa4c415b8c0 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.158+0000 7fa4c17fa640 1 -- 172.21.15.137:0/4027863221 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4bc004d00 con 0x7fa4c415b8c0 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.158+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c414f610 con 0x7fa4c415b8c0 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.158+0000 7fa4c17fa640 1 -- 172.21.15.137:0/4027863221 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00aa90 con 0x7fa4c415b8c0 2024-04-26T22:04:01.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.158+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c414fbd0 con 0x7fa4c415b8c0 2024-04-26T22:04:01.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.159+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c406a290 con 0x7fa4c415b8c0 2024-04-26T22:04:01.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.159+0000 7fa4c17fa640 1 -- 172.21.15.137:0/4027863221 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4bc00ac30 con 0x7fa4c415b8c0 2024-04-26T22:04:01.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.159+0000 7fa4c17fa640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4a806c8f0 0x7fa4a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.160+0000 7fa4c17fa640 1 -- 172.21.15.137:0/4027863221 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7fa4bc08be80 con 0x7fa4c415b8c0 2024-04-26T22:04:01.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.160+0000 7fa4c8a94640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4a806c8f0 0x7fa4a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.160+0000 7fa4c8a94640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4a806c8f0 0x7fa4a806edb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8034000 tx=0x7fa4b802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:01.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.164+0000 7fa4c17fa640 1 -- 172.21.15.137:0/4027863221 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa4bc020070 con 0x7fa4c415b8c0 2024-04-26T22:04:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.376+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4c414cea0 con 0x7fa4c415b8c0 2024-04-26T22:04:01.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.376+0000 7fa4c17fa640 1 -- 172.21.15.137:0/4027863221 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5197 (secure 0 0 0) 0x7fa4bc05a290 con 0x7fa4c415b8c0 2024-04-26T22:04:01.376 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:01.376 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:03:28.395142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/2422385986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2422385986},{"type":"v1","addr":"172.21.15.137:6837","nonce":2422385986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6843,"qdb_cluster":[6843]},"id":5}]} 2024-04-26T22:04:01.377 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 41 2024-04-26T22:04:01.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4a806c8f0 msgr2=0x7fa4a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4a806c8f0 0x7fa4a806edb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8034000 tx=0x7fa4b802e000 comp rx=0 tx=0).stop 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b8c0 msgr2=0x7fa4c41563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b8c0 0x7fa4c41563e0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c780 tx=0x7fa4bc00cc40 comp rx=0 tx=0).stop 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 shutdown_connections 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa4a806c8f0 0x7fa4a806edb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4c415b8c0 0x7fa4c41563e0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4c415b4e0 0x7fa4c40ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 --2- 172.21.15.137:0/4027863221 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4c4073820 0x7fa4c4145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 >> 172.21.15.137:0/4027863221 conn(0x7fa4c40d0d30 msgr2=0x7fa4c40b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 shutdown_connections 2024-04-26T22:04:01.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.378+0000 7fa4cacf8640 1 -- 172.21.15.137:0/4027863221 wait complete. 2024-04-26T22:04:01.389 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:04:01.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.486+0000 7f4010262640 1 Processor -- start 2024-04-26T22:04:01.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.486+0000 7f4010262640 1 -- start start 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f4010262640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f400815b4e0 0x7f4008071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f4010262640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f400815b8c0 0x7f40080cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f4010262640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40080733e0 con 0x7f4008073820 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f4010262640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f40080ce230 con 0x7f400815b8c0 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f4010262640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4008072f00 con 0x7f400815b4e0 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f400d7fd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f400815b8c0 0x7f40080cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f400d7fd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f400815b8c0 0x7f40080cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53922/0 (socket says 172.21.15.137:53922) 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f400d7fd640 1 -- 172.21.15.137:0/2040814560 learned_addr learned my addr 172.21.15.137:0/2040814560 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f400d7fd640 1 -- 172.21.15.137:0/2040814560 >> v2:172.21.15.170:3300/0 conn(0x7f400815b4e0 msgr2=0x7f4008071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f400dffe640 1 --2- 172.21.15.137:0/2040814560 >> v2:172.21.15.170:3300/0 conn(0x7f400815b4e0 0x7f4008071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f400d7fd640 1 --2- 172.21.15.137:0/2040814560 >> v2:172.21.15.170:3300/0 conn(0x7f400815b4e0 0x7f4008071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f400d7fd640 1 -- 172.21.15.137:0/2040814560 >> v1:172.21.15.170:6789/0 conn(0x7f4008073820 legacy=0x7f400806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:01.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.487+0000 7f400d7fd640 1 -- 172.21.15.137:0/2040814560 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4008072660 con 0x7f400815b8c0 2024-04-26T22:04:01.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.488+0000 7f400d7fd640 1 --2- 172.21.15.137:0/2040814560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 0x7f40080cdcf0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009870 tx=0x7f3ff802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd54264fc9f1d91d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:01.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.488+0000 7f400cffc640 1 -- 172.21.15.137:0/2040814560 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8037070 con 0x7f400815b8c0 2024-04-26T22:04:01.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.488+0000 7f400cffc640 1 -- 172.21.15.137:0/2040814560 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff8032440 con 0x7f400815b8c0 2024-04-26T22:04:01.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.488+0000 7f400cffc640 1 -- 172.21.15.137:0/2040814560 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8032810 con 0x7f400815b8c0 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.489+0000 7f4010262640 1 -- 172.21.15.137:0/2040814560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 msgr2=0x7f40080cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.489+0000 7f4010262640 1 --2- 172.21.15.137:0/2040814560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 0x7f40080cdcf0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009870 tx=0x7f3ff802a270 comp rx=0 tx=0).stop 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.489+0000 7f4010262640 1 -- 172.21.15.137:0/2040814560 shutdown_connections 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.489+0000 7f4010262640 1 --2- 172.21.15.137:0/2040814560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 0x7f40080cdcf0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.489+0000 7f4010262640 1 --2- 172.21.15.137:0/2040814560 >> v2:172.21.15.170:3300/0 conn(0x7f400815b4e0 0x7f4008071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.489+0000 7f4010262640 1 -- 172.21.15.137:0/2040814560 >> 172.21.15.137:0/2040814560 conn(0x7f40080d0d30 msgr2=0x7f40080d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.489+0000 7f4010262640 1 -- 172.21.15.137:0/2040814560 shutdown_connections 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.489+0000 7f4010262640 1 -- 172.21.15.137:0/2040814560 wait complete. 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.490+0000 7f4010262640 1 Processor -- start 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.490+0000 7f4010262640 1 -- start start 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.490+0000 7f4010262640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4008073820 0x7f40080b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.490+0000 7f4010262640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f400815b4e0 0x7f40080cf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f4010262640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 0x7f4008158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f4010262640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f40080b3e80 con 0x7f400815b8c0 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f4010262640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4008072c20 con 0x7f400815b4e0 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f4010262640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f400806f2c0 con 0x7f4008073820 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f400e7ff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 0x7f4008158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f400e7ff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 0x7f4008158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53930/0 (socket says 172.21.15.137:53930) 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f400e7ff640 1 -- 172.21.15.137:0/1750274630 learned_addr learned my addr 172.21.15.137:0/1750274630 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f400e7ff640 1 -- 172.21.15.137:0/1750274630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4008073820 msgr2=0x7f40080b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f400e7ff640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4008073820 0x7f40080b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f400e7ff640 1 -- 172.21.15.137:0/1750274630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f400815b4e0 msgr2=0x7f40080cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f400e7ff640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f400815b4e0 0x7f40080cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f400e7ff640 1 -- 172.21.15.137:0/1750274630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40081f5d70 con 0x7f400815b8c0 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f400e7ff640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 0x7f4008158ad0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f400000c780 tx=0x7f400000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f3ffe7fc640 1 -- 172.21.15.137:0/1750274630 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4000017070 con 0x7f400815b8c0 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f3ffe7fc640 1 -- 172.21.15.137:0/1750274630 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4000003da0 con 0x7f400815b8c0 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f3ffe7fc640 1 -- 172.21.15.137:0/1750274630 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40000052b0 con 0x7f400815b8c0 2024-04-26T22:04:01.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40081f54d0 con 0x7f400815b8c0 2024-04-26T22:04:01.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.491+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40081f5a90 con 0x7f400815b8c0 2024-04-26T22:04:01.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.492+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f400806a290 con 0x7f400815b8c0 2024-04-26T22:04:01.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.493+0000 7f3ffe7fc640 1 -- 172.21.15.137:0/1750274630 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f400001a070 con 0x7f400815b8c0 2024-04-26T22:04:01.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.493+0000 7f3ffe7fc640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fec06c8f0 0x7f3fec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.493+0000 7f3ffe7fc640 1 -- 172.21.15.137:0/1750274630 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f400008b270 con 0x7f400815b8c0 2024-04-26T22:04:01.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.493+0000 7f400dffe640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fec06c8f0 0x7f3fec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.493+0000 7f400dffe640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fec06c8f0 0x7f3fec06edb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4004006fd0 tx=0x7f4004008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:01.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.497+0000 7f3ffe7fc640 1 -- 172.21.15.137:0/1750274630 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f40000595f0 con 0x7f400815b8c0 2024-04-26T22:04:01.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.675+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40080b5580 con 0x7f400815b8c0 2024-04-26T22:04:01.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.676+0000 7f3ffe7fc640 1 -- 172.21.15.137:0/1750274630 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16956 (secure 0 0 0) 0x7f4000058ef0 con 0x7f400815b8c0 2024-04-26T22:04:01.677 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:01.677 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":75,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:03:23.459267+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:02:34.722395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T22:02:35.462679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.10","mappings":[{"from":6,"to":1}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/1566574554":"2024-04-27T22:02:45.720691+0000","172.21.15.137:6835/1566574554":"2024-04-27T22:02:45.720691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:01.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fec06c8f0 msgr2=0x7f3fec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fec06c8f0 0x7f3fec06edb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4004006fd0 tx=0x7f4004008040 comp rx=0 tx=0).stop 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 msgr2=0x7f4008158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 0x7f4008158ad0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f400000c780 tx=0x7f400000cc40 comp rx=0 tx=0).stop 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 shutdown_connections 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3fec06c8f0 0x7f3fec06edb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f400815b8c0 0x7f4008158ad0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f400815b4e0 0x7f40080cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 --2- 172.21.15.137:0/1750274630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4008073820 0x7f40080b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.678+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 >> 172.21.15.137:0/1750274630 conn(0x7f40080d0d30 msgr2=0x7f4008149500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.679+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 shutdown_connections 2024-04-26T22:04:01.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.679+0000 7f4010262640 1 -- 172.21.15.137:0/1750274630 wait complete. 2024-04-26T22:04:01.689 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:04:01.690 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:01.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.786+0000 7f7447d96640 1 Processor -- start 2024-04-26T22:04:01.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.786+0000 7f7447d96640 1 -- start start 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.787+0000 7f7447d96640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74400b61a0 0x7f7440160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.787+0000 7f7447d96640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74400b4530 con 0x7f74400b3de0 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.787+0000 7f7447d96640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74400b4810 con 0x7f7440145980 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.787+0000 7f7447d96640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f74400b5140 con 0x7f74400b61a0 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.787+0000 7f7446333640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f74400b3de0 0x7f74400720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55972/0 (socket says 172.21.15.137:55972) 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.787+0000 7f7446333640 1 -- 172.21.15.137:0/1076267753 learned_addr learned my addr 172.21.15.137:0/1076267753 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.787+0000 7f7445331640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74400b61a0 0x7f7440160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.787+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277492989 0 0) 0x7f74400b4530 con 0x7f74400b3de0 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.787+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f742c003520 con 0x7f74400b3de0 2024-04-26T22:04:01.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3628095915 0 0) 0x7f74400b4810 con 0x7f7440145980 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74400b4530 con 0x7f7440145980 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 208734529 0 0) 0x7f742c003520 con 0x7f74400b3de0 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74400b61a0 msgr2=0x7f7440160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74400b61a0 0x7f7440160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 >> v1:172.21.15.170:6789/0 conn(0x7f7440145980 legacy=0x7f74400b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74400b4af0 con 0x7f74400b3de0 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f74380019f0 con 0x7f74400b3de0 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 >> v1:172.21.15.137:6789/0 conn(0x7f74400b3de0 legacy=0x7f74400720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f742c003b70 0x7f742c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f742c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74400b61a0 0x7f742c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f74400b5140 con 0x7f742c004800 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f742c00dce0 con 0x7f742c003b70 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f742c00dee0 con 0x7f74400b61a0 2024-04-26T22:04:01.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7445331640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f742c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7446333640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74400b61a0 0x7f742c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7445b32640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f742c003b70 0x7f742c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7445331640 1 -- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74400b61a0 msgr2=0x7f742c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7445331640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f74400b61a0 0x7f742c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7445331640 1 -- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f742c003b70 msgr2=0x7f742c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7445331640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f742c003b70 0x7f742c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7445331640 1 -- 172.21.15.137:0/1076267753 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742c003520 con 0x7f742c004800 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.788+0000 7f7445b32640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f742c003b70 0x7f742c003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.789+0000 7f7445331640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f742c004c80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f743c009ac0 tx=0x7f742c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fb9981fc489d2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.789+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c036070 con 0x7f742c004800 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.789+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743c031400 con 0x7f742c004800 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.789+0000 7f7444b30640 1 -- 172.21.15.137:0/1076267753 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743c009690 con 0x7f742c004800 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.789+0000 7f7447d96640 1 -- 172.21.15.137:0/1076267753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 msgr2=0x7f742c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.789+0000 7f7447d96640 1 --2- 172.21.15.137:0/1076267753 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f742c004c80 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f743c009ac0 tx=0x7f742c005830 comp rx=0 tx=0).stop 2024-04-26T22:04:01.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.789+0000 7f7446333640 1 -- 172.21.15.137:0/1076267753 reap_dead start 2024-04-26T22:04:01.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.789+0000 7f7447d96640 1 -- 172.21.15.137:0/1076267753 shutdown_connections 2024-04-26T22:04:01.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.789+0000 7f7447d96640 1 -- 172.21.15.137:0/1076267753 >> 172.21.15.137:0/1076267753 conn(0x7f74400d0d30 msgr2=0x7f74400d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:01.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.790+0000 7f7447d96640 1 -- 172.21.15.137:0/1076267753 shutdown_connections 2024-04-26T22:04:01.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.790+0000 7f7447d96640 1 -- 172.21.15.137:0/1076267753 wait complete. 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.791+0000 7f7447d96640 1 Processor -- start 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.791+0000 7f7447d96640 1 -- start start 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.791+0000 7f7447d96640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f744013c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.791+0000 7f7447d96640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744015af00 0x7f744015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.791+0000 7f7447d96640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f744015b940 0x7f74401e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.791+0000 7f7447d96640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7440160630 con 0x7f742c004800 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.791+0000 7f7447d96640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f74400b4240 con 0x7f744015af00 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.791+0000 7f7447d96640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f74401607b0 con 0x7f744015b940 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.791+0000 7f7445b32640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f744013c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445b32640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f744013c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53946/0 (socket says 172.21.15.137:53946) 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445b32640 1 -- 172.21.15.137:0/968129118 learned_addr learned my addr 172.21.15.137:0/968129118 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445331640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744015af00 0x7f744015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7446333640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f744015b940 0x7f74401e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445b32640 1 -- 172.21.15.137:0/968129118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f744015b940 msgr2=0x7f74401e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445b32640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f744015b940 0x7f74401e6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445b32640 1 -- 172.21.15.137:0/968129118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744015af00 msgr2=0x7f744015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445b32640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744015af00 0x7f744015b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445b32640 1 -- 172.21.15.137:0/968129118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744013a880 con 0x7f742c004800 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445331640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744015af00 0x7f744015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7445b32640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f744013c050 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f743000e7b0 tx=0x7f743000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f74367fc640 1 -- 172.21.15.137:0/968129118 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743000ee60 con 0x7f742c004800 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f74367fc640 1 -- 172.21.15.137:0/968129118 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74300052e0 con 0x7f742c004800 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744013b570 con 0x7f742c004800 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f74367fc640 1 -- 172.21.15.137:0/968129118 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7430007020 con 0x7f742c004800 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.792+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744013bb30 con 0x7f742c004800 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.793+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744013bd30 con 0x7f742c004800 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.794+0000 7f74367fc640 1 -- 172.21.15.137:0/968129118 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f743001a020 con 0x7f742c004800 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.794+0000 7f74367fc640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f742406c8f0 0x7f742406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:01.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.794+0000 7f74367fc640 1 -- 172.21.15.137:0/968129118 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f743008b3a0 con 0x7f742c004800 2024-04-26T22:04:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.794+0000 7f7445331640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f742406c8f0 0x7f742406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.794+0000 7f7445331640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f742406c8f0 0x7f742406edb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f743c033000 tx=0x7f743c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:01.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:01.798+0000 7f74367fc640 1 -- 172.21.15.137:0/968129118 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f744013bd30 con 0x7f742c004800 2024-04-26T22:04:02.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.009+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f744006a290 con 0x7f742c004800 2024-04-26T22:04:02.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.009+0000 7f74367fc640 1 -- 172.21.15.137:0/968129118 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5197 (secure 0 0 0) 0x7f7430059720 con 0x7f742c004800 2024-04-26T22:04:02.009 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:02.009 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:03:28.395142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/2422385986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2422385986},{"type":"v1","addr":"172.21.15.137:6837","nonce":2422385986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6843,"qdb_cluster":[6843]},"id":5}]} 2024-04-26T22:04:02.010 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 41 2024-04-26T22:04:02.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f742406c8f0 msgr2=0x7f742406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f742406c8f0 0x7f742406edb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f743c033000 tx=0x7f743c008030 comp rx=0 tx=0).stop 2024-04-26T22:04:02.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 msgr2=0x7f744013c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f744013c050 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f743000e7b0 tx=0x7f743000ec70 comp rx=0 tx=0).stop 2024-04-26T22:04:02.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 shutdown_connections 2024-04-26T22:04:02.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f742406c8f0 0x7f742406edb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f744015b940 0x7f74401e6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f744015af00 0x7f744015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 --2- 172.21.15.137:0/968129118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f742c004800 0x7f744013c050 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 >> 172.21.15.137:0/968129118 conn(0x7f74400d0d30 msgr2=0x7f744015d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:02.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 shutdown_connections 2024-04-26T22:04:02.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.011+0000 7f7447d96640 1 -- 172.21.15.137:0/968129118 wait complete. 2024-04-26T22:04:02.023 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:02.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.119+0000 7f0b0c538640 1 Processor -- start 2024-04-26T22:04:02.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.119+0000 7f0b0c538640 1 -- start start 2024-04-26T22:04:02.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0c538640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b0413ff70 0x7f0b04146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0c538640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b040d05b0 con 0x7f0b040cff20 2024-04-26T22:04:02.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0c538640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b040d0890 con 0x7f0b04140350 2024-04-26T22:04:02.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0c538640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0b0406e450 con 0x7f0b0413ff70 2024-04-26T22:04:02.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0a2d4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b0413ff70 0x7f0b04146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0aad5640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0b040cff20 0x7f0b0406ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55980/0 (socket says 172.21.15.137:55980) 2024-04-26T22:04:02.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0aad5640 1 -- 172.21.15.137:0/4060120032 learned_addr learned my addr 172.21.15.137:0/4060120032 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:02.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0a2d4640 1 -- 172.21.15.137:0/4060120032 >> v1:172.21.15.170:6789/0 conn(0x7f0b04140350 legacy=0x7f0b040cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:02.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0a2d4640 1 -- 172.21.15.137:0/4060120032 >> v1:172.21.15.137:6789/0 conn(0x7f0b040cff20 legacy=0x7f0b0406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b092d2640 1 -- 172.21.15.137:0/4060120032 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964801125 0 0) 0x7f0b040d05b0 con 0x7f0b040cff20 2024-04-26T22:04:02.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.120+0000 7f0b0a2d4640 1 -- 172.21.15.137:0/4060120032 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0406e730 con 0x7f0b0413ff70 2024-04-26T22:04:02.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.121+0000 7f0b0a2d4640 1 --2- 172.21.15.137:0/4060120032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b0413ff70 0x7f0b04146080 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0b000097a0 tx=0x7f0b0002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889505723cdf4098 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:02.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.121+0000 7f0b092d2640 1 -- 172.21.15.137:0/4060120032 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b00037070 con 0x7f0b0413ff70 2024-04-26T22:04:02.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.121+0000 7f0b092d2640 1 -- 172.21.15.137:0/4060120032 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b00032440 con 0x7f0b0413ff70 2024-04-26T22:04:02.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.121+0000 7f0b092d2640 1 -- 172.21.15.137:0/4060120032 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b00032810 con 0x7f0b0413ff70 2024-04-26T22:04:02.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.121+0000 7f0b0c538640 1 -- 172.21.15.137:0/4060120032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b0413ff70 msgr2=0x7f0b04146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.121+0000 7f0b0c538640 1 --2- 172.21.15.137:0/4060120032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b0413ff70 0x7f0b04146080 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0b000097a0 tx=0x7f0b0002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.122+0000 7f0b0c538640 1 -- 172.21.15.137:0/4060120032 shutdown_connections 2024-04-26T22:04:02.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.122+0000 7f0b0c538640 1 --2- 172.21.15.137:0/4060120032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b0413ff70 0x7f0b04146080 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.122+0000 7f0b0c538640 1 -- 172.21.15.137:0/4060120032 >> 172.21.15.137:0/4060120032 conn(0x7f0b040d0d30 msgr2=0x7f0b040d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:02.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.122+0000 7f0b0c538640 1 -- 172.21.15.137:0/4060120032 shutdown_connections 2024-04-26T22:04:02.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.122+0000 7f0b0c538640 1 -- 172.21.15.137:0/4060120032 wait complete. 2024-04-26T22:04:02.124 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0c538640 1 Processor -- start 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0c538640 1 -- start start 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0c538640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b040cff20 0x7f0b04144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0c538640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0413ff70 0x7f0b04150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0c538640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b04140350 0x7f0b0415e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0c538640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04146990 con 0x7f0b04140350 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0c538640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04146810 con 0x7f0b040cff20 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0c538640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0406f360 con 0x7f0b0413ff70 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0aad5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b04140350 0x7f0b0415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0aad5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b04140350 0x7f0b0415e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53972/0 (socket says 172.21.15.137:53972) 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.123+0000 7f0b0aad5640 1 -- 172.21.15.137:0/1423894730 learned_addr learned my addr 172.21.15.137:0/1423894730 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0b0aad5640 1 -- 172.21.15.137:0/1423894730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0413ff70 msgr2=0x7f0b04150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0b0aad5640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0413ff70 0x7f0b04150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0b0aad5640 1 -- 172.21.15.137:0/1423894730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b040cff20 msgr2=0x7f0b04144f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0b0aad5640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b040cff20 0x7f0b04144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0b0aad5640 1 -- 172.21.15.137:0/1423894730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b04142840 con 0x7f0b04140350 2024-04-26T22:04:02.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0b0aad5640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b04140350 0x7f0b0415e780 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00c7a0 tx=0x7f0afc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:02.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0afaffd640 1 -- 172.21.15.137:0/1423894730 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc018070 con 0x7f0b04140350 2024-04-26T22:04:02.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0afaffd640 1 -- 172.21.15.137:0/1423894730 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc00a640 con 0x7f0b04140350 2024-04-26T22:04:02.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0afaffd640 1 -- 172.21.15.137:0/1423894730 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc00aab0 con 0x7f0b04140350 2024-04-26T22:04:02.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b04142b20 con 0x7f0b04140350 2024-04-26T22:04:02.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.124+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b041430e0 con 0x7f0b04140350 2024-04-26T22:04:02.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.125+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0406a290 con 0x7f0b04140350 2024-04-26T22:04:02.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.126+0000 7f0afaffd640 1 -- 172.21.15.137:0/1423894730 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0afc00ac50 con 0x7f0b04140350 2024-04-26T22:04:02.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.126+0000 7f0afaffd640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ae806c8f0 0x7f0ae806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.126+0000 7f0afaffd640 1 -- 172.21.15.137:0/1423894730 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f0afc08b1f0 con 0x7f0b04140350 2024-04-26T22:04:02.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.126+0000 7f0b0a2d4640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ae806c8f0 0x7f0ae806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.126+0000 7f0b0a2d4640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ae806c8f0 0x7f0ae806edb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0b00034000 tx=0x7f0b0002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:02.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.130+0000 7f0afaffd640 1 -- 172.21.15.137:0/1423894730 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0afc059600 con 0x7f0b04140350 2024-04-26T22:04:02.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.338+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b040b45e0 con 0x7f0b04140350 2024-04-26T22:04:02.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.339+0000 7f0afaffd640 1 -- 172.21.15.137:0/1423894730 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+5197 (secure 0 0 0) 0x7f0afc058f00 con 0x7f0b04140350 2024-04-26T22:04:02.339 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:02.339 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:02:36.507203+0000","modified":"2024-04-26T22:03:28.395142+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":73,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6843":{"gid":6843,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":14,"addr":"172.21.15.137:6837/2422385986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2422385986},{"type":"v1","addr":"172.21.15.137:6837","nonce":2422385986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6843,"qdb_cluster":[6843]},"id":5}]} 2024-04-26T22:04:02.339 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 41 2024-04-26T22:04:02.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ae806c8f0 msgr2=0x7f0ae806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ae806c8f0 0x7f0ae806edb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0b00034000 tx=0x7f0b0002c000 comp rx=0 tx=0).stop 2024-04-26T22:04:02.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b04140350 msgr2=0x7f0b0415e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b04140350 0x7f0b0415e780 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00c7a0 tx=0x7f0afc00cc60 comp rx=0 tx=0).stop 2024-04-26T22:04:02.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 shutdown_connections 2024-04-26T22:04:02.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ae806c8f0 0x7f0ae806edb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b04140350 0x7f0b0415e780 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0413ff70 0x7f0b04150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 --2- 172.21.15.137:0/1423894730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b040cff20 0x7f0b04144f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 >> 172.21.15.137:0/1423894730 conn(0x7f0b040d0d30 msgr2=0x7f0b040b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:02.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 shutdown_connections 2024-04-26T22:04:02.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.341+0000 7f0b0c538640 1 -- 172.21.15.137:0/1423894730 wait complete. 2024-04-26T22:04:02.352 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:04:02.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.449+0000 7f8c2dabd640 1 Processor -- start 2024-04-26T22:04:02.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.449+0000 7f8c2dabd640 1 -- start start 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c2dabd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8c2815b4e0 0x7f8c28071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c2dabd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c2806f2c0 0x7f8c280cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c2dabd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c280733e0 con 0x7f8c2815b8c0 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c2dabd640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8c280ce230 con 0x7f8c2806f2c0 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c2dabd640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8c28072f00 con 0x7f8c2815b4e0 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c27fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c2806f2c0 0x7f8c280cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c27fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8c2806f2c0 0x7f8c280cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53982/0 (socket says 172.21.15.137:53982) 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c27fff640 1 -- 172.21.15.137:0/1906786757 learned_addr learned my addr 172.21.15.137:0/1906786757 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c277fe640 1 --2- 172.21.15.137:0/1906786757 >> v2:172.21.15.170:3300/0 conn(0x7f8c2815b4e0 0x7f8c28071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c27fff640 1 -- 172.21.15.137:0/1906786757 >> v2:172.21.15.170:3300/0 conn(0x7f8c2815b4e0 msgr2=0x7f8c28071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c27fff640 1 --2- 172.21.15.137:0/1906786757 >> v2:172.21.15.170:3300/0 conn(0x7f8c2815b4e0 0x7f8c28071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c27fff640 1 -- 172.21.15.137:0/1906786757 >> v1:172.21.15.170:6789/0 conn(0x7f8c2815b8c0 legacy=0x7f8c2806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:02.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.450+0000 7f8c27fff640 1 -- 172.21.15.137:0/1906786757 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c28072660 con 0x7f8c2806f2c0 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.451+0000 7f8c27fff640 1 --2- 172.21.15.137:0/1906786757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2806f2c0 0x7f8c280cdcf0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8c280ce3b0 tx=0x7f8c2002b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48e3a2ef8e5a4fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.451+0000 7f8c267fc640 1 -- 172.21.15.137:0/1906786757 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20037070 con 0x7f8c2806f2c0 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.451+0000 7f8c267fc640 1 -- 172.21.15.137:0/1906786757 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c20032600 con 0x7f8c2806f2c0 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.451+0000 7f8c267fc640 1 -- 172.21.15.137:0/1906786757 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c200329d0 con 0x7f8c2806f2c0 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.452+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1906786757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2806f2c0 msgr2=0x7f8c280cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.452+0000 7f8c2dabd640 1 --2- 172.21.15.137:0/1906786757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2806f2c0 0x7f8c280cdcf0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8c280ce3b0 tx=0x7f8c2002b750 comp rx=0 tx=0).stop 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.452+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1906786757 shutdown_connections 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.452+0000 7f8c2dabd640 1 --2- 172.21.15.137:0/1906786757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2806f2c0 0x7f8c280cdcf0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.452+0000 7f8c2dabd640 1 --2- 172.21.15.137:0/1906786757 >> v2:172.21.15.170:3300/0 conn(0x7f8c2815b4e0 0x7f8c28071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.452+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1906786757 >> 172.21.15.137:0/1906786757 conn(0x7f8c280d0d30 msgr2=0x7f8c280d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.452+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1906786757 shutdown_connections 2024-04-26T22:04:02.453 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.452+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1906786757 wait complete. 2024-04-26T22:04:02.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.453+0000 7f8c2dabd640 1 Processor -- start 2024-04-26T22:04:02.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.453+0000 7f8c2dabd640 1 -- start start 2024-04-26T22:04:02.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c2dabd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c2806f2c0 0x7f8c280b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c2dabd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2815b4e0 0x7f8c281533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c2dabd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c2815b8c0 0x7f8c28153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c2dabd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8c280b3e80 con 0x7f8c2815b4e0 2024-04-26T22:04:02.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c2dabd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8c28072c20 con 0x7f8c2806f2c0 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c2dabd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8c28073820 con 0x7f8c2815b8c0 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c26ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2815b4e0 0x7f8c281533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c26ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2815b4e0 0x7f8c281533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53986/0 (socket says 172.21.15.137:53986) 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c26ffd640 1 -- 172.21.15.137:0/1172800311 learned_addr learned my addr 172.21.15.137:0/1172800311 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c26ffd640 1 -- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c2815b8c0 msgr2=0x7f8c28153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c27fff640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c2815b8c0 0x7f8c28153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c277fe640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c2806f2c0 0x7f8c280b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c26ffd640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c2815b8c0 0x7f8c28153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c26ffd640 1 -- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c2806f2c0 msgr2=0x7f8c280b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c26ffd640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c2806f2c0 0x7f8c280b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c26ffd640 1 -- 172.21.15.137:0/1172800311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c281f66b0 con 0x7f8c2815b4e0 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c277fe640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c2806f2c0 0x7f8c280b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c27fff640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c2815b8c0 0x7f8c28153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:02.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c26ffd640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2815b4e0 0x7f8c281533e0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00b3c0 tx=0x7f8c1c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c0ffff640 1 -- 172.21.15.137:0/1172800311 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c011830 con 0x7f8c2815b4e0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c0ffff640 1 -- 172.21.15.137:0/1172800311 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1c016070 con 0x7f8c2815b4e0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c281f6990 con 0x7f8c2815b4e0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c0ffff640 1 -- 172.21.15.137:0/1172800311 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c011c50 con 0x7f8c2815b4e0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.454+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c281f6f50 con 0x7f8c2815b4e0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.455+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c281f7330 con 0x7f8c2815b4e0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.456+0000 7f8c0ffff640 1 -- 172.21.15.137:0/1172800311 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c1c01b460 con 0x7f8c2815b4e0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.456+0000 7f8c0ffff640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c1406c8f0 0x7f8c1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.456+0000 7f8c0ffff640 1 -- 172.21.15.137:0/1172800311 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f8c1c08b8f0 con 0x7f8c2815b4e0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.456+0000 7f8c277fe640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c1406c8f0 0x7f8c1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.456+0000 7f8c277fe640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c1406c8f0 0x7f8c1406edb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8c18006fd0 tx=0x7f8c18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:02.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.460+0000 7f8c0ffff640 1 -- 172.21.15.137:0/1172800311 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8c281f7330 con 0x7f8c2815b4e0 2024-04-26T22:04:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.636+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c2806a290 con 0x7f8c2815b4e0 2024-04-26T22:04:02.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.637+0000 7f8c0ffff640 1 -- 172.21.15.137:0/1172800311 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+16956 (secure 0 0 0) 0x7f8c1c059c70 con 0x7f8c2815b4e0 2024-04-26T22:04:02.637 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:02.637 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":75,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:03:23.459267+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:02:34.722395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-26T22:02:35.462679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.10","mappings":[{"from":6,"to":1}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/1566574554":"2024-04-27T22:02:45.720691+0000","172.21.15.137:6835/1566574554":"2024-04-27T22:02:45.720691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:02.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c1406c8f0 msgr2=0x7f8c1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c1406c8f0 0x7f8c1406edb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8c18006fd0 tx=0x7f8c18008040 comp rx=0 tx=0).stop 2024-04-26T22:04:02.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2815b4e0 msgr2=0x7f8c281533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2815b4e0 0x7f8c281533e0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00b3c0 tx=0x7f8c1c00b880 comp rx=0 tx=0).stop 2024-04-26T22:04:02.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 shutdown_connections 2024-04-26T22:04:02.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8c1406c8f0 0x7f8c1406edb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8c2815b4e0 0x7f8c281533e0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8c2815b8c0 0x7f8c28153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 --2- 172.21.15.137:0/1172800311 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c2806f2c0 0x7f8c280b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 >> 172.21.15.137:0/1172800311 conn(0x7f8c280d0d30 msgr2=0x7f8c2815f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:02.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 shutdown_connections 2024-04-26T22:04:02.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.639+0000 7f8c2dabd640 1 -- 172.21.15.137:0/1172800311 wait complete. 2024-04-26T22:04:02.651 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:04:02.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.749+0000 7f04e6d9d640 1 Processor -- start 2024-04-26T22:04:02.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.749+0000 7f04e6d9d640 1 -- start start 2024-04-26T22:04:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.750+0000 7f04e6d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f04e015fa20 0x7f04e00cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.750+0000 7f04e6d9d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e0163830 con 0x7f04e0162f30 2024-04-26T22:04:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.750+0000 7f04e6d9d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e0163b10 con 0x7f04e006c2a0 2024-04-26T22:04:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.750+0000 7f04e6d9d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f04e0163df0 con 0x7f04e015fa20 2024-04-26T22:04:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.750+0000 7f04dffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f04e015fa20 0x7f04e00cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.750+0000 7f04e533a640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f04e0162f30 0x7f04e006fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55986/0 (socket says 172.21.15.137:55986) 2024-04-26T22:04:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.750+0000 7f04e533a640 1 -- 172.21.15.137:0/3328601407 learned_addr learned my addr 172.21.15.137:0/3328601407 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.751+0000 7f04dffff640 1 -- 172.21.15.137:0/3328601407 >> v1:172.21.15.170:6789/0 conn(0x7f04e006c2a0 legacy=0x7f04e006c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.751+0000 7f04dffff640 1 -- 172.21.15.137:0/3328601407 >> v1:172.21.15.137:6789/0 conn(0x7f04e0162f30 legacy=0x7f04e006fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.751+0000 7f04df7fe640 1 -- 172.21.15.137:0/3328601407 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512928945 0 0) 0x7f04e0163830 con 0x7f04e0162f30 2024-04-26T22:04:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.751+0000 7f04dffff640 1 -- 172.21.15.137:0/3328601407 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e00ce950 con 0x7f04e015fa20 2024-04-26T22:04:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.751+0000 7f04dffff640 1 --2- 172.21.15.137:0/3328601407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e015fa20 0x7f04e00cf150 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f04d40097a0 tx=0x7f04d402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354681057a67d609 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.751+0000 7f04df7fe640 1 -- 172.21.15.137:0/3328601407 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4037070 con 0x7f04e015fa20 2024-04-26T22:04:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.751+0000 7f04df7fe640 1 -- 172.21.15.137:0/3328601407 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d402adc0 con 0x7f04e015fa20 2024-04-26T22:04:02.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.752+0000 7f04df7fe640 1 -- 172.21.15.137:0/3328601407 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4032660 con 0x7f04e015fa20 2024-04-26T22:04:02.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.752+0000 7f04e6d9d640 1 -- 172.21.15.137:0/3328601407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e015fa20 msgr2=0x7f04e00cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.752+0000 7f04e6d9d640 1 --2- 172.21.15.137:0/3328601407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e015fa20 0x7f04e00cf150 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f04d40097a0 tx=0x7f04d402a0b0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.752+0000 7f04e6d9d640 1 -- 172.21.15.137:0/3328601407 shutdown_connections 2024-04-26T22:04:02.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.752+0000 7f04e6d9d640 1 --2- 172.21.15.137:0/3328601407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e015fa20 0x7f04e00cf150 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.752+0000 7f04e6d9d640 1 -- 172.21.15.137:0/3328601407 >> 172.21.15.137:0/3328601407 conn(0x7f04e00b3b10 msgr2=0x7f04e00b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:02.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.752+0000 7f04e6d9d640 1 -- 172.21.15.137:0/3328601407 shutdown_connections 2024-04-26T22:04:02.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.752+0000 7f04e6d9d640 1 -- 172.21.15.137:0/3328601407 wait complete. 2024-04-26T22:04:02.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.753+0000 7f04e6d9d640 1 Processor -- start 2024-04-26T22:04:02.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.753+0000 7f04e6d9d640 1 -- start start 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e006c2a0 0x7f04e01599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e6d9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04e015fa20 0x7f04e0159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e6d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04e0162f30 0x7f04e006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e6d9d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f04e01606a0 con 0x7f04e006c2a0 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e6d9d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f04e00cf690 con 0x7f04e0162f30 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e6d9d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f04e0160820 con 0x7f04e015fa20 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e4b39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e006c2a0 0x7f04e01599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e4b39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e006c2a0 0x7f04e01599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54002/0 (socket says 172.21.15.137:54002) 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e4b39640 1 -- 172.21.15.137:0/560484848 learned_addr learned my addr 172.21.15.137:0/560484848 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04dffff640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04e015fa20 0x7f04e0159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e533a640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04e0162f30 0x7f04e006fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e4b39640 1 -- 172.21.15.137:0/560484848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04e015fa20 msgr2=0x7f04e0159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e4b39640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04e015fa20 0x7f04e0159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e4b39640 1 -- 172.21.15.137:0/560484848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04e0162f30 msgr2=0x7f04e006fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e4b39640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04e0162f30 0x7f04e006fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.754+0000 7f04e4b39640 1 -- 172.21.15.137:0/560484848 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e0162240 con 0x7f04e006c2a0 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.755+0000 7f04e4b39640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e006c2a0 0x7f04e01599a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f04d000b3e0 tx=0x7f04d000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.755+0000 7f04dd7fa640 1 -- 172.21.15.137:0/560484848 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0015020 con 0x7f04e006c2a0 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.755+0000 7f04dd7fa640 1 -- 172.21.15.137:0/560484848 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d0011850 con 0x7f04e006c2a0 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.755+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e0162520 con 0x7f04e006c2a0 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.755+0000 7f04dd7fa640 1 -- 172.21.15.137:0/560484848 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0011c40 con 0x7f04e006c2a0 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.755+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e0161ee0 con 0x7f04e006c2a0 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.756+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e00693d0 con 0x7f04e006c2a0 2024-04-26T22:04:02.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.756+0000 7f04dd7fa640 1 -- 172.21.15.137:0/560484848 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04d0018020 con 0x7f04e006c2a0 2024-04-26T22:04:02.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.756+0000 7f04dd7fa640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f04cc06c8f0 0x7f04cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:02.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.757+0000 7f04dd7fa640 1 -- 172.21.15.137:0/560484848 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5882+0+0 (secure 0 0 0) 0x7f04d008bb00 con 0x7f04e006c2a0 2024-04-26T22:04:02.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.757+0000 7f04dffff640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f04cc06c8f0 0x7f04cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:02.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.757+0000 7f04dffff640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f04cc06c8f0 0x7f04cc06edb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f04d4034000 tx=0x7f04d402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:02.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.761+0000 7f04dd7fa640 1 -- 172.21.15.137:0/560484848 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f04d001f020 con 0x7f04e006c2a0 2024-04-26T22:04:02.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.972+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f04e00d0030 con 0x7f04e006c2a0 2024-04-26T22:04:02.973 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:04:02.973+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:04:02.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.974+0000 7f04dd7fa640 1 -- 172.21.15.137:0/560484848 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) ==== 161+0+0 (secure 0 0 0) 0x7f04d00172c0 con 0x7f04e006c2a0 2024-04-26T22:04:02.974 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:04:02.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f04cc06c8f0 msgr2=0x7f04cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f04cc06c8f0 0x7f04cc06edb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f04d4034000 tx=0x7f04d402e000 comp rx=0 tx=0).stop 2024-04-26T22:04:02.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e006c2a0 msgr2=0x7f04e01599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:02.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e006c2a0 0x7f04e01599a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f04d000b3e0 tx=0x7f04d000b8a0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 shutdown_connections 2024-04-26T22:04:02.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f04cc06c8f0 0x7f04cc06edb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04e0162f30 0x7f04e006fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f04e015fa20 0x7f04e0159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 --2- 172.21.15.137:0/560484848 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04e006c2a0 0x7f04e01599a0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:02.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 >> 172.21.15.137:0/560484848 conn(0x7f04e00b3b10 msgr2=0x7f04e015c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:02.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 shutdown_connections 2024-04-26T22:04:02.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:02.977+0000 7f04e6d9d640 1 -- 172.21.15.137:0/560484848 wait complete. 2024-04-26T22:04:02.980 INFO:tasks.ceph.mds.c.smithi137.stderr: -4172> 2024-04-26T22:02:51.388+0000 7fdfeb306640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:04:02.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:04:03.010 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:04:03.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.089+0000 7f4748e52640 1 Processor -- start 2024-04-26T22:04:03.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.089+0000 7f4748e52640 1 -- start start 2024-04-26T22:04:03.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f4748e52640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f474406f340 0x7f47440b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:03.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f4748e52640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47440b46a0 con 0x7f47440b3e50 2024-04-26T22:04:03.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f4748e52640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47440b5db0 con 0x7f47440d0300 2024-04-26T22:04:03.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f4748e52640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f47440b6090 con 0x7f474406f340 2024-04-26T22:04:03.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f474259c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f474406f340 0x7f47440b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:03.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f4742d9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f47440b3e50 0x7f47440720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:56010/0 (socket says 172.21.15.137:56010) 2024-04-26T22:04:03.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f4742d9d640 1 -- 172.21.15.137:0/1048896260 learned_addr learned my addr 172.21.15.137:0/1048896260 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:03.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f474259c640 1 -- 172.21.15.137:0/1048896260 >> v1:172.21.15.170:6789/0 conn(0x7f47440d0300 legacy=0x7f474406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:03.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f474259c640 1 -- 172.21.15.137:0/1048896260 >> v1:172.21.15.137:6789/0 conn(0x7f47440b3e50 legacy=0x7f47440720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:03.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f4741d9b640 1 -- 172.21.15.137:0/1048896260 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2672687841 0 0) 0x7f47440b46a0 con 0x7f47440b3e50 2024-04-26T22:04:03.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.090+0000 7f474259c640 1 -- 172.21.15.137:0/1048896260 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47440b6370 con 0x7f474406f340 2024-04-26T22:04:03.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.091+0000 7f474259c640 1 --2- 172.21.15.137:0/1048896260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f474406f340 0x7f47440b6b70 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f47340097a0 tx=0x7f473402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc871300ddc97aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:03.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.091+0000 7f4741d9b640 1 -- 172.21.15.137:0/1048896260 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734037070 con 0x7f474406f340 2024-04-26T22:04:03.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.091+0000 7f4741d9b640 1 -- 172.21.15.137:0/1048896260 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4734032440 con 0x7f474406f340 2024-04-26T22:04:03.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.091+0000 7f4741d9b640 1 -- 172.21.15.137:0/1048896260 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473402ae60 con 0x7f474406f340 2024-04-26T22:04:03.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.092+0000 7f4748e52640 1 -- 172.21.15.137:0/1048896260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f474406f340 msgr2=0x7f47440b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:03.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.092+0000 7f4748e52640 1 --2- 172.21.15.137:0/1048896260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f474406f340 0x7f47440b6b70 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f47340097a0 tx=0x7f473402a110 comp rx=0 tx=0).stop 2024-04-26T22:04:03.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.092+0000 7f4748e52640 1 -- 172.21.15.137:0/1048896260 shutdown_connections 2024-04-26T22:04:03.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.092+0000 7f4748e52640 1 --2- 172.21.15.137:0/1048896260 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f474406f340 0x7f47440b6b70 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:03.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.092+0000 7f4748e52640 1 -- 172.21.15.137:0/1048896260 >> 172.21.15.137:0/1048896260 conn(0x7f47440cd8a0 msgr2=0x7f47440cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:03.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.092+0000 7f4748e52640 1 -- 172.21.15.137:0/1048896260 shutdown_connections 2024-04-26T22:04:03.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.092+0000 7f4748e52640 1 -- 172.21.15.137:0/1048896260 wait complete. 2024-04-26T22:04:03.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.093+0000 7f4748e52640 1 Processor -- start 2024-04-26T22:04:03.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.093+0000 7f4748e52640 1 -- start start 2024-04-26T22:04:03.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4748e52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f474406f340 0x7f47441f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:03.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4748e52640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47440b3e50 0x7f47441e5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:03.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4748e52640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47440d0300 0x7f47441e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:03.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4748e52640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f47440b4460 con 0x7f47440d0300 2024-04-26T22:04:03.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4748e52640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f47440b42e0 con 0x7f474406f340 2024-04-26T22:04:03.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4748e52640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4744142a30 con 0x7f47440b3e50 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4742d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47440d0300 0x7f47441e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4742d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47440d0300 0x7f47441e58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54052/0 (socket says 172.21.15.137:54052) 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4742d9d640 1 -- 172.21.15.137:0/2820537348 learned_addr learned my addr 172.21.15.137:0/2820537348 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4742d9d640 1 -- 172.21.15.137:0/2820537348 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47440b3e50 msgr2=0x7f47441e5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4742d9d640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47440b3e50 0x7f47441e5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4742d9d640 1 -- 172.21.15.137:0/2820537348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f474406f340 msgr2=0x7f47441f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4742d9d640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f474406f340 0x7f47441f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4742d9d640 1 -- 172.21.15.137:0/2820537348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47441418f0 con 0x7f47440d0300 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4742d9d640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47440d0300 0x7f47441e58b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c700 tx=0x7f473c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f473affd640 1 -- 172.21.15.137:0/2820537348 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c018070 con 0x7f47440d0300 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f473affd640 1 -- 172.21.15.137:0/2820537348 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473c00ce10 con 0x7f47440d0300 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47441e5ee0 con 0x7f47440d0300 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f473affd640 1 -- 172.21.15.137:0/2820537348 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c00a860 con 0x7f47440d0300 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.094+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4744130810 con 0x7f47440d0300 2024-04-26T22:04:03.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.095+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47441e62d0 con 0x7f47440d0300 2024-04-26T22:04:03.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.096+0000 7f473affd640 1 -- 172.21.15.137:0/2820537348 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f473c01b070 con 0x7f47440d0300 2024-04-26T22:04:03.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.096+0000 7f473affd640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472406c8f0 0x7f472406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:03.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.096+0000 7f473affd640 1 -- 172.21.15.137:0/2820537348 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5968+0+0 (secure 0 0 0) 0x7f473c08b1f0 con 0x7f47440d0300 2024-04-26T22:04:03.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.096+0000 7f474259c640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472406c8f0 0x7f472406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:03.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.097+0000 7f474259c640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472406c8f0 0x7f472406edb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4734034000 tx=0x7f473402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:03.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.101+0000 7f473affd640 1 -- 172.21.15.137:0/2820537348 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f473c059520 con 0x7f47440d0300 2024-04-26T22:04:03.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.313+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f474406a290 con 0x7f47440d0300 2024-04-26T22:04:03.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.976+0000 7f473affd640 1 -- 172.21.15.137:0/2820537348 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7f473c058e20 con 0x7f47440d0300 2024-04-26T22:04:03.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472406c8f0 msgr2=0x7f472406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:03.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472406c8f0 0x7f472406edb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4734034000 tx=0x7f473402c000 comp rx=0 tx=0).stop 2024-04-26T22:04:03.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47440d0300 msgr2=0x7f47441e58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:03.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47440d0300 0x7f47441e58b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c700 tx=0x7f473c00cbc0 comp rx=0 tx=0).stop 2024-04-26T22:04:03.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 shutdown_connections 2024-04-26T22:04:03.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f472406c8f0 0x7f472406edb0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f47440d0300 0x7f47441e58b0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f47440b3e50 0x7f47441e5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 --2- 172.21.15.137:0/2820537348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f474406f340 0x7f47441f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 >> 172.21.15.137:0/2820537348 conn(0x7f47440cd8a0 msgr2=0x7f47440ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 shutdown_connections 2024-04-26T22:04:03.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:03.979+0000 7f4748e52640 1 -- 172.21.15.137:0/2820537348 wait complete. 2024-04-26T22:04:03.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:04:04.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.140+0000 7f6344f78640 1 Processor -- start 2024-04-26T22:04:04.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.140+0000 7f6344f78640 1 -- start start 2024-04-26T22:04:04.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f6344f78640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6340145fe0 0x7f6340146580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:04.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f6344f78640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63400d0d00 con 0x7f63400d2900 2024-04-26T22:04:04.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f6344f78640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63400d0fe0 con 0x7f6340161be0 2024-04-26T22:04:04.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f6344f78640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f63401463c0 con 0x7f6340145fe0 2024-04-26T22:04:04.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f633e59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6340145fe0 0x7f6340146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:04.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f633ed9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f63400d2900 0x7f634006f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:56024/0 (socket says 172.21.15.137:56024) 2024-04-26T22:04:04.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f633ed9d640 1 -- 172.21.15.137:0/956431228 learned_addr learned my addr 172.21.15.137:0/956431228 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:04.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f633e59c640 1 -- 172.21.15.137:0/956431228 >> v1:172.21.15.170:6789/0 conn(0x7f6340161be0 legacy=0x7f63400d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:04.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f633e59c640 1 -- 172.21.15.137:0/956431228 >> v1:172.21.15.137:6789/0 conn(0x7f63400d2900 legacy=0x7f634006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:04.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.141+0000 7f633e59c640 1 -- 172.21.15.137:0/956431228 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63400d12c0 con 0x7f6340145fe0 2024-04-26T22:04:04.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.142+0000 7f633e59c640 1 --2- 172.21.15.137:0/956431228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340145fe0 0x7f6340146580 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f63300097a0 tx=0x7f633002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e549156aaf9359 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:04.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.142+0000 7f633dd9b640 1 -- 172.21.15.137:0/956431228 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330037070 con 0x7f6340145fe0 2024-04-26T22:04:04.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.142+0000 7f633dd9b640 1 -- 172.21.15.137:0/956431228 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633002ae50 con 0x7f6340145fe0 2024-04-26T22:04:04.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.142+0000 7f633dd9b640 1 -- 172.21.15.137:0/956431228 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6330032660 con 0x7f6340145fe0 2024-04-26T22:04:04.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.142+0000 7f6344f78640 1 -- 172.21.15.137:0/956431228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340145fe0 msgr2=0x7f6340146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:04.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.142+0000 7f6344f78640 1 --2- 172.21.15.137:0/956431228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340145fe0 0x7f6340146580 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f63300097a0 tx=0x7f633002a140 comp rx=0 tx=0).stop 2024-04-26T22:04:04.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.142+0000 7f6344f78640 1 -- 172.21.15.137:0/956431228 shutdown_connections 2024-04-26T22:04:04.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.142+0000 7f6344f78640 1 --2- 172.21.15.137:0/956431228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340145fe0 0x7f6340146580 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:04.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.142+0000 7f6344f78640 1 -- 172.21.15.137:0/956431228 >> 172.21.15.137:0/956431228 conn(0x7f634006d590 msgr2=0x7f634006d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:04.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.143+0000 7f6344f78640 1 -- 172.21.15.137:0/956431228 shutdown_connections 2024-04-26T22:04:04.144 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.143+0000 7f6344f78640 1 -- 172.21.15.137:0/956431228 wait complete. 2024-04-26T22:04:04.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.144+0000 7f6344f78640 1 Processor -- start 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.144+0000 7f6344f78640 1 -- start start 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.144+0000 7f6344f78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63400d2900 0x7f6340160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.144+0000 7f6344f78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6340145fe0 0x7f6340159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.144+0000 7f6344f78640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340161be0 0x7f63401598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.144+0000 7f6344f78640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6340146ac0 con 0x7f6340161be0 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.144+0000 7f6344f78640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f63400d09b0 con 0x7f63400d2900 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.144+0000 7f6344f78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6340146c40 con 0x7f6340145fe0 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f633ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340161be0 0x7f63401598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f633ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340161be0 0x7f63401598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54070/0 (socket says 172.21.15.137:54070) 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f633ed9d640 1 -- 172.21.15.137:0/1693540356 learned_addr learned my addr 172.21.15.137:0/1693540356 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f633ed9d640 1 -- 172.21.15.137:0/1693540356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6340145fe0 msgr2=0x7f6340159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f633ed9d640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6340145fe0 0x7f6340159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:04.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f633ed9d640 1 -- 172.21.15.137:0/1693540356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63400d2900 msgr2=0x7f6340160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:04.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f633ed9d640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63400d2900 0x7f6340160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:04.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f633ed9d640 1 -- 172.21.15.137:0/1693540356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6340135d50 con 0x7f6340161be0 2024-04-26T22:04:04.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f633ed9d640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340161be0 0x7f63401598a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f633800cae0 tx=0x7f633800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:04.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f6336ffd640 1 -- 172.21.15.137:0/1693540356 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338017070 con 0x7f6340161be0 2024-04-26T22:04:04.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f6336ffd640 1 -- 172.21.15.137:0/1693540356 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633800ac40 con 0x7f6340161be0 2024-04-26T22:04:04.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63401583f0 con 0x7f6340161be0 2024-04-26T22:04:04.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f6336ffd640 1 -- 172.21.15.137:0/1693540356 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338012400 con 0x7f6340161be0 2024-04-26T22:04:04.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.145+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63401589b0 con 0x7f6340161be0 2024-04-26T22:04:04.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.146+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634006a290 con 0x7f6340161be0 2024-04-26T22:04:04.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.147+0000 7f6336ffd640 1 -- 172.21.15.137:0/1693540356 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f633801a070 con 0x7f6340161be0 2024-04-26T22:04:04.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.147+0000 7f6336ffd640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f632006c8f0 0x7f632006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:04.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.147+0000 7f633e59c640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f632006c8f0 0x7f632006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:04.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.147+0000 7f6336ffd640 1 -- 172.21.15.137:0/1693540356 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5968+0+0 (secure 0 0 0) 0x7f633808b930 con 0x7f6340161be0 2024-04-26T22:04:04.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.148+0000 7f633e59c640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f632006c8f0 0x7f632006edb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6330034000 tx=0x7f633002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:04.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.151+0000 7f6336ffd640 1 -- 172.21.15.137:0/1693540356 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6338059cf0 con 0x7f6340161be0 2024-04-26T22:04:04.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.328+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6340157570 con 0x7f6340161be0 2024-04-26T22:04:04.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.978+0000 7f6336ffd640 1 -- 172.21.15.137:0/1693540356 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7f63380595f0 con 0x7f6340161be0 2024-04-26T22:04:04.978 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:04:04.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f632006c8f0 msgr2=0x7f632006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f632006c8f0 0x7f632006edb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6330034000 tx=0x7f633002c000 comp rx=0 tx=0).stop 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340161be0 msgr2=0x7f63401598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340161be0 0x7f63401598a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f633800cae0 tx=0x7f633800a060 comp rx=0 tx=0).stop 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 shutdown_connections 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f632006c8f0 0x7f632006edb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6340161be0 0x7f63401598a0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6340145fe0 0x7f6340159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 --2- 172.21.15.137:0/1693540356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63400d2900 0x7f6340160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 >> 172.21.15.137:0/1693540356 conn(0x7f634006d590 msgr2=0x7f6340140db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.980+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 shutdown_connections 2024-04-26T22:04:04.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:04.981+0000 7f6344f78640 1 -- 172.21.15.137:0/1693540356 wait complete. 2024-04-26T22:04:04.992 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:04:05.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.095+0000 7f02303da640 1 Processor -- start 2024-04-26T22:04:05.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.095+0000 7f02303da640 1 -- start start 2024-04-26T22:04:05.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f02303da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0228160700 0x7f02280ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f02303da640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f022815f670 0x7f02280cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f02303da640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02280d1320 con 0x7f022806d2b0 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f02303da640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0228160270 con 0x7f022815f670 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f02303da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f022815fc20 con 0x7f0228160700 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f022e977640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f022815f670 0x7f02280cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f022e977640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f022815f670 0x7f02280cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54074/0 (socket says 172.21.15.137:54074) 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f022e977640 1 -- 172.21.15.137:0/2072099704 learned_addr learned my addr 172.21.15.137:0/2072099704 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f022d975640 1 --2- 172.21.15.137:0/2072099704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0228160700 0x7f02280ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f022e977640 1 -- 172.21.15.137:0/2072099704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0228160700 msgr2=0x7f02280ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f022e977640 1 --2- 172.21.15.137:0/2072099704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0228160700 0x7f02280ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f022e977640 1 -- 172.21.15.137:0/2072099704 >> v1:172.21.15.170:6789/0 conn(0x7f022806d2b0 legacy=0x7f022806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f022e977640 1 -- 172.21.15.137:0/2072099704 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022815ff00 con 0x7f022815f670 2024-04-26T22:04:05.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.096+0000 7f022d975640 1 --2- 172.21.15.137:0/2072099704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0228160700 0x7f02280ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:05.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.097+0000 7f022e977640 1 --2- 172.21.15.137:0/2072099704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f022815f670 0x7f02280cf290 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0220009870 tx=0x7f022002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1efab49f3f0d30a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:05.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.097+0000 7f022d174640 1 -- 172.21.15.137:0/2072099704 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220037070 con 0x7f022815f670 2024-04-26T22:04:05.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.097+0000 7f022d174640 1 -- 172.21.15.137:0/2072099704 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022002ae10 con 0x7f022815f670 2024-04-26T22:04:05.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.097+0000 7f022d174640 1 -- 172.21.15.137:0/2072099704 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220032660 con 0x7f022815f670 2024-04-26T22:04:05.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.098+0000 7f02303da640 1 -- 172.21.15.137:0/2072099704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f022815f670 msgr2=0x7f02280cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:05.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.098+0000 7f02303da640 1 --2- 172.21.15.137:0/2072099704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f022815f670 0x7f02280cf290 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0220009870 tx=0x7f022002a100 comp rx=0 tx=0).stop 2024-04-26T22:04:05.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.098+0000 7f02303da640 1 -- 172.21.15.137:0/2072099704 shutdown_connections 2024-04-26T22:04:05.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.098+0000 7f02303da640 1 --2- 172.21.15.137:0/2072099704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f022815f670 0x7f02280cf290 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.098+0000 7f02303da640 1 --2- 172.21.15.137:0/2072099704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0228160700 0x7f02280ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.098+0000 7f02303da640 1 -- 172.21.15.137:0/2072099704 >> 172.21.15.137:0/2072099704 conn(0x7f0228072900 msgr2=0x7f0228072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:05.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.098+0000 7f02303da640 1 -- 172.21.15.137:0/2072099704 shutdown_connections 2024-04-26T22:04:05.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.098+0000 7f02303da640 1 -- 172.21.15.137:0/2072099704 wait complete. 2024-04-26T22:04:05.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.099+0000 7f02303da640 1 Processor -- start 2024-04-26T22:04:05.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.099+0000 7f02303da640 1 -- start start 2024-04-26T22:04:05.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f02303da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022806d2b0 0x7f0228150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:05.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f02303da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f022815f670 0x7f022815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:05.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f02303da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0228160700 0x7f02280b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f02303da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0228071270 con 0x7f0228160700 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f02303da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f02280710f0 con 0x7f022806d2b0 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f02303da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f02280cf7d0 con 0x7f022815f670 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e977640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0228160700 0x7f02280b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e977640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0228160700 0x7f02280b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54088/0 (socket says 172.21.15.137:54088) 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e977640 1 -- 172.21.15.137:0/2516669870 learned_addr learned my addr 172.21.15.137:0/2516669870 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022d975640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f022815f670 0x7f022815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e176640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022806d2b0 0x7f0228150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e977640 1 -- 172.21.15.137:0/2516669870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f022815f670 msgr2=0x7f022815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:05.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e977640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f022815f670 0x7f022815ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e977640 1 -- 172.21.15.137:0/2516669870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022806d2b0 msgr2=0x7f0228150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e977640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022806d2b0 0x7f0228150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e977640 1 -- 172.21.15.137:0/2516669870 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022815c460 con 0x7f0228160700 2024-04-26T22:04:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e176640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022806d2b0 0x7f0228150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f022e977640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0228160700 0x7f02280b6070 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f0220009870 tx=0x7f02200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f021effd640 1 -- 172.21.15.137:0/2516669870 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220041070 con 0x7f0228160700 2024-04-26T22:04:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f021effd640 1 -- 172.21.15.137:0/2516669870 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022003c670 con 0x7f0228160700 2024-04-26T22:04:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f021effd640 1 -- 172.21.15.137:0/2516669870 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220037040 con 0x7f0228160700 2024-04-26T22:04:05.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.100+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022815c740 con 0x7f0228160700 2024-04-26T22:04:05.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.101+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022815cd00 con 0x7f0228160700 2024-04-26T22:04:05.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.101+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022806a290 con 0x7f0228160700 2024-04-26T22:04:05.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.102+0000 7f021effd640 1 -- 172.21.15.137:0/2516669870 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0220044070 con 0x7f0228160700 2024-04-26T22:04:05.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.102+0000 7f021effd640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f020c06c8f0 0x7f020c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:05.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.102+0000 7f022e176640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f020c06c8f0 0x7f020c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:05.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.102+0000 7f021effd640 1 -- 172.21.15.137:0/2516669870 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5530+0+0 (secure 0 0 0) 0x7f02200ac370 con 0x7f0228160700 2024-04-26T22:04:05.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.103+0000 7f022e176640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f020c06c8f0 0x7f020c06edb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0228151850 tx=0x7f0224009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:05.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.107+0000 7f021effd640 1 -- 172.21.15.137:0/2516669870 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f022007a7b0 con 0x7f0228160700 2024-04-26T22:04:05.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.294+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0228073bb0 con 0x7f0228160700 2024-04-26T22:04:05.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.979+0000 7f021effd640 1 -- 172.21.15.137:0/2516669870 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7f022007a0b0 con 0x7f0228160700 2024-04-26T22:04:05.979 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T22:04:05.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f020c06c8f0 msgr2=0x7f020c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:05.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f020c06c8f0 0x7f020c06edb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0228151850 tx=0x7f0224009040 comp rx=0 tx=0).stop 2024-04-26T22:04:05.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0228160700 msgr2=0x7f02280b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:05.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0228160700 0x7f02280b6070 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f0220009870 tx=0x7f02200046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 shutdown_connections 2024-04-26T22:04:05.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f020c06c8f0 0x7f020c06edb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0228160700 0x7f02280b6070 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f022815f670 0x7f022815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 --2- 172.21.15.137:0/2516669870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f022806d2b0 0x7f0228150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:05.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 >> 172.21.15.137:0/2516669870 conn(0x7f0228072900 msgr2=0x7f02280b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:05.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 shutdown_connections 2024-04-26T22:04:05.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:05.982+0000 7f02303da640 1 -- 172.21.15.137:0/2516669870 wait complete. 2024-04-26T22:04:05.998 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T22:04:06.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.102+0000 7f309f859640 1 Processor -- start 2024-04-26T22:04:06.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.103+0000 7f309f859640 1 -- start start 2024-04-26T22:04:06.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.103+0000 7f309f859640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f30980d4f20 0x7f30980d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.103+0000 7f309f859640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30980d3c90 con 0x7f30980d3820 2024-04-26T22:04:06.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.103+0000 7f309f859640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30980d58c0 con 0x7f309815f680 2024-04-26T22:04:06.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.103+0000 7f309f859640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f309815fa60 con 0x7f30980d4f20 2024-04-26T22:04:06.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309cdf4640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f30980d3820 0x7f30980b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51718/0 (socket says 172.21.15.137:51718) 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309cdf4640 1 -- 172.21.15.137:0/1512377075 learned_addr learned my addr 172.21.15.137:0/1512377075 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277602025 0 0) 0x7f30980d3c90 con 0x7f30980d3820 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309ddf6640 1 --2- 172.21.15.137:0/1512377075 >> v2:172.21.15.170:3300/0 conn(0x7f30980d4f20 0x7f30980d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3084003520 con 0x7f30980d3820 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4227728259 0 0) 0x7f3084003520 con 0x7f30980d3820 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 >> v2:172.21.15.170:3300/0 conn(0x7f30980d4f20 msgr2=0x7f30980d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 --2- 172.21.15.137:0/1512377075 >> v2:172.21.15.170:3300/0 conn(0x7f30980d4f20 0x7f30980d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 >> v1:172.21.15.170:6789/0 conn(0x7f309815f680 legacy=0x7f3098163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30980d3f50 con 0x7f30980d3820 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f3094001670 con 0x7f30980d3820 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 >> v1:172.21.15.137:6789/0 conn(0x7f30980d3820 legacy=0x7f30980b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30840039b0 0x7f3084003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3084004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30840051c0 0x7f308400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f309815fa60 con 0x7f3084004800 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f308400c060 con 0x7f30840039b0 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f308400c260 con 0x7f30840051c0 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309cdf4640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3084004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309d5f5640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30840039b0 0x7f3084003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309ddf6640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30840051c0 0x7f308400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309cdf4640 1 -- 172.21.15.137:0/1512377075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30840051c0 msgr2=0x7f308400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309cdf4640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f30840051c0 0x7f308400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309cdf4640 1 -- 172.21.15.137:0/1512377075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30840039b0 msgr2=0x7f3084003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.104+0000 7f309cdf4640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30840039b0 0x7f3084003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.105+0000 7f309cdf4640 1 -- 172.21.15.137:0/1512377075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3084003520 con 0x7f3084004800 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.105+0000 7f309ddf6640 1 -- 172.21.15.137:0/1512377075 reap_dead start 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.105+0000 7f309d5f5640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30840039b0 0x7f3084003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:06.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.105+0000 7f309cdf4640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3084004c80 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f309400c210 tx=0x7f3084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65e9a706063a266 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:06.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.105+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094007d30 con 0x7f3084004800 2024-04-26T22:04:06.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.105+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3094005ad0 con 0x7f3084004800 2024-04-26T22:04:06.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.105+0000 7f308bfff640 1 -- 172.21.15.137:0/1512377075 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094007070 con 0x7f3084004800 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.106+0000 7f309f859640 1 -- 172.21.15.137:0/1512377075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 msgr2=0x7f3084004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.106+0000 7f309f859640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3084004c80 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f309400c210 tx=0x7f3084005830 comp rx=0 tx=0).stop 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.106+0000 7f309f859640 1 -- 172.21.15.137:0/1512377075 shutdown_connections 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.106+0000 7f309f859640 1 --2- 172.21.15.137:0/1512377075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3084004c80 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.106+0000 7f309f859640 1 -- 172.21.15.137:0/1512377075 >> 172.21.15.137:0/1512377075 conn(0x7f309808eca0 msgr2=0x7f309809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.106+0000 7f309f859640 1 -- 172.21.15.137:0/1512377075 shutdown_connections 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.106+0000 7f309f859640 1 -- 172.21.15.137:0/1512377075 wait complete. 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.107+0000 7f309f859640 1 Processor -- start 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.107+0000 7f309f859640 1 -- start start 2024-04-26T22:04:06.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309f859640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3098153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309f859640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30980ccef0 0x7f30980d2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309f859640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098153ef0 0x7f3098160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309f859640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f30980d5380 con 0x7f3084004800 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309f859640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f30980b5370 con 0x7f30980ccef0 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309f859640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f30980d5500 con 0x7f3098153ef0 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309d5f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3098153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309d5f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3098153780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36200/0 (socket says 172.21.15.137:36200) 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309d5f5640 1 -- 172.21.15.137:0/601621007 learned_addr learned my addr 172.21.15.137:0/601621007 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309ddf6640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098153ef0 0x7f3098160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309d5f5640 1 -- 172.21.15.137:0/601621007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098153ef0 msgr2=0x7f3098160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309cdf4640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30980ccef0 0x7f30980d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309d5f5640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098153ef0 0x7f3098160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309d5f5640 1 -- 172.21.15.137:0/601621007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30980ccef0 msgr2=0x7f30980d2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309d5f5640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30980ccef0 0x7f30980d2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309d5f5640 1 -- 172.21.15.137:0/601621007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3098153cc0 con 0x7f3084004800 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f309d5f5640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3098153780 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f308c00e480 tx=0x7f308c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.108+0000 7f3089ffb640 1 -- 172.21.15.137:0/601621007 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c0052e0 con 0x7f3084004800 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.109+0000 7f3089ffb640 1 -- 172.21.15.137:0/601621007 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308c007020 con 0x7f3084004800 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.109+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30981624a0 con 0x7f3084004800 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.109+0000 7f3089ffb640 1 -- 172.21.15.137:0/601621007 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c007210 con 0x7f3084004800 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.109+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30980d1910 con 0x7f3084004800 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.110+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309806a290 con 0x7f3084004800 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.110+0000 7f3089ffb640 1 -- 172.21.15.137:0/601621007 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f308c01a020 con 0x7f3084004800 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.110+0000 7f3089ffb640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c8f0 0x7f307c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.111+0000 7f3089ffb640 1 -- 172.21.15.137:0/601621007 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f308c08add0 con 0x7f3084004800 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.111+0000 7f309cdf4640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c8f0 0x7f307c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.111+0000 7f309cdf4640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c8f0 0x7f307c06edb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3094032000 tx=0x7f309402d000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:06.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.115+0000 7f3089ffb640 1 -- 172.21.15.137:0/601621007 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f308c059530 con 0x7f3084004800 2024-04-26T22:04:06.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.302+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f30980b4cd0 con 0x7f3084004800 2024-04-26T22:04:06.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.305+0000 7f3089ffb640 1 -- 172.21.15.137:0/601621007 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f308c058e30 con 0x7f3084004800 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c8f0 msgr2=0x7f307c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c8f0 0x7f307c06edb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3094032000 tx=0x7f309402d000 comp rx=0 tx=0).stop 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 msgr2=0x7f3098153780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3098153780 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f308c00e480 tx=0x7f308c00e940 comp rx=0 tx=0).stop 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 shutdown_connections 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f307c06c8f0 0x7f307c06edb0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3098153ef0 0x7f3098160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30980ccef0 0x7f30980d2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 --2- 172.21.15.137:0/601621007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3084004800 0x7f3098153780 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 >> 172.21.15.137:0/601621007 conn(0x7f309808eca0 msgr2=0x7f30980b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 shutdown_connections 2024-04-26T22:04:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.307+0000 7f309f859640 1 -- 172.21.15.137:0/601621007 wait complete. 2024-04-26T22:04:06.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-26T22:04:06.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.415+0000 7f075d237640 1 Processor -- start 2024-04-26T22:04:06.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.415+0000 7f075d237640 1 -- start start 2024-04-26T22:04:06.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.416+0000 7f075d237640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758140350 0x7f07580cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.416+0000 7f075d237640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0758146790 0x7f07580cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.416+0000 7f075d237640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07580d05b0 con 0x7f075813ff70 2024-04-26T22:04:06.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.416+0000 7f075d237640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f07580d0890 con 0x7f0758146790 2024-04-26T22:04:06.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.416+0000 7f075d237640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f075806e450 con 0x7f0758140350 2024-04-26T22:04:06.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.416+0000 7f075759e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0758146790 0x7f07580cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.416+0000 7f075759e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0758146790 0x7f07580cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36210/0 (socket says 172.21.15.137:36210) 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.416+0000 7f075759e640 1 -- 172.21.15.137:0/1677749406 learned_addr learned my addr 172.21.15.137:0/1677749406 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.416+0000 7f075659c640 1 --2- 172.21.15.137:0/1677749406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758140350 0x7f07580cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.417+0000 7f075759e640 1 -- 172.21.15.137:0/1677749406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758140350 msgr2=0x7f07580cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.417+0000 7f075759e640 1 --2- 172.21.15.137:0/1677749406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758140350 0x7f07580cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.417+0000 7f075759e640 1 -- 172.21.15.137:0/1677749406 >> v1:172.21.15.170:6789/0 conn(0x7f075813ff70 legacy=0x7f0758146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.417+0000 7f075759e640 1 -- 172.21.15.137:0/1677749406 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075806e730 con 0x7f0758146790 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.417+0000 7f075659c640 1 --2- 172.21.15.137:0/1677749406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758140350 0x7f07580cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.417+0000 7f075759e640 1 --2- 172.21.15.137:0/1677749406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0758146790 0x7f07580cfd50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f0750009e50 tx=0x7f075002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c888f01e0a7820dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.417+0000 7f0755d9b640 1 -- 172.21.15.137:0/1677749406 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0750036070 con 0x7f0758146790 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.417+0000 7f0755d9b640 1 -- 172.21.15.137:0/1677749406 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0750031600 con 0x7f0758146790 2024-04-26T22:04:06.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.417+0000 7f0755d9b640 1 -- 172.21.15.137:0/1677749406 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500319d0 con 0x7f0758146790 2024-04-26T22:04:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.418+0000 7f075d237640 1 -- 172.21.15.137:0/1677749406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0758146790 msgr2=0x7f07580cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.418+0000 7f075d237640 1 --2- 172.21.15.137:0/1677749406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0758146790 0x7f07580cfd50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f0750009e50 tx=0x7f075002a680 comp rx=0 tx=0).stop 2024-04-26T22:04:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.418+0000 7f075d237640 1 -- 172.21.15.137:0/1677749406 shutdown_connections 2024-04-26T22:04:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.418+0000 7f075d237640 1 --2- 172.21.15.137:0/1677749406 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0758146790 0x7f07580cfd50 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.418+0000 7f075d237640 1 --2- 172.21.15.137:0/1677749406 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758140350 0x7f07580cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.418+0000 7f075d237640 1 -- 172.21.15.137:0/1677749406 >> 172.21.15.137:0/1677749406 conn(0x7f07580d0d30 msgr2=0x7f07580d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.418+0000 7f075d237640 1 -- 172.21.15.137:0/1677749406 shutdown_connections 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.418+0000 7f075d237640 1 -- 172.21.15.137:0/1677749406 wait complete. 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.419+0000 7f075d237640 1 Processor -- start 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.419+0000 7f075d237640 1 -- start start 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f075d237640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f075813ff70 0x7f0758143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f075d237640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0758140350 0x7f075815dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f075d237640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758146790 0x7f07580b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f075d237640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f075806edd0 con 0x7f075813ff70 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f075d237640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f075806ec50 con 0x7f0758140350 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f075d237640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f075806ef50 con 0x7f0758146790 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f0756d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f075813ff70 0x7f0758143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f0756d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f075813ff70 0x7f0758143b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36216/0 (socket says 172.21.15.137:36216) 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f0756d9d640 1 -- 172.21.15.137:0/1949752939 learned_addr learned my addr 172.21.15.137:0/1949752939 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f075759e640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758146790 0x7f07580b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.420+0000 7f075659c640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0758140350 0x7f075815dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f0756d9d640 1 -- 172.21.15.137:0/1949752939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758146790 msgr2=0x7f07580b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f0756d9d640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758146790 0x7f07580b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f0756d9d640 1 -- 172.21.15.137:0/1949752939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0758140350 msgr2=0x7f075815dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f0756d9d640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0758140350 0x7f075815dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f0756d9d640 1 -- 172.21.15.137:0/1949752939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0758144220 con 0x7f075813ff70 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f0756d9d640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f075813ff70 0x7f0758143b20 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c400 tx=0x7f074c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f073f7fe640 1 -- 172.21.15.137:0/1949752939 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c0052d0 con 0x7f075813ff70 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f073f7fe640 1 -- 172.21.15.137:0/1949752939 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c005490 con 0x7f075813ff70 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0758144500 con 0x7f075813ff70 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f073f7fe640 1 -- 172.21.15.137:0/1949752939 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c007260 con 0x7f075813ff70 2024-04-26T22:04:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.421+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0758144ac0 con 0x7f075813ff70 2024-04-26T22:04:06.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.422+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f075806a290 con 0x7f075813ff70 2024-04-26T22:04:06.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.422+0000 7f073f7fe640 1 -- 172.21.15.137:0/1949752939 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f074c007400 con 0x7f075813ff70 2024-04-26T22:04:06.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.423+0000 7f073f7fe640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f074406c8f0 0x7f074406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:06.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.423+0000 7f075659c640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f074406c8f0 0x7f074406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:06.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.423+0000 7f073f7fe640 1 -- 172.21.15.137:0/1949752939 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f074c08ae10 con 0x7f075813ff70 2024-04-26T22:04:06.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.423+0000 7f075659c640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f074406c8f0 0x7f074406edb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f075815e510 tx=0x7f0748008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.427+0000 7f073f7fe640 1 -- 172.21.15.137:0/1949752939 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f074c058e10 con 0x7f075813ff70 2024-04-26T22:04:06.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.669+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) -- 0x7f07580b2850 con 0x7f075813ff70 2024-04-26T22:04:06.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.989+0000 7f073f7fe640 1 -- 172.21.15.137:0/1949752939 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v270) ==== 166+0+0 (secure 0 0 0) 0x7f074c05d110 con 0x7f075813ff70 2024-04-26T22:04:06.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.990+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f074406c8f0 msgr2=0x7f074406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.990+0000 7f075d237640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f074406c8f0 0x7f074406edb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f075815e510 tx=0x7f0748008040 comp rx=0 tx=0).stop 2024-04-26T22:04:06.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.990+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f075813ff70 msgr2=0x7f0758143b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:06.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.990+0000 7f075d237640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f075813ff70 0x7f0758143b20 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c400 tx=0x7f074c00c8c0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.991+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 shutdown_connections 2024-04-26T22:04:06.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.991+0000 7f075d237640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f074406c8f0 0x7f074406edb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.991+0000 7f075d237640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0758146790 0x7f07580b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.991+0000 7f075d237640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0758140350 0x7f075815dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.991+0000 7f075d237640 1 --2- 172.21.15.137:0/1949752939 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f075813ff70 0x7f0758143b20 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.991+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 >> 172.21.15.137:0/1949752939 conn(0x7f07580d0d30 msgr2=0x7f0758140730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.991+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 shutdown_connections 2024-04-26T22:04:06.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:06.991+0000 7f075d237640 1 -- 172.21.15.137:0/1949752939 wait complete. 2024-04-26T22:04:07.002 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-26T22:04:07.002 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-26T22:04:07.002 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-26T22:04:07.002 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:04:07.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.099+0000 7f71abca2640 1 Processor -- start 2024-04-26T22:04:07.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.100+0000 7f71abca2640 1 -- start start 2024-04-26T22:04:07.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.100+0000 7f71abca2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 0x7f71a40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.100+0000 7f71abca2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f71a409c450 0x7f71a40ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.100+0000 7f71abca2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a40cda60 con 0x7f71a40d1510 2024-04-26T22:04:07.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.100+0000 7f71abca2640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f71a415d740 con 0x7f71a409c450 2024-04-26T22:04:07.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.100+0000 7f71abca2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f71a40d1100 con 0x7f71a415d360 2024-04-26T22:04:07.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71a923d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f71a409c450 0x7f71a40ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71aa23f640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f71a40d1510 0x7f71a4070310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51734/0 (socket says 172.21.15.137:51734) 2024-04-26T22:04:07.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71aa23f640 1 -- 172.21.15.137:0/3715520642 learned_addr learned my addr 172.21.15.137:0/3715520642 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:07.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71a9a3e640 1 --2- 172.21.15.137:0/3715520642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 0x7f71a40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71a923d640 1 -- 172.21.15.137:0/3715520642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 msgr2=0x7f71a40d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:07.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71a923d640 1 --2- 172.21.15.137:0/3715520642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 0x7f71a40d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71a923d640 1 -- 172.21.15.137:0/3715520642 >> v1:172.21.15.137:6789/0 conn(0x7f71a40d1510 legacy=0x7f71a4070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71a8a3c640 1 -- 172.21.15.137:0/3715520642 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012911386 0 0) 0x7f71a40cda60 con 0x7f71a40d1510 2024-04-26T22:04:07.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71a923d640 1 -- 172.21.15.137:0/3715520642 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a40cdd00 con 0x7f71a409c450 2024-04-26T22:04:07.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.101+0000 7f71a923d640 1 --2- 172.21.15.137:0/3715520642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 0x7f71a40ce7e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f71940097a0 tx=0x7f719402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb2ab5e0f5859e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:07.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71a8a3c640 1 -- 172.21.15.137:0/3715520642 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194037070 con 0x7f71a409c450 2024-04-26T22:04:07.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71a8a3c640 1 -- 172.21.15.137:0/3715520642 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7194032440 con 0x7f71a409c450 2024-04-26T22:04:07.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71a8a3c640 1 -- 172.21.15.137:0/3715520642 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194032810 con 0x7f71a409c450 2024-04-26T22:04:07.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71abca2640 1 -- 172.21.15.137:0/3715520642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 msgr2=0x7f71a40ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71abca2640 1 --2- 172.21.15.137:0/3715520642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 0x7f71a40ce7e0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f71940097a0 tx=0x7f719402a180 comp rx=0 tx=0).stop 2024-04-26T22:04:07.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71abca2640 1 -- 172.21.15.137:0/3715520642 shutdown_connections 2024-04-26T22:04:07.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71abca2640 1 --2- 172.21.15.137:0/3715520642 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 0x7f71a40ce7e0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71abca2640 1 --2- 172.21.15.137:0/3715520642 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 0x7f71a40d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71abca2640 1 -- 172.21.15.137:0/3715520642 >> 172.21.15.137:0/3715520642 conn(0x7f71a40b4a40 msgr2=0x7f71a40b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71abca2640 1 -- 172.21.15.137:0/3715520642 shutdown_connections 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.102+0000 7f71abca2640 1 -- 172.21.15.137:0/3715520642 wait complete. 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.103+0000 7f71abca2640 1 Processor -- start 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.103+0000 7f71abca2640 1 -- start start 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71abca2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 0x7f71a40c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71abca2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a40d1510 0x7f71a4070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71abca2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 0x7f71a4159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71abca2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71a40ced20 con 0x7f71a409c450 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71abca2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f71a409c8b0 con 0x7f71a40d1510 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71abca2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f71a40ceea0 con 0x7f71a415d360 2024-04-26T22:04:07.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71a9a3e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 0x7f71a40c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71a9a3e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 0x7f71a40c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36228/0 (socket says 172.21.15.137:36228) 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71a9a3e640 1 -- 172.21.15.137:0/3861788536 learned_addr learned my addr 172.21.15.137:0/3861788536 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71aa23f640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 0x7f71a4159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.104+0000 7f71a923d640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a40d1510 0x7f71a4070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71a9a3e640 1 -- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 msgr2=0x7f71a4159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71a9a3e640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 0x7f71a4159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71a9a3e640 1 -- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a40d1510 msgr2=0x7f71a4070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71a9a3e640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a40d1510 0x7f71a4070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71a9a3e640 1 -- 172.21.15.137:0/3861788536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a40c7c40 con 0x7f71a409c450 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71aa23f640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 0x7f71a4159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71a923d640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a40d1510 0x7f71a4070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:07.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71a9a3e640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 0x7f71a40c7700 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f71a000d800 tx=0x7f71a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f719a7fc640 1 -- 172.21.15.137:0/3861788536 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a000b6c0 con 0x7f71a409c450 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f719a7fc640 1 -- 172.21.15.137:0/3861788536 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a0019070 con 0x7f71a409c450 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a40cad80 con 0x7f71a409c450 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f719a7fc640 1 -- 172.21.15.137:0/3861788536 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a000bac0 con 0x7f71a409c450 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.105+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a40c6f00 con 0x7f71a409c450 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.106+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a40693d0 con 0x7f71a409c450 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.106+0000 7f719a7fc640 1 -- 172.21.15.137:0/3861788536 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f71a000bc60 con 0x7f71a409c450 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.107+0000 7f719a7fc640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718806c8f0 0x7f718806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.107+0000 7f719a7fc640 1 -- 172.21.15.137:0/3861788536 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f71a008bdc0 con 0x7f71a409c450 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.107+0000 7f71a923d640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718806c8f0 0x7f718806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.107+0000 7f71a923d640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718806c8f0 0x7f718806edb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7194034000 tx=0x7f719402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:07.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.111+0000 7f719a7fc640 1 -- 172.21.15.137:0/3861788536 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f71a005a490 con 0x7f71a409c450 2024-04-26T22:04:07.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.288+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71a4161c70 con 0x7f71a409c450 2024-04-26T22:04:07.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.288+0000 7f719a7fc640 1 -- 172.21.15.137:0/3861788536 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+13167 (secure 0 0 0) 0x7f71a0059d90 con 0x7f71a409c450 2024-04-26T22:04:07.289 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:07.289 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":78,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:04:05.979274+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/2422385986":"2024-04-27T22:04:02.973993+0000","172.21.15.137:6835/2422385986":"2024-04-27T22:04:02.973993+0000","172.21.15.137:6837/1566574554":"2024-04-27T22:02:45.720691+0000","172.21.15.137:6835/1566574554":"2024-04-27T22:02:45.720691+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.290+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718806c8f0 msgr2=0x7f718806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.290+0000 7f71abca2640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718806c8f0 0x7f718806edb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7194034000 tx=0x7f719402e000 comp rx=0 tx=0).stop 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.290+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 msgr2=0x7f71a40c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.290+0000 7f71abca2640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 0x7f71a40c7700 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f71a000d800 tx=0x7f71a000dcc0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.290+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 shutdown_connections 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.290+0000 7f71abca2640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718806c8f0 0x7f718806edb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.290+0000 7f71abca2640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a415d360 0x7f71a4159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.291+0000 7f71abca2640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a40d1510 0x7f71a4070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.291+0000 7f71abca2640 1 --2- 172.21.15.137:0/3861788536 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f71a409c450 0x7f71a40c7700 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.291+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 >> 172.21.15.137:0/3861788536 conn(0x7f71a40b4a40 msgr2=0x7f71a40b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.291+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 shutdown_connections 2024-04-26T22:04:07.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.291+0000 7f71abca2640 1 -- 172.21.15.137:0/3861788536 wait complete. 2024-04-26T22:04:07.302 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:04:07.302 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:04:07.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.402+0000 7f88f110a640 1 Processor -- start 2024-04-26T22:04:07.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.402+0000 7f88f110a640 1 -- start start 2024-04-26T22:04:07.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88f110a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f88ec15f470 0x7f88ec0af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88f110a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f88ec069ae0 0x7f88ec0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88f110a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ec0aeb50 con 0x7f88ec0b03e0 2024-04-26T22:04:07.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88f110a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f88ec0aee30 con 0x7f88ec15f470 2024-04-26T22:04:07.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88f110a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f88ec0af110 con 0x7f88ec069ae0 2024-04-26T22:04:07.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88ead9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f88ec15f470 0x7f88ec0af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88ead9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f88ec15f470 0x7f88ec0af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36242/0 (socket says 172.21.15.137:36242) 2024-04-26T22:04:07.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88ead9d640 1 -- 172.21.15.137:0/94458209 learned_addr learned my addr 172.21.15.137:0/94458209 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88ea59c640 1 --2- 172.21.15.137:0/94458209 >> v2:172.21.15.170:3300/0 conn(0x7f88ec069ae0 0x7f88ec0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88ead9d640 1 -- 172.21.15.137:0/94458209 >> v2:172.21.15.170:3300/0 conn(0x7f88ec069ae0 msgr2=0x7f88ec0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88ead9d640 1 --2- 172.21.15.137:0/94458209 >> v2:172.21.15.170:3300/0 conn(0x7f88ec069ae0 0x7f88ec0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88ead9d640 1 -- 172.21.15.137:0/94458209 >> v1:172.21.15.170:6789/0 conn(0x7f88ec0b03e0 legacy=0x7f88ec06e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.403+0000 7f88ead9d640 1 -- 172.21.15.137:0/94458209 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec0af3f0 con 0x7f88ec15f470 2024-04-26T22:04:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.404+0000 7f88ead9d640 1 --2- 172.21.15.137:0/94458209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec15f470 0x7f88ec0af910 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0b3e80 tx=0x7f88dc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e972d1d33ca8aa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.404+0000 7f88e9d9b640 1 -- 172.21.15.137:0/94458209 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc037070 con 0x7f88ec15f470 2024-04-26T22:04:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.404+0000 7f88e9d9b640 1 -- 172.21.15.137:0/94458209 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88dc032440 con 0x7f88ec15f470 2024-04-26T22:04:07.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.404+0000 7f88e9d9b640 1 -- 172.21.15.137:0/94458209 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88dc032810 con 0x7f88ec15f470 2024-04-26T22:04:07.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.405+0000 7f88f110a640 1 -- 172.21.15.137:0/94458209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec15f470 msgr2=0x7f88ec0af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.405+0000 7f88f110a640 1 --2- 172.21.15.137:0/94458209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec15f470 0x7f88ec0af910 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0b3e80 tx=0x7f88dc02a230 comp rx=0 tx=0).stop 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.405+0000 7f88f110a640 1 -- 172.21.15.137:0/94458209 shutdown_connections 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.405+0000 7f88f110a640 1 --2- 172.21.15.137:0/94458209 >> v2:172.21.15.170:3300/0 conn(0x7f88ec069ae0 0x7f88ec0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.405+0000 7f88f110a640 1 --2- 172.21.15.137:0/94458209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec15f470 0x7f88ec0af910 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.405+0000 7f88f110a640 1 -- 172.21.15.137:0/94458209 >> 172.21.15.137:0/94458209 conn(0x7f88ec073910 msgr2=0x7f88ec073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.405+0000 7f88f110a640 1 -- 172.21.15.137:0/94458209 shutdown_connections 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.405+0000 7f88f110a640 1 -- 172.21.15.137:0/94458209 wait complete. 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.406+0000 7f88f110a640 1 Processor -- start 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.406+0000 7f88f110a640 1 -- start start 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88f110a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88ec069ae0 0x7f88ec154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88f110a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec0b03e0 0x7f88ec1445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88f110a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88ec15f470 0x7f88ec153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88f110a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec0b63a0 con 0x7f88ec0b03e0 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88f110a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec0b6220 con 0x7f88ec069ae0 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88f110a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f88ec0afe50 con 0x7f88ec15f470 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ea59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec0b03e0 0x7f88ec1445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ea59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec0b03e0 0x7f88ec1445f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36252/0 (socket says 172.21.15.137:36252) 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ea59c640 1 -- 172.21.15.137:0/3484381565 learned_addr learned my addr 172.21.15.137:0/3484381565 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ead9d640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88ec069ae0 0x7f88ec154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88eb59e640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88ec15f470 0x7f88ec153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ea59c640 1 -- 172.21.15.137:0/3484381565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88ec15f470 msgr2=0x7f88ec153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ea59c640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88ec15f470 0x7f88ec153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ea59c640 1 -- 172.21.15.137:0/3484381565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88ec069ae0 msgr2=0x7f88ec154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ea59c640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88ec069ae0 0x7f88ec154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ea59c640 1 -- 172.21.15.137:0/3484381565 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec153f00 con 0x7f88ec0b03e0 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88eb59e640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88ec15f470 0x7f88ec153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.407+0000 7f88ea59c640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec0b03e0 0x7f88ec1445f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f88e000d830 tx=0x7f88e000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.408+0000 7f88d37fe640 1 -- 172.21.15.137:0/3484381565 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e000b660 con 0x7f88ec0b03e0 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.408+0000 7f88d37fe640 1 -- 172.21.15.137:0/3484381565 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e0019070 con 0x7f88ec0b03e0 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.408+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec1541e0 con 0x7f88ec0b03e0 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.408+0000 7f88d37fe640 1 -- 172.21.15.137:0/3484381565 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e000ba20 con 0x7f88ec0b03e0 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.408+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ec1547a0 con 0x7f88ec0b03e0 2024-04-26T22:04:07.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.409+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ec06a290 con 0x7f88ec0b03e0 2024-04-26T22:04:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.409+0000 7f88d37fe640 1 -- 172.21.15.137:0/3484381565 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f88e001e460 con 0x7f88ec0b03e0 2024-04-26T22:04:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.410+0000 7f88d37fe640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f88d806c8f0 0x7f88d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.410+0000 7f88ead9d640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f88d806c8f0 0x7f88d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.410+0000 7f88d37fe640 1 -- 172.21.15.137:0/3484381565 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f88e008be90 con 0x7f88ec0b03e0 2024-04-26T22:04:07.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.410+0000 7f88ead9d640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f88d806c8f0 0x7f88d806edb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f88dc034000 tx=0x7f88dc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:07.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.414+0000 7f88d37fe640 1 -- 172.21.15.137:0/3484381565 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f88e005a560 con 0x7f88ec0b03e0 2024-04-26T22:04:07.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.588+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f88ec073f40 con 0x7f88ec0b03e0 2024-04-26T22:04:07.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.589+0000 7f88d37fe640 1 -- 172.21.15.137:0/3484381565 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f88e0059e60 con 0x7f88ec0b03e0 2024-04-26T22:04:07.589 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:04:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f88d806c8f0 msgr2=0x7f88d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f88d806c8f0 0x7f88d806edb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f88dc034000 tx=0x7f88dc02e000 comp rx=0 tx=0).stop 2024-04-26T22:04:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec0b03e0 msgr2=0x7f88ec1445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec0b03e0 0x7f88ec1445f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f88e000d830 tx=0x7f88e000dcf0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 shutdown_connections 2024-04-26T22:04:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f88d806c8f0 0x7f88d806edb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f88ec0b03e0 0x7f88ec1445f0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f88ec15f470 0x7f88ec153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 --2- 172.21.15.137:0/3484381565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88ec069ae0 0x7f88ec154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 >> 172.21.15.137:0/3484381565 conn(0x7f88ec073910 msgr2=0x7f88ec15cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 shutdown_connections 2024-04-26T22:04:07.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.591+0000 7f88f110a640 1 -- 172.21.15.137:0/3484381565 wait complete. 2024-04-26T22:04:07.602 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-26T22:04:07.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.700+0000 7f61526f8640 1 Processor -- start 2024-04-26T22:04:07.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.700+0000 7f61526f8640 1 -- start start 2024-04-26T22:04:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f61526f8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f614c146980 0x7f614c073bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f61526f8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c161850 0x7f614c0740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f61526f8640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c15e2e0 con 0x7f614c15d6b0 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f61526f8640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f614c15e5c0 con 0x7f614c146980 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f61526f8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f614c1613c0 con 0x7f614c161850 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f614bfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f614c146980 0x7f614c073bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f6150c95640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f614c15d6b0 0x7f614c06c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51750/0 (socket says 172.21.15.137:51750) 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f6150c95640 1 -- 172.21.15.137:0/1867273801 learned_addr learned my addr 172.21.15.137:0/1867273801 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f614b7fe640 1 --2- 172.21.15.137:0/1867273801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c161850 0x7f614c0740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f614bfff640 1 -- 172.21.15.137:0/1867273801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c161850 msgr2=0x7f614c0740f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f614bfff640 1 --2- 172.21.15.137:0/1867273801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c161850 0x7f614c0740f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f614bfff640 1 -- 172.21.15.137:0/1867273801 >> v1:172.21.15.137:6789/0 conn(0x7f614c15d6b0 legacy=0x7f614c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f614bfff640 1 -- 172.21.15.137:0/1867273801 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c160d70 con 0x7f614c146980 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.701+0000 7f614affd640 1 -- 172.21.15.137:0/1867273801 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844038693 0 0) 0x7f614c15e2e0 con 0x7f614c15d6b0 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f614bfff640 1 --2- 172.21.15.137:0/1867273801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c146980 0x7f614c073bb0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f613c0097a0 tx=0x7f613c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4080cd568eb326 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f614affd640 1 -- 172.21.15.137:0/1867273801 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c037070 con 0x7f614c146980 2024-04-26T22:04:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f614affd640 1 -- 172.21.15.137:0/1867273801 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f613c032440 con 0x7f614c146980 2024-04-26T22:04:07.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f614affd640 1 -- 172.21.15.137:0/1867273801 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c032810 con 0x7f614c146980 2024-04-26T22:04:07.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f61526f8640 1 -- 172.21.15.137:0/1867273801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c146980 msgr2=0x7f614c073bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f61526f8640 1 --2- 172.21.15.137:0/1867273801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c146980 0x7f614c073bb0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f613c0097a0 tx=0x7f613c02a180 comp rx=0 tx=0).stop 2024-04-26T22:04:07.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f61526f8640 1 -- 172.21.15.137:0/1867273801 shutdown_connections 2024-04-26T22:04:07.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f61526f8640 1 --2- 172.21.15.137:0/1867273801 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c161850 0x7f614c0740f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f61526f8640 1 --2- 172.21.15.137:0/1867273801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c146980 0x7f614c073bb0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f61526f8640 1 -- 172.21.15.137:0/1867273801 >> 172.21.15.137:0/1867273801 conn(0x7f614c0ce8b0 msgr2=0x7f614c0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:07.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f61526f8640 1 -- 172.21.15.137:0/1867273801 shutdown_connections 2024-04-26T22:04:07.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.702+0000 7f61526f8640 1 -- 172.21.15.137:0/1867273801 wait complete. 2024-04-26T22:04:07.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.703+0000 7f61526f8640 1 Processor -- start 2024-04-26T22:04:07.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f61526f8640 1 -- start start 2024-04-26T22:04:07.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f61526f8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c146980 0x7f614c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f61526f8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c15d6b0 0x7f614c15c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f61526f8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c161850 0x7f614c13fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f61526f8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f614c146d60 con 0x7f614c15d6b0 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f61526f8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f614c0b5120 con 0x7f614c161850 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f61526f8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f614c15db40 con 0x7f614c146980 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c15d6b0 0x7f614c15c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f614b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c15d6b0 0x7f614c15c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36284/0 (socket says 172.21.15.137:36284) 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.704+0000 7f614b7fe640 1 -- 172.21.15.137:0/3119165992 learned_addr learned my addr 172.21.15.137:0/3119165992 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f6150c95640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c161850 0x7f614c13fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f614bfff640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c146980 0x7f614c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f614b7fe640 1 -- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c146980 msgr2=0x7f614c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f614b7fe640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c146980 0x7f614c154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f614b7fe640 1 -- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c161850 msgr2=0x7f614c13fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f614b7fe640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c161850 0x7f614c13fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f614b7fe640 1 -- 172.21.15.137:0/3119165992 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c15ce00 con 0x7f614c15d6b0 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f6150c95640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c161850 0x7f614c13fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:07.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f614bfff640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c146980 0x7f614c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f614b7fe640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c15d6b0 0x7f614c15c700 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f614000d5f0 tx=0x7f614000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f6148ff9640 1 -- 172.21.15.137:0/3119165992 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400125f0 con 0x7f614c15d6b0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f6148ff9640 1 -- 172.21.15.137:0/3119165992 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6140019070 con 0x7f614c15d6b0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c140140 con 0x7f614c15d6b0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f6148ff9640 1 -- 172.21.15.137:0/3119165992 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61400129d0 con 0x7f614c15d6b0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.705+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c140700 con 0x7f614c15d6b0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.706+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c06a290 con 0x7f614c15d6b0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.707+0000 7f6148ff9640 1 -- 172.21.15.137:0/3119165992 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6140012b70 con 0x7f614c15d6b0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.707+0000 7f6148ff9640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f613806c8f0 0x7f613806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.707+0000 7f6148ff9640 1 -- 172.21.15.137:0/3119165992 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f614008bbc0 con 0x7f614c15d6b0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.707+0000 7f614bfff640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f613806c8f0 0x7f613806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:07.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.707+0000 7f614bfff640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f613806c8f0 0x7f613806edb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f613c034000 tx=0x7f613c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:07.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.711+0000 7f6148ff9640 1 -- 172.21.15.137:0/3119165992 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f614005a320 con 0x7f614c15d6b0 2024-04-26T22:04:07.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.955+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7f614c0b4500 con 0x7f614c15d6b0 2024-04-26T22:04:07.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.990+0000 7f6148ff9640 1 -- 172.21.15.137:0/3119165992 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v271) ==== 170+0+0 (secure 0 0 0) 0x7f6140059c20 con 0x7f614c15d6b0 2024-04-26T22:04:07.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f613806c8f0 msgr2=0x7f613806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f613806c8f0 0x7f613806edb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f613c034000 tx=0x7f613c02e000 comp rx=0 tx=0).stop 2024-04-26T22:04:07.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c15d6b0 msgr2=0x7f614c15c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:07.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c15d6b0 0x7f614c15c700 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f614000d5f0 tx=0x7f614000dab0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 shutdown_connections 2024-04-26T22:04:07.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f613806c8f0 0x7f613806edb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f614c15d6b0 0x7f614c15c700 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f614c161850 0x7f614c13fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 --2- 172.21.15.137:0/3119165992 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f614c146980 0x7f614c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:07.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 >> 172.21.15.137:0/3119165992 conn(0x7f614c0ce8b0 msgr2=0x7f614c1446c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:07.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 shutdown_connections 2024-04-26T22:04:07.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:07.992+0000 7f61526f8640 1 -- 172.21.15.137:0/3119165992 wait complete. 2024-04-26T22:04:08.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T22:04:08.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.103+0000 7f447b4f8640 1 Processor -- start 2024-04-26T22:04:08.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.104+0000 7f447b4f8640 1 -- start start 2024-04-26T22:04:08.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.104+0000 7f447b4f8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f44740b4eb0 0x7f44740b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.104+0000 7f447b4f8640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447415dca0 con 0x7f44740ceff0 2024-04-26T22:04:08.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.104+0000 7f447b4f8640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447415df80 con 0x7f4474143840 2024-04-26T22:04:08.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.104+0000 7f447b4f8640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4474143c20 con 0x7f44740b4eb0 2024-04-26T22:04:08.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f4479a95640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f44740ceff0 0x7f44740cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51756/0 (socket says 172.21.15.137:51756) 2024-04-26T22:04:08.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f4479a95640 1 -- 172.21.15.137:0/385623738 learned_addr learned my addr 172.21.15.137:0/385623738 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:08.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f4478a93640 1 --2- 172.21.15.137:0/385623738 >> v2:172.21.15.170:3300/0 conn(0x7f44740b4eb0 0x7f44740b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441324427 0 0) 0x7f447415dca0 con 0x7f44740ceff0 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4460003520 con 0x7f44740ceff0 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3995965691 0 0) 0x7f4460003520 con 0x7f44740ceff0 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 >> v2:172.21.15.170:3300/0 conn(0x7f44740b4eb0 msgr2=0x7f44740b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 --2- 172.21.15.137:0/385623738 >> v2:172.21.15.170:3300/0 conn(0x7f44740b4eb0 0x7f44740b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 >> v1:172.21.15.170:6789/0 conn(0x7f4474143840 legacy=0x7f44740b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447415e260 con 0x7f44740ceff0 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f446c0019f0 con 0x7f44740ceff0 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 >> v1:172.21.15.137:6789/0 conn(0x7f44740ceff0 legacy=0x7f44740cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44600039b0 0x7f4460003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4460004800 0x7f4460004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f446000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4474143c20 con 0x7f44600051c0 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f446000c090 con 0x7f44600039b0 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f446000c290 con 0x7f4460004800 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f4479a95640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f446000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f4479294640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44600039b0 0x7f4460003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.105+0000 7f4478a93640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4460004800 0x7f4460004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f4479a95640 1 -- 172.21.15.137:0/385623738 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4460004800 msgr2=0x7f4460004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f4479a95640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4460004800 0x7f4460004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f4479a95640 1 -- 172.21.15.137:0/385623738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44600039b0 msgr2=0x7f4460003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f4479a95640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44600039b0 0x7f4460003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f4479a95640 1 -- 172.21.15.137:0/385623738 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4460003520 con 0x7f44600051c0 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f4479294640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44600039b0 0x7f4460003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f4479a95640 1 -- 172.21.15.137:0/385623738 reap_dead start 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f4479a95640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f446000b9c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f446c00a860 tx=0x7f4460005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7719d467252a1ed5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470001370 con 0x7f44600051c0 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f446c02f070 con 0x7f44600051c0 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.106+0000 7f446bfff640 1 -- 172.21.15.137:0/385623738 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446c00a480 con 0x7f44600051c0 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.107+0000 7f447b4f8640 1 -- 172.21.15.137:0/385623738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 msgr2=0x7f446000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.107+0000 7f447b4f8640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f446000b9c0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f446c00a860 tx=0x7f4460005830 comp rx=0 tx=0).stop 2024-04-26T22:04:08.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.107+0000 7f447b4f8640 1 -- 172.21.15.137:0/385623738 shutdown_connections 2024-04-26T22:04:08.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.107+0000 7f447b4f8640 1 --2- 172.21.15.137:0/385623738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f446000b9c0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.107+0000 7f447b4f8640 1 -- 172.21.15.137:0/385623738 >> 172.21.15.137:0/385623738 conn(0x7f44740cd8a0 msgr2=0x7f44740cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:08.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.107+0000 7f447b4f8640 1 -- 172.21.15.137:0/385623738 shutdown_connections 2024-04-26T22:04:08.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.107+0000 7f447b4f8640 1 -- 172.21.15.137:0/385623738 wait complete. 2024-04-26T22:04:08.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.108+0000 7f447b4f8640 1 Processor -- start 2024-04-26T22:04:08.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.108+0000 7f447b4f8640 1 -- start start 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f447b4f8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f44741f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f447b4f8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f447413ba70 0x7f447413f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f447b4f8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447413bef0 0x7f447413fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f447b4f8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f447415da40 con 0x7f44600051c0 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f447b4f8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f447415d8c0 con 0x7f447413bef0 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f447b4f8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f44740b5330 con 0x7f447413ba70 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479294640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f44741f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479294640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f44741f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36302/0 (socket says 172.21.15.137:36302) 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479294640 1 -- 172.21.15.137:0/41911303 learned_addr learned my addr 172.21.15.137:0/41911303 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4478a93640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f447413ba70 0x7f447413f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479a95640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447413bef0 0x7f447413fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479294640 1 -- 172.21.15.137:0/41911303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f447413ba70 msgr2=0x7f447413f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479294640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f447413ba70 0x7f447413f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479294640 1 -- 172.21.15.137:0/41911303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447413bef0 msgr2=0x7f447413fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479294640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447413bef0 0x7f447413fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479294640 1 -- 172.21.15.137:0/41911303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4474144210 con 0x7f44600051c0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.109+0000 7f4479294640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f44741f25b0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f447000f650 tx=0x7f447000fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.110+0000 7f4469ffb640 1 -- 172.21.15.137:0/41911303 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44700050d0 con 0x7f44600051c0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.110+0000 7f4469ffb640 1 -- 172.21.15.137:0/41911303 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4470018070 con 0x7f44600051c0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.110+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44741444f0 con 0x7f44600051c0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.110+0000 7f4469ffb640 1 -- 172.21.15.137:0/41911303 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470005490 con 0x7f44600051c0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.110+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4474144ab0 con 0x7f44600051c0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.111+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f447406a290 con 0x7f44600051c0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.111+0000 7f4469ffb640 1 -- 172.21.15.137:0/41911303 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f447000d730 con 0x7f44600051c0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.112+0000 7f4469ffb640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f445806c8f0 0x7f445806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.112+0000 7f4469ffb640 1 -- 172.21.15.137:0/41911303 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7f447008b6b0 con 0x7f44600051c0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.112+0000 7f4478a93640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f445806c8f0 0x7f445806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.112+0000 7f4478a93640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f445806c8f0 0x7f445806edb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f44740cca50 tx=0x7f4464008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:08.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.116+0000 7f4469ffb640 1 -- 172.21.15.137:0/41911303 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4470059d80 con 0x7f44600051c0 2024-04-26T22:04:08.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.292+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f44740ccd10 con 0x7f44600051c0 2024-04-26T22:04:08.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.297+0000 7f4469ffb640 1 -- 172.21.15.137:0/41911303 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f4470059680 con 0x7f44600051c0 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.299+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f445806c8f0 msgr2=0x7f445806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.299+0000 7f447b4f8640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f445806c8f0 0x7f445806edb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f44740cca50 tx=0x7f4464008040 comp rx=0 tx=0).stop 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.299+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 msgr2=0x7f44741f25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.299+0000 7f447b4f8640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f44741f25b0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f447000f650 tx=0x7f447000fb10 comp rx=0 tx=0).stop 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.300+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 shutdown_connections 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.300+0000 7f447b4f8640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f445806c8f0 0x7f445806edb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.300+0000 7f447b4f8640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447413bef0 0x7f447413fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.300+0000 7f447b4f8640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f447413ba70 0x7f447413f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.300+0000 7f447b4f8640 1 --2- 172.21.15.137:0/41911303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44600051c0 0x7f44741f25b0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.300+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 >> 172.21.15.137:0/41911303 conn(0x7f44740cd8a0 msgr2=0x7f44741413f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.300+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 shutdown_connections 2024-04-26T22:04:08.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.300+0000 7f447b4f8640 1 -- 172.21.15.137:0/41911303 wait complete. 2024-04-26T22:04:08.311 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:04:08.311 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:04:08.354 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:04:08.401 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:04:08.401 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:04:08.401 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:04:08.416 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:04:08.416 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:04:08.416 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:04:08.433 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:04:08.433 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:04:08.433 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:04:08.472 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:04:08.472 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:04:08.472 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:04:08.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:04:08.490 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T22:04:08.490 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.607+0000 7fb774e47640 1 Processor -- start 2024-04-26T22:04:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.607+0000 7fb774e47640 1 -- start start 2024-04-26T22:04:08.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb774e47640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb770160630 0x7fb7700b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb774e47640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7700b4530 con 0x7fb770145980 2024-04-26T22:04:08.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb774e47640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7700b4810 con 0x7fb7700b61a0 2024-04-26T22:04:08.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb774e47640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb770160ac0 con 0x7fb770160630 2024-04-26T22:04:08.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76e59c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb770145980 0x7fb7700b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51770/0 (socket says 172.21.15.137:51770) 2024-04-26T22:04:08.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76e59c640 1 -- 172.21.15.137:0/2945980037 learned_addr learned my addr 172.21.15.137:0/2945980037 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:08.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76ed9d640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb770160630 0x7fb7700b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307928349 0 0) 0x7fb7700b4530 con 0x7fb770145980 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb75c003520 con 0x7fb770145980 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3478176751 0 0) 0x7fb75c003520 con 0x7fb770145980 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb770160630 msgr2=0x7fb7700b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb770160630 0x7fb7700b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 >> v1:172.21.15.170:6789/0 conn(0x7fb7700b61a0 legacy=0x7fb7700720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7700b4af0 con 0x7fb770145980 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fb760001690 con 0x7fb770145980 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 >> v1:172.21.15.137:6789/0 conn(0x7fb770145980 legacy=0x7fb7700b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb75c0039e0 0x7fb75c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb75c004390 0x7fb75c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb770160630 0x7fb75c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c00ba70 con 0x7fb75c004390 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb75c00bc20 con 0x7fb75c0039e0 2024-04-26T22:04:08.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb75c00be20 con 0x7fb770160630 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb765d9b640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb75c004390 0x7fb75c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.608+0000 7fb76e59c640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb75c0039e0 0x7fb75c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.609+0000 7fb76ed9d640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb770160630 0x7fb75c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.609+0000 7fb765d9b640 1 -- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb770160630 msgr2=0x7fb75c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.609+0000 7fb765d9b640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb770160630 0x7fb75c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.609+0000 7fb765d9b640 1 -- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb75c0039e0 msgr2=0x7fb75c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.609+0000 7fb765d9b640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb75c0039e0 0x7fb75c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.609+0000 7fb765d9b640 1 -- 172.21.15.137:0/2945980037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75c003520 con 0x7fb75c004390 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.609+0000 7fb765d9b640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb75c004390 0x7fb75c004860 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb758001910 tx=0x7fb75c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8010aa210be25f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.609+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758037070 con 0x7fb75c004390 2024-04-26T22:04:08.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.610+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75802ac40 con 0x7fb75c004390 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.610+0000 7fb76dd9b640 1 -- 172.21.15.137:0/2945980037 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7580014e0 con 0x7fb75c004390 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.610+0000 7fb774e47640 1 -- 172.21.15.137:0/2945980037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb75c004390 msgr2=0x7fb75c004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.610+0000 7fb774e47640 1 --2- 172.21.15.137:0/2945980037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb75c004390 0x7fb75c004860 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fb758001910 tx=0x7fb75c005830 comp rx=0 tx=0).stop 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.610+0000 7fb76ed9d640 1 -- 172.21.15.137:0/2945980037 reap_dead start 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.610+0000 7fb774e47640 1 -- 172.21.15.137:0/2945980037 shutdown_connections 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.610+0000 7fb774e47640 1 -- 172.21.15.137:0/2945980037 >> 172.21.15.137:0/2945980037 conn(0x7fb7700d0d30 msgr2=0x7fb7700d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.610+0000 7fb774e47640 1 -- 172.21.15.137:0/2945980037 shutdown_connections 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.610+0000 7fb774e47640 1 -- 172.21.15.137:0/2945980037 wait complete. 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.611+0000 7fb774e47640 1 Processor -- start 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb774e47640 1 -- start start 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb774e47640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb75c004390 0x7fb7700b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb774e47640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77015ffc0 0x7fb77015f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb774e47640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7700b0830 0x7fb77013bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb774e47640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb7700b3de0 con 0x7fb7700b0830 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb774e47640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb7700b5140 con 0x7fb75c004390 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb774e47640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb7700b3f60 con 0x7fb77015ffc0 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb76ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7700b0830 0x7fb77013bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb76ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7700b0830 0x7fb77013bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36322/0 (socket says 172.21.15.137:36322) 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb76ed9d640 1 -- 172.21.15.137:0/1558777561 learned_addr learned my addr 172.21.15.137:0/1558777561 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb76e59c640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb75c004390 0x7fb7700b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.612+0000 7fb765d9b640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77015ffc0 0x7fb77015f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb76ed9d640 1 -- 172.21.15.137:0/1558777561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77015ffc0 msgr2=0x7fb77015f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb76ed9d640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77015ffc0 0x7fb77015f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb76ed9d640 1 -- 172.21.15.137:0/1558777561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb75c004390 msgr2=0x7fb7700b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb76ed9d640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb75c004390 0x7fb7700b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb76ed9d640 1 -- 172.21.15.137:0/1558777561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7700b2580 con 0x7fb7700b0830 2024-04-26T22:04:08.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb76ed9d640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7700b0830 0x7fb77013bef0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb7700b6fc0 tx=0x7fb76800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb7677fe640 1 -- 172.21.15.137:0/1558777561 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768015430 con 0x7fb7700b0830 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb7677fe640 1 -- 172.21.15.137:0/1558777561 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76801d070 con 0x7fb7700b0830 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7700b2860 con 0x7fb7700b0830 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb7677fe640 1 -- 172.21.15.137:0/1558777561 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768015830 con 0x7fb7700b0830 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.613+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77013b9d0 con 0x7fb7700b0830 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.614+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77006a290 con 0x7fb7700b0830 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.614+0000 7fb7677fe640 1 -- 172.21.15.137:0/1558777561 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7680159d0 con 0x7fb7700b0830 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.615+0000 7fb7677fe640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb75006c920 0x7fb75006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.615+0000 7fb7677fe640 1 -- 172.21.15.137:0/1558777561 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5029+0+0 (secure 0 0 0) 0x7fb76808c0d0 con 0x7fb7700b0830 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.615+0000 7fb76e59c640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb75006c920 0x7fb75006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:08.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.615+0000 7fb76e59c640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb75006c920 0x7fb75006ede0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb760000c00 tx=0x7fb760001e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:08.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.619+0000 7fb7677fe640 1 -- 172.21.15.137:0/1558777561 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb768010040 con 0x7fb7700b0830 2024-04-26T22:04:08.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.831+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb770073cc0 con 0x7fb7700b0830 2024-04-26T22:04:08.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.832+0000 7fb7677fe640 1 -- 172.21.15.137:0/1558777561 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+3878 (secure 0 0 0) 0x7fb76805a150 con 0x7fb7700b0830 2024-04-26T22:04:08.836 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:08.836 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5507,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2376649836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2376649836},{"type":"v1","addr":"172.21.15.170:6835","nonce":2376649836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5938,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/3937352176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3937352176},{"type":"v1","addr":"172.21.15.170:6834","nonce":3937352176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1129562028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1129562028},{"type":"v1","addr":"172.21.15.137:6836","nonce":1129562028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":7233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/503632463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":503632463},{"type":"v1","addr":"172.21.15.137:6837","nonce":503632463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[]} 2024-04-26T22:04:08.837 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 43 2024-04-26T22:04:08.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb75006c920 msgr2=0x7fb75006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb75006c920 0x7fb75006ede0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb760000c00 tx=0x7fb760001e40 comp rx=0 tx=0).stop 2024-04-26T22:04:08.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7700b0830 msgr2=0x7fb77013bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:08.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7700b0830 0x7fb77013bef0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fb7700b6fc0 tx=0x7fb76800f580 comp rx=0 tx=0).stop 2024-04-26T22:04:08.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 shutdown_connections 2024-04-26T22:04:08.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb75006c920 0x7fb75006ede0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb7700b0830 0x7fb77013bef0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb77015ffc0 0x7fb77015f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 --2- 172.21.15.137:0/1558777561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb75c004390 0x7fb7700b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:08.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 >> 172.21.15.137:0/1558777561 conn(0x7fb7700d0d30 msgr2=0x7fb7700cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:08.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 shutdown_connections 2024-04-26T22:04:08.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:08.834+0000 7fb774e47640 1 -- 172.21.15.137:0/1558777561 wait complete. 2024-04-26T22:04:08.846 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T22:04:08.846 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T22:04:08.847 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:04:08.847 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:08.847 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T22:04:08.847 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T22:04:08.847 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T22:04:08.848 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:08.848 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T22:04:08.848 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T22:04:08.848 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:04:08.848 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:08.848 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T22:04:08.848 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T22:04:08.849 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T22:04:08.849 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:04:08.856 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:04:08.856 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T22:04:08.857 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T22:04:08.857 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T22:04:08.860 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T22:04:08.860 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T22:04:08.861 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:04:08.861 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T22:04:08.898 INFO:tasks.ceph.mds.a:Started 2024-04-26T22:04:08.899 DEBUG:teuthology.parallel:result is None 2024-04-26T22:04:08.899 INFO:tasks.ceph.mds.c:Started 2024-04-26T22:04:08.899 DEBUG:teuthology.parallel:result is None 2024-04-26T22:04:08.903 INFO:tasks.ceph.mds.d:Started 2024-04-26T22:04:08.903 DEBUG:teuthology.parallel:result is None 2024-04-26T22:04:08.903 INFO:tasks.ceph.mds.b:Started 2024-04-26T22:04:08.904 DEBUG:teuthology.parallel:result is None 2024-04-26T22:04:08.904 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T22:04:08.971 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:04:08.971 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:04:08.982 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T22:04:08.982 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T22:04:09.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.005+0000 7f0871c74640 1 Processor -- start 2024-04-26T22:04:09.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.005+0000 7f0871c74640 1 -- start start 2024-04-26T22:04:09.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.006+0000 7f0871c74640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15fb70 0x7f086c13f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:09.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.006+0000 7f0871c74640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f086c0731c0 0x7f086c073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:09.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.006+0000 7f0871c74640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c13fe00 con 0x7f086c15c5f0 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.006+0000 7f0871c74640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f086c070910 con 0x7f086c0731c0 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.006+0000 7f0871c74640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f086c160050 con 0x7f086c15fb70 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.006+0000 7f086b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f086c15c5f0 0x7f086c0cde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51794/0 (socket says 172.21.15.137:51794) 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.006+0000 7f086b7fe640 1 -- 172.21.15.137:0/331482363 learned_addr learned my addr 172.21.15.137:0/331482363 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.006+0000 7f086bfff640 1 --2- 172.21.15.137:0/331482363 >> v2:172.21.15.137:3300/0 conn(0x7f086c0731c0 0x7f086c073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.007+0000 7f086affd640 1 --2- 172.21.15.137:0/331482363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15fb70 0x7f086c13f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.007+0000 7f086bfff640 1 -- 172.21.15.137:0/331482363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15fb70 msgr2=0x7f086c13f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.007+0000 7f086bfff640 1 --2- 172.21.15.137:0/331482363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15fb70 0x7f086c13f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.007+0000 7f086bfff640 1 -- 172.21.15.137:0/331482363 >> v1:172.21.15.137:6789/0 conn(0x7f086c15c5f0 legacy=0x7f086c0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.007+0000 7f086a7fc640 1 -- 172.21.15.137:0/331482363 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456973735 0 0) 0x7f086c13fe00 con 0x7f086c15c5f0 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.007+0000 7f086bfff640 1 -- 172.21.15.137:0/331482363 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c160330 con 0x7f086c0731c0 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f086bfff640 1 --2- 172.21.15.137:0/331482363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c0731c0 0x7f086c073650 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f0864009d90 tx=0x7f086402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fd09b0971ad932 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f086a7fc640 1 -- 172.21.15.137:0/331482363 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864007740 con 0x7f086c0731c0 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f086a7fc640 1 -- 172.21.15.137:0/331482363 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08640078e0 con 0x7f086c0731c0 2024-04-26T22:04:09.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f086a7fc640 1 -- 172.21.15.137:0/331482363 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864007cb0 con 0x7f086c0731c0 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f0871c74640 1 -- 172.21.15.137:0/331482363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c0731c0 msgr2=0x7f086c073650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f0871c74640 1 --2- 172.21.15.137:0/331482363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c0731c0 0x7f086c073650 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f0864009d90 tx=0x7f086402a660 comp rx=0 tx=0).stop 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f0871c74640 1 -- 172.21.15.137:0/331482363 shutdown_connections 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f0871c74640 1 --2- 172.21.15.137:0/331482363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c0731c0 0x7f086c073650 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f0871c74640 1 --2- 172.21.15.137:0/331482363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15fb70 0x7f086c13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f0871c74640 1 -- 172.21.15.137:0/331482363 >> 172.21.15.137:0/331482363 conn(0x7f086c0d1e30 msgr2=0x7f086c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f0871c74640 1 -- 172.21.15.137:0/331482363 shutdown_connections 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.008+0000 7f0871c74640 1 -- 172.21.15.137:0/331482363 wait complete. 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.010+0000 7f0871c74640 1 Processor -- start 2024-04-26T22:04:09.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.010+0000 7f0871c74640 1 -- start start 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.010+0000 7f0871c74640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f086c0731c0 0x7f086c0b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f0871c74640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15c5f0 0x7f086c06c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f0871c74640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c15fb70 0x7f086c06c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f0871c74640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f086c141780 con 0x7f086c15fb70 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f0871c74640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f086c1608f0 con 0x7f086c0731c0 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f0871c74640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f086c0ce550 con 0x7f086c15c5f0 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c15fb70 0x7f086c06c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c15fb70 0x7f086c06c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36358/0 (socket says 172.21.15.137:36358) 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086bfff640 1 -- 172.21.15.137:0/674273142 learned_addr learned my addr 172.21.15.137:0/674273142 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086b7fe640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f086c0731c0 0x7f086c0b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:09.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086affd640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15c5f0 0x7f086c06c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:09.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086bfff640 1 -- 172.21.15.137:0/674273142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15c5f0 msgr2=0x7f086c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:09.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086bfff640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15c5f0 0x7f086c06c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:09.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086bfff640 1 -- 172.21.15.137:0/674273142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f086c0731c0 msgr2=0x7f086c0b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:09.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086bfff640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f086c0731c0 0x7f086c0b73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:09.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086bfff640 1 -- 172.21.15.137:0/674273142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c156c30 con 0x7f086c15fb70 2024-04-26T22:04:09.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.011+0000 7f086bfff640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c15fb70 0x7f086c06c7e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f0864009eb0 tx=0x7f0864004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:09.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.014+0000 7f0853fff640 1 -- 172.21.15.137:0/674273142 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086403f070 con 0x7f086c15fb70 2024-04-26T22:04:09.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.014+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f086c156f10 con 0x7f086c15fb70 2024-04-26T22:04:09.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.014+0000 7f0853fff640 1 -- 172.21.15.137:0/674273142 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0864031bc0 con 0x7f086c15fb70 2024-04-26T22:04:09.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.014+0000 7f0853fff640 1 -- 172.21.15.137:0/674273142 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864009450 con 0x7f086c15fb70 2024-04-26T22:04:09.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.015+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f086c13ed10 con 0x7f086c15fb70 2024-04-26T22:04:09.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.015+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f086c069d60 con 0x7f086c15fb70 2024-04-26T22:04:09.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.016+0000 7f0853fff640 1 -- 172.21.15.137:0/674273142 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f086403b410 con 0x7f086c15fb70 2024-04-26T22:04:09.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.016+0000 7f0853fff640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f085806c8f0 0x7f085806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:09.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.016+0000 7f0853fff640 1 -- 172.21.15.137:0/674273142 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5029+0+0 (secure 0 0 0) 0x7f08640acef0 con 0x7f086c15fb70 2024-04-26T22:04:09.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.016+0000 7f086b7fe640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f085806c8f0 0x7f085806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:09.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.017+0000 7f086b7fe640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f085806c8f0 0x7f085806edb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f085c000f60 tx=0x7f085c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:09.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.021+0000 7f0853fff640 1 -- 172.21.15.137:0/674273142 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f086c069d60 con 0x7f086c15fb70 2024-04-26T22:04:09.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:09.205+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f086c0693d0 con 0x7f086c15fb70 2024-04-26T22:04:10.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.025+0000 7f0853fff640 1 -- 172.21.15.137:0/674273142 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v83) ==== 97+0+0 (secure 0 0 0) 0x7f086407af80 con 0x7f086c15fb70 2024-04-26T22:04:10.025 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f085806c8f0 msgr2=0x7f085806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f085806c8f0 0x7f085806edb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f085c000f60 tx=0x7f085c009040 comp rx=0 tx=0).stop 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c15fb70 msgr2=0x7f086c06c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c15fb70 0x7f086c06c7e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f0864009eb0 tx=0x7f0864004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 shutdown_connections 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f085806c8f0 0x7f085806edb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f086c15fb70 0x7f086c06c7e0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f086c15c5f0 0x7f086c06c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 --2- 172.21.15.137:0/674273142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f086c0731c0 0x7f086c0b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 >> 172.21.15.137:0/674273142 conn(0x7f086c0d1e30 msgr2=0x7f086c0d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.026+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 shutdown_connections 2024-04-26T22:04:10.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.027+0000 7f0871c74640 1 -- 172.21.15.137:0/674273142 wait complete. 2024-04-26T22:04:10.040 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T22:04:10.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.138+0000 7f916d81d640 1 Processor -- start 2024-04-26T22:04:10.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.138+0000 7f916d81d640 1 -- start start 2024-04-26T22:04:10.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f916d81d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f916815f750 0x7f91680cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f916d81d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91680d03a0 con 0x7f916815f370 2024-04-26T22:04:10.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f916d81d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91680d0680 con 0x7f91680d3ee0 2024-04-26T22:04:10.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f916d81d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f91680d0960 con 0x7f916815f750 2024-04-26T22:04:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f91677fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f916815f750 0x7f91680cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f9166ffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f916815f370 0x7f91680d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51798/0 (socket says 172.21.15.137:51798) 2024-04-26T22:04:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f9166ffd640 1 -- 172.21.15.137:0/3867328521 learned_addr learned my addr 172.21.15.137:0/3867328521 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f91677fe640 1 -- 172.21.15.137:0/3867328521 >> v1:172.21.15.170:6789/0 conn(0x7f91680d3ee0 legacy=0x7f91680b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f91677fe640 1 -- 172.21.15.137:0/3867328521 >> v1:172.21.15.137:6789/0 conn(0x7f916815f370 legacy=0x7f91680d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f91677fe640 1 -- 172.21.15.137:0/3867328521 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91680d0c40 con 0x7f916815f750 2024-04-26T22:04:10.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.139+0000 7f9165ffb640 1 -- 172.21.15.137:0/3867328521 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109198898 0 0) 0x7f91680d03a0 con 0x7f916815f370 2024-04-26T22:04:10.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.140+0000 7f91677fe640 1 --2- 172.21.15.137:0/3867328521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 0x7f91680cfd70 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f9160009d90 tx=0x7f916002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff878fe43bd871a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.140+0000 7f9165ffb640 1 -- 172.21.15.137:0/3867328521 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160007740 con 0x7f916815f750 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.140+0000 7f9165ffb640 1 -- 172.21.15.137:0/3867328521 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91600078e0 con 0x7f916815f750 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.140+0000 7f9165ffb640 1 -- 172.21.15.137:0/3867328521 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160007cb0 con 0x7f916815f750 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.141+0000 7f916d81d640 1 -- 172.21.15.137:0/3867328521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 msgr2=0x7f91680cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.141+0000 7f916d81d640 1 --2- 172.21.15.137:0/3867328521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 0x7f91680cfd70 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f9160009d90 tx=0x7f916002a6a0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.141+0000 7f916d81d640 1 -- 172.21.15.137:0/3867328521 shutdown_connections 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.141+0000 7f916d81d640 1 --2- 172.21.15.137:0/3867328521 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 0x7f91680cfd70 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.141+0000 7f916d81d640 1 -- 172.21.15.137:0/3867328521 >> 172.21.15.137:0/3867328521 conn(0x7f916808ec10 msgr2=0x7f916809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.141+0000 7f916d81d640 1 -- 172.21.15.137:0/3867328521 shutdown_connections 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.141+0000 7f916d81d640 1 -- 172.21.15.137:0/3867328521 wait complete. 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.142+0000 7f916d81d640 1 Processor -- start 2024-04-26T22:04:10.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.142+0000 7f916d81d640 1 -- start start 2024-04-26T22:04:10.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f916d81d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91680d3ee0 0x7f91680b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f916d81d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f916815f370 0x7f91680b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f916d81d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 0x7f91680ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f916d81d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f91680b4950 con 0x7f916815f750 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f916d81d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f91680b47d0 con 0x7f91680d3ee0 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f916d81d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f91680b4ad0 con 0x7f916815f370 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 0x7f91680ba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 0x7f91680ba2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36380/0 (socket says 172.21.15.137:36380) 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91677fe640 1 -- 172.21.15.137:0/3887302950 learned_addr learned my addr 172.21.15.137:0/3887302950 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f9166ffd640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91680d3ee0 0x7f91680b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91667fc640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f916815f370 0x7f91680b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91677fe640 1 -- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f916815f370 msgr2=0x7f91680b9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91677fe640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f916815f370 0x7f91680b9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91677fe640 1 -- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91680d3ee0 msgr2=0x7f91680b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91677fe640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91680d3ee0 0x7f91680b7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91677fe640 1 -- 172.21.15.137:0/3887302950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9168158d00 con 0x7f916815f750 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91667fc640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f916815f370 0x7f91680b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f9166ffd640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91680d3ee0 0x7f91680b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f91677fe640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 0x7f91680ba2a0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f9160009eb0 tx=0x7f9160004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f914ffff640 1 -- 172.21.15.137:0/3887302950 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160040070 con 0x7f916815f750 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f914ffff640 1 -- 172.21.15.137:0/3887302950 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9160031c90 con 0x7f916815f750 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91680ba900 con 0x7f916815f750 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f914ffff640 1 -- 172.21.15.137:0/3887302950 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9160045680 con 0x7f916815f750 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.143+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91680c8f80 con 0x7f916815f750 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.145+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f916806a290 con 0x7f916815f750 2024-04-26T22:04:10.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.145+0000 7f914ffff640 1 -- 172.21.15.137:0/3887302950 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9160039040 con 0x7f916815f750 2024-04-26T22:04:10.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.145+0000 7f914ffff640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f915406c8f0 0x7f915406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.145+0000 7f914ffff640 1 -- 172.21.15.137:0/3887302950 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4857+0+0 (secure 0 0 0) 0x7f91600ad190 con 0x7f916815f750 2024-04-26T22:04:10.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.145+0000 7f9166ffd640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f915406c8f0 0x7f915406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.146+0000 7f9166ffd640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f915406c8f0 0x7f915406edb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9158000f60 tx=0x7f9158007c30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:10.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.150+0000 7f914ffff640 1 -- 172.21.15.137:0/3887302950 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f916007b9d0 con 0x7f916815f750 2024-04-26T22:04:10.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.392+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f91680d4fe0 con 0x7f916815f750 2024-04-26T22:04:10.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.393+0000 7f914ffff640 1 -- 172.21.15.137:0/3887302950 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f916007b2d0 con 0x7f916815f750 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmKffkBRAAh7EvvT0pmNbLKtJsBH/25Q==", 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:04:10.394 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmd5UHERAAykWO/C56qwLwimzH2f6mcA==", 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.395 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmMbCsDBAANF98tMtCSOy4TVN7I498cw==", 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmQ47KFxAAsreL970BTH5yQLOol942iQ==", 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:04:10.396 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBcIyxmY2T8NhAAMyJ5OP3dhuqMymrlUG4q2A==", 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.397 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBfIyxmNfGnNRAAp+tTaVBwfAMUsyqRSgoRvw==", 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBiIyxm3Q1yMxAAf7f6Me7uKYzM+Fp+2FCQsA==", 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:04:10.398 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlIyxmFcj2MRAAL/yPxOwtgMnfbmr0YUZs6Q==", 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T22:04:10.399 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBpIyxmaaAqORAAfowCddy0wT/LptWvqD4CDw==", 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBsIyxmJaOFNhAAqjJAuU/SoVnjIAYCODWMnA==", 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.400 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBvIyxmRkINNBAAjfFLMQ9/XMLLU8ZAoUxvkQ==", 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQByIyxmeF1gMRAAH0t727lSCZgkTgJ0ZXyA6g==", 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.401 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ==", 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow r", 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.402 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxms4U0JBAAMZ056L4EP1qzX2KVx8JiEg==", 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmUnswIRAA5nYDanYzHiEVk98/041RHA==", 2024-04-26T22:04:10.403 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmHOORKRAA6Agn7TqBPywtop3Eo8+yFQ==", 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:04:10.404 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxm7ue6JhAAyLiai4CKXmiB00fCAfp2WA==", 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T22:04:10.405 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmFBrPAhAAfrkQvzF5SSyb5iQ0zr0eww==", 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxmlrq3OhAA9Fd+zmECU9xK/pWp2Hg9kg==", 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:04:10.406 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.407 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:10.407 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T22:04:10.407 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:04:10.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.394+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f915406c8f0 msgr2=0x7f915406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.394+0000 7f916d81d640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f915406c8f0 0x7f915406edb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9158000f60 tx=0x7f9158007c30 comp rx=0 tx=0).stop 2024-04-26T22:04:10.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.394+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 msgr2=0x7f91680ba2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.394+0000 7f916d81d640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 0x7f91680ba2a0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f9160009eb0 tx=0x7f9160004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:10.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.395+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 shutdown_connections 2024-04-26T22:04:10.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.395+0000 7f916d81d640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f915406c8f0 0x7f915406edb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.395+0000 7f916d81d640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f916815f750 0x7f91680ba2a0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.395+0000 7f916d81d640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f916815f370 0x7f91680b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.395+0000 7f916d81d640 1 --2- 172.21.15.137:0/3887302950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91680d3ee0 0x7f91680b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.395+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 >> 172.21.15.137:0/3887302950 conn(0x7f916808ec10 msgr2=0x7f916809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.395+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 shutdown_connections 2024-04-26T22:04:10.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.395+0000 7f916d81d640 1 -- 172.21.15.137:0/3887302950 wait complete. 2024-04-26T22:04:10.409 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:04:10.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.505+0000 7f6f78980640 1 Processor -- start 2024-04-26T22:04:10.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.505+0000 7f6f78980640 1 -- start start 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.506+0000 7f6f78980640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f7415f720 0x7f6f740b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.506+0000 7f6f78980640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6f740d5610 0x7f6f740d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.506+0000 7f6f78980640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f740b2510 con 0x7f6f7415f340 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.506+0000 7f6f78980640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6f740b27f0 con 0x7f6f740d5610 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.506+0000 7f6f78980640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6f740b2ad0 con 0x7f6f7415f720 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.506+0000 7f6f7259c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6f7415f340 0x7f6f740d4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51806/0 (socket says 172.21.15.137:51806) 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.506+0000 7f6f7259c640 1 -- 172.21.15.137:0/339559822 learned_addr learned my addr 172.21.15.137:0/339559822 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.506+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153047821 0 0) 0x7f6f740b2510 con 0x7f6f7415f340 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.506+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f5c003520 con 0x7f6f7415f340 2024-04-26T22:04:10.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f71d9b640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f7415f720 0x7f6f740b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f72d9d640 1 --2- 172.21.15.137:0/339559822 >> v2:172.21.15.170:3300/0 conn(0x7f6f740d5610 0x7f6f740d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2465090807 0 0) 0x7f6f5c003520 con 0x7f6f7415f340 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f7415f720 msgr2=0x7f6f740b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f7415f720 0x7f6f740b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 >> v2:172.21.15.170:3300/0 conn(0x7f6f740d5610 msgr2=0x7f6f740d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 --2- 172.21.15.137:0/339559822 >> v2:172.21.15.170:3300/0 conn(0x7f6f740d5610 0x7f6f740d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f740b2db0 con 0x7f6f7415f340 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6f64001670 con 0x7f6f7415f340 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 >> v1:172.21.15.137:6789/0 conn(0x7f6f7415f340 legacy=0x7f6f740d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f7415f720 0x7f6f5c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c003f30 0x7f6f5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c004d40 0x7f6f5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f740b27f0 con 0x7f6f5c003f30 2024-04-26T22:04:10.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6f740b2ad0 con 0x7f6f5c004d40 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5c00ba10 con 0x7f6f7415f720 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f71d9b640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c003f30 0x7f6f5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f7259c640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f7415f720 0x7f6f5c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f72d9d640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c004d40 0x7f6f5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f71d9b640 1 -- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f7415f720 msgr2=0x7f6f5c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f71d9b640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f7415f720 0x7f6f5c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f71d9b640 1 -- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c004d40 msgr2=0x7f6f5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f71d9b640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c004d40 0x7f6f5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.507+0000 7f6f71d9b640 1 -- 172.21.15.137:0/339559822 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c003520 con 0x7f6f5c003f30 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.508+0000 7f6f71d9b640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c003f30 0x7f6f5c004800 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009af0 tx=0x7f6f5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284d7760ca7b9008 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.508+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68036070 con 0x7f6f5c003f30 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.508+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f68031400 con 0x7f6f5c003f30 2024-04-26T22:04:10.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.508+0000 7f6f7159a640 1 -- 172.21.15.137:0/339559822 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68009690 con 0x7f6f5c003f30 2024-04-26T22:04:10.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.508+0000 7f6f78980640 1 -- 172.21.15.137:0/339559822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c003f30 msgr2=0x7f6f5c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.508+0000 7f6f78980640 1 --2- 172.21.15.137:0/339559822 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f5c003f30 0x7f6f5c004800 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6f68009af0 tx=0x7f6f5c005830 comp rx=0 tx=0).stop 2024-04-26T22:04:10.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.508+0000 7f6f72d9d640 1 -- 172.21.15.137:0/339559822 reap_dead start 2024-04-26T22:04:10.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.509+0000 7f6f78980640 1 -- 172.21.15.137:0/339559822 shutdown_connections 2024-04-26T22:04:10.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.509+0000 7f6f78980640 1 -- 172.21.15.137:0/339559822 >> 172.21.15.137:0/339559822 conn(0x7f6f7408ec70 msgr2=0x7f6f7409e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:10.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.509+0000 7f6f78980640 1 -- 172.21.15.137:0/339559822 shutdown_connections 2024-04-26T22:04:10.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.509+0000 7f6f78980640 1 -- 172.21.15.137:0/339559822 wait complete. 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.510+0000 7f6f78980640 1 Processor -- start 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.510+0000 7f6f78980640 1 -- start start 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f78980640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c003f30 0x7f6f740cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f78980640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f740b8880 0x7f6f740cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f78980640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f740cd8b0 0x7f6f740cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f78980640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6f740b2210 con 0x7f6f740b8880 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f78980640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6f740b2090 con 0x7f6f5c003f30 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f78980640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6f740b35b0 con 0x7f6f740cd8b0 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f71d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f740b8880 0x7f6f740cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f71d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f740b8880 0x7f6f740cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36400/0 (socket says 172.21.15.137:36400) 2024-04-26T22:04:10.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f71d9b640 1 -- 172.21.15.137:0/3801777675 learned_addr learned my addr 172.21.15.137:0/3801777675 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f7259c640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c003f30 0x7f6f740cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f72d9d640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f740cd8b0 0x7f6f740cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f71d9b640 1 -- 172.21.15.137:0/3801777675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f740cd8b0 msgr2=0x7f6f740cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f71d9b640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f740cd8b0 0x7f6f740cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f71d9b640 1 -- 172.21.15.137:0/3801777675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c003f30 msgr2=0x7f6f740cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f71d9b640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c003f30 0x7f6f740cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f71d9b640 1 -- 172.21.15.137:0/3801777675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f740b9020 con 0x7f6f740b8880 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f7259c640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c003f30 0x7f6f740cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f71d9b640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f740b8880 0x7f6f740cd370 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6f68034040 tx=0x7f6f68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f62ffd640 1 -- 172.21.15.137:0/3801777675 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68040020 con 0x7f6f740b8880 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f62ffd640 1 -- 172.21.15.137:0/3801777675 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f68003c60 con 0x7f6f740b8880 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f740ce280 con 0x7f6f740b8880 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f62ffd640 1 -- 172.21.15.137:0/3801777675 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68036040 con 0x7f6f740b8880 2024-04-26T22:04:10.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.511+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f740ce520 con 0x7f6f740b8880 2024-04-26T22:04:10.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.512+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7406a290 con 0x7f6f740b8880 2024-04-26T22:04:10.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.513+0000 7f6f62ffd640 1 -- 172.21.15.137:0/3801777675 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f68043020 con 0x7f6f740b8880 2024-04-26T22:04:10.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.513+0000 7f6f62ffd640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f5406c920 0x7f6f5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.513+0000 7f6f62ffd640 1 -- 172.21.15.137:0/3801777675 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4857+0+0 (secure 0 0 0) 0x7f6f680abba0 con 0x7f6f740b8880 2024-04-26T22:04:10.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.513+0000 7f6f7259c640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f5406c920 0x7f6f5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.513+0000 7f6f7259c640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f5406c920 0x7f6f5406ede0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6f64000fb0 tx=0x7f6f64009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:10.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.517+0000 7f6f62ffd640 1 -- 172.21.15.137:0/3801777675 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6f6804a030 con 0x7f6f740b8880 2024-04-26T22:04:10.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.693+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f740d3020 con 0x7f6f740b8880 2024-04-26T22:04:10.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.694+0000 7f6f62ffd640 1 -- 172.21.15.137:0/3801777675 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+12904 (secure 0 0 0) 0x7f6f740b9020 con 0x7f6f740b8880 2024-04-26T22:04:10.694 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:10.694 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":83,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:04:10.022936+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:10.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f5406c920 msgr2=0x7f6f5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f5406c920 0x7f6f5406ede0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6f64000fb0 tx=0x7f6f64009040 comp rx=0 tx=0).stop 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f740b8880 msgr2=0x7f6f740cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f740b8880 0x7f6f740cd370 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f6f68034040 tx=0x7f6f68004730 comp rx=0 tx=0).stop 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 shutdown_connections 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6f5406c920 0x7f6f5406ede0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6f740b8880 0x7f6f740cd370 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6f740cd8b0 0x7f6f740cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 --2- 172.21.15.137:0/3801777675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f5c003f30 0x7f6f740cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 >> 172.21.15.137:0/3801777675 conn(0x7f6f7408ec70 msgr2=0x7f6f7406e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 shutdown_connections 2024-04-26T22:04:10.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.696+0000 7f6f78980640 1 -- 172.21.15.137:0/3801777675 wait complete. 2024-04-26T22:04:10.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:04:10.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:04:10.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.809+0000 7fee26a59640 1 Processor -- start 2024-04-26T22:04:10.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.809+0000 7fee26a59640 1 -- start start 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.809+0000 7fee26a59640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 0x7fee200d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.809+0000 7fee26a59640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee20163aa0 0x7fee200b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.809+0000 7fee26a59640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fee200b60b0 0x7fee200d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.809+0000 7fee26a59640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fee2015fa60 con 0x7fee20163aa0 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.809+0000 7fee26a59640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fee200d3f50 con 0x7fee200b60b0 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.809+0000 7fee26a59640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee200b5090 con 0x7fee2015f680 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee20163aa0 0x7fee200b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee20163aa0 0x7fee200b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36416/0 (socket says 172.21.15.137:36416) 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1f7fe640 1 -- 172.21.15.137:0/3362454510 learned_addr learned my addr 172.21.15.137:0/3362454510 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:10.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1ffff640 1 --2- 172.21.15.137:0/3362454510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 0x7fee200d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee24ff6640 1 --2- 172.21.15.137:0/3362454510 >> v2:172.21.15.170:3300/0 conn(0x7fee200b60b0 0x7fee200d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1f7fe640 1 -- 172.21.15.137:0/3362454510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 msgr2=0x7fee200d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:10.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1f7fe640 1 --2- 172.21.15.137:0/3362454510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 0x7fee200d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1f7fe640 1 -- 172.21.15.137:0/3362454510 >> v2:172.21.15.170:3300/0 conn(0x7fee200b60b0 msgr2=0x7fee200d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:10.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1f7fe640 1 --2- 172.21.15.137:0/3362454510 >> v2:172.21.15.170:3300/0 conn(0x7fee200b60b0 0x7fee200d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1f7fe640 1 -- 172.21.15.137:0/3362454510 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200b5370 con 0x7fee20163aa0 2024-04-26T22:04:10.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.810+0000 7fee1f7fe640 1 --2- 172.21.15.137:0/3362454510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee20163aa0 0x7fee200b5b70 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fee200b4b10 tx=0x7fee1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2cb617721c0c63 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:10.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee1effd640 1 -- 172.21.15.137:0/3362454510 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14037070 con 0x7fee20163aa0 2024-04-26T22:04:10.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee1effd640 1 -- 172.21.15.137:0/3362454510 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14032440 con 0x7fee20163aa0 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee1effd640 1 -- 172.21.15.137:0/3362454510 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14032810 con 0x7fee20163aa0 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee26a59640 1 -- 172.21.15.137:0/3362454510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee20163aa0 msgr2=0x7fee200b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee26a59640 1 --2- 172.21.15.137:0/3362454510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee20163aa0 0x7fee200b5b70 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fee200b4b10 tx=0x7fee1402a1e0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee26a59640 1 -- 172.21.15.137:0/3362454510 shutdown_connections 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee26a59640 1 --2- 172.21.15.137:0/3362454510 >> v2:172.21.15.170:3300/0 conn(0x7fee200b60b0 0x7fee200d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee26a59640 1 --2- 172.21.15.137:0/3362454510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee20163aa0 0x7fee200b5b70 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee26a59640 1 --2- 172.21.15.137:0/3362454510 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 0x7fee200d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee26a59640 1 -- 172.21.15.137:0/3362454510 >> 172.21.15.137:0/3362454510 conn(0x7fee2008eca0 msgr2=0x7fee2009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee26a59640 1 -- 172.21.15.137:0/3362454510 shutdown_connections 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.811+0000 7fee26a59640 1 -- 172.21.15.137:0/3362454510 wait complete. 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.812+0000 7fee26a59640 1 Processor -- start 2024-04-26T22:04:10.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee26a59640 1 -- start start 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee26a59640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee200b60b0 0x7fee20153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee26a59640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 0x7fee200d1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee26a59640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee20163aa0 0x7fee201621f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee26a59640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee200d55e0 con 0x7fee200b60b0 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee26a59640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fee200d5460 con 0x7fee20163aa0 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee26a59640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee200d5760 con 0x7fee2015f680 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee200b60b0 0x7fee20153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee1ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee200b60b0 0x7fee20153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36422/0 (socket says 172.21.15.137:36422) 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.813+0000 7fee1ffff640 1 -- 172.21.15.137:0/2802482096 learned_addr learned my addr 172.21.15.137:0/2802482096 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:10.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee24ff6640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee20163aa0 0x7fee201621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1f7fe640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 0x7fee200d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1ffff640 1 -- 172.21.15.137:0/2802482096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 msgr2=0x7fee200d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1ffff640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 0x7fee200d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1ffff640 1 -- 172.21.15.137:0/2802482096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee20163aa0 msgr2=0x7fee201621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1ffff640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee20163aa0 0x7fee201621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1ffff640 1 -- 172.21.15.137:0/2802482096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200cd650 con 0x7fee200b60b0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1ffff640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee200b60b0 0x7fee20153660 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fee1000c7f0 tx=0x7fee1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1cff9640 1 -- 172.21.15.137:0/2802482096 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10015070 con 0x7fee200b60b0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1cff9640 1 -- 172.21.15.137:0/2802482096 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee10004240 con 0x7fee200b60b0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee200cd090 con 0x7fee200b60b0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee1cff9640 1 -- 172.21.15.137:0/2802482096 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10007620 con 0x7fee200b60b0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.814+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee200d0d70 con 0x7fee200b60b0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.815+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee200d5a70 con 0x7fee200b60b0 2024-04-26T22:04:10.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.816+0000 7fee1cff9640 1 -- 172.21.15.137:0/2802482096 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee100079d0 con 0x7fee200b60b0 2024-04-26T22:04:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.816+0000 7fee1cff9640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee0c06c8f0 0x7fee0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.816+0000 7fee1cff9640 1 -- 172.21.15.137:0/2802482096 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4857+0+0 (secure 0 0 0) 0x7fee1008bad0 con 0x7fee200b60b0 2024-04-26T22:04:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.816+0000 7fee1f7fe640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee0c06c8f0 0x7fee0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:10.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.816+0000 7fee1f7fe640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee0c06c8f0 0x7fee0c06edb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fee14034000 tx=0x7fee1402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:10.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.820+0000 7fee1cff9640 1 -- 172.21.15.137:0/2802482096 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fee200d5a70 con 0x7fee200b60b0 2024-04-26T22:04:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.994+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fee200b4cd0 con 0x7fee200b60b0 2024-04-26T22:04:10.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.994+0000 7fee1cff9640 1 -- 172.21.15.137:0/2802482096 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7fee10059c90 con 0x7fee200b60b0 2024-04-26T22:04:10.994 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:04:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee0c06c8f0 msgr2=0x7fee0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee0c06c8f0 0x7fee0c06edb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fee14034000 tx=0x7fee1402e000 comp rx=0 tx=0).stop 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee200b60b0 msgr2=0x7fee20153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee200b60b0 0x7fee20153660 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fee1000c7f0 tx=0x7fee1000ccb0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 shutdown_connections 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee0c06c8f0 0x7fee0c06edb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee20163aa0 0x7fee201621f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee2015f680 0x7fee200d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 --2- 172.21.15.137:0/2802482096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee200b60b0 0x7fee20153660 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 >> 172.21.15.137:0/2802482096 conn(0x7fee2008eca0 msgr2=0x7fee200d49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 shutdown_connections 2024-04-26T22:04:10.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:10.996+0000 7fee26a59640 1 -- 172.21.15.137:0/2802482096 wait complete. 2024-04-26T22:04:11.008 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T22:04:11.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.104+0000 7fb673524640 1 Processor -- start 2024-04-26T22:04:11.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.105+0000 7fb673524640 1 -- start start 2024-04-26T22:04:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.105+0000 7fb673524640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c15f750 0x7fb66c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.105+0000 7fb673524640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66c0d03a0 con 0x7fb66c0d3ee0 2024-04-26T22:04:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.105+0000 7fb673524640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb66c0d0680 con 0x7fb66c15f370 2024-04-26T22:04:11.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.105+0000 7fb673524640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c0d0960 con 0x7fb66c15f750 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb670abf640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb66c0d3ee0 0x7fb66c0b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51818/0 (socket says 172.21.15.137:51818) 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb670abf640 1 -- 172.21.15.137:0/1606576254 learned_addr learned my addr 172.21.15.137:0/1606576254 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3104457442 0 0) 0x7fb66c0d03a0 con 0x7fb66c0d3ee0 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb671ac1640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c15f750 0x7fb66c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb654003520 con 0x7fb66c0d3ee0 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2964120233 0 0) 0x7fb654003520 con 0x7fb66c0d3ee0 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c15f750 msgr2=0x7fb66c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c15f750 0x7fb66c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 >> v1:172.21.15.170:6789/0 conn(0x7fb66c15f370 legacy=0x7fb66c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c0d0c40 con 0x7fb66c0d3ee0 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fb660001670 con 0x7fb66c0d3ee0 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 >> v1:172.21.15.137:6789/0 conn(0x7fb66c0d3ee0 legacy=0x7fb66c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c15f750 0x7fb6540039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb654003f60 0x7fb654004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb654004d40 0x7fb6540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c0d0960 con 0x7fb654004d40 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb65400baa0 con 0x7fb654003f60 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb65400bca0 con 0x7fb66c15f750 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb671ac1640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb654004d40 0x7fb6540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb6712c0640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c15f750 0x7fb6540039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.106+0000 7fb670abf640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb654003f60 0x7fb654004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.107+0000 7fb671ac1640 1 -- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c15f750 msgr2=0x7fb6540039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.107+0000 7fb671ac1640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c15f750 0x7fb6540039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.107+0000 7fb671ac1640 1 -- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb654003f60 msgr2=0x7fb654004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.107+0000 7fb671ac1640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb654003f60 0x7fb654004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.107+0000 7fb671ac1640 1 -- 172.21.15.137:0/1606576254 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb654003520 con 0x7fb654004d40 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.107+0000 7fb671ac1640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb654004d40 0x7fb6540051c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009ac0 tx=0x7fb654005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3a756d30fdbe4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.107+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c036070 con 0x7fb654004d40 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.107+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb65c031400 con 0x7fb654004d40 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.107+0000 7fb66bfff640 1 -- 172.21.15.137:0/1606576254 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c009690 con 0x7fb654004d40 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.108+0000 7fb673524640 1 -- 172.21.15.137:0/1606576254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb654004d40 msgr2=0x7fb6540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.108+0000 7fb673524640 1 --2- 172.21.15.137:0/1606576254 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb654004d40 0x7fb6540051c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009ac0 tx=0x7fb654005830 comp rx=0 tx=0).stop 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.108+0000 7fb671ac1640 1 -- 172.21.15.137:0/1606576254 reap_dead start 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.108+0000 7fb673524640 1 -- 172.21.15.137:0/1606576254 shutdown_connections 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.108+0000 7fb673524640 1 -- 172.21.15.137:0/1606576254 >> 172.21.15.137:0/1606576254 conn(0x7fb66c08ec10 msgr2=0x7fb66c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.108+0000 7fb673524640 1 -- 172.21.15.137:0/1606576254 shutdown_connections 2024-04-26T22:04:11.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.108+0000 7fb673524640 1 -- 172.21.15.137:0/1606576254 wait complete. 2024-04-26T22:04:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.109+0000 7fb673524640 1 Processor -- start 2024-04-26T22:04:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.109+0000 7fb673524640 1 -- start start 2024-04-26T22:04:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb673524640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c0a1ba0 0x7fb66c0a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb673524640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1f85f0 0x7fb66c15b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb673524640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c0b3820 0x7fb66c0b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb673524640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c0cfef0 con 0x7fb66c1f85f0 2024-04-26T22:04:11.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb673524640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb66c0cfd70 con 0x7fb66c0b3820 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb673524640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb66c0d0070 con 0x7fb66c0a1ba0 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb670abf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1f85f0 0x7fb66c15b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb670abf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1f85f0 0x7fb66c15b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36450/0 (socket says 172.21.15.137:36450) 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb670abf640 1 -- 172.21.15.137:0/3175068142 learned_addr learned my addr 172.21.15.137:0/3175068142 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb671ac1640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c0b3820 0x7fb66c0b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb6712c0640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c0a1ba0 0x7fb66c0a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb670abf640 1 -- 172.21.15.137:0/3175068142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c0a1ba0 msgr2=0x7fb66c0a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb670abf640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c0a1ba0 0x7fb66c0a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb670abf640 1 -- 172.21.15.137:0/3175068142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c0b3820 msgr2=0x7fb66c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb670abf640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c0b3820 0x7fb66c0b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb670abf640 1 -- 172.21.15.137:0/3175068142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb66c0a1f80 con 0x7fb66c1f85f0 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb6712c0640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c0a1ba0 0x7fb66c0a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb670abf640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1f85f0 0x7fb66c15b100 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fb660007290 tx=0x7fb660007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:11.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.110+0000 7fb669ffb640 1 -- 172.21.15.137:0/3175068142 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66000f9c0 con 0x7fb66c1f85f0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.111+0000 7fb669ffb640 1 -- 172.21.15.137:0/3175068142 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb660018070 con 0x7fb66c1f85f0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.111+0000 7fb669ffb640 1 -- 172.21.15.137:0/3175068142 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb66000fda0 con 0x7fb66c1f85f0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.111+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb66c0cf0a0 con 0x7fb66c1f85f0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.111+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb66c1f8f60 con 0x7fb66c1f85f0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.112+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb66c0b41e0 con 0x7fb66c1f85f0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.112+0000 7fb669ffb640 1 -- 172.21.15.137:0/3175068142 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb66001d460 con 0x7fb66c1f85f0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.112+0000 7fb669ffb640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb65806c8f0 0x7fb65806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.112+0000 7fb669ffb640 1 -- 172.21.15.137:0/3175068142 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4857+0+0 (secure 0 0 0) 0x7fb66008b8e0 con 0x7fb66c1f85f0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.112+0000 7fb6712c0640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb65806c8f0 0x7fb65806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.113+0000 7fb6712c0640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb65806c8f0 0x7fb65806edb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb664003fc0 tx=0x7fb664009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:11.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.116+0000 7fb669ffb640 1 -- 172.21.15.137:0/3175068142 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb66005a0f0 con 0x7fb66c1f85f0 2024-04-26T22:04:11.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.293+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb66c06a290 con 0x7fb66c1f85f0 2024-04-26T22:04:11.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.294+0000 7fb669ffb640 1 -- 172.21.15.137:0/3175068142 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) ==== 84+0+65 (secure 0 0 0) 0x7fb6600599f0 con 0x7fb66c1f85f0 2024-04-26T22:04:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:11.294 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:04:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T22:04:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T22:04:11.294 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:11.294 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:04:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.295+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb65806c8f0 msgr2=0x7fb65806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.295+0000 7fb673524640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb65806c8f0 0x7fb65806edb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb664003fc0 tx=0x7fb664009040 comp rx=0 tx=0).stop 2024-04-26T22:04:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.295+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1f85f0 msgr2=0x7fb66c15b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.295+0000 7fb673524640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1f85f0 0x7fb66c15b100 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fb660007290 tx=0x7fb660007750 comp rx=0 tx=0).stop 2024-04-26T22:04:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.296+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 shutdown_connections 2024-04-26T22:04:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.296+0000 7fb673524640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb65806c8f0 0x7fb65806edb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.296+0000 7fb673524640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb66c1f85f0 0x7fb66c15b100 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.296+0000 7fb673524640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb66c0b3820 0x7fb66c0b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.296+0000 7fb673524640 1 --2- 172.21.15.137:0/3175068142 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb66c0a1ba0 0x7fb66c0a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.296+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 >> 172.21.15.137:0/3175068142 conn(0x7fb66c08ec10 msgr2=0x7fb66c06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.296+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 shutdown_connections 2024-04-26T22:04:11.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.296+0000 7fb673524640 1 -- 172.21.15.137:0/3175068142 wait complete. 2024-04-26T22:04:11.306 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T22:04:11.307 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T22:04:11.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.408+0000 7f5f62a52640 1 Processor -- start 2024-04-26T22:04:11.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.408+0000 7f5f62a52640 1 -- start start 2024-04-26T22:04:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.408+0000 7f5f62a52640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 0x7f5f5c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.408+0000 7f5f62a52640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5f5c0b39f0 0x7f5f5c0cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.408+0000 7f5f62a52640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5c0b2cb0 con 0x7f5f5c0cb850 2024-04-26T22:04:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.408+0000 7f5f62a52640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5f5c0b1d20 con 0x7f5f5c0b39f0 2024-04-26T22:04:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.408+0000 7f5f62a52640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5c0ce9f0 con 0x7f5f5c15d360 2024-04-26T22:04:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f5b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5f5c0b39f0 0x7f5f5c0cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f60fef640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5f5c0cb850 0x7f5f5c0ce120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51820/0 (socket says 172.21.15.137:51820) 2024-04-26T22:04:11.409 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f60fef640 1 -- 172.21.15.137:0/2784548736 learned_addr learned my addr 172.21.15.137:0/2784548736 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f5bfff640 1 --2- 172.21.15.137:0/2784548736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 0x7f5f5c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f5b7fe640 1 -- 172.21.15.137:0/2784548736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 msgr2=0x7f5f5c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f5b7fe640 1 --2- 172.21.15.137:0/2784548736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 0x7f5f5c0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f5b7fe640 1 -- 172.21.15.137:0/2784548736 >> v1:172.21.15.137:6789/0 conn(0x7f5f5c0cb850 legacy=0x7f5f5c0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f5affd640 1 -- 172.21.15.137:0/2784548736 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213824150 0 0) 0x7f5f5c0b2cb0 con 0x7f5f5c0cb850 2024-04-26T22:04:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f5b7fe640 1 -- 172.21.15.137:0/2784548736 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c0b1f70 con 0x7f5f5c0b39f0 2024-04-26T22:04:11.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.409+0000 7f5f5bfff640 1 --2- 172.21.15.137:0/2784548736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 0x7f5f5c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f5b7fe640 1 --2- 172.21.15.137:0/2784548736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0b39f0 0x7f5f5c0cdbe0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5f500097a0 tx=0x7f5f5002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6620c638cae9e6d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:11.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f5affd640 1 -- 172.21.15.137:0/2784548736 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50037070 con 0x7f5f5c0b39f0 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f5affd640 1 -- 172.21.15.137:0/2784548736 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f50032440 con 0x7f5f5c0b39f0 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f5affd640 1 -- 172.21.15.137:0/2784548736 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50032810 con 0x7f5f5c0b39f0 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f62a52640 1 -- 172.21.15.137:0/2784548736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0b39f0 msgr2=0x7f5f5c0cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f62a52640 1 --2- 172.21.15.137:0/2784548736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0b39f0 0x7f5f5c0cdbe0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f5f500097a0 tx=0x7f5f5002a180 comp rx=0 tx=0).stop 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f62a52640 1 -- 172.21.15.137:0/2784548736 shutdown_connections 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f62a52640 1 --2- 172.21.15.137:0/2784548736 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0b39f0 0x7f5f5c0cdbe0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f62a52640 1 --2- 172.21.15.137:0/2784548736 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 0x7f5f5c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f62a52640 1 -- 172.21.15.137:0/2784548736 >> 172.21.15.137:0/2784548736 conn(0x7f5f5c0b2ed0 msgr2=0x7f5f5c0b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f62a52640 1 -- 172.21.15.137:0/2784548736 shutdown_connections 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.410+0000 7f5f62a52640 1 -- 172.21.15.137:0/2784548736 wait complete. 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.412+0000 7f5f62a52640 1 Processor -- start 2024-04-26T22:04:11.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.412+0000 7f5f62a52640 1 -- start start 2024-04-26T22:04:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.412+0000 7f5f62a52640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f5c0b39f0 0x7f5f5c09ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.412+0000 7f5f62a52640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0cb850 0x7f5f5c155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.412+0000 7f5f62a52640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 0x7f5f5c156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.412+0000 7f5f62a52640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c069bc0 con 0x7f5f5c0cb850 2024-04-26T22:04:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.412+0000 7f5f62a52640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c15d740 con 0x7f5f5c0b39f0 2024-04-26T22:04:11.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.412+0000 7f5f62a52640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5c069d40 con 0x7f5f5c15d360 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0cb850 0x7f5f5c155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0cb850 0x7f5f5c155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36468/0 (socket says 172.21.15.137:36468) 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5b7fe640 1 -- 172.21.15.137:0/594851464 learned_addr learned my addr 172.21.15.137:0/594851464 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5bfff640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f5c0b39f0 0x7f5f5c09ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f60fef640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 0x7f5f5c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5b7fe640 1 -- 172.21.15.137:0/594851464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 msgr2=0x7f5f5c156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5b7fe640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 0x7f5f5c156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5b7fe640 1 -- 172.21.15.137:0/594851464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f5c0b39f0 msgr2=0x7f5f5c09ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5b7fe640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f5c0b39f0 0x7f5f5c09ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5b7fe640 1 -- 172.21.15.137:0/594851464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c09f280 con 0x7f5f5c0cb850 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5bfff640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f5c0b39f0 0x7f5f5c09ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f5b7fe640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0cb850 0x7f5f5c155d50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5f500097a0 tx=0x7f5f500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f58ff9640 1 -- 172.21.15.137:0/594851464 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50041070 con 0x7f5f5c0cb850 2024-04-26T22:04:11.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f58ff9640 1 -- 172.21.15.137:0/594851464 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5003c870 con 0x7f5f5c0cb850 2024-04-26T22:04:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5c155790 con 0x7f5f5c0cb850 2024-04-26T22:04:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f58ff9640 1 -- 172.21.15.137:0/594851464 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50037040 con 0x7f5f5c0cb850 2024-04-26T22:04:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.413+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5c147770 con 0x7f5f5c0cb850 2024-04-26T22:04:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.414+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f5c06a290 con 0x7f5f5c0cb850 2024-04-26T22:04:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.415+0000 7f5f58ff9640 1 -- 172.21.15.137:0/594851464 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f50044070 con 0x7f5f5c0cb850 2024-04-26T22:04:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.415+0000 7f5f58ff9640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5f4806c8f0 0x7f5f4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.415+0000 7f5f5bfff640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5f4806c8f0 0x7f5f4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.415+0000 7f5f58ff9640 1 -- 172.21.15.137:0/594851464 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4857+0+0 (secure 0 0 0) 0x7f5f500ac320 con 0x7f5f5c0cb850 2024-04-26T22:04:11.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.416+0000 7f5f5bfff640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5f4806c8f0 0x7f5f4806edb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c006fd0 tx=0x7f5f4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:11.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.419+0000 7f5f58ff9640 1 -- 172.21.15.137:0/594851464 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5f5007abc0 con 0x7f5f5c0cb850 2024-04-26T22:04:11.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:11.595+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5f5c15a4a0 con 0x7f5f5c0cb850 2024-04-26T22:04:12.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.035+0000 7f5f58ff9640 1 -- 172.21.15.137:0/594851464 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) ==== 138+0+0 (secure 0 0 0) 0x7f5f5007a4c0 con 0x7f5f5c0cb850 2024-04-26T22:04:12.035 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5f4806c8f0 msgr2=0x7f5f4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5f4806c8f0 0x7f5f4806edb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c006fd0 tx=0x7f5f4c008040 comp rx=0 tx=0).stop 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0cb850 msgr2=0x7f5f5c155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0cb850 0x7f5f5c155d50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5f500097a0 tx=0x7f5f500046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 shutdown_connections 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5f4806c8f0 0x7f5f4806edb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5f5c0cb850 0x7f5f5c155d50 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5f5c15d360 0x7f5f5c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 --2- 172.21.15.137:0/594851464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f5c0b39f0 0x7f5f5c09ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.037+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 >> 172.21.15.137:0/594851464 conn(0x7f5f5c0b2ed0 msgr2=0x7f5f5c0cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:12.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.038+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 shutdown_connections 2024-04-26T22:04:12.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.038+0000 7f5f62a52640 1 -- 172.21.15.137:0/594851464 wait complete. 2024-04-26T22:04:12.052 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T22:04:12.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.156+0000 7fcb50371640 1 Processor -- start 2024-04-26T22:04:12.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.156+0000 7fcb50371640 1 -- start start 2024-04-26T22:04:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb50371640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb480b6300 0x7fcb480b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb50371640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcb4815d030 0x7fcb480720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb50371640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4815d4c0 con 0x7fcb481459a0 2024-04-26T22:04:12.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb50371640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480b4480 con 0x7fcb480b6300 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb50371640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480b4760 con 0x7fcb4815d030 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb4d90c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcb480b6300 0x7fcb480b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb4e10d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcb481459a0 0x7fcb480b5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51832/0 (socket says 172.21.15.137:51832) 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb4e10d640 1 -- 172.21.15.137:0/947812200 learned_addr learned my addr 172.21.15.137:0/947812200 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb4e90e640 1 --2- 172.21.15.137:0/947812200 >> v2:172.21.15.170:3300/0 conn(0x7fcb4815d030 0x7fcb480720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb4d90c640 1 -- 172.21.15.137:0/947812200 >> v2:172.21.15.170:3300/0 conn(0x7fcb4815d030 msgr2=0x7fcb480720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb4d90c640 1 --2- 172.21.15.137:0/947812200 >> v2:172.21.15.170:3300/0 conn(0x7fcb4815d030 0x7fcb480720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb4d90c640 1 -- 172.21.15.137:0/947812200 >> v1:172.21.15.137:6789/0 conn(0x7fcb481459a0 legacy=0x7fcb480b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb4d10b640 1 -- 172.21.15.137:0/947812200 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493831191 0 0) 0x7fcb4815d4c0 con 0x7fcb481459a0 2024-04-26T22:04:12.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.157+0000 7fcb4d90c640 1 -- 172.21.15.137:0/947812200 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb480b4a40 con 0x7fcb480b6300 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.158+0000 7fcb4d90c640 1 --2- 172.21.15.137:0/947812200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 0x7fcb480b3de0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcb48071470 tx=0x7fcb3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc412f0285e950a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.158+0000 7fcb4d10b640 1 -- 172.21.15.137:0/947812200 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38037070 con 0x7fcb480b6300 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.158+0000 7fcb4d10b640 1 -- 172.21.15.137:0/947812200 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb38032440 con 0x7fcb480b6300 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.158+0000 7fcb4d10b640 1 -- 172.21.15.137:0/947812200 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38032810 con 0x7fcb480b6300 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.159+0000 7fcb50371640 1 -- 172.21.15.137:0/947812200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 msgr2=0x7fcb480b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.159+0000 7fcb50371640 1 --2- 172.21.15.137:0/947812200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 0x7fcb480b3de0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcb48071470 tx=0x7fcb3802a1a0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.159+0000 7fcb50371640 1 -- 172.21.15.137:0/947812200 shutdown_connections 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.159+0000 7fcb50371640 1 --2- 172.21.15.137:0/947812200 >> v2:172.21.15.170:3300/0 conn(0x7fcb4815d030 0x7fcb480720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.159+0000 7fcb50371640 1 --2- 172.21.15.137:0/947812200 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 0x7fcb480b3de0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.159+0000 7fcb50371640 1 -- 172.21.15.137:0/947812200 >> 172.21.15.137:0/947812200 conn(0x7fcb480d0d30 msgr2=0x7fcb480d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:12.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.159+0000 7fcb50371640 1 -- 172.21.15.137:0/947812200 shutdown_connections 2024-04-26T22:04:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.159+0000 7fcb50371640 1 -- 172.21.15.137:0/947812200 wait complete. 2024-04-26T22:04:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.160+0000 7fcb50371640 1 Processor -- start 2024-04-26T22:04:12.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.160+0000 7fcb50371640 1 -- start start 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb50371640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 0x7fcb4806f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb50371640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb481459a0 0x7fcb48144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb50371640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815d030 0x7fcb480cf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb50371640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcb48072630 con 0x7fcb480b6300 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb50371640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480b5000 con 0x7fcb4815d030 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb50371640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcb480727b0 con 0x7fcb481459a0 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e10d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 0x7fcb4806f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e10d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 0x7fcb4806f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36486/0 (socket says 172.21.15.137:36486) 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e10d640 1 -- 172.21.15.137:0/1818453030 learned_addr learned my addr 172.21.15.137:0/1818453030 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:12.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e90e640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815d030 0x7fcb480cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4d90c640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb481459a0 0x7fcb48144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e10d640 1 -- 172.21.15.137:0/1818453030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb481459a0 msgr2=0x7fcb48144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e10d640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb481459a0 0x7fcb48144420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e10d640 1 -- 172.21.15.137:0/1818453030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815d030 msgr2=0x7fcb480cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e10d640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815d030 0x7fcb480cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e10d640 1 -- 172.21.15.137:0/1818453030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb481f6650 con 0x7fcb480b6300 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb4e10d640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 0x7fcb4806f460 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400cc40 tx=0x7fcb4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb3effd640 1 -- 172.21.15.137:0/1818453030 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44017070 con 0x7fcb480b6300 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb3effd640 1 -- 172.21.15.137:0/1818453030 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4400ce50 con 0x7fcb480b6300 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.161+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb481f6930 con 0x7fcb480b6300 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.162+0000 7fcb3effd640 1 -- 172.21.15.137:0/1818453030 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44012640 con 0x7fcb480b6300 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.162+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb480b2920 con 0x7fcb480b6300 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.163+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4806a290 con 0x7fcb480b6300 2024-04-26T22:04:12.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.163+0000 7fcb3effd640 1 -- 172.21.15.137:0/1818453030 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb4401a070 con 0x7fcb480b6300 2024-04-26T22:04:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.163+0000 7fcb3effd640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.164+0000 7fcb4d90c640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.164+0000 7fcb3effd640 1 -- 172.21.15.137:0/1818453030 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5227+0+0 (secure 0 0 0) 0x7fcb4408b800 con 0x7fcb480b6300 2024-04-26T22:04:12.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.164+0000 7fcb4d90c640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcb38034000 tx=0x7fcb3802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:12.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.168+0000 7fcb3effd640 1 -- 172.21.15.137:0/1818453030 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcb44059e10 con 0x7fcb480b6300 2024-04-26T22:04:12.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:12.342+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcb48073ca0 con 0x7fcb480b6300 2024-04-26T22:04:13.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.039+0000 7fcb3effd640 1 -- 172.21.15.137:0/1818453030 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7fcb44059710 con 0x7fcb480b6300 2024-04-26T22:04:13.039 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T22:04:13.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 msgr2=0x7fcb2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:13.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcb38034000 tx=0x7fcb3802e000 comp rx=0 tx=0).stop 2024-04-26T22:04:13.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 msgr2=0x7fcb4806f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 0x7fcb4806f460 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400cc40 tx=0x7fcb4400a430 comp rx=0 tx=0).stop 2024-04-26T22:04:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 shutdown_connections 2024-04-26T22:04:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb4815d030 0x7fcb480cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcb481459a0 0x7fcb48144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 --2- 172.21.15.137:0/1818453030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcb480b6300 0x7fcb4806f460 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 >> 172.21.15.137:0/1818453030 conn(0x7fcb480d0d30 msgr2=0x7fcb4815fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 shutdown_connections 2024-04-26T22:04:13.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.042+0000 7fcb50371640 1 -- 172.21.15.137:0/1818453030 wait complete. 2024-04-26T22:04:13.064 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T22:04:13.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.165+0000 7fba14415640 1 Processor -- start 2024-04-26T22:04:13.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.165+0000 7fba14415640 1 -- start start 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba14415640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c1468a0 0x7fba0c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba14415640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba0c15d6f0 0x7fba0c0b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba14415640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba0c070740 con 0x7fba0c06ffd0 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba14415640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fba0c070a00 con 0x7fba0c15d6f0 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba14415640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fba0c070ce0 con 0x7fba0c1468a0 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba119b0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba0c15d6f0 0x7fba0c0b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba119b0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fba0c15d6f0 0x7fba0c0b7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36500/0 (socket says 172.21.15.137:36500) 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba119b0640 1 -- 172.21.15.137:0/3997725415 learned_addr learned my addr 172.21.15.137:0/3997725415 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba121b1640 1 --2- 172.21.15.137:0/3997725415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c1468a0 0x7fba0c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:13.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba119b0640 1 -- 172.21.15.137:0/3997725415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c1468a0 msgr2=0x7fba0c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:13.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba119b0640 1 --2- 172.21.15.137:0/3997725415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c1468a0 0x7fba0c0b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:13.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba119b0640 1 -- 172.21.15.137:0/3997725415 >> v1:172.21.15.170:6789/0 conn(0x7fba0c06ffd0 legacy=0x7fba0c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:13.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba119b0640 1 -- 172.21.15.137:0/3997725415 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c070fc0 con 0x7fba0c15d6f0 2024-04-26T22:04:13.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.166+0000 7fba121b1640 1 --2- 172.21.15.137:0/3997725415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c1468a0 0x7fba0c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:13.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.167+0000 7fba119b0640 1 --2- 172.21.15.137:0/3997725415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c15d6f0 0x7fba0c0b7790 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009870 tx=0x7fb9fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8c0e922bf1ef41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:13.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.167+0000 7fba111af640 1 -- 172.21.15.137:0/3997725415 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc037070 con 0x7fba0c15d6f0 2024-04-26T22:04:13.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.167+0000 7fba111af640 1 -- 172.21.15.137:0/3997725415 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc032440 con 0x7fba0c15d6f0 2024-04-26T22:04:13.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.167+0000 7fba111af640 1 -- 172.21.15.137:0/3997725415 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc032810 con 0x7fba0c15d6f0 2024-04-26T22:04:13.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.167+0000 7fba14415640 1 -- 172.21.15.137:0/3997725415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c15d6f0 msgr2=0x7fba0c0b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:13.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.167+0000 7fba14415640 1 --2- 172.21.15.137:0/3997725415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c15d6f0 0x7fba0c0b7790 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009870 tx=0x7fb9fc02a180 comp rx=0 tx=0).stop 2024-04-26T22:04:13.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.168+0000 7fba14415640 1 -- 172.21.15.137:0/3997725415 shutdown_connections 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.168+0000 7fba14415640 1 --2- 172.21.15.137:0/3997725415 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c15d6f0 0x7fba0c0b7790 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.168+0000 7fba14415640 1 --2- 172.21.15.137:0/3997725415 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c1468a0 0x7fba0c0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.168+0000 7fba14415640 1 -- 172.21.15.137:0/3997725415 >> 172.21.15.137:0/3997725415 conn(0x7fba0c06f050 msgr2=0x7fba0c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.168+0000 7fba14415640 1 -- 172.21.15.137:0/3997725415 shutdown_connections 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.168+0000 7fba14415640 1 -- 172.21.15.137:0/3997725415 wait complete. 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba14415640 1 Processor -- start 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba14415640 1 -- start start 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba14415640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c06ffd0 0x7fba0c1f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba14415640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c1468a0 0x7fba0c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba14415640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba0c15d6f0 0x7fba0c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba14415640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c146e00 con 0x7fba0c1468a0 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba14415640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fba0c146c80 con 0x7fba0c15d6f0 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba14415640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fba0c0ce920 con 0x7fba0c06ffd0 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba119b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c1468a0 0x7fba0c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:13.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba119b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c1468a0 0x7fba0c0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36508/0 (socket says 172.21.15.137:36508) 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.169+0000 7fba119b0640 1 -- 172.21.15.137:0/4255307475 learned_addr learned my addr 172.21.15.137:0/4255307475 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba121b1640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c06ffd0 0x7fba0c1f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba129b2640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba0c15d6f0 0x7fba0c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba119b0640 1 -- 172.21.15.137:0/4255307475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c06ffd0 msgr2=0x7fba0c1f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba119b0640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c06ffd0 0x7fba0c1f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba119b0640 1 -- 172.21.15.137:0/4255307475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba0c15d6f0 msgr2=0x7fba0c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba119b0640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba0c15d6f0 0x7fba0c0b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba119b0640 1 -- 172.21.15.137:0/4255307475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c0cca40 con 0x7fba0c1468a0 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba119b0640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c1468a0 0x7fba0c0b1890 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009870 tx=0x7fb9fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba02ffd640 1 -- 172.21.15.137:0/4255307475 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc041020 con 0x7fba0c1468a0 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba02ffd640 1 -- 172.21.15.137:0/4255307475 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc030970 con 0x7fba0c1468a0 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0c1f89a0 con 0x7fba0c1468a0 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba02ffd640 1 -- 172.21.15.137:0/4255307475 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc037040 con 0x7fba0c1468a0 2024-04-26T22:04:13.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.170+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0c1f8f60 con 0x7fba0c1468a0 2024-04-26T22:04:13.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.171+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba0c0ccc10 con 0x7fba0c1468a0 2024-04-26T22:04:13.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.171+0000 7fba02ffd640 1 -- 172.21.15.137:0/4255307475 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9fc044020 con 0x7fba0c1468a0 2024-04-26T22:04:13.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.172+0000 7fba02ffd640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9f006c8f0 0x7fb9f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:13.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.172+0000 7fba121b1640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9f006c8f0 0x7fb9f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:13.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.172+0000 7fba02ffd640 1 -- 172.21.15.137:0/4255307475 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5609+0+0 (secure 0 0 0) 0x7fb9fc0ac430 con 0x7fba0c1468a0 2024-04-26T22:04:13.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.172+0000 7fba121b1640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9f006c8f0 0x7fb9f006edb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fba0800a990 tx=0x7fba08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:13.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.177+0000 7fba02ffd640 1 -- 172.21.15.137:0/4255307475 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb9fc04b030 con 0x7fba0c1468a0 2024-04-26T22:04:13.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:13.389+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fba0c06a290 con 0x7fba0c1468a0 2024-04-26T22:04:13.695 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:04:13.698 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:04:14.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.041+0000 7fba02ffd640 1 -- 172.21.15.137:0/4255307475 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v45) ==== 174+0+0 (secure 0 0 0) 0x7fb9fc07a950 con 0x7fba0c1468a0 2024-04-26T22:04:14.041 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 12 and data pool 13 2024-04-26T22:04:14.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9f006c8f0 msgr2=0x7fb9f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9f006c8f0 0x7fb9f006edb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fba0800a990 tx=0x7fba08008040 comp rx=0 tx=0).stop 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c1468a0 msgr2=0x7fba0c0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c1468a0 0x7fba0c0b1890 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009870 tx=0x7fb9fc0046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 shutdown_connections 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb9f006c8f0 0x7fb9f006edb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fba0c1468a0 0x7fba0c0b1890 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba0c15d6f0 0x7fba0c0b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 --2- 172.21.15.137:0/4255307475 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fba0c06ffd0 0x7fba0c1f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 >> 172.21.15.137:0/4255307475 conn(0x7fba0c06f050 msgr2=0x7fba0c0b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 shutdown_connections 2024-04-26T22:04:14.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.043+0000 7fba14415640 1 -- 172.21.15.137:0/4255307475 wait complete. 2024-04-26T22:04:14.065 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:04:14.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.165+0000 7f20f719d640 1 Processor -- start 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20f719d640 1 -- start start 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20f719d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20f00d2e60 0x7f20f00d32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20f719d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00b2ce0 0x7f20f00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20f719d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f00b3a50 con 0x7f20f015d120 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20f719d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f20f00d3810 con 0x7f20f00d2e60 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20f719d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f20f00b3d30 con 0x7f20f00b2ce0 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20effff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20f00d2e60 0x7f20f00d32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20f4f39640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f20f015d120 0x7f20f00cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51848/0 (socket says 172.21.15.137:51848) 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20effff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20f00d2e60 0x7f20f00d32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36520/0 (socket says 172.21.15.137:36520) 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20f4f39640 1 -- 172.21.15.137:0/1350675850 learned_addr learned my addr 172.21.15.137:0/1350675850 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.166+0000 7f20f573a640 1 --2- 172.21.15.137:0/1350675850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00b2ce0 0x7f20f00b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.167+0000 7f20effff640 1 -- 172.21.15.137:0/1350675850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00b2ce0 msgr2=0x7f20f00b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.167+0000 7f20effff640 1 --2- 172.21.15.137:0/1350675850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00b2ce0 0x7f20f00b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.167+0000 7f20effff640 1 -- 172.21.15.137:0/1350675850 >> v1:172.21.15.137:6789/0 conn(0x7f20f015d120 legacy=0x7f20f00cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.167+0000 7f20ef7fe640 1 -- 172.21.15.137:0/1350675850 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350283254 0 0) 0x7f20f00b3a50 con 0x7f20f015d120 2024-04-26T22:04:14.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.167+0000 7f20effff640 1 -- 172.21.15.137:0/1350675850 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f00d0c80 con 0x7f20f00d2e60 2024-04-26T22:04:14.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.167+0000 7f20effff640 1 --2- 172.21.15.137:0/1350675850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 0x7f20f00d32d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f20e40097a0 tx=0x7f20e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb60216c5b1e1eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:14.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20ef7fe640 1 -- 172.21.15.137:0/1350675850 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4037070 con 0x7f20f00d2e60 2024-04-26T22:04:14.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20ef7fe640 1 -- 172.21.15.137:0/1350675850 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e4032440 con 0x7f20f00d2e60 2024-04-26T22:04:14.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20ef7fe640 1 -- 172.21.15.137:0/1350675850 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4032810 con 0x7f20f00d2e60 2024-04-26T22:04:14.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20f719d640 1 -- 172.21.15.137:0/1350675850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 msgr2=0x7f20f00d32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20f719d640 1 --2- 172.21.15.137:0/1350675850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 0x7f20f00d32d0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f20e40097a0 tx=0x7f20e402a180 comp rx=0 tx=0).stop 2024-04-26T22:04:14.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20f719d640 1 -- 172.21.15.137:0/1350675850 shutdown_connections 2024-04-26T22:04:14.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20f719d640 1 --2- 172.21.15.137:0/1350675850 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f00b2ce0 0x7f20f00b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20f719d640 1 --2- 172.21.15.137:0/1350675850 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 0x7f20f00d32d0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20f719d640 1 -- 172.21.15.137:0/1350675850 >> 172.21.15.137:0/1350675850 conn(0x7f20f009ba40 msgr2=0x7f20f009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:14.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20f719d640 1 -- 172.21.15.137:0/1350675850 shutdown_connections 2024-04-26T22:04:14.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.168+0000 7f20f719d640 1 -- 172.21.15.137:0/1350675850 wait complete. 2024-04-26T22:04:14.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.169+0000 7f20f719d640 1 Processor -- start 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.169+0000 7f20f719d640 1 -- start start 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20f719d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f00b2ce0 0x7f20f014c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20f719d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 0x7f20f00c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20f719d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d120 0x7f20f006d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20f719d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20f015d500 con 0x7f20f00d2e60 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20f719d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f20f00ce1a0 con 0x7f20f00b2ce0 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20f719d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f20f00b3690 con 0x7f20f015d120 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20effff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 0x7f20f00c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20effff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 0x7f20f00c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36532/0 (socket says 172.21.15.137:36532) 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20effff640 1 -- 172.21.15.137:0/90782215 learned_addr learned my addr 172.21.15.137:0/90782215 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20f4f39640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f00b2ce0 0x7f20f014c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.170+0000 7f20f573a640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d120 0x7f20f006d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20effff640 1 -- 172.21.15.137:0/90782215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d120 msgr2=0x7f20f006d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20effff640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d120 0x7f20f006d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20effff640 1 -- 172.21.15.137:0/90782215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f00b2ce0 msgr2=0x7f20f014c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20effff640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f00b2ce0 0x7f20f014c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20effff640 1 -- 172.21.15.137:0/90782215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f006dd10 con 0x7f20f00d2e60 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20f573a640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d120 0x7f20f006d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20effff640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 0x7f20f00c93b0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f20e40097a0 tx=0x7f20e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20ed7fa640 1 -- 172.21.15.137:0/90782215 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4037050 con 0x7f20f00d2e60 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20ed7fa640 1 -- 172.21.15.137:0/90782215 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e4038040 con 0x7f20f00d2e60 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f006dff0 con 0x7f20f00d2e60 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20ed7fa640 1 -- 172.21.15.137:0/90782215 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4004490 con 0x7f20f00d2e60 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.171+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f006e5b0 con 0x7f20f00d2e60 2024-04-26T22:04:14.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.172+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f00cd2d0 con 0x7f20f00d2e60 2024-04-26T22:04:14.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.173+0000 7f20ed7fa640 1 -- 172.21.15.137:0/90782215 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f20e403c6d0 con 0x7f20f00d2e60 2024-04-26T22:04:14.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.173+0000 7f20ed7fa640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20dc06c8f0 0x7f20dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.173+0000 7f20ed7fa640 1 -- 172.21.15.137:0/90782215 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f20e40ac650 con 0x7f20f00d2e60 2024-04-26T22:04:14.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.173+0000 7f20f4f39640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20dc06c8f0 0x7f20dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.173+0000 7f20f4f39640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20dc06c8f0 0x7f20dc06edb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f60 tx=0x7f20e0007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:14.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.177+0000 7f20ed7fa640 1 -- 172.21.15.137:0/90782215 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f20f00cd2d0 con 0x7f20f00d2e60 2024-04-26T22:04:14.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.354+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20f006a290 con 0x7f20f00d2e60 2024-04-26T22:04:14.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.355+0000 7f20ed7fa640 1 -- 172.21.15.137:0/90782215 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16685 (secure 0 0 0) 0x7f20e407aa00 con 0x7f20f00d2e60 2024-04-26T22:04:14.355 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:14.355 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":86,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:04:13.390593+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:04:11.600389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-26T22:04:12.347068+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:14.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20dc06c8f0 msgr2=0x7f20dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20dc06c8f0 0x7f20dc06edb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f20e0000f60 tx=0x7f20e0007c00 comp rx=0 tx=0).stop 2024-04-26T22:04:14.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 msgr2=0x7f20f00c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 0x7f20f00c93b0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f20e40097a0 tx=0x7f20e40046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 shutdown_connections 2024-04-26T22:04:14.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20dc06c8f0 0x7f20dc06edb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00d2e60 0x7f20f00c93b0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d120 0x7f20f006d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 --2- 172.21.15.137:0/90782215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f00b2ce0 0x7f20f014c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 >> 172.21.15.137:0/90782215 conn(0x7f20f009ba40 msgr2=0x7f20f00704d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:14.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 shutdown_connections 2024-04-26T22:04:14.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.357+0000 7f20f719d640 1 -- 172.21.15.137:0/90782215 wait complete. 2024-04-26T22:04:14.368 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:04:14.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.465+0000 7f7a48fb4640 1 Processor -- start 2024-04-26T22:04:14.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.465+0000 7f7a48fb4640 1 -- start start 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.466+0000 7f7a48fb4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7a440d3ee0 0x7f7a440cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.466+0000 7f7a48fb4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7a4415f750 0x7f7a440b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.466+0000 7f7a48fb4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a440d03a0 con 0x7f7a4415f370 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.466+0000 7f7a48fb4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7a440b4d10 con 0x7f7a4415f750 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.466+0000 7f7a48fb4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7a440d0680 con 0x7f7a440d3ee0 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.466+0000 7f7a42d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7a4415f750 0x7f7a440b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.466+0000 7f7a42d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7a4415f750 0x7f7a440b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36538/0 (socket says 172.21.15.137:36538) 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.466+0000 7f7a42d9d640 1 -- 172.21.15.137:0/2335685742 learned_addr learned my addr 172.21.15.137:0/2335685742 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.467+0000 7f7a41d9b640 1 --2- 172.21.15.137:0/2335685742 >> v2:172.21.15.170:3300/0 conn(0x7f7a440d3ee0 0x7f7a440cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.467+0000 7f7a42d9d640 1 -- 172.21.15.137:0/2335685742 >> v2:172.21.15.170:3300/0 conn(0x7f7a440d3ee0 msgr2=0x7f7a440cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.467+0000 7f7a42d9d640 1 --2- 172.21.15.137:0/2335685742 >> v2:172.21.15.170:3300/0 conn(0x7f7a440d3ee0 0x7f7a440cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.467+0000 7f7a42d9d640 1 -- 172.21.15.137:0/2335685742 >> v1:172.21.15.170:6789/0 conn(0x7f7a4415f370 legacy=0x7f7a440d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.467+0000 7f7a42d9d640 1 -- 172.21.15.137:0/2335685742 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a440d0960 con 0x7f7a4415f750 2024-04-26T22:04:14.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.467+0000 7f7a41d9b640 1 --2- 172.21.15.137:0/2335685742 >> v2:172.21.15.170:3300/0 conn(0x7f7a440d3ee0 0x7f7a440cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:14.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.467+0000 7f7a42d9d640 1 --2- 172.21.15.137:0/2335685742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 0x7f7a440b47d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009870 tx=0x7f7a3c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f3108947bc8b11 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:14.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a4159a640 1 -- 172.21.15.137:0/2335685742 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c037070 con 0x7f7a4415f750 2024-04-26T22:04:14.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a4159a640 1 -- 172.21.15.137:0/2335685742 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3c032440 con 0x7f7a4415f750 2024-04-26T22:04:14.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a4159a640 1 -- 172.21.15.137:0/2335685742 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c032810 con 0x7f7a4415f750 2024-04-26T22:04:14.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2335685742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 msgr2=0x7f7a440b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a48fb4640 1 --2- 172.21.15.137:0/2335685742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 0x7f7a440b47d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009870 tx=0x7f7a3c02a2a0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2335685742 shutdown_connections 2024-04-26T22:04:14.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a48fb4640 1 --2- 172.21.15.137:0/2335685742 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 0x7f7a440b47d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a48fb4640 1 --2- 172.21.15.137:0/2335685742 >> v2:172.21.15.170:3300/0 conn(0x7f7a440d3ee0 0x7f7a440cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2335685742 >> 172.21.15.137:0/2335685742 conn(0x7f7a4408ec10 msgr2=0x7f7a4409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:14.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2335685742 shutdown_connections 2024-04-26T22:04:14.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.468+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2335685742 wait complete. 2024-04-26T22:04:14.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a48fb4640 1 Processor -- start 2024-04-26T22:04:14.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a48fb4640 1 -- start start 2024-04-26T22:04:14.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a48fb4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a440d3ee0 0x7f7a441f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a48fb4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a4415f370 0x7f7a44162040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a48fb4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 0x7f7a440cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a48fb4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a440b51c0 con 0x7f7a4415f750 2024-04-26T22:04:14.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a48fb4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7a440d0f20 con 0x7f7a440d3ee0 2024-04-26T22:04:14.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a48fb4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7a440b5340 con 0x7f7a4415f370 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a42d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 0x7f7a440cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a42d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 0x7f7a440cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36552/0 (socket says 172.21.15.137:36552) 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.470+0000 7f7a42d9d640 1 -- 172.21.15.137:0/2879814229 learned_addr learned my addr 172.21.15.137:0/2879814229 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a41d9b640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a4415f370 0x7f7a44162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a4259c640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a440d3ee0 0x7f7a441f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a42d9d640 1 -- 172.21.15.137:0/2879814229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a4415f370 msgr2=0x7f7a44162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a42d9d640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a4415f370 0x7f7a44162040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a42d9d640 1 -- 172.21.15.137:0/2879814229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a440d3ee0 msgr2=0x7f7a441f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a42d9d640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a440d3ee0 0x7f7a441f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a42d9d640 1 -- 172.21.15.137:0/2879814229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a440c8cf0 con 0x7f7a4415f750 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a42d9d640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 0x7f7a440cb2a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009870 tx=0x7f7a3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a32ffd640 1 -- 172.21.15.137:0/2879814229 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c037040 con 0x7f7a4415f750 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a32ffd640 1 -- 172.21.15.137:0/2879814229 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3c042070 con 0x7f7a4415f750 2024-04-26T22:04:14.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a440c8fd0 con 0x7f7a4415f750 2024-04-26T22:04:14.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a32ffd640 1 -- 172.21.15.137:0/2879814229 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c030920 con 0x7f7a4415f750 2024-04-26T22:04:14.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.471+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a440c9590 con 0x7f7a4415f750 2024-04-26T22:04:14.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.472+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4406a290 con 0x7f7a4415f750 2024-04-26T22:04:14.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.473+0000 7f7a32ffd640 1 -- 172.21.15.137:0/2879814229 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a3c030ac0 con 0x7f7a4415f750 2024-04-26T22:04:14.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.473+0000 7f7a32ffd640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a2406c8f0 0x7f7a2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.473+0000 7f7a32ffd640 1 -- 172.21.15.137:0/2879814229 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f7a3c0ac2c0 con 0x7f7a4415f750 2024-04-26T22:04:14.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.473+0000 7f7a4259c640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a2406c8f0 0x7f7a2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.474+0000 7f7a4259c640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a2406c8f0 0x7f7a2406edb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7a34001f10 tx=0x7f7a34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:14.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.478+0000 7f7a32ffd640 1 -- 172.21.15.137:0/2879814229 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7a3c07a0a0 con 0x7f7a4415f750 2024-04-26T22:04:14.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.654+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a440d4ea0 con 0x7f7a4415f750 2024-04-26T22:04:14.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.655+0000 7f7a32ffd640 1 -- 172.21.15.137:0/2879814229 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16685 (secure 0 0 0) 0x7f7a3c07e3a0 con 0x7f7a4415f750 2024-04-26T22:04:14.656 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:14.656 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":86,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:04:13.390593+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:04:11.600389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-26T22:04:12.347068+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.657+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a2406c8f0 msgr2=0x7f7a2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.657+0000 7f7a48fb4640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a2406c8f0 0x7f7a2406edb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7a34001f10 tx=0x7f7a34009040 comp rx=0 tx=0).stop 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.657+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 msgr2=0x7f7a440cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.657+0000 7f7a48fb4640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 0x7f7a440cb2a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c009870 tx=0x7f7a3c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.657+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 shutdown_connections 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.657+0000 7f7a48fb4640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a2406c8f0 0x7f7a2406edb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.657+0000 7f7a48fb4640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a4415f750 0x7f7a440cb2a0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.657+0000 7f7a48fb4640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a4415f370 0x7f7a44162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.657+0000 7f7a48fb4640 1 --2- 172.21.15.137:0/2879814229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a440d3ee0 0x7f7a441f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.658+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 >> 172.21.15.137:0/2879814229 conn(0x7f7a4408ec10 msgr2=0x7f7a4409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:14.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.658+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 shutdown_connections 2024-04-26T22:04:14.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.658+0000 7f7a48fb4640 1 -- 172.21.15.137:0/2879814229 wait complete. 2024-04-26T22:04:14.669 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T22:04:14.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.768+0000 7f0cd09af640 1 Processor -- start 2024-04-26T22:04:14.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.768+0000 7f0cd09af640 1 -- start start 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cd09af640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0ccc15e7e0 0x7f0ccc0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cd09af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ccc161080 0x7f0ccc1614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cd09af640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ccc0cdd40 con 0x7f0ccc161cb0 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cd09af640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0ccc0d2280 con 0x7f0ccc15e7e0 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cd09af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0ccc161a10 con 0x7f0ccc161080 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cca59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0ccc15e7e0 0x7f0ccc0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cca59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0ccc15e7e0 0x7f0ccc0ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36558/0 (socket says 172.21.15.137:36558) 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cca59c640 1 -- 172.21.15.137:0/2989951011 learned_addr learned my addr 172.21.15.137:0/2989951011 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cca59c640 1 -- 172.21.15.137:0/2989951011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ccc161080 msgr2=0x7f0ccc1614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:14.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cca59c640 1 --2- 172.21.15.137:0/2989951011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ccc161080 0x7f0ccc1614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cca59c640 1 -- 172.21.15.137:0/2989951011 >> v1:172.21.15.170:6789/0 conn(0x7f0ccc161cb0 legacy=0x7f0ccc0d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.769+0000 7f0cca59c640 1 -- 172.21.15.137:0/2989951011 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ccc0cdfe0 con 0x7f0ccc15e7e0 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.770+0000 7f0cca59c640 1 --2- 172.21.15.137:0/2989951011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc15e7e0 0x7f0ccc0ceda0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009870 tx=0x7f0cbc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94abaf3a544dfa74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.770+0000 7f0cc9d9b640 1 -- 172.21.15.137:0/2989951011 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc037070 con 0x7f0ccc15e7e0 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.770+0000 7f0cc9d9b640 1 -- 172.21.15.137:0/2989951011 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc032440 con 0x7f0ccc15e7e0 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.770+0000 7f0cc9d9b640 1 -- 172.21.15.137:0/2989951011 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc032810 con 0x7f0ccc15e7e0 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.771+0000 7f0cd09af640 1 -- 172.21.15.137:0/2989951011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc15e7e0 msgr2=0x7f0ccc0ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.771+0000 7f0cd09af640 1 --2- 172.21.15.137:0/2989951011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc15e7e0 0x7f0ccc0ceda0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009870 tx=0x7f0cbc02a210 comp rx=0 tx=0).stop 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.771+0000 7f0cd09af640 1 -- 172.21.15.137:0/2989951011 shutdown_connections 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.771+0000 7f0cd09af640 1 --2- 172.21.15.137:0/2989951011 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ccc161080 0x7f0ccc1614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.771+0000 7f0cd09af640 1 --2- 172.21.15.137:0/2989951011 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc15e7e0 0x7f0ccc0ceda0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.771+0000 7f0cd09af640 1 -- 172.21.15.137:0/2989951011 >> 172.21.15.137:0/2989951011 conn(0x7f0ccc09ba40 msgr2=0x7f0ccc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.771+0000 7f0cd09af640 1 -- 172.21.15.137:0/2989951011 shutdown_connections 2024-04-26T22:04:14.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.771+0000 7f0cd09af640 1 -- 172.21.15.137:0/2989951011 wait complete. 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.772+0000 7f0cd09af640 1 Processor -- start 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.772+0000 7f0cd09af640 1 -- start start 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cd09af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ccc15e7e0 0x7f0ccc0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cd09af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc161080 0x7f0ccc0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cd09af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ccc161cb0 0x7f0ccc1f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cd09af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc0ce880 con 0x7f0ccc161080 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cd09af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc0ce5a0 con 0x7f0ccc161cb0 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cd09af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0ccc0cf2e0 con 0x7f0ccc15e7e0 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc161080 0x7f0ccc0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc161080 0x7f0ccc0cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36570/0 (socket says 172.21.15.137:36570) 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc3fff640 1 -- 172.21.15.137:0/1556459818 learned_addr learned my addr 172.21.15.137:0/1556459818 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc3fff640 1 -- 172.21.15.137:0/1556459818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ccc15e7e0 msgr2=0x7f0ccc0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc3fff640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ccc15e7e0 0x7f0ccc0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.775 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc3fff640 1 -- 172.21.15.137:0/1556459818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ccc161cb0 msgr2=0x7f0ccc1f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc3fff640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ccc161cb0 0x7f0ccc1f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc3fff640 1 -- 172.21.15.137:0/1556459818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ccc0cb6f0 con 0x7f0ccc161080 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc3fff640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc161080 0x7f0ccc0cc790 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c430 tx=0x7f0cb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc2ffd640 1 -- 172.21.15.137:0/1556459818 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4017070 con 0x7f0ccc161080 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc2ffd640 1 -- 172.21.15.137:0/1556459818 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb40035f0 con 0x7f0ccc161080 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ccc0cb9d0 con 0x7f0ccc161080 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.773+0000 7f0cc2ffd640 1 -- 172.21.15.137:0/1556459818 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40039e0 con 0x7f0ccc161080 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.774+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ccc0cbf90 con 0x7f0ccc161080 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.775+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ccc0cc480 con 0x7f0ccc161080 2024-04-26T22:04:14.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.775+0000 7f0cc2ffd640 1 -- 172.21.15.137:0/1556459818 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0cb401a070 con 0x7f0ccc161080 2024-04-26T22:04:14.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.775+0000 7f0cc2ffd640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0cac06c8f0 0x7f0cac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:14.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.775+0000 7f0cc2ffd640 1 -- 172.21.15.137:0/1556459818 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5709+0+0 (secure 0 0 0) 0x7f0cb408ae40 con 0x7f0ccc161080 2024-04-26T22:04:14.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.775+0000 7f0cca59c640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0cac06c8f0 0x7f0cac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:14.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.776+0000 7f0cca59c640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0cac06c8f0 0x7f0cac06edb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc034000 tx=0x7f0cbc02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:14.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.780+0000 7f0cc2ffd640 1 -- 172.21.15.137:0/1556459818 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0cb4058cb0 con 0x7f0ccc161080 2024-04-26T22:04:14.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:14.992+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0ccc068e00 con 0x7f0ccc161080 2024-04-26T22:04:15.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.058+0000 7f0cc2ffd640 1 -- 172.21.15.137:0/1556459818 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) ==== 118+0+0 (secure 0 0 0) 0x7f0cb405cfb0 con 0x7f0ccc161080 2024-04-26T22:04:15.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0cac06c8f0 msgr2=0x7f0cac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:15.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0cac06c8f0 0x7f0cac06edb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc034000 tx=0x7f0cbc02c000 comp rx=0 tx=0).stop 2024-04-26T22:04:15.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc161080 msgr2=0x7f0ccc0cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:15.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc161080 0x7f0ccc0cc790 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c430 tx=0x7f0cb400c8f0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 shutdown_connections 2024-04-26T22:04:15.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0cac06c8f0 0x7f0cac06edb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0ccc161080 0x7f0ccc0cc790 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ccc161cb0 0x7f0ccc1f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 --2- 172.21.15.137:0/1556459818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0ccc15e7e0 0x7f0ccc0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 >> 172.21.15.137:0/1556459818 conn(0x7f0ccc09ba40 msgr2=0x7f0ccc071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:15.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 shutdown_connections 2024-04-26T22:04:15.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.060+0000 7f0cd09af640 1 -- 172.21.15.137:0/1556459818 wait complete. 2024-04-26T22:04:15.071 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T22:04:15.071 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T22:04:15.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.171+0000 7faf3319d640 1 Processor -- start 2024-04-26T22:04:15.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.171+0000 7faf3319d640 1 -- start start 2024-04-26T22:04:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3319d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c0b7960 0x7faf2c160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3319d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faf2c15d6f0 0x7faf2c1611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3319d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf2c070740 con 0x7faf2c1468a0 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3319d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faf2c070a00 con 0x7faf2c15d6f0 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3319d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faf2c070ce0 con 0x7faf2c0b7960 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3173a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faf2c15d6f0 0x7faf2c1611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf30f39640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7faf2c1468a0 0x7faf2c0b7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:51858/0 (socket says 172.21.15.137:51858) 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3173a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faf2c15d6f0 0x7faf2c1611f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36574/0 (socket says 172.21.15.137:36574) 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf30f39640 1 -- 172.21.15.137:0/1654753257 learned_addr learned my addr 172.21.15.137:0/1654753257 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf2bfff640 1 --2- 172.21.15.137:0/1654753257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c0b7960 0x7faf2c160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3173a640 1 -- 172.21.15.137:0/1654753257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c0b7960 msgr2=0x7faf2c160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3173a640 1 --2- 172.21.15.137:0/1654753257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c0b7960 0x7faf2c160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3173a640 1 -- 172.21.15.137:0/1654753257 >> v1:172.21.15.137:6789/0 conn(0x7faf2c1468a0 legacy=0x7faf2c0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf3173a640 1 -- 172.21.15.137:0/1654753257 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c070fc0 con 0x7faf2c15d6f0 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf2b7fe640 1 -- 172.21.15.137:0/1654753257 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280322422 0 0) 0x7faf2c070740 con 0x7faf2c1468a0 2024-04-26T22:04:15.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.172+0000 7faf2bfff640 1 --2- 172.21.15.137:0/1654753257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c0b7960 0x7faf2c160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:15.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.173+0000 7faf3173a640 1 --2- 172.21.15.137:0/1654753257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c15d6f0 0x7faf2c1611f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7faf24009d90 tx=0x7faf2402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff103c7309a46ba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:15.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.173+0000 7faf2b7fe640 1 -- 172.21.15.137:0/1654753257 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24031600 con 0x7faf2c15d6f0 2024-04-26T22:04:15.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.173+0000 7faf2b7fe640 1 -- 172.21.15.137:0/1654753257 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf240317a0 con 0x7faf2c15d6f0 2024-04-26T22:04:15.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.173+0000 7faf2b7fe640 1 -- 172.21.15.137:0/1654753257 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24031b70 con 0x7faf2c15d6f0 2024-04-26T22:04:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.174+0000 7faf3319d640 1 -- 172.21.15.137:0/1654753257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c15d6f0 msgr2=0x7faf2c1611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.174+0000 7faf3319d640 1 --2- 172.21.15.137:0/1654753257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c15d6f0 0x7faf2c1611f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7faf24009d90 tx=0x7faf2402a5d0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.174+0000 7faf3319d640 1 -- 172.21.15.137:0/1654753257 shutdown_connections 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.174+0000 7faf3319d640 1 --2- 172.21.15.137:0/1654753257 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c15d6f0 0x7faf2c1611f0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.174+0000 7faf3319d640 1 --2- 172.21.15.137:0/1654753257 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c0b7960 0x7faf2c160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.174+0000 7faf3319d640 1 -- 172.21.15.137:0/1654753257 >> 172.21.15.137:0/1654753257 conn(0x7faf2c06f050 msgr2=0x7faf2c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.174+0000 7faf3319d640 1 -- 172.21.15.137:0/1654753257 shutdown_connections 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.174+0000 7faf3319d640 1 -- 172.21.15.137:0/1654753257 wait complete. 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.175+0000 7faf3319d640 1 Processor -- start 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.175+0000 7faf3319d640 1 -- start start 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf3319d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c0b7960 0x7faf2c13b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf3319d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c1468a0 0x7faf2c14bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf3319d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c15d6f0 0x7faf2c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf3319d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c146e00 con 0x7faf2c0b7960 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf3319d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c146c80 con 0x7faf2c1468a0 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf3319d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faf2c06ffd0 con 0x7faf2c15d6f0 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf30f39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c0b7960 0x7faf2c13b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf30f39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c0b7960 0x7faf2c13b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36576/0 (socket says 172.21.15.137:36576) 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf30f39640 1 -- 172.21.15.137:0/728363550 learned_addr learned my addr 172.21.15.137:0/728363550 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf30f39640 1 -- 172.21.15.137:0/728363550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c15d6f0 msgr2=0x7faf2c146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf3173a640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c15d6f0 0x7faf2c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf30f39640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c15d6f0 0x7faf2c146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf30f39640 1 -- 172.21.15.137:0/728363550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c1468a0 msgr2=0x7faf2c14bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf2bfff640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c1468a0 0x7faf2c14bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf30f39640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c1468a0 0x7faf2c14bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf30f39640 1 -- 172.21.15.137:0/728363550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c14c310 con 0x7faf2c0b7960 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.176+0000 7faf30f39640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c0b7960 0x7faf2c13b8a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c4d0 tx=0x7faf1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.177+0000 7faf297fa640 1 -- 172.21.15.137:0/728363550 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c018070 con 0x7faf2c0b7960 2024-04-26T22:04:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.177+0000 7faf297fa640 1 -- 172.21.15.137:0/728363550 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c007500 con 0x7faf2c0b7960 2024-04-26T22:04:15.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.177+0000 7faf297fa640 1 -- 172.21.15.137:0/728363550 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c004a20 con 0x7faf2c0b7960 2024-04-26T22:04:15.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.177+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c1495b0 con 0x7faf2c0b7960 2024-04-26T22:04:15.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.177+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2c149b70 con 0x7faf2c0b7960 2024-04-26T22:04:15.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.178+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2c06a290 con 0x7faf2c0b7960 2024-04-26T22:04:15.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.178+0000 7faf297fa640 1 -- 172.21.15.137:0/728363550 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf1c004bc0 con 0x7faf2c0b7960 2024-04-26T22:04:15.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.178+0000 7faf297fa640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf1806c8f0 0x7faf1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:15.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.179+0000 7faf297fa640 1 -- 172.21.15.137:0/728363550 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7faf1c08ad60 con 0x7faf2c0b7960 2024-04-26T22:04:15.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.179+0000 7faf2bfff640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf1806c8f0 0x7faf1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:15.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.179+0000 7faf2bfff640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf1806c8f0 0x7faf1806edb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faf2c15ffc0 tx=0x7faf20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:15.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.183+0000 7faf297fa640 1 -- 172.21.15.137:0/728363550 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faf1c059220 con 0x7faf2c0b7960 2024-04-26T22:04:15.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:15.393+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7faf2c1e79d0 con 0x7faf2c0b7960 2024-04-26T22:04:16.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.066+0000 7faf297fa640 1 -- 172.21.15.137:0/728363550 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) ==== 122+0+0 (secure 0 0 0) 0x7faf1c058b20 con 0x7faf2c0b7960 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf1806c8f0 msgr2=0x7faf1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf1806c8f0 0x7faf1806edb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faf2c15ffc0 tx=0x7faf20008040 comp rx=0 tx=0).stop 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c0b7960 msgr2=0x7faf2c13b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c0b7960 0x7faf2c13b8a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c4d0 tx=0x7faf1c00c990 comp rx=0 tx=0).stop 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 shutdown_connections 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf1806c8f0 0x7faf1806edb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf2c15d6f0 0x7faf2c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf2c1468a0 0x7faf2c14bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 --2- 172.21.15.137:0/728363550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf2c0b7960 0x7faf2c13b8a0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.068+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 >> 172.21.15.137:0/728363550 conn(0x7faf2c06f050 msgr2=0x7faf2c0b3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.069+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 shutdown_connections 2024-04-26T22:04:16.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.069+0000 7faf3319d640 1 -- 172.21.15.137:0/728363550 wait complete. 2024-04-26T22:04:16.081 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T22:04:16.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.181+0000 7f23ee46d640 1 Processor -- start 2024-04-26T22:04:16.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.181+0000 7f23ee46d640 1 -- start start 2024-04-26T22:04:16.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23ee46d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f23e815b4e0 0x7f23e8071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23ee46d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e80733e0 con 0x7f23e806f2c0 2024-04-26T22:04:16.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23ee46d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e8072f00 con 0x7f23e815b8c0 2024-04-26T22:04:16.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23ee46d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f23e8072660 con 0x7f23e815b4e0 2024-04-26T22:04:16.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23e7fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f23e815b4e0 0x7f23e8071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23eca0a640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f23e806f2c0 0x7f23e80b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45100/0 (socket says 172.21.15.137:45100) 2024-04-26T22:04:16.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23eca0a640 1 -- 172.21.15.137:0/3354995835 learned_addr learned my addr 172.21.15.137:0/3354995835 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:16.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23e7fff640 1 -- 172.21.15.137:0/3354995835 >> v1:172.21.15.170:6789/0 conn(0x7f23e815b8c0 legacy=0x7f23e806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:16.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23e7fff640 1 -- 172.21.15.137:0/3354995835 >> v1:172.21.15.137:6789/0 conn(0x7f23e806f2c0 legacy=0x7f23e80b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23e6ffd640 1 -- 172.21.15.137:0/3354995835 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955130362 0 0) 0x7f23e80733e0 con 0x7f23e806f2c0 2024-04-26T22:04:16.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.182+0000 7f23e7fff640 1 -- 172.21.15.137:0/3354995835 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e8072940 con 0x7f23e815b4e0 2024-04-26T22:04:16.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.183+0000 7f23e7fff640 1 --2- 172.21.15.137:0/3354995835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b4e0 0x7f23e8071fd0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f23d80097a0 tx=0x7f23d802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0c9151a7ffbbad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:16.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.183+0000 7f23e6ffd640 1 -- 172.21.15.137:0/3354995835 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8037070 con 0x7f23e815b4e0 2024-04-26T22:04:16.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.183+0000 7f23e6ffd640 1 -- 172.21.15.137:0/3354995835 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d802ae50 con 0x7f23e815b4e0 2024-04-26T22:04:16.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.183+0000 7f23e6ffd640 1 -- 172.21.15.137:0/3354995835 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8032660 con 0x7f23e815b4e0 2024-04-26T22:04:16.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.184+0000 7f23ee46d640 1 -- 172.21.15.137:0/3354995835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b4e0 msgr2=0x7f23e8071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.184+0000 7f23ee46d640 1 --2- 172.21.15.137:0/3354995835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b4e0 0x7f23e8071fd0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f23d80097a0 tx=0x7f23d802a140 comp rx=0 tx=0).stop 2024-04-26T22:04:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.184+0000 7f23ee46d640 1 -- 172.21.15.137:0/3354995835 shutdown_connections 2024-04-26T22:04:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.184+0000 7f23ee46d640 1 --2- 172.21.15.137:0/3354995835 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b4e0 0x7f23e8071fd0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.184+0000 7f23ee46d640 1 -- 172.21.15.137:0/3354995835 >> 172.21.15.137:0/3354995835 conn(0x7f23e80d0d30 msgr2=0x7f23e80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.184+0000 7f23ee46d640 1 -- 172.21.15.137:0/3354995835 shutdown_connections 2024-04-26T22:04:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.184+0000 7f23ee46d640 1 -- 172.21.15.137:0/3354995835 wait complete. 2024-04-26T22:04:16.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.185+0000 7f23ee46d640 1 Processor -- start 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.185+0000 7f23ee46d640 1 -- start start 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23ee46d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e806f2c0 0x7f23e815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23ee46d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23e815b4e0 0x7f23e814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23ee46d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b8c0 0x7f23e815a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23ee46d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8073820 con 0x7f23e815b8c0 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23ee46d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f23e80b3e80 con 0x7f23e806f2c0 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23ee46d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f23e80739a0 con 0x7f23e815b4e0 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23eca0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b8c0 0x7f23e815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23eca0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b8c0 0x7f23e815a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43968/0 (socket says 172.21.15.137:43968) 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23eca0a640 1 -- 172.21.15.137:0/1195098258 learned_addr learned my addr 172.21.15.137:0/1195098258 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23eca0a640 1 -- 172.21.15.137:0/1195098258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23e815b4e0 msgr2=0x7f23e814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23eca0a640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23e815b4e0 0x7f23e814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23eca0a640 1 -- 172.21.15.137:0/1195098258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e806f2c0 msgr2=0x7f23e815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23e7fff640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e806f2c0 0x7f23e815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23eca0a640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e806f2c0 0x7f23e815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23eca0a640 1 -- 172.21.15.137:0/1195098258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e80ce1b0 con 0x7f23e815b8c0 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23e7fff640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e806f2c0 0x7f23e815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23eca0a640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b8c0 0x7f23e815a820 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f23e000c7a0 tx=0x7f23e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23e4ff9640 1 -- 172.21.15.137:0/1195098258 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0018070 con 0x7f23e815b8c0 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23e4ff9640 1 -- 172.21.15.137:0/1195098258 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e000a640 con 0x7f23e815b8c0 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e80ce490 con 0x7f23e815b8c0 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23e4ff9640 1 -- 172.21.15.137:0/1195098258 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e000aab0 con 0x7f23e815b8c0 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.186+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e80cea50 con 0x7f23e815b8c0 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.188+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e806a290 con 0x7f23e815b8c0 2024-04-26T22:04:16.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.188+0000 7f23e4ff9640 1 -- 172.21.15.137:0/1195098258 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23e001b070 con 0x7f23e815b8c0 2024-04-26T22:04:16.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.188+0000 7f23e4ff9640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23d406c8f0 0x7f23d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.188+0000 7f23e4ff9640 1 -- 172.21.15.137:0/1195098258 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f23e008b0b0 con 0x7f23e815b8c0 2024-04-26T22:04:16.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.188+0000 7f23e7fff640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23d406c8f0 0x7f23d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.189+0000 7f23e7fff640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23d406c8f0 0x7f23d406edb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f23d8034000 tx=0x7f23d802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:16.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.193+0000 7f23e4ff9640 1 -- 172.21.15.137:0/1195098258 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f23e0059570 con 0x7f23e815b8c0 2024-04-26T22:04:16.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.404+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23e814fe90 con 0x7f23e815b8c0 2024-04-26T22:04:16.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.405+0000 7f23e4ff9640 1 -- 172.21.15.137:0/1195098258 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5192 (secure 0 0 0) 0x7f23e0058e70 con 0x7f23e815b8c0 2024-04-26T22:04:16.405 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:16.405 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":7317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/2128712520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2128712520},{"type":"v1","addr":"172.21.15.137:6837","nonce":2128712520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:04:15.394897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7335},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7335":{"gid":7335,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/865192507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":865192507},{"type":"v1","addr":"172.21.15.170:6835","nonce":865192507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7335,"qdb_cluster":[7335]},"id":6}]} 2024-04-26T22:04:16.405 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 47 2024-04-26T22:04:16.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23d406c8f0 msgr2=0x7f23d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23d406c8f0 0x7f23d406edb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f23d8034000 tx=0x7f23d802e000 comp rx=0 tx=0).stop 2024-04-26T22:04:16.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b8c0 msgr2=0x7f23e815a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b8c0 0x7f23e815a820 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f23e000c7a0 tx=0x7f23e000cc60 comp rx=0 tx=0).stop 2024-04-26T22:04:16.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 shutdown_connections 2024-04-26T22:04:16.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f23d406c8f0 0x7f23d406edb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f23e815b8c0 0x7f23e815a820 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f23e815b4e0 0x7f23e814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 --2- 172.21.15.137:0/1195098258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e806f2c0 0x7f23e815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 >> 172.21.15.137:0/1195098258 conn(0x7f23e80d0d30 msgr2=0x7f23e80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:16.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 shutdown_connections 2024-04-26T22:04:16.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.407+0000 7f23ee46d640 1 -- 172.21.15.137:0/1195098258 wait complete. 2024-04-26T22:04:16.419 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:04:16.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.725+0000 7f97253f2640 1 Processor -- start 2024-04-26T22:04:16.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.725+0000 7f97253f2640 1 -- start start 2024-04-26T22:04:16.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f97253f2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f972015f370 0x7f97200cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f97253f2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97200d03a0 con 0x7f97200d3ee0 2024-04-26T22:04:16.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f97253f2640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97200d0680 con 0x7f972015f750 2024-04-26T22:04:16.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f97253f2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f97200d0960 con 0x7f972015f370 2024-04-26T22:04:16.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971f7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f97200d3ee0 0x7f97200b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45104/0 (socket says 172.21.15.137:45104) 2024-04-26T22:04:16.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971f7fe640 1 -- 172.21.15.137:0/2768371209 learned_addr learned my addr 172.21.15.137:0/2768371209 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:16.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971effd640 1 --2- 172.21.15.137:0/2768371209 >> v2:172.21.15.170:3300/0 conn(0x7f972015f370 0x7f97200cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913612562 0 0) 0x7f97200d03a0 con 0x7f97200d3ee0 2024-04-26T22:04:16.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9708003520 con 0x7f97200d3ee0 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688367469 0 0) 0x7f97200d0680 con 0x7f972015f750 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97200d03a0 con 0x7f972015f750 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3769604880 0 0) 0x7f9708003520 con 0x7f97200d3ee0 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 >> v2:172.21.15.170:3300/0 conn(0x7f972015f370 msgr2=0x7f97200cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 --2- 172.21.15.137:0/2768371209 >> v2:172.21.15.170:3300/0 conn(0x7f972015f370 0x7f97200cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 >> v1:172.21.15.170:6789/0 conn(0x7f972015f750 legacy=0x7f97200d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97200d0c40 con 0x7f97200d3ee0 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f97180019f0 con 0x7f97200d3ee0 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 >> v1:172.21.15.137:6789/0 conn(0x7f97200d3ee0 legacy=0x7f97200b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.726+0000 7f971dffb640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9708003b40 0x7f9708003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971dffb640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9708004800 0x7f9708004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971dffb640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97080051c0 0x7f970800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97200d0960 con 0x7f9708004800 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f970800c040 con 0x7f97080051c0 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f970800c240 con 0x7f9708003b40 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971e7fc640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9708004800 0x7f9708004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971effd640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9708003b40 0x7f9708003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971f7fe640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97080051c0 0x7f970800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971e7fc640 1 -- 172.21.15.137:0/2768371209 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9708003b40 msgr2=0x7f9708003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:16.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971e7fc640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9708003b40 0x7f9708003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971e7fc640 1 -- 172.21.15.137:0/2768371209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97080051c0 msgr2=0x7f970800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:16.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971e7fc640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97080051c0 0x7f970800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971e7fc640 1 -- 172.21.15.137:0/2768371209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9708003520 con 0x7f9708004800 2024-04-26T22:04:16.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971f7fe640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97080051c0 0x7f970800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:16.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.727+0000 7f971f7fe640 1 -- 172.21.15.137:0/2768371209 reap_dead start 2024-04-26T22:04:16.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f971e7fc640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9708004800 0x7f9708004c80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f97140018d0 tx=0x7f9708005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321c7b428f4f5f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:16.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97140014f0 con 0x7f9708004800 2024-04-26T22:04:16.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97140052d0 con 0x7f9708004800 2024-04-26T22:04:16.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f971dffb640 1 -- 172.21.15.137:0/2768371209 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971402ac70 con 0x7f9708004800 2024-04-26T22:04:16.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f97253f2640 1 -- 172.21.15.137:0/2768371209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9708004800 msgr2=0x7f9708004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f97253f2640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9708004800 0x7f9708004c80 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f97140018d0 tx=0x7f9708005830 comp rx=0 tx=0).stop 2024-04-26T22:04:16.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f97253f2640 1 -- 172.21.15.137:0/2768371209 shutdown_connections 2024-04-26T22:04:16.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f97253f2640 1 --2- 172.21.15.137:0/2768371209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9708004800 0x7f9708004c80 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f97253f2640 1 -- 172.21.15.137:0/2768371209 >> 172.21.15.137:0/2768371209 conn(0x7f972008ec10 msgr2=0x7f972009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:16.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f97253f2640 1 -- 172.21.15.137:0/2768371209 shutdown_connections 2024-04-26T22:04:16.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.728+0000 7f97253f2640 1 -- 172.21.15.137:0/2768371209 wait complete. 2024-04-26T22:04:16.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f97253f2640 1 Processor -- start 2024-04-26T22:04:16.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f97253f2640 1 -- start start 2024-04-26T22:04:16.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f97253f2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9708004800 0x7f97200b8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f97253f2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97201f8600 0x7f97200baa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f97253f2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97201f57b0 0x7f97201f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f97253f2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97200cfef0 con 0x7f97201f8600 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f97253f2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f97200cfd70 con 0x7f97201f57b0 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f97253f2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f97200d0070 con 0x7f9708004800 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f971e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97201f8600 0x7f97200baa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f971e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97201f8600 0x7f97200baa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:43988/0 (socket says 172.21.15.137:43988) 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.730+0000 7f971e7fc640 1 -- 172.21.15.137:0/3861748423 learned_addr learned my addr 172.21.15.137:0/3861748423 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f971f7fe640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97201f57b0 0x7f97201f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f971effd640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9708004800 0x7f97200b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f971e7fc640 1 -- 172.21.15.137:0/3861748423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9708004800 msgr2=0x7f97200b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f971e7fc640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9708004800 0x7f97200b8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f971e7fc640 1 -- 172.21.15.137:0/3861748423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97201f57b0 msgr2=0x7f97201f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f971e7fc640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97201f57b0 0x7f97201f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f971e7fc640 1 -- 172.21.15.137:0/3861748423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97201f5010 con 0x7f97201f8600 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f971e7fc640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97201f8600 0x7f97200baa90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f9714000c00 tx=0x7f97140012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f97077fe640 1 -- 172.21.15.137:0/3861748423 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714040030 con 0x7f97201f8600 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f97077fe640 1 -- 172.21.15.137:0/3861748423 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9714005480 con 0x7f97201f8600 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97201f8de0 con 0x7f97201f8600 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f97077fe640 1 -- 172.21.15.137:0/3861748423 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97140014f0 con 0x7f97201f8600 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.731+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97201f93a0 con 0x7f97201f8600 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.732+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f972006a290 con 0x7f97201f8600 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.732+0000 7f97077fe640 1 -- 172.21.15.137:0/3861748423 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9714043070 con 0x7f97201f8600 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.733+0000 7f97077fe640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f970c06c920 0x7f970c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.733+0000 7f971effd640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f970c06c920 0x7f970c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.733+0000 7f97077fe640 1 -- 172.21.15.137:0/3861748423 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f97140ab7f0 con 0x7f97201f8600 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.733+0000 7f971effd640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f970c06c920 0x7f970c06ede0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9710009aa0 tx=0x7f9710008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:16.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.737+0000 7f97077fe640 1 -- 172.21.15.137:0/3861748423 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f97201f5010 con 0x7f97201f8600 2024-04-26T22:04:16.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.916+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97200b4790 con 0x7f97201f8600 2024-04-26T22:04:16.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.917+0000 7f97077fe640 1 -- 172.21.15.137:0/3861748423 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16672 (secure 0 0 0) 0x7f9714079cb0 con 0x7f97201f8600 2024-04-26T22:04:16.917 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:16.918 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:04:15.042019+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:04:11.600389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-26T22:04:12.347068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:16.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f970c06c920 msgr2=0x7f970c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f970c06c920 0x7f970c06ede0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9710009aa0 tx=0x7f9710008040 comp rx=0 tx=0).stop 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97201f8600 msgr2=0x7f97200baa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97201f8600 0x7f97200baa90 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f9714000c00 tx=0x7f97140012d0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 shutdown_connections 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f970c06c920 0x7f970c06ede0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97201f8600 0x7f97200baa90 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97201f57b0 0x7f97201f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 --2- 172.21.15.137:0/3861748423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9708004800 0x7f97200b8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 >> 172.21.15.137:0/3861748423 conn(0x7f972008ec10 msgr2=0x7f97200d5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 shutdown_connections 2024-04-26T22:04:16.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:16.919+0000 7f97253f2640 1 -- 172.21.15.137:0/3861748423 wait complete. 2024-04-26T22:04:16.931 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T22:04:16.931 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:04:17.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.029+0000 7f6adde1d640 1 Processor -- start 2024-04-26T22:04:17.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.029+0000 7f6adde1d640 1 -- start start 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.029+0000 7f6adde1d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6ad8140350 0x7f6ad80cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.029+0000 7f6adde1d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad80d05b0 con 0x7f6ad8146790 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.029+0000 7f6adde1d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad80d0890 con 0x7f6ad813ff70 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.029+0000 7f6adde1d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad806e450 con 0x7f6ad8140350 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad7fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6ad8146790 0x7f6ad80cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45106/0 (socket says 172.21.15.137:45106) 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad7fff640 1 -- 172.21.15.137:0/3902687727 learned_addr learned my addr 172.21.15.137:0/3902687727 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3902687727 >> v2:172.21.15.170:3300/0 conn(0x7f6ad8140350 0x7f6ad80cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907930028 0 0) 0x7f6ad80d05b0 con 0x7f6ad8146790 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ac0003520 con 0x7f6ad8146790 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2047890451 0 0) 0x7f6ad80d0890 con 0x7f6ad813ff70 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad80d05b0 con 0x7f6ad813ff70 2024-04-26T22:04:17.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3710192819 0 0) 0x7f6ac0003520 con 0x7f6ad8146790 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 >> v2:172.21.15.170:3300/0 conn(0x7f6ad8140350 msgr2=0x7f6ad80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 --2- 172.21.15.137:0/3902687727 >> v2:172.21.15.170:3300/0 conn(0x7f6ad8140350 0x7f6ad80cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 >> v1:172.21.15.170:6789/0 conn(0x7f6ad813ff70 legacy=0x7f6ad8146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad806e730 con 0x7f6ad8146790 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6ad00019f0 con 0x7f6ad8146790 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3902687727 >> v2:172.21.15.170:3300/0 conn(0x7f6ad8140350 0x7f6ad80cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 >> v1:172.21.15.137:6789/0 conn(0x7f6ad8146790 legacy=0x7f6ad80cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ac0003b40 0x7f6ac0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ac0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ac00051c0 0x7f6ac000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad806e450 con 0x7f6ac0004800 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac000c0f0 con 0x7f6ac0003b40 2024-04-26T22:04:17.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac000c2f0 con 0x7f6ac00051c0 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ac0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad77fe640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ac0003b40 0x7f6ac0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.030+0000 7f6ad7fff640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ac00051c0 0x7f6ac000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad6ffd640 1 -- 172.21.15.137:0/3902687727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ac00051c0 msgr2=0x7f6ac000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ac00051c0 0x7f6ac000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad6ffd640 1 -- 172.21.15.137:0/3902687727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ac0003b40 msgr2=0x7f6ac0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ac0003b40 0x7f6ac0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad6ffd640 1 -- 172.21.15.137:0/3902687727 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac0003520 con 0x7f6ac0004800 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad7fff640 1 -- 172.21.15.137:0/3902687727 reap_dead start 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ac0004c80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009c90 tx=0x7f6ac0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821fa7204fae0044 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:17.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8036070 con 0x7f6ac0004800 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ac8031400 con 0x7f6ac0004800 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.031+0000 7f6ad67fc640 1 -- 172.21.15.137:0/3902687727 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8009860 con 0x7f6ac0004800 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.032+0000 7f6adde1d640 1 -- 172.21.15.137:0/3902687727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 msgr2=0x7f6ac0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.032+0000 7f6adde1d640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ac0004c80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009c90 tx=0x7f6ac0005830 comp rx=0 tx=0).stop 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.032+0000 7f6adde1d640 1 -- 172.21.15.137:0/3902687727 shutdown_connections 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.032+0000 7f6adde1d640 1 --2- 172.21.15.137:0/3902687727 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ac0004c80 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.032+0000 7f6adde1d640 1 -- 172.21.15.137:0/3902687727 >> 172.21.15.137:0/3902687727 conn(0x7f6ad80d0d30 msgr2=0x7f6ad80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.032+0000 7f6adde1d640 1 -- 172.21.15.137:0/3902687727 shutdown_connections 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.032+0000 7f6adde1d640 1 -- 172.21.15.137:0/3902687727 wait complete. 2024-04-26T22:04:17.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.033+0000 7f6adde1d640 1 Processor -- start 2024-04-26T22:04:17.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.033+0000 7f6adde1d640 1 -- start start 2024-04-26T22:04:17.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6adde1d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ad815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6adde1d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad813b270 0x7f6ad81f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6adde1d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad80b5850 0x7f6ad80b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6adde1d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8146410 con 0x7f6ac0004800 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6adde1d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad8146290 con 0x7f6ad813b270 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6adde1d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad8146590 con 0x7f6ad80b5850 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ad815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ad815f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44010/0 (socket says 172.21.15.137:44010) 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad77fe640 1 -- 172.21.15.137:0/3435038904 learned_addr learned my addr 172.21.15.137:0/3435038904 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad7fff640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad80b5850 0x7f6ad80b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad813b270 0x7f6ad81f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad77fe640 1 -- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad80b5850 msgr2=0x7f6ad80b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad77fe640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad80b5850 0x7f6ad80b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad77fe640 1 -- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad813b270 msgr2=0x7f6ad81f3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad77fe640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad813b270 0x7f6ad81f3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad77fe640 1 -- 172.21.15.137:0/3435038904 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad815f860 con 0x7f6ac0004800 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad7fff640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad80b5850 0x7f6ad80b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:17.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad813b270 0x7f6ad81f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.034+0000 7f6ad77fe640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ad815f1f0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00f7a0 tx=0x7f6acc00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.035+0000 7f6abffff640 1 -- 172.21.15.137:0/3435038904 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00fe50 con 0x7f6ac0004800 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.035+0000 7f6abffff640 1 -- 172.21.15.137:0/3435038904 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc018070 con 0x7f6ac0004800 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.035+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad815fb40 con 0x7f6ac0004800 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.035+0000 7f6abffff640 1 -- 172.21.15.137:0/3435038904 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00d730 con 0x7f6ac0004800 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.035+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad8160100 con 0x7f6ac0004800 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.036+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad806a290 con 0x7f6ac0004800 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.036+0000 7f6abffff640 1 -- 172.21.15.137:0/3435038904 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6acc00d8d0 con 0x7f6ac0004800 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.036+0000 7f6abffff640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ac406c920 0x7f6ac406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.037+0000 7f6abffff640 1 -- 172.21.15.137:0/3435038904 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f6acc08ba20 con 0x7f6ac0004800 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.037+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ac406c920 0x7f6ac406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.037+0000 7f6ad6ffd640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ac406c920 0x7f6ac406ede0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8033000 tx=0x7f6ac8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:17.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.041+0000 7f6abffff640 1 -- 172.21.15.137:0/3435038904 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6acc059ee0 con 0x7f6ac0004800 2024-04-26T22:04:17.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.214+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ad80b6220 con 0x7f6ac406c920 2024-04-26T22:04:17.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.220+0000 7f6abffff640 1 -- 172.21.15.137:0/3435038904 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240154 (secure 0 0 0) 0x7f6ac80303a0 con 0x7f6ac406c920 2024-04-26T22:04:17.223 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:17.224 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:04:17.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ac406c920 msgr2=0x7f6ac406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ac406c920 0x7f6ac406ede0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8033000 tx=0x7f6ac8008030 comp rx=0 tx=0).stop 2024-04-26T22:04:17.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 msgr2=0x7f6ad815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ad815f1f0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00f7a0 tx=0x7f6acc00fc60 comp rx=0 tx=0).stop 2024-04-26T22:04:17.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 shutdown_connections 2024-04-26T22:04:17.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ac406c920 0x7f6ac406ede0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6ad80b5850 0x7f6ad80b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ad813b270 0x7f6ad81f3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 --2- 172.21.15.137:0/3435038904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6ac0004800 0x7f6ad815f1f0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 >> 172.21.15.137:0/3435038904 conn(0x7f6ad80d0d30 msgr2=0x7f6ad8160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:17.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 shutdown_connections 2024-04-26T22:04:17.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.223+0000 7f6adde1d640 1 -- 172.21.15.137:0/3435038904 wait complete. 2024-04-26T22:04:17.234 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-26T22:04:16.766565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266968,"kb_used_data":9176,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754707752,"statfs":{"total":773094113280,"available":772820738048,"internally_reserved":0,"allocated":9396224,"data_stored":4656476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.729930"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.042339+0000","last_change":"2024-04-26T22:04:12.042339+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.042339+0000","last_undegraded":"2024-04-26T22:04:12.042339+0000","last_fullsized":"2024-04-26T22:04:12.042339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038758+0000","last_change":"2024-04-26T22:04:12.038758+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038758+0000","last_undegraded":"2024-04-26T22:04:12.038758+0000","last_fullsized":"2024-04-26T22:04:12.038758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040016+0000","last_change":"2024-04-26T22:04:12.040016+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040016+0000","last_undegraded":"2024-04-26T22:04:12.040016+0000","last_fullsized":"2024-04-26T22:04:12.040016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039872+0000","last_change":"2024-04-26T22:04:12.039872+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039872+0000","last_undegraded":"2024-04-26T22:04:12.039872+0000","last_fullsized":"2024-04-26T22:04:12.039872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038754+0000","last_change":"2024-04-26T22:04:12.038754+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038754+0000","last_undegraded":"2024-04-26T22:04:12.038754+0000","last_fullsized":"2024-04-26T22:04:12.038754+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039990+0000","last_change":"2024-04-26T22:04:12.039990+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039990+0000","last_undegraded":"2024-04-26T22:04:12.039990+0000","last_fullsized":"2024-04-26T22:04:12.039990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039354+0000","last_change":"2024-04-26T22:04:12.039354+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039354+0000","last_undegraded":"2024-04-26T22:04:12.039354+0000","last_fullsized":"2024-04-26T22:04:12.039354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040845+0000","last_change":"2024-04-26T22:04:12.040845+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040845+0000","last_undegraded":"2024-04-26T22:04:12.040845+0000","last_fullsized":"2024-04-26T22:04:12.040845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041888+0000","last_change":"2024-04-26T22:04:12.041888+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041888+0000","last_undegraded":"2024-04-26T22:04:12.041888+0000","last_fullsized":"2024-04-26T22:04:12.041888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041253+0000","last_change":"2024-04-26T22:04:12.041253+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041253+0000","last_undegraded":"2024-04-26T22:04:12.041253+0000","last_fullsized":"2024-04-26T22:04:12.041253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.042015+0000","last_change":"2024-04-26T22:04:12.042015+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.042015+0000","last_undegraded":"2024-04-26T22:04:12.042015+0000","last_fullsized":"2024-04-26T22:04:12.042015+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041679+0000","last_change":"2024-04-26T22:04:12.041679+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041679+0000","last_undegraded":"2024-04-26T22:04:12.041679+0000","last_fullsized":"2024-04-26T22:04:12.041679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041440+0000","last_change":"2024-04-26T22:04:12.041440+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041440+0000","last_undegraded":"2024-04-26T22:04:12.041440+0000","last_fullsized":"2024-04-26T22:04:12.041440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041210+0000","last_change":"2024-04-26T22:04:12.041210+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041210+0000","last_undegraded":"2024-04-26T22:04:12.041210+0000","last_fullsized":"2024-04-26T22:04:12.041210+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041684+0000","last_change":"2024-04-26T22:04:12.041684+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041684+0000","last_undegraded":"2024-04-26T22:04:12.041684+0000","last_fullsized":"2024-04-26T22:04:12.041684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039282+0000","last_change":"2024-04-26T22:04:12.039282+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039282+0000","last_undegraded":"2024-04-26T22:04:12.039282+0000","last_fullsized":"2024-04-26T22:04:12.039282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041255+0000","last_change":"2024-04-26T22:04:12.041255+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041255+0000","last_undegraded":"2024-04-26T22:04:12.041255+0000","last_fullsized":"2024-04-26T22:04:12.041255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039289+0000","last_change":"2024-04-26T22:04:12.039289+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039289+0000","last_undegraded":"2024-04-26T22:04:12.039289+0000","last_fullsized":"2024-04-26T22:04:12.039289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039277+0000","last_change":"2024-04-26T22:04:12.039277+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039277+0000","last_undegraded":"2024-04-26T22:04:12.039277+0000","last_fullsized":"2024-04-26T22:04:12.039277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041056+0000","last_change":"2024-04-26T22:04:12.041056+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041056+0000","last_undegraded":"2024-04-26T22:04:12.041056+0000","last_fullsized":"2024-04-26T22:04:12.041056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.043068+0000","last_change":"2024-04-26T22:04:12.043068+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.043068+0000","last_undegraded":"2024-04-26T22:04:12.043068+0000","last_fullsized":"2024-04-26T22:04:12.043068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.043490+0000","last_change":"2024-04-26T22:04:12.043490+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.043490+0000","last_undegraded":"2024-04-26T22:04:12.043490+0000","last_fullsized":"2024-04-26T22:04:12.043490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040998+0000","last_change":"2024-04-26T22:04:12.040998+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040998+0000","last_undegraded":"2024-04-26T22:04:12.040998+0000","last_fullsized":"2024-04-26T22:04:12.040998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041826+0000","last_change":"2024-04-26T22:04:12.041826+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041826+0000","last_undegraded":"2024-04-26T22:04:12.041826+0000","last_fullsized":"2024-04-26T22:04:12.041826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041112+0000","last_change":"2024-04-26T22:04:12.041112+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041112+0000","last_undegraded":"2024-04-26T22:04:12.041112+0000","last_fullsized":"2024-04-26T22:04:12.041112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041256+0000","last_change":"2024-04-26T22:04:12.041256+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041256+0000","last_undegraded":"2024-04-26T22:04:12.041256+0000","last_fullsized":"2024-04-26T22:04:12.041256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041088+0000","last_change":"2024-04-26T22:04:12.041088+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041088+0000","last_undegraded":"2024-04-26T22:04:12.041088+0000","last_fullsized":"2024-04-26T22:04:12.041088+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039234+0000","last_change":"2024-04-26T22:04:12.039234+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039234+0000","last_undegraded":"2024-04-26T22:04:12.039234+0000","last_fullsized":"2024-04-26T22:04:12.039234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038776+0000","last_change":"2024-04-26T22:04:12.038776+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038776+0000","last_undegraded":"2024-04-26T22:04:12.038776+0000","last_fullsized":"2024-04-26T22:04:12.038776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041198+0000","last_change":"2024-04-26T22:04:12.041198+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041198+0000","last_undegraded":"2024-04-26T22:04:12.041198+0000","last_fullsized":"2024-04-26T22:04:12.041198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038823+0000","last_change":"2024-04-26T22:04:12.038823+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038823+0000","last_undegraded":"2024-04-26T22:04:12.038823+0000","last_fullsized":"2024-04-26T22:04:12.038823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038759+0000","last_change":"2024-04-26T22:04:12.038759+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038759+0000","last_undegraded":"2024-04-26T22:04:12.038759+0000","last_fullsized":"2024-04-26T22:04:12.038759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":298,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T22:04:12.038452+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:04:12.038452+0000","last_peered":"2024-04-26T22:04:12.038452+0000","last_clean":"2024-04-26T22:04:12.038452+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:04:12.038452+0000","last_undegraded":"2024-04-26T22:04:12.038452+0000","last_fullsized":"2024-04-26T22:04:12.038452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36928,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334912,"statfs":{"total":96636764160,"available":96598949888,"internally_reserved":0,"allocated":1626112,"data_stored":1027744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1032192,"data_stored":437376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":437376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1626112,"data_stored":1027744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:04:17.240 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:04:17.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.371+0000 7fbf6acb0640 1 Processor -- start 2024-04-26T22:04:17.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.371+0000 7fbf6acb0640 1 -- start start 2024-04-26T22:04:17.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf6acb0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbf6413ff70 0x7fbf64146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf6acb0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf640cff20 0x7fbf641465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf6acb0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf640d05b0 con 0x7fbf64140350 2024-04-26T22:04:17.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf6acb0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbf640d0890 con 0x7fbf6413ff70 2024-04-26T22:04:17.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf6acb0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6406e450 con 0x7fbf640cff20 2024-04-26T22:04:17.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf63fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbf64140350 0x7fbf640cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45120/0 (socket says 172.21.15.137:45120) 2024-04-26T22:04:17.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf63fff640 1 -- 172.21.15.137:0/3649088864 learned_addr learned my addr 172.21.15.137:0/3649088864 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:17.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4038663012 0 0) 0x7fbf640d05b0 con 0x7fbf64140350 2024-04-26T22:04:17.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf4c003520 con 0x7fbf64140350 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf68a4c640 1 --2- 172.21.15.137:0/3649088864 >> v2:172.21.15.170:3300/0 conn(0x7fbf6413ff70 0x7fbf64146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.372+0000 7fbf6924d640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf640cff20 0x7fbf641465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4280713307 0 0) 0x7fbf4c003520 con 0x7fbf64140350 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf640cff20 msgr2=0x7fbf641465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf640cff20 0x7fbf641465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 >> v2:172.21.15.170:3300/0 conn(0x7fbf6413ff70 msgr2=0x7fbf64146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 --2- 172.21.15.137:0/3649088864 >> v2:172.21.15.170:3300/0 conn(0x7fbf6413ff70 0x7fbf64146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf6406e730 con 0x7fbf64140350 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fbf58001670 con 0x7fbf64140350 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 >> v1:172.21.15.137:6789/0 conn(0x7fbf64140350 legacy=0x7fbf640cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf4c0039b0 0x7fbf4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf640cff20 0x7fbf4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf640d0890 con 0x7fbf4c004d40 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6406e450 con 0x7fbf4c0039b0 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf4c00b9c0 con 0x7fbf640cff20 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf6924d640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf68a4c640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf4c0039b0 0x7fbf4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf63fff640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf640cff20 0x7fbf4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf6924d640 1 -- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf640cff20 msgr2=0x7fbf4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf6924d640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf640cff20 0x7fbf4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf6924d640 1 -- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf4c0039b0 msgr2=0x7fbf4c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf6924d640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf4c0039b0 0x7fbf4c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf6924d640 1 -- 172.21.15.137:0/3649088864 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c003520 con 0x7fbf4c004d40 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.373+0000 7fbf63fff640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf640cff20 0x7fbf4c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.374+0000 7fbf6924d640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf4c0051c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009fc0 tx=0x7fbf4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dee74118c94ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.374+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c009c10 con 0x7fbf4c004d40 2024-04-26T22:04:17.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.374+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5c036070 con 0x7fbf4c004d40 2024-04-26T22:04:17.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.374+0000 7fbf637fe640 1 -- 172.21.15.137:0/3649088864 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c031880 con 0x7fbf4c004d40 2024-04-26T22:04:17.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.374+0000 7fbf6acb0640 1 -- 172.21.15.137:0/3649088864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 msgr2=0x7fbf4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.374+0000 7fbf6acb0640 1 --2- 172.21.15.137:0/3649088864 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf4c0051c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c009fc0 tx=0x7fbf4c005830 comp rx=0 tx=0).stop 2024-04-26T22:04:17.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.374+0000 7fbf6924d640 1 -- 172.21.15.137:0/3649088864 reap_dead start 2024-04-26T22:04:17.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.375+0000 7fbf6acb0640 1 -- 172.21.15.137:0/3649088864 shutdown_connections 2024-04-26T22:04:17.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.375+0000 7fbf6acb0640 1 -- 172.21.15.137:0/3649088864 >> 172.21.15.137:0/3649088864 conn(0x7fbf640d0d30 msgr2=0x7fbf640d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:17.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.375+0000 7fbf6acb0640 1 -- 172.21.15.137:0/3649088864 shutdown_connections 2024-04-26T22:04:17.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.375+0000 7fbf6acb0640 1 -- 172.21.15.137:0/3649088864 wait complete. 2024-04-26T22:04:17.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.376+0000 7fbf6acb0640 1 Processor -- start 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.376+0000 7fbf6acb0640 1 -- start start 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6acb0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf641455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6acb0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf64141f10 0x7fbf6415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6acb0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf6413e1a0 0x7fbf6413e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6acb0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64146990 con 0x7fbf4c004d40 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6acb0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64146810 con 0x7fbf64141f10 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6acb0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6406ec50 con 0x7fbf6413e1a0 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf68a4c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf641455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf68a4c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf641455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44032/0 (socket says 172.21.15.137:44032) 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf68a4c640 1 -- 172.21.15.137:0/1672044722 learned_addr learned my addr 172.21.15.137:0/1672044722 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf63fff640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf64141f10 0x7fbf6415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6924d640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf6413e1a0 0x7fbf6413e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf68a4c640 1 -- 172.21.15.137:0/1672044722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf6413e1a0 msgr2=0x7fbf6413e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf68a4c640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf6413e1a0 0x7fbf6413e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf68a4c640 1 -- 172.21.15.137:0/1672044722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf64141f10 msgr2=0x7fbf6415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf68a4c640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf64141f10 0x7fbf6415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf68a4c640 1 -- 172.21.15.137:0/1672044722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf640b03a0 con 0x7fbf4c004d40 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6924d640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf6413e1a0 0x7fbf6413e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf68a4c640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf641455f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbf54011960 tx=0x7fbf54011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf617fa640 1 -- 172.21.15.137:0/1672044722 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400faf0 con 0x7fbf4c004d40 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf617fa640 1 -- 172.21.15.137:0/1672044722 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf5400fc90 con 0x7fbf4c004d40 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf64142390 con 0x7fbf4c004d40 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf617fa640 1 -- 172.21.15.137:0/1672044722 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf54014440 con 0x7fbf4c004d40 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.377+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6415d7b0 con 0x7fbf4c004d40 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.378+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf6406a290 con 0x7fbf4c004d40 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.379+0000 7fbf617fa640 1 -- 172.21.15.137:0/1672044722 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf54012040 con 0x7fbf4c004d40 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.379+0000 7fbf617fa640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf5006c920 0x7fbf5006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.379+0000 7fbf617fa640 1 -- 172.21.15.137:0/1672044722 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7fbf5408c0b0 con 0x7fbf4c004d40 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.379+0000 7fbf63fff640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf5006c920 0x7fbf5006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.380+0000 7fbf63fff640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf5006c920 0x7fbf5006ede0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbf58001eb0 tx=0x7fbf58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:17.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.383+0000 7fbf617fa640 1 -- 172.21.15.137:0/1672044722 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbf54019030 con 0x7fbf4c004d40 2024-04-26T22:04:17.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.553+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf640b45e0 con 0x7fbf5006c920 2024-04-26T22:04:17.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.559+0000 7fbf617fa640 1 -- 172.21.15.137:0/1672044722 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240154 (secure 0 0 0) 0x7fbf640b45e0 con 0x7fbf5006c920 2024-04-26T22:04:17.561 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:17.562 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:04:17.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf5006c920 msgr2=0x7fbf5006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf5006c920 0x7fbf5006ede0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbf58001eb0 tx=0x7fbf58009040 comp rx=0 tx=0).stop 2024-04-26T22:04:17.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 msgr2=0x7fbf641455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf641455f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbf54011960 tx=0x7fbf54011e20 comp rx=0 tx=0).stop 2024-04-26T22:04:17.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 shutdown_connections 2024-04-26T22:04:17.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf5006c920 0x7fbf5006ede0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf6413e1a0 0x7fbf6413e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf64141f10 0x7fbf6415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 --2- 172.21.15.137:0/1672044722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf4c004d40 0x7fbf641455f0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 >> 172.21.15.137:0/1672044722 conn(0x7fbf640d0d30 msgr2=0x7fbf640b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:17.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 shutdown_connections 2024-04-26T22:04:17.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.562+0000 7fbf6acb0640 1 -- 172.21.15.137:0/1672044722 wait complete. 2024-04-26T22:04:17.573 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-26T22:04:16.766565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266968,"kb_used_data":9176,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754707752,"statfs":{"total":773094113280,"available":772820738048,"internally_reserved":0,"allocated":9396224,"data_stored":4656476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.729930"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.042339+0000","last_change":"2024-04-26T22:04:12.042339+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.042339+0000","last_undegraded":"2024-04-26T22:04:12.042339+0000","last_fullsized":"2024-04-26T22:04:12.042339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038758+0000","last_change":"2024-04-26T22:04:12.038758+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038758+0000","last_undegraded":"2024-04-26T22:04:12.038758+0000","last_fullsized":"2024-04-26T22:04:12.038758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040016+0000","last_change":"2024-04-26T22:04:12.040016+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040016+0000","last_undegraded":"2024-04-26T22:04:12.040016+0000","last_fullsized":"2024-04-26T22:04:12.040016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039872+0000","last_change":"2024-04-26T22:04:12.039872+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039872+0000","last_undegraded":"2024-04-26T22:04:12.039872+0000","last_fullsized":"2024-04-26T22:04:12.039872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038754+0000","last_change":"2024-04-26T22:04:12.038754+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038754+0000","last_undegraded":"2024-04-26T22:04:12.038754+0000","last_fullsized":"2024-04-26T22:04:12.038754+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039990+0000","last_change":"2024-04-26T22:04:12.039990+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039990+0000","last_undegraded":"2024-04-26T22:04:12.039990+0000","last_fullsized":"2024-04-26T22:04:12.039990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039354+0000","last_change":"2024-04-26T22:04:12.039354+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039354+0000","last_undegraded":"2024-04-26T22:04:12.039354+0000","last_fullsized":"2024-04-26T22:04:12.039354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040845+0000","last_change":"2024-04-26T22:04:12.040845+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040845+0000","last_undegraded":"2024-04-26T22:04:12.040845+0000","last_fullsized":"2024-04-26T22:04:12.040845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041888+0000","last_change":"2024-04-26T22:04:12.041888+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041888+0000","last_undegraded":"2024-04-26T22:04:12.041888+0000","last_fullsized":"2024-04-26T22:04:12.041888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041253+0000","last_change":"2024-04-26T22:04:12.041253+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041253+0000","last_undegraded":"2024-04-26T22:04:12.041253+0000","last_fullsized":"2024-04-26T22:04:12.041253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.042015+0000","last_change":"2024-04-26T22:04:12.042015+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.042015+0000","last_undegraded":"2024-04-26T22:04:12.042015+0000","last_fullsized":"2024-04-26T22:04:12.042015+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041679+0000","last_change":"2024-04-26T22:04:12.041679+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041679+0000","last_undegraded":"2024-04-26T22:04:12.041679+0000","last_fullsized":"2024-04-26T22:04:12.041679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041440+0000","last_change":"2024-04-26T22:04:12.041440+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041440+0000","last_undegraded":"2024-04-26T22:04:12.041440+0000","last_fullsized":"2024-04-26T22:04:12.041440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041210+0000","last_change":"2024-04-26T22:04:12.041210+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041210+0000","last_undegraded":"2024-04-26T22:04:12.041210+0000","last_fullsized":"2024-04-26T22:04:12.041210+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041684+0000","last_change":"2024-04-26T22:04:12.041684+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041684+0000","last_undegraded":"2024-04-26T22:04:12.041684+0000","last_fullsized":"2024-04-26T22:04:12.041684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039282+0000","last_change":"2024-04-26T22:04:12.039282+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039282+0000","last_undegraded":"2024-04-26T22:04:12.039282+0000","last_fullsized":"2024-04-26T22:04:12.039282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041255+0000","last_change":"2024-04-26T22:04:12.041255+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041255+0000","last_undegraded":"2024-04-26T22:04:12.041255+0000","last_fullsized":"2024-04-26T22:04:12.041255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039289+0000","last_change":"2024-04-26T22:04:12.039289+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039289+0000","last_undegraded":"2024-04-26T22:04:12.039289+0000","last_fullsized":"2024-04-26T22:04:12.039289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039277+0000","last_change":"2024-04-26T22:04:12.039277+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039277+0000","last_undegraded":"2024-04-26T22:04:12.039277+0000","last_fullsized":"2024-04-26T22:04:12.039277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041056+0000","last_change":"2024-04-26T22:04:12.041056+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041056+0000","last_undegraded":"2024-04-26T22:04:12.041056+0000","last_fullsized":"2024-04-26T22:04:12.041056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.043068+0000","last_change":"2024-04-26T22:04:12.043068+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.043068+0000","last_undegraded":"2024-04-26T22:04:12.043068+0000","last_fullsized":"2024-04-26T22:04:12.043068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.043490+0000","last_change":"2024-04-26T22:04:12.043490+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.043490+0000","last_undegraded":"2024-04-26T22:04:12.043490+0000","last_fullsized":"2024-04-26T22:04:12.043490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040998+0000","last_change":"2024-04-26T22:04:12.040998+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040998+0000","last_undegraded":"2024-04-26T22:04:12.040998+0000","last_fullsized":"2024-04-26T22:04:12.040998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041826+0000","last_change":"2024-04-26T22:04:12.041826+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041826+0000","last_undegraded":"2024-04-26T22:04:12.041826+0000","last_fullsized":"2024-04-26T22:04:12.041826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041112+0000","last_change":"2024-04-26T22:04:12.041112+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041112+0000","last_undegraded":"2024-04-26T22:04:12.041112+0000","last_fullsized":"2024-04-26T22:04:12.041112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041256+0000","last_change":"2024-04-26T22:04:12.041256+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041256+0000","last_undegraded":"2024-04-26T22:04:12.041256+0000","last_fullsized":"2024-04-26T22:04:12.041256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041088+0000","last_change":"2024-04-26T22:04:12.041088+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041088+0000","last_undegraded":"2024-04-26T22:04:12.041088+0000","last_fullsized":"2024-04-26T22:04:12.041088+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039234+0000","last_change":"2024-04-26T22:04:12.039234+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039234+0000","last_undegraded":"2024-04-26T22:04:12.039234+0000","last_fullsized":"2024-04-26T22:04:12.039234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038776+0000","last_change":"2024-04-26T22:04:12.038776+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038776+0000","last_undegraded":"2024-04-26T22:04:12.038776+0000","last_fullsized":"2024-04-26T22:04:12.038776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041198+0000","last_change":"2024-04-26T22:04:12.041198+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041198+0000","last_undegraded":"2024-04-26T22:04:12.041198+0000","last_fullsized":"2024-04-26T22:04:12.041198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038823+0000","last_change":"2024-04-26T22:04:12.038823+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038823+0000","last_undegraded":"2024-04-26T22:04:12.038823+0000","last_fullsized":"2024-04-26T22:04:12.038823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038759+0000","last_change":"2024-04-26T22:04:12.038759+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038759+0000","last_undegraded":"2024-04-26T22:04:12.038759+0000","last_fullsized":"2024-04-26T22:04:12.038759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":298,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T22:04:12.038452+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:04:12.038452+0000","last_peered":"2024-04-26T22:04:12.038452+0000","last_clean":"2024-04-26T22:04:12.038452+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:04:12.038452+0000","last_undegraded":"2024-04-26T22:04:12.038452+0000","last_fullsized":"2024-04-26T22:04:12.038452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36928,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334912,"statfs":{"total":96636764160,"available":96598949888,"internally_reserved":0,"allocated":1626112,"data_stored":1027744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1032192,"data_stored":437376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":437376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1626112,"data_stored":1027744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:04:17.577 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:04:17.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.710+0000 7ff49c79d640 1 Processor -- start 2024-04-26T22:04:17.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.710+0000 7ff49c79d640 1 -- start start 2024-04-26T22:04:17.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.711+0000 7ff49c79d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff49415f1e0 0x7ff49406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.711+0000 7ff49c79d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 0x7ff4940ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.711+0000 7ff49c79d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4940b4a10 con 0x7ff49406d2b0 2024-04-26T22:04:17.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.711+0000 7ff49c79d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff49406eeb0 con 0x7ff49415f1e0 2024-04-26T22:04:17.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.711+0000 7ff49c79d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff4940b4cf0 con 0x7ff4940b44e0 2024-04-26T22:04:17.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.711+0000 7ff499d38640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 0x7ff4940ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.711+0000 7ff49a539640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff49415f1e0 0x7ff49406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.711+0000 7ff49ad3a640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ff49406d2b0 0x7ff4940b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:44526/0 (socket says 172.21.15.137:44526) 2024-04-26T22:04:17.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.711+0000 7ff49ad3a640 1 -- 172.21.15.137:0/3501976536 learned_addr learned my addr 172.21.15.137:0/3501976536 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:17.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.712+0000 7ff49a539640 1 -- 172.21.15.137:0/3501976536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 msgr2=0x7ff4940ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:17.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.712+0000 7ff49a539640 1 --2- 172.21.15.137:0/3501976536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 0x7ff4940ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.712+0000 7ff49a539640 1 -- 172.21.15.137:0/3501976536 >> v1:172.21.15.170:6789/0 conn(0x7ff49406d2b0 legacy=0x7ff4940b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.712+0000 7ff49a539640 1 -- 172.21.15.137:0/3501976536 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4940b4fd0 con 0x7ff49415f1e0 2024-04-26T22:04:17.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.712+0000 7ff49a539640 1 --2- 172.21.15.137:0/3501976536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49415f1e0 0x7ff49406e970 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d90 tx=0x7ff48c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=642af10eedc5c8ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:17.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.712+0000 7ff499537640 1 -- 172.21.15.137:0/3501976536 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c007740 con 0x7ff49415f1e0 2024-04-26T22:04:17.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.712+0000 7ff499537640 1 -- 172.21.15.137:0/3501976536 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48c0078e0 con 0x7ff49415f1e0 2024-04-26T22:04:17.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.713+0000 7ff499537640 1 -- 172.21.15.137:0/3501976536 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c007cb0 con 0x7ff49415f1e0 2024-04-26T22:04:17.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.713+0000 7ff49c79d640 1 -- 172.21.15.137:0/3501976536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49415f1e0 msgr2=0x7ff49406e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.713+0000 7ff49c79d640 1 --2- 172.21.15.137:0/3501976536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49415f1e0 0x7ff49406e970 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d90 tx=0x7ff48c02a660 comp rx=0 tx=0).stop 2024-04-26T22:04:17.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.713+0000 7ff49c79d640 1 -- 172.21.15.137:0/3501976536 shutdown_connections 2024-04-26T22:04:17.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.713+0000 7ff49c79d640 1 --2- 172.21.15.137:0/3501976536 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 0x7ff4940ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.713+0000 7ff49c79d640 1 --2- 172.21.15.137:0/3501976536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49415f1e0 0x7ff49406e970 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.713+0000 7ff49c79d640 1 -- 172.21.15.137:0/3501976536 >> 172.21.15.137:0/3501976536 conn(0x7ff4940728a0 msgr2=0x7ff494072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:17.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.713+0000 7ff49c79d640 1 -- 172.21.15.137:0/3501976536 shutdown_connections 2024-04-26T22:04:17.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.713+0000 7ff49c79d640 1 -- 172.21.15.137:0/3501976536 wait complete. 2024-04-26T22:04:17.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.714+0000 7ff49c79d640 1 Processor -- start 2024-04-26T22:04:17.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.714+0000 7ff49c79d640 1 -- start start 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49c79d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49406d2b0 0x7ff494150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49c79d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 0x7ff49415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49c79d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49415f1e0 0x7ff4941615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49c79d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff4940aedf0 con 0x7ff49406d2b0 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49c79d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff4940b5590 con 0x7ff49415f1e0 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49c79d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff49415f5c0 con 0x7ff4940b44e0 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49a539640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49406d2b0 0x7ff494150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49a539640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49406d2b0 0x7ff494150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44036/0 (socket says 172.21.15.137:44036) 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49a539640 1 -- 172.21.15.137:0/1629690561 learned_addr learned my addr 172.21.15.137:0/1629690561 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff499d38640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 0x7ff49415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49ad3a640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49415f1e0 0x7ff4941615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49a539640 1 -- 172.21.15.137:0/1629690561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 msgr2=0x7ff49415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49a539640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 0x7ff49415c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49a539640 1 -- 172.21.15.137:0/1629690561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49415f1e0 msgr2=0x7ff4941615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.715+0000 7ff49a539640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49415f1e0 0x7ff4941615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.716+0000 7ff49a539640 1 -- 172.21.15.137:0/1629690561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49415b5a0 con 0x7ff49406d2b0 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.716+0000 7ff49a539640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49406d2b0 0x7ff494150300 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d90 tx=0x7ff48c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.716+0000 7ff48affd640 1 -- 172.21.15.137:0/1629690561 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c03f070 con 0x7ff49406d2b0 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.716+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49415b880 con 0x7ff49406d2b0 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.716+0000 7ff48affd640 1 -- 172.21.15.137:0/1629690561 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48c031c40 con 0x7ff49406d2b0 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.716+0000 7ff48affd640 1 -- 172.21.15.137:0/1629690561 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48c009450 con 0x7ff49406d2b0 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.716+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49415be40 con 0x7ff49406d2b0 2024-04-26T22:04:17.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.717+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff49406a290 con 0x7ff49406d2b0 2024-04-26T22:04:17.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.717+0000 7ff48affd640 1 -- 172.21.15.137:0/1629690561 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff48c044460 con 0x7ff49406d2b0 2024-04-26T22:04:17.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.718+0000 7ff48affd640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff47806c8f0 0x7ff47806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:17.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.718+0000 7ff48affd640 1 -- 172.21.15.137:0/1629690561 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7ff48c0ad1e0 con 0x7ff49406d2b0 2024-04-26T22:04:17.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.718+0000 7ff499d38640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff47806c8f0 0x7ff47806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:17.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.718+0000 7ff499d38640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff47806c8f0 0x7ff47806edb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff494150e90 tx=0x7ff484009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:17.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.722+0000 7ff48affd640 1 -- 172.21.15.137:0/1629690561 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff48c07af40 con 0x7ff49406d2b0 2024-04-26T22:04:17.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.893+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff494073710 con 0x7ff47806c8f0 2024-04-26T22:04:17.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.898+0000 7ff48affd640 1 -- 172.21.15.137:0/1629690561 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240154 (secure 0 0 0) 0x7ff484011a30 con 0x7ff47806c8f0 2024-04-26T22:04:17.903 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:17.905 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:04:17.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff47806c8f0 msgr2=0x7ff47806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff47806c8f0 0x7ff47806edb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff494150e90 tx=0x7ff484009190 comp rx=0 tx=0).stop 2024-04-26T22:04:17.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49406d2b0 msgr2=0x7ff494150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:17.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49406d2b0 0x7ff494150300 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009d90 tx=0x7ff48c004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:17.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 shutdown_connections 2024-04-26T22:04:17.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff47806c8f0 0x7ff47806edb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff49415f1e0 0x7ff4941615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff4940b44e0 0x7ff49415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 --2- 172.21.15.137:0/1629690561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff49406d2b0 0x7ff494150300 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:17.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 >> 172.21.15.137:0/1629690561 conn(0x7ff4940728a0 msgr2=0x7ff49406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:17.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 shutdown_connections 2024-04-26T22:04:17.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:17.902+0000 7ff49c79d640 1 -- 172.21.15.137:0/1629690561 wait complete. 2024-04-26T22:04:17.913 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-26T22:04:16.766565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266968,"kb_used_data":9176,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754707752,"statfs":{"total":773094113280,"available":772820738048,"internally_reserved":0,"allocated":9396224,"data_stored":4656476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.729930"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.042339+0000","last_change":"2024-04-26T22:04:12.042339+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.042339+0000","last_undegraded":"2024-04-26T22:04:12.042339+0000","last_fullsized":"2024-04-26T22:04:12.042339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038758+0000","last_change":"2024-04-26T22:04:12.038758+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038758+0000","last_undegraded":"2024-04-26T22:04:12.038758+0000","last_fullsized":"2024-04-26T22:04:12.038758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040016+0000","last_change":"2024-04-26T22:04:12.040016+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040016+0000","last_undegraded":"2024-04-26T22:04:12.040016+0000","last_fullsized":"2024-04-26T22:04:12.040016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039872+0000","last_change":"2024-04-26T22:04:12.039872+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039872+0000","last_undegraded":"2024-04-26T22:04:12.039872+0000","last_fullsized":"2024-04-26T22:04:12.039872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038754+0000","last_change":"2024-04-26T22:04:12.038754+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038754+0000","last_undegraded":"2024-04-26T22:04:12.038754+0000","last_fullsized":"2024-04-26T22:04:12.038754+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039990+0000","last_change":"2024-04-26T22:04:12.039990+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039990+0000","last_undegraded":"2024-04-26T22:04:12.039990+0000","last_fullsized":"2024-04-26T22:04:12.039990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039354+0000","last_change":"2024-04-26T22:04:12.039354+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039354+0000","last_undegraded":"2024-04-26T22:04:12.039354+0000","last_fullsized":"2024-04-26T22:04:12.039354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040845+0000","last_change":"2024-04-26T22:04:12.040845+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040845+0000","last_undegraded":"2024-04-26T22:04:12.040845+0000","last_fullsized":"2024-04-26T22:04:12.040845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041888+0000","last_change":"2024-04-26T22:04:12.041888+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041888+0000","last_undegraded":"2024-04-26T22:04:12.041888+0000","last_fullsized":"2024-04-26T22:04:12.041888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041253+0000","last_change":"2024-04-26T22:04:12.041253+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041253+0000","last_undegraded":"2024-04-26T22:04:12.041253+0000","last_fullsized":"2024-04-26T22:04:12.041253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.042015+0000","last_change":"2024-04-26T22:04:12.042015+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.042015+0000","last_undegraded":"2024-04-26T22:04:12.042015+0000","last_fullsized":"2024-04-26T22:04:12.042015+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041679+0000","last_change":"2024-04-26T22:04:12.041679+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041679+0000","last_undegraded":"2024-04-26T22:04:12.041679+0000","last_fullsized":"2024-04-26T22:04:12.041679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041440+0000","last_change":"2024-04-26T22:04:12.041440+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041440+0000","last_undegraded":"2024-04-26T22:04:12.041440+0000","last_fullsized":"2024-04-26T22:04:12.041440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041210+0000","last_change":"2024-04-26T22:04:12.041210+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041210+0000","last_undegraded":"2024-04-26T22:04:12.041210+0000","last_fullsized":"2024-04-26T22:04:12.041210+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041684+0000","last_change":"2024-04-26T22:04:12.041684+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041684+0000","last_undegraded":"2024-04-26T22:04:12.041684+0000","last_fullsized":"2024-04-26T22:04:12.041684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039282+0000","last_change":"2024-04-26T22:04:12.039282+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039282+0000","last_undegraded":"2024-04-26T22:04:12.039282+0000","last_fullsized":"2024-04-26T22:04:12.039282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041255+0000","last_change":"2024-04-26T22:04:12.041255+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041255+0000","last_undegraded":"2024-04-26T22:04:12.041255+0000","last_fullsized":"2024-04-26T22:04:12.041255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039289+0000","last_change":"2024-04-26T22:04:12.039289+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039289+0000","last_undegraded":"2024-04-26T22:04:12.039289+0000","last_fullsized":"2024-04-26T22:04:12.039289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039277+0000","last_change":"2024-04-26T22:04:12.039277+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039277+0000","last_undegraded":"2024-04-26T22:04:12.039277+0000","last_fullsized":"2024-04-26T22:04:12.039277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041056+0000","last_change":"2024-04-26T22:04:12.041056+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041056+0000","last_undegraded":"2024-04-26T22:04:12.041056+0000","last_fullsized":"2024-04-26T22:04:12.041056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.043068+0000","last_change":"2024-04-26T22:04:12.043068+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.043068+0000","last_undegraded":"2024-04-26T22:04:12.043068+0000","last_fullsized":"2024-04-26T22:04:12.043068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.043490+0000","last_change":"2024-04-26T22:04:12.043490+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.043490+0000","last_undegraded":"2024-04-26T22:04:12.043490+0000","last_fullsized":"2024-04-26T22:04:12.043490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040998+0000","last_change":"2024-04-26T22:04:12.040998+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040998+0000","last_undegraded":"2024-04-26T22:04:12.040998+0000","last_fullsized":"2024-04-26T22:04:12.040998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041826+0000","last_change":"2024-04-26T22:04:12.041826+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041826+0000","last_undegraded":"2024-04-26T22:04:12.041826+0000","last_fullsized":"2024-04-26T22:04:12.041826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041112+0000","last_change":"2024-04-26T22:04:12.041112+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041112+0000","last_undegraded":"2024-04-26T22:04:12.041112+0000","last_fullsized":"2024-04-26T22:04:12.041112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041256+0000","last_change":"2024-04-26T22:04:12.041256+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041256+0000","last_undegraded":"2024-04-26T22:04:12.041256+0000","last_fullsized":"2024-04-26T22:04:12.041256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041088+0000","last_change":"2024-04-26T22:04:12.041088+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041088+0000","last_undegraded":"2024-04-26T22:04:12.041088+0000","last_fullsized":"2024-04-26T22:04:12.041088+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039234+0000","last_change":"2024-04-26T22:04:12.039234+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039234+0000","last_undegraded":"2024-04-26T22:04:12.039234+0000","last_fullsized":"2024-04-26T22:04:12.039234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038776+0000","last_change":"2024-04-26T22:04:12.038776+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038776+0000","last_undegraded":"2024-04-26T22:04:12.038776+0000","last_fullsized":"2024-04-26T22:04:12.038776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041198+0000","last_change":"2024-04-26T22:04:12.041198+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041198+0000","last_undegraded":"2024-04-26T22:04:12.041198+0000","last_fullsized":"2024-04-26T22:04:12.041198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038823+0000","last_change":"2024-04-26T22:04:12.038823+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038823+0000","last_undegraded":"2024-04-26T22:04:12.038823+0000","last_fullsized":"2024-04-26T22:04:12.038823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038759+0000","last_change":"2024-04-26T22:04:12.038759+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038759+0000","last_undegraded":"2024-04-26T22:04:12.038759+0000","last_fullsized":"2024-04-26T22:04:12.038759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":298,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T22:04:12.038452+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:04:12.038452+0000","last_peered":"2024-04-26T22:04:12.038452+0000","last_clean":"2024-04-26T22:04:12.038452+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:04:12.038452+0000","last_undegraded":"2024-04-26T22:04:12.038452+0000","last_fullsized":"2024-04-26T22:04:12.038452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36928,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334912,"statfs":{"total":96636764160,"available":96598949888,"internally_reserved":0,"allocated":1626112,"data_stored":1027744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1032192,"data_stored":437376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":437376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1626112,"data_stored":1027744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:04:17.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2024-04-26T22:04:17.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2024-04-26T22:04:17.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2024-04-26T22:04:17.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2024-04-26T22:04:17.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2024-04-26T22:04:17.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2024-04-26T22:04:17.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2024-04-26T22:04:17.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2024-04-26T22:04:17.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2024-04-26T22:04:17.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2024-04-26T22:04:17.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2024-04-26T22:04:17.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2024-04-26T22:04:17.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2024-04-26T22:04:17.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2024-04-26T22:04:17.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2024-04-26T22:04:17.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2024-04-26T22:04:17.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2024-04-26T22:04:17.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2024-04-26T22:04:17.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2024-04-26T22:04:17.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2024-04-26T22:04:17.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2024-04-26T22:04:17.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2024-04-26T22:04:17.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2024-04-26T22:04:17.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2024-04-26T22:04:17.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2024-04-26T22:04:17.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2024-04-26T22:04:17.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2024-04-26T22:04:17.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2024-04-26T22:04:17.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2024-04-26T22:04:17.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2024-04-26T22:04:17.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2024-04-26T22:04:17.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2024-04-26T22:04:17.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2024-04-26T22:04:17.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2024-04-26T22:04:17.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.042339+0000', 'last_change': '2024-04-26T22:04:12.042339+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.042339+0000', 'last_undegraded': '2024-04-26T22:04:12.042339+0000', 'last_fullsized': '2024-04-26T22:04:12.042339+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:04:17.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2024-04-26T22:04:17.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2024-04-26T22:04:17.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.038758+0000', 'last_change': '2024-04-26T22:04:12.038758+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.038758+0000', 'last_undegraded': '2024-04-26T22:04:12.038758+0000', 'last_fullsized': '2024-04-26T22:04:12.038758+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:04:17.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2024-04-26T22:04:17.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2024-04-26T22:04:17.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.040016+0000', 'last_change': '2024-04-26T22:04:12.040016+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.040016+0000', 'last_undegraded': '2024-04-26T22:04:12.040016+0000', 'last_fullsized': '2024-04-26T22:04:12.040016+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:04:17.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2024-04-26T22:04:17.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2024-04-26T22:04:17.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.039872+0000', 'last_change': '2024-04-26T22:04:12.039872+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.039872+0000', 'last_undegraded': '2024-04-26T22:04:12.039872+0000', 'last_fullsized': '2024-04-26T22:04:12.039872+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:04:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2024-04-26T22:04:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2024-04-26T22:04:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.038754+0000', 'last_change': '2024-04-26T22:04:12.038754+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.038754+0000', 'last_undegraded': '2024-04-26T22:04:12.038754+0000', 'last_fullsized': '2024-04-26T22:04:12.038754+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:04:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2024-04-26T22:04:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2024-04-26T22:04:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.039990+0000', 'last_change': '2024-04-26T22:04:12.039990+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.039990+0000', 'last_undegraded': '2024-04-26T22:04:12.039990+0000', 'last_fullsized': '2024-04-26T22:04:12.039990+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:04:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2024-04-26T22:04:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2024-04-26T22:04:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.039354+0000', 'last_change': '2024-04-26T22:04:12.039354+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.039354+0000', 'last_undegraded': '2024-04-26T22:04:12.039354+0000', 'last_fullsized': '2024-04-26T22:04:12.039354+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:04:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2024-04-26T22:04:17.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2024-04-26T22:04:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.040845+0000', 'last_change': '2024-04-26T22:04:12.040845+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.040845+0000', 'last_undegraded': '2024-04-26T22:04:12.040845+0000', 'last_fullsized': '2024-04-26T22:04:12.040845+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T22:04:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2024-04-26T22:04:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2024-04-26T22:04:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041888+0000', 'last_change': '2024-04-26T22:04:12.041888+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041888+0000', 'last_undegraded': '2024-04-26T22:04:12.041888+0000', 'last_fullsized': '2024-04-26T22:04:12.041888+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:04:17.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2024-04-26T22:04:17.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2024-04-26T22:04:17.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041253+0000', 'last_change': '2024-04-26T22:04:12.041253+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041253+0000', 'last_undegraded': '2024-04-26T22:04:12.041253+0000', 'last_fullsized': '2024-04-26T22:04:12.041253+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:04:17.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2024-04-26T22:04:17.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2024-04-26T22:04:17.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.042015+0000', 'last_change': '2024-04-26T22:04:12.042015+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.042015+0000', 'last_undegraded': '2024-04-26T22:04:12.042015+0000', 'last_fullsized': '2024-04-26T22:04:12.042015+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:04:17.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2024-04-26T22:04:17.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2024-04-26T22:04:17.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041679+0000', 'last_change': '2024-04-26T22:04:12.041679+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041679+0000', 'last_undegraded': '2024-04-26T22:04:12.041679+0000', 'last_fullsized': '2024-04-26T22:04:12.041679+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T22:04:17.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2024-04-26T22:04:17.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2024-04-26T22:04:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041440+0000', 'last_change': '2024-04-26T22:04:12.041440+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041440+0000', 'last_undegraded': '2024-04-26T22:04:12.041440+0000', 'last_fullsized': '2024-04-26T22:04:12.041440+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T22:04:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2024-04-26T22:04:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2024-04-26T22:04:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041210+0000', 'last_change': '2024-04-26T22:04:12.041210+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041210+0000', 'last_undegraded': '2024-04-26T22:04:12.041210+0000', 'last_fullsized': '2024-04-26T22:04:12.041210+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:04:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2024-04-26T22:04:17.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2024-04-26T22:04:17.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041684+0000', 'last_change': '2024-04-26T22:04:12.041684+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041684+0000', 'last_undegraded': '2024-04-26T22:04:12.041684+0000', 'last_fullsized': '2024-04-26T22:04:12.041684+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T22:04:17.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2024-04-26T22:04:17.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2024-04-26T22:04:17.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.039282+0000', 'last_change': '2024-04-26T22:04:12.039282+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.039282+0000', 'last_undegraded': '2024-04-26T22:04:12.039282+0000', 'last_fullsized': '2024-04-26T22:04:12.039282+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:04:17.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2024-04-26T22:04:17.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2024-04-26T22:04:17.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041255+0000', 'last_change': '2024-04-26T22:04:12.041255+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041255+0000', 'last_undegraded': '2024-04-26T22:04:12.041255+0000', 'last_fullsized': '2024-04-26T22:04:12.041255+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:04:17.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2024-04-26T22:04:17.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2024-04-26T22:04:17.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.039289+0000', 'last_change': '2024-04-26T22:04:12.039289+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.039289+0000', 'last_undegraded': '2024-04-26T22:04:12.039289+0000', 'last_fullsized': '2024-04-26T22:04:12.039289+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:04:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2024-04-26T22:04:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2024-04-26T22:04:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.039277+0000', 'last_change': '2024-04-26T22:04:12.039277+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.039277+0000', 'last_undegraded': '2024-04-26T22:04:12.039277+0000', 'last_fullsized': '2024-04-26T22:04:12.039277+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:04:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2024-04-26T22:04:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2024-04-26T22:04:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041056+0000', 'last_change': '2024-04-26T22:04:12.041056+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041056+0000', 'last_undegraded': '2024-04-26T22:04:12.041056+0000', 'last_fullsized': '2024-04-26T22:04:12.041056+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:04:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2024-04-26T22:04:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2024-04-26T22:04:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.043068+0000', 'last_change': '2024-04-26T22:04:12.043068+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.043068+0000', 'last_undegraded': '2024-04-26T22:04:12.043068+0000', 'last_fullsized': '2024-04-26T22:04:12.043068+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T22:04:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2024-04-26T22:04:17.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2024-04-26T22:04:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.043490+0000', 'last_change': '2024-04-26T22:04:12.043490+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.043490+0000', 'last_undegraded': '2024-04-26T22:04:12.043490+0000', 'last_fullsized': '2024-04-26T22:04:12.043490+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T22:04:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2024-04-26T22:04:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2024-04-26T22:04:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.040998+0000', 'last_change': '2024-04-26T22:04:12.040998+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.040998+0000', 'last_undegraded': '2024-04-26T22:04:12.040998+0000', 'last_fullsized': '2024-04-26T22:04:12.040998+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T22:04:17.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2024-04-26T22:04:17.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2024-04-26T22:04:17.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041826+0000', 'last_change': '2024-04-26T22:04:12.041826+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041826+0000', 'last_undegraded': '2024-04-26T22:04:12.041826+0000', 'last_fullsized': '2024-04-26T22:04:12.041826+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T22:04:17.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2024-04-26T22:04:17.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2024-04-26T22:04:17.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041112+0000', 'last_change': '2024-04-26T22:04:12.041112+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041112+0000', 'last_undegraded': '2024-04-26T22:04:12.041112+0000', 'last_fullsized': '2024-04-26T22:04:12.041112+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T22:04:17.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2024-04-26T22:04:17.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2024-04-26T22:04:17.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041256+0000', 'last_change': '2024-04-26T22:04:12.041256+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041256+0000', 'last_undegraded': '2024-04-26T22:04:12.041256+0000', 'last_fullsized': '2024-04-26T22:04:12.041256+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:04:17.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2024-04-26T22:04:17.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2024-04-26T22:04:17.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041088+0000', 'last_change': '2024-04-26T22:04:12.041088+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041088+0000', 'last_undegraded': '2024-04-26T22:04:12.041088+0000', 'last_fullsized': '2024-04-26T22:04:12.041088+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:04:17.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2024-04-26T22:04:17.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2024-04-26T22:04:17.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.039234+0000', 'last_change': '2024-04-26T22:04:12.039234+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.039234+0000', 'last_undegraded': '2024-04-26T22:04:12.039234+0000', 'last_fullsized': '2024-04-26T22:04:12.039234+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T22:04:17.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2024-04-26T22:04:17.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2024-04-26T22:04:17.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.038776+0000', 'last_change': '2024-04-26T22:04:12.038776+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.038776+0000', 'last_undegraded': '2024-04-26T22:04:12.038776+0000', 'last_fullsized': '2024-04-26T22:04:12.038776+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:04:17.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2024-04-26T22:04:17.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2024-04-26T22:04:17.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.041198+0000', 'last_change': '2024-04-26T22:04:12.041198+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.041198+0000', 'last_undegraded': '2024-04-26T22:04:12.041198+0000', 'last_fullsized': '2024-04-26T22:04:12.041198+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T22:04:17.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2024-04-26T22:04:17.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2024-04-26T22:04:17.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.038823+0000', 'last_change': '2024-04-26T22:04:12.038823+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.038823+0000', 'last_undegraded': '2024-04-26T22:04:12.038823+0000', 'last_fullsized': '2024-04-26T22:04:12.038823+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T22:04:17.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2024-04-26T22:04:17.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T22:04:13.036247+0000', 'last_change': '2024-04-26T22:04:13.036247+0000', 'last_active': '2024-04-26T22:04:13.036247+0000', 'last_peered': '2024-04-26T22:04:13.036247+0000', 'last_clean': '2024-04-26T22:04:13.036247+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:13.036247+0000', 'last_undegraded': '2024-04-26T22:04:13.036247+0000', 'last_fullsized': '2024-04-26T22:04:13.036247+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:13.036247+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T22:04:17.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2024-04-26T22:04:17.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 84, 'state': 'creating+peering', 'last_fresh': '2024-04-26T22:04:12.038759+0000', 'last_change': '2024-04-26T22:04:12.038759+0000', 'last_active': '2024-04-26T22:04:12.030935+0000', 'last_peered': '2024-04-26T22:04:12.030935+0000', 'last_clean': '2024-04-26T22:04:12.030935+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T22:04:12.038759+0000', 'last_undegraded': '2024-04-26T22:04:12.038759+0000', 'last_fullsized': '2024-04-26T22:04:12.038759+0000', 'mapping_epoch': 84, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 84, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'last_clean_scrub_stamp': '2024-04-26T22:04:12.030935+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T22:04:17.955 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T22:04:18.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.052+0000 7fe50f4da640 1 Processor -- start 2024-04-26T22:04:18.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.053+0000 7fe50f4da640 1 -- start start 2024-04-26T22:04:18.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.053+0000 7fe50f4da640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe50806fb50 0x7fe508072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.053+0000 7fe50f4da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 0x7fe50815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.053+0000 7fe50f4da640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe508073a40 con 0x7fe508145870 2024-04-26T22:04:18.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.053+0000 7fe50f4da640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe50815d8d0 con 0x7fe50806fb50 2024-04-26T22:04:18.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.053+0000 7fe50f4da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe50815dbb0 con 0x7fe508073250 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe50da77640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 0x7fe50815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe50d276640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe508145870 0x7fe50806f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:44538/0 (socket says 172.21.15.137:44538) 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe50ca75640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe50806fb50 0x7fe508072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe50d276640 1 -- 172.21.15.137:0/4011232492 learned_addr learned my addr 172.21.15.137:0/4011232492 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe50ca75640 1 -- 172.21.15.137:0/4011232492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 msgr2=0x7fe50815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe50ca75640 1 --2- 172.21.15.137:0/4011232492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 0x7fe50815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe50ca75640 1 -- 172.21.15.137:0/4011232492 >> v1:172.21.15.170:6789/0 conn(0x7fe508145870 legacy=0x7fe50806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe4fffff640 1 -- 172.21.15.137:0/4011232492 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542209567 0 0) 0x7fe508073a40 con 0x7fe508145870 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe50ca75640 1 -- 172.21.15.137:0/4011232492 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50815de90 con 0x7fe50806fb50 2024-04-26T22:04:18.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.054+0000 7fe50da77640 1 --2- 172.21.15.137:0/4011232492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 0x7fe50815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:04:18.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.055+0000 7fe50ca75640 1 --2- 172.21.15.137:0/4011232492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 0x7fe508072d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe5040097a0 tx=0x7fe50402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7164b5a7504745d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:18.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.055+0000 7fe4fffff640 1 -- 172.21.15.137:0/4011232492 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504037070 con 0x7fe50806fb50 2024-04-26T22:04:18.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.055+0000 7fe4fffff640 1 -- 172.21.15.137:0/4011232492 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe504032440 con 0x7fe50806fb50 2024-04-26T22:04:18.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.055+0000 7fe4fffff640 1 -- 172.21.15.137:0/4011232492 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504032810 con 0x7fe50806fb50 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.056+0000 7fe50f4da640 1 -- 172.21.15.137:0/4011232492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 msgr2=0x7fe508072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.056+0000 7fe50f4da640 1 --2- 172.21.15.137:0/4011232492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 0x7fe508072d10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe5040097a0 tx=0x7fe50402a180 comp rx=0 tx=0).stop 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.056+0000 7fe50f4da640 1 -- 172.21.15.137:0/4011232492 shutdown_connections 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.056+0000 7fe50f4da640 1 --2- 172.21.15.137:0/4011232492 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 0x7fe50815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.056+0000 7fe50f4da640 1 --2- 172.21.15.137:0/4011232492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 0x7fe508072d10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.056+0000 7fe50f4da640 1 -- 172.21.15.137:0/4011232492 >> 172.21.15.137:0/4011232492 conn(0x7fe5080cd830 msgr2=0x7fe5080cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.056+0000 7fe50f4da640 1 -- 172.21.15.137:0/4011232492 shutdown_connections 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.056+0000 7fe50f4da640 1 -- 172.21.15.137:0/4011232492 wait complete. 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.057+0000 7fe50f4da640 1 Processor -- start 2024-04-26T22:04:18.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.057+0000 7fe50f4da640 1 -- start start 2024-04-26T22:04:18.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50f4da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 0x7fe508152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50f4da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 0x7fe5081437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50f4da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe508145870 0x7fe5081e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50f4da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5080736c0 con 0x7fe508145870 2024-04-26T22:04:18.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50f4da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe508145c50 con 0x7fe50806fb50 2024-04-26T22:04:18.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50f4da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe50815e8f0 con 0x7fe508073250 2024-04-26T22:04:18.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50da77640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe508145870 0x7fe5081e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50da77640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe508145870 0x7fe5081e8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44052/0 (socket says 172.21.15.137:44052) 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50da77640 1 -- 172.21.15.137:0/1061769086 learned_addr learned my addr 172.21.15.137:0/1061769086 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50d276640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 0x7fe508152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50ca75640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 0x7fe5081437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50da77640 1 -- 172.21.15.137:0/1061769086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 msgr2=0x7fe5081437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50da77640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 0x7fe5081437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50da77640 1 -- 172.21.15.137:0/1061769086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 msgr2=0x7fe508152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50da77640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 0x7fe508152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50da77640 1 -- 172.21.15.137:0/1061769086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5080d0180 con 0x7fe508145870 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50d276640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 0x7fe508152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50da77640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe508145870 0x7fe5081e8b60 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fe50000efc0 tx=0x7fe50000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe4fdffb640 1 -- 172.21.15.137:0/1061769086 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500018030 con 0x7fe508145870 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe4fdffb640 1 -- 172.21.15.137:0/1061769086 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe50000cd30 con 0x7fe508145870 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe4fdffb640 1 -- 172.21.15.137:0/1061769086 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500003bb0 con 0x7fe508145870 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.058+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5080cfc00 con 0x7fe508145870 2024-04-26T22:04:18.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.059+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe508142fe0 con 0x7fe508145870 2024-04-26T22:04:18.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.060+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50806a290 con 0x7fe508145870 2024-04-26T22:04:18.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.060+0000 7fe4fdffb640 1 -- 172.21.15.137:0/1061769086 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe500005d10 con 0x7fe508145870 2024-04-26T22:04:18.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.060+0000 7fe4fdffb640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4ec06c8f0 0x7fe4ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.060+0000 7fe50d276640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4ec06c8f0 0x7fe4ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.060+0000 7fe4fdffb640 1 -- 172.21.15.137:0/1061769086 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7fe50008c540 con 0x7fe508145870 2024-04-26T22:04:18.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.061+0000 7fe50d276640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4ec06c8f0 0x7fe4ec06edb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8000f60 tx=0x7fe4f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:18.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.065+0000 7fe4fdffb640 1 -- 172.21.15.137:0/1061769086 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe500022070 con 0x7fe508145870 2024-04-26T22:04:18.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.307+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe508069470 con 0x7fe508145870 2024-04-26T22:04:18.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.307+0000 7fe4fdffb640 1 -- 172.21.15.137:0/1061769086 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1271 (secure 0 0 0) 0x7fe500010040 con 0x7fe508145870 2024-04-26T22:04:18.308 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:18.308 INFO:teuthology.orchestra.run.smithi137.stdout:{"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":361,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":87,"num_osds":8,"num_up_osds":8,"osd_up_since":1714168707,"num_in_osds":8,"osd_in_since":1714168698,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":273375232,"bytes_avail":772820738048,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":47,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":7335}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-04-26T22:03:36.758106+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-26T22:04:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4ec06c8f0 msgr2=0x7fe4ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4ec06c8f0 0x7fe4ec06edb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8000f60 tx=0x7fe4f8009040 comp rx=0 tx=0).stop 2024-04-26T22:04:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe508145870 msgr2=0x7fe5081e8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe508145870 0x7fe5081e8b60 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fe50000efc0 tx=0x7fe50000c490 comp rx=0 tx=0).stop 2024-04-26T22:04:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 shutdown_connections 2024-04-26T22:04:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4ec06c8f0 0x7fe4ec06edb0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe508145870 0x7fe5081e8b60 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe508073250 0x7fe5081437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 --2- 172.21.15.137:0/1061769086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe50806fb50 0x7fe508152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 >> 172.21.15.137:0/1061769086 conn(0x7fe5080cd830 msgr2=0x7fe50815b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:18.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 shutdown_connections 2024-04-26T22:04:18.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.309+0000 7fe50f4da640 1 -- 172.21.15.137:0/1061769086 wait complete. 2024-04-26T22:04:18.320 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T22:04:18.320 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:04:18.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.417+0000 7fb6c1ca9640 1 Processor -- start 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.417+0000 7fb6c1ca9640 1 -- start start 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.417+0000 7fb6c1ca9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb6bc148a30 0x7fb6bc073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.417+0000 7fb6c1ca9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb6bc160640 0x7fb6bc1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.417+0000 7fb6c1ca9640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6bc0cfa80 con 0x7fb6bc163be0 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.417+0000 7fb6c1ca9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb6bc0cfd60 con 0x7fb6bc148a30 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6c1ca9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb6bc0d0040 con 0x7fb6bc160640 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6bb7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb6bc148a30 0x7fb6bc073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6bbfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb6bc163be0 0x7fb6bc0b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45132/0 (socket says 172.21.15.137:45132) 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6bbfff640 1 -- 172.21.15.137:0/3981926366 learned_addr learned my addr 172.21.15.137:0/3981926366 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6baffd640 1 --2- 172.21.15.137:0/3981926366 >> v2:172.21.15.170:3300/0 conn(0x7fb6bc160640 0x7fb6bc1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6bb7fe640 1 -- 172.21.15.137:0/3981926366 >> v2:172.21.15.170:3300/0 conn(0x7fb6bc160640 msgr2=0x7fb6bc1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:18.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6bb7fe640 1 --2- 172.21.15.137:0/3981926366 >> v2:172.21.15.170:3300/0 conn(0x7fb6bc160640 0x7fb6bc1636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6bb7fe640 1 -- 172.21.15.137:0/3981926366 >> v1:172.21.15.137:6789/0 conn(0x7fb6bc163be0 legacy=0x7fb6bc0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6bb7fe640 1 -- 172.21.15.137:0/3981926366 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6bc162ea0 con 0x7fb6bc148a30 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.418+0000 7fb6baffd640 1 --2- 172.21.15.137:0/3981926366 >> v2:172.21.15.170:3300/0 conn(0x7fb6bc160640 0x7fb6bc1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6bb7fe640 1 --2- 172.21.15.137:0/3981926366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc148a30 0x7fb6bc073ed0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0b1aa0 tx=0x7fb6ac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98cc20789fca7c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6ba7fc640 1 -- 172.21.15.137:0/3981926366 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac037070 con 0x7fb6bc148a30 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6ba7fc640 1 -- 172.21.15.137:0/3981926366 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ac032440 con 0x7fb6bc148a30 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6ba7fc640 1 -- 172.21.15.137:0/3981926366 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac02ae60 con 0x7fb6bc148a30 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3981926366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc148a30 msgr2=0x7fb6bc073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6c1ca9640 1 --2- 172.21.15.137:0/3981926366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc148a30 0x7fb6bc073ed0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0b1aa0 tx=0x7fb6ac02a110 comp rx=0 tx=0).stop 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3981926366 shutdown_connections 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6c1ca9640 1 --2- 172.21.15.137:0/3981926366 >> v2:172.21.15.170:3300/0 conn(0x7fb6bc160640 0x7fb6bc1636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6c1ca9640 1 --2- 172.21.15.137:0/3981926366 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc148a30 0x7fb6bc073ed0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3981926366 >> 172.21.15.137:0/3981926366 conn(0x7fb6bc0ce8b0 msgr2=0x7fb6bc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:18.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3981926366 shutdown_connections 2024-04-26T22:04:18.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.419+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3981926366 wait complete. 2024-04-26T22:04:18.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.420+0000 7fb6c1ca9640 1 Processor -- start 2024-04-26T22:04:18.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.421+0000 7fb6c1ca9640 1 -- start start 2024-04-26T22:04:18.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.421+0000 7fb6c1ca9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6bc148a30 0x7fb6bc15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.421+0000 7fb6c1ca9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc160640 0x7fb6bc0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.421+0000 7fb6c1ca9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6bc163be0 0x7fb6bc0b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.421+0000 7fb6c1ca9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc074590 con 0x7fb6bc160640 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.421+0000 7fb6c1ca9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb6bc074410 con 0x7fb6bc163be0 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.421+0000 7fb6c1ca9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb6bc148e10 con 0x7fb6bc148a30 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.421+0000 7fb6baffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc160640 0x7fb6bc0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6baffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc160640 0x7fb6bc0b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44066/0 (socket says 172.21.15.137:44066) 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6baffd640 1 -- 172.21.15.137:0/3684881191 learned_addr learned my addr 172.21.15.137:0/3684881191 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6bb7fe640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6bc148a30 0x7fb6bc15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6bbfff640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6bc163be0 0x7fb6bc0b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6baffd640 1 -- 172.21.15.137:0/3684881191 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6bc148a30 msgr2=0x7fb6bc15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6baffd640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6bc148a30 0x7fb6bc15eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6baffd640 1 -- 172.21.15.137:0/3684881191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6bc163be0 msgr2=0x7fb6bc0b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6baffd640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6bc163be0 0x7fb6bc0b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6baffd640 1 -- 172.21.15.137:0/3684881191 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6bc0afce0 con 0x7fb6bc160640 2024-04-26T22:04:18.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6bbfff640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6bc163be0 0x7fb6bc0b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6baffd640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc160640 0x7fb6bc0b30b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c820 tx=0x7fb6b000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6a3fff640 1 -- 172.21.15.137:0/3684881191 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0015070 con 0x7fb6bc160640 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6a3fff640 1 -- 172.21.15.137:0/3684881191 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b0007a30 con 0x7fb6bc160640 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6bc0b59d0 con 0x7fb6bc160640 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6a3fff640 1 -- 172.21.15.137:0/3684881191 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0007e20 con 0x7fb6bc160640 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.422+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6bc0b5f90 con 0x7fb6bc160640 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.423+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6bc06a290 con 0x7fb6bc160640 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.423+0000 7fb6a3fff640 1 -- 172.21.15.137:0/3684881191 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6b0018070 con 0x7fb6bc160640 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.424+0000 7fb6a3fff640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb6a806c8f0 0x7fb6a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.424+0000 7fb6a3fff640 1 -- 172.21.15.137:0/3684881191 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7fb6b008b9f0 con 0x7fb6bc160640 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.424+0000 7fb6bb7fe640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb6a806c8f0 0x7fb6a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:18.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.424+0000 7fb6bb7fe640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb6a806c8f0 0x7fb6a806edb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac034000 tx=0x7fb6ac02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:18.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.428+0000 7fb6a3fff640 1 -- 172.21.15.137:0/3684881191 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb6b0059860 con 0x7fb6bc160640 2024-04-26T22:04:18.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.598+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6bc0739f0 con 0x7fb6a806c8f0 2024-04-26T22:04:18.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.604+0000 7fb6a3fff640 1 -- 172.21.15.137:0/3684881191 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240154 (secure 0 0 0) 0x7fb6bc0739f0 con 0x7fb6a806c8f0 2024-04-26T22:04:18.606 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:18.607 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb6a806c8f0 msgr2=0x7fb6a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb6a806c8f0 0x7fb6a806edb0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac034000 tx=0x7fb6ac02e000 comp rx=0 tx=0).stop 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc160640 msgr2=0x7fb6bc0b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc160640 0x7fb6bc0b30b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c820 tx=0x7fb6b000cce0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 shutdown_connections 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb6a806c8f0 0x7fb6a806edb0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb6bc160640 0x7fb6bc0b30b0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6bc163be0 0x7fb6bc0b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 --2- 172.21.15.137:0/3684881191 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb6bc148a30 0x7fb6bc15eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 >> 172.21.15.137:0/3684881191 conn(0x7fb6bc0ce8b0 msgr2=0x7fb6bc072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 shutdown_connections 2024-04-26T22:04:18.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:18.607+0000 7fb6c1ca9640 1 -- 172.21.15.137:0/3684881191 wait complete. 2024-04-26T22:04:18.618 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-26T22:04:16.766565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266968,"kb_used_data":9176,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754707752,"statfs":{"total":773094113280,"available":772820738048,"internally_reserved":0,"allocated":9396224,"data_stored":4656476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.729930"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.042339+0000","last_change":"2024-04-26T22:04:12.042339+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.042339+0000","last_undegraded":"2024-04-26T22:04:12.042339+0000","last_fullsized":"2024-04-26T22:04:12.042339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038758+0000","last_change":"2024-04-26T22:04:12.038758+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038758+0000","last_undegraded":"2024-04-26T22:04:12.038758+0000","last_fullsized":"2024-04-26T22:04:12.038758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040016+0000","last_change":"2024-04-26T22:04:12.040016+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040016+0000","last_undegraded":"2024-04-26T22:04:12.040016+0000","last_fullsized":"2024-04-26T22:04:12.040016+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039872+0000","last_change":"2024-04-26T22:04:12.039872+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039872+0000","last_undegraded":"2024-04-26T22:04:12.039872+0000","last_fullsized":"2024-04-26T22:04:12.039872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038754+0000","last_change":"2024-04-26T22:04:12.038754+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038754+0000","last_undegraded":"2024-04-26T22:04:12.038754+0000","last_fullsized":"2024-04-26T22:04:12.038754+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039990+0000","last_change":"2024-04-26T22:04:12.039990+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039990+0000","last_undegraded":"2024-04-26T22:04:12.039990+0000","last_fullsized":"2024-04-26T22:04:12.039990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039354+0000","last_change":"2024-04-26T22:04:12.039354+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039354+0000","last_undegraded":"2024-04-26T22:04:12.039354+0000","last_fullsized":"2024-04-26T22:04:12.039354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040845+0000","last_change":"2024-04-26T22:04:12.040845+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040845+0000","last_undegraded":"2024-04-26T22:04:12.040845+0000","last_fullsized":"2024-04-26T22:04:12.040845+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041888+0000","last_change":"2024-04-26T22:04:12.041888+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041888+0000","last_undegraded":"2024-04-26T22:04:12.041888+0000","last_fullsized":"2024-04-26T22:04:12.041888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041253+0000","last_change":"2024-04-26T22:04:12.041253+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041253+0000","last_undegraded":"2024-04-26T22:04:12.041253+0000","last_fullsized":"2024-04-26T22:04:12.041253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.042015+0000","last_change":"2024-04-26T22:04:12.042015+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.042015+0000","last_undegraded":"2024-04-26T22:04:12.042015+0000","last_fullsized":"2024-04-26T22:04:12.042015+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041679+0000","last_change":"2024-04-26T22:04:12.041679+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041679+0000","last_undegraded":"2024-04-26T22:04:12.041679+0000","last_fullsized":"2024-04-26T22:04:12.041679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041440+0000","last_change":"2024-04-26T22:04:12.041440+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041440+0000","last_undegraded":"2024-04-26T22:04:12.041440+0000","last_fullsized":"2024-04-26T22:04:12.041440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041210+0000","last_change":"2024-04-26T22:04:12.041210+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041210+0000","last_undegraded":"2024-04-26T22:04:12.041210+0000","last_fullsized":"2024-04-26T22:04:12.041210+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041684+0000","last_change":"2024-04-26T22:04:12.041684+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041684+0000","last_undegraded":"2024-04-26T22:04:12.041684+0000","last_fullsized":"2024-04-26T22:04:12.041684+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039282+0000","last_change":"2024-04-26T22:04:12.039282+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039282+0000","last_undegraded":"2024-04-26T22:04:12.039282+0000","last_fullsized":"2024-04-26T22:04:12.039282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041255+0000","last_change":"2024-04-26T22:04:12.041255+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041255+0000","last_undegraded":"2024-04-26T22:04:12.041255+0000","last_fullsized":"2024-04-26T22:04:12.041255+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039289+0000","last_change":"2024-04-26T22:04:12.039289+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039289+0000","last_undegraded":"2024-04-26T22:04:12.039289+0000","last_fullsized":"2024-04-26T22:04:12.039289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039277+0000","last_change":"2024-04-26T22:04:12.039277+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039277+0000","last_undegraded":"2024-04-26T22:04:12.039277+0000","last_fullsized":"2024-04-26T22:04:12.039277+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041056+0000","last_change":"2024-04-26T22:04:12.041056+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041056+0000","last_undegraded":"2024-04-26T22:04:12.041056+0000","last_fullsized":"2024-04-26T22:04:12.041056+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.043068+0000","last_change":"2024-04-26T22:04:12.043068+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.043068+0000","last_undegraded":"2024-04-26T22:04:12.043068+0000","last_fullsized":"2024-04-26T22:04:12.043068+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.043490+0000","last_change":"2024-04-26T22:04:12.043490+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.043490+0000","last_undegraded":"2024-04-26T22:04:12.043490+0000","last_fullsized":"2024-04-26T22:04:12.043490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.040998+0000","last_change":"2024-04-26T22:04:12.040998+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.040998+0000","last_undegraded":"2024-04-26T22:04:12.040998+0000","last_fullsized":"2024-04-26T22:04:12.040998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041826+0000","last_change":"2024-04-26T22:04:12.041826+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041826+0000","last_undegraded":"2024-04-26T22:04:12.041826+0000","last_fullsized":"2024-04-26T22:04:12.041826+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041112+0000","last_change":"2024-04-26T22:04:12.041112+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041112+0000","last_undegraded":"2024-04-26T22:04:12.041112+0000","last_fullsized":"2024-04-26T22:04:12.041112+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041256+0000","last_change":"2024-04-26T22:04:12.041256+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041256+0000","last_undegraded":"2024-04-26T22:04:12.041256+0000","last_fullsized":"2024-04-26T22:04:12.041256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041088+0000","last_change":"2024-04-26T22:04:12.041088+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041088+0000","last_undegraded":"2024-04-26T22:04:12.041088+0000","last_fullsized":"2024-04-26T22:04:12.041088+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.039234+0000","last_change":"2024-04-26T22:04:12.039234+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.039234+0000","last_undegraded":"2024-04-26T22:04:12.039234+0000","last_fullsized":"2024-04-26T22:04:12.039234+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038776+0000","last_change":"2024-04-26T22:04:12.038776+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038776+0000","last_undegraded":"2024-04-26T22:04:12.038776+0000","last_fullsized":"2024-04-26T22:04:12.038776+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.041198+0000","last_change":"2024-04-26T22:04:12.041198+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.041198+0000","last_undegraded":"2024-04-26T22:04:12.041198+0000","last_fullsized":"2024-04-26T22:04:12.041198+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038823+0000","last_change":"2024-04-26T22:04:12.038823+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038823+0000","last_undegraded":"2024-04-26T22:04:12.038823+0000","last_fullsized":"2024-04-26T22:04:12.038823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T22:04:13.036247+0000","last_change":"2024-04-26T22:04:13.036247+0000","last_active":"2024-04-26T22:04:13.036247+0000","last_peered":"2024-04-26T22:04:13.036247+0000","last_clean":"2024-04-26T22:04:13.036247+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:13.036247+0000","last_undegraded":"2024-04-26T22:04:13.036247+0000","last_fullsized":"2024-04-26T22:04:13.036247+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-04-26T22:04:12.038759+0000","last_change":"2024-04-26T22:04:12.038759+0000","last_active":"2024-04-26T22:04:12.030935+0000","last_peered":"2024-04-26T22:04:12.030935+0000","last_clean":"2024-04-26T22:04:12.030935+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T22:04:12.038759+0000","last_undegraded":"2024-04-26T22:04:12.038759+0000","last_fullsized":"2024-04-26T22:04:12.038759+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":298,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T22:04:12.038452+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:04:12.038452+0000","last_peered":"2024-04-26T22:04:12.038452+0000","last_clean":"2024-04-26T22:04:12.038452+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:04:12.038452+0000","last_undegraded":"2024-04-26T22:04:12.038452+0000","last_fullsized":"2024-04-26T22:04:12.038452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36928,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334912,"statfs":{"total":96636764160,"available":96598949888,"internally_reserved":0,"allocated":1626112,"data_stored":1027744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1032192,"data_stored":437376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":437376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1019904,"data_stored":431559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1626112,"data_stored":1027744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:04:19.307 INFO:tasks.ceph.mds.b.smithi170.stderr:2024-04-26T22:04:19.307+0000 7ff6bb8c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:04:21.623 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:04:21.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.732+0000 7efe8d1da640 1 Processor -- start 2024-04-26T22:04:21.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.732+0000 7efe8d1da640 1 -- start start 2024-04-26T22:04:21.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.732+0000 7efe8d1da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe88160640 0x7efe881636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.732+0000 7efe8d1da640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efe88163be0 0x7efe880b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.732+0000 7efe8d1da640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe880cfa80 con 0x7efe88148a30 2024-04-26T22:04:21.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe8d1da640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7efe880745e0 con 0x7efe88163be0 2024-04-26T22:04:21.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe8d1da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efe880cfd60 con 0x7efe88160640 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe86d9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7efe88148a30 0x7efe88073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45146/0 (socket says 172.21.15.137:45146) 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe86d9d640 1 -- 172.21.15.137:0/1122113852 learned_addr learned my addr 172.21.15.137:0/1122113852 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251546401 0 0) 0x7efe880cfa80 con 0x7efe88148a30 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe70003520 con 0x7efe88148a30 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe8759e640 1 --2- 172.21.15.137:0/1122113852 >> v2:172.21.15.170:3300/0 conn(0x7efe88163be0 0x7efe880b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe8659c640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe88160640 0x7efe881636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2192846777 0 0) 0x7efe70003520 con 0x7efe88148a30 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe88160640 msgr2=0x7efe881636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe88160640 0x7efe881636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 >> v2:172.21.15.170:3300/0 conn(0x7efe88163be0 msgr2=0x7efe880b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 --2- 172.21.15.137:0/1122113852 >> v2:172.21.15.170:3300/0 conn(0x7efe88163be0 0x7efe880b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe880d0040 con 0x7efe88148a30 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe8759e640 1 --2- 172.21.15.137:0/1122113852 >> v2:172.21.15.170:3300/0 conn(0x7efe88163be0 0x7efe880b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:21.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7efe78001670 con 0x7efe88148a30 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe8659c640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe88160640 0x7efe881636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 >> v1:172.21.15.137:6789/0 conn(0x7efe88148a30 legacy=0x7efe88073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe88160640 0x7efe70004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe70004d40 0x7efe700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe880745e0 con 0x7efe700039b0 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efe880cfd60 con 0x7efe70004d40 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efe7000bac0 con 0x7efe88160640 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe86d9d640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe8659c640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe88160640 0x7efe70004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.733+0000 7efe8759e640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe70004d40 0x7efe700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.734+0000 7efe86d9d640 1 -- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe88160640 msgr2=0x7efe70004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.734+0000 7efe86d9d640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe88160640 0x7efe70004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.734+0000 7efe86d9d640 1 -- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe70004d40 msgr2=0x7efe700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.734+0000 7efe86d9d640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe70004d40 0x7efe700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.734+0000 7efe86d9d640 1 -- 172.21.15.137:0/1122113852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe70003520 con 0x7efe700039b0 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.734+0000 7efe86d9d640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7efe7800c290 tx=0x7efe70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df052e271e21032c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.734+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78007d50 con 0x7efe700039b0 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.734+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe78005af0 con 0x7efe700039b0 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.735+0000 7efe85d9b640 1 -- 172.21.15.137:0/1122113852 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78007070 con 0x7efe700039b0 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.735+0000 7efe8d1da640 1 -- 172.21.15.137:0/1122113852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe700039b0 msgr2=0x7efe70003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.735+0000 7efe8d1da640 1 --2- 172.21.15.137:0/1122113852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe700039b0 0x7efe70003dd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7efe7800c290 tx=0x7efe70005830 comp rx=0 tx=0).stop 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.735+0000 7efe8759e640 1 -- 172.21.15.137:0/1122113852 reap_dead start 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.735+0000 7efe8d1da640 1 -- 172.21.15.137:0/1122113852 shutdown_connections 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.735+0000 7efe8d1da640 1 -- 172.21.15.137:0/1122113852 >> 172.21.15.137:0/1122113852 conn(0x7efe880ce8b0 msgr2=0x7efe880cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.735+0000 7efe8d1da640 1 -- 172.21.15.137:0/1122113852 shutdown_connections 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.735+0000 7efe8d1da640 1 -- 172.21.15.137:0/1122113852 wait complete. 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.737+0000 7efe8d1da640 1 Processor -- start 2024-04-26T22:04:21.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.737+0000 7efe8d1da640 1 -- start start 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.737+0000 7efe8d1da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe700039b0 0x7efe8815e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.737+0000 7efe8d1da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe881f50d0 0x7efe88161ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.737+0000 7efe8d1da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe881f5530 0x7efe88162420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.737+0000 7efe8d1da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efe88148e10 con 0x7efe881f50d0 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.737+0000 7efe8d1da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efe88163180 con 0x7efe700039b0 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.737+0000 7efe8d1da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efe88148f90 con 0x7efe881f5530 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.737+0000 7efe8659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe881f50d0 0x7efe88161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe881f50d0 0x7efe88161ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44092/0 (socket says 172.21.15.137:44092) 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8659c640 1 -- 172.21.15.137:0/887241176 learned_addr learned my addr 172.21.15.137:0/887241176 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8759e640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe881f5530 0x7efe88162420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe86d9d640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe700039b0 0x7efe8815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8659c640 1 -- 172.21.15.137:0/887241176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe881f5530 msgr2=0x7efe88162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8659c640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe881f5530 0x7efe88162420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8659c640 1 -- 172.21.15.137:0/887241176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe700039b0 msgr2=0x7efe8815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8659c640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe700039b0 0x7efe8815e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8659c640 1 -- 172.21.15.137:0/887241176 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe880b5b20 con 0x7efe881f50d0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8659c640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe881f50d0 0x7efe88161ee0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0114e0 tx=0x7efe7c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe6f7fe640 1 -- 172.21.15.137:0/887241176 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c019070 con 0x7efe881f50d0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe6f7fe640 1 -- 172.21.15.137:0/887241176 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7c015930 con 0x7efe881f50d0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe880b5e00 con 0x7efe881f50d0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe6f7fe640 1 -- 172.21.15.137:0/887241176 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00f040 con 0x7efe881f50d0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.738+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe880b63c0 con 0x7efe881f50d0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.739+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe8806a290 con 0x7efe881f50d0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.740+0000 7efe6f7fe640 1 -- 172.21.15.137:0/887241176 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe7c01c070 con 0x7efe881f50d0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.740+0000 7efe6f7fe640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efe7406c920 0x7efe7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.740+0000 7efe6f7fe640 1 -- 172.21.15.137:0/887241176 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7efe7c08bc60 con 0x7efe881f50d0 2024-04-26T22:04:21.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.740+0000 7efe86d9d640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efe7406c920 0x7efe7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:21.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.741+0000 7efe86d9d640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efe7406c920 0x7efe7406ede0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efe78033000 tx=0x7efe78009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:21.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.745+0000 7efe6f7fe640 1 -- 172.21.15.137:0/887241176 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efe7c059a40 con 0x7efe881f50d0 2024-04-26T22:04:21.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.917+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe88073300 con 0x7efe7406c920 2024-04-26T22:04:21.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.923+0000 7efe6f7fe640 1 -- 172.21.15.137:0/887241176 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252085 (secure 0 0 0) 0x7efe88073300 con 0x7efe7406c920 2024-04-26T22:04:21.925 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:21.927 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:04:21.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.925+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efe7406c920 msgr2=0x7efe7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.925+0000 7efe8d1da640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efe7406c920 0x7efe7406ede0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efe78033000 tx=0x7efe78009030 comp rx=0 tx=0).stop 2024-04-26T22:04:21.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.925+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe881f50d0 msgr2=0x7efe88161ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:21.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.925+0000 7efe8d1da640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe881f50d0 0x7efe88161ee0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0114e0 tx=0x7efe7c0119a0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.926+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 shutdown_connections 2024-04-26T22:04:21.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.926+0000 7efe8d1da640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efe7406c920 0x7efe7406ede0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.926+0000 7efe8d1da640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efe881f50d0 0x7efe88161ee0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.926+0000 7efe8d1da640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efe881f5530 0x7efe88162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.926+0000 7efe8d1da640 1 --2- 172.21.15.137:0/887241176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe700039b0 0x7efe8815e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:21.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.926+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 >> 172.21.15.137:0/887241176 conn(0x7efe880ce8b0 msgr2=0x7efe880b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:21.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.926+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 shutdown_connections 2024-04-26T22:04:21.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:21.926+0000 7efe8d1da640 1 -- 172.21.15.137:0/887241176 wait complete. 2024-04-26T22:04:21.936 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-04-26T22:04:20.767521+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271496,"kb_used_data":9576,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754703224,"statfs":{"total":773094113280,"available":772816101376,"internally_reserved":0,"allocated":9805824,"data_stored":4839364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.726252"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831457+0000","last_change":"2024-04-26T22:04:14.069033+0000","last_active":"2024-04-26T22:04:15.831457+0000","last_peered":"2024-04-26T22:04:15.831457+0000","last_clean":"2024-04-26T22:04:15.831457+0000","last_became_active":"2024-04-26T22:04:14.068713+0000","last_became_peered":"2024-04-26T22:04:14.068713+0000","last_unstale":"2024-04-26T22:04:15.831457+0000","last_undegraded":"2024-04-26T22:04:15.831457+0000","last_fullsized":"2024-04-26T22:04:15.831457+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:00.967009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831540+0000","last_change":"2024-04-26T22:04:14.069066+0000","last_active":"2024-04-26T22:04:15.831540+0000","last_peered":"2024-04-26T22:04:15.831540+0000","last_clean":"2024-04-26T22:04:15.831540+0000","last_became_active":"2024-04-26T22:04:14.068179+0000","last_became_peered":"2024-04-26T22:04:14.068179+0000","last_unstale":"2024-04-26T22:04:15.831540+0000","last_undegraded":"2024-04-26T22:04:15.831540+0000","last_fullsized":"2024-04-26T22:04:15.831540+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:21.819524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047542+0000","last_change":"2024-04-26T22:04:14.063946+0000","last_active":"2024-04-26T22:04:15.047542+0000","last_peered":"2024-04-26T22:04:15.047542+0000","last_clean":"2024-04-26T22:04:15.047542+0000","last_became_active":"2024-04-26T22:04:14.063676+0000","last_became_peered":"2024-04-26T22:04:14.063676+0000","last_unstale":"2024-04-26T22:04:15.047542+0000","last_undegraded":"2024-04-26T22:04:15.047542+0000","last_fullsized":"2024-04-26T22:04:15.047542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:20.570254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.832073+0000","last_change":"2024-04-26T22:04:14.068277+0000","last_active":"2024-04-26T22:04:15.832073+0000","last_peered":"2024-04-26T22:04:15.832073+0000","last_clean":"2024-04-26T22:04:15.832073+0000","last_became_active":"2024-04-26T22:04:14.067786+0000","last_became_peered":"2024-04-26T22:04:14.067786+0000","last_unstale":"2024-04-26T22:04:15.832073+0000","last_undegraded":"2024-04-26T22:04:15.832073+0000","last_fullsized":"2024-04-26T22:04:15.832073+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:09:41.034116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046977+0000","last_change":"2024-04-26T22:04:14.072924+0000","last_active":"2024-04-26T22:04:15.046977+0000","last_peered":"2024-04-26T22:04:15.046977+0000","last_clean":"2024-04-26T22:04:15.046977+0000","last_became_active":"2024-04-26T22:04:14.072655+0000","last_became_peered":"2024-04-26T22:04:14.072655+0000","last_unstale":"2024-04-26T22:04:15.046977+0000","last_undegraded":"2024-04-26T22:04:15.046977+0000","last_fullsized":"2024-04-26T22:04:15.046977+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:26.831818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831131+0000","last_change":"2024-04-26T22:04:14.055077+0000","last_active":"2024-04-26T22:04:15.831131+0000","last_peered":"2024-04-26T22:04:15.831131+0000","last_clean":"2024-04-26T22:04:15.831131+0000","last_became_active":"2024-04-26T22:04:14.054823+0000","last_became_peered":"2024-04-26T22:04:14.054823+0000","last_unstale":"2024-04-26T22:04:15.831131+0000","last_undegraded":"2024-04-26T22:04:15.831131+0000","last_fullsized":"2024-04-26T22:04:15.831131+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:36.480327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831252+0000","last_change":"2024-04-26T22:04:14.048732+0000","last_active":"2024-04-26T22:04:15.831252+0000","last_peered":"2024-04-26T22:04:15.831252+0000","last_clean":"2024-04-26T22:04:15.831252+0000","last_became_active":"2024-04-26T22:04:14.048470+0000","last_became_peered":"2024-04-26T22:04:14.048470+0000","last_unstale":"2024-04-26T22:04:15.831252+0000","last_undegraded":"2024-04-26T22:04:15.831252+0000","last_fullsized":"2024-04-26T22:04:15.831252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:45:12.173365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.830972+0000","last_change":"2024-04-26T22:04:14.069463+0000","last_active":"2024-04-26T22:04:15.830972+0000","last_peered":"2024-04-26T22:04:15.830972+0000","last_clean":"2024-04-26T22:04:15.830972+0000","last_became_active":"2024-04-26T22:04:14.069194+0000","last_became_peered":"2024-04-26T22:04:14.069194+0000","last_unstale":"2024-04-26T22:04:15.830972+0000","last_undegraded":"2024-04-26T22:04:15.830972+0000","last_fullsized":"2024-04-26T22:04:15.830972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:20.235670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831495+0000","last_change":"2024-04-26T22:04:14.057704+0000","last_active":"2024-04-26T22:04:15.831495+0000","last_peered":"2024-04-26T22:04:15.831495+0000","last_clean":"2024-04-26T22:04:15.831495+0000","last_became_active":"2024-04-26T22:04:14.057326+0000","last_became_peered":"2024-04-26T22:04:14.057326+0000","last_unstale":"2024-04-26T22:04:15.831495+0000","last_undegraded":"2024-04-26T22:04:15.831495+0000","last_fullsized":"2024-04-26T22:04:15.831495+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:30.106963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831553+0000","last_change":"2024-04-26T22:04:14.065661+0000","last_active":"2024-04-26T22:04:15.831553+0000","last_peered":"2024-04-26T22:04:15.831553+0000","last_clean":"2024-04-26T22:04:15.831553+0000","last_became_active":"2024-04-26T22:04:14.065221+0000","last_became_peered":"2024-04-26T22:04:14.065221+0000","last_unstale":"2024-04-26T22:04:15.831553+0000","last_undegraded":"2024-04-26T22:04:15.831553+0000","last_fullsized":"2024-04-26T22:04:15.831553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:39.245980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831465+0000","last_change":"2024-04-26T22:04:14.064065+0000","last_active":"2024-04-26T22:04:15.831465+0000","last_peered":"2024-04-26T22:04:15.831465+0000","last_clean":"2024-04-26T22:04:15.831465+0000","last_became_active":"2024-04-26T22:04:14.063794+0000","last_became_peered":"2024-04-26T22:04:14.063794+0000","last_unstale":"2024-04-26T22:04:15.831465+0000","last_undegraded":"2024-04-26T22:04:15.831465+0000","last_fullsized":"2024-04-26T22:04:15.831465+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:02.118951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831645+0000","last_change":"2024-04-26T22:04:14.064356+0000","last_active":"2024-04-26T22:04:15.831645+0000","last_peered":"2024-04-26T22:04:15.831645+0000","last_clean":"2024-04-26T22:04:15.831645+0000","last_became_active":"2024-04-26T22:04:14.062887+0000","last_became_peered":"2024-04-26T22:04:14.062887+0000","last_unstale":"2024-04-26T22:04:15.831645+0000","last_undegraded":"2024-04-26T22:04:15.831645+0000","last_fullsized":"2024-04-26T22:04:15.831645+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:11.757684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047394+0000","last_change":"2024-04-26T22:04:14.061972+0000","last_active":"2024-04-26T22:04:15.047394+0000","last_peered":"2024-04-26T22:04:15.047394+0000","last_clean":"2024-04-26T22:04:15.047394+0000","last_became_active":"2024-04-26T22:04:14.061704+0000","last_became_peered":"2024-04-26T22:04:14.061704+0000","last_unstale":"2024-04-26T22:04:15.047394+0000","last_undegraded":"2024-04-26T22:04:15.047394+0000","last_fullsized":"2024-04-26T22:04:15.047394+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:57.349244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.830939+0000","last_change":"2024-04-26T22:04:14.071812+0000","last_active":"2024-04-26T22:04:15.830939+0000","last_peered":"2024-04-26T22:04:15.830939+0000","last_clean":"2024-04-26T22:04:15.830939+0000","last_became_active":"2024-04-26T22:04:14.071456+0000","last_became_peered":"2024-04-26T22:04:14.071456+0000","last_unstale":"2024-04-26T22:04:15.830939+0000","last_undegraded":"2024-04-26T22:04:15.830939+0000","last_fullsized":"2024-04-26T22:04:15.830939+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:47.545349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.045127+0000","last_change":"2024-04-26T22:04:14.057070+0000","last_active":"2024-04-26T22:04:15.045127+0000","last_peered":"2024-04-26T22:04:15.045127+0000","last_clean":"2024-04-26T22:04:15.045127+0000","last_became_active":"2024-04-26T22:04:14.056792+0000","last_became_peered":"2024-04-26T22:04:14.056792+0000","last_unstale":"2024-04-26T22:04:15.045127+0000","last_undegraded":"2024-04-26T22:04:15.045127+0000","last_fullsized":"2024-04-26T22:04:15.045127+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:22.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046332+0000","last_change":"2024-04-26T22:04:14.065248+0000","last_active":"2024-04-26T22:04:15.046332+0000","last_peered":"2024-04-26T22:04:15.046332+0000","last_clean":"2024-04-26T22:04:15.046332+0000","last_became_active":"2024-04-26T22:04:14.064987+0000","last_became_peered":"2024-04-26T22:04:14.064987+0000","last_unstale":"2024-04-26T22:04:15.046332+0000","last_undegraded":"2024-04-26T22:04:15.046332+0000","last_fullsized":"2024-04-26T22:04:15.046332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:28.938958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047185+0000","last_change":"2024-04-26T22:04:14.055404+0000","last_active":"2024-04-26T22:04:15.047185+0000","last_peered":"2024-04-26T22:04:15.047185+0000","last_clean":"2024-04-26T22:04:15.047185+0000","last_became_active":"2024-04-26T22:04:14.055124+0000","last_became_peered":"2024-04-26T22:04:14.055124+0000","last_unstale":"2024-04-26T22:04:15.047185+0000","last_undegraded":"2024-04-26T22:04:15.047185+0000","last_fullsized":"2024-04-26T22:04:15.047185+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:00.744399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.832265+0000","last_change":"2024-04-26T22:04:14.067250+0000","last_active":"2024-04-26T22:04:15.832265+0000","last_peered":"2024-04-26T22:04:15.832265+0000","last_clean":"2024-04-26T22:04:15.832265+0000","last_became_active":"2024-04-26T22:04:14.066701+0000","last_became_peered":"2024-04-26T22:04:14.066701+0000","last_unstale":"2024-04-26T22:04:15.832265+0000","last_undegraded":"2024-04-26T22:04:15.832265+0000","last_fullsized":"2024-04-26T22:04:15.832265+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:21.439098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831165+0000","last_change":"2024-04-26T22:04:14.059430+0000","last_active":"2024-04-26T22:04:15.831165+0000","last_peered":"2024-04-26T22:04:15.831165+0000","last_clean":"2024-04-26T22:04:15.831165+0000","last_became_active":"2024-04-26T22:04:14.059133+0000","last_became_peered":"2024-04-26T22:04:14.059133+0000","last_unstale":"2024-04-26T22:04:15.831165+0000","last_undegraded":"2024-04-26T22:04:15.831165+0000","last_fullsized":"2024-04-26T22:04:15.831165+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:18.422672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.832219+0000","last_change":"2024-04-26T22:04:14.059187+0000","last_active":"2024-04-26T22:04:15.832219+0000","last_peered":"2024-04-26T22:04:15.832219+0000","last_clean":"2024-04-26T22:04:15.832219+0000","last_became_active":"2024-04-26T22:04:14.058957+0000","last_became_peered":"2024-04-26T22:04:14.058957+0000","last_unstale":"2024-04-26T22:04:15.832219+0000","last_undegraded":"2024-04-26T22:04:15.832219+0000","last_fullsized":"2024-04-26T22:04:15.832219+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:31.116477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.832093+0000","last_change":"2024-04-26T22:04:14.058453+0000","last_active":"2024-04-26T22:04:15.832093+0000","last_peered":"2024-04-26T22:04:15.832093+0000","last_clean":"2024-04-26T22:04:15.832093+0000","last_became_active":"2024-04-26T22:04:14.058186+0000","last_became_peered":"2024-04-26T22:04:14.058186+0000","last_unstale":"2024-04-26T22:04:15.832093+0000","last_undegraded":"2024-04-26T22:04:15.832093+0000","last_fullsized":"2024-04-26T22:04:15.832093+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:56.549573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831676+0000","last_change":"2024-04-26T22:04:14.071784+0000","last_active":"2024-04-26T22:04:15.831676+0000","last_peered":"2024-04-26T22:04:15.831676+0000","last_clean":"2024-04-26T22:04:15.831676+0000","last_became_active":"2024-04-26T22:04:14.071536+0000","last_became_peered":"2024-04-26T22:04:14.071536+0000","last_unstale":"2024-04-26T22:04:15.831676+0000","last_undegraded":"2024-04-26T22:04:15.831676+0000","last_fullsized":"2024-04-26T22:04:15.831676+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:24.562051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831583+0000","last_change":"2024-04-26T22:04:14.066201+0000","last_active":"2024-04-26T22:04:15.831583+0000","last_peered":"2024-04-26T22:04:15.831583+0000","last_clean":"2024-04-26T22:04:15.831583+0000","last_became_active":"2024-04-26T22:04:14.065858+0000","last_became_peered":"2024-04-26T22:04:14.065858+0000","last_unstale":"2024-04-26T22:04:15.831583+0000","last_undegraded":"2024-04-26T22:04:15.831583+0000","last_fullsized":"2024-04-26T22:04:15.831583+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:26.831818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.830757+0000","last_change":"2024-04-26T22:04:14.057829+0000","last_active":"2024-04-26T22:04:15.830757+0000","last_peered":"2024-04-26T22:04:15.830757+0000","last_clean":"2024-04-26T22:04:15.830757+0000","last_became_active":"2024-04-26T22:04:14.057596+0000","last_became_peered":"2024-04-26T22:04:14.057596+0000","last_unstale":"2024-04-26T22:04:15.830757+0000","last_undegraded":"2024-04-26T22:04:15.830757+0000","last_fullsized":"2024-04-26T22:04:15.830757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:39.464080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831683+0000","last_change":"2024-04-26T22:04:14.067838+0000","last_active":"2024-04-26T22:04:15.831683+0000","last_peered":"2024-04-26T22:04:15.831683+0000","last_clean":"2024-04-26T22:04:15.831683+0000","last_became_active":"2024-04-26T22:04:14.066840+0000","last_became_peered":"2024-04-26T22:04:14.066840+0000","last_unstale":"2024-04-26T22:04:15.831683+0000","last_undegraded":"2024-04-26T22:04:15.831683+0000","last_fullsized":"2024-04-26T22:04:15.831683+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:11.157411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046550+0000","last_change":"2024-04-26T22:04:14.067660+0000","last_active":"2024-04-26T22:04:15.046550+0000","last_peered":"2024-04-26T22:04:15.046550+0000","last_clean":"2024-04-26T22:04:15.046550+0000","last_became_active":"2024-04-26T22:04:14.067376+0000","last_became_peered":"2024-04-26T22:04:14.067376+0000","last_unstale":"2024-04-26T22:04:15.046550+0000","last_undegraded":"2024-04-26T22:04:15.046550+0000","last_fullsized":"2024-04-26T22:04:15.046550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:00.744399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046553+0000","last_change":"2024-04-26T22:04:14.064468+0000","last_active":"2024-04-26T22:04:15.046553+0000","last_peered":"2024-04-26T22:04:15.046553+0000","last_clean":"2024-04-26T22:04:15.046553+0000","last_became_active":"2024-04-26T22:04:14.061934+0000","last_became_peered":"2024-04-26T22:04:14.061934+0000","last_unstale":"2024-04-26T22:04:15.046553+0000","last_undegraded":"2024-04-26T22:04:15.046553+0000","last_fullsized":"2024-04-26T22:04:15.046553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:49.549920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831613+0000","last_change":"2024-04-26T22:04:14.070268+0000","last_active":"2024-04-26T22:04:15.831613+0000","last_peered":"2024-04-26T22:04:15.831613+0000","last_clean":"2024-04-26T22:04:15.831613+0000","last_became_active":"2024-04-26T22:04:14.069983+0000","last_became_peered":"2024-04-26T22:04:14.069983+0000","last_unstale":"2024-04-26T22:04:15.831613+0000","last_undegraded":"2024-04-26T22:04:15.831613+0000","last_fullsized":"2024-04-26T22:04:15.831613+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:27.394412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831951+0000","last_change":"2024-04-26T22:04:14.067467+0000","last_active":"2024-04-26T22:04:15.831951+0000","last_peered":"2024-04-26T22:04:15.831951+0000","last_clean":"2024-04-26T22:04:15.831951+0000","last_became_active":"2024-04-26T22:04:14.067204+0000","last_became_peered":"2024-04-26T22:04:14.067204+0000","last_unstale":"2024-04-26T22:04:15.831951+0000","last_undegraded":"2024-04-26T22:04:15.831951+0000","last_fullsized":"2024-04-26T22:04:15.831951+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:37.585245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831810+0000","last_change":"2024-04-26T22:04:14.067418+0000","last_active":"2024-04-26T22:04:15.831810+0000","last_peered":"2024-04-26T22:04:15.831810+0000","last_clean":"2024-04-26T22:04:15.831810+0000","last_became_active":"2024-04-26T22:04:14.067152+0000","last_became_peered":"2024-04-26T22:04:14.067152+0000","last_unstale":"2024-04-26T22:04:15.831810+0000","last_undegraded":"2024-04-26T22:04:15.831810+0000","last_fullsized":"2024-04-26T22:04:15.831810+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:50.657079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046726+0000","last_change":"2024-04-26T22:04:14.058751+0000","last_active":"2024-04-26T22:04:15.046726+0000","last_peered":"2024-04-26T22:04:15.046726+0000","last_clean":"2024-04-26T22:04:15.046726+0000","last_became_active":"2024-04-26T22:04:14.058280+0000","last_became_peered":"2024-04-26T22:04:14.058280+0000","last_unstale":"2024-04-26T22:04:15.046726+0000","last_undegraded":"2024-04-26T22:04:15.046726+0000","last_fullsized":"2024-04-26T22:04:15.046726+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:30.156225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831412+0000","last_change":"2024-04-26T22:04:14.069136+0000","last_active":"2024-04-26T22:04:15.831412+0000","last_peered":"2024-04-26T22:04:15.831412+0000","last_clean":"2024-04-26T22:04:15.831412+0000","last_became_active":"2024-04-26T22:04:14.068827+0000","last_became_peered":"2024-04-26T22:04:14.068827+0000","last_unstale":"2024-04-26T22:04:15.831412+0000","last_undegraded":"2024-04-26T22:04:15.831412+0000","last_fullsized":"2024-04-26T22:04:15.831412+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:31:49.549920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047557+0000","last_change":"2024-04-26T22:04:14.067728+0000","last_active":"2024-04-26T22:04:15.047557+0000","last_peered":"2024-04-26T22:04:15.047557+0000","last_clean":"2024-04-26T22:04:15.047557+0000","last_became_active":"2024-04-26T22:04:14.067410+0000","last_became_peered":"2024-04-26T22:04:14.067410+0000","last_unstale":"2024-04-26T22:04:15.047557+0000","last_undegraded":"2024-04-26T22:04:15.047557+0000","last_fullsized":"2024-04-26T22:04:15.047557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:06.669825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831833+0000","last_change":"2024-04-26T22:04:13.060166+0000","last_active":"2024-04-26T22:04:15.831833+0000","last_peered":"2024-04-26T22:04:15.831833+0000","last_clean":"2024-04-26T22:04:15.831833+0000","last_became_active":"2024-04-26T22:04:13.059911+0000","last_became_peered":"2024-04-26T22:04:13.059911+0000","last_unstale":"2024-04-26T22:04:15.831833+0000","last_undegraded":"2024-04-26T22:04:15.831833+0000","last_fullsized":"2024-04-26T22:04:15.831833+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:35.251945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831866+0000","last_change":"2024-04-26T22:04:14.061955+0000","last_active":"2024-04-26T22:04:15.831866+0000","last_peered":"2024-04-26T22:04:15.831866+0000","last_clean":"2024-04-26T22:04:15.831866+0000","last_became_active":"2024-04-26T22:04:14.060091+0000","last_became_peered":"2024-04-26T22:04:14.060091+0000","last_unstale":"2024-04-26T22:04:15.831866+0000","last_undegraded":"2024-04-26T22:04:15.831866+0000","last_fullsized":"2024-04-26T22:04:15.831866+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:46.292828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047656+0000","last_change":"2024-04-26T22:04:13.057698+0000","last_active":"2024-04-26T22:04:15.047656+0000","last_peered":"2024-04-26T22:04:15.047656+0000","last_clean":"2024-04-26T22:04:15.047656+0000","last_became_active":"2024-04-26T22:04:13.057448+0000","last_became_peered":"2024-04-26T22:04:13.057448+0000","last_unstale":"2024-04-26T22:04:15.047656+0000","last_undegraded":"2024-04-26T22:04:15.047656+0000","last_fullsized":"2024-04-26T22:04:15.047656+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:09.761048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831815+0000","last_change":"2024-04-26T22:04:14.070047+0000","last_active":"2024-04-26T22:04:15.831815+0000","last_peered":"2024-04-26T22:04:15.831815+0000","last_clean":"2024-04-26T22:04:15.831815+0000","last_became_active":"2024-04-26T22:04:14.069378+0000","last_became_peered":"2024-04-26T22:04:14.069378+0000","last_unstale":"2024-04-26T22:04:15.831815+0000","last_undegraded":"2024-04-26T22:04:15.831815+0000","last_fullsized":"2024-04-26T22:04:15.831815+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:06.669825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831279+0000","last_change":"2024-04-26T22:04:13.060846+0000","last_active":"2024-04-26T22:04:15.831279+0000","last_peered":"2024-04-26T22:04:15.831279+0000","last_clean":"2024-04-26T22:04:15.831279+0000","last_became_active":"2024-04-26T22:04:13.060555+0000","last_became_peered":"2024-04-26T22:04:13.060555+0000","last_unstale":"2024-04-26T22:04:15.831279+0000","last_undegraded":"2024-04-26T22:04:15.831279+0000","last_fullsized":"2024-04-26T22:04:15.831279+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:10.752373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047508+0000","last_change":"2024-04-26T22:04:14.053813+0000","last_active":"2024-04-26T22:04:15.047508+0000","last_peered":"2024-04-26T22:04:15.047508+0000","last_clean":"2024-04-26T22:04:15.047508+0000","last_became_active":"2024-04-26T22:04:14.053468+0000","last_became_peered":"2024-04-26T22:04:14.053468+0000","last_unstale":"2024-04-26T22:04:15.047508+0000","last_undegraded":"2024-04-26T22:04:15.047508+0000","last_fullsized":"2024-04-26T22:04:15.047508+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:53.873694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831256+0000","last_change":"2024-04-26T22:04:13.061087+0000","last_active":"2024-04-26T22:04:15.831256+0000","last_peered":"2024-04-26T22:04:15.831256+0000","last_clean":"2024-04-26T22:04:15.831256+0000","last_became_active":"2024-04-26T22:04:13.060576+0000","last_became_peered":"2024-04-26T22:04:13.060576+0000","last_unstale":"2024-04-26T22:04:15.831256+0000","last_undegraded":"2024-04-26T22:04:15.831256+0000","last_fullsized":"2024-04-26T22:04:15.831256+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:05.664513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831757+0000","last_change":"2024-04-26T22:04:14.067486+0000","last_active":"2024-04-26T22:04:15.831757+0000","last_peered":"2024-04-26T22:04:15.831757+0000","last_clean":"2024-04-26T22:04:15.831757+0000","last_became_active":"2024-04-26T22:04:14.067219+0000","last_became_peered":"2024-04-26T22:04:14.067219+0000","last_unstale":"2024-04-26T22:04:15.831757+0000","last_undegraded":"2024-04-26T22:04:15.831757+0000","last_fullsized":"2024-04-26T22:04:15.831757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:36.257257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047288+0000","last_change":"2024-04-26T22:04:13.058738+0000","last_active":"2024-04-26T22:04:15.047288+0000","last_peered":"2024-04-26T22:04:15.047288+0000","last_clean":"2024-04-26T22:04:15.047288+0000","last_became_active":"2024-04-26T22:04:13.058321+0000","last_became_peered":"2024-04-26T22:04:13.058321+0000","last_unstale":"2024-04-26T22:04:15.047288+0000","last_undegraded":"2024-04-26T22:04:15.047288+0000","last_fullsized":"2024-04-26T22:04:15.047288+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:36.579934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047143+0000","last_change":"2024-04-26T22:04:14.060703+0000","last_active":"2024-04-26T22:04:15.047143+0000","last_peered":"2024-04-26T22:04:15.047143+0000","last_clean":"2024-04-26T22:04:15.047143+0000","last_became_active":"2024-04-26T22:04:14.060303+0000","last_became_peered":"2024-04-26T22:04:14.060303+0000","last_unstale":"2024-04-26T22:04:15.047143+0000","last_undegraded":"2024-04-26T22:04:15.047143+0000","last_fullsized":"2024-04-26T22:04:15.047143+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:11.757684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046569+0000","last_change":"2024-04-26T22:04:13.057567+0000","last_active":"2024-04-26T22:04:15.046569+0000","last_peered":"2024-04-26T22:04:15.046569+0000","last_clean":"2024-04-26T22:04:15.046569+0000","last_became_active":"2024-04-26T22:04:13.057305+0000","last_became_peered":"2024-04-26T22:04:13.057305+0000","last_unstale":"2024-04-26T22:04:15.046569+0000","last_undegraded":"2024-04-26T22:04:15.046569+0000","last_fullsized":"2024-04-26T22:04:15.046569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:10.152100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046997+0000","last_change":"2024-04-26T22:04:14.055272+0000","last_active":"2024-04-26T22:04:15.046997+0000","last_peered":"2024-04-26T22:04:15.046997+0000","last_clean":"2024-04-26T22:04:15.046997+0000","last_became_active":"2024-04-26T22:04:14.055049+0000","last_became_peered":"2024-04-26T22:04:14.055049+0000","last_unstale":"2024-04-26T22:04:15.046997+0000","last_undegraded":"2024-04-26T22:04:15.046997+0000","last_fullsized":"2024-04-26T22:04:15.046997+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:48.565966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831167+0000","last_change":"2024-04-26T22:04:13.055989+0000","last_active":"2024-04-26T22:04:15.831167+0000","last_peered":"2024-04-26T22:04:15.831167+0000","last_clean":"2024-04-26T22:04:15.831167+0000","last_became_active":"2024-04-26T22:04:13.055700+0000","last_became_peered":"2024-04-26T22:04:13.055700+0000","last_unstale":"2024-04-26T22:04:15.831167+0000","last_undegraded":"2024-04-26T22:04:15.831167+0000","last_fullsized":"2024-04-26T22:04:15.831167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:45.287517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.045319+0000","last_change":"2024-04-26T22:04:14.054291+0000","last_active":"2024-04-26T22:04:15.045319+0000","last_peered":"2024-04-26T22:04:15.045319+0000","last_clean":"2024-04-26T22:04:15.045319+0000","last_became_active":"2024-04-26T22:04:14.054014+0000","last_became_peered":"2024-04-26T22:04:14.054014+0000","last_unstale":"2024-04-26T22:04:15.045319+0000","last_undegraded":"2024-04-26T22:04:15.045319+0000","last_fullsized":"2024-04-26T22:04:15.045319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:02:42.108789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.830862+0000","last_change":"2024-04-26T22:04:13.053786+0000","last_active":"2024-04-26T22:04:15.830862+0000","last_peered":"2024-04-26T22:04:15.830862+0000","last_clean":"2024-04-26T22:04:15.830862+0000","last_became_active":"2024-04-26T22:04:13.053477+0000","last_became_peered":"2024-04-26T22:04:13.053477+0000","last_unstale":"2024-04-26T22:04:15.830862+0000","last_undegraded":"2024-04-26T22:04:15.830862+0000","last_fullsized":"2024-04-26T22:04:15.830862+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:49:50.941070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.045369+0000","last_change":"2024-04-26T22:04:14.069741+0000","last_active":"2024-04-26T22:04:15.045369+0000","last_peered":"2024-04-26T22:04:15.045369+0000","last_clean":"2024-04-26T22:04:15.045369+0000","last_became_active":"2024-04-26T22:04:14.068950+0000","last_became_peered":"2024-04-26T22:04:14.068950+0000","last_unstale":"2024-04-26T22:04:15.045369+0000","last_undegraded":"2024-04-26T22:04:15.045369+0000","last_fullsized":"2024-04-26T22:04:15.045369+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:55.997750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831905+0000","last_change":"2024-04-26T22:04:13.058926+0000","last_active":"2024-04-26T22:04:15.831905+0000","last_peered":"2024-04-26T22:04:15.831905+0000","last_clean":"2024-04-26T22:04:15.831905+0000","last_became_active":"2024-04-26T22:04:13.058572+0000","last_became_peered":"2024-04-26T22:04:13.058572+0000","last_unstale":"2024-04-26T22:04:15.831905+0000","last_undegraded":"2024-04-26T22:04:15.831905+0000","last_fullsized":"2024-04-26T22:04:15.831905+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:49.651767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831660+0000","last_change":"2024-04-26T22:04:14.063819+0000","last_active":"2024-04-26T22:04:15.831660+0000","last_peered":"2024-04-26T22:04:15.831660+0000","last_clean":"2024-04-26T22:04:15.831660+0000","last_became_active":"2024-04-26T22:04:14.063552+0000","last_became_peered":"2024-04-26T22:04:14.063552+0000","last_unstale":"2024-04-26T22:04:15.831660+0000","last_undegraded":"2024-04-26T22:04:15.831660+0000","last_fullsized":"2024-04-26T22:04:15.831660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:26.672321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831470+0000","last_change":"2024-04-26T22:04:13.057193+0000","last_active":"2024-04-26T22:04:15.831470+0000","last_peered":"2024-04-26T22:04:15.831470+0000","last_clean":"2024-04-26T22:04:15.831470+0000","last_became_active":"2024-04-26T22:04:13.056770+0000","last_became_peered":"2024-04-26T22:04:13.056770+0000","last_unstale":"2024-04-26T22:04:15.831470+0000","last_undegraded":"2024-04-26T22:04:15.831470+0000","last_fullsized":"2024-04-26T22:04:15.831470+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:21:59.074315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831592+0000","last_change":"2024-04-26T22:04:14.067114+0000","last_active":"2024-04-26T22:04:15.831592+0000","last_peered":"2024-04-26T22:04:15.831592+0000","last_clean":"2024-04-26T22:04:15.831592+0000","last_became_active":"2024-04-26T22:04:14.066797+0000","last_became_peered":"2024-04-26T22:04:14.066797+0000","last_unstale":"2024-04-26T22:04:15.831592+0000","last_undegraded":"2024-04-26T22:04:15.831592+0000","last_fullsized":"2024-04-26T22:04:15.831592+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:22.482805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831182+0000","last_change":"2024-04-26T22:04:13.055692+0000","last_active":"2024-04-26T22:04:15.831182+0000","last_peered":"2024-04-26T22:04:15.831182+0000","last_clean":"2024-04-26T22:04:15.831182+0000","last_became_active":"2024-04-26T22:04:13.055363+0000","last_became_peered":"2024-04-26T22:04:13.055363+0000","last_unstale":"2024-04-26T22:04:15.831182+0000","last_undegraded":"2024-04-26T22:04:15.831182+0000","last_fullsized":"2024-04-26T22:04:15.831182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:23.556740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046724+0000","last_change":"2024-04-26T22:04:14.061514+0000","last_active":"2024-04-26T22:04:15.046724+0000","last_peered":"2024-04-26T22:04:15.046724+0000","last_clean":"2024-04-26T22:04:15.046724+0000","last_became_active":"2024-04-26T22:04:14.061236+0000","last_became_peered":"2024-04-26T22:04:14.061236+0000","last_unstale":"2024-04-26T22:04:15.046724+0000","last_undegraded":"2024-04-26T22:04:15.046724+0000","last_fullsized":"2024-04-26T22:04:15.046724+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:08:00.967009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831113+0000","last_change":"2024-04-26T22:04:13.057146+0000","last_active":"2024-04-26T22:04:15.831113+0000","last_peered":"2024-04-26T22:04:15.831113+0000","last_clean":"2024-04-26T22:04:15.831113+0000","last_became_active":"2024-04-26T22:04:13.056896+0000","last_became_peered":"2024-04-26T22:04:13.056896+0000","last_unstale":"2024-04-26T22:04:15.831113+0000","last_undegraded":"2024-04-26T22:04:15.831113+0000","last_fullsized":"2024-04-26T22:04:15.831113+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:23.556740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831175+0000","last_change":"2024-04-26T22:04:14.062065+0000","last_active":"2024-04-26T22:04:15.831175+0000","last_peered":"2024-04-26T22:04:15.831175+0000","last_clean":"2024-04-26T22:04:15.831175+0000","last_became_active":"2024-04-26T22:04:14.061801+0000","last_became_peered":"2024-04-26T22:04:14.061801+0000","last_unstale":"2024-04-26T22:04:15.831175+0000","last_undegraded":"2024-04-26T22:04:15.831175+0000","last_fullsized":"2024-04-26T22:04:15.831175+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:05:18.300346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831994+0000","last_change":"2024-04-26T22:04:13.060948+0000","last_active":"2024-04-26T22:04:15.831994+0000","last_peered":"2024-04-26T22:04:15.831994+0000","last_clean":"2024-04-26T22:04:15.831994+0000","last_became_active":"2024-04-26T22:04:13.060658+0000","last_became_peered":"2024-04-26T22:04:13.060658+0000","last_unstale":"2024-04-26T22:04:15.831994+0000","last_undegraded":"2024-04-26T22:04:15.831994+0000","last_fullsized":"2024-04-26T22:04:15.831994+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:05.657571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047401+0000","last_change":"2024-04-26T22:04:14.056417+0000","last_active":"2024-04-26T22:04:15.047401+0000","last_peered":"2024-04-26T22:04:15.047401+0000","last_clean":"2024-04-26T22:04:15.047401+0000","last_became_active":"2024-04-26T22:04:14.056151+0000","last_became_peered":"2024-04-26T22:04:14.056151+0000","last_unstale":"2024-04-26T22:04:15.047401+0000","last_undegraded":"2024-04-26T22:04:15.047401+0000","last_fullsized":"2024-04-26T22:04:15.047401+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:57.818613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.045173+0000","last_change":"2024-04-26T22:04:13.054129+0000","last_active":"2024-04-26T22:04:15.045173+0000","last_peered":"2024-04-26T22:04:15.045173+0000","last_clean":"2024-04-26T22:04:15.045173+0000","last_became_active":"2024-04-26T22:04:13.053874+0000","last_became_peered":"2024-04-26T22:04:13.053874+0000","last_unstale":"2024-04-26T22:04:15.045173+0000","last_undegraded":"2024-04-26T22:04:15.045173+0000","last_fullsized":"2024-04-26T22:04:15.045173+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:08:19.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.830893+0000","last_change":"2024-04-26T22:04:14.063950+0000","last_active":"2024-04-26T22:04:15.830893+0000","last_peered":"2024-04-26T22:04:15.830893+0000","last_clean":"2024-04-26T22:04:15.830893+0000","last_became_active":"2024-04-26T22:04:14.063662+0000","last_became_peered":"2024-04-26T22:04:14.063662+0000","last_unstale":"2024-04-26T22:04:15.830893+0000","last_undegraded":"2024-04-26T22:04:15.830893+0000","last_fullsized":"2024-04-26T22:04:15.830893+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:49.844549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831028+0000","last_change":"2024-04-26T22:04:13.052225+0000","last_active":"2024-04-26T22:04:15.831028+0000","last_peered":"2024-04-26T22:04:15.831028+0000","last_clean":"2024-04-26T22:04:15.831028+0000","last_became_active":"2024-04-26T22:04:13.051186+0000","last_became_peered":"2024-04-26T22:04:13.051186+0000","last_unstale":"2024-04-26T22:04:15.831028+0000","last_undegraded":"2024-04-26T22:04:15.831028+0000","last_fullsized":"2024-04-26T22:04:15.831028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:10.152100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831539+0000","last_change":"2024-04-26T22:04:14.068840+0000","last_active":"2024-04-26T22:04:15.831539+0000","last_peered":"2024-04-26T22:04:15.831539+0000","last_clean":"2024-04-26T22:04:15.831539+0000","last_became_active":"2024-04-26T22:04:14.067902+0000","last_became_peered":"2024-04-26T22:04:14.067902+0000","last_unstale":"2024-04-26T22:04:15.831539+0000","last_undegraded":"2024-04-26T22:04:15.831539+0000","last_fullsized":"2024-04-26T22:04:15.831539+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:28:52.311679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.830592+0000","last_change":"2024-04-26T22:04:13.057117+0000","last_active":"2024-04-26T22:04:15.830592+0000","last_peered":"2024-04-26T22:04:15.830592+0000","last_clean":"2024-04-26T22:04:15.830592+0000","last_became_active":"2024-04-26T22:04:13.056857+0000","last_became_peered":"2024-04-26T22:04:13.056857+0000","last_unstale":"2024-04-26T22:04:15.830592+0000","last_undegraded":"2024-04-26T22:04:15.830592+0000","last_fullsized":"2024-04-26T22:04:15.830592+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:25.826506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046699+0000","last_change":"2024-04-26T22:04:14.053691+0000","last_active":"2024-04-26T22:04:15.046699+0000","last_peered":"2024-04-26T22:04:15.046699+0000","last_clean":"2024-04-26T22:04:15.046699+0000","last_became_active":"2024-04-26T22:04:14.053412+0000","last_became_peered":"2024-04-26T22:04:14.053412+0000","last_unstale":"2024-04-26T22:04:15.046699+0000","last_undegraded":"2024-04-26T22:04:15.046699+0000","last_fullsized":"2024-04-26T22:04:15.046699+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:18:06.669825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831968+0000","last_change":"2024-04-26T22:04:13.055185+0000","last_active":"2024-04-26T22:04:15.831968+0000","last_peered":"2024-04-26T22:04:15.831968+0000","last_clean":"2024-04-26T22:04:15.831968+0000","last_became_active":"2024-04-26T22:04:13.054825+0000","last_became_peered":"2024-04-26T22:04:13.054825+0000","last_unstale":"2024-04-26T22:04:15.831968+0000","last_undegraded":"2024-04-26T22:04:15.831968+0000","last_fullsized":"2024-04-26T22:04:15.831968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:01:09.761048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831760+0000","last_change":"2024-04-26T22:04:14.064188+0000","last_active":"2024-04-26T22:04:15.831760+0000","last_peered":"2024-04-26T22:04:15.831760+0000","last_clean":"2024-04-26T22:04:15.831760+0000","last_became_active":"2024-04-26T22:04:14.063922+0000","last_became_peered":"2024-04-26T22:04:14.063922+0000","last_unstale":"2024-04-26T22:04:15.831760+0000","last_undegraded":"2024-04-26T22:04:15.831760+0000","last_fullsized":"2024-04-26T22:04:15.831760+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:20:00.744399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.830904+0000","last_change":"2024-04-26T22:04:13.058515+0000","last_active":"2024-04-26T22:04:15.830904+0000","last_peered":"2024-04-26T22:04:15.830904+0000","last_clean":"2024-04-26T22:04:15.830904+0000","last_became_active":"2024-04-26T22:04:13.058255+0000","last_became_peered":"2024-04-26T22:04:13.058255+0000","last_unstale":"2024-04-26T22:04:15.830904+0000","last_undegraded":"2024-04-26T22:04:15.830904+0000","last_fullsized":"2024-04-26T22:04:15.830904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:19:59.739087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046884+0000","last_change":"2024-04-26T22:04:14.072207+0000","last_active":"2024-04-26T22:04:15.046884+0000","last_peered":"2024-04-26T22:04:15.046884+0000","last_clean":"2024-04-26T22:04:15.046884+0000","last_became_active":"2024-04-26T22:04:14.071958+0000","last_became_peered":"2024-04-26T22:04:14.071958+0000","last_unstale":"2024-04-26T22:04:15.046884+0000","last_undegraded":"2024-04-26T22:04:15.046884+0000","last_fullsized":"2024-04-26T22:04:15.046884+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:46:39.245980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831365+0000","last_change":"2024-04-26T22:04:13.056076+0000","last_active":"2024-04-26T22:04:15.831365+0000","last_peered":"2024-04-26T22:04:15.831365+0000","last_clean":"2024-04-26T22:04:15.831365+0000","last_became_active":"2024-04-26T22:04:13.055672+0000","last_became_peered":"2024-04-26T22:04:13.055672+0000","last_unstale":"2024-04-26T22:04:15.831365+0000","last_undegraded":"2024-04-26T22:04:15.831365+0000","last_fullsized":"2024-04-26T22:04:15.831365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:47.560655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831659+0000","last_change":"2024-04-26T22:04:14.071164+0000","last_active":"2024-04-26T22:04:15.831659+0000","last_peered":"2024-04-26T22:04:15.831659+0000","last_clean":"2024-04-26T22:04:15.831659+0000","last_became_active":"2024-04-26T22:04:14.070907+0000","last_became_peered":"2024-04-26T22:04:14.070907+0000","last_unstale":"2024-04-26T22:04:15.831659+0000","last_undegraded":"2024-04-26T22:04:15.831659+0000","last_fullsized":"2024-04-26T22:04:15.831659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:53.003518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.045248+0000","last_change":"2024-04-26T22:04:13.057368+0000","last_active":"2024-04-26T22:04:15.045248+0000","last_peered":"2024-04-26T22:04:15.045248+0000","last_clean":"2024-04-26T22:04:15.045248+0000","last_became_active":"2024-04-26T22:04:13.057105+0000","last_became_peered":"2024-04-26T22:04:13.057105+0000","last_unstale":"2024-04-26T22:04:15.045248+0000","last_undegraded":"2024-04-26T22:04:15.045248+0000","last_fullsized":"2024-04-26T22:04:15.045248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:52.868382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831238+0000","last_change":"2024-04-26T22:04:14.061389+0000","last_active":"2024-04-26T22:04:15.831238+0000","last_peered":"2024-04-26T22:04:15.831238+0000","last_clean":"2024-04-26T22:04:15.831238+0000","last_became_active":"2024-04-26T22:04:14.061134+0000","last_became_peered":"2024-04-26T22:04:14.061134+0000","last_unstale":"2024-04-26T22:04:15.831238+0000","last_undegraded":"2024-04-26T22:04:15.831238+0000","last_fullsized":"2024-04-26T22:04:15.831238+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:47.723996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831708+0000","last_change":"2024-04-26T22:04:13.059029+0000","last_active":"2024-04-26T22:04:15.831708+0000","last_peered":"2024-04-26T22:04:15.831708+0000","last_clean":"2024-04-26T22:04:15.831708+0000","last_became_active":"2024-04-26T22:04:13.058737+0000","last_became_peered":"2024-04-26T22:04:13.058737+0000","last_unstale":"2024-04-26T22:04:15.831708+0000","last_undegraded":"2024-04-26T22:04:15.831708+0000","last_fullsized":"2024-04-26T22:04:15.831708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:20.078688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831035+0000","last_change":"2024-04-26T22:04:14.054326+0000","last_active":"2024-04-26T22:04:15.831035+0000","last_peered":"2024-04-26T22:04:15.831035+0000","last_clean":"2024-04-26T22:04:15.831035+0000","last_became_active":"2024-04-26T22:04:14.053646+0000","last_became_peered":"2024-04-26T22:04:14.053646+0000","last_unstale":"2024-04-26T22:04:15.831035+0000","last_undegraded":"2024-04-26T22:04:15.831035+0000","last_fullsized":"2024-04-26T22:04:15.831035+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:44:22.458794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831295+0000","last_change":"2024-04-26T22:04:13.059080+0000","last_active":"2024-04-26T22:04:15.831295+0000","last_peered":"2024-04-26T22:04:15.831295+0000","last_clean":"2024-04-26T22:04:15.831295+0000","last_became_active":"2024-04-26T22:04:13.058768+0000","last_became_peered":"2024-04-26T22:04:13.058768+0000","last_unstale":"2024-04-26T22:04:15.831295+0000","last_undegraded":"2024-04-26T22:04:15.831295+0000","last_fullsized":"2024-04-26T22:04:15.831295+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:42:54.846579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831065+0000","last_change":"2024-04-26T22:04:14.059235+0000","last_active":"2024-04-26T22:04:15.831065+0000","last_peered":"2024-04-26T22:04:15.831065+0000","last_clean":"2024-04-26T22:04:15.831065+0000","last_became_active":"2024-04-26T22:04:14.058960+0000","last_became_peered":"2024-04-26T22:04:14.058960+0000","last_unstale":"2024-04-26T22:04:15.831065+0000","last_undegraded":"2024-04-26T22:04:15.831065+0000","last_fullsized":"2024-04-26T22:04:15.831065+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:08.813881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.044999+0000","last_change":"2024-04-26T22:04:13.056700+0000","last_active":"2024-04-26T22:04:15.044999+0000","last_peered":"2024-04-26T22:04:15.044999+0000","last_clean":"2024-04-26T22:04:15.044999+0000","last_became_active":"2024-04-26T22:04:13.056448+0000","last_became_peered":"2024-04-26T22:04:13.056448+0000","last_unstale":"2024-04-26T22:04:15.044999+0000","last_undegraded":"2024-04-26T22:04:15.044999+0000","last_fullsized":"2024-04-26T22:04:15.044999+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:56.813301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047734+0000","last_change":"2024-04-26T22:04:14.056275+0000","last_active":"2024-04-26T22:04:15.047734+0000","last_peered":"2024-04-26T22:04:15.047734+0000","last_clean":"2024-04-26T22:04:15.047734+0000","last_became_active":"2024-04-26T22:04:14.055999+0000","last_became_peered":"2024-04-26T22:04:14.055999+0000","last_unstale":"2024-04-26T22:04:15.047734+0000","last_undegraded":"2024-04-26T22:04:15.047734+0000","last_fullsized":"2024-04-26T22:04:15.047734+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:48.565966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831726+0000","last_change":"2024-04-26T22:04:13.052772+0000","last_active":"2024-04-26T22:04:15.831726+0000","last_peered":"2024-04-26T22:04:15.831726+0000","last_clean":"2024-04-26T22:04:15.831726+0000","last_became_active":"2024-04-26T22:04:13.052515+0000","last_became_peered":"2024-04-26T22:04:13.052515+0000","last_unstale":"2024-04-26T22:04:15.831726+0000","last_undegraded":"2024-04-26T22:04:15.831726+0000","last_fullsized":"2024-04-26T22:04:15.831726+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:36:20.433787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047087+0000","last_change":"2024-04-26T22:04:14.068927+0000","last_active":"2024-04-26T22:04:15.047087+0000","last_peered":"2024-04-26T22:04:15.047087+0000","last_clean":"2024-04-26T22:04:15.047087+0000","last_became_active":"2024-04-26T22:04:14.068647+0000","last_became_peered":"2024-04-26T22:04:14.068647+0000","last_unstale":"2024-04-26T22:04:15.047087+0000","last_undegraded":"2024-04-26T22:04:15.047087+0000","last_fullsized":"2024-04-26T22:04:15.047087+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:50:46.292828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"87'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831624+0000","last_change":"2024-04-26T22:04:13.058721+0000","last_active":"2024-04-26T22:04:15.831624+0000","last_peered":"2024-04-26T22:04:15.831624+0000","last_clean":"2024-04-26T22:04:15.831624+0000","last_became_active":"2024-04-26T22:04:13.058447+0000","last_became_peered":"2024-04-26T22:04:13.058447+0000","last_unstale":"2024-04-26T22:04:15.831624+0000","last_undegraded":"2024-04-26T22:04:15.831624+0000","last_fullsized":"2024-04-26T22:04:15.831624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:51.711279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831823+0000","last_change":"2024-04-26T22:04:14.063601+0000","last_active":"2024-04-26T22:04:15.831823+0000","last_peered":"2024-04-26T22:04:15.831823+0000","last_clean":"2024-04-26T22:04:15.831823+0000","last_became_active":"2024-04-26T22:04:14.062424+0000","last_became_peered":"2024-04-26T22:04:14.062424+0000","last_unstale":"2024-04-26T22:04:15.831823+0000","last_undegraded":"2024-04-26T22:04:15.831823+0000","last_fullsized":"2024-04-26T22:04:15.831823+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:00:48.565966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831392+0000","last_change":"2024-04-26T22:04:13.060426+0000","last_active":"2024-04-26T22:04:15.831392+0000","last_peered":"2024-04-26T22:04:15.831392+0000","last_clean":"2024-04-26T22:04:15.831392+0000","last_became_active":"2024-04-26T22:04:13.060173+0000","last_became_peered":"2024-04-26T22:04:13.060173+0000","last_unstale":"2024-04-26T22:04:15.831392+0000","last_undegraded":"2024-04-26T22:04:15.831392+0000","last_fullsized":"2024-04-26T22:04:15.831392+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:10.152100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047094+0000","last_change":"2024-04-26T22:04:14.059828+0000","last_active":"2024-04-26T22:04:15.047094+0000","last_peered":"2024-04-26T22:04:15.047094+0000","last_clean":"2024-04-26T22:04:15.047094+0000","last_became_active":"2024-04-26T22:04:14.059564+0000","last_became_peered":"2024-04-26T22:04:14.059564+0000","last_unstale":"2024-04-26T22:04:15.047094+0000","last_undegraded":"2024-04-26T22:04:15.047094+0000","last_fullsized":"2024-04-26T22:04:15.047094+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:27.394412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831864+0000","last_change":"2024-04-26T22:04:13.055814+0000","last_active":"2024-04-26T22:04:15.831864+0000","last_peered":"2024-04-26T22:04:15.831864+0000","last_clean":"2024-04-26T22:04:15.831864+0000","last_became_active":"2024-04-26T22:04:13.055509+0000","last_became_peered":"2024-04-26T22:04:13.055509+0000","last_unstale":"2024-04-26T22:04:15.831864+0000","last_undegraded":"2024-04-26T22:04:15.831864+0000","last_fullsized":"2024-04-26T22:04:15.831864+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:20.814212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831241+0000","last_change":"2024-04-26T22:04:14.060247+0000","last_active":"2024-04-26T22:04:15.831241+0000","last_peered":"2024-04-26T22:04:15.831241+0000","last_clean":"2024-04-26T22:04:15.831241+0000","last_became_active":"2024-04-26T22:04:14.059977+0000","last_became_peered":"2024-04-26T22:04:14.059977+0000","last_unstale":"2024-04-26T22:04:15.831241+0000","last_undegraded":"2024-04-26T22:04:15.831241+0000","last_fullsized":"2024-04-26T22:04:15.831241+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:00:59.916014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831182+0000","last_change":"2024-04-26T22:04:13.056533+0000","last_active":"2024-04-26T22:04:15.831182+0000","last_peered":"2024-04-26T22:04:15.831182+0000","last_clean":"2024-04-26T22:04:15.831182+0000","last_became_active":"2024-04-26T22:04:13.056276+0000","last_became_peered":"2024-04-26T22:04:13.056276+0000","last_unstale":"2024-04-26T22:04:15.831182+0000","last_undegraded":"2024-04-26T22:04:15.831182+0000","last_fullsized":"2024-04-26T22:04:15.831182+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:53:26.389100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831051+0000","last_change":"2024-04-26T22:04:14.062265+0000","last_active":"2024-04-26T22:04:15.831051+0000","last_peered":"2024-04-26T22:04:15.831051+0000","last_clean":"2024-04-26T22:04:15.831051+0000","last_became_active":"2024-04-26T22:04:14.062011+0000","last_became_peered":"2024-04-26T22:04:14.062011+0000","last_unstale":"2024-04-26T22:04:15.831051+0000","last_undegraded":"2024-04-26T22:04:15.831051+0000","last_fullsized":"2024-04-26T22:04:15.831051+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:07:35.439445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046358+0000","last_change":"2024-04-26T22:04:13.056931+0000","last_active":"2024-04-26T22:04:15.046358+0000","last_peered":"2024-04-26T22:04:15.046358+0000","last_clean":"2024-04-26T22:04:15.046358+0000","last_became_active":"2024-04-26T22:04:13.056641+0000","last_became_peered":"2024-04-26T22:04:13.056641+0000","last_unstale":"2024-04-26T22:04:15.046358+0000","last_undegraded":"2024-04-26T22:04:15.046358+0000","last_fullsized":"2024-04-26T22:04:15.046358+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:35.251945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047146+0000","last_change":"2024-04-26T22:04:14.070857+0000","last_active":"2024-04-26T22:04:15.047146+0000","last_peered":"2024-04-26T22:04:15.047146+0000","last_clean":"2024-04-26T22:04:15.047146+0000","last_became_active":"2024-04-26T22:04:14.070350+0000","last_became_peered":"2024-04-26T22:04:14.070350+0000","last_unstale":"2024-04-26T22:04:15.047146+0000","last_undegraded":"2024-04-26T22:04:15.047146+0000","last_fullsized":"2024-04-26T22:04:15.047146+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:55.752509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831599+0000","last_change":"2024-04-26T22:04:13.055774+0000","last_active":"2024-04-26T22:04:15.831599+0000","last_peered":"2024-04-26T22:04:15.831599+0000","last_clean":"2024-04-26T22:04:15.831599+0000","last_became_active":"2024-04-26T22:04:13.055468+0000","last_became_peered":"2024-04-26T22:04:13.055468+0000","last_unstale":"2024-04-26T22:04:15.831599+0000","last_undegraded":"2024-04-26T22:04:15.831599+0000","last_fullsized":"2024-04-26T22:04:15.831599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:12:36.579934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831502+0000","last_change":"2024-04-26T22:04:14.066230+0000","last_active":"2024-04-26T22:04:15.831502+0000","last_peered":"2024-04-26T22:04:15.831502+0000","last_clean":"2024-04-26T22:04:15.831502+0000","last_became_active":"2024-04-26T22:04:14.065712+0000","last_became_peered":"2024-04-26T22:04:14.065712+0000","last_unstale":"2024-04-26T22:04:15.831502+0000","last_undegraded":"2024-04-26T22:04:15.831502+0000","last_fullsized":"2024-04-26T22:04:15.831502+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:30.156225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.046267+0000","last_change":"2024-04-26T22:04:13.059570+0000","last_active":"2024-04-26T22:04:15.046267+0000","last_peered":"2024-04-26T22:04:15.046267+0000","last_clean":"2024-04-26T22:04:15.046267+0000","last_became_active":"2024-04-26T22:04:13.059290+0000","last_became_peered":"2024-04-26T22:04:13.059290+0000","last_unstale":"2024-04-26T22:04:15.046267+0000","last_undegraded":"2024-04-26T22:04:15.046267+0000","last_fullsized":"2024-04-26T22:04:15.046267+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:41:49.651767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.831237+0000","last_change":"2024-04-26T22:04:14.063969+0000","last_active":"2024-04-26T22:04:15.831237+0000","last_peered":"2024-04-26T22:04:15.831237+0000","last_clean":"2024-04-26T22:04:15.831237+0000","last_became_active":"2024-04-26T22:04:14.063636+0000","last_became_peered":"2024-04-26T22:04:14.063636+0000","last_unstale":"2024-04-26T22:04:15.831237+0000","last_undegraded":"2024-04-26T22:04:15.831237+0000","last_fullsized":"2024-04-26T22:04:15.831237+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:13.036247+0000","last_clean_scrub_stamp":"2024-04-26T22:04:13.036247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:34:58.584676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047546+0000","last_change":"2024-04-26T22:04:13.053975+0000","last_active":"2024-04-26T22:04:15.047546+0000","last_peered":"2024-04-26T22:04:15.047546+0000","last_clean":"2024-04-26T22:04:15.047546+0000","last_became_active":"2024-04-26T22:04:13.053675+0000","last_became_peered":"2024-04-26T22:04:13.053675+0000","last_unstale":"2024-04-26T22:04:15.047546+0000","last_undegraded":"2024-04-26T22:04:15.047546+0000","last_fullsized":"2024-04-26T22:04:15.047546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:04:12.030935+0000","last_clean_scrub_stamp":"2024-04-26T22:04:12.030935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:29.101651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":304,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-26T22:04:15.047213+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:04:15.047213+0000","last_peered":"2024-04-26T22:04:15.047213+0000","last_clean":"2024-04-26T22:04:15.047213+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:04:15.047213+0000","last_undegraded":"2024-04-26T22:04:15.047213+0000","last_fullsized":"2024-04-26T22:04:15.047213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36968,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334872,"statfs":{"total":96636764160,"available":96598908928,"internally_reserved":0,"allocated":1667072,"data_stored":1047164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36396,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335444,"statfs":{"total":96636764160,"available":96599494656,"internally_reserved":0,"allocated":1081344,"data_stored":457420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1085440,"data_stored":458360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36384,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335456,"statfs":{"total":96636764160,"available":96599506944,"internally_reserved":0,"allocated":1069056,"data_stored":456726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":458338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1073152,"data_stored":457308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1081344,"data_stored":456920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32808,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339032,"statfs":{"total":96636764160,"available":96603168768,"internally_reserved":0,"allocated":1667072,"data_stored":1047128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:04:21.975 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T22:04:21.976 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T22:04:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.082+0000 7f79793e2640 1 Processor -- start 2024-04-26T22:04:22.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.083+0000 7f79793e2640 1 -- start start 2024-04-26T22:04:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.083+0000 7f79793e2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7974145460 0x7f79740b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.083+0000 7f79793e2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7974160610 0x7f79740b6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.083+0000 7f79793e2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7974160a70 con 0x7f79740b6c50 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.083+0000 7f79793e2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f79740b6280 con 0x7f7974160610 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.083+0000 7f79793e2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f79740b5670 con 0x7f7974145460 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.083+0000 7f79737fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f79740b6c50 0x7f7974073220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45156/0 (socket says 172.21.15.137:45156) 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.083+0000 7f79737fe640 1 -- 172.21.15.137:0/1176284795 learned_addr learned my addr 172.21.15.137:0/1176284795 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f79727fc640 1 --2- 172.21.15.137:0/1176284795 >> v2:172.21.15.170:3300/0 conn(0x7f7974160610 0x7f79740b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7972ffd640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7974145460 0x7f79740b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177109244 0 0) 0x7f7974160a70 con 0x7f79740b6c50 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795c003520 con 0x7f79740b6c50 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3057983614 0 0) 0x7f795c003520 con 0x7f79740b6c50 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7974145460 msgr2=0x7f79740b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7974145460 0x7f79740b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 >> v2:172.21.15.170:3300/0 conn(0x7f7974160610 msgr2=0x7f79740b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 --2- 172.21.15.137:0/1176284795 >> v2:172.21.15.170:3300/0 conn(0x7f7974160610 0x7f79740b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79740b5950 con 0x7f79740b6c50 2024-04-26T22:04:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f796c0019f0 con 0x7f79740b6c50 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 >> v1:172.21.15.137:6789/0 conn(0x7f79740b6c50 legacy=0x7f7974073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7974145460 0x7f795c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f795c003f30 0x7f795c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f795c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79740b6280 con 0x7f795c004d40 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f79740b5670 con 0x7f795c003f30 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f795c00b9c0 con 0x7f7974145460 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f79737fe640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f795c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f7972ffd640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7974145460 0x7f795c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f79727fc640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f795c003f30 0x7f795c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f79737fe640 1 -- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7974145460 msgr2=0x7f795c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f79737fe640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7974145460 0x7f795c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f79737fe640 1 -- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f795c003f30 msgr2=0x7f795c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f79737fe640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f795c003f30 0x7f795c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.084+0000 7f79737fe640 1 -- 172.21.15.137:0/1176284795 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c003520 con 0x7f795c004d40 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.085+0000 7f79737fe640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f795c0051c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f796c0013d0 tx=0x7f795c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e3612f98792533 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.085+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c00a4e0 con 0x7f795c004d40 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.085+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796c02f070 con 0x7f795c004d40 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.085+0000 7f7971ffb640 1 -- 172.21.15.137:0/1176284795 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c02bcd0 con 0x7f795c004d40 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.086+0000 7f79793e2640 1 -- 172.21.15.137:0/1176284795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 msgr2=0x7f795c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.086+0000 7f79793e2640 1 --2- 172.21.15.137:0/1176284795 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f795c0051c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f796c0013d0 tx=0x7f795c005830 comp rx=0 tx=0).stop 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.086+0000 7f79737fe640 1 -- 172.21.15.137:0/1176284795 reap_dead start 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.086+0000 7f79793e2640 1 -- 172.21.15.137:0/1176284795 shutdown_connections 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.086+0000 7f79793e2640 1 -- 172.21.15.137:0/1176284795 >> 172.21.15.137:0/1176284795 conn(0x7f79740b3c40 msgr2=0x7f79740b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.086+0000 7f79793e2640 1 -- 172.21.15.137:0/1176284795 shutdown_connections 2024-04-26T22:04:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.086+0000 7f79793e2640 1 -- 172.21.15.137:0/1176284795 wait complete. 2024-04-26T22:04:22.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.087+0000 7f79793e2640 1 Processor -- start 2024-04-26T22:04:22.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.087+0000 7f79793e2640 1 -- start start 2024-04-26T22:04:22.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f79793e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f797413c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f79793e2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797415d110 0x7f797415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f79793e2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79741f0b60 0x7f79741f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f79793e2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7974073930 con 0x7f795c004d40 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f79793e2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f79740b5f10 con 0x7f797415d110 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f79793e2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7974073ab0 con 0x7f79741f0b60 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f7972ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f797413c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f7972ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f797413c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44112/0 (socket says 172.21.15.137:44112) 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f7972ffd640 1 -- 172.21.15.137:0/1495130564 learned_addr learned my addr 172.21.15.137:0/1495130564 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f79727fc640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797415d110 0x7f797415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f79737fe640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79741f0b60 0x7f79741f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f7972ffd640 1 -- 172.21.15.137:0/1495130564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79741f0b60 msgr2=0x7f79741f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f7972ffd640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79741f0b60 0x7f79741f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f7972ffd640 1 -- 172.21.15.137:0/1495130564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797415d110 msgr2=0x7f797415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f7972ffd640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797415d110 0x7f797415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f7972ffd640 1 -- 172.21.15.137:0/1495130564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797413c910 con 0x7f795c004d40 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f79727fc640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797415d110 0x7f797415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.088+0000 7f7972ffd640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f797413c210 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f79640119a0 tx=0x7f7964011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.089+0000 7f795b7fe640 1 -- 172.21.15.137:0/1495130564 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796400faf0 con 0x7f795c004d40 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.089+0000 7f795b7fe640 1 -- 172.21.15.137:0/1495130564 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796400fc90 con 0x7f795c004d40 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.089+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797413cbf0 con 0x7f795c004d40 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.089+0000 7f795b7fe640 1 -- 172.21.15.137:0/1495130564 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964014440 con 0x7f795c004d40 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.089+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797415c910 con 0x7f795c004d40 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.090+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79740693d0 con 0x7f795c004d40 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.090+0000 7f795b7fe640 1 -- 172.21.15.137:0/1495130564 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7964012040 con 0x7f795c004d40 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.091+0000 7f795b7fe640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f796006c920 0x7f796006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.091+0000 7f795b7fe640 1 -- 172.21.15.137:0/1495130564 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f796408c250 con 0x7f795c004d40 2024-04-26T22:04:22.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.091+0000 7f79727fc640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f796006c920 0x7f796006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.091+0000 7f79727fc640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f796006c920 0x7f796006ede0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f797415ed10 tx=0x7f7968008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:22.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.095+0000 7f795b7fe640 1 -- 172.21.15.137:0/1495130564 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7964019030 con 0x7f795c004d40 2024-04-26T22:04:22.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.336+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f7974071be0 con 0x7f795c004d40 2024-04-26T22:04:22.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.338+0000 7f795b7fe640 1 -- 172.21.15.137:0/1495130564 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f796405a030 con 0x7f795c004d40 2024-04-26T22:04:22.339 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T22:04:22.339 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ== 2024-04-26T22:04:22.339 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T22:04:22.339 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T22:04:22.339 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T22:04:22.341 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T22:04:22.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f796006c920 msgr2=0x7f796006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f796006c920 0x7f796006ede0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f797415ed10 tx=0x7f7968008040 comp rx=0 tx=0).stop 2024-04-26T22:04:22.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 msgr2=0x7f797413c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f797413c210 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f79640119a0 tx=0x7f7964011e60 comp rx=0 tx=0).stop 2024-04-26T22:04:22.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 shutdown_connections 2024-04-26T22:04:22.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f796006c920 0x7f796006ede0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79741f0b60 0x7f79741f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f797415d110 0x7f797415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 --2- 172.21.15.137:0/1495130564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f795c004d40 0x7f797413c210 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 >> 172.21.15.137:0/1495130564 conn(0x7f79740b3c40 msgr2=0x7f79740d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:22.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 shutdown_connections 2024-04-26T22:04:22.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.340+0000 7f79793e2640 1 -- 172.21.15.137:0/1495130564 wait complete. 2024-04-26T22:04:22.351 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:22.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.448+0000 7f641b787640 1 Processor -- start 2024-04-26T22:04:22.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.448+0000 7f641b787640 1 -- start start 2024-04-26T22:04:22.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f641b787640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f64140b3af0 0x7f64140b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f641b787640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64140cfa80 con 0x7f6414148a30 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f641b787640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64140cfd60 con 0x7f6414160640 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f641b787640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f64140745e0 con 0x7f64140b3af0 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f6419523640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6414148a30 0x7f6414073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45166/0 (socket says 172.21.15.137:45166) 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f6419523640 1 -- 172.21.15.137:0/2771277488 learned_addr learned my addr 172.21.15.137:0/2771277488 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f6419d24640 1 --2- 172.21.15.137:0/2771277488 >> v2:172.21.15.170:3300/0 conn(0x7f64140b3af0 0x7f64140b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489538828 0 0) 0x7f64140cfa80 con 0x7f6414148a30 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6400003520 con 0x7f6414148a30 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095294493 0 0) 0x7f64140cfd60 con 0x7f6414160640 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64140cfa80 con 0x7f6414160640 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3956788542 0 0) 0x7f6400003520 con 0x7f6414148a30 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 >> v2:172.21.15.170:3300/0 conn(0x7f64140b3af0 msgr2=0x7f64140b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 --2- 172.21.15.137:0/2771277488 >> v2:172.21.15.170:3300/0 conn(0x7f64140b3af0 0x7f64140b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 >> v1:172.21.15.170:6789/0 conn(0x7f6414160640 legacy=0x7f64141636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64140d0040 con 0x7f6414148a30 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6410001670 con 0x7f6414148a30 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 >> v1:172.21.15.137:6789/0 conn(0x7f6414148a30 legacy=0x7f6414073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6400003b40 0x7f6400003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6400004800 0x7f6400004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64000051c0 0x7f640000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f64140745e0 con 0x7f64000051c0 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f640000c0f0 con 0x7f6400004800 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.449+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f640000c2f0 con 0x7f6400003b40 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6419d24640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64000051c0 0x7f640000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6419523640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6400003b40 0x7f6400003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6418d22640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6400004800 0x7f6400004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6419d24640 1 -- 172.21.15.137:0/2771277488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6400003b40 msgr2=0x7f6400003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6419d24640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6400003b40 0x7f6400003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6419d24640 1 -- 172.21.15.137:0/2771277488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6400004800 msgr2=0x7f6400004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6419d24640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6400004800 0x7f6400004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6419d24640 1 -- 172.21.15.137:0/2771277488 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6400003520 con 0x7f64000051c0 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6418d22640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6400004800 0x7f6400004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.450+0000 7f6419d24640 1 -- 172.21.15.137:0/2771277488 reap_dead start 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f6419d24640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64000051c0 0x7f640000b9c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f640c009fc0 tx=0x7f6400005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce12b67a24cc9122 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c035020 con 0x7f64000051c0 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f640c003bd0 con 0x7f64000051c0 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f640bfff640 1 -- 172.21.15.137:0/2771277488 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c009c10 con 0x7f64000051c0 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f641b787640 1 -- 172.21.15.137:0/2771277488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64000051c0 msgr2=0x7f640000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f641b787640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64000051c0 0x7f640000b9c0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f640c009fc0 tx=0x7f6400005830 comp rx=0 tx=0).stop 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f641b787640 1 -- 172.21.15.137:0/2771277488 shutdown_connections 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f641b787640 1 --2- 172.21.15.137:0/2771277488 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64000051c0 0x7f640000b9c0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f641b787640 1 -- 172.21.15.137:0/2771277488 >> 172.21.15.137:0/2771277488 conn(0x7f64140ce8b0 msgr2=0x7f64140cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f641b787640 1 -- 172.21.15.137:0/2771277488 shutdown_connections 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.451+0000 7f641b787640 1 -- 172.21.15.137:0/2771277488 wait complete. 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.452+0000 7f641b787640 1 Processor -- start 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.452+0000 7f641b787640 1 -- start start 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f641b787640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64000051c0 0x7f641415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f641b787640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64140b2af0 0x7f64140b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f641b787640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140b5e50 0x7f64140b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f641b787640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6414148e10 con 0x7f64140b2af0 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f641b787640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6414163180 con 0x7f64000051c0 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f641b787640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6414148f90 con 0x7f64140b5e50 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f6418d22640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64140b2af0 0x7f64140b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f6418d22640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64140b2af0 0x7f64140b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44132/0 (socket says 172.21.15.137:44132) 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f6418d22640 1 -- 172.21.15.137:0/3553924983 learned_addr learned my addr 172.21.15.137:0/3553924983 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:22.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f6419d24640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140b5e50 0x7f64140b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f6419523640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64000051c0 0x7f641415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f6418d22640 1 -- 172.21.15.137:0/3553924983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140b5e50 msgr2=0x7f64140b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.453+0000 7f6418d22640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140b5e50 0x7f64140b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.454+0000 7f6418d22640 1 -- 172.21.15.137:0/3553924983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64000051c0 msgr2=0x7f641415eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.454+0000 7f6418d22640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64000051c0 0x7f641415eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.454+0000 7f6418d22640 1 -- 172.21.15.137:0/3553924983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641415f090 con 0x7f64140b2af0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.454+0000 7f6418d22640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64140b2af0 0x7f64140b2f50 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f640400e460 tx=0x7f640400e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.454+0000 7f6409ffb640 1 -- 172.21.15.137:0/3553924983 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040052e0 con 0x7f64140b2af0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.454+0000 7f6409ffb640 1 -- 172.21.15.137:0/3553924983 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6404007020 con 0x7f64140b2af0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.454+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64140b02e0 con 0x7f64140b2af0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.454+0000 7f6409ffb640 1 -- 172.21.15.137:0/3553924983 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040071d0 con 0x7f64140b2af0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.454+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64140b08a0 con 0x7f64140b2af0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.455+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641406a290 con 0x7f64140b2af0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.455+0000 7f6409ffb640 1 -- 172.21.15.137:0/3553924983 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f640401a020 con 0x7f64140b2af0 2024-04-26T22:04:22.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.456+0000 7f6409ffb640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c8f0 0x7f63f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:22.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.456+0000 7f6419523640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c8f0 0x7f63f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:22.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.456+0000 7f6409ffb640 1 -- 172.21.15.137:0/3553924983 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f640408b120 con 0x7f64140b2af0 2024-04-26T22:04:22.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.456+0000 7f6419523640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c8f0 0x7f63f806edb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6410001eb0 tx=0x7f6410001e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:22.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.460+0000 7f6409ffb640 1 -- 172.21.15.137:0/3553924983 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f641415f090 con 0x7f64140b2af0 2024-04-26T22:04:22.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.669+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64140739f0 con 0x7f64140b2af0 2024-04-26T22:04:22.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.669+0000 7f6409ffb640 1 -- 172.21.15.137:0/3553924983 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5192 (secure 0 0 0) 0x7f6404058e70 con 0x7f64140b2af0 2024-04-26T22:04:22.669 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:22.669 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":7317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/2128712520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2128712520},{"type":"v1","addr":"172.21.15.137:6837","nonce":2128712520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:04:15.394897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7335},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7335":{"gid":7335,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/865192507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":865192507},{"type":"v1","addr":"172.21.15.170:6835","nonce":865192507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7335,"qdb_cluster":[7335]},"id":6}]} 2024-04-26T22:04:22.670 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 47 2024-04-26T22:04:22.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c8f0 msgr2=0x7f63f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c8f0 0x7f63f806edb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6410001eb0 tx=0x7f6410001e40 comp rx=0 tx=0).stop 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64140b2af0 msgr2=0x7f64140b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64140b2af0 0x7f64140b2f50 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f640400e460 tx=0x7f640400e920 comp rx=0 tx=0).stop 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 shutdown_connections 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f63f806c8f0 0x7f63f806edb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64140b2af0 0x7f64140b2f50 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64140b5e50 0x7f64140b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 --2- 172.21.15.137:0/3553924983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64000051c0 0x7f641415eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 >> 172.21.15.137:0/3553924983 conn(0x7f64140ce8b0 msgr2=0x7f64141455f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 shutdown_connections 2024-04-26T22:04:22.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:22.671+0000 7f641b787640 1 -- 172.21.15.137:0/3553924983 wait complete. 2024-04-26T22:04:23.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:04:13.390555+0000', 'modified': '2024-04-26T22:04:15.394897+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7335}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7335': {'gid': 7335, 'name': 'b', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6835/865192507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6833', 'nonce': 865192507}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 865192507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7335, 'qdb_cluster': [7335]} 2024-04-26T22:04:23.085 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:04:23.085 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T22:04:23.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.186+0000 7f074e997640 1 Processor -- start 2024-04-26T22:04:23.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.186+0000 7f074e997640 1 -- start start 2024-04-26T22:04:23.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f074e997640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f074806f2c0 0x7f0748071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f074e997640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07480733e0 con 0x7f074815b8c0 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f074e997640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0748072f00 con 0x7f074815b4e0 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f074e997640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0748072660 con 0x7f074806f2c0 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f074cf34640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f074815b8c0 0x7f07480b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45174/0 (socket says 172.21.15.137:45174) 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f074cf34640 1 -- 172.21.15.137:0/3438831967 learned_addr learned my addr 172.21.15.137:0/3438831967 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f07477fe640 1 --2- 172.21.15.137:0/3438831967 >> v2:172.21.15.170:3300/0 conn(0x7f074806f2c0 0x7f0748071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086457863 0 0) 0x7f07480733e0 con 0x7f074815b8c0 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0730003520 con 0x7f074815b8c0 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2395329355 0 0) 0x7f0730003520 con 0x7f074815b8c0 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 >> v2:172.21.15.170:3300/0 conn(0x7f074806f2c0 msgr2=0x7f0748071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 --2- 172.21.15.137:0/3438831967 >> v2:172.21.15.170:3300/0 conn(0x7f074806f2c0 0x7f0748071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 >> v1:172.21.15.170:6789/0 conn(0x7f074815b4e0 legacy=0x7f074806ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0748072940 con 0x7f074815b8c0 2024-04-26T22:04:23.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f07400019f0 con 0x7f074815b8c0 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 >> v1:172.21.15.137:6789/0 conn(0x7f074815b8c0 legacy=0x7f07480b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f0730003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07300043b0 0x7f0730004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0730005120 0x7f073000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0748072660 con 0x7f07300039b0 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f073000c060 con 0x7f0730005120 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.187+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f073000c260 con 0x7f07300043b0 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f0747fff640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f0730003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f074cf34640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0730005120 0x7f073000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f07477fe640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07300043b0 0x7f0730004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f0747fff640 1 -- 172.21.15.137:0/3438831967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07300043b0 msgr2=0x7f0730004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f0747fff640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07300043b0 0x7f0730004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f0747fff640 1 -- 172.21.15.137:0/3438831967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0730005120 msgr2=0x7f073000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f0747fff640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0730005120 0x7f073000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f0747fff640 1 -- 172.21.15.137:0/3438831967 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0730003520 con 0x7f07300039b0 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f074cf34640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0730005120 0x7f073000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f074cf34640 1 -- 172.21.15.137:0/3438831967 reap_dead start 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.188+0000 7f0747fff640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f0730003d90 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f0738001860 tx=0x7f0730005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276728872d8f77bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738038070 con 0x7f07300039b0 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073802bd00 con 0x7f07300039b0 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f0746ffd640 1 -- 172.21.15.137:0/3438831967 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738001430 con 0x7f07300039b0 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f074e997640 1 -- 172.21.15.137:0/3438831967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 msgr2=0x7f0730003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f074e997640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f0730003d90 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f0738001860 tx=0x7f0730005830 comp rx=0 tx=0).stop 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f074e997640 1 -- 172.21.15.137:0/3438831967 shutdown_connections 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f074e997640 1 --2- 172.21.15.137:0/3438831967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f0730003d90 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f074e997640 1 -- 172.21.15.137:0/3438831967 >> 172.21.15.137:0/3438831967 conn(0x7f07480d0d30 msgr2=0x7f07480d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f074e997640 1 -- 172.21.15.137:0/3438831967 shutdown_connections 2024-04-26T22:04:23.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.189+0000 7f074e997640 1 -- 172.21.15.137:0/3438831967 wait complete. 2024-04-26T22:04:23.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.190+0000 7f074e997640 1 Processor -- start 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f074e997640 1 -- start start 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f074e997640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f074814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f074e997640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0748152f20 0x7f0748154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f074e997640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07481533a0 0x7f07481546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f074e997640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0748073820 con 0x7f07300039b0 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f074e997640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f07480b3e80 con 0x7f07481533a0 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f074e997640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f07480739a0 con 0x7f0748152f20 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f0747fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f074814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f0747fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f074814da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44158/0 (socket says 172.21.15.137:44158) 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f0747fff640 1 -- 172.21.15.137:0/2692676508 learned_addr learned my addr 172.21.15.137:0/2692676508 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f074cf34640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07481533a0 0x7f07481546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.191+0000 7f07477fe640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0748152f20 0x7f0748154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f0747fff640 1 -- 172.21.15.137:0/2692676508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0748152f20 msgr2=0x7f0748154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f0747fff640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0748152f20 0x7f0748154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f0747fff640 1 -- 172.21.15.137:0/2692676508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07481533a0 msgr2=0x7f07481546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f0747fff640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07481533a0 0x7f07481546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f0747fff640 1 -- 172.21.15.137:0/2692676508 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0748153970 con 0x7f07300039b0 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f074cf34640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07481533a0 0x7f07481546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f0747fff640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f074814da70 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f0738001980 tx=0x7f0738001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f0744ff9640 1 -- 172.21.15.137:0/2692676508 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738001430 con 0x7f07300039b0 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f0744ff9640 1 -- 172.21.15.137:0/2692676508 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0738033c80 con 0x7f07300039b0 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f074e997640 1 -- 172.21.15.137:0/2692676508 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07481f3ff0 con 0x7f07300039b0 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f0744ff9640 1 -- 172.21.15.137:0/2692676508 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738007270 con 0x7f07300039b0 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.192+0000 7f074e997640 1 -- 172.21.15.137:0/2692676508 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07481f45b0 con 0x7f07300039b0 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.193+0000 7f0744ff9640 1 -- 172.21.15.137:0/2692676508 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0738007410 con 0x7f07300039b0 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.194+0000 7f0744ff9640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f073406c8f0 0x7f073406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.194+0000 7f0744ff9640 1 -- 172.21.15.137:0/2692676508 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f07380adba0 con 0x7f07300039b0 2024-04-26T22:04:23.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.194+0000 7f07477fe640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f073406c8f0 0x7f073406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.194+0000 7f07477fe640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f073406c8f0 0x7f073406edb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f07481f3f50 tx=0x7f073c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.195+0000 7f0751786740 1 Processor -- start 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.195+0000 7f0751786740 1 -- start start 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.195+0000 7f0751786740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f2419f0 0x55a15f21a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f0751786740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f244250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f0751786740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f244790 0x55a15f217ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f0751786740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a15f17e740 con 0x55a15f241dd0 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f0751786740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a15f11a3a0 con 0x55a15f244790 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f0751786740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a15f17a700 con 0x55a15f2419f0 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f07477fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f244250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f07477fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f244250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44160/0 (socket says 172.21.15.137:44160) 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f07477fe640 1 -- 172.21.15.137:0/3342878359 learned_addr learned my addr 172.21.15.137:0/3342878359 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f074cf34640 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f244790 0x55a15f217ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f0747fff640 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f2419f0 0x55a15f21a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f07477fe640 1 -- 172.21.15.137:0/3342878359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f2419f0 msgr2=0x55a15f21a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f07477fe640 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f2419f0 0x55a15f21a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f07477fe640 1 -- 172.21.15.137:0/3342878359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f244790 msgr2=0x55a15f217ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f07477fe640 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f244790 0x55a15f217ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f07477fe640 1 -- 172.21.15.137:0/3342878359 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15f136750 con 0x55a15f241dd0 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f074cf34640 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f244790 0x55a15f217ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f07477fe640 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f244250 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f073c013cd0 tx=0x7f073c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af526b9c5ae6f1c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f072dffb640 1 -- 172.21.15.137:0/3342878359 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c013d00 con 0x55a15f241dd0 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f072dffb640 1 -- 172.21.15.137:0/3342878359 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073c01c030 con 0x55a15f241dd0 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.196+0000 7f072dffb640 1 -- 172.21.15.137:0/3342878359 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c013ea0 con 0x55a15f241dd0 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 -- 172.21.15.137:0/3342878359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 msgr2=0x55a15f244250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f244250 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f073c013cd0 tx=0x7f073c016000 comp rx=0 tx=0).stop 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 -- 172.21.15.137:0/3342878359 shutdown_connections 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f244250 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f244790 0x55a15f217ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 --2- 172.21.15.137:0/3342878359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f2419f0 0x55a15f21a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 -- 172.21.15.137:0/3342878359 >> 172.21.15.137:0/3342878359 conn(0x55a15f216a50 msgr2=0x55a15f25f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 -- 172.21.15.137:0/3342878359 shutdown_connections 2024-04-26T22:04:23.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 -- 172.21.15.137:0/3342878359 wait complete. 2024-04-26T22:04:23.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.197+0000 7f0751786740 1 -- start start 2024-04-26T22:04:23.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0751786740 1 Processor -- start 2024-04-26T22:04:23.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0751786740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f258760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0751786740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f244790 0x55a15f247280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0751786740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0751786740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a15f105fe0 con 0x55a15f241dd0 2024-04-26T22:04:23.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0751786740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a15f25cf50 con 0x55a15f2401e0 2024-04-26T22:04:23.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0751786740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a15f258fd0 con 0x55a15f244790 2024-04-26T22:04:23.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0751786740 10 client.0 _ll_register_callbacks cb 0x55a15f11c150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0747fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f258760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0747fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f258760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44170/0 (socket says 172.21.15.137:44170) 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.198+0000 7f0747fff640 1 -- 172.21.15.137:0/2527414570 learned_addr learned my addr 172.21.15.137:0/2527414570 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f07477fe640 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f244790 0x55a15f247280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f074cf34640 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0747fff640 1 -- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f244790 msgr2=0x55a15f247280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0747fff640 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f244790 0x55a15f247280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0747fff640 1 -- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 msgr2=0x55a15f2477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0747fff640 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0747fff640 1 -- 172.21.15.137:0/2527414570 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15ee902d0 con 0x55a15f241dd0 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f074cf34640 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0747fff640 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f258760 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0738036040 tx=0x7f073807b1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3769ce98294e7db9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0726ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0726ffd640 1 -- 172.21.15.137:0/2527414570 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738038040 con 0x55a15f241dd0 2024-04-26T22:04:23.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0726ffd640 1 -- 172.21.15.137:0/2527414570 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f0738084020 con 0x55a15f241dd0 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0751786740 1 -- 172.21.15.137:0/2527414570 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f073c01c030 con 0x55a15f241dd0 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0726ffd640 1 -- 172.21.15.137:0/2527414570 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f073809a050 con 0x55a15f241dd0 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0751786740 10 client.7497 fetch_fsmap learned FSMap version 47 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0751786740 1 -- 172.21.15.137:0/2527414570 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55a15ef5a6b0 con 0x55a15f241dd0 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0726ffd640 1 -- 172.21.15.137:0/2527414570 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073c01c030 con 0x55a15f241dd0 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0726ffd640 1 -- 172.21.15.137:0/2527414570 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 47) ==== 3494+0+0 (secure 0 0 0) 0x7f073809e020 con 0x55a15f241dd0 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0751786740 10 client.7497 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0751786740 10 client.7497 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0751786740 20 client.7497 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0751786740 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] conn(0x55a15f25e430 0x55a15f25e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0751786740 4 client.7497 mds_command: new command op to 7335 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.199+0000 7f0751786740 1 -- 172.21.15.137:0/2527414570 --> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a15f18c350 con 0x55a15f25e430 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.200+0000 7f07477fe640 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] conn(0x55a15f25e430 0x55a15f25e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.200+0000 7f0726ffd640 10 client.7497 ms_handle_connect on v2:172.21.15.170:6833/865192507 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.200+0000 7f07477fe640 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] conn(0x55a15f25e430 0x55a15f25e810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22312d758c7aead6 server_cookie=5be066c5e3766c13 in_seq=0 out_seq=0 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0726ffd640 1 -- 172.21.15.137:0/2527414570 <== mds.0 v2:172.21.15.170:6833/865192507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a15f18c350 con 0x55a15f25e430 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0726ffd640 10 client.7497 handle_command_reply: tid=0 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 client.7497 shutdown 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 -- 172.21.15.137:0/2527414570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 msgr2=0x55a15f258760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f258760 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f0738036040 tx=0x7f073807b1a0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 -- 172.21.15.137:0/2527414570 shutdown_connections 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] conn(0x55a15f25e430 0x55a15f25e810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f244790 0x55a15f247280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0726ffd640 0 client.7497 ms_handle_reset on v2:172.21.15.170:6833/865192507 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 --2- 172.21.15.137:0/2527414570 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f241dd0 0x55a15f258760 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 -- 172.21.15.137:0/2527414570 >> 172.21.15.137:0/2527414570 conn(0x55a15f2419f0 msgr2=0x55a15f213f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 -- 172.21.15.137:0/2527414570 shutdown_connections 2024-04-26T22:04:23.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 1 -- 172.21.15.137:0/2527414570 wait complete. 2024-04-26T22:04:23.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.201+0000 7f0751786740 20 client.7497 trim_cache size 0 max 16384 2024-04-26T22:04:23.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.219+0000 7f0751786740 1 Processor -- start 2024-04-26T22:04:23.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.219+0000 7f0751786740 1 -- start start 2024-04-26T22:04:23.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f0751786740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f0751786740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 0x55a15f261780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f0751786740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f247d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f0751786740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f07481fca00 con 0x55a15f244790 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f0751786740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f07481e6c50 con 0x55a15f2401e0 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f0751786740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f07481fc3b0 con 0x55a15f241dd0 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f074cf34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f247d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f074cf34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f247d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44180/0 (socket says 172.21.15.137:44180) 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f074cf34640 1 -- 172.21.15.137:0/420980043 learned_addr learned my addr 172.21.15.137:0/420980043 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f0747fff640 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f07477fe640 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 0x55a15f261780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f074cf34640 1 -- 172.21.15.137:0/420980043 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 msgr2=0x55a15f261780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f074cf34640 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 0x55a15f261780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f074cf34640 1 -- 172.21.15.137:0/420980043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 msgr2=0x55a15f2630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f074cf34640 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f074cf34640 1 -- 172.21.15.137:0/420980043 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15f210700 con 0x55a15f244790 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f07477fe640 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 0x55a15f261780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f074cf34640 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f247d50 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f07480cd860 tx=0x7f0740005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f653c7e213843c22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f072d7fa640 1 -- 172.21.15.137:0/420980043 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740007760 con 0x55a15f244790 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f072d7fa640 1 -- 172.21.15.137:0/420980043 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0740007900 con 0x55a15f244790 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.220+0000 7f072d7fa640 1 -- 172.21.15.137:0/420980043 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740016680 con 0x55a15f244790 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 -- 172.21.15.137:0/420980043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 msgr2=0x55a15f247d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f247d50 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f07480cd860 tx=0x7f0740005f40 comp rx=0 tx=0).stop 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 -- 172.21.15.137:0/420980043 shutdown_connections 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f247d50 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 0x55a15f261780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 --2- 172.21.15.137:0/420980043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 -- 172.21.15.137:0/420980043 >> 172.21.15.137:0/420980043 conn(0x55a15f2419f0 msgr2=0x55a15f257c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 -- 172.21.15.137:0/420980043 shutdown_connections 2024-04-26T22:04:23.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 -- 172.21.15.137:0/420980043 wait complete. 2024-04-26T22:04:23.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.221+0000 7f0751786740 1 -- start start 2024-04-26T22:04:23.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.222+0000 7f0751786740 1 Processor -- start 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.222+0000 7f0751786740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.222+0000 7f0751786740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 0x55a15f213e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.222+0000 7f0751786740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f2143c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.222+0000 7f0751786740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a15f240a00 con 0x55a15f244790 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.222+0000 7f0751786740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a15f105fe0 con 0x55a15f2401e0 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.222+0000 7f0751786740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a15f2563e0 con 0x55a15f241dd0 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0751786740 10 client.0 _ll_register_callbacks cb 0x7f073802cee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f074cf34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f2143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f074cf34640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f2143c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44196/0 (socket says 172.21.15.137:44196) 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f074cf34640 1 -- 172.21.15.137:0/490154649 learned_addr learned my addr 172.21.15.137:0/490154649 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0747fff640 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f07477fe640 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 0x55a15f213e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f074cf34640 1 -- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 msgr2=0x55a15f213e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f074cf34640 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 0x55a15f213e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f074cf34640 1 -- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 msgr2=0x55a15f2ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f074cf34640 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2ddf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f074cf34640 1 -- 172.21.15.137:0/490154649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15f21a1a0 con 0x55a15f244790 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f074cf34640 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f2143c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0740001580 tx=0x7f0748072b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7760a992f8f0a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0726ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0726ffd640 1 -- 172.21.15.137:0/490154649 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740007760 con 0x55a15f244790 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0726ffd640 1 -- 172.21.15.137:0/490154649 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f0740024720 con 0x55a15f244790 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0751786740 1 -- 172.21.15.137:0/490154649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0740007900 con 0x55a15f244790 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0726ffd640 1 -- 172.21.15.137:0/490154649 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f0740007ab0 con 0x55a15f244790 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0751786740 10 client.7503 fetch_fsmap learned FSMap version 47 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0751786740 1 -- 172.21.15.137:0/490154649 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) -- 0x55a15f246d20 con 0x55a15f244790 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.223+0000 7f0726ffd640 1 -- 172.21.15.137:0/490154649 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0740007900 con 0x55a15f244790 2024-04-26T22:04:23.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0726ffd640 1 -- 172.21.15.137:0/490154649 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 47) ==== 3494+0+0 (secure 0 0 0) 0x7f0740024020 con 0x55a15f244790 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0751786740 10 client.7503 fetch_fsmap finished waiting for FSMap version 47 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0751786740 10 client.7503 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0751786740 20 client.7503 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0751786740 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] conn(0x55a15f25de40 0x55a15f2e1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0751786740 4 client.7503 mds_command: new command op to 7335 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0751786740 1 -- 172.21.15.137:0/490154649 --> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] -- command(tid 0: {"prefix": "status"}) -- 0x55a15f1861c0 con 0x55a15f25de40 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0747fff640 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] conn(0x55a15f25de40 0x55a15f2e1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0726ffd640 10 client.7503 ms_handle_connect on v2:172.21.15.170:6833/865192507 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0747fff640 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] conn(0x55a15f25de40 0x55a15f2e1a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4afea15bfa6b97c server_cookie=64a9a37fe7b530da in_seq=0 out_seq=0 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0726ffd640 1 -- 172.21.15.137:0/490154649 <== mds.0 v2:172.21.15.170:6833/865192507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a15f1861c0 con 0x55a15f25de40 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0726ffd640 10 client.7503 handle_command_reply: tid=0 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0751786740 1 client.7503 shutdown 2024-04-26T22:04:23.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0751786740 1 -- 172.21.15.137:0/490154649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 msgr2=0x55a15f2143c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.224+0000 7f0751786740 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f2143c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0740001580 tx=0x7f0748072b10 comp rx=0 tx=0).stop 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0751786740 1 -- 172.21.15.137:0/490154649 shutdown_connections 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0751786740 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:6833/865192507,v1:172.21.15.170:6835/865192507] conn(0x55a15f25de40 0x55a15f2e1a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0751786740 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a15f244790 0x55a15f2143c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0751786740 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a15f241dd0 0x55a15f213e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0751786740 1 --2- 172.21.15.137:0/490154649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a15f2401e0 0x55a15f2ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0726ffd640 0 client.7503 ms_handle_reset on v2:172.21.15.170:6833/865192507 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0751786740 1 -- 172.21.15.137:0/490154649 >> 172.21.15.137:0/490154649 conn(0x55a15f2419f0 msgr2=0x55a15f2471f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0751786740 1 -- 172.21.15.137:0/490154649 shutdown_connections 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0751786740 1 -- 172.21.15.137:0/490154649 wait complete. 2024-04-26T22:04:23.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f0751786740 20 client.7503 trim_cache size 0 max 16384 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 7335, 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 9.1829658470000002, 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 47, 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 87, 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 87, 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 14.241045566 2024-04-26T22:04:23.232 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:04:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 -- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f073406c8f0 msgr2=0x7f073406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f073406c8f0 0x7f073406edb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f07481f3f50 tx=0x7f073c008040 comp rx=0 tx=0).stop 2024-04-26T22:04:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 -- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 msgr2=0x7f074814da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f074814da70 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f0738001980 tx=0x7f0738001230 comp rx=0 tx=0).stop 2024-04-26T22:04:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 -- 172.21.15.137:0/2692676508 shutdown_connections 2024-04-26T22:04:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f073406c8f0 0x7f073406edb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07481533a0 0x7f07481546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0748152f20 0x7f0748154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 --2- 172.21.15.137:0/2692676508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f07300039b0 0x7f074814da70 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 -- 172.21.15.137:0/2692676508 >> 172.21.15.137:0/2692676508 conn(0x7f07480d0d30 msgr2=0x7f07480b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 -- 172.21.15.137:0/2692676508 shutdown_connections 2024-04-26T22:04:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.225+0000 7f074e997640 1 -- 172.21.15.137:0/2692676508 wait complete. 2024-04-26T22:04:23.236 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:04:23.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.333+0000 7f98a9223640 1 Processor -- start 2024-04-26T22:04:23.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.333+0000 7f98a9223640 1 -- start start 2024-04-26T22:04:23.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.333+0000 7f98a9223640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a4145980 0x7f98a4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.333+0000 7f98a9223640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f98a40b3de0 0x7f98a40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.333+0000 7f98a9223640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a40b4260 con 0x7f98a40b5fd0 2024-04-26T22:04:23.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.333+0000 7f98a9223640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f98a40b6440 con 0x7f98a40b3de0 2024-04-26T22:04:23.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.333+0000 7f98a9223640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f98a40b5140 con 0x7f98a4145980 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a359e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f98a40b5fd0 0x7f98a415c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45184/0 (socket says 172.21.15.137:45184) 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a359e640 1 -- 172.21.15.137:0/951813868 learned_addr learned my addr 172.21.15.137:0/951813868 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a2d9d640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a4145980 0x7f98a4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185163092 0 0) 0x7f98a40b4260 con 0x7f98a40b5fd0 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a259c640 1 --2- 172.21.15.137:0/951813868 >> v2:172.21.15.170:3300/0 conn(0x7f98a40b3de0 0x7f98a40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f988c003520 con 0x7f98a40b5fd0 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2741440866 0 0) 0x7f988c003520 con 0x7f98a40b5fd0 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a4145980 msgr2=0x7f98a4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a4145980 0x7f98a4160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 >> v2:172.21.15.170:3300/0 conn(0x7f98a40b3de0 msgr2=0x7f98a40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 --2- 172.21.15.137:0/951813868 >> v2:172.21.15.170:3300/0 conn(0x7f98a40b3de0 0x7f98a40b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a40b4530 con 0x7f98a40b5fd0 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f989c001a10 con 0x7f98a40b5fd0 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 >> v1:172.21.15.137:6789/0 conn(0x7f98a40b5fd0 legacy=0x7f98a415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a4145980 0x7f988c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f988c003f30 0x7f988c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f988c004d40 0x7f988c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98a40b6440 con 0x7f988c004d40 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f98a40b5140 con 0x7f988c003f30 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f988c00ba10 con 0x7f98a4145980 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a359e640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f988c004d40 0x7f988c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a259c640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f988c003f30 0x7f988c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.334+0000 7f98a2d9d640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a4145980 0x7f988c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.335+0000 7f98a359e640 1 -- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a4145980 msgr2=0x7f988c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.335+0000 7f98a359e640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a4145980 0x7f988c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.335+0000 7f98a359e640 1 -- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f988c003f30 msgr2=0x7f988c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.335+0000 7f98a359e640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f988c003f30 0x7f988c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.335+0000 7f98a359e640 1 -- 172.21.15.137:0/951813868 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988c003520 con 0x7f988c004d40 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.335+0000 7f98a359e640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f988c004d40 0x7f988c0051c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f989c00a8b0 tx=0x7f988c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b33d0020090405 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.335+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c00a4d0 con 0x7f988c004d40 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.335+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c02f070 con 0x7f988c004d40 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.335+0000 7f98a1d9b640 1 -- 172.21.15.137:0/951813868 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c02bd00 con 0x7f988c004d40 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.336+0000 7f98a9223640 1 -- 172.21.15.137:0/951813868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f988c004d40 msgr2=0x7f988c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.336+0000 7f98a9223640 1 --2- 172.21.15.137:0/951813868 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f988c004d40 0x7f988c0051c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f989c00a8b0 tx=0x7f988c005830 comp rx=0 tx=0).stop 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.336+0000 7f98a359e640 1 -- 172.21.15.137:0/951813868 reap_dead start 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.336+0000 7f98a9223640 1 -- 172.21.15.137:0/951813868 shutdown_connections 2024-04-26T22:04:23.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.336+0000 7f98a9223640 1 -- 172.21.15.137:0/951813868 >> 172.21.15.137:0/951813868 conn(0x7f98a40d0d30 msgr2=0x7f98a40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.336+0000 7f98a9223640 1 -- 172.21.15.137:0/951813868 shutdown_connections 2024-04-26T22:04:23.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.336+0000 7f98a9223640 1 -- 172.21.15.137:0/951813868 wait complete. 2024-04-26T22:04:23.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.337+0000 7f98a9223640 1 Processor -- start 2024-04-26T22:04:23.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.337+0000 7f98a9223640 1 -- start start 2024-04-26T22:04:23.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a9223640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f988c004d40 0x7f98a415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a9223640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a413f8b0 0x7f98a4144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a9223640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a4141540 0x7f98a415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a9223640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f98a40b4dd0 con 0x7f98a4141540 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a9223640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f98a40b4af0 con 0x7f988c004d40 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a9223640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f98a40730e0 con 0x7f98a413f8b0 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a359e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a4141540 0x7f98a415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a359e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a4141540 0x7f98a415a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44212/0 (socket says 172.21.15.137:44212) 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a359e640 1 -- 172.21.15.137:0/285668721 learned_addr learned my addr 172.21.15.137:0/285668721 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a259c640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a413f8b0 0x7f98a4144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.338+0000 7f98a2d9d640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f988c004d40 0x7f98a415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f98a359e640 1 -- 172.21.15.137:0/285668721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a413f8b0 msgr2=0x7f98a4144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f98a359e640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a413f8b0 0x7f98a4144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f98a359e640 1 -- 172.21.15.137:0/285668721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f988c004d40 msgr2=0x7f98a415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f98a359e640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f988c004d40 0x7f98a415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f98a359e640 1 -- 172.21.15.137:0/285668721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a415ee30 con 0x7f98a4141540 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f98a359e640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a4141540 0x7f98a415a8d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f989c00a9d0 tx=0x7f989c001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f988b7fe640 1 -- 172.21.15.137:0/285668721 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c00a4d0 con 0x7f98a4141540 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f988b7fe640 1 -- 172.21.15.137:0/285668721 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c001a00 con 0x7f98a4141540 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a415c560 con 0x7f98a4141540 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f988b7fe640 1 -- 172.21.15.137:0/285668721 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c002020 con 0x7f98a4141540 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.339+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a415cb20 con 0x7f98a4141540 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.340+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a415c380 con 0x7f98a4141540 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.342+0000 7f988b7fe640 1 -- 172.21.15.137:0/285668721 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f989c034670 con 0x7f98a4141540 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.343+0000 7f988b7fe640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f989006c920 0x7f989006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.343+0000 7f988b7fe640 1 -- 172.21.15.137:0/285668721 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5709+0+0 (secure 0 0 0) 0x7f989c0abd00 con 0x7f98a4141540 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.343+0000 7f98a2d9d640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f989006c920 0x7f989006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:23.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.343+0000 7f98a2d9d640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f989006c920 0x7f989006ede0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f98a41f62f0 tx=0x7f9898009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:23.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.346+0000 7f988b7fe640 1 -- 172.21.15.137:0/285668721 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f98a415c380 con 0x7f98a4141540 2024-04-26T22:04:23.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.561+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f98a406a290 con 0x7f98a4141540 2024-04-26T22:04:23.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.561+0000 7f988b7fe640 1 -- 172.21.15.137:0/285668721 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) ==== 53+0+73 (secure 0 0 0) 0x7f989c046060 con 0x7f98a4141540 2024-04-26T22:04:23.561 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:04:23.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f989006c920 msgr2=0x7f989006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f989006c920 0x7f989006ede0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f98a41f62f0 tx=0x7f9898009190 comp rx=0 tx=0).stop 2024-04-26T22:04:23.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a4141540 msgr2=0x7f98a415a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:23.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a4141540 0x7f98a415a8d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f989c00a9d0 tx=0x7f989c001de0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 shutdown_connections 2024-04-26T22:04:23.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f989006c920 0x7f989006ede0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f98a4141540 0x7f98a415a8d0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f98a413f8b0 0x7f98a4144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 --2- 172.21.15.137:0/285668721 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f988c004d40 0x7f98a415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:23.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 >> 172.21.15.137:0/285668721 conn(0x7f98a40d0d30 msgr2=0x7f98a40b17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:23.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 shutdown_connections 2024-04-26T22:04:23.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23.563+0000 7f98a9223640 1 -- 172.21.15.137:0/285668721 wait complete. 2024-04-26T22:04:23.574 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:04:23.574 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:04:23.574 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:04:23.574 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:04:23.574 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:04:23.575 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:04:23.575 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:04:23.575 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:04:23.575 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:04:23.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:23.575 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:04:23.590 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:04:23.591 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:23.592 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:04:23.593 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:04:23.593 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:04:23.593 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:23.593 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:04:23.593 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:04:23.593 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:04:23.593 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:23.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:23.593 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:04:23.653 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:04:23.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:23.654 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:04:23.710 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:04:23.710 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:04:23.710 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:04:23.710 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:04:23.710 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:04:23.711 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:04:23.711 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:04:23.711 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:04:23.711 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:04:23.711 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:04:23.711 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:04:23.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:04:23.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:04:23.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:23.834 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:04:23.849 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:04:23.849 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:04:23.849 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:04:23.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:23.849 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:04:23.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:04:23.914 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:04:23.968 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:04:23.969 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:04:23.969 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:04:24.023 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:04:24.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:24.024 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:04:24.106 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:04:24.106 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:04:24.113 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:04:24.113 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:04:24.113 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:04:24.114 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:04:24.114 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:04:24.114 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:04:24.114 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:04:24.114 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:04:24.114 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:04:24.114 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:04:24.116 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:04:24.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:24.116 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:04:24.181 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:04:24.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:04:24.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:04:24.284 INFO:teuthology.orchestra.run.smithi137.stdout:client7512 2024-04-26T22:04:24.284 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:04:24.284 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:04:24.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:24.300 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-04-26T22:04:24.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:24.362 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-04-26T22:04:24.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:24.419 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-04-26T22:04:24.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:24.477 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-04-26T22:04:24.535 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:04:24.535 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:04:24.535 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:04:24.535 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:04:24.535 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-04-26T22:04:24.535 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:04:24.639 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627776 2024-04-26T22:04:24.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:04:24.647 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:04:24.647 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:04:24.704 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:04:24.704 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:04:24.759 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:04:24.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.897+0000 7f089022a640 1 Processor -- start 2024-04-26T22:04:24.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.897+0000 7f089022a640 1 -- start start 2024-04-26T22:04:24.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.897+0000 7f089022a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0888145980 0x7f0888160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f089022a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b3de0 0x7f08880b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f089022a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08880b4260 con 0x7f08880b5fd0 2024-04-26T22:04:24.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f089022a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f08880b6440 con 0x7f0888145980 2024-04-26T22:04:24.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f089022a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f08880b5140 con 0x7f08880b3de0 2024-04-26T22:04:24.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088dfc6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0888145980 0x7f0888160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088e7c7640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f08880b5fd0 0x7f088815c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45194/0 (socket says 172.21.15.137:45194) 2024-04-26T22:04:24.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088e7c7640 1 -- 172.21.15.137:0/1085734699 learned_addr learned my addr 172.21.15.137:0/1085734699 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:24.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088d7c5640 1 --2- 172.21.15.137:0/1085734699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b3de0 0x7f08880b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088dfc6640 1 -- 172.21.15.137:0/1085734699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b3de0 msgr2=0x7f08880b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:24.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088dfc6640 1 --2- 172.21.15.137:0/1085734699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b3de0 0x7f08880b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088dfc6640 1 -- 172.21.15.137:0/1085734699 >> v1:172.21.15.137:6789/0 conn(0x7f08880b5fd0 legacy=0x7f088815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088dfc6640 1 -- 172.21.15.137:0/1085734699 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08880b4530 con 0x7f0888145980 2024-04-26T22:04:24.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088cfc4640 1 -- 172.21.15.137:0/1085734699 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776748751 0 0) 0x7f08880b4260 con 0x7f08880b5fd0 2024-04-26T22:04:24.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.898+0000 7f088d7c5640 1 --2- 172.21.15.137:0/1085734699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b3de0 0x7f08880b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:24.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f088dfc6640 1 --2- 172.21.15.137:0/1085734699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0888145980 0x7f0888160630 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f0880009d90 tx=0x7f088002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126d85635eeacdd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:24.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f088cfc4640 1 -- 172.21.15.137:0/1085734699 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880031600 con 0x7f0888145980 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f088cfc4640 1 -- 172.21.15.137:0/1085734699 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08800317a0 con 0x7f0888145980 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f088cfc4640 1 -- 172.21.15.137:0/1085734699 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880031b70 con 0x7f0888145980 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f089022a640 1 -- 172.21.15.137:0/1085734699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0888145980 msgr2=0x7f0888160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f089022a640 1 --2- 172.21.15.137:0/1085734699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0888145980 0x7f0888160630 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f0880009d90 tx=0x7f088002a5d0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f089022a640 1 -- 172.21.15.137:0/1085734699 shutdown_connections 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f089022a640 1 --2- 172.21.15.137:0/1085734699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b3de0 0x7f08880b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f089022a640 1 --2- 172.21.15.137:0/1085734699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0888145980 0x7f0888160630 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f089022a640 1 -- 172.21.15.137:0/1085734699 >> 172.21.15.137:0/1085734699 conn(0x7f08880d0d30 msgr2=0x7f08880d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f089022a640 1 -- 172.21.15.137:0/1085734699 shutdown_connections 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.899+0000 7f089022a640 1 -- 172.21.15.137:0/1085734699 wait complete. 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f089022a640 1 Processor -- start 2024-04-26T22:04:24.901 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f089022a640 1 -- start start 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f089022a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08880b3de0 0x7f088813fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f089022a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b5fd0 0x7f08881403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f089022a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0888145980 0x7f08881416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f089022a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08880b4dd0 con 0x7f08880b3de0 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f089022a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f08880b4af0 con 0x7f0888145980 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f089022a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f08880730e0 con 0x7f08880b5fd0 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f088dfc6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08880b3de0 0x7f088813fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f088dfc6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08880b3de0 0x7f088813fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44222/0 (socket says 172.21.15.137:44222) 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.901+0000 7f088dfc6640 1 -- 172.21.15.137:0/501122263 learned_addr learned my addr 172.21.15.137:0/501122263 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f088d7c5640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b5fd0 0x7f08881403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f088e7c7640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0888145980 0x7f08881416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f088dfc6640 1 -- 172.21.15.137:0/501122263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b5fd0 msgr2=0x7f08881403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f088dfc6640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b5fd0 0x7f08881403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f088dfc6640 1 -- 172.21.15.137:0/501122263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0888145980 msgr2=0x7f08881416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f088dfc6640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0888145980 0x7f08881416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f088dfc6640 1 -- 172.21.15.137:0/501122263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088813bc10 con 0x7f08880b3de0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f088e7c7640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0888145980 0x7f08881416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f088dfc6640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08880b3de0 0x7f088813fe70 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f0880009d90 tx=0x7f0880004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f087e7fc640 1 -- 172.21.15.137:0/501122263 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f088003f070 con 0x7f08880b3de0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f087e7fc640 1 -- 172.21.15.137:0/501122263 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0880030be0 con 0x7f08880b3de0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f087e7fc640 1 -- 172.21.15.137:0/501122263 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880043410 con 0x7f08880b3de0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0888140bf0 con 0x7f08880b3de0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.902+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088815d500 con 0x7f08880b3de0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.903+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088806a290 con 0x7f08880b3de0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.904+0000 7f087e7fc640 1 -- 172.21.15.137:0/501122263 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08800435b0 con 0x7f08880b3de0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.904+0000 7f087e7fc640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f086c06c920 0x7f086c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.904+0000 7f088d7c5640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f086c06c920 0x7f086c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:24.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.904+0000 7f087e7fc640 1 -- 172.21.15.137:0/501122263 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5738+0+0 (secure 0 0 0) 0x7f08800ace90 con 0x7f08880b3de0 2024-04-26T22:04:24.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.904+0000 7f088d7c5640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f086c06c920 0x7f086c06ede0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f08881f5e00 tx=0x7f0878008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:24.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:24.908+0000 7f087e7fc640 1 -- 172.21.15.137:0/501122263 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f088007b360 con 0x7f08880b3de0 2024-04-26T22:04:25.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.086+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0888073cc0 con 0x7f08880b3de0 2024-04-26T22:04:25.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.088+0000 7f087e7fc640 1 -- 172.21.15.137:0/501122263 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16722 (secure 0 0 0) 0x7f088007ac60 con 0x7f08880b3de0 2024-04-26T22:04:25.088 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:25.088 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":89,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:04:24.347448+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:04:11.600389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-26T22:04:12.347068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:04:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f086c06c920 msgr2=0x7f086c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f086c06c920 0x7f086c06ede0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f08881f5e00 tx=0x7f0878008040 comp rx=0 tx=0).stop 2024-04-26T22:04:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08880b3de0 msgr2=0x7f088813fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08880b3de0 0x7f088813fe70 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f0880009d90 tx=0x7f0880004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 shutdown_connections 2024-04-26T22:04:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f086c06c920 0x7f086c06ede0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0888145980 0x7f08881416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08880b5fd0 0x7f08881403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 --2- 172.21.15.137:0/501122263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08880b3de0 0x7f088813fe70 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 >> 172.21.15.137:0/501122263 conn(0x7f08880d0d30 msgr2=0x7f088815c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:25.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 shutdown_connections 2024-04-26T22:04:25.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.090+0000 7f089022a640 1 -- 172.21.15.137:0/501122263 wait complete. 2024-04-26T22:04:25.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:04:11.600389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:04:12.347068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:04:25.101 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:04:25.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.201+0000 7fade8eda640 1 Processor -- start 2024-04-26T22:04:25.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.201+0000 7fade8eda640 1 -- start start 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.202+0000 7fade8eda640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fade40d3820 0x7fade40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.202+0000 7fade8eda640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fade40b60b0 0x7fade40d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.202+0000 7fade8eda640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade40d3c90 con 0x7fade415f680 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.202+0000 7fade8eda640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fade415fa60 con 0x7fade40b60b0 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.202+0000 7fade8eda640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fade40d3f50 con 0x7fade40d3820 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.202+0000 7fade2d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fade40b60b0 0x7fade40d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.202+0000 7fade259c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fade415f680 0x7fade4163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45200/0 (socket says 172.21.15.137:45200) 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.202+0000 7fade259c640 1 -- 172.21.15.137:0/3845967799 learned_addr learned my addr 172.21.15.137:0/3845967799 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.203+0000 7fade1d9b640 1 --2- 172.21.15.137:0/3845967799 >> v2:172.21.15.170:3300/0 conn(0x7fade40d3820 0x7fade40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.203+0000 7fade2d9d640 1 -- 172.21.15.137:0/3845967799 >> v2:172.21.15.170:3300/0 conn(0x7fade40d3820 msgr2=0x7fade40b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.203+0000 7fade2d9d640 1 --2- 172.21.15.137:0/3845967799 >> v2:172.21.15.170:3300/0 conn(0x7fade40d3820 0x7fade40b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.203+0000 7fade2d9d640 1 -- 172.21.15.137:0/3845967799 >> v1:172.21.15.137:6789/0 conn(0x7fade415f680 legacy=0x7fade4163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.203+0000 7fade2d9d640 1 -- 172.21.15.137:0/3845967799 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade40b5090 con 0x7fade40b60b0 2024-04-26T22:04:25.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.203+0000 7fade159a640 1 -- 172.21.15.137:0/3845967799 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320918643 0 0) 0x7fade40d3c90 con 0x7fade415f680 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.203+0000 7fade2d9d640 1 --2- 172.21.15.137:0/3845967799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade40b60b0 0x7fade40d4f20 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fade4163040 tx=0x7faddc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a4a2fa96ff9f83 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade159a640 1 -- 172.21.15.137:0/3845967799 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc037070 con 0x7fade40b60b0 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade159a640 1 -- 172.21.15.137:0/3845967799 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc032440 con 0x7fade40b60b0 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade159a640 1 -- 172.21.15.137:0/3845967799 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc032810 con 0x7fade40b60b0 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade8eda640 1 -- 172.21.15.137:0/3845967799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade40b60b0 msgr2=0x7fade40d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade8eda640 1 --2- 172.21.15.137:0/3845967799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade40b60b0 0x7fade40d4f20 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fade4163040 tx=0x7faddc02a1a0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade8eda640 1 -- 172.21.15.137:0/3845967799 shutdown_connections 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade8eda640 1 --2- 172.21.15.137:0/3845967799 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade40b60b0 0x7fade40d4f20 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade8eda640 1 --2- 172.21.15.137:0/3845967799 >> v2:172.21.15.170:3300/0 conn(0x7fade40d3820 0x7fade40b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade8eda640 1 -- 172.21.15.137:0/3845967799 >> 172.21.15.137:0/3845967799 conn(0x7fade408eca0 msgr2=0x7fade409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:25.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade8eda640 1 -- 172.21.15.137:0/3845967799 shutdown_connections 2024-04-26T22:04:25.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.204+0000 7fade8eda640 1 -- 172.21.15.137:0/3845967799 wait complete. 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade8eda640 1 Processor -- start 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade8eda640 1 -- start start 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade8eda640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fade40b60b0 0x7fade4150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade8eda640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade40d3820 0x7fade415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade8eda640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade415f680 0x7fade41f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade8eda640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fade40d55e0 con 0x7fade415f680 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade8eda640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fade40d5460 con 0x7fade40d3820 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade8eda640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fade40d5760 con 0x7fade40b60b0 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade2d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade415f680 0x7fade41f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade2d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade415f680 0x7fade41f85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44234/0 (socket says 172.21.15.137:44234) 2024-04-26T22:04:25.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade2d9d640 1 -- 172.21.15.137:0/1986669591 learned_addr learned my addr 172.21.15.137:0/1986669591 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.206+0000 7fade259c640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fade40b60b0 0x7fade4150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade1d9b640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade40d3820 0x7fade415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade2d9d640 1 -- 172.21.15.137:0/1986669591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fade40b60b0 msgr2=0x7fade4150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade2d9d640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fade40b60b0 0x7fade4150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade2d9d640 1 -- 172.21.15.137:0/1986669591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade40d3820 msgr2=0x7fade415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade2d9d640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade40d3820 0x7fade415fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade2d9d640 1 -- 172.21.15.137:0/1986669591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade40d0a30 con 0x7fade415f680 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade259c640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fade40b60b0 0x7fade4150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade2d9d640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade415f680 0x7fade41f85e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7faddc035040 tx=0x7faddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fadd2ffd640 1 -- 172.21.15.137:0/1986669591 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc037040 con 0x7fade415f680 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fadd2ffd640 1 -- 172.21.15.137:0/1986669591 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc042070 con 0x7fade415f680 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fadd2ffd640 1 -- 172.21.15.137:0/1986669591 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc030b30 con 0x7fade415f680 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade40d0d10 con 0x7fade415f680 2024-04-26T22:04:25.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.207+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade40d12d0 con 0x7fade415f680 2024-04-26T22:04:25.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.208+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade40c8d60 con 0x7fade415f680 2024-04-26T22:04:25.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.208+0000 7fadd2ffd640 1 -- 172.21.15.137:0/1986669591 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faddc030cd0 con 0x7fade415f680 2024-04-26T22:04:25.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.209+0000 7fadd2ffd640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadc406c920 0x7fadc406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.209+0000 7fadd2ffd640 1 -- 172.21.15.137:0/1986669591 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5738+0+0 (secure 0 0 0) 0x7faddc0ac6a0 con 0x7fade415f680 2024-04-26T22:04:25.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.209+0000 7fade259c640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadc406c920 0x7fadc406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.209+0000 7fade259c640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadc406c920 0x7fadc406ede0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fadd40012e0 tx=0x7fadd4005b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:25.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.213+0000 7fadd2ffd640 1 -- 172.21.15.137:0/1986669591 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faddc032e20 con 0x7fade415f680 2024-04-26T22:04:25.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.389+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fade406a290 con 0x7fade415f680 2024-04-26T22:04:25.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.390+0000 7fadd2ffd640 1 -- 172.21.15.137:0/1986669591 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7faddc045360 con 0x7fade415f680 2024-04-26T22:04:25.390 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:04:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadc406c920 msgr2=0x7fadc406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadc406c920 0x7fadc406ede0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fadd40012e0 tx=0x7fadd4005b90 comp rx=0 tx=0).stop 2024-04-26T22:04:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade415f680 msgr2=0x7fade41f85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade415f680 0x7fade41f85e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7faddc035040 tx=0x7faddc0046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 shutdown_connections 2024-04-26T22:04:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadc406c920 0x7fadc406ede0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fade415f680 0x7fade41f85e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade40d3820 0x7fade415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 --2- 172.21.15.137:0/1986669591 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fade40b60b0 0x7fade4150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 >> 172.21.15.137:0/1986669591 conn(0x7fade408eca0 msgr2=0x7fade4075440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 shutdown_connections 2024-04-26T22:04:25.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.392+0000 7fade8eda640 1 -- 172.21.15.137:0/1986669591 wait complete. 2024-04-26T22:04:25.403 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:04:25.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.502+0000 7f514234e640 1 Processor -- start 2024-04-26T22:04:25.502 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.502+0000 7f514234e640 1 -- start start 2024-04-26T22:04:25.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.503+0000 7f514234e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f513c0cffd0 0x7f513c0d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.503+0000 7f514234e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513c0d0780 con 0x7f513c15d130 2024-04-26T22:04:25.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.503+0000 7f514234e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513c0d04a0 con 0x7f513c0c6a90 2024-04-26T22:04:25.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.503+0000 7f514234e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f513c0d0e60 con 0x7f513c0cffd0 2024-04-26T22:04:25.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.503+0000 7f513bfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f513c15d130 0x7f513c0cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45210/0 (socket says 172.21.15.137:45210) 2024-04-26T22:04:25.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.503+0000 7f513bfff640 1 -- 172.21.15.137:0/3080175496 learned_addr learned my addr 172.21.15.137:0/3080175496 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:25.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.504+0000 7f513b7fe640 1 --2- 172.21.15.137:0/3080175496 >> v2:172.21.15.170:3300/0 conn(0x7f513c0cffd0 0x7f513c0d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.504+0000 7f513affd640 1 -- 172.21.15.137:0/3080175496 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696870905 0 0) 0x7f513c0d0780 con 0x7f513c15d130 2024-04-26T22:04:25.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.504+0000 7f513affd640 1 -- 172.21.15.137:0/3080175496 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5124003520 con 0x7f513c15d130 2024-04-26T22:04:25.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.504+0000 7f513b7fe640 1 -- 172.21.15.137:0/3080175496 >> v1:172.21.15.170:6789/0 conn(0x7f513c0c6a90 legacy=0x7f513c0ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.504+0000 7f513b7fe640 1 -- 172.21.15.137:0/3080175496 >> v1:172.21.15.137:6789/0 conn(0x7f513c15d130 legacy=0x7f513c0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.504+0000 7f513b7fe640 1 -- 172.21.15.137:0/3080175496 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c0cdc80 con 0x7f513c0cffd0 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.505+0000 7f513b7fe640 1 --2- 172.21.15.137:0/3080175496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c0cffd0 0x7f513c0d14a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f51300097a0 tx=0x7f513002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=943d310aa9caf022 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.505+0000 7f513affd640 1 -- 172.21.15.137:0/3080175496 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130037070 con 0x7f513c0cffd0 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.505+0000 7f513affd640 1 -- 172.21.15.137:0/3080175496 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5130032440 con 0x7f513c0cffd0 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.505+0000 7f513affd640 1 -- 172.21.15.137:0/3080175496 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51300327f0 con 0x7f513c0cffd0 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.505+0000 7f514234e640 1 -- 172.21.15.137:0/3080175496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c0cffd0 msgr2=0x7f513c0d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.505+0000 7f514234e640 1 --2- 172.21.15.137:0/3080175496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c0cffd0 0x7f513c0d14a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f51300097a0 tx=0x7f513002a230 comp rx=0 tx=0).stop 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.505+0000 7f514234e640 1 -- 172.21.15.137:0/3080175496 shutdown_connections 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.505+0000 7f514234e640 1 --2- 172.21.15.137:0/3080175496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c0cffd0 0x7f513c0d14a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.505+0000 7f514234e640 1 -- 172.21.15.137:0/3080175496 >> 172.21.15.137:0/3080175496 conn(0x7f513c08cfd0 msgr2=0x7f513c09c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:25.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.506+0000 7f514234e640 1 -- 172.21.15.137:0/3080175496 shutdown_connections 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.506+0000 7f514234e640 1 -- 172.21.15.137:0/3080175496 wait complete. 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.507+0000 7f514234e640 1 Processor -- start 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.507+0000 7f514234e640 1 -- start start 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.507+0000 7f514234e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c0c6a90 0x7f513c153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f514234e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0cffd0 0x7f513c1f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f514234e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15d130 0x7f513c0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f514234e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f513c15d510 con 0x7f513c0c6a90 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f514234e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f513c0ce240 con 0x7f513c15d130 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f514234e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f513c1f7230 con 0x7f513c0cffd0 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c0c6a90 0x7f513c153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c0c6a90 0x7f513c153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:44240/0 (socket says 172.21.15.137:44240) 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513bfff640 1 -- 172.21.15.137:0/2021749771 learned_addr learned my addr 172.21.15.137:0/2021749771 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513b7fe640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0cffd0 0x7f513c1f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f51408eb640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15d130 0x7f513c0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513bfff640 1 -- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0cffd0 msgr2=0x7f513c1f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513bfff640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0cffd0 0x7f513c1f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513bfff640 1 -- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15d130 msgr2=0x7f513c0cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513bfff640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15d130 0x7f513c0cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513bfff640 1 -- 172.21.15.137:0/2021749771 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c1f7510 con 0x7f513c0c6a90 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513b7fe640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0cffd0 0x7f513c1f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f51408eb640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15d130 0x7f513c0cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f513bfff640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c0c6a90 0x7f513c153510 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c410 tx=0x7f512c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f5138ff9640 1 -- 172.21.15.137:0/2021749771 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c017070 con 0x7f513c0c6a90 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f5138ff9640 1 -- 172.21.15.137:0/2021749771 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c005ce0 con 0x7f513c0c6a90 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513c1f77f0 con 0x7f513c0c6a90 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f5138ff9640 1 -- 172.21.15.137:0/2021749771 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c0072f0 con 0x7f513c0c6a90 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.508+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513c1f3700 con 0x7f513c0c6a90 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.509+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513c06a290 con 0x7f513c0c6a90 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.510+0000 7f5138ff9640 1 -- 172.21.15.137:0/2021749771 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f512c01a070 con 0x7f513c0c6a90 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.510+0000 7f5138ff9640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c920 0x7f512806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.510+0000 7f5138ff9640 1 -- 172.21.15.137:0/2021749771 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5738+0+0 (secure 0 0 0) 0x7f512c08afd0 con 0x7f513c0c6a90 2024-04-26T22:04:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.510+0000 7f513b7fe640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c920 0x7f512806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.511+0000 7f513b7fe640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c920 0x7f512806ede0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5130034000 tx=0x7f513002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:25.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.515+0000 7f5138ff9640 1 -- 172.21.15.137:0/2021749771 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f512c059420 con 0x7f513c0c6a90 2024-04-26T22:04:25.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.692+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f513c09f8d0 con 0x7f513c0c6a90 2024-04-26T22:04:25.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.692+0000 7f5138ff9640 1 -- 172.21.15.137:0/2021749771 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f512c058d20 con 0x7f513c0c6a90 2024-04-26T22:04:25.692 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:04:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c920 msgr2=0x7f512806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c920 0x7f512806ede0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5130034000 tx=0x7f513002e000 comp rx=0 tx=0).stop 2024-04-26T22:04:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c0c6a90 msgr2=0x7f513c153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c0c6a90 0x7f513c153510 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c410 tx=0x7f512c00c8d0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 shutdown_connections 2024-04-26T22:04:25.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c920 0x7f512806ede0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15d130 0x7f513c0cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0cffd0 0x7f513c1f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 --2- 172.21.15.137:0/2021749771 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c0c6a90 0x7f513c153510 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 >> 172.21.15.137:0/2021749771 conn(0x7f513c08cfd0 msgr2=0x7f513c0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:25.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 shutdown_connections 2024-04-26T22:04:25.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.694+0000 7f514234e640 1 -- 172.21.15.137:0/2021749771 wait complete. 2024-04-26T22:04:25.704 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:04:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.804+0000 7ffbf5293640 1 Processor -- start 2024-04-26T22:04:25.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.804+0000 7ffbf5293640 1 -- start start 2024-04-26T22:04:25.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbf5293640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffbf015d010 0x7ffbf00cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbf5293640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf00ce450 0x7ffbf00d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbf5293640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbf00b4890 con 0x7ffbf00b5930 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbf5293640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf00b4b70 con 0x7ffbf015d010 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbf5293640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf00b4e50 con 0x7ffbf00ce450 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbeeffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffbf015d010 0x7ffbf00cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbef7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf00ce450 0x7ffbf00d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbee7fc640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ffbf00b5930 0x7ffbf00cdd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:37582/0 (socket says 172.21.15.137:37582) 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbeeffd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffbf015d010 0x7ffbf00cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34042/0 (socket says 172.21.15.137:34042) 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.805+0000 7ffbee7fc640 1 -- 172.21.15.137:0/1710539831 learned_addr learned my addr 172.21.15.137:0/1710539831 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.806+0000 7ffbeeffd640 1 -- 172.21.15.137:0/1710539831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf00ce450 msgr2=0x7ffbf00d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.806+0000 7ffbeeffd640 1 --2- 172.21.15.137:0/1710539831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf00ce450 0x7ffbf00d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.806+0000 7ffbeeffd640 1 -- 172.21.15.137:0/1710539831 >> v1:172.21.15.170:6789/0 conn(0x7ffbf00b5930 legacy=0x7ffbf00cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.806+0000 7ffbeeffd640 1 -- 172.21.15.137:0/1710539831 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf00b5130 con 0x7ffbf015d010 2024-04-26T22:04:25.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.806+0000 7ffbef7fe640 1 --2- 172.21.15.137:0/1710539831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf00ce450 0x7ffbf00d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:04:25.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.806+0000 7ffbeeffd640 1 --2- 172.21.15.137:0/1710539831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbf015d010 0x7ffbf00cffb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ffbe00097a0 tx=0x7ffbe002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54fddf687ab66b7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:25.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.806+0000 7ffbedffb640 1 -- 172.21.15.137:0/1710539831 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0037070 con 0x7ffbf015d010 2024-04-26T22:04:25.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbedffb640 1 -- 172.21.15.137:0/1710539831 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe0032440 con 0x7ffbf015d010 2024-04-26T22:04:25.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbedffb640 1 -- 172.21.15.137:0/1710539831 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0032810 con 0x7ffbf015d010 2024-04-26T22:04:25.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbf5293640 1 -- 172.21.15.137:0/1710539831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbf015d010 msgr2=0x7ffbf00cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbf5293640 1 --2- 172.21.15.137:0/1710539831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbf015d010 0x7ffbf00cffb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ffbe00097a0 tx=0x7ffbe002a180 comp rx=0 tx=0).stop 2024-04-26T22:04:25.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbf5293640 1 -- 172.21.15.137:0/1710539831 shutdown_connections 2024-04-26T22:04:25.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbf5293640 1 --2- 172.21.15.137:0/1710539831 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf00ce450 0x7ffbf00d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbf5293640 1 --2- 172.21.15.137:0/1710539831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbf015d010 0x7ffbf00cffb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbf5293640 1 -- 172.21.15.137:0/1710539831 >> 172.21.15.137:0/1710539831 conn(0x7ffbf00d1660 msgr2=0x7ffbf00d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:25.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbf5293640 1 -- 172.21.15.137:0/1710539831 shutdown_connections 2024-04-26T22:04:25.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.807+0000 7ffbf5293640 1 -- 172.21.15.137:0/1710539831 wait complete. 2024-04-26T22:04:25.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.808+0000 7ffbf5293640 1 Processor -- start 2024-04-26T22:04:25.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.808+0000 7ffbf5293640 1 -- start start 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbf5293640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbf00b5930 0x7ffbf00ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbf5293640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbf00ce450 0x7ffbf015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbf5293640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf015d010 0x7ffbf00ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbf5293640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf006c2a0 con 0x7ffbf00ce450 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbf5293640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf015d3f0 con 0x7ffbf00b5930 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbf5293640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf006c420 con 0x7ffbf015d010 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbee7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbf00ce450 0x7ffbf015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbee7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbf00ce450 0x7ffbf015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57906/0 (socket says 172.21.15.137:57906) 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbee7fc640 1 -- 172.21.15.137:0/1232955115 learned_addr learned my addr 172.21.15.137:0/1232955115 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:25.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbeeffd640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbf00b5930 0x7ffbf00ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.809+0000 7ffbef7fe640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf015d010 0x7ffbf00ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbee7fc640 1 -- 172.21.15.137:0/1232955115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf015d010 msgr2=0x7ffbf00ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbee7fc640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf015d010 0x7ffbf00ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbee7fc640 1 -- 172.21.15.137:0/1232955115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbf00b5930 msgr2=0x7ffbf00ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbee7fc640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbf00b5930 0x7ffbf00ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbee7fc640 1 -- 172.21.15.137:0/1232955115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf00abdb0 con 0x7ffbf00ce450 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbee7fc640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbf00ce450 0x7ffbf015b6e0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c430 tx=0x7ffbe400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbd77fe640 1 -- 172.21.15.137:0/1232955115 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4017070 con 0x7ffbf00ce450 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbd77fe640 1 -- 172.21.15.137:0/1232955115 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe4005ce0 con 0x7ffbf00ce450 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbd77fe640 1 -- 172.21.15.137:0/1232955115 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe40072f0 con 0x7ffbf00ce450 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf00ad790 con 0x7ffbf00ce450 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.810+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf00add50 con 0x7ffbf00ce450 2024-04-26T22:04:25.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.811+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf006a290 con 0x7ffbf00ce450 2024-04-26T22:04:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.812+0000 7ffbd77fe640 1 -- 172.21.15.137:0/1232955115 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffbe401a070 con 0x7ffbf00ce450 2024-04-26T22:04:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.812+0000 7ffbd77fe640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffbdc06c8f0 0x7ffbdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.812+0000 7ffbd77fe640 1 -- 172.21.15.137:0/1232955115 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5738+0+0 (secure 0 0 0) 0x7ffbe408ae20 con 0x7ffbf00ce450 2024-04-26T22:04:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.812+0000 7ffbeeffd640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffbdc06c8f0 0x7ffbdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:25.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.812+0000 7ffbeeffd640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffbdc06c8f0 0x7ffbdc06edb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0034000 tx=0x7ffbe002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:25.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.816+0000 7ffbd77fe640 1 -- 172.21.15.137:0/1232955115 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ffbe4058be0 con 0x7ffbf00ce450 2024-04-26T22:04:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.991+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffbf00682b0 con 0x7ffbf00ce450 2024-04-26T22:04:25.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.991+0000 7ffbd77fe640 1 -- 172.21.15.137:0/1232955115 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7ffbe405cee0 con 0x7ffbf00ce450 2024-04-26T22:04:25.991 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:04:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffbdc06c8f0 msgr2=0x7ffbdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffbdc06c8f0 0x7ffbdc06edb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0034000 tx=0x7ffbe002e000 comp rx=0 tx=0).stop 2024-04-26T22:04:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbf00ce450 msgr2=0x7ffbf015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:25.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbf00ce450 0x7ffbf015b6e0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c430 tx=0x7ffbe400c830 comp rx=0 tx=0).stop 2024-04-26T22:04:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 shutdown_connections 2024-04-26T22:04:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ffbdc06c8f0 0x7ffbdc06edb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ffbf00ce450 0x7ffbf015b6e0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ffbf015d010 0x7ffbf00ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 --2- 172.21.15.137:0/1232955115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbf00b5930 0x7ffbf00ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 >> 172.21.15.137:0/1232955115 conn(0x7ffbf00d1660 msgr2=0x7ffbf00b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 shutdown_connections 2024-04-26T22:04:25.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:25.993+0000 7ffbf5293640 1 -- 172.21.15.137:0/1232955115 wait complete. 2024-04-26T22:04:26.004 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:04:26.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.102+0000 7f09c4a62640 1 Processor -- start 2024-04-26T22:04:26.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.102+0000 7f09c4a62640 1 -- start start 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.103+0000 7f09c4a62640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09c00cf2e0 0x7f09c006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.103+0000 7f09c4a62640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 0x7f09c006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.103+0000 7f09c4a62640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f09c006e2c0 0x7f09c015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.103+0000 7f09c4a62640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f09c006e750 con 0x7f09c00cf2e0 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.103+0000 7f09c4a62640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f09c00d1740 con 0x7f09c006e2c0 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.103+0000 7f09c4a62640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f09c00d1a20 con 0x7f09c00d11b0 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.103+0000 7f09be59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09c00cf2e0 0x7f09c006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.103+0000 7f09be59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f09c00cf2e0 0x7f09c006d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57912/0 (socket says 172.21.15.137:57912) 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.103+0000 7f09be59c640 1 -- 172.21.15.137:0/1606615562 learned_addr learned my addr 172.21.15.137:0/1606615562 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.104+0000 7f09bdd9b640 1 --2- 172.21.15.137:0/1606615562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 0x7f09c006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.104+0000 7f09bed9d640 1 --2- 172.21.15.137:0/1606615562 >> v2:172.21.15.170:3300/0 conn(0x7f09c006e2c0 0x7f09c015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.104+0000 7f09be59c640 1 -- 172.21.15.137:0/1606615562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 msgr2=0x7f09c006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:26.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.104+0000 7f09be59c640 1 --2- 172.21.15.137:0/1606615562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 0x7f09c006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.104+0000 7f09be59c640 1 -- 172.21.15.137:0/1606615562 >> v2:172.21.15.170:3300/0 conn(0x7f09c006e2c0 msgr2=0x7f09c015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:26.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.104+0000 7f09be59c640 1 --2- 172.21.15.137:0/1606615562 >> v2:172.21.15.170:3300/0 conn(0x7f09c006e2c0 0x7f09c015ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.104+0000 7f09be59c640 1 -- 172.21.15.137:0/1606615562 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c00d1d00 con 0x7f09c00cf2e0 2024-04-26T22:04:26.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.104+0000 7f09be59c640 1 --2- 172.21.15.137:0/1606615562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c00cf2e0 0x7f09c006d4d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f09c0163ff0 tx=0x7f09b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78d1428a01c4cdb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:26.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.104+0000 7f09bd59a640 1 -- 172.21.15.137:0/1606615562 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0036070 con 0x7f09c00cf2e0 2024-04-26T22:04:26.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09bd59a640 1 -- 172.21.15.137:0/1606615562 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b0031600 con 0x7f09c00cf2e0 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09bd59a640 1 -- 172.21.15.137:0/1606615562 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b00319d0 con 0x7f09c00cf2e0 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09c4a62640 1 -- 172.21.15.137:0/1606615562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c00cf2e0 msgr2=0x7f09c006d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09c4a62640 1 --2- 172.21.15.137:0/1606615562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c00cf2e0 0x7f09c006d4d0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f09c0163ff0 tx=0x7f09b002a6a0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09c4a62640 1 -- 172.21.15.137:0/1606615562 shutdown_connections 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09c4a62640 1 --2- 172.21.15.137:0/1606615562 >> v2:172.21.15.170:3300/0 conn(0x7f09c006e2c0 0x7f09c015ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09c4a62640 1 --2- 172.21.15.137:0/1606615562 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 0x7f09c006dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09c4a62640 1 --2- 172.21.15.137:0/1606615562 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c00cf2e0 0x7f09c006d4d0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09c4a62640 1 -- 172.21.15.137:0/1606615562 >> 172.21.15.137:0/1606615562 conn(0x7f09c00b4a60 msgr2=0x7f09c00b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09c4a62640 1 -- 172.21.15.137:0/1606615562 shutdown_connections 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.105+0000 7f09c4a62640 1 -- 172.21.15.137:0/1606615562 wait complete. 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.106+0000 7f09c4a62640 1 Processor -- start 2024-04-26T22:04:26.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09c4a62640 1 -- start start 2024-04-26T22:04:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09c4a62640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c006e2c0 0x7f09c015dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09c4a62640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09c00cf2e0 0x7f09c00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09c4a62640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 0x7f09c01f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09c4a62640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f09c006da10 con 0x7f09c006e2c0 2024-04-26T22:04:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09c4a62640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f09c00d22c0 con 0x7f09c00cf2e0 2024-04-26T22:04:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09c4a62640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f09c00cf6c0 con 0x7f09c00d11b0 2024-04-26T22:04:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09be59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c006e2c0 0x7f09c015dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09be59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c006e2c0 0x7f09c015dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57916/0 (socket says 172.21.15.137:57916) 2024-04-26T22:04:26.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09be59c640 1 -- 172.21.15.137:0/2343760128 learned_addr learned my addr 172.21.15.137:0/2343760128 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09bdd9b640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09c00cf2e0 0x7f09c00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.107+0000 7f09bed9d640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 0x7f09c01f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09be59c640 1 -- 172.21.15.137:0/2343760128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 msgr2=0x7f09c01f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09be59c640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 0x7f09c01f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09be59c640 1 -- 172.21.15.137:0/2343760128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09c00cf2e0 msgr2=0x7f09c00c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09be59c640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09c00cf2e0 0x7f09c00c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09be59c640 1 -- 172.21.15.137:0/2343760128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c00c9610 con 0x7f09c006e2c0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09be59c640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c006e2c0 0x7f09c015dc80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f09b0034040 tx=0x7f09b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09aeffd640 1 -- 172.21.15.137:0/2343760128 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0041020 con 0x7f09c006e2c0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09aeffd640 1 -- 172.21.15.137:0/2343760128 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b0007820 con 0x7f09c006e2c0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c00c98f0 con 0x7f09c006e2c0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09aeffd640 1 -- 172.21.15.137:0/2343760128 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b0036040 con 0x7f09c006e2c0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.108+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c00b6980 con 0x7f09c006e2c0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.109+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c00c9e10 con 0x7f09c006e2c0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.109+0000 7f09aeffd640 1 -- 172.21.15.137:0/2343760128 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09b0044020 con 0x7f09c006e2c0 2024-04-26T22:04:26.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.110+0000 7f09aeffd640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f09a006c8f0 0x7f09a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.110+0000 7f09aeffd640 1 -- 172.21.15.137:0/2343760128 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5738+0+0 (secure 0 0 0) 0x7f09b00ac970 con 0x7f09c006e2c0 2024-04-26T22:04:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.110+0000 7f09bdd9b640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f09a006c8f0 0x7f09a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.110+0000 7f09bdd9b640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f09a006c8f0 0x7f09a006edb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f09b4006fd0 tx=0x7f09b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:26.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.114+0000 7f09aeffd640 1 -- 172.21.15.137:0/2343760128 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f09c00c9e10 con 0x7f09c006e2c0 2024-04-26T22:04:26.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.304+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f09c006a290 con 0x7f09c006e2c0 2024-04-26T22:04:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.305+0000 7f09aeffd640 1 -- 172.21.15.137:0/2343760128 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) ==== 80+0+0 (secure 0 0 0) 0x7f09b004b030 con 0x7f09c006e2c0 2024-04-26T22:04:26.305 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T22:04:26.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f09a006c8f0 msgr2=0x7f09a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f09a006c8f0 0x7f09a006edb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f09b4006fd0 tx=0x7f09b4008040 comp rx=0 tx=0).stop 2024-04-26T22:04:26.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c006e2c0 msgr2=0x7f09c015dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c006e2c0 0x7f09c015dc80 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f09b0034040 tx=0x7f09b0004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:26.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 shutdown_connections 2024-04-26T22:04:26.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f09a006c8f0 0x7f09a006edb0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f09c00d11b0 0x7f09c01f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09c00cf2e0 0x7f09c00c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 --2- 172.21.15.137:0/2343760128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f09c006e2c0 0x7f09c015dc80 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 >> 172.21.15.137:0/2343760128 conn(0x7f09c00b4a60 msgr2=0x7f09c00703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:26.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 shutdown_connections 2024-04-26T22:04:26.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.307+0000 7f09c4a62640 1 -- 172.21.15.137:0/2343760128 wait complete. 2024-04-26T22:04:26.317 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:04:26.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:26.318 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:04:26.367 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:04:26.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:26.367 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:04:26.389 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:26.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.526+0000 7fd2c0546640 1 Processor -- start 2024-04-26T22:04:26.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.526+0000 7fd2c0546640 1 -- start start 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.527+0000 7fd2c0546640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2b80b61a0 0x7fd2b8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.527+0000 7fd2c0546640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd2b80b3de0 0x7fd2b80720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.527+0000 7fd2c0546640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b80b4270 con 0x7fd2b8145980 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.527+0000 7fd2c0546640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b80b5140 con 0x7fd2b80b61a0 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.527+0000 7fd2c0546640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b80b4530 con 0x7fd2b80b3de0 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.528+0000 7fd2bdae1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2b80b61a0 0x7fd2b8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.528+0000 7fd2bdae1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd2b80b61a0 0x7fd2b8160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57930/0 (socket says 172.21.15.137:57930) 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.528+0000 7fd2bdae1640 1 -- 172.21.15.137:0/2192938107 learned_addr learned my addr 172.21.15.137:0/2192938107 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.528+0000 7fd2beae3640 1 --2- 172.21.15.137:0/2192938107 >> v2:172.21.15.170:3300/0 conn(0x7fd2b80b3de0 0x7fd2b80720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.528+0000 7fd2bdae1640 1 -- 172.21.15.137:0/2192938107 >> v2:172.21.15.170:3300/0 conn(0x7fd2b80b3de0 msgr2=0x7fd2b80720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:26.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.528+0000 7fd2bdae1640 1 --2- 172.21.15.137:0/2192938107 >> v2:172.21.15.170:3300/0 conn(0x7fd2b80b3de0 0x7fd2b80720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.528+0000 7fd2bdae1640 1 -- 172.21.15.137:0/2192938107 >> v1:172.21.15.170:6789/0 conn(0x7fd2b8145980 legacy=0x7fd2b80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:26.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.528+0000 7fd2bdae1640 1 -- 172.21.15.137:0/2192938107 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b80b4810 con 0x7fd2b80b61a0 2024-04-26T22:04:26.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.528+0000 7fd2bdae1640 1 --2- 172.21.15.137:0/2192938107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 0x7fd2b8160630 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80b52c0 tx=0x7fd2ac02c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5b6d688f6abc25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:26.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2bd2e0640 1 -- 172.21.15.137:0/2192938107 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac032710 con 0x7fd2b80b61a0 2024-04-26T22:04:26.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2bd2e0640 1 -- 172.21.15.137:0/2192938107 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0328b0 con 0x7fd2b80b61a0 2024-04-26T22:04:26.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2bd2e0640 1 -- 172.21.15.137:0/2192938107 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac032ca0 con 0x7fd2b80b61a0 2024-04-26T22:04:26.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2c0546640 1 -- 172.21.15.137:0/2192938107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 msgr2=0x7fd2b8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2c0546640 1 --2- 172.21.15.137:0/2192938107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 0x7fd2b8160630 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80b52c0 tx=0x7fd2ac02c850 comp rx=0 tx=0).stop 2024-04-26T22:04:26.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2c0546640 1 -- 172.21.15.137:0/2192938107 shutdown_connections 2024-04-26T22:04:26.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2c0546640 1 --2- 172.21.15.137:0/2192938107 >> v2:172.21.15.170:3300/0 conn(0x7fd2b80b3de0 0x7fd2b80720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2c0546640 1 --2- 172.21.15.137:0/2192938107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 0x7fd2b8160630 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2c0546640 1 -- 172.21.15.137:0/2192938107 >> 172.21.15.137:0/2192938107 conn(0x7fd2b80d0d30 msgr2=0x7fd2b80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:26.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2c0546640 1 -- 172.21.15.137:0/2192938107 shutdown_connections 2024-04-26T22:04:26.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.529+0000 7fd2c0546640 1 -- 172.21.15.137:0/2192938107 wait complete. 2024-04-26T22:04:26.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.530+0000 7fd2c0546640 1 Processor -- start 2024-04-26T22:04:26.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.530+0000 7fd2c0546640 1 -- start start 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2c0546640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b80b3de0 0x7fd2b815b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2c0546640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 0x7fd2b813fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2c0546640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2b8145980 0x7fd2b8143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2c0546640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8072610 con 0x7fd2b80b61a0 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2c0546640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b80b4dd0 con 0x7fd2b80b3de0 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2c0546640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b8072790 con 0x7fd2b8145980 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2bdae1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 0x7fd2b813fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2bdae1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 0x7fd2b813fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57942/0 (socket says 172.21.15.137:57942) 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2bdae1640 1 -- 172.21.15.137:0/4049420862 learned_addr learned my addr 172.21.15.137:0/4049420862 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:26.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2be2e2640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b80b3de0 0x7fd2b815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2beae3640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2b8145980 0x7fd2b8143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2bdae1640 1 -- 172.21.15.137:0/4049420862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2b8145980 msgr2=0x7fd2b8143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2bdae1640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2b8145980 0x7fd2b8143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2bdae1640 1 -- 172.21.15.137:0/4049420862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b80b3de0 msgr2=0x7fd2b815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.531+0000 7fd2bdae1640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b80b3de0 0x7fd2b815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.532+0000 7fd2bdae1640 1 -- 172.21.15.137:0/4049420862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b8140960 con 0x7fd2b80b61a0 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.532+0000 7fd2beae3640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2b8145980 0x7fd2b8143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.532+0000 7fd2bdae1640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 0x7fd2b813fd80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00b2c0 tx=0x7fd2ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.532+0000 7fd2aaffd640 1 -- 172.21.15.137:0/4049420862 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac044070 con 0x7fd2b80b61a0 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.532+0000 7fd2aaffd640 1 -- 172.21.15.137:0/4049420862 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac003830 con 0x7fd2b80b61a0 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.532+0000 7fd2aaffd640 1 -- 172.21.15.137:0/4049420862 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac003c20 con 0x7fd2b80b61a0 2024-04-26T22:04:26.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.532+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b8140c40 con 0x7fd2b80b61a0 2024-04-26T22:04:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.532+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b8141200 con 0x7fd2b80b61a0 2024-04-26T22:04:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.533+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b806a290 con 0x7fd2b80b61a0 2024-04-26T22:04:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.533+0000 7fd2aaffd640 1 -- 172.21.15.137:0/4049420862 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd2ac047070 con 0x7fd2b80b61a0 2024-04-26T22:04:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.534+0000 7fd2aaffd640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd29c06c920 0x7fd29c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.534+0000 7fd2aaffd640 1 -- 172.21.15.137:0/4049420862 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5738+0+0 (secure 0 0 0) 0x7fd2ac0aee20 con 0x7fd2b80b61a0 2024-04-26T22:04:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.534+0000 7fd2be2e2640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd29c06c920 0x7fd29c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.534+0000 7fd2be2e2640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd29c06c920 0x7fd29c06ede0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4006fd0 tx=0x7fd2b4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:26.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.538+0000 7fd2aaffd640 1 -- 172.21.15.137:0/4049420862 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd2ac07cd00 con 0x7fd2b80b61a0 2024-04-26T22:04:26.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.749+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2b8073cc0 con 0x7fd2b80b61a0 2024-04-26T22:04:26.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.749+0000 7fd2aaffd640 1 -- 172.21.15.137:0/4049420862 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5192 (secure 0 0 0) 0x7fd2ac081000 con 0x7fd2b80b61a0 2024-04-26T22:04:26.750 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:26.750 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":7317,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/2128712520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2128712520},{"type":"v1","addr":"172.21.15.137:6837","nonce":2128712520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:04:15.394897+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7335},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7335":{"gid":7335,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/865192507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":865192507},{"type":"v1","addr":"172.21.15.170:6835","nonce":865192507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7335,"qdb_cluster":[7335]},"id":6}]} 2024-04-26T22:04:26.750 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 47 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.751+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd29c06c920 msgr2=0x7fd29c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.751+0000 7fd2c0546640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd29c06c920 0x7fd29c06ede0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4006fd0 tx=0x7fd2b4009060 comp rx=0 tx=0).stop 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.751+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 msgr2=0x7fd2b813fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.751+0000 7fd2c0546640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 0x7fd2b813fd80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00b2c0 tx=0x7fd2ac0046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.752+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 shutdown_connections 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.752+0000 7fd2c0546640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd29c06c920 0x7fd29c06ede0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.752+0000 7fd2c0546640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd2b80b61a0 0x7fd2b813fd80 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.752+0000 7fd2c0546640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd2b8145980 0x7fd2b8143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.752+0000 7fd2c0546640 1 --2- 172.21.15.137:0/4049420862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b80b3de0 0x7fd2b815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.752+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 >> 172.21.15.137:0/4049420862 conn(0x7fd2b80d0d30 msgr2=0x7fd2b81430f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.752+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 shutdown_connections 2024-04-26T22:04:26.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.752+0000 7fd2c0546640 1 -- 172.21.15.137:0/4049420862 wait complete. 2024-04-26T22:04:26.763 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-26T22:04:26.899 INFO:teuthology.orchestra.run.smithi170.stdout:{"message":"","return_code":0} 2024-04-26T22:04:26.899 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T22:04:26.899 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:04:26.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.997+0000 7f17ab6d9640 1 Processor -- start 2024-04-26T22:04:26.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.997+0000 7f17ab6d9640 1 -- start start 2024-04-26T22:04:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.998+0000 7f17ab6d9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17a415f370 0x7f17a40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.998+0000 7f17ab6d9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a415f750 0x7f17a40b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.998+0000 7f17ab6d9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a40d03a0 con 0x7f17a40d37d0 2024-04-26T22:04:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.998+0000 7f17ab6d9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f17a40b4d10 con 0x7f17a415f370 2024-04-26T22:04:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.998+0000 7f17ab6d9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f17a40d0680 con 0x7f17a415f750 2024-04-26T22:04:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a9475640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17a415f370 0x7f17a40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a8c74640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a415f750 0x7f17a40b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a9475640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17a415f370 0x7f17a40cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34096/0 (socket says 172.21.15.137:34096) 2024-04-26T22:04:26.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a8c74640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a415f750 0x7f17a40b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:54684/0 (socket says 172.21.15.137:54684) 2024-04-26T22:04:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a9475640 1 -- 172.21.15.137:0/3639359752 learned_addr learned my addr 172.21.15.137:0/3639359752 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a9c76640 1 --1- 172.21.15.137:0/3639359752 >> v1:172.21.15.170:6789/0 conn(0x7f17a40d37d0 0x7f17a40d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:37600/0 (socket says 172.21.15.137:37600) 2024-04-26T22:04:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a8c74640 1 -- 172.21.15.137:0/3639359752 >> v2:172.21.15.170:3300/0 conn(0x7f17a415f370 msgr2=0x7f17a40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a8c74640 1 --2- 172.21.15.137:0/3639359752 >> v2:172.21.15.170:3300/0 conn(0x7f17a415f370 0x7f17a40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a8c74640 1 -- 172.21.15.137:0/3639359752 >> v1:172.21.15.170:6789/0 conn(0x7f17a40d37d0 legacy=0x7f17a40d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a8c74640 1 -- 172.21.15.137:0/3639359752 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a40d0960 con 0x7f17a415f750 2024-04-26T22:04:27.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:26.999+0000 7f17a9475640 1 --2- 172.21.15.137:0/3639359752 >> v2:172.21.15.170:3300/0 conn(0x7f17a415f370 0x7f17a40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f17a8c74640 1 --2- 172.21.15.137:0/3639359752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a415f750 0x7f17a40b47d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17940097a0 tx=0x7f179402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=481406a79532f373 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f179bfff640 1 -- 172.21.15.137:0/3639359752 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794037070 con 0x7f17a415f750 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f179bfff640 1 -- 172.21.15.137:0/3639359752 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179402ae50 con 0x7f17a415f750 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f179bfff640 1 -- 172.21.15.137:0/3639359752 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794032660 con 0x7f17a415f750 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f17ab6d9640 1 -- 172.21.15.137:0/3639359752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a415f750 msgr2=0x7f17a40b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f17ab6d9640 1 --2- 172.21.15.137:0/3639359752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a415f750 0x7f17a40b47d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17940097a0 tx=0x7f179402a100 comp rx=0 tx=0).stop 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f17ab6d9640 1 -- 172.21.15.137:0/3639359752 shutdown_connections 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f17ab6d9640 1 --2- 172.21.15.137:0/3639359752 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a415f750 0x7f17a40b47d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f17ab6d9640 1 --2- 172.21.15.137:0/3639359752 >> v2:172.21.15.170:3300/0 conn(0x7f17a415f370 0x7f17a40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.000+0000 7f17ab6d9640 1 -- 172.21.15.137:0/3639359752 >> 172.21.15.137:0/3639359752 conn(0x7f17a408ec10 msgr2=0x7f17a409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:27.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.001+0000 7f17ab6d9640 1 -- 172.21.15.137:0/3639359752 shutdown_connections 2024-04-26T22:04:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.001+0000 7f17ab6d9640 1 -- 172.21.15.137:0/3639359752 wait complete. 2024-04-26T22:04:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17ab6d9640 1 Processor -- start 2024-04-26T22:04:27.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17ab6d9640 1 -- start start 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17ab6d9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a40d37d0 0x7f17a40b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17ab6d9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17a415f370 0x7f17a406d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17ab6d9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17a415f750 0x7f17a40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17ab6d9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f17a40b51c0 con 0x7f17a415f370 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17ab6d9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f17a40d0f20 con 0x7f17a415f750 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17ab6d9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f17a40b5340 con 0x7f17a40d37d0 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17a8c74640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17a415f370 0x7f17a406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17a8c74640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17a415f370 0x7f17a406d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57956/0 (socket says 172.21.15.137:57956) 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.002+0000 7f17a8c74640 1 -- 172.21.15.137:0/1989283598 learned_addr learned my addr 172.21.15.137:0/1989283598 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a9475640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a40d37d0 0x7f17a40b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a9c76640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17a415f750 0x7f17a40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a8c74640 1 -- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a40d37d0 msgr2=0x7f17a40b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a8c74640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a40d37d0 0x7f17a40b7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a8c74640 1 -- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17a415f750 msgr2=0x7f17a40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a8c74640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17a415f750 0x7f17a40cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a8c74640 1 -- 172.21.15.137:0/1989283598 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a40b84f0 con 0x7f17a415f370 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a9475640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a40d37d0 0x7f17a40b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a9c76640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17a415f750 0x7f17a40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17a8c74640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17a415f370 0x7f17a406d980 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1794000c00 tx=0x7f17940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f1799ffb640 1 -- 172.21.15.137:0/1989283598 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794041070 con 0x7f17a415f370 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f1799ffb640 1 -- 172.21.15.137:0/1989283598 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179403c460 con 0x7f17a415f370 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a40b87d0 con 0x7f17a415f370 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f1799ffb640 1 -- 172.21.15.137:0/1989283598 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794037040 con 0x7f17a415f370 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.003+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a40b8d90 con 0x7f17a415f370 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.004+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a406a290 con 0x7f17a415f370 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.005+0000 7f1799ffb640 1 -- 172.21.15.137:0/1989283598 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1794044070 con 0x7f17a415f370 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.005+0000 7f1799ffb640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f178806c8f0 0x7f178806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.005+0000 7f1799ffb640 1 -- 172.21.15.137:0/1989283598 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5738+0+0 (secure 0 0 0) 0x7f17940ac1e0 con 0x7f17a415f370 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.005+0000 7f17a9475640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f178806c8f0 0x7f178806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.006+0000 7f17a9475640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f178806c8f0 0x7f178806edb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f17a415dd00 tx=0x7f17a000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.010+0000 7f1799ffb640 1 -- 172.21.15.137:0/1989283598 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f179407a5f0 con 0x7f17a415f370 2024-04-26T22:04:27.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.222+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f17a415e1f0 con 0x7f17a415f370 2024-04-26T22:04:27.223 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:04:27.223+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:04:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.224+0000 7f1799ffb640 1 -- 172.21.15.137:0/1989283598 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) ==== 161+0+0 (secure 0 0 0) 0x7f1794079ef0 con 0x7f17a415f370 2024-04-26T22:04:27.224 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:04:27.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f178806c8f0 msgr2=0x7f178806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f178806c8f0 0x7f178806edb0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f17a415dd00 tx=0x7f17a000b040 comp rx=0 tx=0).stop 2024-04-26T22:04:27.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17a415f370 msgr2=0x7f17a406d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17a415f370 0x7f17a406d980 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1794000c00 tx=0x7f17940046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 shutdown_connections 2024-04-26T22:04:27.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f178806c8f0 0x7f178806edb0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f17a415f370 0x7f17a406d980 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17a415f750 0x7f17a40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 --2- 172.21.15.137:0/1989283598 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f17a40d37d0 0x7f17a40b7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 >> 172.21.15.137:0/1989283598 conn(0x7f17a408ec10 msgr2=0x7f17a4075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:27.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 shutdown_connections 2024-04-26T22:04:27.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.227+0000 7f17ab6d9640 1 -- 172.21.15.137:0/1989283598 wait complete. 2024-04-26T22:04:27.230 INFO:tasks.ceph.mds.b.smithi170.stderr: -5030> 2024-04-26T22:04:19.307+0000 7ff6bb8c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:04:27.238 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-04-26T22:04:27.258 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T22:04:27.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.278+0000 7febcdf8af40 1 Processor -- start 2024-04-26T22:04:27.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.278+0000 7febcdf8af40 1 -- start start 2024-04-26T22:04:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcdf8af40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 0x564c92d55e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcdf8af40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 0x564c92d3c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcdf8af40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92d3cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcdf8af40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564c92cc4a80 con 0x564c92d54cf0 2024-04-26T22:04:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcdf8af40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564c92c24e40 con 0x564c92d54910 2024-04-26T22:04:27.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcdf8af40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564c92cc40b0 con 0x564c92cc6b50 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcc285640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92d3cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcc285640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92d3cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57986/0 (socket says 172.21.15.137:57986) 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcc285640 1 -- 172.21.15.137:0/1778651251 learned_addr learned my addr 172.21.15.137:0/1778651251 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcba84640 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 0x564c92d55e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcb283640 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 0x564c92d3c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcc285640 1 -- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 msgr2=0x564c92d55e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcc285640 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 0x564c92d55e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcc285640 1 -- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 msgr2=0x564c92d3c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcc285640 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 0x564c92d3c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcc285640 1 -- 172.21.15.137:0/1778651251 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c92d58020 con 0x564c92d54cf0 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcba84640 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 0x564c92d55e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcb283640 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 0x564c92d3c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febcc285640 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92d3cb10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7febc400c480 tx=0x7febc400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66893c7c5da0a143 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febca281640 1 -- 172.21.15.137:0/1778651251 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc40116b0 con 0x564c92d54cf0 2024-04-26T22:04:27.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febca281640 1 -- 172.21.15.137:0/1778651251 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc4017070 con 0x564c92d54cf0 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.279+0000 7febca281640 1 -- 172.21.15.137:0/1778651251 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4011a90 con 0x564c92d54cf0 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 -- 172.21.15.137:0/1778651251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 msgr2=0x564c92d3cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92d3cb10 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7febc400c480 tx=0x7febc400c940 comp rx=0 tx=0).stop 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 -- 172.21.15.137:0/1778651251 shutdown_connections 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92d3cb10 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 0x564c92d3c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 --2- 172.21.15.137:0/1778651251 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 0x564c92d55e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 -- 172.21.15.137:0/1778651251 >> 172.21.15.137:0/1778651251 conn(0x564c92c7c210 msgr2=0x564c92caa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 -- 172.21.15.137:0/1778651251 shutdown_connections 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 -- 172.21.15.137:0/1778651251 wait complete. 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 Processor -- start 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.280+0000 7febcdf8af40 1 -- start start 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcdf8af40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 0x564c92d575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcdf8af40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 0x564c92deeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcdf8af40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92def020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcdf8af40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564c92d3d050 con 0x564c92d54cf0 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcdf8af40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564c92d3f010 con 0x564c92d54910 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcdf8af40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564c92d3e6e0 con 0x564c92cc6b50 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcc285640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92def020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcba84640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 0x564c92d575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcb283640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 0x564c92deeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcc285640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92def020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57992/0 (socket says 172.21.15.137:57992) 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcb283640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 0x564c92deeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34130/0 (socket says 172.21.15.137:34130) 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcba84640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 0x564c92d575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:54718/0 (socket says 172.21.15.137:54718) 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcc285640 1 -- 172.21.15.137:0/2160324336 learned_addr learned my addr 172.21.15.137:0/2160324336 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcc285640 1 -- 172.21.15.137:0/2160324336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 msgr2=0x564c92d575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcc285640 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564c92cc6b50 0x564c92d575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcc285640 1 -- 172.21.15.137:0/2160324336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 msgr2=0x564c92deeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.281+0000 7febcc285640 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564c92d54910 0x564c92deeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.282+0000 7febcc285640 1 -- 172.21.15.137:0/2160324336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c92d3c5f0 con 0x564c92d54cf0 2024-04-26T22:04:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.282+0000 7febcc285640 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92def020 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7febc400c210 tx=0x7febc40033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.282+0000 7febc927f640 1 -- 172.21.15.137:0/2160324336 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc40129c0 con 0x564c92d54cf0 2024-04-26T22:04:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.282+0000 7febc927f640 1 -- 172.21.15.137:0/2160324336 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc4012b80 con 0x564c92d54cf0 2024-04-26T22:04:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.282+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c92d3c8d0 con 0x564c92d54cf0 2024-04-26T22:04:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.282+0000 7febc927f640 1 -- 172.21.15.137:0/2160324336 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc4024400 con 0x564c92d54cf0 2024-04-26T22:04:27.286 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.282+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c92d3a9a0 con 0x564c92d54cf0 2024-04-26T22:04:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.283+0000 7febc927f640 1 -- 172.21.15.137:0/2160324336 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7febc401c400 con 0x564c92d54cf0 2024-04-26T22:04:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.283+0000 7febc927f640 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7febb806b2d0 0x7febb806d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.284+0000 7febc927f640 1 -- 172.21.15.137:0/2160324336 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7febc408c6a0 con 0x564c92d54cf0 2024-04-26T22:04:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.284+0000 7febcba84640 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7febb806b2d0 0x7febb806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.284+0000 7febcdf8af40 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564c92d57b30 0x564c92d3b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.284+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e90) -- 0x564c92d3a3c0 con 0x564c92d57b30 2024-04-26T22:04:27.287 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.284+0000 7febcb283640 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564c92d57b30 0x564c92d3b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.284+0000 7febcba84640 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7febb806b2d0 0x7febb806d790 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7febbc056000 tx=0x7febbc050000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.284+0000 7febcb283640 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564c92d57b30 0x564c92d3b0e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcb283640 1 -- 172.21.15.137:0/2160324336 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v90'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7febc00106e0 con 0x564c92d57b30 2024-04-26T22:04:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564c92d57b30 msgr2=0x564c92d3b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcdf8af40 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564c92d57b30 0x564c92d3b0e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7febb806b2d0 msgr2=0x7febb806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcdf8af40 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7febb806b2d0 0x7febb806d790 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7febbc056000 tx=0x7febbc050000 comp rx=0 tx=0).stop 2024-04-26T22:04:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 msgr2=0x564c92def020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcdf8af40 1 --2- 172.21.15.137:0/2160324336 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564c92d54cf0 0x564c92def020 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7febc400c210 tx=0x7febc40033a0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcc285640 1 -- 172.21.15.137:0/2160324336 reap_dead start 2024-04-26T22:04:27.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 shutdown_connections 2024-04-26T22:04:27.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.288+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 >> 172.21.15.137:0/2160324336 conn(0x564c92c7c210 msgr2=0x564c92caa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:27.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.289+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 shutdown_connections 2024-04-26T22:04:27.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.289+0000 7febcdf8af40 1 -- 172.21.15.137:0/2160324336 wait complete. 2024-04-26T22:04:27.291 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-26T22:04:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.371+0000 7f972e159280 1 -- start start 2024-04-26T22:04:27.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.371+0000 7f972e159280 1 Processor -- start 2024-04-26T22:04:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972e159280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc5c4800 0x55f3dc5bb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972e159280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc5c5c00 0x55f3dc5ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972e159280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc5c5400 0x55f3dc5ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972e159280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc5be000 con 0x55f3dc5c5c00 2024-04-26T22:04:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972e159280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc5be180 con 0x55f3dc5c4800 2024-04-26T22:04:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972e159280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f3dc5be300 con 0x55f3dc5c5400 2024-04-26T22:04:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c104640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc5c5c00 0x55f3dc5ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c104640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc5c5c00 0x55f3dc5ba580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58000/0 (socket says 172.21.15.137:58000) 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c104640 1 -- 172.21.15.137:0/3787738255 learned_addr learned my addr 172.21.15.137:0/3787738255 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972d106640 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc5c5400 0x55f3dc5ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c905640 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc5c4800 0x55f3dc5bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c104640 1 -- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc5c5400 msgr2=0x55f3dc5ba000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c104640 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc5c5400 0x55f3dc5ba000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c104640 1 -- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc5c4800 msgr2=0x55f3dc5bb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c104640 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc5c4800 0x55f3dc5bb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c104640 1 -- 172.21.15.137:0/3787738255 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3db81a780 con 0x55f3dc5c5c00 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c905640 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc5c4800 0x55f3dc5bb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972d106640 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc5c5400 0x55f3dc5ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972c104640 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc5c5c00 0x55f3dc5ba580 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55f3dc61f7d0 tx=0x55f3dc5840c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7893e8a50acf729f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972a100640 1 -- 172.21.15.137:0/3787738255 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f3db80a9c0 con 0x55f3dc5c5c00 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972a100640 1 -- 172.21.15.137:0/3787738255 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f3db810a80 con 0x55f3dc5c5c00 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972a100640 1 -- 172.21.15.137:0/3787738255 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f3db80ab60 con 0x55f3dc5c5c00 2024-04-26T22:04:27.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.372+0000 7f972e159280 1 -- 172.21.15.137:0/3787738255 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3db81a000 con 0x55f3dc5c5c00 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.373+0000 7f972e159280 1 -- 172.21.15.137:0/3787738255 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55f3db81ba40 con 0x55f3dc5c5c00 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.373+0000 7f972e159280 4 waiting for MDS map... 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.373+0000 7f972a100640 1 -- 172.21.15.137:0/3787738255 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x55f3dc606800 con 0x55f3dc5c5c00 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.373+0000 7f972a100640 1 -- 172.21.15.137:0/3787738255 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 48) ==== 2885+0+0 (secure 0 0 0) 0x55f3db83f180 con 0x55f3dc5c5c00 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.373+0000 7f972e159280 4 Got MDS map 48 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.373+0000 7f972e159280 10 main: JournalTool::main 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.373+0000 7f972e159280 4 main: JournalTool: connecting to RADOS... 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.373+0000 7f972e159280 1 Processor -- start 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.373+0000 7f972e159280 1 -- start start 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972e159280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972e159280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972e159280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 0x55f3dc5bc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972e159280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc5be480 con 0x55f3dc6c5000 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972e159280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc5be600 con 0x55f3dc6c5400 2024-04-26T22:04:27.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972e159280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f3dc5be780 con 0x55f3dc6c5800 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972d106640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972d106640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58016/0 (socket says 172.21.15.137:58016) 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972d106640 1 -- 172.21.15.137:0/2107225669 learned_addr learned my addr 172.21.15.137:0/2107225669 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972c104640 1 --2- 172.21.15.137:0/2107225669 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 0x55f3dc5bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972c905640 1 --2- 172.21.15.137:0/2107225669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972d106640 1 -- 172.21.15.137:0/2107225669 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 msgr2=0x55f3dc5bc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972d106640 1 --2- 172.21.15.137:0/2107225669 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 0x55f3dc5bc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972d106640 1 -- 172.21.15.137:0/2107225669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5400 msgr2=0x55f3dc5bbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972d106640 1 --2- 172.21.15.137:0/2107225669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972d106640 1 -- 172.21.15.137:0/2107225669 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3db81b860 con 0x55f3dc6c5000 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.374+0000 7f972d106640 1 --2- 172.21.15.137:0/2107225669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bb600 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x55f3db95e2d0 tx=0x55f3dc582ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3ab3a11ee70186 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f97280fc640 1 -- 172.21.15.137:0/2107225669 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f3db80a680 con 0x55f3dc6c5000 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f97280fc640 1 -- 172.21.15.137:0/2107225669 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f3db810c40 con 0x55f3dc6c5000 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f97280fc640 1 -- 172.21.15.137:0/2107225669 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f3db80a9c0 con 0x55f3dc6c5000 2024-04-26T22:04:27.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f972e159280 1 -- 172.21.15.137:0/2107225669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5000 msgr2=0x55f3dc5bb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f972e159280 1 --2- 172.21.15.137:0/2107225669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bb600 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x55f3db95e2d0 tx=0x55f3dc582ba0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f972e159280 1 -- 172.21.15.137:0/2107225669 shutdown_connections 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f972e159280 1 --2- 172.21.15.137:0/2107225669 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 0x55f3dc5bc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f972e159280 1 --2- 172.21.15.137:0/2107225669 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f972e159280 1 --2- 172.21.15.137:0/2107225669 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bb600 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f972e159280 1 -- 172.21.15.137:0/2107225669 >> 172.21.15.137:0/2107225669 conn(0x55f3dc5c5800 msgr2=0x55f3db8dd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f972e159280 1 -- 172.21.15.137:0/2107225669 shutdown_connections 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.375+0000 7f972e159280 1 -- 172.21.15.137:0/2107225669 wait complete. 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972e159280 1 Processor -- start 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972e159280 1 -- start start 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972e159280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972e159280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972e159280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 0x55f3dc5bc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972e159280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc5bfc80 con 0x55f3dc6c5400 2024-04-26T22:04:27.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972e159280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc5bfb00 con 0x55f3dc6c5000 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972e159280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f3dc5bf980 con 0x55f3dc6c5800 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972c905640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972c905640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58018/0 (socket says 172.21.15.137:58018) 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972c905640 1 -- 172.21.15.137:0/1176325948 learned_addr learned my addr 172.21.15.137:0/1176325948 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972c104640 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 0x55f3dc5bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972d106640 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972c905640 1 -- 172.21.15.137:0/1176325948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 msgr2=0x55f3dc5bc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972c905640 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 0x55f3dc5bc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972c905640 1 -- 172.21.15.137:0/1176325948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5000 msgr2=0x55f3dc5bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.376+0000 7f972c905640 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.377+0000 7f972c905640 1 -- 172.21.15.137:0/1176325948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3db81b4a0 con 0x55f3dc6c5400 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.377+0000 7f972c905640 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bcc00 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x55f3dc6dda40 tx=0x55f3dc6e0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.377+0000 7f97268f9640 1 -- 172.21.15.137:0/1176325948 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f3db80a680 con 0x55f3dc6c5400 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.377+0000 7f97268f9640 1 -- 172.21.15.137:0/1176325948 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f3db8101c0 con 0x55f3dc6c5400 2024-04-26T22:04:27.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.377+0000 7f972e159280 1 -- 172.21.15.137:0/1176325948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3db81a960 con 0x55f3dc6c5400 2024-04-26T22:04:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.377+0000 7f97268f9640 1 -- 172.21.15.137:0/1176325948 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f3db80a9c0 con 0x55f3dc6c5400 2024-04-26T22:04:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.377+0000 7f972e159280 1 -- 172.21.15.137:0/1176325948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3db81a780 con 0x55f3dc6c5400 2024-04-26T22:04:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.377+0000 7f972e159280 4 main: JournalTool: resolving pool 12 2024-04-26T22:04:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.378+0000 7f97268f9640 1 -- 172.21.15.137:0/1176325948 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55f3dc732c00 con 0x55f3dc6c5400 2024-04-26T22:04:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.378+0000 7f97268f9640 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55f3dc736c00 0x55f3dc5bd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.378+0000 7f97268f9640 1 -- 172.21.15.137:0/1176325948 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x55f3dc730c00 con 0x55f3dc6c5400 2024-04-26T22:04:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.378+0000 7f972d106640 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55f3dc736c00 0x55f3dc5bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.378+0000 7f972e159280 4 main: JournalTool: creating IoCtx.. 2024-04-26T22:04:27.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.378+0000 7f972e159280 4 main: Executing for rank 0 2024-04-26T22:04:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.379+0000 7f972d106640 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55f3dc736c00 0x55f3dc5bd700 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55f3db95e2d0 tx=0x55f3dc584120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.379+0000 7f972e159280 1 -- start start 2024-04-26T22:04:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.379+0000 7f972e159280 1 Processor -- start 2024-04-26T22:04:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972e159280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc737000 0x55f3dc5bc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972e159280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc737400 0x55f3dc5bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972e159280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc737800 0x55f3dc5bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972e159280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc5bf680 con 0x55f3dc737800 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972e159280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc5bf500 con 0x55f3dc737400 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972e159280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55f3dc5be480 con 0x55f3dc737000 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c104640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc737800 0x55f3dc5bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c104640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc737800 0x55f3dc5bb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58022/0 (socket says 172.21.15.137:58022) 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c104640 1 -- 172.21.15.137:0/3030713553 learned_addr learned my addr 172.21.15.137:0/3030713553 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972d106640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc737000 0x55f3dc5bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c905640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc737400 0x55f3dc5bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c104640 1 -- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc737000 msgr2=0x55f3dc5bc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c104640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc737000 0x55f3dc5bc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c104640 1 -- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc737400 msgr2=0x55f3dc5bbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c104640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc737400 0x55f3dc5bbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c104640 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3db81a000 con 0x55f3dc737800 2024-04-26T22:04:27.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c905640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc737400 0x55f3dc5bbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972c104640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc737800 0x55f3dc5bb600 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x55f3dbb0dbc0 tx=0x55f3dc5828a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836fd98e3aaadf69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f97238f3640 1 -- 172.21.15.137:0/3030713553 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f3dc760000 con 0x55f3dc737800 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f97238f3640 1 -- 172.21.15.137:0/3030713553 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f3db810e00 con 0x55f3dc737800 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f97238f3640 1 -- 172.21.15.137:0/3030713553 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55f3dbaf3a00 con 0x55f3dc737800 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3db81b4a0 con 0x55f3dc737800 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55f3db81a960 con 0x55f3dc737800 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f972e159280 4 waiting for MDS map... 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.380+0000 7f97238f3640 1 -- 172.21.15.137:0/3030713553 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x55f3dbbc2400 con 0x55f3dc737800 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.381+0000 7f97238f3640 1 -- 172.21.15.137:0/3030713553 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 48) ==== 2885+0+0 (secure 0 0 0) 0x55f3db83f500 con 0x55f3dc737800 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.381+0000 7f972e159280 4 Got MDS map 48 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.381+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f3dc737c00 0x55f3dbbe2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.381+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbc5800 con 0x55f3dc737c00 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.381+0000 7f972d106640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f3dc737c00 0x55f3dbbe2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.381+0000 7f972d106640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f3dc737c00 0x55f3dbbe2000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=5687aa1f6f46aaf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.384+0000 7f972d106640 1 -- 172.21.15.137:0/3030713553 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55f3dc572000 con 0x55f3dc737c00 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.384+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f3dbbc5c00 0x55f3dbbe2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.384+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:2 12.14 12:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbea000 con 0x55f3dbbc5c00 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.384+0000 7f972c905640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f3dbbc5c00 0x55f3dbbe2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.384+0000 7f972c905640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f3dbbc5c00 0x55f3dbbe2580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=bfe5277bbb74afdf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.386+0000 7f972c905640 1 -- 172.21.15.137:0/3030713553 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55f3dc572500 con 0x55f3dbbc5c00 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.386+0000 7f97220f0640 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:3 12.14 12:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbf0000 con 0x55f3dbbc5c00 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.386+0000 7f97220f0640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55f3dbbf0400 0x55f3dbbe4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.386+0000 7f97220f0640 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:4 12.1b 12:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbf0800 con 0x55f3dbbf0400 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.386+0000 7f972c905640 1 -- 172.21.15.137:0/3030713553 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 156+0+16 (crc 0 0 0) 0x55f3dc572500 con 0x55f3dbbc5c00 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.386+0000 7f972d106640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55f3dbbf0400 0x55f3dbbe4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.387+0000 7f972d106640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55f3dbbf0400 0x55f3dbbe4680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=6ea222c9f2ad261e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.387+0000 7f972d106640 1 -- 172.21.15.137:0/3030713553 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f3dc572000 con 0x55f3dbbf0400 2024-04-26T22:04:27.392 INFO:teuthology.orchestra.run.smithi137.stdout:old journal was 4212724~2605 2024-04-26T22:04:27.392 INFO:teuthology.orchestra.run.smithi137.stdout:new journal start will be 8388608 (4173279 bytes past old end) 2024-04-26T22:04:27.392 INFO:teuthology.orchestra.run.smithi137.stdout:writing journal head 2024-04-26T22:04:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.387+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:5 12.14 12:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbea400 con 0x55f3dbbc5c00 2024-04-26T22:04:27.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972c905640 1 -- 172.21.15.137:0/3030713553 <== osd.5 v2:172.21.15.170:6808/205812566 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v90'21 uv21 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55f3dc572500 con 0x55f3dbbc5c00 2024-04-26T22:04:27.393 INFO:teuthology.orchestra.run.smithi137.stdout:writing EResetJournal entry 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:6 12.1b 12:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbea800 con 0x55f3dbbf0400 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55f3dbbeac00 0x55f3dbbe2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:7 12.b 12:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbeb000 con 0x55f3dbbeac00 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:8 12.1f 12:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbeb400 con 0x55f3dc737c00 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:9 12.1a 12:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbeb800 con 0x55f3dbbf0400 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:10 12.1e 12:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbebc00 con 0x55f3dbbf0400 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55f3dbbf0c00 0x55f3dbbe3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:11 12.1d 12:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbf1000 con 0x55f3dbbf0c00 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972c905640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55f3dbbeac00 0x55f3dbbe2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.388+0000 7f972c104640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55f3dbbf0c00 0x55f3dbbe3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.389+0000 7f972c905640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55f3dbbeac00 0x55f3dbbe2b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=ed47b5d9c8cca2e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.389+0000 7f972c104640 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55f3dbbf0c00 0x55f3dbbe3080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=8a502ce50228829d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.390+0000 7f972d106640 1 -- 172.21.15.137:0/3030713553 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== osd_op_reply(6 200.00000002 [delete] v90'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f3dc572000 con 0x55f3dbbf0400 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.390+0000 7f972d106640 1 -- 172.21.15.137:0/3030713553 <== osd.4 v2:172.21.15.170:6824/2080414701 3 ==== osd_op_reply(10 200.00000006 [delete] v90'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f3dc572000 con 0x55f3dbbf0400 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.390+0000 7f972d106640 1 -- 172.21.15.137:0/3030713553 <== osd.6 v2:172.21.15.170:6800/3855301024 2 ==== osd_op_reply(8 200.00000004 [delete] v90'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f3dc572000 con 0x55f3dc737c00 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.392+0000 7f972c905640 1 -- 172.21.15.137:0/3030713553 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(7 200.00000003 [delete] v90'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f3dc572500 con 0x55f3dbbeac00 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.392+0000 7f972d106640 1 -- 172.21.15.137:0/3030713553 <== osd.4 v2:172.21.15.170:6824/2080414701 4 ==== osd_op_reply(9 200.00000005 [delete] v90'2 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f3dc572000 con 0x55f3dbbf0400 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.392+0000 7f972c104640 1 -- 172.21.15.137:0/3030713553 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(11 200.00000007 [delete] v90'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55f3dc572780 con 0x55f3dbbf0c00 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.393+0000 7f97220f0640 1 -- 172.21.15.137:0/3030713553 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:12 12.1b 12:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) -- 0x55f3dbbf0000 con 0x55f3dbbf0400 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972d106640 1 -- 172.21.15.137:0/3030713553 <== osd.4 v2:172.21.15.170:6824/2080414701 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v90'3 uv3 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x55f3dc572000 con 0x55f3dbbf0400 2024-04-26T22:04:27.396 INFO:teuthology.orchestra.run.smithi137.stdout:done 2024-04-26T22:04:27.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55f3dbbf0c00 msgr2=0x55f3dbbe3080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55f3dbbf0c00 0x55f3dbbe3080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55f3dbbeac00 msgr2=0x55f3dbbe2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55f3dbbeac00 0x55f3dbbe2b00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55f3dbbf0400 msgr2=0x55f3dbbe4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55f3dbbf0400 0x55f3dbbe4680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f3dbbc5c00 msgr2=0x55f3dbbe2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55f3dbbc5c00 0x55f3dbbe2580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f3dc737c00 msgr2=0x55f3dbbe2000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972c104640 1 -- 172.21.15.137:0/3030713553 reap_dead start 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f3dc737c00 0x55f3dbbe2000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc737800 msgr2=0x55f3dc5bb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc737800 0x55f3dc5bb600 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x55f3dbb0dbc0 tx=0x55f3dc5828a0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 shutdown_connections 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55f3dc737c00 0x55f3dbbe2000 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/3030713553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc737800 0x55f3dc5bb600 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 >> 172.21.15.137:0/3030713553 conn(0x55f3dc6c5c00 msgr2=0x55f3db8dd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:27.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 shutdown_connections 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/3030713553 wait complete. 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55f3dc736c00 msgr2=0x55f3dc5bd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55f3dc736c00 0x55f3dc5bd700 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55f3db95e2d0 tx=0x55f3dc584120 comp rx=0 tx=0).stop 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5400 msgr2=0x55f3dc5bcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bcc00 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x55f3dc6dda40 tx=0x55f3dc6e0c00 comp rx=0 tx=0).stop 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 -- 172.21.15.137:0/1176325948 shutdown_connections 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55f3dc736c00 0x55f3dc5bd700 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc6c5400 0x55f3dc5bcc00 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc6c5800 0x55f3dc5bc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.394+0000 7f972e159280 1 --2- 172.21.15.137:0/1176325948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc6c5000 0x55f3dc5bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 -- 172.21.15.137:0/1176325948 >> 172.21.15.137:0/1176325948 conn(0x55f3dc5c5800 msgr2=0x55f3db8dd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 -- 172.21.15.137:0/1176325948 shutdown_connections 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 -- 172.21.15.137:0/1176325948 wait complete. 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 -- 172.21.15.137:0/3787738255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc5c5c00 msgr2=0x55f3dc5ba580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc5c5c00 0x55f3dc5ba580 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55f3dc61f7d0 tx=0x55f3dc5840c0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 -- 172.21.15.137:0/3787738255 shutdown_connections 2024-04-26T22:04:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55f3dc5c5c00 0x55f3dc5ba580 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55f3dc5c5400 0x55f3dc5ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 --2- 172.21.15.137:0/3787738255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f3dc5c4800 0x55f3dc5bb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 -- 172.21.15.137:0/3787738255 >> 172.21.15.137:0/3787738255 conn(0x55f3db7e5000 msgr2=0x55f3db8dc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 -- 172.21.15.137:0/3787738255 shutdown_connections 2024-04-26T22:04:27.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.395+0000 7f972e159280 1 -- 172.21.15.137:0/3787738255 wait complete. 2024-04-26T22:04:27.402 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.111330, result: old journal was 4212724~2605 new journal start will be 8388608 (4173279 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-26T22:04:27.402 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-26T22:04:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.539+0000 7f39ced7f640 1 Processor -- start 2024-04-26T22:04:27.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.539+0000 7f39ced7f640 1 -- start start 2024-04-26T22:04:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39ced7f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c80b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39ced7f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f39c80b55c0 0x7f39c80ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39ced7f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c815dca0 con 0x7f39c80b4520 2024-04-26T22:04:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39ced7f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f39c8143c20 con 0x7f39c80b55c0 2024-04-26T22:04:27.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39ced7f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39c815df80 con 0x7f39c8143840 2024-04-26T22:04:27.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39ccb1b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c80b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39cd31c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f39c80b55c0 0x7f39c80ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39c7fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f39c80b4520 0x7f39c80b4eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:37604/0 (socket says 172.21.15.137:37604) 2024-04-26T22:04:27.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39ccb1b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c80b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:54790/0 (socket says 172.21.15.137:54790) 2024-04-26T22:04:27.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.540+0000 7f39c7fff640 1 -- 172.21.15.137:0/3631768498 learned_addr learned my addr 172.21.15.137:0/3631768498 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.541+0000 7f39ccb1b640 1 -- 172.21.15.137:0/3631768498 >> v2:172.21.15.170:3300/0 conn(0x7f39c80b55c0 msgr2=0x7f39c80ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.541+0000 7f39ccb1b640 1 --2- 172.21.15.137:0/3631768498 >> v2:172.21.15.170:3300/0 conn(0x7f39c80b55c0 0x7f39c80ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.541+0000 7f39ccb1b640 1 -- 172.21.15.137:0/3631768498 >> v1:172.21.15.170:6789/0 conn(0x7f39c80b4520 legacy=0x7f39c80b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.541+0000 7f39ccb1b640 1 -- 172.21.15.137:0/3631768498 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c815e260 con 0x7f39c8143840 2024-04-26T22:04:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.541+0000 7f39cd31c640 1 --2- 172.21.15.137:0/3631768498 >> v2:172.21.15.170:3300/0 conn(0x7f39c80b55c0 0x7f39c80ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:04:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.541+0000 7f39ccb1b640 1 --2- 172.21.15.137:0/3631768498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c80b3fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39b80097a0 tx=0x7f39b802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d5b49ecd3395ded server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.541+0000 7f39c77fe640 1 -- 172.21.15.137:0/3631768498 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8037070 con 0x7f39c8143840 2024-04-26T22:04:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.541+0000 7f39c77fe640 1 -- 172.21.15.137:0/3631768498 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8032440 con 0x7f39c8143840 2024-04-26T22:04:27.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.541+0000 7f39c77fe640 1 -- 172.21.15.137:0/3631768498 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8032810 con 0x7f39c8143840 2024-04-26T22:04:27.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.542+0000 7f39ced7f640 1 -- 172.21.15.137:0/3631768498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 msgr2=0x7f39c80b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.542+0000 7f39ced7f640 1 --2- 172.21.15.137:0/3631768498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c80b3fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f39b80097a0 tx=0x7f39b802a180 comp rx=0 tx=0).stop 2024-04-26T22:04:27.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.542+0000 7f39ced7f640 1 -- 172.21.15.137:0/3631768498 shutdown_connections 2024-04-26T22:04:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.542+0000 7f39ced7f640 1 --2- 172.21.15.137:0/3631768498 >> v2:172.21.15.170:3300/0 conn(0x7f39c80b55c0 0x7f39c80ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.542+0000 7f39ced7f640 1 --2- 172.21.15.137:0/3631768498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c80b3fe0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.542+0000 7f39ced7f640 1 -- 172.21.15.137:0/3631768498 >> 172.21.15.137:0/3631768498 conn(0x7f39c80cd8a0 msgr2=0x7f39c80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.542+0000 7f39ced7f640 1 -- 172.21.15.137:0/3631768498 shutdown_connections 2024-04-26T22:04:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.542+0000 7f39ced7f640 1 -- 172.21.15.137:0/3631768498 wait complete. 2024-04-26T22:04:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.543+0000 7f39ced7f640 1 Processor -- start 2024-04-26T22:04:27.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.543+0000 7f39ced7f640 1 -- start start 2024-04-26T22:04:27.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ced7f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c80b4520 0x7f39c81f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ced7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c80b55c0 0x7f39c81e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ced7f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c813f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ced7f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f39c815da40 con 0x7f39c80b55c0 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ced7f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39c815d8c0 con 0x7f39c80b4520 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ced7f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39c80cf530 con 0x7f39c8143840 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c80b55c0 0x7f39c81e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c80b55c0 0x7f39c81e8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58026/0 (socket says 172.21.15.137:58026) 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39c7fff640 1 -- 172.21.15.137:0/52010579 learned_addr learned my addr 172.21.15.137:0/52010579 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ccb1b640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c80b4520 0x7f39c81f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39cd31c640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c813f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ccb1b640 1 -- 172.21.15.137:0/52010579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 msgr2=0x7f39c813f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ccb1b640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c813f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ccb1b640 1 -- 172.21.15.137:0/52010579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c80b55c0 msgr2=0x7f39c81e8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ccb1b640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c80b55c0 0x7f39c81e8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.544+0000 7f39ccb1b640 1 -- 172.21.15.137:0/52010579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c813d100 con 0x7f39c80b4520 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.545+0000 7f39ccb1b640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c80b4520 0x7f39c81f6170 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f39c806d280 tx=0x7f39b80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.545+0000 7f39c57fa640 1 -- 172.21.15.137:0/52010579 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8041030 con 0x7f39c80b4520 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.545+0000 7f39c57fa640 1 -- 172.21.15.137:0/52010579 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8030440 con 0x7f39c80b4520 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.545+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c813d3e0 con 0x7f39c80b4520 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.545+0000 7f39c57fa640 1 -- 172.21.15.137:0/52010579 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8037040 con 0x7f39c80b4520 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.545+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c81e7e60 con 0x7f39c80b4520 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.546+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c806a290 con 0x7f39c80b4520 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.546+0000 7f39c57fa640 1 -- 172.21.15.137:0/52010579 <== mon.1 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f39b8044070 con 0x7f39c80b4520 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.547+0000 7f39c57fa640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f39b406c8f0 0x7f39b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.547+0000 7f39c57fa640 1 -- 172.21.15.137:0/52010579 <== mon.1 v2:172.21.15.170:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f39b80ac360 con 0x7f39c80b4520 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.547+0000 7f39c7fff640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f39b406c8f0 0x7f39b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:27.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.547+0000 7f39c7fff640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f39b406c8f0 0x7f39b406edb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f39c81e97d0 tx=0x7f39bc007f10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:27.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.551+0000 7f39c57fa640 1 -- 172.21.15.137:0/52010579 <== mon.1 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f39b807a740 con 0x7f39c80b4520 2024-04-26T22:04:27.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:27.764+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f39c80ce420 con 0x7f39c80b4520 2024-04-26T22:04:28.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.228+0000 7f39c57fa640 1 -- 172.21.15.137:0/52010579 <== mon.1 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v49) ==== 162+0+0 (secure 0 0 0) 0x7f39b807a040 con 0x7f39c80b4520 2024-04-26T22:04:28.229 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-26T22:04:28.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f39b406c8f0 msgr2=0x7f39b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f39b406c8f0 0x7f39b406edb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f39c81e97d0 tx=0x7f39bc007f10 comp rx=0 tx=0).stop 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c80b4520 msgr2=0x7f39c81f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c80b4520 0x7f39c81f6170 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f39c806d280 tx=0x7f39b80046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 shutdown_connections 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f39b406c8f0 0x7f39b406edb0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39c80b55c0 0x7f39c81e8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39c8143840 0x7f39c813f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 --2- 172.21.15.137:0/52010579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c80b4520 0x7f39c81f6170 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 >> 172.21.15.137:0/52010579 conn(0x7f39c80cd8a0 msgr2=0x7f39c815fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 shutdown_connections 2024-04-26T22:04:28.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.231+0000 7f39ced7f640 1 -- 172.21.15.137:0/52010579 wait complete. 2024-04-26T22:04:28.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:28.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.342+0000 7fdd30a62640 1 Processor -- start 2024-04-26T22:04:28.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.342+0000 7fdd30a62640 1 -- start start 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd30a62640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd2c15d130 0x7fdd2c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd30a62640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 0x7fdd2c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd30a62640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c15d510 con 0x7fdd2c0733c0 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd30a62640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdd2c0b0e80 con 0x7fdd2c15d130 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd30a62640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2c0b54f0 con 0x7fdd2c070d00 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd2a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdd2c15d130 0x7fdd2c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd23fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdd2c0733c0 0x7fdd2c160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43404/0 (socket says 172.21.15.137:43404) 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd23fff640 1 -- 172.21.15.137:0/2963274932 learned_addr learned my addr 172.21.15.137:0/2963274932 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd2ad9d640 1 --2- 172.21.15.137:0/2963274932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 0x7fdd2c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd2a59c640 1 -- 172.21.15.137:0/2963274932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 msgr2=0x7fdd2c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:28.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd2a59c640 1 --2- 172.21.15.137:0/2963274932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 0x7fdd2c06d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd2a59c640 1 -- 172.21.15.137:0/2963274932 >> v1:172.21.15.137:6789/0 conn(0x7fdd2c0733c0 legacy=0x7fdd2c160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:28.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd2a59c640 1 -- 172.21.15.137:0/2963274932 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c0d12c0 con 0x7fdd2c15d130 2024-04-26T22:04:28.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.343+0000 7fdd29d9b640 1 -- 172.21.15.137:0/2963274932 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599559736 0 0) 0x7fdd2c15d510 con 0x7fdd2c0733c0 2024-04-26T22:04:28.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.344+0000 7fdd2a59c640 1 --2- 172.21.15.137:0/2963274932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 0x7fdd2c06d2b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0097a0 tx=0x7fdd1c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec5226be59cfe46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:28.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.344+0000 7fdd29d9b640 1 -- 172.21.15.137:0/2963274932 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c037070 con 0x7fdd2c15d130 2024-04-26T22:04:28.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.344+0000 7fdd29d9b640 1 -- 172.21.15.137:0/2963274932 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c032440 con 0x7fdd2c15d130 2024-04-26T22:04:28.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.344+0000 7fdd29d9b640 1 -- 172.21.15.137:0/2963274932 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c032810 con 0x7fdd2c15d130 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.345+0000 7fdd30a62640 1 -- 172.21.15.137:0/2963274932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 msgr2=0x7fdd2c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.345+0000 7fdd30a62640 1 --2- 172.21.15.137:0/2963274932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 0x7fdd2c06d2b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0097a0 tx=0x7fdd1c02a180 comp rx=0 tx=0).stop 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.345+0000 7fdd30a62640 1 -- 172.21.15.137:0/2963274932 shutdown_connections 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.345+0000 7fdd30a62640 1 --2- 172.21.15.137:0/2963274932 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 0x7fdd2c06d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.345+0000 7fdd30a62640 1 --2- 172.21.15.137:0/2963274932 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 0x7fdd2c06d2b0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.345+0000 7fdd30a62640 1 -- 172.21.15.137:0/2963274932 >> 172.21.15.137:0/2963274932 conn(0x7fdd2c0728a0 msgr2=0x7fdd2c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.345+0000 7fdd30a62640 1 -- 172.21.15.137:0/2963274932 shutdown_connections 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.345+0000 7fdd30a62640 1 -- 172.21.15.137:0/2963274932 wait complete. 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.346+0000 7fdd30a62640 1 Processor -- start 2024-04-26T22:04:28.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.346+0000 7fdd30a62640 1 -- start start 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd30a62640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 0x7fdd2c144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd30a62640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c0733c0 0x7fdd2c070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd30a62640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 0x7fdd2c15a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd30a62640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c0d07e0 con 0x7fdd2c15d130 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd30a62640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c0d0500 con 0x7fdd2c0733c0 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd30a62640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2c0d0ac0 con 0x7fdd2c070d00 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 0x7fdd2c15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 0x7fdd2c15a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58056/0 (socket says 172.21.15.137:58056) 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2ad9d640 1 -- 172.21.15.137:0/456755277 learned_addr learned my addr 172.21.15.137:0/456755277 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2a59c640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 0x7fdd2c144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd23fff640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c0733c0 0x7fdd2c070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2ad9d640 1 -- 172.21.15.137:0/456755277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 msgr2=0x7fdd2c144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2ad9d640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 0x7fdd2c144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2ad9d640 1 -- 172.21.15.137:0/456755277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c0733c0 msgr2=0x7fdd2c070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2ad9d640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c0733c0 0x7fdd2c070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2ad9d640 1 -- 172.21.15.137:0/456755277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c150770 con 0x7fdd2c15d130 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd23fff640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c0733c0 0x7fdd2c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd2ad9d640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 0x7fdd2c15a270 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009e30 tx=0x7fdd2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd22ffd640 1 -- 172.21.15.137:0/456755277 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24018020 con 0x7fdd2c15d130 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd22ffd640 1 -- 172.21.15.137:0/456755277 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd24014480 con 0x7fdd2c15d130 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd22ffd640 1 -- 172.21.15.137:0/456755277 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24014870 con 0x7fdd2c15d130 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2c1591d0 con 0x7fdd2c15d130 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.347+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd2c159790 con 0x7fdd2c15d130 2024-04-26T22:04:28.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.348+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd2c06a290 con 0x7fdd2c15d130 2024-04-26T22:04:28.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.349+0000 7fdd22ffd640 1 -- 172.21.15.137:0/456755277 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd24005d10 con 0x7fdd2c15d130 2024-04-26T22:04:28.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.349+0000 7fdd22ffd640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:28.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.349+0000 7fdd22ffd640 1 -- 172.21.15.137:0/456755277 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fdd2408c9a0 con 0x7fdd2c15d130 2024-04-26T22:04:28.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.349+0000 7fdd2a59c640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:28.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.350+0000 7fdd2a59c640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c034000 tx=0x7fdd1c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:28.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.354+0000 7fdd22ffd640 1 -- 172.21.15.137:0/456755277 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdd24022030 con 0x7fdd2c15d130 2024-04-26T22:04:28.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.565+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd2c15dcb0 con 0x7fdd2c15d130 2024-04-26T22:04:28.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.566+0000 7fdd22ffd640 1 -- 172.21.15.137:0/456755277 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5189 (secure 0 0 0) 0x7fdd24010040 con 0x7fdd2c15d130 2024-04-26T22:04:28.566 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:28.566 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:04:28.229065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7317":{"gid":7317,"name":"a","rank":0,"incarnation":50,"state":"up:replay","state_seq":1,"addr":"172.21.15.137:6837/2128712520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2128712520},{"type":"v1","addr":"172.21.15.137:6837","nonce":2128712520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-26T22:04:28.566 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 50 2024-04-26T22:04:28.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd0c06c8f0 msgr2=0x7fdd0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:28.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c034000 tx=0x7fdd1c02e000 comp rx=0 tx=0).stop 2024-04-26T22:04:28.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 msgr2=0x7fdd2c15a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:28.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 0x7fdd2c15a270 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009e30 tx=0x7fdd2400c490 comp rx=0 tx=0).stop 2024-04-26T22:04:28.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 shutdown_connections 2024-04-26T22:04:28.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdd0c06c8f0 0x7fdd0c06edb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdd2c15d130 0x7fdd2c15a270 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c0733c0 0x7fdd2c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 --2- 172.21.15.137:0/456755277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdd2c070d00 0x7fdd2c144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:28.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 >> 172.21.15.137:0/456755277 conn(0x7fdd2c0728a0 msgr2=0x7fdd2c0b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:28.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 shutdown_connections 2024-04-26T22:04:28.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:28.568+0000 7fdd30a62640 1 -- 172.21.15.137:0/456755277 wait complete. 2024-04-26T22:04:28.982 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:04:13.390555+0000', 'modified': '2024-04-26T22:04:28.229065+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7317}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7317': {'gid': 7317, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.137:6837/2128712520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 2128712520}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 2128712520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:04:28.982 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7317:up:replay 2024-04-26T22:04:29.983 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:30.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.094+0000 7f0b0f5e9640 1 Processor -- start 2024-04-26T22:04:30.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.095+0000 7f0b0f5e9640 1 -- start start 2024-04-26T22:04:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.095+0000 7f0b0f5e9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b0815f370 0x7f0b080cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.095+0000 7f0b0f5e9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 0x7f0b080b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.095+0000 7f0b0f5e9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b080d03a0 con 0x7f0b080d37d0 2024-04-26T22:04:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.095+0000 7f0b0f5e9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0b080b4d10 con 0x7f0b0815f370 2024-04-26T22:04:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.095+0000 7f0b0f5e9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b080d0680 con 0x7f0b0815f750 2024-04-26T22:04:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.095+0000 7f0b0d385640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b0815f370 0x7f0b080cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.096+0000 7f0b0d385640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0b0815f370 0x7f0b080cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58070/0 (socket says 172.21.15.137:58070) 2024-04-26T22:04:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.096+0000 7f0b0d385640 1 -- 172.21.15.137:0/1095468235 learned_addr learned my addr 172.21.15.137:0/1095468235 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:30.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.096+0000 7f0b0cb84640 1 --2- 172.21.15.137:0/1095468235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 0x7f0b080b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:30.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.096+0000 7f0b0d385640 1 -- 172.21.15.137:0/1095468235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 msgr2=0x7f0b080b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:30.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.096+0000 7f0b0d385640 1 --2- 172.21.15.137:0/1095468235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 0x7f0b080b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:30.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.096+0000 7f0b0d385640 1 -- 172.21.15.137:0/1095468235 >> v1:172.21.15.170:6789/0 conn(0x7f0b080d37d0 legacy=0x7f0b080d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:30.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.096+0000 7f0b0d385640 1 -- 172.21.15.137:0/1095468235 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b080d0960 con 0x7f0b0815f370 2024-04-26T22:04:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0b0d385640 1 --2- 172.21.15.137:0/1095468235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b0815f370 0x7f0b080cfd70 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009e50 tx=0x7f0b0402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc99108577c9b52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0afffff640 1 -- 172.21.15.137:0/1095468235 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04036070 con 0x7f0b0815f370 2024-04-26T22:04:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0afffff640 1 -- 172.21.15.137:0/1095468235 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b04031600 con 0x7f0b0815f370 2024-04-26T22:04:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0afffff640 1 -- 172.21.15.137:0/1095468235 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b040319d0 con 0x7f0b0815f370 2024-04-26T22:04:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/1095468235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b0815f370 msgr2=0x7f0b080cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0b0f5e9640 1 --2- 172.21.15.137:0/1095468235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b0815f370 0x7f0b080cfd70 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009e50 tx=0x7f0b0402a680 comp rx=0 tx=0).stop 2024-04-26T22:04:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/1095468235 shutdown_connections 2024-04-26T22:04:30.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0b0f5e9640 1 --2- 172.21.15.137:0/1095468235 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 0x7f0b080b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0b0f5e9640 1 --2- 172.21.15.137:0/1095468235 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b0815f370 0x7f0b080cfd70 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/1095468235 >> 172.21.15.137:0/1095468235 conn(0x7f0b0808ec10 msgr2=0x7f0b0809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/1095468235 shutdown_connections 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.097+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/1095468235 wait complete. 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0f5e9640 1 Processor -- start 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0f5e9640 1 -- start start 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0f5e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b080d37d0 0x7f0b0814ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0f5e9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b0815f370 0x7f0b080cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0f5e9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 0x7f0b080cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0f5e9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b080b51c0 con 0x7f0b080d37d0 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0f5e9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b080d0f20 con 0x7f0b0815f370 2024-04-26T22:04:30.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0f5e9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b080b5340 con 0x7f0b0815f750 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0d385640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b080d37d0 0x7f0b0814ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0d385640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b080d37d0 0x7f0b0814ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58082/0 (socket says 172.21.15.137:58082) 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.099+0000 7f0b0d385640 1 -- 172.21.15.137:0/2422291650 learned_addr learned my addr 172.21.15.137:0/2422291650 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0cb84640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b0815f370 0x7f0b080cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0db86640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 0x7f0b080cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0d385640 1 -- 172.21.15.137:0/2422291650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 msgr2=0x7f0b080cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0d385640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 0x7f0b080cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0d385640 1 -- 172.21.15.137:0/2422291650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b0815f370 msgr2=0x7f0b080cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0d385640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b0815f370 0x7f0b080cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0d385640 1 -- 172.21.15.137:0/2422291650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0809f380 con 0x7f0b080d37d0 2024-04-26T22:04:30.104 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0d385640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b080d37d0 0x7f0b0814ed40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009f70 tx=0x7f0b04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0afdffb640 1 -- 172.21.15.137:0/2422291650 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0403f020 con 0x7f0b080d37d0 2024-04-26T22:04:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0afdffb640 1 -- 172.21.15.137:0/2422291650 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b04037040 con 0x7f0b080d37d0 2024-04-26T22:04:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0814f930 con 0x7f0b080d37d0 2024-04-26T22:04:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0afdffb640 1 -- 172.21.15.137:0/2422291650 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04036070 con 0x7f0b080d37d0 2024-04-26T22:04:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.100+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0814fef0 con 0x7f0b080d37d0 2024-04-26T22:04:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.101+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0814f740 con 0x7f0b080d37d0 2024-04-26T22:04:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.102+0000 7f0afdffb640 1 -- 172.21.15.137:0/2422291650 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b04042020 con 0x7f0b080d37d0 2024-04-26T22:04:30.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.102+0000 7f0afdffb640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0aec06c8f0 0x7f0aec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:30.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.102+0000 7f0afdffb640 1 -- 172.21.15.137:0/2422291650 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f0b040ac100 con 0x7f0b080d37d0 2024-04-26T22:04:30.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.102+0000 7f0b0cb84640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0aec06c8f0 0x7f0aec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:30.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.103+0000 7f0b0cb84640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0aec06c8f0 0x7f0aec06edb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0af8006fd0 tx=0x7f0af8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:30.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.107+0000 7f0afdffb640 1 -- 172.21.15.137:0/2422291650 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0b04049030 con 0x7f0b080d37d0 2024-04-26T22:04:30.319 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.319+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b080d1570 con 0x7f0b080d37d0 2024-04-26T22:04:30.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.320+0000 7f0afdffb640 1 -- 172.21.15.137:0/2422291650 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5189 (secure 0 0 0) 0x7f0b0407a4c0 con 0x7f0b080d37d0 2024-04-26T22:04:30.320 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:30.320 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:04:29.233849+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7317":{"gid":7317,"name":"a","rank":0,"incarnation":50,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.137:6837/2128712520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2128712520},{"type":"v1","addr":"172.21.15.137:6837","nonce":2128712520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-26T22:04:30.321 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 52 2024-04-26T22:04:30.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0aec06c8f0 msgr2=0x7f0aec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:30.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0aec06c8f0 0x7f0aec06edb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0af8006fd0 tx=0x7f0af8008040 comp rx=0 tx=0).stop 2024-04-26T22:04:30.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b080d37d0 msgr2=0x7f0b0814ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:30.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b080d37d0 0x7f0b0814ed40 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009f70 tx=0x7f0b04004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:30.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 shutdown_connections 2024-04-26T22:04:30.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0aec06c8f0 0x7f0aec06edb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:30.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b0815f750 0x7f0b080cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:30.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b0815f370 0x7f0b080cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:30.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 --2- 172.21.15.137:0/2422291650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b080d37d0 0x7f0b0814ed40 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:30.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 >> 172.21.15.137:0/2422291650 conn(0x7f0b0808ec10 msgr2=0x7f0b080d4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:30.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 shutdown_connections 2024-04-26T22:04:30.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:30.322+0000 7f0b0f5e9640 1 -- 172.21.15.137:0/2422291650 wait complete. 2024-04-26T22:04:30.735 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:04:13.390555+0000', 'modified': '2024-04-26T22:04:29.233849+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7317}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7317': {'gid': 7317, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:rejoin', 'state_seq': 7, 'addr': '172.21.15.137:6837/2128712520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 2128712520}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 2128712520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:04:30.736 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7317:up:rejoin 2024-04-26T22:04:31.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:31.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.845+0000 7fe2a8299640 1 Processor -- start 2024-04-26T22:04:31.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.845+0000 7fe2a8299640 1 -- start start 2024-04-26T22:04:31.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.846+0000 7fe2a8299640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2a015f1e0 0x7fe2a006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:31.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.846+0000 7fe2a8299640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a00b4a10 con 0x7fe2a006d2b0 2024-04-26T22:04:31.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.846+0000 7fe2a8299640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a00b4cf0 con 0x7fe2a00b44e0 2024-04-26T22:04:31.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.846+0000 7fe2a8299640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a006eeb0 con 0x7fe2a015f1e0 2024-04-26T22:04:31.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.846+0000 7fe2a6035640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2a015f1e0 0x7fe2a006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:31.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.846+0000 7fe2a6836640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe2a006d2b0 0x7fe2a00b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43414/0 (socket says 172.21.15.137:43414) 2024-04-26T22:04:31.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.846+0000 7fe2a6035640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2a015f1e0 0x7fe2a006e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58094/0 (socket says 172.21.15.137:58094) 2024-04-26T22:04:31.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.846+0000 7fe2a6836640 1 -- 172.21.15.137:0/605119143 learned_addr learned my addr 172.21.15.137:0/605119143 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:31.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.847+0000 7fe2a6035640 1 -- 172.21.15.137:0/605119143 >> v1:172.21.15.170:6789/0 conn(0x7fe2a00b44e0 legacy=0x7fe2a00ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:31.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.847+0000 7fe2a5033640 1 -- 172.21.15.137:0/605119143 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425564287 0 0) 0x7fe2a00b4a10 con 0x7fe2a006d2b0 2024-04-26T22:04:31.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.847+0000 7fe2a6035640 1 -- 172.21.15.137:0/605119143 >> v1:172.21.15.137:6789/0 conn(0x7fe2a006d2b0 legacy=0x7fe2a00b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:31.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.847+0000 7fe2a6035640 1 -- 172.21.15.137:0/605119143 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a00b4fd0 con 0x7fe2a015f1e0 2024-04-26T22:04:31.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.847+0000 7fe2a6035640 1 --2- 172.21.15.137:0/605119143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a015f1e0 0x7fe2a006e970 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0097a0 tx=0x7fe29c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26574d9bc22bd52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:31.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.847+0000 7fe2a5033640 1 -- 172.21.15.137:0/605119143 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c037070 con 0x7fe2a015f1e0 2024-04-26T22:04:31.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.848+0000 7fe2a5033640 1 -- 172.21.15.137:0/605119143 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29c032440 con 0x7fe2a015f1e0 2024-04-26T22:04:31.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.848+0000 7fe2a5033640 1 -- 172.21.15.137:0/605119143 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c032810 con 0x7fe2a015f1e0 2024-04-26T22:04:31.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.848+0000 7fe2a8299640 1 -- 172.21.15.137:0/605119143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a015f1e0 msgr2=0x7fe2a006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:31.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.848+0000 7fe2a8299640 1 --2- 172.21.15.137:0/605119143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a015f1e0 0x7fe2a006e970 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0097a0 tx=0x7fe29c02a1e0 comp rx=0 tx=0).stop 2024-04-26T22:04:31.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.848+0000 7fe2a8299640 1 -- 172.21.15.137:0/605119143 shutdown_connections 2024-04-26T22:04:31.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.848+0000 7fe2a8299640 1 --2- 172.21.15.137:0/605119143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a015f1e0 0x7fe2a006e970 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:31.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.848+0000 7fe2a8299640 1 -- 172.21.15.137:0/605119143 >> 172.21.15.137:0/605119143 conn(0x7fe2a00728a0 msgr2=0x7fe2a0072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:31.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.848+0000 7fe2a8299640 1 -- 172.21.15.137:0/605119143 shutdown_connections 2024-04-26T22:04:31.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.848+0000 7fe2a8299640 1 -- 172.21.15.137:0/605119143 wait complete. 2024-04-26T22:04:31.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.849+0000 7fe2a8299640 1 Processor -- start 2024-04-26T22:04:31.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.849+0000 7fe2a8299640 1 -- start start 2024-04-26T22:04:31.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a8299640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2a006d2b0 0x7fe2a015e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:31.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a8299640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a00b44e0 0x7fe2a014a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:31.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a8299640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2a015f1e0 0x7fe2a01e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:31.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a8299640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a015f5c0 con 0x7fe2a00b44e0 2024-04-26T22:04:31.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a8299640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a00b5590 con 0x7fe2a006d2b0 2024-04-26T22:04:31.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a8299640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a015e840 con 0x7fe2a015f1e0 2024-04-26T22:04:31.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a5834640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a00b44e0 0x7fe2a014a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:31.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a5834640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a00b44e0 0x7fe2a014a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58104/0 (socket says 172.21.15.137:58104) 2024-04-26T22:04:31.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a5834640 1 -- 172.21.15.137:0/4133317518 learned_addr learned my addr 172.21.15.137:0/4133317518 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:31.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a6035640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2a006d2b0 0x7fe2a015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:31.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.850+0000 7fe2a6836640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2a015f1e0 0x7fe2a01e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:31.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe2a5834640 1 -- 172.21.15.137:0/4133317518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2a015f1e0 msgr2=0x7fe2a01e9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:31.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe2a5834640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2a015f1e0 0x7fe2a01e9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:31.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe2a5834640 1 -- 172.21.15.137:0/4133317518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2a006d2b0 msgr2=0x7fe2a015e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:31.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe2a5834640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2a006d2b0 0x7fe2a015e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:31.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe2a5834640 1 -- 172.21.15.137:0/4133317518 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a015b990 con 0x7fe2a00b44e0 2024-04-26T22:04:31.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe2a5834640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a00b44e0 0x7fe2a014a1b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c430 tx=0x7fe29000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:31.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe296ffd640 1 -- 172.21.15.137:0/4133317518 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290011790 con 0x7fe2a00b44e0 2024-04-26T22:04:31.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe296ffd640 1 -- 172.21.15.137:0/4133317518 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe290017070 con 0x7fe2a00b44e0 2024-04-26T22:04:31.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe296ffd640 1 -- 172.21.15.137:0/4133317518 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290011bb0 con 0x7fe2a00b44e0 2024-04-26T22:04:31.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a014a6f0 con 0x7fe2a00b44e0 2024-04-26T22:04:31.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.851+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a01625f0 con 0x7fe2a00b44e0 2024-04-26T22:04:31.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.852+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a00720a0 con 0x7fe2a00b44e0 2024-04-26T22:04:31.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.852+0000 7fe296ffd640 1 -- 172.21.15.137:0/4133317518 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe29001c460 con 0x7fe2a00b44e0 2024-04-26T22:04:31.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.853+0000 7fe296ffd640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe28406c8f0 0x7fe28406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:31.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.853+0000 7fe296ffd640 1 -- 172.21.15.137:0/4133317518 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fe29008ba50 con 0x7fe2a00b44e0 2024-04-26T22:04:31.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.853+0000 7fe2a6035640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe28406c8f0 0x7fe28406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:31.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.853+0000 7fe2a6035640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe28406c8f0 0x7fe28406edb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe29c034000 tx=0x7fe29c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:31.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:31.857+0000 7fe296ffd640 1 -- 172.21.15.137:0/4133317518 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe2a00720a0 con 0x7fe2a00b44e0 2024-04-26T22:04:32.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.066+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2a006a290 con 0x7fe2a00b44e0 2024-04-26T22:04:32.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.067+0000 7fe296ffd640 1 -- 172.21.15.137:0/4133317518 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5196 (secure 0 0 0) 0x7fe290059ea0 con 0x7fe2a00b44e0 2024-04-26T22:04:32.067 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:32.067 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:04:31.233209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7317":{"gid":7317,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":8,"addr":"172.21.15.137:6837/2128712520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2128712520},{"type":"v1","addr":"172.21.15.137:6837","nonce":2128712520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7317,"qdb_cluster":[7317]},"id":6}]} 2024-04-26T22:04:32.067 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 53 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe28406c8f0 msgr2=0x7fe28406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe28406c8f0 0x7fe28406edb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe29c034000 tx=0x7fe29c02e000 comp rx=0 tx=0).stop 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a00b44e0 msgr2=0x7fe2a014a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a00b44e0 0x7fe2a014a1b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c430 tx=0x7fe29000c8f0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 shutdown_connections 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe28406c8f0 0x7fe28406edb0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2a00b44e0 0x7fe2a014a1b0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2a015f1e0 0x7fe2a01e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 --2- 172.21.15.137:0/4133317518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2a006d2b0 0x7fe2a015e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 >> 172.21.15.137:0/4133317518 conn(0x7fe2a00728a0 msgr2=0x7fe2a00af020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:32.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 shutdown_connections 2024-04-26T22:04:32.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.069+0000 7fe2a8299640 1 -- 172.21.15.137:0/4133317518 wait complete. 2024-04-26T22:04:32.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:04:13.390555+0000', 'modified': '2024-04-26T22:04:31.233209+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7317}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7317': {'gid': 7317, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.137:6837/2128712520', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 2128712520}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 2128712520}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7317, 'qdb_cluster': [7317]} 2024-04-26T22:04:32.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:04:32.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T22:04:32.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.584+0000 7f07052e3640 1 Processor -- start 2024-04-26T22:04:32.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.584+0000 7f07052e3640 1 -- start start 2024-04-26T22:04:32.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f07052e3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f070015f1e0 0x7f070006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f07052e3640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07000b4a10 con 0x7f070006d2b0 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f07052e3640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07000b4cf0 con 0x7f07000b44e0 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f07052e3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f070006eeb0 con 0x7f070015f1e0 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06ff7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f070006d2b0 0x7f07000b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43422/0 (socket says 172.21.15.137:43422) 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06ff7fe640 1 -- 172.21.15.137:0/4157646360 learned_addr learned my addr 172.21.15.137:0/4157646360 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132878583 0 0) 0x7f07000b4a10 con 0x7f070006d2b0 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06e8003520 con 0x7f070006d2b0 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06feffd640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f070015f1e0 0x7f070006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1646617696 0 0) 0x7f06e8003520 con 0x7f070006d2b0 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f070015f1e0 msgr2=0x7f070006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f070015f1e0 0x7f070006e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 >> v1:172.21.15.170:6789/0 conn(0x7f07000b44e0 legacy=0x7f07000ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07000b4fd0 con 0x7f070006d2b0 2024-04-26T22:04:32.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f06f8001670 con 0x7f070006d2b0 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 >> v1:172.21.15.137:6789/0 conn(0x7f070006d2b0 legacy=0x7f07000b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f070015f1e0 0x7f06e80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.585+0000 7f06fdffb640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f06e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fdffb640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e8004d40 0x7f06e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f070006eeb0 con 0x7f06e8004010 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f06e800bb80 con 0x7f06e8004d40 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f06e800bd80 con 0x7f070015f1e0 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f06e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06feffd640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f070015f1e0 0x7f06e80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e8004d40 0x7f06e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fe7fc640 1 -- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f070015f1e0 msgr2=0x7f06e80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f070015f1e0 0x7f06e80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fe7fc640 1 -- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e8004d40 msgr2=0x7f06e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06e8004d40 0x7f06e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.586+0000 7f06fe7fc640 1 -- 172.21.15.137:0/4157646360 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e8003520 con 0x7f06e8004010 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f06e8004800 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f06f4001750 tx=0x7f06e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa4009c31b8b542 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4001370 con 0x7f06e8004010 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f40052d0 con 0x7f06e8004010 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f06fdffb640 1 -- 172.21.15.137:0/4157646360 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f402abe0 con 0x7f06e8004010 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f07052e3640 1 -- 172.21.15.137:0/4157646360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 msgr2=0x7f06e8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f07052e3640 1 --2- 172.21.15.137:0/4157646360 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f06e8004800 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f06f4001750 tx=0x7f06e8005830 comp rx=0 tx=0).stop 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f06ff7fe640 1 -- 172.21.15.137:0/4157646360 reap_dead start 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f07052e3640 1 -- 172.21.15.137:0/4157646360 shutdown_connections 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f07052e3640 1 -- 172.21.15.137:0/4157646360 >> 172.21.15.137:0/4157646360 conn(0x7f07000728a0 msgr2=0x7f0700072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f07052e3640 1 -- 172.21.15.137:0/4157646360 shutdown_connections 2024-04-26T22:04:32.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.587+0000 7f07052e3640 1 -- 172.21.15.137:0/4157646360 wait complete. 2024-04-26T22:04:32.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f07052e3640 1 Processor -- start 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f07052e3640 1 -- start start 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f07052e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f070014fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f07052e3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07001544b0 0x7f0700160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f07052e3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0700160e60 0x7f07001612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f07052e3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f070015f5c0 con 0x7f06e8004010 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f07052e3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f07000b5590 con 0x7f0700160e60 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f07052e3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f07001511c0 con 0x7f07001544b0 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f06feffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f070014fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f06feffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f070014fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58126/0 (socket says 172.21.15.137:58126) 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.589+0000 7f06feffd640 1 -- 172.21.15.137:0/711078983 learned_addr learned my addr 172.21.15.137:0/711078983 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0700160e60 0x7f07001612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06feffd640 1 -- 172.21.15.137:0/711078983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07001544b0 msgr2=0x7f0700160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07001544b0 0x7f0700160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06feffd640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07001544b0 0x7f0700160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06feffd640 1 -- 172.21.15.137:0/711078983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0700160e60 msgr2=0x7f07001612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06feffd640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0700160e60 0x7f07001612c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06feffd640 1 -- 172.21.15.137:0/711078983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0700150380 con 0x7f06e8004010 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0700160e60 0x7f07001612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06feffd640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f070014fe40 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f06f00046d0 tx=0x7f06f0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06e77fe640 1 -- 172.21.15.137:0/711078983 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0015420 con 0x7f06e8004010 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06e77fe640 1 -- 172.21.15.137:0/711078983 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f001a070 con 0x7f06e8004010 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f07052e3640 1 -- 172.21.15.137:0/711078983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07001571a0 con 0x7f06e8004010 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f06e77fe640 1 -- 172.21.15.137:0/711078983 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0015800 con 0x7f06e8004010 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.590+0000 7f07052e3640 1 -- 172.21.15.137:0/711078983 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0700151760 con 0x7f06e8004010 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.591+0000 7f06e77fe640 1 -- 172.21.15.137:0/711078983 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f06f00159a0 con 0x7f06e8004010 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.592+0000 7f06e77fe640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f06ec06c8f0 0x7f06ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.592+0000 7f06e77fe640 1 -- 172.21.15.137:0/711078983 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f06f008c700 con 0x7f06e8004010 2024-04-26T22:04:32.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.592+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f06ec06c8f0 0x7f06ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.592+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f06ec06c8f0 0x7f06ec06edb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f06f4032000 tx=0x7f06f402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.593+0000 7f0707ffd740 1 Processor -- start 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.593+0000 7f0707ffd740 1 -- start start 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 0x5631166a8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 0x5631166c6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56311667e120 0x5631166c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f0707ffd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5631165e2740 con 0x56311667e120 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f0707ffd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56311657e3a0 con 0x5631166a8440 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f0707ffd740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5631165de700 con 0x5631166c5ce0 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56311667e120 0x5631166c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56311667e120 0x5631166c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58136/0 (socket says 172.21.15.137:58136) 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06ff7fe640 1 -- 172.21.15.137:0/2394318046 learned_addr learned my addr 172.21.15.137:0/2394318046 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06feffd640 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 0x5631166a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 0x5631166c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06ff7fe640 1 -- 172.21.15.137:0/2394318046 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 msgr2=0x5631166c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 0x5631166c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06ff7fe640 1 -- 172.21.15.137:0/2394318046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 msgr2=0x5631166a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 0x5631166a8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06ff7fe640 1 -- 172.21.15.137:0/2394318046 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311659a750 con 0x56311667e120 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06feffd640 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 0x5631166a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.594+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56311667e120 0x5631166c43a0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f070006e550 tx=0x7f06f8001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2499ebc458241b7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f06e4ff9640 1 -- 172.21.15.137:0/2394318046 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f801a070 con 0x56311667e120 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f06e4ff9640 1 -- 172.21.15.137:0/2394318046 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f8007180 con 0x56311667e120 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f06e4ff9640 1 -- 172.21.15.137:0/2394318046 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8007550 con 0x56311667e120 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f0707ffd740 1 -- 172.21.15.137:0/2394318046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56311667e120 msgr2=0x5631166c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f0707ffd740 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56311667e120 0x5631166c43a0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f070006e550 tx=0x7f06f8001690 comp rx=0 tx=0).stop 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f0707ffd740 1 -- 172.21.15.137:0/2394318046 shutdown_connections 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f0707ffd740 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56311667e120 0x5631166c43a0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f0707ffd740 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 0x5631166c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f0707ffd740 1 --2- 172.21.15.137:0/2394318046 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 0x5631166a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f0707ffd740 1 -- 172.21.15.137:0/2394318046 >> 172.21.15.137:0/2394318046 conn(0x56311667aa50 msgr2=0x5631166c3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f0707ffd740 1 -- 172.21.15.137:0/2394318046 shutdown_connections 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.595+0000 7f0707ffd740 1 -- 172.21.15.137:0/2394318046 wait complete. 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.596+0000 7f0707ffd740 1 -- start start 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.596+0000 7f0707ffd740 1 Processor -- start 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a8440 0x5631166a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166c5ce0 0x5631166d3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a4b90 0x5631166aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f0707ffd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56311667eec0 con 0x5631166a4b90 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f0707ffd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563116569fe0 con 0x5631166c5ce0 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f0707ffd740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563116678980 con 0x5631166a8440 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f0707ffd740 10 client.0 _ll_register_callbacks cb 0x563116580150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a4b90 0x5631166aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a4b90 0x5631166aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58144/0 (socket says 172.21.15.137:58144) 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ff7fe640 1 -- 172.21.15.137:0/635601762 learned_addr learned my addr 172.21.15.137:0/635601762 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166c5ce0 0x5631166d3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06feffd640 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a8440 0x5631166a4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ff7fe640 1 -- 172.21.15.137:0/635601762 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a8440 msgr2=0x5631166a4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a8440 0x5631166a4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ff7fe640 1 -- 172.21.15.137:0/635601762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166c5ce0 msgr2=0x5631166d3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166c5ce0 0x5631166d3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ff7fe640 1 -- 172.21.15.137:0/635601762 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631162f42d0 con 0x5631166a4b90 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166c5ce0 0x5631166d3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a4b90 0x5631166aacf0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f06f8001050 tx=0x7f07000b4ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e964fddc251cb722 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ddffb640 1 -- 172.21.15.137:0/635601762 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f801a030 con 0x5631166a4b90 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f06ddffb640 1 -- 172.21.15.137:0/635601762 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f06f8014bc0 con 0x5631166a4b90 2024-04-26T22:04:32.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.597+0000 7f0707ffd740 1 -- 172.21.15.137:0/635601762 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f8007180 con 0x5631166a4b90 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f06ddffb640 1 -- 172.21.15.137:0/635601762 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f06f8007750 con 0x5631166a4b90 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f0707ffd740 10 client.7626 fetch_fsmap learned FSMap version 53 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f0707ffd740 1 -- 172.21.15.137:0/635601762 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x5631163be6b0 con 0x5631166a4b90 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f06ddffb640 1 -- 172.21.15.137:0/635601762 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f8007180 con 0x5631166a4b90 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f06ddffb640 1 -- 172.21.15.137:0/635601762 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f06f801f400 con 0x5631166a4b90 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f0707ffd740 10 client.7626 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f0707ffd740 10 client.7626 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f0707ffd740 20 client.7626 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f0707ffd740 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5631166a6800 0x5631166a6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f0707ffd740 4 client.7626 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f0707ffd740 1 -- 172.21.15.137:0/635601762 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631165f0350 con 0x5631166a6800 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f06feffd640 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5631166a6800 0x5631166a6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f06ddffb640 10 client.7626 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.598+0000 7f06feffd640 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5631166a6800 0x5631166a6be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78f58fac1f8291af server_cookie=6f01c9c500c5dc0e in_seq=0 out_seq=0 2024-04-26T22:04:32.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f06ddffb640 1 -- 172.21.15.137:0/635601762 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5631165f0350 con 0x5631166a6800 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f06ddffb640 10 client.7626 handle_command_reply: tid=0 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 client.7626 shutdown 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 -- 172.21.15.137:0/635601762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a4b90 msgr2=0x5631166aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a4b90 0x5631166aacf0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f06f8001050 tx=0x7f07000b4ec0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 -- 172.21.15.137:0/635601762 shutdown_connections 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5631166a6800 0x5631166a6be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a4b90 0x5631166aacf0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166c5ce0 0x5631166d3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f06ddffb640 0 client.7626 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 --2- 172.21.15.137:0/635601762 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a8440 0x5631166a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 -- 172.21.15.137:0/635601762 >> 172.21.15.137:0/635601762 conn(0x56311667e120 msgr2=0x5631166c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 -- 172.21.15.137:0/635601762 shutdown_connections 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 1 -- 172.21.15.137:0/635601762 wait complete. 2024-04-26T22:04:32.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.599+0000 7f0707ffd740 20 client.7626 trim_cache size 0 max 16384 2024-04-26T22:04:32.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.617+0000 7f0707ffd740 1 Processor -- start 2024-04-26T22:04:32.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.617+0000 7f0707ffd740 1 -- start start 2024-04-26T22:04:32.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a4b90 0x56311667e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 0x56311667ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166c5ce0 0x5631166c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f0707ffd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0700200ff0 con 0x5631166c5ce0 2024-04-26T22:04:32.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f0707ffd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0700156990 con 0x5631166a8440 2024-04-26T22:04:32.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f0707ffd740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0700200b50 con 0x5631166a4b90 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166c5ce0 0x5631166c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06ff7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166c5ce0 0x5631166c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58146/0 (socket says 172.21.15.137:58146) 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06ff7fe640 1 -- 172.21.15.137:0/3518530957 learned_addr learned my addr 172.21.15.137:0/3518530957 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/3518530957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 0x56311667ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06feffd640 1 --2- 172.21.15.137:0/3518530957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a4b90 0x56311667e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06ff7fe640 1 -- 172.21.15.137:0/3518530957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a4b90 msgr2=0x56311667e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/3518530957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a4b90 0x56311667e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06ff7fe640 1 -- 172.21.15.137:0/3518530957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 msgr2=0x56311667ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/3518530957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 0x56311667ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06ff7fe640 1 -- 172.21.15.137:0/3518530957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631166baab0 con 0x5631166c5ce0 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/3518530957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166c5ce0 0x5631166c60c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f06f8004c60 tx=0x7f06f801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77bf65758e779ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06dffff640 1 -- 172.21.15.137:0/3518530957 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f801a070 con 0x5631166c5ce0 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06dffff640 1 -- 172.21.15.137:0/3518530957 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f801b040 con 0x5631166c5ce0 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.618+0000 7f06dffff640 1 -- 172.21.15.137:0/3518530957 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f802f070 con 0x5631166c5ce0 2024-04-26T22:04:32.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 -- 172.21.15.137:0/3518530957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166c5ce0 msgr2=0x5631166c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 --2- 172.21.15.137:0/3518530957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166c5ce0 0x5631166c60c0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f06f8004c60 tx=0x7f06f801d000 comp rx=0 tx=0).stop 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 -- 172.21.15.137:0/3518530957 shutdown_connections 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 --2- 172.21.15.137:0/3518530957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166c5ce0 0x5631166c60c0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 --2- 172.21.15.137:0/3518530957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a8440 0x56311667ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 --2- 172.21.15.137:0/3518530957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166a4b90 0x56311667e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 -- 172.21.15.137:0/3518530957 >> 172.21.15.137:0/3518530957 conn(0x56311667e120 msgr2=0x563116673f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 -- 172.21.15.137:0/3518530957 shutdown_connections 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 -- 172.21.15.137:0/3518530957 wait complete. 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.619+0000 7f0707ffd740 1 -- start start 2024-04-26T22:04:32.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f0707ffd740 1 Processor -- start 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a4b90 0x56311667e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a8440 0x56311667ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f0707ffd740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 0x563116677670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f0707ffd740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5631166ac190 con 0x5631166a8440 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f0707ffd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5631166aa210 con 0x5631166a4b90 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f0707ffd740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5631166c4480 con 0x5631166c5ce0 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f0707ffd740 10 client.0 _ll_register_callbacks cb 0x7f06f8018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f06fe7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a8440 0x56311667ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f06fe7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a8440 0x56311667ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58150/0 (socket says 172.21.15.137:58150) 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f06fe7fc640 1 -- 172.21.15.137:0/274762687 learned_addr learned my addr 172.21.15.137:0/274762687 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.620+0000 7f06feffd640 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a4b90 0x56311667e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 0x563116677670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06fe7fc640 1 -- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 msgr2=0x563116677670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 0x563116677670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06fe7fc640 1 -- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a4b90 msgr2=0x56311667e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a4b90 0x56311667e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06fe7fc640 1 -- 172.21.15.137:0/274762687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631166a3fd0 con 0x5631166a8440 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06feffd640 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a4b90 0x56311667e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06ff7fe640 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 0x563116677670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06fe7fc640 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a8440 0x56311667ea40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f06f402a590 tx=0x7f06f4001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac299e551025089 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06ddffb640 1 -- 172.21.15.137:0/274762687 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f404e070 con 0x5631166a8440 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06ddffb640 1 -- 172.21.15.137:0/274762687 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f06f4007590 con 0x5631166a8440 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f0707ffd740 1 -- 172.21.15.137:0/274762687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f801b040 con 0x5631166a8440 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06ddffb640 1 -- 172.21.15.137:0/274762687 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f06f4056050 con 0x5631166a8440 2024-04-26T22:04:32.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f0707ffd740 10 client.7632 fetch_fsmap learned FSMap version 53 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f0707ffd740 1 -- 172.21.15.137:0/274762687 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x5631166e6cd0 con 0x5631166a8440 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06ddffb640 1 -- 172.21.15.137:0/274762687 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f801b040 con 0x5631166a8440 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f06ddffb640 1 -- 172.21.15.137:0/274762687 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f06f4059020 con 0x5631166a8440 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f0707ffd740 10 client.7632 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f0707ffd740 10 client.7632 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f0707ffd740 20 client.7632 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f0707ffd740 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563116677e60 0x5631166dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f0707ffd740 4 client.7632 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.621+0000 7f0707ffd740 1 -- 172.21.15.137:0/274762687 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "status"}) -- 0x5631165ea1c0 con 0x563116677e60 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f06feffd640 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563116677e60 0x5631166dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f06ddffb640 10 client.7632 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f06feffd640 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563116677e60 0x5631166dcf80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b62f1d7fc5b9cf11 server_cookie=ad9335e18122b6eb in_seq=0 out_seq=0 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f06ddffb640 1 -- 172.21.15.137:0/274762687 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5631165ea1c0 con 0x563116677e60 2024-04-26T22:04:32.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f06ddffb640 10 client.7632 handle_command_reply: tid=0 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 client.7632 shutdown 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 -- 172.21.15.137:0/274762687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a8440 msgr2=0x56311667ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a8440 0x56311667ea40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f06f402a590 tx=0x7f06f4001190 comp rx=0 tx=0).stop 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 -- 172.21.15.137:0/274762687 shutdown_connections 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563116677e60 0x5631166dcf80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5631166a8440 0x56311667ea40 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5631166c5ce0 0x563116677670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f06ddffb640 0 client.7632 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 --2- 172.21.15.137:0/274762687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5631166a4b90 0x56311667e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 -- 172.21.15.137:0/274762687 >> 172.21.15.137:0/274762687 conn(0x56311667e120 msgr2=0x5631166bbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 -- 172.21.15.137:0/274762687 shutdown_connections 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 1 -- 172.21.15.137:0/274762687 wait complete. 2024-04-26T22:04:32.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.622+0000 7f0707ffd740 20 client.7632 trim_cache size 0 max 16384 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 7317, 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.3926105809999996, 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 53, 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 90, 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 90, 2024-04-26T22:04:32.629 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 23.649743568000002 2024-04-26T22:04:32.630 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:04:32.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 -- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f06ec06c8f0 msgr2=0x7f06ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f06ec06c8f0 0x7f06ec06edb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f06f4032000 tx=0x7f06f402e000 comp rx=0 tx=0).stop 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 -- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 msgr2=0x7f070014fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f070014fe40 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f06f00046d0 tx=0x7f06f0007700 comp rx=0 tx=0).stop 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 -- 172.21.15.137:0/711078983 shutdown_connections 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f06ec06c8f0 0x7f06ec06edb0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0700160e60 0x7f07001612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f07001544b0 0x7f0700160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 --2- 172.21.15.137:0/711078983 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06e8004010 0x7f070014fe40 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 -- 172.21.15.137:0/711078983 >> 172.21.15.137:0/711078983 conn(0x7f07000728a0 msgr2=0x7f0700159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 -- 172.21.15.137:0/711078983 shutdown_connections 2024-04-26T22:04:32.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.623+0000 7f07052e3640 1 -- 172.21.15.137:0/711078983 wait complete. 2024-04-26T22:04:32.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:04:32.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.729+0000 7f5d620f1640 1 Processor -- start 2024-04-26T22:04:32.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.729+0000 7f5d620f1640 1 -- start start 2024-04-26T22:04:32.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d620f1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5d5c145980 0x7f5d5c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d620f1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5d5c0b3de0 0x7f5d5c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d620f1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d5c0b4260 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d620f1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5d5c0b5140 con 0x7f5d5c0b3de0 2024-04-26T22:04:32.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d620f1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5d5c0b6410 con 0x7f5d5c145980 2024-04-26T22:04:32.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5affd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5d5c0b3de0 0x7f5d5c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5bfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5d5c0b5fd0 0x7f5d5c15c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43428/0 (socket says 172.21.15.137:43428) 2024-04-26T22:04:32.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5bfff640 1 -- 172.21.15.137:0/2405378981 learned_addr learned my addr 172.21.15.137:0/2405378981 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5affd640 1 -- 172.21.15.137:0/2405378981 >> v2:172.21.15.170:3300/0 conn(0x7f5d5c145980 msgr2=0x7f5d5c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5b7fe640 1 --2- 172.21.15.137:0/2405378981 >> v2:172.21.15.170:3300/0 conn(0x7f5d5c145980 0x7f5d5c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5affd640 1 --2- 172.21.15.137:0/2405378981 >> v2:172.21.15.170:3300/0 conn(0x7f5d5c145980 0x7f5d5c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5a7fc640 1 -- 172.21.15.137:0/2405378981 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859992776 0 0) 0x7f5d5c0b4260 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5affd640 1 -- 172.21.15.137:0/2405378981 >> v1:172.21.15.137:6789/0 conn(0x7f5d5c0b5fd0 legacy=0x7f5d5c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5affd640 1 -- 172.21.15.137:0/2405378981 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5c0b4530 con 0x7f5d5c0b3de0 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.730+0000 7f5d5b7fe640 1 --2- 172.21.15.137:0/2405378981 >> v2:172.21.15.170:3300/0 conn(0x7f5d5c145980 0x7f5d5c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.731+0000 7f5d5affd640 1 --2- 172.21.15.137:0/2405378981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b3de0 0x7f5d5c0b5a90 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c06ff10 tx=0x7f5d5002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77a30188ff3059 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.731+0000 7f5d5a7fc640 1 -- 172.21.15.137:0/2405378981 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50037070 con 0x7f5d5c0b3de0 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.731+0000 7f5d5a7fc640 1 -- 172.21.15.137:0/2405378981 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d50032440 con 0x7f5d5c0b3de0 2024-04-26T22:04:32.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.731+0000 7f5d5a7fc640 1 -- 172.21.15.137:0/2405378981 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5002ae60 con 0x7f5d5c0b3de0 2024-04-26T22:04:32.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.732+0000 7f5d620f1640 1 -- 172.21.15.137:0/2405378981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b3de0 msgr2=0x7f5d5c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.732+0000 7f5d620f1640 1 --2- 172.21.15.137:0/2405378981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b3de0 0x7f5d5c0b5a90 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c06ff10 tx=0x7f5d5002a110 comp rx=0 tx=0).stop 2024-04-26T22:04:32.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.732+0000 7f5d620f1640 1 -- 172.21.15.137:0/2405378981 shutdown_connections 2024-04-26T22:04:32.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.732+0000 7f5d620f1640 1 --2- 172.21.15.137:0/2405378981 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b3de0 0x7f5d5c0b5a90 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.732+0000 7f5d620f1640 1 --2- 172.21.15.137:0/2405378981 >> v2:172.21.15.170:3300/0 conn(0x7f5d5c145980 0x7f5d5c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.732+0000 7f5d620f1640 1 -- 172.21.15.137:0/2405378981 >> 172.21.15.137:0/2405378981 conn(0x7f5d5c0d0d30 msgr2=0x7f5d5c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.732+0000 7f5d620f1640 1 -- 172.21.15.137:0/2405378981 shutdown_connections 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.732+0000 7f5d620f1640 1 -- 172.21.15.137:0/2405378981 wait complete. 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.733+0000 7f5d620f1640 1 Processor -- start 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.733+0000 7f5d620f1640 1 -- start start 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d620f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d5c0b3de0 0x7f5d5c15af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d620f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b5fd0 0x7f5d5c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d620f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d5c145980 0x7f5d5c0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d620f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c0b4dd0 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d620f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5c0b4af0 con 0x7f5d5c145980 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d620f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5d5c0730e0 con 0x7f5d5c0b3de0 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b5fd0 0x7f5d5c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5affd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b5fd0 0x7f5d5c0cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58166/0 (socket says 172.21.15.137:58166) 2024-04-26T22:04:32.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5affd640 1 -- 172.21.15.137:0/2971285197 learned_addr learned my addr 172.21.15.137:0/2971285197 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5bfff640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d5c145980 0x7f5d5c0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5b7fe640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d5c0b3de0 0x7f5d5c15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5affd640 1 -- 172.21.15.137:0/2971285197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d5c0b3de0 msgr2=0x7f5d5c15af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5affd640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d5c0b3de0 0x7f5d5c15af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5affd640 1 -- 172.21.15.137:0/2971285197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d5c145980 msgr2=0x7f5d5c0cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5affd640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d5c145980 0x7f5d5c0cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5affd640 1 -- 172.21.15.137:0/2971285197 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5c15b4b0 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5b7fe640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d5c0b3de0 0x7f5d5c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.734+0000 7f5d5affd640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b5fd0 0x7f5d5c0cf5a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009890 tx=0x7f5d500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.735+0000 7f5d43fff640 1 -- 172.21.15.137:0/2971285197 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50037040 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.735+0000 7f5d43fff640 1 -- 172.21.15.137:0/2971285197 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d50042070 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.735+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5c137f70 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.735+0000 7f5d43fff640 1 -- 172.21.15.137:0/2971285197 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50030bd0 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.735+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d5c138530 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.736+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d5c06a290 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.736+0000 7f5d43fff640 1 -- 172.21.15.137:0/2971285197 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d50047460 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.737+0000 7f5d43fff640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5d4806c920 0x7f5d4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:32.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.737+0000 7f5d43fff640 1 -- 172.21.15.137:0/2971285197 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f5d500ac830 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.737+0000 7f5d5b7fe640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5d4806c920 0x7f5d4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:32.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.737+0000 7f5d5b7fe640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5d4806c920 0x7f5d4806ede0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c006fd0 tx=0x7f5d4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:32.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.741+0000 7f5d43fff640 1 -- 172.21.15.137:0/2971285197 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5d50032e20 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.954+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5d5c0b2890 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.954+0000 7f5d43fff640 1 -- 172.21.15.137:0/2971285197 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) ==== 53+0+73 (secure 0 0 0) 0x7f5d5007abf0 con 0x7f5d5c0b5fd0 2024-04-26T22:04:32.954 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5d4806c920 msgr2=0x7f5d4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5d4806c920 0x7f5d4806ede0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c006fd0 tx=0x7f5d4c008040 comp rx=0 tx=0).stop 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b5fd0 msgr2=0x7f5d5c0cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b5fd0 0x7f5d5c0cf5a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f5d50009890 tx=0x7f5d500046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 shutdown_connections 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5d4806c920 0x7f5d4806ede0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5d5c0b5fd0 0x7f5d5c0cf5a0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d5c145980 0x7f5d5c0cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 --2- 172.21.15.137:0/2971285197 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5d5c0b3de0 0x7f5d5c15af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 >> 172.21.15.137:0/2971285197 conn(0x7f5d5c0d0d30 msgr2=0x7f5d5c13ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.956+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 shutdown_connections 2024-04-26T22:04:32.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:32.957+0000 7f5d620f1640 1 -- 172.21.15.137:0/2971285197 wait complete. 2024-04-26T22:04:32.967 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:04:32.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:04:32.967 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:04:32.967 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:04:32.968 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:04:32.968 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:04:32.968 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:04:32.968 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:04:32.968 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:04:32.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:32.968 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:04:32.983 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:04:32.983 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:04:32.983 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:04:32.983 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:04:32.984 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42433sec preferred_lft 42433sec 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:04:32.985 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:04:32.986 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:04:32.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:32.986 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:04:33.047 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:04:33.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:33.048 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:04:33.104 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:04:33.105 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:04:33.105 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:04:33.105 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:04:33.105 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:04:33.105 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:04:33.105 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:04:33.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:04:33.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:04:33.105 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:04:33.106 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:04:33.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:04:33.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:04:33.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:33.229 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:04:33.243 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:04:33.243 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:04:33.243 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:04:33.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:33.244 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:04:33.307 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:04:33.308 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:04:33.362 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:04:33.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:04:33.363 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:04:33.417 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:04:33.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:33.417 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:04:33.498 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:04:33.499 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:04:33.516 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:04:33.517 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:04:33.517 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:04:33.517 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:04:33.517 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:04:33.519 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:04:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:04:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:04:33.519 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:04:33.520 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:04:33.520 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:04:33.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:33.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:04:33.583 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:04:33.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:04:33.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:04:33.678 INFO:teuthology.orchestra.run.smithi137.stdout:client5966 2024-04-26T22:04:33.679 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:04:33.679 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:04:33.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:33.694 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-04-26T22:04:33.752 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:04:33.752+0000 7fa56fcb9640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-26T22:04:33.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:04:33.754 INFO:teuthology.orchestra.run.smithi137.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-04-26T22:04:33.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:33.754 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-04-26T22:04:33.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.896+0000 7f2c4f683640 1 Processor -- start 2024-04-26T22:04:33.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.896+0000 7f2c4f683640 1 -- start start 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4f683640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c4806e330 0x7f2c480d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4f683640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2c480d16d0 0x7f2c480cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4f683640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c480d1ae0 con 0x7f2c481454c0 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4f683640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2c480721a0 con 0x7f2c4806e330 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4f683640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2c480ceca0 con 0x7f2c480d16d0 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4cc1e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c4806e330 0x7f2c480d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4cc1e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c4806e330 0x7f2c480d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58170/0 (socket says 172.21.15.137:58170) 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4d41f640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2c481454c0 0x7f2c480d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43432/0 (socket says 172.21.15.137:43432) 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4cc1e640 1 -- 172.21.15.137:0/1291040865 learned_addr learned my addr 172.21.15.137:0/1291040865 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4cc1e640 1 -- 172.21.15.137:0/1291040865 >> v2:172.21.15.170:3300/0 conn(0x7f2c480d16d0 msgr2=0x7f2c480cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4cc1e640 1 --2- 172.21.15.137:0/1291040865 >> v2:172.21.15.170:3300/0 conn(0x7f2c480d16d0 0x7f2c480cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4cc1e640 1 -- 172.21.15.137:0/1291040865 >> v1:172.21.15.137:6789/0 conn(0x7f2c481454c0 legacy=0x7f2c480d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c4cc1e640 1 -- 172.21.15.137:0/1291040865 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4806e830 con 0x7f2c4806e330 2024-04-26T22:04:33.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.897+0000 7f2c3ffff640 1 -- 172.21.15.137:0/1291040865 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217498316 0 0) 0x7f2c44001110 con 0x7f2c481454c0 2024-04-26T22:04:33.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.898+0000 7f2c4cc1e640 1 --2- 172.21.15.137:0/1291040865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c4806e330 0x7f2c480d1190 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b44a0 tx=0x7f2c3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feeab77ecbc2df54 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:33.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.898+0000 7f2c3ffff640 1 -- 172.21.15.137:0/1291040865 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c38037070 con 0x7f2c4806e330 2024-04-26T22:04:33.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.898+0000 7f2c3ffff640 1 -- 172.21.15.137:0/1291040865 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c38032440 con 0x7f2c4806e330 2024-04-26T22:04:33.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.898+0000 7f2c3ffff640 1 -- 172.21.15.137:0/1291040865 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c38032810 con 0x7f2c4806e330 2024-04-26T22:04:33.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.898+0000 7f2c4f683640 1 -- 172.21.15.137:0/1291040865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c4806e330 msgr2=0x7f2c480d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.898+0000 7f2c4f683640 1 --2- 172.21.15.137:0/1291040865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c4806e330 0x7f2c480d1190 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b44a0 tx=0x7f2c3802a270 comp rx=0 tx=0).stop 2024-04-26T22:04:33.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.899+0000 7f2c4f683640 1 -- 172.21.15.137:0/1291040865 shutdown_connections 2024-04-26T22:04:33.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.899+0000 7f2c4f683640 1 --2- 172.21.15.137:0/1291040865 >> v2:172.21.15.170:3300/0 conn(0x7f2c480d16d0 0x7f2c480cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.899+0000 7f2c4f683640 1 --2- 172.21.15.137:0/1291040865 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c4806e330 0x7f2c480d1190 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.899+0000 7f2c4f683640 1 -- 172.21.15.137:0/1291040865 >> 172.21.15.137:0/1291040865 conn(0x7f2c4806c690 msgr2=0x7f2c4806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:33.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.899+0000 7f2c4f683640 1 -- 172.21.15.137:0/1291040865 shutdown_connections 2024-04-26T22:04:33.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.899+0000 7f2c4f683640 1 -- 172.21.15.137:0/1291040865 wait complete. 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.900+0000 7f2c4f683640 1 Processor -- start 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.900+0000 7f2c4f683640 1 -- start start 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.900+0000 7f2c4f683640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c4806e330 0x7f2c48073f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.900+0000 7f2c4f683640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c480d16d0 0x7f2c481f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.900+0000 7f2c4f683640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c481454c0 0x7f2c48159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.900+0000 7f2c4f683640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4806f0d0 con 0x7f2c481454c0 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.900+0000 7f2c4f683640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4806edf0 con 0x7f2c480d16d0 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.900+0000 7f2c4f683640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4815d8a0 con 0x7f2c4806e330 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c481454c0 0x7f2c48159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c481454c0 0x7f2c48159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58182/0 (socket says 172.21.15.137:58182) 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4dc20640 1 -- 172.21.15.137:0/3308621690 learned_addr learned my addr 172.21.15.137:0/3308621690 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4cc1e640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c480d16d0 0x7f2c481f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c4806e330 0x7f2c48073f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4dc20640 1 -- 172.21.15.137:0/3308621690 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c4806e330 msgr2=0x7f2c48073f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c4806e330 0x7f2c48073f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4dc20640 1 -- 172.21.15.137:0/3308621690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c480d16d0 msgr2=0x7f2c481f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c480d16d0 0x7f2c481f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4dc20640 1 -- 172.21.15.137:0/3308621690 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c481f4ac0 con 0x7f2c481454c0 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4cc1e640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c480d16d0 0x7f2c481f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c481454c0 0x7f2c48159370 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b970 tx=0x7f2c4000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c3dffb640 1 -- 172.21.15.137:0/3308621690 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40019070 con 0x7f2c481454c0 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c3dffb640 1 -- 172.21.15.137:0/3308621690 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4000cb60 con 0x7f2c481454c0 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4f683640 1 -- 172.21.15.137:0/3308621690 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c481598b0 con 0x7f2c481454c0 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c3dffb640 1 -- 172.21.15.137:0/3308621690 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40014440 con 0x7f2c481454c0 2024-04-26T22:04:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.901+0000 7f2c4f683640 1 -- 172.21.15.137:0/3308621690 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c481f5020 con 0x7f2c481454c0 2024-04-26T22:04:33.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.903+0000 7f2c3dffb640 1 -- 172.21.15.137:0/3308621690 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c4001c070 con 0x7f2c481454c0 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.903+0000 7f2c3dffb640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2c2c06c8f0 0x7f2c2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.903+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2c2c06c8f0 0x7f2c2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.903+0000 7f2c3dffb640 1 -- 172.21.15.137:0/3308621690 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f2c4008b980 con 0x7f2c481454c0 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.904+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2c2c06c8f0 0x7f2c2c06edb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2c44000f60 tx=0x7f2c44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.904+0000 7f2c523a7740 1 Processor -- start 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.904+0000 7f2c523a7740 1 -- start start 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f49110 0x55cd34f4c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f4cdd0 0x55cd34f68d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f696b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c523a7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cd34e86980 con 0x55cd34f69250 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c523a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55cd34e40990 con 0x55cd34f4cdd0 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c523a7740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55cd34e82940 con 0x55cd34f49110 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f696b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58192/0 (socket says 172.21.15.137:58192) 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4dc20640 1 -- 172.21.15.137:0/939714967 learned_addr learned my addr 172.21.15.137:0/939714967 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4cc1e640 1 --2- 172.21.15.137:0/939714967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f4cdd0 0x55cd34f68d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/939714967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f49110 0x55cd34f4c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4dc20640 1 -- 172.21.15.137:0/939714967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f49110 msgr2=0x55cd34f4c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/939714967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f49110 0x55cd34f4c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4dc20640 1 -- 172.21.15.137:0/939714967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f4cdd0 msgr2=0x55cd34f68d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/939714967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f4cdd0 0x55cd34f68d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.905+0000 7f2c4dc20640 1 -- 172.21.15.137:0/939714967 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd34e4bcd0 con 0x55cd34f69250 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/939714967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f696b0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2c40089d30 tx=0x7f2c40059680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a374f40d98b42942 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c32ffd640 1 -- 172.21.15.137:0/939714967 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c400578c0 con 0x55cd34f69250 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c32ffd640 1 -- 172.21.15.137:0/939714967 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40055c30 con 0x55cd34f69250 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c32ffd640 1 -- 172.21.15.137:0/939714967 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40061f30 con 0x55cd34f69250 2024-04-26T22:04:33.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c523a7740 1 -- 172.21.15.137:0/939714967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 msgr2=0x55cd34f696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c523a7740 1 --2- 172.21.15.137:0/939714967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f696b0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2c40089d30 tx=0x7f2c40059680 comp rx=0 tx=0).stop 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c523a7740 1 -- 172.21.15.137:0/939714967 shutdown_connections 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c523a7740 1 --2- 172.21.15.137:0/939714967 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f696b0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c523a7740 1 --2- 172.21.15.137:0/939714967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f4cdd0 0x55cd34f68d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c523a7740 1 --2- 172.21.15.137:0/939714967 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f49110 0x55cd34f4c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c523a7740 1 -- 172.21.15.137:0/939714967 >> 172.21.15.137:0/939714967 conn(0x55cd34f1f380 msgr2=0x55cd34f200f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c523a7740 1 -- 172.21.15.137:0/939714967 shutdown_connections 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.906+0000 7f2c523a7740 1 -- 172.21.15.137:0/939714967 wait complete. 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.907+0000 7f2c523a7740 1 -- start start 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.907+0000 7f2c523a7740 1 Processor -- start 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f34d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f69250 0x55cd34f48ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f64870 0x55cd34f4fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c523a7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cd34f1d1b0 con 0x55cd34f64870 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c523a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55cd34e0de50 con 0x55cd34f69250 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c523a7740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55cd34f1d490 con 0x55cd34f4cdd0 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c523a7740 10 client.0 _ll_register_callbacks cb 0x55cd34e31fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f64870 0x55cd34f4fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f64870 0x55cd34f4fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58202/0 (socket says 172.21.15.137:58202) 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4dc20640 1 -- 172.21.15.137:0/2458254709 learned_addr learned my addr 172.21.15.137:0/2458254709 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f34d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4dc20640 1 -- 172.21.15.137:0/2458254709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 msgr2=0x55cd34f34d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4cc1e640 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f69250 0x55cd34f48ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f34d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4dc20640 1 -- 172.21.15.137:0/2458254709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f69250 msgr2=0x55cd34f48ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f69250 0x55cd34f48ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.915 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4dc20640 1 -- 172.21.15.137:0/2458254709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd34c647b0 con 0x55cd34f64870 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f34d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f64870 0x55cd34f4fb80 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2c40055a20 tx=0x7f2c40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5168eaebb88bc4ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c27fff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.908+0000 7f2c27fff640 1 -- 172.21.15.137:0/2458254709 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40058c10 con 0x55cd34f64870 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c27fff640 1 -- 172.21.15.137:0/2458254709 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f2c4005eb00 con 0x55cd34f64870 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c523a7740 1 -- 172.21.15.137:0/2458254709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c40055c30 con 0x55cd34f64870 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c27fff640 1 -- 172.21.15.137:0/2458254709 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f2c40055310 con 0x55cd34f64870 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c523a7740 10 client.7656 fetch_fsmap learned FSMap version 53 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c523a7740 1 -- 172.21.15.137:0/2458254709 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55cd34cc4f40 con 0x55cd34f64870 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c27fff640 1 -- 172.21.15.137:0/2458254709 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40055c30 con 0x55cd34f64870 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c27fff640 1 -- 172.21.15.137:0/2458254709 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f2c400554b0 con 0x55cd34f64870 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c523a7740 10 client.7656 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c523a7740 10 client.7656 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c523a7740 20 client.7656 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:33.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c523a7740 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x55cd34f64cd0 0x55cd34f61e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c523a7740 4 client.7656 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c523a7740 1 -- 172.21.15.137:0/2458254709 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd34e94590 con 0x55cd34f64cd0 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x55cd34f64cd0 0x55cd34f61e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c27fff640 10 client.7656 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.909+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x55cd34f64cd0 0x55cd34f61e30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7d2bbb838fd1ab4 server_cookie=4fddbbc10d2d614f in_seq=0 out_seq=0 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c27fff640 1 -- 172.21.15.137:0/2458254709 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd34e94590 con 0x55cd34f64cd0 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c27fff640 10 client.7656 handle_command_reply: tid=0 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 client.7656 shutdown 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 -- 172.21.15.137:0/2458254709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f64870 msgr2=0x55cd34f4fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f64870 0x55cd34f4fb80 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f2c40055a20 tx=0x7f2c40004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 -- 172.21.15.137:0/2458254709 shutdown_connections 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x55cd34f64cd0 0x55cd34f61e30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f64870 0x55cd34f4fb80 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f69250 0x55cd34f48ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 --2- 172.21.15.137:0/2458254709 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f34d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c27fff640 0 client.7656 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 -- 172.21.15.137:0/2458254709 >> 172.21.15.137:0/2458254709 conn(0x55cd34f49110 msgr2=0x55cd34f1bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 -- 172.21.15.137:0/2458254709 shutdown_connections 2024-04-26T22:04:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 1 -- 172.21.15.137:0/2458254709 wait complete. 2024-04-26T22:04:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.910+0000 7f2c523a7740 20 client.7656 trim_cache size 0 max 16384 2024-04-26T22:04:33.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c523a7740 1 Processor -- start 2024-04-26T22:04:33.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c523a7740 1 -- start start 2024-04-26T22:04:33.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 0x55cd34f67690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f44fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c523a7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c481fd630 con 0x55cd34f69250 2024-04-26T22:04:33.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c523a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480b1ba0 con 0x55cd34f64870 2024-04-26T22:04:33.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c523a7740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2c480b0f00 con 0x55cd34f4cdd0 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f44fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.928+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f44fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58208/0 (socket says 172.21.15.137:58208) 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4dc20640 1 -- 172.21.15.137:0/4075431590 learned_addr learned my addr 172.21.15.137:0/4075431590 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4cc1e640 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 0x55cd34f67690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4dc20640 1 -- 172.21.15.137:0/4075431590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 msgr2=0x55cd34f488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4dc20640 1 -- 172.21.15.137:0/4075431590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 msgr2=0x55cd34f67690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 0x55cd34f67690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4dc20640 1 -- 172.21.15.137:0/4075431590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd34f69080 con 0x55cd34f69250 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4cc1e640 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 0x55cd34f67690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f44fe0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f2c400096e0 tx=0x7f2c4005c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6a17fd1ef372b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c327fc640 1 -- 172.21.15.137:0/4075431590 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40058480 con 0x55cd34f69250 2024-04-26T22:04:33.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c327fc640 1 -- 172.21.15.137:0/4075431590 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40058710 con 0x55cd34f69250 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.929+0000 7f2c327fc640 1 -- 172.21.15.137:0/4075431590 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c400090a0 con 0x55cd34f69250 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 -- 172.21.15.137:0/4075431590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 msgr2=0x55cd34f44fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f44fe0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f2c400096e0 tx=0x7f2c4005c040 comp rx=0 tx=0).stop 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 -- 172.21.15.137:0/4075431590 shutdown_connections 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f44fe0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 0x55cd34f67690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 --2- 172.21.15.137:0/4075431590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 -- 172.21.15.137:0/4075431590 >> 172.21.15.137:0/4075431590 conn(0x55cd34f49110 msgr2=0x55cd34f1e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 -- 172.21.15.137:0/4075431590 shutdown_connections 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 -- 172.21.15.137:0/4075431590 wait complete. 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 -- start start 2024-04-26T22:04:33.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.930+0000 7f2c523a7740 1 Processor -- start 2024-04-26T22:04:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f44fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 0x55cd34f45520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c523a7740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f61870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c523a7740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55cd34f62a40 con 0x55cd34f69250 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c523a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2c480b1550 con 0x55cd34f64870 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c523a7740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55cd34f1e340 con 0x55cd34f4cdd0 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c523a7740 10 client.0 _ll_register_callbacks cb 0x7f2c40070070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f61870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c4dc20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f61870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58210/0 (socket says 172.21.15.137:58210) 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c4dc20640 1 -- 172.21.15.137:0/3341659363 learned_addr learned my addr 172.21.15.137:0/3341659363 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f44fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.931+0000 7f2c4cc1e640 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 0x55cd34f45520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c4dc20640 1 -- 172.21.15.137:0/3341659363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 msgr2=0x55cd34f44fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f44fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c4dc20640 1 -- 172.21.15.137:0/3341659363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 msgr2=0x55cd34f45520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 0x55cd34f45520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c4dc20640 1 -- 172.21.15.137:0/3341659363 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd34b580a0 con 0x55cd34f69250 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c4dc20640 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f61870 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2c40059550 tx=0x7f2c40004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf38c7fa74c262f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c27fff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c27fff640 1 -- 172.21.15.137:0/3341659363 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c400554b0 con 0x55cd34f69250 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c27fff640 1 -- 172.21.15.137:0/3341659363 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f2c40058a10 con 0x55cd34f69250 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c523a7740 1 -- 172.21.15.137:0/3341659363 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c40058710 con 0x55cd34f69250 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c27fff640 1 -- 172.21.15.137:0/3341659363 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f2c40067050 con 0x55cd34f69250 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c523a7740 10 client.7662 fetch_fsmap learned FSMap version 53 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c523a7740 1 -- 172.21.15.137:0/3341659363 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55cd34fdbd30 con 0x55cd34f69250 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c27fff640 1 -- 172.21.15.137:0/3341659363 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40058710 con 0x55cd34f69250 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c27fff640 1 -- 172.21.15.137:0/3341659363 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f2c4006a020 con 0x55cd34f69250 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c523a7740 10 client.7662 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c523a7740 10 client.7662 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:04:33.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c523a7740 20 client.7662 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c523a7740 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x55cd34f1ce20 0x55cd34f61db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c523a7740 4 client.7662 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c523a7740 1 -- 172.21.15.137:0/3341659363 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) -- 0x55cd34e8e400 con 0x55cd34f1ce20 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.932+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x55cd34f1ce20 0x55cd34f61db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c27fff640 10 client.7662 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c4d41f640 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x55cd34f1ce20 0x55cd34f61db0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf25c1e01322bda8 server_cookie=81d913f51df8748e in_seq=0 out_seq=0 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c27fff640 1 -- 172.21.15.137:0/3341659363 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cd34e8e400 con 0x55cd34f1ce20 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c27fff640 10 client.7662 handle_command_reply: tid=0 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 client.7662 shutdown 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 -- 172.21.15.137:0/3341659363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 msgr2=0x55cd34f61870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f61870 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2c40059550 tx=0x7f2c40004b50 comp rx=0 tx=0).stop 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 -- 172.21.15.137:0/3341659363 shutdown_connections 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x55cd34f1ce20 0x55cd34f61db0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55cd34f69250 0x55cd34f61870 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd34f64870 0x55cd34f45520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 --2- 172.21.15.137:0/3341659363 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55cd34f4cdd0 0x55cd34f44fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 -- 172.21.15.137:0/3341659363 >> 172.21.15.137:0/3341659363 conn(0x55cd34f49110 msgr2=0x55cd34f4e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c27fff640 0 client.7662 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:33.940 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:04:33.933+0000 7fa56fcb9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-26T22:04:24.418706+0000 1=1+0) n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x5596f393e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-26T22:04:24.418706+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-26T22:04:33.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 -- 172.21.15.137:0/3341659363 shutdown_connections 2024-04-26T22:04:33.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 1 -- 172.21.15.137:0/3341659363 wait complete. 2024-04-26T22:04:33.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.933+0000 7f2c523a7740 20 client.7662 trim_cache size 0 max 16384 2024-04-26T22:04:33.941 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:04:33.941 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:04:33.941 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "6b169d43-698d-4370-9a99-d018259b1ad2", 2024-04-26T22:04:33.941 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:04:33.941 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:04:33.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 -- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2c2c06c8f0 msgr2=0x7f2c2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2c2c06c8f0 0x7f2c2c06edb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2c44000f60 tx=0x7f2c44009040 comp rx=0 tx=0).stop 2024-04-26T22:04:33.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 -- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c481454c0 msgr2=0x7f2c48159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:33.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c481454c0 0x7f2c48159370 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000b970 tx=0x7f2c4000be30 comp rx=0 tx=0).stop 2024-04-26T22:04:33.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 -- 172.21.15.137:0/3308621690 shutdown_connections 2024-04-26T22:04:33.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2c2c06c8f0 0x7f2c2c06edb0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c481454c0 0x7f2c48159370 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c480d16d0 0x7f2c481f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 --2- 172.21.15.137:0/3308621690 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c4806e330 0x7f2c48073f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:33.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 -- 172.21.15.137:0/3308621690 >> 172.21.15.137:0/3308621690 conn(0x7f2c4806c690 msgr2=0x7f2c480cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:33.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 -- 172.21.15.137:0/3308621690 shutdown_connections 2024-04-26T22:04:33.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:33.934+0000 7f2c4f683640 1 -- 172.21.15.137:0/3308621690 wait complete. 2024-04-26T22:04:33.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:33.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-26T22:04:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.043+0000 7f0c3f31c640 1 Processor -- start 2024-04-26T22:04:34.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.044+0000 7f0c3f31c640 1 -- start start 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.044+0000 7f0c3f31c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0c380d3820 0x7f0c380b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.044+0000 7f0c3f31c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 0x7f0c380d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.044+0000 7f0c3f31c640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c380d3c90 con 0x7f0c3815f680 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.044+0000 7f0c3f31c640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3815fa60 con 0x7f0c380d3820 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.044+0000 7f0c3f31c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0c380d3f50 con 0x7f0c380b60b0 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.044+0000 7f0c3c8b7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0c380d3820 0x7f0c380b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c3c8b7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0c380d3820 0x7f0c380b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58226/0 (socket says 172.21.15.137:58226) 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c3d0b8640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0c3815f680 0x7f0c38163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:43446/0 (socket says 172.21.15.137:43446) 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c3c8b7640 1 -- 172.21.15.137:0/1107214386 learned_addr learned my addr 172.21.15.137:0/1107214386 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c3d8b9640 1 --2- 172.21.15.137:0/1107214386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 0x7f0c380d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c3c8b7640 1 -- 172.21.15.137:0/1107214386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 msgr2=0x7f0c380d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/1107214386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 0x7f0c380d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c3c8b7640 1 -- 172.21.15.137:0/1107214386 >> v1:172.21.15.137:6789/0 conn(0x7f0c3815f680 legacy=0x7f0c38163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c3c8b7640 1 -- 172.21.15.137:0/1107214386 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c380b5090 con 0x7f0c380d3820 2024-04-26T22:04:34.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c37fff640 1 -- 172.21.15.137:0/1107214386 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3170687638 0 0) 0x7f0c380d3c90 con 0x7f0c3815f680 2024-04-26T22:04:34.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.045+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/1107214386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c380d3820 0x7f0c380b5b70 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009870 tx=0x7f0c2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb1122c517fcc50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c37fff640 1 -- 172.21.15.137:0/1107214386 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c037070 con 0x7f0c380d3820 2024-04-26T22:04:34.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c37fff640 1 -- 172.21.15.137:0/1107214386 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c032440 con 0x7f0c380d3820 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c37fff640 1 -- 172.21.15.137:0/1107214386 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c032810 con 0x7f0c380d3820 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c3f31c640 1 -- 172.21.15.137:0/1107214386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c380d3820 msgr2=0x7f0c380b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c3f31c640 1 --2- 172.21.15.137:0/1107214386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c380d3820 0x7f0c380b5b70 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009870 tx=0x7f0c2c02a270 comp rx=0 tx=0).stop 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c3f31c640 1 -- 172.21.15.137:0/1107214386 shutdown_connections 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c3f31c640 1 --2- 172.21.15.137:0/1107214386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 0x7f0c380d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c3f31c640 1 --2- 172.21.15.137:0/1107214386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c380d3820 0x7f0c380b5b70 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c3f31c640 1 -- 172.21.15.137:0/1107214386 >> 172.21.15.137:0/1107214386 conn(0x7f0c3808eca0 msgr2=0x7f0c3809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c3f31c640 1 -- 172.21.15.137:0/1107214386 shutdown_connections 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.046+0000 7f0c3f31c640 1 -- 172.21.15.137:0/1107214386 wait complete. 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.047+0000 7f0c3f31c640 1 Processor -- start 2024-04-26T22:04:34.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.047+0000 7f0c3f31c640 1 -- start start 2024-04-26T22:04:34.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3f31c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 0x7f0c381536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3f31c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c380d3820 0x7f0c38161d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3f31c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c3815f680 0x7f0c380c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3f31c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c380d55e0 con 0x7f0c3815f680 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3f31c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c380d5460 con 0x7f0c380d3820 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3f31c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0c380d5760 con 0x7f0c380b60b0 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3d8b9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c3815f680 0x7f0c380c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3d8b9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c3815f680 0x7f0c380c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58234/0 (socket says 172.21.15.137:58234) 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3d8b9640 1 -- 172.21.15.137:0/2263296295 learned_addr learned my addr 172.21.15.137:0/2263296295 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 0x7f0c381536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.048+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c380d3820 0x7f0c38161d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c3d8b9640 1 -- 172.21.15.137:0/2263296295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 msgr2=0x7f0c381536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c3d8b9640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 0x7f0c381536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c3d8b9640 1 -- 172.21.15.137:0/2263296295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c380d3820 msgr2=0x7f0c38161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c3d8b9640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c380d3820 0x7f0c38161d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c3d8b9640 1 -- 172.21.15.137:0/2263296295 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c380b8160 con 0x7f0c3815f680 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c3d8b9640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c3815f680 0x7f0c380c8da0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800d5d0 tx=0x7f0c2800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c35ffb640 1 -- 172.21.15.137:0/2263296295 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c280125f0 con 0x7f0c3815f680 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c35ffb640 1 -- 172.21.15.137:0/2263296295 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c28019070 con 0x7f0c3815f680 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c35ffb640 1 -- 172.21.15.137:0/2263296295 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c280129f0 con 0x7f0c3815f680 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c3f31c640 1 -- 172.21.15.137:0/2263296295 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c380b8440 con 0x7f0c3815f680 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.049+0000 7f0c3f31c640 1 -- 172.21.15.137:0/2263296295 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c380b8a00 con 0x7f0c3815f680 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.050+0000 7f0c35ffb640 1 -- 172.21.15.137:0/2263296295 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c28012b90 con 0x7f0c3815f680 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.051+0000 7f0c35ffb640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0c2406c920 0x7f0c2406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.051+0000 7f0c35ffb640 1 -- 172.21.15.137:0/2263296295 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f0c2808be70 con 0x7f0c3815f680 2024-04-26T22:04:34.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.051+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0c2406c920 0x7f0c2406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.051+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0c2406c920 0x7f0c2406ede0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0c300012e0 tx=0x7f0c30001760 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.052+0000 7f0c42031740 1 Processor -- start 2024-04-26T22:04:34.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.052+0000 7f0c42031740 1 -- start start 2024-04-26T22:04:34.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c42031740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x56422660f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c42031740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x56422660db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c42031740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x56422660e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c42031740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564226573d80 con 0x564226609e10 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c42031740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x56422652d8b0 con 0x56422660e0c0 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c42031740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56422656fd40 con 0x56422660ef80 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3c8b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x56422660db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3c8b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x56422660db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58238/0 (socket says 172.21.15.137:58238) 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3c8b7640 1 -- 172.21.15.137:0/4209382275 learned_addr learned my addr 172.21.15.137:0/4209382275 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/4209382275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x56422660f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3d8b9640 1 --2- 172.21.15.137:0/4209382275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x56422660e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3c8b7640 1 -- 172.21.15.137:0/4209382275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 msgr2=0x56422660f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/4209382275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x56422660f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3c8b7640 1 -- 172.21.15.137:0/4209382275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 msgr2=0x56422660e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/4209382275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x56422660e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3c8b7640 1 -- 172.21.15.137:0/4209382275 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642264fea40 con 0x564226609e10 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/4209382275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x56422660db80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009870 tx=0x7f0c2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9b7f3b630ee8b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c1effd640 1 -- 172.21.15.137:0/4209382275 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c037040 con 0x564226609e10 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c1effd640 1 -- 172.21.15.137:0/4209382275 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c004240 con 0x564226609e10 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.053+0000 7f0c1effd640 1 -- 172.21.15.137:0/4209382275 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c003610 con 0x564226609e10 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.054+0000 7f0c42031740 1 -- 172.21.15.137:0/4209382275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 msgr2=0x56422660db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.054+0000 7f0c42031740 1 --2- 172.21.15.137:0/4209382275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x56422660db80 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009870 tx=0x7f0c2c02c000 comp rx=0 tx=0).stop 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.054+0000 7f0c42031740 1 -- 172.21.15.137:0/4209382275 shutdown_connections 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.054+0000 7f0c42031740 1 --2- 172.21.15.137:0/4209382275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x56422660db80 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.054+0000 7f0c42031740 1 --2- 172.21.15.137:0/4209382275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x56422660e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.054+0000 7f0c42031740 1 --2- 172.21.15.137:0/4209382275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x56422660f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.054+0000 7f0c42031740 1 -- 172.21.15.137:0/4209382275 >> 172.21.15.137:0/4209382275 conn(0x56422660c080 msgr2=0x564226654b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.054+0000 7f0c42031740 1 -- 172.21.15.137:0/4209382275 shutdown_connections 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.054+0000 7f0c42031740 1 -- 172.21.15.137:0/4209382275 wait complete. 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.055+0000 7f0c42031740 1 -- start start 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.055+0000 7f0c42031740 1 Processor -- start 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56422660e0c0 0x564226667d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x564226658c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564226659210 0x564226654680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56422663ab10 con 0x56422660e0c0 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5642264fad10 con 0x564226659210 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564226639f90 con 0x56422660ef80 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 10 client.0 _ll_register_callbacks cb 0x564226527210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:34.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d0b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56422660e0c0 0x564226667d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d0b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56422660e0c0 0x564226667d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58254/0 (socket says 172.21.15.137:58254) 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3933714203 learned_addr learned my addr 172.21.15.137:0/3933714203 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x564226658c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d8b9640 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564226659210 0x564226654680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3933714203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 msgr2=0x564226658c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x564226658c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3933714203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564226659210 msgr2=0x564226654680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564226659210 0x564226654680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3933714203 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56422634f7d0 con 0x56422660e0c0 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56422660e0c0 0x564226667d60 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f0c300138c0 tx=0x7f0c30001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc8ebd9f8c87f02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c13fff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c13fff640 1 -- 172.21.15.137:0/3933714203 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30027060 con 0x56422660e0c0 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c13fff640 1 -- 172.21.15.137:0/3933714203 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f0c30022b20 con 0x56422660e0c0 2024-04-26T22:04:34.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 1 -- 172.21.15.137:0/3933714203 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c2c004240 con 0x56422660e0c0 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c13fff640 1 -- 172.21.15.137:0/3933714203 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f0c30022d20 con 0x56422660e0c0 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 10 client.7677 fetch_fsmap learned FSMap version 53 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.056+0000 7f0c42031740 1 -- 172.21.15.137:0/3933714203 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x5642262853f0 con 0x56422660e0c0 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c13fff640 1 -- 172.21.15.137:0/3933714203 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c004240 con 0x56422660e0c0 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c13fff640 1 -- 172.21.15.137:0/3933714203 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f0c300128d0 con 0x56422660e0c0 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c42031740 10 client.7677 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c42031740 10 client.7677 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c42031740 20 client.7677 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c42031740 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x564226656cc0 0x5642266570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c42031740 4 client.7677 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c42031740 1 -- 172.21.15.137:0/3933714203 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564226581990 con 0x564226656cc0 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x564226656cc0 0x5642266570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c13fff640 10 client.7677 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.057+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x564226656cc0 0x5642266570a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56943833df9c3a70 server_cookie=b7410989c0b1290e in_seq=0 out_seq=0 2024-04-26T22:04:34.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c13fff640 1 -- 172.21.15.137:0/3933714203 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564226581990 con 0x564226656cc0 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c13fff640 10 client.7677 handle_command_reply: tid=0 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 client.7677 shutdown 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 -- 172.21.15.137:0/3933714203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56422660e0c0 msgr2=0x564226667d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56422660e0c0 0x564226667d60 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f0c300138c0 tx=0x7f0c30001250 comp rx=0 tx=0).stop 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 -- 172.21.15.137:0/3933714203 shutdown_connections 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x564226656cc0 0x5642266570a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c13fff640 0 client.7677 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564226659210 0x564226654680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x564226658c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 --2- 172.21.15.137:0/3933714203 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56422660e0c0 0x564226667d60 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 -- 172.21.15.137:0/3933714203 >> 172.21.15.137:0/3933714203 conn(0x564226609e10 msgr2=0x56422660fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 -- 172.21.15.137:0/3933714203 shutdown_connections 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 1 -- 172.21.15.137:0/3933714203 wait complete. 2024-04-26T22:04:34.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.058+0000 7f0c42031740 20 client.7677 trim_cache size 0 max 16384 2024-04-26T22:04:34.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.075+0000 7f0c42031740 1 Processor -- start 2024-04-26T22:04:34.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.075+0000 7f0c42031740 1 -- start start 2024-04-26T22:04:34.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c42031740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c42031740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x564226657e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c42031740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x564226658380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c42031740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0c382018c0 con 0x564226609e10 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c42031740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c38200910 con 0x56422660e0c0 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c42031740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0c380b9b10 con 0x56422660ef80 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c3d0b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c3d0b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58270/0 (socket says 172.21.15.137:58270) 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3155372465 learned_addr learned my addr 172.21.15.137:0/3155372465 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3155372465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 msgr2=0x564226658380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/3155372465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x564226658380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3155372465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 msgr2=0x564226657e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/3155372465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x564226657e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3155372465 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642262450f0 con 0x564226609e10 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/3155372465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266589c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0c30001830 tx=0x7f0c30020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab22d9d24db94b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c1e7fc640 1 -- 172.21.15.137:0/3155372465 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30012720 con 0x564226609e10 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c1e7fc640 1 -- 172.21.15.137:0/3155372465 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c300128c0 con 0x564226609e10 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.076+0000 7f0c1e7fc640 1 -- 172.21.15.137:0/3155372465 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3002d430 con 0x564226609e10 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.077+0000 7f0c42031740 1 -- 172.21.15.137:0/3155372465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 msgr2=0x5642266589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.077+0000 7f0c42031740 1 --2- 172.21.15.137:0/3155372465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266589c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f0c30001830 tx=0x7f0c30020000 comp rx=0 tx=0).stop 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.077+0000 7f0c42031740 1 -- 172.21.15.137:0/3155372465 shutdown_connections 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.077+0000 7f0c42031740 1 --2- 172.21.15.137:0/3155372465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x564226658380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.077+0000 7f0c42031740 1 --2- 172.21.15.137:0/3155372465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x564226657e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.077+0000 7f0c42031740 1 --2- 172.21.15.137:0/3155372465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266589c0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.077+0000 7f0c42031740 1 -- 172.21.15.137:0/3155372465 >> 172.21.15.137:0/3155372465 conn(0x56422660cf90 msgr2=0x56422660f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.077+0000 7f0c42031740 1 -- 172.21.15.137:0/3155372465 shutdown_connections 2024-04-26T22:04:34.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.077+0000 7f0c42031740 1 -- 172.21.15.137:0/3155372465 wait complete. 2024-04-26T22:04:34.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.078+0000 7f0c42031740 1 -- start start 2024-04-26T22:04:34.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.078+0000 7f0c42031740 1 Processor -- start 2024-04-26T22:04:34.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.078+0000 7f0c42031740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.078+0000 7f0c42031740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x5642266cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.078+0000 7f0c42031740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x5642266661f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.078+0000 7f0c42031740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56422660cc20 con 0x564226609e10 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.078+0000 7f0c42031740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0c380ba160 con 0x56422660e0c0 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.078+0000 7f0c42031740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56422656fec0 con 0x56422660ef80 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c42031740 10 client.0 _ll_register_callbacks cb 0x7f0c30004e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d0b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d0b8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266b7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58276/0 (socket says 172.21.15.137:58276) 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3709952748 learned_addr learned my addr 172.21.15.137:0/3709952748 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x5642266cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d8b9640 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x5642266661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3709952748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 msgr2=0x5642266661f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x5642266661f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3709952748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 msgr2=0x5642266cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x5642266cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d0b8640 1 -- 172.21.15.137:0/3709952748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642265344b0 con 0x564226609e10 2024-04-26T22:04:34.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c3d0b8640 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266b7b40 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f0c30002230 tx=0x7f0c3000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51993bbc7fde1449 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c13fff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c13fff640 1 -- 172.21.15.137:0/3709952748 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30012720 con 0x564226609e10 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c13fff640 1 -- 172.21.15.137:0/3709952748 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f0c30012dd0 con 0x564226609e10 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c42031740 1 -- 172.21.15.137:0/3709952748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c300128c0 con 0x564226609e10 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c13fff640 1 -- 172.21.15.137:0/3709952748 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f0c30048050 con 0x564226609e10 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c42031740 10 client.7683 fetch_fsmap learned FSMap version 53 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c42031740 1 -- 172.21.15.137:0/3709952748 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x564226666d10 con 0x564226609e10 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c13fff640 1 -- 172.21.15.137:0/3709952748 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c300128c0 con 0x564226609e10 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c13fff640 1 -- 172.21.15.137:0/3709952748 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 53) ==== 3494+0+0 (secure 0 0 0) 0x7f0c3004b020 con 0x564226609e10 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c42031740 10 client.7683 fetch_fsmap finished waiting for FSMap version 53 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c42031740 10 client.7683 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.079+0000 7f0c42031740 20 client.7683 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:34.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x564226656cc0 0x564226677740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 4 client.7683 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 -- 172.21.15.137:0/3709952748 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56422657b800 con 0x564226656cc0 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x564226656cc0 0x564226677740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c13fff640 10 client.7683 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c3c8b7640 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x564226656cc0 0x564226677740 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e98425001fda3e server_cookie=baab16c982207f69 in_seq=0 out_seq=0 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c13fff640 1 -- 172.21.15.137:0/3709952748 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56422657b800 con 0x564226656cc0 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c13fff640 10 client.7683 handle_command_reply: tid=0 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 client.7683 shutdown 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 -- 172.21.15.137:0/3709952748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 msgr2=0x5642266b7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266b7b40 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f0c30002230 tx=0x7f0c3000a000 comp rx=0 tx=0).stop 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 -- 172.21.15.137:0/3709952748 shutdown_connections 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x564226656cc0 0x564226677740 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x56422660ef80 0x5642266661f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56422660e0c0 0x5642266cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c13fff640 0 client.7683 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 --2- 172.21.15.137:0/3709952748 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564226609e10 0x5642266b7b40 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 -- 172.21.15.137:0/3709952748 >> 172.21.15.137:0/3709952748 conn(0x56422660cf90 msgr2=0x56422665bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 -- 172.21.15.137:0/3709952748 shutdown_connections 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 1 -- 172.21.15.137:0/3709952748 wait complete. 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.080+0000 7f0c42031740 20 client.7683 trim_cache size 0 max 16384 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:04:34.088 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:04:34.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 -- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0c2406c920 msgr2=0x7f0c2406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0c2406c920 0x7f0c2406ede0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0c300012e0 tx=0x7f0c30001760 comp rx=0 tx=0).stop 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 -- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c3815f680 msgr2=0x7f0c380c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c3815f680 0x7f0c380c8da0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800d5d0 tx=0x7f0c2800da90 comp rx=0 tx=0).stop 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 -- 172.21.15.137:0/2263296295 shutdown_connections 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0c2406c920 0x7f0c2406ede0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0c3815f680 0x7f0c380c8da0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c380d3820 0x7f0c38161d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 --2- 172.21.15.137:0/2263296295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0c380b60b0 0x7f0c381536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 -- 172.21.15.137:0/2263296295 >> 172.21.15.137:0/2263296295 conn(0x7f0c3808eca0 msgr2=0x7f0c380d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 -- 172.21.15.137:0/2263296295 shutdown_connections 2024-04-26T22:04:34.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.081+0000 7f0c3f31c640 1 -- 172.21.15.137:0/2263296295 wait complete. 2024-04-26T22:04:34.091 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:04:34.092 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:04:34.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.188+0000 7f97b33d4640 1 Processor -- start 2024-04-26T22:04:34.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.188+0000 7f97b33d4640 1 -- start start 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.189+0000 7f97b33d4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f97ac145980 0x7f97ac160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.189+0000 7f97b33d4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b3de0 0x7f97ac0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.189+0000 7f97b33d4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97ac0b4260 con 0x7f97ac0b5fd0 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.189+0000 7f97b33d4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f97ac0b6440 con 0x7f97ac145980 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.189+0000 7f97b33d4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f97ac0b5140 con 0x7f97ac0b3de0 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b096f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b3de0 0x7f97ac0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b1170640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f97ac145980 0x7f97ac160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b096f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b3de0 0x7f97ac0b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:55008/0 (socket says 172.21.15.137:55008) 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b1170640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f97ac145980 0x7f97ac160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34378/0 (socket says 172.21.15.137:34378) 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b096f640 1 -- 172.21.15.137:0/911365315 learned_addr learned my addr 172.21.15.137:0/911365315 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b1971640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f97ac0b5fd0 0x7f97ac15c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:37636/0 (socket says 172.21.15.137:37636) 2024-04-26T22:04:34.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b1170640 1 -- 172.21.15.137:0/911365315 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b3de0 msgr2=0x7f97ac0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b1170640 1 --2- 172.21.15.137:0/911365315 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b3de0 0x7f97ac0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b1170640 1 -- 172.21.15.137:0/911365315 >> v1:172.21.15.170:6789/0 conn(0x7f97ac0b5fd0 legacy=0x7f97ac15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.190+0000 7f97b1170640 1 -- 172.21.15.137:0/911365315 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac0b4530 con 0x7f97ac145980 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97b1170640 1 --2- 172.21.15.137:0/911365315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac145980 0x7f97ac160630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009d90 tx=0x7f97a802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e425a7b4b7b793d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97a3fff640 1 -- 172.21.15.137:0/911365315 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a8031600 con 0x7f97ac145980 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97a3fff640 1 -- 172.21.15.137:0/911365315 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a80317a0 con 0x7f97ac145980 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97a3fff640 1 -- 172.21.15.137:0/911365315 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a8031b70 con 0x7f97ac145980 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97b33d4640 1 -- 172.21.15.137:0/911365315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac145980 msgr2=0x7f97ac160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97b33d4640 1 --2- 172.21.15.137:0/911365315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac145980 0x7f97ac160630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009d90 tx=0x7f97a802a5d0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97b33d4640 1 -- 172.21.15.137:0/911365315 shutdown_connections 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97b33d4640 1 --2- 172.21.15.137:0/911365315 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b3de0 0x7f97ac0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97b33d4640 1 --2- 172.21.15.137:0/911365315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac145980 0x7f97ac160630 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.191+0000 7f97b33d4640 1 -- 172.21.15.137:0/911365315 >> 172.21.15.137:0/911365315 conn(0x7f97ac0d0d30 msgr2=0x7f97ac0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.192+0000 7f97b33d4640 1 -- 172.21.15.137:0/911365315 shutdown_connections 2024-04-26T22:04:34.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.192+0000 7f97b33d4640 1 -- 172.21.15.137:0/911365315 wait complete. 2024-04-26T22:04:34.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.193+0000 7f97b33d4640 1 Processor -- start 2024-04-26T22:04:34.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.193+0000 7f97b33d4640 1 -- start start 2024-04-26T22:04:34.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.193+0000 7f97b33d4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac0b3de0 0x7f97ac15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.193+0000 7f97b33d4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b5fd0 0x7f97ac0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.193+0000 7f97b33d4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97ac145980 0x7f97ac0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.193+0000 7f97b33d4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac0b4dd0 con 0x7f97ac145980 2024-04-26T22:04:34.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.193+0000 7f97b33d4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac0b4af0 con 0x7f97ac0b3de0 2024-04-26T22:04:34.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.193+0000 7f97b33d4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f97ac0730e0 con 0x7f97ac0b5fd0 2024-04-26T22:04:34.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1971640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97ac145980 0x7f97ac0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1971640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97ac145980 0x7f97ac0b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58290/0 (socket says 172.21.15.137:58290) 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1971640 1 -- 172.21.15.137:0/453413230 learned_addr learned my addr 172.21.15.137:0/453413230 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1170640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac0b3de0 0x7f97ac15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b096f640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b5fd0 0x7f97ac0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1971640 1 -- 172.21.15.137:0/453413230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b5fd0 msgr2=0x7f97ac0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1971640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b5fd0 0x7f97ac0b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1971640 1 -- 172.21.15.137:0/453413230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac0b3de0 msgr2=0x7f97ac15b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1971640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac0b3de0 0x7f97ac15b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1971640 1 -- 172.21.15.137:0/453413230 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac15bce0 con 0x7f97ac145980 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b1971640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97ac145980 0x7f97ac0b22e0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c3c0 tx=0x7f97a400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97a1ffb640 1 -- 172.21.15.137:0/453413230 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a40074e0 con 0x7f97ac145980 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97a1ffb640 1 -- 172.21.15.137:0/453413230 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a40076a0 con 0x7f97ac145980 2024-04-26T22:04:34.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac0c6200 con 0x7f97ac145980 2024-04-26T22:04:34.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97a1ffb640 1 -- 172.21.15.137:0/453413230 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a4004a20 con 0x7f97ac145980 2024-04-26T22:04:34.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.194+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac0c6780 con 0x7f97ac145980 2024-04-26T22:04:34.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.195+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97ac06a290 con 0x7f97ac145980 2024-04-26T22:04:34.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.196+0000 7f97a1ffb640 1 -- 172.21.15.137:0/453413230 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97a401a020 con 0x7f97ac145980 2024-04-26T22:04:34.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.196+0000 7f97a1ffb640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f979006c8f0 0x7f979006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.196+0000 7f97b1170640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f979006c8f0 0x7f979006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.196+0000 7f97a1ffb640 1 -- 172.21.15.137:0/453413230 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f97a408b2e0 con 0x7f97ac145980 2024-04-26T22:04:34.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.197+0000 7f97b1170640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f979006c8f0 0x7f979006edb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f97a8034000 tx=0x7f97a802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.201+0000 7f97a1ffb640 1 -- 172.21.15.137:0/453413230 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f97ac15bce0 con 0x7f97ac145980 2024-04-26T22:04:34.307 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:04:34.307+0000 7fa573cc1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:04:34.389 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:04:34.389+0000 7f8ac040b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-26T22:04:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.417+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97ac0b13e0 con 0x7f97ac145980 2024-04-26T22:04:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.418+0000 7f97a1ffb640 1 -- 172.21.15.137:0/453413230 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5196 (secure 0 0 0) 0x7f97a40596a0 con 0x7f97ac145980 2024-04-26T22:04:34.418 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:34.418 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:04:34.234174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7317":{"gid":7317,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/2128712520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2128712520},{"type":"v1","addr":"172.21.15.137:6837","nonce":2128712520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7317,"qdb_cluster":[7317]},"id":6}]} 2024-04-26T22:04:34.418 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 54 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f979006c8f0 msgr2=0x7f979006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f979006c8f0 0x7f979006edb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f97a8034000 tx=0x7f97a802f000 comp rx=0 tx=0).stop 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97ac145980 msgr2=0x7f97ac0b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97ac145980 0x7f97ac0b22e0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f97a400c3c0 tx=0x7f97a400c880 comp rx=0 tx=0).stop 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 shutdown_connections 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f979006c8f0 0x7f979006edb0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97ac145980 0x7f97ac0b22e0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97ac0b5fd0 0x7f97ac0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 --2- 172.21.15.137:0/453413230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac0b3de0 0x7f97ac15b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.420+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 >> 172.21.15.137:0/453413230 conn(0x7f97ac0d0d30 msgr2=0x7f97ac144770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.421+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 shutdown_connections 2024-04-26T22:04:34.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.421+0000 7f97b33d4640 1 -- 172.21.15.137:0/453413230 wait complete. 2024-04-26T22:04:34.432 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-26T22:04:34.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.530+0000 7fe6f50f8640 1 Processor -- start 2024-04-26T22:04:34.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.530+0000 7fe6f50f8640 1 -- start start 2024-04-26T22:04:34.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6f50f8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe6f00d1be0 0x7fe6f00d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6f50f8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6f00ba3a0 0x7fe6f00ba7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6f50f8640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f00d4240 con 0x7fe6f015f490 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6f50f8640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f00d31a0 con 0x7fe6f00ba3a0 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6f50f8640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f00d3480 con 0x7fe6f00d1be0 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6ef59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6f00ba3a0 0x7fe6f00ba7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6ef59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe6f00ba3a0 0x7fe6f00ba7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58296/0 (socket says 172.21.15.137:58296) 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6ef59e640 1 -- 172.21.15.137:0/630710033 learned_addr learned my addr 172.21.15.137:0/630710033 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6ef59e640 1 -- 172.21.15.137:0/630710033 >> v2:172.21.15.170:3300/0 conn(0x7fe6f00d1be0 msgr2=0x7fe6f00d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/630710033 >> v2:172.21.15.170:3300/0 conn(0x7fe6f00d1be0 0x7fe6f00d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6ef59e640 1 -- 172.21.15.137:0/630710033 >> v1:172.21.15.170:6789/0 conn(0x7fe6f015f490 legacy=0x7fe6f00d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.531+0000 7fe6ef59e640 1 -- 172.21.15.137:0/630710033 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f00d3760 con 0x7fe6f00ba3a0 2024-04-26T22:04:34.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.532+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/630710033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00ba3a0 0x7fe6f00ba7b0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe6f008eb10 tx=0x7fe6e802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e874f01d0b6735 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.532+0000 7fe6ee59c640 1 -- 172.21.15.137:0/630710033 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8036070 con 0x7fe6f00ba3a0 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.532+0000 7fe6ee59c640 1 -- 172.21.15.137:0/630710033 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e8031600 con 0x7fe6f00ba3a0 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.532+0000 7fe6ee59c640 1 -- 172.21.15.137:0/630710033 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80319d0 con 0x7fe6f00ba3a0 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.532+0000 7fe6f50f8640 1 -- 172.21.15.137:0/630710033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00ba3a0 msgr2=0x7fe6f00ba7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.532+0000 7fe6f50f8640 1 --2- 172.21.15.137:0/630710033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00ba3a0 0x7fe6f00ba7b0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe6f008eb10 tx=0x7fe6e802a6f0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.533+0000 7fe6f50f8640 1 -- 172.21.15.137:0/630710033 shutdown_connections 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.533+0000 7fe6f50f8640 1 --2- 172.21.15.137:0/630710033 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f00ba3a0 0x7fe6f00ba7b0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.533+0000 7fe6f50f8640 1 --2- 172.21.15.137:0/630710033 >> v2:172.21.15.170:3300/0 conn(0x7fe6f00d1be0 0x7fe6f00d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.533+0000 7fe6f50f8640 1 -- 172.21.15.137:0/630710033 >> 172.21.15.137:0/630710033 conn(0x7fe6f009e530 msgr2=0x7fe6f00d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.533+0000 7fe6f50f8640 1 -- 172.21.15.137:0/630710033 shutdown_connections 2024-04-26T22:04:34.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.533+0000 7fe6f50f8640 1 -- 172.21.15.137:0/630710033 wait complete. 2024-04-26T22:04:34.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.534+0000 7fe6f50f8640 1 Processor -- start 2024-04-26T22:04:34.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.534+0000 7fe6f50f8640 1 -- start start 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6f50f8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00ba3a0 0x7fe6f0162520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6f50f8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00d1be0 0x7fe6f0158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6f50f8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f015f490 0x7fe6f01f8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6f50f8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00d11c0 con 0x7fe6f015f490 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6f50f8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f00d3d20 con 0x7fe6f00d1be0 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6f50f8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f015f870 con 0x7fe6f00ba3a0 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6ef59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f015f490 0x7fe6f01f8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6ef59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f015f490 0x7fe6f01f8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58302/0 (socket says 172.21.15.137:58302) 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6ef59e640 1 -- 172.21.15.137:0/349982081 learned_addr learned my addr 172.21.15.137:0/349982081 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6ef59e640 1 -- 172.21.15.137:0/349982081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00ba3a0 msgr2=0x7fe6f0162520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00ba3a0 0x7fe6f0162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6ef59e640 1 -- 172.21.15.137:0/349982081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00d1be0 msgr2=0x7fe6f0158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00d1be0 0x7fe6f0158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6ef59e640 1 -- 172.21.15.137:0/349982081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f00cf1f0 con 0x7fe6f015f490 2024-04-26T22:04:34.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f015f490 0x7fe6f01f8e00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8034040 tx=0x7fe6e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6e77fe640 1 -- 172.21.15.137:0/349982081 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8036050 con 0x7fe6f015f490 2024-04-26T22:04:34.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6e77fe640 1 -- 172.21.15.137:0/349982081 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e8042070 con 0x7fe6f015f490 2024-04-26T22:04:34.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6f50f8640 1 -- 172.21.15.137:0/349982081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f01e9780 con 0x7fe6f015f490 2024-04-26T22:04:34.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6e77fe640 1 -- 172.21.15.137:0/349982081 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8009510 con 0x7fe6f015f490 2024-04-26T22:04:34.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.535+0000 7fe6f50f8640 1 -- 172.21.15.137:0/349982081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f0158dc0 con 0x7fe6f015f490 2024-04-26T22:04:34.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.537+0000 7fe6e77fe640 1 -- 172.21.15.137:0/349982081 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6e8007bf0 con 0x7fe6f015f490 2024-04-26T22:04:34.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.537+0000 7fe6e77fe640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6d006c8f0 0x7fe6d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.537+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6d006c8f0 0x7fe6d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.537+0000 7fe6e77fe640 1 -- 172.21.15.137:0/349982081 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fe6e80acac0 con 0x7fe6f015f490 2024-04-26T22:04:34.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.538+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6d006c8f0 0x7fe6d006edb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe6f01600c0 tx=0x7fe6e0007990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.538+0000 7fe6f7e0e740 1 Processor -- start 2024-04-26T22:04:34.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6f7e0e740 1 -- start start 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 0x561abe86ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8a93c0 0x561abe86d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8977b0 0x561abe897c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561abe7d1b80 con 0x561abe8a93c0 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561abe76d4d0 con 0x561abe8977b0 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561abe7cdb40 con 0x561abe86ccf0 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6e7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8a93c0 0x561abe86d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6e7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8a93c0 0x561abe86d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58308/0 (socket says 172.21.15.137:58308) 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6e7fff640 1 -- 172.21.15.137:0/1777906907 learned_addr learned my addr 172.21.15.137:0/1777906907 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/1777906907 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 0x561abe86ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.539+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/1777906907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8977b0 0x561abe897c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.540+0000 7fe6e7fff640 1 -- 172.21.15.137:0/1777906907 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 msgr2=0x561abe86ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.540+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/1777906907 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 0x561abe86ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.540+0000 7fe6e7fff640 1 -- 172.21.15.137:0/1777906907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8977b0 msgr2=0x561abe897c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.540+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/1777906907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8977b0 0x561abe897c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.540+0000 7fe6e7fff640 1 -- 172.21.15.137:0/1777906907 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abe79a770 con 0x561abe8a93c0 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.540+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/1777906907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8a93c0 0x561abe86d0d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009770 tx=0x7fe6d8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e008294c6f818be7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.540+0000 7fe6e4ff9640 1 -- 172.21.15.137:0/1777906907 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8015020 con 0x561abe8a93c0 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.540+0000 7fe6e4ff9640 1 -- 172.21.15.137:0/1777906907 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d800ba70 con 0x561abe8a93c0 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.540+0000 7fe6e4ff9640 1 -- 172.21.15.137:0/1777906907 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d800be60 con 0x561abe8a93c0 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1777906907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8a93c0 msgr2=0x561abe86d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1777906907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8a93c0 0x561abe86d0d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009770 tx=0x7fe6d8009c30 comp rx=0 tx=0).stop 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1777906907 shutdown_connections 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1777906907 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8a93c0 0x561abe86d0d0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1777906907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8977b0 0x561abe897c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1777906907 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 0x561abe86ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1777906907 >> 172.21.15.137:0/1777906907 conn(0x561abe801e90 msgr2=0x561abe8b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1777906907 shutdown_connections 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1777906907 wait complete. 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 -- start start 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.541+0000 7fe6f7e0e740 1 Processor -- start 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 0x561abe892130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8977b0 0x561abe8999b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe88e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561abe76ae70 con 0x561abe8977b0 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561abe895300 con 0x561abe8a93c0 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561abe898ef0 con 0x561abe86ccf0 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6f7e0e740 10 client.0 _ll_register_callbacks cb 0x561abe77bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6e7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8977b0 0x561abe8999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6e7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8977b0 0x561abe8999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58310/0 (socket says 172.21.15.137:58310) 2024-04-26T22:04:34.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6e7fff640 1 -- 172.21.15.137:0/487255244 learned_addr learned my addr 172.21.15.137:0/487255244 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 0x561abe892130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe88e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6e7fff640 1 -- 172.21.15.137:0/487255244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 msgr2=0x561abe892130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 0x561abe892130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6e7fff640 1 -- 172.21.15.137:0/487255244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 msgr2=0x561abe88e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe88e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6e7fff640 1 -- 172.21.15.137:0/487255244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561abe5af7c0 con 0x561abe8977b0 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.542+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8977b0 0x561abe8999b0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009690 tx=0x7fe6d80047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8676ff6dc5800b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6cdffb640 1 -- 172.21.15.137:0/487255244 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8029060 con 0x561abe8977b0 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6cdffb640 1 -- 172.21.15.137:0/487255244 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fe6d800be20 con 0x561abe8977b0 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/487255244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6d800ba70 con 0x561abe8977b0 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6cdffb640 1 -- 172.21.15.137:0/487255244 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fe6d802f050 con 0x561abe8977b0 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6f7e0e740 10 client.7698 fetch_fsmap learned FSMap version 54 2024-04-26T22:04:34.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/487255244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x561abe60ff50 con 0x561abe8977b0 2024-04-26T22:04:34.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6cdffb640 1 -- 172.21.15.137:0/487255244 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d800ba70 con 0x561abe8977b0 2024-04-26T22:04:34.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6cdffb640 1 -- 172.21.15.137:0/487255244 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fe6d8032020 con 0x561abe8977b0 2024-04-26T22:04:34.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6f7e0e740 10 client.7698 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:04:34.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6f7e0e740 10 client.7698 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:04:34.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6f7e0e740 20 client.7698 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:34.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x561abe8cda50 0x561abe8cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6f7e0e740 4 client.7698 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:04:34.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/487255244 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561abe785240 con 0x561abe8cda50 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.543+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x561abe8cda50 0x561abe8cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6cdffb640 10 client.7698 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x561abe8cda50 0x561abe8cfe40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84466446c1ab631a server_cookie=eef7600ea9acf6f2 in_seq=0 out_seq=0 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6cdffb640 1 -- 172.21.15.137:0/487255244 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561abe785240 con 0x561abe8cda50 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6cdffb640 10 client.7698 handle_command_reply: tid=0 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 client.7698 shutdown 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/487255244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8977b0 msgr2=0x561abe8999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8977b0 0x561abe8999b0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009690 tx=0x7fe6d80047a0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/487255244 shutdown_connections 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x561abe8cda50 0x561abe8cfe40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe8977b0 0x561abe8999b0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe88e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6cdffb640 0 client.7698 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:34.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/487255244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe86ccf0 0x561abe892130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/487255244 >> 172.21.15.137:0/487255244 conn(0x561abe801e90 msgr2=0x561abe892700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/487255244 shutdown_connections 2024-04-26T22:04:34.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/487255244 wait complete. 2024-04-26T22:04:34.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.544+0000 7fe6f7e0e740 20 client.7698 trim_cache size 0 max 16384 2024-04-26T22:04:34.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.557+0000 7fe6f7e0e740 1 Processor -- start 2024-04-26T22:04:34.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6f7e0e740 1 -- start start 2024-04-26T22:04:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe891530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 0x561abe891a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe8d4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0201c90 con 0x561abe86ccf0 2024-04-26T22:04:34.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0161950 con 0x561abe8a93c0 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe6f00ca660 con 0x561abe8977b0 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6eed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe891530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6eed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe891530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58314/0 (socket says 172.21.15.137:58314) 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.558+0000 7fe6eed9d640 1 -- 172.21.15.137:0/1837844253 learned_addr learned my addr 172.21.15.137:0/1837844253 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 0x561abe891a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe8d4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6eed9d640 1 -- 172.21.15.137:0/1837844253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 msgr2=0x561abe891a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 0x561abe891a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6eed9d640 1 -- 172.21.15.137:0/1837844253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 msgr2=0x561abe8d4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe8d4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6eed9d640 1 -- 172.21.15.137:0/1837844253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561abe4a30b0 con 0x561abe86ccf0 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe8d4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe891530 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0003940 tx=0x7fe6e0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9717d91ee102067d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6cffff640 1 -- 172.21.15.137:0/1837844253 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0007250 con 0x561abe86ccf0 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6cffff640 1 -- 172.21.15.137:0/1837844253 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e00073f0 con 0x561abe86ccf0 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6cffff640 1 -- 172.21.15.137:0/1837844253 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0006790 con 0x561abe86ccf0 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1837844253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 msgr2=0x561abe891530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe891530 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0003940 tx=0x7fe6e0010000 comp rx=0 tx=0).stop 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1837844253 shutdown_connections 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe8d4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 0x561abe891a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1837844253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe891530 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1837844253 >> 172.21.15.137:0/1837844253 conn(0x561abe801e90 msgr2=0x561abe86dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1837844253 shutdown_connections 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.559+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1837844253 wait complete. 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.560+0000 7fe6f7e0e740 1 -- start start 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.560+0000 7fe6f7e0e740 1 Processor -- start 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe8b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 0x561abe891ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6f7e0e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe8d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561abe890a50 con 0x561abe86ccf0 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0161300 con 0x561abe8a93c0 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6f7e0e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561abe88fd00 con 0x561abe8977b0 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6f7e0e740 10 client.0 _ll_register_callbacks cb 0x7fe6d8009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6eed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe8b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6eed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe8b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58320/0 (socket says 172.21.15.137:58320) 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6eed9d640 1 -- 172.21.15.137:0/1429234541 learned_addr learned my addr 172.21.15.137:0/1429234541 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 0x561abe891ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6ef59e640 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe8d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6eed9d640 1 -- 172.21.15.137:0/1429234541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 msgr2=0x561abe891ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 0x561abe891ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6eed9d640 1 -- 172.21.15.137:0/1429234541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 msgr2=0x561abe8d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe8d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6eed9d640 1 -- 172.21.15.137:0/1429234541 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561abe8d5c90 con 0x561abe86ccf0 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6eed9d640 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe8b5e00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00077d0 tx=0x7fe6e0001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576d52cfb6fbc067 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.561+0000 7fe6cdffb640 1 -- 172.21.15.137:0/1429234541 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0006990 con 0x561abe86ccf0 2024-04-26T22:04:34.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6cdffb640 1 -- 172.21.15.137:0/1429234541 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fe6e0006b30 con 0x561abe86ccf0 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1429234541 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6e00073f0 con 0x561abe86ccf0 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6cdffb640 1 -- 172.21.15.137:0/1429234541 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fe6e0038050 con 0x561abe86ccf0 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6f7e0e740 10 client.7704 fetch_fsmap learned FSMap version 54 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1429234541 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x561abe8d4920 con 0x561abe86ccf0 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6cdffb640 1 -- 172.21.15.137:0/1429234541 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e00073f0 con 0x561abe86ccf0 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6cdffb640 1 -- 172.21.15.137:0/1429234541 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fe6e003b020 con 0x561abe86ccf0 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6f7e0e740 10 client.7704 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6f7e0e740 10 client.7704 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6f7e0e740 20 client.7704 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x561abe8c0ed0 0x561abe8c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6f7e0e740 4 client.7704 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-26T22:04:34.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1429234541 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x561abe7df790 con 0x561abe8c0ed0 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x561abe8c0ed0 0x561abe8c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6cdffb640 10 client.7704 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6e7fff640 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x561abe8c0ed0 0x561abe8c12b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=873c78da895514ec server_cookie=e71a515a45405134 in_seq=0 out_seq=0 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6cdffb640 1 -- 172.21.15.137:0/1429234541 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+419 (crc 0 0 0) 0x561abe7df790 con 0x561abe8c0ed0 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.562+0000 7fe6cdffb640 10 client.7704 handle_command_reply: tid=0 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 client.7704 shutdown 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1429234541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 msgr2=0x561abe8b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe8b5e00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00077d0 tx=0x7fe6e0001090 comp rx=0 tx=0).stop 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1429234541 shutdown_connections 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x561abe8c0ed0 0x561abe8c12b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abe8a93c0 0x561abe8d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.570 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x561abe8977b0 0x561abe891ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 --2- 172.21.15.137:0/1429234541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x561abe86ccf0 0x561abe8b5e00 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6cdffb640 0 client.7704 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:34.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1429234541 >> 172.21.15.137:0/1429234541 conn(0x561abe801e90 msgr2=0x561abe8b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1429234541 shutdown_connections 2024-04-26T22:04:34.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 1 -- 172.21.15.137:0/1429234541 wait complete. 2024-04-26T22:04:34.571 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f7e0e740 20 client.7704 trim_cache size 0 max 16384 2024-04-26T22:04:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:34.571 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:04:34.571 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "dir_frag", 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 334358747, 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511627776, 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "frag": "*", 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/dir" 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 3014549508, 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511627776, 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/dir" 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:04:34.572 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-26T22:04:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4037181928, 2024-04-26T22:04:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511627777, 2024-04-26T22:04:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/testdir/hardlink" 2024-04-26T22:04:34.573 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:34.573 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:04:34.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 -- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6d006c8f0 msgr2=0x7fe6d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6d006c8f0 0x7fe6d006edb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe6f01600c0 tx=0x7fe6e0007990 comp rx=0 tx=0).stop 2024-04-26T22:04:34.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 -- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f015f490 msgr2=0x7fe6f01f8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f015f490 0x7fe6f01f8e00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8034040 tx=0x7fe6e8004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 -- 172.21.15.137:0/349982081 shutdown_connections 2024-04-26T22:04:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe6d006c8f0 0x7fe6d006edb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe6f015f490 0x7fe6f01f8e00 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe6f00d1be0 0x7fe6f0158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 --2- 172.21.15.137:0/349982081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe6f00ba3a0 0x7fe6f0162520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 -- 172.21.15.137:0/349982081 >> 172.21.15.137:0/349982081 conn(0x7fe6f009e530 msgr2=0x7fe6f006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 -- 172.21.15.137:0/349982081 shutdown_connections 2024-04-26T22:04:34.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.563+0000 7fe6f50f8640 1 -- 172.21.15.137:0/349982081 wait complete. 2024-04-26T22:04:34.576 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T22:04:34.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.671+0000 7f5c732da640 1 Processor -- start 2024-04-26T22:04:34.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.671+0000 7f5c732da640 1 -- start start 2024-04-26T22:04:34.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c732da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09ba40 0x7f5c6c15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c732da640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5c6c070570 0x7f5c6c0b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c732da640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5c6c09be20 0x7f5c6c162f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c732da640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5c6c160610 con 0x7f5c6c070570 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c732da640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5c6c0709b0 con 0x7f5c6c09be20 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c732da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6c15fce0 con 0x7f5c6c09ba40 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c70875640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5c6c070570 0x7f5c6c0b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c70875640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5c6c070570 0x7f5c6c0b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58334/0 (socket says 172.21.15.137:58334) 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c70875640 1 -- 172.21.15.137:0/136595165 learned_addr learned my addr 172.21.15.137:0/136595165 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c71076640 1 --2- 172.21.15.137:0/136595165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09ba40 0x7f5c6c15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c71877640 1 --2- 172.21.15.137:0/136595165 >> v2:172.21.15.170:3300/0 conn(0x7f5c6c09be20 0x7f5c6c162f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.672+0000 7f5c70875640 1 -- 172.21.15.137:0/136595165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09ba40 msgr2=0x7f5c6c15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.673+0000 7f5c70875640 1 --2- 172.21.15.137:0/136595165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09ba40 0x7f5c6c15f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.673+0000 7f5c70875640 1 -- 172.21.15.137:0/136595165 >> v2:172.21.15.170:3300/0 conn(0x7f5c6c09be20 msgr2=0x7f5c6c162f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:34.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.673+0000 7f5c70875640 1 --2- 172.21.15.137:0/136595165 >> v2:172.21.15.170:3300/0 conn(0x7f5c6c09be20 0x7f5c6c162f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.673+0000 7f5c70875640 1 -- 172.21.15.137:0/136595165 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c15ffc0 con 0x7f5c6c070570 2024-04-26T22:04:34.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.673+0000 7f5c70875640 1 --2- 172.21.15.137:0/136595165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 0x7f5c6c0b5530 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c073c50 tx=0x7f5c5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668fc518376bf262 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.673+0000 7f5c63fff640 1 -- 172.21.15.137:0/136595165 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c037070 con 0x7f5c6c070570 2024-04-26T22:04:34.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.673+0000 7f5c63fff640 1 -- 172.21.15.137:0/136595165 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c5c032440 con 0x7f5c6c070570 2024-04-26T22:04:34.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.673+0000 7f5c63fff640 1 -- 172.21.15.137:0/136595165 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c032810 con 0x7f5c6c070570 2024-04-26T22:04:34.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.674+0000 7f5c732da640 1 -- 172.21.15.137:0/136595165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 msgr2=0x7f5c6c0b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.674+0000 7f5c732da640 1 --2- 172.21.15.137:0/136595165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 0x7f5c6c0b5530 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c073c50 tx=0x7f5c5c02a1e0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.674+0000 7f5c732da640 1 -- 172.21.15.137:0/136595165 shutdown_connections 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.674+0000 7f5c732da640 1 --2- 172.21.15.137:0/136595165 >> v2:172.21.15.170:3300/0 conn(0x7f5c6c09be20 0x7f5c6c162f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.674+0000 7f5c732da640 1 --2- 172.21.15.137:0/136595165 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 0x7f5c6c0b5530 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.674+0000 7f5c732da640 1 --2- 172.21.15.137:0/136595165 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09ba40 0x7f5c6c15f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.674+0000 7f5c732da640 1 -- 172.21.15.137:0/136595165 >> 172.21.15.137:0/136595165 conn(0x7f5c6c0b4a10 msgr2=0x7f5c6c0b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.674+0000 7f5c732da640 1 -- 172.21.15.137:0/136595165 shutdown_connections 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.674+0000 7f5c732da640 1 -- 172.21.15.137:0/136595165 wait complete. 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.675+0000 7f5c732da640 1 Processor -- start 2024-04-26T22:04:34.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.675+0000 7f5c732da640 1 -- start start 2024-04-26T22:04:34.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c732da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 0x7f5c6c15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c732da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c6c09ba40 0x7f5c6c0c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c732da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09be20 0x7f5c6c0ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c732da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c1634c0 con 0x7f5c6c070570 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c732da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c09c2b0 con 0x7f5c6c09ba40 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c732da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6c163640 con 0x7f5c6c09be20 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71076640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 0x7f5c6c15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71076640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 0x7f5c6c15a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58344/0 (socket says 172.21.15.137:58344) 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71076640 1 -- 172.21.15.137:0/271606857 learned_addr learned my addr 172.21.15.137:0/271606857 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71877640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09be20 0x7f5c6c0ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c70875640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c6c09ba40 0x7f5c6c0c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71076640 1 -- 172.21.15.137:0/271606857 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09be20 msgr2=0x7f5c6c0ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71076640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09be20 0x7f5c6c0ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71076640 1 -- 172.21.15.137:0/271606857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c6c09ba40 msgr2=0x7f5c6c0c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71076640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c6c09ba40 0x7f5c6c0c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71076640 1 -- 172.21.15.137:0/271606857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c0ca090 con 0x7f5c6c070570 2024-04-26T22:04:34.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.676+0000 7f5c71076640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 0x7f5c6c15a100 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800e890 tx=0x7f5c6800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.677+0000 7f5c61ffb640 1 -- 172.21.15.137:0/271606857 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68017070 con 0x7f5c6c070570 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.677+0000 7f5c61ffb640 1 -- 172.21.15.137:0/271606857 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6800c940 con 0x7f5c6c070570 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.677+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6c0cb8e0 con 0x7f5c6c070570 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.677+0000 7f5c61ffb640 1 -- 172.21.15.137:0/271606857 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800cd10 con 0x7f5c6c070570 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.677+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6c0cbe40 con 0x7f5c6c070570 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.678+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6c06a290 con 0x7f5c6c070570 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.678+0000 7f5c61ffb640 1 -- 172.21.15.137:0/271606857 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c6801a070 con 0x7f5c6c070570 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.678+0000 7f5c61ffb640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5c5006c920 0x7f5c5006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.679+0000 7f5c61ffb640 1 -- 172.21.15.137:0/271606857 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f5c6808baa0 con 0x7f5c6c070570 2024-04-26T22:04:34.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.679+0000 7f5c70875640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5c5006c920 0x7f5c5006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:34.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.679+0000 7f5c70875640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5c5006c920 0x7f5c5006ede0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c034000 tx=0x7f5c5c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:34.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.683+0000 7f5c61ffb640 1 -- 172.21.15.137:0/271606857 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5c6c0cb8e0 con 0x7f5c6c070570 2024-04-26T22:04:34.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.896+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5c6c0c9ac0 con 0x7f5c6c070570 2024-04-26T22:04:34.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.897+0000 7f5c61ffb640 1 -- 172.21.15.137:0/271606857 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+164 (secure 0 0 0) 0x7f5c68059ef0 con 0x7f5c6c070570 2024-04-26T22:04:34.897 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:04:34.897 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5c5006c920 msgr2=0x7f5c5006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5c5006c920 0x7f5c5006ede0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c034000 tx=0x7f5c5c02e000 comp rx=0 tx=0).stop 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 msgr2=0x7f5c6c15a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 0x7f5c6c15a100 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800e890 tx=0x7f5c6800ed50 comp rx=0 tx=0).stop 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 shutdown_connections 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5c5006c920 0x7f5c5006ede0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5c6c09be20 0x7f5c6c0ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c6c09ba40 0x7f5c6c0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 --2- 172.21.15.137:0/271606857 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5c6c070570 0x7f5c6c15a100 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:34.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 >> 172.21.15.137:0/271606857 conn(0x7f5c6c0b4a10 msgr2=0x7f5c6c15c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:34.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 shutdown_connections 2024-04-26T22:04:34.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:34.899+0000 7f5c732da640 1 -- 172.21.15.137:0/271606857 wait complete. 2024-04-26T22:04:34.909 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-26T22:04:34.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:34.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-26T22:04:35.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.011+0000 7f0a3de6d640 1 Processor -- start 2024-04-26T22:04:35.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.011+0000 7f0a3de6d640 1 -- start start 2024-04-26T22:04:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a3de6d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a380cee20 0x7f0a3806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a3de6d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0a380d3a30 0x7f0a3809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a3de6d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3809bf80 0x7f0a381630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a3de6d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0a380d1e10 con 0x7f0a380cee20 2024-04-26T22:04:35.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a3de6d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0a380d1240 con 0x7f0a380d3a30 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a3de6d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0a380d14e0 con 0x7f0a3809bf80 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a377fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a380cee20 0x7f0a3806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a377fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a380cee20 0x7f0a3806d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58348/0 (socket says 172.21.15.137:58348) 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a377fe640 1 -- 172.21.15.137:0/1996353535 learned_addr learned my addr 172.21.15.137:0/1996353535 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a37fff640 1 --2- 172.21.15.137:0/1996353535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3809bf80 0x7f0a381630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/1996353535 >> v2:172.21.15.170:3300/0 conn(0x7f0a380d3a30 0x7f0a3809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a377fe640 1 -- 172.21.15.137:0/1996353535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3809bf80 msgr2=0x7f0a381630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a377fe640 1 --2- 172.21.15.137:0/1996353535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3809bf80 0x7f0a381630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.012+0000 7f0a377fe640 1 -- 172.21.15.137:0/1996353535 >> v2:172.21.15.170:3300/0 conn(0x7f0a380d3a30 msgr2=0x7f0a3809ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.013+0000 7f0a377fe640 1 --2- 172.21.15.137:0/1996353535 >> v2:172.21.15.170:3300/0 conn(0x7f0a380d3a30 0x7f0a3809ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.013+0000 7f0a377fe640 1 -- 172.21.15.137:0/1996353535 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a380d17c0 con 0x7f0a380cee20 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.013+0000 7f0a377fe640 1 --2- 172.21.15.137:0/1996353535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a380cee20 0x7f0a3806d5c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f0a38073960 tx=0x7f0a2802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59512efb5c83a96a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.013+0000 7f0a367fc640 1 -- 172.21.15.137:0/1996353535 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28037070 con 0x7f0a380cee20 2024-04-26T22:04:35.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.013+0000 7f0a367fc640 1 -- 172.21.15.137:0/1996353535 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a28032440 con 0x7f0a380cee20 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.013+0000 7f0a367fc640 1 -- 172.21.15.137:0/1996353535 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28032810 con 0x7f0a380cee20 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.014+0000 7f0a3de6d640 1 -- 172.21.15.137:0/1996353535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a380cee20 msgr2=0x7f0a3806d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.014+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/1996353535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a380cee20 0x7f0a3806d5c0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f0a38073960 tx=0x7f0a2802a1e0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.014+0000 7f0a3de6d640 1 -- 172.21.15.137:0/1996353535 shutdown_connections 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.014+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/1996353535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a3809bf80 0x7f0a381630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.014+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/1996353535 >> v2:172.21.15.170:3300/0 conn(0x7f0a380d3a30 0x7f0a3809ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.014+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/1996353535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a380cee20 0x7f0a3806d5c0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.014+0000 7f0a3de6d640 1 -- 172.21.15.137:0/1996353535 >> 172.21.15.137:0/1996353535 conn(0x7f0a380d2f10 msgr2=0x7f0a380d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.014+0000 7f0a3de6d640 1 -- 172.21.15.137:0/1996353535 shutdown_connections 2024-04-26T22:04:35.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.014+0000 7f0a3de6d640 1 -- 172.21.15.137:0/1996353535 wait complete. 2024-04-26T22:04:35.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.015+0000 7f0a3de6d640 1 Processor -- start 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.015+0000 7f0a3de6d640 1 -- start start 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a3de6d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3809bf80 0x7f0a3815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a3de6d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a380cee20 0x7f0a380cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a3de6d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a380d3a30 0x7f0a380c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a3de6d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0a380cf200 con 0x7f0a3809bf80 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a3de6d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3809c7a0 con 0x7f0a380cee20 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a3de6d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0a380cf380 con 0x7f0a380d3a30 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3809bf80 0x7f0a3815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3809bf80 0x7f0a3815d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58364/0 (socket says 172.21.15.137:58364) 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a377fe640 1 -- 172.21.15.137:0/3639531050 learned_addr learned my addr 172.21.15.137:0/3639531050 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a380cee20 0x7f0a380cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a37fff640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a380d3a30 0x7f0a380c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a377fe640 1 -- 172.21.15.137:0/3639531050 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a380d3a30 msgr2=0x7f0a380c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a377fe640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a380d3a30 0x7f0a380c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a377fe640 1 -- 172.21.15.137:0/3639531050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a380cee20 msgr2=0x7f0a380cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a377fe640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a380cee20 0x7f0a380cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.016+0000 7f0a377fe640 1 -- 172.21.15.137:0/3639531050 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a380ccca0 con 0x7f0a3809bf80 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.017+0000 7f0a377fe640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3809bf80 0x7f0a3815d3c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0a28000c00 tx=0x7f0a280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.017+0000 7f0a1ffff640 1 -- 172.21.15.137:0/3639531050 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28041020 con 0x7f0a3809bf80 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.017+0000 7f0a1ffff640 1 -- 172.21.15.137:0/3639531050 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a280306c0 con 0x7f0a3809bf80 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.017+0000 7f0a1ffff640 1 -- 172.21.15.137:0/3639531050 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28037040 con 0x7f0a3809bf80 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.017+0000 7f0a3de6d640 1 -- 172.21.15.137:0/3639531050 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a380ccf40 con 0x7f0a3809bf80 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.017+0000 7f0a3de6d640 1 -- 172.21.15.137:0/3639531050 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a380cd500 con 0x7f0a3809bf80 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.018+0000 7f0a1ffff640 1 -- 172.21.15.137:0/3639531050 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a28044020 con 0x7f0a3809bf80 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.019+0000 7f0a1ffff640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a2406c8f0 0x7f0a2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.019+0000 7f0a1ffff640 1 -- 172.21.15.137:0/3639531050 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f0a280ac270 con 0x7f0a3809bf80 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.019+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a2406c8f0 0x7f0a2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.019+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a2406c8f0 0x7f0a2406edb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0a380d0a40 tx=0x7f0a2c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.019+0000 7f0a40b84740 1 Processor -- start 2024-04-26T22:04:35.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.020+0000 7f0a40b84740 1 -- start start 2024-04-26T22:04:35.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.020+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2e67960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.020+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2e97470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.020+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e979b0 0x5619c2e6c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.020+0000 7f0a40b84740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5619c2dd1b00 con 0x5619c2eb4fd0 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.020+0000 7f0a40b84740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5619c2d6d920 con 0x5619c2e980f0 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.020+0000 7f0a40b84740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5619c2dcdac0 con 0x5619c2e979b0 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.020+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2e67960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a377fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2e67960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58370/0 (socket says 172.21.15.137:58370) 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a377fe640 1 -- 172.21.15.137:0/1075565508 learned_addr learned my addr 172.21.15.137:0/1075565508 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a377fe640 1 -- 172.21.15.137:0/1075565508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e979b0 msgr2=0x5619c2e6c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a377fe640 1 --2- 172.21.15.137:0/1075565508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e979b0 0x5619c2e6c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a377fe640 1 -- 172.21.15.137:0/1075565508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 msgr2=0x5619c2e97470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a377fe640 1 --2- 172.21.15.137:0/1075565508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2e97470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a377fe640 1 -- 172.21.15.137:0/1075565508 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c2bab7e0 con 0x5619c2eb4fd0 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a377fe640 1 --2- 172.21.15.137:0/1075565508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2e67960 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f0a280aa700 tx=0x7f0a28009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82c937eac5fbbe2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a1d7fa640 1 -- 172.21.15.137:0/1075565508 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2807a070 con 0x5619c2eb4fd0 2024-04-26T22:04:35.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a1d7fa640 1 -- 172.21.15.137:0/1075565508 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2807e370 con 0x5619c2eb4fd0 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.021+0000 7f0a1d7fa640 1 -- 172.21.15.137:0/1075565508 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28082ba0 con 0x5619c2eb4fd0 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 -- 172.21.15.137:0/1075565508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 msgr2=0x5619c2e67960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 --2- 172.21.15.137:0/1075565508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2e67960 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f0a280aa700 tx=0x7f0a28009240 comp rx=0 tx=0).stop 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 -- 172.21.15.137:0/1075565508 shutdown_connections 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 --2- 172.21.15.137:0/1075565508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e979b0 0x5619c2e6c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 --2- 172.21.15.137:0/1075565508 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2e97470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 --2- 172.21.15.137:0/1075565508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2e67960 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 -- 172.21.15.137:0/1075565508 >> 172.21.15.137:0/1075565508 conn(0x5619c2e69bd0 msgr2=0x5619c2eb2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 -- 172.21.15.137:0/1075565508 shutdown_connections 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 -- 172.21.15.137:0/1075565508 wait complete. 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 -- start start 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.022+0000 7f0a40b84740 1 Processor -- start 2024-04-26T22:04:35.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e980f0 0x5619c2e84cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2eb4fd0 0x5619c2e9a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eb35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a40b84740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5619c2d6d920 con 0x5619c2e9aa30 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a40b84740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5619c2d6b5d0 con 0x5619c2eb4fd0 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a40b84740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5619c2dd1b00 con 0x5619c2e980f0 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a40b84740 10 client.0 _ll_register_callbacks cb 0x5619c2d59080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eb35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eb35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58378/0 (socket says 172.21.15.137:58378) 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.023+0000 7f0a37fff640 1 -- 172.21.15.137:0/3560852957 learned_addr learned my addr 172.21.15.137:0/3560852957 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a377fe640 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e980f0 0x5619c2e84cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2eb4fd0 0x5619c2e9a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a37fff640 1 -- 172.21.15.137:0/3560852957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e980f0 msgr2=0x5619c2e84cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a37fff640 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e980f0 0x5619c2e84cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a37fff640 1 -- 172.21.15.137:0/3560852957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2eb4fd0 msgr2=0x5619c2e9a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a37fff640 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2eb4fd0 0x5619c2e9a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a37fff640 1 -- 172.21.15.137:0/3560852957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619c2c0bf70 con 0x5619c2e9aa30 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2eb4fd0 0x5619c2e9a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a37fff640 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eb35a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0a300042f0 tx=0x7f0a30003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d7b3bce5555e65 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a167fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a167fc640 1 -- 172.21.15.137:0/3560852957 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30007a20 con 0x5619c2e9aa30 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a167fc640 1 -- 172.21.15.137:0/3560852957 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f0a30007bc0 con 0x5619c2e9aa30 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a40b84740 1 -- 172.21.15.137:0/3560852957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a2807e370 con 0x5619c2e9aa30 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a167fc640 1 -- 172.21.15.137:0/3560852957 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f0a30007dc0 con 0x5619c2e9aa30 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a40b84740 10 client.7722 fetch_fsmap learned FSMap version 54 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a40b84740 1 -- 172.21.15.137:0/3560852957 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x5619c2aa3170 con 0x5619c2e9aa30 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a167fc640 1 -- 172.21.15.137:0/3560852957 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2807e370 con 0x5619c2e9aa30 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a167fc640 1 -- 172.21.15.137:0/3560852957 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f0a30025080 con 0x5619c2e9aa30 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a40b84740 10 client.7722 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a40b84740 10 client.7722 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:04:35.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a40b84740 20 client.7722 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a40b84740 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5619c2e985e0 0x5619c2e989f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a40b84740 4 client.7722 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.024+0000 7f0a40b84740 1 -- 172.21.15.137:0/3560852957 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619c2ddf710 con 0x5619c2e985e0 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.025+0000 7f0a377fe640 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5619c2e985e0 0x5619c2e989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.025+0000 7f0a377fe640 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5619c2e985e0 0x5619c2e989f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb26911dd56c206d server_cookie=bddf00aa7fd040bc in_seq=0 out_seq=0 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.025+0000 7f0a167fc640 10 client.7722 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.025+0000 7f0a167fc640 1 -- 172.21.15.137:0/3560852957 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5619c2ddf710 con 0x5619c2e985e0 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.025+0000 7f0a167fc640 10 client.7722 handle_command_reply: tid=0 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.025+0000 7f0a40b84740 1 client.7722 shutdown 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.025+0000 7f0a40b84740 1 -- 172.21.15.137:0/3560852957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 msgr2=0x5619c2eb35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.025+0000 7f0a40b84740 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eb35a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0a300042f0 tx=0x7f0a30003f90 comp rx=0 tx=0).stop 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a40b84740 1 -- 172.21.15.137:0/3560852957 shutdown_connections 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a40b84740 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5619c2e985e0 0x5619c2e989f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a40b84740 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eb35a0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a40b84740 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2eb4fd0 0x5619c2e9a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a40b84740 1 --2- 172.21.15.137:0/3560852957 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e980f0 0x5619c2e84cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a40b84740 1 -- 172.21.15.137:0/3560852957 >> 172.21.15.137:0/3560852957 conn(0x5619c2e979b0 msgr2=0x5619c2eb2470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a167fc640 0 client.7722 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:35.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a40b84740 1 -- 172.21.15.137:0/3560852957 shutdown_connections 2024-04-26T22:04:35.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a40b84740 1 -- 172.21.15.137:0/3560852957 wait complete. 2024-04-26T22:04:35.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.026+0000 7f0a40b84740 20 client.7722 trim_cache size 0 max 16384 2024-04-26T22:04:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.043+0000 7f0a40b84740 1 Processor -- start 2024-04-26T22:04:35.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.043+0000 7f0a40b84740 1 -- start start 2024-04-26T22:04:35.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.044+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2e67e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.044+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eaa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.044+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2eb4fd0 0x5619c2eaa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.044+0000 7f0a40b84740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0a38201ab0 con 0x5619c2e9aa30 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.044+0000 7f0a40b84740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0a38200b10 con 0x5619c2e980f0 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.044+0000 7f0a40b84740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0a381f9440 con 0x5619c2eb4fd0 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.044+0000 7f0a36ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eaa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.044+0000 7f0a36ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eaa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58390/0 (socket says 172.21.15.137:58390) 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.044+0000 7f0a36ffd640 1 -- 172.21.15.137:0/2758759044 learned_addr learned my addr 172.21.15.137:0/2758759044 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a377fe640 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2e67e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a37fff640 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2eb4fd0 0x5619c2eaa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a36ffd640 1 -- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2eb4fd0 msgr2=0x5619c2eaa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2eb4fd0 0x5619c2eaa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a36ffd640 1 -- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 msgr2=0x5619c2e67e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2e67e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a36ffd640 1 -- 172.21.15.137:0/2758759044 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c2e6b7a0 con 0x5619c2e9aa30 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a377fe640 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2e67e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a37fff640 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2eb4fd0 0x5619c2eaa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eaa070 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c010920 tx=0x7f0a2c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56af689a513cabad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a1cff9640 1 -- 172.21.15.137:0/2758759044 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c010ea0 con 0x5619c2e9aa30 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a1cff9640 1 -- 172.21.15.137:0/2758759044 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c016b90 con 0x5619c2e9aa30 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.045+0000 7f0a1cff9640 1 -- 172.21.15.137:0/2758759044 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c016d40 con 0x5619c2e9aa30 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 -- 172.21.15.137:0/2758759044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 msgr2=0x5619c2eaa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eaa070 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c010920 tx=0x7f0a2c013000 comp rx=0 tx=0).stop 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 -- 172.21.15.137:0/2758759044 shutdown_connections 2024-04-26T22:04:35.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2e9aa30 0x5619c2eaa070 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2eb4fd0 0x5619c2eaa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2758759044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2e67e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 -- 172.21.15.137:0/2758759044 >> 172.21.15.137:0/2758759044 conn(0x5619c2e979b0 msgr2=0x5619c2eb45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 -- 172.21.15.137:0/2758759044 shutdown_connections 2024-04-26T22:04:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 -- 172.21.15.137:0/2758759044 wait complete. 2024-04-26T22:04:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 -- start start 2024-04-26T22:04:35.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.046+0000 7f0a40b84740 1 Processor -- start 2024-04-26T22:04:35.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2f2b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e9aa30 0x5619c2e815e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a40b84740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2eab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a40b84740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5619c2e99d30 con 0x5619c2eb4fd0 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a40b84740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3815ffb0 con 0x5619c2e980f0 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a40b84740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5619c2ec6060 con 0x5619c2e9aa30 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a40b84740 10 client.0 _ll_register_callbacks cb 0x7f0a30003e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2eab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a37fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2eab3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58392/0 (socket says 172.21.15.137:58392) 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a37fff640 1 -- 172.21.15.137:0/2218921589 learned_addr learned my addr 172.21.15.137:0/2218921589 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a36ffd640 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e9aa30 0x5619c2e815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a377fe640 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2f2b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a37fff640 1 -- 172.21.15.137:0/2218921589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e9aa30 msgr2=0x5619c2e815e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a37fff640 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e9aa30 0x5619c2e815e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a37fff640 1 -- 172.21.15.137:0/2218921589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 msgr2=0x5619c2f2b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a37fff640 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2f2b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a37fff640 1 -- 172.21.15.137:0/2218921589 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619c2ec5b90 con 0x5619c2eb4fd0 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.047+0000 7f0a377fe640 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2f2b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a37fff640 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2eab3d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0a300049b0 tx=0x7f0a30009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecf3f81556b048f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a167fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a167fc640 1 -- 172.21.15.137:0/2218921589 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a30015790 con 0x5619c2eb4fd0 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a167fc640 1 -- 172.21.15.137:0/2218921589 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f0a30015930 con 0x5619c2eb4fd0 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a40b84740 1 -- 172.21.15.137:0/2218921589 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a2c016b90 con 0x5619c2eb4fd0 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a167fc640 1 -- 172.21.15.137:0/2218921589 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f0a30034050 con 0x5619c2eb4fd0 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a40b84740 10 client.7728 fetch_fsmap learned FSMap version 54 2024-04-26T22:04:35.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a40b84740 1 -- 172.21.15.137:0/2218921589 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x5619c2e81b20 con 0x5619c2eb4fd0 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a167fc640 1 -- 172.21.15.137:0/2218921589 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c016b90 con 0x5619c2eb4fd0 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a167fc640 1 -- 172.21.15.137:0/2218921589 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f0a30037020 con 0x5619c2eb4fd0 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a40b84740 10 client.7728 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a40b84740 10 client.7728 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a40b84740 20 client.7728 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5619c2eab9d0 0x5619c2eb22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a40b84740 4 client.7728 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a40b84740 1 -- 172.21.15.137:0/2218921589 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x5619c2dd9580 con 0x5619c2eab9d0 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.048+0000 7f0a377fe640 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5619c2eab9d0 0x5619c2eb22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a167fc640 10 client.7728 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a377fe640 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5619c2eab9d0 0x5619c2eb22a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b5ab239d16c9712 server_cookie=42b207a4e160ae0f in_seq=0 out_seq=0 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a167fc640 1 -- 172.21.15.137:0/2218921589 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5619c2dd9580 con 0x5619c2eab9d0 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a167fc640 10 client.7728 handle_command_reply: tid=0 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 client.7728 shutdown 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 -- 172.21.15.137:0/2218921589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 msgr2=0x5619c2eab3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2eab3d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0a300049b0 tx=0x7f0a30009820 comp rx=0 tx=0).stop 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 -- 172.21.15.137:0/2218921589 shutdown_connections 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5619c2eab9d0 0x5619c2eb22a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5619c2eb4fd0 0x5619c2eab3d0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5619c2e9aa30 0x5619c2e815e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a167fc640 0 client.7728 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 --2- 172.21.15.137:0/2218921589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5619c2e980f0 0x5619c2f2b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 -- 172.21.15.137:0/2218921589 >> 172.21.15.137:0/2218921589 conn(0x5619c2e979b0 msgr2=0x5619c2ec1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 -- 172.21.15.137:0/2218921589 shutdown_connections 2024-04-26T22:04:35.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 1 -- 172.21.15.137:0/2218921589 wait complete. 2024-04-26T22:04:35.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.049+0000 7f0a40b84740 20 client.7728 trim_cache size 0 max 16384 2024-04-26T22:04:35.057 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:04:35.057 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:04:35.057 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "9891a80c-60c5-4d4b-9fb7-ebb2cb268406", 2024-04-26T22:04:35.057 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:04:35.057 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:04:35.057 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:04:35.050+0000 7fa56fcb9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv18 ap=3 DIRTYPARENT f(v0 m2024-04-26T22:04:24.418706+0000 1=1+0)->f(v1 m2024-04-26T22:04:24.418706+0000) n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1)->n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5596f393e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-26T22:04:24.418706+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-26T22:04:35.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 -- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a2406c8f0 msgr2=0x7f0a2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a2406c8f0 0x7f0a2406edb0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0a380d0a40 tx=0x7f0a2c008040 comp rx=0 tx=0).stop 2024-04-26T22:04:35.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 -- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3809bf80 msgr2=0x7f0a3815d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3809bf80 0x7f0a3815d3c0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0a28000c00 tx=0x7f0a280046c0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 -- 172.21.15.137:0/3639531050 shutdown_connections 2024-04-26T22:04:35.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a2406c8f0 0x7f0a2406edb0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a380d3a30 0x7f0a380c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a380cee20 0x7f0a380cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 --2- 172.21.15.137:0/3639531050 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3809bf80 0x7f0a3815d3c0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 -- 172.21.15.137:0/3639531050 >> 172.21.15.137:0/3639531050 conn(0x7f0a380d2f10 msgr2=0x7f0a380d22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 -- 172.21.15.137:0/3639531050 shutdown_connections 2024-04-26T22:04:35.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.050+0000 7f0a3de6d640 1 -- 172.21.15.137:0/3639531050 wait complete. 2024-04-26T22:04:35.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:04:35.061 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-26T22:04:35.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.160+0000 7f8b6f178640 1 Processor -- start 2024-04-26T22:04:35.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.160+0000 7f8b6f178640 1 -- start start 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.160+0000 7f8b6f178640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8b6815f410 0x7f8b680d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.160+0000 7f8b6f178640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680d1750 0x7f8b680cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.160+0000 7f8b6f178640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b680d0210 con 0x7f8b680cfd00 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.160+0000 7f8b6f178640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8b680d07d0 con 0x7f8b6815f410 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.160+0000 7f8b6f178640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8b680b3310 con 0x7f8b680d1750 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.161+0000 7f8b67fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680d1750 0x7f8b680cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.161+0000 7f8b6cf14640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8b6815f410 0x7f8b680d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.161+0000 7f8b67fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680d1750 0x7f8b680cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:55176/0 (socket says 172.21.15.137:55176) 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.161+0000 7f8b6d715640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8b680cfd00 0x7f8b680d2ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:37654/0 (socket says 172.21.15.137:37654) 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.161+0000 7f8b67fff640 1 -- 172.21.15.137:0/2536617727 learned_addr learned my addr 172.21.15.137:0/2536617727 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.161+0000 7f8b67fff640 1 -- 172.21.15.137:0/2536617727 >> v2:172.21.15.170:3300/0 conn(0x7f8b6815f410 msgr2=0x7f8b680d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.161+0000 7f8b67fff640 1 --2- 172.21.15.137:0/2536617727 >> v2:172.21.15.170:3300/0 conn(0x7f8b6815f410 0x7f8b680d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.161+0000 7f8b67fff640 1 -- 172.21.15.137:0/2536617727 >> v1:172.21.15.170:6789/0 conn(0x7f8b680cfd00 legacy=0x7f8b680d2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.161+0000 7f8b67fff640 1 -- 172.21.15.137:0/2536617727 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b680d04f0 con 0x7f8b680d1750 2024-04-26T22:04:35.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.162+0000 7f8b67fff640 1 --2- 172.21.15.137:0/2536617727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680d1750 0x7f8b680cf7c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009870 tx=0x7f8b5002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c74dd19c717cc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.162+0000 7f8b677fe640 1 -- 172.21.15.137:0/2536617727 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50037070 con 0x7f8b680d1750 2024-04-26T22:04:35.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.162+0000 7f8b677fe640 1 -- 172.21.15.137:0/2536617727 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b50032440 con 0x7f8b680d1750 2024-04-26T22:04:35.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.162+0000 7f8b677fe640 1 -- 172.21.15.137:0/2536617727 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50032810 con 0x7f8b680d1750 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.162+0000 7f8b6f178640 1 -- 172.21.15.137:0/2536617727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680d1750 msgr2=0x7f8b680cf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.162+0000 7f8b6f178640 1 --2- 172.21.15.137:0/2536617727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680d1750 0x7f8b680cf7c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009870 tx=0x7f8b5002a270 comp rx=0 tx=0).stop 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.163+0000 7f8b6f178640 1 -- 172.21.15.137:0/2536617727 shutdown_connections 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.163+0000 7f8b6f178640 1 --2- 172.21.15.137:0/2536617727 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680d1750 0x7f8b680cf7c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.163+0000 7f8b6f178640 1 --2- 172.21.15.137:0/2536617727 >> v2:172.21.15.170:3300/0 conn(0x7f8b6815f410 0x7f8b680d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.163+0000 7f8b6f178640 1 -- 172.21.15.137:0/2536617727 >> 172.21.15.137:0/2536617727 conn(0x7f8b6808cfd0 msgr2=0x7f8b6809c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.163+0000 7f8b6f178640 1 -- 172.21.15.137:0/2536617727 shutdown_connections 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.163+0000 7f8b6f178640 1 -- 172.21.15.137:0/2536617727 wait complete. 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.164+0000 7f8b6f178640 1 Processor -- start 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.164+0000 7f8b6f178640 1 -- start start 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6f178640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680cfd00 0x7f8b68158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6f178640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b680d1750 0x7f8b680c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6f178640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b6815f410 0x7f8b680afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6f178640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6815f7f0 con 0x7f8b6815f410 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6f178640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8b680b2710 con 0x7f8b680d1750 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6f178640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8b680b0c10 con 0x7f8b680cfd00 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6d715640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b6815f410 0x7f8b680afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6d715640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b6815f410 0x7f8b680afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58396/0 (socket says 172.21.15.137:58396) 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6d715640 1 -- 172.21.15.137:0/3449353915 learned_addr learned my addr 172.21.15.137:0/3449353915 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680cfd00 0x7f8b68158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b67fff640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b680d1750 0x7f8b680c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6d715640 1 -- 172.21.15.137:0/3449353915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680cfd00 msgr2=0x7f8b68158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6d715640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680cfd00 0x7f8b68158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6d715640 1 -- 172.21.15.137:0/3449353915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b680d1750 msgr2=0x7f8b680c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6d715640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b680d1750 0x7f8b680c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6d715640 1 -- 172.21.15.137:0/3449353915 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b680b0650 con 0x7f8b6815f410 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6d715640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b6815f410 0x7f8b680afb90 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800c460 tx=0x7f8b5800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b657fa640 1 -- 172.21.15.137:0/3449353915 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58018070 con 0x7f8b6815f410 2024-04-26T22:04:35.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b657fa640 1 -- 172.21.15.137:0/3449353915 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b58007480 con 0x7f8b6815f410 2024-04-26T22:04:35.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6f178640 1 -- 172.21.15.137:0/3449353915 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b680b0930 con 0x7f8b6815f410 2024-04-26T22:04:35.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b657fa640 1 -- 172.21.15.137:0/3449353915 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b580047e0 con 0x7f8b6815f410 2024-04-26T22:04:35.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.165+0000 7f8b6f178640 1 -- 172.21.15.137:0/3449353915 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b680b5ed0 con 0x7f8b6815f410 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.167+0000 7f8b657fa640 1 -- 172.21.15.137:0/3449353915 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b58004980 con 0x7f8b6815f410 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.168+0000 7f8b657fa640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8b4806c8f0 0x7f8b4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.168+0000 7f8b657fa640 1 -- 172.21.15.137:0/3449353915 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f8b5808aca0 con 0x7f8b6815f410 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.168+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8b4806c8f0 0x7f8b4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.168+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8b4806c8f0 0x7f8b4806edb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8b60011340 tx=0x7f8b6000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.168+0000 7f8b71f6e740 1 Processor -- start 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b71f6e740 1 -- start start 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 0x563bd85c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85bbe10 0x563bd85bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd85c0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563bd8525d80 con 0x563bd85c00c0 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563bd84df8b0 con 0x563bd85bbe10 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563bd8521d40 con 0x563bd85c0f80 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b6d715640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd85c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b6d715640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd85c0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58404/0 (socket says 172.21.15.137:58404) 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b6d715640 1 -- 172.21.15.137:0/968362361 learned_addr learned my addr 172.21.15.137:0/968362361 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 0x563bd85c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.169+0000 7f8b67fff640 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85bbe10 0x563bd85bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b6d715640 1 -- 172.21.15.137:0/968362361 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 msgr2=0x563bd85c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b6d715640 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 0x563bd85c1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b6d715640 1 -- 172.21.15.137:0/968362361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85bbe10 msgr2=0x563bd85bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b6d715640 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85bbe10 0x563bd85bfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b6d715640 1 -- 172.21.15.137:0/968362361 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bd84b0a40 con 0x563bd85c00c0 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 0x563bd85c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:04:35.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b6d715640 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd85c0500 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f8b58007b90 tx=0x7f8b5805cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21704e2e2278c8e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b5e7fc640 1 -- 172.21.15.137:0/968362361 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58056d20 con 0x563bd85c00c0 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b5e7fc640 1 -- 172.21.15.137:0/968362361 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5805f0f0 con 0x563bd85c00c0 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b5e7fc640 1 -- 172.21.15.137:0/968362361 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b580610c0 con 0x563bd85c00c0 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b71f6e740 1 -- 172.21.15.137:0/968362361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 msgr2=0x563bd85c0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd85c0500 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f8b58007b90 tx=0x7f8b5805cde0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b71f6e740 1 -- 172.21.15.137:0/968362361 shutdown_connections 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd85c0500 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85bbe10 0x563bd85bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/968362361 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 0x563bd85c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b71f6e740 1 -- 172.21.15.137:0/968362361 >> 172.21.15.137:0/968362361 conn(0x563bd85be080 msgr2=0x563bd8606b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.170+0000 7f8b71f6e740 1 -- 172.21.15.137:0/968362361 shutdown_connections 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.171+0000 7f8b71f6e740 1 -- 172.21.15.137:0/968362361 wait complete. 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.171+0000 7f8b71f6e740 1 -- start start 2024-04-26T22:04:35.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.171+0000 7f8b71f6e740 1 Processor -- start 2024-04-26T22:04:35.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c00c0 0x563bd85e4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 0x563bd86098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd860c8f0 0x563bd8609de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x563bd85ecb10 con 0x563bd860c8f0 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563bd84acd10 con 0x563bd85c00c0 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563bd85ebf90 con 0x563bd85c0f80 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b71f6e740 10 client.0 _ll_register_callbacks cb 0x563bd84d9210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b6d715640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd860c8f0 0x563bd8609de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b6d715640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd860c8f0 0x563bd8609de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58412/0 (socket says 172.21.15.137:58412) 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b6d715640 1 -- 172.21.15.137:0/443398619 learned_addr learned my addr 172.21.15.137:0/443398619 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c00c0 0x563bd85e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b67fff640 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 0x563bd86098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b6d715640 1 -- 172.21.15.137:0/443398619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 msgr2=0x563bd86098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b6d715640 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 0x563bd86098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b6d715640 1 -- 172.21.15.137:0/443398619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c00c0 msgr2=0x563bd85e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b6d715640 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c00c0 0x563bd85e4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.172+0000 7f8b6d715640 1 -- 172.21.15.137:0/443398619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bd83017d0 con 0x563bd860c8f0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b6d715640 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd860c8f0 0x563bd8609de0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f8b58058720 tx=0x7f8b58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abf5676648f67e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b477fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b477fe640 1 -- 172.21.15.137:0/443398619 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b580612c0 con 0x563bd860c8f0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b477fe640 1 -- 172.21.15.137:0/443398619 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f8b58076b90 con 0x563bd860c8f0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b71f6e740 1 -- 172.21.15.137:0/443398619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b5805f0f0 con 0x563bd860c8f0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b477fe640 1 -- 172.21.15.137:0/443398619 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8b58001120 con 0x563bd860c8f0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b71f6e740 10 client.7737 fetch_fsmap learned FSMap version 54 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b71f6e740 1 -- 172.21.15.137:0/443398619 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x563bd82373f0 con 0x563bd860c8f0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b477fe640 1 -- 172.21.15.137:0/443398619 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b5805f0f0 con 0x563bd860c8f0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b477fe640 1 -- 172.21.15.137:0/443398619 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f8b58082b50 con 0x563bd860c8f0 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b71f6e740 10 client.7737 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b71f6e740 10 client.7737 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b71f6e740 20 client.7737 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:35.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563bd861a290 0x563bd861a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b71f6e740 4 client.7737 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b71f6e740 1 -- 172.21.15.137:0/443398619 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bd8533990 con 0x563bd861a290 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.173+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563bd861a290 0x563bd861a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b477fe640 10 client.7737 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563bd861a290 0x563bd861a6a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54b811fd2e6b4947 server_cookie=3646e3e1771afea8 in_seq=0 out_seq=0 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b477fe640 1 -- 172.21.15.137:0/443398619 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563bd8533990 con 0x563bd861a290 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b477fe640 10 client.7737 handle_command_reply: tid=0 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 client.7737 shutdown 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 -- 172.21.15.137:0/443398619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd860c8f0 msgr2=0x563bd8609de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd860c8f0 0x563bd8609de0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f8b58058720 tx=0x7f8b58000ed0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 -- 172.21.15.137:0/443398619 shutdown_connections 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563bd861a290 0x563bd861a6a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd860c8f0 0x563bd8609de0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b477fe640 0 client.7737 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:35.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd85c0f80 0x563bd86098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/443398619 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c00c0 0x563bd85e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 -- 172.21.15.137:0/443398619 >> 172.21.15.137:0/443398619 conn(0x563bd85bbe10 msgr2=0x563bd85c1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.174+0000 7f8b71f6e740 1 -- 172.21.15.137:0/443398619 shutdown_connections 2024-04-26T22:04:35.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.175+0000 7f8b71f6e740 1 -- 172.21.15.137:0/443398619 wait complete. 2024-04-26T22:04:35.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.175+0000 7f8b71f6e740 20 client.7737 trim_cache size 0 max 16384 2024-04-26T22:04:35.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.192+0000 7f8b71f6e740 1 Processor -- start 2024-04-26T22:04:35.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.192+0000 7f8b71f6e740 1 -- start start 2024-04-26T22:04:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.192+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd86206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.192+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c0f80 0x563bd8620c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.192+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd860c8f0 0x563bd85c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.192+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b68201990 con 0x563bd85c00c0 2024-04-26T22:04:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.192+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8b682009d0 con 0x563bd85c0f80 2024-04-26T22:04:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.192+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8b681ffd60 con 0x563bd860c8f0 2024-04-26T22:04:35.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b6cf14640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd86206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b6cf14640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd86206d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58424/0 (socket says 172.21.15.137:58424) 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b6cf14640 1 -- 172.21.15.137:0/3268675906 learned_addr learned my addr 172.21.15.137:0/3268675906 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b6cf14640 1 -- 172.21.15.137:0/3268675906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd860c8f0 msgr2=0x563bd85c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/3268675906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd860c8f0 0x563bd85c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b6cf14640 1 -- 172.21.15.137:0/3268675906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c0f80 msgr2=0x563bd8620c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/3268675906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c0f80 0x563bd8620c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b6cf14640 1 -- 172.21.15.137:0/3268675906 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bd81f70f0 con 0x563bd85c00c0 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/3268675906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd86206d0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f8b6002be20 tx=0x7f8b60014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fab6ff7e1dbae6b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b5dffb640 1 -- 172.21.15.137:0/3268675906 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60031070 con 0x563bd85c00c0 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b5dffb640 1 -- 172.21.15.137:0/3268675906 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b60017cd0 con 0x563bd85c00c0 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.193+0000 7f8b5dffb640 1 -- 172.21.15.137:0/3268675906 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6002b510 con 0x563bd85c00c0 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 -- 172.21.15.137:0/3268675906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 msgr2=0x563bd86206d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/3268675906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd86206d0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f8b6002be20 tx=0x7f8b60014000 comp rx=0 tx=0).stop 2024-04-26T22:04:35.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 -- 172.21.15.137:0/3268675906 shutdown_connections 2024-04-26T22:04:35.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/3268675906 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd860c8f0 0x563bd85c1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/3268675906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c0f80 0x563bd8620c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/3268675906 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd86206d0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 -- 172.21.15.137:0/3268675906 >> 172.21.15.137:0/3268675906 conn(0x563bd85bbe10 msgr2=0x563bd85e8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 -- 172.21.15.137:0/3268675906 shutdown_connections 2024-04-26T22:04:35.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 -- 172.21.15.137:0/3268675906 wait complete. 2024-04-26T22:04:35.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 -- start start 2024-04-26T22:04:35.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.194+0000 7f8b71f6e740 1 Processor -- start 2024-04-26T22:04:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd8688340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c0f80 0x563bd8620c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b71f6e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd860c8f0 0x563bd8600480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8b68200380 con 0x563bd85c00c0 2024-04-26T22:04:35.200 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x563bd8600bd0 con 0x563bd85c0f80 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b71f6e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x563bd8602d40 con 0x563bd860c8f0 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b71f6e740 10 client.0 _ll_register_callbacks cb 0x7f8b600095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b6cf14640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd8688340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b6cf14640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd8688340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58434/0 (socket says 172.21.15.137:58434) 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b6cf14640 1 -- 172.21.15.137:0/1798423449 learned_addr learned my addr 172.21.15.137:0/1798423449 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b6d715640 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd860c8f0 0x563bd8600480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.195+0000 7f8b67fff640 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c0f80 0x563bd8620c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b6cf14640 1 -- 172.21.15.137:0/1798423449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd860c8f0 msgr2=0x563bd8600480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd860c8f0 0x563bd8600480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b6cf14640 1 -- 172.21.15.137:0/1798423449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c0f80 msgr2=0x563bd8620c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c0f80 0x563bd8620c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b6cf14640 1 -- 172.21.15.137:0/1798423449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bd84e64b0 con 0x563bd85c00c0 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b6cf14640 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd8688340 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000b010 tx=0x7f8b60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c818ff5721e6b1e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:04:35.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b477fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b477fe640 1 -- 172.21.15.137:0/1798423449 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6003c060 con 0x563bd85c00c0 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b477fe640 1 -- 172.21.15.137:0/1798423449 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f8b60037460 con 0x563bd85c00c0 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b71f6e740 1 -- 172.21.15.137:0/1798423449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b60017cd0 con 0x563bd85c00c0 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b477fe640 1 -- 172.21.15.137:0/1798423449 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8b60042050 con 0x563bd85c00c0 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b71f6e740 10 client.7743 fetch_fsmap learned FSMap version 54 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b71f6e740 1 -- 172.21.15.137:0/1798423449 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x563bd8603a90 con 0x563bd85c00c0 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b477fe640 1 -- 172.21.15.137:0/1798423449 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b60017cd0 con 0x563bd85c00c0 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b477fe640 1 -- 172.21.15.137:0/1798423449 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f8b60045020 con 0x563bd85c00c0 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b71f6e740 10 client.7743 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b71f6e740 10 client.7743 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b71f6e740 20 client.7743 populate_metadata read hostname 'smithi137' 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563bd85fc3b0 0x563bd85c1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b71f6e740 4 client.7743 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:04:35.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b71f6e740 1 -- 172.21.15.137:0/1798423449 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563bd852d800 con 0x563bd85fc3b0 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.196+0000 7f8b67fff640 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563bd85fc3b0 0x563bd85c1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b477fe640 10 client.7743 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b67fff640 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563bd85fc3b0 0x563bd85c1360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=194a05b830536c6d server_cookie=631fe68a7a333175 in_seq=0 out_seq=0 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b477fe640 1 -- 172.21.15.137:0/1798423449 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x563bd852d800 con 0x563bd85fc3b0 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b477fe640 10 client.7743 handle_command_reply: tid=0 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 client.7743 shutdown 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 -- 172.21.15.137:0/1798423449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 msgr2=0x563bd8688340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd8688340 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f8b6000b010 tx=0x7f8b60004a40 comp rx=0 tx=0).stop 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 -- 172.21.15.137:0/1798423449 shutdown_connections 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x563bd85fc3b0 0x563bd85c1360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x563bd860c8f0 0x563bd8600480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b477fe640 0 client.7743 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bd85c0f80 0x563bd8620c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 --2- 172.21.15.137:0/1798423449 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x563bd85c00c0 0x563bd8688340 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 -- 172.21.15.137:0/1798423449 >> 172.21.15.137:0/1798423449 conn(0x563bd85bbe10 msgr2=0x563bd85ec270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 -- 172.21.15.137:0/1798423449 shutdown_connections 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 1 -- 172.21.15.137:0/1798423449 wait complete. 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.197+0000 7f8b71f6e740 20 client.7743 trim_cache size 0 max 16384 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stdout: "9891a80c-60c5-4d4b-9fb7-ebb2cb268406": { 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/dir", 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "9891a80c-60c5-4d4b-9fb7-ebb2cb268406", 2024-04-26T22:04:35.204 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,repair" 2024-04-26T22:04:35.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:35.205 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:04:35.205 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:04:35.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 -- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8b4806c8f0 msgr2=0x7f8b4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8b4806c8f0 0x7f8b4806edb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8b60011340 tx=0x7f8b6000b040 comp rx=0 tx=0).stop 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 -- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b6815f410 msgr2=0x7f8b680afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b6815f410 0x7f8b680afb90 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800c460 tx=0x7f8b5800c920 comp rx=0 tx=0).stop 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 -- 172.21.15.137:0/3449353915 shutdown_connections 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8b4806c8f0 0x7f8b4806edb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8b6815f410 0x7f8b680afb90 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b680d1750 0x7f8b680c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 --2- 172.21.15.137:0/3449353915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8b680cfd00 0x7f8b68158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 -- 172.21.15.137:0/3449353915 >> 172.21.15.137:0/3449353915 conn(0x7f8b6808cfd0 msgr2=0x7f8b6806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 -- 172.21.15.137:0/3449353915 shutdown_connections 2024-04-26T22:04:35.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:04:35.198+0000 7f8b6f178640 1 -- 172.21.15.137:0/3449353915 wait complete. 2024-04-26T22:04:35.208 INFO:tasks.cephfs.filesystem:scrub status for tag:9891a80c-60c5-4d4b-9fb7-ebb2cb268406 - {'path': '/dir', 'tag': '9891a80c-60c5-4d4b-9fb7-ebb2cb268406', 'options': 'recursive,repair'} 2024-04-26T22:04:44.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:04:44.019 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:05:05.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:05.210 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-26T22:05:05.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.320+0000 7fcf2b45b640 1 Processor -- start 2024-04-26T22:05:05.321 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.320+0000 7fcf2b45b640 1 -- start start 2024-04-26T22:05:05.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf2b45b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcf240d0300 0x7fcf240b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf2b45b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf240b3e50 0x7fcf240720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf2b45b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf240b46a0 con 0x7fcf2406f340 2024-04-26T22:05:05.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf2b45b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcf240b5db0 con 0x7fcf240d0300 2024-04-26T22:05:05.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf2b45b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcf240b6090 con 0x7fcf240b3e50 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf289f6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcf240d0300 0x7fcf240b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf291f7640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcf2406f340 0x7fcf2406f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58200/0 (socket says 172.21.15.137:58200) 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf289f6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcf240d0300 0x7fcf240b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39602/0 (socket says 172.21.15.137:39602) 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf291f7640 1 -- 172.21.15.137:0/2453111498 learned_addr learned my addr 172.21.15.137:0/2453111498 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf299f8640 1 --2- 172.21.15.137:0/2453111498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf240b3e50 0x7fcf240720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf289f6640 1 -- 172.21.15.137:0/2453111498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf240b3e50 msgr2=0x7fcf240720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf289f6640 1 --2- 172.21.15.137:0/2453111498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf240b3e50 0x7fcf240720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf289f6640 1 -- 172.21.15.137:0/2453111498 >> v1:172.21.15.137:6789/0 conn(0x7fcf2406f340 legacy=0x7fcf2406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf289f6640 1 -- 172.21.15.137:0/2453111498 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf240b6370 con 0x7fcf240d0300 2024-04-26T22:05:05.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.321+0000 7fcf1bfff640 1 -- 172.21.15.137:0/2453111498 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144710225 0 0) 0x7fcf240b46a0 con 0x7fcf2406f340 2024-04-26T22:05:05.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.322+0000 7fcf289f6640 1 --2- 172.21.15.137:0/2453111498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf240d0300 0x7fcf240b6b70 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcf140097a0 tx=0x7fcf1402a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72df1dc360f2c73 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.322+0000 7fcf1bfff640 1 -- 172.21.15.137:0/2453111498 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf14037070 con 0x7fcf240d0300 2024-04-26T22:05:05.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.322+0000 7fcf1bfff640 1 -- 172.21.15.137:0/2453111498 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf1402adb0 con 0x7fcf240d0300 2024-04-26T22:05:05.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.322+0000 7fcf1bfff640 1 -- 172.21.15.137:0/2453111498 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf14032660 con 0x7fcf240d0300 2024-04-26T22:05:05.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.323+0000 7fcf2b45b640 1 -- 172.21.15.137:0/2453111498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf240d0300 msgr2=0x7fcf240b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.323+0000 7fcf2b45b640 1 --2- 172.21.15.137:0/2453111498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf240d0300 0x7fcf240b6b70 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcf140097a0 tx=0x7fcf1402a060 comp rx=0 tx=0).stop 2024-04-26T22:05:05.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.323+0000 7fcf2b45b640 1 -- 172.21.15.137:0/2453111498 shutdown_connections 2024-04-26T22:05:05.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.323+0000 7fcf2b45b640 1 --2- 172.21.15.137:0/2453111498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf240b3e50 0x7fcf240720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.323+0000 7fcf2b45b640 1 --2- 172.21.15.137:0/2453111498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf240d0300 0x7fcf240b6b70 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.323+0000 7fcf2b45b640 1 -- 172.21.15.137:0/2453111498 >> 172.21.15.137:0/2453111498 conn(0x7fcf240cd8a0 msgr2=0x7fcf240cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.323+0000 7fcf2b45b640 1 -- 172.21.15.137:0/2453111498 shutdown_connections 2024-04-26T22:05:05.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.323+0000 7fcf2b45b640 1 -- 172.21.15.137:0/2453111498 wait complete. 2024-04-26T22:05:05.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.324+0000 7fcf2b45b640 1 Processor -- start 2024-04-26T22:05:05.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.324+0000 7fcf2b45b640 1 -- start start 2024-04-26T22:05:05.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf2b45b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf2406f340 0x7fcf241686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf2b45b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf240b3e50 0x7fcf24139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf2b45b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf240d0300 0x7fcf240720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf2b45b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf240b4460 con 0x7fcf2406f340 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf2b45b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf240b42e0 con 0x7fcf240d0300 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf2b45b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcf24142a30 con 0x7fcf240b3e50 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf291f7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf2406f340 0x7fcf241686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf291f7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf2406f340 0x7fcf241686f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39608/0 (socket says 172.21.15.137:39608) 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf291f7640 1 -- 172.21.15.137:0/677359223 learned_addr learned my addr 172.21.15.137:0/677359223 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf291f7640 1 -- 172.21.15.137:0/677359223 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf240b3e50 msgr2=0x7fcf24139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf291f7640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf240b3e50 0x7fcf24139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf291f7640 1 -- 172.21.15.137:0/677359223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf240d0300 msgr2=0x7fcf240720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf291f7640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf240d0300 0x7fcf240720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf291f7640 1 -- 172.21.15.137:0/677359223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf241f56a0 con 0x7fcf2406f340 2024-04-26T22:05:05.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf291f7640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf2406f340 0x7fcf241686f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000c430 tx=0x7fcf2000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf19ffb640 1 -- 172.21.15.137:0/677359223 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf200074e0 con 0x7fcf2406f340 2024-04-26T22:05:05.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf19ffb640 1 -- 172.21.15.137:0/677359223 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf200047e0 con 0x7fcf2406f340 2024-04-26T22:05:05.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf19ffb640 1 -- 172.21.15.137:0/677359223 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf20004bd0 con 0x7fcf2406f340 2024-04-26T22:05:05.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.325+0000 7fcf2b45b640 1 -- 172.21.15.137:0/677359223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf241f5970 con 0x7fcf2406f340 2024-04-26T22:05:05.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.326+0000 7fcf2b45b640 1 -- 172.21.15.137:0/677359223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf241f5f30 con 0x7fcf2406f340 2024-04-26T22:05:05.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.327+0000 7fcf19ffb640 1 -- 172.21.15.137:0/677359223 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf20011070 con 0x7fcf2406f340 2024-04-26T22:05:05.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.327+0000 7fcf19ffb640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcf0806c8f0 0x7fcf0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.327+0000 7fcf19ffb640 1 -- 172.21.15.137:0/677359223 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fcf2008b750 con 0x7fcf2406f340 2024-04-26T22:05:05.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.328+0000 7fcf289f6640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcf0806c8f0 0x7fcf0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.328+0000 7fcf289f6640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcf0806c8f0 0x7fcf0806edb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcf14034000 tx=0x7fcf1402c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf2e170740 1 Processor -- start 2024-04-26T22:05:05.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf2e170740 1 -- start start 2024-04-26T22:05:05.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1cf80 0x557311b1d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b17e10 0x557311b1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b1c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf2e170740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557311a81d80 con 0x557311b1c0c0 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf2e170740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557311a3b8b0 con 0x557311b1cf80 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf2e170740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x557311a7dd40 con 0x557311b17e10 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf299f8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b1c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf299f8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b1c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39610/0 (socket says 172.21.15.137:39610) 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.329+0000 7fcf299f8640 1 -- 172.21.15.137:0/2403036863 learned_addr learned my addr 172.21.15.137:0/2403036863 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf291f7640 1 --2- 172.21.15.137:0/2403036863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1cf80 0x557311b1d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf289f6640 1 --2- 172.21.15.137:0/2403036863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b17e10 0x557311b1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf299f8640 1 -- 172.21.15.137:0/2403036863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b17e10 msgr2=0x557311b1bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf299f8640 1 --2- 172.21.15.137:0/2403036863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b17e10 0x557311b1bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf299f8640 1 -- 172.21.15.137:0/2403036863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1cf80 msgr2=0x557311b1d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf299f8640 1 --2- 172.21.15.137:0/2403036863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1cf80 0x557311b1d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf299f8640 1 -- 172.21.15.137:0/2403036863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557311a0ca40 con 0x557311b1c0c0 2024-04-26T22:05:05.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf299f8640 1 --2- 172.21.15.137:0/2403036863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b1c500 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009e80 tx=0x7fcf1c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38752448436e53ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf06ffd640 1 -- 172.21.15.137:0/2403036863 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c019070 con 0x557311b1c0c0 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf06ffd640 1 -- 172.21.15.137:0/2403036863 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf1c012710 con 0x557311b1c0c0 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.330+0000 7fcf06ffd640 1 -- 172.21.15.137:0/2403036863 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c012ac0 con 0x557311b1c0c0 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 -- 172.21.15.137:0/2403036863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 msgr2=0x557311b1c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 --2- 172.21.15.137:0/2403036863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b1c500 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009e80 tx=0x7fcf1c007700 comp rx=0 tx=0).stop 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 -- 172.21.15.137:0/2403036863 shutdown_connections 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 --2- 172.21.15.137:0/2403036863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b1c500 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 --2- 172.21.15.137:0/2403036863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b17e10 0x557311b1bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 --2- 172.21.15.137:0/2403036863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1cf80 0x557311b1d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 -- 172.21.15.137:0/2403036863 >> 172.21.15.137:0/2403036863 conn(0x557311b1a080 msgr2=0x557311b62b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 -- 172.21.15.137:0/2403036863 shutdown_connections 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 -- 172.21.15.137:0/2403036863 wait complete. 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 -- start start 2024-04-26T22:05:05.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.331+0000 7fcf2e170740 1 Processor -- start 2024-04-26T22:05:05.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1c0c0 0x557311b44800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1cf80 0x557311b65810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b3f110 0x557311b65d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf2e170740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557311b48b10 con 0x557311b1cf80 2024-04-26T22:05:05.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf2e170740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557311a08d10 con 0x557311b1c0c0 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf2e170740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x557311b47f90 con 0x557311b3f110 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf2e170740 10 client.0 _ll_register_callbacks cb 0x557311a35210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf289f6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1cf80 0x557311b65810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf289f6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1cf80 0x557311b65810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39620/0 (socket says 172.21.15.137:39620) 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf289f6640 1 -- 172.21.15.137:0/3821612706 learned_addr learned my addr 172.21.15.137:0/3821612706 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf291f7640 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1c0c0 0x557311b44800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.332+0000 7fcf299f8640 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b3f110 0x557311b65d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf289f6640 1 -- 172.21.15.137:0/3821612706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b3f110 msgr2=0x557311b65d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf289f6640 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b3f110 0x557311b65d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf289f6640 1 -- 172.21.15.137:0/3821612706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1c0c0 msgr2=0x557311b44800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf289f6640 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1c0c0 0x557311b44800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf289f6640 1 -- 172.21.15.137:0/3821612706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55731185d7d0 con 0x557311b1cf80 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf289f6640 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1cf80 0x557311b65810 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fcf1402a0a0 tx=0x7fcf14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4592072dd60cf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcefffff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcefffff640 1 -- 172.21.15.137:0/3821612706 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1404c030 con 0x557311b1cf80 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcefffff640 1 -- 172.21.15.137:0/3821612706 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fcf14032710 con 0x557311b1cf80 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf2e170740 1 -- 172.21.15.137:0/3821612706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf1c012710 con 0x557311b1cf80 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcefffff640 1 -- 172.21.15.137:0/3821612706 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fcf14058050 con 0x557311b1cf80 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf2e170740 10 client.7758 fetch_fsmap learned FSMap version 54 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf2e170740 1 -- 172.21.15.137:0/3821612706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x5573117933f0 con 0x557311b1cf80 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcefffff640 1 -- 172.21.15.137:0/3821612706 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf1c012710 con 0x557311b1cf80 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcefffff640 1 -- 172.21.15.137:0/3821612706 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fcf1405b020 con 0x557311b1cf80 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf2e170740 10 client.7758 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf2e170740 10 client.7758 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf2e170740 20 client.7758 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x557311b41240 0x557311b41640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf2e170740 4 client.7758 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.333+0000 7fcf2e170740 1 -- 172.21.15.137:0/3821612706 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557311a8f990 con 0x557311b41240 2024-04-26T22:05:05.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.334+0000 7fcf291f7640 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x557311b41240 0x557311b41640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.334+0000 7fcf291f7640 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x557311b41240 0x557311b41640 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c73b2384da58134 server_cookie=aea253e08bdae0b7 in_seq=0 out_seq=0 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.334+0000 7fcefffff640 10 client.7758 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.334+0000 7fcefffff640 1 -- 172.21.15.137:0/3821612706 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557311a8f990 con 0x557311b41240 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.334+0000 7fcefffff640 10 client.7758 handle_command_reply: tid=0 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.334+0000 7fcf2e170740 1 client.7758 shutdown 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.334+0000 7fcf2e170740 1 -- 172.21.15.137:0/3821612706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1cf80 msgr2=0x557311b65810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.334+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1cf80 0x557311b65810 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fcf1402a0a0 tx=0x7fcf14004730 comp rx=0 tx=0).stop 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcf2e170740 1 -- 172.21.15.137:0/3821612706 shutdown_connections 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x557311b41240 0x557311b41640 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1cf80 0x557311b65810 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b3f110 0x557311b65d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcefffff640 0 client.7758 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3821612706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b1c0c0 0x557311b44800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcf2e170740 1 -- 172.21.15.137:0/3821612706 >> 172.21.15.137:0/3821612706 conn(0x557311b17e10 msgr2=0x557311b1da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcf2e170740 1 -- 172.21.15.137:0/3821612706 shutdown_connections 2024-04-26T22:05:05.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcf2e170740 1 -- 172.21.15.137:0/3821612706 wait complete. 2024-04-26T22:05:05.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.335+0000 7fcf2e170740 20 client.7758 trim_cache size 0 max 16384 2024-04-26T22:05:05.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.352+0000 7fcf2e170740 1 Processor -- start 2024-04-26T22:05:05.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.352+0000 7fcf2e170740 1 -- start start 2024-04-26T22:05:05.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b48700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b1cf80 0x557311b44440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b3f110 0x557311b44980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf2e170740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcf24201980 con 0x557311b1c0c0 2024-04-26T22:05:05.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf2e170740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf24200960 con 0x557311b3f110 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf2e170740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcf241ffd70 con 0x557311b1cf80 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf291f7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b48700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf291f7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b48700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39628/0 (socket says 172.21.15.137:39628) 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf291f7640 1 -- 172.21.15.137:0/948452483 learned_addr learned my addr 172.21.15.137:0/948452483 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf291f7640 1 -- 172.21.15.137:0/948452483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b1cf80 msgr2=0x557311b44440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf291f7640 1 --2- 172.21.15.137:0/948452483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b1cf80 0x557311b44440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf291f7640 1 -- 172.21.15.137:0/948452483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b3f110 msgr2=0x557311b44980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf291f7640 1 --2- 172.21.15.137:0/948452483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b3f110 0x557311b44980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf291f7640 1 -- 172.21.15.137:0/948452483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573117530f0 con 0x557311b1c0c0 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf291f7640 1 --2- 172.21.15.137:0/948452483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b48700 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fcf20000fb0 tx=0x7fcf2005d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7683f929cec9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf067fc640 1 -- 172.21.15.137:0/948452483 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf20088070 con 0x557311b1c0c0 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf067fc640 1 -- 172.21.15.137:0/948452483 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf20062080 con 0x557311b1c0c0 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.353+0000 7fcf067fc640 1 -- 172.21.15.137:0/948452483 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf20075070 con 0x557311b1c0c0 2024-04-26T22:05:05.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 -- 172.21.15.137:0/948452483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 msgr2=0x557311b48700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 --2- 172.21.15.137:0/948452483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b48700 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fcf20000fb0 tx=0x7fcf2005d040 comp rx=0 tx=0).stop 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 -- 172.21.15.137:0/948452483 shutdown_connections 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 --2- 172.21.15.137:0/948452483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b3f110 0x557311b44980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 --2- 172.21.15.137:0/948452483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b1cf80 0x557311b44440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 --2- 172.21.15.137:0/948452483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b48700 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 -- 172.21.15.137:0/948452483 >> 172.21.15.137:0/948452483 conn(0x557311b17e10 msgr2=0x557311b13240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 -- 172.21.15.137:0/948452483 shutdown_connections 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 -- 172.21.15.137:0/948452483 wait complete. 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.354+0000 7fcf2e170740 1 -- start start 2024-04-26T22:05:05.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.355+0000 7fcf2e170740 1 Processor -- start 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.355+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b3e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.355+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b1cf80 0x557311b61e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.355+0000 7fcf2e170740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b3f110 0x557311bdef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.355+0000 7fcf2e170740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557311b19380 con 0x557311b1c0c0 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.355+0000 7fcf2e170740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcf24200310 con 0x557311b3f110 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.355+0000 7fcf2e170740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x557311b1e9f0 con 0x557311b1cf80 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.355+0000 7fcf2e170740 10 client.0 _ll_register_callbacks cb 0x7fcf14035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.355+0000 7fcf291f7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b3e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf291f7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b3e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39638/0 (socket says 172.21.15.137:39638) 2024-04-26T22:05:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf291f7640 1 -- 172.21.15.137:0/3205513697 learned_addr learned my addr 172.21.15.137:0/3205513697 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf291f7640 1 -- 172.21.15.137:0/3205513697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b1cf80 msgr2=0x557311b61e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf289f6640 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b1cf80 0x557311b61e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf299f8640 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b3f110 0x557311bdef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf291f7640 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b1cf80 0x557311b61e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf291f7640 1 -- 172.21.15.137:0/3205513697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b3f110 msgr2=0x557311bdef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf291f7640 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b3f110 0x557311bdef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf291f7640 1 -- 172.21.15.137:0/3205513697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557311a424b0 con 0x557311b1c0c0 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf291f7640 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b3e1f0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fcf20055900 tx=0x7fcf20009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5205ad3c9ed400 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcefffff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcefffff640 1 -- 172.21.15.137:0/3205513697 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2007d060 con 0x557311b1c0c0 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcefffff640 1 -- 172.21.15.137:0/3205513697 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fcf20004d70 con 0x557311b1c0c0 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf2e170740 1 -- 172.21.15.137:0/3205513697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf20062080 con 0x557311b1c0c0 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcefffff640 1 -- 172.21.15.137:0/3205513697 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fcf20088070 con 0x557311b1c0c0 2024-04-26T22:05:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf2e170740 10 client.7764 fetch_fsmap learned FSMap version 54 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcf2e170740 1 -- 172.21.15.137:0/3205513697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x557311b62380 con 0x557311b1c0c0 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcefffff640 1 -- 172.21.15.137:0/3205513697 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf20062080 con 0x557311b1c0c0 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.356+0000 7fcefffff640 1 -- 172.21.15.137:0/3205513697 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7fcf20055b10 con 0x557311b1c0c0 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 10 client.7764 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 10 client.7764 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 20 client.7764 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x557311b62f50 0x557311bdf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 4 client.7764 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 -- 172.21.15.137:0/3205513697 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557311a89800 con 0x557311b62f50 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf289f6640 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x557311b62f50 0x557311bdf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcefffff640 10 client.7764 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf289f6640 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x557311b62f50 0x557311bdf490 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ca6e3b24ec3e0cb server_cookie=c442797cbf652d4a in_seq=0 out_seq=0 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcefffff640 1 -- 172.21.15.137:0/3205513697 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557311a89800 con 0x557311b62f50 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcefffff640 10 client.7764 handle_command_reply: tid=0 2024-04-26T22:05:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 client.7764 shutdown 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 -- 172.21.15.137:0/3205513697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 msgr2=0x557311b3e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b3e1f0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fcf20055900 tx=0x7fcf20009040 comp rx=0 tx=0).stop 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 -- 172.21.15.137:0/3205513697 shutdown_connections 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x557311b62f50 0x557311bdf490 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557311b3f110 0x557311bdef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcefffff640 0 client.7764 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557311b1cf80 0x557311b61e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 --2- 172.21.15.137:0/3205513697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557311b1c0c0 0x557311b3e1f0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 -- 172.21.15.137:0/3205513697 >> 172.21.15.137:0/3205513697 conn(0x557311b17e10 msgr2=0x557311b86760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 -- 172.21.15.137:0/3205513697 shutdown_connections 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 1 -- 172.21.15.137:0/3205513697 wait complete. 2024-04-26T22:05:05.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.357+0000 7fcf2e170740 20 client.7764 trim_cache size 0 max 16384 2024-04-26T22:05:05.365 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:05:05.365 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:05:05.365 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:05:05.365 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 -- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcf0806c8f0 msgr2=0x7fcf0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcf0806c8f0 0x7fcf0806edb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fcf14034000 tx=0x7fcf1402c000 comp rx=0 tx=0).stop 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 -- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf2406f340 msgr2=0x7fcf241686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf2406f340 0x7fcf241686f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000c430 tx=0x7fcf2000c8f0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 -- 172.21.15.137:0/677359223 shutdown_connections 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcf0806c8f0 0x7fcf0806edb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf240d0300 0x7fcf240720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcf240b3e50 0x7fcf24139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 --2- 172.21.15.137:0/677359223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcf2406f340 0x7fcf241686f0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 -- 172.21.15.137:0/677359223 >> 172.21.15.137:0/677359223 conn(0x7fcf240cd8a0 msgr2=0x7fcf24142d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 -- 172.21.15.137:0/677359223 shutdown_connections 2024-04-26T22:05:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.358+0000 7fcf2b45b640 1 -- 172.21.15.137:0/677359223 wait complete. 2024-04-26T22:05:05.370 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:05:05.370 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:05.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276efa4640 1 Processor -- start 2024-04-26T22:05:05.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276efa4640 1 -- start start 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276efa4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f276815fa20 0x7f27680cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276efa4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2768162f30 0x7f276806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276efa4640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2768163830 con 0x7f276806c2a0 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276efa4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2768163df0 con 0x7f2768162f30 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276efa4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2768163b10 con 0x7f276815fa20 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276d541640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2768162f30 0x7f276806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276cd40640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f276806c2a0 0x7f276806c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58208/0 (socket says 172.21.15.137:58208) 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276cd40640 1 -- 172.21.15.137:0/800655527 learned_addr learned my addr 172.21.15.137:0/800655527 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276d541640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2768162f30 0x7f276806fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39648/0 (socket says 172.21.15.137:39648) 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276d541640 1 -- 172.21.15.137:0/800655527 >> v2:172.21.15.170:3300/0 conn(0x7f276815fa20 msgr2=0x7f27680cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f2767fff640 1 --2- 172.21.15.137:0/800655527 >> v2:172.21.15.170:3300/0 conn(0x7f276815fa20 0x7f27680cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f27677fe640 1 -- 172.21.15.137:0/800655527 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620613481 0 0) 0x7f2768163830 con 0x7f276806c2a0 2024-04-26T22:05:05.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276d541640 1 --2- 172.21.15.137:0/800655527 >> v2:172.21.15.170:3300/0 conn(0x7f276815fa20 0x7f27680cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276d541640 1 -- 172.21.15.137:0/800655527 >> v1:172.21.15.137:6789/0 conn(0x7f276806c2a0 legacy=0x7f276806c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.468+0000 7f276d541640 1 -- 172.21.15.137:0/800655527 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27680ce950 con 0x7f2768162f30 2024-04-26T22:05:05.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f276d541640 1 --2- 172.21.15.137:0/800655527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 0x7f276806fb40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f276806ec20 tx=0x7f275002a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5757acba9cbcbd99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f27677fe640 1 -- 172.21.15.137:0/800655527 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750037070 con 0x7f2768162f30 2024-04-26T22:05:05.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f27677fe640 1 -- 172.21.15.137:0/800655527 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275002add0 con 0x7f2768162f30 2024-04-26T22:05:05.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f27677fe640 1 -- 172.21.15.137:0/800655527 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750032660 con 0x7f2768162f30 2024-04-26T22:05:05.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f276efa4640 1 -- 172.21.15.137:0/800655527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 msgr2=0x7f276806fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f276efa4640 1 --2- 172.21.15.137:0/800655527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 0x7f276806fb40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f276806ec20 tx=0x7f275002a080 comp rx=0 tx=0).stop 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f276efa4640 1 -- 172.21.15.137:0/800655527 shutdown_connections 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f276efa4640 1 --2- 172.21.15.137:0/800655527 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 0x7f276806fb40 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f276efa4640 1 --2- 172.21.15.137:0/800655527 >> v2:172.21.15.170:3300/0 conn(0x7f276815fa20 0x7f27680cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f276efa4640 1 -- 172.21.15.137:0/800655527 >> 172.21.15.137:0/800655527 conn(0x7f27680b3b10 msgr2=0x7f27680b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f276efa4640 1 -- 172.21.15.137:0/800655527 shutdown_connections 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.470+0000 7f276efa4640 1 -- 172.21.15.137:0/800655527 wait complete. 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.472+0000 7f276efa4640 1 Processor -- start 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.472+0000 7f276efa4640 1 -- start start 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.472+0000 7f276efa4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276806c2a0 0x7f2768160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.472+0000 7f276efa4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f276815fa20 0x7f27680d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.472+0000 7f276efa4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 0x7f27681574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.472+0000 7f276efa4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27681606a0 con 0x7f2768162f30 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.472+0000 7f276efa4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27680cf690 con 0x7f276815fa20 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.472+0000 7f276efa4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2768160820 con 0x7f276806c2a0 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276d541640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 0x7f27681574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276d541640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 0x7f27681574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39656/0 (socket says 172.21.15.137:39656) 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276d541640 1 -- 172.21.15.137:0/1386461026 learned_addr learned my addr 172.21.15.137:0/1386461026 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f2767fff640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f276815fa20 0x7f27680d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276cd40640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276806c2a0 0x7f2768160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276d541640 1 -- 172.21.15.137:0/1386461026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276806c2a0 msgr2=0x7f2768160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276d541640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276806c2a0 0x7f2768160ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276d541640 1 -- 172.21.15.137:0/1386461026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f276815fa20 msgr2=0x7f27680d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276d541640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f276815fa20 0x7f27680d0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276d541640 1 -- 172.21.15.137:0/1386461026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2768161840 con 0x7f2768162f30 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276d541640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 0x7f27681574c0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f2750035040 tx=0x7f27500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f27657fa640 1 -- 172.21.15.137:0/1386461026 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750037050 con 0x7f2768162f30 2024-04-26T22:05:05.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f27657fa640 1 -- 172.21.15.137:0/1386461026 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2750038040 con 0x7f2768162f30 2024-04-26T22:05:05.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2768161b20 con 0x7f2768162f30 2024-04-26T22:05:05.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f27657fa640 1 -- 172.21.15.137:0/1386461026 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750004450 con 0x7f2768162f30 2024-04-26T22:05:05.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.473+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27681620e0 con 0x7f2768162f30 2024-04-26T22:05:05.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.474+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27680693d0 con 0x7f2768162f30 2024-04-26T22:05:05.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.475+0000 7f27657fa640 1 -- 172.21.15.137:0/1386461026 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f275002ac90 con 0x7f2768162f30 2024-04-26T22:05:05.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.475+0000 7f27657fa640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f274806c8f0 0x7f274806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.475+0000 7f27657fa640 1 -- 172.21.15.137:0/1386461026 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f27500ac4b0 con 0x7f2768162f30 2024-04-26T22:05:05.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.475+0000 7f276cd40640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f274806c8f0 0x7f274806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.475+0000 7f276cd40640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f274806c8f0 0x7f274806edb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f27600012e0 tx=0x7f2760009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.479+0000 7f27657fa640 1 -- 172.21.15.137:0/1386461026 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f275007a870 con 0x7f2768162f30 2024-04-26T22:05:05.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.695+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27680d0640 con 0x7f2768162f30 2024-04-26T22:05:05.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.695+0000 7f27657fa640 1 -- 172.21.15.137:0/1386461026 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5196 (secure 0 0 0) 0x7f275007a170 con 0x7f2768162f30 2024-04-26T22:05:05.695 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:05.696 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:04:34.234174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7317":{"gid":7317,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/2128712520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2128712520},{"type":"v1","addr":"172.21.15.137:6837","nonce":2128712520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7317,"qdb_cluster":[7317]},"id":6}]} 2024-04-26T22:05:05.696 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 54 2024-04-26T22:05:05.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f274806c8f0 msgr2=0x7f274806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f274806c8f0 0x7f274806edb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f27600012e0 tx=0x7f2760009040 comp rx=0 tx=0).stop 2024-04-26T22:05:05.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 msgr2=0x7f27681574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 0x7f27681574c0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f2750035040 tx=0x7f27500046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 shutdown_connections 2024-04-26T22:05:05.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f274806c8f0 0x7f274806edb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2768162f30 0x7f27681574c0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f276815fa20 0x7f27680d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 --2- 172.21.15.137:0/1386461026 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f276806c2a0 0x7f2768160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.697+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 >> 172.21.15.137:0/1386461026 conn(0x7f27680b3b10 msgr2=0x7f27680b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.698+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 shutdown_connections 2024-04-26T22:05:05.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.698+0000 7f276efa4640 1 -- 172.21.15.137:0/1386461026 wait complete. 2024-04-26T22:05:05.708 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-26T22:05:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.806+0000 7f495e43e640 1 Processor -- start 2024-04-26T22:05:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.807+0000 7f495e43e640 1 -- start start 2024-04-26T22:05:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.807+0000 7f495e43e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4958162ca0 0x7f4958070640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.807+0000 7f495e43e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49580d1c20 0x7f4958070c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.807+0000 7f495e43e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49580d2470 con 0x7f4958071160 2024-04-26T22:05:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.807+0000 7f495e43e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f49580715d0 con 0x7f49580d1c20 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.807+0000 7f495e43e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f49580cdc40 con 0x7f4958162ca0 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.807+0000 7f49577fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49580d1c20 0x7f4958070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.807+0000 7f49577fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f49580d1c20 0x7f4958070c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40928/0 (socket says 172.21.15.137:40928) 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.807+0000 7f49577fe640 1 -- 172.21.15.137:0/1954199970 learned_addr learned my addr 172.21.15.137:0/1954199970 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.808+0000 7f4957fff640 1 --2- 172.21.15.137:0/1954199970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4958162ca0 0x7f4958070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.808+0000 7f49577fe640 1 -- 172.21.15.137:0/1954199970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4958162ca0 msgr2=0x7f4958070640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.808+0000 7f49577fe640 1 --2- 172.21.15.137:0/1954199970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4958162ca0 0x7f4958070640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.808+0000 7f49577fe640 1 -- 172.21.15.137:0/1954199970 >> v1:172.21.15.170:6789/0 conn(0x7f4958071160 legacy=0x7f49580cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.808+0000 7f49577fe640 1 -- 172.21.15.137:0/1954199970 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49580d2750 con 0x7f49580d1c20 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.808+0000 7f49577fe640 1 --2- 172.21.15.137:0/1954199970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49580d1c20 0x7f4958070c20 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f494c009870 tx=0x7f494c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a027fa1cc17c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f4956ffd640 1 -- 172.21.15.137:0/1954199970 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c037070 con 0x7f49580d1c20 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f4956ffd640 1 -- 172.21.15.137:0/1954199970 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c032440 con 0x7f49580d1c20 2024-04-26T22:05:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f4956ffd640 1 -- 172.21.15.137:0/1954199970 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c032810 con 0x7f49580d1c20 2024-04-26T22:05:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f495e43e640 1 -- 172.21.15.137:0/1954199970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49580d1c20 msgr2=0x7f4958070c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f495e43e640 1 --2- 172.21.15.137:0/1954199970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49580d1c20 0x7f4958070c20 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f494c009870 tx=0x7f494c02a270 comp rx=0 tx=0).stop 2024-04-26T22:05:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f495e43e640 1 -- 172.21.15.137:0/1954199970 shutdown_connections 2024-04-26T22:05:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f495e43e640 1 --2- 172.21.15.137:0/1954199970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49580d1c20 0x7f4958070c20 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f495e43e640 1 --2- 172.21.15.137:0/1954199970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4958162ca0 0x7f4958070640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f495e43e640 1 -- 172.21.15.137:0/1954199970 >> 172.21.15.137:0/1954199970 conn(0x7f495809ba40 msgr2=0x7f495809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f495e43e640 1 -- 172.21.15.137:0/1954199970 shutdown_connections 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.809+0000 7f495e43e640 1 -- 172.21.15.137:0/1954199970 wait complete. 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.810+0000 7f495e43e640 1 Processor -- start 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495e43e640 1 -- start start 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495e43e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4958071160 0x7f495814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495e43e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49580d1c20 0x7f49580cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495e43e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4958162ca0 0x7f49580ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495e43e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49580d2080 con 0x7f4958162ca0 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495e43e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f49580cd8d0 con 0x7f4958071160 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495e43e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f49580d2200 con 0x7f49580d1c20 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495c9db640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4958162ca0 0x7f49580ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495c9db640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4958162ca0 0x7f49580ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40934/0 (socket says 172.21.15.137:40934) 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f495c9db640 1 -- 172.21.15.137:0/975308959 learned_addr learned my addr 172.21.15.137:0/975308959 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f4957fff640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4958071160 0x7f495814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.811+0000 7f49577fe640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49580d1c20 0x7f49580cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f495c9db640 1 -- 172.21.15.137:0/975308959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49580d1c20 msgr2=0x7f49580cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f495c9db640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49580d1c20 0x7f49580cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f495c9db640 1 -- 172.21.15.137:0/975308959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4958071160 msgr2=0x7f495814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f495c9db640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4958071160 0x7f495814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f495c9db640 1 -- 172.21.15.137:0/975308959 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495815e940 con 0x7f4958162ca0 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f495c9db640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4958162ca0 0x7f49580ccb90 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f495000c7a0 tx=0x7f495000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f4954ff9640 1 -- 172.21.15.137:0/975308959 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950003b70 con 0x7f4958162ca0 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f4954ff9640 1 -- 172.21.15.137:0/975308959 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4950003d30 con 0x7f4958162ca0 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f495e43e640 1 -- 172.21.15.137:0/975308959 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49580ca280 con 0x7f4958162ca0 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f4954ff9640 1 -- 172.21.15.137:0/975308959 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495000aa90 con 0x7f4958162ca0 2024-04-26T22:05:05.814 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.812+0000 7f495e43e640 1 -- 172.21.15.137:0/975308959 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495814d7f0 con 0x7f4958162ca0 2024-04-26T22:05:05.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.814+0000 7f4954ff9640 1 -- 172.21.15.137:0/975308959 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f495000ac30 con 0x7f4958162ca0 2024-04-26T22:05:05.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.814+0000 7f4954ff9640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f494406c8f0 0x7f494406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.814+0000 7f4954ff9640 1 -- 172.21.15.137:0/975308959 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f495008b9a0 con 0x7f4958162ca0 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.814+0000 7f4957fff640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f494406c8f0 0x7f494406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.815+0000 7f4957fff640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f494406c8f0 0x7f494406edb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4948009aa0 tx=0x7f4948009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.815+0000 7f4961232740 1 Processor -- start 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.815+0000 7f4961232740 1 -- start start 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4961232740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502a1cf0 0x5618502a3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4961232740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502de3c0 0x5618502a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4961232740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502cc7b0 0x5618502ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4961232740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561850206b80 con 0x5618502a1cf0 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4961232740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5618501a24d0 con 0x5618502de3c0 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4961232740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x561850202b40 con 0x5618502cc7b0 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4957fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502a1cf0 0x5618502a3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4957fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502a1cf0 0x5618502a3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40946/0 (socket says 172.21.15.137:40946) 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4957fff640 1 -- 172.21.15.137:0/2265854520 learned_addr learned my addr 172.21.15.137:0/2265854520 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4957fff640 1 -- 172.21.15.137:0/2265854520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502cc7b0 msgr2=0x5618502ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4957fff640 1 --2- 172.21.15.137:0/2265854520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502cc7b0 0x5618502ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4957fff640 1 -- 172.21.15.137:0/2265854520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502de3c0 msgr2=0x5618502a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4957fff640 1 --2- 172.21.15.137:0/2265854520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502de3c0 0x5618502a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4957fff640 1 -- 172.21.15.137:0/2265854520 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618501cf770 con 0x5618502a1cf0 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f4957fff640 1 --2- 172.21.15.137:0/2265854520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502a1cf0 0x5618502a3e50 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f4948004470 tx=0x7f4948014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0493b724ea0a66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f493dffb640 1 -- 172.21.15.137:0/2265854520 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494801b070 con 0x5618502a1cf0 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f493dffb640 1 -- 172.21.15.137:0/2265854520 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4948027070 con 0x5618502a1cf0 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.816+0000 7f493dffb640 1 -- 172.21.15.137:0/2265854520 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948003a20 con 0x5618502a1cf0 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.817+0000 7f4961232740 1 -- 172.21.15.137:0/2265854520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502a1cf0 msgr2=0x5618502a3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.817+0000 7f4961232740 1 --2- 172.21.15.137:0/2265854520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502a1cf0 0x5618502a3e50 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f4948004470 tx=0x7f4948014000 comp rx=0 tx=0).stop 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.817+0000 7f4961232740 1 -- 172.21.15.137:0/2265854520 shutdown_connections 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.817+0000 7f4961232740 1 --2- 172.21.15.137:0/2265854520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502cc7b0 0x5618502ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.817+0000 7f4961232740 1 --2- 172.21.15.137:0/2265854520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502de3c0 0x5618502a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.817+0000 7f4961232740 1 --2- 172.21.15.137:0/2265854520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502a1cf0 0x5618502a3e50 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.817+0000 7f4961232740 1 -- 172.21.15.137:0/2265854520 >> 172.21.15.137:0/2265854520 conn(0x561850236e90 msgr2=0x5618502e77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.817+0000 7f4961232740 1 -- 172.21.15.137:0/2265854520 shutdown_connections 2024-04-26T22:05:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.817+0000 7f4961232740 1 -- 172.21.15.137:0/2265854520 wait complete. 2024-04-26T22:05:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.818+0000 7f4961232740 1 -- start start 2024-04-26T22:05:05.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.818+0000 7f4961232740 1 Processor -- start 2024-04-26T22:05:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.818+0000 7f4961232740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x5618502e1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.818+0000 7f4961232740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.818+0000 7f4961232740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 0x5618502ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.818+0000 7f4961232740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56185019fe70 con 0x5618502cc7b0 2024-04-26T22:05:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.818+0000 7f4961232740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5618502ca300 con 0x5618502a1cf0 2024-04-26T22:05:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4961232740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5618502f88b0 con 0x5618502de3c0 2024-04-26T22:05:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4961232740 10 client.0 _ll_register_callbacks cb 0x5618501b0ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f49577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f49577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502de890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40958/0 (socket says 172.21.15.137:40958) 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f49577fe640 1 -- 172.21.15.137:0/14534549 learned_addr learned my addr 172.21.15.137:0/14534549 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4957fff640 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x5618502e1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f495c9db640 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 0x5618502ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f49577fe640 1 -- 172.21.15.137:0/14534549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 msgr2=0x5618502ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f49577fe640 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 0x5618502ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f49577fe640 1 -- 172.21.15.137:0/14534549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 msgr2=0x5618502e1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f49577fe640 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x5618502e1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f49577fe640 1 -- 172.21.15.137:0/14534549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56184ffe47c0 con 0x5618502cc7b0 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4957fff640 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x5618502e1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f49577fe640 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502de890 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f494c02a2b0 tx=0x7f494c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780b8cd89c6b4376 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4936ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4936ffd640 1 -- 172.21.15.137:0/14534549 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c037040 con 0x5618502cc7b0 2024-04-26T22:05:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4936ffd640 1 -- 172.21.15.137:0/14534549 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f494c032d70 con 0x5618502cc7b0 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4961232740 1 -- 172.21.15.137:0/14534549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4948027070 con 0x5618502cc7b0 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4936ffd640 1 -- 172.21.15.137:0/14534549 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f494c04c050 con 0x5618502cc7b0 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4961232740 10 client.7785 fetch_fsmap learned FSMap version 54 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4961232740 1 -- 172.21.15.137:0/14534549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x561850044f50 con 0x5618502cc7b0 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.819+0000 7f4936ffd640 1 -- 172.21.15.137:0/14534549 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4948027070 con 0x5618502cc7b0 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4936ffd640 1 -- 172.21.15.137:0/14534549 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f494c04f020 con 0x5618502cc7b0 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4961232740 10 client.7785 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4961232740 10 client.7785 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4961232740 20 client.7785 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4961232740 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5618502f7570 0x5618502f7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4961232740 4 client.7785 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4961232740 1 -- 172.21.15.137:0/14534549 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618501ba240 con 0x5618502f7570 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4957fff640 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5618502f7570 0x5618502f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4957fff640 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5618502f7570 0x5618502f7950 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=906e4e6d3206d233 server_cookie=45d9fbf53cf28211 in_seq=0 out_seq=0 2024-04-26T22:05:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.820+0000 7f4936ffd640 10 client.7785 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4936ffd640 1 -- 172.21.15.137:0/14534549 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5618501ba240 con 0x5618502f7570 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4936ffd640 10 client.7785 handle_command_reply: tid=0 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 client.7785 shutdown 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 -- 172.21.15.137:0/14534549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 msgr2=0x5618502de890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502de890 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f494c02a2b0 tx=0x7f494c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 -- 172.21.15.137:0/14534549 shutdown_connections 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5618502f7570 0x5618502f7950 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502de890 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 0x5618502ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4936ffd640 0 client.7785 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 --2- 172.21.15.137:0/14534549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x5618502e1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 -- 172.21.15.137:0/14534549 >> 172.21.15.137:0/14534549 conn(0x561850236e90 msgr2=0x5618502ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 -- 172.21.15.137:0/14534549 shutdown_connections 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 1 -- 172.21.15.137:0/14534549 wait complete. 2024-04-26T22:05:05.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.821+0000 7f4961232740 20 client.7785 trim_cache size 0 max 16384 2024-04-26T22:05:05.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.834+0000 7f4961232740 1 Processor -- start 2024-04-26T22:05:05.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.834+0000 7f4961232740 1 -- start start 2024-04-26T22:05:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f4961232740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502a1cf0 0x56185029bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f4961232740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f4961232740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502de3c0 0x561850300a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f4961232740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4958200b90 con 0x5618502cc7b0 2024-04-26T22:05:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f4961232740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f49580cb620 con 0x5618502de3c0 2024-04-26T22:05:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f4961232740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f49580cbc70 con 0x5618502a1cf0 2024-04-26T22:05:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f49577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f49577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40964/0 (socket says 172.21.15.137:40964) 2024-04-26T22:05:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f49577fe640 1 -- 172.21.15.137:0/2150984024 learned_addr learned my addr 172.21.15.137:0/2150984024 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f49577fe640 1 -- 172.21.15.137:0/2150984024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502a1cf0 msgr2=0x56185029bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f49577fe640 1 --2- 172.21.15.137:0/2150984024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502a1cf0 0x56185029bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f49577fe640 1 -- 172.21.15.137:0/2150984024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502de3c0 msgr2=0x561850300a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f49577fe640 1 --2- 172.21.15.137:0/2150984024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502de3c0 0x561850300a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f49577fe640 1 -- 172.21.15.137:0/2150984024 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56184fed80b0 con 0x5618502cc7b0 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.835+0000 7f49577fe640 1 --2- 172.21.15.137:0/2150984024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502f7b40 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f494c001eb0 tx=0x7f494c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a637d9e4a0c311a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f493d7fa640 1 -- 172.21.15.137:0/2150984024 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c000e60 con 0x5618502cc7b0 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f493d7fa640 1 -- 172.21.15.137:0/2150984024 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c032d70 con 0x5618502cc7b0 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f493d7fa640 1 -- 172.21.15.137:0/2150984024 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c037030 con 0x5618502cc7b0 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f4961232740 1 -- 172.21.15.137:0/2150984024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 msgr2=0x5618502f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f4961232740 1 --2- 172.21.15.137:0/2150984024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502f7b40 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f494c001eb0 tx=0x7f494c03f000 comp rx=0 tx=0).stop 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f4961232740 1 -- 172.21.15.137:0/2150984024 shutdown_connections 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f4961232740 1 --2- 172.21.15.137:0/2150984024 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502f7b40 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f4961232740 1 --2- 172.21.15.137:0/2150984024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502de3c0 0x561850300a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f4961232740 1 --2- 172.21.15.137:0/2150984024 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502a1cf0 0x56185029bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f4961232740 1 -- 172.21.15.137:0/2150984024 >> 172.21.15.137:0/2150984024 conn(0x561850236e90 msgr2=0x5618502e1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f4961232740 1 -- 172.21.15.137:0/2150984024 shutdown_connections 2024-04-26T22:05:05.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.836+0000 7f4961232740 1 -- 172.21.15.137:0/2150984024 wait complete. 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.837+0000 7f4961232740 1 -- start start 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.837+0000 7f4961232740 1 Processor -- start 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x56185030aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502e4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 0x5618502e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5618502cf540 con 0x5618502cc7b0 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5618502f86a0 con 0x5618502a1cf0 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5618502cceb0 con 0x5618502de3c0 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 10 client.0 _ll_register_callbacks cb 0x7f4948009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f49577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f49577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502e4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40970/0 (socket says 172.21.15.137:40970) 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f49577fe640 1 -- 172.21.15.137:0/4268312035 learned_addr learned my addr 172.21.15.137:0/4268312035 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f495c9db640 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 0x5618502e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f49577fe640 1 -- 172.21.15.137:0/4268312035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 msgr2=0x5618502e4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4957fff640 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x56185030aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f49577fe640 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 0x5618502e4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f49577fe640 1 -- 172.21.15.137:0/4268312035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 msgr2=0x56185030aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f49577fe640 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x56185030aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f49577fe640 1 -- 172.21.15.137:0/4268312035 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618502e7360 con 0x5618502cc7b0 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4957fff640 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x56185030aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f49577fe640 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502e4700 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f494c02a860 tx=0x7f494c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f47911a69f24bf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4936ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4936ffd640 1 -- 172.21.15.137:0/4268312035 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c037040 con 0x5618502cc7b0 2024-04-26T22:05:05.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4936ffd640 1 -- 172.21.15.137:0/4268312035 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f494c003c50 con 0x5618502cc7b0 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 1 -- 172.21.15.137:0/4268312035 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f494c032d70 con 0x5618502cc7b0 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4936ffd640 1 -- 172.21.15.137:0/4268312035 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f494c061050 con 0x5618502cc7b0 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 10 client.7791 fetch_fsmap learned FSMap version 54 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.838+0000 7f4961232740 1 -- 172.21.15.137:0/4268312035 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x5618502a18a0 con 0x5618502cc7b0 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4936ffd640 1 -- 172.21.15.137:0/4268312035 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c032d70 con 0x5618502cc7b0 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4936ffd640 1 -- 172.21.15.137:0/4268312035 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 54) ==== 3494+0+0 (secure 0 0 0) 0x7f494c064020 con 0x5618502cc7b0 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4961232740 10 client.7791 fetch_fsmap finished waiting for FSMap version 54 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4961232740 10 client.7791 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4961232740 20 client.7791 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4961232740 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5618502f8280 0x561850300a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4961232740 4 client.7791 mds_command: new command op to 7317 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4961232740 1 -- 172.21.15.137:0/4268312035 --> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x561850214790 con 0x5618502f8280 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4957fff640 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5618502f8280 0x561850300a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:05.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4936ffd640 10 client.7791 ms_handle_connect on v2:172.21.15.137:6835/2128712520 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4957fff640 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5618502f8280 0x561850300a80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9c18ee93e1797ba server_cookie=c74d73da3eaf67f0 in_seq=0 out_seq=0 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4936ffd640 1 -- 172.21.15.137:0/4268312035 <== mds.0 v2:172.21.15.137:6835/2128712520 1 ==== command_reply(tid 0: 0 ) ==== 8+0+144 (crc 0 0 0) 0x561850214790 con 0x5618502f8280 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4936ffd640 10 client.7791 handle_command_reply: tid=0 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4961232740 1 client.7791 shutdown 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4961232740 1 -- 172.21.15.137:0/4268312035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 msgr2=0x5618502e4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.839+0000 7f4961232740 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502e4700 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f494c02a860 tx=0x7f494c02e000 comp rx=0 tx=0).stop 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4961232740 1 -- 172.21.15.137:0/4268312035 shutdown_connections 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4961232740 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.137:6835/2128712520,v1:172.21.15.137:6837/2128712520] conn(0x5618502f8280 0x561850300a80 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4961232740 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5618502cc7b0 0x5618502e4700 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4936ffd640 0 client.7791 ms_handle_reset on v2:172.21.15.137:6835/2128712520 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4961232740 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5618502de3c0 0x5618502e4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4961232740 1 --2- 172.21.15.137:0/4268312035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5618502a1cf0 0x56185030aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4961232740 1 -- 172.21.15.137:0/4268312035 >> 172.21.15.137:0/4268312035 conn(0x561850236e90 msgr2=0x5618502e1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4961232740 1 -- 172.21.15.137:0/4268312035 shutdown_connections 2024-04-26T22:05:05.845 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4961232740 1 -- 172.21.15.137:0/4268312035 wait complete. 2024-04-26T22:05:05.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f4961232740 20 client.7791 trim_cache size 0 max 16384 2024-04-26T22:05:05.846 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:05.846 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:05:05.846 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:05.846 INFO:teuthology.orchestra.run.smithi137.stdout: "damage_type": "backtrace", 2024-04-26T22:05:05.846 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 4037181928, 2024-04-26T22:05:05.846 INFO:teuthology.orchestra.run.smithi137.stdout: "ino": 1099511627777, 2024-04-26T22:05:05.846 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/testdir/hardlink" 2024-04-26T22:05:05.847 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:05.847 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:05:05.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 -- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f494406c8f0 msgr2=0x7f494406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f494406c8f0 0x7f494406edb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4948009aa0 tx=0x7f4948009190 comp rx=0 tx=0).stop 2024-04-26T22:05:05.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 -- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4958162ca0 msgr2=0x7f49580ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:05.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4958162ca0 0x7f49580ccb90 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f495000c7a0 tx=0x7f495000cc60 comp rx=0 tx=0).stop 2024-04-26T22:05:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 -- 172.21.15.137:0/975308959 shutdown_connections 2024-04-26T22:05:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f494406c8f0 0x7f494406edb0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4958162ca0 0x7f49580ccb90 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49580d1c20 0x7f49580cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 --2- 172.21.15.137:0/975308959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4958071160 0x7f495814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 -- 172.21.15.137:0/975308959 >> 172.21.15.137:0/975308959 conn(0x7f495809ba40 msgr2=0x7f49580ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 -- 172.21.15.137:0/975308959 shutdown_connections 2024-04-26T22:05:05.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:05.840+0000 7f495e43e640 1 -- 172.21.15.137:0/975308959 wait complete. 2024-04-26T22:05:05.851 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:05:05.851 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:05.866 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:05:05.866 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:05.921 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:05:06.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.057+0000 7ff3787e7640 1 Processor -- start 2024-04-26T22:05:06.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.057+0000 7ff3787e7640 1 -- start start 2024-04-26T22:05:06.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff3787e7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff37006d9c0 0x7ff37006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff3787e7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3700b4a10 con 0x7ff37015f1e0 2024-04-26T22:05:06.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff3787e7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3700b4cf0 con 0x7ff3700b44e0 2024-04-26T22:05:06.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff3787e7640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff37006eeb0 con 0x7ff37006d9c0 2024-04-26T22:05:06.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff376d84640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff37006d9c0 0x7ff37006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff376583640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff37015f1e0 0x7ff3700ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49068/0 (socket says 172.21.15.137:49068) 2024-04-26T22:05:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff376583640 1 -- 172.21.15.137:0/4226730376 learned_addr learned my addr 172.21.15.137:0/4226730376 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff376d84640 1 -- 172.21.15.137:0/4226730376 >> v1:172.21.15.170:6789/0 conn(0x7ff3700b44e0 legacy=0x7ff37006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff376d84640 1 -- 172.21.15.137:0/4226730376 >> v1:172.21.15.137:6789/0 conn(0x7ff37015f1e0 legacy=0x7ff3700ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff376d84640 1 -- 172.21.15.137:0/4226730376 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3700b4fd0 con 0x7ff37006d9c0 2024-04-26T22:05:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.058+0000 7ff375581640 1 -- 172.21.15.137:0/4226730376 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101474383 0 0) 0x7ff3700b4a10 con 0x7ff37015f1e0 2024-04-26T22:05:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.059+0000 7ff376d84640 1 --2- 172.21.15.137:0/4226730376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37006d9c0 0x7ff37006e970 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7ff368009d90 tx=0x7ff36802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd53d57be0b3779 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.059+0000 7ff375581640 1 -- 172.21.15.137:0/4226730376 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368007740 con 0x7ff37006d9c0 2024-04-26T22:05:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.059+0000 7ff375581640 1 -- 172.21.15.137:0/4226730376 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3680078e0 con 0x7ff37006d9c0 2024-04-26T22:05:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.059+0000 7ff375581640 1 -- 172.21.15.137:0/4226730376 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368007cb0 con 0x7ff37006d9c0 2024-04-26T22:05:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.060+0000 7ff3787e7640 1 -- 172.21.15.137:0/4226730376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37006d9c0 msgr2=0x7ff37006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.060+0000 7ff3787e7640 1 --2- 172.21.15.137:0/4226730376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37006d9c0 0x7ff37006e970 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7ff368009d90 tx=0x7ff36802a6f0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.060+0000 7ff3787e7640 1 -- 172.21.15.137:0/4226730376 shutdown_connections 2024-04-26T22:05:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.060+0000 7ff3787e7640 1 --2- 172.21.15.137:0/4226730376 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37006d9c0 0x7ff37006e970 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.060+0000 7ff3787e7640 1 -- 172.21.15.137:0/4226730376 >> 172.21.15.137:0/4226730376 conn(0x7ff3700728a0 msgr2=0x7ff370072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.060+0000 7ff3787e7640 1 -- 172.21.15.137:0/4226730376 shutdown_connections 2024-04-26T22:05:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.060+0000 7ff3787e7640 1 -- 172.21.15.137:0/4226730376 wait complete. 2024-04-26T22:05:06.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.061+0000 7ff3787e7640 1 Processor -- start 2024-04-26T22:05:06.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.061+0000 7ff3787e7640 1 -- start start 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff3787e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff37006d9c0 0x7ff370147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff3787e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3700b44e0 0x7ff370143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff3787e7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37015f1e0 0x7ff37015f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff3787e7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff37015f5c0 con 0x7ff37015f1e0 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff3787e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff3700b5590 con 0x7ff3700b44e0 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff3787e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff3701600b0 con 0x7ff37006d9c0 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376d84640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37015f1e0 0x7ff37015f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376d84640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37015f1e0 0x7ff37015f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40990/0 (socket says 172.21.15.137:40990) 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376d84640 1 -- 172.21.15.137:0/1120449757 learned_addr learned my addr 172.21.15.137:0/1120449757 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff375d82640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3700b44e0 0x7ff370143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376583640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff37006d9c0 0x7ff370147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376d84640 1 -- 172.21.15.137:0/1120449757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff37006d9c0 msgr2=0x7ff370147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376d84640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff37006d9c0 0x7ff370147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376d84640 1 -- 172.21.15.137:0/1120449757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3700b44e0 msgr2=0x7ff370143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376d84640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3700b44e0 0x7ff370143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376d84640 1 -- 172.21.15.137:0/1120449757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff370144260 con 0x7ff37015f1e0 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff375d82640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3700b44e0 0x7ff370143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff376d84640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37015f1e0 0x7ff37015f8d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7ff368009eb0 tx=0x7ff368004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff366ffd640 1 -- 172.21.15.137:0/1120449757 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368040070 con 0x7ff37015f1e0 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff366ffd640 1 -- 172.21.15.137:0/1120449757 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff368031c90 con 0x7ff37015f1e0 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37015fe10 con 0x7ff37015f1e0 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff366ffd640 1 -- 172.21.15.137:0/1120449757 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36803c640 con 0x7ff37015f1e0 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.062+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3701f8550 con 0x7ff37015f1e0 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.063+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff37006a290 con 0x7ff37015f1e0 2024-04-26T22:05:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.064+0000 7ff366ffd640 1 -- 172.21.15.137:0/1120449757 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff368039040 con 0x7ff37015f1e0 2024-04-26T22:05:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.064+0000 7ff366ffd640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff35406c920 0x7ff35406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.064+0000 7ff376583640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff35406c920 0x7ff35406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.064+0000 7ff366ffd640 1 -- 172.21.15.137:0/1120449757 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7ff3680ad170 con 0x7ff37015f1e0 2024-04-26T22:05:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.065+0000 7ff376583640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff35406c920 0x7ff35406ede0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff36c000f60 tx=0x7ff36c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.069+0000 7ff366ffd640 1 -- 172.21.15.137:0/1120449757 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff36807b680 con 0x7ff37015f1e0 2024-04-26T22:05:06.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.247+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff370162730 con 0x7ff37015f1e0 2024-04-26T22:05:06.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.248+0000 7ff366ffd640 1 -- 172.21.15.137:0/1120449757 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16851 (secure 0 0 0) 0x7ff36807af80 con 0x7ff37015f1e0 2024-04-26T22:05:06.248 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:06.248 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":90,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:04:27.224195+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:04:11.600389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-26T22:04:12.347068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6835/865192507":"2024-04-27T22:04:27.224170+0000","172.21.15.170:6833/865192507":"2024-04-27T22:04:27.224170+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:05:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff35406c920 msgr2=0x7ff35406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff35406c920 0x7ff35406ede0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff36c000f60 tx=0x7ff36c009040 comp rx=0 tx=0).stop 2024-04-26T22:05:06.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37015f1e0 msgr2=0x7ff37015f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37015f1e0 0x7ff37015f8d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7ff368009eb0 tx=0x7ff368004a40 comp rx=0 tx=0).stop 2024-04-26T22:05:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 shutdown_connections 2024-04-26T22:05:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff35406c920 0x7ff35406ede0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff37015f1e0 0x7ff37015f8d0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3700b44e0 0x7ff370143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 --2- 172.21.15.137:0/1120449757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff37006d9c0 0x7ff370147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 >> 172.21.15.137:0/1120449757 conn(0x7ff3700728a0 msgr2=0x7ff3700707e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 shutdown_connections 2024-04-26T22:05:06.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.250+0000 7ff3787e7640 1 -- 172.21.15.137:0/1120449757 wait complete. 2024-04-26T22:05:06.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:04:11.600389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:04:12.347068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:05:06.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:05:06.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.361+0000 7face14e1640 1 Processor -- start 2024-04-26T22:05:06.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.361+0000 7face14e1640 1 -- start start 2024-04-26T22:05:06.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.361+0000 7face14e1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc15f680 0x7facdc0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.361+0000 7face14e1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7facdc0d4f20 0x7facdc0d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.361+0000 7face14e1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc0d58f0 con 0x7facdc163aa0 2024-04-26T22:05:06.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.361+0000 7face14e1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7facdc15fa60 con 0x7facdc0d4f20 2024-04-26T22:05:06.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.361+0000 7face14e1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7facdc0d3f50 con 0x7facdc15f680 2024-04-26T22:05:06.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.362+0000 7facdaffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc15f680 0x7facdc0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.362+0000 7facdaffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc15f680 0x7facdc0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:45532/0 (socket says 172.21.15.137:45532) 2024-04-26T22:05:06.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.362+0000 7facdb7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7facdc0d4f20 0x7facdc0d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.362+0000 7facdaffd640 1 -- 172.21.15.137:0/3787939853 learned_addr learned my addr 172.21.15.137:0/3787939853 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:06.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.362+0000 7facdaffd640 1 -- 172.21.15.137:0/3787939853 >> v2:172.21.15.170:3300/0 conn(0x7facdc0d4f20 msgr2=0x7facdc0d53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:06.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.362+0000 7facdaffd640 1 --2- 172.21.15.137:0/3787939853 >> v2:172.21.15.170:3300/0 conn(0x7facdc0d4f20 0x7facdc0d53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.362+0000 7facdaffd640 1 -- 172.21.15.137:0/3787939853 >> v1:172.21.15.170:6789/0 conn(0x7facdc163aa0 legacy=0x7facdc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.362+0000 7facdaffd640 1 -- 172.21.15.137:0/3787939853 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc0b5090 con 0x7facdc15f680 2024-04-26T22:05:06.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.363+0000 7facdaffd640 1 --2- 172.21.15.137:0/3787939853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc15f680 0x7facdc0d3820 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faccc009e50 tx=0x7faccc02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9855e476fcbf5733 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.363+0000 7facd9ffb640 1 -- 172.21.15.137:0/3787939853 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc036070 con 0x7facdc15f680 2024-04-26T22:05:06.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.363+0000 7facd9ffb640 1 -- 172.21.15.137:0/3787939853 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc031600 con 0x7facdc15f680 2024-04-26T22:05:06.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.363+0000 7facd9ffb640 1 -- 172.21.15.137:0/3787939853 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc0319d0 con 0x7facdc15f680 2024-04-26T22:05:06.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.364+0000 7face14e1640 1 -- 172.21.15.137:0/3787939853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc15f680 msgr2=0x7facdc0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.364+0000 7face14e1640 1 --2- 172.21.15.137:0/3787939853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc15f680 0x7facdc0d3820 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faccc009e50 tx=0x7faccc02a710 comp rx=0 tx=0).stop 2024-04-26T22:05:06.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.364+0000 7face14e1640 1 -- 172.21.15.137:0/3787939853 shutdown_connections 2024-04-26T22:05:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.364+0000 7face14e1640 1 --2- 172.21.15.137:0/3787939853 >> v2:172.21.15.170:3300/0 conn(0x7facdc0d4f20 0x7facdc0d53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.364+0000 7face14e1640 1 --2- 172.21.15.137:0/3787939853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc15f680 0x7facdc0d3820 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.364+0000 7face14e1640 1 -- 172.21.15.137:0/3787939853 >> 172.21.15.137:0/3787939853 conn(0x7facdc08eca0 msgr2=0x7facdc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.364+0000 7face14e1640 1 -- 172.21.15.137:0/3787939853 shutdown_connections 2024-04-26T22:05:06.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.364+0000 7face14e1640 1 -- 172.21.15.137:0/3787939853 wait complete. 2024-04-26T22:05:06.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.365+0000 7face14e1640 1 Processor -- start 2024-04-26T22:05:06.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.365+0000 7face14e1640 1 -- start start 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7face14e1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facdc0d4f20 0x7facdc153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7face14e1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facdc15f680 0x7facdc0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7face14e1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc163aa0 0x7facdc0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7face14e1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7facdc163f00 con 0x7facdc15f680 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7face14e1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7facdc0b6280 con 0x7facdc0d4f20 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7face14e1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7facdc0cfd80 con 0x7facdc163aa0 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facda7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facdc15f680 0x7facdc0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facda7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facdc15f680 0x7facdc0c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40998/0 (socket says 172.21.15.137:40998) 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facda7fc640 1 -- 172.21.15.137:0/126810009 learned_addr learned my addr 172.21.15.137:0/126810009 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facdaffd640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facdc0d4f20 0x7facdc153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facda7fc640 1 -- 172.21.15.137:0/126810009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc163aa0 msgr2=0x7facdc0cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facdb7fe640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc163aa0 0x7facdc0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facda7fc640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc163aa0 0x7facdc0cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facda7fc640 1 -- 172.21.15.137:0/126810009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facdc0d4f20 msgr2=0x7facdc153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facda7fc640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facdc0d4f20 0x7facdc153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facda7fc640 1 -- 172.21.15.137:0/126810009 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc0c92b0 con 0x7facdc15f680 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facdaffd640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facdc0d4f20 0x7facdc153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facda7fc640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facdc15f680 0x7facdc0c8d70 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7facd000c3c0 tx=0x7facd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facc37fe640 1 -- 172.21.15.137:0/126810009 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd00052d0 con 0x7facdc15f680 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facc37fe640 1 -- 172.21.15.137:0/126810009 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd0005490 con 0x7facdc15f680 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7facc37fe640 1 -- 172.21.15.137:0/126810009 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0007260 con 0x7facdc15f680 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facdc0b2f00 con 0x7facdc15f680 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.366+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facdc0cceb0 con 0x7facdc15f680 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.367+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facdc06a290 con 0x7facdc15f680 2024-04-26T22:05:06.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.368+0000 7facc37fe640 1 -- 172.21.15.137:0/126810009 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facd0007400 con 0x7facdc15f680 2024-04-26T22:05:06.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.368+0000 7facc37fe640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7facc806c8f0 0x7facc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.369+0000 7facdaffd640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7facc806c8f0 0x7facc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.369+0000 7facc37fe640 1 -- 172.21.15.137:0/126810009 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7facd008b160 con 0x7facdc15f680 2024-04-26T22:05:06.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.369+0000 7facdaffd640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7facc806c8f0 0x7facc806edb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7faccc033000 tx=0x7faccc009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.373+0000 7facc37fe640 1 -- 172.21.15.137:0/126810009 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7facd00594a0 con 0x7facdc15f680 2024-04-26T22:05:06.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.547+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7facdc0b4cd0 con 0x7facdc15f680 2024-04-26T22:05:06.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.548+0000 7facc37fe640 1 -- 172.21.15.137:0/126810009 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7facd0058da0 con 0x7facdc15f680 2024-04-26T22:05:06.548 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:05:06.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7facc806c8f0 msgr2=0x7facc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7facc806c8f0 0x7facc806edb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7faccc033000 tx=0x7faccc009000 comp rx=0 tx=0).stop 2024-04-26T22:05:06.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facdc15f680 msgr2=0x7facdc0c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facdc15f680 0x7facdc0c8d70 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7facd000c3c0 tx=0x7facd000c880 comp rx=0 tx=0).stop 2024-04-26T22:05:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 shutdown_connections 2024-04-26T22:05:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7facc806c8f0 0x7facc806edb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7facdc15f680 0x7facdc0c8d70 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7facdc163aa0 0x7facdc0cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 --2- 172.21.15.137:0/126810009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7facdc0d4f20 0x7facdc153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 >> 172.21.15.137:0/126810009 conn(0x7facdc08eca0 msgr2=0x7facdc0d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 shutdown_connections 2024-04-26T22:05:06.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.550+0000 7face14e1640 1 -- 172.21.15.137:0/126810009 wait complete. 2024-04-26T22:05:06.561 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:05:06.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.662+0000 7fee06f7f640 1 Processor -- start 2024-04-26T22:05:06.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.662+0000 7fee06f7f640 1 -- start start 2024-04-26T22:05:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.662+0000 7fee06f7f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee0015d340 0x7fee0009c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.662+0000 7fee06f7f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fee000d1940 0x7fee000702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.662+0000 7fee06f7f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee000cee60 con 0x7fee000b2420 2024-04-26T22:05:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.662+0000 7fee06f7f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fee000ce9d0 con 0x7fee000d1940 2024-04-26T22:05:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.662+0000 7fee06f7f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee000d0ff0 con 0x7fee0015d340 2024-04-26T22:05:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedfffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fee000b2420 0x7fee000d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49072/0 (socket says 172.21.15.137:49072) 2024-04-26T22:05:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedfffff640 1 -- 172.21.15.137:0/3875725961 learned_addr learned my addr 172.21.15.137:0/3875725961 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:06.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fee04d1b640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee0015d340 0x7fee0009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fee0551c640 1 --2- 172.21.15.137:0/3875725961 >> v2:172.21.15.170:3300/0 conn(0x7fee000d1940 0x7fee000702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844893966 0 0) 0x7fee000cee60 con 0x7fee000b2420 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedf0003520 con 0x7fee000b2420 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4048728707 0 0) 0x7fedf0003520 con 0x7fee000b2420 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee0015d340 msgr2=0x7fee0009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee0015d340 0x7fee0009c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 >> v2:172.21.15.170:3300/0 conn(0x7fee000d1940 msgr2=0x7fee000702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 --2- 172.21.15.137:0/3875725961 >> v2:172.21.15.170:3300/0 conn(0x7fee000d1940 0x7fee000702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee000d0d10 con 0x7fee000b2420 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fedec001670 con 0x7fee000b2420 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 >> v1:172.21.15.137:6789/0 conn(0x7fee000b2420 legacy=0x7fee000d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedf00039b0 0x7fedf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf0004800 0x7fedf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee0015d340 0x7fedf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee000ce9d0 con 0x7fedf00039b0 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fee000d0ff0 con 0x7fedf0004800 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fedf000b9c0 con 0x7fee0015d340 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fee04d1b640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedf00039b0 0x7fedf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fedfffff640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf0004800 0x7fedf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.663+0000 7fee0551c640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee0015d340 0x7fedf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.664+0000 7fee04d1b640 1 -- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee0015d340 msgr2=0x7fedf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.664+0000 7fee04d1b640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee0015d340 0x7fedf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.664+0000 7fee04d1b640 1 -- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf0004800 msgr2=0x7fedf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.664+0000 7fee04d1b640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf0004800 0x7fedf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.664+0000 7fee04d1b640 1 -- 172.21.15.137:0/3875725961 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf0003520 con 0x7fedf00039b0 2024-04-26T22:05:06.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.664+0000 7fee04d1b640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedf00039b0 0x7fedf0003dd0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009ac0 tx=0x7fedf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb64e163aa82d4da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.664+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4036070 con 0x7fedf00039b0 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.664+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf4031400 con 0x7fedf00039b0 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.664+0000 7fedff7fe640 1 -- 172.21.15.137:0/3875725961 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4009690 con 0x7fedf00039b0 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.665+0000 7fee06f7f640 1 -- 172.21.15.137:0/3875725961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedf00039b0 msgr2=0x7fedf0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.665+0000 7fee06f7f640 1 --2- 172.21.15.137:0/3875725961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fedf00039b0 0x7fedf0003dd0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009ac0 tx=0x7fedf0005830 comp rx=0 tx=0).stop 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.665+0000 7fee0551c640 1 -- 172.21.15.137:0/3875725961 reap_dead start 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.665+0000 7fee06f7f640 1 -- 172.21.15.137:0/3875725961 shutdown_connections 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.665+0000 7fee06f7f640 1 -- 172.21.15.137:0/3875725961 >> 172.21.15.137:0/3875725961 conn(0x7fee0009ba40 msgr2=0x7fee0009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.665+0000 7fee06f7f640 1 -- 172.21.15.137:0/3875725961 shutdown_connections 2024-04-26T22:05:06.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.665+0000 7fee06f7f640 1 -- 172.21.15.137:0/3875725961 wait complete. 2024-04-26T22:05:06.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.666+0000 7fee06f7f640 1 Processor -- start 2024-04-26T22:05:06.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.666+0000 7fee06f7f640 1 -- start start 2024-04-26T22:05:06.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee06f7f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf00039b0 0x7fee001563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee06f7f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee001f4fc0 0x7fee001f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee06f7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee001f5440 0x7fee001f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee06f7f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee000b2090 con 0x7fee001f5440 2024-04-26T22:05:06.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee06f7f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fee0015d720 con 0x7fedf00039b0 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee06f7f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee000b2210 con 0x7fee001f4fc0 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee0551c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee001f5440 0x7fee001f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee0551c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee001f5440 0x7fee001f92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41006/0 (socket says 172.21.15.137:41006) 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee0551c640 1 -- 172.21.15.137:0/2077535500 learned_addr learned my addr 172.21.15.137:0/2077535500 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee04d1b640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf00039b0 0x7fee001563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fedfffff640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee001f4fc0 0x7fee001f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee0551c640 1 -- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee001f4fc0 msgr2=0x7fee001f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee0551c640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee001f4fc0 0x7fee001f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee0551c640 1 -- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf00039b0 msgr2=0x7fee001563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee0551c640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf00039b0 0x7fee001563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee0551c640 1 -- 172.21.15.137:0/2077535500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee00152420 con 0x7fee001f5440 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee04d1b640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf00039b0 0x7fee001563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:06.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fedfffff640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee001f4fc0 0x7fee001f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.667+0000 7fee0551c640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee001f5440 0x7fee001f92f0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fee00073c10 tx=0x7fedf80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.668+0000 7fedfd7fa640 1 -- 172.21.15.137:0/2077535500 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8003990 con 0x7fee001f5440 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.668+0000 7fedfd7fa640 1 -- 172.21.15.137:0/2077535500 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf801b070 con 0x7fee001f5440 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.668+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0006f370 con 0x7fee001f5440 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.668+0000 7fedfd7fa640 1 -- 172.21.15.137:0/2077535500 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8003b70 con 0x7fee001f5440 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.668+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee000b7040 con 0x7fee001f5440 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.669+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee000693d0 con 0x7fee001f5440 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.669+0000 7fedfd7fa640 1 -- 172.21.15.137:0/2077535500 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fedf8005d10 con 0x7fee001f5440 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.669+0000 7fedfd7fa640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fede406c8f0 0x7fede406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.670+0000 7fee04d1b640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fede406c8f0 0x7fede406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.670+0000 7fedfd7fa640 1 -- 172.21.15.137:0/2077535500 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fedf808bf60 con 0x7fee001f5440 2024-04-26T22:05:06.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.670+0000 7fee04d1b640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fede406c8f0 0x7fede406edb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fedf4033000 tx=0x7fedf4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.674+0000 7fedfd7fa640 1 -- 172.21.15.137:0/2077535500 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fee00152420 con 0x7fee001f5440 2024-04-26T22:05:06.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.848+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fee000b0b10 con 0x7fee001f5440 2024-04-26T22:05:06.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.849+0000 7fedfd7fa640 1 -- 172.21.15.137:0/2077535500 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7fedf8014350 con 0x7fee001f5440 2024-04-26T22:05:06.849 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fede406c8f0 msgr2=0x7fede406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fede406c8f0 0x7fede406edb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fedf4033000 tx=0x7fedf4008030 comp rx=0 tx=0).stop 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee001f5440 msgr2=0x7fee001f92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee001f5440 0x7fee001f92f0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fee00073c10 tx=0x7fedf80115a0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 shutdown_connections 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fede406c8f0 0x7fede406edb0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee001f5440 0x7fee001f92f0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee001f4fc0 0x7fee001f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 --2- 172.21.15.137:0/2077535500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedf00039b0 0x7fee001563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 >> 172.21.15.137:0/2077535500 conn(0x7fee0009ba40 msgr2=0x7fee000d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:06.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 shutdown_connections 2024-04-26T22:05:06.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.851+0000 7fee06f7f640 1 -- 172.21.15.137:0/2077535500 wait complete. 2024-04-26T22:05:06.861 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:05:06.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.960+0000 7f0cc7459640 1 Processor -- start 2024-04-26T22:05:06.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.960+0000 7f0cc7459640 1 -- start start 2024-04-26T22:05:06.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.961+0000 7f0cc7459640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 0x7f0cc00b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.961+0000 7f0cc7459640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0cc00b03e0 0x7f0cc00b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.961+0000 7f0cc7459640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00aeb50 con 0x7f0cc015f470 2024-04-26T22:05:06.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.961+0000 7f0cc7459640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00b0020 con 0x7f0cc00b03e0 2024-04-26T22:05:06.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.961+0000 7f0cc7459640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00aee30 con 0x7f0cc0069ae0 2024-04-26T22:05:06.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.961+0000 7f0cc59f6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0cc00b03e0 0x7f0cc00b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.961+0000 7f0cc59f6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0cc00b03e0 0x7f0cc00b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41020/0 (socket says 172.21.15.137:41020) 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.961+0000 7f0cc59f6640 1 -- 172.21.15.137:0/2583946465 learned_addr learned my addr 172.21.15.137:0/2583946465 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.962+0000 7f0cc49f4640 1 --2- 172.21.15.137:0/2583946465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 0x7f0cc00b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.962+0000 7f0cc59f6640 1 -- 172.21.15.137:0/2583946465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 msgr2=0x7f0cc00b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.962+0000 7f0cc59f6640 1 --2- 172.21.15.137:0/2583946465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 0x7f0cc00b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.962+0000 7f0cc59f6640 1 -- 172.21.15.137:0/2583946465 >> v1:172.21.15.170:6789/0 conn(0x7f0cc015f470 legacy=0x7f0cc00af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.962+0000 7f0cc59f6640 1 -- 172.21.15.137:0/2583946465 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc00af110 con 0x7f0cc00b03e0 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.962+0000 7f0cc59f6640 1 --2- 172.21.15.137:0/2583946465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 0x7f0cc00b4600 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009870 tx=0x7f0cb802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16308d28c2452144 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.962+0000 7f0cb7fff640 1 -- 172.21.15.137:0/2583946465 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8037070 con 0x7f0cc00b03e0 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.962+0000 7f0cb7fff640 1 -- 172.21.15.137:0/2583946465 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb8032440 con 0x7f0cc00b03e0 2024-04-26T22:05:06.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.962+0000 7f0cb7fff640 1 -- 172.21.15.137:0/2583946465 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8032810 con 0x7f0cc00b03e0 2024-04-26T22:05:06.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.963+0000 7f0cc7459640 1 -- 172.21.15.137:0/2583946465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 msgr2=0x7f0cc00b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.963+0000 7f0cc7459640 1 --2- 172.21.15.137:0/2583946465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 0x7f0cc00b4600 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009870 tx=0x7f0cb802a210 comp rx=0 tx=0).stop 2024-04-26T22:05:06.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.963+0000 7f0cc7459640 1 -- 172.21.15.137:0/2583946465 shutdown_connections 2024-04-26T22:05:06.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.963+0000 7f0cc7459640 1 --2- 172.21.15.137:0/2583946465 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 0x7f0cc00b4600 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.963+0000 7f0cc7459640 1 --2- 172.21.15.137:0/2583946465 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 0x7f0cc00b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.963+0000 7f0cc7459640 1 -- 172.21.15.137:0/2583946465 >> 172.21.15.137:0/2583946465 conn(0x7f0cc0073910 msgr2=0x7f0cc0073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.963+0000 7f0cc7459640 1 -- 172.21.15.137:0/2583946465 shutdown_connections 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.963+0000 7f0cc7459640 1 -- 172.21.15.137:0/2583946465 wait complete. 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.964+0000 7f0cc7459640 1 Processor -- start 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.964+0000 7f0cc7459640 1 -- start start 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc7459640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 0x7f0cc01561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc7459640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 0x7f0cc009e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc7459640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc015f470 0x7f0cc009e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc7459640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00b6220 con 0x7f0cc00b03e0 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc7459640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00b09a0 con 0x7f0cc015f470 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc7459640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00b63a0 con 0x7f0cc0069ae0 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc49f4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 0x7f0cc009e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc49f4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 0x7f0cc009e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41026/0 (socket says 172.21.15.137:41026) 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc49f4640 1 -- 172.21.15.137:0/1476202209 learned_addr learned my addr 172.21.15.137:0/1476202209 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:06.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc59f6640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc015f470 0x7f0cc009e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc51f5640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 0x7f0cc01561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc49f4640 1 -- 172.21.15.137:0/1476202209 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 msgr2=0x7f0cc01561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc49f4640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 0x7f0cc01561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc49f4640 1 -- 172.21.15.137:0/1476202209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc015f470 msgr2=0x7f0cc009e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc49f4640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc015f470 0x7f0cc009e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc49f4640 1 -- 172.21.15.137:0/1476202209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc009f200 con 0x7f0cc00b03e0 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.965+0000 7f0cc59f6640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc015f470 0x7f0cc009e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.966+0000 7f0cc49f4640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 0x7f0cc009e180 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c820 tx=0x7f0cb000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.966+0000 7f0cb5ffb640 1 -- 172.21.15.137:0/1476202209 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0015070 con 0x7f0cc00b03e0 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.966+0000 7f0cb5ffb640 1 -- 172.21.15.137:0/1476202209 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb0004220 con 0x7f0cc00b03e0 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.966+0000 7f0cb5ffb640 1 -- 172.21.15.137:0/1476202209 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb000ce10 con 0x7f0cc00b03e0 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.966+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc009ef20 con 0x7f0cc00b03e0 2024-04-26T22:05:06.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.966+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc0158150 con 0x7f0cc00b03e0 2024-04-26T22:05:06.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.967+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc006a290 con 0x7f0cc00b03e0 2024-04-26T22:05:06.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.967+0000 7f0cb5ffb640 1 -- 172.21.15.137:0/1476202209 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0cb0007830 con 0x7f0cc00b03e0 2024-04-26T22:05:06.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.967+0000 7f0cb5ffb640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ca406c8f0 0x7f0ca406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:06.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.968+0000 7f0cb5ffb640 1 -- 172.21.15.137:0/1476202209 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f0cb008be70 con 0x7f0cc00b03e0 2024-04-26T22:05:06.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.968+0000 7f0cc51f5640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ca406c8f0 0x7f0ca406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:06.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.968+0000 7f0cc51f5640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ca406c8f0 0x7f0ca406edb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc007bf0 tx=0x7f0cbc007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:06.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:06.972+0000 7f0cb5ffb640 1 -- 172.21.15.137:0/1476202209 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0cb005a1a0 con 0x7f0cc00b03e0 2024-04-26T22:05:07.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.145+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0cc00af9b0 con 0x7f0cc00b03e0 2024-04-26T22:05:07.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.146+0000 7f0cb5ffb640 1 -- 172.21.15.137:0/1476202209 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f0cb0059aa0 con 0x7f0cc00b03e0 2024-04-26T22:05:07.146 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.147+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ca406c8f0 msgr2=0x7f0ca406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.147+0000 7f0cc7459640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ca406c8f0 0x7f0ca406edb0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc007bf0 tx=0x7f0cbc007240 comp rx=0 tx=0).stop 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.147+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 msgr2=0x7f0cc009e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.147+0000 7f0cc7459640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 0x7f0cc009e180 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f0cb000c820 tx=0x7f0cb000cce0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.148+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 shutdown_connections 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.148+0000 7f0cc7459640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0ca406c8f0 0x7f0ca406edb0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.148+0000 7f0cc7459640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0cc00b03e0 0x7f0cc009e180 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.148+0000 7f0cc7459640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0cc015f470 0x7f0cc009e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.148+0000 7f0cc7459640 1 --2- 172.21.15.137:0/1476202209 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0cc0069ae0 0x7f0cc01561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.148+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 >> 172.21.15.137:0/1476202209 conn(0x7f0cc0073910 msgr2=0x7f0cc00d17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.148+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 shutdown_connections 2024-04-26T22:05:07.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.148+0000 7f0cc7459640 1 -- 172.21.15.137:0/1476202209 wait complete. 2024-04-26T22:05:07.159 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:05:07.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.256+0000 7fa239f24640 1 Processor -- start 2024-04-26T22:05:07.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.256+0000 7fa239f24640 1 -- start start 2024-04-26T22:05:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.257+0000 7fa239f24640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa234148a30 0x7fa234073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.257+0000 7fa239f24640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2340b3af0 0x7fa2340b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.257+0000 7fa239f24640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2340cfa80 con 0x7fa234160640 2024-04-26T22:05:07.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.257+0000 7fa239f24640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa2340cfd60 con 0x7fa234148a30 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.257+0000 7fa239f24640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa2340d0040 con 0x7fa2340b3af0 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.257+0000 7fa2337fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa234148a30 0x7fa234073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.257+0000 7fa232ffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa234160640 0x7fa2341636a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49084/0 (socket says 172.21.15.137:49084) 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.257+0000 7fa232ffd640 1 -- 172.21.15.137:0/801732508 learned_addr learned my addr 172.21.15.137:0/801732508 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.257+0000 7fa233fff640 1 --2- 172.21.15.137:0/801732508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2340b3af0 0x7fa2340b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa2337fe640 1 -- 172.21.15.137:0/801732508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2340b3af0 msgr2=0x7fa2340b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa2337fe640 1 --2- 172.21.15.137:0/801732508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2340b3af0 0x7fa2340b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa2337fe640 1 -- 172.21.15.137:0/801732508 >> v1:172.21.15.137:6789/0 conn(0x7fa234160640 legacy=0x7fa2341636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa2327fc640 1 -- 172.21.15.137:0/801732508 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689969438 0 0) 0x7fa2340cfa80 con 0x7fa234160640 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa2337fe640 1 -- 172.21.15.137:0/801732508 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa234162ea0 con 0x7fa234148a30 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa233fff640 1 --2- 172.21.15.137:0/801732508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2340b3af0 0x7fa2340b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa2337fe640 1 --2- 172.21.15.137:0/801732508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa234148a30 0x7fa234073ed0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa2240097a0 tx=0x7fa22402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c973ea498c68b4e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:07.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa2327fc640 1 -- 172.21.15.137:0/801732508 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224037070 con 0x7fa234148a30 2024-04-26T22:05:07.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa2327fc640 1 -- 172.21.15.137:0/801732508 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa224032440 con 0x7fa234148a30 2024-04-26T22:05:07.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.258+0000 7fa2327fc640 1 -- 172.21.15.137:0/801732508 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22402ae60 con 0x7fa234148a30 2024-04-26T22:05:07.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.259+0000 7fa239f24640 1 -- 172.21.15.137:0/801732508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa234148a30 msgr2=0x7fa234073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.259+0000 7fa239f24640 1 --2- 172.21.15.137:0/801732508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa234148a30 0x7fa234073ed0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa2240097a0 tx=0x7fa22402a110 comp rx=0 tx=0).stop 2024-04-26T22:05:07.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.259+0000 7fa239f24640 1 -- 172.21.15.137:0/801732508 shutdown_connections 2024-04-26T22:05:07.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.259+0000 7fa239f24640 1 --2- 172.21.15.137:0/801732508 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2340b3af0 0x7fa2340b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.259+0000 7fa239f24640 1 --2- 172.21.15.137:0/801732508 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa234148a30 0x7fa234073ed0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.259+0000 7fa239f24640 1 -- 172.21.15.137:0/801732508 >> 172.21.15.137:0/801732508 conn(0x7fa2340ce8b0 msgr2=0x7fa2340cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.259+0000 7fa239f24640 1 -- 172.21.15.137:0/801732508 shutdown_connections 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.259+0000 7fa239f24640 1 -- 172.21.15.137:0/801732508 wait complete. 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.260+0000 7fa239f24640 1 Processor -- start 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.260+0000 7fa239f24640 1 -- start start 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa239f24640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2340b3af0 0x7fa2340b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa239f24640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa234148a30 0x7fa2340af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa239f24640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa234160640 0x7fa23415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa239f24640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa234074410 con 0x7fa2340b3af0 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa239f24640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa234163db0 con 0x7fa234160640 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa239f24640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa234074590 con 0x7fa234148a30 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa2337fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2340b3af0 0x7fa2340b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa2337fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2340b3af0 0x7fa2340b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41042/0 (socket says 172.21.15.137:41042) 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa2337fe640 1 -- 172.21.15.137:0/3243476440 learned_addr learned my addr 172.21.15.137:0/3243476440 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa233fff640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa234160640 0x7fa23415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa232ffd640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa234148a30 0x7fa2340af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa2337fe640 1 -- 172.21.15.137:0/3243476440 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa234148a30 msgr2=0x7fa2340af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa2337fe640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa234148a30 0x7fa2340af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa2337fe640 1 -- 172.21.15.137:0/3243476440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa234160640 msgr2=0x7fa23415e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa2337fe640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa234160640 0x7fa23415e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.261+0000 7fa2337fe640 1 -- 172.21.15.137:0/3243476440 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2341f4c70 con 0x7fa2340b3af0 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.262+0000 7fa2337fe640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2340b3af0 0x7fa2340b5ed0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa224000c00 tx=0x7fa2240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.262+0000 7fa21bfff640 1 -- 172.21.15.137:0/3243476440 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224037040 con 0x7fa2340b3af0 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.262+0000 7fa21bfff640 1 -- 172.21.15.137:0/3243476440 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa224042070 con 0x7fa2340b3af0 2024-04-26T22:05:07.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.262+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2340afef0 con 0x7fa2340b3af0 2024-04-26T22:05:07.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.262+0000 7fa21bfff640 1 -- 172.21.15.137:0/3243476440 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa224030bb0 con 0x7fa2340b3af0 2024-04-26T22:05:07.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.262+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2341f4f00 con 0x7fa2340b3af0 2024-04-26T22:05:07.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.263+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23406a290 con 0x7fa2340b3af0 2024-04-26T22:05:07.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.263+0000 7fa21bfff640 1 -- 172.21.15.137:0/3243476440 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa224047460 con 0x7fa2340b3af0 2024-04-26T22:05:07.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.264+0000 7fa21bfff640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22006c8f0 0x7fa22006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.264+0000 7fa21bfff640 1 -- 172.21.15.137:0/3243476440 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7fa2240ac560 con 0x7fa2340b3af0 2024-04-26T22:05:07.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.264+0000 7fa232ffd640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22006c8f0 0x7fa22006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.264+0000 7fa232ffd640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22006c8f0 0x7fa22006edb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa234145b40 tx=0x7fa228007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:07.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.268+0000 7fa21bfff640 1 -- 172.21.15.137:0/3243476440 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa224032e20 con 0x7fa2340b3af0 2024-04-26T22:05:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.461+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2340739f0 con 0x7fa2340b3af0 2024-04-26T22:05:07.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.461+0000 7fa21bfff640 1 -- 172.21.15.137:0/3243476440 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v90) ==== 80+0+122 (secure 0 0 0) 0x7fa22407a360 con 0x7fa2340b3af0 2024-04-26T22:05:07.461 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.170:6835/865192507 2024-04-27T22:04:27.224170+0000 2024-04-26T22:05:07.462 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.170:6833/865192507 2024-04-27T22:04:27.224170+0000 2024-04-26T22:05:07.462 INFO:teuthology.orchestra.run.smithi137.stderr:listed 2 entries 2024-04-26T22:05:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22006c8f0 msgr2=0x7fa22006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22006c8f0 0x7fa22006edb0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa234145b40 tx=0x7fa228007e40 comp rx=0 tx=0).stop 2024-04-26T22:05:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2340b3af0 msgr2=0x7fa2340b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2340b3af0 0x7fa2340b5ed0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa224000c00 tx=0x7fa2240046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 shutdown_connections 2024-04-26T22:05:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa22006c8f0 0x7fa22006edb0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa234160640 0x7fa23415e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa234148a30 0x7fa2340af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 --2- 172.21.15.137:0/3243476440 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2340b3af0 0x7fa2340b5ed0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 >> 172.21.15.137:0/3243476440 conn(0x7fa2340ce8b0 msgr2=0x7fa2340b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:07.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 shutdown_connections 2024-04-26T22:05:07.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.464+0000 7fa239f24640 1 -- 172.21.15.137:0/3243476440 wait complete. 2024-04-26T22:05:07.474 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:05:07.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:07.474 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:05:07.501 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:05:07.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:07.502 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:05:07.557 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:07.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.694+0000 7efdee0dc640 1 Processor -- start 2024-04-26T22:05:07.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.694+0000 7efdee0dc640 1 -- start start 2024-04-26T22:05:07.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efdee0dc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efde8146790 0x7efde80cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efdee0dc640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde80d05b0 con 0x7efde813ff70 2024-04-26T22:05:07.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efdee0dc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde80d0890 con 0x7efde8140350 2024-04-26T22:05:07.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efdee0dc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efde806e450 con 0x7efde8146790 2024-04-26T22:05:07.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efde7fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efde8146790 0x7efde80cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efde77fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7efde813ff70 0x7efde8146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49098/0 (socket says 172.21.15.137:49098) 2024-04-26T22:05:07.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efde77fe640 1 -- 172.21.15.137:0/1739113119 learned_addr learned my addr 172.21.15.137:0/1739113119 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:07.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efde7fff640 1 -- 172.21.15.137:0/1739113119 >> v1:172.21.15.170:6789/0 conn(0x7efde8140350 legacy=0x7efde80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:07.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efde7fff640 1 -- 172.21.15.137:0/1739113119 >> v1:172.21.15.137:6789/0 conn(0x7efde813ff70 legacy=0x7efde8146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efde67fc640 1 -- 172.21.15.137:0/1739113119 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976689386 0 0) 0x7efde80d05b0 con 0x7efde813ff70 2024-04-26T22:05:07.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.695+0000 7efde7fff640 1 -- 172.21.15.137:0/1739113119 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde806e730 con 0x7efde8146790 2024-04-26T22:05:07.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.696+0000 7efde7fff640 1 --2- 172.21.15.137:0/1739113119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde8146790 0x7efde80cff20 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7efde0009dc0 tx=0x7efde002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb9e0581f8aa1da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.696+0000 7efde67fc640 1 -- 172.21.15.137:0/1739113119 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0007740 con 0x7efde8146790 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.696+0000 7efde67fc640 1 -- 172.21.15.137:0/1739113119 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde00078e0 con 0x7efde8146790 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.696+0000 7efde67fc640 1 -- 172.21.15.137:0/1739113119 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde0007cb0 con 0x7efde8146790 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.697+0000 7efdee0dc640 1 -- 172.21.15.137:0/1739113119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde8146790 msgr2=0x7efde80cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.697+0000 7efdee0dc640 1 --2- 172.21.15.137:0/1739113119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde8146790 0x7efde80cff20 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7efde0009dc0 tx=0x7efde002a640 comp rx=0 tx=0).stop 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.697+0000 7efdee0dc640 1 -- 172.21.15.137:0/1739113119 shutdown_connections 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.697+0000 7efdee0dc640 1 --2- 172.21.15.137:0/1739113119 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde8146790 0x7efde80cff20 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.697+0000 7efdee0dc640 1 -- 172.21.15.137:0/1739113119 >> 172.21.15.137:0/1739113119 conn(0x7efde80d0d30 msgr2=0x7efde80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.697+0000 7efdee0dc640 1 -- 172.21.15.137:0/1739113119 shutdown_connections 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.697+0000 7efdee0dc640 1 -- 172.21.15.137:0/1739113119 wait complete. 2024-04-26T22:05:07.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.698+0000 7efdee0dc640 1 Processor -- start 2024-04-26T22:05:07.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.698+0000 7efdee0dc640 1 -- start start 2024-04-26T22:05:07.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efdee0dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde813ff70 0x7efde81397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efdee0dc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efde8140350 0x7efde8158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efdee0dc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efde8146790 0x7efde8155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efdee0dc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efde81681c0 con 0x7efde813ff70 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efdee0dc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efde8168040 con 0x7efde8140350 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efdee0dc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efde8168340 con 0x7efde8146790 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde813ff70 0x7efde81397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde813ff70 0x7efde81397c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41050/0 (socket says 172.21.15.137:41050) 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde77fe640 1 -- 172.21.15.137:0/224183382 learned_addr learned my addr 172.21.15.137:0/224183382 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde77fe640 1 -- 172.21.15.137:0/224183382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efde8146790 msgr2=0x7efde8155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde7fff640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efde8146790 0x7efde8155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde77fe640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efde8146790 0x7efde8155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde6ffd640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efde8140350 0x7efde8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde77fe640 1 -- 172.21.15.137:0/224183382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efde8140350 msgr2=0x7efde8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde77fe640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efde8140350 0x7efde8158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde77fe640 1 -- 172.21.15.137:0/224183382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde815d730 con 0x7efde813ff70 2024-04-26T22:05:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.699+0000 7efde77fe640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde813ff70 0x7efde81397c0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c500 tx=0x7efdd800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.700+0000 7efdcffff640 1 -- 172.21.15.137:0/224183382 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8018070 con 0x7efde813ff70 2024-04-26T22:05:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.700+0000 7efdcffff640 1 -- 172.21.15.137:0/224183382 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd8007580 con 0x7efde813ff70 2024-04-26T22:05:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.700+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde815d9f0 con 0x7efde813ff70 2024-04-26T22:05:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.700+0000 7efdcffff640 1 -- 172.21.15.137:0/224183382 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd8004a20 con 0x7efde813ff70 2024-04-26T22:05:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.700+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde815dfb0 con 0x7efde813ff70 2024-04-26T22:05:07.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.701+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde806a290 con 0x7efde813ff70 2024-04-26T22:05:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.701+0000 7efdcffff640 1 -- 172.21.15.137:0/224183382 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efdd801b070 con 0x7efde813ff70 2024-04-26T22:05:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.701+0000 7efdcffff640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efdd406c8f0 0x7efdd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.701+0000 7efdcffff640 1 -- 172.21.15.137:0/224183382 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7efdd808ae30 con 0x7efde813ff70 2024-04-26T22:05:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.701+0000 7efde6ffd640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efdd406c8f0 0x7efdd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:07.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.702+0000 7efde6ffd640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efdd406c8f0 0x7efdd406edb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efde8160890 tx=0x7efddc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:07.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.706+0000 7efdcffff640 1 -- 172.21.15.137:0/224183382 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efdd8059280 con 0x7efde813ff70 2024-04-26T22:05:07.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.919+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efde80ce100 con 0x7efde813ff70 2024-04-26T22:05:07.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.920+0000 7efdcffff640 1 -- 172.21.15.137:0/224183382 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5196 (secure 0 0 0) 0x7efdd8058b80 con 0x7efde813ff70 2024-04-26T22:05:07.920 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:07.921 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":54,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:04:34.234174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7317},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7317":{"gid":7317,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":9,"addr":"172.21.15.137:6837/2128712520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2128712520},{"type":"v1","addr":"172.21.15.137:6837","nonce":2128712520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7317,"qdb_cluster":[7317]},"id":6}]} 2024-04-26T22:05:07.921 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 54 2024-04-26T22:05:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efdd406c8f0 msgr2=0x7efdd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efdd406c8f0 0x7efdd406edb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efde8160890 tx=0x7efddc009040 comp rx=0 tx=0).stop 2024-04-26T22:05:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde813ff70 msgr2=0x7efde81397c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde813ff70 0x7efde81397c0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c500 tx=0x7efdd800c9c0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 shutdown_connections 2024-04-26T22:05:07.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efdd406c8f0 0x7efdd406edb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efde8146790 0x7efde8155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efde8140350 0x7efde8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 --2- 172.21.15.137:0/224183382 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efde813ff70 0x7efde81397c0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:07.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 >> 172.21.15.137:0/224183382 conn(0x7efde80d0d30 msgr2=0x7efde80b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:07.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 shutdown_connections 2024-04-26T22:05:07.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:07.922+0000 7efdee0dc640 1 -- 172.21.15.137:0/224183382 wait complete. 2024-04-26T22:05:07.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-26T22:05:08.056 INFO:teuthology.orchestra.run.smithi137.stdout:{"message":"","return_code":0} 2024-04-26T22:05:08.057 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T22:05:08.057 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:05:08.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.155+0000 7f5de736a640 1 Processor -- start 2024-04-26T22:05:08.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.155+0000 7f5de736a640 1 -- start start 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de736a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5de0145980 0x7f5de0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de736a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5de00b61a0 0x7f5de00720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de736a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de00b4260 con 0x7f5de00b3de0 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de736a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5de00b5140 con 0x7f5de00b61a0 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de736a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5de00b4530 con 0x7f5de0145980 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de5907640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5de00b61a0 0x7f5de00720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de4905640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5de00b3de0 0x7f5de00b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49104/0 (socket says 172.21.15.137:49104) 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de4905640 1 -- 172.21.15.137:0/663526584 learned_addr learned my addr 172.21.15.137:0/663526584 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de5106640 1 --2- 172.21.15.137:0/663526584 >> v2:172.21.15.170:3300/0 conn(0x7f5de0145980 0x7f5de0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de5907640 1 -- 172.21.15.137:0/663526584 >> v2:172.21.15.170:3300/0 conn(0x7f5de0145980 msgr2=0x7f5de0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de5907640 1 --2- 172.21.15.137:0/663526584 >> v2:172.21.15.170:3300/0 conn(0x7f5de0145980 0x7f5de0160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de5907640 1 -- 172.21.15.137:0/663526584 >> v1:172.21.15.137:6789/0 conn(0x7f5de00b3de0 legacy=0x7f5de00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5de5907640 1 -- 172.21.15.137:0/663526584 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de00b4810 con 0x7f5de00b61a0 2024-04-26T22:05:08.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.156+0000 7f5dd7fff640 1 -- 172.21.15.137:0/663526584 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1061656180 0 0) 0x7f5de00b4260 con 0x7f5de00b3de0 2024-04-26T22:05:08.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.157+0000 7f5de5907640 1 --2- 172.21.15.137:0/663526584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de00b61a0 0x7f5de00720d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f5de006ff10 tx=0x7f5dd802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c5bc5258880901 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.157+0000 7f5dd7fff640 1 -- 172.21.15.137:0/663526584 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8007740 con 0x7f5de00b61a0 2024-04-26T22:05:08.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.157+0000 7f5dd7fff640 1 -- 172.21.15.137:0/663526584 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd80078e0 con 0x7f5de00b61a0 2024-04-26T22:05:08.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.157+0000 7f5dd7fff640 1 -- 172.21.15.137:0/663526584 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8007cb0 con 0x7f5de00b61a0 2024-04-26T22:05:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.157+0000 7f5de736a640 1 -- 172.21.15.137:0/663526584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de00b61a0 msgr2=0x7f5de00720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.157+0000 7f5de736a640 1 --2- 172.21.15.137:0/663526584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de00b61a0 0x7f5de00720d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f5de006ff10 tx=0x7f5dd802a5f0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.158+0000 7f5de736a640 1 -- 172.21.15.137:0/663526584 shutdown_connections 2024-04-26T22:05:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.158+0000 7f5de736a640 1 --2- 172.21.15.137:0/663526584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de00b61a0 0x7f5de00720d0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.158+0000 7f5de736a640 1 --2- 172.21.15.137:0/663526584 >> v2:172.21.15.170:3300/0 conn(0x7f5de0145980 0x7f5de0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.158+0000 7f5de736a640 1 -- 172.21.15.137:0/663526584 >> 172.21.15.137:0/663526584 conn(0x7f5de00d0d30 msgr2=0x7f5de00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.158+0000 7f5de736a640 1 -- 172.21.15.137:0/663526584 shutdown_connections 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.158+0000 7f5de736a640 1 -- 172.21.15.137:0/663526584 wait complete. 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.159+0000 7f5de736a640 1 Processor -- start 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.159+0000 7f5de736a640 1 -- start start 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.159+0000 7f5de736a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de00b3de0 0x7f5de013d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.159+0000 7f5de736a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de00b61a0 0x7f5de00b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.159+0000 7f5de736a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de0145980 0x7f5de01e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.159+0000 7f5de736a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5de0072610 con 0x7f5de0145980 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.159+0000 7f5de736a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5de00b4dd0 con 0x7f5de00b3de0 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.159+0000 7f5de736a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5de0072790 con 0x7f5de00b61a0 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5907640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de0145980 0x7f5de01e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5907640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de0145980 0x7f5de01e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41068/0 (socket says 172.21.15.137:41068) 2024-04-26T22:05:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5907640 1 -- 172.21.15.137:0/3099629490 learned_addr learned my addr 172.21.15.137:0/3099629490 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5106640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de00b3de0 0x7f5de013d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de4905640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de00b61a0 0x7f5de00b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5907640 1 -- 172.21.15.137:0/3099629490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de00b61a0 msgr2=0x7f5de00b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5907640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de00b61a0 0x7f5de00b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5907640 1 -- 172.21.15.137:0/3099629490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de00b3de0 msgr2=0x7f5de013d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5907640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de00b3de0 0x7f5de013d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5907640 1 -- 172.21.15.137:0/3099629490 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de00b2760 con 0x7f5de0145980 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de4905640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de00b61a0 0x7f5de00b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de5907640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de0145980 0x7f5de01e5f80 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f5dd802abe0 tx=0x7f5dd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5dd5ffb640 1 -- 172.21.15.137:0/3099629490 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8040070 con 0x7f5de0145980 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5dd5ffb640 1 -- 172.21.15.137:0/3099629490 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dd8031bc0 con 0x7f5de0145980 2024-04-26T22:05:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de00b21a0 con 0x7f5de0145980 2024-04-26T22:05:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5dd5ffb640 1 -- 172.21.15.137:0/3099629490 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8045460 con 0x7f5de0145980 2024-04-26T22:05:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.160+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de01e5a60 con 0x7f5de0145980 2024-04-26T22:05:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.161+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de006a290 con 0x7f5de0145980 2024-04-26T22:05:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.162+0000 7f5dd5ffb640 1 -- 172.21.15.137:0/3099629490 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5dd8039040 con 0x7f5de0145980 2024-04-26T22:05:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.162+0000 7f5dd5ffb640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5dc406c8f0 0x7f5dc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.162+0000 7f5dd5ffb640 1 -- 172.21.15.137:0/3099629490 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5824+0+0 (secure 0 0 0) 0x7f5dd80ad450 con 0x7f5de0145980 2024-04-26T22:05:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.162+0000 7f5de5106640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5dc406c8f0 0x7f5dc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.163+0000 7f5de5106640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5dc406c8f0 0x7f5dc406edb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc006fd0 tx=0x7f5ddc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.167+0000 7f5dd5ffb640 1 -- 172.21.15.137:0/3099629490 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5de00b2760 con 0x7f5de0145980 2024-04-26T22:05:08.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.379+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5de01e5c30 con 0x7f5de0145980 2024-04-26T22:05:08.379 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:05:08.379+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:05:08.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.380+0000 7f5dd5ffb640 1 -- 172.21.15.137:0/3099629490 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) ==== 161+0+0 (secure 0 0 0) 0x7f5dd807b9c0 con 0x7f5de0145980 2024-04-26T22:05:08.380 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:05:08.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5dc406c8f0 msgr2=0x7f5dc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5dc406c8f0 0x7f5dc406edb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc006fd0 tx=0x7f5ddc008040 comp rx=0 tx=0).stop 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de0145980 msgr2=0x7f5de01e5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de0145980 0x7f5de01e5f80 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f5dd802abe0 tx=0x7f5dd8004a40 comp rx=0 tx=0).stop 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 shutdown_connections 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5dc406c8f0 0x7f5dc406edb0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5de0145980 0x7f5de01e5f80 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5de00b61a0 0x7f5de00b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 --2- 172.21.15.137:0/3099629490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5de00b3de0 0x7f5de013d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 >> 172.21.15.137:0/3099629490 conn(0x7f5de00d0d30 msgr2=0x7f5de0072ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 shutdown_connections 2024-04-26T22:05:08.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.383+0000 7f5de736a640 1 -- 172.21.15.137:0/3099629490 wait complete. 2024-04-26T22:05:08.386 INFO:tasks.ceph.mds.a.smithi137.stderr: -2819> 2024-04-26T22:04:33.752+0000 7fa56fcb9640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-26T22:05:08.386 INFO:tasks.ceph.mds.a.smithi137.stderr: -2653> 2024-04-26T22:04:33.933+0000 7fa56fcb9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-26T22:04:24.418706+0000 1=1+0) n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1) | dirfrag=0 authpin=1 scrubqueue=0 0x5596f393e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-26T22:04:24.418706+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-26T22:05:08.386 INFO:tasks.ceph.mds.a.smithi137.stderr: -2545> 2024-04-26T22:04:34.307+0000 7fa573cc1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:05:08.386 INFO:tasks.ceph.mds.a.smithi137.stderr: -2263> 2024-04-26T22:04:35.050+0000 7fa56fcb9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv18 ap=3 DIRTYPARENT f(v0 m2024-04-26T22:04:24.418706+0000 1=1+0)->f(v1 m2024-04-26T22:04:24.418706+0000) n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1)->n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x5596f393e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-26T22:04:24.418706+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-26T22:04:24.533704+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-26T22:05:08.395 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-26T22:05:08.413 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:05:08.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.434+0000 7f064e41a740 1 -- start start 2024-04-26T22:05:08.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.434+0000 7f064e41a740 1 Processor -- start 2024-04-26T22:05:08.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064e41a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00884cc00 0x55c00962a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064e41a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c00884d800 0x55c00962a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064e41a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c00884dc00 0x55c00962ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064e41a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c009638180 con 0x55c00884d800 2024-04-26T22:05:08.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064e41a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c009638300 con 0x55c00884cc00 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064e41a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c009638480 con 0x55c00884dc00 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064b858640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c00884d800 0x55c00962a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064b858640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c00884d800 0x55c00962a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41100/0 (socket says 172.21.15.137:41100) 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064b858640 1 -- 172.21.15.137:0/686577041 learned_addr learned my addr 172.21.15.137:0/686577041 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064c059640 1 --2- 172.21.15.137:0/686577041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00884cc00 0x55c00962a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064c85a640 1 --2- 172.21.15.137:0/686577041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c00884dc00 0x55c00962ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064b858640 1 -- 172.21.15.137:0/686577041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c00884dc00 msgr2=0x55c00962ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064b858640 1 --2- 172.21.15.137:0/686577041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c00884dc00 0x55c00962ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064b858640 1 -- 172.21.15.137:0/686577041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00884cc00 msgr2=0x55c00962a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064b858640 1 --2- 172.21.15.137:0/686577041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00884cc00 0x55c00962a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064b858640 1 -- 172.21.15.137:0/686577041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c008879680 con 0x55c00884d800 2024-04-26T22:05:08.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064b858640 1 --2- 172.21.15.137:0/686577041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c00884d800 0x55c00962a580 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x55c009679f80 tx=0x55c0095f4300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3978e38d798bad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f0649854640 1 -- 172.21.15.137:0/686577041 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c008872680 con 0x55c00884d800 2024-04-26T22:05:08.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f0649854640 1 -- 172.21.15.137:0/686577041 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c008894e00 con 0x55c00884d800 2024-04-26T22:05:08.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f0649854640 1 -- 172.21.15.137:0/686577041 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c008872b60 con 0x55c00884d800 2024-04-26T22:05:08.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064e41a740 1 -- 172.21.15.137:0/686577041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0088794a0 con 0x55c00884d800 2024-04-26T22:05:08.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064e41a740 1 -- 172.21.15.137:0/686577041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55c008879a40 con 0x55c00884d800 2024-04-26T22:05:08.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.435+0000 7f064e41a740 4 waiting for MDS map... 2024-04-26T22:05:08.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.436+0000 7f0649854640 1 -- 172.21.15.137:0/686577041 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x55c00972c600 con 0x55c00884d800 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.436+0000 7f0649854640 1 -- 172.21.15.137:0/686577041 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 55) ==== 2885+0+0 (secure 0 0 0) 0x55c0088a5180 con 0x55c00884d800 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.436+0000 7f064e41a740 4 Got MDS map 55 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.436+0000 7f064e41a740 4 datascan.main: Using metadata pool output 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.436+0000 7f064e41a740 4 datascan.main: connecting to RADOS... 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.436+0000 7f064e41a740 1 Processor -- start 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.436+0000 7f064e41a740 1 -- start start 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064e41a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725400 0x55c00962b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064e41a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725800 0x55c00962b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064e41a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725c00 0x55c00962bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064e41a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c009638600 con 0x55c009725c00 2024-04-26T22:05:08.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064e41a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c009638780 con 0x55c009725800 2024-04-26T22:05:08.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064e41a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c009638900 con 0x55c009725400 2024-04-26T22:05:08.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064b858640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725c00 0x55c00962bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064b858640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725c00 0x55c00962bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41106/0 (socket says 172.21.15.137:41106) 2024-04-26T22:05:08.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064b858640 1 -- 172.21.15.137:0/3694668991 learned_addr learned my addr 172.21.15.137:0/3694668991 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064c85a640 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725400 0x55c00962b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064c059640 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725800 0x55c00962b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064b858640 1 -- 172.21.15.137:0/3694668991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725400 msgr2=0x55c00962b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064b858640 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725400 0x55c00962b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064b858640 1 -- 172.21.15.137:0/3694668991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725800 msgr2=0x55c00962b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064b858640 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725800 0x55c00962b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064b858640 1 -- 172.21.15.137:0/3694668991 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c008879860 con 0x55c009725c00 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064c059640 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725800 0x55c00962b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f064b858640 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725c00 0x55c00962bb80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x55c009727410 tx=0x55c0095f0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c38e18523e5601 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.437+0000 7f0647850640 1 -- 172.21.15.137:0/3694668991 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c008872820 con 0x55c009725c00 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f0647850640 1 -- 172.21.15.137:0/3694668991 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c008894c40 con 0x55c009725c00 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f0647850640 1 -- 172.21.15.137:0/3694668991 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c008872680 con 0x55c009725c00 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 -- 172.21.15.137:0/3694668991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725c00 msgr2=0x55c00962bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725c00 0x55c00962bb80 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x55c009727410 tx=0x55c0095f0c00 comp rx=0 tx=0).stop 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 -- 172.21.15.137:0/3694668991 shutdown_connections 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725c00 0x55c00962bb80 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725800 0x55c00962b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 --2- 172.21.15.137:0/3694668991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725400 0x55c00962b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 -- 172.21.15.137:0/3694668991 >> 172.21.15.137:0/3694668991 conn(0x55c009725000 msgr2=0x55c00893d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 -- 172.21.15.137:0/3694668991 shutdown_connections 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 -- 172.21.15.137:0/3694668991 wait complete. 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 Processor -- start 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.438+0000 7f064e41a740 1 -- start start 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064e41a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725400 0x55c00962b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064e41a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725800 0x55c00962b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064e41a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725c00 0x55c00962bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064e41a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c009639b00 con 0x55c009725400 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064e41a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c009639980 con 0x55c009725c00 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064e41a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c009638600 con 0x55c009725800 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c85a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725400 0x55c00962b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.449 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c85a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725400 0x55c00962b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41114/0 (socket says 172.21.15.137:41114) 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 learned_addr learned my addr 172.21.15.137:0/2274863935 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064b858640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725c00 0x55c00962bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c059640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725800 0x55c00962b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725800 msgr2=0x55c00962b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c85a640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725800 0x55c00962b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725c00 msgr2=0x55c00962bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c85a640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c009725c00 0x55c00962bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c008879680 con 0x55c009725400 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c059640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c009725800 0x55c00962b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.439+0000 7f064c85a640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725400 0x55c00962b080 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x55c009679410 tx=0x55c0095f4240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.440+0000 7f064604d640 1 -- 172.21.15.137:0/2274863935 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c0088729c0 con 0x55c009725400 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.440+0000 7f064604d640 1 -- 172.21.15.137:0/2274863935 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c008895340 con 0x55c009725400 2024-04-26T22:05:08.450 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.440+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0088794a0 con 0x55c009725400 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.440+0000 7f064604d640 1 -- 172.21.15.137:0/2274863935 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c008872820 con 0x55c009725400 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.440+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0088792c0 con 0x55c009725400 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.440+0000 7f064e41a740 4 datascan.init: resolving metadata pool 12 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064604d640 1 -- 172.21.15.137:0/2274863935 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55c009634c00 con 0x55c009725400 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064604d640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c009633000 0x55c00962c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064604d640 1 -- 172.21.15.137:0/2274863935 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x55c009660600 con 0x55c009725400 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064e41a740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064e41a740 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064e41a740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c009633400 0x55c00962c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064c059640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c009633000 0x55c00962c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.451 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c009633800 con 0x55c009633400 2024-04-26T22:05:08.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.441+0000 7f064b858640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c009633400 0x55c00962c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.442+0000 7f064c059640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c009633000 0x55c00962c100 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55c0095f3290 tx=0x55c0097451a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.442+0000 7f064b858640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c009633400 0x55c00962c680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.442+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== osd_op_reply(1 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.442+0000 7f064704f640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55c009724800 0x55c008bec000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.442+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:2 13.20 13:04000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c009632c00 con 0x55c009724800 2024-04-26T22:05:08.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.443+0000 7f064c85a640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55c009724800 0x55c008bec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.452 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.443+0000 7f064c85a640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55c009724800 0x55c008bec000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.445+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(2 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.445+0000 7f0647850640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c009632400 0x55c008bec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.445+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:3 13.10 13:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c009632000 con 0x55c009632400 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.445+0000 7f064c059640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c009632400 0x55c008bec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.446+0000 7f064c059640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c009632400 0x55c008bec580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.447+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(3 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c009632400 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.447+0000 7f064704f640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c009632800 0x55c008becb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.448+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:4 13.30 13:0c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5ec00 con 0x55c009632800 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.448+0000 7f064b858640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c009632800 0x55c008becb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.448+0000 7f064b858640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c009632800 0x55c008becb00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.448+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(4 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.456 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.448+0000 7f0647850640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55c009633800 0x55c008bed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.448+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:5 13.8 13:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5f800 con 0x55c009633800 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.449+0000 7f064c85a640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55c009633800 0x55c008bed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.449+0000 7f064c85a640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55c009633800 0x55c008bed600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.449+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== osd_op_reply(5 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009633800 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.449+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:6 13.28 13:14000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5f000 con 0x55c009633800 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.449+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.2 v2:172.21.15.137:6816/1304816807 2 ==== osd_op_reply(6 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009633800 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.449+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:7 13.18 13:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5fc00 con 0x55c009633400 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.450+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 2 ==== osd_op_reply(7 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.450+0000 7f064704f640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55c008b5f400 0x55c008bed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.450+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:8 13.38 13:1c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe000 con 0x55c008b5f400 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.450+0000 7f064c059640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55c008b5f400 0x55c008bed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.450+0000 7f064c059640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55c008b5f400 0x55c008bed080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.453+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(8 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c008b5f400 2024-04-26T22:05:08.457 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.453+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:9 13.4 13:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bff000 con 0x55c009724800 2024-04-26T22:05:08.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.453+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 2 ==== osd_op_reply(9 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.453+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:10 13.24 13:24000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe400 con 0x55c009724800 2024-04-26T22:05:08.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.453+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 3 ==== osd_op_reply(10 [pgnls start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.453+0000 7f0647850640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55c008bff400 0x55c008bedb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.453+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:11 13.14 13:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bff800 con 0x55c008bff400 2024-04-26T22:05:08.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.454+0000 7f064b858640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55c008bff400 0x55c008bedb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.454+0000 7f064b858640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55c008bff400 0x55c008bedb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.458+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(11 [pgnls start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c008bff400 2024-04-26T22:05:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.458+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:12 13.34 13:2c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe800 con 0x55c009724800 2024-04-26T22:05:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.458+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 4 ==== osd_op_reply(12 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.458+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:13 13.c 13:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bffc00 con 0x55c009632400 2024-04-26T22:05:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.459+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.1 v2:172.21.15.137:6800/757189714 2 ==== osd_op_reply(13 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c009632400 2024-04-26T22:05:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.459+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:14 13.2c 13:34000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfec00 con 0x55c009633800 2024-04-26T22:05:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.459+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.2 v2:172.21.15.137:6816/1304816807 3 ==== osd_op_reply(14 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009633800 2024-04-26T22:05:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.459+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:15 13.1c 13:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5e800 con 0x55c009724800 2024-04-26T22:05:08.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.459+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 5 ==== osd_op_reply(15 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.459+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:16 13.3c 13:3c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe000 con 0x55c009633800 2024-04-26T22:05:08.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.460+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.2 v2:172.21.15.137:6816/1304816807 4 ==== osd_op_reply(16 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009633800 2024-04-26T22:05:08.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.460+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:17 13.2 13:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5f800 con 0x55c008b5f400 2024-04-26T22:05:08.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.460+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== osd_op_reply(17 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c008b5f400 2024-04-26T22:05:08.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.460+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:18 13.22 13:44000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bffc00 con 0x55c009632400 2024-04-26T22:05:08.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.460+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.1 v2:172.21.15.137:6800/757189714 3 ==== osd_op_reply(18 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c009632400 2024-04-26T22:05:08.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.460+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:19 13.12 13:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c009632000 con 0x55c008bff400 2024-04-26T22:05:08.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.461+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.0 v2:172.21.15.137:6820/109358669 2 ==== osd_op_reply(19 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c008bff400 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.461+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:20 13.32 13:4c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bff000 con 0x55c009633800 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.461+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.2 v2:172.21.15.137:6816/1304816807 5 ==== osd_op_reply(20 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009633800 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.461+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:21 13.a 13:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c009632c00 con 0x55c009633800 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.461+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.2 v2:172.21.15.137:6816/1304816807 6 ==== osd_op_reply(21 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009633800 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.461+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:22 13.2a 13:54000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5f000 con 0x55c009632400 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.461+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.1 v2:172.21.15.137:6800/757189714 4 ==== osd_op_reply(22 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c009632400 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.461+0000 7f0647850640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55c009647400 0x55c008bee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.461+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:23 13.1a 13:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe400 con 0x55c009647400 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.462+0000 7f064c85a640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55c009647400 0x55c008bee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.462+0000 7f064c85a640 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55c009647400 0x55c008bee100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.464+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(23 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009647400 2024-04-26T22:05:08.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.464+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:24 13.3a 13:5c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c14000 con 0x55c008b5f400 2024-04-26T22:05:08.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.464+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.5 v2:172.21.15.170:6808/205812566 3 ==== osd_op_reply(24 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c008b5f400 2024-04-26T22:05:08.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.464+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:25 13.6 13:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe800 con 0x55c009632800 2024-04-26T22:05:08.464 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.465+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== osd_op_reply(25 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.465+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:26 13.26 13:64000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c14400 con 0x55c009633400 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.465+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 3 ==== osd_op_reply(26 [pgnls start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.465+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:27 13.16 13:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfec00 con 0x55c009647400 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.465+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.3 v2:172.21.15.137:6808/492121506 2 ==== osd_op_reply(27 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009647400 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.465+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:28 13.36 13:6c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c14800 con 0x55c009724800 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.466+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 6 ==== osd_op_reply(28 [pgnls start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.466+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:29 13.e 13:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe000 con 0x55c009633400 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.466+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 4 ==== osd_op_reply(29 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.466+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:30 13.2e 13:74000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c14c00 con 0x55c009633800 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.466+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.2 v2:172.21.15.137:6816/1304816807 7 ==== osd_op_reply(30 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009633800 2024-04-26T22:05:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.466+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:31 13.1e 13:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bff000 con 0x55c009632800 2024-04-26T22:05:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.467+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 3 ==== osd_op_reply(31 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.467+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:32 13.3e 13:7c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c15000 con 0x55c009632400 2024-04-26T22:05:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.467+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.1 v2:172.21.15.137:6800/757189714 5 ==== osd_op_reply(32 [pgnls start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c009632400 2024-04-26T22:05:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.467+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:33 13.1 13:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5e800 con 0x55c009724800 2024-04-26T22:05:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.467+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 7 ==== osd_op_reply(33 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.467+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:34 13.21 13:84000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c15400 con 0x55c009632800 2024-04-26T22:05:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.468+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 4 ==== osd_op_reply(34 [pgnls start_epoch 91 out=49b] v89'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.468+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:35 13.11 13:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bffc00 con 0x55c009632400 2024-04-26T22:05:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.468+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.1 v2:172.21.15.137:6800/757189714 6 ==== osd_op_reply(35 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c009632400 2024-04-26T22:05:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.468+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:36 13.31 13:8c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c14000 con 0x55c009647400 2024-04-26T22:05:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.468+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.3 v2:172.21.15.137:6808/492121506 3 ==== osd_op_reply(36 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009647400 2024-04-26T22:05:08.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.468+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:37 13.9 13:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bff800 con 0x55c008b5f400 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.469+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.5 v2:172.21.15.170:6808/205812566 4 ==== osd_op_reply(37 [pgnls start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c008b5f400 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.469+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:38 13.29 13:94000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c15000 con 0x55c009724800 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.469+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 8 ==== osd_op_reply(38 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.469+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:39 13.19 13:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c009632000 con 0x55c009647400 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.469+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.3 v2:172.21.15.137:6808/492121506 4 ==== osd_op_reply(39 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009647400 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.469+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:40 13.39 13:9c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c14400 con 0x55c009633800 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.469+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.2 v2:172.21.15.137:6816/1304816807 8 ==== osd_op_reply(40 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009633800 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.470+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:41 13.5 13:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5f800 con 0x55c009632800 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.470+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 5 ==== osd_op_reply(41 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.470+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:42 13.25 13:a4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c15800 con 0x55c009632800 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.470+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 6 ==== osd_op_reply(42 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.470+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:43 13.15 13:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5f000 con 0x55c009632800 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.470+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 7 ==== osd_op_reply(43 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.471+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:44 13.35 13:ac000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c15c00 con 0x55c009632400 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.471+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.1 v2:172.21.15.137:6800/757189714 7 ==== osd_op_reply(44 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c009632400 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.471+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:45 13.d 13:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5ec00 con 0x55c009632800 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.471+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 8 ==== osd_op_reply(45 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.471+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:46 13.2d 13:b4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe800 con 0x55c008bff400 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.471+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.0 v2:172.21.15.137:6820/109358669 3 ==== osd_op_reply(46 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c008bff400 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.471+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:47 13.1d 13:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5fc00 con 0x55c009633400 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.472+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 5 ==== osd_op_reply(47 [pgnls start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.472+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:48 13.3d 13:bc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe000 con 0x55c009633400 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.472+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 6 ==== osd_op_reply(48 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.472+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:49 13.3 13:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5f800 con 0x55c008bff400 2024-04-26T22:05:08.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.472+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.0 v2:172.21.15.137:6820/109358669 4 ==== osd_op_reply(49 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c008bff400 2024-04-26T22:05:08.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.472+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:50 13.23 13:c4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c15400 con 0x55c009632400 2024-04-26T22:05:08.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.473+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.1 v2:172.21.15.137:6800/757189714 8 ==== osd_op_reply(50 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c009632400 2024-04-26T22:05:08.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.473+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:51 13.13 13:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5f000 con 0x55c009633400 2024-04-26T22:05:08.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.473+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 7 ==== osd_op_reply(51 [pgnls start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.473+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:52 13.33 13:cc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c15800 con 0x55c009633400 2024-04-26T22:05:08.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.473+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 8 ==== osd_op_reply(52 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.473+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:53 13.b 13:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5ec00 con 0x55c008b5f400 2024-04-26T22:05:08.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.474+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.5 v2:172.21.15.170:6808/205812566 5 ==== osd_op_reply(53 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c008b5f400 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.474+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:54 13.2b 13:d4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c14800 con 0x55c009633800 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.474+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.2 v2:172.21.15.137:6816/1304816807 9 ==== osd_op_reply(54 [pgnls start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009633800 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.474+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:55 13.1b 13:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bff000 con 0x55c009632800 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.474+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 9 ==== osd_op_reply(55 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.474+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:56 13.3b 13:dc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c14c00 con 0x55c009632800 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.475+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 10 ==== osd_op_reply(56 [pgnls start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.475+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:57 13.7 13:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe800 con 0x55c009633400 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.475+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 9 ==== osd_op_reply(57 [pgnls start_epoch 91 out=81b] v89'6 uv6 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.475+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:58 13.7 13:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55c009633c00 con 0x55c009633400 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.475+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 10 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.475+0000 7f064e41a740 10 datascan.operator(): handling object 1099511627777.0 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.475+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:59 13.7 13:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55c008c1e000 con 0x55c009633400 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.477+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.7 v2:172.21.15.170:6816/3085321649 11 ==== osd_op_reply(59 10000000001.00000000 [call] v91'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55c0095d8000 con 0x55c009633400 2024-04-26T22:05:08.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.477+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:60 13.27 13:e4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c1e400 con 0x55c009632400 2024-04-26T22:05:08.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.477+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.1 v2:172.21.15.137:6800/757189714 9 ==== osd_op_reply(60 [pgnls start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c009632400 2024-04-26T22:05:08.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.477+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:61 13.17 13:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfe400 con 0x55c008b5f400 2024-04-26T22:05:08.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.477+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.5 v2:172.21.15.170:6808/205812566 6 ==== osd_op_reply(61 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c008b5f400 2024-04-26T22:05:08.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.477+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:62 13.37 13:ec000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008c14000 con 0x55c008b5f400 2024-04-26T22:05:08.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.478+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 <== osd.5 v2:172.21.15.170:6808/205812566 7 ==== osd_op_reply(62 [pgnls start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8780 con 0x55c008b5f400 2024-04-26T22:05:08.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.478+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:63 13.f 13:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008bfec00 con 0x55c009724800 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.478+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 9 ==== osd_op_reply(63 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.478+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:64 13.2f 13:f4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5fc00 con 0x55c009632800 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.478+0000 7f064b858640 1 -- 172.21.15.137:0/2274863935 <== osd.4 v2:172.21.15.170:6824/2080414701 11 ==== osd_op_reply(64 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8000 con 0x55c009632800 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.478+0000 7f0647850640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:65 13.1f 13:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c009632c00 con 0x55c009724800 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 10 ==== osd_op_reply(65 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064704f640 1 -- 172.21.15.137:0/2274863935 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:66 13.3f 13:fc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55c008b5e800 con 0x55c009724800 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064c85a640 1 -- 172.21.15.137:0/2274863935 <== osd.6 v2:172.21.15.170:6800/3855301024 11 ==== osd_op_reply(66 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55c0095d8500 con 0x55c009724800 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55c008bff400 msgr2=0x55c008bedb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55c008bff400 0x55c008bedb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c009632400 msgr2=0x55c008bec580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c009632400 0x55c008bec580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55c009633800 msgr2=0x55c008bed600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55c009633800 0x55c008bed600 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55c009647400 msgr2=0x55c008bee100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55c009647400 0x55c008bee100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c009632800 msgr2=0x55c008becb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c009632800 0x55c008becb00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 reap_dead start 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55c008b5f400 msgr2=0x55c008bed080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55c008b5f400 0x55c008bed080 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064c059640 1 -- 172.21.15.137:0/2274863935 reap_dead start 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55c009724800 msgr2=0x55c008bec000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55c009724800 0x55c008bec000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c009633400 msgr2=0x55c00962c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c009633400 0x55c00962c680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c009633000 msgr2=0x55c00962c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c009633000 0x55c00962c100 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55c0095f3290 tx=0x55c0097451a0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725400 msgr2=0x55c00962b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725400 0x55c00962b080 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x55c009679410 tx=0x55c0095f4240 comp rx=0 tx=0).stop 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 shutdown_connections 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55c009724800 0x55c008bec000 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c009633000 0x55c00962c100 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c009633400 0x55c00962c680 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 --2- 172.21.15.137:0/2274863935 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c009725400 0x55c00962b080 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 >> 172.21.15.137:0/2274863935 conn(0x55c009725000 msgr2=0x55c00893d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 shutdown_connections 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.479+0000 7f064e41a740 1 -- 172.21.15.137:0/2274863935 wait complete. 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.480+0000 7f064e41a740 1 -- 172.21.15.137:0/686577041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c00884d800 msgr2=0x55c00962a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.480+0000 7f064e41a740 1 --2- 172.21.15.137:0/686577041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c00884d800 0x55c00962a580 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x55c009679f80 tx=0x55c0095f4300 comp rx=0 tx=0).stop 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.480+0000 7f064e41a740 1 -- 172.21.15.137:0/686577041 shutdown_connections 2024-04-26T22:05:08.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.480+0000 7f064e41a740 1 --2- 172.21.15.137:0/686577041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c00884d800 0x55c00962a580 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.480+0000 7f064e41a740 1 --2- 172.21.15.137:0/686577041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c00884dc00 0x55c00962ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.480+0000 7f064e41a740 1 --2- 172.21.15.137:0/686577041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00884cc00 0x55c00962a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.480+0000 7f064e41a740 1 -- 172.21.15.137:0/686577041 >> 172.21.15.137:0/686577041 conn(0x55c00884d000 msgr2=0x55c00893c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.480+0000 7f064e41a740 1 -- 172.21.15.137:0/686577041 shutdown_connections 2024-04-26T22:05:08.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.480+0000 7f064e41a740 1 -- 172.21.15.137:0/686577041 wait complete. 2024-04-26T22:05:08.485 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.090094, result: 2024-04-26T22:05:08.486 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-04-26T22:05:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.565+0000 7f3789c11740 1 -- start start 2024-04-26T22:05:08.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.565+0000 7f3789c11740 1 Processor -- start 2024-04-26T22:05:08.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3789c11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df35278800 0x55df35252b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3789c11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df35279c00 0x55df35253b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3789c11740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df35279400 0x55df35253080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3789c11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df3527e480 con 0x55df35278800 2024-04-26T22:05:08.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3789c11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55df3527e600 con 0x55df35279c00 2024-04-26T22:05:08.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3789c11740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55df3527e780 con 0x55df35279400 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378796c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df35278800 0x55df35252b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378796c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df35278800 0x55df35252b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41132/0 (socket says 172.21.15.137:41132) 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378796c640 1 -- 172.21.15.137:0/2752493859 learned_addr learned my addr 172.21.15.137:0/2752493859 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378716b640 1 --2- 172.21.15.137:0/2752493859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df35279c00 0x55df35253b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378816d640 1 --2- 172.21.15.137:0/2752493859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df35279400 0x55df35253080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378796c640 1 -- 172.21.15.137:0/2752493859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df35279400 msgr2=0x55df35253080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378796c640 1 --2- 172.21.15.137:0/2752493859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df35279400 0x55df35253080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378796c640 1 -- 172.21.15.137:0/2752493859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df35279c00 msgr2=0x55df35253b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378796c640 1 --2- 172.21.15.137:0/2752493859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df35279c00 0x55df35253b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378796c640 1 -- 172.21.15.137:0/2752493859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3449f680 con 0x55df35278800 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f378796c640 1 --2- 172.21.15.137:0/2752493859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df35278800 0x55df35252b00 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x55df352adb30 tx=0x55df3521a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d28abc01dd151 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3785167640 1 -- 172.21.15.137:0/2752493859 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55df34498d00 con 0x55df35278800 2024-04-26T22:05:08.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3785167640 1 -- 172.21.15.137:0/2752493859 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55df344ba1c0 con 0x55df35278800 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3785167640 1 -- 172.21.15.137:0/2752493859 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55df34498680 con 0x55df35278800 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3789c11740 1 -- 172.21.15.137:0/2752493859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3449f2c0 con 0x55df35278800 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3789c11740 1 -- 172.21.15.137:0/2752493859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55df3449eb40 con 0x55df35278800 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3789c11740 4 waiting for MDS map... 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.566+0000 7f3785167640 1 -- 172.21.15.137:0/2752493859 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x55df35298400 con 0x55df35278800 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.567+0000 7f3785167640 1 -- 172.21.15.137:0/2752493859 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 55) ==== 2885+0+0 (secure 0 0 0) 0x55df344cb180 con 0x55df35278800 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.567+0000 7f3789c11740 4 Got MDS map 55 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.567+0000 7f3789c11740 4 datascan.main: Using metadata pool output 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.567+0000 7f3789c11740 4 datascan.main: connecting to RADOS... 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.567+0000 7f3789c11740 1 Processor -- start 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.567+0000 7f3789c11740 1 -- start start 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f3789c11740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df3535b000 0x55df35252580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f3789c11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 0x55df35254100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f3789c11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b800 0x55df35254680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f3789c11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df344d2180 con 0x55df3535b800 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f3789c11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55df3527ef00 con 0x55df3535b400 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f3789c11740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55df3527f080 con 0x55df3535b000 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378716b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b800 0x55df35254680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378716b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b800 0x55df35254680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41142/0 (socket says 172.21.15.137:41142) 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378716b640 1 -- 172.21.15.137:0/3989781558 learned_addr learned my addr 172.21.15.137:0/3989781558 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378796c640 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 0x55df35254100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378816d640 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df3535b000 0x55df35252580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378716b640 1 -- 172.21.15.137:0/3989781558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df3535b000 msgr2=0x55df35252580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378716b640 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df3535b000 0x55df35252580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378716b640 1 -- 172.21.15.137:0/3989781558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 msgr2=0x55df35254100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378716b640 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 0x55df35254100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378716b640 1 -- 172.21.15.137:0/3989781558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3449e3c0 con 0x55df3535b800 2024-04-26T22:05:08.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378796c640 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 0x55df35254100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f378716b640 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b800 0x55df35254680 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x55df3536f140 tx=0x55df35372c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feea57911a909c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f3783163640 1 -- 172.21.15.137:0/3989781558 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55df34498d00 con 0x55df3535b800 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f3783163640 1 -- 172.21.15.137:0/3989781558 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55df344bac40 con 0x55df3535b800 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.568+0000 7f3783163640 1 -- 172.21.15.137:0/3989781558 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55df34498680 con 0x55df3535b800 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 -- 172.21.15.137:0/3989781558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b800 msgr2=0x55df35254680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b800 0x55df35254680 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x55df3536f140 tx=0x55df35372c00 comp rx=0 tx=0).stop 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 -- 172.21.15.137:0/3989781558 shutdown_connections 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b800 0x55df35254680 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 0x55df35254100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 --2- 172.21.15.137:0/3989781558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df3535b000 0x55df35252580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 -- 172.21.15.137:0/3989781558 >> 172.21.15.137:0/3989781558 conn(0x55df35279800 msgr2=0x55df3456f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 -- 172.21.15.137:0/3989781558 shutdown_connections 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 -- 172.21.15.137:0/3989781558 wait complete. 2024-04-26T22:05:08.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 Processor -- start 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.569+0000 7f3789c11740 1 -- start start 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f3789c11740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b000 0x55df35252580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f3789c11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 0x55df35254100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f3789c11740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df3535b800 0x55df35254680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f3789c11740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55df3527f380 con 0x55df3535b000 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f3789c11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55df3527f200 con 0x55df3535b400 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f3789c11740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55df3527f500 con 0x55df3535b800 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378816d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b000 0x55df35252580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378816d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b000 0x55df35252580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41148/0 (socket says 172.21.15.137:41148) 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 learned_addr learned my addr 172.21.15.137:0/2858632295 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378716b640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df3535b800 0x55df35254680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378796c640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 0x55df35254100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df3535b800 msgr2=0x55df35254680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378816d640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df3535b800 0x55df35254680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 msgr2=0x55df35254100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378816d640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df3535b400 0x55df35254100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.570+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3449f860 con 0x55df3535b000 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.571+0000 7f378816d640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b000 0x55df35252580 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x55df352182a0 tx=0x55df35216c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.571+0000 7f3781960640 1 -- 172.21.15.137:0/2858632295 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55df34498b60 con 0x55df3535b000 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.571+0000 7f3781960640 1 -- 172.21.15.137:0/2858632295 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55df344baa80 con 0x55df3535b000 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.571+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df3449f0e0 con 0x55df3535b000 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.571+0000 7f3781960640 1 -- 172.21.15.137:0/2858632295 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55df34498d00 con 0x55df3535b000 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.571+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3449f680 con 0x55df3535b000 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.571+0000 7f3789c11740 4 datascan.init: resolving metadata pool 12 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.572+0000 7f3781960640 1 -- 172.21.15.137:0/2858632295 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55df353c4c00 con 0x55df3535b000 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.572+0000 7f3781960640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55df353c0c00 0x55df35255700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.572+0000 7f3781960640 1 -- 172.21.15.137:0/2858632295 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x55df353c2e00 con 0x55df3535b000 2024-04-26T22:05:08.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.572+0000 7f3789c11740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.572+0000 7f3789c11740 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.572+0000 7f3789c11740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.572+0000 7f378796c640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55df353c0c00 0x55df35255700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.572+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55df3535bc00 0x55df35254c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.572+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55df353c1000 con 0x55df3535bc00 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.573+0000 7f378716b640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55df3535bc00 0x55df35254c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.573+0000 7f378796c640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55df353c0c00 0x55df35255700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55df3536eea0 tx=0x55df352168a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.573+0000 7f378716b640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55df3535bc00 0x55df35254c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.573+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv24 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.573+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55df353c1400 0x55df35255180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.573+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:2 12.1f 12:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55df353c1800 con 0x55df353c1400 2024-04-26T22:05:08.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.573+0000 7f378816d640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55df353c1400 0x55df35255180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.574+0000 7f378816d640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55df353c1400 0x55df35255180 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.574+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.574+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55df353c1c00 0x55df34816000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.574+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:3 13.0 13:00000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34789000 con 0x55df353c1c00 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.574+0000 7f378796c640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55df353c1c00 0x55df34816000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.575+0000 7f378796c640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55df353c1c00 0x55df34816000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.575+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.575+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:4 13.20 13:04000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34789c00 con 0x55df353c1400 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.575+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.575+0000 7f3783163640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55df34824000 0x55df34817b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.575+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:5 13.10 13:08000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34824400 con 0x55df34824000 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.576+0000 7f378716b640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55df34824000 0x55df34817b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.576+0000 7f378716b640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55df34824000 0x55df34817b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.576+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.576+0000 7f3782962640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55df34824c00 0x55df34818100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.576+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:6 13.30 13:0c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825000 con 0x55df34824c00 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.576+0000 7f378816d640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55df34824c00 0x55df34818100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.577+0000 7f378816d640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55df34824c00 0x55df34818100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.577+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.577+0000 7f3783163640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55df34824800 0x55df34818680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.577+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:7 13.8 13:10000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825400 con 0x55df34824800 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.577+0000 7f378796c640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55df34824800 0x55df34818680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.577+0000 7f378796c640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55df34824800 0x55df34818680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.578+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.578+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:8 13.28 13:14000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834000 con 0x55df34824800 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.578+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.578+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:9 13.18 13:18000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825800 con 0x55df353c1c00 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.578+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.578+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:10 13.38 13:1c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834400 con 0x55df3535bc00 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.578+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.578+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:11 13.4 13:20000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825c00 con 0x55df353c1400 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.579+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 3 ==== osd_op_reply(11 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.579+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:12 13.24 13:24000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834800 con 0x55df353c1400 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.579+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 4 ==== osd_op_reply(12 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.579+0000 7f3783163640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55df34788c00 0x55df34818c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.579+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:13 13.14 13:28000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788800 con 0x55df34788c00 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.579+0000 7f378716b640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55df34788c00 0x55df34818c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.579+0000 7f378716b640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55df34788c00 0x55df34818c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.580+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.580+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:14 13.34 13:2c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834000 con 0x55df353c1400 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.580+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.580+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:15 13.c 13:30000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788400 con 0x55df34824000 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.580+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 2 ==== osd_op_reply(15 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.580+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:16 13.2c 13:34000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834c00 con 0x55df34824800 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.580+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.581+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:17 13.1c 13:38000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34789000 con 0x55df353c1400 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.581+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.581+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:18 13.3c 13:3c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835000 con 0x55df34824800 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.581+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 4 ==== osd_op_reply(18 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.581+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:19 13.2 13:40000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834800 con 0x55df3535bc00 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.581+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.581+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:20 13.22 13:44000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825400 con 0x55df34824000 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.582+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.582+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:21 13.12 13:48000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825000 con 0x55df34788c00 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.582+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.582+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:22 13.32 13:4c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834400 con 0x55df34824800 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.582+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.582+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:23 13.a 13:50000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825c00 con 0x55df34824800 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.582+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 6 ==== osd_op_reply(23 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.582+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:24 13.2a 13:54000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834800 con 0x55df34824000 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.583+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.583+0000 7f3783163640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55df34789c00 0x55df34819180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.583+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:25 13.1a 13:58000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df353c1800 con 0x55df34789c00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.583+0000 7f378816d640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55df34789c00 0x55df34819180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.583+0000 7f378816d640 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55df34789c00 0x55df34819180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.583+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(25 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34789c00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.583+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:26 13.3a 13:5c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788800 con 0x55df3535bc00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.584+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 4 ==== osd_op_reply(26 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.584+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:27 13.6 13:60000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834000 con 0x55df34824c00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.584+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== osd_op_reply(27 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.584+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:28 13.26 13:64000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788400 con 0x55df353c1c00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.584+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.584+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:29 13.16 13:68000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835400 con 0x55df34789c00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.584+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.3 v2:172.21.15.137:6808/492121506 2 ==== osd_op_reply(29 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34789c00 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.584+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:30 13.36 13:6c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34824400 con 0x55df353c1400 2024-04-26T22:05:08.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.585+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 7 ==== osd_op_reply(30 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.585+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:31 13.e 13:70000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835800 con 0x55df353c1c00 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.585+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 4 ==== osd_op_reply(31 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.585+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:32 13.2e 13:74000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834c00 con 0x55df34824800 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.585+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 7 ==== osd_op_reply(32 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.585+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:33 13.1e 13:78000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835c00 con 0x55df34824c00 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.585+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 3 ==== osd_op_reply(33 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.586+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:34 13.3e 13:7c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835000 con 0x55df34824000 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.586+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 5 ==== osd_op_reply(34 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.586+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:35 13.1 13:80000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835800 con 0x55df353c1400 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.586+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 8 ==== osd_op_reply(35 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.586+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:36 13.21 13:84000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834400 con 0x55df34824c00 2024-04-26T22:05:08.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.586+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 91 out=49b] v89'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.586+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:37 13.11 13:88000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834000 con 0x55df34824000 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.587+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 6 ==== osd_op_reply(37 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.587+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:38 13.31 13:8c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788400 con 0x55df34789c00 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.587+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.3 v2:172.21.15.137:6808/492121506 3 ==== osd_op_reply(38 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34789c00 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.587+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:39 13.9 13:90000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835400 con 0x55df3535bc00 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.587+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.587+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:40 13.29 13:94000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825800 con 0x55df353c1400 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.587+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 9 ==== osd_op_reply(40 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.588+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:41 13.19 13:98000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835c00 con 0x55df34789c00 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.588+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.3 v2:172.21.15.137:6808/492121506 4 ==== osd_op_reply(41 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34789c00 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.588+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:42 13.39 13:9c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825c00 con 0x55df34824800 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.588+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 8 ==== osd_op_reply(42 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.588+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:43 13.5 13:a0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835800 con 0x55df34824c00 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.588+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 5 ==== osd_op_reply(43 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.588+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:44 13.25 13:a4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834800 con 0x55df34824c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 6 ==== osd_op_reply(44 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:45 13.15 13:a8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34824400 con 0x55df34824c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 7 ==== osd_op_reply(45 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:46 13.35 13:ac000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835000 con 0x55df34824000 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 7 ==== osd_op_reply(46 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:47 13.d 13:b0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df353c1800 con 0x55df34824c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 8 ==== osd_op_reply(47 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:48 13.2d 13:b4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834000 con 0x55df34788c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 3 ==== osd_op_reply(48 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.589+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:49 13.1d 13:b8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34789000 con 0x55df353c1c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.590+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.590+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:50 13.3d 13:bc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788800 con 0x55df353c1c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.590+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 6 ==== osd_op_reply(50 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.590+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:51 13.3 13:c0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df353c1800 con 0x55df34788c00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.591+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 4 ==== osd_op_reply(51 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.591+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:52 13.23 13:c4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825400 con 0x55df34824000 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.591+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 8 ==== osd_op_reply(52 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.591+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:53 13.13 13:c8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825800 con 0x55df353c1c00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.591+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 7 ==== osd_op_reply(53 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.591+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:54 13.33 13:cc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825000 con 0x55df353c1c00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.591+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.591+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:55 13.b 13:d0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34824400 con 0x55df3535bc00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.592+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 6 ==== osd_op_reply(55 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.592+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:56 13.2b 13:d4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846000 con 0x55df34824800 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.592+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 9 ==== osd_op_reply(56 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.592+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:57 13.1b 13:d8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834400 con 0x55df34824c00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.592+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 9 ==== osd_op_reply(57 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.592+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:58 13.3b 13:dc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846400 con 0x55df34824c00 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.593+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 10 ==== osd_op_reply(58 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.593+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:59 13.7 13:e0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835c00 con 0x55df353c1c00 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.593+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 9 ==== osd_op_reply(59 [pgnls-filter start_epoch 91 out=81b] v91'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.593+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:60 13.0 13:00000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34789400 con 0x55df353c1c00 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.594+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 10 ==== osd_op_reply(60 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.594+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:61 13.20 13:04000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835800 con 0x55df353c1400 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.594+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 10 ==== osd_op_reply(61 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.594+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:62 13.10 13:08000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846800 con 0x55df34824000 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.595+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 9 ==== osd_op_reply(62 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.595+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:63 13.30 13:0c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834800 con 0x55df34824c00 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.595+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 11 ==== osd_op_reply(63 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.595+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:64 13.8 13:10000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846c00 con 0x55df34824800 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.595+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 10 ==== osd_op_reply(64 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.595+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:65 13.28 13:14000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788400 con 0x55df34824800 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.596+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 11 ==== osd_op_reply(65 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.596+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:66 13.18 13:18000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847000 con 0x55df353c1c00 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.596+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 11 ==== osd_op_reply(66 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.596+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:67 13.38 13:1c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846800 con 0x55df3535bc00 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.596+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 7 ==== osd_op_reply(67 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.596+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:68 13.4 13:20000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847400 con 0x55df353c1400 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.597+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 11 ==== osd_op_reply(68 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.597+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:69 13.24 13:24000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846000 con 0x55df353c1400 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.597+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 12 ==== osd_op_reply(69 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.597+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:70 13.14 13:28000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847800 con 0x55df34788c00 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.597+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 5 ==== osd_op_reply(70 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.597+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:71 13.34 13:2c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825400 con 0x55df353c1400 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.598+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 13 ==== osd_op_reply(71 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.612 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.598+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:72 13.c 13:30000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847c00 con 0x55df34824000 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.598+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 10 ==== osd_op_reply(72 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.598+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:73 13.2c 13:34000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34824400 con 0x55df34824800 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.598+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.598+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:74 13.1c 13:38000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835400 con 0x55df353c1400 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.598+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 14 ==== osd_op_reply(74 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.598+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:75 13.3c 13:3c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825c00 con 0x55df34824800 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.599+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 13 ==== osd_op_reply(75 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.599+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:76 13.2 13:40000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835000 con 0x55df3535bc00 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.599+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.599+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:77 13.22 13:44000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825800 con 0x55df34824000 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.599+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 11 ==== osd_op_reply(77 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.599+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:78 13.12 13:48000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834000 con 0x55df34788c00 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.599+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 6 ==== osd_op_reply(78 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.600+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:79 13.32 13:4c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825000 con 0x55df34824800 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.600+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.600+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:80 13.a 13:50000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34834c00 con 0x55df34824800 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.600+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 15 ==== osd_op_reply(80 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.600+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:81 13.2a 13:54000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34789000 con 0x55df34824000 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.600+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 12 ==== osd_op_reply(81 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.600+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:82 13.1a 13:58000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34835c00 con 0x55df34789c00 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.600+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.3 v2:172.21.15.137:6808/492121506 5 ==== osd_op_reply(82 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34789c00 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.600+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:83 13.3a 13:5c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788800 con 0x55df3535bc00 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.601+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 9 ==== osd_op_reply(83 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.601+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:84 13.6 13:60000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825800 con 0x55df34824c00 2024-04-26T22:05:08.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.601+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 12 ==== osd_op_reply(84 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.601+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:85 13.26 13:64000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df353c1800 con 0x55df353c1c00 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.602+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.602+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:86 13.16 13:68000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825400 con 0x55df34789c00 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.602+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.3 v2:172.21.15.137:6808/492121506 6 ==== osd_op_reply(86 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34789c00 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.602+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:87 13.36 13:6c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df353c1800 con 0x55df353c1400 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.602+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 15 ==== osd_op_reply(87 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.602+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:88 13.e 13:70000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846800 con 0x55df353c1c00 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.603+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.603+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:89 13.2e 13:74000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34824400 con 0x55df34824800 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.603+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.603+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:90 13.1e 13:78000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847800 con 0x55df34824c00 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.603+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 13 ==== osd_op_reply(90 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.603+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:91 13.3e 13:7c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825c00 con 0x55df34824000 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.603+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 13 ==== osd_op_reply(91 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.603+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:92 13.1 13:80000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847c00 con 0x55df353c1400 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.604+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 16 ==== osd_op_reply(92 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.604+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:93 13.21 13:84000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825000 con 0x55df34824c00 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.604+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 14 ==== osd_op_reply(93 [pgnls-filter start_epoch 91 out=49b] v89'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.604+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:94 13.11 13:88000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846400 con 0x55df34824000 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.605+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 14 ==== osd_op_reply(94 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.605+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:95 13.31 13:8c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846c00 con 0x55df34789c00 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.605+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.3 v2:172.21.15.137:6808/492121506 7 ==== osd_op_reply(95 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34789c00 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.605+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:96 13.9 13:90000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847400 con 0x55df3535bc00 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.605+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 10 ==== osd_op_reply(96 [pgnls-filter start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.605+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:97 13.29 13:94000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847000 con 0x55df353c1400 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.605+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 17 ==== osd_op_reply(97 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.605+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:98 13.19 13:98000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846000 con 0x55df34789c00 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.606+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.3 v2:172.21.15.137:6808/492121506 8 ==== osd_op_reply(98 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34789c00 2024-04-26T22:05:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.606+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:99 13.39 13:9c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34789400 con 0x55df34824800 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.606+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 17 ==== osd_op_reply(99 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.606+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:100 13.5 13:a0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34789000 con 0x55df34824c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.606+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 15 ==== osd_op_reply(100 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.606+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:101 13.25 13:a4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788400 con 0x55df34824c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.606+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 16 ==== osd_op_reply(101 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.606+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:102 13.15 13:a8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34788800 con 0x55df34824c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.607+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 17 ==== osd_op_reply(102 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.607+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:103 13.35 13:ac000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34789000 con 0x55df34824000 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.607+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 15 ==== osd_op_reply(103 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.607+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:104 13.d 13:b0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df3484e000 con 0x55df34824c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.607+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 18 ==== osd_op_reply(104 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.607+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:105 13.2d 13:b4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847800 con 0x55df34788c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.607+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 7 ==== osd_op_reply(105 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.607+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:106 13.1d 13:b8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df3484e400 con 0x55df353c1c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.608+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 14 ==== osd_op_reply(106 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.608+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:107 13.3d 13:bc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847c00 con 0x55df353c1c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.608+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 15 ==== osd_op_reply(107 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.608+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:108 13.3 13:c0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df3484e800 con 0x55df34788c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.608+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 8 ==== osd_op_reply(108 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.608+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:109 13.23 13:c4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846c00 con 0x55df34824000 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.608+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 16 ==== osd_op_reply(109 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.608+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:110 13.13 13:c8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df3484ec00 con 0x55df353c1c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.609+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 16 ==== osd_op_reply(110 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.609+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:111 13.33 13:cc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34847000 con 0x55df353c1c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.609+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 17 ==== osd_op_reply(111 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.609+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:112 13.b 13:d0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df3484f000 con 0x55df3535bc00 2024-04-26T22:05:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.610+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 11 ==== osd_op_reply(112 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.610+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:113 13.2b 13:d4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34846000 con 0x55df34824800 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.610+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.2 v2:172.21.15.137:6816/1304816807 18 ==== osd_op_reply(113 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204780 con 0x55df34824800 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.610+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:114 13.1b 13:d8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df3484f400 con 0x55df34824c00 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.610+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 19 ==== osd_op_reply(114 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.610+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:115 13.3b 13:dc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825800 con 0x55df34824c00 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.611+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 20 ==== osd_op_reply(115 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.611+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:116 13.7 13:e0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df3484f800 con 0x55df353c1c00 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.611+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 18 ==== osd_op_reply(116 [pgnls-filter start_epoch 91 out=81b] v91'7 uv7 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.611+0000 7f3789c11740 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.611+0000 7f3789c11740 10 datascan.operator(): handling object 10000000001.0 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.611+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:117 13.7 13:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55df353c0800 con 0x55df353c1c00 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.612+0000 7f378796c640 1 -- 172.21.15.137:0/2858632295 <== osd.7 v2:172.21.15.170:6816/3085321649 19 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) ==== 416+0+157 (crc 0 0 0) 0x55df35204780 con 0x55df353c1c00 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.612+0000 7f3789c11740 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-26T22:05:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.612+0000 7f3789c11740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.612+0000 7f3789c11740 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.612+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:118 12.10 12:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55df353c0000 con 0x55df34788c00 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.612+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 9 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) ==== 164+0+59 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.612+0000 7f3789c11740 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.612+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55df353c0400 con 0x55df353c1400 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 18 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=581b] v0'0 uv9 ondisk = 0) ==== 154+0+581 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 20 datascan.get_frag_of: frag is * 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:120 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55df353c1000 con 0x55df34788c00 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 10 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 10 datascan.find_or_create_dirfrag: read_version = 17 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:121 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x55df3484e800 con 0x55df34788c00 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 11 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 20 datascan.read_dentry: file_head not found in result 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.613+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:122 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x55df3484f000 con 0x55df34788c00 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.614+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.0 v2:172.21.15.137:6820/109358669 12 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v91'18 uv18 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55df35204000 con 0x55df34788c00 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.614+0000 7f3789c11740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.614+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:123 13.27 13:e4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df3484e400 con 0x55df34824000 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.615+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.1 v2:172.21.15.137:6800/757189714 17 ==== osd_op_reply(123 [pgnls-filter start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df34824000 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.615+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:124 13.17 13:e8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df3484fc00 con 0x55df3535bc00 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.615+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 12 ==== osd_op_reply(124 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.615+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:125 13.37 13:ec000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825400 con 0x55df3535bc00 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.615+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 <== osd.5 v2:172.21.15.170:6808/205812566 13 ==== osd_op_reply(125 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204000 con 0x55df3535bc00 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.615+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:126 13.f 13:f0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df353c0000 con 0x55df353c1400 2024-04-26T22:05:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.616+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 19 ==== osd_op_reply(126 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.616+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:127 13.2f 13:f4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df34825000 con 0x55df34824c00 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.616+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.4 v2:172.21.15.170:6824/2080414701 21 ==== osd_op_reply(127 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df34824c00 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.616+0000 7f3782962640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:128 13.1f 13:f8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df353c0800 con 0x55df353c1400 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.616+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 20 ==== osd_op_reply(128 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.616+0000 7f3783163640 1 -- 172.21.15.137:0/2858632295 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:129 13.3f 13:fc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x55df353c1800 con 0x55df353c1400 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f378816d640 1 -- 172.21.15.137:0/2858632295 <== osd.6 v2:172.21.15.170:6800/3855301024 21 ==== osd_op_reply(129 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55df35204500 con 0x55df353c1400 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55df34788c00 msgr2=0x55df34818c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55df34788c00 0x55df34818c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55df34824000 msgr2=0x55df34817b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55df34824000 0x55df34817b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55df34824800 msgr2=0x55df34818680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55df34824800 0x55df34818680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55df34789c00 msgr2=0x55df34819180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55df34789c00 0x55df34819180 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55df34824c00 msgr2=0x55df34818100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.633 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55df34824c00 0x55df34818100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55df3535bc00 msgr2=0x55df35254c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55df3535bc00 0x55df35254c00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55df353c1400 msgr2=0x55df35255180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55df353c1400 0x55df35255180 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55df353c1c00 msgr2=0x55df34816000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55df353c1c00 0x55df34816000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 reap_dead start 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55df353c0c00 msgr2=0x55df35255700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55df353c0c00 0x55df35255700 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x55df3536eea0 tx=0x55df352168a0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 reap_dead start 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b000 msgr2=0x55df35252580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2858632295 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df3535b000 0x55df35252580 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x55df352182a0 tx=0x55df35216c00 comp rx=0 tx=0).stop 2024-04-26T22:05:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f378716b640 1 -- 172.21.15.137:0/2858632295 reap_dead start 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 shutdown_connections 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 >> 172.21.15.137:0/2858632295 conn(0x55df35279800 msgr2=0x55df3456f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 shutdown_connections 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2858632295 wait complete. 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2752493859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df35278800 msgr2=0x55df35252b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2752493859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df35278800 0x55df35252b00 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x55df352adb30 tx=0x55df3521a060 comp rx=0 tx=0).stop 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2752493859 shutdown_connections 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2752493859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55df35279400 0x55df35253080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2752493859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df35279c00 0x55df35253b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 --2- 172.21.15.137:0/2752493859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55df35278800 0x55df35252b00 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2752493859 >> 172.21.15.137:0/2752493859 conn(0x55df34473000 msgr2=0x55df3456f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2752493859 shutdown_connections 2024-04-26T22:05:08.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.617+0000 7f3789c11740 1 -- 172.21.15.137:0/2752493859 wait complete. 2024-04-26T22:05:08.635 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.149745, result: 2024-04-26T22:05:08.636 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-26T22:05:08.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.703+0000 7fbe1f122740 1 -- start start 2024-04-26T22:05:08.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.703+0000 7fbe1f122740 1 Processor -- start 2024-04-26T22:05:08.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1f122740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653efe4ac00 0x5653f0c1a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1f122740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653efe4b800 0x5653f0c1a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1f122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653efe4bc00 0x5653f0c1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1f122740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5653f0c42180 con 0x5653efe4b800 2024-04-26T22:05:08.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1f122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5653efeaa900 con 0x5653efe4bc00 2024-04-26T22:05:08.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1f122740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5653efeaa480 con 0x5653efe4ac00 2024-04-26T22:05:08.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1c814640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653efe4b800 0x5653f0c1a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1c814640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653efe4b800 0x5653f0c1a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41168/0 (socket says 172.21.15.137:41168) 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1c814640 1 -- 172.21.15.137:0/949852128 learned_addr learned my addr 172.21.15.137:0/949852128 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1d015640 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653efe4ac00 0x5653f0c1a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1d816640 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653efe4bc00 0x5653f0c1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1c814640 1 -- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653efe4ac00 msgr2=0x5653f0c1a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1c814640 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653efe4ac00 0x5653f0c1a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1c814640 1 -- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653efe4bc00 msgr2=0x5653f0c1ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1c814640 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653efe4bc00 0x5653f0c1ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1c814640 1 -- 172.21.15.137:0/949852128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653efe77680 con 0x5653efe4b800 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1d816640 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653efe4bc00 0x5653f0c1ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1d015640 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653efe4ac00 0x5653f0c1a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1c814640 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653efe4b800 0x5653f0c1a580 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x5653f0c79f80 tx=0x5653f0bf2120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c762faa748fceb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1a810640 1 -- 172.21.15.137:0/949852128 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5653efe70680 con 0x5653efe4b800 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1a810640 1 -- 172.21.15.137:0/949852128 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5653efe921c0 con 0x5653efe4b800 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1a810640 1 -- 172.21.15.137:0/949852128 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5653efe70b60 con 0x5653efe4b800 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1f122740 1 -- 172.21.15.137:0/949852128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653efe77860 con 0x5653efe4b800 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1f122740 1 -- 172.21.15.137:0/949852128 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5653efe772c0 con 0x5653efe4b800 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.704+0000 7fbe1f122740 4 waiting for MDS map... 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.705+0000 7fbe1a810640 1 -- 172.21.15.137:0/949852128 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x5653f0d20600 con 0x5653efe4b800 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.705+0000 7fbe1a810640 1 -- 172.21.15.137:0/949852128 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 55) ==== 2885+0+0 (secure 0 0 0) 0x5653efea3180 con 0x5653efe4b800 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.705+0000 7fbe1f122740 4 Got MDS map 55 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.705+0000 7fbe1f122740 4 datascan.main: Using metadata pool output 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.705+0000 7fbe1f122740 4 datascan.main: connecting to RADOS... 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.705+0000 7fbe1f122740 1 Processor -- start 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.705+0000 7fbe1f122740 1 -- start start 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1f122740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653f0d23400 0x5653f0c1b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1f122740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23800 0x5653f0c1b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1f122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653f0d23c00 0x5653f0c1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1f122740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5653efeaa180 con 0x5653f0d23800 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1f122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5653f0c42d80 con 0x5653f0d23c00 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1f122740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5653f0c42f00 con 0x5653f0d23400 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d015640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23800 0x5653f0c1b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d015640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23800 0x5653f0c1b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41178/0 (socket says 172.21.15.137:41178) 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d015640 1 -- 172.21.15.137:0/3086044244 learned_addr learned my addr 172.21.15.137:0/3086044244 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d816640 1 --2- 172.21.15.137:0/3086044244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653f0d23400 0x5653f0c1b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1c814640 1 --2- 172.21.15.137:0/3086044244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653f0d23c00 0x5653f0c1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d015640 1 -- 172.21.15.137:0/3086044244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653f0d23400 msgr2=0x5653f0c1b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d015640 1 --2- 172.21.15.137:0/3086044244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653f0d23400 0x5653f0c1b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d015640 1 -- 172.21.15.137:0/3086044244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653f0d23c00 msgr2=0x5653f0c1bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d015640 1 --2- 172.21.15.137:0/3086044244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653f0d23c00 0x5653f0c1bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d015640 1 -- 172.21.15.137:0/3086044244 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653efe774a0 con 0x5653f0d23800 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1d015640 1 --2- 172.21.15.137:0/3086044244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23800 0x5653f0c1b600 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x5653f0c79440 tx=0x5653f0bee6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615a8f59fb8a2a1f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.706+0000 7fbe1880c640 1 -- 172.21.15.137:0/3086044244 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5653efe709c0 con 0x5653f0d23800 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1880c640 1 -- 172.21.15.137:0/3086044244 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5653efe92e00 con 0x5653f0d23800 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1880c640 1 -- 172.21.15.137:0/3086044244 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5653efe70680 con 0x5653f0d23800 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 -- 172.21.15.137:0/3086044244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23800 msgr2=0x5653f0c1b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 --2- 172.21.15.137:0/3086044244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23800 0x5653f0c1b600 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x5653f0c79440 tx=0x5653f0bee6c0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 -- 172.21.15.137:0/3086044244 shutdown_connections 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 --2- 172.21.15.137:0/3086044244 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23800 0x5653f0c1b600 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 --2- 172.21.15.137:0/3086044244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653f0d23c00 0x5653f0c1bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 --2- 172.21.15.137:0/3086044244 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653f0d23400 0x5653f0c1b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 -- 172.21.15.137:0/3086044244 >> 172.21.15.137:0/3086044244 conn(0x5653f0d23000 msgr2=0x5653eff3b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 -- 172.21.15.137:0/3086044244 shutdown_connections 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 -- 172.21.15.137:0/3086044244 wait complete. 2024-04-26T22:05:08.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 Processor -- start 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.707+0000 7fbe1f122740 1 -- start start 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1f122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653f0d23400 0x5653f0c1b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1f122740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653f0d23800 0x5653f0c1b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1f122740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23c00 0x5653f0c1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1f122740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5653f0c43200 con 0x5653f0d23c00 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1f122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5653f0c43080 con 0x5653f0d23400 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1f122740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5653f0c43380 con 0x5653f0d23800 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1c814640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23c00 0x5653f0c1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1c814640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23c00 0x5653f0c1bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41180/0 (socket says 172.21.15.137:41180) 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 learned_addr learned my addr 172.21.15.137:0/2113315450 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653f0d23800 0x5653f0c1b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653f0d23400 0x5653f0c1b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653f0d23800 msgr2=0x5653f0c1b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1c814640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653f0d23800 0x5653f0c1b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653f0d23400 msgr2=0x5653f0c1b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1c814640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653f0d23400 0x5653f0c1b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.708+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653efe77680 con 0x5653f0d23c00 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.709+0000 7fbe1c814640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23c00 0x5653f0c1bb80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x5653f0d29da0 tx=0x5653f0bee9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.709+0000 7fbe17009640 1 -- 172.21.15.137:0/2113315450 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5653efe70820 con 0x5653f0d23c00 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.709+0000 7fbe17009640 1 -- 172.21.15.137:0/2113315450 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5653efe92540 con 0x5653f0d23c00 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.709+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653efe77860 con 0x5653f0d23c00 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.709+0000 7fbe17009640 1 -- 172.21.15.137:0/2113315450 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5653efe709c0 con 0x5653f0d23c00 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.709+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653efe770e0 con 0x5653f0d23c00 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.709+0000 7fbe1f122740 4 datascan.init: resolving metadata pool 12 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.710+0000 7fbe17009640 1 -- 172.21.15.137:0/2113315450 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x5653f0d1cc00 con 0x5653f0d23c00 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.710+0000 7fbe17009640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5653f0c5f000 0x5653f0c1c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.710+0000 7fbe17009640 1 -- 172.21.15.137:0/2113315450 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x5653f0c5c600 con 0x5653f0d23c00 2024-04-26T22:05:08.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.710+0000 7fbe1f122740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.710+0000 7fbe1f122740 4 datascan.main: resolving metadata pool 12 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.710+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5653f0c5f000 0x5653f0c1c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.710+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5653f0c5f400 0x5653f0c1c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.710+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c5f800 con 0x5653f0c5f400 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.711+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5653f0c5f400 0x5653f0c1c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.711+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5653f0c5f000 0x5653f0c1c100 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x5653f0bf1110 tx=0x5653f0d3f0e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.711+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5653f0c5f400 0x5653f0c1c680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.711+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(1 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.711+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5653f0c5f800 0x5653f01e0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.711+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:2 12.10 12:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c27400 con 0x5653f0c5f800 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.711+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5653f0c5f800 0x5653f01e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.712+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5653f0c5f800 0x5653f01e0000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.712+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(2 [pgnls start_epoch 91 out=177b] v91'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.712+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5653f0c27400 0x5653f01e0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.712+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:3 12.8 12:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015e800 con 0x5653f0c27400 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.712+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5653f0c27400 0x5653f01e0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.712+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5653f0c27400 0x5653f01e0580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.713+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(3 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c27400 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.713+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5653f015e800 0x5653f01e0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.713+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:4 12.18 12:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c27000 con 0x5653f015e800 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.713+0000 7fbe1c814640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5653f015e800 0x5653f01e0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.713+0000 7fbe1c814640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5653f015e800 0x5653f01e0b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.713+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(4 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.713+0000 7fbe1c814640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5653f0c27000 0x5653f01e1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.713+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:5 12.4 12:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c5e800 con 0x5653f0c27000 2024-04-26T22:05:08.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.713+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5653f0c27000 0x5653f01e1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.714+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5653f0c27000 0x5653f01e1600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.714+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(5 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.714+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5653f0c5e800 0x5653f01e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.714+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:6 12.14 12:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015ec00 con 0x5653f0c5e800 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.714+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5653f0c5e800 0x5653f01e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.715+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5653f0c5e800 0x5653f01e1b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.715+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(6 [pgnls start_epoch 91 out=149b] v90'27 uv27 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5e800 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.715+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:7 12.c 12:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015ec00 con 0x5653f0c5f800 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.715+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 2 ==== osd_op_reply(7 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.715+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:8 12.1c 12:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015ec00 con 0x5653f0c5f800 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.715+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 3 ==== osd_op_reply(8 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.715+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:9 12.2 12:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015ec00 con 0x5653f0c5f400 2024-04-26T22:05:08.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.716+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== osd_op_reply(9 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.716+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:10 12.12 12:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015ec00 con 0x5653f0c27400 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.716+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.3 v2:172.21.15.137:6808/492121506 2 ==== osd_op_reply(10 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c27400 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.716+0000 7fbe1d015640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5653f015ec00 0x5653f01e1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.716+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:11 12.a 12:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f015ec00 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.716+0000 7fbe1c814640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5653f015ec00 0x5653f01e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.716+0000 7fbe1c814640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5653f015ec00 0x5653f01e1080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.716+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== osd_op_reply(11 [pgnls start_epoch 91 out=81b] v90'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015ec00 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.716+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:12 12.1a 12:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f0c5f400 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.717+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 3 ==== osd_op_reply(12 [pgnls start_epoch 91 out=49b] v90'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.717+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:13 12.6 12:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f015e800 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.717+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 2 ==== osd_op_reply(13 [pgnls start_epoch 91 out=77b] v90'6 uv6 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.717+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:14 12.16 12:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f0c27000 2024-04-26T22:05:08.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.717+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 2 ==== osd_op_reply(14 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.717+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:15 12.e 12:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f0c5f800 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.718+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 4 ==== osd_op_reply(15 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.718+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:16 12.1e 12:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f0c5f400 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.718+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 4 ==== osd_op_reply(16 [pgnls start_epoch 91 out=49b] v90'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.718+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:17 12.1 12:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f0c27000 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.718+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 3 ==== osd_op_reply(17 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.718+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:18 12.11 12:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f0c5e800 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.719+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== osd_op_reply(18 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5e800 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.719+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:19 12.9 12:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f015ec00 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.719+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.2 v2:172.21.15.137:6816/1304816807 2 ==== osd_op_reply(19 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015ec00 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.719+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:20 12.19 12:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f0c5f800 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.719+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 5 ==== osd_op_reply(20 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.719+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:21 12.5 12:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f0c27000 2024-04-26T22:05:08.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.719+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 4 ==== osd_op_reply(21 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.719+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:22 12.15 12:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c26c00 con 0x5653f0c27000 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.720+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 5 ==== osd_op_reply(22 [pgnls start_epoch 91 out=97b] v90'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.720+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5653f0c26c00 0x5653f01e2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.720+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:23 12.d 12:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c26c00 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.720+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5653f0c26c00 0x5653f01e2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.720+0000 7fbe1d816640 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5653f0c26c00 0x5653f01e2100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.720+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== osd_op_reply(23 [pgnls start_epoch 91 out=74b] v86'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c26c00 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.720+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:24 12.1d 12:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c5f800 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.721+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 6 ==== osd_op_reply(24 [pgnls start_epoch 91 out=73b] v90'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.721+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:25 12.3 12:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c5f800 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.721+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 7 ==== osd_op_reply(25 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.721+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:26 12.13 12:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f015e800 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.721+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 3 ==== osd_op_reply(26 [pgnls start_epoch 91 out=98b] v90'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.721+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:27 12.b 12:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c27400 2024-04-26T22:05:08.751 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.721+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.3 v2:172.21.15.137:6808/492121506 3 ==== osd_op_reply(27 [pgnls start_epoch 91 out=76b] v90'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c27400 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.721+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:28 12.1b 12:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c5f400 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.722+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 5 ==== osd_op_reply(28 [pgnls start_epoch 91 out=73b] v90'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.722+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:29 12.7 12:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f015e800 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.722+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 4 ==== osd_op_reply(29 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.722+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:30 12.17 12:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c27000 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.722+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 6 ==== osd_op_reply(30 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.722+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:31 12.f 12:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c27000 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.722+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 7 ==== osd_op_reply(31 [pgnls start_epoch 91 out=73b] v86'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.722+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:32 12.1f 12:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c27000 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 8 ==== osd_op_reply(32 [pgnls start_epoch 91 out=101b] v90'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:33 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c5fc00 con 0x5653f0c5f800 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:34 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f800 con 0x5653f0c5f800 2024-04-26T22:05:08.752 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:35 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015fc00 con 0x5653f0c5f800 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1f122740 20 datascan.scan_links: injected ino detected 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.723+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:36 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f400 con 0x5653f0c5f800 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:37 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c5f800 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-26T22:05:08.753 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:38 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f800 con 0x5653f0c5e800 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.5 v2:172.21.15.170:6808/205812566 3 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5e800 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.724+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:39 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015fc00 con 0x5653f0c5f800 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:40 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c5fc00 con 0x5653f015ec00 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.2 v2:172.21.15.137:6816/1304816807 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015ec00 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-26T22:05:08.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:41 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208000 con 0x5653f0c5f800 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:42 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208400 con 0x5653f0c27000 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.725+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:43 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208800 con 0x5653f0c5f800 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-26T22:05:08.755 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:44 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208c00 con 0x5653f015e800 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 200.00000002 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:45 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209000 con 0x5653f015e800 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 6 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-26T22:05:08.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.726+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:46 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209400 con 0x5653f0c27000 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.727+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 10 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.727+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:47 12.0 12:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f400 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.727+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 6 ==== osd_op_reply(47 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.727+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:48 12.10 12:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f800 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.727+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 16 ==== osd_op_reply(48 [pgnls start_epoch 91 out=177b] v91'18 uv18 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.727+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:49 12.8 12:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27400 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.728+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.3 v2:172.21.15.137:6808/492121506 4 ==== osd_op_reply(49 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c27400 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.728+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:50 12.18 12:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f015e800 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.728+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 7 ==== osd_op_reply(50 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.728+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:51 12.4 12:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27000 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.728+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 11 ==== osd_op_reply(51 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.728+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:52 12.14 12:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5e800 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.728+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.5 v2:172.21.15.170:6808/205812566 4 ==== osd_op_reply(52 [pgnls start_epoch 91 out=149b] v90'27 uv27 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5e800 2024-04-26T22:05:08.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.729+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:53 12.c 12:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f800 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.729+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 17 ==== osd_op_reply(53 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.729+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:54 12.1c 12:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f800 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.729+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 18 ==== osd_op_reply(54 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.729+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:55 12.2 12:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f400 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.729+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 7 ==== osd_op_reply(55 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.729+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:56 12.12 12:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27400 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.729+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.3 v2:172.21.15.137:6808/492121506 5 ==== osd_op_reply(56 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c27400 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.729+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:57 12.a 12:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f015ec00 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.730+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.2 v2:172.21.15.137:6816/1304816807 4 ==== osd_op_reply(57 [pgnls start_epoch 91 out=81b] v90'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015ec00 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.730+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:58 12.1a 12:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f400 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.730+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 8 ==== osd_op_reply(58 [pgnls start_epoch 91 out=49b] v90'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.730+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:59 12.6 12:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f015e800 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.730+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 8 ==== osd_op_reply(59 [pgnls start_epoch 91 out=77b] v90'6 uv6 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.730+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:60 12.16 12:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27000 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.731+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 12 ==== osd_op_reply(60 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.731+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:61 12.e 12:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f800 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.731+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 19 ==== osd_op_reply(61 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.731+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:62 12.1e 12:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f400 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.731+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 9 ==== osd_op_reply(62 [pgnls start_epoch 91 out=49b] v90'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.731+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:63 12.1 12:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27000 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.732+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 13 ==== osd_op_reply(63 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.732+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:64 12.11 12:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5e800 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.732+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.5 v2:172.21.15.170:6808/205812566 5 ==== osd_op_reply(64 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5e800 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.732+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:65 12.9 12:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f015ec00 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.732+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.2 v2:172.21.15.137:6816/1304816807 5 ==== osd_op_reply(65 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015ec00 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.732+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:66 12.19 12:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f800 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.732+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 20 ==== osd_op_reply(66 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.732+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:67 12.5 12:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27000 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.733+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 14 ==== osd_op_reply(67 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.733+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:68 12.15 12:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27000 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.733+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 15 ==== osd_op_reply(68 [pgnls start_epoch 91 out=97b] v90'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.733+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:69 12.d 12:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c26c00 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.733+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.7 v2:172.21.15.170:6816/3085321649 2 ==== osd_op_reply(69 [pgnls start_epoch 91 out=74b] v86'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c26c00 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.733+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:70 12.1d 12:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f800 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.733+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 21 ==== osd_op_reply(70 [pgnls start_epoch 91 out=73b] v90'5 uv5 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.733+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:71 12.3 12:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f800 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.734+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 22 ==== osd_op_reply(71 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.734+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:72 12.13 12:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f015e800 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.734+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 9 ==== osd_op_reply(72 [pgnls start_epoch 91 out=98b] v90'4 uv4 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.734+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:73 12.b 12:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27400 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.734+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.3 v2:172.21.15.137:6808/492121506 6 ==== osd_op_reply(73 [pgnls start_epoch 91 out=76b] v90'6 uv6 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c27400 2024-04-26T22:05:08.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.734+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:74 12.1b 12:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c5f400 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.734+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.4 v2:172.21.15.170:6824/2080414701 10 ==== osd_op_reply(74 [pgnls start_epoch 91 out=73b] v90'10 uv10 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5f400 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.734+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:75 12.7 12:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f015e800 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.735+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 10 ==== osd_op_reply(75 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.735+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:76 12.17 12:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27000 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.735+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 16 ==== osd_op_reply(76 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.735+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:77 12.f 12:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27000 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.735+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 17 ==== osd_op_reply(77 [pgnls start_epoch 91 out=73b] v86'1 uv1 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.735+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:78 12.1f 12:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27000 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.735+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 18 ==== osd_op_reply(78 [pgnls start_epoch 91 out=101b] v90'9 uv9 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.735+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.735+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:79 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209c00 con 0x5653f0c5f800 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 23 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:80 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208000 con 0x5653f0c5f800 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 24 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:81 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208400 con 0x5653f0c5f800 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 25 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 20 datascan.scan_links: injected ino detected 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:82 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208800 con 0x5653f0c5f800 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 26 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:83 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f400 con 0x5653f0c5f800 2024-04-26T22:05:08.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 27 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.736+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:84 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f000 con 0x5653f0c5e800 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 <== osd.5 v2:172.21.15.170:6808/205812566 6 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6000 con 0x5653f0c5e800 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:85 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015fc00 con 0x5653f0c5f800 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 28 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-04-26T22:05:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:86 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f400 con 0x5653f015ec00 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.2 v2:172.21.15.137:6816/1304816807 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) ==== 164+0+54 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015ec00 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.737+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:87 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209400 con 0x5653f0c5f800 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 29 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:88 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209800 con 0x5653f0c27000 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 19 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-26T22:05:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209c00 con 0x5653f0c5f800 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 30 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.738+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:90 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208000 con 0x5653f015e800 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 11 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 200.00000002 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-26T22:05:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:91 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208400 con 0x5653f015e800 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 12 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:92 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208800 con 0x5653f0c27000 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.6 v2:172.21.15.170:6800/3855301024 20 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1163b] v0'0 uv9 ondisk = 0) ==== 154+0+1163 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c27000 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-26T22:05:08.766 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.739+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:93 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208c00 con 0x5653f0c5f800 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.740+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 31 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.740+0000 7fbe1f122740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.740+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:94 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209000 con 0x5653f0c5f800 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 32 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v91'19 uv19 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1f122740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1f122740 10 datascan.scan_links: processing 1 injected_inos 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1f122740 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1f122740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:95 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0208000 con 0x5653f0c5f800 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 33 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) ==== 164+0+505 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1f122740 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1f122740 20 datascan.scan_links: first is now 2 2024-04-26T22:05:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.741+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:96 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5653f015f400 con 0x5653f0c5f800 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.742+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.0 v2:172.21.15.137:6820/109358669 34 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v91'20 uv20 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5653f0bd6500 con 0x5653f0c5f800 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.742+0000 7fbe1f122740 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.742+0000 7fbe1f122740 10 datascan.scan_links: updating inotable 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.742+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:97 12.13 12:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c5ec00 con 0x5653f015e800 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.742+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 13 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.742+0000 7fbe1f122740 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.742+0000 7fbe1f122740 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.742+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:98 12.13 12:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) -- 0x5653f0c5fc00 con 0x5653f015e800 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1c814640 1 -- 172.21.15.137:0/2113315450 <== osd.1 v2:172.21.15.137:6800/757189714 14 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v91'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x5653f0bd6780 con 0x5653f015e800 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 10 datascan.scan_links: updating snaptable 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:99 12.d 12:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) -- 0x5653f0209400 con 0x5653f0c26c00 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1d816640 1 -- 172.21.15.137:0/2113315450 <== osd.7 v2:172.21.15.170:6816/3085321649 3 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x5653f0bd6280 con 0x5653f0c26c00 2024-04-26T22:05:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5653f0c5f800 msgr2=0x5653f01e0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5653f0c5f800 0x5653f01e0000 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5653f015e800 msgr2=0x5653f01e0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5653f015e800 0x5653f01e0b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5653f015ec00 msgr2=0x5653f01e1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5653f015ec00 0x5653f01e1080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5653f0c27400 msgr2=0x5653f01e0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5653f0c27400 0x5653f01e0580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 reap_dead start 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5653f0c5f400 msgr2=0x5653f0c1c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5653f0c5f400 0x5653f0c1c680 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5653f0c5e800 msgr2=0x5653f01e1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5653f0c5e800 0x5653f01e1b80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5653f0c27000 msgr2=0x5653f01e1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5653f0c27000 0x5653f01e1600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5653f0c26c00 msgr2=0x5653f01e2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5653f0c26c00 0x5653f01e2100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5653f0c5f000 msgr2=0x5653f0c1c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5653f0c5f000 0x5653f0c1c100 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x5653f0bf1110 tx=0x5653f0d3f0e0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 reap_dead start 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23c00 msgr2=0x5653f0c1bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 --2- 172.21.15.137:0/2113315450 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653f0d23c00 0x5653f0c1bb80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x5653f0d29da0 tx=0x5653f0bee9c0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1d015640 1 -- 172.21.15.137:0/2113315450 reap_dead start 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 shutdown_connections 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 >> 172.21.15.137:0/2113315450 conn(0x5653f0d23000 msgr2=0x5653eff3b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 shutdown_connections 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.744+0000 7fbe1f122740 1 -- 172.21.15.137:0/2113315450 wait complete. 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.745+0000 7fbe1f122740 1 -- 172.21.15.137:0/949852128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653efe4b800 msgr2=0x5653f0c1a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.745+0000 7fbe1f122740 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653efe4b800 0x5653f0c1a580 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x5653f0c79f80 tx=0x5653f0bf2120 comp rx=0 tx=0).stop 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.745+0000 7fbe1f122740 1 -- 172.21.15.137:0/949852128 shutdown_connections 2024-04-26T22:05:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.745+0000 7fbe1f122740 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5653efe4b800 0x5653f0c1a580 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.745+0000 7fbe1f122740 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653efe4bc00 0x5653f0c1ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.745+0000 7fbe1f122740 1 --2- 172.21.15.137:0/949852128 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5653efe4ac00 0x5653f0c1a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.745+0000 7fbe1f122740 1 -- 172.21.15.137:0/949852128 >> 172.21.15.137:0/949852128 conn(0x5653efe4b000 msgr2=0x5653eff3a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.745+0000 7fbe1f122740 1 -- 172.21.15.137:0/949852128 shutdown_connections 2024-04-26T22:05:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.745+0000 7fbe1f122740 1 -- 172.21.15.137:0/949852128 wait complete. 2024-04-26T22:05:08.771 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.135355, result: 2024-04-26T22:05:08.771 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-26T22:05:08.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.887+0000 7f8bd3779640 1 Processor -- start 2024-04-26T22:05:08.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.887+0000 7f8bd3779640 1 -- start start 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.888+0000 7f8bd3779640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc06f340 0x7f8bcc0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.888+0000 7f8bd3779640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bcc0b46a0 con 0x7f8bcc0d0300 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.888+0000 7f8bd3779640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bcc0b5db0 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.888+0000 7f8bd3779640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc0b6090 con 0x7f8bcc06f340 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.888+0000 7f8bd0d14640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8bcc0d0300 0x7f8bcc06f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49136/0 (socket says 172.21.15.137:49136) 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.888+0000 7f8bd0d14640 1 -- 172.21.15.137:0/2073339501 learned_addr learned my addr 172.21.15.137:0/2073339501 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.888+0000 7f8bd1515640 1 --2- 172.21.15.137:0/2073339501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc06f340 0x7f8bcc0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.888+0000 7f8bc3fff640 1 -- 172.21.15.137:0/2073339501 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1580661197 0 0) 0x7f8bcc0b46a0 con 0x7f8bcc0d0300 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.888+0000 7f8bc3fff640 1 -- 172.21.15.137:0/2073339501 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bb8003520 con 0x7f8bcc0d0300 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.889+0000 7f8bc3fff640 1 -- 172.21.15.137:0/2073339501 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372568053 0 0) 0x7f8bcc0b5db0 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.889+0000 7f8bc3fff640 1 -- 172.21.15.137:0/2073339501 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bcc0b46a0 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.889+0000 7f8bd1515640 1 -- 172.21.15.137:0/2073339501 >> v1:172.21.15.170:6789/0 conn(0x7f8bcc0b3e50 legacy=0x7f8bcc0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.889+0000 7f8bd1515640 1 -- 172.21.15.137:0/2073339501 >> v1:172.21.15.137:6789/0 conn(0x7f8bcc0d0300 legacy=0x7f8bcc06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.889+0000 7f8bd1515640 1 -- 172.21.15.137:0/2073339501 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc0b6370 con 0x7f8bcc06f340 2024-04-26T22:05:08.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.889+0000 7f8bd1515640 1 --2- 172.21.15.137:0/2073339501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc06f340 0x7f8bcc0b6b70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009800 tx=0x7f8bc402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c119374f389ac065 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.889+0000 7f8bc3fff640 1 -- 172.21.15.137:0/2073339501 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4037070 con 0x7f8bcc06f340 2024-04-26T22:05:08.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.890+0000 7f8bc3fff640 1 -- 172.21.15.137:0/2073339501 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc402ae20 con 0x7f8bcc06f340 2024-04-26T22:05:08.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.890+0000 7f8bc3fff640 1 -- 172.21.15.137:0/2073339501 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4032640 con 0x7f8bcc06f340 2024-04-26T22:05:08.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.890+0000 7f8bd3779640 1 -- 172.21.15.137:0/2073339501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc06f340 msgr2=0x7f8bcc0b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.890+0000 7f8bd3779640 1 --2- 172.21.15.137:0/2073339501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc06f340 0x7f8bcc0b6b70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009800 tx=0x7f8bc402a110 comp rx=0 tx=0).stop 2024-04-26T22:05:08.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.890+0000 7f8bd3779640 1 -- 172.21.15.137:0/2073339501 shutdown_connections 2024-04-26T22:05:08.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.890+0000 7f8bd3779640 1 --2- 172.21.15.137:0/2073339501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc06f340 0x7f8bcc0b6b70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.890+0000 7f8bd3779640 1 -- 172.21.15.137:0/2073339501 >> 172.21.15.137:0/2073339501 conn(0x7f8bcc0cd8a0 msgr2=0x7f8bcc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:08.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.890+0000 7f8bd3779640 1 -- 172.21.15.137:0/2073339501 shutdown_connections 2024-04-26T22:05:08.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.890+0000 7f8bd3779640 1 -- 172.21.15.137:0/2073339501 wait complete. 2024-04-26T22:05:08.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.891+0000 7f8bd3779640 1 Processor -- start 2024-04-26T22:05:08.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.891+0000 7f8bd3779640 1 -- start start 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd3779640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bcc06f340 0x7f8bcc1f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd3779640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bcc0b3e50 0x7f8bcc15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd3779640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc0d0300 0x7f8bcc1e5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd3779640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0b4460 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd3779640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0b42e0 con 0x7f8bcc06f340 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd3779640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc142a30 con 0x7f8bcc0d0300 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd0d14640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bcc0b3e50 0x7f8bcc15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd0d14640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bcc0b3e50 0x7f8bcc15ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41190/0 (socket says 172.21.15.137:41190) 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd0d14640 1 -- 172.21.15.137:0/871832091 learned_addr learned my addr 172.21.15.137:0/871832091 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd1515640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bcc06f340 0x7f8bcc1f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd1d16640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc0d0300 0x7f8bcc1e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd0d14640 1 -- 172.21.15.137:0/871832091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc0d0300 msgr2=0x7f8bcc1e5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd0d14640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc0d0300 0x7f8bcc1e5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd0d14640 1 -- 172.21.15.137:0/871832091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bcc06f340 msgr2=0x7f8bcc1f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd0d14640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bcc06f340 0x7f8bcc1f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.892+0000 7f8bd0d14640 1 -- 172.21.15.137:0/871832091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc1e6d80 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.893+0000 7f8bd0d14640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bcc0b3e50 0x7f8bcc15ba60 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c410 tx=0x7f8bbc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.893+0000 7f8bc1ffb640 1 -- 172.21.15.137:0/871832091 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc017070 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.893+0000 7f8bc1ffb640 1 -- 172.21.15.137:0/871832091 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc005ce0 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.893+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc1e7060 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.893+0000 7f8bc1ffb640 1 -- 172.21.15.137:0/871832091 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0072d0 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.893+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc1e7620 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.894+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc06a290 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.894+0000 7f8bc1ffb640 1 -- 172.21.15.137:0/871832091 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8bbc01a070 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.895+0000 7f8bc1ffb640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8bb006c8f0 0x7f8bb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:08.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.895+0000 7f8bc1ffb640 1 -- 172.21.15.137:0/871832091 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f8bbc08af10 con 0x7f8bcc0b3e50 2024-04-26T22:05:08.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.895+0000 7f8bd1515640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8bb006c8f0 0x7f8bb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:08.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.895+0000 7f8bd1515640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8bb006c8f0 0x7f8bb006edb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4034000 tx=0x7f8bc402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:08.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:08.899+0000 7f8bc1ffb640 1 -- 172.21.15.137:0/871832091 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8bbc058c20 con 0x7f8bcc0b3e50 2024-04-26T22:05:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.117+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f8bcc1e4e60 con 0x7f8bcc0b3e50 2024-04-26T22:05:09.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.382+0000 7f8bc1ffb640 1 -- 172.21.15.137:0/871832091 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v56) ==== 162+0+0 (secure 0 0 0) 0x7f8bbc05cf20 con 0x7f8bcc0b3e50 2024-04-26T22:05:09.382 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8bb006c8f0 msgr2=0x7f8bb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8bb006c8f0 0x7f8bb006edb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4034000 tx=0x7f8bc402e000 comp rx=0 tx=0).stop 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bcc0b3e50 msgr2=0x7f8bcc15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bcc0b3e50 0x7f8bcc15ba60 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00c410 tx=0x7f8bbc00c8d0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 shutdown_connections 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8bb006c8f0 0x7f8bb006edb0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8bcc0b3e50 0x7f8bcc15ba60 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8bcc0d0300 0x7f8bcc1e5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 --2- 172.21.15.137:0/871832091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bcc06f340 0x7f8bcc1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 >> 172.21.15.137:0/871832091 conn(0x7f8bcc0cd8a0 msgr2=0x7f8bcc144160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:09.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 shutdown_connections 2024-04-26T22:05:09.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.385+0000 7f8bd3779640 1 -- 172.21.15.137:0/871832091 wait complete. 2024-04-26T22:05:09.398 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:09.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.494+0000 7f76b8959640 1 Processor -- start 2024-04-26T22:05:09.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.494+0000 7f76b8959640 1 -- start start 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.495+0000 7f76b8959640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f76b40cf2e0 0x7f76b406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.495+0000 7f76b8959640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b40d1740 con 0x7f76b406e490 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.495+0000 7f76b8959640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b40d1a20 con 0x7f76b40d11b0 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.495+0000 7f76b8959640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f76b40d1d00 con 0x7f76b40cf2e0 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.495+0000 7f76b2d9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f76b406e490 0x7f76b415ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49144/0 (socket says 172.21.15.137:49144) 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.495+0000 7f76b2d9d640 1 -- 172.21.15.137:0/3916956265 learned_addr learned my addr 172.21.15.137:0/3916956265 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.495+0000 7f76b259c640 1 --2- 172.21.15.137:0/3916956265 >> v2:172.21.15.170:3300/0 conn(0x7f76b40cf2e0 0x7f76b406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.495+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260978391 0 0) 0x7f76b40d1740 con 0x7f76b406e490 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f769c003520 con 0x7f76b406e490 2024-04-26T22:05:09.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3674474465 0 0) 0x7f769c003520 con 0x7f76b406e490 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 >> v2:172.21.15.170:3300/0 conn(0x7f76b40cf2e0 msgr2=0x7f76b406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 --2- 172.21.15.137:0/3916956265 >> v2:172.21.15.170:3300/0 conn(0x7f76b40cf2e0 0x7f76b406d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 >> v1:172.21.15.170:6789/0 conn(0x7f76b40d11b0 legacy=0x7f76b406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b40d1fe0 con 0x7f76b406e490 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f76ac001670 con 0x7f76b406e490 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 >> v1:172.21.15.137:6789/0 conn(0x7f76b406e490 legacy=0x7f76b415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f769c0039b0 0x7f769c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c004800 0x7f769c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f769c0051c0 0x7f769c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f76b40d1d00 con 0x7f769c004800 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f769c00c060 con 0x7f769c0039b0 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f769c00c260 con 0x7f769c0051c0 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b1d9b640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c004800 0x7f769c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:09.499 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b259c640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f769c0039b0 0x7f769c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b2d9d640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f769c0051c0 0x7f769c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b1d9b640 1 -- 172.21.15.137:0/3916956265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f769c0051c0 msgr2=0x7f769c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b1d9b640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f769c0051c0 0x7f769c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b1d9b640 1 -- 172.21.15.137:0/3916956265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f769c0039b0 msgr2=0x7f769c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b1d9b640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f769c0039b0 0x7f769c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b1d9b640 1 -- 172.21.15.137:0/3916956265 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c003520 con 0x7f769c004800 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.496+0000 7f76b2d9d640 1 -- 172.21.15.137:0/3916956265 reap_dead start 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.497+0000 7f76b1d9b640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c004800 0x7f769c004c80 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f76a8001750 tx=0x7f769c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe370a812684ca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.497+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8001370 con 0x7f769c004800 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.497+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a80052d0 con 0x7f769c004800 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.497+0000 7f76b159a640 1 -- 172.21.15.137:0/3916956265 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a802abe0 con 0x7f769c004800 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.497+0000 7f76b8959640 1 -- 172.21.15.137:0/3916956265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c004800 msgr2=0x7f769c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:09.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.498+0000 7f76b8959640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c004800 0x7f769c004c80 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f76a8001750 tx=0x7f769c005830 comp rx=0 tx=0).stop 2024-04-26T22:05:09.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.498+0000 7f76b8959640 1 -- 172.21.15.137:0/3916956265 shutdown_connections 2024-04-26T22:05:09.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.498+0000 7f76b8959640 1 --2- 172.21.15.137:0/3916956265 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f769c004800 0x7f769c004c80 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.498+0000 7f76b8959640 1 -- 172.21.15.137:0/3916956265 >> 172.21.15.137:0/3916956265 conn(0x7f76b40b4a60 msgr2=0x7f76b40b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:09.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.498+0000 7f76b8959640 1 -- 172.21.15.137:0/3916956265 shutdown_connections 2024-04-26T22:05:09.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.498+0000 7f76b8959640 1 -- 172.21.15.137:0/3916956265 wait complete. 2024-04-26T22:05:09.503 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.499+0000 7f76b8959640 1 Processor -- start 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.499+0000 7f76b8959640 1 -- start start 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b8959640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f769c004800 0x7f76b414f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b8959640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b4152d90 0x7f76b4152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b8959640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76b4152550 0x7f76b4150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b8959640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f76b40cf840 con 0x7f76b4152550 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b8959640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f76b40cf6c0 con 0x7f76b4152d90 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b8959640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f76b406dd80 con 0x7f769c004800 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b2d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76b4152550 0x7f76b4150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b2d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76b4152550 0x7f76b4150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41210/0 (socket says 172.21.15.137:41210) 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b2d9d640 1 -- 172.21.15.137:0/3327512603 learned_addr learned my addr 172.21.15.137:0/3327512603 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b1d9b640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b4152d90 0x7f76b4152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b259c640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f769c004800 0x7f76b414f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:09.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b2d9d640 1 -- 172.21.15.137:0/3327512603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f769c004800 msgr2=0x7f76b414f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b2d9d640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f769c004800 0x7f76b414f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b2d9d640 1 -- 172.21.15.137:0/3327512603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b4152d90 msgr2=0x7f76b4152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b2d9d640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b4152d90 0x7f76b4152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b2d9d640 1 -- 172.21.15.137:0/3327512603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b40ccc80 con 0x7f76b4152550 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b1d9b640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b4152d90 0x7f76b4152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b2d9d640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76b4152550 0x7f76b4150d90 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f76ac000c00 tx=0x7f76ac007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76a2ffd640 1 -- 172.21.15.137:0/3327512603 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00f680 con 0x7f76b4152550 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76a2ffd640 1 -- 172.21.15.137:0/3327512603 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac018070 con 0x7f76b4152550 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b414ffd0 con 0x7f76b4152550 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76a2ffd640 1 -- 172.21.15.137:0/3327512603 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00fa80 con 0x7f76b4152550 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.500+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b4150590 con 0x7f76b4152550 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.501+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b406c790 con 0x7f76b4152550 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.502+0000 7f76a2ffd640 1 -- 172.21.15.137:0/3327512603 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76ac00fc20 con 0x7f76b4152550 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.502+0000 7f76a2ffd640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f769406c920 0x7f769406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:09.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.502+0000 7f76b259c640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f769406c920 0x7f769406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:09.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.502+0000 7f76a2ffd640 1 -- 172.21.15.137:0/3327512603 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f76ac08b960 con 0x7f76b4152550 2024-04-26T22:05:09.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.503+0000 7f76b259c640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f769406c920 0x7f769406ede0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009fd0 tx=0x7f76a400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:09.506 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.507+0000 7f76a2ffd640 1 -- 172.21.15.137:0/3327512603 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f76b406c790 con 0x7f76b4152550 2024-04-26T22:05:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.721+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76b406a290 con 0x7f76b4152550 2024-04-26T22:05:09.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.721+0000 7f76a2ffd640 1 -- 172.21.15.137:0/3327512603 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5189 (secure 0 0 0) 0x7f76ac059cc0 con 0x7f76b4152550 2024-04-26T22:05:09.721 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:09.721 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":57,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:05:09.385684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"a","rank":0,"incarnation":57,"state":"up:replay","state_seq":1,"addr":"172.21.15.137:6837/4231448082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":4231448082},{"type":"v1","addr":"172.21.15.137:6837","nonce":4231448082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-26T22:05:09.722 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 57 2024-04-26T22:05:09.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f769406c920 msgr2=0x7f769406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:09.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f769406c920 0x7f769406ede0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009fd0 tx=0x7f76a400b040 comp rx=0 tx=0).stop 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76b4152550 msgr2=0x7f76b4150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76b4152550 0x7f76b4150d90 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f76ac000c00 tx=0x7f76ac007430 comp rx=0 tx=0).stop 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 shutdown_connections 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f769406c920 0x7f769406ede0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f76b4152550 0x7f76b4150d90 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b4152d90 0x7f76b4152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 --2- 172.21.15.137:0/3327512603 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f769c004800 0x7f76b414f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 >> 172.21.15.137:0/3327512603 conn(0x7f76b40b4a60 msgr2=0x7f76b40b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 shutdown_connections 2024-04-26T22:05:09.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:09.723+0000 7f76b8959640 1 -- 172.21.15.137:0/3327512603 wait complete. 2024-04-26T22:05:10.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:04:13.390555+0000', 'modified': '2024-04-26T22:05:09.385684+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7845}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7845': {'gid': 7845, 'name': 'a', 'rank': 0, 'incarnation': 57, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.137:6837/4231448082', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 4231448082}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 4231448082}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:05:10.137 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7845:up:replay 2024-04-26T22:05:11.138 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.247+0000 7fc13159d640 1 Processor -- start 2024-04-26T22:05:11.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.247+0000 7fc13159d640 1 -- start start 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.248+0000 7fc13159d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc12c15d3b0 0x7fc12c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.248+0000 7fc13159d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc12c0b6b80 con 0x7fc12c06c9b0 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.248+0000 7fc13159d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc12c0b6e60 con 0x7fc12c073b10 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.248+0000 7fc13159d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc12c0aedf0 con 0x7fc12c15d3b0 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.248+0000 7fc12affd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc12c15d3b0 0x7fc12c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.248+0000 7fc12b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc12c06c9b0 0x7fc12c0d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49154/0 (socket says 172.21.15.137:49154) 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.248+0000 7fc12affd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc12c15d3b0 0x7fc12c0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41222/0 (socket says 172.21.15.137:41222) 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.248+0000 7fc12b7fe640 1 -- 172.21.15.137:0/1936800718 learned_addr learned my addr 172.21.15.137:0/1936800718 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.249+0000 7fc12affd640 1 -- 172.21.15.137:0/1936800718 >> v1:172.21.15.170:6789/0 conn(0x7fc12c073b10 legacy=0x7fc12c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.249+0000 7fc12affd640 1 -- 172.21.15.137:0/1936800718 >> v1:172.21.15.137:6789/0 conn(0x7fc12c06c9b0 legacy=0x7fc12c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:11.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.249+0000 7fc12affd640 1 -- 172.21.15.137:0/1936800718 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c0b7140 con 0x7fc12c15d3b0 2024-04-26T22:05:11.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.249+0000 7fc12affd640 1 --2- 172.21.15.137:0/1936800718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 0x7fc12c0735d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009d90 tx=0x7fc11c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ffffad0fd92f1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc129ffb640 1 -- 172.21.15.137:0/1936800718 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c007740 con 0x7fc12c15d3b0 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc129ffb640 1 -- 172.21.15.137:0/1936800718 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11c0078e0 con 0x7fc12c15d3b0 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc129ffb640 1 -- 172.21.15.137:0/1936800718 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c007cb0 con 0x7fc12c15d3b0 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc13159d640 1 -- 172.21.15.137:0/1936800718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 msgr2=0x7fc12c0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc13159d640 1 --2- 172.21.15.137:0/1936800718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 0x7fc12c0735d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009d90 tx=0x7fc11c02a660 comp rx=0 tx=0).stop 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc13159d640 1 -- 172.21.15.137:0/1936800718 shutdown_connections 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc13159d640 1 --2- 172.21.15.137:0/1936800718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 0x7fc12c0735d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc13159d640 1 -- 172.21.15.137:0/1936800718 >> 172.21.15.137:0/1936800718 conn(0x7fc12c0b3b10 msgr2=0x7fc12c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc13159d640 1 -- 172.21.15.137:0/1936800718 shutdown_connections 2024-04-26T22:05:11.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.250+0000 7fc13159d640 1 -- 172.21.15.137:0/1936800718 wait complete. 2024-04-26T22:05:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc13159d640 1 Processor -- start 2024-04-26T22:05:11.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc13159d640 1 -- start start 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc13159d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc12c06c9b0 0x7fc12c0b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc13159d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc12c073b10 0x7fc12c1572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc13159d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 0x7fc12c1f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc13159d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c15d790 con 0x7fc12c15d3b0 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc13159d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc12c0b6930 con 0x7fc12c06c9b0 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc13159d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc12c15d910 con 0x7fc12c073b10 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc12b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 0x7fc12c1f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc12b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 0x7fc12c1f6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41224/0 (socket says 172.21.15.137:41224) 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc12b7fe640 1 -- 172.21.15.137:0/285484032 learned_addr learned my addr 172.21.15.137:0/285484032 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.252+0000 7fc12affd640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc12c06c9b0 0x7fc12c0b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc12a7fc640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc12c073b10 0x7fc12c1572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc12b7fe640 1 -- 172.21.15.137:0/285484032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc12c073b10 msgr2=0x7fc12c1572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:11.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc12b7fe640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc12c073b10 0x7fc12c1572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc12b7fe640 1 -- 172.21.15.137:0/285484032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc12c06c9b0 msgr2=0x7fc12c0b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc12b7fe640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc12c06c9b0 0x7fc12c0b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc12b7fe640 1 -- 172.21.15.137:0/285484032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12c1533c0 con 0x7fc12c15d3b0 2024-04-26T22:05:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc12b7fe640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 0x7fc12c1f6c80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c450 tx=0x7fc12400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc1137fe640 1 -- 172.21.15.137:0/285484032 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124017070 con 0x7fc12c15d3b0 2024-04-26T22:05:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc1137fe640 1 -- 172.21.15.137:0/285484032 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc124005ce0 con 0x7fc12c15d3b0 2024-04-26T22:05:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12c1536a0 con 0x7fc12c15d3b0 2024-04-26T22:05:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc1137fe640 1 -- 172.21.15.137:0/285484032 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124007270 con 0x7fc12c15d3b0 2024-04-26T22:05:11.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.253+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12c153c60 con 0x7fc12c15d3b0 2024-04-26T22:05:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.254+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc12c0693d0 con 0x7fc12c15d3b0 2024-04-26T22:05:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.254+0000 7fc1137fe640 1 -- 172.21.15.137:0/285484032 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc12401a070 con 0x7fc12c15d3b0 2024-04-26T22:05:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.255+0000 7fc1137fe640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc11806c8f0 0x7fc11806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.255+0000 7fc1137fe640 1 -- 172.21.15.137:0/285484032 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7fc12408adb0 con 0x7fc12c15d3b0 2024-04-26T22:05:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.255+0000 7fc12affd640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc11806c8f0 0x7fc11806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:11.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.255+0000 7fc12affd640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc11806c8f0 0x7fc11806edb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc11c034000 tx=0x7fc11c02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:11.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.259+0000 7fc1137fe640 1 -- 172.21.15.137:0/285484032 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc124058b30 con 0x7fc12c15d3b0 2024-04-26T22:05:11.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.474+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc12c0b4740 con 0x7fc12c15d3b0 2024-04-26T22:05:11.475 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.475+0000 7fc1137fe640 1 -- 172.21.15.137:0/285484032 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5189 (secure 0 0 0) 0x7fc12405ce30 con 0x7fc12c15d3b0 2024-04-26T22:05:11.475 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:11.475 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":59,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:05:10.392562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"a","rank":0,"incarnation":57,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.137:6837/4231448082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":4231448082},{"type":"v1","addr":"172.21.15.137:6837","nonce":4231448082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-04-26T22:05:11.475 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 59 2024-04-26T22:05:11.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc11806c8f0 msgr2=0x7fc11806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:11.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc11806c8f0 0x7fc11806edb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc11c034000 tx=0x7fc11c02f000 comp rx=0 tx=0).stop 2024-04-26T22:05:11.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 msgr2=0x7fc12c1f6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:11.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 0x7fc12c1f6c80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c450 tx=0x7fc12400c910 comp rx=0 tx=0).stop 2024-04-26T22:05:11.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 shutdown_connections 2024-04-26T22:05:11.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc11806c8f0 0x7fc11806edb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:11.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc12c15d3b0 0x7fc12c1f6c80 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:11.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc12c073b10 0x7fc12c1572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:11.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 --2- 172.21.15.137:0/285484032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc12c06c9b0 0x7fc12c0b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:11.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 >> 172.21.15.137:0/285484032 conn(0x7fc12c0b3b10 msgr2=0x7fc12c0d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:11.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 shutdown_connections 2024-04-26T22:05:11.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:11.477+0000 7fc13159d640 1 -- 172.21.15.137:0/285484032 wait complete. 2024-04-26T22:05:11.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:04:13.390555+0000', 'modified': '2024-04-26T22:05:10.392562+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7845}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7845': {'gid': 7845, 'name': 'a', 'rank': 0, 'incarnation': 57, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.137:6837/4231448082', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 4231448082}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 4231448082}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:05:11.891 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7845:up:rejoin 2024-04-26T22:05:12.892 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:13.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.001+0000 7f8d392bd640 1 Processor -- start 2024-04-26T22:05:13.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.001+0000 7f8d392bd640 1 -- start start 2024-04-26T22:05:13.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.002+0000 7f8d392bd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8d3406e490 0x7f8d3415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.002+0000 7f8d392bd640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340d1740 con 0x7f8d340cf2e0 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.002+0000 7f8d392bd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340d1a20 con 0x7f8d340d11b0 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.002+0000 7f8d392bd640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8d340d1d00 con 0x7f8d3406e490 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.002+0000 7f8d32ffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8d340cf2e0 0x7f8d3406d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49170/0 (socket says 172.21.15.137:49170) 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.002+0000 7f8d32ffd640 1 -- 172.21.15.137:0/2282968427 learned_addr learned my addr 172.21.15.137:0/2282968427 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.002+0000 7f8d337fe640 1 --2- 172.21.15.137:0/2282968427 >> v2:172.21.15.170:3300/0 conn(0x7f8d3406e490 0x7f8d3415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.002+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072223231 0 0) 0x7f8d340d1740 con 0x7f8d340cf2e0 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.002+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d1c003520 con 0x7f8d340cf2e0 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516411755 0 0) 0x7f8d340d1a20 con 0x7f8d340d11b0 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d340d1740 con 0x7f8d340d11b0 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1563918907 0 0) 0x7f8d1c003520 con 0x7f8d340cf2e0 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 >> v2:172.21.15.170:3300/0 conn(0x7f8d3406e490 msgr2=0x7f8d3415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 --2- 172.21.15.137:0/2282968427 >> v2:172.21.15.170:3300/0 conn(0x7f8d3406e490 0x7f8d3415ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 >> v1:172.21.15.170:6789/0 conn(0x7f8d340d11b0 legacy=0x7f8d3406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d340d1fe0 con 0x7f8d340cf2e0 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f8d24001670 con 0x7f8d340cf2e0 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d337fe640 1 --2- 172.21.15.137:0/2282968427 >> v2:172.21.15.170:3300/0 conn(0x7f8d3406e490 0x7f8d3415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 >> v1:172.21.15.137:6789/0 conn(0x7f8d340cf2e0 legacy=0x7f8d3406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c003b40 0x7f8d1c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d1c004800 0x7f8d1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d1c0051c0 0x7f8d1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340d1d00 con 0x7f8d1c004800 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c00c040 con 0x7f8d1c003b40 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1c00c240 con 0x7f8d1c0051c0 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d327fc640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d1c004800 0x7f8d1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d32ffd640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c003b40 0x7f8d1c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.006 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d337fe640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d1c0051c0 0x7f8d1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d327fc640 1 -- 172.21.15.137:0/2282968427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d1c0051c0 msgr2=0x7f8d1c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d327fc640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d1c0051c0 0x7f8d1c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d327fc640 1 -- 172.21.15.137:0/2282968427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c003b40 msgr2=0x7f8d1c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d327fc640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c003b40 0x7f8d1c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d327fc640 1 -- 172.21.15.137:0/2282968427 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c003520 con 0x7f8d1c004800 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.003+0000 7f8d337fe640 1 -- 172.21.15.137:0/2282968427 reap_dead start 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.004+0000 7f8d327fc640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d1c004800 0x7f8d1c004c80 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f8d280018d0 tx=0x7f8d1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872331c412a604d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.004+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d280014f0 con 0x7f8d1c004800 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.004+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d280052d0 con 0x7f8d1c004800 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.004+0000 7f8d31ffb640 1 -- 172.21.15.137:0/2282968427 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2802ac60 con 0x7f8d1c004800 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.004+0000 7f8d392bd640 1 -- 172.21.15.137:0/2282968427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d1c004800 msgr2=0x7f8d1c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.004+0000 7f8d392bd640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d1c004800 0x7f8d1c004c80 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f8d280018d0 tx=0x7f8d1c005830 comp rx=0 tx=0).stop 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.004+0000 7f8d392bd640 1 -- 172.21.15.137:0/2282968427 shutdown_connections 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.004+0000 7f8d392bd640 1 --2- 172.21.15.137:0/2282968427 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d1c004800 0x7f8d1c004c80 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.004+0000 7f8d392bd640 1 -- 172.21.15.137:0/2282968427 >> 172.21.15.137:0/2282968427 conn(0x7f8d340b4a60 msgr2=0x7f8d340b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:13.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.005+0000 7f8d392bd640 1 -- 172.21.15.137:0/2282968427 shutdown_connections 2024-04-26T22:05:13.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.005+0000 7f8d392bd640 1 -- 172.21.15.137:0/2282968427 wait complete. 2024-04-26T22:05:13.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.006+0000 7f8d392bd640 1 Processor -- start 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.006+0000 7f8d392bd640 1 -- start start 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d392bd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c004800 0x7f8d34153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d392bd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d340ce5a0 0x7f8d340cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d392bd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d340cc620 0x7f8d340ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d392bd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340cf840 con 0x7f8d340cc620 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d392bd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340cf6c0 con 0x7f8d1c004800 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d392bd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3406dd80 con 0x7f8d340ce5a0 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d337fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d340cc620 0x7f8d340ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d337fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d340cc620 0x7f8d340ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41244/0 (socket says 172.21.15.137:41244) 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d337fe640 1 -- 172.21.15.137:0/1620787605 learned_addr learned my addr 172.21.15.137:0/1620787605 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d337fe640 1 -- 172.21.15.137:0/1620787605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d340ce5a0 msgr2=0x7f8d340cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d327fc640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d340ce5a0 0x7f8d340cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d337fe640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d340ce5a0 0x7f8d340cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d337fe640 1 -- 172.21.15.137:0/1620787605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c004800 msgr2=0x7f8d34153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d32ffd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c004800 0x7f8d34153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d337fe640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c004800 0x7f8d34153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d337fe640 1 -- 172.21.15.137:0/1620787605 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d34154050 con 0x7f8d340cc620 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d32ffd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c004800 0x7f8d34153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d337fe640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d340cc620 0x7f8d340ca040 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f8d34074240 tx=0x7f8d2c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d1b7fe640 1 -- 172.21.15.137:0/1620787605 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c003990 con 0x7f8d340cc620 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d1b7fe640 1 -- 172.21.15.137:0/1620787605 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c01b070 con 0x7f8d340cc620 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d34151430 con 0x7f8d340cc620 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d1b7fe640 1 -- 172.21.15.137:0/1620787605 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c003bb0 con 0x7f8d340cc620 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.007+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d341519f0 con 0x7f8d340cc620 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.009+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3406a290 con 0x7f8d340cc620 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.009+0000 7f8d1b7fe640 1 -- 172.21.15.137:0/1620787605 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d2c005d10 con 0x7f8d340cc620 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.010+0000 7f8d1b7fe640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d2006c8f0 0x7f8d2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.010+0000 7f8d32ffd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d2006c8f0 0x7f8d2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.010+0000 7f8d1b7fe640 1 -- 172.21.15.137:0/1620787605 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f8d2c08c1d0 con 0x7f8d340cc620 2024-04-26T22:05:13.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.010+0000 7f8d32ffd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d2006c8f0 0x7f8d2006edb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8d24001eb0 tx=0x7f8d24009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.014+0000 7f8d1b7fe640 1 -- 172.21.15.137:0/1620787605 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8d2c05a530 con 0x7f8d340cc620 2024-04-26T22:05:13.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.225+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d340b8ef0 con 0x7f8d340cc620 2024-04-26T22:05:13.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.226+0000 7f8d1b7fe640 1 -- 172.21.15.137:0/1620787605 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5196 (secure 0 0 0) 0x7f8d2c059e30 con 0x7f8d340cc620 2024-04-26T22:05:13.226 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:13.226 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:05:12.391859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/4231448082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":4231448082},{"type":"v1","addr":"172.21.15.137:6837","nonce":4231448082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":6}]} 2024-04-26T22:05:13.226 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 60 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.227+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d2006c8f0 msgr2=0x7f8d2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.227+0000 7f8d392bd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d2006c8f0 0x7f8d2006edb0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8d24001eb0 tx=0x7f8d24009040 comp rx=0 tx=0).stop 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d340cc620 msgr2=0x7f8d340ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d340cc620 0x7f8d340ca040 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f8d34074240 tx=0x7f8d2c009f90 comp rx=0 tx=0).stop 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 shutdown_connections 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8d2006c8f0 0x7f8d2006edb0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8d340cc620 0x7f8d340ca040 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8d340ce5a0 0x7f8d340cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 --2- 172.21.15.137:0/1620787605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d1c004800 0x7f8d34153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 >> 172.21.15.137:0/1620787605 conn(0x7f8d340b4a60 msgr2=0x7f8d340b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 shutdown_connections 2024-04-26T22:05:13.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.228+0000 7f8d392bd640 1 -- 172.21.15.137:0/1620787605 wait complete. 2024-04-26T22:05:13.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:04:13.390555+0000', 'modified': '2024-04-26T22:05:12.391859+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7845}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7845': {'gid': 7845, 'name': 'a', 'rank': 0, 'incarnation': 57, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.137:6837/4231448082', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 4231448082}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 4231448082}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7845, 'qdb_cluster': [7845]} 2024-04-26T22:05:13.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:05:13.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T22:05:13.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.741+0000 7fc21a093640 1 Processor -- start 2024-04-26T22:05:13.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.741+0000 7fc21a093640 1 -- start start 2024-04-26T22:05:13.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc21a093640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc214145980 0x7fc214160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc21a093640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2140b3de0 0x7fc2140b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc21a093640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2140b4260 con 0x7fc2140b5fd0 2024-04-26T22:05:13.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc21a093640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc2140b6440 con 0x7fc2140b3de0 2024-04-26T22:05:13.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc21a093640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc2140b5140 con 0x7fc214145980 2024-04-26T22:05:13.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc212ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2140b3de0 0x7fc2140b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc213fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc2140b5fd0 0x7fc21415c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49174/0 (socket says 172.21.15.137:49174) 2024-04-26T22:05:13.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc213fff640 1 -- 172.21.15.137:0/1285725633 learned_addr learned my addr 172.21.15.137:0/1285725633 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:13.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc212ffd640 1 -- 172.21.15.137:0/1285725633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc214145980 msgr2=0x7fc214160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc212ffd640 1 --2- 172.21.15.137:0/1285725633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc214145980 0x7fc214160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc212ffd640 1 -- 172.21.15.137:0/1285725633 >> v1:172.21.15.137:6789/0 conn(0x7fc2140b5fd0 legacy=0x7fc21415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc2127fc640 1 -- 172.21.15.137:0/1285725633 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454625262 0 0) 0x7fc2140b4260 con 0x7fc2140b5fd0 2024-04-26T22:05:13.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.742+0000 7fc212ffd640 1 -- 172.21.15.137:0/1285725633 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2140b4530 con 0x7fc2140b3de0 2024-04-26T22:05:13.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.743+0000 7fc212ffd640 1 --2- 172.21.15.137:0/1285725633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b3de0 0x7fc2140b5a90 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fc2080097a0 tx=0x7fc20802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fe8f62a0f6254a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.743+0000 7fc2127fc640 1 -- 172.21.15.137:0/1285725633 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208037070 con 0x7fc2140b3de0 2024-04-26T22:05:13.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.743+0000 7fc2127fc640 1 -- 172.21.15.137:0/1285725633 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20802ae50 con 0x7fc2140b3de0 2024-04-26T22:05:13.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.743+0000 7fc2127fc640 1 -- 172.21.15.137:0/1285725633 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208032660 con 0x7fc2140b3de0 2024-04-26T22:05:13.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.744+0000 7fc21a093640 1 -- 172.21.15.137:0/1285725633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b3de0 msgr2=0x7fc2140b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.744+0000 7fc21a093640 1 --2- 172.21.15.137:0/1285725633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b3de0 0x7fc2140b5a90 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fc2080097a0 tx=0x7fc20802a100 comp rx=0 tx=0).stop 2024-04-26T22:05:13.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.744+0000 7fc21a093640 1 -- 172.21.15.137:0/1285725633 shutdown_connections 2024-04-26T22:05:13.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.744+0000 7fc21a093640 1 --2- 172.21.15.137:0/1285725633 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b3de0 0x7fc2140b5a90 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.744+0000 7fc21a093640 1 --2- 172.21.15.137:0/1285725633 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc214145980 0x7fc214160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.744+0000 7fc21a093640 1 -- 172.21.15.137:0/1285725633 >> 172.21.15.137:0/1285725633 conn(0x7fc2140d0d30 msgr2=0x7fc2140d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:13.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.744+0000 7fc21a093640 1 -- 172.21.15.137:0/1285725633 shutdown_connections 2024-04-26T22:05:13.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.744+0000 7fc21a093640 1 -- 172.21.15.137:0/1285725633 wait complete. 2024-04-26T22:05:13.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.745+0000 7fc21a093640 1 Processor -- start 2024-04-26T22:05:13.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.745+0000 7fc21a093640 1 -- start start 2024-04-26T22:05:13.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc21a093640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2140b3de0 0x7fc21415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc21a093640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b5fd0 0x7fc21413de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc21a093640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc214145980 0x7fc21406eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc21a093640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc2140b4dd0 con 0x7fc2140b5fd0 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc21a093640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc2140b4af0 con 0x7fc2140b3de0 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc21a093640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc2140730e0 con 0x7fc214145980 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc212ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b5fd0 0x7fc21413de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc212ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b5fd0 0x7fc21413de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41274/0 (socket says 172.21.15.137:41274) 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc212ffd640 1 -- 172.21.15.137:0/761301982 learned_addr learned my addr 172.21.15.137:0/761301982 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc213fff640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc214145980 0x7fc21406eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc2137fe640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2140b3de0 0x7fc21415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc212ffd640 1 -- 172.21.15.137:0/761301982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc214145980 msgr2=0x7fc21406eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc212ffd640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc214145980 0x7fc21406eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.748 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc212ffd640 1 -- 172.21.15.137:0/761301982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2140b3de0 msgr2=0x7fc21415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc212ffd640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2140b3de0 0x7fc21415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc212ffd640 1 -- 172.21.15.137:0/761301982 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21413e7c0 con 0x7fc2140b5fd0 2024-04-26T22:05:13.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc2137fe640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2140b3de0 0x7fc21415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:13.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc212ffd640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b5fd0 0x7fc21413de90 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fc2080097a0 tx=0x7fc2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.746+0000 7fc1fbfff640 1 -- 172.21.15.137:0/761301982 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208037040 con 0x7fc2140b5fd0 2024-04-26T22:05:13.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.747+0000 7fc1fbfff640 1 -- 172.21.15.137:0/761301982 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc208004030 con 0x7fc2140b5fd0 2024-04-26T22:05:13.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.747+0000 7fc21a093640 1 -- 172.21.15.137:0/761301982 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21413eaa0 con 0x7fc2140b5fd0 2024-04-26T22:05:13.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.747+0000 7fc1fbfff640 1 -- 172.21.15.137:0/761301982 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208006e10 con 0x7fc2140b5fd0 2024-04-26T22:05:13.749 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.747+0000 7fc21a093640 1 -- 172.21.15.137:0/761301982 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21413f060 con 0x7fc2140b5fd0 2024-04-26T22:05:13.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.748+0000 7fc1fbfff640 1 -- 172.21.15.137:0/761301982 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc20803d650 con 0x7fc2140b5fd0 2024-04-26T22:05:13.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.748+0000 7fc1fbfff640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc20006c8f0 0x7fc20006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.749+0000 7fc2137fe640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc20006c8f0 0x7fc20006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.749+0000 7fc1fbfff640 1 -- 172.21.15.137:0/761301982 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7fc2080ac570 con 0x7fc2140b5fd0 2024-04-26T22:05:13.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.749+0000 7fc2137fe640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc20006c8f0 0x7fc20006edb0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc2141f6750 tx=0x7fc204008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.749+0000 7fc21cda9740 1 Processor -- start 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.749+0000 7fc21cda9740 1 -- start start 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.750+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281a1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.750+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d8281bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.750+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d828177120 0x55d8281bd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.750+0000 7fc21cda9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d8280db740 con 0x55d828177120 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.750+0000 7fc21cda9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d8280773a0 con 0x55d8281bece0 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.750+0000 7fc21cda9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d8280d7700 con 0x55d8281a1440 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.750+0000 7fc213fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d828177120 0x55d8281bd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.750+0000 7fc213fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d828177120 0x55d8281bd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41288/0 (socket says 172.21.15.137:41288) 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.750+0000 7fc213fff640 1 -- 172.21.15.137:0/3534168545 learned_addr learned my addr 172.21.15.137:0/3534168545 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc2137fe640 1 --2- 172.21.15.137:0/3534168545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc212ffd640 1 --2- 172.21.15.137:0/3534168545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d8281bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc213fff640 1 -- 172.21.15.137:0/3534168545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 msgr2=0x55d8281a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc213fff640 1 --2- 172.21.15.137:0/3534168545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc213fff640 1 -- 172.21.15.137:0/3534168545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 msgr2=0x55d8281bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc213fff640 1 --2- 172.21.15.137:0/3534168545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d8281bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc213fff640 1 -- 172.21.15.137:0/3534168545 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d828093750 con 0x55d828177120 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc213fff640 1 --2- 172.21.15.137:0/3534168545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d828177120 0x55d8281bd3a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc20c002020 tx=0x7fc20c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a9e6e38846753 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc1f97fa640 1 -- 172.21.15.137:0/3534168545 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c019070 con 0x55d828177120 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc1f97fa640 1 -- 172.21.15.137:0/3534168545 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c00ee50 con 0x55d828177120 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.751+0000 7fc1f97fa640 1 -- 172.21.15.137:0/3534168545 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c005e10 con 0x55d828177120 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 -- 172.21.15.137:0/3534168545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d828177120 msgr2=0x55d8281bd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 --2- 172.21.15.137:0/3534168545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d828177120 0x55d8281bd3a0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc20c002020 tx=0x7fc20c00e530 comp rx=0 tx=0).stop 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 -- 172.21.15.137:0/3534168545 shutdown_connections 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 --2- 172.21.15.137:0/3534168545 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d828177120 0x55d8281bd3a0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 --2- 172.21.15.137:0/3534168545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d8281bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 --2- 172.21.15.137:0/3534168545 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 -- 172.21.15.137:0/3534168545 >> 172.21.15.137:0/3534168545 conn(0x55d828173a50 msgr2=0x55d8281bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:13.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 -- 172.21.15.137:0/3534168545 shutdown_connections 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 -- 172.21.15.137:0/3534168545 wait complete. 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 -- start start 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.752+0000 7fc21cda9740 1 Processor -- start 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d8281cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc21cda9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d828177ec0 con 0x55d8281a23b0 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc21cda9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d828062fe0 con 0x55d8281bece0 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc21cda9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d828171980 con 0x55d8281a1440 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc21cda9740 10 client.0 _ll_register_callbacks cb 0x55d828079150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc213fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc213fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41300/0 (socket says 172.21.15.137:41300) 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc213fff640 1 -- 172.21.15.137:0/1294169978 learned_addr learned my addr 172.21.15.137:0/1294169978 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:13.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc2137fe640 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.753+0000 7fc212ffd640 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d8281cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc213fff640 1 -- 172.21.15.137:0/1294169978 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 msgr2=0x55d8281a39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc213fff640 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281a39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc213fff640 1 -- 172.21.15.137:0/1294169978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 msgr2=0x55d8281cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc213fff640 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d8281cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc213fff640 1 -- 172.21.15.137:0/1294169978 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d827ded2d0 con 0x55d8281a23b0 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc213fff640 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281b5740 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009010 tx=0x7fc20c001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95a92982d37215 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc1f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc1f27fc640 1 -- 172.21.15.137:0/1294169978 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c019040 con 0x55d8281a23b0 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc1f27fc640 1 -- 172.21.15.137:0/1294169978 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7fc20c014680 con 0x55d8281a23b0 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc21cda9740 1 -- 172.21.15.137:0/1294169978 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc20c00ee50 con 0x55d8281a23b0 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc1f27fc640 1 -- 172.21.15.137:0/1294169978 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fc20c02b050 con 0x55d8281a23b0 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc21cda9740 10 client.7926 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:13.760 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc21cda9740 1 -- 172.21.15.137:0/1294169978 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x55d827eb76b0 con 0x55d8281a23b0 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc1f27fc640 1 -- 172.21.15.137:0/1294169978 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c00ee50 con 0x55d8281a23b0 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc1f27fc640 1 -- 172.21.15.137:0/1294169978 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7fc20c02e020 con 0x55d8281a23b0 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc21cda9740 10 client.7926 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc21cda9740 10 client.7926 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc21cda9740 20 client.7926 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55d8281cfd70 0x55d8281d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc21cda9740 4 client.7926 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc21cda9740 1 -- 172.21.15.137:0/1294169978 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8280e9350 con 0x55d8281cfd70 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.754+0000 7fc2137fe640 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55d8281cfd70 0x55d8281d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.755+0000 7fc1f27fc640 10 client.7926 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.755+0000 7fc2137fe640 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55d8281cfd70 0x55d8281d0150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a662af9c9ab940 server_cookie=eea2a2d8345b615a in_seq=0 out_seq=0 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.755+0000 7fc1f27fc640 1 -- 172.21.15.137:0/1294169978 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d8280e9350 con 0x55d8281cfd70 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.755+0000 7fc1f27fc640 10 client.7926 handle_command_reply: tid=0 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.755+0000 7fc21cda9740 1 client.7926 shutdown 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.755+0000 7fc21cda9740 1 -- 172.21.15.137:0/1294169978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 msgr2=0x55d8281b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.755+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281b5740 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009010 tx=0x7fc20c001770 comp rx=0 tx=0).stop 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc21cda9740 1 -- 172.21.15.137:0/1294169978 shutdown_connections 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55d8281cfd70 0x55d8281d0150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281b5740 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d8281cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc1f27fc640 0 client.7926 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1294169978 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281a39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc21cda9740 1 -- 172.21.15.137:0/1294169978 >> 172.21.15.137:0/1294169978 conn(0x55d828177120 msgr2=0x55d8281bf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc21cda9740 1 -- 172.21.15.137:0/1294169978 shutdown_connections 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc21cda9740 1 -- 172.21.15.137:0/1294169978 wait complete. 2024-04-26T22:05:13.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.756+0000 7fc21cda9740 20 client.7926 trim_cache size 0 max 16384 2024-04-26T22:05:13.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.774+0000 7fc21cda9740 1 Processor -- start 2024-04-26T22:05:13.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.774+0000 7fc21cda9740 1 -- start start 2024-04-26T22:05:13.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.774+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281a1440 0x55d8281cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.774+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.774+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281bece0 0x55d828174ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc21cda9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc21413d630 con 0x55d8281a23b0 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc21cda9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141351f0 con 0x55d8281a1440 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc21cda9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc21413cfe0 con 0x55d8281bece0 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc212ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc212ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281a45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41314/0 (socket says 172.21.15.137:41314) 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc212ffd640 1 -- 172.21.15.137:0/1386793070 learned_addr learned my addr 172.21.15.137:0/1386793070 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc212ffd640 1 -- 172.21.15.137:0/1386793070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281bece0 msgr2=0x55d828174ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc212ffd640 1 --2- 172.21.15.137:0/1386793070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281bece0 0x55d828174ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc212ffd640 1 -- 172.21.15.137:0/1386793070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281a1440 msgr2=0x55d8281cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc212ffd640 1 --2- 172.21.15.137:0/1386793070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281a1440 0x55d8281cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc212ffd640 1 -- 172.21.15.137:0/1386793070 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82818f440 con 0x55d8281a23b0 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc212ffd640 1 --2- 172.21.15.137:0/1386793070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281a45d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc208035040 tx=0x7fc208008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689b727a488538cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc1f8ff9640 1 -- 172.21.15.137:0/1386793070 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20804b040 con 0x55d8281a23b0 2024-04-26T22:05:13.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc1f8ff9640 1 -- 172.21.15.137:0/1386793070 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20802ae50 con 0x55d8281a23b0 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.775+0000 7fc1f8ff9640 1 -- 172.21.15.137:0/1386793070 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20807e4e0 con 0x55d8281a23b0 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 -- 172.21.15.137:0/1386793070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 msgr2=0x55d8281a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1386793070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281a45d0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc208035040 tx=0x7fc208008040 comp rx=0 tx=0).stop 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 -- 172.21.15.137:0/1386793070 shutdown_connections 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1386793070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281a45d0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1386793070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281bece0 0x55d828174ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 --2- 172.21.15.137:0/1386793070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281a1440 0x55d8281cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 -- 172.21.15.137:0/1386793070 >> 172.21.15.137:0/1386793070 conn(0x55d828177120 msgr2=0x55d8281b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 -- 172.21.15.137:0/1386793070 shutdown_connections 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 -- 172.21.15.137:0/1386793070 wait complete. 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 -- start start 2024-04-26T22:05:13.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.776+0000 7fc21cda9740 1 Processor -- start 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281df720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281dfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc21cda9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d828175360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc21cda9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d8281b3940 con 0x55d8281a23b0 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc21cda9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d8281b3dd0 con 0x55d8281bece0 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc21cda9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d82818f610 con 0x55d8281a1440 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc21cda9740 10 client.0 _ll_register_callbacks cb 0x7fc20c017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc212ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281dfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc212ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281dfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41326/0 (socket says 172.21.15.137:41326) 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc212ffd640 1 -- 172.21.15.137:0/2498663213 learned_addr learned my addr 172.21.15.137:0/2498663213 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc212ffd640 1 -- 172.21.15.137:0/2498663213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 msgr2=0x55d8281df720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.777+0000 7fc2137fe640 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281df720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc212ffd640 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281df720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc212ffd640 1 -- 172.21.15.137:0/2498663213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 msgr2=0x55d828175360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc213fff640 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d828175360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc212ffd640 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d828175360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc212ffd640 1 -- 172.21.15.137:0/2498663213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8281bb800 con 0x55d8281a23b0 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc212ffd640 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281dfc60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc208035040 tx=0x7fc2080aa800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a417324f50a4a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc1f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc1f27fc640 1 -- 172.21.15.137:0/2498663213 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20804b070 con 0x55d8281a23b0 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc1f27fc640 1 -- 172.21.15.137:0/2498663213 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7fc2080767a0 con 0x55d8281a23b0 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc21cda9740 1 -- 172.21.15.137:0/2498663213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc20802ae50 con 0x55d8281a23b0 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc1f27fc640 1 -- 172.21.15.137:0/2498663213 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fc20807e4e0 con 0x55d8281a23b0 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc21cda9740 10 client.7932 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:13.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc21cda9740 1 -- 172.21.15.137:0/2498663213 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x55d8281b28d0 con 0x55d8281a23b0 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc1f27fc640 1 -- 172.21.15.137:0/2498663213 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20802ae50 con 0x55d8281a23b0 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc1f27fc640 1 -- 172.21.15.137:0/2498663213 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7fc208082880 con 0x55d8281a23b0 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc21cda9740 10 client.7932 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc21cda9740 10 client.7932 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc21cda9740 20 client.7932 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc21cda9740 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55d8281cc740 0x55d8281ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc21cda9740 4 client.7932 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc21cda9740 1 -- 172.21.15.137:0/2498663213 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "status"}) -- 0x55d8280e31c0 con 0x55d8281cc740 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.778+0000 7fc2137fe640 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55d8281cc740 0x55d8281ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc1f27fc640 10 client.7932 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc2137fe640 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55d8281cc740 0x55d8281ccb20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9a106576ece5d93 server_cookie=bdefc8a71b0086f0 in_seq=0 out_seq=0 2024-04-26T22:05:13.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc1f27fc640 1 -- 172.21.15.137:0/2498663213 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d8280e31c0 con 0x55d8281cc740 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc1f27fc640 10 client.7932 handle_command_reply: tid=0 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 client.7932 shutdown 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 -- 172.21.15.137:0/2498663213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 msgr2=0x55d8281dfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281dfc60 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc208035040 tx=0x7fc2080aa800 comp rx=0 tx=0).stop 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 -- 172.21.15.137:0/2498663213 shutdown_connections 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55d8281cc740 0x55d8281ccb20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d8281a23b0 0x55d8281dfc60 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8281bece0 0x55d828175360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 --2- 172.21.15.137:0/2498663213 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d8281a1440 0x55d8281df720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 -- 172.21.15.137:0/2498663213 >> 172.21.15.137:0/2498663213 conn(0x55d828177120 msgr2=0x55d8281b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc1f27fc640 0 client.7932 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 -- 172.21.15.137:0/2498663213 shutdown_connections 2024-04-26T22:05:13.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 1 -- 172.21.15.137:0/2498663213 wait complete. 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.779+0000 7fc21cda9740 20 client.7932 trim_cache size 0 max 16384 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 7845, 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.3906283019999996, 2024-04-26T22:05:13.787 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 60, 2024-04-26T22:05:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 91, 2024-04-26T22:05:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 91, 2024-04-26T22:05:13.788 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 5.3641140869999999 2024-04-26T22:05:13.788 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 -- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc20006c8f0 msgr2=0x7fc20006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc20006c8f0 0x7fc20006edb0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc2141f6750 tx=0x7fc204008040 comp rx=0 tx=0).stop 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 -- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b5fd0 msgr2=0x7fc21413de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b5fd0 0x7fc21413de90 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fc2080097a0 tx=0x7fc2080046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 -- 172.21.15.137:0/761301982 shutdown_connections 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc20006c8f0 0x7fc20006edb0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2140b5fd0 0x7fc21413de90 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc214145980 0x7fc21406eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 --2- 172.21.15.137:0/761301982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2140b3de0 0x7fc21415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 -- 172.21.15.137:0/761301982 >> 172.21.15.137:0/761301982 conn(0x7fc2140d0d30 msgr2=0x7fc2140b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:13.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 -- 172.21.15.137:0/761301982 shutdown_connections 2024-04-26T22:05:13.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.780+0000 7fc21a093640 1 -- 172.21.15.137:0/761301982 wait complete. 2024-04-26T22:05:13.791 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:05:13.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.886+0000 7f521a285640 1 Processor -- start 2024-04-26T22:05:13.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.886+0000 7f521a285640 1 -- start start 2024-04-26T22:05:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.887+0000 7f521a285640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f521415f2d0 0x7f52140b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.887+0000 7f521a285640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f52140d0160 0x7f52140d32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.887+0000 7f521a285640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52140d07d0 con 0x7f52140d2ea0 2024-04-26T22:05:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.887+0000 7f521a285640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f52140d3820 con 0x7f52140d0160 2024-04-26T22:05:13.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.887+0000 7f521a285640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f521415f6b0 con 0x7f521415f2d0 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.887+0000 7f5218822640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f52140d0160 0x7f52140d32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.887+0000 7f52137fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f52140d2ea0 0x7f52140cfa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49190/0 (socket says 172.21.15.137:49190) 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.887+0000 7f5218822640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f52140d0160 0x7f52140d32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41336/0 (socket says 172.21.15.137:41336) 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.887+0000 7f52137fe640 1 -- 172.21.15.137:0/173701390 learned_addr learned my addr 172.21.15.137:0/173701390 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.888+0000 7f5213fff640 1 --2- 172.21.15.137:0/173701390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f521415f2d0 0x7f52140b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.888+0000 7f5218822640 1 -- 172.21.15.137:0/173701390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f521415f2d0 msgr2=0x7f52140b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.888+0000 7f5218822640 1 --2- 172.21.15.137:0/173701390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f521415f2d0 0x7f52140b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.888+0000 7f5218822640 1 -- 172.21.15.137:0/173701390 >> v1:172.21.15.137:6789/0 conn(0x7f52140d2ea0 legacy=0x7f52140cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.888+0000 7f5212ffd640 1 -- 172.21.15.137:0/173701390 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525831190 0 0) 0x7f52140d07d0 con 0x7f52140d2ea0 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.888+0000 7f5218822640 1 -- 172.21.15.137:0/173701390 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52140b2ca0 con 0x7f52140d0160 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.888+0000 7f5213fff640 1 --2- 172.21.15.137:0/173701390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f521415f2d0 0x7f52140b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.888+0000 7f5218822640 1 --2- 172.21.15.137:0/173701390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d0160 0x7f52140d32e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f520c009d90 tx=0x7f520c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226e3457d8a48e68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f5212ffd640 1 -- 172.21.15.137:0/173701390 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c007740 con 0x7f52140d0160 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f5212ffd640 1 -- 172.21.15.137:0/173701390 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f520c0078e0 con 0x7f52140d0160 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f5212ffd640 1 -- 172.21.15.137:0/173701390 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520c007cb0 con 0x7f52140d0160 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f521a285640 1 -- 172.21.15.137:0/173701390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d0160 msgr2=0x7f52140d32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f521a285640 1 --2- 172.21.15.137:0/173701390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d0160 0x7f52140d32e0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f520c009d90 tx=0x7f520c02a660 comp rx=0 tx=0).stop 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f521a285640 1 -- 172.21.15.137:0/173701390 shutdown_connections 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f521a285640 1 --2- 172.21.15.137:0/173701390 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d0160 0x7f52140d32e0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f521a285640 1 --2- 172.21.15.137:0/173701390 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f521415f2d0 0x7f52140b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f521a285640 1 -- 172.21.15.137:0/173701390 >> 172.21.15.137:0/173701390 conn(0x7f521409ba40 msgr2=0x7f521409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f521a285640 1 -- 172.21.15.137:0/173701390 shutdown_connections 2024-04-26T22:05:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.889+0000 7f521a285640 1 -- 172.21.15.137:0/173701390 wait complete. 2024-04-26T22:05:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.890+0000 7f521a285640 1 Processor -- start 2024-04-26T22:05:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.890+0000 7f521a285640 1 -- start start 2024-04-26T22:05:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f521a285640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52140d0160 0x7f521414b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f521a285640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d2ea0 0x7f521414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f521a285640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f521415f2d0 0x7f5214162e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f521a285640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f52140b3540 con 0x7f52140d2ea0 2024-04-26T22:05:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f521a285640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f52140b3260 con 0x7f521415f2d0 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f521a285640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f521406d3b0 con 0x7f52140d0160 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f52137fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d2ea0 0x7f521414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f52137fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d2ea0 0x7f521414df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41344/0 (socket says 172.21.15.137:41344) 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f52137fe640 1 -- 172.21.15.137:0/4152816635 learned_addr learned my addr 172.21.15.137:0/4152816635 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f5213fff640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52140d0160 0x7f521414b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.891+0000 7f5218822640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f521415f2d0 0x7f5214162e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f52137fe640 1 -- 172.21.15.137:0/4152816635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52140d0160 msgr2=0x7f521414b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f52137fe640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52140d0160 0x7f521414b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f52137fe640 1 -- 172.21.15.137:0/4152816635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f521415f2d0 msgr2=0x7f5214162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f52137fe640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f521415f2d0 0x7f5214162e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f52137fe640 1 -- 172.21.15.137:0/4152816635 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521414e780 con 0x7f52140d2ea0 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f52137fe640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d2ea0 0x7f521414df30 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f520800c4d0 tx=0x7f520800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f5210ff9640 1 -- 172.21.15.137:0/4152816635 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208018070 con 0x7f52140d2ea0 2024-04-26T22:05:13.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f5210ff9640 1 -- 172.21.15.137:0/4152816635 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5208007500 con 0x7f52140d2ea0 2024-04-26T22:05:13.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f5210ff9640 1 -- 172.21.15.137:0/4152816635 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5208004a20 con 0x7f52140d2ea0 2024-04-26T22:05:13.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521414ea60 con 0x7f52140d2ea0 2024-04-26T22:05:13.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.892+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521414bea0 con 0x7f52140d2ea0 2024-04-26T22:05:13.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.893+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521406a290 con 0x7f52140d2ea0 2024-04-26T22:05:13.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.893+0000 7f5210ff9640 1 -- 172.21.15.137:0/4152816635 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5208004bc0 con 0x7f52140d2ea0 2024-04-26T22:05:13.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.894+0000 7f5210ff9640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f520006c8f0 0x7f520006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:13.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.894+0000 7f5213fff640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f520006c8f0 0x7f520006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:13.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.894+0000 7f5210ff9640 1 -- 172.21.15.137:0/4152816635 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f520808adf0 con 0x7f52140d2ea0 2024-04-26T22:05:13.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.894+0000 7f5213fff640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f520006c8f0 0x7f520006edb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5204006e80 tx=0x7f5204008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:13.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:13.898+0000 7f5210ff9640 1 -- 172.21.15.137:0/4152816635 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5208058b70 con 0x7f52140d2ea0 2024-04-26T22:05:14.080 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:05:14.083 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:05:14.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.110+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f52140b2970 con 0x7f52140d2ea0 2024-04-26T22:05:14.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.110+0000 7f5210ff9640 1 -- 172.21.15.137:0/4152816635 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) ==== 53+0+73 (secure 0 0 0) 0x7f520805ce70 con 0x7f52140d2ea0 2024-04-26T22:05:14.110 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:05:14.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f520006c8f0 msgr2=0x7f520006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:14.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f520006c8f0 0x7f520006edb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5204006e80 tx=0x7f5204008040 comp rx=0 tx=0).stop 2024-04-26T22:05:14.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d2ea0 msgr2=0x7f521414df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:14.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d2ea0 0x7f521414df30 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f520800c4d0 tx=0x7f520800c990 comp rx=0 tx=0).stop 2024-04-26T22:05:14.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 shutdown_connections 2024-04-26T22:05:14.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f520006c8f0 0x7f520006edb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:14.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f52140d2ea0 0x7f521414df30 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:14.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f521415f2d0 0x7f5214162e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:14.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 --2- 172.21.15.137:0/4152816635 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f52140d0160 0x7f521414b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:14.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 >> 172.21.15.137:0/4152816635 conn(0x7f521409ba40 msgr2=0x7f52140b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:14.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 shutdown_connections 2024-04-26T22:05:14.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14.112+0000 7f521a285640 1 -- 172.21.15.137:0/4152816635 wait complete. 2024-04-26T22:05:14.123 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:05:14.123 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:05:14.123 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:05:14.123 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:05:14.123 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:05:14.123 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:05:14.123 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:05:14.123 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:05:14.123 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:05:14.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:14.124 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:05:14.182 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:05:14.182 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:05:14.182 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:05:14.182 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:05:14.182 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:05:14.182 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:05:14.182 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42392sec preferred_lft 42392sec 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:05:14.183 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:05:14.184 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:05:14.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:14.185 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:05:14.244 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:05:14.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:14.246 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:05:14.301 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:05:14.301 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:05:14.301 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:05:14.301 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:05:14.301 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:05:14.301 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:05:14.302 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:05:14.302 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:05:14.302 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:05:14.302 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:05:14.302 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:05:14.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:05:14.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:05:14.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:14.426 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:05:14.440 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:05:14.440 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:05:14.441 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:05:14.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:14.441 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:05:14.504 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:05:14.504 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:05:14.559 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:05:14.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:05:14.560 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:05:14.614 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:05:14.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:14.614 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:05:14.695 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:05:14.696 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:05:14.703 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:05:14.703 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:05:14.703 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:05:14.703 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:05:14.703 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:05:14.703 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:05:14.703 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:05:14.703 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:05:14.703 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:05:14.704 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:05:14.705 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:05:14.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:14.705 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:05:14.770 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:05:14.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:05:14.860 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:05:14.866 INFO:teuthology.orchestra.run.smithi137.stdout:client6745 2024-04-26T22:05:14.866 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:05:14.866 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:14.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:14.882 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-26T22:05:15.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.022+0000 7f5cec3e6640 1 Processor -- start 2024-04-26T22:05:15.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.022+0000 7f5cec3e6640 1 -- start start 2024-04-26T22:05:15.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.023+0000 7f5cec3e6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5ce40b46f0 0x7f5ce40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.023+0000 7f5cec3e6640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5ce40b63f0 0x7f5ce40b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.023+0000 7f5cec3e6640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce40b5700 con 0x7f5ce406d2b0 2024-04-26T22:05:15.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.023+0000 7f5cec3e6640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5ce40b5f60 con 0x7f5ce40b46f0 2024-04-26T22:05:15.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.023+0000 7f5cec3e6640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5ce40b5140 con 0x7f5ce40b63f0 2024-04-26T22:05:15.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.023+0000 7f5ce9981640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5ce40b46f0 0x7f5ce40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5cea182640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5ce406d2b0 0x7f5ce406d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49204/0 (socket says 172.21.15.137:49204) 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5ce9981640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5ce40b46f0 0x7f5ce40b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41352/0 (socket says 172.21.15.137:41352) 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5cea182640 1 -- 172.21.15.137:0/2291559801 learned_addr learned my addr 172.21.15.137:0/2291559801 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5cea983640 1 --2- 172.21.15.137:0/2291559801 >> v2:172.21.15.170:3300/0 conn(0x7f5ce40b63f0 0x7f5ce40b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5ce9981640 1 -- 172.21.15.137:0/2291559801 >> v2:172.21.15.170:3300/0 conn(0x7f5ce40b63f0 msgr2=0x7f5ce40b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5ce9981640 1 --2- 172.21.15.137:0/2291559801 >> v2:172.21.15.170:3300/0 conn(0x7f5ce40b63f0 0x7f5ce40b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5ce9981640 1 -- 172.21.15.137:0/2291559801 >> v1:172.21.15.137:6789/0 conn(0x7f5ce406d2b0 legacy=0x7f5ce406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5ce9981640 1 -- 172.21.15.137:0/2291559801 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce40b5420 con 0x7f5ce40b46f0 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5ce9180640 1 -- 172.21.15.137:0/2291559801 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248895146 0 0) 0x7f5ce40b5700 con 0x7f5ce406d2b0 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.024+0000 7f5ce9981640 1 --2- 172.21.15.137:0/2291559801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b46f0 0x7f5ce40b4b50 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40b3380 tx=0x7f5cd402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e05be699e1aafaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5ce9180640 1 -- 172.21.15.137:0/2291559801 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4037070 con 0x7f5ce40b46f0 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5ce9180640 1 -- 172.21.15.137:0/2291559801 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd4032440 con 0x7f5ce40b46f0 2024-04-26T22:05:15.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5ce9180640 1 -- 172.21.15.137:0/2291559801 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4032810 con 0x7f5ce40b46f0 2024-04-26T22:05:15.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5cec3e6640 1 -- 172.21.15.137:0/2291559801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b46f0 msgr2=0x7f5ce40b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5cec3e6640 1 --2- 172.21.15.137:0/2291559801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b46f0 0x7f5ce40b4b50 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40b3380 tx=0x7f5cd402a1a0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5cec3e6640 1 -- 172.21.15.137:0/2291559801 shutdown_connections 2024-04-26T22:05:15.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5cec3e6640 1 --2- 172.21.15.137:0/2291559801 >> v2:172.21.15.170:3300/0 conn(0x7f5ce40b63f0 0x7f5ce40b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5cec3e6640 1 --2- 172.21.15.137:0/2291559801 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b46f0 0x7f5ce40b4b50 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5cec3e6640 1 -- 172.21.15.137:0/2291559801 >> 172.21.15.137:0/2291559801 conn(0x7f5ce4072900 msgr2=0x7f5ce4072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5cec3e6640 1 -- 172.21.15.137:0/2291559801 shutdown_connections 2024-04-26T22:05:15.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.025+0000 7f5cec3e6640 1 -- 172.21.15.137:0/2291559801 wait complete. 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.026+0000 7f5cec3e6640 1 Processor -- start 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cec3e6640 1 -- start start 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cec3e6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ce406d2b0 0x7f5ce4141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cec3e6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce40b46f0 0x7f5ce40aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cec3e6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b63f0 0x7f5ce40ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cec3e6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce40d12e0 con 0x7f5ce40b63f0 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cec3e6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce40d1160 con 0x7f5ce40b46f0 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cec3e6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce4145490 con 0x7f5ce406d2b0 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cea983640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b63f0 0x7f5ce40ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cea983640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b63f0 0x7f5ce40ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41356/0 (socket says 172.21.15.137:41356) 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.027+0000 7f5cea983640 1 -- 172.21.15.137:0/3895921022 learned_addr learned my addr 172.21.15.137:0/3895921022 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cea983640 1 -- 172.21.15.137:0/3895921022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ce406d2b0 msgr2=0x7f5ce4141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cea983640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ce406d2b0 0x7f5ce4141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cea983640 1 -- 172.21.15.137:0/3895921022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce40b46f0 msgr2=0x7f5ce40aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cea983640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce40b46f0 0x7f5ce40aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cea983640 1 -- 172.21.15.137:0/3895921022 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce40aad30 con 0x7f5ce40b63f0 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cea983640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b63f0 0x7f5ce40ceaa0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00d800 tx=0x7f5cdc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cdaffd640 1 -- 172.21.15.137:0/3895921022 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00b6c0 con 0x7f5ce40b63f0 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cdaffd640 1 -- 172.21.15.137:0/3895921022 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc019070 con 0x7f5ce40b63f0 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cec3e6640 1 -- 172.21.15.137:0/3895921022 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce40ab010 con 0x7f5ce40b63f0 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cdaffd640 1 -- 172.21.15.137:0/3895921022 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc00bac0 con 0x7f5ce40b63f0 2024-04-26T22:05:15.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.028+0000 7f5cec3e6640 1 -- 172.21.15.137:0/3895921022 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce40ab5d0 con 0x7f5ce40b63f0 2024-04-26T22:05:15.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.029+0000 7f5cdaffd640 1 -- 172.21.15.137:0/3895921022 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5cdc00bc60 con 0x7f5ce40b63f0 2024-04-26T22:05:15.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.030+0000 7f5cdaffd640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5cc806c920 0x7f5cc806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.030+0000 7f5cdaffd640 1 -- 172.21.15.137:0/3895921022 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f5cdc08c040 con 0x7f5ce40b63f0 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.030+0000 7f5cea182640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5cc806c920 0x7f5cc806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.030+0000 7f5cea182640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5cc806c920 0x7f5cc806ede0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0007fd0 tx=0x7f5ce0007ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.031+0000 7f5cef1d8740 1 Processor -- start 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.031+0000 7f5cef1d8740 1 -- start start 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b835a0fd0 0x559b83553960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b83583470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835839b0 0x559b835587c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559b834bdb00 con 0x559b835840f0 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x559b83459920 con 0x559b835839b0 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x559b834b9ac0 con 0x559b835a0fd0 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5ce9981640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b83583470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5ce9981640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b83583470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41358/0 (socket says 172.21.15.137:41358) 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5ce9981640 1 -- 172.21.15.137:0/3483658716 learned_addr learned my addr 172.21.15.137:0/3483658716 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5cea182640 1 --2- 172.21.15.137:0/3483658716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b835a0fd0 0x559b83553960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5cea983640 1 --2- 172.21.15.137:0/3483658716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835839b0 0x559b835587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5ce9981640 1 -- 172.21.15.137:0/3483658716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b835a0fd0 msgr2=0x559b83553960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5ce9981640 1 --2- 172.21.15.137:0/3483658716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b835a0fd0 0x559b83553960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5ce9981640 1 -- 172.21.15.137:0/3483658716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835839b0 msgr2=0x559b835587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5ce9981640 1 --2- 172.21.15.137:0/3483658716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835839b0 0x559b835587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.032+0000 7f5ce9981640 1 -- 172.21.15.137:0/3483658716 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b832977e0 con 0x559b835840f0 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5ce9981640 1 --2- 172.21.15.137:0/3483658716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b83583470 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5cd402a790 tx=0x7f5cd402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c306f9c2f5be71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cc7fff640 1 -- 172.21.15.137:0/3483658716 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4037040 con 0x559b835840f0 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cc7fff640 1 -- 172.21.15.137:0/3483658716 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd4042070 con 0x559b835840f0 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cc7fff640 1 -- 172.21.15.137:0/3483658716 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd403d880 con 0x559b835840f0 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3483658716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 msgr2=0x559b83583470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3483658716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b83583470 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5cd402a790 tx=0x7f5cd402c070 comp rx=0 tx=0).stop 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3483658716 shutdown_connections 2024-04-26T22:05:15.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3483658716 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b83583470 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3483658716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835839b0 0x559b835587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3483658716 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b835a0fd0 0x559b83553960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3483658716 >> 172.21.15.137:0/3483658716 conn(0x559b83555bd0 msgr2=0x559b8359e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.033+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3483658716 shutdown_connections 2024-04-26T22:05:15.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.034+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3483658716 wait complete. 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.034+0000 7f5cef1d8740 1 -- start start 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.034+0000 7f5cef1d8740 1 Processor -- start 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b8359ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 0x559b8357b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 0x559b835a1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x559b83557d80 con 0x559b835840f0 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x559b834575d0 con 0x559b835a0fd0 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x559b83557170 con 0x559b83585a30 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cef1d8740 10 client.0 _ll_register_callbacks cb 0x559b83445080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cea182640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b8359ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cea182640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b8359ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41360/0 (socket says 172.21.15.137:41360) 2024-04-26T22:05:15.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cea182640 1 -- 172.21.15.137:0/2596430592 learned_addr learned my addr 172.21.15.137:0/2596430592 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5ce9981640 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 0x559b8357b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cea983640 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 0x559b835a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cea182640 1 -- 172.21.15.137:0/2596430592 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 msgr2=0x559b835a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cea182640 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 0x559b835a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cea182640 1 -- 172.21.15.137:0/2596430592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 msgr2=0x559b8357b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cea182640 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 0x559b8357b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.035+0000 7f5cea182640 1 -- 172.21.15.137:0/2596430592 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b832f7f70 con 0x559b835840f0 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cea182640 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b8359ceb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00073b0 tx=0x7f5ce0001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3201d603654aaeb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cc57fa640 1 -- 172.21.15.137:0/2596430592 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0015940 con 0x559b835840f0 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cef1d8740 1 -- 172.21.15.137:0/2596430592 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cd4042070 con 0x559b835840f0 2024-04-26T22:05:15.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cc57fa640 1 -- 172.21.15.137:0/2596430592 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f5ce0015ae0 con 0x559b835840f0 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cc57fa640 1 -- 172.21.15.137:0/2596430592 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f5ce0015ce0 con 0x559b835840f0 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cef1d8740 10 client.7956 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cef1d8740 1 -- 172.21.15.137:0/2596430592 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x559b8318f170 con 0x559b835840f0 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cc57fa640 1 -- 172.21.15.137:0/2596430592 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd4042070 con 0x559b835840f0 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cc57fa640 1 -- 172.21.15.137:0/2596430592 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7f5ce002e080 con 0x559b835840f0 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cef1d8740 10 client.7956 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cef1d8740 10 client.7956 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cef1d8740 20 client.7956 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x559b835b1aa0 0x559b835b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cef1d8740 4 client.7956 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5cef1d8740 1 -- 172.21.15.137:0/2596430592 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b834cb710 con 0x559b835b1aa0 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.036+0000 7f5ce9981640 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x559b835b1aa0 0x559b835b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cc57fa640 10 client.7956 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:15.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5ce9981640 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x559b835b1aa0 0x559b835b1ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5afc1e6b50aad74 server_cookie=902f7fbafc19fc7f in_seq=0 out_seq=0 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cc57fa640 1 -- 172.21.15.137:0/2596430592 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559b834cb710 con 0x559b835b1aa0 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cc57fa640 10 client.7956 handle_command_reply: tid=0 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 client.7956 shutdown 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 -- 172.21.15.137:0/2596430592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 msgr2=0x559b8359ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b8359ceb0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f5ce00073b0 tx=0x7f5ce0001400 comp rx=0 tx=0).stop 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 -- 172.21.15.137:0/2596430592 shutdown_connections 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x559b835b1aa0 0x559b835b1ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 0x559b835a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 0x559b8357b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cc57fa640 0 client.7956 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/2596430592 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b8359ceb0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 -- 172.21.15.137:0/2596430592 >> 172.21.15.137:0/2596430592 conn(0x559b835839b0 msgr2=0x559b835530e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 -- 172.21.15.137:0/2596430592 shutdown_connections 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.037+0000 7f5cef1d8740 1 -- 172.21.15.137:0/2596430592 wait complete. 2024-04-26T22:05:15.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.038+0000 7f5cef1d8740 20 client.7956 trim_cache size 0 max 16384 2024-04-26T22:05:15.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.055+0000 7f5cef1d8740 1 Processor -- start 2024-04-26T22:05:15.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.055+0000 7f5cef1d8740 1 -- start start 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b835840f0 0x559b83594990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b83585a30 0x559b835546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835a0fd0 0x559b83554be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41ff660 con 0x559b835a0fd0 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce41fe6a0 con 0x559b83585a30 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce40aea10 con 0x559b835840f0 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cea983640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835a0fd0 0x559b83554be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cea983640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835a0fd0 0x559b83554be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41368/0 (socket says 172.21.15.137:41368) 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cea983640 1 -- 172.21.15.137:0/3203119897 learned_addr learned my addr 172.21.15.137:0/3203119897 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cea983640 1 -- 172.21.15.137:0/3203119897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b835840f0 msgr2=0x559b83594990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cea983640 1 --2- 172.21.15.137:0/3203119897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b835840f0 0x559b83594990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cea983640 1 -- 172.21.15.137:0/3203119897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b83585a30 msgr2=0x559b835546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cea983640 1 --2- 172.21.15.137:0/3203119897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b83585a30 0x559b835546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cea983640 1 -- 172.21.15.137:0/3203119897 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b835a1c00 con 0x559b835a0fd0 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cea983640 1 --2- 172.21.15.137:0/3203119897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835a0fd0 0x559b83554be0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc059c30 tx=0x7f5cdc020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d1b4984a0cced server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cc77fe640 1 -- 172.21.15.137:0/3203119897 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc062880 con 0x559b835a0fd0 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cc77fe640 1 -- 172.21.15.137:0/3203119897 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc08a5b0 con 0x559b835a0fd0 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.056+0000 7f5cc77fe640 1 -- 172.21.15.137:0/3203119897 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0721d0 con 0x559b835a0fd0 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.057+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3203119897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835a0fd0 msgr2=0x559b83554be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.057+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3203119897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835a0fd0 0x559b83554be0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc059c30 tx=0x7f5cdc020040 comp rx=0 tx=0).stop 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.057+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3203119897 shutdown_connections 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.057+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3203119897 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835a0fd0 0x559b83554be0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.057+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3203119897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b83585a30 0x559b835546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.057+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3203119897 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b835840f0 0x559b83594990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.057+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3203119897 >> 172.21.15.137:0/3203119897 conn(0x559b835839b0 msgr2=0x559b83559460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.057+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3203119897 shutdown_connections 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.057+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3203119897 wait complete. 2024-04-26T22:05:15.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.058+0000 7f5cef1d8740 1 -- start start 2024-04-26T22:05:15.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.058+0000 7f5cef1d8740 1 Processor -- start 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.058+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b835c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.058+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 0x559b835c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cef1d8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 0x559b83552850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce40af060 con 0x559b835840f0 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x559b83553960 con 0x559b835a0fd0 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cef1d8740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x559b835c14d0 con 0x559b83585a30 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cef1d8740 10 client.0 _ll_register_callbacks cb 0x7f5ce000cde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea182640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b835c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea182640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b835c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41382/0 (socket says 172.21.15.137:41382) 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea182640 1 -- 172.21.15.137:0/3152348834 learned_addr learned my addr 172.21.15.137:0/3152348834 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea182640 1 -- 172.21.15.137:0/3152348834 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 msgr2=0x559b835c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea983640 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 0x559b83552850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5ce9981640 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 0x559b835c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea182640 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 0x559b835c1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea182640 1 -- 172.21.15.137:0/3152348834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 msgr2=0x559b83552850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea182640 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 0x559b83552850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea182640 1 -- 172.21.15.137:0/3152348834 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b83580ee0 con 0x559b835840f0 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea983640 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 0x559b83552850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cea182640 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b835c1820 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0002230 tx=0x7f5ce0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b5d4531e37250b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cc57fa640 1 -- 172.21.15.137:0/3152348834 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0012560 con 0x559b835840f0 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cc57fa640 1 -- 172.21.15.137:0/3152348834 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f5ce00237f0 con 0x559b835840f0 2024-04-26T22:05:15.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3152348834 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cdc08a5b0 con 0x559b835840f0 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cc57fa640 1 -- 172.21.15.137:0/3152348834 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f5ce0023a30 con 0x559b835840f0 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cef1d8740 10 client.7962 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3152348834 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x559b83587680 con 0x559b835840f0 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.059+0000 7f5cc57fa640 1 -- 172.21.15.137:0/3152348834 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc08a5b0 con 0x559b835840f0 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cc57fa640 1 -- 172.21.15.137:0/3152348834 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7f5ce0023bd0 con 0x559b835840f0 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cef1d8740 10 client.7962 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cef1d8740 10 client.7962 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cef1d8740 20 client.7962 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x559b8361c3c0 0x559b83552d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cef1d8740 4 client.7962 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3152348834 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) -- 0x559b834c5580 con 0x559b8361c3c0 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5ce9981640 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x559b8361c3c0 0x559b83552d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cc57fa640 10 client.7962 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:15.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5ce9981640 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x559b8361c3c0 0x559b83552d90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26e48c7fb1f6868c server_cookie=10374ce67c56806a in_seq=0 out_seq=0 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cc57fa640 1 -- 172.21.15.137:0/3152348834 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559b834c5580 con 0x559b8361c3c0 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cc57fa640 10 client.7962 handle_command_reply: tid=0 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.060+0000 7f5cef1d8740 1 client.7962 shutdown 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3152348834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 msgr2=0x559b835c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b835c1820 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0002230 tx=0x7f5ce0007000 comp rx=0 tx=0).stop 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3152348834 shutdown_connections 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x559b8361c3c0 0x559b83552d90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b835a0fd0 0x559b83552850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x559b83585a30 0x559b835c1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cc57fa640 0 client.7962 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 --2- 172.21.15.137:0/3152348834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x559b835840f0 0x559b835c1820 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3152348834 >> 172.21.15.137:0/3152348834 conn(0x559b835839b0 msgr2=0x559b83559460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3152348834 shutdown_connections 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 1 -- 172.21.15.137:0/3152348834 wait complete. 2024-04-26T22:05:15.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cef1d8740 20 client.7962 trim_cache size 0 max 16384 2024-04-26T22:05:15.068 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:05:15.068 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:05:15.068 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "bcd6aea1-5172-42e6-b3f0-7356ee6ea170", 2024-04-26T22:05:15.068 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:05:15.068 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cec3e6640 1 -- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5cc806c920 msgr2=0x7f5cc806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cec3e6640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5cc806c920 0x7f5cc806ede0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0007fd0 tx=0x7f5ce0007ce0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cec3e6640 1 -- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b63f0 msgr2=0x7f5ce40ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.061+0000 7f5cec3e6640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b63f0 0x7f5ce40ceaa0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00d800 tx=0x7f5cdc00dcc0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.062+0000 7f5cec3e6640 1 -- 172.21.15.137:0/3895921022 shutdown_connections 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.062+0000 7f5cec3e6640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5cc806c920 0x7f5cc806ede0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.062+0000 7f5cec3e6640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5ce40b63f0 0x7f5ce40ceaa0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.062+0000 7f5cec3e6640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ce40b46f0 0x7f5ce40aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.062+0000 7f5cec3e6640 1 --2- 172.21.15.137:0/3895921022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5ce406d2b0 0x7f5ce4141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.062+0000 7f5cec3e6640 1 -- 172.21.15.137:0/3895921022 >> 172.21.15.137:0/3895921022 conn(0x7f5ce4072900 msgr2=0x7f5ce4141fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.062+0000 7f5cec3e6640 1 -- 172.21.15.137:0/3895921022 shutdown_connections 2024-04-26T22:05:15.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.062+0000 7f5cec3e6640 1 -- 172.21.15.137:0/3895921022 wait complete. 2024-04-26T22:05:15.070 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:05:15.062+0000 7efff620c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x55a17821c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T22:05:15.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:15.072 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-26T22:05:15.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.170+0000 7f735d864640 1 Processor -- start 2024-04-26T22:05:15.171 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.170+0000 7f735d864640 1 -- start start 2024-04-26T22:05:15.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.171+0000 7f735d864640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f73580b2420 0x7f735809c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.171+0000 7f735d864640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f73580d1940 0x7f73580702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.171+0000 7f735d864640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73580cee60 con 0x7f735815d340 2024-04-26T22:05:15.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.171+0000 7f735d864640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f73580ce9d0 con 0x7f73580d1940 2024-04-26T22:05:15.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.171+0000 7f735d864640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f73580d0ff0 con 0x7f73580b2420 2024-04-26T22:05:15.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.171+0000 7f73577fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f73580d1940 0x7f73580702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.171+0000 7f7356ffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f735815d340 0x7f73580d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49216/0 (socket says 172.21.15.137:49216) 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.171+0000 7f7356ffd640 1 -- 172.21.15.137:0/1924188108 learned_addr learned my addr 172.21.15.137:0/1924188108 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.172+0000 7f73567fc640 1 --2- 172.21.15.137:0/1924188108 >> v2:172.21.15.170:3300/0 conn(0x7f73580b2420 0x7f735809c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.172+0000 7f73577fe640 1 -- 172.21.15.137:0/1924188108 >> v2:172.21.15.170:3300/0 conn(0x7f73580b2420 msgr2=0x7f735809c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.172+0000 7f73577fe640 1 --2- 172.21.15.137:0/1924188108 >> v2:172.21.15.170:3300/0 conn(0x7f73580b2420 0x7f735809c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.172+0000 7f73577fe640 1 -- 172.21.15.137:0/1924188108 >> v1:172.21.15.137:6789/0 conn(0x7f735815d340 legacy=0x7f73580d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.172+0000 7f73577fe640 1 -- 172.21.15.137:0/1924188108 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73580d0d10 con 0x7f73580d1940 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.172+0000 7f7355ffb640 1 -- 172.21.15.137:0/1924188108 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592948411 0 0) 0x7f73580cee60 con 0x7f735815d340 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.172+0000 7f73577fe640 1 --2- 172.21.15.137:0/1924188108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 0x7f73580702a0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f73580d0aa0 tx=0x7f735002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22346cf736ea8ac8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.172+0000 7f7355ffb640 1 -- 172.21.15.137:0/1924188108 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350037070 con 0x7f73580d1940 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f7355ffb640 1 -- 172.21.15.137:0/1924188108 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7350032440 con 0x7f73580d1940 2024-04-26T22:05:15.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f7355ffb640 1 -- 172.21.15.137:0/1924188108 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350032810 con 0x7f73580d1940 2024-04-26T22:05:15.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f735d864640 1 -- 172.21.15.137:0/1924188108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 msgr2=0x7f73580702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f735d864640 1 --2- 172.21.15.137:0/1924188108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 0x7f73580702a0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f73580d0aa0 tx=0x7f735002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f735d864640 1 -- 172.21.15.137:0/1924188108 shutdown_connections 2024-04-26T22:05:15.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f735d864640 1 --2- 172.21.15.137:0/1924188108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 0x7f73580702a0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f735d864640 1 --2- 172.21.15.137:0/1924188108 >> v2:172.21.15.170:3300/0 conn(0x7f73580b2420 0x7f735809c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f735d864640 1 -- 172.21.15.137:0/1924188108 >> 172.21.15.137:0/1924188108 conn(0x7f735809ba40 msgr2=0x7f735809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f735d864640 1 -- 172.21.15.137:0/1924188108 shutdown_connections 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.173+0000 7f735d864640 1 -- 172.21.15.137:0/1924188108 wait complete. 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.174+0000 7f735d864640 1 Processor -- start 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.174+0000 7f735d864640 1 -- start start 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f735d864640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 0x7f735809f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f735d864640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f735815d340 0x7f73580b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f735d864640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73580b2990 0x7f7358152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f735d864640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73580b2090 con 0x7f73580d1940 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f735d864640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f735815d720 con 0x7f73580b2990 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f735d864640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f73580b2210 con 0x7f735815d340 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f7356ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 0x7f735809f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f7356ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 0x7f735809f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41400/0 (socket says 172.21.15.137:41400) 2024-04-26T22:05:15.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f7356ffd640 1 -- 172.21.15.137:0/4233224892 learned_addr learned my addr 172.21.15.137:0/4233224892 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f73567fc640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f735815d340 0x7f73580b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f73577fe640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73580b2990 0x7f7358152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f7356ffd640 1 -- 172.21.15.137:0/4233224892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f735815d340 msgr2=0x7f73580b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f7356ffd640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f735815d340 0x7f73580b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f7356ffd640 1 -- 172.21.15.137:0/4233224892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73580b2990 msgr2=0x7f7358152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f7356ffd640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73580b2990 0x7f7358152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f7356ffd640 1 -- 172.21.15.137:0/4233224892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f735809fac0 con 0x7f73580d1940 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.175+0000 7f73577fe640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73580b2990 0x7f7358152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.176+0000 7f7356ffd640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 0x7f735809f190 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f734800c7c0 tx=0x7f734800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.176+0000 7f734ffff640 1 -- 172.21.15.137:0/4233224892 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348018070 con 0x7f73580d1940 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.176+0000 7f734ffff640 1 -- 172.21.15.137:0/4233224892 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f734800a5e0 con 0x7f73580d1940 2024-04-26T22:05:15.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.176+0000 7f734ffff640 1 -- 172.21.15.137:0/4233224892 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734800a9d0 con 0x7f73580d1940 2024-04-26T22:05:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.176+0000 7f735d864640 1 -- 172.21.15.137:0/4233224892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73580a0080 con 0x7f73580d1940 2024-04-26T22:05:15.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.176+0000 7f735d864640 1 -- 172.21.15.137:0/4233224892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73580a0640 con 0x7f73580d1940 2024-04-26T22:05:15.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.177+0000 7f734ffff640 1 -- 172.21.15.137:0/4233224892 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f734801b070 con 0x7f73580d1940 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.178+0000 7f734ffff640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f733806c8f0 0x7f733806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.178+0000 7f734ffff640 1 -- 172.21.15.137:0/4233224892 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f734808b220 con 0x7f73580d1940 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.178+0000 7f73567fc640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f733806c8f0 0x7f733806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.178+0000 7f73567fc640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f733806c8f0 0x7f733806edb0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f73580ccbf0 tx=0x7f7340008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.178+0000 7f736057e740 1 Processor -- start 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f736057e740 1 -- start start 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f736057e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f736057e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28cb6f0 0x5562d287fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f736057e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d2880350 0x5562d2883850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f736057e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5562d27e9d80 con 0x5562d2880350 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f736057e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5562d27a38b0 con 0x5562d28afd30 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f736057e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5562d27e5d40 con 0x5562d28cb6f0 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f73577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d2880350 0x5562d2883850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f73577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d2880350 0x5562d2883850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41416/0 (socket says 172.21.15.137:41416) 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.179+0000 7f73577fe640 1 -- 172.21.15.137:0/3706274007 learned_addr learned my addr 172.21.15.137:0/3706274007 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f73567fc640 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28cb6f0 0x5562d287fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f7356ffd640 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f73577fe640 1 -- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28cb6f0 msgr2=0x5562d287fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f73577fe640 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28cb6f0 0x5562d287fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f73577fe640 1 -- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 msgr2=0x5562d28b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f73577fe640 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f73577fe640 1 -- 172.21.15.137:0/3706274007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d2774a40 con 0x5562d2880350 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f73567fc640 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28cb6f0 0x5562d287fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f7356ffd640 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f73577fe640 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d2880350 0x5562d2883850 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f735002a1e0 tx=0x7f735002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930d9e7d7a0c6b29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f734d7fa640 1 -- 172.21.15.137:0/3706274007 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350037070 con 0x5562d2880350 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f734d7fa640 1 -- 172.21.15.137:0/3706274007 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7350043070 con 0x5562d2880350 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.180+0000 7f734d7fa640 1 -- 172.21.15.137:0/3706274007 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73500044c0 con 0x5562d2880350 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 -- 172.21.15.137:0/3706274007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d2880350 msgr2=0x5562d2883850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d2880350 0x5562d2883850 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f735002a1e0 tx=0x7f735002c000 comp rx=0 tx=0).stop 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 -- 172.21.15.137:0/3706274007 shutdown_connections 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d2880350 0x5562d2883850 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28cb6f0 0x5562d287fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 --2- 172.21.15.137:0/3706274007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 -- 172.21.15.137:0/3706274007 >> 172.21.15.137:0/3706274007 conn(0x5562d2882080 msgr2=0x5562d28cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 -- 172.21.15.137:0/3706274007 shutdown_connections 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 -- 172.21.15.137:0/3706274007 wait complete. 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.181+0000 7f736057e740 1 -- start start 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f736057e740 1 Processor -- start 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f736057e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28ac080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f736057e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d28b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f736057e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28acda0 0x5562d28cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f736057e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5562d2885840 con 0x5562d28cb6f0 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f736057e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5562d2770d10 con 0x5562d28afd30 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f736057e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5562d2885ae0 con 0x5562d28acda0 2024-04-26T22:05:15.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f736057e740 10 client.0 _ll_register_callbacks cb 0x5562d279d210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f73567fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d28b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f73567fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d28b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41422/0 (socket says 172.21.15.137:41422) 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.182+0000 7f73567fc640 1 -- 172.21.15.137:0/1912663379 learned_addr learned my addr 172.21.15.137:0/1912663379 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f7356ffd640 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73567fc640 1 -- 172.21.15.137:0/1912663379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28acda0 msgr2=0x5562d28cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73567fc640 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28acda0 0x5562d28cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73567fc640 1 -- 172.21.15.137:0/1912663379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 msgr2=0x5562d28ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73567fc640 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28ac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73567fc640 1 -- 172.21.15.137:0/1912663379 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d25c57d0 con 0x5562d28cb6f0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73567fc640 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d28b37f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f7340014510 tx=0x7f7340004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4a16d30d1a58b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73367fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73367fc640 1 -- 172.21.15.137:0/1912663379 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7340025020 con 0x5562d28cb6f0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73367fc640 1 -- 172.21.15.137:0/1912663379 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f73400158e0 con 0x5562d28cb6f0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f736057e740 1 -- 172.21.15.137:0/1912663379 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7350043070 con 0x5562d28cb6f0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73367fc640 1 -- 172.21.15.137:0/1912663379 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f734002f050 con 0x5562d28cb6f0 2024-04-26T22:05:15.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f736057e740 10 client.7977 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f736057e740 1 -- 172.21.15.137:0/1912663379 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x5562d24fb3f0 con 0x5562d28cb6f0 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73367fc640 1 -- 172.21.15.137:0/1912663379 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7350043070 con 0x5562d28cb6f0 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f73367fc640 1 -- 172.21.15.137:0/1912663379 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7f7340032020 con 0x5562d28cb6f0 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f736057e740 10 client.7977 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f736057e740 10 client.7977 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f736057e740 20 client.7977 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f736057e740 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5562d28d02e0 0x5562d28d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f736057e740 4 client.7977 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f736057e740 1 -- 172.21.15.137:0/1912663379 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562d27f7990 con 0x5562d28d02e0 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.183+0000 7f7356ffd640 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5562d28d02e0 0x5562d28d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f73367fc640 10 client.7977 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:15.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f7356ffd640 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5562d28d02e0 0x5562d28d0740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7764761aebae3c5 server_cookie=bed2271cb2c5731 in_seq=0 out_seq=0 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f73367fc640 1 -- 172.21.15.137:0/1912663379 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5562d27f7990 con 0x5562d28d02e0 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f73367fc640 10 client.7977 handle_command_reply: tid=0 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f736057e740 1 client.7977 shutdown 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f736057e740 1 -- 172.21.15.137:0/1912663379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 msgr2=0x5562d28b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f736057e740 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d28b37f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f7340014510 tx=0x7f7340004730 comp rx=0 tx=0).stop 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f736057e740 1 -- 172.21.15.137:0/1912663379 shutdown_connections 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f736057e740 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5562d28d02e0 0x5562d28d0740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f736057e740 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d28b37f0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f736057e740 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d28acda0 0x5562d28cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f736057e740 1 --2- 172.21.15.137:0/1912663379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f73367fc640 0 client.7977 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.184+0000 7f736057e740 1 -- 172.21.15.137:0/1912663379 >> 172.21.15.137:0/1912663379 conn(0x5562d2880350 msgr2=0x5562d2886dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.185+0000 7f736057e740 1 -- 172.21.15.137:0/1912663379 shutdown_connections 2024-04-26T22:05:15.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.185+0000 7f736057e740 1 -- 172.21.15.137:0/1912663379 wait complete. 2024-04-26T22:05:15.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.185+0000 7f736057e740 20 client.7977 trim_cache size 0 max 16384 2024-04-26T22:05:15.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.202+0000 7f736057e740 1 Processor -- start 2024-04-26T22:05:15.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.202+0000 7f736057e740 1 -- start start 2024-04-26T22:05:15.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f736057e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28afd30 0x5562d28b0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f736057e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28cb6f0 0x5562d28cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f736057e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 0x5562d28cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f736057e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f73581f7090 con 0x5562d28afd30 2024-04-26T22:05:15.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f736057e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f735806f0b0 con 0x5562d28cb6f0 2024-04-26T22:05:15.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f736057e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f735809dc90 con 0x5562d2881020 2024-04-26T22:05:15.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f7356ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28afd30 0x5562d28b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f7356ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28afd30 0x5562d28b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41428/0 (socket says 172.21.15.137:41428) 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f7356ffd640 1 -- 172.21.15.137:0/3163501075 learned_addr learned my addr 172.21.15.137:0/3163501075 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f7356ffd640 1 -- 172.21.15.137:0/3163501075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 msgr2=0x5562d28cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f7356ffd640 1 --2- 172.21.15.137:0/3163501075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 0x5562d28cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f7356ffd640 1 -- 172.21.15.137:0/3163501075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28cb6f0 msgr2=0x5562d28cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f7356ffd640 1 --2- 172.21.15.137:0/3163501075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28cb6f0 0x5562d28cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f7356ffd640 1 -- 172.21.15.137:0/3163501075 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d24bb0f0 con 0x5562d28afd30 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f7356ffd640 1 --2- 172.21.15.137:0/3163501075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28afd30 0x5562d28b0110 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f734808b1f0 tx=0x7f7348009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b489f268c711f74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f734cff9640 1 -- 172.21.15.137:0/3163501075 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348061a60 con 0x5562d28afd30 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f734cff9640 1 -- 172.21.15.137:0/3163501075 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7348056f20 con 0x5562d28afd30 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.203+0000 7f734cff9640 1 -- 172.21.15.137:0/3163501075 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480554f0 con 0x5562d28afd30 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 -- 172.21.15.137:0/3163501075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28afd30 msgr2=0x5562d28b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 --2- 172.21.15.137:0/3163501075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28afd30 0x5562d28b0110 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f734808b1f0 tx=0x7f7348009040 comp rx=0 tx=0).stop 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 -- 172.21.15.137:0/3163501075 shutdown_connections 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 --2- 172.21.15.137:0/3163501075 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 0x5562d28cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 --2- 172.21.15.137:0/3163501075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28cb6f0 0x5562d28cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 --2- 172.21.15.137:0/3163501075 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28afd30 0x5562d28b0110 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 -- 172.21.15.137:0/3163501075 >> 172.21.15.137:0/3163501075 conn(0x5562d2880350 msgr2=0x5562d28d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 -- 172.21.15.137:0/3163501075 shutdown_connections 2024-04-26T22:05:15.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 -- 172.21.15.137:0/3163501075 wait complete. 2024-04-26T22:05:15.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 -- start start 2024-04-26T22:05:15.206 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.204+0000 7f736057e740 1 Processor -- start 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f736057e740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 0x5562d28cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f736057e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f736057e740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d2948f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f736057e740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5562d28ad2c0 con 0x5562d28cb6f0 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f736057e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f735806ea60 con 0x5562d28afd30 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f736057e740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5562d2882f60 con 0x5562d2881020 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f736057e740 10 client.0 _ll_register_callbacks cb 0x7f734000b1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f73577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d2948f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f73577fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d2948f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41442/0 (socket says 172.21.15.137:41442) 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f73577fe640 1 -- 172.21.15.137:0/3282425174 learned_addr learned my addr 172.21.15.137:0/3282425174 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f73567fc640 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.205+0000 7f7356ffd640 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 0x5562d28cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73577fe640 1 -- 172.21.15.137:0/3282425174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 msgr2=0x5562d28cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73577fe640 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 0x5562d28cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73577fe640 1 -- 172.21.15.137:0/3282425174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 msgr2=0x5562d28cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73577fe640 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73577fe640 1 -- 172.21.15.137:0/3282425174 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d27aa4b0 con 0x5562d28cb6f0 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f7356ffd640 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 0x5562d28cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73577fe640 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d2948f80 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f7350006f80 tx=0x7f73500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed6896d52587c17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73367fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73367fc640 1 -- 172.21.15.137:0/3282425174 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735004b020 con 0x5562d28cb6f0 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73367fc640 1 -- 172.21.15.137:0/3282425174 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f7350003810 con 0x5562d28cb6f0 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f736057e740 1 -- 172.21.15.137:0/3282425174 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7348056f20 con 0x5562d28cb6f0 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73367fc640 1 -- 172.21.15.137:0/3282425174 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f7350055050 con 0x5562d28cb6f0 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f736057e740 10 client.7983 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f736057e740 1 -- 172.21.15.137:0/3282425174 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x5562d28eca10 con 0x5562d28cb6f0 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73367fc640 1 -- 172.21.15.137:0/3282425174 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7348056f20 con 0x5562d28cb6f0 2024-04-26T22:05:15.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f73367fc640 1 -- 172.21.15.137:0/3282425174 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7f7350058020 con 0x5562d28cb6f0 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f736057e740 10 client.7983 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f736057e740 10 client.7983 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f736057e740 20 client.7983 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f736057e740 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5562d2946460 0x5562d29494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f736057e740 4 client.7983 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f736057e740 1 -- 172.21.15.137:0/3282425174 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5562d27f1800 con 0x5562d2946460 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.206+0000 7f7356ffd640 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5562d2946460 0x5562d29494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f73367fc640 10 client.7983 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f7356ffd640 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5562d2946460 0x5562d29494c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7da6d79cb2b8afc server_cookie=97a7c194ae8f9b2d in_seq=0 out_seq=0 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f73367fc640 1 -- 172.21.15.137:0/3282425174 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+263 (crc 0 0 0) 0x5562d27f1800 con 0x5562d2946460 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f73367fc640 10 client.7983 handle_command_reply: tid=0 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 client.7983 shutdown 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 -- 172.21.15.137:0/3282425174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 msgr2=0x5562d2948f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d2948f80 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f7350006f80 tx=0x7f73500042f0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 -- 172.21.15.137:0/3282425174 shutdown_connections 2024-04-26T22:05:15.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5562d2946460 0x5562d29494c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5562d28cb6f0 0x5562d2948f80 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562d28afd30 0x5562d28cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f73367fc640 0 client.7983 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 --2- 172.21.15.137:0/3282425174 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5562d2881020 0x5562d28cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 -- 172.21.15.137:0/3282425174 >> 172.21.15.137:0/3282425174 conn(0x5562d2880350 msgr2=0x5562d28caaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 -- 172.21.15.137:0/3282425174 shutdown_connections 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 1 -- 172.21.15.137:0/3282425174 wait complete. 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.207+0000 7f736057e740 20 client.7983 trim_cache size 0 max 16384 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-26T22:05:15.213 INFO:teuthology.orchestra.run.smithi137.stdout: "bcd6aea1-5172-42e6-b3f0-7356ee6ea170": { 2024-04-26T22:05:15.214 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/dir", 2024-04-26T22:05:15.214 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "bcd6aea1-5172-42e6-b3f0-7356ee6ea170", 2024-04-26T22:05:15.214 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,repair" 2024-04-26T22:05:15.214 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:15.214 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:15.214 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 -- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f733806c8f0 msgr2=0x7f733806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f733806c8f0 0x7f733806edb0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f73580ccbf0 tx=0x7f7340008040 comp rx=0 tx=0).stop 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 -- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 msgr2=0x7f735809f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 0x7f735809f190 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f734800c7c0 tx=0x7f734800cc80 comp rx=0 tx=0).stop 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 -- 172.21.15.137:0/4233224892 shutdown_connections 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f733806c8f0 0x7f733806edb0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73580b2990 0x7f7358152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f735815d340 0x7f73580b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 --2- 172.21.15.137:0/4233224892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f73580d1940 0x7f735809f190 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 -- 172.21.15.137:0/4233224892 >> 172.21.15.137:0/4233224892 conn(0x7f735809ba40 msgr2=0x7f73580b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:15.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 -- 172.21.15.137:0/4233224892 shutdown_connections 2024-04-26T22:05:15.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:15.208+0000 7f735d864640 1 -- 172.21.15.137:0/4233224892 wait complete. 2024-04-26T22:05:15.218 INFO:tasks.cephfs.filesystem:scrub status for tag:bcd6aea1-5172-42e6-b3f0-7356ee6ea170 - {'path': '/dir', 'tag': 'bcd6aea1-5172-42e6-b3f0-7356ee6ea170', 'options': 'recursive,repair'} 2024-04-26T22:05:15.388 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:05:15.388+0000 7efffa214640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:05:44.134 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:05:44.141 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:05:45.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:45.220 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-26T22:05:45.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.330+0000 7f42645af640 1 Processor -- start 2024-04-26T22:05:45.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.330+0000 7f42645af640 1 -- start start 2024-04-26T22:05:45.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.331+0000 7f42645af640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f425c15f260 0x7f425c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.331+0000 7f42645af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.331+0000 7f42645af640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f425c15f640 con 0x7f425c070560 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.331+0000 7f42645af640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f425c06c2a0 con 0x7f425c15f260 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.331+0000 7f42645af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f425c06c580 con 0x7f425c0b4e00 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f4262b4c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f426234b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f425c15f260 0x7f425c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f4262b4c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:49708/0 (socket says 172.21.15.137:49708) 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f426234b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f425c15f260 0x7f425c06d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:57374/0 (socket says 172.21.15.137:57374) 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f4261b4a640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f425c070560 0x7f425c0b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:36276/0 (socket says 172.21.15.137:36276) 2024-04-26T22:05:45.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f4262b4c640 1 -- 172.21.15.137:0/1164260115 learned_addr learned my addr 172.21.15.137:0/1164260115 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f4262b4c640 1 -- 172.21.15.137:0/1164260115 >> v2:172.21.15.170:3300/0 conn(0x7f425c15f260 msgr2=0x7f425c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f4262b4c640 1 --2- 172.21.15.137:0/1164260115 >> v2:172.21.15.170:3300/0 conn(0x7f425c15f260 0x7f425c06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f4262b4c640 1 -- 172.21.15.137:0/1164260115 >> v1:172.21.15.170:6789/0 conn(0x7f425c070560 legacy=0x7f425c0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f4262b4c640 1 -- 172.21.15.137:0/1164260115 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425c06c860 con 0x7f425c0b4e00 2024-04-26T22:05:45.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.332+0000 7f426234b640 1 --2- 172.21.15.137:0/1164260115 >> v2:172.21.15.170:3300/0 conn(0x7f425c15f260 0x7f425c06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:05:45.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.333+0000 7f4262b4c640 1 --2- 172.21.15.137:0/1164260115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c0ae8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4258009e50 tx=0x7f425802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57ee50efde4f962b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.333+0000 7f4261349640 1 -- 172.21.15.137:0/1164260115 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258036070 con 0x7f425c0b4e00 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.333+0000 7f4261349640 1 -- 172.21.15.137:0/1164260115 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4258031600 con 0x7f425c0b4e00 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.333+0000 7f4261349640 1 -- 172.21.15.137:0/1164260115 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580319d0 con 0x7f425c0b4e00 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.334+0000 7f42645af640 1 -- 172.21.15.137:0/1164260115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 msgr2=0x7f425c0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.334+0000 7f42645af640 1 --2- 172.21.15.137:0/1164260115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c0ae8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4258009e50 tx=0x7f425802a710 comp rx=0 tx=0).stop 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.334+0000 7f42645af640 1 -- 172.21.15.137:0/1164260115 shutdown_connections 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.334+0000 7f42645af640 1 --2- 172.21.15.137:0/1164260115 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c0ae8b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.334+0000 7f42645af640 1 --2- 172.21.15.137:0/1164260115 >> v2:172.21.15.170:3300/0 conn(0x7f425c15f260 0x7f425c06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.334+0000 7f42645af640 1 -- 172.21.15.137:0/1164260115 >> 172.21.15.137:0/1164260115 conn(0x7f425c0d1660 msgr2=0x7f425c0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.334+0000 7f42645af640 1 -- 172.21.15.137:0/1164260115 shutdown_connections 2024-04-26T22:05:45.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.334+0000 7f42645af640 1 -- 172.21.15.137:0/1164260115 wait complete. 2024-04-26T22:05:45.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.335+0000 7f42645af640 1 Processor -- start 2024-04-26T22:05:45.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.335+0000 7f42645af640 1 -- start start 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f42645af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f425c070560 0x7f425c0d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f42645af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f42645af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f425c15f260 0x7f425c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f42645af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f425c06d100 con 0x7f425c070560 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f42645af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f425c06ce20 con 0x7f425c15f260 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f42645af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f425c06db60 con 0x7f425c0b4e00 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f426234b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f425c070560 0x7f425c0d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f426234b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f425c070560 0x7f425c0d0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57104/0 (socket says 172.21.15.137:57104) 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f426234b640 1 -- 172.21.15.137:0/2199375839 learned_addr learned my addr 172.21.15.137:0/2199375839 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f4261b4a640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f4262b4c640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f425c15f260 0x7f425c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f426234b640 1 -- 172.21.15.137:0/2199375839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 msgr2=0x7f425c147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f426234b640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f426234b640 1 -- 172.21.15.137:0/2199375839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f425c15f260 msgr2=0x7f425c0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f426234b640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f425c15f260 0x7f425c0ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f426234b640 1 -- 172.21.15.137:0/2199375839 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425c162140 con 0x7f425c070560 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.336+0000 7f426234b640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f425c070560 0x7f425c0d0a70 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f425400e990 tx=0x7f425400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.337+0000 7f4252ffd640 1 -- 172.21.15.137:0/2199375839 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254017070 con 0x7f425c070560 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.337+0000 7f4252ffd640 1 -- 172.21.15.137:0/2199375839 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425400c9e0 con 0x7f425c070560 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.337+0000 7f42645af640 1 -- 172.21.15.137:0/2199375839 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425c162420 con 0x7f425c070560 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.337+0000 7f4252ffd640 1 -- 172.21.15.137:0/2199375839 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425400cdb0 con 0x7f425c070560 2024-04-26T22:05:45.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.337+0000 7f42645af640 1 -- 172.21.15.137:0/2199375839 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425c0ce600 con 0x7f425c070560 2024-04-26T22:05:45.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.338+0000 7f4252ffd640 1 -- 172.21.15.137:0/2199375839 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f425401a070 con 0x7f425c070560 2024-04-26T22:05:45.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.338+0000 7f4252ffd640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424006c920 0x7f424006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.339+0000 7f4252ffd640 1 -- 172.21.15.137:0/2199375839 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f425408bcb0 con 0x7f425c070560 2024-04-26T22:05:45.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.339+0000 7f4261b4a640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424006c920 0x7f424006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.339+0000 7f4261b4a640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424006c920 0x7f424006ede0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f425c06d740 tx=0x7f424c000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.340+0000 7f42673a3740 1 Processor -- start 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.340+0000 7f42673a3740 1 -- start start 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f42673a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283da360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f42673a3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d4e10 0x5585283d8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f42673a3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d90c0 0x5585283d9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f42673a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55852833ed80 con 0x5585283d9f80 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f42673a3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5585282f88b0 con 0x5585283d4e10 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f42673a3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55852833ad40 con 0x5585283d90c0 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f426234b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283da360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f426234b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283da360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57110/0 (socket says 172.21.15.137:57110) 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f426234b640 1 -- 172.21.15.137:0/3744445601 learned_addr learned my addr 172.21.15.137:0/3744445601 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f426234b640 1 -- 172.21.15.137:0/3744445601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d90c0 msgr2=0x5585283d9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f426234b640 1 --2- 172.21.15.137:0/3744445601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d90c0 0x5585283d9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f426234b640 1 -- 172.21.15.137:0/3744445601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d4e10 msgr2=0x5585283d8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f426234b640 1 --2- 172.21.15.137:0/3744445601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d4e10 0x5585283d8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f426234b640 1 -- 172.21.15.137:0/3744445601 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585282c9a40 con 0x5585283d9f80 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f426234b640 1 --2- 172.21.15.137:0/3744445601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283da360 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f425408a110 tx=0x7f425405dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449a1d12316dea2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f423ffff640 1 -- 172.21.15.137:0/3744445601 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4254021070 con 0x5585283d9f80 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f423ffff640 1 -- 172.21.15.137:0/3744445601 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4254057af0 con 0x5585283d9f80 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.341+0000 7f423ffff640 1 -- 172.21.15.137:0/3744445601 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42540560c0 con 0x5585283d9f80 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.342+0000 7f42673a3740 1 -- 172.21.15.137:0/3744445601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 msgr2=0x5585283da360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.342+0000 7f42673a3740 1 --2- 172.21.15.137:0/3744445601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283da360 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f425408a110 tx=0x7f425405dd50 comp rx=0 tx=0).stop 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.342+0000 7f42673a3740 1 -- 172.21.15.137:0/3744445601 shutdown_connections 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.342+0000 7f42673a3740 1 --2- 172.21.15.137:0/3744445601 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d90c0 0x5585283d9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.342+0000 7f42673a3740 1 --2- 172.21.15.137:0/3744445601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d4e10 0x5585283d8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.342+0000 7f42673a3740 1 --2- 172.21.15.137:0/3744445601 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283da360 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.342+0000 7f42673a3740 1 -- 172.21.15.137:0/3744445601 >> 172.21.15.137:0/3744445601 conn(0x5585283d7080 msgr2=0x55852841fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.342+0000 7f42673a3740 1 -- 172.21.15.137:0/3744445601 shutdown_connections 2024-04-26T22:05:45.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.342+0000 7f42673a3740 1 -- 172.21.15.137:0/3744445601 wait complete. 2024-04-26T22:05:45.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.343+0000 7f42673a3740 1 -- start start 2024-04-26T22:05:45.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.343+0000 7f42673a3740 1 Processor -- start 2024-04-26T22:05:45.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f42673a3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 0x5585283fdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f42673a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f42673a3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585284278f0 0x558528427d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f42673a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558528405b10 con 0x5585283d9f80 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f42673a3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5585282c5d10 con 0x5585283d90c0 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f42673a3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558528404f90 con 0x5585284278f0 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f42673a3740 10 client.0 _ll_register_callbacks cb 0x5585282f2210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4261b4a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4261b4a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57114/0 (socket says 172.21.15.137:57114) 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4261b4a640 1 -- 172.21.15.137:0/3207075929 learned_addr learned my addr 172.21.15.137:0/3207075929 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4262b4c640 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585284278f0 0x558528427d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f426234b640 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 0x5585283fdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4261b4a640 1 -- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585284278f0 msgr2=0x558528427d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4261b4a640 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585284278f0 0x558528427d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4261b4a640 1 -- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 msgr2=0x5585283fdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4261b4a640 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 0x5585283fdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4261b4a640 1 -- 172.21.15.137:0/3207075929 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55852811a7d0 con 0x5585283d9f80 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4262b4c640 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585284278f0 0x558528427d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f426234b640 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 0x5585283fdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f4261b4a640 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fa1d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f424c004f80 tx=0x7f424c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adb3ae4b282f4de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f423d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f423d7fa640 1 -- 172.21.15.137:0/3207075929 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c015e60 con 0x5585283d9f80 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f423d7fa640 1 -- 172.21.15.137:0/3207075929 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f424c023ba0 con 0x5585283d9f80 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.344+0000 7f42673a3740 1 -- 172.21.15.137:0/3207075929 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4254057af0 con 0x5585283d9f80 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f423d7fa640 1 -- 172.21.15.137:0/3207075929 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f424c023da0 con 0x5585283d9f80 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f42673a3740 10 client.7992 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f42673a3740 1 -- 172.21.15.137:0/3207075929 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x5585280503f0 con 0x5585283d9f80 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f423d7fa640 1 -- 172.21.15.137:0/3207075929 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4254057af0 con 0x5585283d9f80 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f423d7fa640 1 -- 172.21.15.137:0/3207075929 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7f424c02a050 con 0x5585283d9f80 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f42673a3740 10 client.7992 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f42673a3740 10 client.7992 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f42673a3740 20 client.7992 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f42673a3740 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5585283e3430 0x5585283e4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f42673a3740 4 client.7992 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f42673a3740 1 -- 172.21.15.137:0/3207075929 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55852834c990 con 0x5585283e3430 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f426234b640 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5585283e3430 0x5585283e4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f426234b640 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5585283e3430 0x5585283e4fb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f4e1cb92548b2e4 server_cookie=cf90d9681f227576 in_seq=0 out_seq=0 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.345+0000 7f423d7fa640 10 client.7992 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f423d7fa640 1 -- 172.21.15.137:0/3207075929 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f4254078ae0 con 0x5585283e3430 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f423d7fa640 10 client.7992 handle_command_reply: tid=0 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 client.7992 shutdown 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 -- 172.21.15.137:0/3207075929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 msgr2=0x5585283fa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fa1d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f424c004f80 tx=0x7f424c007e40 comp rx=0 tx=0).stop 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 -- 172.21.15.137:0/3207075929 shutdown_connections 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x5585283e3430 0x5585283e4fb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fa1d0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585284278f0 0x558528427d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 --2- 172.21.15.137:0/3207075929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 0x5585283fdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f423d7fa640 0 client.7992 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:45.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 -- 172.21.15.137:0/3207075929 >> 172.21.15.137:0/3207075929 conn(0x5585283d4e10 msgr2=0x5585283d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 -- 172.21.15.137:0/3207075929 shutdown_connections 2024-04-26T22:05:45.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 1 -- 172.21.15.137:0/3207075929 wait complete. 2024-04-26T22:05:45.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.346+0000 7f42673a3740 20 client.7992 trim_cache size 0 max 16384 2024-04-26T22:05:45.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.364+0000 7f42673a3740 1 Processor -- start 2024-04-26T22:05:45.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.364+0000 7f42673a3740 1 -- start start 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.364+0000 7f42673a3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 0x558528423570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f42673a3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d9f80 0x5585283da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f42673a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585284278f0 0x5585283f9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f42673a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f425c201b60 con 0x5585284278f0 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f42673a3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f425c200c10 con 0x5585283d90c0 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f42673a3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f425c0cf430 con 0x5585283d9f80 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4262b4c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585284278f0 0x5585283f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4262b4c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585284278f0 0x5585283f9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57118/0 (socket says 172.21.15.137:57118) 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4262b4c640 1 -- 172.21.15.137:0/3368793337 learned_addr learned my addr 172.21.15.137:0/3368793337 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4261b4a640 1 --2- 172.21.15.137:0/3368793337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d9f80 0x5585283da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f426234b640 1 --2- 172.21.15.137:0/3368793337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 0x558528423570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4262b4c640 1 -- 172.21.15.137:0/3368793337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d9f80 msgr2=0x5585283da8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4262b4c640 1 --2- 172.21.15.137:0/3368793337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d9f80 0x5585283da8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4262b4c640 1 -- 172.21.15.137:0/3368793337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 msgr2=0x558528423570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4262b4c640 1 --2- 172.21.15.137:0/3368793337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 0x558528423570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4262b4c640 1 -- 172.21.15.137:0/3368793337 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585280100f0 con 0x5585284278f0 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f4262b4c640 1 --2- 172.21.15.137:0/3368793337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585284278f0 0x5585283f9030 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4258034040 tx=0x7f425802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7847b285787666 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f423f7fe640 1 -- 172.21.15.137:0/3368793337 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258042070 con 0x5585284278f0 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f423f7fe640 1 -- 172.21.15.137:0/3368793337 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42580316a0 con 0x5585284278f0 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.365+0000 7f423f7fe640 1 -- 172.21.15.137:0/3368793337 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258036040 con 0x5585284278f0 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 -- 172.21.15.137:0/3368793337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585284278f0 msgr2=0x5585283f9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 --2- 172.21.15.137:0/3368793337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585284278f0 0x5585283f9030 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f4258034040 tx=0x7f425802c000 comp rx=0 tx=0).stop 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 -- 172.21.15.137:0/3368793337 shutdown_connections 2024-04-26T22:05:45.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 --2- 172.21.15.137:0/3368793337 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585284278f0 0x5585283f9030 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 --2- 172.21.15.137:0/3368793337 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d9f80 0x5585283da8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 --2- 172.21.15.137:0/3368793337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585283d90c0 0x558528423570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 -- 172.21.15.137:0/3368793337 >> 172.21.15.137:0/3368793337 conn(0x5585283d4e10 msgr2=0x5585283f9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 -- 172.21.15.137:0/3368793337 shutdown_connections 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 -- 172.21.15.137:0/3368793337 wait complete. 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 -- start start 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.366+0000 7f42673a3740 1 Processor -- start 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f42673a3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d90c0 0x5585283fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f42673a3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f42673a3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585284278f0 0x5585283f4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f42673a3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5585283d7c20 con 0x5585283d9f80 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f42673a3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f425c0cfa80 con 0x5585284278f0 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f42673a3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5585282e0440 con 0x5585283d90c0 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f42673a3740 10 client.0 _ll_register_callbacks cb 0x7f424c001b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f4261b4a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f4261b4a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57120/0 (socket says 172.21.15.137:57120) 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.367+0000 7f4261b4a640 1 -- 172.21.15.137:0/598577175 learned_addr learned my addr 172.21.15.137:0/598577175 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f426234b640 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d90c0 0x5585283fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f4262b4c640 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585284278f0 0x5585283f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f4261b4a640 1 -- 172.21.15.137:0/598577175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d90c0 msgr2=0x5585283fccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f4261b4a640 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d90c0 0x5585283fccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f4261b4a640 1 -- 172.21.15.137:0/598577175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585284278f0 msgr2=0x5585283f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f4261b4a640 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585284278f0 0x5585283f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f4261b4a640 1 -- 172.21.15.137:0/598577175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585282ff4b0 con 0x5585283d9f80 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f4261b4a640 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fd200 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f424c02cbd0 tx=0x7f424c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764922931dd6f911 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f423d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f423d7fa640 1 -- 172.21.15.137:0/598577175 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c031030 con 0x5585283d9f80 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f423d7fa640 1 -- 172.21.15.137:0/598577175 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f424c010030 con 0x5585283d9f80 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f42673a3740 1 -- 172.21.15.137:0/598577175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42580316a0 con 0x5585283d9f80 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f423d7fa640 1 -- 172.21.15.137:0/598577175 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f424c03a050 con 0x5585283d9f80 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f42673a3740 10 client.7998 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:45.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f42673a3740 1 -- 172.21.15.137:0/598577175 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x558528404430 con 0x5585283d9f80 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f423d7fa640 1 -- 172.21.15.137:0/598577175 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42580316a0 con 0x5585283d9f80 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f423d7fa640 1 -- 172.21.15.137:0/598577175 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7f424c03d020 con 0x5585283d9f80 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f42673a3740 10 client.7998 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f42673a3740 10 client.7998 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f42673a3740 20 client.7998 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f42673a3740 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x558528499510 0x5585283f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f42673a3740 4 client.7998 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f42673a3740 1 -- 172.21.15.137:0/598577175 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5585283fac70 con 0x558528499510 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.368+0000 7f426234b640 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x558528499510 0x5585283f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f423d7fa640 10 client.7998 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f426234b640 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x558528499510 0x5585283f4d80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a722774af31fc5 server_cookie=ad9f05d40ff5ea90 in_seq=0 out_seq=0 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f423d7fa640 1 -- 172.21.15.137:0/598577175 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5585283fac70 con 0x558528499510 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f423d7fa640 10 client.7998 handle_command_reply: tid=0 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 client.7998 shutdown 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 -- 172.21.15.137:0/598577175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 msgr2=0x5585283fd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fd200 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f424c02cbd0 tx=0x7f424c013000 comp rx=0 tx=0).stop 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 -- 172.21.15.137:0/598577175 shutdown_connections 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x558528499510 0x5585283f4d80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5585283d9f80 0x5585283fd200 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5585284278f0 0x5585283f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f423d7fa640 0 client.7998 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 --2- 172.21.15.137:0/598577175 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5585283d90c0 0x5585283fccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 -- 172.21.15.137:0/598577175 >> 172.21.15.137:0/598577175 conn(0x5585283d4e10 msgr2=0x558528443d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 -- 172.21.15.137:0/598577175 shutdown_connections 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 1 -- 172.21.15.137:0/598577175 wait complete. 2024-04-26T22:05:45.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.369+0000 7f42673a3740 20 client.7998 trim_cache size 0 max 16384 2024-04-26T22:05:45.376 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:05:45.376 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:05:45.376 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:05:45.376 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 -- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424006c920 msgr2=0x7f424006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424006c920 0x7f424006ede0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f425c06d740 tx=0x7f424c000ed0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 -- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f425c070560 msgr2=0x7f425c0d0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f425c070560 0x7f425c0d0a70 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f425400e990 tx=0x7f425400ee50 comp rx=0 tx=0).stop 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 -- 172.21.15.137:0/2199375839 shutdown_connections 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424006c920 0x7f424006ede0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f425c15f260 0x7f425c0ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f425c0b4e00 0x7f425c147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 --2- 172.21.15.137:0/2199375839 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f425c070560 0x7f425c0d0a70 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 -- 172.21.15.137:0/2199375839 >> 172.21.15.137:0/2199375839 conn(0x7f425c0d1660 msgr2=0x7f425c0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 -- 172.21.15.137:0/2199375839 shutdown_connections 2024-04-26T22:05:45.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.370+0000 7f42645af640 1 -- 172.21.15.137:0/2199375839 wait complete. 2024-04-26T22:05:45.380 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:05:45.381 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:45.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.478+0000 7f81fc99e640 1 Processor -- start 2024-04-26T22:05:45.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.479+0000 7f81fc99e640 1 -- start start 2024-04-26T22:05:45.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.479+0000 7f81fc99e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f815d3d0 0x7f81f80ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.479+0000 7f81fc99e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f81f80d3b20 0x7f81f80d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.479+0000 7f81fc99e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f815d7b0 con 0x7f81f80cea30 2024-04-26T22:05:45.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.479+0000 7f81fc99e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f81f80cef00 con 0x7f81f80d3b20 2024-04-26T22:05:45.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.479+0000 7f81fc99e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81f80b25b0 con 0x7f81f815d3d0 2024-04-26T22:05:45.481 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.480+0000 7f81f6ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f81f80d3b20 0x7f81f80d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.480+0000 7f81f6ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f81f80d3b20 0x7f81f80d1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57124/0 (socket says 172.21.15.137:57124) 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.480+0000 7f81f6ffd640 1 -- 172.21.15.137:0/1111884890 learned_addr learned my addr 172.21.15.137:0/1111884890 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.480+0000 7f81f7fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f81f80cea30 0x7f81f80cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:49996/0 (socket says 172.21.15.137:49996) 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.480+0000 7f81f77fe640 1 --2- 172.21.15.137:0/1111884890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f815d3d0 0x7f81f80ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.480+0000 7f81f6ffd640 1 -- 172.21.15.137:0/1111884890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f815d3d0 msgr2=0x7f81f80ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.480+0000 7f81f6ffd640 1 --2- 172.21.15.137:0/1111884890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f815d3d0 0x7f81f80ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.480+0000 7f81f6ffd640 1 -- 172.21.15.137:0/1111884890 >> v1:172.21.15.137:6789/0 conn(0x7f81f80cea30 legacy=0x7f81f80cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.480+0000 7f81f6ffd640 1 -- 172.21.15.137:0/1111884890 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f80b2890 con 0x7f81f80d3b20 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81f6ffd640 1 --2- 172.21.15.137:0/1111884890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 0x7f81f80d1330 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db5ddcc271222be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81f67fc640 1 -- 172.21.15.137:0/1111884890 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec037070 con 0x7f81f80d3b20 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81f67fc640 1 -- 172.21.15.137:0/1111884890 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec032440 con 0x7f81f80d3b20 2024-04-26T22:05:45.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81f67fc640 1 -- 172.21.15.137:0/1111884890 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec032810 con 0x7f81f80d3b20 2024-04-26T22:05:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81fc99e640 1 -- 172.21.15.137:0/1111884890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 msgr2=0x7f81f80d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81fc99e640 1 --2- 172.21.15.137:0/1111884890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 0x7f81f80d1330 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009870 tx=0x7f81ec02a270 comp rx=0 tx=0).stop 2024-04-26T22:05:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81fc99e640 1 -- 172.21.15.137:0/1111884890 shutdown_connections 2024-04-26T22:05:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81fc99e640 1 --2- 172.21.15.137:0/1111884890 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 0x7f81f80d1330 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81fc99e640 1 --2- 172.21.15.137:0/1111884890 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f815d3d0 0x7f81f80ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81fc99e640 1 -- 172.21.15.137:0/1111884890 >> 172.21.15.137:0/1111884890 conn(0x7f81f80d2f00 msgr2=0x7f81f80d3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81fc99e640 1 -- 172.21.15.137:0/1111884890 shutdown_connections 2024-04-26T22:05:45.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.481+0000 7f81fc99e640 1 -- 172.21.15.137:0/1111884890 wait complete. 2024-04-26T22:05:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.483+0000 7f81fc99e640 1 Processor -- start 2024-04-26T22:05:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.483+0000 7f81fc99e640 1 -- start start 2024-04-26T22:05:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.483+0000 7f81fc99e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f80cea30 0x7f81f8158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.483+0000 7f81fc99e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 0x7f81f809ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.483+0000 7f81fc99e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81f815d3d0 0x7f81f809d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.483+0000 7f81fc99e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81f80b4220 con 0x7f81f80d3b20 2024-04-26T22:05:45.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.483+0000 7f81fc99e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f81f80b40a0 con 0x7f81f815d3d0 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.483+0000 7f81fc99e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81f80b43a0 con 0x7f81f80cea30 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 0x7f81f809ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 0x7f81f809ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:57138/0 (socket says 172.21.15.137:57138) 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f6ffd640 1 -- 172.21.15.137:0/4238627135 learned_addr learned my addr 172.21.15.137:0/4238627135 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f7fff640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81f815d3d0 0x7f81f809d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f77fe640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f80cea30 0x7f81f8158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f6ffd640 1 -- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f80cea30 msgr2=0x7f81f8158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f6ffd640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f80cea30 0x7f81f8158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f6ffd640 1 -- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81f815d3d0 msgr2=0x7f81f809d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f6ffd640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81f815d3d0 0x7f81f809d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f6ffd640 1 -- 172.21.15.137:0/4238627135 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f809fd90 con 0x7f81f80d3b20 2024-04-26T22:05:45.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f77fe640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f80cea30 0x7f81f8158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f7fff640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81f815d3d0 0x7f81f809d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81f6ffd640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 0x7f81f809ce50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f81ec000c00 tx=0x7f81ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81dffff640 1 -- 172.21.15.137:0/4238627135 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec041020 con 0x7f81f80d3b20 2024-04-26T22:05:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81dffff640 1 -- 172.21.15.137:0/4238627135 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec0306c0 con 0x7f81f80d3b20 2024-04-26T22:05:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81dffff640 1 -- 172.21.15.137:0/4238627135 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec037040 con 0x7f81f80d3b20 2024-04-26T22:05:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f80a0070 con 0x7f81f80d3b20 2024-04-26T22:05:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.484+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f80a0630 con 0x7f81f80d3b20 2024-04-26T22:05:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.485+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f80a0e40 con 0x7f81f80d3b20 2024-04-26T22:05:45.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.486+0000 7f81dffff640 1 -- 172.21.15.137:0/4238627135 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81ec044020 con 0x7f81f80d3b20 2024-04-26T22:05:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.486+0000 7f81dffff640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e406c8f0 0x7f81e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.486+0000 7f81dffff640 1 -- 172.21.15.137:0/4238627135 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f81ec0ac430 con 0x7f81f80d3b20 2024-04-26T22:05:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.486+0000 7f81f77fe640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e406c8f0 0x7f81e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.486+0000 7f81f77fe640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e406c8f0 0x7f81e406edb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f81e8006fd0 tx=0x7f81e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.490+0000 7f81dffff640 1 -- 172.21.15.137:0/4238627135 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f81ec04b030 con 0x7f81f80d3b20 2024-04-26T22:05:45.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.700+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81f80507a0 con 0x7f81f80d3b20 2024-04-26T22:05:45.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.701+0000 7f81dffff640 1 -- 172.21.15.137:0/4238627135 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5196 (secure 0 0 0) 0x7f81ec07a790 con 0x7f81f80d3b20 2024-04-26T22:05:45.701 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:45.701 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:05:12.391859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/4231448082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":4231448082},{"type":"v1","addr":"172.21.15.137:6837","nonce":4231448082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":6}]} 2024-04-26T22:05:45.701 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 60 2024-04-26T22:05:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e406c8f0 msgr2=0x7f81e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e406c8f0 0x7f81e406edb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f81e8006fd0 tx=0x7f81e8008040 comp rx=0 tx=0).stop 2024-04-26T22:05:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 msgr2=0x7f81f809ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 0x7f81f809ce50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f81ec000c00 tx=0x7f81ec0046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 shutdown_connections 2024-04-26T22:05:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e406c8f0 0x7f81e406edb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81f80d3b20 0x7f81f809ce50 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81f815d3d0 0x7f81f809d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 --2- 172.21.15.137:0/4238627135 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81f80cea30 0x7f81f8158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 >> 172.21.15.137:0/4238627135 conn(0x7f81f80d2f00 msgr2=0x7f81f80afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 shutdown_connections 2024-04-26T22:05:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.703+0000 7f81fc99e640 1 -- 172.21.15.137:0/4238627135 wait complete. 2024-04-26T22:05:45.714 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-26T22:05:45.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.812+0000 7f87be6cf640 1 Processor -- start 2024-04-26T22:05:45.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.812+0000 7f87be6cf640 1 -- start start 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87be6cf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f87b80b4eb0 0x7f87b80b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87be6cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80ceff0 0x7f87b80cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87be6cf640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b815dca0 con 0x7f87b8143840 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87be6cf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f87b8143c20 con 0x7f87b80b4eb0 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87be6cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f87b815df80 con 0x7f87b80ceff0 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87b77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f87b80b4eb0 0x7f87b80b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87b77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f87b80b4eb0 0x7f87b80b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41218/0 (socket says 172.21.15.137:41218) 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87b77fe640 1 -- 172.21.15.137:0/4003361663 learned_addr learned my addr 172.21.15.137:0/4003361663 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87bcc6c640 1 --2- 172.21.15.137:0/4003361663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80ceff0 0x7f87b80cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87b77fe640 1 -- 172.21.15.137:0/4003361663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80ceff0 msgr2=0x7f87b80cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87b77fe640 1 --2- 172.21.15.137:0/4003361663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80ceff0 0x7f87b80cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87b77fe640 1 -- 172.21.15.137:0/4003361663 >> v1:172.21.15.170:6789/0 conn(0x7f87b8143840 legacy=0x7f87b80b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.813+0000 7f87b77fe640 1 -- 172.21.15.137:0/4003361663 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b815e260 con 0x7f87b80b4eb0 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.814+0000 7f87b77fe640 1 --2- 172.21.15.137:0/4003361663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80b4eb0 0x7f87b80b5330 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009870 tx=0x7f87ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98d25027cc05974 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.814+0000 7f87b6ffd640 1 -- 172.21.15.137:0/4003361663 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac037070 con 0x7f87b80b4eb0 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.814+0000 7f87b6ffd640 1 -- 172.21.15.137:0/4003361663 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac032440 con 0x7f87b80b4eb0 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.814+0000 7f87b6ffd640 1 -- 172.21.15.137:0/4003361663 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac032810 con 0x7f87b80b4eb0 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.815+0000 7f87be6cf640 1 -- 172.21.15.137:0/4003361663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80b4eb0 msgr2=0x7f87b80b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.815+0000 7f87be6cf640 1 --2- 172.21.15.137:0/4003361663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80b4eb0 0x7f87b80b5330 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009870 tx=0x7f87ac02a270 comp rx=0 tx=0).stop 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.815+0000 7f87be6cf640 1 -- 172.21.15.137:0/4003361663 shutdown_connections 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.815+0000 7f87be6cf640 1 --2- 172.21.15.137:0/4003361663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80ceff0 0x7f87b80cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.815+0000 7f87be6cf640 1 --2- 172.21.15.137:0/4003361663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80b4eb0 0x7f87b80b5330 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.815+0000 7f87be6cf640 1 -- 172.21.15.137:0/4003361663 >> 172.21.15.137:0/4003361663 conn(0x7f87b80cd8a0 msgr2=0x7f87b80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.815+0000 7f87be6cf640 1 -- 172.21.15.137:0/4003361663 shutdown_connections 2024-04-26T22:05:45.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.815+0000 7f87be6cf640 1 -- 172.21.15.137:0/4003361663 wait complete. 2024-04-26T22:05:45.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.816+0000 7f87be6cf640 1 Processor -- start 2024-04-26T22:05:45.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.816+0000 7f87be6cf640 1 -- start start 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87be6cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80b4eb0 0x7f87b8142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87be6cf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80ceff0 0x7f87b81463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87be6cf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87b8143840 0x7f87b81e9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87be6cf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87b815d8c0 con 0x7f87b80ceff0 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87be6cf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f87b80b46f0 con 0x7f87b8143840 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87be6cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f87b815da40 con 0x7f87b80b4eb0 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80ceff0 0x7f87b81463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80ceff0 0x7f87b81463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41230/0 (socket says 172.21.15.137:41230) 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b77fe640 1 -- 172.21.15.137:0/406983486 learned_addr learned my addr 172.21.15.137:0/406983486 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b7fff640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80b4eb0 0x7f87b8142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87bcc6c640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87b8143840 0x7f87b81e9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b77fe640 1 -- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80b4eb0 msgr2=0x7f87b8142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b77fe640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80b4eb0 0x7f87b8142630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b77fe640 1 -- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87b8143840 msgr2=0x7f87b81e9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b77fe640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87b8143840 0x7f87b81e9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b77fe640 1 -- 172.21.15.137:0/406983486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b80ab3b0 con 0x7f87b80ceff0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b7fff640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80b4eb0 0x7f87b8142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87bcc6c640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87b8143840 0x7f87b81e9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b77fe640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80ceff0 0x7f87b81463c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f87ac000c00 tx=0x7f87ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.817+0000 7f87b4ff9640 1 -- 172.21.15.137:0/406983486 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac037040 con 0x7f87b80ceff0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.818+0000 7f87b4ff9640 1 -- 172.21.15.137:0/406983486 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac042070 con 0x7f87b80ceff0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.818+0000 7f87be6cf640 1 -- 172.21.15.137:0/406983486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b80ab690 con 0x7f87b80ceff0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.818+0000 7f87b4ff9640 1 -- 172.21.15.137:0/406983486 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac030880 con 0x7f87b80ceff0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.818+0000 7f87be6cf640 1 -- 172.21.15.137:0/406983486 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b80abc50 con 0x7f87b80ceff0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.819+0000 7f87b4ff9640 1 -- 172.21.15.137:0/406983486 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87ac030a20 con 0x7f87b80ceff0 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.819+0000 7f87b4ff9640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f87a406c8f0 0x7f87a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.819+0000 7f87b4ff9640 1 -- 172.21.15.137:0/406983486 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f87ac0ac420 con 0x7f87b80ceff0 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.819+0000 7f87b7fff640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f87a406c8f0 0x7f87a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.820+0000 7f87b7fff640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f87a406c8f0 0x7f87a406edb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87a80015e0 tx=0x7f87a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87c13e2740 1 Processor -- start 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87c13e2740 1 -- start start 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 0x55e5c14ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 0x55e5c14f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87c13e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e5c1432b80 con 0x55e5c14cdcf0 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87c13e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e5c13ce4d0 con 0x55e5c14f87b0 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87c13e2740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e5c142eb40 con 0x55e5c150a3c0 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41238/0 (socket says 172.21.15.137:41238) 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87b7fff640 1 -- 172.21.15.137:0/2288222856 learned_addr learned my addr 172.21.15.137:0/2288222856 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87bcc6c640 1 --2- 172.21.15.137:0/2288222856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 0x55e5c14f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.821+0000 7f87b77fe640 1 --2- 172.21.15.137:0/2288222856 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 0x55e5c14ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f87b7fff640 1 -- 172.21.15.137:0/2288222856 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 msgr2=0x55e5c14ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f87b7fff640 1 --2- 172.21.15.137:0/2288222856 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 0x55e5c14ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f87b7fff640 1 -- 172.21.15.137:0/2288222856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 msgr2=0x55e5c14f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f87b7fff640 1 --2- 172.21.15.137:0/2288222856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 0x55e5c14f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f87b7fff640 1 -- 172.21.15.137:0/2288222856 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c13fb770 con 0x55e5c14cdcf0 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f87b7fff640 1 --2- 172.21.15.137:0/2288222856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14cfe50 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f87a800d890 tx=0x7f87a8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8721c0a55959f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f879dffb640 1 -- 172.21.15.137:0/2288222856 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8024070 con 0x55e5c14cdcf0 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f879dffb640 1 -- 172.21.15.137:0/2288222856 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a8014ba0 con 0x55e5c14cdcf0 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f879dffb640 1 -- 172.21.15.137:0/2288222856 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8007050 con 0x55e5c14cdcf0 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f87c13e2740 1 -- 172.21.15.137:0/2288222856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 msgr2=0x55e5c14cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.822+0000 7f87c13e2740 1 --2- 172.21.15.137:0/2288222856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14cfe50 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f87a800d890 tx=0x7f87a8010000 comp rx=0 tx=0).stop 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.823+0000 7f87c13e2740 1 -- 172.21.15.137:0/2288222856 shutdown_connections 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.823+0000 7f87c13e2740 1 --2- 172.21.15.137:0/2288222856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 0x55e5c14f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.823+0000 7f87c13e2740 1 --2- 172.21.15.137:0/2288222856 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 0x55e5c14ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.823+0000 7f87c13e2740 1 --2- 172.21.15.137:0/2288222856 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14cfe50 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.823+0000 7f87c13e2740 1 -- 172.21.15.137:0/2288222856 >> 172.21.15.137:0/2288222856 conn(0x55e5c1462e90 msgr2=0x55e5c15137b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.823+0000 7f87c13e2740 1 -- 172.21.15.137:0/2288222856 shutdown_connections 2024-04-26T22:05:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.823+0000 7f87c13e2740 1 -- 172.21.15.137:0/2288222856 wait complete. 2024-04-26T22:05:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.823+0000 7f87c13e2740 1 -- start start 2024-04-26T22:05:45.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.823+0000 7f87c13e2740 1 Processor -- start 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14cdcf0 0x55e5c1526b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14f87b0 0x55e5c150b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 0x55e5c150b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87c13e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e5c13cbe70 con 0x55e5c14f87b0 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87c13e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e5c14f6300 con 0x55e5c14cdcf0 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87c13e2740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e5c14fc2e0 con 0x55e5c150a3c0 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87c13e2740 10 client.0 _ll_register_callbacks cb 0x55e5c13dcea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14f87b0 0x55e5c150b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14f87b0 0x55e5c150b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41254/0 (socket says 172.21.15.137:41254) 2024-04-26T22:05:45.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b77fe640 1 -- 172.21.15.137:0/680916699 learned_addr learned my addr 172.21.15.137:0/680916699 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b7fff640 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14cdcf0 0x55e5c1526b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87bcc6c640 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 0x55e5c150b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b77fe640 1 -- 172.21.15.137:0/680916699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 msgr2=0x55e5c150b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b77fe640 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 0x55e5c150b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b77fe640 1 -- 172.21.15.137:0/680916699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14cdcf0 msgr2=0x55e5c1526b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b77fe640 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14cdcf0 0x55e5c1526b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b77fe640 1 -- 172.21.15.137:0/680916699 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c12107c0 con 0x55e5c14f87b0 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.824+0000 7f87b7fff640 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14cdcf0 0x55e5c1526b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87b77fe640 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14f87b0 0x55e5c150b0a0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0827c0 tx=0x7f87ac030d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253b0d297aceb3fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f8796ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f8796ffd640 1 -- 172.21.15.137:0/680916699 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac07a810 con 0x55e5c14f87b0 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f8796ffd640 1 -- 172.21.15.137:0/680916699 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f87ac07e0d0 con 0x55e5c14f87b0 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87c13e2740 1 -- 172.21.15.137:0/680916699 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87a8014ba0 con 0x55e5c14f87b0 2024-04-26T22:05:45.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f8796ffd640 1 -- 172.21.15.137:0/680916699 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f87ac07a110 con 0x55e5c14f87b0 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87c13e2740 10 client.8019 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87c13e2740 1 -- 172.21.15.137:0/680916699 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x55e5c1270f50 con 0x55e5c14f87b0 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f8796ffd640 1 -- 172.21.15.137:0/680916699 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a8014ba0 con 0x55e5c14f87b0 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f8796ffd640 1 -- 172.21.15.137:0/680916699 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7f87ac03a070 con 0x55e5c14f87b0 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87c13e2740 10 client.8019 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87c13e2740 10 client.8019 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87c13e2740 20 client.8019 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87c13e2740 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55e5c14fb020 0x55e5c14fb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87c13e2740 4 client.8019 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87c13e2740 1 -- 172.21.15.137:0/680916699 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5c13e6240 con 0x55e5c14fb020 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.825+0000 7f87b7fff640 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55e5c14fb020 0x55e5c14fb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f8796ffd640 10 client.8019 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87b7fff640 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55e5c14fb020 0x55e5c14fb400 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acf236c7700eaac2 server_cookie=72c64a92257c022d in_seq=0 out_seq=0 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f8796ffd640 1 -- 172.21.15.137:0/680916699 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e5c13e6240 con 0x55e5c14fb020 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f8796ffd640 10 client.8019 handle_command_reply: tid=0 2024-04-26T22:05:45.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 client.8019 shutdown 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 -- 172.21.15.137:0/680916699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14f87b0 msgr2=0x55e5c150b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14f87b0 0x55e5c150b0a0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0827c0 tx=0x7f87ac030d10 comp rx=0 tx=0).stop 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 -- 172.21.15.137:0/680916699 shutdown_connections 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55e5c14fb020 0x55e5c14fb400 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14f87b0 0x55e5c150b0a0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c150a3c0 0x55e5c150b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f8796ffd640 0 client.8019 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 --2- 172.21.15.137:0/680916699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14cdcf0 0x55e5c1526b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 -- 172.21.15.137:0/680916699 >> 172.21.15.137:0/680916699 conn(0x55e5c1462e90 msgr2=0x55e5c14f64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 -- 172.21.15.137:0/680916699 shutdown_connections 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.826+0000 7f87c13e2740 1 -- 172.21.15.137:0/680916699 wait complete. 2024-04-26T22:05:45.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.827+0000 7f87c13e2740 20 client.8019 trim_cache size 0 max 16384 2024-04-26T22:05:45.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87c13e2740 1 Processor -- start 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87c13e2740 1 -- start start 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14f9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14f87b0 0x55e5c14fb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c150a3c0 0x55e5c14fb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87c13e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f87b81fe940 con 0x55e5c14cdcf0 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87c13e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f87b8144750 con 0x55e5c150a3c0 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87c13e2740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f87b81fe320 con 0x55e5c14f87b0 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14f9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87b7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14f9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41258/0 (socket says 172.21.15.137:41258) 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.840+0000 7f87b7fff640 1 -- 172.21.15.137:0/762546154 learned_addr learned my addr 172.21.15.137:0/762546154 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87b77fe640 1 --2- 172.21.15.137:0/762546154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14f87b0 0x55e5c14fb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87bcc6c640 1 --2- 172.21.15.137:0/762546154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c150a3c0 0x55e5c14fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87b7fff640 1 -- 172.21.15.137:0/762546154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14f87b0 msgr2=0x55e5c14fb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87b7fff640 1 --2- 172.21.15.137:0/762546154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14f87b0 0x55e5c14fb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87b7fff640 1 -- 172.21.15.137:0/762546154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c150a3c0 msgr2=0x55e5c14fb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87b7fff640 1 --2- 172.21.15.137:0/762546154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c150a3c0 0x55e5c14fb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87b7fff640 1 -- 172.21.15.137:0/762546154 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c150cb80 con 0x55e5c14cdcf0 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87b7fff640 1 --2- 172.21.15.137:0/762546154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14f9f50 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f87a801e000 tx=0x7f87a8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908758e989a18fca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f879d7fa640 1 -- 172.21.15.137:0/762546154 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8030e60 con 0x55e5c14cdcf0 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f879d7fa640 1 -- 172.21.15.137:0/762546154 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a80304b0 con 0x55e5c14cdcf0 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f879d7fa640 1 -- 172.21.15.137:0/762546154 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8015e60 con 0x55e5c14cdcf0 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87c13e2740 1 -- 172.21.15.137:0/762546154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 msgr2=0x55e5c14f9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87c13e2740 1 --2- 172.21.15.137:0/762546154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14f9f50 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f87a801e000 tx=0x7f87a8012000 comp rx=0 tx=0).stop 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87c13e2740 1 -- 172.21.15.137:0/762546154 shutdown_connections 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87c13e2740 1 --2- 172.21.15.137:0/762546154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c150a3c0 0x55e5c14fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87c13e2740 1 --2- 172.21.15.137:0/762546154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14f87b0 0x55e5c14fb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87c13e2740 1 --2- 172.21.15.137:0/762546154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c14cdcf0 0x55e5c14f9f50 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.841+0000 7f87c13e2740 1 -- 172.21.15.137:0/762546154 >> 172.21.15.137:0/762546154 conn(0x55e5c1462e90 msgr2=0x55e5c14c42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.842+0000 7f87c13e2740 1 -- 172.21.15.137:0/762546154 shutdown_connections 2024-04-26T22:05:45.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.842+0000 7f87c13e2740 1 -- 172.21.15.137:0/762546154 wait complete. 2024-04-26T22:05:45.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.842+0000 7f87c13e2740 1 -- start start 2024-04-26T22:05:45.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.842+0000 7f87c13e2740 1 Processor -- start 2024-04-26T22:05:45.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14cdcf0 0x55e5c14f6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 0x55e5c14f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87c13e2740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c150a3c0 0x55e5c1521ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87c13e2740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e5c14f3390 con 0x55e5c150a3c0 2024-04-26T22:05:45.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87c13e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e5c14fc020 con 0x55e5c14f87b0 2024-04-26T22:05:45.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87c13e2740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e5c14f9100 con 0x55e5c14cdcf0 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87c13e2740 10 client.0 _ll_register_callbacks cb 0x7f87ac009240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87bcc6c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c150a3c0 0x55e5c1521ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87bcc6c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c150a3c0 0x55e5c1521ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41276/0 (socket says 172.21.15.137:41276) 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87bcc6c640 1 -- 172.21.15.137:0/4016960044 learned_addr learned my addr 172.21.15.137:0/4016960044 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87b77fe640 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 0x55e5c14f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87b7fff640 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14cdcf0 0x55e5c14f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87bcc6c640 1 -- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14cdcf0 msgr2=0x55e5c14f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87bcc6c640 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14cdcf0 0x55e5c14f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87bcc6c640 1 -- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 msgr2=0x55e5c14f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87bcc6c640 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 0x55e5c14f6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87bcc6c640 1 -- 172.21.15.137:0/4016960044 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c11040b0 con 0x55e5c150a3c0 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87b7fff640 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14cdcf0 0x55e5c14f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:45.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87b77fe640 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 0x55e5c14f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f87bcc6c640 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c150a3c0 0x55e5c1521ed0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x55e5c14f83c0 tx=0x7f87b0013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc5718a7a2f6ff2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.843+0000 7f8796ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f8796ffd640 1 -- 172.21.15.137:0/4016960044 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b001c070 con 0x55e5c150a3c0 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f8796ffd640 1 -- 172.21.15.137:0/4016960044 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f87b0016430 con 0x55e5c150a3c0 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87c13e2740 1 -- 172.21.15.137:0/4016960044 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87a80304b0 con 0x55e5c150a3c0 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f8796ffd640 1 -- 172.21.15.137:0/4016960044 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f87b0009e60 con 0x55e5c150a3c0 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87c13e2740 10 client.8025 fetch_fsmap learned FSMap version 60 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87c13e2740 1 -- 172.21.15.137:0/4016960044 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x55e5c1509510 con 0x55e5c150a3c0 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f8796ffd640 1 -- 172.21.15.137:0/4016960044 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a80304b0 con 0x55e5c150a3c0 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f8796ffd640 1 -- 172.21.15.137:0/4016960044 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 60) ==== 3494+0+0 (secure 0 0 0) 0x7f87b002a080 con 0x55e5c150a3c0 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87c13e2740 10 client.8025 fetch_fsmap finished waiting for FSMap version 60 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87c13e2740 10 client.8025 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:05:45.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87c13e2740 20 client.8025 populate_metadata read hostname 'smithi137' 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87c13e2740 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55e5c1522840 0x55e5c1535fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87c13e2740 4 client.8025 mds_command: new command op to 7845 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87c13e2740 1 -- 172.21.15.137:0/4016960044 --> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) -- 0x55e5c1440790 con 0x55e5c1522840 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87b7fff640 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55e5c1522840 0x55e5c1535fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f8796ffd640 10 client.8025 ms_handle_connect on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.844+0000 7f87b7fff640 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55e5c1522840 0x55e5c1535fb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d119843d000ed79b server_cookie=db11e8457d0c25ca in_seq=0 out_seq=0 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f8796ffd640 1 -- 172.21.15.137:0/4016960044 <== mds.0 v2:172.21.15.137:6835/4231448082 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5c1440790 con 0x55e5c1522840 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f8796ffd640 10 client.8025 handle_command_reply: tid=0 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 client.8025 shutdown 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 -- 172.21.15.137:0/4016960044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c150a3c0 msgr2=0x55e5c1521ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c150a3c0 0x55e5c1521ed0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x55e5c14f83c0 tx=0x7f87b0013680 comp rx=0 tx=0).stop 2024-04-26T22:05:45.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 -- 172.21.15.137:0/4016960044 shutdown_connections 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.137:6835/4231448082,v1:172.21.15.137:6837/4231448082] conn(0x55e5c1522840 0x55e5c1535fb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e5c150a3c0 0x55e5c1521ed0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e5c14f87b0 0x55e5c14f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f8796ffd640 0 client.8025 ms_handle_reset on v2:172.21.15.137:6835/4231448082 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 --2- 172.21.15.137:0/4016960044 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e5c14cdcf0 0x55e5c14f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 -- 172.21.15.137:0/4016960044 >> 172.21.15.137:0/4016960044 conn(0x55e5c1462e90 msgr2=0x55e5c14f5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 -- 172.21.15.137:0/4016960044 shutdown_connections 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 1 -- 172.21.15.137:0/4016960044 wait complete. 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87c13e2740 20 client.8025 trim_cache size 0 max 16384 2024-04-26T22:05:45.851 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:45.852 INFO:teuthology.orchestra.run.smithi137.stdout:[] 2024-04-26T22:05:45.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87be6cf640 1 -- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f87a406c8f0 msgr2=0x7f87a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87be6cf640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f87a406c8f0 0x7f87a406edb0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87a80015e0 tx=0x7f87a8009040 comp rx=0 tx=0).stop 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87be6cf640 1 -- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80ceff0 msgr2=0x7f87b81463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.845+0000 7f87be6cf640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80ceff0 0x7f87b81463c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f87ac000c00 tx=0x7f87ac0046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.846+0000 7f87be6cf640 1 -- 172.21.15.137:0/406983486 shutdown_connections 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.846+0000 7f87be6cf640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f87a406c8f0 0x7f87a406edb0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.846+0000 7f87be6cf640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87b80ceff0 0x7f87b81463c0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.846+0000 7f87be6cf640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f87b8143840 0x7f87b81e9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.846+0000 7f87be6cf640 1 --2- 172.21.15.137:0/406983486 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87b80b4eb0 0x7f87b8142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.846+0000 7f87be6cf640 1 -- 172.21.15.137:0/406983486 >> 172.21.15.137:0/406983486 conn(0x7f87b80cd8a0 msgr2=0x7f87b80b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.846+0000 7f87be6cf640 1 -- 172.21.15.137:0/406983486 shutdown_connections 2024-04-26T22:05:45.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.846+0000 7f87be6cf640 1 -- 172.21.15.137:0/406983486 wait complete. 2024-04-26T22:05:45.856 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T22:05:45.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0856c93640 1 Processor -- start 2024-04-26T22:05:45.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0856c93640 1 -- start start 2024-04-26T22:05:45.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0856c93640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f085015f4d0 0x7f08500b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0856c93640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f08500d5810 0x7f08500b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0856c93640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08500b2550 con 0x7f08500d2e20 2024-04-26T22:05:45.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0856c93640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f08500b6180 con 0x7f08500d5810 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0856c93640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f08500b2830 con 0x7f085015f4d0 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0855230640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f08500d5810 0x7f08500b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0855230640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f08500d5810 0x7f08500b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41284/0 (socket says 172.21.15.137:41284) 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.952+0000 7f0855230640 1 -- 172.21.15.137:0/470373612 learned_addr learned my addr 172.21.15.137:0/470373612 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.953+0000 7f0855230640 1 -- 172.21.15.137:0/470373612 >> v2:172.21.15.170:3300/0 conn(0x7f085015f4d0 msgr2=0x7f08500b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.953+0000 7f0854a2f640 1 --2- 172.21.15.137:0/470373612 >> v2:172.21.15.170:3300/0 conn(0x7f085015f4d0 0x7f08500b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.953+0000 7f0855230640 1 --2- 172.21.15.137:0/470373612 >> v2:172.21.15.170:3300/0 conn(0x7f085015f4d0 0x7f08500b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.953+0000 7f0855230640 1 -- 172.21.15.137:0/470373612 >> v1:172.21.15.170:6789/0 conn(0x7f08500d2e20 legacy=0x7f08500d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.953+0000 7f0855230640 1 -- 172.21.15.137:0/470373612 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08500b2b10 con 0x7f08500d5810 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.953+0000 7f0855230640 1 --2- 172.21.15.137:0/470373612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d5810 0x7f08500b35f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f085008f070 tx=0x7f084802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338e56963d74c330 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f084f7fe640 1 -- 172.21.15.137:0/470373612 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848036070 con 0x7f08500d5810 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f084f7fe640 1 -- 172.21.15.137:0/470373612 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0848031600 con 0x7f08500d5810 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f084f7fe640 1 -- 172.21.15.137:0/470373612 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08480319d0 con 0x7f08500d5810 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f0856c93640 1 -- 172.21.15.137:0/470373612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d5810 msgr2=0x7f08500b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f0856c93640 1 --2- 172.21.15.137:0/470373612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d5810 0x7f08500b35f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f085008f070 tx=0x7f084802a5d0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f0856c93640 1 -- 172.21.15.137:0/470373612 shutdown_connections 2024-04-26T22:05:45.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f0856c93640 1 --2- 172.21.15.137:0/470373612 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d5810 0x7f08500b35f0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f0856c93640 1 --2- 172.21.15.137:0/470373612 >> v2:172.21.15.170:3300/0 conn(0x7f085015f4d0 0x7f08500b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f0856c93640 1 -- 172.21.15.137:0/470373612 >> 172.21.15.137:0/470373612 conn(0x7f085008ebf0 msgr2=0x7f085009e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:45.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f0856c93640 1 -- 172.21.15.137:0/470373612 shutdown_connections 2024-04-26T22:05:45.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.954+0000 7f0856c93640 1 -- 172.21.15.137:0/470373612 wait complete. 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.955+0000 7f0856c93640 1 Processor -- start 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.955+0000 7f0856c93640 1 -- start start 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0856c93640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d2e20 0x7f08501f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0856c93640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08500d5810 0x7f08501599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0856c93640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f085015f4d0 0x7f08500b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0856c93640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08500b3b30 con 0x7f08500d2e20 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0856c93640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f08500b30d0 con 0x7f08500d5810 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0856c93640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f08500b3cb0 con 0x7f085015f4d0 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0854a2f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d2e20 0x7f08501f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0854a2f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d2e20 0x7f08501f5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41298/0 (socket says 172.21.15.137:41298) 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0854a2f640 1 -- 172.21.15.137:0/2820122163 learned_addr learned my addr 172.21.15.137:0/2820122163 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:45.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f0855230640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f085015f4d0 0x7f08500b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.956+0000 7f084ffff640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08500d5810 0x7f08501599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f0854a2f640 1 -- 172.21.15.137:0/2820122163 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f085015f4d0 msgr2=0x7f08500b95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f0854a2f640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f085015f4d0 0x7f08500b95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f0854a2f640 1 -- 172.21.15.137:0/2820122163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08500d5810 msgr2=0x7f08501599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f0854a2f640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08500d5810 0x7f08501599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f0854a2f640 1 -- 172.21.15.137:0/2820122163 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08500b8ef0 con 0x7f08500d2e20 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f0855230640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f085015f4d0 0x7f08500b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f0854a2f640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d2e20 0x7f08501f5150 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f084000c820 tx=0x7f084000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f084d7fa640 1 -- 172.21.15.137:0/2820122163 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0840015070 con 0x7f08500d2e20 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f084d7fa640 1 -- 172.21.15.137:0/2820122163 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0840004020 con 0x7f08500d2e20 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08500b8c10 con 0x7f08500d2e20 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f084d7fa640 1 -- 172.21.15.137:0/2820122163 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08400043f0 con 0x7f08500d2e20 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.957+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08500cc6a0 con 0x7f08500d2e20 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.958+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085006a290 con 0x7f08500d2e20 2024-04-26T22:05:45.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.958+0000 7f084d7fa640 1 -- 172.21.15.137:0/2820122163 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0840007830 con 0x7f08500d2e20 2024-04-26T22:05:45.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.959+0000 7f084d7fa640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f083c06c8f0 0x7f083c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:45.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.959+0000 7f084d7fa640 1 -- 172.21.15.137:0/2820122163 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f084008b9d0 con 0x7f08500d2e20 2024-04-26T22:05:45.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.959+0000 7f084ffff640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f083c06c8f0 0x7f083c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:45.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.959+0000 7f084ffff640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f083c06c8f0 0x7f083c06edb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f085006d3a0 tx=0x7f0844009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:45.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:45.963+0000 7f084d7fa640 1 -- 172.21.15.137:0/2820122163 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0840059d30 con 0x7f08500d2e20 2024-04-26T22:05:46.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.174+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f085006d3d0 con 0x7f08500d2e20 2024-04-26T22:05:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.175+0000 7f084d7fa640 1 -- 172.21.15.137:0/2820122163 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0840059630 con 0x7f08500d2e20 2024-04-26T22:05:46.175 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:46.175 INFO:teuthology.orchestra.run.smithi137.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f083c06c8f0 msgr2=0x7f083c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f083c06c8f0 0x7f083c06edb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f085006d3a0 tx=0x7f0844009040 comp rx=0 tx=0).stop 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d2e20 msgr2=0x7f08501f5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d2e20 0x7f08501f5150 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f084000c820 tx=0x7f084000cce0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 shutdown_connections 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f083c06c8f0 0x7f083c06edb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f085015f4d0 0x7f08500b95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08500d5810 0x7f08501599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 --2- 172.21.15.137:0/2820122163 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08500d2e20 0x7f08501f5150 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 >> 172.21.15.137:0/2820122163 conn(0x7f085008ebf0 msgr2=0x7f08500d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 shutdown_connections 2024-04-26T22:05:46.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.177+0000 7f0856c93640 1 -- 172.21.15.137:0/2820122163 wait complete. 2024-04-26T22:05:46.187 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-26T22:05:46.188 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:05:46.188 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:05:46.232 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:05:46.276 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:05:46.277 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:05:46.277 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:05:46.277 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:46.292 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:05:46.292 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:46.347 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:05:46.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.485+0000 7f9d79ebd640 1 Processor -- start 2024-04-26T22:05:46.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.485+0000 7f9d79ebd640 1 -- start start 2024-04-26T22:05:46.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d79ebd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9d740b28c0 0x7f9d740cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d79ebd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740d1750 0x7f9d740b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d79ebd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d740b0620 con 0x7f9d740d1370 2024-04-26T22:05:46.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d79ebd640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9d74074070 con 0x7f9d740b28c0 2024-04-26T22:05:46.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d79ebd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9d74074350 con 0x7f9d740d1750 2024-04-26T22:05:46.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d6bfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9d740b28c0 0x7f9d740cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740d1750 0x7f9d740b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d737fe640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f9d740d1370 0x7f9d740ae0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:38996/0 (socket says 172.21.15.137:38996) 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d6bfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9d740b28c0 0x7f9d740cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:46286/0 (socket says 172.21.15.137:46286) 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.486+0000 7f9d737fe640 1 -- 172.21.15.137:0/227690590 learned_addr learned my addr 172.21.15.137:0/227690590 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.487+0000 7f9d73fff640 1 -- 172.21.15.137:0/227690590 >> v2:172.21.15.170:3300/0 conn(0x7f9d740b28c0 msgr2=0x7f9d740cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.487+0000 7f9d73fff640 1 --2- 172.21.15.137:0/227690590 >> v2:172.21.15.170:3300/0 conn(0x7f9d740b28c0 0x7f9d740cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.487+0000 7f9d73fff640 1 -- 172.21.15.137:0/227690590 >> v1:172.21.15.170:6789/0 conn(0x7f9d740d1370 legacy=0x7f9d740ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.487+0000 7f9d73fff640 1 -- 172.21.15.137:0/227690590 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d74074630 con 0x7f9d740d1750 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.487+0000 7f9d6bfff640 1 --2- 172.21.15.137:0/227690590 >> v2:172.21.15.170:3300/0 conn(0x7f9d740b28c0 0x7f9d740cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d73fff640 1 --2- 172.21.15.137:0/227690590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740d1750 0x7f9d740b0dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009d90 tx=0x7f9d6c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348ff2f05aee043c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d72ffd640 1 -- 172.21.15.137:0/227690590 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c007740 con 0x7f9d740d1750 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d72ffd640 1 -- 172.21.15.137:0/227690590 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6c0078e0 con 0x7f9d740d1750 2024-04-26T22:05:46.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d72ffd640 1 -- 172.21.15.137:0/227690590 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c007cb0 con 0x7f9d740d1750 2024-04-26T22:05:46.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d79ebd640 1 -- 172.21.15.137:0/227690590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740d1750 msgr2=0x7f9d740b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d79ebd640 1 --2- 172.21.15.137:0/227690590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740d1750 0x7f9d740b0dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009d90 tx=0x7f9d6c02a660 comp rx=0 tx=0).stop 2024-04-26T22:05:46.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d79ebd640 1 -- 172.21.15.137:0/227690590 shutdown_connections 2024-04-26T22:05:46.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d79ebd640 1 --2- 172.21.15.137:0/227690590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740d1750 0x7f9d740b0dd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d79ebd640 1 --2- 172.21.15.137:0/227690590 >> v2:172.21.15.170:3300/0 conn(0x7f9d740b28c0 0x7f9d740cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d79ebd640 1 -- 172.21.15.137:0/227690590 >> 172.21.15.137:0/227690590 conn(0x7f9d740b6800 msgr2=0x7f9d740738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d79ebd640 1 -- 172.21.15.137:0/227690590 shutdown_connections 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.488+0000 7f9d79ebd640 1 -- 172.21.15.137:0/227690590 wait complete. 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.489+0000 7f9d79ebd640 1 Processor -- start 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d79ebd640 1 -- start start 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d79ebd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740b28c0 0x7f9d741e5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d79ebd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d740d1370 0x7f9d741e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d79ebd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d740d1750 0x7f9d7409a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d79ebd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9d740b1310 con 0x7f9d740d1750 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d79ebd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9d740d1e90 con 0x7f9d740d1370 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d79ebd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9d740b1490 con 0x7f9d740b28c0 2024-04-26T22:05:46.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d740d1750 0x7f9d7409a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d73fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d740d1750 0x7f9d7409a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41308/0 (socket says 172.21.15.137:41308) 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d73fff640 1 -- 172.21.15.137:0/1803243317 learned_addr learned my addr 172.21.15.137:0/1803243317 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d6bfff640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d740d1370 0x7f9d741e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.490+0000 7f9d737fe640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740b28c0 0x7f9d741e5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d73fff640 1 -- 172.21.15.137:0/1803243317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740b28c0 msgr2=0x7f9d741e5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d73fff640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740b28c0 0x7f9d741e5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d73fff640 1 -- 172.21.15.137:0/1803243317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d740d1370 msgr2=0x7f9d741e7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d73fff640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d740d1370 0x7f9d741e7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d73fff640 1 -- 172.21.15.137:0/1803243317 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d741e80a0 con 0x7f9d740d1750 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d73fff640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d740d1750 0x7f9d7409a860 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c02ac50 tx=0x7f9d6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d70ff9640 1 -- 172.21.15.137:0/1803243317 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c03f070 con 0x7f9d740d1750 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d70ff9640 1 -- 172.21.15.137:0/1803243317 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d6c031bc0 con 0x7f9d740d1750 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d741e5fe0 con 0x7f9d740d1750 2024-04-26T22:05:46.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d70ff9640 1 -- 172.21.15.137:0/1803243317 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c009450 con 0x7f9d740d1750 2024-04-26T22:05:46.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.491+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741e65a0 con 0x7f9d740d1750 2024-04-26T22:05:46.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.492+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7406a290 con 0x7f9d740d1750 2024-04-26T22:05:46.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.492+0000 7f9d70ff9640 1 -- 172.21.15.137:0/1803243317 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d6c03b410 con 0x7f9d740d1750 2024-04-26T22:05:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.493+0000 7f9d70ff9640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d5406c8f0 0x7f9d5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.493+0000 7f9d70ff9640 1 -- 172.21.15.137:0/1803243317 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f9d6c0ad300 con 0x7f9d740d1750 2024-04-26T22:05:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.493+0000 7f9d737fe640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d5406c8f0 0x7f9d5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.493+0000 7f9d737fe640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d5406c8f0 0x7f9d5406edb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9d64007fd0 tx=0x7f9d64007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:46.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.497+0000 7f9d70ff9640 1 -- 172.21.15.137:0/1803243317 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9d6c07af90 con 0x7f9d740d1750 2024-04-26T22:05:46.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.676+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d740cfb20 con 0x7f9d740d1750 2024-04-26T22:05:46.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.677+0000 7f9d70ff9640 1 -- 172.21.15.137:0/1803243317 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16983 (secure 0 0 0) 0x7f9d6c07f290 con 0x7f9d740d1750 2024-04-26T22:05:46.677 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:46.677 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":91,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:05:08.380391+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:04:11.600389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-26T22:04:12.347068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.137:6835/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.170:6835/865192507":"2024-04-27T22:04:27.224170+0000","172.21.15.170:6833/865192507":"2024-04-27T22:04:27.224170+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:05:46.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d5406c8f0 msgr2=0x7f9d5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d5406c8f0 0x7f9d5406edb0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9d64007fd0 tx=0x7f9d64007e80 comp rx=0 tx=0).stop 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d740d1750 msgr2=0x7f9d7409a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d740d1750 0x7f9d7409a860 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c02ac50 tx=0x7f9d6c004a40 comp rx=0 tx=0).stop 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 shutdown_connections 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9d5406c8f0 0x7f9d5406edb0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9d740d1750 0x7f9d7409a860 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d740d1370 0x7f9d741e7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 --2- 172.21.15.137:0/1803243317 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9d740b28c0 0x7f9d741e5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 >> 172.21.15.137:0/1803243317 conn(0x7f9d740b6800 msgr2=0x7f9d7406f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 shutdown_connections 2024-04-26T22:05:46.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.679+0000 7f9d79ebd640 1 -- 172.21.15.137:0/1803243317 wait complete. 2024-04-26T22:05:46.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:04:11.600389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:04:12.347068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:05:46.691 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:05:46.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.790+0000 7fee50693640 1 Processor -- start 2024-04-26T22:05:46.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.790+0000 7fee50693640 1 -- start start 2024-04-26T22:05:46.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee50693640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee4806f340 0x7fee480b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee50693640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee480d0300 0x7fee4806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee50693640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fee480b3e50 0x7fee480720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee50693640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fee4806fc60 con 0x7fee4806f340 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee50693640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fee480b46a0 con 0x7fee480b3e50 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee50693640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee480b5db0 con 0x7fee480d0300 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee4e42f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee4806f340 0x7fee480b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee4e42f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fee4806f340 0x7fee480b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41310/0 (socket says 172.21.15.137:41310) 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee4e42f640 1 -- 172.21.15.137:0/1507769130 learned_addr learned my addr 172.21.15.137:0/1507769130 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee4e42f640 1 -- 172.21.15.137:0/1507769130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee480d0300 msgr2=0x7fee4806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee4e42f640 1 --2- 172.21.15.137:0/1507769130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee480d0300 0x7fee4806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee4e42f640 1 -- 172.21.15.137:0/1507769130 >> v2:172.21.15.170:3300/0 conn(0x7fee480b3e50 msgr2=0x7fee480720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee4e42f640 1 --2- 172.21.15.137:0/1507769130 >> v2:172.21.15.170:3300/0 conn(0x7fee480b3e50 0x7fee480720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.791+0000 7fee4e42f640 1 -- 172.21.15.137:0/1507769130 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee480b6090 con 0x7fee4806f340 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee4e42f640 1 --2- 172.21.15.137:0/1507769130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee4806f340 0x7fee480b6b70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fee48072080 tx=0x7fee4002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408120e5b92a3b9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee4d42d640 1 -- 172.21.15.137:0/1507769130 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40036070 con 0x7fee4806f340 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee4d42d640 1 -- 172.21.15.137:0/1507769130 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40031600 con 0x7fee4806f340 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee4d42d640 1 -- 172.21.15.137:0/1507769130 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee400319d0 con 0x7fee4806f340 2024-04-26T22:05:46.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee50693640 1 -- 172.21.15.137:0/1507769130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee4806f340 msgr2=0x7fee480b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee50693640 1 --2- 172.21.15.137:0/1507769130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee4806f340 0x7fee480b6b70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fee48072080 tx=0x7fee4002a570 comp rx=0 tx=0).stop 2024-04-26T22:05:46.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee50693640 1 -- 172.21.15.137:0/1507769130 shutdown_connections 2024-04-26T22:05:46.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee50693640 1 --2- 172.21.15.137:0/1507769130 >> v2:172.21.15.170:3300/0 conn(0x7fee480b3e50 0x7fee480720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee50693640 1 --2- 172.21.15.137:0/1507769130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee480d0300 0x7fee4806f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.792+0000 7fee50693640 1 --2- 172.21.15.137:0/1507769130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee4806f340 0x7fee480b6b70 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.793+0000 7fee50693640 1 -- 172.21.15.137:0/1507769130 >> 172.21.15.137:0/1507769130 conn(0x7fee480cd8a0 msgr2=0x7fee480cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:46.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.793+0000 7fee50693640 1 -- 172.21.15.137:0/1507769130 shutdown_connections 2024-04-26T22:05:46.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.793+0000 7fee50693640 1 -- 172.21.15.137:0/1507769130 wait complete. 2024-04-26T22:05:46.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee50693640 1 Processor -- start 2024-04-26T22:05:46.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee50693640 1 -- start start 2024-04-26T22:05:46.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee50693640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee4806f340 0x7fee48141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee50693640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee480b3e50 0x7fee4815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee50693640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee480d0300 0x7fee4813e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee50693640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fee480b42e0 con 0x7fee480b3e50 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee50693640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fee480b6650 con 0x7fee480d0300 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee50693640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fee480b4460 con 0x7fee4806f340 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee4dc2e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee480b3e50 0x7fee4815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.794+0000 7fee4dc2e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee480b3e50 0x7fee4815afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41318/0 (socket says 172.21.15.137:41318) 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee4dc2e640 1 -- 172.21.15.137:0/3631181023 learned_addr learned my addr 172.21.15.137:0/3631181023 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee4ec30640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee480d0300 0x7fee4813e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee4e42f640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee4806f340 0x7fee48141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee4dc2e640 1 -- 172.21.15.137:0/3631181023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee4806f340 msgr2=0x7fee48141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee4dc2e640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee4806f340 0x7fee48141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee4dc2e640 1 -- 172.21.15.137:0/3631181023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee480d0300 msgr2=0x7fee4813e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee4dc2e640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee480d0300 0x7fee4813e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee4dc2e640 1 -- 172.21.15.137:0/3631181023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4813baf0 con 0x7fee480b3e50 2024-04-26T22:05:46.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee4dc2e640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee480b3e50 0x7fee4815afa0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fee3800b410 tx=0x7fee3800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:46.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee3effd640 1 -- 172.21.15.137:0/3631181023 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38015020 con 0x7fee480b3e50 2024-04-26T22:05:46.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee3effd640 1 -- 172.21.15.137:0/3631181023 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee38011850 con 0x7fee480b3e50 2024-04-26T22:05:46.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee3effd640 1 -- 172.21.15.137:0/3631181023 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38011c40 con 0x7fee480b3e50 2024-04-26T22:05:46.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4813f4d0 con 0x7fee480b3e50 2024-04-26T22:05:46.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.795+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4813bdd0 con 0x7fee480b3e50 2024-04-26T22:05:46.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.796+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee4806a290 con 0x7fee480b3e50 2024-04-26T22:05:46.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.796+0000 7fee3effd640 1 -- 172.21.15.137:0/3631181023 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fee38018020 con 0x7fee480b3e50 2024-04-26T22:05:46.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.797+0000 7fee3effd640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee2c06c8f0 0x7fee2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:46.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.797+0000 7fee4e42f640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee2c06c8f0 0x7fee2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:46.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.797+0000 7fee3effd640 1 -- 172.21.15.137:0/3631181023 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7fee3808ba70 con 0x7fee480b3e50 2024-04-26T22:05:46.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.797+0000 7fee4e42f640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee2c06c8f0 0x7fee2c06edb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fee40033000 tx=0x7fee40009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:46.801 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.801+0000 7fee3effd640 1 -- 172.21.15.137:0/3631181023 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fee3801f020 con 0x7fee480b3e50 2024-04-26T22:05:46.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.975+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fee48142250 con 0x7fee480b3e50 2024-04-26T22:05:46.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.975+0000 7fee3effd640 1 -- 172.21.15.137:0/3631181023 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fee38059770 con 0x7fee480b3e50 2024-04-26T22:05:46.975 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:05:46.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee2c06c8f0 msgr2=0x7fee2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee2c06c8f0 0x7fee2c06edb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fee40033000 tx=0x7fee40009000 comp rx=0 tx=0).stop 2024-04-26T22:05:46.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee480b3e50 msgr2=0x7fee4815afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:46.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee480b3e50 0x7fee4815afa0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fee3800b410 tx=0x7fee3800b8d0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 shutdown_connections 2024-04-26T22:05:46.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fee2c06c8f0 0x7fee2c06edb0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fee480b3e50 0x7fee4815afa0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fee480d0300 0x7fee4813e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 --2- 172.21.15.137:0/3631181023 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fee4806f340 0x7fee48141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:46.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 >> 172.21.15.137:0/3631181023 conn(0x7fee480cd8a0 msgr2=0x7fee480cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:46.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 shutdown_connections 2024-04-26T22:05:46.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:46.977+0000 7fee50693640 1 -- 172.21.15.137:0/3631181023 wait complete. 2024-04-26T22:05:46.988 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:05:47.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.088+0000 7fbcd25c9640 1 Processor -- start 2024-04-26T22:05:47.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.088+0000 7fbcd25c9640 1 -- start start 2024-04-26T22:05:47.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbcd25c9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbccc15f680 0x7fbccc0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbcd25c9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbcd25c9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbccc0d3f50 con 0x7fbccc0b60b0 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbcd25c9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbccc15fa60 con 0x7fbccc15f680 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbcd25c9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc0b5090 con 0x7fbccc163aa0 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccb7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccbfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbccc15f680 0x7fbccc0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccb7fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:60270/0 (socket says 172.21.15.137:60270) 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccbfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbccc15f680 0x7fbccc0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:46324/0 (socket says 172.21.15.137:46324) 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccb7fe640 1 -- 172.21.15.137:0/2632159833 learned_addr learned my addr 172.21.15.137:0/2632159833 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccbfff640 1 -- 172.21.15.137:0/2632159833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 msgr2=0x7fbccc0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccbfff640 1 --2- 172.21.15.137:0/2632159833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccbfff640 1 -- 172.21.15.137:0/2632159833 >> v1:172.21.15.170:6789/0 conn(0x7fbccc0b60b0 legacy=0x7fbccc0d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.090 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccbfff640 1 -- 172.21.15.137:0/2632159833 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0b5370 con 0x7fbccc15f680 2024-04-26T22:05:47.091 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.089+0000 7fbccb7fe640 1 --2- 172.21.15.137:0/2632159833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:05:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.090+0000 7fbccbfff640 1 --2- 172.21.15.137:0/2632159833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 0x7fbccc0d3820 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097a0 tx=0x7fbcbc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bf7a3378e1c5bf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.090+0000 7fbccaffd640 1 -- 172.21.15.137:0/2632159833 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc037070 con 0x7fbccc15f680 2024-04-26T22:05:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.090+0000 7fbccaffd640 1 -- 172.21.15.137:0/2632159833 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc032440 con 0x7fbccc15f680 2024-04-26T22:05:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.090+0000 7fbccaffd640 1 -- 172.21.15.137:0/2632159833 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc032810 con 0x7fbccc15f680 2024-04-26T22:05:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.091+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2632159833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 msgr2=0x7fbccc0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.091+0000 7fbcd25c9640 1 --2- 172.21.15.137:0/2632159833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 0x7fbccc0d3820 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097a0 tx=0x7fbcbc02a180 comp rx=0 tx=0).stop 2024-04-26T22:05:47.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.091+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2632159833 shutdown_connections 2024-04-26T22:05:47.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.091+0000 7fbcd25c9640 1 --2- 172.21.15.137:0/2632159833 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.091+0000 7fbcd25c9640 1 --2- 172.21.15.137:0/2632159833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 0x7fbccc0d3820 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.091+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2632159833 >> 172.21.15.137:0/2632159833 conn(0x7fbccc08eca0 msgr2=0x7fbccc09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:47.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.091+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2632159833 shutdown_connections 2024-04-26T22:05:47.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.091+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2632159833 wait complete. 2024-04-26T22:05:47.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.092+0000 7fbcd25c9640 1 Processor -- start 2024-04-26T22:05:47.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.092+0000 7fbcd25c9640 1 -- start start 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbcd25c9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbccc0b60b0 0x7fbccc0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbcd25c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 0x7fbccc0cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbcd25c9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbcd25c9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc0d57b0 con 0x7fbccc0b60b0 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbcd25c9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc0d5630 con 0x7fbccc15f680 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbcd25c9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbccc0d5930 con 0x7fbccc163aa0 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbccc0b60b0 0x7fbccc0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbccc0b60b0 0x7fbccc0cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41328/0 (socket says 172.21.15.137:41328) 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccbfff640 1 -- 172.21.15.137:0/2992631430 learned_addr learned my addr 172.21.15.137:0/2992631430 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccb7fe640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 0x7fbccc0cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbcd0b66640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccbfff640 1 -- 172.21.15.137:0/2992631430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 msgr2=0x7fbccc0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccbfff640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccbfff640 1 -- 172.21.15.137:0/2992631430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 msgr2=0x7fbccc0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccbfff640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 0x7fbccc0cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccbfff640 1 -- 172.21.15.137:0/2992631430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbccc0c8ed0 con 0x7fbccc0b60b0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.093+0000 7fbccb7fe640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 0x7fbccc0cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.094+0000 7fbccbfff640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbccc0b60b0 0x7fbccc0cc340 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc035040 tx=0x7fbcbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.094+0000 7fbcc8ff9640 1 -- 172.21.15.137:0/2992631430 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc037040 con 0x7fbccc0b60b0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.094+0000 7fbcc8ff9640 1 -- 172.21.15.137:0/2992631430 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc030500 con 0x7fbccc0b60b0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.094+0000 7fbcc8ff9640 1 -- 172.21.15.137:0/2992631430 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc030910 con 0x7fbccc0b60b0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.094+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbccc0c91b0 con 0x7fbccc0b60b0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.094+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbccc0c9770 con 0x7fbccc0b60b0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.095+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbccc06a290 con 0x7fbccc0b60b0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.095+0000 7fbcc8ff9640 1 -- 172.21.15.137:0/2992631430 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbcbc044020 con 0x7fbccc0b60b0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.096+0000 7fbcc8ff9640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.096+0000 7fbcc8ff9640 1 -- 172.21.15.137:0/2992631430 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7fbcbc0abd10 con 0x7fbccc0b60b0 2024-04-26T22:05:47.097 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.096+0000 7fbccb7fe640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.096+0000 7fbccb7fe640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbccc1f8a10 tx=0x7fbcc0009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:47.100 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.100+0000 7fbcc8ff9640 1 -- 172.21.15.137:0/2992631430 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbcbc079ab0 con 0x7fbccc0b60b0 2024-04-26T22:05:47.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.273+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbccc0b4cd0 con 0x7fbccc0b60b0 2024-04-26T22:05:47.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.273+0000 7fbcc8ff9640 1 -- 172.21.15.137:0/2992631430 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fbcbc07ddb0 con 0x7fbccc0b60b0 2024-04-26T22:05:47.273 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:05:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 msgr2=0x7fbcb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbccc1f8a10 tx=0x7fbcc0009240 comp rx=0 tx=0).stop 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbccc0b60b0 msgr2=0x7fbccc0cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbccc0b60b0 0x7fbccc0cc340 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc035040 tx=0x7fbcbc0046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 shutdown_connections 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbcb806c8f0 0x7fbcb806edb0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbccc163aa0 0x7fbccc0ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbccc15f680 0x7fbccc0cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 --2- 172.21.15.137:0/2992631430 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbccc0b60b0 0x7fbccc0cc340 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 >> 172.21.15.137:0/2992631430 conn(0x7fbccc08eca0 msgr2=0x7fbccc15e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 shutdown_connections 2024-04-26T22:05:47.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.275+0000 7fbcd25c9640 1 -- 172.21.15.137:0/2992631430 wait complete. 2024-04-26T22:05:47.286 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:05:47.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.386+0000 7f7812283640 1 Processor -- start 2024-04-26T22:05:47.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.386+0000 7f7812283640 1 -- start start 2024-04-26T22:05:47.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.387+0000 7f7812283640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c06c9b0 0x7f780c06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.387+0000 7f7812283640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f780c070b30 con 0x7f780c15f2b0 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.387+0000 7f7812283640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f780c070e10 con 0x7f780c0706a0 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.387+0000 7f7812283640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f780c0af610 con 0x7f780c06c9b0 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.387+0000 7f780bfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f780c15f2b0 0x7f780c06c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58566/0 (socket says 172.21.15.137:58566) 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.387+0000 7f780bfff640 1 -- 172.21.15.137:0/2092698417 learned_addr learned my addr 172.21.15.137:0/2092698417 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.387+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637527175 0 0) 0x7f780c070b30 con 0x7f780c15f2b0 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.387+0000 7f7810820640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c06c9b0 0x7f780c06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.387+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77f4003520 con 0x7f780c15f2b0 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1212904401 0 0) 0x7f77f4003520 con 0x7f780c15f2b0 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c06c9b0 msgr2=0x7f780c06fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c06c9b0 0x7f780c06fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 >> v1:172.21.15.170:6789/0 conn(0x7f780c0706a0 legacy=0x7f780c0afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780c0710f0 con 0x7f780c15f2b0 2024-04-26T22:05:47.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f77fc001670 con 0x7f780c15f2b0 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 >> v1:172.21.15.137:6789/0 conn(0x7f780c15f2b0 legacy=0x7f780c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c06c9b0 0x7f77f40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f77f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77f4004d40 0x7f77f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f77f400ba70 con 0x7f77f4003f60 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f77f400bc20 con 0x7f77f4004d40 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f77f400be20 con 0x7f780c06c9b0 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780b7fe640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f77f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780bfff640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c06c9b0 0x7f77f40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f7810820640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77f4004d40 0x7f77f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780b7fe640 1 -- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c06c9b0 msgr2=0x7f77f40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780b7fe640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c06c9b0 0x7f77f40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780b7fe640 1 -- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77f4004d40 msgr2=0x7f77f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:47.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780b7fe640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f77f4004d40 0x7f77f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.388+0000 7f780b7fe640 1 -- 172.21.15.137:0/2092698417 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f4003520 con 0x7f77f4003f60 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.389+0000 7f780b7fe640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f77f4004800 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f7800001750 tx=0x7f77f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a974a854addea0ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.389+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800001370 con 0x7f77f4003f60 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.389+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78000052d0 con 0x7f77f4003f60 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.389+0000 7f780affd640 1 -- 172.21.15.137:0/2092698417 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780002abe0 con 0x7f77f4003f60 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.389+0000 7f7812283640 1 -- 172.21.15.137:0/2092698417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 msgr2=0x7f77f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.389+0000 7f7812283640 1 --2- 172.21.15.137:0/2092698417 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f77f4004800 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f7800001750 tx=0x7f77f4005830 comp rx=0 tx=0).stop 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.389+0000 7f7810820640 1 -- 172.21.15.137:0/2092698417 reap_dead start 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.390+0000 7f7812283640 1 -- 172.21.15.137:0/2092698417 shutdown_connections 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.390+0000 7f7812283640 1 -- 172.21.15.137:0/2092698417 >> 172.21.15.137:0/2092698417 conn(0x7f780c06f050 msgr2=0x7f780c06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.390+0000 7f7812283640 1 -- 172.21.15.137:0/2092698417 shutdown_connections 2024-04-26T22:05:47.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.390+0000 7f7812283640 1 -- 172.21.15.137:0/2092698417 wait complete. 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.391+0000 7f7812283640 1 Processor -- start 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.391+0000 7f7812283640 1 -- start start 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7812283640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f780c1f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7812283640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c146730 0x7f780c0b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7812283640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f780c0b3030 0x7f780c1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7812283640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f780c0b1890 con 0x7f77f4003f60 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7812283640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f780c0b4f40 con 0x7f780c0b3030 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7812283640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f780c15f690 con 0x7f780c146730 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f780bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f780c1f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f780bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f780c1f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41334/0 (socket says 172.21.15.137:41334) 2024-04-26T22:05:47.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f780bfff640 1 -- 172.21.15.137:0/1742579502 learned_addr learned my addr 172.21.15.137:0/1742579502 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f780bfff640 1 -- 172.21.15.137:0/1742579502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c146730 msgr2=0x7f780c0b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f780bfff640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c146730 0x7f780c0b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f780bfff640 1 -- 172.21.15.137:0/1742579502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f780c0b3030 msgr2=0x7f780c1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f780bfff640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f780c0b3030 0x7f780c1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f780bfff640 1 -- 172.21.15.137:0/1742579502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780c1584a0 con 0x7f77f4003f60 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f780bfff640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f780c1f5180 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f77fc007290 tx=0x7f77fc007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7808ff9640 1 -- 172.21.15.137:0/1742579502 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00f8e0 con 0x7f77f4003f60 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7808ff9640 1 -- 172.21.15.137:0/1742579502 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc018070 con 0x7f77f4003f60 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780c151360 con 0x7f77f4003f60 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7808ff9640 1 -- 172.21.15.137:0/1742579502 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00fce0 con 0x7f77f4003f60 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.392+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780c151920 con 0x7f77f4003f60 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.393+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780c06a290 con 0x7f77f4003f60 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.394+0000 7f7808ff9640 1 -- 172.21.15.137:0/1742579502 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77fc01d460 con 0x7f77f4003f60 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.394+0000 7f7808ff9640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f77f806c920 0x7f77f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.394+0000 7f7808ff9640 1 -- 172.21.15.137:0/1742579502 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f77fc08bd00 con 0x7f77f4003f60 2024-04-26T22:05:47.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.394+0000 7f780b7fe640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f77f806c920 0x7f77f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.394+0000 7f780b7fe640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f77f806c920 0x7f77f806ede0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7800032000 tx=0x7f780002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:47.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.398+0000 7f7808ff9640 1 -- 172.21.15.137:0/1742579502 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f77fc05a060 con 0x7f77f4003f60 2024-04-26T22:05:47.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.573+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f780c0b3450 con 0x7f77f4003f60 2024-04-26T22:05:47.574 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.574+0000 7f7808ff9640 1 -- 172.21.15.137:0/1742579502 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f77fc059960 con 0x7f77f4003f60 2024-04-26T22:05:47.574 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:05:47.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f77f806c920 msgr2=0x7f77f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f77f806c920 0x7f77f806ede0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7800032000 tx=0x7f780002c000 comp rx=0 tx=0).stop 2024-04-26T22:05:47.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 msgr2=0x7f780c1f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f780c1f5180 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f77fc007290 tx=0x7f77fc007750 comp rx=0 tx=0).stop 2024-04-26T22:05:47.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 shutdown_connections 2024-04-26T22:05:47.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f77f806c920 0x7f77f806ede0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f780c0b3030 0x7f780c1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f780c146730 0x7f780c0b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 --2- 172.21.15.137:0/1742579502 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f77f4003f60 0x7f780c1f5180 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 >> 172.21.15.137:0/1742579502 conn(0x7f780c06f050 msgr2=0x7f780c074160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:47.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 shutdown_connections 2024-04-26T22:05:47.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.576+0000 7f7812283640 1 -- 172.21.15.137:0/1742579502 wait complete. 2024-04-26T22:05:47.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:05:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.684+0000 7fd9a962a640 1 Processor -- start 2024-04-26T22:05:47.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.684+0000 7fd9a962a640 1 -- start start 2024-04-26T22:05:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a962a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd9a40d3ee0 0x7fd9a40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a962a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a40d03a0 con 0x7fd9a415f750 2024-04-26T22:05:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a962a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a40d0680 con 0x7fd9a415f370 2024-04-26T22:05:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a962a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd9a40d0960 con 0x7fd9a40d3ee0 2024-04-26T22:05:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a37fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd9a415f750 0x7fd9a40b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58576/0 (socket says 172.21.15.137:58576) 2024-04-26T22:05:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a37fe640 1 -- 172.21.15.137:0/1618461437 learned_addr learned my addr 172.21.15.137:0/1618461437 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 856668431 0 0) 0x7fd9a40d03a0 con 0x7fd9a415f750 2024-04-26T22:05:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd98c003520 con 0x7fd9a415f750 2024-04-26T22:05:47.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a27fc640 1 --2- 172.21.15.137:0/1618461437 >> v2:172.21.15.170:3300/0 conn(0x7fd9a40d3ee0 0x7fd9a40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3035557920 0 0) 0x7fd98c003520 con 0x7fd9a415f750 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 >> v2:172.21.15.170:3300/0 conn(0x7fd9a40d3ee0 msgr2=0x7fd9a40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 --2- 172.21.15.137:0/1618461437 >> v2:172.21.15.170:3300/0 conn(0x7fd9a40d3ee0 0x7fd9a40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 >> v1:172.21.15.170:6789/0 conn(0x7fd9a415f370 legacy=0x7fd9a40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a40d0c40 con 0x7fd9a415f750 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fd99c001670 con 0x7fd9a415f750 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a27fc640 1 --2- 172.21.15.137:0/1618461437 >> v2:172.21.15.170:3300/0 conn(0x7fd9a40d3ee0 0x7fd9a40cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 >> v1:172.21.15.137:6789/0 conn(0x7fd9a415f750 legacy=0x7fd9a40b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd98c0039b0 0x7fd98c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd98c004800 0x7fd98c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.685+0000 7fd9a1ffb640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd98c0051c0 0x7fd98c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a40d0960 con 0x7fd98c0051c0 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c00c110 con 0x7fd98c0039b0 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd98c00c310 con 0x7fd98c004800 2024-04-26T22:05:47.689 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a37fe640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd98c0051c0 0x7fd98c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a2ffd640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd98c0039b0 0x7fd98c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a27fc640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd98c004800 0x7fd98c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a37fe640 1 -- 172.21.15.137:0/1618461437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd98c004800 msgr2=0x7fd98c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a37fe640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd98c004800 0x7fd98c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a37fe640 1 -- 172.21.15.137:0/1618461437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd98c0039b0 msgr2=0x7fd98c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a37fe640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd98c0039b0 0x7fd98c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.686+0000 7fd9a37fe640 1 -- 172.21.15.137:0/1618461437 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c003520 con 0x7fd98c0051c0 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a37fe640 1 -- 172.21.15.137:0/1618461437 reap_dead start 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a37fe640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd98c0051c0 0x7fd98c00b9c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c240 tx=0x7fd98c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e91f045e425a405 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c007cf0 con 0x7fd98c0051c0 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd99c0058d0 con 0x7fd98c0051c0 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a1ffb640 1 -- 172.21.15.137:0/1618461437 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c005ce0 con 0x7fd98c0051c0 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a962a640 1 -- 172.21.15.137:0/1618461437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd98c0051c0 msgr2=0x7fd98c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a962a640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd98c0051c0 0x7fd98c00b9c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c240 tx=0x7fd98c005830 comp rx=0 tx=0).stop 2024-04-26T22:05:47.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a962a640 1 -- 172.21.15.137:0/1618461437 shutdown_connections 2024-04-26T22:05:47.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a962a640 1 --2- 172.21.15.137:0/1618461437 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd98c0051c0 0x7fd98c00b9c0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a962a640 1 -- 172.21.15.137:0/1618461437 >> 172.21.15.137:0/1618461437 conn(0x7fd9a408ec10 msgr2=0x7fd9a409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:47.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a962a640 1 -- 172.21.15.137:0/1618461437 shutdown_connections 2024-04-26T22:05:47.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.687+0000 7fd9a962a640 1 -- 172.21.15.137:0/1618461437 wait complete. 2024-04-26T22:05:47.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a962a640 1 Processor -- start 2024-04-26T22:05:47.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a962a640 1 -- start start 2024-04-26T22:05:47.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a962a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd98c0051c0 0x7fd9a415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a962a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a4161390 0x7fd9a415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a962a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a41f8ec0 0x7fd9a406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a962a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a40cfef0 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a962a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a40cfd70 con 0x7fd9a4161390 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a962a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd9a40d0070 con 0x7fd98c0051c0 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a41f8ec0 0x7fd9a406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a37fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a41f8ec0 0x7fd9a406dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41346/0 (socket says 172.21.15.137:41346) 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.689+0000 7fd9a37fe640 1 -- 172.21.15.137:0/1737348960 learned_addr learned my addr 172.21.15.137:0/1737348960 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a27fc640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a4161390 0x7fd9a415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a2ffd640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd98c0051c0 0x7fd9a415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a37fe640 1 -- 172.21.15.137:0/1737348960 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd98c0051c0 msgr2=0x7fd9a415b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a37fe640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd98c0051c0 0x7fd9a415b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a37fe640 1 -- 172.21.15.137:0/1737348960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a4161390 msgr2=0x7fd9a415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a37fe640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a4161390 0x7fd9a415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a37fe640 1 -- 172.21.15.137:0/1737348960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a4161950 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a37fe640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a41f8ec0 0x7fd9a406dab0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c360 tx=0x7fd9a40d0e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd98b7fe640 1 -- 172.21.15.137:0/1737348960 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c007cf0 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd98b7fe640 1 -- 172.21.15.137:0/1737348960 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd99c041070 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a40c8ea0 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd98b7fe640 1 -- 172.21.15.137:0/1737348960 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99c001c30 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.690+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a40c9460 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.691+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a406a290 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.691+0000 7fd98b7fe640 1 -- 172.21.15.137:0/1737348960 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd99c03b070 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.692+0000 7fd98b7fe640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd99006c8f0 0x7fd99006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:47.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.692+0000 7fd98b7fe640 1 -- 172.21.15.137:0/1737348960 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7fd99c0ab480 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.692+0000 7fd9a2ffd640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd99006c8f0 0x7fd99006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:47.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.692+0000 7fd9a2ffd640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd99006c8f0 0x7fd99006edb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd994000f80 tx=0x7fd994009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:47.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.696+0000 7fd98b7fe640 1 -- 172.21.15.137:0/1737348960 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd99c0797e0 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.882+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd9a40c9630 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.883+0000 7fd98b7fe640 1 -- 172.21.15.137:0/1737348960 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v91) ==== 80+0+246 (secure 0 0 0) 0x7fd99c0790e0 con 0x7fd9a41f8ec0 2024-04-26T22:05:47.883 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6837/2128712520 2024-04-27T22:05:08.380367+0000 2024-04-26T22:05:47.883 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6835/2128712520 2024-04-27T22:05:08.380367+0000 2024-04-26T22:05:47.883 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.170:6835/865192507 2024-04-27T22:04:27.224170+0000 2024-04-26T22:05:47.884 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.170:6833/865192507 2024-04-27T22:04:27.224170+0000 2024-04-26T22:05:47.884 INFO:teuthology.orchestra.run.smithi137.stderr:listed 4 entries 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd99006c8f0 msgr2=0x7fd99006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd99006c8f0 0x7fd99006edb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd994000f80 tx=0x7fd994009040 comp rx=0 tx=0).stop 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a41f8ec0 msgr2=0x7fd9a406dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a41f8ec0 0x7fd9a406dab0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fd99c00c360 tx=0x7fd9a40d0e10 comp rx=0 tx=0).stop 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 shutdown_connections 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd99006c8f0 0x7fd99006edb0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd9a41f8ec0 0x7fd9a406dab0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd9a4161390 0x7fd9a415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 --2- 172.21.15.137:0/1737348960 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd98c0051c0 0x7fd9a415b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:47.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 >> 172.21.15.137:0/1737348960 conn(0x7fd9a408ec10 msgr2=0x7fd9a406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:47.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 shutdown_connections 2024-04-26T22:05:47.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:47.885+0000 7fd9a962a640 1 -- 172.21.15.137:0/1737348960 wait complete. 2024-04-26T22:05:47.895 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:05:47.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:47.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:05:47.922 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:05:47.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:05:47.922 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:05:47.977 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:05:47.977 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:05:47.977 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:47.996 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:05:47.996 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:05:47.996 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:05:47.996 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:48.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:05:48.033 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:05:48.033 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:05:48.033 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:48.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:05:48.053 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:48.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.169+0000 7f9582de9640 1 Processor -- start 2024-04-26T22:05:48.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.169+0000 7f9582de9640 1 -- start start 2024-04-26T22:05:48.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.170+0000 7f9582de9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f957c15d0c0 0x7f957c15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.170+0000 7f9582de9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f957c160200 0x7f957c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.170+0000 7f9582de9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957c160780 con 0x7f957c06f3c0 2024-04-26T22:05:48.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.170+0000 7f9582de9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f957c160a60 con 0x7f957c15d0c0 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.170+0000 7f9582de9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f957c0cff90 con 0x7f957c160200 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.170+0000 7f9580b85640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f957c15d0c0 0x7f957c15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.170+0000 7f9580b85640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f957c15d0c0 0x7f957c15fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41348/0 (socket says 172.21.15.137:41348) 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.170+0000 7f9580b85640 1 -- 172.21.15.137:0/2274709092 learned_addr learned my addr 172.21.15.137:0/2274709092 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.171+0000 7f957bfff640 1 --2- 172.21.15.137:0/2274709092 >> v2:172.21.15.170:3300/0 conn(0x7f957c160200 0x7f957c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.171+0000 7f9580b85640 1 -- 172.21.15.137:0/2274709092 >> v2:172.21.15.170:3300/0 conn(0x7f957c160200 msgr2=0x7f957c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.171+0000 7f9580b85640 1 --2- 172.21.15.137:0/2274709092 >> v2:172.21.15.170:3300/0 conn(0x7f957c160200 0x7f957c06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.171+0000 7f9580b85640 1 -- 172.21.15.137:0/2274709092 >> v1:172.21.15.170:6789/0 conn(0x7f957c06f3c0 legacy=0x7f957c073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.171+0000 7f9580b85640 1 -- 172.21.15.137:0/2274709092 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957c0d0270 con 0x7f957c15d0c0 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.171+0000 7f957bfff640 1 --2- 172.21.15.137:0/2274709092 >> v2:172.21.15.170:3300/0 conn(0x7f957c160200 0x7f957c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.171+0000 7f9580b85640 1 --2- 172.21.15.137:0/2274709092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 0x7f957c15fcc0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f957c156d30 tx=0x7f956c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4b42a1fcdd88e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f957b7fe640 1 -- 172.21.15.137:0/2274709092 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c037070 con 0x7f957c15d0c0 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f957b7fe640 1 -- 172.21.15.137:0/2274709092 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f956c032440 con 0x7f957c15d0c0 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f957b7fe640 1 -- 172.21.15.137:0/2274709092 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c032810 con 0x7f957c15d0c0 2024-04-26T22:05:48.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f9582de9640 1 -- 172.21.15.137:0/2274709092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 msgr2=0x7f957c15fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f9582de9640 1 --2- 172.21.15.137:0/2274709092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 0x7f957c15fcc0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f957c156d30 tx=0x7f956c02a270 comp rx=0 tx=0).stop 2024-04-26T22:05:48.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f9582de9640 1 -- 172.21.15.137:0/2274709092 shutdown_connections 2024-04-26T22:05:48.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f9582de9640 1 --2- 172.21.15.137:0/2274709092 >> v2:172.21.15.170:3300/0 conn(0x7f957c160200 0x7f957c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f9582de9640 1 --2- 172.21.15.137:0/2274709092 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 0x7f957c15fcc0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f9582de9640 1 -- 172.21.15.137:0/2274709092 >> 172.21.15.137:0/2274709092 conn(0x7f957c0b3b10 msgr2=0x7f957c0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:48.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f9582de9640 1 -- 172.21.15.137:0/2274709092 shutdown_connections 2024-04-26T22:05:48.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.172+0000 7f9582de9640 1 -- 172.21.15.137:0/2274709092 wait complete. 2024-04-26T22:05:48.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.173+0000 7f9582de9640 1 Processor -- start 2024-04-26T22:05:48.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.173+0000 7f9582de9640 1 -- start start 2024-04-26T22:05:48.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.174+0000 7f9582de9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f957c06f3c0 0x7f957c145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.174+0000 7f9582de9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 0x7f957c14ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.174+0000 7f9582de9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f957c160200 0x7f957c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.174+0000 7f9582de9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f957c15d620 con 0x7f957c15d0c0 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.174+0000 7f9582de9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f957c15d4a0 con 0x7f957c160200 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.174+0000 7f9582de9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f957c0d17a0 con 0x7f957c06f3c0 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.174+0000 7f957bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 0x7f957c14ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.174+0000 7f957bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 0x7f957c14ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41362/0 (socket says 172.21.15.137:41362) 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.174+0000 7f957bfff640 1 -- 172.21.15.137:0/57019239 learned_addr learned my addr 172.21.15.137:0/57019239 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f957bfff640 1 -- 172.21.15.137:0/57019239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f957c06f3c0 msgr2=0x7f957c145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f957bfff640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f957c06f3c0 0x7f957c145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f957bfff640 1 -- 172.21.15.137:0/57019239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f957c160200 msgr2=0x7f957c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f957bfff640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f957c160200 0x7f957c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f957bfff640 1 -- 172.21.15.137:0/57019239 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957c14f1b0 con 0x7f957c15d0c0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f957bfff640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 0x7f957c14ff30 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f957000d800 tx=0x7f957000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f95797fa640 1 -- 172.21.15.137:0/57019239 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95700096a0 con 0x7f957c15d0c0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f95797fa640 1 -- 172.21.15.137:0/57019239 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9570019070 con 0x7f957c15d0c0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957c14f450 con 0x7f957c15d0c0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f95797fa640 1 -- 172.21.15.137:0/57019239 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570009a80 con 0x7f957c15d0c0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.175+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957c145e10 con 0x7f957c15d0c0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.176+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957c0693d0 con 0x7f957c15d0c0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.176+0000 7f95797fa640 1 -- 172.21.15.137:0/57019239 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9570009c20 con 0x7f957c15d0c0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.177+0000 7f95797fa640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f956806c8f0 0x7f956806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.177+0000 7f95797fa640 1 -- 172.21.15.137:0/57019239 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f957008c0b0 con 0x7f957c15d0c0 2024-04-26T22:05:48.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.177+0000 7f9580b85640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f956806c8f0 0x7f956806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.177+0000 7f9580b85640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f956806c8f0 0x7f956806edb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f956c034000 tx=0x7f956c02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:48.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.181+0000 7f95797fa640 1 -- 172.21.15.137:0/57019239 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9570011340 con 0x7f957c15d0c0 2024-04-26T22:05:48.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.395+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f957c0cf450 con 0x7f957c15d0c0 2024-04-26T22:05:48.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.395+0000 7f95797fa640 1 -- 172.21.15.137:0/57019239 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5196 (secure 0 0 0) 0x7f957005a380 con 0x7f957c15d0c0 2024-04-26T22:05:48.395 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:48.395 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:05:12.391859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/4231448082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":4231448082},{"type":"v1","addr":"172.21.15.137:6837","nonce":4231448082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":6}]} 2024-04-26T22:05:48.396 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 60 2024-04-26T22:05:48.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f956806c8f0 msgr2=0x7f956806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f956806c8f0 0x7f956806edb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f956c034000 tx=0x7f956c02c000 comp rx=0 tx=0).stop 2024-04-26T22:05:48.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 msgr2=0x7f957c14ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 0x7f957c14ff30 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f957000d800 tx=0x7f957000dcc0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 shutdown_connections 2024-04-26T22:05:48.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f956806c8f0 0x7f956806edb0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f957c15d0c0 0x7f957c14ff30 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f957c160200 0x7f957c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 --2- 172.21.15.137:0/57019239 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f957c06f3c0 0x7f957c145480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 >> 172.21.15.137:0/57019239 conn(0x7f957c0b3b10 msgr2=0x7f957c1551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:48.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 shutdown_connections 2024-04-26T22:05:48.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.397+0000 7f9582de9640 1 -- 172.21.15.137:0/57019239 wait complete. 2024-04-26T22:05:48.408 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:05:48.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.507+0000 7faf993af640 1 Processor -- start 2024-04-26T22:05:48.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.507+0000 7faf993af640 1 -- start start 2024-04-26T22:05:48.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.507+0000 7faf993af640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faf9415f370 0x7faf940cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.507+0000 7faf993af640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faf9415f750 0x7faf940b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf993af640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf940d03a0 con 0x7faf940d37d0 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf993af640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7faf940b4d10 con 0x7faf9415f750 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf993af640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7faf940d0680 con 0x7faf9415f370 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf927fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7faf9415f750 0x7faf940b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf937fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7faf940d37d0 0x7faf940d1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58588/0 (socket says 172.21.15.137:58588) 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf937fe640 1 -- 172.21.15.137:0/3888532568 learned_addr learned my addr 172.21.15.137:0/3888532568 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf92ffd640 1 --2- 172.21.15.137:0/3888532568 >> v2:172.21.15.170:3300/0 conn(0x7faf9415f370 0x7faf940cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf927fc640 1 -- 172.21.15.137:0/3888532568 >> v2:172.21.15.170:3300/0 conn(0x7faf9415f370 msgr2=0x7faf940cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf927fc640 1 --2- 172.21.15.137:0/3888532568 >> v2:172.21.15.170:3300/0 conn(0x7faf9415f370 0x7faf940cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf927fc640 1 -- 172.21.15.137:0/3888532568 >> v1:172.21.15.137:6789/0 conn(0x7faf940d37d0 legacy=0x7faf940d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf927fc640 1 -- 172.21.15.137:0/3888532568 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf940d0960 con 0x7faf9415f750 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.508+0000 7faf91ffb640 1 -- 172.21.15.137:0/3888532568 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1465871661 0 0) 0x7faf940d03a0 con 0x7faf940d37d0 2024-04-26T22:05:48.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf927fc640 1 --2- 172.21.15.137:0/3888532568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f750 0x7faf940b47d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7faf940d2d10 tx=0x7faf8802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc3710069533ff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:48.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf91ffb640 1 -- 172.21.15.137:0/3888532568 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88037070 con 0x7faf9415f750 2024-04-26T22:05:48.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf91ffb640 1 -- 172.21.15.137:0/3888532568 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf88032440 con 0x7faf9415f750 2024-04-26T22:05:48.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf91ffb640 1 -- 172.21.15.137:0/3888532568 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88032810 con 0x7faf9415f750 2024-04-26T22:05:48.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf993af640 1 -- 172.21.15.137:0/3888532568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f750 msgr2=0x7faf940b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf993af640 1 --2- 172.21.15.137:0/3888532568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f750 0x7faf940b47d0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7faf940d2d10 tx=0x7faf8802a1a0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf993af640 1 -- 172.21.15.137:0/3888532568 shutdown_connections 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf993af640 1 --2- 172.21.15.137:0/3888532568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f750 0x7faf940b47d0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf993af640 1 --2- 172.21.15.137:0/3888532568 >> v2:172.21.15.170:3300/0 conn(0x7faf9415f370 0x7faf940cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf993af640 1 -- 172.21.15.137:0/3888532568 >> 172.21.15.137:0/3888532568 conn(0x7faf9408ec10 msgr2=0x7faf9409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf993af640 1 -- 172.21.15.137:0/3888532568 shutdown_connections 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.509+0000 7faf993af640 1 -- 172.21.15.137:0/3888532568 wait complete. 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.511+0000 7faf993af640 1 Processor -- start 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.511+0000 7faf993af640 1 -- start start 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.511+0000 7faf993af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf940d37d0 0x7faf941f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.511+0000 7faf993af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f370 0x7faf940ba130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.511+0000 7faf993af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf9415f750 0x7faf9406d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.511+0000 7faf993af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7faf940b61d0 con 0x7faf9415f370 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.511+0000 7faf993af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7faf940d0f20 con 0x7faf940d37d0 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.511+0000 7faf993af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7faf940b6350 con 0x7faf9415f750 2024-04-26T22:05:48.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.511+0000 7faf927fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f370 0x7faf940ba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf927fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f370 0x7faf940ba130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41388/0 (socket says 172.21.15.137:41388) 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf927fc640 1 -- 172.21.15.137:0/4052513523 learned_addr learned my addr 172.21.15.137:0/4052513523 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf927fc640 1 -- 172.21.15.137:0/4052513523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf9415f750 msgr2=0x7faf9406d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf927fc640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf9415f750 0x7faf9406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf927fc640 1 -- 172.21.15.137:0/4052513523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf940d37d0 msgr2=0x7faf941f45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf927fc640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf940d37d0 0x7faf941f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf927fc640 1 -- 172.21.15.137:0/4052513523 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9415fca0 con 0x7faf9415f370 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf927fc640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f370 0x7faf940ba130 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7faf88009890 tx=0x7faf880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf7b7fe640 1 -- 172.21.15.137:0/4052513523 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88037040 con 0x7faf9415f370 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf7b7fe640 1 -- 172.21.15.137:0/4052513523 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf88042070 con 0x7faf9415f370 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf7b7fe640 1 -- 172.21.15.137:0/4052513523 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88030bd0 con 0x7faf9415f370 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9415ff80 con 0x7faf9415f370 2024-04-26T22:05:48.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.512+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf94160540 con 0x7faf9415f370 2024-04-26T22:05:48.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.513+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9406a290 con 0x7faf9415f370 2024-04-26T22:05:48.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.513+0000 7faf7b7fe640 1 -- 172.21.15.137:0/4052513523 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf88047460 con 0x7faf9415f370 2024-04-26T22:05:48.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.514+0000 7faf7b7fe640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf8006c8f0 0x7faf8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.514+0000 7faf7b7fe640 1 -- 172.21.15.137:0/4052513523 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7faf880ac7f0 con 0x7faf9415f370 2024-04-26T22:05:48.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.514+0000 7faf92ffd640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf8006c8f0 0x7faf8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.514+0000 7faf92ffd640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf8006c8f0 0x7faf8006edb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faf840098f0 tx=0x7faf84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:48.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.518+0000 7faf7b7fe640 1 -- 172.21.15.137:0/4052513523 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7faf88032e20 con 0x7faf9415f370 2024-04-26T22:05:48.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.692+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf940cfe80 con 0x7faf9415f370 2024-04-26T22:05:48.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.694+0000 7faf7b7fe640 1 -- 172.21.15.137:0/4052513523 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16983 (secure 0 0 0) 0x7faf8807ab50 con 0x7faf9415f370 2024-04-26T22:05:48.694 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:48.694 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":91,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:05:08.380391+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:04:11.600389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-26T22:04:12.347068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.137:6835/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.170:6835/865192507":"2024-04-27T22:04:27.224170+0000","172.21.15.170:6833/865192507":"2024-04-27T22:04:27.224170+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.695+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf8006c8f0 msgr2=0x7faf8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf8006c8f0 0x7faf8006edb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faf840098f0 tx=0x7faf84008040 comp rx=0 tx=0).stop 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f370 msgr2=0x7faf940ba130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f370 0x7faf940ba130 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7faf88009890 tx=0x7faf880046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 shutdown_connections 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf8006c8f0 0x7faf8006edb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7faf9415f370 0x7faf940ba130 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7faf9415f750 0x7faf9406d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 --2- 172.21.15.137:0/4052513523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf940d37d0 0x7faf941f45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 >> 172.21.15.137:0/4052513523 conn(0x7faf9408ec10 msgr2=0x7faf9409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:48.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 shutdown_connections 2024-04-26T22:05:48.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.696+0000 7faf993af640 1 -- 172.21.15.137:0/4052513523 wait complete. 2024-04-26T22:05:48.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:04:11.600389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:04:12.347068+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:05:48.707 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:05:48.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.807+0000 7f9f400cc640 1 Processor -- start 2024-04-26T22:05:48.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.807+0000 7f9f400cc640 1 -- start start 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.808+0000 7f9f400cc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 0x7f9f380b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.808+0000 7f9f400cc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f9f380b60b0 0x7f9f380d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.808+0000 7f9f400cc640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f380d3f50 con 0x7f9f3815f680 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.808+0000 7f9f400cc640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f9f3815fa60 con 0x7f9f380b60b0 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.808+0000 7f9f400cc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9f380b5090 con 0x7f9f380d3820 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.808+0000 7f9f3de68640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9f3815f680 0x7f9f38163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58602/0 (socket says 172.21.15.137:58602) 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.808+0000 7f9f3de68640 1 -- 172.21.15.137:0/744014705 learned_addr learned my addr 172.21.15.137:0/744014705 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.808+0000 7f9f3e669640 1 --2- 172.21.15.137:0/744014705 >> v2:172.21.15.137:3300/0 conn(0x7f9f380b60b0 0x7f9f380d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.809+0000 7f9f3ce66640 1 -- 172.21.15.137:0/744014705 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049488819 0 0) 0x7f9f380d3f50 con 0x7f9f3815f680 2024-04-26T22:05:48.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.809+0000 7f9f3ce66640 1 -- 172.21.15.137:0/744014705 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f24003520 con 0x7f9f3815f680 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.809+0000 7f9f3d667640 1 --2- 172.21.15.137:0/744014705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 0x7f9f380b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.809+0000 7f9f3e669640 1 -- 172.21.15.137:0/744014705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 msgr2=0x7f9f380b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.809+0000 7f9f3e669640 1 --2- 172.21.15.137:0/744014705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 0x7f9f380b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.809+0000 7f9f3e669640 1 -- 172.21.15.137:0/744014705 >> v1:172.21.15.137:6789/0 conn(0x7f9f3815f680 legacy=0x7f9f38163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.809+0000 7f9f3e669640 1 -- 172.21.15.137:0/744014705 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f380b5370 con 0x7f9f380b60b0 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.809+0000 7f9f3d667640 1 --2- 172.21.15.137:0/744014705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 0x7f9f380b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.809+0000 7f9f3e669640 1 --2- 172.21.15.137:0/744014705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f380b60b0 0x7f9f380d4f20 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f9f340097a0 tx=0x7f9f3402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce75b987ebfb9d94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f3ce66640 1 -- 172.21.15.137:0/744014705 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34037070 con 0x7f9f380b60b0 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f3ce66640 1 -- 172.21.15.137:0/744014705 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f34032440 con 0x7f9f380b60b0 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f3ce66640 1 -- 172.21.15.137:0/744014705 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34032810 con 0x7f9f380b60b0 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f400cc640 1 -- 172.21.15.137:0/744014705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f380b60b0 msgr2=0x7f9f380d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f400cc640 1 --2- 172.21.15.137:0/744014705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f380b60b0 0x7f9f380d4f20 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f9f340097a0 tx=0x7f9f3402a180 comp rx=0 tx=0).stop 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f400cc640 1 -- 172.21.15.137:0/744014705 shutdown_connections 2024-04-26T22:05:48.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f400cc640 1 --2- 172.21.15.137:0/744014705 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f380b60b0 0x7f9f380d4f20 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f400cc640 1 --2- 172.21.15.137:0/744014705 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 0x7f9f380b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f400cc640 1 -- 172.21.15.137:0/744014705 >> 172.21.15.137:0/744014705 conn(0x7f9f3808eca0 msgr2=0x7f9f3809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:48.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f400cc640 1 -- 172.21.15.137:0/744014705 shutdown_connections 2024-04-26T22:05:48.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.810+0000 7f9f400cc640 1 -- 172.21.15.137:0/744014705 wait complete. 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.811+0000 7f9f400cc640 1 Processor -- start 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.811+0000 7f9f400cc640 1 -- start start 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f400cc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f380b60b0 0x7f9f38153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f400cc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 0x7f9f380cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f400cc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f3815f680 0x7f9f380cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f400cc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f380d55e0 con 0x7f9f3815f680 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f400cc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9f380d5460 con 0x7f9f380b60b0 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f400cc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9f380d5760 con 0x7f9f380d3820 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3e669640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f3815f680 0x7f9f380cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3e669640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f3815f680 0x7f9f380cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41406/0 (socket says 172.21.15.137:41406) 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3e669640 1 -- 172.21.15.137:0/2863270832 learned_addr learned my addr 172.21.15.137:0/2863270832 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3e669640 1 -- 172.21.15.137:0/2863270832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 msgr2=0x7f9f380cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3e669640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 0x7f9f380cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3e669640 1 -- 172.21.15.137:0/2863270832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f380b60b0 msgr2=0x7f9f38153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3de68640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f380b60b0 0x7f9f38153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3e669640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f380b60b0 0x7f9f38153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3e669640 1 -- 172.21.15.137:0/2863270832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f38154050 con 0x7f9f3815f680 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.812+0000 7f9f3de68640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f380b60b0 0x7f9f38153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.813+0000 7f9f3e669640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f3815f680 0x7f9f380cc880 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f9f340098c0 tx=0x7f9f340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.813+0000 7f9f2e7fc640 1 -- 172.21.15.137:0/2863270832 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34037040 con 0x7f9f3815f680 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.813+0000 7f9f2e7fc640 1 -- 172.21.15.137:0/2863270832 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f34042070 con 0x7f9f3815f680 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.813+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f38161c60 con 0x7f9f3815f680 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.813+0000 7f9f2e7fc640 1 -- 172.21.15.137:0/2863270832 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f340308a0 con 0x7f9f3815f680 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.813+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f380ceae0 con 0x7f9f3815f680 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.814+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3806a290 con 0x7f9f3815f680 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.814+0000 7f9f2e7fc640 1 -- 172.21.15.137:0/2863270832 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f34030a40 con 0x7f9f3815f680 2024-04-26T22:05:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.815+0000 7f9f2e7fc640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1c06c920 0x7f9f1c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.815+0000 7f9f2e7fc640 1 -- 172.21.15.137:0/2863270832 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f9f340ac4c0 con 0x7f9f3815f680 2024-04-26T22:05:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.815+0000 7f9f3de68640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1c06c920 0x7f9f1c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.815+0000 7f9f3de68640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1c06c920 0x7f9f1c06ede0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9f30005c00 tx=0x7f9f30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.819+0000 7f9f2e7fc640 1 -- 172.21.15.137:0/2863270832 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9f3407a8b0 con 0x7f9f3815f680 2024-04-26T22:05:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.996+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9f380b4cd0 con 0x7f9f3815f680 2024-04-26T22:05:48.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.997+0000 7f9f2e7fc640 1 -- 172.21.15.137:0/2863270832 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f9f3407a1b0 con 0x7f9f3815f680 2024-04-26T22:05:48.997 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:05:48.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1c06c920 msgr2=0x7f9f1c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1c06c920 0x7f9f1c06ede0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9f30005c00 tx=0x7f9f30009040 comp rx=0 tx=0).stop 2024-04-26T22:05:48.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f3815f680 msgr2=0x7f9f380cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:48.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f3815f680 0x7f9f380cc880 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f9f340098c0 tx=0x7f9f340046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 shutdown_connections 2024-04-26T22:05:48.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f1c06c920 0x7f9f1c06ede0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:48.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f3815f680 0x7f9f380cc880 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f380d3820 0x7f9f380cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 --2- 172.21.15.137:0/2863270832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f380b60b0 0x7f9f38153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 >> 172.21.15.137:0/2863270832 conn(0x7f9f3808eca0 msgr2=0x7f9f380d3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:49.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 shutdown_connections 2024-04-26T22:05:49.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:48.999+0000 7f9f400cc640 1 -- 172.21.15.137:0/2863270832 wait complete. 2024-04-26T22:05:49.009 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:05:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.111+0000 7f874ff38640 1 Processor -- start 2024-04-26T22:05:49.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.111+0000 7f874ff38640 1 -- start start 2024-04-26T22:05:49.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.112+0000 7f874ff38640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f874815d6f0 0x7f87481613c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.112+0000 7f874ff38640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8748070740 con 0x7f87480b7960 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.112+0000 7f874ff38640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8748070a00 con 0x7f87481468a0 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.112+0000 7f874ff38640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8748070ce0 con 0x7f874815d6f0 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.112+0000 7f874d4d3640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f87480b7960 0x7f8748160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58614/0 (socket says 172.21.15.137:58614) 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.112+0000 7f874d4d3640 1 -- 172.21.15.137:0/3341069815 learned_addr learned my addr 172.21.15.137:0/3341069815 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.112+0000 7f874e4d5640 1 --2- 172.21.15.137:0/3341069815 >> v2:172.21.15.170:3300/0 conn(0x7f874815d6f0 0x7f87481613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.112+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094501766 0 0) 0x7f8748070740 con 0x7f87480b7960 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.112+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8734003520 con 0x7f87480b7960 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4243246257 0 0) 0x7f8734003520 con 0x7f87480b7960 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 >> v2:172.21.15.170:3300/0 conn(0x7f874815d6f0 msgr2=0x7f87481613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 --2- 172.21.15.137:0/3341069815 >> v2:172.21.15.170:3300/0 conn(0x7f874815d6f0 0x7f87481613c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 >> v1:172.21.15.170:6789/0 conn(0x7f87481468a0 legacy=0x7f87480b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8748070fc0 con 0x7f87480b7960 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f8738001670 con 0x7f87480b7960 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 >> v1:172.21.15.137:6789/0 conn(0x7f87480b7960 legacy=0x7f8748160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340039b0 0x7f8734003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734004800 0x7f8734004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87340051c0 0x7f873400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8748070ce0 con 0x7f87340051c0 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f873400c160 con 0x7f8734004800 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f873400c360 con 0x7f87340039b0 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874e4d5640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87340051c0 0x7f873400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874d4d3640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734004800 0x7f8734004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874dcd4640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340039b0 0x7f8734003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874e4d5640 1 -- 172.21.15.137:0/3341069815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340039b0 msgr2=0x7f8734003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874e4d5640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340039b0 0x7f8734003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874e4d5640 1 -- 172.21.15.137:0/3341069815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734004800 msgr2=0x7f8734004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:49.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874e4d5640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8734004800 0x7f8734004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.113+0000 7f874e4d5640 1 -- 172.21.15.137:0/3341069815 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8734003520 con 0x7f87340051c0 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.114+0000 7f874e4d5640 1 -- 172.21.15.137:0/3341069815 reap_dead start 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.114+0000 7f874e4d5640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87340051c0 0x7f873400b9c0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f8740009f90 tx=0x7f8734005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ccddb4daaecaf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.114+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8740035020 con 0x7f87340051c0 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.114+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8740003b90 con 0x7f87340051c0 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.114+0000 7f874ccd2640 1 -- 172.21.15.137:0/3341069815 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8740009c10 con 0x7f87340051c0 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.114+0000 7f874ff38640 1 -- 172.21.15.137:0/3341069815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87340051c0 msgr2=0x7f873400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.114+0000 7f874ff38640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87340051c0 0x7f873400b9c0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f8740009f90 tx=0x7f8734005830 comp rx=0 tx=0).stop 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.115+0000 7f874ff38640 1 -- 172.21.15.137:0/3341069815 shutdown_connections 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.115+0000 7f874ff38640 1 --2- 172.21.15.137:0/3341069815 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f87340051c0 0x7f873400b9c0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.115+0000 7f874ff38640 1 -- 172.21.15.137:0/3341069815 >> 172.21.15.137:0/3341069815 conn(0x7f874806f050 msgr2=0x7f874806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.115+0000 7f874ff38640 1 -- 172.21.15.137:0/3341069815 shutdown_connections 2024-04-26T22:05:49.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.115+0000 7f874ff38640 1 -- 172.21.15.137:0/3341069815 wait complete. 2024-04-26T22:05:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.116+0000 7f874ff38640 1 Processor -- start 2024-04-26T22:05:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.116+0000 7f874ff38640 1 -- start start 2024-04-26T22:05:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.116+0000 7f874ff38640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340051c0 0x7f874813f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.116+0000 7f874ff38640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f874813c380 0x7f874813db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.116+0000 7f874ff38640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8748153770 0x7f87480738c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.116+0000 7f874ff38640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8748146e00 con 0x7f874813c380 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.116+0000 7f874ff38640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8748146c80 con 0x7f8748153770 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.116+0000 7f874ff38640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f874806ffd0 con 0x7f87340051c0 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874d4d3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f874813c380 0x7f874813db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874d4d3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f874813c380 0x7f874813db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41424/0 (socket says 172.21.15.137:41424) 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874d4d3640 1 -- 172.21.15.137:0/3709813479 learned_addr learned my addr 172.21.15.137:0/3709813479 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874e4d5640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8748153770 0x7f87480738c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874dcd4640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340051c0 0x7f874813f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874d4d3640 1 -- 172.21.15.137:0/3709813479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340051c0 msgr2=0x7f874813f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874d4d3640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340051c0 0x7f874813f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874d4d3640 1 -- 172.21.15.137:0/3709813479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8748153770 msgr2=0x7f87480738c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874d4d3640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8748153770 0x7f87480738c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874d4d3640 1 -- 172.21.15.137:0/3709813479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874813c800 con 0x7f874813c380 2024-04-26T22:05:49.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874e4d5640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8748153770 0x7f87480738c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874d4d3640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f874813c380 0x7f874813db20 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f87380072f0 tx=0x7f87380077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f873e7fc640 1 -- 172.21.15.137:0/3709813479 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873801a070 con 0x7f874813c380 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f873e7fc640 1 -- 172.21.15.137:0/3709813479 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873800f960 con 0x7f874813c380 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874813ca80 con 0x7f874813c380 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f873e7fc640 1 -- 172.21.15.137:0/3709813479 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873800fd10 con 0x7f874813c380 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.117+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f874813d040 con 0x7f874813c380 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.118+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874806a290 con 0x7f874813c380 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.119+0000 7f873e7fc640 1 -- 172.21.15.137:0/3709813479 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f873801d070 con 0x7f874813c380 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.119+0000 7f873e7fc640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f872c06c8f0 0x7f872c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.119+0000 7f873e7fc640 1 -- 172.21.15.137:0/3709813479 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f873808b600 con 0x7f874813c380 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.119+0000 7f874dcd4640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f872c06c8f0 0x7f872c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.119+0000 7f874dcd4640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f872c06c8f0 0x7f872c06edb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8744000c00 tx=0x7f8744009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:49.123 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.123+0000 7f873e7fc640 1 -- 172.21.15.137:0/3709813479 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f874813c800 con 0x7f874813c380 2024-04-26T22:05:49.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.298+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f87480d02e0 con 0x7f874813c380 2024-04-26T22:05:49.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.298+0000 7f873e7fc640 1 -- 172.21.15.137:0/3709813479 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f87380599d0 con 0x7f874813c380 2024-04-26T22:05:49.299 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.300+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f872c06c8f0 msgr2=0x7f872c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.300+0000 7f874ff38640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f872c06c8f0 0x7f872c06edb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8744000c00 tx=0x7f8744009040 comp rx=0 tx=0).stop 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.300+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f874813c380 msgr2=0x7f874813db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.300+0000 7f874ff38640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f874813c380 0x7f874813db20 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f87380072f0 tx=0x7f87380077b0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.301+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 shutdown_connections 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.301+0000 7f874ff38640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f872c06c8f0 0x7f872c06edb0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.301+0000 7f874ff38640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f874813c380 0x7f874813db20 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.301+0000 7f874ff38640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8748153770 0x7f87480738c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.301+0000 7f874ff38640 1 --2- 172.21.15.137:0/3709813479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f87340051c0 0x7f874813f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.301+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 >> 172.21.15.137:0/3709813479 conn(0x7f874806f050 msgr2=0x7f8748160140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:49.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.301+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 shutdown_connections 2024-04-26T22:05:49.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.301+0000 7f874ff38640 1 -- 172.21.15.137:0/3709813479 wait complete. 2024-04-26T22:05:49.311 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:05:49.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.411+0000 7f97c1ad1640 1 Processor -- start 2024-04-26T22:05:49.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.411+0000 7f97c1ad1640 1 -- start start 2024-04-26T22:05:49.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97c1ad1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f97bc0b7960 0x7f97bc160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97c1ad1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f97bc15d6f0 0x7f97bc1611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97c1ad1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97bc070740 con 0x7f97bc1468a0 2024-04-26T22:05:49.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97c1ad1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f97bc070a00 con 0x7f97bc15d6f0 2024-04-26T22:05:49.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97c1ad1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f97bc070ce0 con 0x7f97bc0b7960 2024-04-26T22:05:49.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97bbfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f97bc15d6f0 0x7f97bc1611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97bbfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f97bc15d6f0 0x7f97bc1611f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41430/0 (socket says 172.21.15.137:41430) 2024-04-26T22:05:49.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97bbfff640 1 -- 172.21.15.137:0/2096644887 learned_addr learned my addr 172.21.15.137:0/2096644887 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:49.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97bbfff640 1 -- 172.21.15.137:0/2096644887 >> v2:172.21.15.170:3300/0 conn(0x7f97bc0b7960 msgr2=0x7f97bc160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:49.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97baffd640 1 --2- 172.21.15.137:0/2096644887 >> v2:172.21.15.170:3300/0 conn(0x7f97bc0b7960 0x7f97bc160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97bbfff640 1 --2- 172.21.15.137:0/2096644887 >> v2:172.21.15.170:3300/0 conn(0x7f97bc0b7960 0x7f97bc160cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97bbfff640 1 -- 172.21.15.137:0/2096644887 >> v1:172.21.15.170:6789/0 conn(0x7f97bc1468a0 legacy=0x7f97bc0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:49.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97bbfff640 1 -- 172.21.15.137:0/2096644887 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97bc070fc0 con 0x7f97bc15d6f0 2024-04-26T22:05:49.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.412+0000 7f97baffd640 1 --2- 172.21.15.137:0/2096644887 >> v2:172.21.15.170:3300/0 conn(0x7f97bc0b7960 0x7f97bc160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:49.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.413+0000 7f97bbfff640 1 --2- 172.21.15.137:0/2096644887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 0x7f97bc1611f0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0745a0 tx=0x7f97b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367f7045f74b016f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:49.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.413+0000 7f97ba7fc640 1 -- 172.21.15.137:0/2096644887 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4036070 con 0x7f97bc15d6f0 2024-04-26T22:05:49.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.413+0000 7f97ba7fc640 1 -- 172.21.15.137:0/2096644887 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b4031600 con 0x7f97bc15d6f0 2024-04-26T22:05:49.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.413+0000 7f97ba7fc640 1 -- 172.21.15.137:0/2096644887 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b40319d0 con 0x7f97bc15d6f0 2024-04-26T22:05:49.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.414+0000 7f97c1ad1640 1 -- 172.21.15.137:0/2096644887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 msgr2=0x7f97bc1611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.414+0000 7f97c1ad1640 1 --2- 172.21.15.137:0/2096644887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 0x7f97bc1611f0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0745a0 tx=0x7f97b402a660 comp rx=0 tx=0).stop 2024-04-26T22:05:49.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.414+0000 7f97c1ad1640 1 -- 172.21.15.137:0/2096644887 shutdown_connections 2024-04-26T22:05:49.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.414+0000 7f97c1ad1640 1 --2- 172.21.15.137:0/2096644887 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 0x7f97bc1611f0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.414+0000 7f97c1ad1640 1 --2- 172.21.15.137:0/2096644887 >> v2:172.21.15.170:3300/0 conn(0x7f97bc0b7960 0x7f97bc160cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.414+0000 7f97c1ad1640 1 -- 172.21.15.137:0/2096644887 >> 172.21.15.137:0/2096644887 conn(0x7f97bc06f050 msgr2=0x7f97bc06f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:49.417 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.414+0000 7f97c1ad1640 1 -- 172.21.15.137:0/2096644887 shutdown_connections 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.414+0000 7f97c1ad1640 1 -- 172.21.15.137:0/2096644887 wait complete. 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.415+0000 7f97c1ad1640 1 Processor -- start 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.415+0000 7f97c1ad1640 1 -- start start 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97c1ad1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97bc0b7960 0x7f97bc145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97c1ad1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97bc1468a0 0x7f97bc0cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97c1ad1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 0x7f97bc142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97c1ad1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f97bc146e00 con 0x7f97bc15d6f0 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97c1ad1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f97bc146c80 con 0x7f97bc1468a0 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97c1ad1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f97bc06ffd0 con 0x7f97bc0b7960 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 0x7f97bc142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 0x7f97bc142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41444/0 (socket says 172.21.15.137:41444) 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bbfff640 1 -- 172.21.15.137:0/1137068659 learned_addr learned my addr 172.21.15.137:0/1137068659 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bb7fe640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97bc0b7960 0x7f97bc145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.418 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97baffd640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97bc1468a0 0x7f97bc0cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bbfff640 1 -- 172.21.15.137:0/1137068659 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97bc0b7960 msgr2=0x7f97bc145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bbfff640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97bc0b7960 0x7f97bc145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bbfff640 1 -- 172.21.15.137:0/1137068659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97bc1468a0 msgr2=0x7f97bc0cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bbfff640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97bc1468a0 0x7f97bc0cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bbfff640 1 -- 172.21.15.137:0/1137068659 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97bc0b5a00 con 0x7f97bc15d6f0 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bb7fe640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97bc0b7960 0x7f97bc145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97bbfff640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 0x7f97bc142450 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f97b402ac50 tx=0x7f97b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97a3fff640 1 -- 172.21.15.137:0/1137068659 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4036050 con 0x7f97bc15d6f0 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97a3fff640 1 -- 172.21.15.137:0/1137068659 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b4042070 con 0x7f97bc15d6f0 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97a3fff640 1 -- 172.21.15.137:0/1137068659 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4009510 con 0x7f97bc15d6f0 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97bc143580 con 0x7f97bc15d6f0 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.416+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97bc0b5f80 con 0x7f97bc15d6f0 2024-04-26T22:05:49.419 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.417+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97bc06a290 con 0x7f97bc15d6f0 2024-04-26T22:05:49.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.418+0000 7f97a3fff640 1 -- 172.21.15.137:0/1137068659 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97b4007bd0 con 0x7f97bc15d6f0 2024-04-26T22:05:49.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.418+0000 7f97a3fff640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f97a806c920 0x7f97a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.418+0000 7f97bb7fe640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f97a806c920 0x7f97a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.418+0000 7f97a3fff640 1 -- 172.21.15.137:0/1137068659 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f97b40acaa0 con 0x7f97bc15d6f0 2024-04-26T22:05:49.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.419+0000 7f97bb7fe640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f97a806c920 0x7f97a806ede0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f97ac003eb0 tx=0x7f97ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:49.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.423+0000 7f97a3fff640 1 -- 172.21.15.137:0/1137068659 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f97b4045360 con 0x7f97bc15d6f0 2024-04-26T22:05:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.598+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f97bc13fe10 con 0x7f97bc15d6f0 2024-04-26T22:05:49.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.598+0000 7f97a3fff640 1 -- 172.21.15.137:0/1137068659 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f97b407ae90 con 0x7f97bc15d6f0 2024-04-26T22:05:49.598 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:05:49.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f97a806c920 msgr2=0x7f97a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f97a806c920 0x7f97a806ede0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f97ac003eb0 tx=0x7f97ac009040 comp rx=0 tx=0).stop 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 msgr2=0x7f97bc142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 0x7f97bc142450 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f97b402ac50 tx=0x7f97b4004a40 comp rx=0 tx=0).stop 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 shutdown_connections 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f97a806c920 0x7f97a806ede0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f97bc15d6f0 0x7f97bc142450 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97bc1468a0 0x7f97bc0cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 --2- 172.21.15.137:0/1137068659 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f97bc0b7960 0x7f97bc145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 >> 172.21.15.137:0/1137068659 conn(0x7f97bc06f050 msgr2=0x7f97bc0b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 shutdown_connections 2024-04-26T22:05:49.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.600+0000 7f97c1ad1640 1 -- 172.21.15.137:0/1137068659 wait complete. 2024-04-26T22:05:49.611 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:49.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.708+0000 7f27b08a2640 1 Processor -- start 2024-04-26T22:05:49.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.708+0000 7f27b08a2640 1 -- start start 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27b08a2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f27ac15f1e0 0x7f27ac06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27b08a2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27ac0b4a10 con 0x7f27ac06d2b0 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27b08a2640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27ac0b4cf0 con 0x7f27ac0b44e0 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27b08a2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f27ac06eeb0 con 0x7f27ac15f1e0 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27aad9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f27ac06d2b0 0x7f27ac0b5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58626/0 (socket says 172.21.15.137:58626) 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27aad9d640 1 -- 172.21.15.137:0/3253851333 learned_addr learned my addr 172.21.15.137:0/3253851333 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595913510 0 0) 0x7f27ac0b4a10 con 0x7f27ac06d2b0 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2798003520 con 0x7f27ac06d2b0 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27aa59c640 1 --2- 172.21.15.137:0/3253851333 >> v2:172.21.15.170:3300/0 conn(0x7f27ac15f1e0 0x7f27ac06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1997838048 0 0) 0x7f2798003520 con 0x7f27ac06d2b0 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 >> v2:172.21.15.170:3300/0 conn(0x7f27ac15f1e0 msgr2=0x7f27ac06e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 --2- 172.21.15.137:0/3253851333 >> v2:172.21.15.170:3300/0 conn(0x7f27ac15f1e0 0x7f27ac06e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 >> v1:172.21.15.170:6789/0 conn(0x7f27ac0b44e0 legacy=0x7f27ac0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:49.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac0b4fd0 con 0x7f27ac06d2b0 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f279c001670 con 0x7f27ac06d2b0 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 >> v1:172.21.15.137:6789/0 conn(0x7f27ac06d2b0 legacy=0x7f27ac0b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980039b0 0x7f2798003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798004800 0x7f2798004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27980051c0 0x7f279800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac06eeb0 con 0x7f2798004800 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f279800c0f0 con 0x7f27980039b0 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f279800c2f0 con 0x7f27980051c0 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.709+0000 7f27a9d9b640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798004800 0x7f2798004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.710+0000 7f27aa59c640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980039b0 0x7f2798003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.710+0000 7f27aad9d640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27980051c0 0x7f279800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.710+0000 7f27a9d9b640 1 -- 172.21.15.137:0/3253851333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27980051c0 msgr2=0x7f279800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.710+0000 7f27a9d9b640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27980051c0 0x7f279800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.710+0000 7f27a9d9b640 1 -- 172.21.15.137:0/3253851333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980039b0 msgr2=0x7f2798003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.710+0000 7f27a9d9b640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27980039b0 0x7f2798003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.710+0000 7f27a9d9b640 1 -- 172.21.15.137:0/3253851333 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2798003520 con 0x7f2798004800 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.710+0000 7f27aad9d640 1 -- 172.21.15.137:0/3253851333 reap_dead start 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.710+0000 7f27a9d9b640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798004800 0x7f2798004c80 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f2794003d80 tx=0x7f2798005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfa3e1c2420f547 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794037070 con 0x7f2798004800 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f279402a990 con 0x7f2798004800 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27a959a640 1 -- 172.21.15.137:0/3253851333 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794003980 con 0x7f2798004800 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27b08a2640 1 -- 172.21.15.137:0/3253851333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798004800 msgr2=0x7f2798004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27b08a2640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798004800 0x7f2798004c80 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f2794003d80 tx=0x7f2798005830 comp rx=0 tx=0).stop 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27b08a2640 1 -- 172.21.15.137:0/3253851333 shutdown_connections 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27b08a2640 1 --2- 172.21.15.137:0/3253851333 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2798004800 0x7f2798004c80 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27b08a2640 1 -- 172.21.15.137:0/3253851333 >> 172.21.15.137:0/3253851333 conn(0x7f27ac0728a0 msgr2=0x7f27ac072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27b08a2640 1 -- 172.21.15.137:0/3253851333 shutdown_connections 2024-04-26T22:05:49.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.711+0000 7f27b08a2640 1 -- 172.21.15.137:0/3253851333 wait complete. 2024-04-26T22:05:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.712+0000 7f27b08a2640 1 Processor -- start 2024-04-26T22:05:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27b08a2640 1 -- start start 2024-04-26T22:05:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27b08a2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2798004800 0x7f27ac1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27b08a2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac1f84f0 0x7f27ac1f8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27b08a2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac160540 0x7f27ac1609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27b08a2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac15f5c0 con 0x7f27ac1f84f0 2024-04-26T22:05:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27b08a2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac0b5590 con 0x7f2798004800 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27b08a2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27ac1f8e90 con 0x7f27ac160540 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27a9d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac1f84f0 0x7f27ac1f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27a9d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac1f84f0 0x7f27ac1f8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41460/0 (socket says 172.21.15.137:41460) 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27a9d9b640 1 -- 172.21.15.137:0/3391708590 learned_addr learned my addr 172.21.15.137:0/3391708590 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27aa59c640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2798004800 0x7f27ac1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.713+0000 7f27aad9d640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac160540 0x7f27ac1609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27a9d9b640 1 -- 172.21.15.137:0/3391708590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac160540 msgr2=0x7f27ac1609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27a9d9b640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac160540 0x7f27ac1609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27a9d9b640 1 -- 172.21.15.137:0/3391708590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2798004800 msgr2=0x7f27ac1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27a9d9b640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2798004800 0x7f27ac1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27a9d9b640 1 -- 172.21.15.137:0/3391708590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac1536f0 con 0x7f27ac1f84f0 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27a9d9b640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac1f84f0 0x7f27ac1f8950 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f2794003ea0 tx=0x7f27940036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27a2ffd640 1 -- 172.21.15.137:0/3391708590 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794037050 con 0x7f27ac1f84f0 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27a2ffd640 1 -- 172.21.15.137:0/3391708590 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2794038040 con 0x7f27ac1f84f0 2024-04-26T22:05:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac161200 con 0x7f27ac1f84f0 2024-04-26T22:05:49.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27a2ffd640 1 -- 172.21.15.137:0/3391708590 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794006e50 con 0x7f27ac1f84f0 2024-04-26T22:05:49.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.714+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac15c720 con 0x7f27ac1f84f0 2024-04-26T22:05:49.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.715+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ac06a290 con 0x7f27ac1f84f0 2024-04-26T22:05:49.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.716+0000 7f27a2ffd640 1 -- 172.21.15.137:0/3391708590 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2794045020 con 0x7f27ac1f84f0 2024-04-26T22:05:49.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.716+0000 7f27a2ffd640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f278c06ca90 0x7f278c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:49.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.716+0000 7f27aa59c640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f278c06ca90 0x7f278c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:49.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.716+0000 7f27a2ffd640 1 -- 172.21.15.137:0/3391708590 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f27940ab8f0 con 0x7f27ac1f84f0 2024-04-26T22:05:49.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.716+0000 7f27aa59c640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f278c06ca90 0x7f278c06ef50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f27ac06b1f0 tx=0x7f27a4009760 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:49.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.720+0000 7f27a2ffd640 1 -- 172.21.15.137:0/3391708590 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f27ac1536f0 con 0x7f27ac1f84f0 2024-04-26T22:05:49.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.930+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27ac069700 con 0x7f27ac1f84f0 2024-04-26T22:05:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.931+0000 7f27a2ffd640 1 -- 172.21.15.137:0/3391708590 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5196 (secure 0 0 0) 0x7f2794079600 con 0x7f27ac1f84f0 2024-04-26T22:05:49.931 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:49.931 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:05:12.391859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/4231448082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":4231448082},{"type":"v1","addr":"172.21.15.137:6837","nonce":4231448082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":6}]} 2024-04-26T22:05:49.931 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 60 2024-04-26T22:05:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f278c06ca90 msgr2=0x7f278c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f278c06ca90 0x7f278c06ef50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f27ac06b1f0 tx=0x7f27a4009760 comp rx=0 tx=0).stop 2024-04-26T22:05:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac1f84f0 msgr2=0x7f27ac1f8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac1f84f0 0x7f27ac1f8950 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f2794003ea0 tx=0x7f27940036f0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 shutdown_connections 2024-04-26T22:05:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f278c06ca90 0x7f278c06ef50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27ac1f84f0 0x7f27ac1f8950 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.933 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27ac160540 0x7f27ac1609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 --2- 172.21.15.137:0/3391708590 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2798004800 0x7f27ac1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 >> 172.21.15.137:0/3391708590 conn(0x7f27ac0728a0 msgr2=0x7f27ac0af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 shutdown_connections 2024-04-26T22:05:49.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:49.933+0000 7f27b08a2640 1 -- 172.21.15.137:0/3391708590 wait complete. 2024-04-26T22:05:49.944 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:05:50.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.040+0000 7f08cfc69640 1 Processor -- start 2024-04-26T22:05:50.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.040+0000 7f08cfc69640 1 -- start start 2024-04-26T22:05:50.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cfc69640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f08c8145980 0x7f08c8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cfc69640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b3de0 0x7f08c80b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cfc69640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c80b4260 con 0x7f08c80b5fd0 2024-04-26T22:05:50.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cfc69640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f08c80b6440 con 0x7f08c8145980 2024-04-26T22:05:50.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cfc69640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f08c80b5140 con 0x7f08c80b3de0 2024-04-26T22:05:50.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08ce206640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f08c80b5fd0 0x7f08c815c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58638/0 (socket says 172.21.15.137:58638) 2024-04-26T22:05:50.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08ce206640 1 -- 172.21.15.137:0/179035915 learned_addr learned my addr 172.21.15.137:0/179035915 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:50.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cda05640 1 --2- 172.21.15.137:0/179035915 >> v2:172.21.15.170:3300/0 conn(0x7f08c8145980 0x7f08c8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cd204640 1 --2- 172.21.15.137:0/179035915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b3de0 0x7f08c80b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cca03640 1 -- 172.21.15.137:0/179035915 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964147378 0 0) 0x7f08c80b4260 con 0x7f08c80b5fd0 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cca03640 1 -- 172.21.15.137:0/179035915 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b0003520 con 0x7f08c80b5fd0 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cda05640 1 -- 172.21.15.137:0/179035915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b3de0 msgr2=0x7f08c80b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cda05640 1 --2- 172.21.15.137:0/179035915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b3de0 0x7f08c80b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cda05640 1 -- 172.21.15.137:0/179035915 >> v1:172.21.15.137:6789/0 conn(0x7f08c80b5fd0 legacy=0x7f08c815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.041+0000 7f08cda05640 1 -- 172.21.15.137:0/179035915 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c80b4530 con 0x7f08c8145980 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.042+0000 7f08cda05640 1 --2- 172.21.15.137:0/179035915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c8145980 0x7f08c8160630 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f08b80097a0 tx=0x7f08b802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=245b40cfb48b9312 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.042+0000 7f08cca03640 1 -- 172.21.15.137:0/179035915 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8037070 con 0x7f08c8145980 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.042+0000 7f08cca03640 1 -- 172.21.15.137:0/179035915 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b802ae50 con 0x7f08c8145980 2024-04-26T22:05:50.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.042+0000 7f08cca03640 1 -- 172.21.15.137:0/179035915 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8032640 con 0x7f08c8145980 2024-04-26T22:05:50.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.043+0000 7f08cfc69640 1 -- 172.21.15.137:0/179035915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c8145980 msgr2=0x7f08c8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.043+0000 7f08cfc69640 1 --2- 172.21.15.137:0/179035915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c8145980 0x7f08c8160630 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f08b80097a0 tx=0x7f08b802a100 comp rx=0 tx=0).stop 2024-04-26T22:05:50.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.043+0000 7f08cfc69640 1 -- 172.21.15.137:0/179035915 shutdown_connections 2024-04-26T22:05:50.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.043+0000 7f08cfc69640 1 --2- 172.21.15.137:0/179035915 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b3de0 0x7f08c80b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.043+0000 7f08cfc69640 1 --2- 172.21.15.137:0/179035915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c8145980 0x7f08c8160630 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.043+0000 7f08cfc69640 1 -- 172.21.15.137:0/179035915 >> 172.21.15.137:0/179035915 conn(0x7f08c80d0d30 msgr2=0x7f08c80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.043+0000 7f08cfc69640 1 -- 172.21.15.137:0/179035915 shutdown_connections 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.043+0000 7f08cfc69640 1 -- 172.21.15.137:0/179035915 wait complete. 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.044+0000 7f08cfc69640 1 Processor -- start 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.044+0000 7f08cfc69640 1 -- start start 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08cfc69640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c80b3de0 0x7f08c80aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08cfc69640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b5fd0 0x7f08c813b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08cfc69640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08c8145980 0x7f08c81492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08cfc69640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f08c80b4dd0 con 0x7f08c8145980 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08cfc69640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f08c80b4af0 con 0x7f08c80b3de0 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08cfc69640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f08c80730e0 con 0x7f08c80b5fd0 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08ce206640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08c8145980 0x7f08c81492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08ce206640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08c8145980 0x7f08c81492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41474/0 (socket says 172.21.15.137:41474) 2024-04-26T22:05:50.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08ce206640 1 -- 172.21.15.137:0/1416443863 learned_addr learned my addr 172.21.15.137:0/1416443863 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08cd204640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b5fd0 0x7f08c813b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08cda05640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c80b3de0 0x7f08c80aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08ce206640 1 -- 172.21.15.137:0/1416443863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b5fd0 msgr2=0x7f08c813b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08ce206640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b5fd0 0x7f08c813b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08ce206640 1 -- 172.21.15.137:0/1416443863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c80b3de0 msgr2=0x7f08c80aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08ce206640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c80b3de0 0x7f08c80aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08ce206640 1 -- 172.21.15.137:0/1416443863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c81662c0 con 0x7f08c8145980 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08cda05640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c80b3de0 0x7f08c80aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.045+0000 7f08ce206640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08c8145980 0x7f08c81492e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f08c0001580 tx=0x7f08c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.046+0000 7f08c67fc640 1 -- 172.21.15.137:0/1416443863 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0017070 con 0x7f08c8145980 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.046+0000 7f08c67fc640 1 -- 172.21.15.137:0/1416443863 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c000ac20 con 0x7f08c8145980 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.046+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c81665a0 con 0x7f08c8145980 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.046+0000 7f08c67fc640 1 -- 172.21.15.137:0/1416443863 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0012640 con 0x7f08c8145980 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.046+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c8166b60 con 0x7f08c8145980 2024-04-26T22:05:50.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.047+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c806a290 con 0x7f08c8145980 2024-04-26T22:05:50.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.047+0000 7f08c67fc640 1 -- 172.21.15.137:0/1416443863 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08c001a070 con 0x7f08c8145980 2024-04-26T22:05:50.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.048+0000 7f08c67fc640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08b406c8f0 0x7f08b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.048+0000 7f08c67fc640 1 -- 172.21.15.137:0/1416443863 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f08c008ba00 con 0x7f08c8145980 2024-04-26T22:05:50.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.048+0000 7f08cda05640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08b406c8f0 0x7f08b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.048+0000 7f08cda05640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08b406c8f0 0x7f08b406edb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f08b8034000 tx=0x7f08b802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:50.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.052+0000 7f08c67fc640 1 -- 172.21.15.137:0/1416443863 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f08c0059d60 con 0x7f08c8145980 2024-04-26T22:05:50.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.230+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08c81451a0 con 0x7f08c8145980 2024-04-26T22:05:50.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.231+0000 7f08c67fc640 1 -- 172.21.15.137:0/1416443863 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16983 (secure 0 0 0) 0x7f08c0059660 con 0x7f08c8145980 2024-04-26T22:05:50.232 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:50.232 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":91,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:05:08.380391+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:04:11.600389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-26T22:04:12.347068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.137:6835/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.170:6835/865192507":"2024-04-27T22:04:27.224170+0000","172.21.15.170:6833/865192507":"2024-04-27T22:04:27.224170+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:05:50.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08b406c8f0 msgr2=0x7f08b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08b406c8f0 0x7f08b406edb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f08b8034000 tx=0x7f08b802e000 comp rx=0 tx=0).stop 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08c8145980 msgr2=0x7f08c81492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08c8145980 0x7f08c81492e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f08c0001580 tx=0x7f08c000cf90 comp rx=0 tx=0).stop 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 shutdown_connections 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f08b406c8f0 0x7f08b406edb0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f08c8145980 0x7f08c81492e0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f08c80b5fd0 0x7f08c813b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 --2- 172.21.15.137:0/1416443863 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08c80b3de0 0x7f08c80aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 >> 172.21.15.137:0/1416443863 conn(0x7f08c80d0d30 msgr2=0x7f08c80b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.233+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 shutdown_connections 2024-04-26T22:05:50.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.234+0000 7f08cfc69640 1 -- 172.21.15.137:0/1416443863 wait complete. 2024-04-26T22:05:50.244 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:05:50.245 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.341+0000 7f225cabd640 1 Processor -- start 2024-04-26T22:05:50.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.341+0000 7f225cabd640 1 -- start start 2024-04-26T22:05:50.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f225cabd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f22580b61a0 0x7f2258160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f225cabd640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22580b4270 con 0x7f22580b3de0 2024-04-26T22:05:50.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f225cabd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22580b4530 con 0x7f2258145980 2024-04-26T22:05:50.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f225cabd640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f22580b5140 con 0x7f22580b61a0 2024-04-26T22:05:50.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f2255d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f22580b61a0 0x7f2258160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f2256d9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f22580b3de0 0x7f22580720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58648/0 (socket says 172.21.15.137:58648) 2024-04-26T22:05:50.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f2255d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f22580b61a0 0x7f2258160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41478/0 (socket says 172.21.15.137:41478) 2024-04-26T22:05:50.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f2256d9d640 1 -- 172.21.15.137:0/334194516 learned_addr learned my addr 172.21.15.137:0/334194516 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:50.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f2255d9b640 1 -- 172.21.15.137:0/334194516 >> v1:172.21.15.170:6789/0 conn(0x7f2258145980 legacy=0x7f22580b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:50.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f2255d9b640 1 -- 172.21.15.137:0/334194516 >> v1:172.21.15.137:6789/0 conn(0x7f22580b3de0 legacy=0x7f22580720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f2255d9b640 1 -- 172.21.15.137:0/334194516 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580b4810 con 0x7f22580b61a0 2024-04-26T22:05:50.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.342+0000 7f225559a640 1 -- 172.21.15.137:0/334194516 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286422967 0 0) 0x7f22580b4270 con 0x7f22580b3de0 2024-04-26T22:05:50.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.343+0000 7f2255d9b640 1 --2- 172.21.15.137:0/334194516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22580b61a0 0x7f2258160630 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097a0 tx=0x7f224c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897e8b1d7fc6a79b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:50.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.343+0000 7f225559a640 1 -- 172.21.15.137:0/334194516 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c037070 con 0x7f22580b61a0 2024-04-26T22:05:50.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.343+0000 7f225559a640 1 -- 172.21.15.137:0/334194516 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c02ae50 con 0x7f22580b61a0 2024-04-26T22:05:50.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.343+0000 7f225559a640 1 -- 172.21.15.137:0/334194516 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c032660 con 0x7f22580b61a0 2024-04-26T22:05:50.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.344+0000 7f225cabd640 1 -- 172.21.15.137:0/334194516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22580b61a0 msgr2=0x7f2258160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.344+0000 7f225cabd640 1 --2- 172.21.15.137:0/334194516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22580b61a0 0x7f2258160630 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097a0 tx=0x7f224c02a140 comp rx=0 tx=0).stop 2024-04-26T22:05:50.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.344+0000 7f225cabd640 1 -- 172.21.15.137:0/334194516 shutdown_connections 2024-04-26T22:05:50.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.344+0000 7f225cabd640 1 --2- 172.21.15.137:0/334194516 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f22580b61a0 0x7f2258160630 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.344+0000 7f225cabd640 1 -- 172.21.15.137:0/334194516 >> 172.21.15.137:0/334194516 conn(0x7f22580d0d30 msgr2=0x7f22580d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:50.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.344+0000 7f225cabd640 1 -- 172.21.15.137:0/334194516 shutdown_connections 2024-04-26T22:05:50.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.344+0000 7f225cabd640 1 -- 172.21.15.137:0/334194516 wait complete. 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.345+0000 7f225cabd640 1 Processor -- start 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.345+0000 7f225cabd640 1 -- start start 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f225cabd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22580b3de0 0x7f225815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f225cabd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22580b61a0 0x7f225815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f225cabd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258145980 0x7f225813fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f225cabd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22580727e0 con 0x7f2258145980 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f225cabd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f22580b4dd0 con 0x7f22580b3de0 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f225cabd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2258072960 con 0x7f22580b61a0 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2256d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258145980 0x7f225813fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2256d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258145980 0x7f225813fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41484/0 (socket says 172.21.15.137:41484) 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2256d9d640 1 -- 172.21.15.137:0/2967693491 learned_addr learned my addr 172.21.15.137:0/2967693491 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f225659c640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22580b3de0 0x7f225815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2255d9b640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22580b61a0 0x7f225815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2256d9d640 1 -- 172.21.15.137:0/2967693491 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22580b61a0 msgr2=0x7f225815adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2256d9d640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22580b61a0 0x7f225815adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2256d9d640 1 -- 172.21.15.137:0/2967693491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22580b3de0 msgr2=0x7f225815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2256d9d640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22580b3de0 0x7f225815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2256d9d640 1 -- 172.21.15.137:0/2967693491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22581401d0 con 0x7f2258145980 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2255d9b640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22580b61a0 0x7f225815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.346+0000 7f2256d9d640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258145980 0x7f225813fad0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f224800c450 tx=0x7f224800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.347+0000 7f2246ffd640 1 -- 172.21.15.137:0/2967693491 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248018070 con 0x7f2258145980 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.347+0000 7f2246ffd640 1 -- 172.21.15.137:0/2967693491 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2248007500 con 0x7f2258145980 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.347+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22581404b0 con 0x7f2258145980 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.347+0000 7f2246ffd640 1 -- 172.21.15.137:0/2967693491 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2248004a20 con 0x7f2258145980 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.347+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2258140a70 con 0x7f2258145980 2024-04-26T22:05:50.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.348+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f225806a290 con 0x7f2258145980 2024-04-26T22:05:50.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.348+0000 7f2246ffd640 1 -- 172.21.15.137:0/2967693491 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f224801b070 con 0x7f2258145980 2024-04-26T22:05:50.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.348+0000 7f2246ffd640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f223806c8f0 0x7f223806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.348+0000 7f2246ffd640 1 -- 172.21.15.137:0/2967693491 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f224808ada0 con 0x7f2258145980 2024-04-26T22:05:50.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.349+0000 7f225659c640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f223806c8f0 0x7f223806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.349+0000 7f225659c640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f223806c8f0 0x7f223806edb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2258141920 tx=0x7f225000d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:50.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.353+0000 7f2246ffd640 1 -- 172.21.15.137:0/2967693491 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2248058b40 con 0x7f2258145980 2024-04-26T22:05:50.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.564+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2258073cc0 con 0x7f2258145980 2024-04-26T22:05:50.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.565+0000 7f2246ffd640 1 -- 172.21.15.137:0/2967693491 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5196 (secure 0 0 0) 0x7f224805ce40 con 0x7f2258145980 2024-04-26T22:05:50.565 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:50.565 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:05:12.391859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/4231448082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":4231448082},{"type":"v1","addr":"172.21.15.137:6837","nonce":4231448082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":6}]} 2024-04-26T22:05:50.565 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 60 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f223806c8f0 msgr2=0x7f223806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f223806c8f0 0x7f223806edb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2258141920 tx=0x7f225000d040 comp rx=0 tx=0).stop 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258145980 msgr2=0x7f225813fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258145980 0x7f225813fad0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f224800c450 tx=0x7f224800c910 comp rx=0 tx=0).stop 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 shutdown_connections 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f223806c8f0 0x7f223806edb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2258145980 0x7f225813fad0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22580b61a0 0x7f225815adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 --2- 172.21.15.137:0/2967693491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22580b3de0 0x7f225815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 >> 172.21.15.137:0/2967693491 conn(0x7f22580d0d30 msgr2=0x7f225806f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:50.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 shutdown_connections 2024-04-26T22:05:50.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.567+0000 7f225cabd640 1 -- 172.21.15.137:0/2967693491 wait complete. 2024-04-26T22:05:50.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:50.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.675+0000 7f50ed3da640 1 Processor -- start 2024-04-26T22:05:50.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.675+0000 7f50ed3da640 1 -- start start 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50ed3da640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f50e80d3ee0 0x7f50e80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50ed3da640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50e815f750 0x7f50e80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50ed3da640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e80d03a0 con 0x7f50e815f370 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50ed3da640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f50e80b4d10 con 0x7f50e815f750 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50ed3da640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f50e80d0680 con 0x7f50e80d3ee0 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50e815f750 0x7f50e80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50e815f750 0x7f50e80b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41498/0 (socket says 172.21.15.137:41498) 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e77fe640 1 -- 172.21.15.137:0/399762734 learned_addr learned my addr 172.21.15.137:0/399762734 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e6ffd640 1 --1- 172.21.15.137:0/399762734 >> v1:172.21.15.137:6789/0 conn(0x7f50e815f370 0x7f50e80d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58656/0 (socket says 172.21.15.137:58656) 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e67fc640 1 --2- 172.21.15.137:0/399762734 >> v2:172.21.15.170:3300/0 conn(0x7f50e80d3ee0 0x7f50e80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e77fe640 1 -- 172.21.15.137:0/399762734 >> v2:172.21.15.170:3300/0 conn(0x7f50e80d3ee0 msgr2=0x7f50e80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e77fe640 1 --2- 172.21.15.137:0/399762734 >> v2:172.21.15.170:3300/0 conn(0x7f50e80d3ee0 0x7f50e80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e77fe640 1 -- 172.21.15.137:0/399762734 >> v1:172.21.15.137:6789/0 conn(0x7f50e815f370 legacy=0x7f50e80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e77fe640 1 -- 172.21.15.137:0/399762734 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e80d0960 con 0x7f50e815f750 2024-04-26T22:05:50.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e5ffb640 1 -- 172.21.15.137:0/399762734 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 882849206 0 0) 0x7f50e80d03a0 con 0x7f50e815f370 2024-04-26T22:05:50.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.676+0000 7f50e67fc640 1 --2- 172.21.15.137:0/399762734 >> v2:172.21.15.170:3300/0 conn(0x7f50e80d3ee0 0x7f50e80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:50.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.677+0000 7f50e77fe640 1 --2- 172.21.15.137:0/399762734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f750 0x7f50e80b47d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e50 tx=0x7f50d802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7703b01b4a30bcc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:50.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.677+0000 7f50e5ffb640 1 -- 172.21.15.137:0/399762734 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8036070 con 0x7f50e815f750 2024-04-26T22:05:50.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.677+0000 7f50e5ffb640 1 -- 172.21.15.137:0/399762734 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d8031600 con 0x7f50e815f750 2024-04-26T22:05:50.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.677+0000 7f50e5ffb640 1 -- 172.21.15.137:0/399762734 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d80319d0 con 0x7f50e815f750 2024-04-26T22:05:50.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.677+0000 7f50ed3da640 1 -- 172.21.15.137:0/399762734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f750 msgr2=0x7f50e80b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.677+0000 7f50ed3da640 1 --2- 172.21.15.137:0/399762734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f750 0x7f50e80b47d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e50 tx=0x7f50d802a760 comp rx=0 tx=0).stop 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.677+0000 7f50ed3da640 1 -- 172.21.15.137:0/399762734 shutdown_connections 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.677+0000 7f50ed3da640 1 --2- 172.21.15.137:0/399762734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f750 0x7f50e80b47d0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.678+0000 7f50ed3da640 1 --2- 172.21.15.137:0/399762734 >> v2:172.21.15.170:3300/0 conn(0x7f50e80d3ee0 0x7f50e80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.678+0000 7f50ed3da640 1 -- 172.21.15.137:0/399762734 >> 172.21.15.137:0/399762734 conn(0x7f50e808ec10 msgr2=0x7f50e809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.678+0000 7f50ed3da640 1 -- 172.21.15.137:0/399762734 shutdown_connections 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.678+0000 7f50ed3da640 1 -- 172.21.15.137:0/399762734 wait complete. 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.679+0000 7f50ed3da640 1 Processor -- start 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.679+0000 7f50ed3da640 1 -- start start 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50ed3da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50e80d3ee0 0x7f50e8153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50ed3da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f370 0x7f50e8161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50ed3da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e815f750 0x7f50e80ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50ed3da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50e80b51c0 con 0x7f50e815f370 2024-04-26T22:05:50.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50ed3da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f50e80d0f20 con 0x7f50e80d3ee0 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50ed3da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f50e80b5340 con 0x7f50e815f750 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f370 0x7f50e8161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f370 0x7f50e8161370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41514/0 (socket says 172.21.15.137:41514) 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e67fc640 1 -- 172.21.15.137:0/747284331 learned_addr learned my addr 172.21.15.137:0/747284331 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e6ffd640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50e80d3ee0 0x7f50e8153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e77fe640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e815f750 0x7f50e80ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e67fc640 1 -- 172.21.15.137:0/747284331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e815f750 msgr2=0x7f50e80ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e67fc640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e815f750 0x7f50e80ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e67fc640 1 -- 172.21.15.137:0/747284331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50e80d3ee0 msgr2=0x7f50e8153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e67fc640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50e80d3ee0 0x7f50e8153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e67fc640 1 -- 172.21.15.137:0/747284331 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e8161e10 con 0x7f50e815f370 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e77fe640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e815f750 0x7f50e80ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50e67fc640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f370 0x7f50e8161370 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f50d000e810 tx=0x7f50d000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:50.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50df7fe640 1 -- 172.21.15.137:0/747284331 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d000f040 con 0x7f50e815f370 2024-04-26T22:05:50.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50df7fe640 1 -- 172.21.15.137:0/747284331 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d0004030 con 0x7f50e815f370 2024-04-26T22:05:50.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e81620f0 con 0x7f50e815f370 2024-04-26T22:05:50.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50df7fe640 1 -- 172.21.15.137:0/747284331 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0004400 con 0x7f50e815f370 2024-04-26T22:05:50.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.680+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e81626b0 con 0x7f50e815f370 2024-04-26T22:05:50.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.681+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e80b4060 con 0x7f50e815f370 2024-04-26T22:05:50.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.682+0000 7f50df7fe640 1 -- 172.21.15.137:0/747284331 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50d000c6d0 con 0x7f50e815f370 2024-04-26T22:05:50.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.682+0000 7f50df7fe640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:50.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.682+0000 7f50df7fe640 1 -- 172.21.15.137:0/747284331 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f50d008b7d0 con 0x7f50e815f370 2024-04-26T22:05:50.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.682+0000 7f50e6ffd640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:50.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.683+0000 7f50e6ffd640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f50e0000f60 tx=0x7f50e0007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:50.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.686+0000 7f50df7fe640 1 -- 172.21.15.137:0/747284331 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f50e80b4060 con 0x7f50e815f370 2024-04-26T22:05:50.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.899+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50e806a290 con 0x7f50e815f370 2024-04-26T22:05:50.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.900+0000 7f50df7fe640 1 -- 172.21.15.137:0/747284331 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5196 (secure 0 0 0) 0x7f50d0017020 con 0x7f50e815f370 2024-04-26T22:05:50.900 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:50.900 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:04:13.390555+0000","modified":"2024-04-26T22:05:12.391859+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/4231448082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":4231448082},{"type":"v1","addr":"172.21.15.137:6837","nonce":4231448082}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7845,"qdb_cluster":[7845]},"id":6}]} 2024-04-26T22:05:50.900 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 60 2024-04-26T22:05:50.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 msgr2=0x7f50c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f50e0000f60 tx=0x7f50e0007d50 comp rx=0 tx=0).stop 2024-04-26T22:05:50.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f370 msgr2=0x7f50e8161370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:50.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f370 0x7f50e8161370 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f50d000e810 tx=0x7f50d000ecd0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 shutdown_connections 2024-04-26T22:05:50.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e815f370 0x7f50e8161370 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e815f750 0x7f50e80ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 --2- 172.21.15.137:0/747284331 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50e80d3ee0 0x7f50e8153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:50.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 >> 172.21.15.137:0/747284331 conn(0x7f50e808ec10 msgr2=0x7f50e806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:50.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 shutdown_connections 2024-04-26T22:05:50.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:50.902+0000 7f50ed3da640 1 -- 172.21.15.137:0/747284331 wait complete. 2024-04-26T22:05:50.913 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:05:51.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.010+0000 7f2e0d499640 1 Processor -- start 2024-04-26T22:05:51.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.010+0000 7f2e0d499640 1 -- start start 2024-04-26T22:05:51.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e0d499640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e0815f370 0x7f2e080cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e0d499640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 0x7f2e080b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e0d499640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080d03a0 con 0x7f2e0815f750 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e0d499640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2e080b4d10 con 0x7f2e0815f370 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e0d499640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e080d0680 con 0x7f2e080d3ee0 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e06ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2e0815f370 0x7f2e080cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2dfffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2e0815f750 0x7f2e080d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58666/0 (socket says 172.21.15.137:58666) 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2dfffff640 1 -- 172.21.15.137:0/1568261564 learned_addr learned my addr 172.21.15.137:0/1568261564 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e06ffd640 1 -- 172.21.15.137:0/1568261564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 msgr2=0x7f2e080b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e06ffd640 1 --2- 172.21.15.137:0/1568261564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 0x7f2e080b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e06ffd640 1 -- 172.21.15.137:0/1568261564 >> v1:172.21.15.137:6789/0 conn(0x7f2e0815f750 legacy=0x7f2e080d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e067fc640 1 -- 172.21.15.137:0/1568261564 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2117200436 0 0) 0x7f2e080d03a0 con 0x7f2e0815f750 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.011+0000 7f2e06ffd640 1 -- 172.21.15.137:0/1568261564 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e080d0960 con 0x7f2e0815f370 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e06ffd640 1 --2- 172.21.15.137:0/1568261564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f370 0x7f2e080cfd70 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f2df80097a0 tx=0x7f2df802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f570cf5baf4148 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e067fc640 1 -- 172.21.15.137:0/1568261564 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8037070 con 0x7f2e0815f370 2024-04-26T22:05:51.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e067fc640 1 -- 172.21.15.137:0/1568261564 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df8032440 con 0x7f2e0815f370 2024-04-26T22:05:51.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e067fc640 1 -- 172.21.15.137:0/1568261564 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8032810 con 0x7f2e0815f370 2024-04-26T22:05:51.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e0d499640 1 -- 172.21.15.137:0/1568261564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f370 msgr2=0x7f2e080cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e0d499640 1 --2- 172.21.15.137:0/1568261564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f370 0x7f2e080cfd70 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f2df80097a0 tx=0x7f2df802a180 comp rx=0 tx=0).stop 2024-04-26T22:05:51.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e0d499640 1 -- 172.21.15.137:0/1568261564 shutdown_connections 2024-04-26T22:05:51.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e0d499640 1 --2- 172.21.15.137:0/1568261564 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 0x7f2e080b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e0d499640 1 --2- 172.21.15.137:0/1568261564 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f370 0x7f2e080cfd70 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e0d499640 1 -- 172.21.15.137:0/1568261564 >> 172.21.15.137:0/1568261564 conn(0x7f2e0808ec10 msgr2=0x7f2e0809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:51.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e0d499640 1 -- 172.21.15.137:0/1568261564 shutdown_connections 2024-04-26T22:05:51.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.012+0000 7f2e0d499640 1 -- 172.21.15.137:0/1568261564 wait complete. 2024-04-26T22:05:51.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e0d499640 1 Processor -- start 2024-04-26T22:05:51.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e0d499640 1 -- start start 2024-04-26T22:05:51.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e0d499640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 0x7f2e080b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e0d499640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e0815f370 0x7f2e0815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e0d499640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f750 0x7f2e080b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e0d499640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e080b51c0 con 0x7f2e0815f750 2024-04-26T22:05:51.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e0d499640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e080d0f20 con 0x7f2e0815f370 2024-04-26T22:05:51.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e0d499640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e080b5340 con 0x7f2e080d3ee0 2024-04-26T22:05:51.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e077fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f750 0x7f2e080b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.014+0000 7f2e077fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f750 0x7f2e080b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41544/0 (socket says 172.21.15.137:41544) 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e077fe640 1 -- 172.21.15.137:0/87291298 learned_addr learned my addr 172.21.15.137:0/87291298 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2dfffff640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e0815f370 0x7f2e0815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e06ffd640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 0x7f2e080b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e077fe640 1 -- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 msgr2=0x7f2e080b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e077fe640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 0x7f2e080b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e077fe640 1 -- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e0815f370 msgr2=0x7f2e0815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e077fe640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e0815f370 0x7f2e0815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e077fe640 1 -- 172.21.15.137:0/87291298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e080b9fb0 con 0x7f2e0815f750 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e06ffd640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 0x7f2e080b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2dfffff640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e0815f370 0x7f2e0815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e077fe640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f750 0x7f2e080b2e70 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000b9a0 tx=0x7f2e0000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2dff7fe640 1 -- 172.21.15.137:0/87291298 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00019070 con 0x7f2e0815f750 2024-04-26T22:05:51.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2dff7fe640 1 -- 172.21.15.137:0/87291298 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0000cb60 con 0x7f2e0815f750 2024-04-26T22:05:51.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e080ba290 con 0x7f2e0815f750 2024-04-26T22:05:51.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2dff7fe640 1 -- 172.21.15.137:0/87291298 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00014440 con 0x7f2e0815f750 2024-04-26T22:05:51.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.015+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e080ba850 con 0x7f2e0815f750 2024-04-26T22:05:51.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.016+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0806a290 con 0x7f2e0815f750 2024-04-26T22:05:51.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.016+0000 7f2dff7fe640 1 -- 172.21.15.137:0/87291298 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e0001c070 con 0x7f2e0815f750 2024-04-26T22:05:51.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.017+0000 7f2dff7fe640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de806c920 0x7f2de806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.017+0000 7f2e06ffd640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de806c920 0x7f2de806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.017+0000 7f2dff7fe640 1 -- 172.21.15.137:0/87291298 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f2e0008b8d0 con 0x7f2e0815f750 2024-04-26T22:05:51.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.017+0000 7f2e06ffd640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de806c920 0x7f2de806ede0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2df8034000 tx=0x7f2df802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:51.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.021+0000 7f2dff7fe640 1 -- 172.21.15.137:0/87291298 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2e00059cc0 con 0x7f2e0815f750 2024-04-26T22:05:51.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.197+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e080d1610 con 0x7f2e0815f750 2024-04-26T22:05:51.198 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.199+0000 7f2dff7fe640 1 -- 172.21.15.137:0/87291298 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16983 (secure 0 0 0) 0x7f2e000595c0 con 0x7f2e0815f750 2024-04-26T22:05:51.199 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:51.199 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":91,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:05:08.380391+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:04:11.600389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-26T22:04:12.347068+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1a","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.137:6835/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.170:6835/865192507":"2024-04-27T22:04:27.224170+0000","172.21.15.170:6833/865192507":"2024-04-27T22:04:27.224170+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de806c920 msgr2=0x7f2de806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de806c920 0x7f2de806ede0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2df8034000 tx=0x7f2df802e000 comp rx=0 tx=0).stop 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f750 msgr2=0x7f2e080b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f750 0x7f2e080b2e70 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000b9a0 tx=0x7f2e0000be60 comp rx=0 tx=0).stop 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 shutdown_connections 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2de806c920 0x7f2de806ede0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e0815f750 0x7f2e080b2e70 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e0815f370 0x7f2e0815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 --2- 172.21.15.137:0/87291298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e080d3ee0 0x7f2e080b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 >> 172.21.15.137:0/87291298 conn(0x7f2e0808ec10 msgr2=0x7f2e0815e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:51.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 shutdown_connections 2024-04-26T22:05:51.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.201+0000 7f2e0d499640 1 -- 172.21.15.137:0/87291298 wait complete. 2024-04-26T22:05:51.212 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:05:51.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.309+0000 7f80d3ebd640 1 Processor -- start 2024-04-26T22:05:51.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.309+0000 7f80d3ebd640 1 -- start start 2024-04-26T22:05:51.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d3ebd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f80cc0b44e0 0x7f80cc06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d3ebd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f80cc06d2b0 0x7f80cc06d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d3ebd640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80cc0b4a10 con 0x7f80cc15f1e0 2024-04-26T22:05:51.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d3ebd640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f80cc06dc60 con 0x7f80cc0b44e0 2024-04-26T22:05:51.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d3ebd640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f80cc06eeb0 con 0x7f80cc06d2b0 2024-04-26T22:05:51.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d1458640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f80cc0b44e0 0x7f80cc06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d1c59640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f80cc15f1e0 0x7f80cc0ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58680/0 (socket says 172.21.15.137:58680) 2024-04-26T22:05:51.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d1458640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f80cc0b44e0 0x7f80cc06e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41550/0 (socket says 172.21.15.137:41550) 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d1c59640 1 -- 172.21.15.137:0/2874052297 learned_addr learned my addr 172.21.15.137:0/2874052297 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d245a640 1 --2- 172.21.15.137:0/2874052297 >> v2:172.21.15.170:3300/0 conn(0x7f80cc06d2b0 0x7f80cc06d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d1458640 1 -- 172.21.15.137:0/2874052297 >> v2:172.21.15.170:3300/0 conn(0x7f80cc06d2b0 msgr2=0x7f80cc06d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d1458640 1 --2- 172.21.15.137:0/2874052297 >> v2:172.21.15.170:3300/0 conn(0x7f80cc06d2b0 0x7f80cc06d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d1458640 1 -- 172.21.15.137:0/2874052297 >> v1:172.21.15.137:6789/0 conn(0x7f80cc15f1e0 legacy=0x7f80cc0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d1458640 1 -- 172.21.15.137:0/2874052297 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80cc0b4cf0 con 0x7f80cc0b44e0 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.310+0000 7f80d0c57640 1 -- 172.21.15.137:0/2874052297 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839922838 0 0) 0x7f80cc0b4a10 con 0x7f80cc15f1e0 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.311+0000 7f80d1458640 1 --2- 172.21.15.137:0/2874052297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc0b44e0 0x7f80cc06e970 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0b0ba0 tx=0x7f80c002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf83580ed234a57 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.311+0000 7f80d0c57640 1 -- 172.21.15.137:0/2874052297 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0037070 con 0x7f80cc0b44e0 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.311+0000 7f80d0c57640 1 -- 172.21.15.137:0/2874052297 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c0032440 con 0x7f80cc0b44e0 2024-04-26T22:05:51.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.311+0000 7f80d0c57640 1 -- 172.21.15.137:0/2874052297 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c0032810 con 0x7f80cc0b44e0 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.312+0000 7f80d3ebd640 1 -- 172.21.15.137:0/2874052297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc0b44e0 msgr2=0x7f80cc06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.312+0000 7f80d3ebd640 1 --2- 172.21.15.137:0/2874052297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc0b44e0 0x7f80cc06e970 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0b0ba0 tx=0x7f80c002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.312+0000 7f80d3ebd640 1 -- 172.21.15.137:0/2874052297 shutdown_connections 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.312+0000 7f80d3ebd640 1 --2- 172.21.15.137:0/2874052297 >> v2:172.21.15.170:3300/0 conn(0x7f80cc06d2b0 0x7f80cc06d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.312+0000 7f80d3ebd640 1 --2- 172.21.15.137:0/2874052297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc0b44e0 0x7f80cc06e970 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.312+0000 7f80d3ebd640 1 -- 172.21.15.137:0/2874052297 >> 172.21.15.137:0/2874052297 conn(0x7f80cc0728a0 msgr2=0x7f80cc072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.312+0000 7f80d3ebd640 1 -- 172.21.15.137:0/2874052297 shutdown_connections 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.312+0000 7f80d3ebd640 1 -- 172.21.15.137:0/2874052297 wait complete. 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.313+0000 7f80d3ebd640 1 Processor -- start 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.313+0000 7f80d3ebd640 1 -- start start 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d3ebd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80cc06d2b0 0x7f80cc1439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d3ebd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80cc0b44e0 0x7f80cc163040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d3ebd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc15f1e0 0x7f80cc163580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d3ebd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80cc0b5590 con 0x7f80cc15f1e0 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d3ebd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f80cc0b52b0 con 0x7f80cc0b44e0 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d3ebd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f80cc15f5c0 con 0x7f80cc06d2b0 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d245a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc15f1e0 0x7f80cc163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d245a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc15f1e0 0x7f80cc163580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41564/0 (socket says 172.21.15.137:41564) 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d245a640 1 -- 172.21.15.137:0/3464415898 learned_addr learned my addr 172.21.15.137:0/3464415898 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d245a640 1 -- 172.21.15.137:0/3464415898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80cc06d2b0 msgr2=0x7f80cc1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d245a640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80cc06d2b0 0x7f80cc1439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d245a640 1 -- 172.21.15.137:0/3464415898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80cc0b44e0 msgr2=0x7f80cc163040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d1458640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80cc0b44e0 0x7f80cc163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d245a640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80cc0b44e0 0x7f80cc163040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d245a640 1 -- 172.21.15.137:0/3464415898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80cc157f80 con 0x7f80cc15f1e0 2024-04-26T22:05:51.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d245a640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc15f1e0 0x7f80cc163580 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f80c400e960 tx=0x7f80c400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:51.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80ca7fc640 1 -- 172.21.15.137:0/3464415898 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4017070 con 0x7f80cc15f1e0 2024-04-26T22:05:51.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80ca7fc640 1 -- 172.21.15.137:0/3464415898 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c400c980 con 0x7f80cc15f1e0 2024-04-26T22:05:51.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80ca7fc640 1 -- 172.21.15.137:0/3464415898 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c400cd70 con 0x7f80cc15f1e0 2024-04-26T22:05:51.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.314+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80cc158260 con 0x7f80cc15f1e0 2024-04-26T22:05:51.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.315+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80cc158820 con 0x7f80cc15f1e0 2024-04-26T22:05:51.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.315+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80cc06a290 con 0x7f80cc15f1e0 2024-04-26T22:05:51.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.316+0000 7f80ca7fc640 1 -- 172.21.15.137:0/3464415898 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80c401a070 con 0x7f80cc15f1e0 2024-04-26T22:05:51.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.316+0000 7f80ca7fc640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80b806c8f0 0x7f80b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.316+0000 7f80ca7fc640 1 -- 172.21.15.137:0/3464415898 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5910+0+0 (secure 0 0 0) 0x7f80c408bfa0 con 0x7f80cc15f1e0 2024-04-26T22:05:51.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.316+0000 7f80d1c59640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80b806c8f0 0x7f80b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.317+0000 7f80d1c59640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80b806c8f0 0x7f80b806edb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f80bc007fd0 tx=0x7f80bc007ce0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:51.320 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.321+0000 7f80ca7fc640 1 -- 172.21.15.137:0/3464415898 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f80c405a300 con 0x7f80cc15f1e0 2024-04-26T22:05:51.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.535+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f80cc154ad0 con 0x7f80cc15f1e0 2024-04-26T22:05:51.535 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:05:51.535+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:05:51.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.536+0000 7f80ca7fc640 1 -- 172.21.15.137:0/3464415898 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) ==== 161+0+0 (secure 0 0 0) 0x7f80c4059c00 con 0x7f80cc15f1e0 2024-04-26T22:05:51.536 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:05:51.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80b806c8f0 msgr2=0x7f80b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80b806c8f0 0x7f80b806edb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f80bc007fd0 tx=0x7f80bc007ce0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc15f1e0 msgr2=0x7f80cc163580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc15f1e0 0x7f80cc163580 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f80c400e960 tx=0x7f80c400ee20 comp rx=0 tx=0).stop 2024-04-26T22:05:51.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 shutdown_connections 2024-04-26T22:05:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80b806c8f0 0x7f80b806edb0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80cc15f1e0 0x7f80cc163580 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80cc0b44e0 0x7f80cc163040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 --2- 172.21.15.137:0/3464415898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80cc06d2b0 0x7f80cc1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 >> 172.21.15.137:0/3464415898 conn(0x7f80cc0728a0 msgr2=0x7f80cc0aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 shutdown_connections 2024-04-26T22:05:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.539+0000 7f80d3ebd640 1 -- 172.21.15.137:0/3464415898 wait complete. 2024-04-26T22:05:51.542 INFO:tasks.ceph.mds.a.smithi137.stderr: -1921> 2024-04-26T22:05:15.062+0000 7efff620c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() | dirtyparent=1 authpin=1 scrubqueue=0 0x55a17821c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-26T22:05:51.542 INFO:tasks.ceph.mds.a.smithi137.stderr: -1874> 2024-04-26T22:05:15.388+0000 7efffa214640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:05:51.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:05:51.568 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:05:51.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.651+0000 7fa2adc62640 1 Processor -- start 2024-04-26T22:05:51.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.651+0000 7fa2adc62640 1 -- start start 2024-04-26T22:05:51.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.651+0000 7fa2adc62640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa2a815b930 0x7fa2a815bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.651+0000 7fa2adc62640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a8074200 0x7fa2a80cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.651+0000 7fa2adc62640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a815c530 con 0x7fa2a815f4f0 2024-04-26T22:05:51.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.651+0000 7fa2adc62640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a815c810 con 0x7fa2a815b930 2024-04-26T22:05:51.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.651+0000 7fa2adc62640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a815caf0 con 0x7fa2a8074200 2024-04-26T22:05:51.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa2a77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa2a815b930 0x7fa2a815bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa2a77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa2a815b930 0x7fa2a815bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41602/0 (socket says 172.21.15.137:41602) 2024-04-26T22:05:51.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa29ffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa2a815f4f0 0x7fa2a8073af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58686/0 (socket says 172.21.15.137:58686) 2024-04-26T22:05:51.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa2a77fe640 1 -- 172.21.15.137:0/1343838991 learned_addr learned my addr 172.21.15.137:0/1343838991 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:51.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa2a7fff640 1 --2- 172.21.15.137:0/1343838991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a8074200 0x7fa2a80cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa2a77fe640 1 -- 172.21.15.137:0/1343838991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a8074200 msgr2=0x7fa2a80cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:51.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa2a77fe640 1 --2- 172.21.15.137:0/1343838991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a8074200 0x7fa2a80cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa2a77fe640 1 -- 172.21.15.137:0/1343838991 >> v1:172.21.15.137:6789/0 conn(0x7fa2a815f4f0 legacy=0x7fa2a8073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa2a6ffd640 1 -- 172.21.15.137:0/1343838991 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105178436 0 0) 0x7fa2a815c530 con 0x7fa2a815f4f0 2024-04-26T22:05:51.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.652+0000 7fa2a77fe640 1 -- 172.21.15.137:0/1343838991 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a815cdd0 con 0x7fa2a815b930 2024-04-26T22:05:51.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.653+0000 7fa2a77fe640 1 --2- 172.21.15.137:0/1343838991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a815b930 0x7fa2a815bd10 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fa29800bb00 tx=0x7fa29802c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d055df732a2dd66e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:51.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.653+0000 7fa2a6ffd640 1 -- 172.21.15.137:0/1343838991 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29803a070 con 0x7fa2a815b930 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.653+0000 7fa2a6ffd640 1 -- 172.21.15.137:0/1343838991 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa298032480 con 0x7fa2a815b930 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.653+0000 7fa2a6ffd640 1 -- 172.21.15.137:0/1343838991 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298032850 con 0x7fa2a815b930 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.653+0000 7fa2adc62640 1 -- 172.21.15.137:0/1343838991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a815b930 msgr2=0x7fa2a815bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.653+0000 7fa2adc62640 1 --2- 172.21.15.137:0/1343838991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a815b930 0x7fa2a815bd10 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fa29800bb00 tx=0x7fa29802c6e0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.653+0000 7fa2adc62640 1 -- 172.21.15.137:0/1343838991 shutdown_connections 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.653+0000 7fa2adc62640 1 --2- 172.21.15.137:0/1343838991 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a8074200 0x7fa2a80cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.653+0000 7fa2adc62640 1 --2- 172.21.15.137:0/1343838991 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a815b930 0x7fa2a815bd10 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.654+0000 7fa2adc62640 1 -- 172.21.15.137:0/1343838991 >> 172.21.15.137:0/1343838991 conn(0x7fa2a80cd8a0 msgr2=0x7fa2a80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.654+0000 7fa2adc62640 1 -- 172.21.15.137:0/1343838991 shutdown_connections 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.654+0000 7fa2adc62640 1 -- 172.21.15.137:0/1343838991 wait complete. 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.655+0000 7fa2adc62640 1 Processor -- start 2024-04-26T22:05:51.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.655+0000 7fa2adc62640 1 -- start start 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.655+0000 7fa2adc62640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a8074200 0x7fa2a8151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.655+0000 7fa2adc62640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a815b930 0x7fa2a8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.655+0000 7fa2adc62640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a815f4f0 0x7fa2a81f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.655+0000 7fa2adc62640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a806fdd0 con 0x7fa2a8074200 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.655+0000 7fa2adc62640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a815c250 con 0x7fa2a815f4f0 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.655+0000 7fa2adc62640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a806f340 con 0x7fa2a815b930 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.655+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a8074200 0x7fa2a8151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a8074200 0x7fa2a8151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41608/0 (socket says 172.21.15.137:41608) 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a77fe640 1 -- 172.21.15.137:0/2798355059 learned_addr learned my addr 172.21.15.137:0/2798355059 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a77fe640 1 -- 172.21.15.137:0/2798355059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a815b930 msgr2=0x7fa2a8159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a77fe640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a815b930 0x7fa2a8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a77fe640 1 -- 172.21.15.137:0/2798355059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a815f4f0 msgr2=0x7fa2a81f84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a7fff640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a815f4f0 0x7fa2a81f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a77fe640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a815f4f0 0x7fa2a81f84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a77fe640 1 -- 172.21.15.137:0/2798355059 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a8157680 con 0x7fa2a8074200 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a7fff640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a815f4f0 0x7fa2a81f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a77fe640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a8074200 0x7fa2a8151720 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa29800bb00 tx=0x7fa2980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a4ff9640 1 -- 172.21.15.137:0/2798355059 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298045070 con 0x7fa2a8074200 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a4ff9640 1 -- 172.21.15.137:0/2798355059 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa298035a50 con 0x7fa2a8074200 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a8157960 con 0x7fa2a8074200 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2a4ff9640 1 -- 172.21.15.137:0/2798355059 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29803a070 con 0x7fa2a8074200 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.656+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a8157f20 con 0x7fa2a8074200 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.657+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a806a290 con 0x7fa2a8074200 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.658+0000 7fa2a4ff9640 1 -- 172.21.15.137:0/2798355059 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa298048070 con 0x7fa2a8074200 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.658+0000 7fa2a4ff9640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa28806c8f0 0x7fa28806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:51.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.658+0000 7fa2a4ff9640 1 -- 172.21.15.137:0/2798355059 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5996+0+0 (secure 0 0 0) 0x7fa2980ac4b0 con 0x7fa2a8074200 2024-04-26T22:05:51.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.658+0000 7fa29ffff640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa28806c8f0 0x7fa28806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:51.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.658+0000 7fa29ffff640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa28806c8f0 0x7fa28806edb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa290007fd0 tx=0x7fa290007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:51.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.663+0000 7fa2a4ff9640 1 -- 172.21.15.137:0/2798355059 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa29807a7c0 con 0x7fa2a8074200 2024-04-26T22:05:51.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:51.877+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa2a80ce000 con 0x7fa2a8074200 2024-04-26T22:05:52.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.538+0000 7fa2a4ff9640 1 -- 172.21.15.137:0/2798355059 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) ==== 104+0+0 (secure 0 0 0) 0x7fa298035e20 con 0x7fa2a8074200 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa28806c8f0 msgr2=0x7fa28806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa28806c8f0 0x7fa28806edb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa290007fd0 tx=0x7fa290007960 comp rx=0 tx=0).stop 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a8074200 msgr2=0x7fa2a8151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a8074200 0x7fa2a8151720 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fa29800bb00 tx=0x7fa2980046c0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 shutdown_connections 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa28806c8f0 0x7fa28806edb0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2a815f4f0 0x7fa2a81f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2a815b930 0x7fa2a8159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 --2- 172.21.15.137:0/2798355059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2a8074200 0x7fa2a8151720 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 >> 172.21.15.137:0/2798355059 conn(0x7fa2a80cd8a0 msgr2=0x7fa2a80b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:52.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 shutdown_connections 2024-04-26T22:05:52.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.540+0000 7fa2adc62640 1 -- 172.21.15.137:0/2798355059 wait complete. 2024-04-26T22:05:52.553 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:05:52.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.696+0000 7f0b97946640 1 Processor -- start 2024-04-26T22:05:52.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.697+0000 7f0b97946640 1 -- start start 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.697+0000 7f0b97946640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b901454c0 0x7f0b900d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.697+0000 7f0b97946640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9006e830 con 0x7f0b9006e330 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.697+0000 7f0b97946640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9006eb10 con 0x7f0b900d18a0 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.697+0000 7f0b97946640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b900721a0 con 0x7f0b901454c0 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.697+0000 7f0b94ee1640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0b9006e330 0x7f0b900d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58698/0 (socket says 172.21.15.137:58698) 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.697+0000 7f0b94ee1640 1 -- 172.21.15.137:0/444968954 learned_addr learned my addr 172.21.15.137:0/444968954 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b956e2640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b901454c0 0x7f0b900d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277374708 0 0) 0x7f0b9006e830 con 0x7f0b9006e330 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b7c003520 con 0x7f0b9006e330 2024-04-26T22:05:52.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212216701 0 0) 0x7f0b9006eb10 con 0x7f0b900d18a0 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b9006e830 con 0x7f0b900d18a0 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2956846300 0 0) 0x7f0b7c003520 con 0x7f0b9006e330 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b901454c0 msgr2=0x7f0b900d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b901454c0 0x7f0b900d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 >> v1:172.21.15.170:6789/0 conn(0x7f0b900d18a0 legacy=0x7f0b900cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9006edf0 con 0x7f0b9006e330 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f0b80001670 con 0x7f0b9006e330 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 >> v1:172.21.15.137:6789/0 conn(0x7f0b9006e330 legacy=0x7f0b900d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b7c003b70 0x7f0b7c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b901454c0 0x7f0b7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c00ba70 con 0x7f0b7c004800 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c00bbf0 con 0x7f0b7c003b70 2024-04-26T22:05:52.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c00bdc0 con 0x7f0b901454c0 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b94ee1640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b956e2640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b7c003b70 0x7f0b7c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b95ee3640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b901454c0 0x7f0b7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b94ee1640 1 -- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b901454c0 msgr2=0x7f0b7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b94ee1640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b901454c0 0x7f0b7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b94ee1640 1 -- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b7c003b70 msgr2=0x7f0b7c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b94ee1640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b7c003b70 0x7f0b7c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.698+0000 7f0b94ee1640 1 -- 172.21.15.137:0/444968954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c003520 con 0x7f0b7c004800 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.699+0000 7f0b94ee1640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b7c004c80 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c210 tx=0x7f0b7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decbe423bcb1d36e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.699+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b80007ce0 con 0x7f0b7c004800 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.699+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b80005ad0 con 0x7f0b7c004800 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.699+0000 7f0b87fff640 1 -- 172.21.15.137:0/444968954 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b80007070 con 0x7f0b7c004800 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.700+0000 7f0b97946640 1 -- 172.21.15.137:0/444968954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 msgr2=0x7f0b7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:52.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.700+0000 7f0b97946640 1 --2- 172.21.15.137:0/444968954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b7c004c80 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c210 tx=0x7f0b7c005830 comp rx=0 tx=0).stop 2024-04-26T22:05:52.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.700+0000 7f0b95ee3640 1 -- 172.21.15.137:0/444968954 reap_dead start 2024-04-26T22:05:52.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.700+0000 7f0b97946640 1 -- 172.21.15.137:0/444968954 shutdown_connections 2024-04-26T22:05:52.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.700+0000 7f0b97946640 1 -- 172.21.15.137:0/444968954 >> 172.21.15.137:0/444968954 conn(0x7f0b9006c690 msgr2=0x7f0b9006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:52.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.700+0000 7f0b97946640 1 -- 172.21.15.137:0/444968954 shutdown_connections 2024-04-26T22:05:52.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.700+0000 7f0b97946640 1 -- 172.21.15.137:0/444968954 wait complete. 2024-04-26T22:05:52.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.701+0000 7f0b97946640 1 Processor -- start 2024-04-26T22:05:52.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.701+0000 7f0b97946640 1 -- start start 2024-04-26T22:05:52.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b97946640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b900cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:52.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b97946640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b9013dfc0 0x7f0b9013b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:52.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b97946640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b9013b5e0 0x7f0b900cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:52.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b97946640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9015d8a0 con 0x7f0b7c004800 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b97946640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b900ceca0 con 0x7f0b9013b5e0 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b97946640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b900d05a0 con 0x7f0b9013dfc0 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b956e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b900cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b956e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b900cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41620/0 (socket says 172.21.15.137:41620) 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b956e2640 1 -- 172.21.15.137:0/687892679 learned_addr learned my addr 172.21.15.137:0/687892679 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b956e2640 1 -- 172.21.15.137:0/687892679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b9013dfc0 msgr2=0x7f0b9013b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b956e2640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b9013dfc0 0x7f0b9013b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b95ee3640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b9013b5e0 0x7f0b900cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b956e2640 1 -- 172.21.15.137:0/687892679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b9013b5e0 msgr2=0x7f0b900cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b956e2640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b9013b5e0 0x7f0b900cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b956e2640 1 -- 172.21.15.137:0/687892679 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9013cf20 con 0x7f0b7c004800 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b95ee3640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b9013b5e0 0x7f0b900cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b956e2640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b900cc700 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c011ad0 tx=0x7f0b8c011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:52.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b85ffb640 1 -- 172.21.15.137:0/687892679 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c01e070 con 0x7f0b7c004800 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b85ffb640 1 -- 172.21.15.137:0/687892679 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b8c019430 con 0x7f0b7c004800 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b85ffb640 1 -- 172.21.15.137:0/687892679 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0197e0 con 0x7f0b7c004800 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.702+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9013d200 con 0x7f0b7c004800 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.703+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b9013d7c0 con 0x7f0b7c004800 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.703+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9006a290 con 0x7f0b7c004800 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.704+0000 7f0b85ffb640 1 -- 172.21.15.137:0/687892679 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b8c021070 con 0x7f0b7c004800 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.704+0000 7f0b85ffb640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c920 0x7f0b7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.704+0000 7f0b85ffb640 1 -- 172.21.15.137:0/687892679 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5996+0+0 (secure 0 0 0) 0x7f0b8c08c0a0 con 0x7f0b7c004800 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.704+0000 7f0b94ee1640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c920 0x7f0b7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:52.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.705+0000 7f0b94ee1640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c920 0x7f0b7406ede0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0b80032000 tx=0x7f0b80007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:52.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.708+0000 7f0b85ffb640 1 -- 172.21.15.137:0/687892679 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0b8c059df0 con 0x7f0b7c004800 2024-04-26T22:05:52.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:52.883+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0b90140cc0 con 0x7f0b7c004800 2024-04-26T22:05:53.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.542+0000 7f0b85ffb640 1 -- 172.21.15.137:0/687892679 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7f0b8c05e0f0 con 0x7f0b7c004800 2024-04-26T22:05:53.542 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:05:53.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c920 msgr2=0x7f0b7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:53.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c920 0x7f0b7406ede0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0b80032000 tx=0x7f0b80007000 comp rx=0 tx=0).stop 2024-04-26T22:05:53.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 msgr2=0x7f0b900cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:53.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b900cc700 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c011ad0 tx=0x7f0b8c011f90 comp rx=0 tx=0).stop 2024-04-26T22:05:53.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 shutdown_connections 2024-04-26T22:05:53.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b7406c920 0x7f0b7406ede0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:53.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b9013b5e0 0x7f0b900cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:53.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b9013dfc0 0x7f0b9013b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:53.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 --2- 172.21.15.137:0/687892679 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b7c004800 0x7f0b900cc700 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:53.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 >> 172.21.15.137:0/687892679 conn(0x7f0b9006c690 msgr2=0x7f0b9015e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:53.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 shutdown_connections 2024-04-26T22:05:53.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.546+0000 7f0b97946640 1 -- 172.21.15.137:0/687892679 wait complete. 2024-04-26T22:05:53.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:05:53.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.660+0000 7f86cb2ea640 1 Processor -- start 2024-04-26T22:05:53.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.661+0000 7f86cb2ea640 1 -- start start 2024-04-26T22:05:53.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.661+0000 7f86cb2ea640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f86c41454c0 0x7f86c40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:53.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.661+0000 7f86cb2ea640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f86c40d18a0 0x7f86c40cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:53.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.661+0000 7f86cb2ea640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c406e830 con 0x7f86c406e330 2024-04-26T22:05:53.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.661+0000 7f86cb2ea640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f86c40721a0 con 0x7f86c41454c0 2024-04-26T22:05:53.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.661+0000 7f86cb2ea640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f86c40ceca0 con 0x7f86c40d18a0 2024-04-26T22:05:53.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c9086640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f86c41454c0 0x7f86c40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:53.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c9086640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f86c41454c0 0x7f86c40d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41624/0 (socket says 172.21.15.137:41624) 2024-04-26T22:05:53.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c8885640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f86c406e330 0x7f86c40d1190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58712/0 (socket says 172.21.15.137:58712) 2024-04-26T22:05:53.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c9086640 1 -- 172.21.15.137:0/2856098953 learned_addr learned my addr 172.21.15.137:0/2856098953 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:53.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c9887640 1 --2- 172.21.15.137:0/2856098953 >> v2:172.21.15.170:3300/0 conn(0x7f86c40d18a0 0x7f86c40cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:53.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c9086640 1 -- 172.21.15.137:0/2856098953 >> v2:172.21.15.170:3300/0 conn(0x7f86c40d18a0 msgr2=0x7f86c40cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:53.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c9086640 1 --2- 172.21.15.137:0/2856098953 >> v2:172.21.15.170:3300/0 conn(0x7f86c40d18a0 0x7f86c40cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:53.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c9086640 1 -- 172.21.15.137:0/2856098953 >> v1:172.21.15.137:6789/0 conn(0x7f86c406e330 legacy=0x7f86c40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:53.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86bbfff640 1 -- 172.21.15.137:0/2856098953 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 269399619 0 0) 0x7f86c406e830 con 0x7f86c406e330 2024-04-26T22:05:53.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c9086640 1 -- 172.21.15.137:0/2856098953 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c406eb10 con 0x7f86c41454c0 2024-04-26T22:05:53.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.662+0000 7f86c9887640 1 --2- 172.21.15.137:0/2856098953 >> v2:172.21.15.170:3300/0 conn(0x7f86c40d18a0 0x7f86c40cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:53.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86c9086640 1 --2- 172.21.15.137:0/2856098953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c41454c0 0x7f86c40d05a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f86c40b44a0 tx=0x7f86c002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a3fd93ae2c18af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:53.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86bbfff640 1 -- 172.21.15.137:0/2856098953 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0036020 con 0x7f86c41454c0 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86bbfff640 1 -- 172.21.15.137:0/2856098953 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c0032640 con 0x7f86c41454c0 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86bbfff640 1 -- 172.21.15.137:0/2856098953 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0032a10 con 0x7f86c41454c0 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86cb2ea640 1 -- 172.21.15.137:0/2856098953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c41454c0 msgr2=0x7f86c40d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86cb2ea640 1 --2- 172.21.15.137:0/2856098953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c41454c0 0x7f86c40d05a0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f86c40b44a0 tx=0x7f86c002c940 comp rx=0 tx=0).stop 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86cb2ea640 1 -- 172.21.15.137:0/2856098953 shutdown_connections 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86cb2ea640 1 --2- 172.21.15.137:0/2856098953 >> v2:172.21.15.170:3300/0 conn(0x7f86c40d18a0 0x7f86c40cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86cb2ea640 1 --2- 172.21.15.137:0/2856098953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c41454c0 0x7f86c40d05a0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86cb2ea640 1 -- 172.21.15.137:0/2856098953 >> 172.21.15.137:0/2856098953 conn(0x7f86c406c690 msgr2=0x7f86c406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86cb2ea640 1 -- 172.21.15.137:0/2856098953 shutdown_connections 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.663+0000 7f86cb2ea640 1 -- 172.21.15.137:0/2856098953 wait complete. 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86cb2ea640 1 Processor -- start 2024-04-26T22:05:53.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86cb2ea640 1 -- start start 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86cb2ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c406e330 0x7f86c41599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86cb2ea640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86c40d18a0 0x7f86c40c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86cb2ea640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86c41454c0 0x7f86c40c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86cb2ea640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f86c40d0ae0 con 0x7f86c406e330 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86cb2ea640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f86c406f0d0 con 0x7f86c40d18a0 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86cb2ea640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f86c415d8a0 con 0x7f86c41454c0 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86c9086640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c406e330 0x7f86c41599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86c9086640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c406e330 0x7f86c41599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41640/0 (socket says 172.21.15.137:41640) 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86c9086640 1 -- 172.21.15.137:0/1149329378 learned_addr learned my addr 172.21.15.137:0/1149329378 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.665+0000 7f86c8885640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86c40d18a0 0x7f86c40c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:53.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86c9887640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86c41454c0 0x7f86c40c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86c9086640 1 -- 172.21.15.137:0/1149329378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86c41454c0 msgr2=0x7f86c40c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86c9086640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86c41454c0 0x7f86c40c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86c9086640 1 -- 172.21.15.137:0/1149329378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86c40d18a0 msgr2=0x7f86c40c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86c9086640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86c40d18a0 0x7f86c40c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86c9086640 1 -- 172.21.15.137:0/1149329378 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c40c5f80 con 0x7f86c406e330 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86c9887640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86c41454c0 0x7f86c40c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86c9086640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c406e330 0x7f86c41599c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f86c000b2c0 tx=0x7f86c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86b9ffb640 1 -- 172.21.15.137:0/1149329378 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0036040 con 0x7f86c406e330 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86b9ffb640 1 -- 172.21.15.137:0/1149329378 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c003ad80 con 0x7f86c406e330 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86b9ffb640 1 -- 172.21.15.137:0/1149329378 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0004270 con 0x7f86c406e330 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c40c6240 con 0x7f86c406e330 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.666+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c40c6800 con 0x7f86c406e330 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.667+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c40b2920 con 0x7f86c406e330 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.667+0000 7f86b9ffb640 1 -- 172.21.15.137:0/1149329378 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86c0039020 con 0x7f86c406e330 2024-04-26T22:05:53.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.668+0000 7f86b9ffb640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f86a806c8f0 0x7f86a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:53.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.668+0000 7f86b9ffb640 1 -- 172.21.15.137:0/1149329378 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5558+0+0 (secure 0 0 0) 0x7f86c00aca70 con 0x7f86c406e330 2024-04-26T22:05:53.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.668+0000 7f86c8885640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f86a806c8f0 0x7f86a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:53.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.668+0000 7f86c8885640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f86a806c8f0 0x7f86a806edb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f86c415bce0 tx=0x7f86b4007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:53.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.672+0000 7f86b9ffb640 1 -- 172.21.15.137:0/1149329378 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f86c40b2920 con 0x7f86c406e330 2024-04-26T22:05:53.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:53.857+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f86c406a290 con 0x7f86c406e330 2024-04-26T22:05:54.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.548+0000 7f86b9ffb640 1 -- 172.21.15.137:0/1149329378 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7f86c007ae90 con 0x7f86c406e330 2024-04-26T22:05:54.549 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.552+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f86a806c8f0 msgr2=0x7f86a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.552+0000 7f86cb2ea640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f86a806c8f0 0x7f86a806edb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f86c415bce0 tx=0x7f86b4007c00 comp rx=0 tx=0).stop 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.552+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c406e330 msgr2=0x7f86c41599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.552+0000 7f86cb2ea640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c406e330 0x7f86c41599c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f86c000b2c0 tx=0x7f86c0004730 comp rx=0 tx=0).stop 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.553+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 shutdown_connections 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.553+0000 7f86cb2ea640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f86a806c8f0 0x7f86a806edb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.553+0000 7f86cb2ea640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f86c41454c0 0x7f86c40c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.553+0000 7f86cb2ea640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f86c40d18a0 0x7f86c40c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.553+0000 7f86cb2ea640 1 --2- 172.21.15.137:0/1149329378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f86c406e330 0x7f86c41599c0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.553+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 >> 172.21.15.137:0/1149329378 conn(0x7f86c406c690 msgr2=0x7f86c40b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.553+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 shutdown_connections 2024-04-26T22:05:54.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.553+0000 7f86cb2ea640 1 -- 172.21.15.137:0/1149329378 wait complete. 2024-04-26T22:05:54.567 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T22:05:54.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.669+0000 7fe5ac409640 1 Processor -- start 2024-04-26T22:05:54.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.669+0000 7fe5ac409640 1 -- start start 2024-04-26T22:05:54.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.670+0000 7fe5ac409640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a40d0300 0x7fe5a40b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.670+0000 7fe5ac409640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe5a40b3e50 0x7fe5a40720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.670+0000 7fe5ac409640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a40b46a0 con 0x7fe5a406f340 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.670+0000 7fe5ac409640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a40b5db0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.670+0000 7fe5ac409640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a40b6090 con 0x7fe5a40d0300 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.670+0000 7fe5aa9a6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe5a40b3e50 0x7fe5a40720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.671+0000 7fe5aa9a6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe5a40b3e50 0x7fe5a40720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41654/0 (socket says 172.21.15.137:41654) 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.671+0000 7fe5aa9a6640 1 -- 172.21.15.137:0/1060592250 learned_addr learned my addr 172.21.15.137:0/1060592250 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.671+0000 7fe5aa9a6640 1 -- 172.21.15.137:0/1060592250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a40d0300 msgr2=0x7fe5a40b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.671+0000 7fe5a99a4640 1 --2- 172.21.15.137:0/1060592250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a40d0300 0x7fe5a40b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.671+0000 7fe5aa9a6640 1 --2- 172.21.15.137:0/1060592250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a40d0300 0x7fe5a40b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.671+0000 7fe5aa9a6640 1 -- 172.21.15.137:0/1060592250 >> v1:172.21.15.170:6789/0 conn(0x7fe5a406f340 legacy=0x7fe5a406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.671+0000 7fe5aa9a6640 1 -- 172.21.15.137:0/1060592250 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a40b6370 con 0x7fe5a40b3e50 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.671+0000 7fe5aa9a6640 1 --2- 172.21.15.137:0/1060592250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 0x7fe5a40720f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009e80 tx=0x7fe59c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04fa1d516d77833 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5a91a3640 1 -- 172.21.15.137:0/1060592250 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c036070 con 0x7fe5a40b3e50 2024-04-26T22:05:54.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5a91a3640 1 -- 172.21.15.137:0/1060592250 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59c031600 con 0x7fe5a40b3e50 2024-04-26T22:05:54.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5a91a3640 1 -- 172.21.15.137:0/1060592250 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0319d0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5ac409640 1 -- 172.21.15.137:0/1060592250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 msgr2=0x7fe5a40720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5ac409640 1 --2- 172.21.15.137:0/1060592250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 0x7fe5a40720f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009e80 tx=0x7fe59c02a5d0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5ac409640 1 -- 172.21.15.137:0/1060592250 shutdown_connections 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5ac409640 1 --2- 172.21.15.137:0/1060592250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 0x7fe5a40720f0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5ac409640 1 --2- 172.21.15.137:0/1060592250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a40d0300 0x7fe5a40b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5ac409640 1 -- 172.21.15.137:0/1060592250 >> 172.21.15.137:0/1060592250 conn(0x7fe5a40cd8a0 msgr2=0x7fe5a40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5ac409640 1 -- 172.21.15.137:0/1060592250 shutdown_connections 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.672+0000 7fe5ac409640 1 -- 172.21.15.137:0/1060592250 wait complete. 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.673+0000 7fe5ac409640 1 Processor -- start 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5ac409640 1 -- start start 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5ac409640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a406f340 0x7fe5a413a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5ac409640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 0x7fe5a414c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5ac409640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a40d0300 0x7fe5a40ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5ac409640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a40b4460 con 0x7fe5a40b3e50 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5ac409640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a40b42e0 con 0x7fe5a40d0300 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5ac409640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a4142a30 con 0x7fe5a406f340 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5a99a4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 0x7fe5a414c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5a99a4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 0x7fe5a414c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41658/0 (socket says 172.21.15.137:41658) 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.674+0000 7fe5a99a4640 1 -- 172.21.15.137:0/1099488579 learned_addr learned my addr 172.21.15.137:0/1099488579 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe5a99a4640 1 -- 172.21.15.137:0/1099488579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a406f340 msgr2=0x7fe5a413a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe5a99a4640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a406f340 0x7fe5a413a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe5a99a4640 1 -- 172.21.15.137:0/1099488579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a40d0300 msgr2=0x7fe5a40ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe5a99a4640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a40d0300 0x7fe5a40ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe5a99a4640 1 -- 172.21.15.137:0/1099488579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a413aad0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe5a99a4640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 0x7fe5a414c4d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000c820 tx=0x7fe5a000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe59affd640 1 -- 172.21.15.137:0/1099488579 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0015070 con 0x7fe5a40b3e50 2024-04-26T22:05:54.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe59affd640 1 -- 172.21.15.137:0/1099488579 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a0004240 con 0x7fe5a40b3e50 2024-04-26T22:05:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a413dda0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe59affd640 1 -- 172.21.15.137:0/1099488579 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000ce10 con 0x7fe5a40b3e50 2024-04-26T22:05:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.675+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a41435a0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.676+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a406a290 con 0x7fe5a40b3e50 2024-04-26T22:05:54.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.676+0000 7fe59affd640 1 -- 172.21.15.137:0/1099488579 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe5a00077d0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.677+0000 7fe59affd640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe58806c8f0 0x7fe58806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.677+0000 7fe59affd640 1 -- 172.21.15.137:0/1099488579 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5115+0+0 (secure 0 0 0) 0x7fe5a008b6e0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.677+0000 7fe5aa1a5640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe58806c8f0 0x7fe58806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.677+0000 7fe5aa1a5640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe58806c8f0 0x7fe58806edb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe594006fd0 tx=0x7fe594006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:54.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.681+0000 7fe59affd640 1 -- 172.21.15.137:0/1099488579 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe5a0059df0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.866+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe5a406f8c0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.869+0000 7fe59affd640 1 -- 172.21.15.137:0/1099488579 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fe5a00596f0 con 0x7fe5a40b3e50 2024-04-26T22:05:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe58806c8f0 msgr2=0x7fe58806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe58806c8f0 0x7fe58806edb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe594006fd0 tx=0x7fe594006bc0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 msgr2=0x7fe5a414c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 0x7fe5a414c4d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000c820 tx=0x7fe5a000cce0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 shutdown_connections 2024-04-26T22:05:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe58806c8f0 0x7fe58806edb0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.871 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5a40b3e50 0x7fe5a414c4d0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a40d0300 0x7fe5a40ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 --2- 172.21.15.137:0/1099488579 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5a406f340 0x7fe5a413a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 >> 172.21.15.137:0/1099488579 conn(0x7fe5a40cd8a0 msgr2=0x7fe5a4140020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 shutdown_connections 2024-04-26T22:05:54.872 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.871+0000 7fe5ac409640 1 -- 172.21.15.137:0/1099488579 wait complete. 2024-04-26T22:05:54.882 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-26T22:05:54.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.980+0000 7fc4a85da640 1 Processor -- start 2024-04-26T22:05:54.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.980+0000 7fc4a85da640 1 -- start start 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.981+0000 7fc4a85da640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc4a015f370 0x7fc4a00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.981+0000 7fc4a85da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a015f750 0x7fc4a00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.981+0000 7fc4a85da640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a00d03a0 con 0x7fc4a00d37d0 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.981+0000 7fc4a85da640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a00b4d10 con 0x7fc4a015f370 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.981+0000 7fc4a85da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a00d0680 con 0x7fc4a015f750 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.981+0000 7fc4a6b77640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc4a00d37d0 0x7fc4a00d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58728/0 (socket says 172.21.15.137:58728) 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.981+0000 7fc4a6b77640 1 -- 172.21.15.137:0/1532934091 learned_addr learned my addr 172.21.15.137:0/1532934091 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a6376640 1 --2- 172.21.15.137:0/1532934091 >> v2:172.21.15.170:3300/0 conn(0x7fc4a015f370 0x7fc4a00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5b75640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a015f750 0x7fc4a00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333706978 0 0) 0x7fc4a00d03a0 con 0x7fc4a00d37d0 2024-04-26T22:05:54.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc48c003520 con 0x7fc4a00d37d0 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2516080702 0 0) 0x7fc48c003520 con 0x7fc4a00d37d0 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a015f750 msgr2=0x7fc4a00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a015f750 0x7fc4a00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 >> v2:172.21.15.170:3300/0 conn(0x7fc4a015f370 msgr2=0x7fc4a00cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 --2- 172.21.15.137:0/1532934091 >> v2:172.21.15.170:3300/0 conn(0x7fc4a015f370 0x7fc4a00cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a00d0960 con 0x7fc4a00d37d0 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fc498001670 con 0x7fc4a00d37d0 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 >> v1:172.21.15.137:6789/0 conn(0x7fc4a00d37d0 legacy=0x7fc4a00d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c0039b0 0x7fc48c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a015f750 0x7fc48c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc48c004d40 0x7fc48c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a00b4d10 con 0x7fc48c004d40 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a00d0680 con 0x7fc48c0039b0 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc48c00b9c0 con 0x7fc4a015f750 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a6b77640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc48c004d40 0x7fc48c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a5b75640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a015f750 0x7fc48c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a6376640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c0039b0 0x7fc48c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a6b77640 1 -- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a015f750 msgr2=0x7fc48c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a6b77640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a015f750 0x7fc48c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a6b77640 1 -- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c0039b0 msgr2=0x7fc48c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a6b77640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c0039b0 0x7fc48c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a6b77640 1 -- 172.21.15.137:0/1532934091 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c003520 con 0x7fc48c004d40 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.982+0000 7fc4a6376640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c0039b0 0x7fc48c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:54.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.983+0000 7fc4a6b77640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc48c004d40 0x7fc48c0051c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c290 tx=0x7fc48c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9c0900d3b781db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:54.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.983+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498007d50 con 0x7fc48c004d40 2024-04-26T22:05:54.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.983+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc498005af0 con 0x7fc48c004d40 2024-04-26T22:05:54.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.983+0000 7fc4a5374640 1 -- 172.21.15.137:0/1532934091 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498007070 con 0x7fc48c004d40 2024-04-26T22:05:54.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.984+0000 7fc4a85da640 1 -- 172.21.15.137:0/1532934091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc48c004d40 msgr2=0x7fc48c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.984+0000 7fc4a85da640 1 --2- 172.21.15.137:0/1532934091 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc48c004d40 0x7fc48c0051c0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c290 tx=0x7fc48c005830 comp rx=0 tx=0).stop 2024-04-26T22:05:54.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.984+0000 7fc4a6b77640 1 -- 172.21.15.137:0/1532934091 reap_dead start 2024-04-26T22:05:54.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.984+0000 7fc4a85da640 1 -- 172.21.15.137:0/1532934091 shutdown_connections 2024-04-26T22:05:54.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.984+0000 7fc4a85da640 1 -- 172.21.15.137:0/1532934091 >> 172.21.15.137:0/1532934091 conn(0x7fc4a008ec10 msgr2=0x7fc4a009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.984+0000 7fc4a85da640 1 -- 172.21.15.137:0/1532934091 shutdown_connections 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.984+0000 7fc4a85da640 1 -- 172.21.15.137:0/1532934091 wait complete. 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.985+0000 7fc4a85da640 1 Processor -- start 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.985+0000 7fc4a85da640 1 -- start start 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.985+0000 7fc4a85da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c004d40 0x7fc4a00b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.985+0000 7fc4a85da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a01f88d0 0x7fc4a00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a85da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4a01f8d50 0x7fc4a00c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a85da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a00b47d0 con 0x7fc4a01f8d50 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a85da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a00d0f20 con 0x7fc48c004d40 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a85da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a00b4950 con 0x7fc4a01f88d0 2024-04-26T22:05:54.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6b77640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4a01f8d50 0x7fc4a00c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6b77640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4a01f8d50 0x7fc4a00c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:41670/0 (socket says 172.21.15.137:41670) 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6b77640 1 -- 172.21.15.137:0/3102186446 learned_addr learned my addr 172.21.15.137:0/3102186446 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6376640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c004d40 0x7fc4a00b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a5b75640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a01f88d0 0x7fc4a00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6b77640 1 -- 172.21.15.137:0/3102186446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a01f88d0 msgr2=0x7fc4a00cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6b77640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a01f88d0 0x7fc4a00cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6b77640 1 -- 172.21.15.137:0/3102186446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c004d40 msgr2=0x7fc4a00b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6b77640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c004d40 0x7fc4a00b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6b77640 1 -- 172.21.15.137:0/3102186446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a01f9470 con 0x7fc4a01f8d50 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a6b77640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4a01f8d50 0x7fc4a00c9eb0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c3b0 tx=0x7fc4a00d0b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc496ffd640 1 -- 172.21.15.137:0/3102186446 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498007d50 con 0x7fc4a01f8d50 2024-04-26T22:05:54.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc496ffd640 1 -- 172.21.15.137:0/3102186446 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc498044070 con 0x7fc4a01f8d50 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a0162640 con 0x7fc4a01f8d50 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc496ffd640 1 -- 172.21.15.137:0/3102186446 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498001c80 con 0x7fc4a01f8d50 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.986+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a00b2b10 con 0x7fc4a01f8d50 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.987+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a006a290 con 0x7fc4a01f8d50 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.988+0000 7fc496ffd640 1 -- 172.21.15.137:0/3102186446 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc49803e480 con 0x7fc4a01f8d50 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.988+0000 7fc496ffd640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc48406c920 0x7fc48406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.988+0000 7fc496ffd640 1 -- 172.21.15.137:0/3102186446 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5115+0+0 (secure 0 0 0) 0x7fc4980ac1b0 con 0x7fc4a01f8d50 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.988+0000 7fc4a6376640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc48406c920 0x7fc48406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.989+0000 7fc4a6376640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc48406c920 0x7fc48406ede0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0095c0 tx=0x7fc49c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:54.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:54.993+0000 7fc496ffd640 1 -- 172.21.15.137:0/3102186446 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc49807a150 con 0x7fc4a01f8d50 2024-04-26T22:05:55.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.235+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) -- 0x7fc4a00d20d0 con 0x7fc4a01f8d50 2024-04-26T22:05:55.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.554+0000 7fc496ffd640 1 -- 172.21.15.137:0/3102186446 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v347) ==== 167+0+0 (secure 0 0 0) 0x7fc49807e450 con 0x7fc4a01f8d50 2024-04-26T22:05:55.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.556+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc48406c920 msgr2=0x7fc48406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.556+0000 7fc4a85da640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc48406c920 0x7fc48406ede0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0095c0 tx=0x7fc49c00b040 comp rx=0 tx=0).stop 2024-04-26T22:05:55.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.556+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4a01f8d50 msgr2=0x7fc4a00c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.556+0000 7fc4a85da640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4a01f8d50 0x7fc4a00c9eb0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c3b0 tx=0x7fc4a00d0b30 comp rx=0 tx=0).stop 2024-04-26T22:05:55.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.557+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 shutdown_connections 2024-04-26T22:05:55.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.557+0000 7fc4a85da640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc48406c920 0x7fc48406ede0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.557+0000 7fc4a85da640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc4a01f8d50 0x7fc4a00c9eb0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.557+0000 7fc4a85da640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4a01f88d0 0x7fc4a00cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.557+0000 7fc4a85da640 1 --2- 172.21.15.137:0/3102186446 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc48c004d40 0x7fc4a00b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.557+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 >> 172.21.15.137:0/3102186446 conn(0x7fc4a008ec10 msgr2=0x7fc4a00d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:55.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.557+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 shutdown_connections 2024-04-26T22:05:55.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.557+0000 7fc4a85da640 1 -- 172.21.15.137:0/3102186446 wait complete. 2024-04-26T22:05:55.568 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-26T22:05:55.568 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-26T22:05:55.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:05:55.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.666+0000 7f009a42c640 1 Processor -- start 2024-04-26T22:05:55.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.666+0000 7f009a42c640 1 -- start start 2024-04-26T22:05:55.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f009a42c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f009413ff70 0x7f0094146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f009a42c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0094140350 0x7f00941465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f009a42c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00940d05b0 con 0x7f00940cf810 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f009a42c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f00940d0390 con 0x7f0094140350 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f009a42c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f00940d0890 con 0x7f009413ff70 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f0093fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f009413ff70 0x7f0094146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f00937fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0094140350 0x7f00941465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f00989c9640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f00940cf810 0x7f00940cfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:60946/0 (socket says 172.21.15.137:60946) 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f00989c9640 1 -- 172.21.15.137:0/2112149575 learned_addr learned my addr 172.21.15.137:0/2112149575 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f0093fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f009413ff70 0x7f0094146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:46742/0 (socket says 172.21.15.137:46742) 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f0093fff640 1 -- 172.21.15.137:0/2112149575 >> v2:172.21.15.170:3300/0 conn(0x7f0094140350 msgr2=0x7f00941465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f0093fff640 1 --2- 172.21.15.137:0/2112149575 >> v2:172.21.15.170:3300/0 conn(0x7f0094140350 0x7f00941465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f0093fff640 1 -- 172.21.15.137:0/2112149575 >> v1:172.21.15.170:6789/0 conn(0x7f00940cf810 legacy=0x7f00940cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f0093fff640 1 -- 172.21.15.137:0/2112149575 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009406e450 con 0x7f009413ff70 2024-04-26T22:05:55.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.667+0000 7f00937fe640 1 --2- 172.21.15.137:0/2112149575 >> v2:172.21.15.170:3300/0 conn(0x7f0094140350 0x7f00941465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:05:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.668+0000 7f0093fff640 1 --2- 172.21.15.137:0/2112149575 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f009413ff70 0x7f0094146080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00880097a0 tx=0x7f008802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae83eced7462c55a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.668+0000 7f0092ffd640 1 -- 172.21.15.137:0/2112149575 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088037070 con 0x7f009413ff70 2024-04-26T22:05:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.668+0000 7f0092ffd640 1 -- 172.21.15.137:0/2112149575 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008802ae50 con 0x7f009413ff70 2024-04-26T22:05:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.668+0000 7f0092ffd640 1 -- 172.21.15.137:0/2112149575 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088032660 con 0x7f009413ff70 2024-04-26T22:05:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.669+0000 7f009a42c640 1 -- 172.21.15.137:0/2112149575 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f009413ff70 msgr2=0x7f0094146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.669+0000 7f009a42c640 1 --2- 172.21.15.137:0/2112149575 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f009413ff70 0x7f0094146080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f00880097a0 tx=0x7f008802a100 comp rx=0 tx=0).stop 2024-04-26T22:05:55.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.669+0000 7f009a42c640 1 -- 172.21.15.137:0/2112149575 shutdown_connections 2024-04-26T22:05:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.669+0000 7f009a42c640 1 --2- 172.21.15.137:0/2112149575 >> v2:172.21.15.170:3300/0 conn(0x7f0094140350 0x7f00941465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.669+0000 7f009a42c640 1 --2- 172.21.15.137:0/2112149575 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f009413ff70 0x7f0094146080 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.669+0000 7f009a42c640 1 -- 172.21.15.137:0/2112149575 >> 172.21.15.137:0/2112149575 conn(0x7f00940d0d30 msgr2=0x7f00940d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.669+0000 7f009a42c640 1 -- 172.21.15.137:0/2112149575 shutdown_connections 2024-04-26T22:05:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.669+0000 7f009a42c640 1 -- 172.21.15.137:0/2112149575 wait complete. 2024-04-26T22:05:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.670+0000 7f009a42c640 1 Processor -- start 2024-04-26T22:05:55.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.670+0000 7f009a42c640 1 -- start start 2024-04-26T22:05:55.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f009a42c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00940cf810 0x7f009415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f009a42c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f009413ff70 0x7f00941f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f009a42c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0094140350 0x7f009415f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f009a42c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f009406edd0 con 0x7f009413ff70 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f009a42c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f009406ec50 con 0x7f0094140350 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f009a42c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f009406ef50 con 0x7f00940cf810 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00937fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f009413ff70 0x7f00941f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00937fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f009413ff70 0x7f00941f2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49456/0 (socket says 172.21.15.137:49456) 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00937fe640 1 -- 172.21.15.137:0/1879395088 learned_addr learned my addr 172.21.15.137:0/1879395088 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f0093fff640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00940cf810 0x7f009415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00989c9640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0094140350 0x7f009415f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00937fe640 1 -- 172.21.15.137:0/1879395088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00940cf810 msgr2=0x7f009415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00937fe640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00940cf810 0x7f009415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00937fe640 1 -- 172.21.15.137:0/1879395088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0094140350 msgr2=0x7f009415f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00937fe640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0094140350 0x7f009415f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00937fe640 1 -- 172.21.15.137:0/1879395088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009413c7e0 con 0x7f009413ff70 2024-04-26T22:05:55.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.671+0000 7f00937fe640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f009413ff70 0x7f00941f2db0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f008400e960 tx=0x7f008400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.672+0000 7f0090ff9640 1 -- 172.21.15.137:0/1879395088 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084017070 con 0x7f009413ff70 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.672+0000 7f0090ff9640 1 -- 172.21.15.137:0/1879395088 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008400c9a0 con 0x7f009413ff70 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.672+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f009413cac0 con 0x7f009413ff70 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.672+0000 7f0090ff9640 1 -- 172.21.15.137:0/1879395088 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008400cd70 con 0x7f009413ff70 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.672+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f009413d080 con 0x7f009413ff70 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.673+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f009406a290 con 0x7f009413ff70 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.673+0000 7f0090ff9640 1 -- 172.21.15.137:0/1879395088 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f008401a070 con 0x7f009413ff70 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.673+0000 7f0090ff9640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f008006c920 0x7f008006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.674+0000 7f0090ff9640 1 -- 172.21.15.137:0/1879395088 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5115+0+0 (secure 0 0 0) 0x7f008408b9f0 con 0x7f009413ff70 2024-04-26T22:05:55.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.674+0000 7f0093fff640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f008006c920 0x7f008006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.674+0000 7f0093fff640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f008006c920 0x7f008006ede0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0088034000 tx=0x7f008802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:55.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.678+0000 7f0090ff9640 1 -- 172.21.15.137:0/1879395088 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0084059a20 con 0x7f009413ff70 2024-04-26T22:05:55.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.855+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00940b45e0 con 0x7f009413ff70 2024-04-26T22:05:55.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.856+0000 7f0090ff9640 1 -- 172.21.15.137:0/1879395088 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+13297 (secure 0 0 0) 0x7f008405dd20 con 0x7f009413ff70 2024-04-26T22:05:55.856 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:55.856 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":94,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:05:54.543906+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/4231448082":"2024-04-27T22:05:51.536389+0000","172.21.15.137:6837/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.137:6835/2128712520":"2024-04-27T22:05:08.380367+0000","172.21.15.170:6835/865192507":"2024-04-27T22:04:27.224170+0000","172.21.15.137:6835/4231448082":"2024-04-27T22:05:51.536389+0000","172.21.15.170:6833/865192507":"2024-04-27T22:04:27.224170+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:05:55.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f008006c920 msgr2=0x7f008006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f008006c920 0x7f008006ede0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0088034000 tx=0x7f008802e000 comp rx=0 tx=0).stop 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f009413ff70 msgr2=0x7f00941f2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f009413ff70 0x7f00941f2db0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f008400e960 tx=0x7f008400ee20 comp rx=0 tx=0).stop 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 shutdown_connections 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f008006c920 0x7f008006ede0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f009413ff70 0x7f00941f2db0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0094140350 0x7f009415f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 --2- 172.21.15.137:0/1879395088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f00940cf810 0x7f009415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 >> 172.21.15.137:0/1879395088 conn(0x7f00940d0d30 msgr2=0x7f00940b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 shutdown_connections 2024-04-26T22:05:55.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.858+0000 7f009a42c640 1 -- 172.21.15.137:0/1879395088 wait complete. 2024-04-26T22:05:55.869 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:05:55.870 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:05:55.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.970+0000 7f15200cf640 1 Processor -- start 2024-04-26T22:05:55.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.970+0000 7f15200cf640 1 -- start start 2024-04-26T22:05:55.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f15200cf640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f151806f340 0x7f15180b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f15200cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15180d0300 0x7f151806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f15200cf640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151806fc60 con 0x7f15180b3e50 2024-04-26T22:05:55.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f15200cf640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f15180b46a0 con 0x7f151806f340 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f15200cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f15180b5db0 con 0x7f15180d0300 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f151de6b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f151806f340 0x7f15180b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f151d66a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15180d0300 0x7f151806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f151e66c640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f15180b3e50 0x7f15180720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:60952/0 (socket says 172.21.15.137:60952) 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f151e66c640 1 -- 172.21.15.137:0/258901777 learned_addr learned my addr 172.21.15.137:0/258901777 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f151de6b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f151806f340 0x7f15180b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:44294/0 (socket says 172.21.15.137:44294) 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f151de6b640 1 -- 172.21.15.137:0/258901777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15180d0300 msgr2=0x7f151806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f151de6b640 1 --2- 172.21.15.137:0/258901777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15180d0300 0x7f151806f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f151de6b640 1 -- 172.21.15.137:0/258901777 >> v1:172.21.15.170:6789/0 conn(0x7f15180b3e50 legacy=0x7f15180720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.971+0000 7f151de6b640 1 -- 172.21.15.137:0/258901777 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15180b6090 con 0x7f151806f340 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.972+0000 7f151de6b640 1 --2- 172.21.15.137:0/258901777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151806f340 0x7f15180b6b70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f15140097a0 tx=0x7f151402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caccc5656837605a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.972+0000 7f151ce69640 1 -- 172.21.15.137:0/258901777 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514037070 con 0x7f151806f340 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.972+0000 7f151ce69640 1 -- 172.21.15.137:0/258901777 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f151402adb0 con 0x7f151806f340 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.972+0000 7f151ce69640 1 -- 172.21.15.137:0/258901777 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514032660 con 0x7f151806f340 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.973+0000 7f15200cf640 1 -- 172.21.15.137:0/258901777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151806f340 msgr2=0x7f15180b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.973+0000 7f15200cf640 1 --2- 172.21.15.137:0/258901777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151806f340 0x7f15180b6b70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f15140097a0 tx=0x7f151402a060 comp rx=0 tx=0).stop 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.973+0000 7f15200cf640 1 -- 172.21.15.137:0/258901777 shutdown_connections 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.973+0000 7f15200cf640 1 --2- 172.21.15.137:0/258901777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15180d0300 0x7f151806f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.973+0000 7f15200cf640 1 --2- 172.21.15.137:0/258901777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f151806f340 0x7f15180b6b70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.973+0000 7f15200cf640 1 -- 172.21.15.137:0/258901777 >> 172.21.15.137:0/258901777 conn(0x7f15180cd8a0 msgr2=0x7f15180cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:55.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.973+0000 7f15200cf640 1 -- 172.21.15.137:0/258901777 shutdown_connections 2024-04-26T22:05:55.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.973+0000 7f15200cf640 1 -- 172.21.15.137:0/258901777 wait complete. 2024-04-26T22:05:55.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.974+0000 7f15200cf640 1 Processor -- start 2024-04-26T22:05:55.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.974+0000 7f15200cf640 1 -- start start 2024-04-26T22:05:55.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f15200cf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151806f340 0x7f1518139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f15200cf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15180b3e50 0x7f151813c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f15200cf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15180d0300 0x7f151813c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f15200cf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15180b42e0 con 0x7f15180b3e50 2024-04-26T22:05:55.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f15200cf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f15180b6650 con 0x7f15180d0300 2024-04-26T22:05:55.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f15200cf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f15180b4460 con 0x7f151806f340 2024-04-26T22:05:55.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151d66a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15180b3e50 0x7f151813c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151d66a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15180b3e50 0x7f151813c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49466/0 (socket says 172.21.15.137:49466) 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151d66a640 1 -- 172.21.15.137:0/671758499 learned_addr learned my addr 172.21.15.137:0/671758499 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151e66c640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15180d0300 0x7f151813c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151de6b640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151806f340 0x7f1518139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151d66a640 1 -- 172.21.15.137:0/671758499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151806f340 msgr2=0x7f1518139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151d66a640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151806f340 0x7f1518139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151d66a640 1 -- 172.21.15.137:0/671758499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15180d0300 msgr2=0x7f151813c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151d66a640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15180d0300 0x7f151813c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151d66a640 1 -- 172.21.15.137:0/671758499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151813fc20 con 0x7f15180b3e50 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151de6b640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151806f340 0x7f1518139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.975+0000 7f151d66a640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15180b3e50 0x7f151813c420 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f150800e870 tx=0x7f150800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.976+0000 7f150e7fc640 1 -- 172.21.15.137:0/671758499 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1508017070 con 0x7f15180b3e50 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.976+0000 7f150e7fc640 1 -- 172.21.15.137:0/671758499 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150800c940 con 0x7f15180b3e50 2024-04-26T22:05:55.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.976+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151813ff00 con 0x7f15180b3e50 2024-04-26T22:05:55.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.976+0000 7f150e7fc640 1 -- 172.21.15.137:0/671758499 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150800cd30 con 0x7f15180b3e50 2024-04-26T22:05:55.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.976+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1518139c50 con 0x7f15180b3e50 2024-04-26T22:05:55.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.977+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15181400d0 con 0x7f15180b3e50 2024-04-26T22:05:55.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.977+0000 7f150e7fc640 1 -- 172.21.15.137:0/671758499 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f150801a070 con 0x7f15180b3e50 2024-04-26T22:05:55.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.978+0000 7f150e7fc640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14fc06c8f0 0x7f14fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:55.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.978+0000 7f151de6b640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14fc06c8f0 0x7f14fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:55.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.978+0000 7f150e7fc640 1 -- 172.21.15.137:0/671758499 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5115+0+0 (secure 0 0 0) 0x7f150808bb60 con 0x7f15180b3e50 2024-04-26T22:05:55.980 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.978+0000 7f151de6b640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14fc06c8f0 0x7f14fc06edb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1514034000 tx=0x7f151402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:55.982 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:55.982+0000 7f150e7fc640 1 -- 172.21.15.137:0/671758499 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f1508059b10 con 0x7f15180b3e50 2024-04-26T22:05:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.157+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f151806a290 con 0x7f15180b3e50 2024-04-26T22:05:56.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.157+0000 7f150e7fc640 1 -- 172.21.15.137:0/671758499 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f150805de10 con 0x7f15180b3e50 2024-04-26T22:05:56.157 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:05:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14fc06c8f0 msgr2=0x7f14fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14fc06c8f0 0x7f14fc06edb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1514034000 tx=0x7f151402e000 comp rx=0 tx=0).stop 2024-04-26T22:05:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15180b3e50 msgr2=0x7f151813c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15180b3e50 0x7f151813c420 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f150800e870 tx=0x7f150800ed30 comp rx=0 tx=0).stop 2024-04-26T22:05:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 shutdown_connections 2024-04-26T22:05:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f14fc06c8f0 0x7f14fc06edb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15180b3e50 0x7f151813c420 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15180d0300 0x7f151813c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 --2- 172.21.15.137:0/671758499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f151806f340 0x7f1518139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 >> 172.21.15.137:0/671758499 conn(0x7f15180cd8a0 msgr2=0x7f151815eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:56.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 shutdown_connections 2024-04-26T22:05:56.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.159+0000 7f15200cf640 1 -- 172.21.15.137:0/671758499 wait complete. 2024-04-26T22:05:56.170 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-26T22:05:56.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.267+0000 7f4e94247640 1 Processor -- start 2024-04-26T22:05:56.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.267+0000 7f4e94247640 1 -- start start 2024-04-26T22:05:56.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.268+0000 7f4e94247640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0d3ee0 0x7f4e8c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.268+0000 7f4e94247640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e8c0d03a0 con 0x7f4e8c15f370 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.268+0000 7f4e94247640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e8c0d0680 con 0x7f4e8c15f750 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.268+0000 7f4e94247640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c0d0960 con 0x7f4e8c0d3ee0 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.268+0000 7f4e91fe3640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4e8c15f370 0x7f4e8c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40376/0 (socket says 172.21.15.137:40376) 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.268+0000 7f4e91fe3640 1 -- 172.21.15.137:0/163953473 learned_addr learned my addr 172.21.15.137:0/163953473 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.269+0000 7f4e917e2640 1 --2- 172.21.15.137:0/163953473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0d3ee0 0x7f4e8c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.269+0000 7f4e90fe1640 1 -- 172.21.15.137:0/163953473 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1824961087 0 0) 0x7f4e8c0d03a0 con 0x7f4e8c15f370 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.269+0000 7f4e90fe1640 1 -- 172.21.15.137:0/163953473 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e78003520 con 0x7f4e8c15f370 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.269+0000 7f4e90fe1640 1 -- 172.21.15.137:0/163953473 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260577835 0 0) 0x7f4e8c0d0680 con 0x7f4e8c15f750 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.269+0000 7f4e90fe1640 1 -- 172.21.15.137:0/163953473 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e8c0d03a0 con 0x7f4e8c15f750 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.269+0000 7f4e917e2640 1 -- 172.21.15.137:0/163953473 >> v1:172.21.15.170:6789/0 conn(0x7f4e8c15f750 legacy=0x7f4e8c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.269+0000 7f4e90fe1640 1 -- 172.21.15.137:0/163953473 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 45623545 0 0) 0x7f4e78003520 con 0x7f4e8c15f370 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.269+0000 7f4e917e2640 1 -- 172.21.15.137:0/163953473 >> v1:172.21.15.137:6789/0 conn(0x7f4e8c15f370 legacy=0x7f4e8c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.269+0000 7f4e917e2640 1 -- 172.21.15.137:0/163953473 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c0d0c40 con 0x7f4e8c0d3ee0 2024-04-26T22:05:56.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.270+0000 7f4e917e2640 1 --2- 172.21.15.137:0/163953473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0d3ee0 0x7f4e8c0cfd70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0097d0 tx=0x7f4e7c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bbe21afd0343194 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:56.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.270+0000 7f4e90fe1640 1 -- 172.21.15.137:0/163953473 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c037070 con 0x7f4e8c0d3ee0 2024-04-26T22:05:56.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.270+0000 7f4e90fe1640 1 -- 172.21.15.137:0/163953473 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c02ac30 con 0x7f4e8c0d3ee0 2024-04-26T22:05:56.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.270+0000 7f4e90fe1640 1 -- 172.21.15.137:0/163953473 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e880019f0 con 0x7f4e8c0d3ee0 2024-04-26T22:05:56.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.270+0000 7f4e94247640 1 -- 172.21.15.137:0/163953473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0d3ee0 msgr2=0x7f4e8c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.270+0000 7f4e94247640 1 --2- 172.21.15.137:0/163953473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0d3ee0 0x7f4e8c0cfd70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0097d0 tx=0x7f4e7c02a1a0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.270+0000 7f4e94247640 1 -- 172.21.15.137:0/163953473 shutdown_connections 2024-04-26T22:05:56.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.270+0000 7f4e94247640 1 --2- 172.21.15.137:0/163953473 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0d3ee0 0x7f4e8c0cfd70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.270+0000 7f4e94247640 1 -- 172.21.15.137:0/163953473 >> 172.21.15.137:0/163953473 conn(0x7f4e8c08ec10 msgr2=0x7f4e8c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.271+0000 7f4e94247640 1 -- 172.21.15.137:0/163953473 shutdown_connections 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.271+0000 7f4e94247640 1 -- 172.21.15.137:0/163953473 wait complete. 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.272+0000 7f4e94247640 1 Processor -- start 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.272+0000 7f4e94247640 1 -- start start 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.272+0000 7f4e94247640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c0d3ee0 0x7f4e8c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.272+0000 7f4e94247640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f370 0x7f4e8c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.272+0000 7f4e94247640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15f750 0x7f4e8c0b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.272+0000 7f4e94247640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0b4950 con 0x7f4e8c15f750 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.272+0000 7f4e94247640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0b47d0 con 0x7f4e8c0d3ee0 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.272+0000 7f4e94247640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c0b4ad0 con 0x7f4e8c15f370 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.272+0000 7f4e927e4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15f750 0x7f4e8c0b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e927e4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15f750 0x7f4e8c0b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49478/0 (socket says 172.21.15.137:49478) 2024-04-26T22:05:56.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e927e4640 1 -- 172.21.15.137:0/2700520277 learned_addr learned my addr 172.21.15.137:0/2700520277 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e917e2640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f370 0x7f4e8c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e91fe3640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c0d3ee0 0x7f4e8c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e927e4640 1 -- 172.21.15.137:0/2700520277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f370 msgr2=0x7f4e8c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e927e4640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f370 0x7f4e8c0cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e927e4640 1 -- 172.21.15.137:0/2700520277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c0d3ee0 msgr2=0x7f4e8c15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e927e4640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c0d3ee0 0x7f4e8c15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e927e4640 1 -- 172.21.15.137:0/2700520277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c1f8780 con 0x7f4e8c15f750 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e927e4640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15f750 0x7f4e8c0b51c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f4e84001eb0 tx=0x7f4e8400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e827fc640 1 -- 172.21.15.137:0/2700520277 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84017070 con 0x7f4e8c15f750 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e827fc640 1 -- 172.21.15.137:0/2700520277 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e840052d0 con 0x7f4e8c15f750 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8c1f8a60 con 0x7f4e8c15f750 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e827fc640 1 -- 172.21.15.137:0/2700520277 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e840037f0 con 0x7f4e8c15f750 2024-04-26T22:05:56.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.273+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e8c1f9020 con 0x7f4e8c15f750 2024-04-26T22:05:56.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.274+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e8c06a290 con 0x7f4e8c15f750 2024-04-26T22:05:56.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.275+0000 7f4e827fc640 1 -- 172.21.15.137:0/2700520277 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e8401a070 con 0x7f4e8c15f750 2024-04-26T22:05:56.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.275+0000 7f4e827fc640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7006c920 0x7f4e7006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.276 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.275+0000 7f4e827fc640 1 -- 172.21.15.137:0/2700520277 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5115+0+0 (secure 0 0 0) 0x7f4e8408aad0 con 0x7f4e8c15f750 2024-04-26T22:05:56.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.275+0000 7f4e91fe3640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7006c920 0x7f4e7006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.277 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.276+0000 7f4e91fe3640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7006c920 0x7f4e7006ede0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4e880016c0 tx=0x7f4e88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:56.279 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.279+0000 7f4e827fc640 1 -- 172.21.15.137:0/2700520277 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4e84058b10 con 0x7f4e8c15f750 2024-04-26T22:05:56.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.520+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f4e8c06d260 con 0x7f4e8c15f750 2024-04-26T22:05:56.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.556+0000 7f4e827fc640 1 -- 172.21.15.137:0/2700520277 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v348) ==== 149+0+0 (secure 0 0 0) 0x7f4e8405ce10 con 0x7f4e8c15f750 2024-04-26T22:05:56.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7006c920 msgr2=0x7f4e7006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7006c920 0x7f4e7006ede0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4e880016c0 tx=0x7f4e88009040 comp rx=0 tx=0).stop 2024-04-26T22:05:56.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15f750 msgr2=0x7f4e8c0b51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15f750 0x7f4e8c0b51c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f4e84001eb0 tx=0x7f4e8400c820 comp rx=0 tx=0).stop 2024-04-26T22:05:56.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 shutdown_connections 2024-04-26T22:05:56.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7006c920 0x7f4e7006ede0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15f750 0x7f4e8c0b51c0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f370 0x7f4e8c0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 --2- 172.21.15.137:0/2700520277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c0d3ee0 0x7f4e8c15d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 >> 172.21.15.137:0/2700520277 conn(0x7f4e8c08ec10 msgr2=0x7f4e8c0d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:56.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 shutdown_connections 2024-04-26T22:05:56.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.558+0000 7f4e94247640 1 -- 172.21.15.137:0/2700520277 wait complete. 2024-04-26T22:05:56.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T22:05:56.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.669+0000 7f4bf3064640 1 Processor -- start 2024-04-26T22:05:56.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.669+0000 7f4bf3064640 1 -- start start 2024-04-26T22:05:56.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.670+0000 7f4bf3064640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec0afe10 0x7f4bec0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.670+0000 7f4bf3064640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4bec15d4c0 0x7f4bec0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.670+0000 7f4bf3064640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bec074430 con 0x7f4bec069ae0 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.670+0000 7f4bf3064640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4bec0746f0 con 0x7f4bec15d4c0 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.670+0000 7f4bf3064640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4bec0ae140 con 0x7f4bec0afe10 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.670+0000 7f4bf0e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec0afe10 0x7f4bec0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.670+0000 7f4bebfff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4bec15d4c0 0x7f4bec0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.670+0000 7f4bf0e00640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec0afe10 0x7f4bec0cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:46798/0 (socket says 172.21.15.137:46798) 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.670+0000 7f4bf0e00640 1 -- 172.21.15.137:0/1812955077 learned_addr learned my addr 172.21.15.137:0/1812955077 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.671+0000 7f4bf0e00640 1 -- 172.21.15.137:0/1812955077 >> v2:172.21.15.170:3300/0 conn(0x7f4bec15d4c0 msgr2=0x7f4bec0b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.671+0000 7f4bf0e00640 1 --2- 172.21.15.137:0/1812955077 >> v2:172.21.15.170:3300/0 conn(0x7f4bec15d4c0 0x7f4bec0b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.671+0000 7f4bf0e00640 1 -- 172.21.15.137:0/1812955077 >> v1:172.21.15.170:6789/0 conn(0x7f4bec069ae0 legacy=0x7f4bec0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.671+0000 7f4bf0e00640 1 -- 172.21.15.137:0/1812955077 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bec0ae420 con 0x7f4bec0afe10 2024-04-26T22:05:56.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.671+0000 7f4bf0e00640 1 --2- 172.21.15.137:0/1812955077 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec0afe10 0x7f4bec0cdbc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009e50 tx=0x7f4be002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abe4ddaa4d98cea6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:56.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4beb7fe640 1 -- 172.21.15.137:0/1812955077 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be0036070 con 0x7f4bec0afe10 2024-04-26T22:05:56.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4beb7fe640 1 -- 172.21.15.137:0/1812955077 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be0031600 con 0x7f4bec0afe10 2024-04-26T22:05:56.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4beb7fe640 1 -- 172.21.15.137:0/1812955077 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be00319d0 con 0x7f4bec0afe10 2024-04-26T22:05:56.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4bf3064640 1 -- 172.21.15.137:0/1812955077 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec0afe10 msgr2=0x7f4bec0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4bf3064640 1 --2- 172.21.15.137:0/1812955077 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec0afe10 0x7f4bec0cdbc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4be0009e50 tx=0x7f4be002a710 comp rx=0 tx=0).stop 2024-04-26T22:05:56.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4bf3064640 1 -- 172.21.15.137:0/1812955077 shutdown_connections 2024-04-26T22:05:56.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4bf3064640 1 --2- 172.21.15.137:0/1812955077 >> v2:172.21.15.170:3300/0 conn(0x7f4bec15d4c0 0x7f4bec0b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4bf3064640 1 --2- 172.21.15.137:0/1812955077 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec0afe10 0x7f4bec0cdbc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4bf3064640 1 -- 172.21.15.137:0/1812955077 >> 172.21.15.137:0/1812955077 conn(0x7f4bec073910 msgr2=0x7f4bec073d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:56.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4bf3064640 1 -- 172.21.15.137:0/1812955077 shutdown_connections 2024-04-26T22:05:56.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.672+0000 7f4bf3064640 1 -- 172.21.15.137:0/1812955077 wait complete. 2024-04-26T22:05:56.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.673+0000 7f4bf3064640 1 Processor -- start 2024-04-26T22:05:56.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.673+0000 7f4bf3064640 1 -- start start 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.674+0000 7f4bf3064640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bec069ae0 0x7f4bec09ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.674+0000 7f4bf3064640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bec0afe10 0x7f4bec141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.674+0000 7f4bf3064640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec15d4c0 0x7f4bec1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.674+0000 7f4bf3064640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4bec06f8e0 con 0x7f4bec0afe10 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.674+0000 7f4bf3064640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4bec0d1140 con 0x7f4bec069ae0 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.674+0000 7f4bf3064640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4bec0ce100 con 0x7f4bec15d4c0 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.674+0000 7f4bebfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bec0afe10 0x7f4bec141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.674+0000 7f4bebfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bec0afe10 0x7f4bec141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49488/0 (socket says 172.21.15.137:49488) 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.674+0000 7f4bebfff640 1 -- 172.21.15.137:0/1176980697 learned_addr learned my addr 172.21.15.137:0/1176980697 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bf1601640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec15d4c0 0x7f4bec1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bf0e00640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bec069ae0 0x7f4bec09ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bebfff640 1 -- 172.21.15.137:0/1176980697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec15d4c0 msgr2=0x7f4bec1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bebfff640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec15d4c0 0x7f4bec1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bebfff640 1 -- 172.21.15.137:0/1176980697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bec069ae0 msgr2=0x7f4bec09ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bebfff640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bec069ae0 0x7f4bec09ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bebfff640 1 -- 172.21.15.137:0/1176980697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bec14f1d0 con 0x7f4bec0afe10 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bf0e00640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bec069ae0 0x7f4bec09ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bebfff640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bec0afe10 0x7f4bec141fa0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800e9b0 tx=0x7f4bd800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4be97fa640 1 -- 172.21.15.137:0/1176980697 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8017070 con 0x7f4bec0afe10 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4be97fa640 1 -- 172.21.15.137:0/1176980697 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd800c9a0 con 0x7f4bec0afe10 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bec15eb00 con 0x7f4bec0afe10 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4be97fa640 1 -- 172.21.15.137:0/1176980697 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd800cd90 con 0x7f4bec0afe10 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.675+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bec15f0c0 con 0x7f4bec0afe10 2024-04-26T22:05:56.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.676+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bec06a290 con 0x7f4bec0afe10 2024-04-26T22:05:56.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.676+0000 7f4be97fa640 1 -- 172.21.15.137:0/1176980697 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4bd801a070 con 0x7f4bec0afe10 2024-04-26T22:05:56.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.677+0000 7f4be97fa640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd006c920 0x7f4bd006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:56.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.677+0000 7f4be97fa640 1 -- 172.21.15.137:0/1176980697 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5115+0+0 (secure 0 0 0) 0x7f4bd808bbe0 con 0x7f4bec0afe10 2024-04-26T22:05:56.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.677+0000 7f4bf0e00640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd006c920 0x7f4bd006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:56.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.677+0000 7f4bf0e00640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd006c920 0x7f4bd006ede0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4be0033000 tx=0x7f4be0009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:56.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.681+0000 7f4be97fa640 1 -- 172.21.15.137:0/1176980697 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4bd8059c10 con 0x7f4bec0afe10 2024-04-26T22:05:56.861 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.861+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4bec09f1c0 con 0x7f4bec0afe10 2024-04-26T22:05:56.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.864+0000 7f4be97fa640 1 -- 172.21.15.137:0/1176980697 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f4bd805df10 con 0x7f4bec0afe10 2024-04-26T22:05:56.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd006c920 msgr2=0x7f4bd006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd006c920 0x7f4bd006ede0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4be0033000 tx=0x7f4be0009000 comp rx=0 tx=0).stop 2024-04-26T22:05:56.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bec0afe10 msgr2=0x7f4bec141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:56.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bec0afe10 0x7f4bec141fa0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800e9b0 tx=0x7f4bd800ee70 comp rx=0 tx=0).stop 2024-04-26T22:05:56.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 shutdown_connections 2024-04-26T22:05:56.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd006c920 0x7f4bd006ede0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bec0afe10 0x7f4bec141fa0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bec15d4c0 0x7f4bec1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 --2- 172.21.15.137:0/1176980697 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4bec069ae0 0x7f4bec09ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:56.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 >> 172.21.15.137:0/1176980697 conn(0x7f4bec073910 msgr2=0x7f4bec06e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:56.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 shutdown_connections 2024-04-26T22:05:56.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:56.866+0000 7f4bf3064640 1 -- 172.21.15.137:0/1176980697 wait complete. 2024-04-26T22:05:56.877 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:05:56.878 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:05:56.914 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:05:56.965 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:05:56.966 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:05:56.966 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:56.981 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:05:56.981 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:05:56.981 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:56.999 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:05:56.999 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:05:56.999 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:57.036 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:05:57.036 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:05:57.037 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:05:57.056 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:05:57.056 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T22:05:57.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:05:57.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.173+0000 7fb17d7e7640 1 Processor -- start 2024-04-26T22:05:57.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.173+0000 7fb17d7e7640 1 -- start start 2024-04-26T22:05:57.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb17d7e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1780d3ee0 0x7fb1780cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb17d7e7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb17815f750 0x7fb1780b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb17d7e7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1780d03a0 con 0x7fb17815f370 2024-04-26T22:05:57.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb17d7e7640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb1780b4d10 con 0x7fb17815f750 2024-04-26T22:05:57.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb17d7e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb1780d0680 con 0x7fb1780d3ee0 2024-04-26T22:05:57.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb1777fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb17815f750 0x7fb1780b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb1777fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb17815f750 0x7fb1780b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49498/0 (socket says 172.21.15.137:49498) 2024-04-26T22:05:57.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb1777fe640 1 -- 172.21.15.137:0/652238373 learned_addr learned my addr 172.21.15.137:0/652238373 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:57.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb1777fe640 1 -- 172.21.15.137:0/652238373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1780d3ee0 msgr2=0x7fb1780cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:57.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb1777fe640 1 --2- 172.21.15.137:0/652238373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1780d3ee0 0x7fb1780cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb1777fe640 1 -- 172.21.15.137:0/652238373 >> v1:172.21.15.137:6789/0 conn(0x7fb17815f370 legacy=0x7fb1780d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb1777fe640 1 -- 172.21.15.137:0/652238373 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1780d0960 con 0x7fb17815f750 2024-04-26T22:05:57.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.174+0000 7fb1767fc640 1 -- 172.21.15.137:0/652238373 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970522190 0 0) 0x7fb1780d03a0 con 0x7fb17815f370 2024-04-26T22:05:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.175+0000 7fb1777fe640 1 --2- 172.21.15.137:0/652238373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 0x7fb1780b47d0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fb170009e50 tx=0x7fb17002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8addac95939255f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.175+0000 7fb1767fc640 1 -- 172.21.15.137:0/652238373 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170036070 con 0x7fb17815f750 2024-04-26T22:05:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.175+0000 7fb1767fc640 1 -- 172.21.15.137:0/652238373 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb170031600 con 0x7fb17815f750 2024-04-26T22:05:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.175+0000 7fb1767fc640 1 -- 172.21.15.137:0/652238373 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1700319d0 con 0x7fb17815f750 2024-04-26T22:05:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.176+0000 7fb17d7e7640 1 -- 172.21.15.137:0/652238373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 msgr2=0x7fb1780b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.176+0000 7fb17d7e7640 1 --2- 172.21.15.137:0/652238373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 0x7fb1780b47d0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fb170009e50 tx=0x7fb17002a710 comp rx=0 tx=0).stop 2024-04-26T22:05:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.176+0000 7fb17d7e7640 1 -- 172.21.15.137:0/652238373 shutdown_connections 2024-04-26T22:05:57.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.176+0000 7fb17d7e7640 1 --2- 172.21.15.137:0/652238373 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 0x7fb1780b47d0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.176+0000 7fb17d7e7640 1 --2- 172.21.15.137:0/652238373 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1780d3ee0 0x7fb1780cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.176+0000 7fb17d7e7640 1 -- 172.21.15.137:0/652238373 >> 172.21.15.137:0/652238373 conn(0x7fb17808ec10 msgr2=0x7fb17809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.176+0000 7fb17d7e7640 1 -- 172.21.15.137:0/652238373 shutdown_connections 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.176+0000 7fb17d7e7640 1 -- 172.21.15.137:0/652238373 wait complete. 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.177+0000 7fb17d7e7640 1 Processor -- start 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.177+0000 7fb17d7e7640 1 -- start start 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.177+0000 7fb17d7e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1780d3ee0 0x7fb1780cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.177+0000 7fb17d7e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17815f370 0x7fb1780b9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.177+0000 7fb17d7e7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 0x7fb1780cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb17d7e7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb1780b51c0 con 0x7fb17815f750 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb17d7e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb1780d0f20 con 0x7fb17815f370 2024-04-26T22:05:57.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb17d7e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb1780b5340 con 0x7fb1780d3ee0 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb1777fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 0x7fb1780cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb1777fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 0x7fb1780cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49502/0 (socket says 172.21.15.137:49502) 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb1777fe640 1 -- 172.21.15.137:0/955624491 learned_addr learned my addr 172.21.15.137:0/955624491 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb1777fe640 1 -- 172.21.15.137:0/955624491 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1780d3ee0 msgr2=0x7fb1780cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb1777fe640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1780d3ee0 0x7fb1780cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb1777fe640 1 -- 172.21.15.137:0/955624491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17815f370 msgr2=0x7fb1780b9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb16ffff640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17815f370 0x7fb1780b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb1777fe640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17815f370 0x7fb1780b9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb1777fe640 1 -- 172.21.15.137:0/955624491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1780c93a0 con 0x7fb17815f750 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb1777fe640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 0x7fb1780cc2c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fb170009e50 tx=0x7fb170004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb16f7fe640 1 -- 172.21.15.137:0/955624491 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170036040 con 0x7fb17815f750 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb16f7fe640 1 -- 172.21.15.137:0/955624491 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb170003990 con 0x7fb17815f750 2024-04-26T22:05:57.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1780ba310 con 0x7fb17815f750 2024-04-26T22:05:57.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb16f7fe640 1 -- 172.21.15.137:0/955624491 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170003da0 con 0x7fb17815f750 2024-04-26T22:05:57.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.178+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1780c9660 con 0x7fb17815f750 2024-04-26T22:05:57.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.179+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1780ba830 con 0x7fb17815f750 2024-04-26T22:05:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.180+0000 7fb16f7fe640 1 -- 172.21.15.137:0/955624491 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb17003c650 con 0x7fb17815f750 2024-04-26T22:05:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.180+0000 7fb16f7fe640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb15806c8f0 0x7fb15806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.180+0000 7fb16f7fe640 1 -- 172.21.15.137:0/955624491 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5115+0+0 (secure 0 0 0) 0x7fb1700ac350 con 0x7fb17815f750 2024-04-26T22:05:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.180+0000 7fb176ffd640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb15806c8f0 0x7fb15806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.181+0000 7fb176ffd640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb15806c8f0 0x7fb15806edb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb168001600 tx=0x7fb168007910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:57.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.185+0000 7fb16f7fe640 1 -- 172.21.15.137:0/955624491 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb17004a070 con 0x7fb17815f750 2024-04-26T22:05:57.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.396+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb17806a290 con 0x7fb17815f750 2024-04-26T22:05:57.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.396+0000 7fb16f7fe640 1 -- 172.21.15.137:0/955624491 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+3881 (secure 0 0 0) 0x7fb170041030 con 0x7fb17815f750 2024-04-26T22:05:57.396 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:57.397 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/3662687648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":3662687648},{"type":"v1","addr":"172.21.15.137:6836","nonce":3662687648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/4042473885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":4042473885},{"type":"v1","addr":"172.21.15.170:6834","nonce":4042473885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6511,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/2724972310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2724972310},{"type":"v1","addr":"172.21.15.170:6835","nonce":2724972310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":8145,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/3632034131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3632034131},{"type":"v1","addr":"172.21.15.137:6837","nonce":3632034131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[]} 2024-04-26T22:05:57.397 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 62 2024-04-26T22:05:57.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb15806c8f0 msgr2=0x7fb15806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.399 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb15806c8f0 0x7fb15806edb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb168001600 tx=0x7fb168007910 comp rx=0 tx=0).stop 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 msgr2=0x7fb1780cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 0x7fb1780cc2c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fb170009e50 tx=0x7fb170004a40 comp rx=0 tx=0).stop 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 shutdown_connections 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb15806c8f0 0x7fb15806edb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb17815f750 0x7fb1780cc2c0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb17815f370 0x7fb1780b9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 --2- 172.21.15.137:0/955624491 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb1780d3ee0 0x7fb1780cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 >> 172.21.15.137:0/955624491 conn(0x7fb17808ec10 msgr2=0x7fb1780d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 shutdown_connections 2024-04-26T22:05:57.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.398+0000 7fb17d7e7640 1 -- 172.21.15.137:0/955624491 wait complete. 2024-04-26T22:05:57.410 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T22:05:57.410 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T22:05:57.410 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:05:57.410 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:05:57.411 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T22:05:57.411 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T22:05:57.411 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T22:05:57.411 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:05:57.411 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T22:05:57.411 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T22:05:57.411 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:05:57.411 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:05:57.412 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T22:05:57.412 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T22:05:57.412 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T22:05:57.412 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:05:57.420 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:05:57.420 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T22:05:57.421 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T22:05:57.421 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T22:05:57.423 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:05:57.423 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T22:05:57.424 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T22:05:57.424 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T22:05:57.463 INFO:tasks.ceph.mds.a:Started 2024-04-26T22:05:57.463 DEBUG:teuthology.parallel:result is None 2024-04-26T22:05:57.465 INFO:tasks.ceph.mds.c:Started 2024-04-26T22:05:57.466 DEBUG:teuthology.parallel:result is None 2024-04-26T22:05:57.466 INFO:tasks.ceph.mds.b:Started 2024-04-26T22:05:57.467 DEBUG:teuthology.parallel:result is None 2024-04-26T22:05:57.468 INFO:tasks.ceph.mds.d:Started 2024-04-26T22:05:57.468 DEBUG:teuthology.parallel:result is None 2024-04-26T22:05:57.468 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T22:05:57.535 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:05:57.536 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:05:57.547 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T22:05:57.547 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T22:05:57.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.572+0000 7f94ab220640 1 Processor -- start 2024-04-26T22:05:57.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.573+0000 7f94ab220640 1 -- start start 2024-04-26T22:05:57.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.573+0000 7f94ab220640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40d3ee0 0x7f94a40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.573+0000 7f94ab220640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94a40d03a0 con 0x7f94a415f370 2024-04-26T22:05:57.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.573+0000 7f94ab220640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94a40d0680 con 0x7f94a415f750 2024-04-26T22:05:57.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.573+0000 7f94ab220640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f94a40d0960 con 0x7f94a40d3ee0 2024-04-26T22:05:57.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.573+0000 7f94a8fbc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f94a415f370 0x7f94a40d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40408/0 (socket says 172.21.15.137:40408) 2024-04-26T22:05:57.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.573+0000 7f94a8fbc640 1 -- 172.21.15.137:0/2270822411 learned_addr learned my addr 172.21.15.137:0/2270822411 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a3fff640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40d3ee0 0x7f94a40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776411166 0 0) 0x7f94a40d03a0 con 0x7f94a415f370 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9494003520 con 0x7f94a415f370 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1770634892 0 0) 0x7f94a40d0680 con 0x7f94a415f750 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94a40d03a0 con 0x7f94a415f750 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2806603713 0 0) 0x7f9494003520 con 0x7f94a415f370 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40d3ee0 msgr2=0x7f94a40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40d3ee0 0x7f94a40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 >> v1:172.21.15.170:6789/0 conn(0x7f94a415f750 legacy=0x7f94a40b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a40d0c40 con 0x7f94a415f370 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f9498001670 con 0x7f94a415f370 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 >> v1:172.21.15.137:6789/0 conn(0x7f94a415f370 legacy=0x7f94a40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40d3ee0 0x7f9494003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f9494004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9494004d40 0x7f94940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f94a40d0960 con 0x7f94940040d0 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f949400baa0 con 0x7f9494004d40 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f949400bca0 con 0x7f94a40d3ee0 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a3fff640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f9494004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a97bd640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9494004d40 0x7f94940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a8fbc640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40d3ee0 0x7f9494003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a3fff640 1 -- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40d3ee0 msgr2=0x7f9494003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a3fff640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40d3ee0 0x7f9494003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a3fff640 1 -- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9494004d40 msgr2=0x7f94940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a3fff640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9494004d40 0x7f94940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.574+0000 7f94a3fff640 1 -- 172.21.15.137:0/2270822411 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9494003520 con 0x7f94940040d0 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.575+0000 7f94a3fff640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f9494004800 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9490009ac0 tx=0x7f9494005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f1cd3b07ebd473 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.575+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490036070 con 0x7f94940040d0 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.575+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9490031400 con 0x7f94940040d0 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.575+0000 7f94a37fe640 1 -- 172.21.15.137:0/2270822411 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9490009690 con 0x7f94940040d0 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.576+0000 7f94ab220640 1 -- 172.21.15.137:0/2270822411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 msgr2=0x7f9494004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.576+0000 7f94ab220640 1 --2- 172.21.15.137:0/2270822411 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f9494004800 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9490009ac0 tx=0x7f9494005830 comp rx=0 tx=0).stop 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.576+0000 7f94a97bd640 1 -- 172.21.15.137:0/2270822411 reap_dead start 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.576+0000 7f94ab220640 1 -- 172.21.15.137:0/2270822411 shutdown_connections 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.576+0000 7f94ab220640 1 -- 172.21.15.137:0/2270822411 >> 172.21.15.137:0/2270822411 conn(0x7f94a408ec10 msgr2=0x7f94a409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.576+0000 7f94ab220640 1 -- 172.21.15.137:0/2270822411 shutdown_connections 2024-04-26T22:05:57.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.576+0000 7f94ab220640 1 -- 172.21.15.137:0/2270822411 wait complete. 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.577+0000 7f94ab220640 1 Processor -- start 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.577+0000 7f94ab220640 1 -- start start 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94ab220640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f94a415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94ab220640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a40ca940 0x7f94a40cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94ab220640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40c9710 0x7f94a40c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94ab220640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f94a40cfef0 con 0x7f94940040d0 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94ab220640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f94a40cfd70 con 0x7f94a40ca940 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94ab220640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f94a40d0070 con 0x7f94a40c9710 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a8fbc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f94a415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a8fbc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f94a415d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49574/0 (socket says 172.21.15.137:49574) 2024-04-26T22:05:57.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a8fbc640 1 -- 172.21.15.137:0/380700186 learned_addr learned my addr 172.21.15.137:0/380700186 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a97bd640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40c9710 0x7f94a40c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a3fff640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a40ca940 0x7f94a40cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a8fbc640 1 -- 172.21.15.137:0/380700186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40c9710 msgr2=0x7f94a40c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a8fbc640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40c9710 0x7f94a40c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a8fbc640 1 -- 172.21.15.137:0/380700186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a40ca940 msgr2=0x7f94a40cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a8fbc640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a40ca940 0x7f94a40cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a8fbc640 1 -- 172.21.15.137:0/380700186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a40ca490 con 0x7f94940040d0 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a8fbc640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f94a415d210 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f9498007340 tx=0x7f9498007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a17fa640 1 -- 172.21.15.137:0/380700186 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949800f860 con 0x7f94940040d0 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.578+0000 7f94a17fa640 1 -- 172.21.15.137:0/380700186 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9498018070 con 0x7f94940040d0 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.579+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a40b7ec0 con 0x7f94940040d0 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.579+0000 7f94a17fa640 1 -- 172.21.15.137:0/380700186 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949800fc60 con 0x7f94940040d0 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.579+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a40b8480 con 0x7f94940040d0 2024-04-26T22:05:57.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.579+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a406a290 con 0x7f94940040d0 2024-04-26T22:05:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.580+0000 7f94a17fa640 1 -- 172.21.15.137:0/380700186 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f949801d460 con 0x7f94940040d0 2024-04-26T22:05:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.580+0000 7f94a17fa640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f948806c920 0x7f948806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.580+0000 7f94a17fa640 1 -- 172.21.15.137:0/380700186 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f949808b7c0 con 0x7f94940040d0 2024-04-26T22:05:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.580+0000 7f94a3fff640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f948806c920 0x7f948806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.581+0000 7f94a3fff640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f948806c920 0x7f948806ede0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9490033000 tx=0x7f9490008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:57.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.585+0000 7f94a17fa640 1 -- 172.21.15.137:0/380700186 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f94980597f0 con 0x7f94940040d0 2024-04-26T22:05:57.773 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:57.773+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f94a4075fb0 con 0x7f94940040d0 2024-04-26T22:05:58.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.567+0000 7f94a17fa640 1 -- 172.21.15.137:0/380700186 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) ==== 97+0+0 (secure 0 0 0) 0x7f949805daf0 con 0x7f94940040d0 2024-04-26T22:05:58.568 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f948806c920 msgr2=0x7f948806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f948806c920 0x7f948806ede0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9490033000 tx=0x7f9490008030 comp rx=0 tx=0).stop 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 msgr2=0x7f94a415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f94a415d210 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f9498007340 tx=0x7f9498007800 comp rx=0 tx=0).stop 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 shutdown_connections 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f948806c920 0x7f948806ede0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f94a40c9710 0x7f94a40c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94a40ca940 0x7f94a40cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 --2- 172.21.15.137:0/380700186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94940040d0 0x7f94a415d210 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 >> 172.21.15.137:0/380700186 conn(0x7f94a408ec10 msgr2=0x7f94a406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 shutdown_connections 2024-04-26T22:05:58.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.570+0000 7f94ab220640 1 -- 172.21.15.137:0/380700186 wait complete. 2024-04-26T22:05:58.584 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T22:05:58.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.684+0000 7fa050ad9640 1 Processor -- start 2024-04-26T22:05:58.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.684+0000 7fa050ad9640 1 -- start start 2024-04-26T22:05:58.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa050ad9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c0b61a0 0x7fa04c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:58.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa050ad9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa04c0b3de0 0x7fa04c0720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:58.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa050ad9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa04c0b4530 con 0x7fa04c145980 2024-04-26T22:05:58.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa050ad9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa04c0b5140 con 0x7fa04c0b3de0 2024-04-26T22:05:58.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa050ad9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa04c0b4810 con 0x7fa04c0b61a0 2024-04-26T22:05:58.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa04ad9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa04c0b3de0 0x7fa04c0720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa04ad9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa04c0b3de0 0x7fa04c0720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49590/0 (socket says 172.21.15.137:49590) 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa04ad9d640 1 -- 172.21.15.137:0/3520393215 learned_addr learned my addr 172.21.15.137:0/3520393215 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa049d9b640 1 --2- 172.21.15.137:0/3520393215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c0b61a0 0x7fa04c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa04ad9d640 1 -- 172.21.15.137:0/3520393215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c0b61a0 msgr2=0x7fa04c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa04ad9d640 1 --2- 172.21.15.137:0/3520393215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c0b61a0 0x7fa04c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa04ad9d640 1 -- 172.21.15.137:0/3520393215 >> v1:172.21.15.170:6789/0 conn(0x7fa04c145980 legacy=0x7fa04c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.685+0000 7fa04ad9d640 1 -- 172.21.15.137:0/3520393215 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04c0b4af0 con 0x7fa04c0b3de0 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.686+0000 7fa04ad9d640 1 --2- 172.21.15.137:0/3520393215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 0x7fa04c0720d0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa044009870 tx=0x7fa04402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d179a948ceceb176 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.686+0000 7fa04959a640 1 -- 172.21.15.137:0/3520393215 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044037070 con 0x7fa04c0b3de0 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.686+0000 7fa04959a640 1 -- 172.21.15.137:0/3520393215 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa044032440 con 0x7fa04c0b3de0 2024-04-26T22:05:58.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.686+0000 7fa04959a640 1 -- 172.21.15.137:0/3520393215 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044032810 con 0x7fa04c0b3de0 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.687+0000 7fa050ad9640 1 -- 172.21.15.137:0/3520393215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 msgr2=0x7fa04c0720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.687+0000 7fa050ad9640 1 --2- 172.21.15.137:0/3520393215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 0x7fa04c0720d0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fa044009870 tx=0x7fa04402a180 comp rx=0 tx=0).stop 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.687+0000 7fa050ad9640 1 -- 172.21.15.137:0/3520393215 shutdown_connections 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.687+0000 7fa050ad9640 1 --2- 172.21.15.137:0/3520393215 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 0x7fa04c0720d0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.687+0000 7fa050ad9640 1 --2- 172.21.15.137:0/3520393215 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c0b61a0 0x7fa04c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.687+0000 7fa050ad9640 1 -- 172.21.15.137:0/3520393215 >> 172.21.15.137:0/3520393215 conn(0x7fa04c0d0d30 msgr2=0x7fa04c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.687+0000 7fa050ad9640 1 -- 172.21.15.137:0/3520393215 shutdown_connections 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.687+0000 7fa050ad9640 1 -- 172.21.15.137:0/3520393215 wait complete. 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.688+0000 7fa050ad9640 1 Processor -- start 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.688+0000 7fa050ad9640 1 -- start start 2024-04-26T22:05:58.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa050ad9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 0x7fa04c13cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa050ad9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0b61a0 0x7fa04c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa050ad9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c145980 0x7fa04c13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa050ad9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c072610 con 0x7fa04c0b3de0 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa050ad9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c0b4240 con 0x7fa04c0b61a0 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa050ad9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa04c072790 con 0x7fa04c145980 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 0x7fa04c13cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 0x7fa04c13cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49606/0 (socket says 172.21.15.137:49606) 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04a59c640 1 -- 172.21.15.137:0/395237125 learned_addr learned my addr 172.21.15.137:0/395237125 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04ad9d640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c145980 0x7fa04c13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa049d9b640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0b61a0 0x7fa04c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04a59c640 1 -- 172.21.15.137:0/395237125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c145980 msgr2=0x7fa04c13fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04a59c640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c145980 0x7fa04c13fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04a59c640 1 -- 172.21.15.137:0/395237125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0b61a0 msgr2=0x7fa04c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:58.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04a59c640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0b61a0 0x7fa04c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04a59c640 1 -- 172.21.15.137:0/395237125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04c13f4d0 con 0x7fa04c0b3de0 2024-04-26T22:05:58.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.689+0000 7fa04a59c640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 0x7fa04c13cde0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00ba50 tx=0x7fa03c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:58.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.690+0000 7fa03affd640 1 -- 172.21.15.137:0/395237125 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c019070 con 0x7fa04c0b3de0 2024-04-26T22:05:58.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.690+0000 7fa03affd640 1 -- 172.21.15.137:0/395237125 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa03c00cc20 con 0x7fa04c0b3de0 2024-04-26T22:05:58.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.690+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04c13d690 con 0x7fa04c0b3de0 2024-04-26T22:05:58.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.690+0000 7fa03affd640 1 -- 172.21.15.137:0/395237125 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c014680 con 0x7fa04c0b3de0 2024-04-26T22:05:58.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.690+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa04c13dbf0 con 0x7fa04c0b3de0 2024-04-26T22:05:58.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.691+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa04c06a290 con 0x7fa04c0b3de0 2024-04-26T22:05:58.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.691+0000 7fa03affd640 1 -- 172.21.15.137:0/395237125 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa03c01c070 con 0x7fa04c0b3de0 2024-04-26T22:05:58.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.691+0000 7fa03affd640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa02c06c920 0x7fa02c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:58.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.692+0000 7fa03affd640 1 -- 172.21.15.137:0/395237125 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7fa03c08b3b0 con 0x7fa04c0b3de0 2024-04-26T22:05:58.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.692+0000 7fa049d9b640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa02c06c920 0x7fa02c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:58.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.692+0000 7fa049d9b640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa02c06c920 0x7fa02c06ede0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa04c140920 tx=0x7fa040008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:58.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.696+0000 7fa03affd640 1 -- 172.21.15.137:0/395237125 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa04c13d690 con 0x7fa04c0b3de0 2024-04-26T22:05:58.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.941+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa04c073cc0 con 0x7fa04c0b3de0 2024-04-26T22:05:58.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.941+0000 7fa03affd640 1 -- 172.21.15.137:0/395237125 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fa03c059570 con 0x7fa04c0b3de0 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmKffkBRAAh7EvvT0pmNbLKtJsBH/25Q==", 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.943 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmd5UHERAAykWO/C56qwLwimzH2f6mcA==", 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.944 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmMbCsDBAANF98tMtCSOy4TVN7I498cw==", 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmQ47KFxAAsreL970BTH5yQLOol942iQ==", 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:05:58.945 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBcIyxmY2T8NhAAMyJ5OP3dhuqMymrlUG4q2A==", 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.946 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBfIyxmNfGnNRAAp+tTaVBwfAMUsyqRSgoRvw==", 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBiIyxm3Q1yMxAAf7f6Me7uKYzM+Fp+2FCQsA==", 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:05:58.947 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlIyxmFcj2MRAAL/yPxOwtgMnfbmr0YUZs6Q==", 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.948 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBpIyxmaaAqORAAfowCddy0wT/LptWvqD4CDw==", 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBsIyxmJaOFNhAAqjJAuU/SoVnjIAYCODWMnA==", 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:05:58.949 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBvIyxmRkINNBAAjfFLMQ9/XMLLU8ZAoUxvkQ==", 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.950 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQByIyxmeF1gMRAAH0t727lSCZgkTgJ0ZXyA6g==", 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ==", 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow r", 2024-04-26T22:05:58.951 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxms4U0JBAAMZ056L4EP1qzX2KVx8JiEg==", 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.952 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmUnswIRAA5nYDanYzHiEVk98/041RHA==", 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmHOORKRAA6Agn7TqBPywtop3Eo8+yFQ==", 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:05:58.953 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxm7ue6JhAAyLiai4CKXmiB00fCAfp2WA==", 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.954 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmFBrPAhAAfrkQvzF5SSyb5iQ0zr0eww==", 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxmlrq3OhAA9Fd+zmECU9xK/pWp2Hg9kg==", 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:05:58.955 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:05:58.956 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:05:58.956 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:05:58.956 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.956 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:58.956 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T22:05:58.956 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa02c06c920 msgr2=0x7fa02c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa02c06c920 0x7fa02c06ede0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa04c140920 tx=0x7fa040008040 comp rx=0 tx=0).stop 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 msgr2=0x7fa04c13cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 0x7fa04c13cde0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00ba50 tx=0x7fa03c00bf10 comp rx=0 tx=0).stop 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 shutdown_connections 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa02c06c920 0x7fa02c06ede0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa04c145980 0x7fa04c13fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa04c0b61a0 0x7fa04c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 --2- 172.21.15.137:0/395237125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa04c0b3de0 0x7fa04c13cde0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 >> 172.21.15.137:0/395237125 conn(0x7fa04c0d0d30 msgr2=0x7fa04c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 shutdown_connections 2024-04-26T22:05:58.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:58.944+0000 7fa050ad9640 1 -- 172.21.15.137:0/395237125 wait complete. 2024-04-26T22:05:58.959 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:05:59.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.054+0000 7fddfadb7640 1 Processor -- start 2024-04-26T22:05:59.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.055+0000 7fddfadb7640 1 -- start start 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.055+0000 7fddfadb7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.055+0000 7fddfadb7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fddf40b3de0 0x7fddf40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.055+0000 7fddfadb7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf40b4260 con 0x7fddf40b5fd0 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.055+0000 7fddfadb7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fddf40b6440 con 0x7fddf40b3de0 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.055+0000 7fddfadb7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fddf40b5140 con 0x7fddf4145980 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.056+0000 7fddf3fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fddf40b3de0 0x7fddf40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.056+0000 7fddf8b53640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.056+0000 7fddf8b53640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:46896/0 (socket says 172.21.15.137:46896) 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.056+0000 7fddf3fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fddf40b3de0 0x7fddf40b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:44376/0 (socket says 172.21.15.137:44376) 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.056+0000 7fddf8b53640 1 -- 172.21.15.137:0/2835683489 learned_addr learned my addr 172.21.15.137:0/2835683489 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.056+0000 7fddf8b53640 1 -- 172.21.15.137:0/2835683489 >> v2:172.21.15.170:3300/0 conn(0x7fddf40b3de0 msgr2=0x7fddf40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:59.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.056+0000 7fddf8b53640 1 --2- 172.21.15.137:0/2835683489 >> v2:172.21.15.170:3300/0 conn(0x7fddf40b3de0 0x7fddf40b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.056+0000 7fddf8b53640 1 -- 172.21.15.137:0/2835683489 >> v1:172.21.15.170:6789/0 conn(0x7fddf40b5fd0 legacy=0x7fddf415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.056+0000 7fddf8b53640 1 -- 172.21.15.137:0/2835683489 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf40b4530 con 0x7fddf4145980 2024-04-26T22:05:59.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddf8b53640 1 --2- 172.21.15.137:0/2835683489 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4160630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fddec009e50 tx=0x7fddec02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f05c2b6824de8cbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddf37fe640 1 -- 172.21.15.137:0/2835683489 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec036070 con 0x7fddf4145980 2024-04-26T22:05:59.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddf37fe640 1 -- 172.21.15.137:0/2835683489 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec031600 con 0x7fddf4145980 2024-04-26T22:05:59.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddf37fe640 1 -- 172.21.15.137:0/2835683489 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec0319d0 con 0x7fddf4145980 2024-04-26T22:05:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddfadb7640 1 -- 172.21.15.137:0/2835683489 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 msgr2=0x7fddf4160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddfadb7640 1 --2- 172.21.15.137:0/2835683489 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4160630 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fddec009e50 tx=0x7fddec02a680 comp rx=0 tx=0).stop 2024-04-26T22:05:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddfadb7640 1 -- 172.21.15.137:0/2835683489 shutdown_connections 2024-04-26T22:05:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddfadb7640 1 --2- 172.21.15.137:0/2835683489 >> v2:172.21.15.170:3300/0 conn(0x7fddf40b3de0 0x7fddf40b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddfadb7640 1 --2- 172.21.15.137:0/2835683489 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4160630 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddfadb7640 1 -- 172.21.15.137:0/2835683489 >> 172.21.15.137:0/2835683489 conn(0x7fddf40d0d30 msgr2=0x7fddf40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddfadb7640 1 -- 172.21.15.137:0/2835683489 shutdown_connections 2024-04-26T22:05:59.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.057+0000 7fddfadb7640 1 -- 172.21.15.137:0/2835683489 wait complete. 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.058+0000 7fddfadb7640 1 Processor -- start 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.059+0000 7fddfadb7640 1 -- start start 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.059+0000 7fddfadb7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddf40b3de0 0x7fddf41f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.059+0000 7fddfadb7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf40b5fd0 0x7fddf4141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.059+0000 7fddfadb7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.059+0000 7fddfadb7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fddf40b4dd0 con 0x7fddf40b3de0 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.059+0000 7fddfadb7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fddf40b4af0 con 0x7fddf40b5fd0 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.059+0000 7fddfadb7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fddf40730e0 con 0x7fddf4145980 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf8b53640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddf40b3de0 0x7fddf41f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf8b53640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddf40b3de0 0x7fddf41f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49614/0 (socket says 172.21.15.137:49614) 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf8b53640 1 -- 172.21.15.137:0/3946581714 learned_addr learned my addr 172.21.15.137:0/3946581714 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf9354640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf3fff640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf40b5fd0 0x7fddf4141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf8b53640 1 -- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 msgr2=0x7fddf4141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf8b53640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf8b53640 1 -- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf40b5fd0 msgr2=0x7fddf4141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf8b53640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf40b5fd0 0x7fddf4141980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf8b53640 1 -- 172.21.15.137:0/3946581714 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf413fa40 con 0x7fddf40b3de0 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf9354640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf3fff640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf40b5fd0 0x7fddf4141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf8b53640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddf40b3de0 0x7fddf41f2a40 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fddec02ac70 tx=0x7fddec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf17fa640 1 -- 172.21.15.137:0/3946581714 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec03f020 con 0x7fddf40b3de0 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf41593e0 con 0x7fddf40b3de0 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf17fa640 1 -- 172.21.15.137:0/3946581714 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec037040 con 0x7fddf40b3de0 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddf17fa640 1 -- 172.21.15.137:0/3946581714 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec036070 con 0x7fddf40b3de0 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.060+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf4142700 con 0x7fddf40b3de0 2024-04-26T22:05:59.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.061+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf406a290 con 0x7fddf40b3de0 2024-04-26T22:05:59.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.062+0000 7fddf17fa640 1 -- 172.21.15.137:0/3946581714 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fddec042020 con 0x7fddf40b3de0 2024-04-26T22:05:59.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.062+0000 7fddf17fa640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fddd406c8f0 0x7fddd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.062+0000 7fddf17fa640 1 -- 172.21.15.137:0/3946581714 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7fddec0abc30 con 0x7fddf40b3de0 2024-04-26T22:05:59.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.062+0000 7fddf3fff640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fddd406c8f0 0x7fddd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.062+0000 7fddf3fff640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fddd406c8f0 0x7fddd406edb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fddf415e020 tx=0x7fdddc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.067+0000 7fddf17fa640 1 -- 172.21.15.137:0/3946581714 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fddec049030 con 0x7fddf40b3de0 2024-04-26T22:05:59.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.245+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddf4073cc0 con 0x7fddf40b3de0 2024-04-26T22:05:59.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.246+0000 7fddf17fa640 1 -- 172.21.15.137:0/3946581714 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+12904 (secure 0 0 0) 0x7fddec07a3c0 con 0x7fddf40b3de0 2024-04-26T22:05:59.247 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:59.247 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":99,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:05:58.568609+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:05:59.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fddd406c8f0 msgr2=0x7fddd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fddd406c8f0 0x7fddd406edb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fddf415e020 tx=0x7fdddc008040 comp rx=0 tx=0).stop 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddf40b3de0 msgr2=0x7fddf41f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddf40b3de0 0x7fddf41f2a40 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fddec02ac70 tx=0x7fddec004a40 comp rx=0 tx=0).stop 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 shutdown_connections 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fddd406c8f0 0x7fddd406edb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fddf4145980 0x7fddf4141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fddf40b5fd0 0x7fddf4141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 --2- 172.21.15.137:0/3946581714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fddf40b3de0 0x7fddf41f2a40 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 >> 172.21.15.137:0/3946581714 conn(0x7fddf40d0d30 msgr2=0x7fddf415c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 shutdown_connections 2024-04-26T22:05:59.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.248+0000 7fddfadb7640 1 -- 172.21.15.137:0/3946581714 wait complete. 2024-04-26T22:05:59.260 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:05:59.261 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:05:59.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.361+0000 7f2ed5519640 1 Processor -- start 2024-04-26T22:05:59.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.361+0000 7f2ed5519640 1 -- start start 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.361+0000 7f2ed5519640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2ed00d4f20 0x7f2ed00d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.361+0000 7f2ed5519640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed00d3c90 con 0x7f2ed00d3820 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.361+0000 7f2ed5519640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed00d58c0 con 0x7f2ed015f680 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.361+0000 7f2ed5519640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2ed015fa60 con 0x7f2ed00d4f20 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.361+0000 7f2ece7fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2ed00d3820 0x7f2ed00b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40412/0 (socket says 172.21.15.137:40412) 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.361+0000 7f2ece7fc640 1 -- 172.21.15.137:0/425627001 learned_addr learned my addr 172.21.15.137:0/425627001 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515441900 0 0) 0x7f2ed00d3c90 con 0x7f2ed00d3820 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ebc003520 con 0x7f2ed00d3820 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecf7fe640 1 --2- 172.21.15.137:0/425627001 >> v2:172.21.15.170:3300/0 conn(0x7f2ed00d4f20 0x7f2ed00d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2212327479 0 0) 0x7f2ebc003520 con 0x7f2ed00d3820 2024-04-26T22:05:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 >> v2:172.21.15.170:3300/0 conn(0x7f2ed00d4f20 msgr2=0x7f2ed00d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 --2- 172.21.15.137:0/425627001 >> v2:172.21.15.170:3300/0 conn(0x7f2ed00d4f20 0x7f2ed00d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 >> v1:172.21.15.170:6789/0 conn(0x7f2ed015f680 legacy=0x7f2ed0163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed00d3f50 con 0x7f2ed00d3820 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f2eb8001670 con 0x7f2ed00d3820 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 >> v1:172.21.15.137:6789/0 conn(0x7f2ed00d3820 legacy=0x7f2ed00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc0039b0 0x7f2ebc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc004800 0x7f2ebc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ebc0051c0 0x7f2ebc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed015fa60 con 0x7f2ebc004800 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc00c060 con 0x7f2ebc0039b0 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ebc00c260 con 0x7f2ebc0051c0 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ece7fc640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc004800 0x7f2ebc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2eceffd640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc0039b0 0x7f2ebc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecf7fe640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ebc0051c0 0x7f2ebc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ece7fc640 1 -- 172.21.15.137:0/425627001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ebc0051c0 msgr2=0x7f2ebc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ece7fc640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ebc0051c0 0x7f2ebc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ece7fc640 1 -- 172.21.15.137:0/425627001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc0039b0 msgr2=0x7f2ebc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ece7fc640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc0039b0 0x7f2ebc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ece7fc640 1 -- 172.21.15.137:0/425627001 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc003520 con 0x7f2ebc004800 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2ecf7fe640 1 -- 172.21.15.137:0/425627001 reap_dead start 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.362+0000 7f2eceffd640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc0039b0 0x7f2ebc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.363+0000 7f2ece7fc640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc004800 0x7f2ebc004c80 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c210 tx=0x7f2ebc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955e6158791ad1d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.363+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8007d30 con 0x7f2ebc004800 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.363+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb8005ad0 con 0x7f2ebc004800 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.363+0000 7f2ecdffb640 1 -- 172.21.15.137:0/425627001 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8007070 con 0x7f2ebc004800 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.364+0000 7f2ed5519640 1 -- 172.21.15.137:0/425627001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc004800 msgr2=0x7f2ebc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.364+0000 7f2ed5519640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc004800 0x7f2ebc004c80 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c210 tx=0x7f2ebc005830 comp rx=0 tx=0).stop 2024-04-26T22:05:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.364+0000 7f2ed5519640 1 -- 172.21.15.137:0/425627001 shutdown_connections 2024-04-26T22:05:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.364+0000 7f2ed5519640 1 --2- 172.21.15.137:0/425627001 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ebc004800 0x7f2ebc004c80 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.364+0000 7f2ed5519640 1 -- 172.21.15.137:0/425627001 >> 172.21.15.137:0/425627001 conn(0x7f2ed008eca0 msgr2=0x7f2ed009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.364+0000 7f2ed5519640 1 -- 172.21.15.137:0/425627001 shutdown_connections 2024-04-26T22:05:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.364+0000 7f2ed5519640 1 -- 172.21.15.137:0/425627001 wait complete. 2024-04-26T22:05:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.365+0000 7f2ed5519640 1 Processor -- start 2024-04-26T22:05:59.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.365+0000 7f2ed5519640 1 -- start start 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ed5519640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc004800 0x7f2ed01f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ed5519640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed00ceca0 0x7f2ed0161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ed5519640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed015fbe0 0x7f2ed0160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ed5519640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed00d5380 con 0x7f2ed00ceca0 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ed5519640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed00b5370 con 0x7f2ebc004800 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ed5519640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed00d5500 con 0x7f2ed015fbe0 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ece7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed00ceca0 0x7f2ed0161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ece7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed00ceca0 0x7f2ed0161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49634/0 (socket says 172.21.15.137:49634) 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ece7fc640 1 -- 172.21.15.137:0/864666130 learned_addr learned my addr 172.21.15.137:0/864666130 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2eceffd640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc004800 0x7f2ed01f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ecf7fe640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed015fbe0 0x7f2ed0160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ece7fc640 1 -- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed015fbe0 msgr2=0x7f2ed0160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ece7fc640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed015fbe0 0x7f2ed0160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ece7fc640 1 -- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc004800 msgr2=0x7f2ed01f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ece7fc640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc004800 0x7f2ed01f90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ece7fc640 1 -- 172.21.15.137:0/864666130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed0162310 con 0x7f2ed00ceca0 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2eceffd640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc004800 0x7f2ed01f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ecf7fe640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed015fbe0 0x7f2ed0160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.366+0000 7f2ece7fc640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed00ceca0 0x7f2ed0161a50 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c210 tx=0x7f2eb8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.367+0000 7f2ec77fe640 1 -- 172.21.15.137:0/864666130 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8040030 con 0x7f2ed00ceca0 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.367+0000 7f2ec77fe640 1 -- 172.21.15.137:0/864666130 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb8007d10 con 0x7f2ed00ceca0 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.367+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed01625f0 con 0x7f2ed00ceca0 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.367+0000 7f2ec77fe640 1 -- 172.21.15.137:0/864666130 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8037040 con 0x7f2ed00ceca0 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.367+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed00d0dd0 con 0x7f2ed00ceca0 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.368+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed006a290 con 0x7f2ed00ceca0 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.368+0000 7f2ec77fe640 1 -- 172.21.15.137:0/864666130 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2eb8043070 con 0x7f2ed00ceca0 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.368+0000 7f2ec77fe640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2eb006c920 0x7f2eb006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.369+0000 7f2ec77fe640 1 -- 172.21.15.137:0/864666130 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7f2eb80aae10 con 0x7f2ed00ceca0 2024-04-26T22:05:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.369+0000 7f2eceffd640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2eb006c920 0x7f2eb006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.369+0000 7f2eceffd640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2eb006c920 0x7f2eb006ede0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8000f80 tx=0x7f2ec8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.374+0000 7f2ec77fe640 1 -- 172.21.15.137:0/864666130 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2eb8079620 con 0x7f2ed00ceca0 2024-04-26T22:05:59.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.544+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2ed00b4cd0 con 0x7f2ed00ceca0 2024-04-26T22:05:59.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.544+0000 7f2ec77fe640 1 -- 172.21.15.137:0/864666130 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7f2eb8078f20 con 0x7f2ed00ceca0 2024-04-26T22:05:59.545 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:05:59.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2eb006c920 msgr2=0x7f2eb006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2eb006c920 0x7f2eb006ede0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8000f80 tx=0x7f2ec8009040 comp rx=0 tx=0).stop 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed00ceca0 msgr2=0x7f2ed0161a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed00ceca0 0x7f2ed0161a50 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c210 tx=0x7f2eb8001a40 comp rx=0 tx=0).stop 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 shutdown_connections 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2eb006c920 0x7f2eb006ede0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ed00ceca0 0x7f2ed0161a50 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ed015fbe0 0x7f2ed0160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 --2- 172.21.15.137:0/864666130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ebc004800 0x7f2ed01f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 >> 172.21.15.137:0/864666130 conn(0x7f2ed008eca0 msgr2=0x7f2ed015e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 shutdown_connections 2024-04-26T22:05:59.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.546+0000 7f2ed5519640 1 -- 172.21.15.137:0/864666130 wait complete. 2024-04-26T22:05:59.558 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T22:05:59.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe8340640 1 Processor -- start 2024-04-26T22:05:59.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe8340640 1 -- start start 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe8340640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcfe00d3ee0 0x7fcfe00cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe8340640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcfe015f750 0x7fcfe00b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe8340640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe00d03a0 con 0x7fcfe015f370 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe8340640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe00b4d10 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe8340640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe00d0680 con 0x7fcfe015f750 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe58db640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcfe00d3ee0 0x7fcfe00cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe58db640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcfe00d3ee0 0x7fcfe00cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49638/0 (socket says 172.21.15.137:49638) 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe60dc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcfe015f370 0x7fcfe00d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40416/0 (socket says 172.21.15.137:40416) 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.656+0000 7fcfe58db640 1 -- 172.21.15.137:0/3685574300 learned_addr learned my addr 172.21.15.137:0/3685574300 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.657+0000 7fcfe68dd640 1 --2- 172.21.15.137:0/3685574300 >> v2:172.21.15.170:3300/0 conn(0x7fcfe015f750 0x7fcfe00b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.657+0000 7fcfe58db640 1 -- 172.21.15.137:0/3685574300 >> v2:172.21.15.170:3300/0 conn(0x7fcfe015f750 msgr2=0x7fcfe00b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.657+0000 7fcfe58db640 1 --2- 172.21.15.137:0/3685574300 >> v2:172.21.15.170:3300/0 conn(0x7fcfe015f750 0x7fcfe00b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.657+0000 7fcfe58db640 1 -- 172.21.15.137:0/3685574300 >> v1:172.21.15.137:6789/0 conn(0x7fcfe015f370 legacy=0x7fcfe00d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.657+0000 7fcfe58db640 1 -- 172.21.15.137:0/3685574300 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe00d0960 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.657+0000 7fcfe50da640 1 -- 172.21.15.137:0/3685574300 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152763873 0 0) 0x7fcfe00d03a0 con 0x7fcfe015f370 2024-04-26T22:05:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.657+0000 7fcfe58db640 1 --2- 172.21.15.137:0/3685574300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 0x7fcfe00cfd70 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009870 tx=0x7fcfd002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c56fdee3517d7c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.657+0000 7fcfe50da640 1 -- 172.21.15.137:0/3685574300 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0037070 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe50da640 1 -- 172.21.15.137:0/3685574300 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd0032440 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe50da640 1 -- 172.21.15.137:0/3685574300 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0032810 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe8340640 1 -- 172.21.15.137:0/3685574300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 msgr2=0x7fcfe00cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe8340640 1 --2- 172.21.15.137:0/3685574300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 0x7fcfe00cfd70 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009870 tx=0x7fcfd002a2a0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe8340640 1 -- 172.21.15.137:0/3685574300 shutdown_connections 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe8340640 1 --2- 172.21.15.137:0/3685574300 >> v2:172.21.15.170:3300/0 conn(0x7fcfe015f750 0x7fcfe00b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe8340640 1 --2- 172.21.15.137:0/3685574300 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 0x7fcfe00cfd70 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe8340640 1 -- 172.21.15.137:0/3685574300 >> 172.21.15.137:0/3685574300 conn(0x7fcfe008ec10 msgr2=0x7fcfe009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe8340640 1 -- 172.21.15.137:0/3685574300 shutdown_connections 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.658+0000 7fcfe8340640 1 -- 172.21.15.137:0/3685574300 wait complete. 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.659+0000 7fcfe8340640 1 Processor -- start 2024-04-26T22:05:59.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.659+0000 7fcfe8340640 1 -- start start 2024-04-26T22:05:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe8340640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 0x7fcfe01624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe8340640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfe015f370 0x7fcfe00caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe8340640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfe015f750 0x7fcfe00cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe8340640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe00b51c0 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe8340640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe00d0f20 con 0x7fcfe015f750 2024-04-26T22:05:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe8340640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe00b5340 con 0x7fcfe015f370 2024-04-26T22:05:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe60dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 0x7fcfe01624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe60dc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 0x7fcfe01624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49640/0 (socket says 172.21.15.137:49640) 2024-04-26T22:05:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe60dc640 1 -- 172.21.15.137:0/340200249 learned_addr learned my addr 172.21.15.137:0/340200249 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe60dc640 1 -- 172.21.15.137:0/340200249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfe015f370 msgr2=0x7fcfe00caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe60dc640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfe015f370 0x7fcfe00caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe60dc640 1 -- 172.21.15.137:0/340200249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfe015f750 msgr2=0x7fcfe00cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe60dc640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfe015f750 0x7fcfe00cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe60dc640 1 -- 172.21.15.137:0/340200249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe0162a20 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.660+0000 7fcfe60dc640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 0x7fcfe01624e0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c890 tx=0x7fcfdc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.661+0000 7fcfd6ffd640 1 -- 172.21.15.137:0/340200249 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc018070 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.661+0000 7fcfd6ffd640 1 -- 172.21.15.137:0/340200249 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfdc00a640 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.661+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe00b8040 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.661+0000 7fcfd6ffd640 1 -- 172.21.15.137:0/340200249 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc00aa30 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.661+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe00b8600 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.662+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe006a290 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.662+0000 7fcfd6ffd640 1 -- 172.21.15.137:0/340200249 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcfdc01b070 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.663+0000 7fcfd6ffd640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcfc406c8f0 0x7fcfc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.663+0000 7fcfd6ffd640 1 -- 172.21.15.137:0/340200249 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7fcfdc08af90 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.663+0000 7fcfe58db640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcfc406c8f0 0x7fcfc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.663+0000 7fcfe58db640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcfc406c8f0 0x7fcfc406edb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0034000 tx=0x7fcfd002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.668+0000 7fcfd6ffd640 1 -- 172.21.15.137:0/340200249 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcfdc059680 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.847+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcfe015dd10 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.847+0000 7fcfd6ffd640 1 -- 172.21.15.137:0/340200249 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v99) ==== 84+0+65 (secure 0 0 0) 0x7fcfdc058f80 con 0x7fcfe00d3ee0 2024-04-26T22:05:59.848 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:05:59.848 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:05:59.848 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:05:59.848 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T22:05:59.848 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T22:05:59.849 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:05:59.849 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:05:59.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcfc406c8f0 msgr2=0x7fcfc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcfc406c8f0 0x7fcfc406edb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0034000 tx=0x7fcfd002c000 comp rx=0 tx=0).stop 2024-04-26T22:05:59.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 msgr2=0x7fcfe01624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 0x7fcfe01624e0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c890 tx=0x7fcfdc00cd50 comp rx=0 tx=0).stop 2024-04-26T22:05:59.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 shutdown_connections 2024-04-26T22:05:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcfc406c8f0 0x7fcfc406edb0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfe015f750 0x7fcfe00cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcfe015f370 0x7fcfe00caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 --2- 172.21.15.137:0/340200249 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcfe00d3ee0 0x7fcfe01624e0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 >> 172.21.15.137:0/340200249 conn(0x7fcfe008ec10 msgr2=0x7fcfe009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 shutdown_connections 2024-04-26T22:05:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.850+0000 7fcfe8340640 1 -- 172.21.15.137:0/340200249 wait complete. 2024-04-26T22:05:59.861 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T22:05:59.861 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T22:05:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.961+0000 7fe28e8bb640 1 Processor -- start 2024-04-26T22:05:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.961+0000 7fe28e8bb640 1 -- start start 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe28e8bb640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe2880cee20 0x7fe28806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe28e8bb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2880d3a30 0x7fe28809ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe28e8bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe28809bf80 0x7fe2881630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe28e8bb640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe2880d1e10 con 0x7fe2880d3a30 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe28e8bb640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe2880d1240 con 0x7fe2880cee20 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe28e8bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe2880d14e0 con 0x7fe28809bf80 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe2877fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2880d3a30 0x7fe28809ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe2877fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe2880d3a30 0x7fe28809ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49648/0 (socket says 172.21.15.137:49648) 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe2877fe640 1 -- 172.21.15.137:0/118124832 learned_addr learned my addr 172.21.15.137:0/118124832 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe287fff640 1 --2- 172.21.15.137:0/118124832 >> v2:172.21.15.170:3300/0 conn(0x7fe2880cee20 0x7fe28806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe28ce58640 1 --2- 172.21.15.137:0/118124832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe28809bf80 0x7fe2881630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe2877fe640 1 -- 172.21.15.137:0/118124832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe28809bf80 msgr2=0x7fe2881630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe2877fe640 1 --2- 172.21.15.137:0/118124832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe28809bf80 0x7fe2881630d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe2877fe640 1 -- 172.21.15.137:0/118124832 >> v2:172.21.15.170:3300/0 conn(0x7fe2880cee20 msgr2=0x7fe28806d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe2877fe640 1 --2- 172.21.15.137:0/118124832 >> v2:172.21.15.170:3300/0 conn(0x7fe2880cee20 0x7fe28806d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe2877fe640 1 -- 172.21.15.137:0/118124832 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2880d17c0 con 0x7fe2880d3a30 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe287fff640 1 --2- 172.21.15.137:0/118124832 >> v2:172.21.15.170:3300/0 conn(0x7fe2880cee20 0x7fe28806d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe2877fe640 1 --2- 172.21.15.137:0/118124832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2880d3a30 0x7fe28809ba40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe288073bd0 tx=0x7fe27c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bc589e87cc1aef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe286ffd640 1 -- 172.21.15.137:0/118124832 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c037070 con 0x7fe2880d3a30 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe286ffd640 1 -- 172.21.15.137:0/118124832 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c032440 con 0x7fe2880d3a30 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.962+0000 7fe286ffd640 1 -- 172.21.15.137:0/118124832 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c032810 con 0x7fe2880d3a30 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.963+0000 7fe28e8bb640 1 -- 172.21.15.137:0/118124832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2880d3a30 msgr2=0x7fe28809ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.963+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/118124832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2880d3a30 0x7fe28809ba40 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe288073bd0 tx=0x7fe27c02a1e0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.963+0000 7fe28e8bb640 1 -- 172.21.15.137:0/118124832 shutdown_connections 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.963+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/118124832 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe28809bf80 0x7fe2881630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.963+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/118124832 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe2880d3a30 0x7fe28809ba40 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.963+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/118124832 >> v2:172.21.15.170:3300/0 conn(0x7fe2880cee20 0x7fe28806d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.963+0000 7fe28e8bb640 1 -- 172.21.15.137:0/118124832 >> 172.21.15.137:0/118124832 conn(0x7fe2880d2f10 msgr2=0x7fe2880d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:05:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.963+0000 7fe28e8bb640 1 -- 172.21.15.137:0/118124832 shutdown_connections 2024-04-26T22:05:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.963+0000 7fe28e8bb640 1 -- 172.21.15.137:0/118124832 wait complete. 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.964+0000 7fe28e8bb640 1 Processor -- start 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.964+0000 7fe28e8bb640 1 -- start start 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe28e8bb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe28809bf80 0x7fe2881f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe28e8bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2880cee20 0x7fe2880cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe28e8bb640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2880d3a30 0x7fe2880c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe28e8bb640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe2880cf200 con 0x7fe28809bf80 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe28e8bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe28809c7a0 con 0x7fe2880cee20 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe28e8bb640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe2880cf380 con 0x7fe2880d3a30 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe287fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe28809bf80 0x7fe2881f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe287fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe28809bf80 0x7fe2881f59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49650/0 (socket says 172.21.15.137:49650) 2024-04-26T22:05:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe287fff640 1 -- 172.21.15.137:0/400593651 learned_addr learned my addr 172.21.15.137:0/400593651 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe287fff640 1 -- 172.21.15.137:0/400593651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2880d3a30 msgr2=0x7fe2880c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe287fff640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2880d3a30 0x7fe2880c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe287fff640 1 -- 172.21.15.137:0/400593651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2880cee20 msgr2=0x7fe2880cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe287fff640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2880cee20 0x7fe2880cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe287fff640 1 -- 172.21.15.137:0/400593651 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2880c6ae0 con 0x7fe28809bf80 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe287fff640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe28809bf80 0x7fe2881f59a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fe27800c7f0 tx=0x7fe27800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe284ff9640 1 -- 172.21.15.137:0/400593651 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278015070 con 0x7fe28809bf80 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe284ff9640 1 -- 172.21.15.137:0/400593651 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2780079d0 con 0x7fe28809bf80 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2880c6dc0 con 0x7fe28809bf80 2024-04-26T22:05:59.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe284ff9640 1 -- 172.21.15.137:0/400593651 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278007da0 con 0x7fe28809bf80 2024-04-26T22:05:59.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.965+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2880c7380 con 0x7fe28809bf80 2024-04-26T22:05:59.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.966+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe28806a290 con 0x7fe28809bf80 2024-04-26T22:05:59.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.967+0000 7fe284ff9640 1 -- 172.21.15.137:0/400593651 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe278018070 con 0x7fe28809bf80 2024-04-26T22:05:59.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.967+0000 7fe284ff9640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe27406c8f0 0x7fe27406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:05:59.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.967+0000 7fe284ff9640 1 -- 172.21.15.137:0/400593651 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7fe27808b740 con 0x7fe28809bf80 2024-04-26T22:05:59.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.967+0000 7fe2877fe640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe27406c8f0 0x7fe27406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:05:59.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.968+0000 7fe2877fe640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe27406c8f0 0x7fe27406edb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe27c034000 tx=0x7fe27c02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:05:59.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:05:59.972+0000 7fe284ff9640 1 -- 172.21.15.137:0/400593651 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe278059ec0 con 0x7fe28809bf80 2024-04-26T22:06:00.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.146+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe2880ce550 con 0x7fe28809bf80 2024-04-26T22:06:00.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.577+0000 7fe284ff9640 1 -- 172.21.15.137:0/400593651 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v100) ==== 138+0+0 (secure 0 0 0) 0x7fe2780597c0 con 0x7fe28809bf80 2024-04-26T22:06:00.577 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T22:06:00.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe27406c8f0 msgr2=0x7fe27406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:00.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe27406c8f0 0x7fe27406edb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe27c034000 tx=0x7fe27c02c000 comp rx=0 tx=0).stop 2024-04-26T22:06:00.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe28809bf80 msgr2=0x7fe2881f59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:00.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe28809bf80 0x7fe2881f59a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fe27800c7f0 tx=0x7fe27800cbf0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 shutdown_connections 2024-04-26T22:06:00.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe27406c8f0 0x7fe27406edb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe2880d3a30 0x7fe2880c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe2880cee20 0x7fe2880cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 --2- 172.21.15.137:0/400593651 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe28809bf80 0x7fe2881f59a0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.581+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 >> 172.21.15.137:0/400593651 conn(0x7fe2880d2f10 msgr2=0x7fe2880b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:00.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.582+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 shutdown_connections 2024-04-26T22:06:00.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.582+0000 7fe28e8bb640 1 -- 172.21.15.137:0/400593651 wait complete. 2024-04-26T22:06:00.596 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T22:06:00.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.701+0000 7fbf7ec2c640 1 Processor -- start 2024-04-26T22:06:00.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.701+0000 7fbf7ec2c640 1 -- start start 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7ec2c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbf781459a0 0x7fbf780b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7ec2c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf7815d030 0x7fbf780b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7ec2c640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf780b4480 con 0x7fbf780b6130 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7ec2c640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fbf780b4760 con 0x7fbf781459a0 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7ec2c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf780b4a40 con 0x7fbf7815d030 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7c9c8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbf781459a0 0x7fbf780b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7c9c8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fbf781459a0 0x7fbf780b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49662/0 (socket says 172.21.15.137:49662) 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7d1c9640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fbf780b6130 0x7fbf7815fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40432/0 (socket says 172.21.15.137:40432) 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7c9c8640 1 -- 172.21.15.137:0/1702441555 learned_addr learned my addr 172.21.15.137:0/1702441555 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7c9c8640 1 -- 172.21.15.137:0/1702441555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf7815d030 msgr2=0x7fbf780b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7c9c8640 1 --2- 172.21.15.137:0/1702441555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf7815d030 0x7fbf780b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7c9c8640 1 -- 172.21.15.137:0/1702441555 >> v1:172.21.15.137:6789/0 conn(0x7fbf780b6130 legacy=0x7fbf7815fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:00.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf777fe640 1 -- 172.21.15.137:0/1702441555 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2539097889 0 0) 0x7fbf780b4480 con 0x7fbf780b6130 2024-04-26T22:06:00.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.702+0000 7fbf7c9c8640 1 -- 172.21.15.137:0/1702441555 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf780b4d20 con 0x7fbf781459a0 2024-04-26T22:06:00.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf7c9c8640 1 --2- 172.21.15.137:0/1702441555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 0x7fbf780b3de0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009e50 tx=0x7fbf6802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d6a729fb9aa07f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:00.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf777fe640 1 -- 172.21.15.137:0/1702441555 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68036070 con 0x7fbf781459a0 2024-04-26T22:06:00.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf777fe640 1 -- 172.21.15.137:0/1702441555 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf68031600 con 0x7fbf781459a0 2024-04-26T22:06:00.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf777fe640 1 -- 172.21.15.137:0/1702441555 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf680319d0 con 0x7fbf781459a0 2024-04-26T22:06:00.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1702441555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 msgr2=0x7fbf780b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:00.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf7ec2c640 1 --2- 172.21.15.137:0/1702441555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 0x7fbf780b3de0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009e50 tx=0x7fbf6802a710 comp rx=0 tx=0).stop 2024-04-26T22:06:00.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1702441555 shutdown_connections 2024-04-26T22:06:00.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf7ec2c640 1 --2- 172.21.15.137:0/1702441555 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf7815d030 0x7fbf780b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf7ec2c640 1 --2- 172.21.15.137:0/1702441555 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 0x7fbf780b3de0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.703+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1702441555 >> 172.21.15.137:0/1702441555 conn(0x7fbf780d0d30 msgr2=0x7fbf780d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:00.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.704+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1702441555 shutdown_connections 2024-04-26T22:06:00.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.704+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1702441555 wait complete. 2024-04-26T22:06:00.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.705+0000 7fbf7ec2c640 1 Processor -- start 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.705+0000 7fbf7ec2c640 1 -- start start 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.705+0000 7fbf7ec2c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf780b6130 0x7fbf7815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.705+0000 7fbf7ec2c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 0x7fbf7815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.705+0000 7fbf7ec2c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf7815d030 0x7fbf7815bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.705+0000 7fbf7ec2c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbf78073100 con 0x7fbf781459a0 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.705+0000 7fbf7ec2c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7815d470 con 0x7fbf780b6130 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.705+0000 7fbf7ec2c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbf78073280 con 0x7fbf7815d030 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf77fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 0x7fbf7815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf77fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 0x7fbf7815b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49674/0 (socket says 172.21.15.137:49674) 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf77fff640 1 -- 172.21.15.137:0/1984153233 learned_addr learned my addr 172.21.15.137:0/1984153233 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf7c9c8640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf780b6130 0x7fbf7815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf7d1c9640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf7815d030 0x7fbf7815bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:00.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf77fff640 1 -- 172.21.15.137:0/1984153233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf7815d030 msgr2=0x7fbf7815bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf77fff640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf7815d030 0x7fbf7815bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf77fff640 1 -- 172.21.15.137:0/1984153233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf780b6130 msgr2=0x7fbf7815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf77fff640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf780b6130 0x7fbf7815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf77fff640 1 -- 172.21.15.137:0/1984153233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf780b0960 con 0x7fbf781459a0 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf7c9c8640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf780b6130 0x7fbf7815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf77fff640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 0x7fbf7815b600 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00b440 tx=0x7fbf6c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf757fa640 1 -- 172.21.15.137:0/1984153233 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c015020 con 0x7fbf781459a0 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf757fa640 1 -- 172.21.15.137:0/1984153233 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6c011890 con 0x7fbf781459a0 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf757fa640 1 -- 172.21.15.137:0/1984153233 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c011c80 con 0x7fbf781459a0 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf780b0c40 con 0x7fbf781459a0 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.706+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf780b1200 con 0x7fbf781459a0 2024-04-26T22:06:00.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.707+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7806a290 con 0x7fbf781459a0 2024-04-26T22:06:00.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.708+0000 7fbf757fa640 1 -- 172.21.15.137:0/1984153233 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf6c018020 con 0x7fbf781459a0 2024-04-26T22:06:00.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.708+0000 7fbf757fa640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6406c8f0 0x7fbf6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:00.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.708+0000 7fbf757fa640 1 -- 172.21.15.137:0/1984153233 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5227+0+0 (secure 0 0 0) 0x7fbf6c08ba60 con 0x7fbf781459a0 2024-04-26T22:06:00.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.708+0000 7fbf7c9c8640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6406c8f0 0x7fbf6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:00.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.709+0000 7fbf7c9c8640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6406c8f0 0x7fbf6406edb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbf68033000 tx=0x7fbf68009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:00.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.713+0000 7fbf757fa640 1 -- 172.21.15.137:0/1984153233 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbf6c01f020 con 0x7fbf781459a0 2024-04-26T22:06:00.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:00.890+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbf78073ca0 con 0x7fbf781459a0 2024-04-26T22:06:01.580 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.580+0000 7fbf757fa640 1 -- 172.21.15.137:0/1984153233 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v101) ==== 170+0+0 (secure 0 0 0) 0x7fbf6c00d040 con 0x7fbf781459a0 2024-04-26T22:06:01.580 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T22:06:01.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6406c8f0 msgr2=0x7fbf6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:01.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6406c8f0 0x7fbf6406edb0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbf68033000 tx=0x7fbf68009000 comp rx=0 tx=0).stop 2024-04-26T22:06:01.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 msgr2=0x7fbf7815b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:01.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 0x7fbf7815b600 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00b440 tx=0x7fbf6c00b900 comp rx=0 tx=0).stop 2024-04-26T22:06:01.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 shutdown_connections 2024-04-26T22:06:01.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbf6406c8f0 0x7fbf6406edb0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbf781459a0 0x7fbf7815b600 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbf7815d030 0x7fbf7815bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 --2- 172.21.15.137:0/1984153233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf780b6130 0x7fbf7815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 >> 172.21.15.137:0/1984153233 conn(0x7fbf780d0d30 msgr2=0x7fbf7815fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:01.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 shutdown_connections 2024-04-26T22:06:01.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.583+0000 7fbf7ec2c640 1 -- 172.21.15.137:0/1984153233 wait complete. 2024-04-26T22:06:01.611 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T22:06:01.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.714+0000 7f84dc8d3640 1 Processor -- start 2024-04-26T22:06:01.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.714+0000 7f84dc8d3640 1 -- start start 2024-04-26T22:06:01.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84dc8d3640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f84d80d1be0 0x7f84d80d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:01.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84dc8d3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d80ba3a0 0x7f84d80ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:01.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84dc8d3640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d80d4240 con 0x7f84d815f490 2024-04-26T22:06:01.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84dc8d3640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f84d80d31a0 con 0x7f84d80d1be0 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84dc8d3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f84d80d3480 con 0x7f84d80ba3a0 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d659c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f84d815f490 0x7f84d80d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40442/0 (socket says 172.21.15.137:40442) 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d659c640 1 -- 172.21.15.137:0/2697559057 learned_addr learned my addr 172.21.15.137:0/2697559057 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d5d9b640 1 --2- 172.21.15.137:0/2697559057 >> v2:172.21.15.170:3300/0 conn(0x7f84d80d1be0 0x7f84d80d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d6d9d640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d80ba3a0 0x7f84d80ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156890938 0 0) 0x7f84d80d4240 con 0x7f84d815f490 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84c0003520 con 0x7f84d815f490 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2186962585 0 0) 0x7f84c0003520 con 0x7f84d815f490 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d80ba3a0 msgr2=0x7f84d80ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d80ba3a0 0x7f84d80ba7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 >> v2:172.21.15.170:3300/0 conn(0x7f84d80d1be0 msgr2=0x7f84d80d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 --2- 172.21.15.137:0/2697559057 >> v2:172.21.15.170:3300/0 conn(0x7f84d80d1be0 0x7f84d80d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d80d3760 con 0x7f84d815f490 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f84c8001670 con 0x7f84d815f490 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.715+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 >> v1:172.21.15.137:6789/0 conn(0x7f84d815f490 legacy=0x7f84d80d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d559a640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d80ba3a0 0x7f84c00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d559a640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c0003f30 0x7f84c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d559a640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c0004d40 0x7f84c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80d31a0 con 0x7f84c0004d40 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80d3480 con 0x7f84c0003f30 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f84c000b9c0 con 0x7f84d80ba3a0 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d6d9d640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c0004d40 0x7f84c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d659c640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d80ba3a0 0x7f84c00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d5d9b640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c0003f30 0x7f84c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d6d9d640 1 -- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d80ba3a0 msgr2=0x7f84c00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d6d9d640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84d80ba3a0 0x7f84c00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d6d9d640 1 -- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c0003f30 msgr2=0x7f84c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d6d9d640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c0003f30 0x7f84c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.716+0000 7f84d6d9d640 1 -- 172.21.15.137:0/2697559057 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c0003520 con 0x7f84c0004d40 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84d6d9d640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c0004d40 0x7f84c00051c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009fc0 tx=0x7f84c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0d1a122e236f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0009c10 con 0x7f84c0004d40 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d0036070 con 0x7f84c0004d40 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84d559a640 1 -- 172.21.15.137:0/2697559057 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0031670 con 0x7f84c0004d40 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84dc8d3640 1 -- 172.21.15.137:0/2697559057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c0004d40 msgr2=0x7f84c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84dc8d3640 1 --2- 172.21.15.137:0/2697559057 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84c0004d40 0x7f84c00051c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009fc0 tx=0x7f84c0005830 comp rx=0 tx=0).stop 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84d6d9d640 1 -- 172.21.15.137:0/2697559057 reap_dead start 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84dc8d3640 1 -- 172.21.15.137:0/2697559057 shutdown_connections 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84dc8d3640 1 -- 172.21.15.137:0/2697559057 >> 172.21.15.137:0/2697559057 conn(0x7f84d809e530 msgr2=0x7f84d80d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84dc8d3640 1 -- 172.21.15.137:0/2697559057 shutdown_connections 2024-04-26T22:06:01.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.717+0000 7f84dc8d3640 1 -- 172.21.15.137:0/2697559057 wait complete. 2024-04-26T22:06:01.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.719+0000 7f84dc8d3640 1 Processor -- start 2024-04-26T22:06:01.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.719+0000 7f84dc8d3640 1 -- start start 2024-04-26T22:06:01.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.719+0000 7f84dc8d3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84c0004d40 0x7f84d80c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:01.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.719+0000 7f84dc8d3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d8156640 0x7f84d80ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:01.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.719+0000 7f84dc8d3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84d814c340 0x7f84d80b8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.719+0000 7f84dc8d3640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80d11c0 con 0x7f84d814c340 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.719+0000 7f84dc8d3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f84d80d3d20 con 0x7f84d8156640 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.719+0000 7f84dc8d3640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f84d815f870 con 0x7f84c0004d40 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84d814c340 0x7f84d80b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d6d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84d814c340 0x7f84d80b8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49702/0 (socket says 172.21.15.137:49702) 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d6d9d640 1 -- 172.21.15.137:0/199622483 learned_addr learned my addr 172.21.15.137:0/199622483 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d659c640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84c0004d40 0x7f84d80c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d5d9b640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d8156640 0x7f84d80ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d6d9d640 1 -- 172.21.15.137:0/199622483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84c0004d40 msgr2=0x7f84d80c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d6d9d640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84c0004d40 0x7f84d80c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d6d9d640 1 -- 172.21.15.137:0/199622483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d8156640 msgr2=0x7f84d80ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d6d9d640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d8156640 0x7f84d80ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d6d9d640 1 -- 172.21.15.137:0/199622483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d80c9230 con 0x7f84d814c340 2024-04-26T22:06:01.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84d6d9d640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84d814c340 0x7f84d80b8670 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f84d0033040 tx=0x7f84d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84c6ffd640 1 -- 172.21.15.137:0/199622483 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0009c10 con 0x7f84d814c340 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84c6ffd640 1 -- 172.21.15.137:0/199622483 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d0031dd0 con 0x7f84d814c340 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d80c9510 con 0x7f84d814c340 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84c6ffd640 1 -- 172.21.15.137:0/199622483 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0003bd0 con 0x7f84d814c340 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.720+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d80c9ad0 con 0x7f84d814c340 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.721+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d806a290 con 0x7f84d814c340 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.722+0000 7f84c6ffd640 1 -- 172.21.15.137:0/199622483 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84d0005d10 con 0x7f84d814c340 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.722+0000 7f84c6ffd640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84b806c920 0x7f84b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.722+0000 7f84c6ffd640 1 -- 172.21.15.137:0/199622483 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5609+0+0 (secure 0 0 0) 0x7f84d00accb0 con 0x7f84d814c340 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.722+0000 7f84d659c640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84b806c920 0x7f84b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:01.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.723+0000 7f84d659c640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84b806c920 0x7f84b806ede0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f84c8007df0 tx=0x7f84c80078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:01.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.727+0000 7f84c6ffd640 1 -- 172.21.15.137:0/199622483 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f84d0049060 con 0x7f84d814c340 2024-04-26T22:06:01.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:01.939+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f84d815fae0 con 0x7f84d814c340 2024-04-26T22:06:02.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.588+0000 7f84c6ffd640 1 -- 172.21.15.137:0/199622483 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v64) ==== 174+0+0 (secure 0 0 0) 0x7f84d007b140 con 0x7f84d814c340 2024-04-26T22:06:02.588 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 14 and data pool 15 2024-04-26T22:06:02.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84b806c920 msgr2=0x7f84b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:02.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84b806c920 0x7f84b806ede0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f84c8007df0 tx=0x7f84c80078f0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84d814c340 msgr2=0x7f84d80b8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:02.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84d814c340 0x7f84d80b8670 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f84d0033040 tx=0x7f84d0009750 comp rx=0 tx=0).stop 2024-04-26T22:06:02.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 shutdown_connections 2024-04-26T22:06:02.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f84b806c920 0x7f84b806ede0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f84d814c340 0x7f84d80b8670 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84d8156640 0x7f84d80ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 --2- 172.21.15.137:0/199622483 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f84c0004d40 0x7f84d80c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 >> 172.21.15.137:0/199622483 conn(0x7f84d809e530 msgr2=0x7f84d815fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:02.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 shutdown_connections 2024-04-26T22:06:02.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.591+0000 7f84dc8d3640 1 -- 172.21.15.137:0/199622483 wait complete. 2024-04-26T22:06:02.617 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:06:02.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.716+0000 7f92de883640 1 Processor -- start 2024-04-26T22:06:02.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.716+0000 7f92de883640 1 -- start start 2024-04-26T22:06:02.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.717+0000 7f92de883640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92d815d120 0x7f92d80cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:02.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.717+0000 7f92de883640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f92d80d3570 0x7f92d80b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:02.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.717+0000 7f92de883640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d80b3a50 con 0x7f92d80cdfd0 2024-04-26T22:06:02.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.717+0000 7f92de883640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f92d80b3d30 con 0x7f92d80d3570 2024-04-26T22:06:02.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.717+0000 7f92de883640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f92d80d0c80 con 0x7f92d815d120 2024-04-26T22:06:02.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.717+0000 7f92d77fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f92d80cdfd0 0x7f92d80d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40452/0 (socket says 172.21.15.137:40452) 2024-04-26T22:06:02.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.717+0000 7f92d77fe640 1 -- 172.21.15.137:0/2620931534 learned_addr learned my addr 172.21.15.137:0/2620931534 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:02.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938242504 0 0) 0x7f92d80b3a50 con 0x7f92d80cdfd0 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d7fff640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92d815d120 0x7f92d80cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92c0003520 con 0x7f92d80cdfd0 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92dce20640 1 --2- 172.21.15.137:0/2620931534 >> v2:172.21.15.170:3300/0 conn(0x7f92d80d3570 0x7f92d80b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4139801180 0 0) 0x7f92c0003520 con 0x7f92d80cdfd0 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92d815d120 msgr2=0x7f92d80cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92d815d120 0x7f92d80cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 >> v2:172.21.15.170:3300/0 conn(0x7f92d80d3570 msgr2=0x7f92d80b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 --2- 172.21.15.137:0/2620931534 >> v2:172.21.15.170:3300/0 conn(0x7f92d80d3570 0x7f92d80b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d80d0f60 con 0x7f92d80cdfd0 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f92cc001670 con 0x7f92d80cdfd0 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 >> v1:172.21.15.137:6789/0 conn(0x7f92d80cdfd0 legacy=0x7f92d80d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c00039b0 0x7f92c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92c0004800 0x7f92c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:02.721 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92d815d120 0x7f92c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80b3d30 con 0x7f92c00039b0 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80d0c80 con 0x7f92c0004800 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f92c000b9c0 con 0x7f92d815d120 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d7fff640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c00039b0 0x7f92c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d77fe640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92c0004800 0x7f92c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92dce20640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92d815d120 0x7f92c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d7fff640 1 -- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92d815d120 msgr2=0x7f92c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d7fff640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92d815d120 0x7f92c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d7fff640 1 -- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92c0004800 msgr2=0x7f92c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d7fff640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92c0004800 0x7f92c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.718+0000 7f92d7fff640 1 -- 172.21.15.137:0/2620931534 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c0003520 con 0x7f92c00039b0 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.719+0000 7f92d7fff640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c00039b0 0x7f92c0003dd0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009ac0 tx=0x7f92c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797437b7941cc65e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:02.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.719+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c8036070 con 0x7f92c00039b0 2024-04-26T22:06:02.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.719+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c8031400 con 0x7f92c00039b0 2024-04-26T22:06:02.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.719+0000 7f92d6ffd640 1 -- 172.21.15.137:0/2620931534 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c8009690 con 0x7f92c00039b0 2024-04-26T22:06:02.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.720+0000 7f92de883640 1 -- 172.21.15.137:0/2620931534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c00039b0 msgr2=0x7f92c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:02.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.720+0000 7f92de883640 1 --2- 172.21.15.137:0/2620931534 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92c00039b0 0x7f92c0003dd0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009ac0 tx=0x7f92c0005830 comp rx=0 tx=0).stop 2024-04-26T22:06:02.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.720+0000 7f92dce20640 1 -- 172.21.15.137:0/2620931534 reap_dead start 2024-04-26T22:06:02.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.720+0000 7f92de883640 1 -- 172.21.15.137:0/2620931534 shutdown_connections 2024-04-26T22:06:02.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.720+0000 7f92de883640 1 -- 172.21.15.137:0/2620931534 >> 172.21.15.137:0/2620931534 conn(0x7f92d809ba40 msgr2=0x7f92d809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:02.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.720+0000 7f92de883640 1 -- 172.21.15.137:0/2620931534 shutdown_connections 2024-04-26T22:06:02.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.720+0000 7f92de883640 1 -- 172.21.15.137:0/2620931534 wait complete. 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.721+0000 7f92de883640 1 Processor -- start 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.721+0000 7f92de883640 1 -- start start 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92de883640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92c00039b0 0x7f92d815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92de883640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d81538b0 0x7f92d81f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92de883640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92d81f9710 0x7f92d81f9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92de883640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80cdc10 con 0x7f92d81f9710 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92de883640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f92d80cda90 con 0x7f92d81538b0 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92de883640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f92d80cdd90 con 0x7f92c00039b0 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92dce20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92d81f9710 0x7f92d81f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92dce20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92d81f9710 0x7f92d81f9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49728/0 (socket says 172.21.15.137:49728) 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92dce20640 1 -- 172.21.15.137:0/3528615126 learned_addr learned my addr 172.21.15.137:0/3528615126 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92d77fe640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d81538b0 0x7f92d81f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:02.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92d7fff640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92c00039b0 0x7f92d815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92dce20640 1 -- 172.21.15.137:0/3528615126 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92c00039b0 msgr2=0x7f92d815fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92dce20640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92c00039b0 0x7f92d815fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92dce20640 1 -- 172.21.15.137:0/3528615126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d81538b0 msgr2=0x7f92d81f91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92dce20640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d81538b0 0x7f92d81f91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92dce20640 1 -- 172.21.15.137:0/3528615126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d80b5650 con 0x7f92d81f9710 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92dce20640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92d81f9710 0x7f92d81f9b90 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f92d0011c80 tx=0x7f92d000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92d4ff9640 1 -- 172.21.15.137:0/3528615126 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0011e90 con 0x7f92d81f9710 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.722+0000 7f92d4ff9640 1 -- 172.21.15.137:0/3528615126 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d001d070 con 0x7f92d81f9710 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.723+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d815e3e0 con 0x7f92d81f9710 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.723+0000 7f92d4ff9640 1 -- 172.21.15.137:0/3528615126 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d0015670 con 0x7f92d81f9710 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.723+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d80b6f90 con 0x7f92d81f9710 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.723+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d806a290 con 0x7f92d81f9710 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.724+0000 7f92d4ff9640 1 -- 172.21.15.137:0/3528615126 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92d0015810 con 0x7f92d81f9710 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.724+0000 7f92d4ff9640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f92c406ca90 0x7f92c406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:02.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.724+0000 7f92d4ff9640 1 -- 172.21.15.137:0/3528615126 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f92d008c320 con 0x7f92d81f9710 2024-04-26T22:06:02.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.724+0000 7f92d7fff640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f92c406ca90 0x7f92c406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:02.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.725+0000 7f92d7fff640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f92c406ca90 0x7f92c406ef50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f92c8033000 tx=0x7f92c8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:02.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.729+0000 7f92d4ff9640 1 -- 172.21.15.137:0/3528615126 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f92d0010040 con 0x7f92d81f9710 2024-04-26T22:06:02.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.907+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92d8161460 con 0x7f92d81f9710 2024-04-26T22:06:02.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.908+0000 7f92d4ff9640 1 -- 172.21.15.137:0/3528615126 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16644 (secure 0 0 0) 0x7f92d0089120 con 0x7f92d81f9710 2024-04-26T22:06:02.908 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:02.908 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":102,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:06:01.940568+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:06:00.152074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-26T22:06:00.894660+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:06:02.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f92c406ca90 msgr2=0x7f92c406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:02.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f92c406ca90 0x7f92c406ef50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f92c8033000 tx=0x7f92c8008030 comp rx=0 tx=0).stop 2024-04-26T22:06:02.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92d81f9710 msgr2=0x7f92d81f9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:02.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92d81f9710 0x7f92d81f9b90 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f92d0011c80 tx=0x7f92d000f580 comp rx=0 tx=0).stop 2024-04-26T22:06:02.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 shutdown_connections 2024-04-26T22:06:02.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f92c406ca90 0x7f92c406ef50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f92d81f9710 0x7f92d81f9b90 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92d81538b0 0x7f92d81f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 --2- 172.21.15.137:0/3528615126 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f92c00039b0 0x7f92d815fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:02.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 >> 172.21.15.137:0/3528615126 conn(0x7f92d809ba40 msgr2=0x7f92d80b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:02.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 shutdown_connections 2024-04-26T22:06:02.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:02.910+0000 7f92de883640 1 -- 172.21.15.137:0/3528615126 wait complete. 2024-04-26T22:06:02.921 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:06:03.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.018+0000 7fa4b026d640 1 Processor -- start 2024-04-26T22:06:03.019 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.018+0000 7fa4b026d640 1 -- start start 2024-04-26T22:06:03.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.019+0000 7fa4b026d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa4a80d11b0 0x7fa4a806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.019+0000 7fa4b026d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806e2c0 0x7fa4a815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.019+0000 7fa4b026d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a80d1740 con 0x7fa4a80cf2e0 2024-04-26T22:06:03.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.019+0000 7fa4b026d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa4a806e750 con 0x7fa4a80d11b0 2024-04-26T22:06:03.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.019+0000 7fa4b026d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a80d1a20 con 0x7fa4a806e2c0 2024-04-26T22:06:03.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.019+0000 7fa4ae009640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa4a80cf2e0 0x7fa4a806d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40454/0 (socket says 172.21.15.137:40454) 2024-04-26T22:06:03.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.019+0000 7fa4ae009640 1 -- 172.21.15.137:0/3892680269 learned_addr learned my addr 172.21.15.137:0/3892680269 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:03.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae80a640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806e2c0 0x7fa4a815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad808640 1 --2- 172.21.15.137:0/3892680269 >> v2:172.21.15.170:3300/0 conn(0x7fa4a80d11b0 0x7fa4a806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792394132 0 0) 0x7fa4a80d1740 con 0x7fa4a80cf2e0 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa494003520 con 0x7fa4a80cf2e0 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1676614664 0 0) 0x7fa494003520 con 0x7fa4a80cf2e0 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806e2c0 msgr2=0x7fa4a815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806e2c0 0x7fa4a815ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 >> v2:172.21.15.170:3300/0 conn(0x7fa4a80d11b0 msgr2=0x7fa4a806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 --2- 172.21.15.137:0/3892680269 >> v2:172.21.15.170:3300/0 conn(0x7fa4a80d11b0 0x7fa4a806dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a80d1d00 con 0x7fa4a80cf2e0 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fa4a40019f0 con 0x7fa4a80cf2e0 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae80a640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806e2c0 0x7fa4a815ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 >> v1:172.21.15.137:6789/0 conn(0x7fa4a80cf2e0 legacy=0x7fa4a806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4940039b0 0x7fa494003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806e2c0 0x7fa494004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa494004d40 0x7fa4940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a806e750 con 0x7fa4940039b0 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a80d1a20 con 0x7fa494004d40 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa49400b9c0 con 0x7fa4a806e2c0 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad808640 1 --2- 172.21.15.137:0/3892680269 >> v2:172.21.15.170:3300/0 conn(0x7fa4a80d11b0 0x7fa4a806dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae009640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4940039b0 0x7fa494003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae80a640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa494004d40 0x7fa4940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ad808640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806e2c0 0x7fa494004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae009640 1 -- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806e2c0 msgr2=0x7fa494004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae009640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4a806e2c0 0x7fa494004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae009640 1 -- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa494004d40 msgr2=0x7fa4940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae009640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa494004d40 0x7fa4940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae009640 1 -- 172.21.15.137:0/3892680269 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa494003520 con 0x7fa4940039b0 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.020+0000 7fa4ae80a640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa494004d40 0x7fa4940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.021+0000 7fa4ae009640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4940039b0 0x7fa494003dd0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400a850 tx=0x7fa494005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779d0eef720ca2ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.021+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400a4a0 con 0x7fa4940039b0 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.021+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a402f070 con 0x7fa4940039b0 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.021+0000 7fa4ad007640 1 -- 172.21.15.137:0/3892680269 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a402bce0 con 0x7fa4940039b0 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.022+0000 7fa4b026d640 1 -- 172.21.15.137:0/3892680269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4940039b0 msgr2=0x7fa494003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.022+0000 7fa4b026d640 1 --2- 172.21.15.137:0/3892680269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4940039b0 0x7fa494003dd0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400a850 tx=0x7fa494005830 comp rx=0 tx=0).stop 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.022+0000 7fa4ae80a640 1 -- 172.21.15.137:0/3892680269 reap_dead start 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.022+0000 7fa4b026d640 1 -- 172.21.15.137:0/3892680269 shutdown_connections 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.022+0000 7fa4b026d640 1 -- 172.21.15.137:0/3892680269 >> 172.21.15.137:0/3892680269 conn(0x7fa4a80b4a60 msgr2=0x7fa4a80b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.022+0000 7fa4b026d640 1 -- 172.21.15.137:0/3892680269 shutdown_connections 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.022+0000 7fa4b026d640 1 -- 172.21.15.137:0/3892680269 wait complete. 2024-04-26T22:06:03.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.023+0000 7fa4b026d640 1 Processor -- start 2024-04-26T22:06:03.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.023+0000 7fa4b026d640 1 -- start start 2024-04-26T22:06:03.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4b026d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4940039b0 0x7fa4a80b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4b026d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a80afd20 0x7fa4a80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4b026d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4a80b5b00 0x7fa4a80b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4b026d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a80cf6c0 con 0x7fa4a80b5b00 2024-04-26T22:06:03.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4b026d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a80d22c0 con 0x7fa4a80afd20 2024-04-26T22:06:03.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4b026d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a80cf840 con 0x7fa4940039b0 2024-04-26T22:06:03.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae80a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4a80b5b00 0x7fa4a80b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae80a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4a80b5b00 0x7fa4a80b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49760/0 (socket says 172.21.15.137:49760) 2024-04-26T22:06:03.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae80a640 1 -- 172.21.15.137:0/1654224827 learned_addr learned my addr 172.21.15.137:0/1654224827 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:03.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae009640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4940039b0 0x7fa4a80b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ad808640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a80afd20 0x7fa4a80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae80a640 1 -- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4940039b0 msgr2=0x7fa4a80b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae80a640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4940039b0 0x7fa4a80b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae80a640 1 -- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a80afd20 msgr2=0x7fa4a80b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae80a640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a80afd20 0x7fa4a80b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae80a640 1 -- 172.21.15.137:0/1654224827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a80b3b90 con 0x7fa4a80b5b00 2024-04-26T22:06:03.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ad808640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a80afd20 0x7fa4a80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:03.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae009640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4940039b0 0x7fa4a80b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:03.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4ae80a640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4a80b5b00 0x7fa4a80b5f80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8073840 tx=0x7fa4a0011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:03.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa49effd640 1 -- 172.21.15.137:0/1654224827 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0019020 con 0x7fa4a80b5b00 2024-04-26T22:06:03.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa49effd640 1 -- 172.21.15.137:0/1654224827 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a0004440 con 0x7fa4a80b5b00 2024-04-26T22:06:03.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a80b1480 con 0x7fa4a80b5b00 2024-04-26T22:06:03.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.024+0000 7fa49effd640 1 -- 172.21.15.137:0/1654224827 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0003830 con 0x7fa4a80b5b00 2024-04-26T22:06:03.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.025+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a80b0be0 con 0x7fa4a80b5b00 2024-04-26T22:06:03.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.025+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a806a290 con 0x7fa4a80b5b00 2024-04-26T22:06:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.026+0000 7fa49effd640 1 -- 172.21.15.137:0/1654224827 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4a001c020 con 0x7fa4a80b5b00 2024-04-26T22:06:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.026+0000 7fa49effd640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa48c06c8f0 0x7fa48c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.026+0000 7fa49effd640 1 -- 172.21.15.137:0/1654224827 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7fa4a008bc80 con 0x7fa4a80b5b00 2024-04-26T22:06:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.026+0000 7fa4ae009640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa48c06c8f0 0x7fa48c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.034 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.027+0000 7fa4ae009640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa48c06c8f0 0x7fa48c06edb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4033000 tx=0x7fa4a4009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:03.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.031+0000 7fa49effd640 1 -- 172.21.15.137:0/1654224827 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa4a0023030 con 0x7fa4a80b5b00 2024-04-26T22:06:03.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.208+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4a809c920 con 0x7fa4a80b5b00 2024-04-26T22:06:03.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.209+0000 7fa49effd640 1 -- 172.21.15.137:0/1654224827 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16644 (secure 0 0 0) 0x7fa4a80b1480 con 0x7fa4a80b5b00 2024-04-26T22:06:03.209 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:03.209 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":102,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:06:01.940568+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:06:00.152074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-26T22:06:00.894660+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:06:03.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa48c06c8f0 msgr2=0x7fa48c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa48c06c8f0 0x7fa48c06edb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4033000 tx=0x7fa4a4009030 comp rx=0 tx=0).stop 2024-04-26T22:06:03.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4a80b5b00 msgr2=0x7fa4a80b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4a80b5b00 0x7fa4a80b5f80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8073840 tx=0x7fa4a0011920 comp rx=0 tx=0).stop 2024-04-26T22:06:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 shutdown_connections 2024-04-26T22:06:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa48c06c8f0 0x7fa48c06edb0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa4a80b5b00 0x7fa4a80b5f80 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4a80afd20 0x7fa4a80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 --2- 172.21.15.137:0/1654224827 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa4940039b0 0x7fa4a80b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 >> 172.21.15.137:0/1654224827 conn(0x7fa4a80b4a60 msgr2=0x7fa4a80c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 shutdown_connections 2024-04-26T22:06:03.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.211+0000 7fa4b026d640 1 -- 172.21.15.137:0/1654224827 wait complete. 2024-04-26T22:06:03.222 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T22:06:03.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.322+0000 7ff767bb4640 1 Processor -- start 2024-04-26T22:06:03.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.322+0000 7ff767bb4640 1 -- start start 2024-04-26T22:06:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff767bb4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff7600d3820 0x7ff7600b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff767bb4640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7600d3c90 con 0x7ff7600b60b0 2024-04-26T22:06:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff767bb4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7600d3f50 con 0x7ff76015f680 2024-04-26T22:06:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff767bb4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff76015fa60 con 0x7ff7600d3820 2024-04-26T22:06:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff766151640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff7600b60b0 0x7ff7600d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40468/0 (socket says 172.21.15.137:40468) 2024-04-26T22:06:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff766151640 1 -- 172.21.15.137:0/3408044851 learned_addr learned my addr 172.21.15.137:0/3408044851 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 925188054 0 0) 0x7ff7600d3c90 con 0x7ff7600b60b0 2024-04-26T22:06:03.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff74c003520 con 0x7ff7600b60b0 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76514f640 1 --2- 172.21.15.137:0/3408044851 >> v2:172.21.15.170:3300/0 conn(0x7ff7600d3820 0x7ff7600b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1093656649 0 0) 0x7ff74c003520 con 0x7ff7600b60b0 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 >> v2:172.21.15.170:3300/0 conn(0x7ff7600d3820 msgr2=0x7ff7600b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76494e640 1 --2- 172.21.15.137:0/3408044851 >> v2:172.21.15.170:3300/0 conn(0x7ff7600d3820 0x7ff7600b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 >> v1:172.21.15.170:6789/0 conn(0x7ff76015f680 legacy=0x7ff760163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7600b5090 con 0x7ff7600b60b0 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7ff7580019f0 con 0x7ff7600b60b0 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.323+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 >> v1:172.21.15.137:6789/0 conn(0x7ff7600b60b0 legacy=0x7ff7600d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76494e640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff74c0039b0 0x7ff74c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76494e640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff74c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76494e640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff74c0051c0 0x7ff74c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff76015fa60 con 0x7ff74c004800 2024-04-26T22:06:03.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c00c110 con 0x7ff74c0039b0 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c00c310 con 0x7ff74c0051c0 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76514f640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff74c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff765950640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff74c0039b0 0x7ff74c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff766151640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff74c0051c0 0x7ff74c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76514f640 1 -- 172.21.15.137:0/3408044851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff74c0051c0 msgr2=0x7ff74c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76514f640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff74c0051c0 0x7ff74c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76514f640 1 -- 172.21.15.137:0/3408044851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff74c0039b0 msgr2=0x7ff74c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76514f640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff74c0039b0 0x7ff74c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff76514f640 1 -- 172.21.15.137:0/3408044851 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c003520 con 0x7ff74c004800 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff766151640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff74c0051c0 0x7ff74c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.324+0000 7ff766151640 1 -- 172.21.15.137:0/3408044851 reap_dead start 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff76514f640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff74c004c80 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00ba30 tx=0x7ff74c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a109f3e0a4b1e4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c030070 con 0x7ff74c004800 2024-04-26T22:06:03.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c02ade0 con 0x7ff74c004800 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff76494e640 1 -- 172.21.15.137:0/3408044851 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00b600 con 0x7ff74c004800 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff767bb4640 1 -- 172.21.15.137:0/3408044851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 msgr2=0x7ff74c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff767bb4640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff74c004c80 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00ba30 tx=0x7ff74c005830 comp rx=0 tx=0).stop 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff767bb4640 1 -- 172.21.15.137:0/3408044851 shutdown_connections 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff767bb4640 1 --2- 172.21.15.137:0/3408044851 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff74c004c80 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff767bb4640 1 -- 172.21.15.137:0/3408044851 >> 172.21.15.137:0/3408044851 conn(0x7ff76008eca0 msgr2=0x7ff76009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff767bb4640 1 -- 172.21.15.137:0/3408044851 shutdown_connections 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.325+0000 7ff767bb4640 1 -- 172.21.15.137:0/3408044851 wait complete. 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.326+0000 7ff767bb4640 1 Processor -- start 2024-04-26T22:06:03.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.326+0000 7ff767bb4640 1 -- start start 2024-04-26T22:06:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff767bb4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff7601548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff767bb4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff760153a10 0x7ff7600ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff767bb4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7600ceb10 0x7ff7600cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff767bb4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff7600b5cf0 con 0x7ff74c004800 2024-04-26T22:06:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff767bb4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff7600b5b70 con 0x7ff760153a10 2024-04-26T22:06:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff767bb4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff7600b5e70 con 0x7ff7600ceb10 2024-04-26T22:06:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff765950640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff7601548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff765950640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff7601548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49778/0 (socket says 172.21.15.137:49778) 2024-04-26T22:06:03.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff765950640 1 -- 172.21.15.137:0/2970658076 learned_addr learned my addr 172.21.15.137:0/2970658076 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff76514f640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff760153a10 0x7ff7600ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.327+0000 7ff766151640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7600ceb10 0x7ff7600cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff765950640 1 -- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7600ceb10 msgr2=0x7ff7600cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff765950640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7600ceb10 0x7ff7600cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff765950640 1 -- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff760153a10 msgr2=0x7ff7600ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff765950640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff760153a10 0x7ff7600ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff765950640 1 -- 172.21.15.137:0/2970658076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff760160530 con 0x7ff74c004800 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff766151640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7600ceb10 0x7ff7600cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff76514f640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff760153a10 0x7ff7600ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff765950640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff7601548b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7ff75000f5f0 tx=0x7ff75000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff7567fc640 1 -- 172.21.15.137:0/2970658076 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500052e0 con 0x7ff74c004800 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff7567fc640 1 -- 172.21.15.137:0/2970658076 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff750018070 con 0x7ff74c004800 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff760160810 con 0x7ff74c004800 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff7567fc640 1 -- 172.21.15.137:0/2970658076 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff750003810 con 0x7ff74c004800 2024-04-26T22:06:03.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.328+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff760160dd0 con 0x7ff74c004800 2024-04-26T22:06:03.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.329+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff76006a290 con 0x7ff74c004800 2024-04-26T22:06:03.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.329+0000 7ff7567fc640 1 -- 172.21.15.137:0/2970658076 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7500039b0 con 0x7ff74c004800 2024-04-26T22:06:03.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.330+0000 7ff7567fc640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff74406c920 0x7ff74406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.330+0000 7ff7567fc640 1 -- 172.21.15.137:0/2970658076 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7ff75008b4d0 con 0x7ff74c004800 2024-04-26T22:06:03.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.330+0000 7ff76514f640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff74406c920 0x7ff74406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.330+0000 7ff76514f640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff74406c920 0x7ff74406ede0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00ba00 tx=0x7ff75c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:03.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.334+0000 7ff7567fc640 1 -- 172.21.15.137:0/2970658076 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff7500599c0 con 0x7ff74c004800 2024-04-26T22:06:03.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.544+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff7600b4cd0 con 0x7ff74c004800 2024-04-26T22:06:03.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.612+0000 7ff7567fc640 1 -- 172.21.15.137:0/2970658076 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) ==== 118+0+0 (secure 0 0 0) 0x7ff750089e20 con 0x7ff74c004800 2024-04-26T22:06:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff74406c920 msgr2=0x7ff74406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff74406c920 0x7ff74406ede0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00ba00 tx=0x7ff75c030000 comp rx=0 tx=0).stop 2024-04-26T22:06:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 msgr2=0x7ff7601548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff7601548b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7ff75000f5f0 tx=0x7ff75000fab0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 shutdown_connections 2024-04-26T22:06:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff74406c920 0x7ff74406ede0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff7600ceb10 0x7ff7600cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff760153a10 0x7ff7600ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 --2- 172.21.15.137:0/2970658076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff74c004800 0x7ff7601548b0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 >> 172.21.15.137:0/2970658076 conn(0x7ff76008eca0 msgr2=0x7ff7600b74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:03.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 shutdown_connections 2024-04-26T22:06:03.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.614+0000 7ff767bb4640 1 -- 172.21.15.137:0/2970658076 wait complete. 2024-04-26T22:06:03.624 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T22:06:03.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T22:06:03.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.725+0000 7fd34a2f1640 1 Processor -- start 2024-04-26T22:06:03.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.725+0000 7fd34a2f1640 1 -- start start 2024-04-26T22:06:03.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd34a2f1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd34415f490 0x7fd3440d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd34a2f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3440d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd34a2f1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3440d4240 con 0x7fd3440d2120 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd34a2f1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd3440d2570 con 0x7fd34415f490 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd34a2f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd3440d31a0 con 0x7fd3440d0ff0 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd343fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd34415f490 0x7fd3440d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd3437fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3440d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd343fff640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd34415f490 0x7fd3440d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:44556/0 (socket says 172.21.15.137:44556) 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd3437fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3440d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:47046/0 (socket says 172.21.15.137:47046) 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd343fff640 1 -- 172.21.15.137:0/4220587471 learned_addr learned my addr 172.21.15.137:0/4220587471 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.726+0000 7fd34888e640 1 --1- 172.21.15.137:0/4220587471 >> v1:172.21.15.170:6789/0 conn(0x7fd3440d2120 0x7fd3440ba3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:32824/0 (socket says 172.21.15.137:32824) 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.727+0000 7fd3437fe640 1 -- 172.21.15.137:0/4220587471 >> v2:172.21.15.170:3300/0 conn(0x7fd34415f490 msgr2=0x7fd3440d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.727+0000 7fd3437fe640 1 --2- 172.21.15.137:0/4220587471 >> v2:172.21.15.170:3300/0 conn(0x7fd34415f490 0x7fd3440d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.727+0000 7fd3437fe640 1 -- 172.21.15.137:0/4220587471 >> v1:172.21.15.170:6789/0 conn(0x7fd3440d2120 legacy=0x7fd3440ba3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.727+0000 7fd3437fe640 1 -- 172.21.15.137:0/4220587471 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3440d3480 con 0x7fd3440d0ff0 2024-04-26T22:06:03.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.727+0000 7fd343fff640 1 --2- 172.21.15.137:0/4220587471 >> v2:172.21.15.170:3300/0 conn(0x7fd34415f490 0x7fd3440d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.727+0000 7fd3437fe640 1 --2- 172.21.15.137:0/4220587471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3440d1be0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd3380097a0 tx=0x7fd33802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da464b2f10e7ddd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd342ffd640 1 -- 172.21.15.137:0/4220587471 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338037070 con 0x7fd3440d0ff0 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd342ffd640 1 -- 172.21.15.137:0/4220587471 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd338032440 con 0x7fd3440d0ff0 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd342ffd640 1 -- 172.21.15.137:0/4220587471 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338032810 con 0x7fd3440d0ff0 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd34a2f1640 1 -- 172.21.15.137:0/4220587471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 msgr2=0x7fd3440d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd34a2f1640 1 --2- 172.21.15.137:0/4220587471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3440d1be0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd3380097a0 tx=0x7fd33802a180 comp rx=0 tx=0).stop 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd34a2f1640 1 -- 172.21.15.137:0/4220587471 shutdown_connections 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd34a2f1640 1 --2- 172.21.15.137:0/4220587471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3440d1be0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd34a2f1640 1 --2- 172.21.15.137:0/4220587471 >> v2:172.21.15.170:3300/0 conn(0x7fd34415f490 0x7fd3440d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd34a2f1640 1 -- 172.21.15.137:0/4220587471 >> 172.21.15.137:0/4220587471 conn(0x7fd34409e530 msgr2=0x7fd3440d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd34a2f1640 1 -- 172.21.15.137:0/4220587471 shutdown_connections 2024-04-26T22:06:03.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.728+0000 7fd34a2f1640 1 -- 172.21.15.137:0/4220587471 wait complete. 2024-04-26T22:06:03.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.729+0000 7fd34a2f1640 1 Processor -- start 2024-04-26T22:06:03.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34a2f1640 1 -- start start 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34a2f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3441e9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34a2f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3440d2120 0x7fd3440cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34a2f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34415f490 0x7fd3440c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34a2f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440d3d20 con 0x7fd34415f490 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34a2f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd3440d3a40 con 0x7fd3440d2120 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34a2f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd34415f870 con 0x7fd3440d0ff0 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34888e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34415f490 0x7fd3440c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34888e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34415f490 0x7fd3440c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49794/0 (socket says 172.21.15.137:49794) 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd34888e640 1 -- 172.21.15.137:0/3983268997 learned_addr learned my addr 172.21.15.137:0/3983268997 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.730+0000 7fd343fff640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3441e9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd3437fe640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3440d2120 0x7fd3440cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd34888e640 1 -- 172.21.15.137:0/3983268997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 msgr2=0x7fd3441e9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd34888e640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3441e9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd34888e640 1 -- 172.21.15.137:0/3983268997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3440d2120 msgr2=0x7fd3440cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:03.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd34888e640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3440d2120 0x7fd3440cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:03.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd34888e640 1 -- 172.21.15.137:0/3983268997 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3440cbd30 con 0x7fd34415f490 2024-04-26T22:06:03.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd34888e640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34415f490 0x7fd3440c8b50 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00c730 tx=0x7fd33c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:03.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd340ff9640 1 -- 172.21.15.137:0/3983268997 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c017070 con 0x7fd34415f490 2024-04-26T22:06:03.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd340ff9640 1 -- 172.21.15.137:0/3983268997 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33c00ce40 con 0x7fd34415f490 2024-04-26T22:06:03.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd340ff9640 1 -- 172.21.15.137:0/3983268997 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00a840 con 0x7fd34415f490 2024-04-26T22:06:03.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3440cc010 con 0x7fd34415f490 2024-04-26T22:06:03.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.731+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3440b9780 con 0x7fd34415f490 2024-04-26T22:06:03.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.732+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd344075a40 con 0x7fd34415f490 2024-04-26T22:06:03.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.732+0000 7fd340ff9640 1 -- 172.21.15.137:0/3983268997 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd33c01a070 con 0x7fd34415f490 2024-04-26T22:06:03.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.733+0000 7fd340ff9640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd33006c8f0 0x7fd33006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:03.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.733+0000 7fd340ff9640 1 -- 172.21.15.137:0/3983268997 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fd33c08afa0 con 0x7fd34415f490 2024-04-26T22:06:03.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.733+0000 7fd343fff640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd33006c8f0 0x7fd33006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:03.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.733+0000 7fd343fff640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd33006c8f0 0x7fd33006edb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd334009ac0 tx=0x7fd334008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:03.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.737+0000 7fd340ff9640 1 -- 172.21.15.137:0/3983268997 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd344075a40 con 0x7fd34415f490 2024-04-26T22:06:03.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:03.955+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd34406a290 con 0x7fd34415f490 2024-04-26T22:06:04.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.613+0000 7fd340ff9640 1 -- 172.21.15.137:0/3983268997 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7fd33c058e10 con 0x7fd34415f490 2024-04-26T22:06:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd33006c8f0 msgr2=0x7fd33006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd33006c8f0 0x7fd33006edb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd334009ac0 tx=0x7fd334008040 comp rx=0 tx=0).stop 2024-04-26T22:06:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34415f490 msgr2=0x7fd3440c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34415f490 0x7fd3440c8b50 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00c730 tx=0x7fd33c00cbf0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 shutdown_connections 2024-04-26T22:06:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd33006c8f0 0x7fd33006edb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd34415f490 0x7fd3440c8b50 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3440d2120 0x7fd3440cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 --2- 172.21.15.137:0/3983268997 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd3440d0ff0 0x7fd3441e9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 >> 172.21.15.137:0/3983268997 conn(0x7fd34409e530 msgr2=0x7fd34415fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:04.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 shutdown_connections 2024-04-26T22:06:04.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.616+0000 7fd34a2f1640 1 -- 172.21.15.137:0/3983268997 wait complete. 2024-04-26T22:06:04.628 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T22:06:04.628 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:06:04.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.728+0000 7f7a5bc85640 1 Processor -- start 2024-04-26T22:06:04.728 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.728+0000 7f7a5bc85640 1 -- start start 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a5bc85640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7a540cf2e0 0x7f7a5406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a5bc85640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7a5406e490 0x7f7a5415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a5bc85640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a540d1740 con 0x7f7a540d11b0 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a5bc85640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7a540d1a20 con 0x7f7a540cf2e0 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a5bc85640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7a540d1d00 con 0x7f7a5406e490 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a59a21640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7a540cf2e0 0x7f7a5406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a59a21640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7a540cf2e0 0x7f7a5406d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49810/0 (socket says 172.21.15.137:49810) 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a59a21640 1 -- 172.21.15.137:0/1990627674 learned_addr learned my addr 172.21.15.137:0/1990627674 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a5a222640 1 --2- 172.21.15.137:0/1990627674 >> v2:172.21.15.170:3300/0 conn(0x7f7a5406e490 0x7f7a5415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a59a21640 1 -- 172.21.15.137:0/1990627674 >> v2:172.21.15.170:3300/0 conn(0x7f7a5406e490 msgr2=0x7f7a5415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a59a21640 1 --2- 172.21.15.137:0/1990627674 >> v2:172.21.15.170:3300/0 conn(0x7f7a5406e490 0x7f7a5415ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a59a21640 1 -- 172.21.15.137:0/1990627674 >> v1:172.21.15.170:6789/0 conn(0x7f7a540d11b0 legacy=0x7f7a5406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:04.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a59a21640 1 -- 172.21.15.137:0/1990627674 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a540d1fe0 con 0x7f7a540cf2e0 2024-04-26T22:06:04.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.729+0000 7f7a5a222640 1 --2- 172.21.15.137:0/1990627674 >> v2:172.21.15.170:3300/0 conn(0x7f7a5406e490 0x7f7a5415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:04.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a59a21640 1 --2- 172.21.15.137:0/1990627674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540cf2e0 0x7f7a5406d4d0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009e50 tx=0x7f7a5002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad577939de5ba5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:04.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a58a1f640 1 -- 172.21.15.137:0/1990627674 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50036070 con 0x7f7a540cf2e0 2024-04-26T22:06:04.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a58a1f640 1 -- 172.21.15.137:0/1990627674 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a50031600 con 0x7f7a540cf2e0 2024-04-26T22:06:04.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a58a1f640 1 -- 172.21.15.137:0/1990627674 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a500319d0 con 0x7f7a540cf2e0 2024-04-26T22:06:04.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1990627674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540cf2e0 msgr2=0x7f7a5406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:04.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a5bc85640 1 --2- 172.21.15.137:0/1990627674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540cf2e0 0x7f7a5406d4d0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009e50 tx=0x7f7a5002a710 comp rx=0 tx=0).stop 2024-04-26T22:06:04.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1990627674 shutdown_connections 2024-04-26T22:06:04.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a5bc85640 1 --2- 172.21.15.137:0/1990627674 >> v2:172.21.15.170:3300/0 conn(0x7f7a5406e490 0x7f7a5415ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a5bc85640 1 --2- 172.21.15.137:0/1990627674 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540cf2e0 0x7f7a5406d4d0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.730+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1990627674 >> 172.21.15.137:0/1990627674 conn(0x7f7a540b4a60 msgr2=0x7f7a540b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:04.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.731+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1990627674 shutdown_connections 2024-04-26T22:06:04.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.731+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1990627674 wait complete. 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.732+0000 7f7a5bc85640 1 Processor -- start 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.732+0000 7f7a5bc85640 1 -- start start 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.732+0000 7f7a5bc85640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a5406e490 0x7f7a5409f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.732+0000 7f7a5bc85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a540cf2e0 0x7f7a540b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.732+0000 7f7a5bc85640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540d11b0 0x7f7a5409fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.732+0000 7f7a5bc85640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7a540cf6c0 con 0x7f7a540d11b0 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.732+0000 7f7a5bc85640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5406da10 con 0x7f7a5406e490 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.732+0000 7f7a5bc85640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7a540cf840 con 0x7f7a540cf2e0 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.732+0000 7f7a5a222640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540d11b0 0x7f7a5409fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5a222640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540d11b0 0x7f7a5409fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49822/0 (socket says 172.21.15.137:49822) 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5a222640 1 -- 172.21.15.137:0/1441951568 learned_addr learned my addr 172.21.15.137:0/1441951568 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a59a21640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a5406e490 0x7f7a5409f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a59220640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a540cf2e0 0x7f7a540b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5a222640 1 -- 172.21.15.137:0/1441951568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a540cf2e0 msgr2=0x7f7a540b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:04.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5a222640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a540cf2e0 0x7f7a540b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5a222640 1 -- 172.21.15.137:0/1441951568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a5406e490 msgr2=0x7f7a5409f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5a222640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a5406e490 0x7f7a5409f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5a222640 1 -- 172.21.15.137:0/1441951568 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a541f5650 con 0x7f7a540d11b0 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a59220640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a540cf2e0 0x7f7a540b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5a222640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540d11b0 0x7f7a5409fd10 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c5d0 tx=0x7f7a4c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a4a7fc640 1 -- 172.21.15.137:0/1441951568 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c015070 con 0x7f7a540d11b0 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a4a7fc640 1 -- 172.21.15.137:0/1441951568 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c004240 con 0x7f7a540d11b0 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a541f5930 con 0x7f7a540d11b0 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a4a7fc640 1 -- 172.21.15.137:0/1441951568 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c003610 con 0x7f7a540d11b0 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.733+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a541f5ef0 con 0x7f7a540d11b0 2024-04-26T22:06:04.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.734+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a5406a290 con 0x7f7a540d11b0 2024-04-26T22:06:04.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.735+0000 7f7a4a7fc640 1 -- 172.21.15.137:0/1441951568 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a4c0037b0 con 0x7f7a540d11b0 2024-04-26T22:06:04.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.735+0000 7f7a4a7fc640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a3806c8f0 0x7f7a3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:04.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.735+0000 7f7a4a7fc640 1 -- 172.21.15.137:0/1441951568 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f7a4c08b890 con 0x7f7a540d11b0 2024-04-26T22:06:04.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.735+0000 7f7a59a21640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a3806c8f0 0x7f7a3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:04.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.736+0000 7f7a59a21640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a3806c8f0 0x7f7a3806edb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7a50033000 tx=0x7f7a50009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:04.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.739+0000 7f7a4a7fc640 1 -- 172.21.15.137:0/1441951568 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7a4c059670 con 0x7f7a540d11b0 2024-04-26T22:06:04.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.951+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a540b8ef0 con 0x7f7a540d11b0 2024-04-26T22:06:04.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.951+0000 7f7a4a7fc640 1 -- 172.21.15.137:0/1441951568 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5195 (secure 0 0 0) 0x7f7a4c05d970 con 0x7f7a540d11b0 2024-04-26T22:06:04.951 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:04.951 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1187927282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1187927282},{"type":"v1","addr":"172.21.15.137:6836","nonce":1187927282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:06:03.956752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2219855149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2219855149},{"type":"v1","addr":"172.21.15.170:6835","nonce":2219855149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8232,"qdb_cluster":[8232]},"id":7}]} 2024-04-26T22:06:04.952 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 66 2024-04-26T22:06:04.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a3806c8f0 msgr2=0x7f7a3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:04.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a3806c8f0 0x7f7a3806edb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7a50033000 tx=0x7f7a50009000 comp rx=0 tx=0).stop 2024-04-26T22:06:04.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540d11b0 msgr2=0x7f7a5409fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:04.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540d11b0 0x7f7a5409fd10 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c5d0 tx=0x7f7a4c00ca90 comp rx=0 tx=0).stop 2024-04-26T22:06:04.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 shutdown_connections 2024-04-26T22:06:04.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7a3806c8f0 0x7f7a3806edb0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7a540d11b0 0x7f7a5409fd10 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7a540cf2e0 0x7f7a540b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 --2- 172.21.15.137:0/1441951568 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7a5406e490 0x7f7a5409f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:04.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 >> 172.21.15.137:0/1441951568 conn(0x7f7a540b4a60 msgr2=0x7f7a540d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:04.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 shutdown_connections 2024-04-26T22:06:04.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:04.953+0000 7f7a5bc85640 1 -- 172.21.15.137:0/1441951568 wait complete. 2024-04-26T22:06:04.964 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:06:05.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.061+0000 7f7ea48f1640 1 Processor -- start 2024-04-26T22:06:05.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.061+0000 7f7ea48f1640 1 -- start start 2024-04-26T22:06:05.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7ea48f1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7ea00cf2e0 0x7f7ea006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7ea48f1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7ea006e490 0x7f7ea015ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7ea48f1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea00d1740 con 0x7f7ea00d11b0 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7ea48f1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea00d1a20 con 0x7f7ea006e490 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7ea48f1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea00d1d00 con 0x7f7ea00cf2e0 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e9ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7ea006e490 0x7f7ea015ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e97fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7ea00d11b0 0x7f7ea006dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40472/0 (socket says 172.21.15.137:40472) 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e9ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7ea006e490 0x7f7ea015ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49828/0 (socket says 172.21.15.137:49828) 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e97fff640 1 -- 172.21.15.137:0/3960514296 learned_addr learned my addr 172.21.15.137:0/3960514296 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e9e59c640 1 --2- 172.21.15.137:0/3960514296 >> v2:172.21.15.170:3300/0 conn(0x7f7ea00cf2e0 0x7f7ea006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e9ed9d640 1 -- 172.21.15.137:0/3960514296 >> v2:172.21.15.170:3300/0 conn(0x7f7ea00cf2e0 msgr2=0x7f7ea006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e9ed9d640 1 --2- 172.21.15.137:0/3960514296 >> v2:172.21.15.170:3300/0 conn(0x7f7ea00cf2e0 0x7f7ea006d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e9ed9d640 1 -- 172.21.15.137:0/3960514296 >> v1:172.21.15.137:6789/0 conn(0x7f7ea00d11b0 legacy=0x7f7ea006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e9ed9d640 1 -- 172.21.15.137:0/3960514296 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea00d1fe0 con 0x7f7ea006e490 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e9e59c640 1 --2- 172.21.15.137:0/3960514296 >> v2:172.21.15.170:3300/0 conn(0x7f7ea00cf2e0 0x7f7ea006d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.062+0000 7f7e9dd9b640 1 -- 172.21.15.137:0/3960514296 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208394761 0 0) 0x7f7ea00d1740 con 0x7f7ea00d11b0 2024-04-26T22:06:05.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7e9ed9d640 1 --2- 172.21.15.137:0/3960514296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea006e490 0x7f7ea015ebe0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009d90 tx=0x7f7e9802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7220424b812091 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7e9dd9b640 1 -- 172.21.15.137:0/3960514296 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98007740 con 0x7f7ea006e490 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7e9dd9b640 1 -- 172.21.15.137:0/3960514296 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e980078e0 con 0x7f7ea006e490 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7e9dd9b640 1 -- 172.21.15.137:0/3960514296 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98007cb0 con 0x7f7ea006e490 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7ea48f1640 1 -- 172.21.15.137:0/3960514296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea006e490 msgr2=0x7f7ea015ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7ea48f1640 1 --2- 172.21.15.137:0/3960514296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea006e490 0x7f7ea015ebe0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009d90 tx=0x7f7e9802a6a0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7ea48f1640 1 -- 172.21.15.137:0/3960514296 shutdown_connections 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7ea48f1640 1 --2- 172.21.15.137:0/3960514296 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea006e490 0x7f7ea015ebe0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7ea48f1640 1 --2- 172.21.15.137:0/3960514296 >> v2:172.21.15.170:3300/0 conn(0x7f7ea00cf2e0 0x7f7ea006d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.063+0000 7f7ea48f1640 1 -- 172.21.15.137:0/3960514296 >> 172.21.15.137:0/3960514296 conn(0x7f7ea00b4a60 msgr2=0x7f7ea00b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.064+0000 7f7ea48f1640 1 -- 172.21.15.137:0/3960514296 shutdown_connections 2024-04-26T22:06:05.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.064+0000 7f7ea48f1640 1 -- 172.21.15.137:0/3960514296 wait complete. 2024-04-26T22:06:05.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.065+0000 7f7ea48f1640 1 Processor -- start 2024-04-26T22:06:05.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.065+0000 7f7ea48f1640 1 -- start start 2024-04-26T22:06:05.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.065+0000 7f7ea48f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ea006e490 0x7f7ea015c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.065+0000 7f7ea48f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ea00cf2e0 0x7f7ea00b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.065+0000 7f7ea48f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea00d11b0 0x7f7ea015dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7ea48f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea00cf6c0 con 0x7f7ea00d11b0 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7ea48f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea006da10 con 0x7f7ea00cf2e0 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7ea48f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea00cf840 con 0x7f7ea006e490 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e9ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea00d11b0 0x7f7ea015dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e9ed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea00d11b0 0x7f7ea015dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49830/0 (socket says 172.21.15.137:49830) 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e9ed9d640 1 -- 172.21.15.137:0/902585737 learned_addr learned my addr 172.21.15.137:0/902585737 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e9ed9d640 1 -- 172.21.15.137:0/902585737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ea006e490 msgr2=0x7f7ea015c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e9ed9d640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ea006e490 0x7f7ea015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e9ed9d640 1 -- 172.21.15.137:0/902585737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ea00cf2e0 msgr2=0x7f7ea00b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e9ed9d640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ea00cf2e0 0x7f7ea00b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e9ed9d640 1 -- 172.21.15.137:0/902585737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea00b6a30 con 0x7f7ea00d11b0 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e9ed9d640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea00d11b0 0x7f7ea015dd90 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009d90 tx=0x7f7e98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:05.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e96ffd640 1 -- 172.21.15.137:0/902585737 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9803f070 con 0x7f7ea00d11b0 2024-04-26T22:06:05.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e96ffd640 1 -- 172.21.15.137:0/902585737 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e98031c40 con 0x7f7ea00d11b0 2024-04-26T22:06:05.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7e96ffd640 1 -- 172.21.15.137:0/902585737 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98009450 con 0x7f7ea00d11b0 2024-04-26T22:06:05.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea00b6d10 con 0x7f7ea00d11b0 2024-04-26T22:06:05.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.066+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea015d130 con 0x7f7ea00d11b0 2024-04-26T22:06:05.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.067+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea006a290 con 0x7f7ea00d11b0 2024-04-26T22:06:05.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.068+0000 7f7e96ffd640 1 -- 172.21.15.137:0/902585737 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e98003990 con 0x7f7ea00d11b0 2024-04-26T22:06:05.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.068+0000 7f7e96ffd640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e8006c920 0x7f7e8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.068+0000 7f7e9e59c640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e8006c920 0x7f7e8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.068+0000 7f7e96ffd640 1 -- 172.21.15.137:0/902585737 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f7e980ac920 con 0x7f7ea00d11b0 2024-04-26T22:06:05.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.068+0000 7f7e9e59c640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e8006c920 0x7f7e8006ede0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7e90006e80 tx=0x7f7e90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:05.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.073+0000 7f7e96ffd640 1 -- 172.21.15.137:0/902585737 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7e9807ade0 con 0x7f7ea00d11b0 2024-04-26T22:06:05.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.247+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ea00b8ef0 con 0x7f7ea00d11b0 2024-04-26T22:06:05.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.249+0000 7f7e96ffd640 1 -- 172.21.15.137:0/902585737 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16631 (secure 0 0 0) 0x7f7e9807a6e0 con 0x7f7ea00d11b0 2024-04-26T22:06:05.249 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:05.249 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":103,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:06:03.589665+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:06:00.152074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-26T22:06:00.894660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e8006c920 msgr2=0x7f7e8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e8006c920 0x7f7e8006ede0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7e90006e80 tx=0x7f7e90008040 comp rx=0 tx=0).stop 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea00d11b0 msgr2=0x7f7ea015dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea00d11b0 0x7f7ea015dd90 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f7e98009d90 tx=0x7f7e98004a40 comp rx=0 tx=0).stop 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 shutdown_connections 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e8006c920 0x7f7e8006ede0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7ea00d11b0 0x7f7ea015dd90 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ea00cf2e0 0x7f7ea00b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 --2- 172.21.15.137:0/902585737 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ea006e490 0x7f7ea015c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 >> 172.21.15.137:0/902585737 conn(0x7f7ea00b4a60 msgr2=0x7f7ea00cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 shutdown_connections 2024-04-26T22:06:05.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.251+0000 7f7ea48f1640 1 -- 172.21.15.137:0/902585737 wait complete. 2024-04-26T22:06:05.262 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T22:06:05.262 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:06:05.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.358+0000 7f655c1f0640 1 Processor -- start 2024-04-26T22:06:05.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.359+0000 7f655c1f0640 1 -- start start 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.359+0000 7f655c1f0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f65540d3ee0 0x7f65540cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.359+0000 7f655c1f0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f655415f750 0x7f65540b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.359+0000 7f655c1f0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65540d03a0 con 0x7f655415f370 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.359+0000 7f655c1f0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f65540b4d10 con 0x7f65540d3ee0 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.359+0000 7f655c1f0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f65540d0680 con 0x7f655415f750 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.360+0000 7f655978b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f65540d3ee0 0x7f65540cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.360+0000 7f6559f8c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f655415f370 0x7f65540d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:40474/0 (socket says 172.21.15.137:40474) 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.360+0000 7f6559f8c640 1 -- 172.21.15.137:0/3431954088 learned_addr learned my addr 172.21.15.137:0/3431954088 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.360+0000 7f655a78d640 1 --2- 172.21.15.137:0/3431954088 >> v2:172.21.15.170:3300/0 conn(0x7f655415f750 0x7f65540b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.360+0000 7f655978b640 1 -- 172.21.15.137:0/3431954088 >> v2:172.21.15.170:3300/0 conn(0x7f655415f750 msgr2=0x7f65540b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.360+0000 7f655978b640 1 --2- 172.21.15.137:0/3431954088 >> v2:172.21.15.170:3300/0 conn(0x7f655415f750 0x7f65540b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.360+0000 7f655978b640 1 -- 172.21.15.137:0/3431954088 >> v1:172.21.15.137:6789/0 conn(0x7f655415f370 legacy=0x7f65540d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.360+0000 7f6558f8a640 1 -- 172.21.15.137:0/3431954088 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596426077 0 0) 0x7f65540d03a0 con 0x7f655415f370 2024-04-26T22:06:05.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.360+0000 7f655978b640 1 -- 172.21.15.137:0/3431954088 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65540d0960 con 0x7f65540d3ee0 2024-04-26T22:06:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f655978b640 1 --2- 172.21.15.137:0/3431954088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65540d3ee0 0x7f65540cfd70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f65500097a0 tx=0x7f655002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac006e3bf0a7010 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:05.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f6558f8a640 1 -- 172.21.15.137:0/3431954088 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550037070 con 0x7f65540d3ee0 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f6558f8a640 1 -- 172.21.15.137:0/3431954088 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6550032440 con 0x7f65540d3ee0 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f6558f8a640 1 -- 172.21.15.137:0/3431954088 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550032810 con 0x7f65540d3ee0 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f655c1f0640 1 -- 172.21.15.137:0/3431954088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65540d3ee0 msgr2=0x7f65540cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f655c1f0640 1 --2- 172.21.15.137:0/3431954088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65540d3ee0 0x7f65540cfd70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f65500097a0 tx=0x7f655002a1e0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f655c1f0640 1 -- 172.21.15.137:0/3431954088 shutdown_connections 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f655c1f0640 1 --2- 172.21.15.137:0/3431954088 >> v2:172.21.15.170:3300/0 conn(0x7f655415f750 0x7f65540b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f655c1f0640 1 --2- 172.21.15.137:0/3431954088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f65540d3ee0 0x7f65540cfd70 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f655c1f0640 1 -- 172.21.15.137:0/3431954088 >> 172.21.15.137:0/3431954088 conn(0x7f655408ec10 msgr2=0x7f655409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f655c1f0640 1 -- 172.21.15.137:0/3431954088 shutdown_connections 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.361+0000 7f655c1f0640 1 -- 172.21.15.137:0/3431954088 wait complete. 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655c1f0640 1 Processor -- start 2024-04-26T22:06:05.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655c1f0640 1 -- start start 2024-04-26T22:06:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655c1f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65540d3ee0 0x7f65540ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655c1f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f655415f370 0x7f65540cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655c1f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f655415f750 0x7f65540c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655c1f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f65540b51c0 con 0x7f655415f370 2024-04-26T22:06:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655c1f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f65540d0f20 con 0x7f655415f750 2024-04-26T22:06:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655c1f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f65540b5340 con 0x7f65540d3ee0 2024-04-26T22:06:05.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655978b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f655415f370 0x7f65540cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655978b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f655415f370 0x7f65540cb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:49834/0 (socket says 172.21.15.137:49834) 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.363+0000 7f655978b640 1 -- 172.21.15.137:0/3845840400 learned_addr learned my addr 172.21.15.137:0/3845840400 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f655978b640 1 -- 172.21.15.137:0/3845840400 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65540d3ee0 msgr2=0x7f65540ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f655978b640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65540d3ee0 0x7f65540ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f655978b640 1 -- 172.21.15.137:0/3845840400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f655415f750 msgr2=0x7f65540c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f655978b640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f655415f750 0x7f65540c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f655978b640 1 -- 172.21.15.137:0/3845840400 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65540cd760 con 0x7f655415f370 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f655978b640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f655415f370 0x7f65540cb470 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f65500098c0 tx=0x7f65500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f654a7fc640 1 -- 172.21.15.137:0/3845840400 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550037040 con 0x7f655415f370 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f654a7fc640 1 -- 172.21.15.137:0/3845840400 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6550042070 con 0x7f655415f370 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65540cda40 con 0x7f655415f370 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f654a7fc640 1 -- 172.21.15.137:0/3845840400 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550030bb0 con 0x7f655415f370 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.364+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65540ce000 con 0x7f655415f370 2024-04-26T22:06:05.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.365+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655406a290 con 0x7f655415f370 2024-04-26T22:06:05.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.365+0000 7f654a7fc640 1 -- 172.21.15.137:0/3845840400 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6550047460 con 0x7f655415f370 2024-04-26T22:06:05.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.366+0000 7f654a7fc640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f653806c8f0 0x7f653806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.366+0000 7f654a7fc640 1 -- 172.21.15.137:0/3845840400 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f65500ac700 con 0x7f655415f370 2024-04-26T22:06:05.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.366+0000 7f6559f8c640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f653806c8f0 0x7f653806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.366+0000 7f6559f8c640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f653806c8f0 0x7f653806edb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6544007fd0 tx=0x7f6544007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:05.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.370+0000 7f654a7fc640 1 -- 172.21.15.137:0/3845840400 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6550032e20 con 0x7f655415f370 2024-04-26T22:06:05.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.541+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65540bb0b0 con 0x7f653806c8f0 2024-04-26T22:06:05.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.547+0000 7f654a7fc640 1 -- 172.21.15.137:0/3845840400 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252412 (secure 0 0 0) 0x7f65540bb0b0 con 0x7f653806c8f0 2024-04-26T22:06:05.550 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:05.552 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:06:05.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f653806c8f0 msgr2=0x7f653806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f653806c8f0 0x7f653806edb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6544007fd0 tx=0x7f6544007920 comp rx=0 tx=0).stop 2024-04-26T22:06:05.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f655415f370 msgr2=0x7f65540cb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f655415f370 0x7f65540cb470 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f65500098c0 tx=0x7f65500046c0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 shutdown_connections 2024-04-26T22:06:05.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f653806c8f0 0x7f653806edb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f655415f370 0x7f65540cb470 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f655415f750 0x7f65540c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 --2- 172.21.15.137:0/3845840400 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f65540d3ee0 0x7f65540ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 >> 172.21.15.137:0/3845840400 conn(0x7f655408ec10 msgr2=0x7f655409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:05.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.550+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 shutdown_connections 2024-04-26T22:06:05.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.551+0000 7f655c1f0640 1 -- 172.21.15.137:0/3845840400 wait complete. 2024-04-26T22:06:05.561 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-04-26T22:06:04.792621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272872,"kb_used_data":10920,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754701848,"statfs":{"total":773094113280,"available":772814692352,"internally_reserved":0,"allocated":11182080,"data_stored":5483168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.213299"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.613693+0000","last_change":"2024-04-26T22:06:02.611629+0000","last_active":"2024-04-26T22:06:02.613693+0000","last_peered":"2024-04-26T22:06:02.613693+0000","last_clean":"2024-04-26T22:06:02.613693+0000","last_became_active":"2024-04-26T22:06:02.611205+0000","last_became_peered":"2024-04-26T22:06:02.611205+0000","last_unstale":"2024-04-26T22:06:02.613693+0000","last_undegraded":"2024-04-26T22:06:02.613693+0000","last_fullsized":"2024-04-26T22:06:02.613693+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:05:43.094981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608151+0000","last_change":"2024-04-26T22:06:02.602752+0000","last_active":"2024-04-26T22:06:02.608151+0000","last_peered":"2024-04-26T22:06:02.608151+0000","last_clean":"2024-04-26T22:06:02.608151+0000","last_became_active":"2024-04-26T22:06:02.602493+0000","last_became_peered":"2024-04-26T22:06:02.602493+0000","last_unstale":"2024-04-26T22:06:02.608151+0000","last_undegraded":"2024-04-26T22:06:02.608151+0000","last_fullsized":"2024-04-26T22:06:02.608151+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:41:50.103376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.613663+0000","last_change":"2024-04-26T22:06:02.611628+0000","last_active":"2024-04-26T22:06:02.613663+0000","last_peered":"2024-04-26T22:06:02.613663+0000","last_clean":"2024-04-26T22:06:02.613663+0000","last_became_active":"2024-04-26T22:06:02.611342+0000","last_became_peered":"2024-04-26T22:06:02.611342+0000","last_unstale":"2024-04-26T22:06:02.613663+0000","last_undegraded":"2024-04-26T22:06:02.613663+0000","last_fullsized":"2024-04-26T22:06:02.613663+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:30.908302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.621396+0000","last_change":"2024-04-26T22:06:02.617416+0000","last_active":"2024-04-26T22:06:02.621396+0000","last_peered":"2024-04-26T22:06:02.621396+0000","last_clean":"2024-04-26T22:06:02.621396+0000","last_became_active":"2024-04-26T22:06:02.617145+0000","last_became_peered":"2024-04-26T22:06:02.617145+0000","last_unstale":"2024-04-26T22:06:02.621396+0000","last_undegraded":"2024-04-26T22:06:02.621396+0000","last_fullsized":"2024-04-26T22:06:02.621396+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:47:30.801577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617548+0000","last_change":"2024-04-26T22:06:02.613905+0000","last_active":"2024-04-26T22:06:02.617548+0000","last_peered":"2024-04-26T22:06:02.617548+0000","last_clean":"2024-04-26T22:06:02.617548+0000","last_became_active":"2024-04-26T22:06:02.613334+0000","last_became_peered":"2024-04-26T22:06:02.613334+0000","last_unstale":"2024-04-26T22:06:02.617548+0000","last_undegraded":"2024-04-26T22:06:02.617548+0000","last_fullsized":"2024-04-26T22:06:02.617548+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:31.573619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.607549+0000","last_change":"2024-04-26T22:06:02.603367+0000","last_active":"2024-04-26T22:06:02.607549+0000","last_peered":"2024-04-26T22:06:02.607549+0000","last_clean":"2024-04-26T22:06:02.607549+0000","last_became_active":"2024-04-26T22:06:02.603007+0000","last_became_peered":"2024-04-26T22:06:02.603007+0000","last_unstale":"2024-04-26T22:06:02.607549+0000","last_undegraded":"2024-04-26T22:06:02.607549+0000","last_fullsized":"2024-04-26T22:06:02.607549+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:54.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608138+0000","last_change":"2024-04-26T22:06:02.603481+0000","last_active":"2024-04-26T22:06:02.608138+0000","last_peered":"2024-04-26T22:06:02.608138+0000","last_clean":"2024-04-26T22:06:02.608138+0000","last_became_active":"2024-04-26T22:06:02.603200+0000","last_became_peered":"2024-04-26T22:06:02.603200+0000","last_unstale":"2024-04-26T22:06:02.608138+0000","last_undegraded":"2024-04-26T22:06:02.608138+0000","last_fullsized":"2024-04-26T22:06:02.608138+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:31.573619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.598223+0000","last_change":"2024-04-26T22:06:02.597206+0000","last_active":"2024-04-26T22:06:02.598223+0000","last_peered":"2024-04-26T22:06:02.598223+0000","last_clean":"2024-04-26T22:06:02.598223+0000","last_became_active":"2024-04-26T22:06:02.596941+0000","last_became_peered":"2024-04-26T22:06:02.596941+0000","last_unstale":"2024-04-26T22:06:02.598223+0000","last_undegraded":"2024-04-26T22:06:02.598223+0000","last_fullsized":"2024-04-26T22:06:02.598223+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:21.975131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620302+0000","last_change":"2024-04-26T22:06:02.619465+0000","last_active":"2024-04-26T22:06:02.620302+0000","last_peered":"2024-04-26T22:06:02.620302+0000","last_clean":"2024-04-26T22:06:02.620302+0000","last_became_active":"2024-04-26T22:06:02.619139+0000","last_became_peered":"2024-04-26T22:06:02.619139+0000","last_unstale":"2024-04-26T22:06:02.620302+0000","last_undegraded":"2024-04-26T22:06:02.620302+0000","last_fullsized":"2024-04-26T22:06:02.620302+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.124042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617587+0000","last_change":"2024-04-26T22:06:02.614009+0000","last_active":"2024-04-26T22:06:02.617587+0000","last_peered":"2024-04-26T22:06:02.617587+0000","last_clean":"2024-04-26T22:06:02.617587+0000","last_became_active":"2024-04-26T22:06:02.613606+0000","last_became_peered":"2024-04-26T22:06:02.613606+0000","last_unstale":"2024-04-26T22:06:02.617587+0000","last_undegraded":"2024-04-26T22:06:02.617587+0000","last_fullsized":"2024-04-26T22:06:02.617587+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:16.628178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614788+0000","last_change":"2024-04-26T22:06:02.609533+0000","last_active":"2024-04-26T22:06:02.614788+0000","last_peered":"2024-04-26T22:06:02.614788+0000","last_clean":"2024-04-26T22:06:02.614788+0000","last_became_active":"2024-04-26T22:06:02.609244+0000","last_became_peered":"2024-04-26T22:06:02.609244+0000","last_unstale":"2024-04-26T22:06:02.614788+0000","last_undegraded":"2024-04-26T22:06:02.614788+0000","last_fullsized":"2024-04-26T22:06:02.614788+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:33.476722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618799+0000","last_change":"2024-04-26T22:06:02.612495+0000","last_active":"2024-04-26T22:06:02.618799+0000","last_peered":"2024-04-26T22:06:02.618799+0000","last_clean":"2024-04-26T22:06:02.618799+0000","last_became_active":"2024-04-26T22:06:02.612166+0000","last_became_peered":"2024-04-26T22:06:02.612166+0000","last_unstale":"2024-04-26T22:06:02.618799+0000","last_undegraded":"2024-04-26T22:06:02.618799+0000","last_fullsized":"2024-04-26T22:06:02.618799+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:30.109337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.623772+0000","last_change":"2024-04-26T22:06:02.620057+0000","last_active":"2024-04-26T22:06:02.623772+0000","last_peered":"2024-04-26T22:06:02.623772+0000","last_clean":"2024-04-26T22:06:02.623772+0000","last_became_active":"2024-04-26T22:06:02.619718+0000","last_became_peered":"2024-04-26T22:06:02.619718+0000","last_unstale":"2024-04-26T22:06:02.623772+0000","last_undegraded":"2024-04-26T22:06:02.623772+0000","last_fullsized":"2024-04-26T22:06:02.623772+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:59.698977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614551+0000","last_change":"2024-04-26T22:06:02.607446+0000","last_active":"2024-04-26T22:06:02.614551+0000","last_peered":"2024-04-26T22:06:02.614551+0000","last_clean":"2024-04-26T22:06:02.614551+0000","last_became_active":"2024-04-26T22:06:02.607193+0000","last_became_peered":"2024-04-26T22:06:02.607193+0000","last_unstale":"2024-04-26T22:06:02.614551+0000","last_undegraded":"2024-04-26T22:06:02.614551+0000","last_fullsized":"2024-04-26T22:06:02.614551+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:09.112731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618843+0000","last_change":"2024-04-26T22:06:02.610140+0000","last_active":"2024-04-26T22:06:02.618843+0000","last_peered":"2024-04-26T22:06:02.618843+0000","last_clean":"2024-04-26T22:06:02.618843+0000","last_became_active":"2024-04-26T22:06:02.609868+0000","last_became_peered":"2024-04-26T22:06:02.609868+0000","last_unstale":"2024-04-26T22:06:02.618843+0000","last_undegraded":"2024-04-26T22:06:02.618843+0000","last_fullsized":"2024-04-26T22:06:02.618843+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:16.628178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.603512+0000","last_change":"2024-04-26T22:06:02.600142+0000","last_active":"2024-04-26T22:06:02.603512+0000","last_peered":"2024-04-26T22:06:02.603512+0000","last_clean":"2024-04-26T22:06:02.603512+0000","last_became_active":"2024-04-26T22:06:02.599858+0000","last_became_peered":"2024-04-26T22:06:02.599858+0000","last_unstale":"2024-04-26T22:06:02.603512+0000","last_undegraded":"2024-04-26T22:06:02.603512+0000","last_fullsized":"2024-04-26T22:06:02.603512+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:30.244089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.615021+0000","last_change":"2024-04-26T22:06:02.605548+0000","last_active":"2024-04-26T22:06:02.615021+0000","last_peered":"2024-04-26T22:06:02.615021+0000","last_clean":"2024-04-26T22:06:02.615021+0000","last_became_active":"2024-04-26T22:06:02.605288+0000","last_became_peered":"2024-04-26T22:06:02.605288+0000","last_unstale":"2024-04-26T22:06:02.615021+0000","last_undegraded":"2024-04-26T22:06:02.615021+0000","last_fullsized":"2024-04-26T22:06:02.615021+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:06.214296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620331+0000","last_change":"2024-04-26T22:06:02.616847+0000","last_active":"2024-04-26T22:06:02.620331+0000","last_peered":"2024-04-26T22:06:02.620331+0000","last_clean":"2024-04-26T22:06:02.620331+0000","last_became_active":"2024-04-26T22:06:02.616606+0000","last_became_peered":"2024-04-26T22:06:02.616606+0000","last_unstale":"2024-04-26T22:06:02.620331+0000","last_undegraded":"2024-04-26T22:06:02.620331+0000","last_fullsized":"2024-04-26T22:06:02.620331+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:32.381320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614776+0000","last_change":"2024-04-26T22:06:02.610957+0000","last_active":"2024-04-26T22:06:02.614776+0000","last_peered":"2024-04-26T22:06:02.614776+0000","last_clean":"2024-04-26T22:06:02.614776+0000","last_became_active":"2024-04-26T22:06:02.610704+0000","last_became_peered":"2024-04-26T22:06:02.610704+0000","last_unstale":"2024-04-26T22:06:02.614776+0000","last_undegraded":"2024-04-26T22:06:02.614776+0000","last_fullsized":"2024-04-26T22:06:02.614776+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:06.965149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618679+0000","last_change":"2024-04-26T22:06:02.611895+0000","last_active":"2024-04-26T22:06:02.618679+0000","last_peered":"2024-04-26T22:06:02.618679+0000","last_clean":"2024-04-26T22:06:02.618679+0000","last_became_active":"2024-04-26T22:06:02.611599+0000","last_became_peered":"2024-04-26T22:06:02.611599+0000","last_unstale":"2024-04-26T22:06:02.618679+0000","last_undegraded":"2024-04-26T22:06:02.618679+0000","last_fullsized":"2024-04-26T22:06:02.618679+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:02.367577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614620+0000","last_change":"2024-04-26T22:06:02.604817+0000","last_active":"2024-04-26T22:06:02.614620+0000","last_peered":"2024-04-26T22:06:02.614620+0000","last_clean":"2024-04-26T22:06:02.614620+0000","last_became_active":"2024-04-26T22:06:02.604522+0000","last_became_peered":"2024-04-26T22:06:02.604522+0000","last_unstale":"2024-04-26T22:06:02.614620+0000","last_undegraded":"2024-04-26T22:06:02.614620+0000","last_fullsized":"2024-04-26T22:06:02.614620+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.835305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608410+0000","last_change":"2024-04-26T22:06:02.603275+0000","last_active":"2024-04-26T22:06:02.608410+0000","last_peered":"2024-04-26T22:06:02.608410+0000","last_clean":"2024-04-26T22:06:02.608410+0000","last_became_active":"2024-04-26T22:06:02.603015+0000","last_became_peered":"2024-04-26T22:06:02.603015+0000","last_unstale":"2024-04-26T22:06:02.608410+0000","last_undegraded":"2024-04-26T22:06:02.608410+0000","last_fullsized":"2024-04-26T22:06:02.608410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:50:45.356545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608727+0000","last_change":"2024-04-26T22:06:02.603476+0000","last_active":"2024-04-26T22:06:02.608727+0000","last_peered":"2024-04-26T22:06:02.608727+0000","last_clean":"2024-04-26T22:06:02.608727+0000","last_became_active":"2024-04-26T22:06:02.602226+0000","last_became_peered":"2024-04-26T22:06:02.602226+0000","last_unstale":"2024-04-26T22:06:02.608727+0000","last_undegraded":"2024-04-26T22:06:02.608727+0000","last_fullsized":"2024-04-26T22:06:02.608727+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:51.981176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614911+0000","last_change":"2024-04-26T22:06:02.611012+0000","last_active":"2024-04-26T22:06:02.614911+0000","last_peered":"2024-04-26T22:06:02.614911+0000","last_clean":"2024-04-26T22:06:02.614911+0000","last_became_active":"2024-04-26T22:06:02.610709+0000","last_became_peered":"2024-04-26T22:06:02.610709+0000","last_unstale":"2024-04-26T22:06:02.614911+0000","last_undegraded":"2024-04-26T22:06:02.614911+0000","last_fullsized":"2024-04-26T22:06:02.614911+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:32.381320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.610340+0000","last_change":"2024-04-26T22:06:02.604736+0000","last_active":"2024-04-26T22:06:02.610340+0000","last_peered":"2024-04-26T22:06:02.610340+0000","last_clean":"2024-04-26T22:06:02.610340+0000","last_became_active":"2024-04-26T22:06:02.604458+0000","last_became_peered":"2024-04-26T22:06:02.604458+0000","last_unstale":"2024-04-26T22:06:02.610340+0000","last_undegraded":"2024-04-26T22:06:02.610340+0000","last_fullsized":"2024-04-26T22:06:02.610340+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:30.109337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617124+0000","last_change":"2024-04-26T22:06:02.609818+0000","last_active":"2024-04-26T22:06:02.617124+0000","last_peered":"2024-04-26T22:06:02.617124+0000","last_clean":"2024-04-26T22:06:02.617124+0000","last_became_active":"2024-04-26T22:06:02.609543+0000","last_became_peered":"2024-04-26T22:06:02.609543+0000","last_unstale":"2024-04-26T22:06:02.617124+0000","last_undegraded":"2024-04-26T22:06:02.617124+0000","last_fullsized":"2024-04-26T22:06:02.617124+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:46.813022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.605985+0000","last_change":"2024-04-26T22:06:02.603357+0000","last_active":"2024-04-26T22:06:02.605985+0000","last_peered":"2024-04-26T22:06:02.605985+0000","last_clean":"2024-04-26T22:06:02.605985+0000","last_became_active":"2024-04-26T22:06:02.602989+0000","last_became_peered":"2024-04-26T22:06:02.602989+0000","last_unstale":"2024-04-26T22:06:02.605985+0000","last_undegraded":"2024-04-26T22:06:02.605985+0000","last_fullsized":"2024-04-26T22:06:02.605985+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:16.628178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616171+0000","last_change":"2024-04-26T22:06:02.612965+0000","last_active":"2024-04-26T22:06:02.616171+0000","last_peered":"2024-04-26T22:06:02.616171+0000","last_clean":"2024-04-26T22:06:02.616171+0000","last_became_active":"2024-04-26T22:06:02.612707+0000","last_became_peered":"2024-04-26T22:06:02.612707+0000","last_unstale":"2024-04-26T22:06:02.616171+0000","last_undegraded":"2024-04-26T22:06:02.616171+0000","last_fullsized":"2024-04-26T22:06:02.616171+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:30.244089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616906+0000","last_change":"2024-04-26T22:06:02.609754+0000","last_active":"2024-04-26T22:06:02.616906+0000","last_peered":"2024-04-26T22:06:02.616906+0000","last_clean":"2024-04-26T22:06:02.616906+0000","last_became_active":"2024-04-26T22:06:02.609484+0000","last_became_peered":"2024-04-26T22:06:02.609484+0000","last_unstale":"2024-04-26T22:06:02.616906+0000","last_undegraded":"2024-04-26T22:06:02.616906+0000","last_fullsized":"2024-04-26T22:06:02.616906+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:14.030893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614807+0000","last_change":"2024-04-26T22:06:02.611819+0000","last_active":"2024-04-26T22:06:02.614807+0000","last_peered":"2024-04-26T22:06:02.614807+0000","last_clean":"2024-04-26T22:06:02.614807+0000","last_became_active":"2024-04-26T22:06:02.611557+0000","last_became_peered":"2024-04-26T22:06:02.611557+0000","last_unstale":"2024-04-26T22:06:02.614807+0000","last_undegraded":"2024-04-26T22:06:02.614807+0000","last_fullsized":"2024-04-26T22:06:02.614807+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:06.842823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620267+0000","last_change":"2024-04-26T22:06:02.614504+0000","last_active":"2024-04-26T22:06:02.620267+0000","last_peered":"2024-04-26T22:06:02.620267+0000","last_clean":"2024-04-26T22:06:02.620267+0000","last_became_active":"2024-04-26T22:06:02.614267+0000","last_became_peered":"2024-04-26T22:06:02.614267+0000","last_unstale":"2024-04-26T22:06:02.620267+0000","last_undegraded":"2024-04-26T22:06:02.620267+0000","last_fullsized":"2024-04-26T22:06:02.620267+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:29:24.354169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622262+0000","last_change":"2024-04-26T22:06:02.618057+0000","last_active":"2024-04-26T22:06:02.622262+0000","last_peered":"2024-04-26T22:06:02.622262+0000","last_clean":"2024-04-26T22:06:02.622262+0000","last_became_active":"2024-04-26T22:06:02.617706+0000","last_became_peered":"2024-04-26T22:06:02.617706+0000","last_unstale":"2024-04-26T22:06:02.622262+0000","last_undegraded":"2024-04-26T22:06:02.622262+0000","last_fullsized":"2024-04-26T22:06:02.622262+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:09.304714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614048+0000","last_change":"2024-04-26T22:06:02.606605+0000","last_active":"2024-04-26T22:06:02.614048+0000","last_peered":"2024-04-26T22:06:02.614048+0000","last_clean":"2024-04-26T22:06:02.614048+0000","last_became_active":"2024-04-26T22:06:02.606372+0000","last_became_peered":"2024-04-26T22:06:02.606372+0000","last_unstale":"2024-04-26T22:06:02.614048+0000","last_undegraded":"2024-04-26T22:06:02.614048+0000","last_fullsized":"2024-04-26T22:06:02.614048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:45.891720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"102'4","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.623617+0000","last_change":"2024-04-26T22:06:01.595255+0000","last_active":"2024-04-26T22:06:02.623617+0000","last_peered":"2024-04-26T22:06:02.623617+0000","last_clean":"2024-04-26T22:06:02.623617+0000","last_became_active":"2024-04-26T22:06:01.594947+0000","last_became_peered":"2024-04-26T22:06:01.594947+0000","last_unstale":"2024-04-26T22:06:02.623617+0000","last_undegraded":"2024-04-26T22:06:02.623617+0000","last_fullsized":"2024-04-26T22:06:02.623617+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:11.774223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620400+0000","last_change":"2024-04-26T22:06:02.615139+0000","last_active":"2024-04-26T22:06:02.620400+0000","last_peered":"2024-04-26T22:06:02.620400+0000","last_clean":"2024-04-26T22:06:02.620400+0000","last_became_active":"2024-04-26T22:06:02.614875+0000","last_became_peered":"2024-04-26T22:06:02.614875+0000","last_unstale":"2024-04-26T22:06:02.620400+0000","last_undegraded":"2024-04-26T22:06:02.620400+0000","last_fullsized":"2024-04-26T22:06:02.620400+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:33.476722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614840+0000","last_change":"2024-04-26T22:06:01.597600+0000","last_active":"2024-04-26T22:06:02.614840+0000","last_peered":"2024-04-26T22:06:02.614840+0000","last_clean":"2024-04-26T22:06:02.614840+0000","last_became_active":"2024-04-26T22:06:01.597313+0000","last_became_peered":"2024-04-26T22:06:01.597313+0000","last_unstale":"2024-04-26T22:06:02.614840+0000","last_undegraded":"2024-04-26T22:06:02.614840+0000","last_fullsized":"2024-04-26T22:06:02.614840+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:29.104875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.623615+0000","last_change":"2024-04-26T22:06:02.619082+0000","last_active":"2024-04-26T22:06:02.623615+0000","last_peered":"2024-04-26T22:06:02.623615+0000","last_clean":"2024-04-26T22:06:02.623615+0000","last_became_active":"2024-04-26T22:06:02.618591+0000","last_became_peered":"2024-04-26T22:06:02.618591+0000","last_unstale":"2024-04-26T22:06:02.623615+0000","last_undegraded":"2024-04-26T22:06:02.623615+0000","last_fullsized":"2024-04-26T22:06:02.623615+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:58:40.092846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622082+0000","last_change":"2024-04-26T22:06:01.603810+0000","last_active":"2024-04-26T22:06:02.622082+0000","last_peered":"2024-04-26T22:06:02.622082+0000","last_clean":"2024-04-26T22:06:02.622082+0000","last_became_active":"2024-04-26T22:06:01.603551+0000","last_became_peered":"2024-04-26T22:06:01.603551+0000","last_unstale":"2024-04-26T22:06:02.622082+0000","last_undegraded":"2024-04-26T22:06:02.622082+0000","last_fullsized":"2024-04-26T22:06:02.622082+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:42.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.610578+0000","last_change":"2024-04-26T22:06:02.603773+0000","last_active":"2024-04-26T22:06:02.610578+0000","last_peered":"2024-04-26T22:06:02.610578+0000","last_clean":"2024-04-26T22:06:02.610578+0000","last_became_active":"2024-04-26T22:06:02.603476+0000","last_became_peered":"2024-04-26T22:06:02.603476+0000","last_unstale":"2024-04-26T22:06:02.610578+0000","last_undegraded":"2024-04-26T22:06:02.610578+0000","last_fullsized":"2024-04-26T22:06:02.610578+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:42.177470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.621631+0000","last_change":"2024-04-26T22:06:01.598299+0000","last_active":"2024-04-26T22:06:02.621631+0000","last_peered":"2024-04-26T22:06:02.621631+0000","last_clean":"2024-04-26T22:06:02.621631+0000","last_became_active":"2024-04-26T22:06:01.597744+0000","last_became_peered":"2024-04-26T22:06:01.597744+0000","last_unstale":"2024-04-26T22:06:02.621631+0000","last_undegraded":"2024-04-26T22:06:02.621631+0000","last_fullsized":"2024-04-26T22:06:02.621631+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:58.694515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616035+0000","last_change":"2024-04-26T22:06:02.611581+0000","last_active":"2024-04-26T22:06:02.616035+0000","last_peered":"2024-04-26T22:06:02.616035+0000","last_clean":"2024-04-26T22:06:02.616035+0000","last_became_active":"2024-04-26T22:06:02.611310+0000","last_became_peered":"2024-04-26T22:06:02.611310+0000","last_unstale":"2024-04-26T22:06:02.616035+0000","last_undegraded":"2024-04-26T22:06:02.616035+0000","last_fullsized":"2024-04-26T22:06:02.616035+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:43.555852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.613297+0000","last_change":"2024-04-26T22:06:01.595197+0000","last_active":"2024-04-26T22:06:02.613297+0000","last_peered":"2024-04-26T22:06:02.613297+0000","last_clean":"2024-04-26T22:06:02.613297+0000","last_became_active":"2024-04-26T22:06:01.594941+0000","last_became_peered":"2024-04-26T22:06:01.594941+0000","last_unstale":"2024-04-26T22:06:02.613297+0000","last_undegraded":"2024-04-26T22:06:02.613297+0000","last_fullsized":"2024-04-26T22:06:02.613297+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:48.506149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.602261+0000","last_change":"2024-04-26T22:06:02.599444+0000","last_active":"2024-04-26T22:06:02.602261+0000","last_peered":"2024-04-26T22:06:02.602261+0000","last_clean":"2024-04-26T22:06:02.602261+0000","last_became_active":"2024-04-26T22:06:02.599196+0000","last_became_peered":"2024-04-26T22:06:02.599196+0000","last_unstale":"2024-04-26T22:06:02.602261+0000","last_undegraded":"2024-04-26T22:06:02.602261+0000","last_fullsized":"2024-04-26T22:06:02.602261+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:35.111920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.623844+0000","last_change":"2024-04-26T22:06:01.601273+0000","last_active":"2024-04-26T22:06:02.623844+0000","last_peered":"2024-04-26T22:06:02.623844+0000","last_clean":"2024-04-26T22:06:02.623844+0000","last_became_active":"2024-04-26T22:06:01.601006+0000","last_became_peered":"2024-04-26T22:06:01.601006+0000","last_unstale":"2024-04-26T22:06:02.623844+0000","last_undegraded":"2024-04-26T22:06:02.623844+0000","last_fullsized":"2024-04-26T22:06:02.623844+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:31.376859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619588+0000","last_change":"2024-04-26T22:06:02.610663+0000","last_active":"2024-04-26T22:06:02.619588+0000","last_peered":"2024-04-26T22:06:02.619588+0000","last_clean":"2024-04-26T22:06:02.619588+0000","last_became_active":"2024-04-26T22:06:02.610392+0000","last_became_peered":"2024-04-26T22:06:02.610392+0000","last_unstale":"2024-04-26T22:06:02.619588+0000","last_undegraded":"2024-04-26T22:06:02.619588+0000","last_fullsized":"2024-04-26T22:06:02.619588+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:54.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.593677+0000","last_change":"2024-04-26T22:06:01.595652+0000","last_active":"2024-04-26T22:06:02.593677+0000","last_peered":"2024-04-26T22:06:02.593677+0000","last_clean":"2024-04-26T22:06:02.593677+0000","last_became_active":"2024-04-26T22:06:01.595226+0000","last_became_peered":"2024-04-26T22:06:01.595226+0000","last_unstale":"2024-04-26T22:06:02.593677+0000","last_undegraded":"2024-04-26T22:06:02.593677+0000","last_fullsized":"2024-04-26T22:06:02.593677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:41.173008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619344+0000","last_change":"2024-04-26T22:06:02.616475+0000","last_active":"2024-04-26T22:06:02.619344+0000","last_peered":"2024-04-26T22:06:02.619344+0000","last_clean":"2024-04-26T22:06:02.619344+0000","last_became_active":"2024-04-26T22:06:02.616043+0000","last_became_peered":"2024-04-26T22:06:02.616043+0000","last_unstale":"2024-04-26T22:06:02.619344+0000","last_undegraded":"2024-04-26T22:06:02.619344+0000","last_fullsized":"2024-04-26T22:06:02.619344+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:30.244089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.603804+0000","last_change":"2024-04-26T22:06:01.598557+0000","last_active":"2024-04-26T22:06:02.603804+0000","last_peered":"2024-04-26T22:06:02.603804+0000","last_clean":"2024-04-26T22:06:02.603804+0000","last_became_active":"2024-04-26T22:06:01.598273+0000","last_became_peered":"2024-04-26T22:06:01.598273+0000","last_unstale":"2024-04-26T22:06:02.603804+0000","last_undegraded":"2024-04-26T22:06:02.603804+0000","last_fullsized":"2024-04-26T22:06:02.603804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:14.001148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.615137+0000","last_change":"2024-04-26T22:06:02.606945+0000","last_active":"2024-04-26T22:06:02.615137+0000","last_peered":"2024-04-26T22:06:02.615137+0000","last_clean":"2024-04-26T22:06:02.615137+0000","last_became_active":"2024-04-26T22:06:02.606640+0000","last_became_peered":"2024-04-26T22:06:02.606640+0000","last_unstale":"2024-04-26T22:06:02.615137+0000","last_undegraded":"2024-04-26T22:06:02.615137+0000","last_fullsized":"2024-04-26T22:06:02.615137+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:37.810482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.603473+0000","last_change":"2024-04-26T22:06:01.598245+0000","last_active":"2024-04-26T22:06:02.603473+0000","last_peered":"2024-04-26T22:06:02.603473+0000","last_clean":"2024-04-26T22:06:02.603473+0000","last_became_active":"2024-04-26T22:06:01.597986+0000","last_became_peered":"2024-04-26T22:06:01.597986+0000","last_unstale":"2024-04-26T22:06:02.603473+0000","last_undegraded":"2024-04-26T22:06:02.603473+0000","last_fullsized":"2024-04-26T22:06:02.603473+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:22:23.725975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618802+0000","last_change":"2024-04-26T22:06:02.612604+0000","last_active":"2024-04-26T22:06:02.618802+0000","last_peered":"2024-04-26T22:06:02.618802+0000","last_clean":"2024-04-26T22:06:02.618802+0000","last_became_active":"2024-04-26T22:06:02.605528+0000","last_became_peered":"2024-04-26T22:06:02.605528+0000","last_unstale":"2024-04-26T22:06:02.618802+0000","last_undegraded":"2024-04-26T22:06:02.618802+0000","last_fullsized":"2024-04-26T22:06:02.618802+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:53.456320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.603111+0000","last_change":"2024-04-26T22:06:01.595706+0000","last_active":"2024-04-26T22:06:02.603111+0000","last_peered":"2024-04-26T22:06:02.603111+0000","last_clean":"2024-04-26T22:06:02.603111+0000","last_became_active":"2024-04-26T22:06:01.595417+0000","last_became_peered":"2024-04-26T22:06:01.595417+0000","last_unstale":"2024-04-26T22:06:02.603111+0000","last_undegraded":"2024-04-26T22:06:02.603111+0000","last_fullsized":"2024-04-26T22:06:02.603111+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:29.239627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.609221+0000","last_change":"2024-04-26T22:06:02.605044+0000","last_active":"2024-04-26T22:06:02.609221+0000","last_peered":"2024-04-26T22:06:02.609221+0000","last_clean":"2024-04-26T22:06:02.609221+0000","last_became_active":"2024-04-26T22:06:02.604207+0000","last_became_peered":"2024-04-26T22:06:02.604207+0000","last_unstale":"2024-04-26T22:06:02.609221+0000","last_undegraded":"2024-04-26T22:06:02.609221+0000","last_fullsized":"2024-04-26T22:06:02.609221+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:53.456320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"102'3","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618380+0000","last_change":"2024-04-26T22:06:01.599223+0000","last_active":"2024-04-26T22:06:02.618380+0000","last_peered":"2024-04-26T22:06:02.618380+0000","last_clean":"2024-04-26T22:06:02.618380+0000","last_became_active":"2024-04-26T22:06:01.596689+0000","last_became_peered":"2024-04-26T22:06:01.596689+0000","last_unstale":"2024-04-26T22:06:02.618380+0000","last_undegraded":"2024-04-26T22:06:02.618380+0000","last_fullsized":"2024-04-26T22:06:02.618380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:14.790002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.605502+0000","last_change":"2024-04-26T22:06:02.601854+0000","last_active":"2024-04-26T22:06:02.605502+0000","last_peered":"2024-04-26T22:06:02.605502+0000","last_clean":"2024-04-26T22:06:02.605502+0000","last_became_active":"2024-04-26T22:06:02.601544+0000","last_became_peered":"2024-04-26T22:06:02.601544+0000","last_unstale":"2024-04-26T22:06:02.605502+0000","last_undegraded":"2024-04-26T22:06:02.605502+0000","last_fullsized":"2024-04-26T22:06:02.605502+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.124042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"102'6","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.624471+0000","last_change":"2024-04-26T22:06:01.595733+0000","last_active":"2024-04-26T22:06:02.624471+0000","last_peered":"2024-04-26T22:06:02.624471+0000","last_clean":"2024-04-26T22:06:02.624471+0000","last_became_active":"2024-04-26T22:06:01.595437+0000","last_became_peered":"2024-04-26T22:06:01.595437+0000","last_unstale":"2024-04-26T22:06:02.624471+0000","last_undegraded":"2024-04-26T22:06:02.624471+0000","last_fullsized":"2024-04-26T22:06:02.624471+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:05:22.623998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620143+0000","last_change":"2024-04-26T22:06:02.614481+0000","last_active":"2024-04-26T22:06:02.620143+0000","last_peered":"2024-04-26T22:06:02.620143+0000","last_clean":"2024-04-26T22:06:02.620143+0000","last_became_active":"2024-04-26T22:06:02.614204+0000","last_became_peered":"2024-04-26T22:06:02.614204+0000","last_unstale":"2024-04-26T22:06:02.620143+0000","last_undegraded":"2024-04-26T22:06:02.620143+0000","last_fullsized":"2024-04-26T22:06:02.620143+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:31.573619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618763+0000","last_change":"2024-04-26T22:06:01.602641+0000","last_active":"2024-04-26T22:06:02.618763+0000","last_peered":"2024-04-26T22:06:02.618763+0000","last_clean":"2024-04-26T22:06:02.618763+0000","last_became_active":"2024-04-26T22:06:01.600508+0000","last_became_peered":"2024-04-26T22:06:01.600508+0000","last_unstale":"2024-04-26T22:06:02.618763+0000","last_undegraded":"2024-04-26T22:06:02.618763+0000","last_fullsized":"2024-04-26T22:06:02.618763+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:36.103982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.612906+0000","last_change":"2024-04-26T22:06:02.608334+0000","last_active":"2024-04-26T22:06:02.612906+0000","last_peered":"2024-04-26T22:06:02.612906+0000","last_clean":"2024-04-26T22:06:02.612906+0000","last_became_active":"2024-04-26T22:06:02.608038+0000","last_became_peered":"2024-04-26T22:06:02.608038+0000","last_unstale":"2024-04-26T22:06:02.612906+0000","last_undegraded":"2024-04-26T22:06:02.612906+0000","last_fullsized":"2024-04-26T22:06:02.612906+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:38.366492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.599446+0000","last_change":"2024-04-26T22:06:01.605508+0000","last_active":"2024-04-26T22:06:02.599446+0000","last_peered":"2024-04-26T22:06:02.599446+0000","last_clean":"2024-04-26T22:06:02.599446+0000","last_became_active":"2024-04-26T22:06:01.605161+0000","last_became_peered":"2024-04-26T22:06:01.605161+0000","last_unstale":"2024-04-26T22:06:02.599446+0000","last_undegraded":"2024-04-26T22:06:02.599446+0000","last_fullsized":"2024-04-26T22:06:02.599446+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:54.207840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618895+0000","last_change":"2024-04-26T22:06:02.614849+0000","last_active":"2024-04-26T22:06:02.618895+0000","last_peered":"2024-04-26T22:06:02.618895+0000","last_clean":"2024-04-26T22:06:02.618895+0000","last_became_active":"2024-04-26T22:06:02.613094+0000","last_became_peered":"2024-04-26T22:06:02.613094+0000","last_unstale":"2024-04-26T22:06:02.618895+0000","last_undegraded":"2024-04-26T22:06:02.618895+0000","last_fullsized":"2024-04-26T22:06:02.618895+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.794464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.604250+0000","last_change":"2024-04-26T22:06:01.595324+0000","last_active":"2024-04-26T22:06:02.604250+0000","last_peered":"2024-04-26T22:06:02.604250+0000","last_clean":"2024-04-26T22:06:02.604250+0000","last_became_active":"2024-04-26T22:06:01.595035+0000","last_became_peered":"2024-04-26T22:06:01.595035+0000","last_unstale":"2024-04-26T22:06:02.604250+0000","last_undegraded":"2024-04-26T22:06:02.604250+0000","last_fullsized":"2024-04-26T22:06:02.604250+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:29.300165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.621601+0000","last_change":"2024-04-26T22:06:02.618402+0000","last_active":"2024-04-26T22:06:02.621601+0000","last_peered":"2024-04-26T22:06:02.621601+0000","last_clean":"2024-04-26T22:06:02.621601+0000","last_became_active":"2024-04-26T22:06:02.618146+0000","last_became_peered":"2024-04-26T22:06:02.618146+0000","last_unstale":"2024-04-26T22:06:02.621601+0000","last_undegraded":"2024-04-26T22:06:02.621601+0000","last_fullsized":"2024-04-26T22:06:02.621601+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:22:44.540227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"102'8","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618070+0000","last_change":"2024-04-26T22:06:01.592520+0000","last_active":"2024-04-26T22:06:02.618070+0000","last_peered":"2024-04-26T22:06:02.618070+0000","last_clean":"2024-04-26T22:06:02.618070+0000","last_became_active":"2024-04-26T22:06:01.592232+0000","last_became_peered":"2024-04-26T22:06:01.592232+0000","last_unstale":"2024-04-26T22:06:02.618070+0000","last_undegraded":"2024-04-26T22:06:02.618070+0000","last_fullsized":"2024-04-26T22:06:02.618070+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:05.576845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.610376+0000","last_change":"2024-04-26T22:06:02.608502+0000","last_active":"2024-04-26T22:06:02.610376+0000","last_peered":"2024-04-26T22:06:02.610376+0000","last_clean":"2024-04-26T22:06:02.610376+0000","last_became_active":"2024-04-26T22:06:02.608226+0000","last_became_peered":"2024-04-26T22:06:02.608226+0000","last_unstale":"2024-04-26T22:06:02.610376+0000","last_undegraded":"2024-04-26T22:06:02.610376+0000","last_fullsized":"2024-04-26T22:06:02.610376+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.794464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617819+0000","last_change":"2024-04-26T22:06:01.603876+0000","last_active":"2024-04-26T22:06:02.617819+0000","last_peered":"2024-04-26T22:06:02.617819+0000","last_clean":"2024-04-26T22:06:02.617819+0000","last_became_active":"2024-04-26T22:06:01.603596+0000","last_became_peered":"2024-04-26T22:06:01.603596+0000","last_unstale":"2024-04-26T22:06:02.617819+0000","last_undegraded":"2024-04-26T22:06:02.617819+0000","last_fullsized":"2024-04-26T22:06:02.617819+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:05:53.028219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616459+0000","last_change":"2024-04-26T22:06:02.614973+0000","last_active":"2024-04-26T22:06:02.616459+0000","last_peered":"2024-04-26T22:06:02.616459+0000","last_clean":"2024-04-26T22:06:02.616459+0000","last_became_active":"2024-04-26T22:06:02.614668+0000","last_became_peered":"2024-04-26T22:06:02.614668+0000","last_unstale":"2024-04-26T22:06:02.616459+0000","last_undegraded":"2024-04-26T22:06:02.616459+0000","last_fullsized":"2024-04-26T22:06:02.616459+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:01:01.057559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617289+0000","last_change":"2024-04-26T22:06:01.596559+0000","last_active":"2024-04-26T22:06:02.617289+0000","last_peered":"2024-04-26T22:06:02.617289+0000","last_clean":"2024-04-26T22:06:02.617289+0000","last_became_active":"2024-04-26T22:06:01.596225+0000","last_became_peered":"2024-04-26T22:06:01.596225+0000","last_unstale":"2024-04-26T22:06:02.617289+0000","last_undegraded":"2024-04-26T22:06:02.617289+0000","last_fullsized":"2024-04-26T22:06:02.617289+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:29.300165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.611646+0000","last_change":"2024-04-26T22:06:02.608842+0000","last_active":"2024-04-26T22:06:02.611646+0000","last_peered":"2024-04-26T22:06:02.611646+0000","last_clean":"2024-04-26T22:06:02.611646+0000","last_became_active":"2024-04-26T22:06:02.608544+0000","last_became_peered":"2024-04-26T22:06:02.608544+0000","last_unstale":"2024-04-26T22:06:02.611646+0000","last_undegraded":"2024-04-26T22:06:02.611646+0000","last_fullsized":"2024-04-26T22:06:02.611646+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:29:24.354169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.594169+0000","last_change":"2024-04-26T22:06:01.598021+0000","last_active":"2024-04-26T22:06:02.594169+0000","last_peered":"2024-04-26T22:06:02.594169+0000","last_clean":"2024-04-26T22:06:02.594169+0000","last_became_active":"2024-04-26T22:06:01.597084+0000","last_became_peered":"2024-04-26T22:06:01.597084+0000","last_unstale":"2024-04-26T22:06:02.594169+0000","last_undegraded":"2024-04-26T22:06:02.594169+0000","last_fullsized":"2024-04-26T22:06:02.594169+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:25.818139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617262+0000","last_change":"2024-04-26T22:06:02.613322+0000","last_active":"2024-04-26T22:06:02.617262+0000","last_peered":"2024-04-26T22:06:02.617262+0000","last_clean":"2024-04-26T22:06:02.617262+0000","last_became_active":"2024-04-26T22:06:02.613046+0000","last_became_peered":"2024-04-26T22:06:02.613046+0000","last_unstale":"2024-04-26T22:06:02.617262+0000","last_undegraded":"2024-04-26T22:06:02.617262+0000","last_fullsized":"2024-04-26T22:06:02.617262+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:04:30.651266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622063+0000","last_change":"2024-04-26T22:06:01.605309+0000","last_active":"2024-04-26T22:06:02.622063+0000","last_peered":"2024-04-26T22:06:02.622063+0000","last_clean":"2024-04-26T22:06:02.622063+0000","last_became_active":"2024-04-26T22:06:01.604981+0000","last_became_peered":"2024-04-26T22:06:01.604981+0000","last_unstale":"2024-04-26T22:06:02.622063+0000","last_undegraded":"2024-04-26T22:06:02.622063+0000","last_fullsized":"2024-04-26T22:06:02.622063+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:47:29.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614641+0000","last_change":"2024-04-26T22:06:02.606560+0000","last_active":"2024-04-26T22:06:02.614641+0000","last_peered":"2024-04-26T22:06:02.614641+0000","last_clean":"2024-04-26T22:06:02.614641+0000","last_became_active":"2024-04-26T22:06:02.606320+0000","last_became_peered":"2024-04-26T22:06:02.606320+0000","last_unstale":"2024-04-26T22:06:02.614641+0000","last_undegraded":"2024-04-26T22:06:02.614641+0000","last_fullsized":"2024-04-26T22:06:02.614641+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:44.294985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.599294+0000","last_change":"2024-04-26T22:06:01.603049+0000","last_active":"2024-04-26T22:06:02.599294+0000","last_peered":"2024-04-26T22:06:02.599294+0000","last_clean":"2024-04-26T22:06:02.599294+0000","last_became_active":"2024-04-26T22:06:01.602778+0000","last_became_peered":"2024-04-26T22:06:01.602778+0000","last_unstale":"2024-04-26T22:06:02.599294+0000","last_undegraded":"2024-04-26T22:06:02.599294+0000","last_fullsized":"2024-04-26T22:06:02.599294+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:07.021690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616659+0000","last_change":"2024-04-26T22:06:02.613129+0000","last_active":"2024-04-26T22:06:02.616659+0000","last_peered":"2024-04-26T22:06:02.616659+0000","last_clean":"2024-04-26T22:06:02.616659+0000","last_became_active":"2024-04-26T22:06:02.612866+0000","last_became_peered":"2024-04-26T22:06:02.612866+0000","last_unstale":"2024-04-26T22:06:02.616659+0000","last_undegraded":"2024-04-26T22:06:02.616659+0000","last_fullsized":"2024-04-26T22:06:02.616659+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:11.025282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.599607+0000","last_change":"2024-04-26T22:06:01.600176+0000","last_active":"2024-04-26T22:06:02.599607+0000","last_peered":"2024-04-26T22:06:02.599607+0000","last_clean":"2024-04-26T22:06:02.599607+0000","last_became_active":"2024-04-26T22:06:01.599869+0000","last_became_peered":"2024-04-26T22:06:01.599869+0000","last_unstale":"2024-04-26T22:06:02.599607+0000","last_undegraded":"2024-04-26T22:06:02.599607+0000","last_fullsized":"2024-04-26T22:06:02.599607+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:46:55.015562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617644+0000","last_change":"2024-04-26T22:06:02.614117+0000","last_active":"2024-04-26T22:06:02.617644+0000","last_peered":"2024-04-26T22:06:02.617644+0000","last_clean":"2024-04-26T22:06:02.617644+0000","last_became_active":"2024-04-26T22:06:02.613793+0000","last_became_peered":"2024-04-26T22:06:02.613793+0000","last_unstale":"2024-04-26T22:06:02.617644+0000","last_undegraded":"2024-04-26T22:06:02.617644+0000","last_fullsized":"2024-04-26T22:06:02.617644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:54.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.593669+0000","last_change":"2024-04-26T22:06:01.600238+0000","last_active":"2024-04-26T22:06:02.593669+0000","last_peered":"2024-04-26T22:06:02.593669+0000","last_clean":"2024-04-26T22:06:02.593669+0000","last_became_active":"2024-04-26T22:06:01.599985+0000","last_became_peered":"2024-04-26T22:06:01.599985+0000","last_unstale":"2024-04-26T22:06:02.593669+0000","last_undegraded":"2024-04-26T22:06:02.593669+0000","last_fullsized":"2024-04-26T22:06:02.593669+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:32.472261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608128+0000","last_change":"2024-04-26T22:06:02.602733+0000","last_active":"2024-04-26T22:06:02.608128+0000","last_peered":"2024-04-26T22:06:02.608128+0000","last_clean":"2024-04-26T22:06:02.608128+0000","last_became_active":"2024-04-26T22:06:02.602470+0000","last_became_peered":"2024-04-26T22:06:02.602470+0000","last_unstale":"2024-04-26T22:06:02.608128+0000","last_undegraded":"2024-04-26T22:06:02.608128+0000","last_fullsized":"2024-04-26T22:06:02.608128+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:12.892944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619603+0000","last_change":"2024-04-26T22:06:01.597740+0000","last_active":"2024-04-26T22:06:02.619603+0000","last_peered":"2024-04-26T22:06:02.619603+0000","last_clean":"2024-04-26T22:06:02.619603+0000","last_became_active":"2024-04-26T22:06:01.597287+0000","last_became_peered":"2024-04-26T22:06:01.597287+0000","last_unstale":"2024-04-26T22:06:02.619603+0000","last_undegraded":"2024-04-26T22:06:02.619603+0000","last_fullsized":"2024-04-26T22:06:02.619603+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:26.796516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622238+0000","last_change":"2024-04-26T22:06:02.615772+0000","last_active":"2024-04-26T22:06:02.622238+0000","last_peered":"2024-04-26T22:06:02.622238+0000","last_clean":"2024-04-26T22:06:02.622238+0000","last_became_active":"2024-04-26T22:06:02.615483+0000","last_became_peered":"2024-04-26T22:06:02.615483+0000","last_unstale":"2024-04-26T22:06:02.622238+0000","last_undegraded":"2024-04-26T22:06:02.622238+0000","last_fullsized":"2024-04-26T22:06:02.622238+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:48.028280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.595182+0000","last_change":"2024-04-26T22:06:01.604551+0000","last_active":"2024-04-26T22:06:02.595182+0000","last_peered":"2024-04-26T22:06:02.595182+0000","last_clean":"2024-04-26T22:06:02.595182+0000","last_became_active":"2024-04-26T22:06:01.604299+0000","last_became_peered":"2024-04-26T22:06:01.604299+0000","last_unstale":"2024-04-26T22:06:02.595182+0000","last_undegraded":"2024-04-26T22:06:02.595182+0000","last_fullsized":"2024-04-26T22:06:02.595182+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:38.064349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622131+0000","last_change":"2024-04-26T22:06:02.613788+0000","last_active":"2024-04-26T22:06:02.622131+0000","last_peered":"2024-04-26T22:06:02.622131+0000","last_clean":"2024-04-26T22:06:02.622131+0000","last_became_active":"2024-04-26T22:06:02.613510+0000","last_became_peered":"2024-04-26T22:06:02.613510+0000","last_unstale":"2024-04-26T22:06:02.622131+0000","last_undegraded":"2024-04-26T22:06:02.622131+0000","last_fullsized":"2024-04-26T22:06:02.622131+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:26.297255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.594422+0000","last_change":"2024-04-26T22:06:01.596653+0000","last_active":"2024-04-26T22:06:02.594422+0000","last_peered":"2024-04-26T22:06:02.594422+0000","last_clean":"2024-04-26T22:06:02.594422+0000","last_became_active":"2024-04-26T22:06:01.596344+0000","last_became_peered":"2024-04-26T22:06:01.596344+0000","last_unstale":"2024-04-26T22:06:02.594422+0000","last_undegraded":"2024-04-26T22:06:02.594422+0000","last_fullsized":"2024-04-26T22:06:02.594422+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:02.975700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616094+0000","last_change":"2024-04-26T22:06:02.612068+0000","last_active":"2024-04-26T22:06:02.616094+0000","last_peered":"2024-04-26T22:06:02.616094+0000","last_clean":"2024-04-26T22:06:02.616094+0000","last_became_active":"2024-04-26T22:06:02.611827+0000","last_became_peered":"2024-04-26T22:06:02.611827+0000","last_unstale":"2024-04-26T22:06:02.616094+0000","last_undegraded":"2024-04-26T22:06:02.616094+0000","last_fullsized":"2024-04-26T22:06:02.616094+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:35.111920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.595023+0000","last_change":"2024-04-26T22:06:01.593497+0000","last_active":"2024-04-26T22:06:02.595023+0000","last_peered":"2024-04-26T22:06:02.595023+0000","last_clean":"2024-04-26T22:06:02.595023+0000","last_became_active":"2024-04-26T22:06:01.593217+0000","last_became_peered":"2024-04-26T22:06:01.593217+0000","last_unstale":"2024-04-26T22:06:02.595023+0000","last_undegraded":"2024-04-26T22:06:02.595023+0000","last_fullsized":"2024-04-26T22:06:02.595023+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:01.363116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614572+0000","last_change":"2024-04-26T22:06:02.608020+0000","last_active":"2024-04-26T22:06:02.614572+0000","last_peered":"2024-04-26T22:06:02.614572+0000","last_clean":"2024-04-26T22:06:02.614572+0000","last_became_active":"2024-04-26T22:06:02.607741+0000","last_became_peered":"2024-04-26T22:06:02.607741+0000","last_unstale":"2024-04-26T22:06:02.614572+0000","last_undegraded":"2024-04-26T22:06:02.614572+0000","last_fullsized":"2024-04-26T22:06:02.614572+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:09:23.981922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.594311+0000","last_change":"2024-04-26T22:06:01.597448+0000","last_active":"2024-04-26T22:06:02.594311+0000","last_peered":"2024-04-26T22:06:02.594311+0000","last_clean":"2024-04-26T22:06:02.594311+0000","last_became_active":"2024-04-26T22:06:01.597189+0000","last_became_peered":"2024-04-26T22:06:01.597189+0000","last_unstale":"2024-04-26T22:06:02.594311+0000","last_undegraded":"2024-04-26T22:06:02.594311+0000","last_fullsized":"2024-04-26T22:06:02.594311+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:58.173331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619088+0000","last_change":"2024-04-26T22:06:02.615912+0000","last_active":"2024-04-26T22:06:02.619088+0000","last_peered":"2024-04-26T22:06:02.619088+0000","last_clean":"2024-04-26T22:06:02.619088+0000","last_became_active":"2024-04-26T22:06:02.615678+0000","last_became_peered":"2024-04-26T22:06:02.615678+0000","last_unstale":"2024-04-26T22:06:02.619088+0000","last_undegraded":"2024-04-26T22:06:02.619088+0000","last_fullsized":"2024-04-26T22:06:02.619088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:35.111920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.593253+0000","last_change":"2024-04-26T22:06:01.598669+0000","last_active":"2024-04-26T22:06:02.593253+0000","last_peered":"2024-04-26T22:06:02.593253+0000","last_clean":"2024-04-26T22:06:02.593253+0000","last_became_active":"2024-04-26T22:06:01.598383+0000","last_became_peered":"2024-04-26T22:06:01.598383+0000","last_unstale":"2024-04-26T22:06:02.593253+0000","last_undegraded":"2024-04-26T22:06:02.593253+0000","last_fullsized":"2024-04-26T22:06:02.593253+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:05:22.623998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614404+0000","last_change":"2024-04-26T22:06:02.607302+0000","last_active":"2024-04-26T22:06:02.614404+0000","last_peered":"2024-04-26T22:06:02.614404+0000","last_clean":"2024-04-26T22:06:02.614404+0000","last_became_active":"2024-04-26T22:06:02.607035+0000","last_became_peered":"2024-04-26T22:06:02.607035+0000","last_unstale":"2024-04-26T22:06:02.614404+0000","last_undegraded":"2024-04-26T22:06:02.614404+0000","last_fullsized":"2024-04-26T22:06:02.614404+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:42.416170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.604423+0000","last_change":"2024-04-26T22:06:01.600243+0000","last_active":"2024-04-26T22:06:02.604423+0000","last_peered":"2024-04-26T22:06:02.604423+0000","last_clean":"2024-04-26T22:06:02.604423+0000","last_became_active":"2024-04-26T22:06:01.599981+0000","last_became_peered":"2024-04-26T22:06:01.599981+0000","last_unstale":"2024-04-26T22:06:02.604423+0000","last_undegraded":"2024-04-26T22:06:02.604423+0000","last_fullsized":"2024-04-26T22:06:02.604423+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:44.119581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617616+0000","last_change":"2024-04-26T22:06:02.613954+0000","last_active":"2024-04-26T22:06:02.617616+0000","last_peered":"2024-04-26T22:06:02.617616+0000","last_clean":"2024-04-26T22:06:02.617616+0000","last_became_active":"2024-04-26T22:06:02.613687+0000","last_became_peered":"2024-04-26T22:06:02.613687+0000","last_unstale":"2024-04-26T22:06:02.617616+0000","last_undegraded":"2024-04-26T22:06:02.617616+0000","last_fullsized":"2024-04-26T22:06:02.617616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.124042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.599377+0000","last_change":"2024-04-26T22:06:01.607061+0000","last_active":"2024-04-26T22:06:02.599377+0000","last_peered":"2024-04-26T22:06:02.599377+0000","last_clean":"2024-04-26T22:06:02.599377+0000","last_became_active":"2024-04-26T22:06:01.606762+0000","last_became_peered":"2024-04-26T22:06:01.606762+0000","last_unstale":"2024-04-26T22:06:02.599377+0000","last_undegraded":"2024-04-26T22:06:02.599377+0000","last_fullsized":"2024-04-26T22:06:02.599377+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:48.282414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614078+0000","last_change":"2024-04-26T22:06:02.606205+0000","last_active":"2024-04-26T22:06:02.614078+0000","last_peered":"2024-04-26T22:06:02.614078+0000","last_clean":"2024-04-26T22:06:02.614078+0000","last_became_active":"2024-04-26T22:06:02.605912+0000","last_became_peered":"2024-04-26T22:06:02.605912+0000","last_unstale":"2024-04-26T22:06:02.614078+0000","last_undegraded":"2024-04-26T22:06:02.614078+0000","last_fullsized":"2024-04-26T22:06:02.614078+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:46.361090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619339+0000","last_change":"2024-04-26T22:06:01.596703+0000","last_active":"2024-04-26T22:06:02.619339+0000","last_peered":"2024-04-26T22:06:02.619339+0000","last_clean":"2024-04-26T22:06:02.619339+0000","last_became_active":"2024-04-26T22:06:01.596403+0000","last_became_peered":"2024-04-26T22:06:01.596403+0000","last_unstale":"2024-04-26T22:06:02.619339+0000","last_undegraded":"2024-04-26T22:06:02.619339+0000","last_fullsized":"2024-04-26T22:06:02.619339+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:52.451859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":335,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.594468+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:06:02.594468+0000","last_peered":"2024-04-26T22:06:02.594468+0000","last_clean":"2024-04-26T22:06:02.594468+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:06:02.594468+0000","last_undegraded":"2024-04-26T22:06:02.594468+0000","last_fullsized":"2024-04-26T22:06:02.594468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37144,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334696,"statfs":{"total":96636764160,"available":96598728704,"internally_reserved":0,"allocated":1843200,"data_stored":1128172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36564,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335276,"statfs":{"total":96636764160,"available":96599322624,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36564,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335276,"statfs":{"total":96636764160,"available":96599322624,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1843200,"data_stored":1128172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:06:05.566 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:06:05.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.699+0000 7f8101637640 1 Processor -- start 2024-04-26T22:06:05.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.699+0000 7f8101637640 1 -- start start 2024-04-26T22:06:05.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.700+0000 7f8101637640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f80fc09c400 0x7f80fc0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.700+0000 7f8101637640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80fc070520 0x7f80fc0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.700+0000 7f8101637640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80fc0d14c0 con 0x7f80fc070d20 2024-04-26T22:06:05.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.700+0000 7f8101637640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f80fc0d1290 con 0x7f80fc09c400 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.700+0000 7f8101637640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f80fc0d1760 con 0x7f80fc070520 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.700+0000 7f80faffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f80fc070d20 0x7f80fc071100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38094/0 (socket says 172.21.15.137:38094) 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.700+0000 7f80faffd640 1 -- 172.21.15.137:0/538694113 learned_addr learned my addr 172.21.15.137:0/538694113 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.700+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3846285586 0 0) 0x7f80fc0d14c0 con 0x7f80fc070d20 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e4003520 con 0x7f80fc070d20 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80fb7fe640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80fc070520 0x7f80fc0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80fa7fc640 1 --2- 172.21.15.137:0/538694113 >> v2:172.21.15.170:3300/0 conn(0x7f80fc09c400 0x7f80fc0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4240120180 0 0) 0x7f80e4003520 con 0x7f80fc070d20 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80fc070520 msgr2=0x7f80fc0cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80fc070520 0x7f80fc0cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 >> v2:172.21.15.170:3300/0 conn(0x7f80fc09c400 msgr2=0x7f80fc0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:05.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 --2- 172.21.15.137:0/538694113 >> v2:172.21.15.170:3300/0 conn(0x7f80fc09c400 0x7f80fc0cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80fc0d1a40 con 0x7f80fc070d20 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f80ec0019f0 con 0x7f80fc070d20 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 >> v1:172.21.15.137:6789/0 conn(0x7f80fc070d20 legacy=0x7f80fc071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e40039b0 0x7f80e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e4004800 0x7f80e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80fc070520 0x7f80e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc0d1760 con 0x7f80e4004800 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f80e400b9c0 con 0x7f80e40039b0 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f80e400bb40 con 0x7f80fc070520 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80fa7fc640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e4004800 0x7f80e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80faffd640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e40039b0 0x7f80e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80fb7fe640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80fc070520 0x7f80e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80fa7fc640 1 -- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80fc070520 msgr2=0x7f80e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80fa7fc640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80fc070520 0x7f80e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80fa7fc640 1 -- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e40039b0 msgr2=0x7f80e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80fa7fc640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80e40039b0 0x7f80e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.701+0000 7f80fa7fc640 1 -- 172.21.15.137:0/538694113 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e4003520 con 0x7f80e4004800 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.702+0000 7f80fa7fc640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e4004800 0x7f80e4004c80 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009ac0 tx=0x7f80e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1bd2ed10fe05e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.702+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0036070 con 0x7f80e4004800 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.702+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f0031400 con 0x7f80e4004800 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.702+0000 7f80f9ffb640 1 -- 172.21.15.137:0/538694113 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0009690 con 0x7f80e4004800 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.703+0000 7f8101637640 1 -- 172.21.15.137:0/538694113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e4004800 msgr2=0x7f80e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.703+0000 7f8101637640 1 --2- 172.21.15.137:0/538694113 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80e4004800 0x7f80e4004c80 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f80f0009ac0 tx=0x7f80e4005830 comp rx=0 tx=0).stop 2024-04-26T22:06:05.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.703+0000 7f80fb7fe640 1 -- 172.21.15.137:0/538694113 reap_dead start 2024-04-26T22:06:05.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.703+0000 7f8101637640 1 -- 172.21.15.137:0/538694113 shutdown_connections 2024-04-26T22:06:05.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.703+0000 7f8101637640 1 -- 172.21.15.137:0/538694113 >> 172.21.15.137:0/538694113 conn(0x7f80fc0b4a40 msgr2=0x7f80fc0b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:05.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.703+0000 7f8101637640 1 -- 172.21.15.137:0/538694113 shutdown_connections 2024-04-26T22:06:05.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.703+0000 7f8101637640 1 -- 172.21.15.137:0/538694113 wait complete. 2024-04-26T22:06:05.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.704+0000 7f8101637640 1 Processor -- start 2024-04-26T22:06:05.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.704+0000 7f8101637640 1 -- start start 2024-04-26T22:06:05.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f8101637640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e4004800 0x7f80fc154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f8101637640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80fc0c6a40 0x7f80fc0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f8101637640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80fc0b02e0 0x7f80fc0b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f8101637640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc0cf350 con 0x7f80fc0b02e0 2024-04-26T22:06:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f8101637640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc0d2000 con 0x7f80fc0c6a40 2024-04-26T22:06:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f8101637640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f80fc0d2520 con 0x7f80e4004800 2024-04-26T22:06:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80fc0b02e0 0x7f80fc0b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80fc0b02e0 0x7f80fc0b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59246/0 (socket says 172.21.15.137:59246) 2024-04-26T22:06:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fb7fe640 1 -- 172.21.15.137:0/133846896 learned_addr learned my addr 172.21.15.137:0/133846896 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80faffd640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e4004800 0x7f80fc154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fa7fc640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80fc0c6a40 0x7f80fc0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fb7fe640 1 -- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e4004800 msgr2=0x7f80fc154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fb7fe640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e4004800 0x7f80fc154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fb7fe640 1 -- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80fc0c6a40 msgr2=0x7f80fc0c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fb7fe640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80fc0c6a40 0x7f80fc0c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fb7fe640 1 -- 172.21.15.137:0/133846896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80fc0c6ed0 con 0x7f80fc0b02e0 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fa7fc640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80fc0c6a40 0x7f80fc0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80faffd640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e4004800 0x7f80fc154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80fb7fe640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80fc0b02e0 0x7f80fc0b0790 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0b2860 tx=0x7f80f400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80e37fe640 1 -- 172.21.15.137:0/133846896 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4004230 con 0x7f80fc0b02e0 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.705+0000 7f80e37fe640 1 -- 172.21.15.137:0/133846896 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f40043d0 con 0x7f80fc0b02e0 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.706+0000 7f80e37fe640 1 -- 172.21.15.137:0/133846896 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4003810 con 0x7f80fc0b02e0 2024-04-26T22:06:05.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.706+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80fc0c71b0 con 0x7f80fc0b02e0 2024-04-26T22:06:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.706+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80fc15c310 con 0x7f80fc0b02e0 2024-04-26T22:06:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.706+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80fc0693d0 con 0x7f80fc0b02e0 2024-04-26T22:06:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.707+0000 7f80e37fe640 1 -- 172.21.15.137:0/133846896 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f80f40039b0 con 0x7f80fc0b02e0 2024-04-26T22:06:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.707+0000 7f80e37fe640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80e806c920 0x7f80e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.707+0000 7f80e37fe640 1 -- 172.21.15.137:0/133846896 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f80f4093e20 con 0x7f80fc0b02e0 2024-04-26T22:06:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.707+0000 7f80faffd640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80e806c920 0x7f80e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.708+0000 7f80faffd640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80e806c920 0x7f80e806ede0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f80ec002230 tx=0x7f80ec006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:05.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.712+0000 7f80e37fe640 1 -- 172.21.15.137:0/133846896 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f80f40622e0 con 0x7f80fc0b02e0 2024-04-26T22:06:05.883 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.884+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f80fc155150 con 0x7f80e806c920 2024-04-26T22:06:05.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.889+0000 7f80e37fe640 1 -- 172.21.15.137:0/133846896 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252412 (secure 0 0 0) 0x7f80fc155150 con 0x7f80e806c920 2024-04-26T22:06:05.892 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:05.894 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80e806c920 msgr2=0x7f80e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80e806c920 0x7f80e806ede0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f80ec002230 tx=0x7f80ec006040 comp rx=0 tx=0).stop 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80fc0b02e0 msgr2=0x7f80fc0b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80fc0b02e0 0x7f80fc0b0790 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0b2860 tx=0x7f80f400c520 comp rx=0 tx=0).stop 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 shutdown_connections 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f80e806c920 0x7f80e806ede0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f80fc0b02e0 0x7f80fc0b0790 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f80fc0c6a40 0x7f80fc0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 --2- 172.21.15.137:0/133846896 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f80e4004800 0x7f80fc154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 >> 172.21.15.137:0/133846896 conn(0x7f80fc0b4a40 msgr2=0x7f80fc06de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.892+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 shutdown_connections 2024-04-26T22:06:05.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:05.893+0000 7f8101637640 1 -- 172.21.15.137:0/133846896 wait complete. 2024-04-26T22:06:05.903 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-04-26T22:06:04.792621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272872,"kb_used_data":10920,"kb_used_omap":12,"kb_used_meta":261811,"kb_avail":754701848,"statfs":{"total":773094113280,"available":772814692352,"internally_reserved":0,"allocated":11182080,"data_stored":5483168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":268095024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.213299"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.613693+0000","last_change":"2024-04-26T22:06:02.611629+0000","last_active":"2024-04-26T22:06:02.613693+0000","last_peered":"2024-04-26T22:06:02.613693+0000","last_clean":"2024-04-26T22:06:02.613693+0000","last_became_active":"2024-04-26T22:06:02.611205+0000","last_became_peered":"2024-04-26T22:06:02.611205+0000","last_unstale":"2024-04-26T22:06:02.613693+0000","last_undegraded":"2024-04-26T22:06:02.613693+0000","last_fullsized":"2024-04-26T22:06:02.613693+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:05:43.094981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608151+0000","last_change":"2024-04-26T22:06:02.602752+0000","last_active":"2024-04-26T22:06:02.608151+0000","last_peered":"2024-04-26T22:06:02.608151+0000","last_clean":"2024-04-26T22:06:02.608151+0000","last_became_active":"2024-04-26T22:06:02.602493+0000","last_became_peered":"2024-04-26T22:06:02.602493+0000","last_unstale":"2024-04-26T22:06:02.608151+0000","last_undegraded":"2024-04-26T22:06:02.608151+0000","last_fullsized":"2024-04-26T22:06:02.608151+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:41:50.103376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.613663+0000","last_change":"2024-04-26T22:06:02.611628+0000","last_active":"2024-04-26T22:06:02.613663+0000","last_peered":"2024-04-26T22:06:02.613663+0000","last_clean":"2024-04-26T22:06:02.613663+0000","last_became_active":"2024-04-26T22:06:02.611342+0000","last_became_peered":"2024-04-26T22:06:02.611342+0000","last_unstale":"2024-04-26T22:06:02.613663+0000","last_undegraded":"2024-04-26T22:06:02.613663+0000","last_fullsized":"2024-04-26T22:06:02.613663+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:58:30.908302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.621396+0000","last_change":"2024-04-26T22:06:02.617416+0000","last_active":"2024-04-26T22:06:02.621396+0000","last_peered":"2024-04-26T22:06:02.621396+0000","last_clean":"2024-04-26T22:06:02.621396+0000","last_became_active":"2024-04-26T22:06:02.617145+0000","last_became_peered":"2024-04-26T22:06:02.617145+0000","last_unstale":"2024-04-26T22:06:02.621396+0000","last_undegraded":"2024-04-26T22:06:02.621396+0000","last_fullsized":"2024-04-26T22:06:02.621396+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:47:30.801577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617548+0000","last_change":"2024-04-26T22:06:02.613905+0000","last_active":"2024-04-26T22:06:02.617548+0000","last_peered":"2024-04-26T22:06:02.617548+0000","last_clean":"2024-04-26T22:06:02.617548+0000","last_became_active":"2024-04-26T22:06:02.613334+0000","last_became_peered":"2024-04-26T22:06:02.613334+0000","last_unstale":"2024-04-26T22:06:02.617548+0000","last_undegraded":"2024-04-26T22:06:02.617548+0000","last_fullsized":"2024-04-26T22:06:02.617548+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:31.573619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.607549+0000","last_change":"2024-04-26T22:06:02.603367+0000","last_active":"2024-04-26T22:06:02.607549+0000","last_peered":"2024-04-26T22:06:02.607549+0000","last_clean":"2024-04-26T22:06:02.607549+0000","last_became_active":"2024-04-26T22:06:02.603007+0000","last_became_peered":"2024-04-26T22:06:02.603007+0000","last_unstale":"2024-04-26T22:06:02.607549+0000","last_undegraded":"2024-04-26T22:06:02.607549+0000","last_fullsized":"2024-04-26T22:06:02.607549+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:54.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608138+0000","last_change":"2024-04-26T22:06:02.603481+0000","last_active":"2024-04-26T22:06:02.608138+0000","last_peered":"2024-04-26T22:06:02.608138+0000","last_clean":"2024-04-26T22:06:02.608138+0000","last_became_active":"2024-04-26T22:06:02.603200+0000","last_became_peered":"2024-04-26T22:06:02.603200+0000","last_unstale":"2024-04-26T22:06:02.608138+0000","last_undegraded":"2024-04-26T22:06:02.608138+0000","last_fullsized":"2024-04-26T22:06:02.608138+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:31.573619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.598223+0000","last_change":"2024-04-26T22:06:02.597206+0000","last_active":"2024-04-26T22:06:02.598223+0000","last_peered":"2024-04-26T22:06:02.598223+0000","last_clean":"2024-04-26T22:06:02.598223+0000","last_became_active":"2024-04-26T22:06:02.596941+0000","last_became_peered":"2024-04-26T22:06:02.596941+0000","last_unstale":"2024-04-26T22:06:02.598223+0000","last_undegraded":"2024-04-26T22:06:02.598223+0000","last_fullsized":"2024-04-26T22:06:02.598223+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:21.975131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620302+0000","last_change":"2024-04-26T22:06:02.619465+0000","last_active":"2024-04-26T22:06:02.620302+0000","last_peered":"2024-04-26T22:06:02.620302+0000","last_clean":"2024-04-26T22:06:02.620302+0000","last_became_active":"2024-04-26T22:06:02.619139+0000","last_became_peered":"2024-04-26T22:06:02.619139+0000","last_unstale":"2024-04-26T22:06:02.620302+0000","last_undegraded":"2024-04-26T22:06:02.620302+0000","last_fullsized":"2024-04-26T22:06:02.620302+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.124042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617587+0000","last_change":"2024-04-26T22:06:02.614009+0000","last_active":"2024-04-26T22:06:02.617587+0000","last_peered":"2024-04-26T22:06:02.617587+0000","last_clean":"2024-04-26T22:06:02.617587+0000","last_became_active":"2024-04-26T22:06:02.613606+0000","last_became_peered":"2024-04-26T22:06:02.613606+0000","last_unstale":"2024-04-26T22:06:02.617587+0000","last_undegraded":"2024-04-26T22:06:02.617587+0000","last_fullsized":"2024-04-26T22:06:02.617587+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:16.628178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614788+0000","last_change":"2024-04-26T22:06:02.609533+0000","last_active":"2024-04-26T22:06:02.614788+0000","last_peered":"2024-04-26T22:06:02.614788+0000","last_clean":"2024-04-26T22:06:02.614788+0000","last_became_active":"2024-04-26T22:06:02.609244+0000","last_became_peered":"2024-04-26T22:06:02.609244+0000","last_unstale":"2024-04-26T22:06:02.614788+0000","last_undegraded":"2024-04-26T22:06:02.614788+0000","last_fullsized":"2024-04-26T22:06:02.614788+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:33.476722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618799+0000","last_change":"2024-04-26T22:06:02.612495+0000","last_active":"2024-04-26T22:06:02.618799+0000","last_peered":"2024-04-26T22:06:02.618799+0000","last_clean":"2024-04-26T22:06:02.618799+0000","last_became_active":"2024-04-26T22:06:02.612166+0000","last_became_peered":"2024-04-26T22:06:02.612166+0000","last_unstale":"2024-04-26T22:06:02.618799+0000","last_undegraded":"2024-04-26T22:06:02.618799+0000","last_fullsized":"2024-04-26T22:06:02.618799+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:30.109337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.623772+0000","last_change":"2024-04-26T22:06:02.620057+0000","last_active":"2024-04-26T22:06:02.623772+0000","last_peered":"2024-04-26T22:06:02.623772+0000","last_clean":"2024-04-26T22:06:02.623772+0000","last_became_active":"2024-04-26T22:06:02.619718+0000","last_became_peered":"2024-04-26T22:06:02.619718+0000","last_unstale":"2024-04-26T22:06:02.623772+0000","last_undegraded":"2024-04-26T22:06:02.623772+0000","last_fullsized":"2024-04-26T22:06:02.623772+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:59.698977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614551+0000","last_change":"2024-04-26T22:06:02.607446+0000","last_active":"2024-04-26T22:06:02.614551+0000","last_peered":"2024-04-26T22:06:02.614551+0000","last_clean":"2024-04-26T22:06:02.614551+0000","last_became_active":"2024-04-26T22:06:02.607193+0000","last_became_peered":"2024-04-26T22:06:02.607193+0000","last_unstale":"2024-04-26T22:06:02.614551+0000","last_undegraded":"2024-04-26T22:06:02.614551+0000","last_fullsized":"2024-04-26T22:06:02.614551+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:09.112731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618843+0000","last_change":"2024-04-26T22:06:02.610140+0000","last_active":"2024-04-26T22:06:02.618843+0000","last_peered":"2024-04-26T22:06:02.618843+0000","last_clean":"2024-04-26T22:06:02.618843+0000","last_became_active":"2024-04-26T22:06:02.609868+0000","last_became_peered":"2024-04-26T22:06:02.609868+0000","last_unstale":"2024-04-26T22:06:02.618843+0000","last_undegraded":"2024-04-26T22:06:02.618843+0000","last_fullsized":"2024-04-26T22:06:02.618843+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:16.628178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.603512+0000","last_change":"2024-04-26T22:06:02.600142+0000","last_active":"2024-04-26T22:06:02.603512+0000","last_peered":"2024-04-26T22:06:02.603512+0000","last_clean":"2024-04-26T22:06:02.603512+0000","last_became_active":"2024-04-26T22:06:02.599858+0000","last_became_peered":"2024-04-26T22:06:02.599858+0000","last_unstale":"2024-04-26T22:06:02.603512+0000","last_undegraded":"2024-04-26T22:06:02.603512+0000","last_fullsized":"2024-04-26T22:06:02.603512+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:30.244089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.615021+0000","last_change":"2024-04-26T22:06:02.605548+0000","last_active":"2024-04-26T22:06:02.615021+0000","last_peered":"2024-04-26T22:06:02.615021+0000","last_clean":"2024-04-26T22:06:02.615021+0000","last_became_active":"2024-04-26T22:06:02.605288+0000","last_became_peered":"2024-04-26T22:06:02.605288+0000","last_unstale":"2024-04-26T22:06:02.615021+0000","last_undegraded":"2024-04-26T22:06:02.615021+0000","last_fullsized":"2024-04-26T22:06:02.615021+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:06.214296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620331+0000","last_change":"2024-04-26T22:06:02.616847+0000","last_active":"2024-04-26T22:06:02.620331+0000","last_peered":"2024-04-26T22:06:02.620331+0000","last_clean":"2024-04-26T22:06:02.620331+0000","last_became_active":"2024-04-26T22:06:02.616606+0000","last_became_peered":"2024-04-26T22:06:02.616606+0000","last_unstale":"2024-04-26T22:06:02.620331+0000","last_undegraded":"2024-04-26T22:06:02.620331+0000","last_fullsized":"2024-04-26T22:06:02.620331+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:32.381320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614776+0000","last_change":"2024-04-26T22:06:02.610957+0000","last_active":"2024-04-26T22:06:02.614776+0000","last_peered":"2024-04-26T22:06:02.614776+0000","last_clean":"2024-04-26T22:06:02.614776+0000","last_became_active":"2024-04-26T22:06:02.610704+0000","last_became_peered":"2024-04-26T22:06:02.610704+0000","last_unstale":"2024-04-26T22:06:02.614776+0000","last_undegraded":"2024-04-26T22:06:02.614776+0000","last_fullsized":"2024-04-26T22:06:02.614776+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:06.965149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618679+0000","last_change":"2024-04-26T22:06:02.611895+0000","last_active":"2024-04-26T22:06:02.618679+0000","last_peered":"2024-04-26T22:06:02.618679+0000","last_clean":"2024-04-26T22:06:02.618679+0000","last_became_active":"2024-04-26T22:06:02.611599+0000","last_became_peered":"2024-04-26T22:06:02.611599+0000","last_unstale":"2024-04-26T22:06:02.618679+0000","last_undegraded":"2024-04-26T22:06:02.618679+0000","last_fullsized":"2024-04-26T22:06:02.618679+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:02.367577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614620+0000","last_change":"2024-04-26T22:06:02.604817+0000","last_active":"2024-04-26T22:06:02.614620+0000","last_peered":"2024-04-26T22:06:02.614620+0000","last_clean":"2024-04-26T22:06:02.614620+0000","last_became_active":"2024-04-26T22:06:02.604522+0000","last_became_peered":"2024-04-26T22:06:02.604522+0000","last_unstale":"2024-04-26T22:06:02.614620+0000","last_undegraded":"2024-04-26T22:06:02.614620+0000","last_fullsized":"2024-04-26T22:06:02.614620+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:34.835305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608410+0000","last_change":"2024-04-26T22:06:02.603275+0000","last_active":"2024-04-26T22:06:02.608410+0000","last_peered":"2024-04-26T22:06:02.608410+0000","last_clean":"2024-04-26T22:06:02.608410+0000","last_became_active":"2024-04-26T22:06:02.603015+0000","last_became_peered":"2024-04-26T22:06:02.603015+0000","last_unstale":"2024-04-26T22:06:02.608410+0000","last_undegraded":"2024-04-26T22:06:02.608410+0000","last_fullsized":"2024-04-26T22:06:02.608410+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:50:45.356545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608727+0000","last_change":"2024-04-26T22:06:02.603476+0000","last_active":"2024-04-26T22:06:02.608727+0000","last_peered":"2024-04-26T22:06:02.608727+0000","last_clean":"2024-04-26T22:06:02.608727+0000","last_became_active":"2024-04-26T22:06:02.602226+0000","last_became_peered":"2024-04-26T22:06:02.602226+0000","last_unstale":"2024-04-26T22:06:02.608727+0000","last_undegraded":"2024-04-26T22:06:02.608727+0000","last_fullsized":"2024-04-26T22:06:02.608727+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:03:51.981176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614911+0000","last_change":"2024-04-26T22:06:02.611012+0000","last_active":"2024-04-26T22:06:02.614911+0000","last_peered":"2024-04-26T22:06:02.614911+0000","last_clean":"2024-04-26T22:06:02.614911+0000","last_became_active":"2024-04-26T22:06:02.610709+0000","last_became_peered":"2024-04-26T22:06:02.610709+0000","last_unstale":"2024-04-26T22:06:02.614911+0000","last_undegraded":"2024-04-26T22:06:02.614911+0000","last_fullsized":"2024-04-26T22:06:02.614911+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:32.381320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.610340+0000","last_change":"2024-04-26T22:06:02.604736+0000","last_active":"2024-04-26T22:06:02.610340+0000","last_peered":"2024-04-26T22:06:02.610340+0000","last_clean":"2024-04-26T22:06:02.610340+0000","last_became_active":"2024-04-26T22:06:02.604458+0000","last_became_peered":"2024-04-26T22:06:02.604458+0000","last_unstale":"2024-04-26T22:06:02.610340+0000","last_undegraded":"2024-04-26T22:06:02.610340+0000","last_fullsized":"2024-04-26T22:06:02.610340+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:30.109337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617124+0000","last_change":"2024-04-26T22:06:02.609818+0000","last_active":"2024-04-26T22:06:02.617124+0000","last_peered":"2024-04-26T22:06:02.617124+0000","last_clean":"2024-04-26T22:06:02.617124+0000","last_became_active":"2024-04-26T22:06:02.609543+0000","last_became_peered":"2024-04-26T22:06:02.609543+0000","last_unstale":"2024-04-26T22:06:02.617124+0000","last_undegraded":"2024-04-26T22:06:02.617124+0000","last_fullsized":"2024-04-26T22:06:02.617124+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:56:46.813022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.605985+0000","last_change":"2024-04-26T22:06:02.603357+0000","last_active":"2024-04-26T22:06:02.605985+0000","last_peered":"2024-04-26T22:06:02.605985+0000","last_clean":"2024-04-26T22:06:02.605985+0000","last_became_active":"2024-04-26T22:06:02.602989+0000","last_became_peered":"2024-04-26T22:06:02.602989+0000","last_unstale":"2024-04-26T22:06:02.605985+0000","last_undegraded":"2024-04-26T22:06:02.605985+0000","last_fullsized":"2024-04-26T22:06:02.605985+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:16.628178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616171+0000","last_change":"2024-04-26T22:06:02.612965+0000","last_active":"2024-04-26T22:06:02.616171+0000","last_peered":"2024-04-26T22:06:02.616171+0000","last_clean":"2024-04-26T22:06:02.616171+0000","last_became_active":"2024-04-26T22:06:02.612707+0000","last_became_peered":"2024-04-26T22:06:02.612707+0000","last_unstale":"2024-04-26T22:06:02.616171+0000","last_undegraded":"2024-04-26T22:06:02.616171+0000","last_fullsized":"2024-04-26T22:06:02.616171+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:30.244089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616906+0000","last_change":"2024-04-26T22:06:02.609754+0000","last_active":"2024-04-26T22:06:02.616906+0000","last_peered":"2024-04-26T22:06:02.616906+0000","last_clean":"2024-04-26T22:06:02.616906+0000","last_became_active":"2024-04-26T22:06:02.609484+0000","last_became_peered":"2024-04-26T22:06:02.609484+0000","last_unstale":"2024-04-26T22:06:02.616906+0000","last_undegraded":"2024-04-26T22:06:02.616906+0000","last_fullsized":"2024-04-26T22:06:02.616906+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:14.030893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614807+0000","last_change":"2024-04-26T22:06:02.611819+0000","last_active":"2024-04-26T22:06:02.614807+0000","last_peered":"2024-04-26T22:06:02.614807+0000","last_clean":"2024-04-26T22:06:02.614807+0000","last_became_active":"2024-04-26T22:06:02.611557+0000","last_became_peered":"2024-04-26T22:06:02.611557+0000","last_unstale":"2024-04-26T22:06:02.614807+0000","last_undegraded":"2024-04-26T22:06:02.614807+0000","last_fullsized":"2024-04-26T22:06:02.614807+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:07:06.842823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620267+0000","last_change":"2024-04-26T22:06:02.614504+0000","last_active":"2024-04-26T22:06:02.620267+0000","last_peered":"2024-04-26T22:06:02.620267+0000","last_clean":"2024-04-26T22:06:02.620267+0000","last_became_active":"2024-04-26T22:06:02.614267+0000","last_became_peered":"2024-04-26T22:06:02.614267+0000","last_unstale":"2024-04-26T22:06:02.620267+0000","last_undegraded":"2024-04-26T22:06:02.620267+0000","last_fullsized":"2024-04-26T22:06:02.620267+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:29:24.354169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622262+0000","last_change":"2024-04-26T22:06:02.618057+0000","last_active":"2024-04-26T22:06:02.622262+0000","last_peered":"2024-04-26T22:06:02.622262+0000","last_clean":"2024-04-26T22:06:02.622262+0000","last_became_active":"2024-04-26T22:06:02.617706+0000","last_became_peered":"2024-04-26T22:06:02.617706+0000","last_unstale":"2024-04-26T22:06:02.622262+0000","last_undegraded":"2024-04-26T22:06:02.622262+0000","last_fullsized":"2024-04-26T22:06:02.622262+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:09.304714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614048+0000","last_change":"2024-04-26T22:06:02.606605+0000","last_active":"2024-04-26T22:06:02.614048+0000","last_peered":"2024-04-26T22:06:02.614048+0000","last_clean":"2024-04-26T22:06:02.614048+0000","last_became_active":"2024-04-26T22:06:02.606372+0000","last_became_peered":"2024-04-26T22:06:02.606372+0000","last_unstale":"2024-04-26T22:06:02.614048+0000","last_undegraded":"2024-04-26T22:06:02.614048+0000","last_fullsized":"2024-04-26T22:06:02.614048+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:45.891720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"102'4","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.623617+0000","last_change":"2024-04-26T22:06:01.595255+0000","last_active":"2024-04-26T22:06:02.623617+0000","last_peered":"2024-04-26T22:06:02.623617+0000","last_clean":"2024-04-26T22:06:02.623617+0000","last_became_active":"2024-04-26T22:06:01.594947+0000","last_became_peered":"2024-04-26T22:06:01.594947+0000","last_unstale":"2024-04-26T22:06:02.623617+0000","last_undegraded":"2024-04-26T22:06:02.623617+0000","last_fullsized":"2024-04-26T22:06:02.623617+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:11.774223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620400+0000","last_change":"2024-04-26T22:06:02.615139+0000","last_active":"2024-04-26T22:06:02.620400+0000","last_peered":"2024-04-26T22:06:02.620400+0000","last_clean":"2024-04-26T22:06:02.620400+0000","last_became_active":"2024-04-26T22:06:02.614875+0000","last_became_peered":"2024-04-26T22:06:02.614875+0000","last_unstale":"2024-04-26T22:06:02.620400+0000","last_undegraded":"2024-04-26T22:06:02.620400+0000","last_fullsized":"2024-04-26T22:06:02.620400+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:33.476722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614840+0000","last_change":"2024-04-26T22:06:01.597600+0000","last_active":"2024-04-26T22:06:02.614840+0000","last_peered":"2024-04-26T22:06:02.614840+0000","last_clean":"2024-04-26T22:06:02.614840+0000","last_became_active":"2024-04-26T22:06:01.597313+0000","last_became_peered":"2024-04-26T22:06:01.597313+0000","last_unstale":"2024-04-26T22:06:02.614840+0000","last_undegraded":"2024-04-26T22:06:02.614840+0000","last_fullsized":"2024-04-26T22:06:02.614840+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:29.104875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.623615+0000","last_change":"2024-04-26T22:06:02.619082+0000","last_active":"2024-04-26T22:06:02.623615+0000","last_peered":"2024-04-26T22:06:02.623615+0000","last_clean":"2024-04-26T22:06:02.623615+0000","last_became_active":"2024-04-26T22:06:02.618591+0000","last_became_peered":"2024-04-26T22:06:02.618591+0000","last_unstale":"2024-04-26T22:06:02.623615+0000","last_undegraded":"2024-04-26T22:06:02.623615+0000","last_fullsized":"2024-04-26T22:06:02.623615+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:58:40.092846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622082+0000","last_change":"2024-04-26T22:06:01.603810+0000","last_active":"2024-04-26T22:06:02.622082+0000","last_peered":"2024-04-26T22:06:02.622082+0000","last_clean":"2024-04-26T22:06:02.622082+0000","last_became_active":"2024-04-26T22:06:01.603551+0000","last_became_peered":"2024-04-26T22:06:01.603551+0000","last_unstale":"2024-04-26T22:06:02.622082+0000","last_undegraded":"2024-04-26T22:06:02.622082+0000","last_fullsized":"2024-04-26T22:06:02.622082+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:42.434533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.610578+0000","last_change":"2024-04-26T22:06:02.603773+0000","last_active":"2024-04-26T22:06:02.610578+0000","last_peered":"2024-04-26T22:06:02.610578+0000","last_clean":"2024-04-26T22:06:02.610578+0000","last_became_active":"2024-04-26T22:06:02.603476+0000","last_became_peered":"2024-04-26T22:06:02.603476+0000","last_unstale":"2024-04-26T22:06:02.610578+0000","last_undegraded":"2024-04-26T22:06:02.610578+0000","last_fullsized":"2024-04-26T22:06:02.610578+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:42.177470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.621631+0000","last_change":"2024-04-26T22:06:01.598299+0000","last_active":"2024-04-26T22:06:02.621631+0000","last_peered":"2024-04-26T22:06:02.621631+0000","last_clean":"2024-04-26T22:06:02.621631+0000","last_became_active":"2024-04-26T22:06:01.597744+0000","last_became_peered":"2024-04-26T22:06:01.597744+0000","last_unstale":"2024-04-26T22:06:02.621631+0000","last_undegraded":"2024-04-26T22:06:02.621631+0000","last_fullsized":"2024-04-26T22:06:02.621631+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:58.694515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616035+0000","last_change":"2024-04-26T22:06:02.611581+0000","last_active":"2024-04-26T22:06:02.616035+0000","last_peered":"2024-04-26T22:06:02.616035+0000","last_clean":"2024-04-26T22:06:02.616035+0000","last_became_active":"2024-04-26T22:06:02.611310+0000","last_became_peered":"2024-04-26T22:06:02.611310+0000","last_unstale":"2024-04-26T22:06:02.616035+0000","last_undegraded":"2024-04-26T22:06:02.616035+0000","last_fullsized":"2024-04-26T22:06:02.616035+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:43.555852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.613297+0000","last_change":"2024-04-26T22:06:01.595197+0000","last_active":"2024-04-26T22:06:02.613297+0000","last_peered":"2024-04-26T22:06:02.613297+0000","last_clean":"2024-04-26T22:06:02.613297+0000","last_became_active":"2024-04-26T22:06:01.594941+0000","last_became_peered":"2024-04-26T22:06:01.594941+0000","last_unstale":"2024-04-26T22:06:02.613297+0000","last_undegraded":"2024-04-26T22:06:02.613297+0000","last_fullsized":"2024-04-26T22:06:02.613297+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:45:48.506149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.602261+0000","last_change":"2024-04-26T22:06:02.599444+0000","last_active":"2024-04-26T22:06:02.602261+0000","last_peered":"2024-04-26T22:06:02.602261+0000","last_clean":"2024-04-26T22:06:02.602261+0000","last_became_active":"2024-04-26T22:06:02.599196+0000","last_became_peered":"2024-04-26T22:06:02.599196+0000","last_unstale":"2024-04-26T22:06:02.602261+0000","last_undegraded":"2024-04-26T22:06:02.602261+0000","last_fullsized":"2024-04-26T22:06:02.602261+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:35.111920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.623844+0000","last_change":"2024-04-26T22:06:01.601273+0000","last_active":"2024-04-26T22:06:02.623844+0000","last_peered":"2024-04-26T22:06:02.623844+0000","last_clean":"2024-04-26T22:06:02.623844+0000","last_became_active":"2024-04-26T22:06:01.601006+0000","last_became_peered":"2024-04-26T22:06:01.601006+0000","last_unstale":"2024-04-26T22:06:02.623844+0000","last_undegraded":"2024-04-26T22:06:02.623844+0000","last_fullsized":"2024-04-26T22:06:02.623844+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:31.376859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619588+0000","last_change":"2024-04-26T22:06:02.610663+0000","last_active":"2024-04-26T22:06:02.619588+0000","last_peered":"2024-04-26T22:06:02.619588+0000","last_clean":"2024-04-26T22:06:02.619588+0000","last_became_active":"2024-04-26T22:06:02.610392+0000","last_became_peered":"2024-04-26T22:06:02.610392+0000","last_unstale":"2024-04-26T22:06:02.619588+0000","last_undegraded":"2024-04-26T22:06:02.619588+0000","last_fullsized":"2024-04-26T22:06:02.619588+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:54.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.593677+0000","last_change":"2024-04-26T22:06:01.595652+0000","last_active":"2024-04-26T22:06:02.593677+0000","last_peered":"2024-04-26T22:06:02.593677+0000","last_clean":"2024-04-26T22:06:02.593677+0000","last_became_active":"2024-04-26T22:06:01.595226+0000","last_became_peered":"2024-04-26T22:06:01.595226+0000","last_unstale":"2024-04-26T22:06:02.593677+0000","last_undegraded":"2024-04-26T22:06:02.593677+0000","last_fullsized":"2024-04-26T22:06:02.593677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:41.173008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619344+0000","last_change":"2024-04-26T22:06:02.616475+0000","last_active":"2024-04-26T22:06:02.619344+0000","last_peered":"2024-04-26T22:06:02.619344+0000","last_clean":"2024-04-26T22:06:02.619344+0000","last_became_active":"2024-04-26T22:06:02.616043+0000","last_became_peered":"2024-04-26T22:06:02.616043+0000","last_unstale":"2024-04-26T22:06:02.619344+0000","last_undegraded":"2024-04-26T22:06:02.619344+0000","last_fullsized":"2024-04-26T22:06:02.619344+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:30.244089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.603804+0000","last_change":"2024-04-26T22:06:01.598557+0000","last_active":"2024-04-26T22:06:02.603804+0000","last_peered":"2024-04-26T22:06:02.603804+0000","last_clean":"2024-04-26T22:06:02.603804+0000","last_became_active":"2024-04-26T22:06:01.598273+0000","last_became_peered":"2024-04-26T22:06:01.598273+0000","last_unstale":"2024-04-26T22:06:02.603804+0000","last_undegraded":"2024-04-26T22:06:02.603804+0000","last_fullsized":"2024-04-26T22:06:02.603804+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:50:14.001148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.615137+0000","last_change":"2024-04-26T22:06:02.606945+0000","last_active":"2024-04-26T22:06:02.615137+0000","last_peered":"2024-04-26T22:06:02.615137+0000","last_clean":"2024-04-26T22:06:02.615137+0000","last_became_active":"2024-04-26T22:06:02.606640+0000","last_became_peered":"2024-04-26T22:06:02.606640+0000","last_unstale":"2024-04-26T22:06:02.615137+0000","last_undegraded":"2024-04-26T22:06:02.615137+0000","last_fullsized":"2024-04-26T22:06:02.615137+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:50:37.810482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.603473+0000","last_change":"2024-04-26T22:06:01.598245+0000","last_active":"2024-04-26T22:06:02.603473+0000","last_peered":"2024-04-26T22:06:02.603473+0000","last_clean":"2024-04-26T22:06:02.603473+0000","last_became_active":"2024-04-26T22:06:01.597986+0000","last_became_peered":"2024-04-26T22:06:01.597986+0000","last_unstale":"2024-04-26T22:06:02.603473+0000","last_undegraded":"2024-04-26T22:06:02.603473+0000","last_fullsized":"2024-04-26T22:06:02.603473+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:22:23.725975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618802+0000","last_change":"2024-04-26T22:06:02.612604+0000","last_active":"2024-04-26T22:06:02.618802+0000","last_peered":"2024-04-26T22:06:02.618802+0000","last_clean":"2024-04-26T22:06:02.618802+0000","last_became_active":"2024-04-26T22:06:02.605528+0000","last_became_peered":"2024-04-26T22:06:02.605528+0000","last_unstale":"2024-04-26T22:06:02.618802+0000","last_undegraded":"2024-04-26T22:06:02.618802+0000","last_fullsized":"2024-04-26T22:06:02.618802+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:53.456320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.603111+0000","last_change":"2024-04-26T22:06:01.595706+0000","last_active":"2024-04-26T22:06:02.603111+0000","last_peered":"2024-04-26T22:06:02.603111+0000","last_clean":"2024-04-26T22:06:02.603111+0000","last_became_active":"2024-04-26T22:06:01.595417+0000","last_became_peered":"2024-04-26T22:06:01.595417+0000","last_unstale":"2024-04-26T22:06:02.603111+0000","last_undegraded":"2024-04-26T22:06:02.603111+0000","last_fullsized":"2024-04-26T22:06:02.603111+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:29.239627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.609221+0000","last_change":"2024-04-26T22:06:02.605044+0000","last_active":"2024-04-26T22:06:02.609221+0000","last_peered":"2024-04-26T22:06:02.609221+0000","last_clean":"2024-04-26T22:06:02.609221+0000","last_became_active":"2024-04-26T22:06:02.604207+0000","last_became_peered":"2024-04-26T22:06:02.604207+0000","last_unstale":"2024-04-26T22:06:02.609221+0000","last_undegraded":"2024-04-26T22:06:02.609221+0000","last_fullsized":"2024-04-26T22:06:02.609221+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:53.456320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"102'3","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618380+0000","last_change":"2024-04-26T22:06:01.599223+0000","last_active":"2024-04-26T22:06:02.618380+0000","last_peered":"2024-04-26T22:06:02.618380+0000","last_clean":"2024-04-26T22:06:02.618380+0000","last_became_active":"2024-04-26T22:06:01.596689+0000","last_became_peered":"2024-04-26T22:06:01.596689+0000","last_unstale":"2024-04-26T22:06:02.618380+0000","last_undegraded":"2024-04-26T22:06:02.618380+0000","last_fullsized":"2024-04-26T22:06:02.618380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:14.790002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.605502+0000","last_change":"2024-04-26T22:06:02.601854+0000","last_active":"2024-04-26T22:06:02.605502+0000","last_peered":"2024-04-26T22:06:02.605502+0000","last_clean":"2024-04-26T22:06:02.605502+0000","last_became_active":"2024-04-26T22:06:02.601544+0000","last_became_peered":"2024-04-26T22:06:02.601544+0000","last_unstale":"2024-04-26T22:06:02.605502+0000","last_undegraded":"2024-04-26T22:06:02.605502+0000","last_fullsized":"2024-04-26T22:06:02.605502+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.124042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"102'6","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.624471+0000","last_change":"2024-04-26T22:06:01.595733+0000","last_active":"2024-04-26T22:06:02.624471+0000","last_peered":"2024-04-26T22:06:02.624471+0000","last_clean":"2024-04-26T22:06:02.624471+0000","last_became_active":"2024-04-26T22:06:01.595437+0000","last_became_peered":"2024-04-26T22:06:01.595437+0000","last_unstale":"2024-04-26T22:06:02.624471+0000","last_undegraded":"2024-04-26T22:06:02.624471+0000","last_fullsized":"2024-04-26T22:06:02.624471+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:05:22.623998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.620143+0000","last_change":"2024-04-26T22:06:02.614481+0000","last_active":"2024-04-26T22:06:02.620143+0000","last_peered":"2024-04-26T22:06:02.620143+0000","last_clean":"2024-04-26T22:06:02.620143+0000","last_became_active":"2024-04-26T22:06:02.614204+0000","last_became_peered":"2024-04-26T22:06:02.614204+0000","last_unstale":"2024-04-26T22:06:02.620143+0000","last_undegraded":"2024-04-26T22:06:02.620143+0000","last_fullsized":"2024-04-26T22:06:02.620143+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:31.573619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618763+0000","last_change":"2024-04-26T22:06:01.602641+0000","last_active":"2024-04-26T22:06:02.618763+0000","last_peered":"2024-04-26T22:06:02.618763+0000","last_clean":"2024-04-26T22:06:02.618763+0000","last_became_active":"2024-04-26T22:06:01.600508+0000","last_became_peered":"2024-04-26T22:06:01.600508+0000","last_unstale":"2024-04-26T22:06:02.618763+0000","last_undegraded":"2024-04-26T22:06:02.618763+0000","last_fullsized":"2024-04-26T22:06:02.618763+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:36.103982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.612906+0000","last_change":"2024-04-26T22:06:02.608334+0000","last_active":"2024-04-26T22:06:02.612906+0000","last_peered":"2024-04-26T22:06:02.612906+0000","last_clean":"2024-04-26T22:06:02.612906+0000","last_became_active":"2024-04-26T22:06:02.608038+0000","last_became_peered":"2024-04-26T22:06:02.608038+0000","last_unstale":"2024-04-26T22:06:02.612906+0000","last_undegraded":"2024-04-26T22:06:02.612906+0000","last_fullsized":"2024-04-26T22:06:02.612906+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:38.366492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.599446+0000","last_change":"2024-04-26T22:06:01.605508+0000","last_active":"2024-04-26T22:06:02.599446+0000","last_peered":"2024-04-26T22:06:02.599446+0000","last_clean":"2024-04-26T22:06:02.599446+0000","last_became_active":"2024-04-26T22:06:01.605161+0000","last_became_peered":"2024-04-26T22:06:01.605161+0000","last_unstale":"2024-04-26T22:06:02.599446+0000","last_undegraded":"2024-04-26T22:06:02.599446+0000","last_fullsized":"2024-04-26T22:06:02.599446+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:54.207840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618895+0000","last_change":"2024-04-26T22:06:02.614849+0000","last_active":"2024-04-26T22:06:02.618895+0000","last_peered":"2024-04-26T22:06:02.618895+0000","last_clean":"2024-04-26T22:06:02.618895+0000","last_became_active":"2024-04-26T22:06:02.613094+0000","last_became_peered":"2024-04-26T22:06:02.613094+0000","last_unstale":"2024-04-26T22:06:02.618895+0000","last_undegraded":"2024-04-26T22:06:02.618895+0000","last_fullsized":"2024-04-26T22:06:02.618895+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.794464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.604250+0000","last_change":"2024-04-26T22:06:01.595324+0000","last_active":"2024-04-26T22:06:02.604250+0000","last_peered":"2024-04-26T22:06:02.604250+0000","last_clean":"2024-04-26T22:06:02.604250+0000","last_became_active":"2024-04-26T22:06:01.595035+0000","last_became_peered":"2024-04-26T22:06:01.595035+0000","last_unstale":"2024-04-26T22:06:02.604250+0000","last_undegraded":"2024-04-26T22:06:02.604250+0000","last_fullsized":"2024-04-26T22:06:02.604250+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:29.300165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.621601+0000","last_change":"2024-04-26T22:06:02.618402+0000","last_active":"2024-04-26T22:06:02.621601+0000","last_peered":"2024-04-26T22:06:02.621601+0000","last_clean":"2024-04-26T22:06:02.621601+0000","last_became_active":"2024-04-26T22:06:02.618146+0000","last_became_peered":"2024-04-26T22:06:02.618146+0000","last_unstale":"2024-04-26T22:06:02.621601+0000","last_undegraded":"2024-04-26T22:06:02.621601+0000","last_fullsized":"2024-04-26T22:06:02.621601+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:22:44.540227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"102'8","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.618070+0000","last_change":"2024-04-26T22:06:01.592520+0000","last_active":"2024-04-26T22:06:02.618070+0000","last_peered":"2024-04-26T22:06:02.618070+0000","last_clean":"2024-04-26T22:06:02.618070+0000","last_became_active":"2024-04-26T22:06:01.592232+0000","last_became_peered":"2024-04-26T22:06:01.592232+0000","last_unstale":"2024-04-26T22:06:02.618070+0000","last_undegraded":"2024-04-26T22:06:02.618070+0000","last_fullsized":"2024-04-26T22:06:02.618070+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:05.576845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.610376+0000","last_change":"2024-04-26T22:06:02.608502+0000","last_active":"2024-04-26T22:06:02.610376+0000","last_peered":"2024-04-26T22:06:02.610376+0000","last_clean":"2024-04-26T22:06:02.610376+0000","last_became_active":"2024-04-26T22:06:02.608226+0000","last_became_peered":"2024-04-26T22:06:02.608226+0000","last_unstale":"2024-04-26T22:06:02.610376+0000","last_undegraded":"2024-04-26T22:06:02.610376+0000","last_fullsized":"2024-04-26T22:06:02.610376+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:27:15.794464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617819+0000","last_change":"2024-04-26T22:06:01.603876+0000","last_active":"2024-04-26T22:06:02.617819+0000","last_peered":"2024-04-26T22:06:02.617819+0000","last_clean":"2024-04-26T22:06:02.617819+0000","last_became_active":"2024-04-26T22:06:01.603596+0000","last_became_peered":"2024-04-26T22:06:01.603596+0000","last_unstale":"2024-04-26T22:06:02.617819+0000","last_undegraded":"2024-04-26T22:06:02.617819+0000","last_fullsized":"2024-04-26T22:06:02.617819+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:05:53.028219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616459+0000","last_change":"2024-04-26T22:06:02.614973+0000","last_active":"2024-04-26T22:06:02.616459+0000","last_peered":"2024-04-26T22:06:02.616459+0000","last_clean":"2024-04-26T22:06:02.616459+0000","last_became_active":"2024-04-26T22:06:02.614668+0000","last_became_peered":"2024-04-26T22:06:02.614668+0000","last_unstale":"2024-04-26T22:06:02.616459+0000","last_undegraded":"2024-04-26T22:06:02.616459+0000","last_fullsized":"2024-04-26T22:06:02.616459+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:01:01.057559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617289+0000","last_change":"2024-04-26T22:06:01.596559+0000","last_active":"2024-04-26T22:06:02.617289+0000","last_peered":"2024-04-26T22:06:02.617289+0000","last_clean":"2024-04-26T22:06:02.617289+0000","last_became_active":"2024-04-26T22:06:01.596225+0000","last_became_peered":"2024-04-26T22:06:01.596225+0000","last_unstale":"2024-04-26T22:06:02.617289+0000","last_undegraded":"2024-04-26T22:06:02.617289+0000","last_fullsized":"2024-04-26T22:06:02.617289+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:29.300165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.611646+0000","last_change":"2024-04-26T22:06:02.608842+0000","last_active":"2024-04-26T22:06:02.611646+0000","last_peered":"2024-04-26T22:06:02.611646+0000","last_clean":"2024-04-26T22:06:02.611646+0000","last_became_active":"2024-04-26T22:06:02.608544+0000","last_became_peered":"2024-04-26T22:06:02.608544+0000","last_unstale":"2024-04-26T22:06:02.611646+0000","last_undegraded":"2024-04-26T22:06:02.611646+0000","last_fullsized":"2024-04-26T22:06:02.611646+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:29:24.354169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.594169+0000","last_change":"2024-04-26T22:06:01.598021+0000","last_active":"2024-04-26T22:06:02.594169+0000","last_peered":"2024-04-26T22:06:02.594169+0000","last_clean":"2024-04-26T22:06:02.594169+0000","last_became_active":"2024-04-26T22:06:01.597084+0000","last_became_peered":"2024-04-26T22:06:01.597084+0000","last_unstale":"2024-04-26T22:06:02.594169+0000","last_undegraded":"2024-04-26T22:06:02.594169+0000","last_fullsized":"2024-04-26T22:06:02.594169+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:05:25.818139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617262+0000","last_change":"2024-04-26T22:06:02.613322+0000","last_active":"2024-04-26T22:06:02.617262+0000","last_peered":"2024-04-26T22:06:02.617262+0000","last_clean":"2024-04-26T22:06:02.617262+0000","last_became_active":"2024-04-26T22:06:02.613046+0000","last_became_peered":"2024-04-26T22:06:02.613046+0000","last_unstale":"2024-04-26T22:06:02.617262+0000","last_undegraded":"2024-04-26T22:06:02.617262+0000","last_fullsized":"2024-04-26T22:06:02.617262+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:04:30.651266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622063+0000","last_change":"2024-04-26T22:06:01.605309+0000","last_active":"2024-04-26T22:06:02.622063+0000","last_peered":"2024-04-26T22:06:02.622063+0000","last_clean":"2024-04-26T22:06:02.622063+0000","last_became_active":"2024-04-26T22:06:01.604981+0000","last_became_peered":"2024-04-26T22:06:01.604981+0000","last_unstale":"2024-04-26T22:06:02.622063+0000","last_undegraded":"2024-04-26T22:06:02.622063+0000","last_fullsized":"2024-04-26T22:06:02.622063+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:47:29.797115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614641+0000","last_change":"2024-04-26T22:06:02.606560+0000","last_active":"2024-04-26T22:06:02.614641+0000","last_peered":"2024-04-26T22:06:02.614641+0000","last_clean":"2024-04-26T22:06:02.614641+0000","last_became_active":"2024-04-26T22:06:02.606320+0000","last_became_peered":"2024-04-26T22:06:02.606320+0000","last_unstale":"2024-04-26T22:06:02.614641+0000","last_undegraded":"2024-04-26T22:06:02.614641+0000","last_fullsized":"2024-04-26T22:06:02.614641+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:44.294985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.599294+0000","last_change":"2024-04-26T22:06:01.603049+0000","last_active":"2024-04-26T22:06:02.599294+0000","last_peered":"2024-04-26T22:06:02.599294+0000","last_clean":"2024-04-26T22:06:02.599294+0000","last_became_active":"2024-04-26T22:06:01.602778+0000","last_became_peered":"2024-04-26T22:06:01.602778+0000","last_unstale":"2024-04-26T22:06:02.599294+0000","last_undegraded":"2024-04-26T22:06:02.599294+0000","last_fullsized":"2024-04-26T22:06:02.599294+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:07.021690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616659+0000","last_change":"2024-04-26T22:06:02.613129+0000","last_active":"2024-04-26T22:06:02.616659+0000","last_peered":"2024-04-26T22:06:02.616659+0000","last_clean":"2024-04-26T22:06:02.616659+0000","last_became_active":"2024-04-26T22:06:02.612866+0000","last_became_peered":"2024-04-26T22:06:02.612866+0000","last_unstale":"2024-04-26T22:06:02.616659+0000","last_undegraded":"2024-04-26T22:06:02.616659+0000","last_fullsized":"2024-04-26T22:06:02.616659+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:27:11.025282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.599607+0000","last_change":"2024-04-26T22:06:01.600176+0000","last_active":"2024-04-26T22:06:02.599607+0000","last_peered":"2024-04-26T22:06:02.599607+0000","last_clean":"2024-04-26T22:06:02.599607+0000","last_became_active":"2024-04-26T22:06:01.599869+0000","last_became_peered":"2024-04-26T22:06:01.599869+0000","last_unstale":"2024-04-26T22:06:02.599607+0000","last_undegraded":"2024-04-26T22:06:02.599607+0000","last_fullsized":"2024-04-26T22:06:02.599607+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:46:55.015562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617644+0000","last_change":"2024-04-26T22:06:02.614117+0000","last_active":"2024-04-26T22:06:02.617644+0000","last_peered":"2024-04-26T22:06:02.617644+0000","last_clean":"2024-04-26T22:06:02.617644+0000","last_became_active":"2024-04-26T22:06:02.613793+0000","last_became_peered":"2024-04-26T22:06:02.613793+0000","last_unstale":"2024-04-26T22:06:02.617644+0000","last_undegraded":"2024-04-26T22:06:02.617644+0000","last_fullsized":"2024-04-26T22:06:02.617644+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:54.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.593669+0000","last_change":"2024-04-26T22:06:01.600238+0000","last_active":"2024-04-26T22:06:02.593669+0000","last_peered":"2024-04-26T22:06:02.593669+0000","last_clean":"2024-04-26T22:06:02.593669+0000","last_became_active":"2024-04-26T22:06:01.599985+0000","last_became_peered":"2024-04-26T22:06:01.599985+0000","last_unstale":"2024-04-26T22:06:02.593669+0000","last_undegraded":"2024-04-26T22:06:02.593669+0000","last_fullsized":"2024-04-26T22:06:02.593669+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:53:32.472261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.608128+0000","last_change":"2024-04-26T22:06:02.602733+0000","last_active":"2024-04-26T22:06:02.608128+0000","last_peered":"2024-04-26T22:06:02.608128+0000","last_clean":"2024-04-26T22:06:02.608128+0000","last_became_active":"2024-04-26T22:06:02.602470+0000","last_became_peered":"2024-04-26T22:06:02.602470+0000","last_unstale":"2024-04-26T22:06:02.608128+0000","last_undegraded":"2024-04-26T22:06:02.608128+0000","last_fullsized":"2024-04-26T22:06:02.608128+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:21:12.892944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"102'2","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619603+0000","last_change":"2024-04-26T22:06:01.597740+0000","last_active":"2024-04-26T22:06:02.619603+0000","last_peered":"2024-04-26T22:06:02.619603+0000","last_clean":"2024-04-26T22:06:02.619603+0000","last_became_active":"2024-04-26T22:06:01.597287+0000","last_became_peered":"2024-04-26T22:06:01.597287+0000","last_unstale":"2024-04-26T22:06:02.619603+0000","last_undegraded":"2024-04-26T22:06:02.619603+0000","last_fullsized":"2024-04-26T22:06:02.619603+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:14:26.796516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622238+0000","last_change":"2024-04-26T22:06:02.615772+0000","last_active":"2024-04-26T22:06:02.622238+0000","last_peered":"2024-04-26T22:06:02.622238+0000","last_clean":"2024-04-26T22:06:02.622238+0000","last_became_active":"2024-04-26T22:06:02.615483+0000","last_became_peered":"2024-04-26T22:06:02.615483+0000","last_unstale":"2024-04-26T22:06:02.622238+0000","last_undegraded":"2024-04-26T22:06:02.622238+0000","last_fullsized":"2024-04-26T22:06:02.622238+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:43:48.028280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.595182+0000","last_change":"2024-04-26T22:06:01.604551+0000","last_active":"2024-04-26T22:06:02.595182+0000","last_peered":"2024-04-26T22:06:02.595182+0000","last_clean":"2024-04-26T22:06:02.595182+0000","last_became_active":"2024-04-26T22:06:01.604299+0000","last_became_peered":"2024-04-26T22:06:01.604299+0000","last_unstale":"2024-04-26T22:06:02.595182+0000","last_undegraded":"2024-04-26T22:06:02.595182+0000","last_fullsized":"2024-04-26T22:06:02.595182+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:39:38.064349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.622131+0000","last_change":"2024-04-26T22:06:02.613788+0000","last_active":"2024-04-26T22:06:02.622131+0000","last_peered":"2024-04-26T22:06:02.622131+0000","last_clean":"2024-04-26T22:06:02.622131+0000","last_became_active":"2024-04-26T22:06:02.613510+0000","last_became_peered":"2024-04-26T22:06:02.613510+0000","last_unstale":"2024-04-26T22:06:02.622131+0000","last_undegraded":"2024-04-26T22:06:02.622131+0000","last_fullsized":"2024-04-26T22:06:02.622131+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:47:26.297255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.594422+0000","last_change":"2024-04-26T22:06:01.596653+0000","last_active":"2024-04-26T22:06:02.594422+0000","last_peered":"2024-04-26T22:06:02.594422+0000","last_clean":"2024-04-26T22:06:02.594422+0000","last_became_active":"2024-04-26T22:06:01.596344+0000","last_became_peered":"2024-04-26T22:06:01.596344+0000","last_unstale":"2024-04-26T22:06:02.594422+0000","last_undegraded":"2024-04-26T22:06:02.594422+0000","last_fullsized":"2024-04-26T22:06:02.594422+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:02.975700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.616094+0000","last_change":"2024-04-26T22:06:02.612068+0000","last_active":"2024-04-26T22:06:02.616094+0000","last_peered":"2024-04-26T22:06:02.616094+0000","last_clean":"2024-04-26T22:06:02.616094+0000","last_became_active":"2024-04-26T22:06:02.611827+0000","last_became_peered":"2024-04-26T22:06:02.611827+0000","last_unstale":"2024-04-26T22:06:02.616094+0000","last_undegraded":"2024-04-26T22:06:02.616094+0000","last_fullsized":"2024-04-26T22:06:02.616094+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:35.111920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.595023+0000","last_change":"2024-04-26T22:06:01.593497+0000","last_active":"2024-04-26T22:06:02.595023+0000","last_peered":"2024-04-26T22:06:02.595023+0000","last_clean":"2024-04-26T22:06:02.595023+0000","last_became_active":"2024-04-26T22:06:01.593217+0000","last_became_peered":"2024-04-26T22:06:01.593217+0000","last_unstale":"2024-04-26T22:06:02.595023+0000","last_undegraded":"2024-04-26T22:06:02.595023+0000","last_fullsized":"2024-04-26T22:06:02.595023+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:43:01.363116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614572+0000","last_change":"2024-04-26T22:06:02.608020+0000","last_active":"2024-04-26T22:06:02.614572+0000","last_peered":"2024-04-26T22:06:02.614572+0000","last_clean":"2024-04-26T22:06:02.614572+0000","last_became_active":"2024-04-26T22:06:02.607741+0000","last_became_peered":"2024-04-26T22:06:02.607741+0000","last_unstale":"2024-04-26T22:06:02.614572+0000","last_undegraded":"2024-04-26T22:06:02.614572+0000","last_fullsized":"2024-04-26T22:06:02.614572+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:09:23.981922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.594311+0000","last_change":"2024-04-26T22:06:01.597448+0000","last_active":"2024-04-26T22:06:02.594311+0000","last_peered":"2024-04-26T22:06:02.594311+0000","last_clean":"2024-04-26T22:06:02.594311+0000","last_became_active":"2024-04-26T22:06:01.597189+0000","last_became_peered":"2024-04-26T22:06:01.597189+0000","last_unstale":"2024-04-26T22:06:02.594311+0000","last_undegraded":"2024-04-26T22:06:02.594311+0000","last_fullsized":"2024-04-26T22:06:02.594311+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:56:58.173331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619088+0000","last_change":"2024-04-26T22:06:02.615912+0000","last_active":"2024-04-26T22:06:02.619088+0000","last_peered":"2024-04-26T22:06:02.619088+0000","last_clean":"2024-04-26T22:06:02.619088+0000","last_became_active":"2024-04-26T22:06:02.615678+0000","last_became_peered":"2024-04-26T22:06:02.615678+0000","last_unstale":"2024-04-26T22:06:02.619088+0000","last_undegraded":"2024-04-26T22:06:02.619088+0000","last_fullsized":"2024-04-26T22:06:02.619088+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:35.111920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.593253+0000","last_change":"2024-04-26T22:06:01.598669+0000","last_active":"2024-04-26T22:06:02.593253+0000","last_peered":"2024-04-26T22:06:02.593253+0000","last_clean":"2024-04-26T22:06:02.593253+0000","last_became_active":"2024-04-26T22:06:01.598383+0000","last_became_peered":"2024-04-26T22:06:01.598383+0000","last_unstale":"2024-04-26T22:06:02.593253+0000","last_undegraded":"2024-04-26T22:06:02.593253+0000","last_fullsized":"2024-04-26T22:06:02.593253+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:05:22.623998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614404+0000","last_change":"2024-04-26T22:06:02.607302+0000","last_active":"2024-04-26T22:06:02.614404+0000","last_peered":"2024-04-26T22:06:02.614404+0000","last_clean":"2024-04-26T22:06:02.614404+0000","last_became_active":"2024-04-26T22:06:02.607035+0000","last_became_peered":"2024-04-26T22:06:02.607035+0000","last_unstale":"2024-04-26T22:06:02.614404+0000","last_undegraded":"2024-04-26T22:06:02.614404+0000","last_fullsized":"2024-04-26T22:06:02.614404+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:06:42.416170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.604423+0000","last_change":"2024-04-26T22:06:01.600243+0000","last_active":"2024-04-26T22:06:02.604423+0000","last_peered":"2024-04-26T22:06:02.604423+0000","last_clean":"2024-04-26T22:06:02.604423+0000","last_became_active":"2024-04-26T22:06:01.599981+0000","last_became_peered":"2024-04-26T22:06:01.599981+0000","last_unstale":"2024-04-26T22:06:02.604423+0000","last_undegraded":"2024-04-26T22:06:02.604423+0000","last_fullsized":"2024-04-26T22:06:02.604423+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:44.119581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.617616+0000","last_change":"2024-04-26T22:06:02.613954+0000","last_active":"2024-04-26T22:06:02.617616+0000","last_peered":"2024-04-26T22:06:02.617616+0000","last_clean":"2024-04-26T22:06:02.617616+0000","last_became_active":"2024-04-26T22:06:02.613687+0000","last_became_peered":"2024-04-26T22:06:02.613687+0000","last_unstale":"2024-04-26T22:06:02.617616+0000","last_undegraded":"2024-04-26T22:06:02.617616+0000","last_fullsized":"2024-04-26T22:06:02.617616+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:19:45.124042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.599377+0000","last_change":"2024-04-26T22:06:01.607061+0000","last_active":"2024-04-26T22:06:02.599377+0000","last_peered":"2024-04-26T22:06:02.599377+0000","last_clean":"2024-04-26T22:06:02.599377+0000","last_became_active":"2024-04-26T22:06:01.606762+0000","last_became_peered":"2024-04-26T22:06:01.606762+0000","last_unstale":"2024-04-26T22:06:02.599377+0000","last_undegraded":"2024-04-26T22:06:02.599377+0000","last_fullsized":"2024-04-26T22:06:02.599377+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:21:48.282414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.614078+0000","last_change":"2024-04-26T22:06:02.606205+0000","last_active":"2024-04-26T22:06:02.614078+0000","last_peered":"2024-04-26T22:06:02.614078+0000","last_clean":"2024-04-26T22:06:02.614078+0000","last_became_active":"2024-04-26T22:06:02.605912+0000","last_became_peered":"2024-04-26T22:06:02.605912+0000","last_unstale":"2024-04-26T22:06:02.614078+0000","last_undegraded":"2024-04-26T22:06:02.614078+0000","last_fullsized":"2024-04-26T22:06:02.614078+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:01.578723+0000","last_clean_scrub_stamp":"2024-04-26T22:06:01.578723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:31:46.361090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"102'1","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.619339+0000","last_change":"2024-04-26T22:06:01.596703+0000","last_active":"2024-04-26T22:06:02.619339+0000","last_peered":"2024-04-26T22:06:02.619339+0000","last_clean":"2024-04-26T22:06:02.619339+0000","last_became_active":"2024-04-26T22:06:01.596403+0000","last_became_peered":"2024-04-26T22:06:01.596403+0000","last_unstale":"2024-04-26T22:06:02.619339+0000","last_undegraded":"2024-04-26T22:06:02.619339+0000","last_fullsized":"2024-04-26T22:06:02.619339+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:06:00.574262+0000","last_clean_scrub_stamp":"2024-04-26T22:06:00.574262+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:52.451859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":335,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-26T22:06:02.594468+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:06:02.594468+0000","last_peered":"2024-04-26T22:06:02.594468+0000","last_clean":"2024-04-26T22:06:02.594468+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:06:02.594468+0000","last_undegraded":"2024-04-26T22:06:02.594468+0000","last_fullsized":"2024-04-26T22:06:02.594468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37144,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334696,"statfs":{"total":96636764160,"available":96598728704,"internally_reserved":0,"allocated":1843200,"data_stored":1128172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36564,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335276,"statfs":{"total":96636764160,"available":96599322624,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36564,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335276,"statfs":{"total":96636764160,"available":96599322624,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1249280,"data_stored":537804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1843200,"data_stored":1128172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:06:05.907 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T22:06:05.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T22:06:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.048+0000 7fa8f182a640 1 Processor -- start 2024-04-26T22:06:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.048+0000 7fa8f182a640 1 -- start start 2024-04-26T22:06:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8f182a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0b1ea0 0x7fa8ec0d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8f182a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec0b2300 con 0x7fa8ec0d56a0 2024-04-26T22:06:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8f182a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec0b2580 con 0x7fa8ec15f6e0 2024-04-26T22:06:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8f182a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0d5b10 con 0x7fa8ec0b1ea0 2024-04-26T22:06:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8eb7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa8ec0d56a0 0x7fa8ec0b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38104/0 (socket says 172.21.15.137:38104) 2024-04-26T22:06:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8eb7fe640 1 -- 172.21.15.137:0/2735746813 learned_addr learned my addr 172.21.15.137:0/2735746813 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:06.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8ea7fc640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0b1ea0 0x7fa8ec0d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183682456 0 0) 0x7fa8e4001110 con 0x7fa8ec0d56a0 2024-04-26T22:06:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8d4003520 con 0x7fa8ec0d56a0 2024-04-26T22:06:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1091474947 0 0) 0x7fa8d4003520 con 0x7fa8ec0d56a0 2024-04-26T22:06:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0b1ea0 msgr2=0x7fa8ec0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0b1ea0 0x7fa8ec0d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 >> v1:172.21.15.170:6789/0 conn(0x7fa8ec15f6e0 legacy=0x7fa8ec0d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec0b2860 con 0x7fa8ec0d56a0 2024-04-26T22:06:06.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fa8e4001840 con 0x7fa8ec0d56a0 2024-04-26T22:06:06.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 >> v1:172.21.15.137:6789/0 conn(0x7fa8ec0d56a0 legacy=0x7fa8ec0b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8d40039e0 0x7fa8d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.049+0000 7fa8e9ffb640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d4004800 0x7fa8d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8e9ffb640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0b1ea0 0x7fa8d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0d5b10 con 0x7fa8d40039e0 2024-04-26T22:06:06.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d400ba70 con 0x7fa8d4004800 2024-04-26T22:06:06.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa8d400bc70 con 0x7fa8ec0b1ea0 2024-04-26T22:06:06.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8eaffd640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8d40039e0 0x7fa8d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8eb7fe640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0b1ea0 0x7fa8d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8ea7fc640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d4004800 0x7fa8d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8eaffd640 1 -- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0b1ea0 msgr2=0x7fa8d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8eaffd640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0b1ea0 0x7fa8d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8eaffd640 1 -- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d4004800 msgr2=0x7fa8d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8eaffd640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d4004800 0x7fa8d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8eaffd640 1 -- 172.21.15.137:0/2735746813 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d4003520 con 0x7fa8d40039e0 2024-04-26T22:06:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8eb7fe640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0b1ea0 0x7fa8d40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.050+0000 7fa8eaffd640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8d40039e0 0x7fa8d4003e00 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc001e20 tx=0x7fa8d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cd74f87841523a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc001a70 con 0x7fa8d40039e0 2024-04-26T22:06:06.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc02ae10 con 0x7fa8d40039e0 2024-04-26T22:06:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8e9ffb640 1 -- 172.21.15.137:0/2735746813 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc003bb0 con 0x7fa8d40039e0 2024-04-26T22:06:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8f182a640 1 -- 172.21.15.137:0/2735746813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8d40039e0 msgr2=0x7fa8d4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8f182a640 1 --2- 172.21.15.137:0/2735746813 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8d40039e0 0x7fa8d4003e00 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc001e20 tx=0x7fa8d4005830 comp rx=0 tx=0).stop 2024-04-26T22:06:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8eb7fe640 1 -- 172.21.15.137:0/2735746813 reap_dead start 2024-04-26T22:06:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8f182a640 1 -- 172.21.15.137:0/2735746813 shutdown_connections 2024-04-26T22:06:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8f182a640 1 -- 172.21.15.137:0/2735746813 >> 172.21.15.137:0/2735746813 conn(0x7fa8ec08ec20 msgr2=0x7fa8ec09e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8f182a640 1 -- 172.21.15.137:0/2735746813 shutdown_connections 2024-04-26T22:06:06.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.051+0000 7fa8f182a640 1 -- 172.21.15.137:0/2735746813 wait complete. 2024-04-26T22:06:06.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.052+0000 7fa8f182a640 1 Processor -- start 2024-04-26T22:06:06.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8f182a640 1 -- start start 2024-04-26T22:06:06.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8f182a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d40039e0 0x7fa8ec0a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8f182a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0a2c80 0x7fa8ec0ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8f182a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8ec0caaf0 0x7fa8ec15fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8f182a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0d5160 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8f182a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0b2e20 con 0x7fa8d40039e0 2024-04-26T22:06:06.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8f182a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0d52e0 con 0x7fa8ec0a2c80 2024-04-26T22:06:06.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8ec0caaf0 0x7fa8ec15fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8ec0caaf0 0x7fa8ec15fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59254/0 (socket says 172.21.15.137:59254) 2024-04-26T22:06:06.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8eb7fe640 1 -- 172.21.15.137:0/2617705084 learned_addr learned my addr 172.21.15.137:0/2617705084 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:06.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8ea7fc640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0a2c80 0x7fa8ec0ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.053+0000 7fa8eaffd640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d40039e0 0x7fa8ec0a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8eb7fe640 1 -- 172.21.15.137:0/2617705084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0a2c80 msgr2=0x7fa8ec0ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8eb7fe640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0a2c80 0x7fa8ec0ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8eb7fe640 1 -- 172.21.15.137:0/2617705084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d40039e0 msgr2=0x7fa8ec0a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8eb7fe640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d40039e0 0x7fa8ec0a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8eb7fe640 1 -- 172.21.15.137:0/2617705084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec1608a0 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8eaffd640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d40039e0 0x7fa8ec0a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:06.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8eb7fe640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8ec0caaf0 0x7fa8ec15fb30 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec08f450 tx=0x7fa8e4007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:06.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8d3fff640 1 -- 172.21.15.137:0/2617705084 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400e610 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8d3fff640 1 -- 172.21.15.137:0/2617705084 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4018070 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec0a21a0 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8d3fff640 1 -- 172.21.15.137:0/2617705084 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e400ea10 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.069 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.054+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec0a2760 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.055+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ec06a290 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.055+0000 7fa8d3fff640 1 -- 172.21.15.137:0/2617705084 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8e400ebb0 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.056+0000 7fa8d3fff640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8d806c920 0x7fa8d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.056+0000 7fa8d3fff640 1 -- 172.21.15.137:0/2617705084 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fa8e408b750 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.056+0000 7fa8eaffd640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8d806c920 0x7fa8d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.056+0000 7fa8eaffd640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8d806c920 0x7fa8d806ede0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc032000 tx=0x7fa8dc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:06.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.060+0000 7fa8d3fff640 1 -- 172.21.15.137:0/2617705084 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa8ec0b2300 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.303+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa8ec0a2930 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.305+0000 7fa8d3fff640 1 -- 172.21.15.137:0/2617705084 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fa8e4059b80 con 0x7fa8ec0caaf0 2024-04-26T22:06:06.305 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T22:06:06.305 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ== 2024-04-26T22:06:06.305 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T22:06:06.306 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T22:06:06.306 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T22:06:06.306 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.307+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8d806c920 msgr2=0x7fa8d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.307+0000 7fa8f182a640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8d806c920 0x7fa8d806ede0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc032000 tx=0x7fa8dc02e000 comp rx=0 tx=0).stop 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.307+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8ec0caaf0 msgr2=0x7fa8ec15fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.307+0000 7fa8f182a640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8ec0caaf0 0x7fa8ec15fb30 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec08f450 tx=0x7fa8e4007420 comp rx=0 tx=0).stop 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.308+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 shutdown_connections 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.308+0000 7fa8f182a640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa8d806c920 0x7fa8d806ede0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.308+0000 7fa8f182a640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa8ec0caaf0 0x7fa8ec15fb30 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.308+0000 7fa8f182a640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa8ec0a2c80 0x7fa8ec0ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.308+0000 7fa8f182a640 1 --2- 172.21.15.137:0/2617705084 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8d40039e0 0x7fa8ec0a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.308+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 >> 172.21.15.137:0/2617705084 conn(0x7fa8ec08ec20 msgr2=0x7fa8ec15c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:06.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.308+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 shutdown_connections 2024-04-26T22:06:06.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.308+0000 7fa8f182a640 1 -- 172.21.15.137:0/2617705084 wait complete. 2024-04-26T22:06:06.319 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:06:06.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.416+0000 7f83869e2640 1 Processor -- start 2024-04-26T22:06:06.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.416+0000 7f83869e2640 1 -- start start 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f83869e2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f838006d9c0 0x7f83800b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f83869e2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f838015d510 con 0x7f838015d130 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f83869e2640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83800d12c0 con 0x7f83800733c0 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f83869e2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f83800b0e80 con 0x7f838006d9c0 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837ffff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f838015d130 0x7f838006d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38120/0 (socket says 172.21.15.137:38120) 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837ffff640 1 -- 172.21.15.137:0/4244392094 learned_addr learned my addr 172.21.15.137:0/4244392094 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837f7fe640 1 --2- 172.21.15.137:0/4244392094 >> v2:172.21.15.170:3300/0 conn(0x7f838006d9c0 0x7f83800b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500946117 0 0) 0x7f838015d510 con 0x7f838015d130 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8368003520 con 0x7f838015d130 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3941119529 0 0) 0x7f8368003520 con 0x7f838015d130 2024-04-26T22:06:06.420 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 >> v2:172.21.15.170:3300/0 conn(0x7f838006d9c0 msgr2=0x7f83800b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837effd640 1 --2- 172.21.15.137:0/4244392094 >> v2:172.21.15.170:3300/0 conn(0x7f838006d9c0 0x7f83800b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 >> v1:172.21.15.170:6789/0 conn(0x7f83800733c0 legacy=0x7f83800b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83800d0220 con 0x7f838015d130 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f8370001670 con 0x7f838015d130 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.417+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 >> v1:172.21.15.137:6789/0 conn(0x7f838015d130 legacy=0x7f838006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f837effd640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83680039b0 0x7f8368003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f837effd640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368004800 0x7f8368004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f837effd640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83680051c0 0x7f836800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83800b0e80 con 0x7f83680051c0 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f836800c060 con 0x7f8368004800 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f836800c260 con 0x7f83680039b0 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f8384f7f640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83680051c0 0x7f836800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f837ffff640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83680039b0 0x7f8368003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f837f7fe640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368004800 0x7f8368004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f8384f7f640 1 -- 172.21.15.137:0/4244392094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83680039b0 msgr2=0x7f8368003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f8384f7f640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83680039b0 0x7f8368003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f8384f7f640 1 -- 172.21.15.137:0/4244392094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368004800 msgr2=0x7f8368004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f8384f7f640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8368004800 0x7f8368004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f8384f7f640 1 -- 172.21.15.137:0/4244392094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368003520 con 0x7f83680051c0 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.418+0000 7f837ffff640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f83680039b0 0x7f8368003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f8384f7f640 1 -- 172.21.15.137:0/4244392094 reap_dead start 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f8384f7f640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83680051c0 0x7f836800b9c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f8378001e20 tx=0x7f8368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3224c97151ed1b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378001a70 con 0x7f83680051c0 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837802ae40 con 0x7f83680051c0 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f837effd640 1 -- 172.21.15.137:0/4244392094 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378003bb0 con 0x7f83680051c0 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f83869e2640 1 -- 172.21.15.137:0/4244392094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83680051c0 msgr2=0x7f836800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f83869e2640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83680051c0 0x7f836800b9c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f8378001e20 tx=0x7f8368005830 comp rx=0 tx=0).stop 2024-04-26T22:06:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f83869e2640 1 -- 172.21.15.137:0/4244392094 shutdown_connections 2024-04-26T22:06:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f83869e2640 1 --2- 172.21.15.137:0/4244392094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f83680051c0 0x7f836800b9c0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f83869e2640 1 -- 172.21.15.137:0/4244392094 >> 172.21.15.137:0/4244392094 conn(0x7f83800728a0 msgr2=0x7f8380072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f83869e2640 1 -- 172.21.15.137:0/4244392094 shutdown_connections 2024-04-26T22:06:06.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.419+0000 7f83869e2640 1 -- 172.21.15.137:0/4244392094 wait complete. 2024-04-26T22:06:06.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.420+0000 7f83869e2640 1 Processor -- start 2024-04-26T22:06:06.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.421+0000 7f83869e2640 1 -- start start 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.421+0000 7f83869e2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83680051c0 0x7f8380155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.421+0000 7f83869e2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8380154c30 0x7f8380147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.421+0000 7f83869e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838015fb40 0x7f838015ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.421+0000 7f83869e2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f83800d0ac0 con 0x7f838015fb40 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.421+0000 7f83869e2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f83800d07e0 con 0x7f83680051c0 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.421+0000 7f83869e2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f83800d0da0 con 0x7f8380154c30 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.421+0000 7f8384f7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838015fb40 0x7f838015ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.421+0000 7f8384f7f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838015fb40 0x7f838015ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59270/0 (socket says 172.21.15.137:59270) 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f8384f7f640 1 -- 172.21.15.137:0/853116263 learned_addr learned my addr 172.21.15.137:0/853116263 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f837ffff640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83680051c0 0x7f8380155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f8384f7f640 1 -- 172.21.15.137:0/853116263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8380154c30 msgr2=0x7f8380147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f8384f7f640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8380154c30 0x7f8380147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.426 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f8384f7f640 1 -- 172.21.15.137:0/853116263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83680051c0 msgr2=0x7f8380155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f8384f7f640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83680051c0 0x7f8380155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f8384f7f640 1 -- 172.21.15.137:0/853116263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8380155fb0 con 0x7f838015fb40 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f8384f7f640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838015fb40 0x7f838015ffc0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f8378001f40 tx=0x7f83780014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f837cff9640 1 -- 172.21.15.137:0/853116263 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378007db0 con 0x7f838015fb40 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f837cff9640 1 -- 172.21.15.137:0/853116263 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8378006d60 con 0x7f838015fb40 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f837cff9640 1 -- 172.21.15.137:0/853116263 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780056a0 con 0x7f838015fb40 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8380156290 con 0x7f838015fb40 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.422+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838015db90 con 0x7f838015fb40 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.423+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838006a290 con 0x7f838015fb40 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.424+0000 7f837cff9640 1 -- 172.21.15.137:0/853116263 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8378007030 con 0x7f838015fb40 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.424+0000 7f837cff9640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f836c06c8f0 0x7f836c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.424+0000 7f837cff9640 1 -- 172.21.15.137:0/853116263 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f83780ab4f0 con 0x7f838015fb40 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.424+0000 7f837ffff640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f836c06c8f0 0x7f836c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:06.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.424+0000 7f837ffff640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f836c06c8f0 0x7f836c06edb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8370000f60 tx=0x7f8370001150 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:06.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.428+0000 7f837cff9640 1 -- 172.21.15.137:0/853116263 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8378039070 con 0x7f838015fb40 2024-04-26T22:06:06.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.641+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f838015dd60 con 0x7f838015fb40 2024-04-26T22:06:06.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.642+0000 7f837cff9640 1 -- 172.21.15.137:0/853116263 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5195 (secure 0 0 0) 0x7f8378079a90 con 0x7f838015fb40 2024-04-26T22:06:06.642 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:06.642 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1187927282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1187927282},{"type":"v1","addr":"172.21.15.137:6836","nonce":1187927282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:06:03.956752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2219855149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2219855149},{"type":"v1","addr":"172.21.15.170:6835","nonce":2219855149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8232,"qdb_cluster":[8232]},"id":7}]} 2024-04-26T22:06:06.643 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 66 2024-04-26T22:06:06.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f836c06c8f0 msgr2=0x7f836c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f836c06c8f0 0x7f836c06edb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8370000f60 tx=0x7f8370001150 comp rx=0 tx=0).stop 2024-04-26T22:06:06.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838015fb40 msgr2=0x7f838015ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:06.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838015fb40 0x7f838015ffc0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f8378001f40 tx=0x7f83780014a0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 shutdown_connections 2024-04-26T22:06:06.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f836c06c8f0 0x7f836c06edb0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f838015fb40 0x7f838015ffc0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8380154c30 0x7f8380147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 --2- 172.21.15.137:0/853116263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83680051c0 0x7f8380155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:06.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 >> 172.21.15.137:0/853116263 conn(0x7f83800728a0 msgr2=0x7f83800b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:06.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 shutdown_connections 2024-04-26T22:06:06.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:06.644+0000 7f83869e2640 1 -- 172.21.15.137:0/853116263 wait complete. 2024-04-26T22:06:07.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:06:01.940531+0000', 'modified': '2024-04-26T22:06:03.956752+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8232}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8232': {'gid': 8232, 'name': 'b', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6835/2219855149', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6832', 'nonce': 2219855149}, {'type': 'v1', 'addr': '172.21.15.170:6835', 'nonce': 2219855149}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8232, 'qdb_cluster': [8232]} 2024-04-26T22:06:07.059 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:06:07.059 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T22:06:07.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.160+0000 7fc0722a9640 1 Processor -- start 2024-04-26T22:06:07.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.160+0000 7fc0722a9640 1 -- start start 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc0722a9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc06c06f2c0 0x7fc06c071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc0722a9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc06c15b8c0 0x7fc06c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc0722a9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc06c0733e0 con 0x7fc06c15b4e0 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc0722a9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc06c0ce230 con 0x7fc06c15b8c0 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc0722a9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc06c072f00 con 0x7fc06c06f2c0 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc070846640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc06c15b8c0 0x7fc06c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc070846640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc06c15b8c0 0x7fc06c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59274/0 (socket says 172.21.15.137:59274) 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc070846640 1 -- 172.21.15.137:0/3642090480 learned_addr learned my addr 172.21.15.137:0/3642090480 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/3642090480 >> v2:172.21.15.170:3300/0 conn(0x7fc06c06f2c0 0x7fc06c071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc070846640 1 -- 172.21.15.137:0/3642090480 >> v2:172.21.15.170:3300/0 conn(0x7fc06c06f2c0 msgr2=0x7fc06c071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc070846640 1 --2- 172.21.15.137:0/3642090480 >> v2:172.21.15.170:3300/0 conn(0x7fc06c06f2c0 0x7fc06c071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc070846640 1 -- 172.21.15.137:0/3642090480 >> v1:172.21.15.170:6789/0 conn(0x7fc06c15b4e0 legacy=0x7fc06c06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc070846640 1 -- 172.21.15.137:0/3642090480 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c072660 con 0x7fc06c15b8c0 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.161+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/3642090480 >> v2:172.21.15.170:3300/0 conn(0x7fc06c06f2c0 0x7fc06c071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.162+0000 7fc070846640 1 --2- 172.21.15.137:0/3642090480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b8c0 0x7fc06c0cdcf0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fc06c074630 tx=0x7fc06402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67d416658af2382 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.162+0000 7fc06affd640 1 -- 172.21.15.137:0/3642090480 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064036070 con 0x7fc06c15b8c0 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.162+0000 7fc06affd640 1 -- 172.21.15.137:0/3642090480 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc064031600 con 0x7fc06c15b8c0 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.162+0000 7fc06affd640 1 -- 172.21.15.137:0/3642090480 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0640319d0 con 0x7fc06c15b8c0 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.163+0000 7fc0722a9640 1 -- 172.21.15.137:0/3642090480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b8c0 msgr2=0x7fc06c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.163+0000 7fc0722a9640 1 --2- 172.21.15.137:0/3642090480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b8c0 0x7fc06c0cdcf0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fc06c074630 tx=0x7fc06402a660 comp rx=0 tx=0).stop 2024-04-26T22:06:07.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.163+0000 7fc0722a9640 1 -- 172.21.15.137:0/3642090480 shutdown_connections 2024-04-26T22:06:07.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.163+0000 7fc0722a9640 1 --2- 172.21.15.137:0/3642090480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b8c0 0x7fc06c0cdcf0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.163+0000 7fc0722a9640 1 --2- 172.21.15.137:0/3642090480 >> v2:172.21.15.170:3300/0 conn(0x7fc06c06f2c0 0x7fc06c071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.163+0000 7fc0722a9640 1 -- 172.21.15.137:0/3642090480 >> 172.21.15.137:0/3642090480 conn(0x7fc06c0d0d30 msgr2=0x7fc06c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:07.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.163+0000 7fc0722a9640 1 -- 172.21.15.137:0/3642090480 shutdown_connections 2024-04-26T22:06:07.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.163+0000 7fc0722a9640 1 -- 172.21.15.137:0/3642090480 wait complete. 2024-04-26T22:06:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.164+0000 7fc0722a9640 1 Processor -- start 2024-04-26T22:06:07.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.164+0000 7fc0722a9640 1 -- start start 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc0722a9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc06c06f2c0 0x7fc06c14bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc0722a9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b4e0 0x7fc06c149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc0722a9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06c15b8c0 0x7fc06c158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc0722a9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c0b3e80 con 0x7fc06c15b4e0 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc0722a9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c072c20 con 0x7fc06c15b8c0 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc0722a9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c073820 con 0x7fc06c06f2c0 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc06b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b4e0 0x7fc06c149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc06b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b4e0 0x7fc06c149090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59278/0 (socket says 172.21.15.137:59278) 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc06b7fe640 1 -- 172.21.15.137:0/3099361783 learned_addr learned my addr 172.21.15.137:0/3099361783 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc06b7fe640 1 -- 172.21.15.137:0/3099361783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc06c06f2c0 msgr2=0x7fc06c14bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc06c06f2c0 0x7fc06c14bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc06b7fe640 1 -- 172.21.15.137:0/3099361783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06c15b8c0 msgr2=0x7fc06c158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06c15b8c0 0x7fc06c158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc06b7fe640 1 -- 172.21.15.137:0/3099361783 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06c15ab70 con 0x7fc06c15b4e0 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b4e0 0x7fc06c149090 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c7f0 tx=0x7fc06000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc068ff9640 1 -- 172.21.15.137:0/3099361783 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060015070 con 0x7fc06c15b4e0 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc068ff9640 1 -- 172.21.15.137:0/3099361783 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc060007a30 con 0x7fc06c15b4e0 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc0722a9640 1 -- 172.21.15.137:0/3099361783 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06c142370 con 0x7fc06c15b4e0 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc068ff9640 1 -- 172.21.15.137:0/3099361783 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060007e00 con 0x7fc06c15b4e0 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.165+0000 7fc0722a9640 1 -- 172.21.15.137:0/3099361783 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06c1495d0 con 0x7fc06c15b4e0 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.167+0000 7fc068ff9640 1 -- 172.21.15.137:0/3099361783 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc060018070 con 0x7fc06c15b4e0 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.167+0000 7fc068ff9640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05806c8f0 0x7fc05806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.167+0000 7fc068ff9640 1 -- 172.21.15.137:0/3099361783 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fc06008bad0 con 0x7fc06c15b4e0 2024-04-26T22:06:07.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.167+0000 7fc06bfff640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05806c8f0 0x7fc05806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.168+0000 7fc06bfff640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05806c8f0 0x7fc05806edb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc05c003cc0 tx=0x7fc05c0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.168+0000 7fc074fc3740 1 Processor -- start 2024-04-26T22:06:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.168+0000 7fc074fc3740 1 -- start start 2024-04-26T22:06:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a046755820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046773230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a04672b120 0x55a0467713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc074fc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a04668f740 con 0x55a046755440 2024-04-26T22:06:07.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc074fc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a04662b3a0 con 0x55a046772ce0 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc074fc3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a04668b700 con 0x55a04672b120 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a046755820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a046755820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59290/0 (socket says 172.21.15.137:59290) 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06bfff640 1 -- 172.21.15.137:0/1733021306 learned_addr learned my addr 172.21.15.137:0/1733021306 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc070846640 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a04672b120 0x55a0467713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046773230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06bfff640 1 -- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a04672b120 msgr2=0x55a0467713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06bfff640 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a04672b120 0x55a0467713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06bfff640 1 -- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 msgr2=0x55a046773230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06bfff640 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046773230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06bfff640 1 -- 172.21.15.137:0/1733021306 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a046647750 con 0x55a046755440 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc070846640 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a04672b120 0x55a0467713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046773230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc06bfff640 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a046755820 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0168c0 tx=0x7fc05c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f20973a6cd0710e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.169+0000 7fc051ffb640 1 -- 172.21.15.137:0/1733021306 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0162e0 con 0x55a046755440 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc051ffb640 1 -- 172.21.15.137:0/1733021306 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c0138b0 con 0x55a046755440 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc051ffb640 1 -- 172.21.15.137:0/1733021306 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c013c80 con 0x55a046755440 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc074fc3740 1 -- 172.21.15.137:0/1733021306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 msgr2=0x55a046755820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a046755820 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0168c0 tx=0x7fc05c00f000 comp rx=0 tx=0).stop 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc074fc3740 1 -- 172.21.15.137:0/1733021306 shutdown_connections 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a04672b120 0x55a0467713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046773230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1733021306 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a046755820 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.179 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc074fc3740 1 -- 172.21.15.137:0/1733021306 >> 172.21.15.137:0/1733021306 conn(0x55a046727a50 msgr2=0x55a046770250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc074fc3740 1 -- 172.21.15.137:0/1733021306 shutdown_connections 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.170+0000 7fc074fc3740 1 -- 172.21.15.137:0/1733021306 wait complete. 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.171+0000 7fc074fc3740 1 -- start start 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.171+0000 7fc074fc3740 1 Processor -- start 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 0x55a046757750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046728ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046781370 0x55a046729530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc074fc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a04672bec0 con 0x55a046781370 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc074fc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a046616fe0 con 0x55a046772ce0 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc074fc3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a046725980 con 0x55a046755440 2024-04-26T22:06:07.180 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc074fc3740 10 client.0 _ll_register_callbacks cb 0x55a04662d150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc070846640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046781370 0x55a046729530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc070846640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046781370 0x55a046729530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59292/0 (socket says 172.21.15.137:59292) 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc070846640 1 -- 172.21.15.137:0/1101574630 learned_addr learned my addr 172.21.15.137:0/1101574630 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc06bfff640 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 0x55a046757750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046728ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc070846640 1 -- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 msgr2=0x55a046757750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc070846640 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 0x55a046757750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc070846640 1 -- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 msgr2=0x55a046728ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc070846640 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046728ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc070846640 1 -- 172.21.15.137:0/1101574630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0463a12d0 con 0x55a046781370 2024-04-26T22:06:07.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc070846640 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046781370 0x55a046729530 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fc064034040 tx=0x7fc064004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9203f8483d353fc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc04affd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc04affd640 1 -- 172.21.15.137:0/1101574630 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064041020 con 0x55a046781370 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc04affd640 1 -- 172.21.15.137:0/1101574630 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fc064031dc0 con 0x55a046781370 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc074fc3740 1 -- 172.21.15.137:0/1101574630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc05c0138b0 con 0x55a046781370 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.172+0000 7fc04affd640 1 -- 172.21.15.137:0/1101574630 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fc06404b050 con 0x55a046781370 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc074fc3740 10 client.8361 fetch_fsmap learned FSMap version 66 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc074fc3740 1 -- 172.21.15.137:0/1101574630 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55a04646b6b0 con 0x55a046781370 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc04affd640 1 -- 172.21.15.137:0/1101574630 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c0138b0 con 0x55a046781370 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc04affd640 1 -- 172.21.15.137:0/1101574630 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7fc064008040 con 0x55a046781370 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc074fc3740 10 client.8361 fetch_fsmap finished waiting for FSMap version 66 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc074fc3740 10 client.8361 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc074fc3740 20 client.8361 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:07.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a046774c30 0x55a046775010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc074fc3740 4 client.8361 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc074fc3740 1 -- 172.21.15.137:0/1101574630 --> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a04669d350 con 0x55a046774c30 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc06bfff640 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a046774c30 0x55a046775010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc04affd640 10 client.8361 ms_handle_connect on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.173+0000 7fc06bfff640 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a046774c30 0x55a046775010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2584098de90ed52e server_cookie=7a27b907232c1837 in_seq=0 out_seq=0 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc04affd640 1 -- 172.21.15.137:0/1101574630 <== mds.0 v2:172.21.15.170:6832/2219855149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a04669d350 con 0x55a046774c30 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc04affd640 10 client.8361 handle_command_reply: tid=0 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc074fc3740 1 client.8361 shutdown 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc074fc3740 1 -- 172.21.15.137:0/1101574630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046781370 msgr2=0x55a046729530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046781370 0x55a046729530 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fc064034040 tx=0x7fc064004a40 comp rx=0 tx=0).stop 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc074fc3740 1 -- 172.21.15.137:0/1101574630 shutdown_connections 2024-04-26T22:06:07.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a046774c30 0x55a046775010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046781370 0x55a046729530 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046728ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc074fc3740 1 --2- 172.21.15.137:0/1101574630 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 0x55a046757750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc04affd640 0 client.8361 ms_handle_reset on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.174+0000 7fc074fc3740 1 -- 172.21.15.137:0/1101574630 >> 172.21.15.137:0/1101574630 conn(0x55a04672b120 msgr2=0x55a046774060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.175+0000 7fc074fc3740 1 -- 172.21.15.137:0/1101574630 shutdown_connections 2024-04-26T22:06:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.175+0000 7fc074fc3740 1 -- 172.21.15.137:0/1101574630 wait complete. 2024-04-26T22:06:07.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.175+0000 7fc074fc3740 20 client.8361 trim_cache size 0 max 16384 2024-04-26T22:06:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.192+0000 7fc074fc3740 1 Processor -- start 2024-04-26T22:06:07.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.192+0000 7fc074fc3740 1 -- start start 2024-04-26T22:06:07.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a0467802a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046750890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046781370 0x55a046724860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc074fc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c14abf0 con 0x55a046755440 2024-04-26T22:06:07.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc074fc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc06c149f50 con 0x55a046772ce0 2024-04-26T22:06:07.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc074fc3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc06c14a5a0 con 0x55a046781370 2024-04-26T22:06:07.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc06bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a0467802a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc06bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a0467802a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59306/0 (socket says 172.21.15.137:59306) 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc06bfff640 1 -- 172.21.15.137:0/2053442228 learned_addr learned my addr 172.21.15.137:0/2053442228 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc06bfff640 1 -- 172.21.15.137:0/2053442228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046781370 msgr2=0x55a046724860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc06bfff640 1 --2- 172.21.15.137:0/2053442228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046781370 0x55a046724860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc06bfff640 1 -- 172.21.15.137:0/2053442228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 msgr2=0x55a046750890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc06bfff640 1 --2- 172.21.15.137:0/2053442228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046750890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.193+0000 7fc06bfff640 1 -- 172.21.15.137:0/2053442228 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a046726f10 con 0x55a046755440 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc06bfff640 1 --2- 172.21.15.137:0/2053442228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a0467802a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc05c021040 tx=0x7fc05c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d8b4b47f20068b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc0517fa640 1 -- 172.21.15.137:0/2053442228 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c031070 con 0x55a046755440 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc0517fa640 1 -- 172.21.15.137:0/2053442228 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c013ca0 con 0x55a046755440 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc0517fa640 1 -- 172.21.15.137:0/2053442228 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0069f0 con 0x55a046755440 2024-04-26T22:06:07.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc074fc3740 1 -- 172.21.15.137:0/2053442228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 msgr2=0x55a0467802a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2053442228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a0467802a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fc05c021040 tx=0x7fc05c011000 comp rx=0 tx=0).stop 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc074fc3740 1 -- 172.21.15.137:0/2053442228 shutdown_connections 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2053442228 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046781370 0x55a046724860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2053442228 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046772ce0 0x55a046750890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2053442228 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046755440 0x55a0467802a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc074fc3740 1 -- 172.21.15.137:0/2053442228 >> 172.21.15.137:0/2053442228 conn(0x55a04672b120 msgr2=0x55a046729290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc074fc3740 1 -- 172.21.15.137:0/2053442228 shutdown_connections 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.194+0000 7fc074fc3740 1 -- 172.21.15.137:0/2053442228 wait complete. 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.195+0000 7fc074fc3740 1 -- start start 2024-04-26T22:06:07.197 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.195+0000 7fc074fc3740 1 Processor -- start 2024-04-26T22:06:07.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 0x55a0467eae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046772ce0 0x55a046792fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc074fc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046781370 0x55a04674f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc074fc3740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a046751310 con 0x55a046772ce0 2024-04-26T22:06:07.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc074fc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a046780e50 con 0x55a046781370 2024-04-26T22:06:07.201 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc074fc3740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a046777510 con 0x55a046755440 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc074fc3740 10 client.0 _ll_register_callbacks cb 0x7fc064034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046772ce0 0x55a046792fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046772ce0 0x55a046792fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59308/0 (socket says 172.21.15.137:59308) 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06b7fe640 1 -- 172.21.15.137:0/2163782250 learned_addr learned my addr 172.21.15.137:0/2163782250 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc070846640 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046781370 0x55a04674f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06bfff640 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 0x55a0467eae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06b7fe640 1 -- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 msgr2=0x55a0467eae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 0x55a0467eae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06b7fe640 1 -- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046781370 msgr2=0x55a04674f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046781370 0x55a04674f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06b7fe640 1 -- 172.21.15.137:0/2163782250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a046776580 con 0x55a046772ce0 2024-04-26T22:06:07.202 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc06b7fe640 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046772ce0 0x55a046792fa0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc060059820 tx=0x7fc0600599d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7141ada258d814e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc04affd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.196+0000 7fc04affd640 1 -- 172.21.15.137:0/2163782250 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06001f040 con 0x55a046772ce0 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc04affd640 1 -- 172.21.15.137:0/2163782250 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fc06005abc0 con 0x55a046772ce0 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc074fc3740 1 -- 172.21.15.137:0/2163782250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc05c013ca0 con 0x55a046772ce0 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc04affd640 1 -- 172.21.15.137:0/2163782250 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fc06005adc0 con 0x55a046772ce0 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc074fc3740 10 client.8367 fetch_fsmap learned FSMap version 66 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc074fc3740 1 -- 172.21.15.137:0/2163782250 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55a046776b40 con 0x55a046772ce0 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc04affd640 1 -- 172.21.15.137:0/2163782250 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc05c013ca0 con 0x55a046772ce0 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc04affd640 1 -- 172.21.15.137:0/2163782250 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7fc060058ce0 con 0x55a046772ce0 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc074fc3740 10 client.8367 fetch_fsmap finished waiting for FSMap version 66 2024-04-26T22:06:07.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc074fc3740 10 client.8367 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc074fc3740 20 client.8367 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a046729e70 0x55a04672a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc074fc3740 4 client.8367 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc074fc3740 1 -- 172.21.15.137:0/2163782250 --> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] -- command(tid 0: {"prefix": "status"}) -- 0x55a0466971c0 con 0x55a046729e70 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.197+0000 7fc06bfff640 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a046729e70 0x55a04672a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc04affd640 10 client.8367 ms_handle_connect on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc06bfff640 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a046729e70 0x55a04672a250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a0f26b6c9333f78 server_cookie=9e71a5fc74cc9e8e in_seq=0 out_seq=0 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc04affd640 1 -- 172.21.15.137:0/2163782250 <== mds.0 v2:172.21.15.170:6832/2219855149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55a0466971c0 con 0x55a046729e70 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc04affd640 10 client.8367 handle_command_reply: tid=0 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 client.8367 shutdown 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 -- 172.21.15.137:0/2163782250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046772ce0 msgr2=0x55a046792fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.204 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046772ce0 0x55a046792fa0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fc060059820 tx=0x7fc0600599d0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 -- 172.21.15.137:0/2163782250 shutdown_connections 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a046729e70 0x55a04672a250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a046772ce0 0x55a046792fa0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a046781370 0x55a04674f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc04affd640 0 client.8367 ms_handle_reset on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 --2- 172.21.15.137:0/2163782250 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a046755440 0x55a0467eae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 -- 172.21.15.137:0/2163782250 >> 172.21.15.137:0/2163782250 conn(0x55a04672b120 msgr2=0x55a046724860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 -- 172.21.15.137:0/2163782250 shutdown_connections 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 1 -- 172.21.15.137:0/2163782250 wait complete. 2024-04-26T22:06:07.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.198+0000 7fc074fc3740 20 client.8367 trim_cache size 0 max 16384 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 8232, 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.6087702400000001, 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 66, 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 103, 2024-04-26T22:06:07.206 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 103, 2024-04-26T22:06:07.207 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 9.6491769220000005 2024-04-26T22:06:07.207 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:06:07.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 -- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05806c8f0 msgr2=0x7fc05806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05806c8f0 0x7fc05806edb0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc05c003cc0 tx=0x7fc05c0079b0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 -- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b4e0 msgr2=0x7fc06c149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b4e0 0x7fc06c149090 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c7f0 tx=0x7fc06000cbf0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 -- 172.21.15.137:0/3099361783 shutdown_connections 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc05806c8f0 0x7fc05806edb0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc06c15b4e0 0x7fc06c149090 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc06c15b8c0 0x7fc06c158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 --2- 172.21.15.137:0/3099361783 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc06c06f2c0 0x7fc06c14bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 -- 172.21.15.137:0/3099361783 >> 172.21.15.137:0/3099361783 conn(0x7fc06c0d0d30 msgr2=0x7fc06c0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 -- 172.21.15.137:0/3099361783 shutdown_connections 2024-04-26T22:06:07.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.199+0000 7fc0722a9640 1 -- 172.21.15.137:0/3099361783 wait complete. 2024-04-26T22:06:07.209 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:06:07.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.306+0000 7f5806367640 1 Processor -- start 2024-04-26T22:06:07.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.306+0000 7f5806367640 1 -- start start 2024-04-26T22:06:07.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f5806367640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5800160640 0x7f58001636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f5806367640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58000cfa80 con 0x7f5800163be0 2024-04-26T22:06:07.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f5806367640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58000cfd60 con 0x7f5800148a30 2024-04-26T22:06:07.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f5806367640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f58000745e0 con 0x7f5800160640 2024-04-26T22:06:07.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f57ff7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5800160640 0x7f58001636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f57ff7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5800160640 0x7f58001636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59324/0 (socket says 172.21.15.137:59324) 2024-04-26T22:06:07.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f57ff7fe640 1 -- 172.21.15.137:0/2894836505 learned_addr learned my addr 172.21.15.137:0/2894836505 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:07.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f5804904640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f5800163be0 0x7f58000b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38132/0 (socket says 172.21.15.137:38132) 2024-04-26T22:06:07.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f57ff7fe640 1 -- 172.21.15.137:0/2894836505 >> v1:172.21.15.170:6789/0 conn(0x7f5800148a30 legacy=0x7f5800073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:07.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f57ff7fe640 1 -- 172.21.15.137:0/2894836505 >> v1:172.21.15.137:6789/0 conn(0x7f5800163be0 legacy=0x7f58000b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.307+0000 7f57ff7fe640 1 -- 172.21.15.137:0/2894836505 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58000d0040 con 0x7f5800160640 2024-04-26T22:06:07.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f57ff7fe640 1 --2- 172.21.15.137:0/2894836505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800160640 0x7f58001636a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009870 tx=0x7f57f002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b000aea139c360 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f57feffd640 1 -- 172.21.15.137:0/2894836505 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0037070 con 0x7f5800160640 2024-04-26T22:06:07.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f57feffd640 1 -- 172.21.15.137:0/2894836505 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f0032440 con 0x7f5800160640 2024-04-26T22:06:07.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f57feffd640 1 -- 172.21.15.137:0/2894836505 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0032810 con 0x7f5800160640 2024-04-26T22:06:07.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f5806367640 1 -- 172.21.15.137:0/2894836505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800160640 msgr2=0x7f58001636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f5806367640 1 --2- 172.21.15.137:0/2894836505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800160640 0x7f58001636a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f57f0009870 tx=0x7f57f002a210 comp rx=0 tx=0).stop 2024-04-26T22:06:07.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f5806367640 1 -- 172.21.15.137:0/2894836505 shutdown_connections 2024-04-26T22:06:07.309 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f5806367640 1 --2- 172.21.15.137:0/2894836505 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800160640 0x7f58001636a0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f5806367640 1 -- 172.21.15.137:0/2894836505 >> 172.21.15.137:0/2894836505 conn(0x7f58000ce8b0 msgr2=0x7f58000cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:07.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f5806367640 1 -- 172.21.15.137:0/2894836505 shutdown_connections 2024-04-26T22:06:07.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.308+0000 7f5806367640 1 -- 172.21.15.137:0/2894836505 wait complete. 2024-04-26T22:06:07.310 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.310+0000 7f5806367640 1 Processor -- start 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.310+0000 7f5806367640 1 -- start start 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.310+0000 7f5806367640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800148a30 0x7f580013f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.310+0000 7f5806367640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5800160640 0x7f58000ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.310+0000 7f5806367640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5800163be0 0x7f58001447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.310+0000 7f5806367640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5800148e10 con 0x7f5800148a30 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.310+0000 7f5806367640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5800163180 con 0x7f5800163be0 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.310+0000 7f5806367640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5800148f90 con 0x7f5800160640 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800148a30 0x7f580013f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800148a30 0x7f580013f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59336/0 (socket says 172.21.15.137:59336) 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fffff640 1 -- 172.21.15.137:0/3759836645 learned_addr learned my addr 172.21.15.137:0/3759836645 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fffff640 1 -- 172.21.15.137:0/3759836645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5800160640 msgr2=0x7f58000ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fffff640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5800160640 0x7f58000ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fffff640 1 -- 172.21.15.137:0/3759836645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5800163be0 msgr2=0x7f58001447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fffff640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5800163be0 0x7f58001447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fffff640 1 -- 172.21.15.137:0/3759836645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58000b4ff0 con 0x7f5800148a30 2024-04-26T22:06:07.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fffff640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800148a30 0x7f580013f9a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f57f400c410 tx=0x7f57f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fcff9640 1 -- 172.21.15.137:0/3759836645 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4017070 con 0x7f5800148a30 2024-04-26T22:06:07.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fcff9640 1 -- 172.21.15.137:0/3759836645 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f40035f0 con 0x7f5800148a30 2024-04-26T22:06:07.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f57fcff9640 1 -- 172.21.15.137:0/3759836645 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4003a20 con 0x7f5800148a30 2024-04-26T22:06:07.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58000b52d0 con 0x7f5800148a30 2024-04-26T22:06:07.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.311+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58000b5890 con 0x7f5800148a30 2024-04-26T22:06:07.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.312+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580006a290 con 0x7f5800148a30 2024-04-26T22:06:07.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.313+0000 7f57fcff9640 1 -- 172.21.15.137:0/3759836645 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f57f401a070 con 0x7f5800148a30 2024-04-26T22:06:07.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.313+0000 7f57fcff9640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f57ec06c8f0 0x7f57ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:07.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.313+0000 7f57ff7fe640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f57ec06c8f0 0x7f57ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:07.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.313+0000 7f57fcff9640 1 -- 172.21.15.137:0/3759836645 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f57f408b030 con 0x7f5800148a30 2024-04-26T22:06:07.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.314+0000 7f57ff7fe640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f57ec06c8f0 0x7f57ec06edb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f57f0034000 tx=0x7f57f002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:07.317 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.318+0000 7f57fcff9640 1 -- 172.21.15.137:0/3759836645 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f57f4059460 con 0x7f5800148a30 2024-04-26T22:06:07.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.528+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f58000b3ab0 con 0x7f5800148a30 2024-04-26T22:06:07.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.528+0000 7f57fcff9640 1 -- 172.21.15.137:0/3759836645 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7f57f4058d60 con 0x7f5800148a30 2024-04-26T22:06:07.528 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:06:07.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f57ec06c8f0 msgr2=0x7f57ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f57ec06c8f0 0x7f57ec06edb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f57f0034000 tx=0x7f57f002c000 comp rx=0 tx=0).stop 2024-04-26T22:06:07.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800148a30 msgr2=0x7f580013f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:07.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800148a30 0x7f580013f9a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f57f400c410 tx=0x7f57f400c8d0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 shutdown_connections 2024-04-26T22:06:07.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f57ec06c8f0 0x7f57ec06edb0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5800163be0 0x7f58001447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5800160640 0x7f58000ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 --2- 172.21.15.137:0/3759836645 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5800148a30 0x7f580013f9a0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:07.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 >> 172.21.15.137:0/3759836645 conn(0x7f58000ce8b0 msgr2=0x7f5800073ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:07.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 shutdown_connections 2024-04-26T22:06:07.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07.530+0000 7f5806367640 1 -- 172.21.15.137:0/3759836645 wait complete. 2024-04-26T22:06:07.541 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:06:07.541 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:06:07.541 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:06:07.541 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:06:07.542 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:07.542 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:06:07.542 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:06:07.542 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:06:07.542 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:06:07.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:07.542 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:06:07.557 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:06:07.557 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:06:07.557 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:06:07.557 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:07.557 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:06:07.558 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42339sec preferred_lft 42339sec 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:06:07.559 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:06:07.560 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:07.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:07.560 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:06:07.619 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:06:07.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:07.621 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:06:07.677 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:06:07.677 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:06:07.677 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:06:07.677 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:06:07.678 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:06:07.678 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:06:07.678 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:06:07.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:06:07.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:06:07.678 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:06:07.678 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:06:07.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:06:07.794 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:06:07.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:07.801 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:06:07.815 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:06:07.815 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:06:07.815 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:06:07.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:07.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:06:07.870 INFO:tasks.ceph.mds.b.smithi170.stderr:2024-04-26T22:06:07.871+0000 7f4af376d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:06:07.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:06:07.879 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:07.934 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:06:07.934 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:06:07.935 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:07.989 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:06:07.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:07.989 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:06:08.071 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:06:08.071 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:06:08.079 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:06:08.079 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:06:08.079 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:06:08.079 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:06:08.079 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:06:08.079 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:06:08.079 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:06:08.080 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:06:08.080 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:06:08.080 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:06:08.081 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:06:08.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:08.081 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:08.145 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:06:08.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:06:08.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:06:08.246 INFO:teuthology.orchestra.run.smithi137.stdout:client6329 2024-04-26T22:06:08.247 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:08.247 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:08.261 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:08.262 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:08.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:08.317 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-26T22:06:08.413 INFO:teuthology.orchestra.run.smithi137.stderr:6+0 records in 2024-04-26T22:06:08.413 INFO:teuthology.orchestra.run.smithi137.stderr:6+0 records out 2024-04-26T22:06:08.413 INFO:teuthology.orchestra.run.smithi137.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0366887 s, 171 MB/s 2024-04-26T22:06:08.415 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:08.415 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:08.430 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:08.430 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:08.486 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:06:08.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.623+0000 7fa2285f7640 1 Processor -- start 2024-04-26T22:06:08.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.623+0000 7fa2285f7640 1 -- start start 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa2285f7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b61a0 0x7fa220160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa2285f7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa2200b3de0 0x7fa2200720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa2285f7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2200b4530 con 0x7fa220145980 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa2285f7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa2200b5140 con 0x7fa2200b3de0 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa2285f7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa2200b4810 con 0x7fa2200b61a0 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa226b94640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa2200b3de0 0x7fa2200720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa225b92640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b61a0 0x7fa220160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa225b92640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b61a0 0x7fa220160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:55652/0 (socket says 172.21.15.137:55652) 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa225b92640 1 -- 172.21.15.137:0/2690434988 learned_addr learned my addr 172.21.15.137:0/2690434988 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:08.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa226393640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa220145980 0x7fa2200b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:52162/0 (socket says 172.21.15.137:52162) 2024-04-26T22:06:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa225391640 1 -- 172.21.15.137:0/2690434988 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716178715 0 0) 0x7fa2200b4530 con 0x7fa220145980 2024-04-26T22:06:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.624+0000 7fa225391640 1 -- 172.21.15.137:0/2690434988 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa20c003520 con 0x7fa220145980 2024-04-26T22:06:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.625+0000 7fa225b92640 1 -- 172.21.15.137:0/2690434988 >> v2:172.21.15.170:3300/0 conn(0x7fa2200b3de0 msgr2=0x7fa2200720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.625+0000 7fa225b92640 1 --2- 172.21.15.137:0/2690434988 >> v2:172.21.15.170:3300/0 conn(0x7fa2200b3de0 0x7fa2200720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.625+0000 7fa225b92640 1 -- 172.21.15.137:0/2690434988 >> v1:172.21.15.170:6789/0 conn(0x7fa220145980 legacy=0x7fa2200b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.625+0000 7fa225b92640 1 -- 172.21.15.137:0/2690434988 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2200b4af0 con 0x7fa2200b61a0 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.625+0000 7fa226b94640 1 --2- 172.21.15.137:0/2690434988 >> v2:172.21.15.170:3300/0 conn(0x7fa2200b3de0 0x7fa2200720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.625+0000 7fa225b92640 1 --2- 172.21.15.137:0/2690434988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b61a0 0x7fa220160630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa210009870 tx=0x7fa21002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d05114bfb5116406 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.625+0000 7fa225391640 1 -- 172.21.15.137:0/2690434988 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210037070 con 0x7fa2200b61a0 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.625+0000 7fa225391640 1 -- 172.21.15.137:0/2690434988 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa210032440 con 0x7fa2200b61a0 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.625+0000 7fa225391640 1 -- 172.21.15.137:0/2690434988 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2100327f0 con 0x7fa2200b61a0 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.626+0000 7fa2285f7640 1 -- 172.21.15.137:0/2690434988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b61a0 msgr2=0x7fa220160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.626+0000 7fa2285f7640 1 --2- 172.21.15.137:0/2690434988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b61a0 0x7fa220160630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa210009870 tx=0x7fa21002a1c0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.626+0000 7fa2285f7640 1 -- 172.21.15.137:0/2690434988 shutdown_connections 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.626+0000 7fa2285f7640 1 --2- 172.21.15.137:0/2690434988 >> v2:172.21.15.170:3300/0 conn(0x7fa2200b3de0 0x7fa2200720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.626+0000 7fa2285f7640 1 --2- 172.21.15.137:0/2690434988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b61a0 0x7fa220160630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.626+0000 7fa2285f7640 1 -- 172.21.15.137:0/2690434988 >> 172.21.15.137:0/2690434988 conn(0x7fa2200d0d30 msgr2=0x7fa2200d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.626+0000 7fa2285f7640 1 -- 172.21.15.137:0/2690434988 shutdown_connections 2024-04-26T22:06:08.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.626+0000 7fa2285f7640 1 -- 172.21.15.137:0/2690434988 wait complete. 2024-04-26T22:06:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.627+0000 7fa2285f7640 1 Processor -- start 2024-04-26T22:06:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.627+0000 7fa2285f7640 1 -- start start 2024-04-26T22:06:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa2285f7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b3de0 0x7fa220140ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa2285f7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2200b61a0 0x7fa22015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa2285f7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa220145980 0x7fa2200b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa2285f7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa220072610 con 0x7fa2200b61a0 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa2285f7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa2200b4240 con 0x7fa220145980 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa2285f7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa220072790 con 0x7fa2200b3de0 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa225b92640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2200b61a0 0x7fa22015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa225b92640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2200b61a0 0x7fa22015ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59340/0 (socket says 172.21.15.137:59340) 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa225b92640 1 -- 172.21.15.137:0/3620044096 learned_addr learned my addr 172.21.15.137:0/3620044096 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa226b94640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa220145980 0x7fa2200b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa226393640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b3de0 0x7fa220140ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa225b92640 1 -- 172.21.15.137:0/3620044096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b3de0 msgr2=0x7fa220140ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa225b92640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b3de0 0x7fa220140ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa225b92640 1 -- 172.21.15.137:0/3620044096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa220145980 msgr2=0x7fa2200b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa225b92640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa220145980 0x7fa2200b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa225b92640 1 -- 172.21.15.137:0/3620044096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa220141530 con 0x7fa2200b61a0 2024-04-26T22:06:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.628+0000 7fa225b92640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2200b61a0 0x7fa22015ae90 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fa210000c00 tx=0x7fa2100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.629+0000 7fa216ffd640 1 -- 172.21.15.137:0/3620044096 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210041020 con 0x7fa2200b61a0 2024-04-26T22:06:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.629+0000 7fa216ffd640 1 -- 172.21.15.137:0/3620044096 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21003d620 con 0x7fa2200b61a0 2024-04-26T22:06:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.629+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2200b2490 con 0x7fa2200b61a0 2024-04-26T22:06:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.629+0000 7fa216ffd640 1 -- 172.21.15.137:0/3620044096 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210037040 con 0x7fa2200b61a0 2024-04-26T22:06:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.629+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2200b2a50 con 0x7fa2200b61a0 2024-04-26T22:06:08.631 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.629+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa22006a290 con 0x7fa2200b61a0 2024-04-26T22:06:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.630+0000 7fa216ffd640 1 -- 172.21.15.137:0/3620044096 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa210044020 con 0x7fa2200b61a0 2024-04-26T22:06:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.630+0000 7fa216ffd640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa20406c8f0 0x7fa20406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.631+0000 7fa216ffd640 1 -- 172.21.15.137:0/3620044096 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fa2100abce0 con 0x7fa2200b61a0 2024-04-26T22:06:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.631+0000 7fa226393640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa20406c8f0 0x7fa20406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.631+0000 7fa226393640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa20406c8f0 0x7fa20406edb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa2200cd5a0 tx=0x7fa21c007cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:08.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.635+0000 7fa216ffd640 1 -- 172.21.15.137:0/3620044096 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa21004b070 con 0x7fa2200b61a0 2024-04-26T22:06:08.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.812+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa22006d2b0 con 0x7fa2200b61a0 2024-04-26T22:06:08.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.813+0000 7fa216ffd640 1 -- 172.21.15.137:0/3620044096 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16631 (secure 0 0 0) 0x7fa21007a1a0 con 0x7fa2200b61a0 2024-04-26T22:06:08.813 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:08.813 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":103,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:06:03.589665+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:06:00.152074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-26T22:06:00.894660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:06:08.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa20406c8f0 msgr2=0x7fa20406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa20406c8f0 0x7fa20406edb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa2200cd5a0 tx=0x7fa21c007cf0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2200b61a0 msgr2=0x7fa22015ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2200b61a0 0x7fa22015ae90 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fa210000c00 tx=0x7fa2100046c0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 shutdown_connections 2024-04-26T22:06:08.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa20406c8f0 0x7fa20406edb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa2200b61a0 0x7fa22015ae90 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa220145980 0x7fa2200b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 --2- 172.21.15.137:0/3620044096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa2200b3de0 0x7fa220140ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 >> 172.21.15.137:0/3620044096 conn(0x7fa2200d0d30 msgr2=0x7fa22015e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:08.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 shutdown_connections 2024-04-26T22:06:08.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.815+0000 7fa2285f7640 1 -- 172.21.15.137:0/3620044096 wait complete. 2024-04-26T22:06:08.826 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:06:00.152074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:06:00.894660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:06:08.826 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:06:08.925 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.925+0000 7ff68f437640 1 Processor -- start 2024-04-26T22:06:08.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.926+0000 7ff68f437640 1 -- start start 2024-04-26T22:06:08.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.926+0000 7ff68f437640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6880d0300 0x7ff6880b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.926+0000 7ff68f437640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6880b46a0 con 0x7ff6880b3e50 2024-04-26T22:06:08.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.926+0000 7ff68f437640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6880b5db0 con 0x7ff68806f340 2024-04-26T22:06:08.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.926+0000 7ff68f437640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff6880b6090 con 0x7ff6880d0300 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff68d9d4640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff6880b3e50 0x7ff6880720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38142/0 (socket says 172.21.15.137:38142) 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff68d9d4640 1 -- 172.21.15.137:0/1686286432 learned_addr learned my addr 172.21.15.137:0/1686286432 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 815324235 0 0) 0x7ff6880b46a0 con 0x7ff6880b3e50 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff674003520 con 0x7ff6880b3e50 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff68c9d2640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6880d0300 0x7ff6880b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3316217870 0 0) 0x7ff674003520 con 0x7ff6880b3e50 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6880d0300 msgr2=0x7ff6880b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6880d0300 0x7ff6880b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 >> v1:172.21.15.170:6789/0 conn(0x7ff68806f340 legacy=0x7ff68806f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6880b6370 con 0x7ff6880b3e50 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7ff680001670 con 0x7ff6880b3e50 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 >> v1:172.21.15.137:6789/0 conn(0x7ff6880b3e50 legacy=0x7ff6880720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.930 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740039e0 0x7ff674003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff674004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6880d0300 0x7ff674005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6880b6090 con 0x7ff674004800 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff67400bb80 con 0x7ff6740039e0 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff67400bd80 con 0x7ff6880d0300 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff68c9d2640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff674004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff68d1d3640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740039e0 0x7ff674003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.927+0000 7ff68d9d4640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6880d0300 0x7ff674005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.928+0000 7ff68c9d2640 1 -- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6880d0300 msgr2=0x7ff674005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.928+0000 7ff68c9d2640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6880d0300 0x7ff674005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.928+0000 7ff68c9d2640 1 -- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740039e0 msgr2=0x7ff674003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.928+0000 7ff68c9d2640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6740039e0 0x7ff674003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.928+0000 7ff68c9d2640 1 -- 172.21.15.137:0/1686286432 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff674003520 con 0x7ff674004800 2024-04-26T22:06:08.931 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.928+0000 7ff68c9d2640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff674004c80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff678009ac0 tx=0x7ff674005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cdf80e9579d71a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.928+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678036070 con 0x7ff674004800 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.928+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff678031400 con 0x7ff674004800 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.928+0000 7ff67ffff640 1 -- 172.21.15.137:0/1686286432 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff678009690 con 0x7ff674004800 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.929+0000 7ff68f437640 1 -- 172.21.15.137:0/1686286432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 msgr2=0x7ff674004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.929+0000 7ff68f437640 1 --2- 172.21.15.137:0/1686286432 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff674004c80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff678009ac0 tx=0x7ff674005830 comp rx=0 tx=0).stop 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.929+0000 7ff68d9d4640 1 -- 172.21.15.137:0/1686286432 reap_dead start 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.929+0000 7ff68f437640 1 -- 172.21.15.137:0/1686286432 shutdown_connections 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.929+0000 7ff68f437640 1 -- 172.21.15.137:0/1686286432 >> 172.21.15.137:0/1686286432 conn(0x7ff6880cd8a0 msgr2=0x7ff6880cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.929+0000 7ff68f437640 1 -- 172.21.15.137:0/1686286432 shutdown_connections 2024-04-26T22:06:08.932 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.929+0000 7ff68f437640 1 -- 172.21.15.137:0/1686286432 wait complete. 2024-04-26T22:06:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.930+0000 7ff68f437640 1 Processor -- start 2024-04-26T22:06:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.930+0000 7ff68f437640 1 -- start start 2024-04-26T22:06:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68f437640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff68815eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68f437640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff68815c6e0 0x7ff6881371c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68f437640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff68815cb40 0x7ff688137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68f437640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6880b4460 con 0x7ff674004800 2024-04-26T22:06:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68f437640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff6880b42e0 con 0x7ff68815cb40 2024-04-26T22:06:08.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68f437640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff688142a30 con 0x7ff68815c6e0 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d1d3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff68815eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d1d3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff68815eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59354/0 (socket says 172.21.15.137:59354) 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d1d3640 1 -- 172.21.15.137:0/3071745922 learned_addr learned my addr 172.21.15.137:0/3071745922 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d9d4640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff68815cb40 0x7ff688137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d1d3640 1 -- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff68815c6e0 msgr2=0x7ff6881371c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68c9d2640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff68815c6e0 0x7ff6881371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d1d3640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff68815c6e0 0x7ff6881371c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d1d3640 1 -- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff68815cb40 msgr2=0x7ff688137700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d1d3640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff68815cb40 0x7ff688137700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d1d3640 1 -- 172.21.15.137:0/3071745922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68815d0c0 con 0x7ff674004800 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d9d4640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff68815cb40 0x7ff688137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68c9d2640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff68815c6e0 0x7ff6881371c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:08.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.931+0000 7ff68d1d3640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff68815eef0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff68400f990 tx=0x7ff68400fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.932+0000 7ff67dffb640 1 -- 172.21.15.137:0/3071745922 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff684003b80 con 0x7ff674004800 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.932+0000 7ff67dffb640 1 -- 172.21.15.137:0/3071745922 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff684018070 con 0x7ff674004800 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.932+0000 7ff67dffb640 1 -- 172.21.15.137:0/3071745922 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68400d770 con 0x7ff674004800 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.932+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff68815d3a0 con 0x7ff674004800 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.932+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff68815d960 con 0x7ff674004800 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.933+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff68806a290 con 0x7ff674004800 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.933+0000 7ff67dffb640 1 -- 172.21.15.137:0/3071745922 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff68400d910 con 0x7ff674004800 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.933+0000 7ff67dffb640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff66c06c8f0 0x7ff66c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.934+0000 7ff67dffb640 1 -- 172.21.15.137:0/3071745922 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7ff68408bca0 con 0x7ff674004800 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.934+0000 7ff68c9d2640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff66c06c8f0 0x7ff66c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:08.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.934+0000 7ff68c9d2640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff66c06c8f0 0x7ff66c06edb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff678033000 tx=0x7ff678008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:08.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:08.938+0000 7ff67dffb640 1 -- 172.21.15.137:0/3071745922 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff68401a310 con 0x7ff674004800 2024-04-26T22:06:09.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.113+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff68806f7c0 con 0x7ff674004800 2024-04-26T22:06:09.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.114+0000 7ff67dffb640 1 -- 172.21.15.137:0/3071745922 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7ff68405a0d0 con 0x7ff674004800 2024-04-26T22:06:09.114 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:06:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff66c06c8f0 msgr2=0x7ff66c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff66c06c8f0 0x7ff66c06edb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff678033000 tx=0x7ff678008030 comp rx=0 tx=0).stop 2024-04-26T22:06:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 msgr2=0x7ff68815eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff68815eef0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff68400f990 tx=0x7ff68400fe50 comp rx=0 tx=0).stop 2024-04-26T22:06:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 shutdown_connections 2024-04-26T22:06:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff66c06c8f0 0x7ff66c06edb0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff68815cb40 0x7ff688137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff68815c6e0 0x7ff6881371c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 --2- 172.21.15.137:0/3071745922 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff674004800 0x7ff68815eef0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 >> 172.21.15.137:0/3071745922 conn(0x7ff6880cd8a0 msgr2=0x7ff688143390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:09.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 shutdown_connections 2024-04-26T22:06:09.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.116+0000 7ff68f437640 1 -- 172.21.15.137:0/3071745922 wait complete. 2024-04-26T22:06:09.127 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:06:09.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.226+0000 7f6349772640 1 Processor -- start 2024-04-26T22:06:09.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.226+0000 7f6349772640 1 -- start start 2024-04-26T22:06:09.227 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f6349772640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f634415f680 0x7f63440d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f6349772640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6344163aa0 0x7f63440b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f6349772640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63440d3f50 con 0x7f63440b60b0 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f6349772640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f634415fa60 con 0x7f6344163aa0 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f6349772640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f63440b5090 con 0x7f634415f680 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f63427fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6344163aa0 0x7f63440b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f6342ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f634415f680 0x7f63440d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f63427fc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6344163aa0 0x7f63440b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34342/0 (socket says 172.21.15.137:34342) 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f6342ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f634415f680 0x7f63440d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:55694/0 (socket says 172.21.15.137:55694) 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f63427fc640 1 -- 172.21.15.137:0/3661689812 learned_addr learned my addr 172.21.15.137:0/3661689812 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.227+0000 7f63437fe640 1 --1- 172.21.15.137:0/3661689812 >> v1:172.21.15.170:6789/0 conn(0x7f63440b60b0 0x7f63440d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:52188/0 (socket says 172.21.15.137:52188) 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.228+0000 7f63427fc640 1 -- 172.21.15.137:0/3661689812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f634415f680 msgr2=0x7f63440d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.228+0000 7f63427fc640 1 --2- 172.21.15.137:0/3661689812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f634415f680 0x7f63440d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.228+0000 7f63427fc640 1 -- 172.21.15.137:0/3661689812 >> v1:172.21.15.170:6789/0 conn(0x7f63440b60b0 legacy=0x7f63440d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.228+0000 7f6341ffb640 1 -- 172.21.15.137:0/3661689812 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445802530 0 0) 0x7f63440d3f50 con 0x7f63440b60b0 2024-04-26T22:06:09.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.228+0000 7f63427fc640 1 -- 172.21.15.137:0/3661689812 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63440b5370 con 0x7f6344163aa0 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f63427fc640 1 --2- 172.21.15.137:0/3661689812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6344163aa0 0x7f63440b5b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6338009870 tx=0x7f633802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be31748748efd5f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6341ffb640 1 -- 172.21.15.137:0/3661689812 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338037070 con 0x7f6344163aa0 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6341ffb640 1 -- 172.21.15.137:0/3661689812 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6338032440 con 0x7f6344163aa0 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6341ffb640 1 -- 172.21.15.137:0/3661689812 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338032810 con 0x7f6344163aa0 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6349772640 1 -- 172.21.15.137:0/3661689812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6344163aa0 msgr2=0x7f63440b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6349772640 1 --2- 172.21.15.137:0/3661689812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6344163aa0 0x7f63440b5b70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6338009870 tx=0x7f633802a270 comp rx=0 tx=0).stop 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6349772640 1 -- 172.21.15.137:0/3661689812 shutdown_connections 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6349772640 1 --2- 172.21.15.137:0/3661689812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6344163aa0 0x7f63440b5b70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6349772640 1 --2- 172.21.15.137:0/3661689812 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f634415f680 0x7f63440d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6349772640 1 -- 172.21.15.137:0/3661689812 >> 172.21.15.137:0/3661689812 conn(0x7f634408eca0 msgr2=0x7f634409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6349772640 1 -- 172.21.15.137:0/3661689812 shutdown_connections 2024-04-26T22:06:09.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.229+0000 7f6349772640 1 -- 172.21.15.137:0/3661689812 wait complete. 2024-04-26T22:06:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f6349772640 1 Processor -- start 2024-04-26T22:06:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f6349772640 1 -- start start 2024-04-26T22:06:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f6349772640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63440b60b0 0x7f63440d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f6349772640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f634415f680 0x7f63441605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f6349772640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6344163aa0 0x7f6344161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f6349772640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f63440d57b0 con 0x7f634415f680 2024-04-26T22:06:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f6349772640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f63440d5630 con 0x7f63440b60b0 2024-04-26T22:06:09.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f6349772640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f63440d5930 con 0x7f6344163aa0 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f63427fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f634415f680 0x7f63441605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f63427fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f634415f680 0x7f63441605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59358/0 (socket says 172.21.15.137:59358) 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.231+0000 7f63427fc640 1 -- 172.21.15.137:0/3586629745 learned_addr learned my addr 172.21.15.137:0/3586629745 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f6342ffd640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63440b60b0 0x7f63440d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f63437fe640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6344163aa0 0x7f6344161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f63427fc640 1 -- 172.21.15.137:0/3586629745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6344163aa0 msgr2=0x7f6344161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f63427fc640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6344163aa0 0x7f6344161bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f63427fc640 1 -- 172.21.15.137:0/3586629745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63440b60b0 msgr2=0x7f63440d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f63427fc640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63440b60b0 0x7f63440d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f63427fc640 1 -- 172.21.15.137:0/3586629745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63440cfee0 con 0x7f634415f680 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f63427fc640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f634415f680 0x7f63441605f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f6338035040 tx=0x7f63380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f632b7fe640 1 -- 172.21.15.137:0/3586629745 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338037040 con 0x7f634415f680 2024-04-26T22:06:09.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f632b7fe640 1 -- 172.21.15.137:0/3586629745 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6338004030 con 0x7f634415f680 2024-04-26T22:06:09.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63440d01c0 con 0x7f634415f680 2024-04-26T22:06:09.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f632b7fe640 1 -- 172.21.15.137:0/3586629745 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338004420 con 0x7f634415f680 2024-04-26T22:06:09.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.232+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6344160b30 con 0x7f634415f680 2024-04-26T22:06:09.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.233+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634408e990 con 0x7f634415f680 2024-04-26T22:06:09.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.233+0000 7f632b7fe640 1 -- 172.21.15.137:0/3586629745 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f633803a070 con 0x7f634415f680 2024-04-26T22:06:09.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.234+0000 7f632b7fe640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f633006c8f0 0x7f633006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.234+0000 7f6342ffd640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f633006c8f0 0x7f633006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.234+0000 7f632b7fe640 1 -- 172.21.15.137:0/3586629745 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f63380abff0 con 0x7f634415f680 2024-04-26T22:06:09.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.234+0000 7f6342ffd640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f633006c8f0 0x7f633006edb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f63440cf340 tx=0x7f6334009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:09.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.238+0000 7f632b7fe640 1 -- 172.21.15.137:0/3586629745 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f634408e990 con 0x7f634415f680 2024-04-26T22:06:09.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.411+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f634406a290 con 0x7f634415f680 2024-04-26T22:06:09.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.411+0000 7f632b7fe640 1 -- 172.21.15.137:0/3586629745 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7f6338041020 con 0x7f634415f680 2024-04-26T22:06:09.411 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:06:09.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f633006c8f0 msgr2=0x7f633006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f633006c8f0 0x7f633006edb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f63440cf340 tx=0x7f6334009190 comp rx=0 tx=0).stop 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f634415f680 msgr2=0x7f63441605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f634415f680 0x7f63441605f0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f6338035040 tx=0x7f63380046c0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 shutdown_connections 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f633006c8f0 0x7f633006edb0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f634415f680 0x7f63441605f0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6344163aa0 0x7f6344161bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 --2- 172.21.15.137:0/3586629745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f63440b60b0 0x7f63440d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 >> 172.21.15.137:0/3586629745 conn(0x7f634408eca0 msgr2=0x7f634415e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 shutdown_connections 2024-04-26T22:06:09.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.413+0000 7f6349772640 1 -- 172.21.15.137:0/3586629745 wait complete. 2024-04-26T22:06:09.424 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:06:09.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.524+0000 7fc8527a4640 1 Processor -- start 2024-04-26T22:06:09.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.524+0000 7fc8527a4640 1 -- start start 2024-04-26T22:06:09.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc8527a4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c143840 0x7fc84c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc8527a4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc84c0b4520 0x7fc84c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc8527a4640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc84c15dca0 con 0x7fc84c0b53f0 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc8527a4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc84c143c20 con 0x7fc84c0b4520 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc8527a4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc84c15df80 con 0x7fc84c143840 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc850d41640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc84c0b53f0 0x7fc84c160e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38150/0 (socket says 172.21.15.137:38150) 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc850d41640 1 -- 172.21.15.137:0/1530021805 learned_addr learned my addr 172.21.15.137:0/1530021805 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882253061 0 0) 0x7fc84c15dca0 con 0x7fc84c0b53f0 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84b7fe640 1 --2- 172.21.15.137:0/1530021805 >> v2:172.21.15.170:3300/0 conn(0x7fc84c0b4520 0x7fc84c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84bfff640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c143840 0x7fc84c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc834003520 con 0x7fc84c0b53f0 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3803947483 0 0) 0x7fc834003520 con 0x7fc84c0b53f0 2024-04-26T22:06:09.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c143840 msgr2=0x7fc84c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c143840 0x7fc84c0b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 >> v2:172.21.15.170:3300/0 conn(0x7fc84c0b4520 msgr2=0x7fc84c0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 --2- 172.21.15.137:0/1530021805 >> v2:172.21.15.170:3300/0 conn(0x7fc84c0b4520 0x7fc84c0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c15e260 con 0x7fc84c0b53f0 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fc8440019f0 con 0x7fc84c0b53f0 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84b7fe640 1 --2- 172.21.15.137:0/1530021805 >> v2:172.21.15.170:3300/0 conn(0x7fc84c0b4520 0x7fc84c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 >> v1:172.21.15.137:6789/0 conn(0x7fc84c0b53f0 legacy=0x7fc84c160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8340039b0 0x7fc834003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.525+0000 7fc84affd640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c143840 0x7fc834004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc84affd640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc834004d40 0x7fc8340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c143c20 con 0x7fc834004d40 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c15df80 con 0x7fc8340039b0 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc83400b9c0 con 0x7fc84c143840 2024-04-26T22:06:09.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc850d41640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc834004d40 0x7fc8340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc84bfff640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8340039b0 0x7fc834003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc84b7fe640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c143840 0x7fc834004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc850d41640 1 -- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c143840 msgr2=0x7fc834004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc850d41640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c143840 0x7fc834004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc850d41640 1 -- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8340039b0 msgr2=0x7fc834003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc850d41640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8340039b0 0x7fc834003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.526+0000 7fc850d41640 1 -- 172.21.15.137:0/1530021805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc834003520 con 0x7fc834004d40 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc850d41640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc834004d40 0x7fc8340051c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc84400a8d0 tx=0x7fc834005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3308e9024ffaa9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84400a4c0 con 0x7fc834004d40 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84402f070 con 0x7fc834004d40 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc84affd640 1 -- 172.21.15.137:0/1530021805 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84402bd00 con 0x7fc834004d40 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc8527a4640 1 -- 172.21.15.137:0/1530021805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc834004d40 msgr2=0x7fc8340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc8527a4640 1 --2- 172.21.15.137:0/1530021805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc834004d40 0x7fc8340051c0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc84400a8d0 tx=0x7fc834005830 comp rx=0 tx=0).stop 2024-04-26T22:06:09.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc850d41640 1 -- 172.21.15.137:0/1530021805 reap_dead start 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc8527a4640 1 -- 172.21.15.137:0/1530021805 shutdown_connections 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc8527a4640 1 -- 172.21.15.137:0/1530021805 >> 172.21.15.137:0/1530021805 conn(0x7fc84c0cd8a0 msgr2=0x7fc84c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc8527a4640 1 -- 172.21.15.137:0/1530021805 shutdown_connections 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.527+0000 7fc8527a4640 1 -- 172.21.15.137:0/1530021805 wait complete. 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.528+0000 7fc8527a4640 1 Processor -- start 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc8527a4640 1 -- start start 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc8527a4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c1f50d0 0x7fc84c0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc8527a4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc84c0af800 0x7fc84c1f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc8527a4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc84c1f59f0 0x7fc84c072ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc8527a4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c15da40 con 0x7fc84c1f59f0 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc8527a4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c15d8c0 con 0x7fc84c0af800 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc8527a4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc84c0d0000 con 0x7fc84c1f50d0 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc850d41640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc84c1f59f0 0x7fc84c072ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc850d41640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc84c1f59f0 0x7fc84c072ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59364/0 (socket says 172.21.15.137:59364) 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.529+0000 7fc850d41640 1 -- 172.21.15.137:0/808308728 learned_addr learned my addr 172.21.15.137:0/808308728 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc84bfff640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c1f50d0 0x7fc84c0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc84b7fe640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc84c0af800 0x7fc84c1f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc850d41640 1 -- 172.21.15.137:0/808308728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c1f50d0 msgr2=0x7fc84c0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc850d41640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c1f50d0 0x7fc84c0af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc850d41640 1 -- 172.21.15.137:0/808308728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc84c0af800 msgr2=0x7fc84c1f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc850d41640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc84c0af800 0x7fc84c1f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc850d41640 1 -- 172.21.15.137:0/808308728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c0b0220 con 0x7fc84c1f59f0 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc850d41640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc84c1f59f0 0x7fc84c072ce0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fc84400a8d0 tx=0x7fc844001e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc848ff9640 1 -- 172.21.15.137:0/808308728 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84400a4c0 con 0x7fc84c1f59f0 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc848ff9640 1 -- 172.21.15.137:0/808308728 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc844034470 con 0x7fc84c1f59f0 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84c0afc80 con 0x7fc84c1f59f0 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc848ff9640 1 -- 172.21.15.137:0/808308728 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844002010 con 0x7fc84c1f59f0 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.530+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84c072200 con 0x7fc84c1f59f0 2024-04-26T22:06:09.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.531+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84c06a290 con 0x7fc84c1f59f0 2024-04-26T22:06:09.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.532+0000 7fc848ff9640 1 -- 172.21.15.137:0/808308728 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc844034840 con 0x7fc84c1f59f0 2024-04-26T22:06:09.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.532+0000 7fc848ff9640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc83806c8f0 0x7fc83806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.532+0000 7fc84bfff640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc83806c8f0 0x7fc83806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.532+0000 7fc848ff9640 1 -- 172.21.15.137:0/808308728 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fc8440abaf0 con 0x7fc84c1f59f0 2024-04-26T22:06:09.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.533+0000 7fc84bfff640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc83806c8f0 0x7fc83806edb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009a80 tx=0x7fc83c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:09.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.537+0000 7fc848ff9640 1 -- 172.21.15.137:0/808308728 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc844079fb0 con 0x7fc84c1f59f0 2024-04-26T22:06:09.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.716+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc84c06a290 con 0x7fc84c1f59f0 2024-04-26T22:06:09.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.716+0000 7fc848ff9640 1 -- 172.21.15.137:0/808308728 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7fc8440798b0 con 0x7fc84c1f59f0 2024-04-26T22:06:09.716 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc83806c8f0 msgr2=0x7fc83806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc83806c8f0 0x7fc83806edb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009a80 tx=0x7fc83c008040 comp rx=0 tx=0).stop 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc84c1f59f0 msgr2=0x7fc84c072ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc84c1f59f0 0x7fc84c072ce0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fc84400a8d0 tx=0x7fc844001e30 comp rx=0 tx=0).stop 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 shutdown_connections 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc83806c8f0 0x7fc83806edb0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc84c1f59f0 0x7fc84c072ce0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc84c0af800 0x7fc84c1f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 --2- 172.21.15.137:0/808308728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc84c1f50d0 0x7fc84c0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 >> 172.21.15.137:0/808308728 conn(0x7fc84c0cd8a0 msgr2=0x7fc84c160c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 shutdown_connections 2024-04-26T22:06:09.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.718+0000 7fc8527a4640 1 -- 172.21.15.137:0/808308728 wait complete. 2024-04-26T22:06:09.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.827+0000 7fe9fef89640 1 Processor -- start 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.827+0000 7fe9fef89640 1 -- start start 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.828+0000 7fe9fef89640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe9f80cf2e0 0x7fe9f806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.828+0000 7fe9fef89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f806e490 0x7fe9f815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.828+0000 7fe9fef89640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f80d1740 con 0x7fe9f80d11b0 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.828+0000 7fe9fef89640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe9f80d1a20 con 0x7fe9f80cf2e0 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.828+0000 7fe9fef89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f80d1d00 con 0x7fe9f806e490 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fd526640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f806e490 0x7fe9f815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fcd25640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe9f80cf2e0 0x7fe9f806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fd526640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f806e490 0x7fe9f815ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:55732/0 (socket says 172.21.15.137:55732) 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9f7fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe9f80d11b0 0x7fe9f806dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:52190/0 (socket says 172.21.15.137:52190) 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fd526640 1 -- 172.21.15.137:0/3360410392 learned_addr learned my addr 172.21.15.137:0/3360410392 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fcd25640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe9f80cf2e0 0x7fe9f806d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34366/0 (socket says 172.21.15.137:34366) 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9f77fe640 1 -- 172.21.15.137:0/3360410392 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147197891 0 0) 0x7fe9f80d1740 con 0x7fe9f80d11b0 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9f77fe640 1 -- 172.21.15.137:0/3360410392 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e4003520 con 0x7fe9f80d11b0 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fd526640 1 -- 172.21.15.137:0/3360410392 >> v2:172.21.15.170:3300/0 conn(0x7fe9f80cf2e0 msgr2=0x7fe9f806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fd526640 1 --2- 172.21.15.137:0/3360410392 >> v2:172.21.15.170:3300/0 conn(0x7fe9f80cf2e0 0x7fe9f806d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fd526640 1 -- 172.21.15.137:0/3360410392 >> v1:172.21.15.170:6789/0 conn(0x7fe9f80d11b0 legacy=0x7fe9f806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fd526640 1 -- 172.21.15.137:0/3360410392 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f80d1fe0 con 0x7fe9f806e490 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.829+0000 7fe9fcd25640 1 --2- 172.21.15.137:0/3360410392 >> v2:172.21.15.170:3300/0 conn(0x7fe9f80cf2e0 0x7fe9f806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9fd526640 1 --2- 172.21.15.137:0/3360410392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f806e490 0x7fe9f815ebe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00098a0 tx=0x7fe9f002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ca51502a1920c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9f77fe640 1 -- 172.21.15.137:0/3360410392 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0037070 con 0x7fe9f806e490 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9f77fe640 1 -- 172.21.15.137:0/3360410392 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f0032440 con 0x7fe9f806e490 2024-04-26T22:06:09.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9f77fe640 1 -- 172.21.15.137:0/3360410392 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00327f0 con 0x7fe9f806e490 2024-04-26T22:06:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9fef89640 1 -- 172.21.15.137:0/3360410392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f806e490 msgr2=0x7fe9f815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9fef89640 1 --2- 172.21.15.137:0/3360410392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f806e490 0x7fe9f815ebe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00098a0 tx=0x7fe9f002a290 comp rx=0 tx=0).stop 2024-04-26T22:06:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9fef89640 1 -- 172.21.15.137:0/3360410392 shutdown_connections 2024-04-26T22:06:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9fef89640 1 --2- 172.21.15.137:0/3360410392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f806e490 0x7fe9f815ebe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9fef89640 1 --2- 172.21.15.137:0/3360410392 >> v2:172.21.15.170:3300/0 conn(0x7fe9f80cf2e0 0x7fe9f806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9fef89640 1 -- 172.21.15.137:0/3360410392 >> 172.21.15.137:0/3360410392 conn(0x7fe9f80b4a60 msgr2=0x7fe9f80b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9fef89640 1 -- 172.21.15.137:0/3360410392 shutdown_connections 2024-04-26T22:06:09.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.830+0000 7fe9fef89640 1 -- 172.21.15.137:0/3360410392 wait complete. 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.832+0000 7fe9fef89640 1 Processor -- start 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.832+0000 7fe9fef89640 1 -- start start 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.832+0000 7fe9fef89640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9f806e490 0x7fe9f80ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.832+0000 7fe9fef89640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f80cf2e0 0x7fe9f8161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.832+0000 7fe9fef89640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9f80d11b0 0x7fe9f80ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.832+0000 7fe9fef89640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f80cf6c0 con 0x7fe9f80d11b0 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.832+0000 7fe9fef89640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f806da10 con 0x7fe9f806e490 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.832+0000 7fe9fef89640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f80cf840 con 0x7fe9f80cf2e0 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fd526640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9f80d11b0 0x7fe9f80ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fd526640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9f80d11b0 0x7fe9f80ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59366/0 (socket says 172.21.15.137:59366) 2024-04-26T22:06:09.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fd526640 1 -- 172.21.15.137:0/4149532452 learned_addr learned my addr 172.21.15.137:0/4149532452 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9f7fff640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f80cf2e0 0x7fe9f8161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fcd25640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9f806e490 0x7fe9f80ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fd526640 1 -- 172.21.15.137:0/4149532452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f80cf2e0 msgr2=0x7fe9f8161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fd526640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f80cf2e0 0x7fe9f8161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fd526640 1 -- 172.21.15.137:0/4149532452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9f806e490 msgr2=0x7fe9f80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fd526640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9f806e490 0x7fe9f80ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fd526640 1 -- 172.21.15.137:0/4149532452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f80cdad0 con 0x7fe9f80d11b0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fd526640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9f80d11b0 0x7fe9f80ca930 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00098a0 tx=0x7fe9f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9f57fa640 1 -- 172.21.15.137:0/4149532452 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0041020 con 0x7fe9f80d11b0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9f57fa640 1 -- 172.21.15.137:0/4149532452 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f003d620 con 0x7fe9f80d11b0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f80cd510 con 0x7fe9f80d11b0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9f57fa640 1 -- 172.21.15.137:0/4149532452 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0037040 con 0x7fe9f80d11b0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.833+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f809ef50 con 0x7fe9f80d11b0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.834+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f806a290 con 0x7fe9f80d11b0 2024-04-26T22:06:09.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.835+0000 7fe9f57fa640 1 -- 172.21.15.137:0/4149532452 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9f0044020 con 0x7fe9f80d11b0 2024-04-26T22:06:09.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.835+0000 7fe9f57fa640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9d806c8f0 0x7fe9d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:09.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.835+0000 7fe9f57fa640 1 -- 172.21.15.137:0/4149532452 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fe9f00ac020 con 0x7fe9f80d11b0 2024-04-26T22:06:09.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.835+0000 7fe9fcd25640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9d806c8f0 0x7fe9d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:09.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.835+0000 7fe9fcd25640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9d806c8f0 0x7fe9d806edb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009560 tx=0x7fe9e0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:09.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:09.839+0000 7fe9f57fa640 1 -- 172.21.15.137:0/4149532452 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe9f004b030 con 0x7fe9f80d11b0 2024-04-26T22:06:10.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.027+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe9f80b8ef0 con 0x7fe9f80d11b0 2024-04-26T22:06:10.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.027+0000 7fe9f57fa640 1 -- 172.21.15.137:0/4149532452 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) ==== 80+0+0 (secure 0 0 0) 0x7fe9f80cdad0 con 0x7fe9f80d11b0 2024-04-26T22:06:10.027 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T22:06:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9d806c8f0 msgr2=0x7fe9d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9d806c8f0 0x7fe9d806edb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009560 tx=0x7fe9e0009190 comp rx=0 tx=0).stop 2024-04-26T22:06:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9f80d11b0 msgr2=0x7fe9f80ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9f80d11b0 0x7fe9f80ca930 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe9f00098a0 tx=0x7fe9f00046c0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 shutdown_connections 2024-04-26T22:06:10.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe9d806c8f0 0x7fe9d806edb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe9f80d11b0 0x7fe9f80ca930 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe9f80cf2e0 0x7fe9f8161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 --2- 172.21.15.137:0/4149532452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9f806e490 0x7fe9f80ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 >> 172.21.15.137:0/4149532452 conn(0x7fe9f80b4a60 msgr2=0x7fe9f8162490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:10.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 shutdown_connections 2024-04-26T22:06:10.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.029+0000 7fe9fef89640 1 -- 172.21.15.137:0/4149532452 wait complete. 2024-04-26T22:06:10.040 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:06:10.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:10.041 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:10.069 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:06:10.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:10.070 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:06:10.126 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:06:10.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.263+0000 7f50ec7af640 1 Processor -- start 2024-04-26T22:06:10.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.263+0000 7f50ec7af640 1 -- start start 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ec7af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e4145980 0x7f50e4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ec7af640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50e40b61a0 0x7f50e40720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ec7af640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e40b4260 con 0x7f50e40b3de0 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ec7af640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f50e40b5140 con 0x7f50e40b61a0 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ec7af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f50e40b4530 con 0x7f50e4145980 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ead4c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f50e40b61a0 0x7f50e40720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50e9d4a640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f50e40b3de0 0x7f50e40b5a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38154/0 (socket says 172.21.15.137:38154) 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50e9d4a640 1 -- 172.21.15.137:0/2418077460 learned_addr learned my addr 172.21.15.137:0/2418077460 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ead4c640 1 --2- 172.21.15.137:0/2418077460 >> v2:172.21.15.137:3300/0 conn(0x7f50e40b61a0 0x7f50e40720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59372/0 (socket says 172.21.15.137:59372) 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ea54b640 1 --2- 172.21.15.137:0/2418077460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e4145980 0x7f50e4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:10.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ead4c640 1 -- 172.21.15.137:0/2418077460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e4145980 msgr2=0x7f50e4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ead4c640 1 --2- 172.21.15.137:0/2418077460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e4145980 0x7f50e4160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ead4c640 1 -- 172.21.15.137:0/2418077460 >> v1:172.21.15.137:6789/0 conn(0x7f50e40b3de0 legacy=0x7f50e40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50e9549640 1 -- 172.21.15.137:0/2418077460 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247879393 0 0) 0x7f50e40b4260 con 0x7f50e40b3de0 2024-04-26T22:06:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.264+0000 7f50ead4c640 1 -- 172.21.15.137:0/2418077460 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e40b4810 con 0x7f50e40b61a0 2024-04-26T22:06:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.265+0000 7f50ead4c640 1 --2- 172.21.15.137:0/2418077460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b61a0 0x7f50e40720d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0097a0 tx=0x7f50dc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecdf83fad939849 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.265+0000 7f50e9549640 1 -- 172.21.15.137:0/2418077460 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc037070 con 0x7f50e40b61a0 2024-04-26T22:06:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.265+0000 7f50e9549640 1 -- 172.21.15.137:0/2418077460 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc02ae50 con 0x7f50e40b61a0 2024-04-26T22:06:10.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.265+0000 7f50e9549640 1 -- 172.21.15.137:0/2418077460 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc032660 con 0x7f50e40b61a0 2024-04-26T22:06:10.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.266+0000 7f50ec7af640 1 -- 172.21.15.137:0/2418077460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b61a0 msgr2=0x7f50e40720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.266+0000 7f50ec7af640 1 --2- 172.21.15.137:0/2418077460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b61a0 0x7f50e40720d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0097a0 tx=0x7f50dc02a100 comp rx=0 tx=0).stop 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.266+0000 7f50ec7af640 1 -- 172.21.15.137:0/2418077460 shutdown_connections 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.266+0000 7f50ec7af640 1 --2- 172.21.15.137:0/2418077460 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b61a0 0x7f50e40720d0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.266+0000 7f50ec7af640 1 --2- 172.21.15.137:0/2418077460 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e4145980 0x7f50e4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.266+0000 7f50ec7af640 1 -- 172.21.15.137:0/2418077460 >> 172.21.15.137:0/2418077460 conn(0x7f50e40d0d30 msgr2=0x7f50e40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.266+0000 7f50ec7af640 1 -- 172.21.15.137:0/2418077460 shutdown_connections 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.266+0000 7f50ec7af640 1 -- 172.21.15.137:0/2418077460 wait complete. 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.267+0000 7f50ec7af640 1 Processor -- start 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.267+0000 7f50ec7af640 1 -- start start 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ec7af640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b3de0 0x7f50e4132fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ec7af640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e40b61a0 0x7f50e4134f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ec7af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50e4145980 0x7f50e4134190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ec7af640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f50e4072610 con 0x7f50e40b3de0 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ec7af640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40b4dd0 con 0x7f50e4145980 2024-04-26T22:06:10.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ec7af640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f50e4072790 con 0x7f50e40b61a0 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ea54b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b3de0 0x7f50e4132fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ea54b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b3de0 0x7f50e4132fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59374/0 (socket says 172.21.15.137:59374) 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ea54b640 1 -- 172.21.15.137:0/2021781948 learned_addr learned my addr 172.21.15.137:0/2021781948 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ea54b640 1 -- 172.21.15.137:0/2021781948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e40b61a0 msgr2=0x7f50e4134f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ea54b640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e40b61a0 0x7f50e4134f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ea54b640 1 -- 172.21.15.137:0/2021781948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50e4145980 msgr2=0x7f50e4134190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ea54b640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50e4145980 0x7f50e4134190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ea54b640 1 -- 172.21.15.137:0/2021781948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e4135490 con 0x7f50e40b3de0 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ea54b640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b3de0 0x7f50e4132fb0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f50e0007e40 tx=0x7f50e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50daffd640 1 -- 172.21.15.137:0/2021781948 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0014620 con 0x7f50e40b3de0 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50daffd640 1 -- 172.21.15.137:0/2021781948 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e0019070 con 0x7f50e40b3de0 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e413da70 con 0x7f50e40b3de0 2024-04-26T22:06:10.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50daffd640 1 -- 172.21.15.137:0/2021781948 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0014a00 con 0x7f50e40b3de0 2024-04-26T22:06:10.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.268+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e4133870 con 0x7f50e40b3de0 2024-04-26T22:06:10.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.269+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e41379f0 con 0x7f50e40b3de0 2024-04-26T22:06:10.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.270+0000 7f50daffd640 1 -- 172.21.15.137:0/2021781948 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50e0014ba0 con 0x7f50e40b3de0 2024-04-26T22:06:10.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.270+0000 7f50daffd640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.270+0000 7f50e9d4a640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:10.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.270+0000 7f50daffd640 1 -- 172.21.15.137:0/2021781948 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f50e008c360 con 0x7f50e40b3de0 2024-04-26T22:06:10.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.271+0000 7f50e9d4a640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f50d4005880 tx=0x7f50d4007950 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:10.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.275+0000 7f50daffd640 1 -- 172.21.15.137:0/2021781948 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f50e41379f0 con 0x7f50e40b3de0 2024-04-26T22:06:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.489+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50e406a290 con 0x7f50e40b3de0 2024-04-26T22:06:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.489+0000 7f50daffd640 1 -- 172.21.15.137:0/2021781948 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5195 (secure 0 0 0) 0x7f50e005a820 con 0x7f50e40b3de0 2024-04-26T22:06:10.489 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:10.490 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1187927282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1187927282},{"type":"v1","addr":"172.21.15.137:6836","nonce":1187927282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:06:03.956752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2219855149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2219855149},{"type":"v1","addr":"172.21.15.170:6835","nonce":2219855149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8232,"qdb_cluster":[8232]},"id":7}]} 2024-04-26T22:06:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 66 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 msgr2=0x7f50c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f50d4005880 tx=0x7f50d4007950 comp rx=0 tx=0).stop 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b3de0 msgr2=0x7f50e4132fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b3de0 0x7f50e4132fb0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f50e0007e40 tx=0x7f50e000e4b0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 shutdown_connections 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f50c806c8f0 0x7f50c806edb0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50e4145980 0x7f50e4134190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f50e40b61a0 0x7f50e4134f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 --2- 172.21.15.137:0/2021781948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f50e40b3de0 0x7f50e4132fb0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 >> 172.21.15.137:0/2021781948 conn(0x7f50e40d0d30 msgr2=0x7f50e40b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 shutdown_connections 2024-04-26T22:06:10.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.491+0000 7f50ec7af640 1 -- 172.21.15.137:0/2021781948 wait complete. 2024-04-26T22:06:10.503 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-26T22:06:10.641 INFO:teuthology.orchestra.run.smithi170.stdout:{"message":"","return_code":0} 2024-04-26T22:06:10.641 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T22:06:10.641 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:06:10.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.738+0000 7f6c3e659640 1 Processor -- start 2024-04-26T22:06:10.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.738+0000 7f6c3e659640 1 -- start start 2024-04-26T22:06:10.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.739+0000 7f6c3e659640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6c3815f370 0x7f6c380cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.739+0000 7f6c3e659640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c380d03a0 con 0x7f6c380d3ee0 2024-04-26T22:06:10.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.739+0000 7f6c3e659640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c380d0680 con 0x7f6c3815f750 2024-04-26T22:06:10.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.739+0000 7f6c3e659640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6c380d0960 con 0x7f6c3815f370 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.739+0000 7f6c37fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6c3815f370 0x7f6c380cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.739+0000 7f6c3cbf6640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6c380d3ee0 0x7f6c380b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38164/0 (socket says 172.21.15.137:38164) 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.739+0000 7f6c37fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6c3815f370 0x7f6c380cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59376/0 (socket says 172.21.15.137:59376) 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.739+0000 7f6c3cbf6640 1 -- 172.21.15.137:0/3803740510 learned_addr learned my addr 172.21.15.137:0/3803740510 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.740+0000 7f6c37fff640 1 -- 172.21.15.137:0/3803740510 >> v1:172.21.15.170:6789/0 conn(0x7f6c3815f750 legacy=0x7f6c380d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.740+0000 7f6c37fff640 1 -- 172.21.15.137:0/3803740510 >> v1:172.21.15.137:6789/0 conn(0x7f6c380d3ee0 legacy=0x7f6c380b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.740+0000 7f6c37fff640 1 -- 172.21.15.137:0/3803740510 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c380d0c40 con 0x7f6c3815f370 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.740+0000 7f6c36ffd640 1 -- 172.21.15.137:0/3803740510 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176964397 0 0) 0x7f6c380d03a0 con 0x7f6c380d3ee0 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.740+0000 7f6c37fff640 1 --2- 172.21.15.137:0/3803740510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c3815f370 0x7f6c380cfd70 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097a0 tx=0x7f6c2802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59ad1ca381f121a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.740+0000 7f6c36ffd640 1 -- 172.21.15.137:0/3803740510 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28037070 con 0x7f6c3815f370 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.740+0000 7f6c36ffd640 1 -- 172.21.15.137:0/3803740510 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c28032440 con 0x7f6c3815f370 2024-04-26T22:06:10.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.740+0000 7f6c36ffd640 1 -- 172.21.15.137:0/3803740510 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28032810 con 0x7f6c3815f370 2024-04-26T22:06:10.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.741+0000 7f6c3e659640 1 -- 172.21.15.137:0/3803740510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c3815f370 msgr2=0x7f6c380cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.741+0000 7f6c3e659640 1 --2- 172.21.15.137:0/3803740510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c3815f370 0x7f6c380cfd70 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097a0 tx=0x7f6c2802a230 comp rx=0 tx=0).stop 2024-04-26T22:06:10.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.741+0000 7f6c3e659640 1 -- 172.21.15.137:0/3803740510 shutdown_connections 2024-04-26T22:06:10.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.741+0000 7f6c3e659640 1 --2- 172.21.15.137:0/3803740510 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c3815f370 0x7f6c380cfd70 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.741+0000 7f6c3e659640 1 -- 172.21.15.137:0/3803740510 >> 172.21.15.137:0/3803740510 conn(0x7f6c3808ec10 msgr2=0x7f6c3809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:10.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.741+0000 7f6c3e659640 1 -- 172.21.15.137:0/3803740510 shutdown_connections 2024-04-26T22:06:10.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.741+0000 7f6c3e659640 1 -- 172.21.15.137:0/3803740510 wait complete. 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.742+0000 7f6c3e659640 1 Processor -- start 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.742+0000 7f6c3e659640 1 -- start start 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c3e659640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c380d3ee0 0x7f6c380b98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c3e659640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c3815f370 0x7f6c380b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c3e659640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c3815f750 0x7f6c380cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c3e659640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c380b4950 con 0x7f6c380d3ee0 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c3e659640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6c380b47d0 con 0x7f6c3815f750 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c3e659640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c380b4ad0 con 0x7f6c3815f370 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c380d3ee0 0x7f6c380b98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c37fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c380d3ee0 0x7f6c380b98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59378/0 (socket says 172.21.15.137:59378) 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c37fff640 1 -- 172.21.15.137:0/1604500830 learned_addr learned my addr 172.21.15.137:0/1604500830 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c3cbf6640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c3815f750 0x7f6c380cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c377fe640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c3815f370 0x7f6c380b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:10.745 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c37fff640 1 -- 172.21.15.137:0/1604500830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c3815f370 msgr2=0x7f6c380b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c37fff640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c3815f370 0x7f6c380b7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c37fff640 1 -- 172.21.15.137:0/1604500830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c3815f750 msgr2=0x7f6c380cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c37fff640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c3815f750 0x7f6c380cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.743+0000 7f6c37fff640 1 -- 172.21.15.137:0/1604500830 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c380b9fc0 con 0x7f6c380d3ee0 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.744+0000 7f6c37fff640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c380d3ee0 0x7f6c380b98e0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097a0 tx=0x7f6c280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.744+0000 7f6c34ff9640 1 -- 172.21.15.137:0/1604500830 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28037050 con 0x7f6c380d3ee0 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.744+0000 7f6c34ff9640 1 -- 172.21.15.137:0/1604500830 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c28038040 con 0x7f6c380d3ee0 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.744+0000 7f6c34ff9640 1 -- 172.21.15.137:0/1604500830 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28004490 con 0x7f6c380d3ee0 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.744+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c380ba2a0 con 0x7f6c380d3ee0 2024-04-26T22:06:10.746 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.744+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c380ba860 con 0x7f6c380d3ee0 2024-04-26T22:06:10.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.745+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c3806a290 con 0x7f6c380d3ee0 2024-04-26T22:06:10.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.745+0000 7f6c34ff9640 1 -- 172.21.15.137:0/1604500830 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c28030900 con 0x7f6c380d3ee0 2024-04-26T22:06:10.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.746+0000 7f6c34ff9640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2406c8f0 0x7f6c2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:10.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.746+0000 7f6c34ff9640 1 -- 172.21.15.137:0/1604500830 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f6c280ac7a0 con 0x7f6c380d3ee0 2024-04-26T22:06:10.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.746+0000 7f6c377fe640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2406c8f0 0x7f6c2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:10.747 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.746+0000 7f6c377fe640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2406c8f0 0x7f6c2406edb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6c380cef60 tx=0x7f6c2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:10.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.750+0000 7f6c34ff9640 1 -- 172.21.15.137:0/1604500830 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6c2807abd0 con 0x7f6c380d3ee0 2024-04-26T22:06:10.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.962+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c380bac40 con 0x7f6c380d3ee0 2024-04-26T22:06:10.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.962+0000 7f6c34ff9640 1 -- 172.21.15.137:0/1604500830 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5195 (secure 0 0 0) 0x7f6c2807a4d0 con 0x7f6c380d3ee0 2024-04-26T22:06:10.962 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:10.963 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1187927282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1187927282},{"type":"v1","addr":"172.21.15.137:6836","nonce":1187927282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:06:03.956752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2219855149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2219855149},{"type":"v1","addr":"172.21.15.170:6835","nonce":2219855149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8232,"qdb_cluster":[8232]},"id":7}]} 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 66 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2406c8f0 msgr2=0x7f6c2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2406c8f0 0x7f6c2406edb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6c380cef60 tx=0x7f6c2c009040 comp rx=0 tx=0).stop 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c380d3ee0 msgr2=0x7f6c380b98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c380d3ee0 0x7f6c380b98e0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097a0 tx=0x7f6c280046c0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 shutdown_connections 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c2406c8f0 0x7f6c2406edb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c3815f750 0x7f6c380cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c3815f370 0x7f6c380b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 --2- 172.21.15.137:0/1604500830 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c380d3ee0 0x7f6c380b98e0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:10.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.964+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 >> 172.21.15.137:0/1604500830 conn(0x7f6c3808ec10 msgr2=0x7f6c380d56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:10.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.965+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 shutdown_connections 2024-04-26T22:06:10.968 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:10.965+0000 7f6c3e659640 1 -- 172.21.15.137:0/1604500830 wait complete. 2024-04-26T22:06:10.975 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-04-26T22:06:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.017+0000 7f9212cf2f40 1 Processor -- start 2024-04-26T22:06:11.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.017+0000 7f9212cf2f40 1 -- start start 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f9212cf2f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dba4e90570 0x55dba4f62c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f9212cf2f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65b50 0x55dba4eceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f9212cf2f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dba4f65f30 0x55dba4ecf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f9212cf2f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dba4e35e40 con 0x55dba4f65b50 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f9212cf2f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55dba4e39e80 con 0x55dba4f65f30 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f9212cf2f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55dba4e909e0 con 0x55dba4e90570 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f920ffeb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65b50 0x55dba4eceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f920ffeb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65b50 0x55dba4eceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59386/0 (socket says 172.21.15.137:59386) 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f920ffeb640 1 -- 172.21.15.137:0/4114110734 learned_addr learned my addr 172.21.15.137:0/4114110734 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f92107ec640 1 --2- 172.21.15.137:0/4114110734 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dba4e90570 0x55dba4f62c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f9210fed640 1 --2- 172.21.15.137:0/4114110734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dba4f65f30 0x55dba4ecf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f920ffeb640 1 -- 172.21.15.137:0/4114110734 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dba4e90570 msgr2=0x55dba4f62c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f920ffeb640 1 --2- 172.21.15.137:0/4114110734 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dba4e90570 0x55dba4f62c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f920ffeb640 1 -- 172.21.15.137:0/4114110734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dba4f65f30 msgr2=0x55dba4ecf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f920ffeb640 1 --2- 172.21.15.137:0/4114110734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dba4f65f30 0x55dba4ecf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.018+0000 7f920ffeb640 1 -- 172.21.15.137:0/4114110734 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba4ece870 con 0x55dba4f65b50 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f920ffeb640 1 --2- 172.21.15.137:0/4114110734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65b50 0x55dba4eceb70 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f920400a520 tx=0x7f920404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94835e642748d8c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f920efe9640 1 -- 172.21.15.137:0/4114110734 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204063070 con 0x55dba4f65b50 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f920efe9640 1 -- 172.21.15.137:0/4114110734 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920400a240 con 0x55dba4f65b50 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f920efe9640 1 -- 172.21.15.137:0/4114110734 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204059040 con 0x55dba4f65b50 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f9212cf2f40 1 -- 172.21.15.137:0/4114110734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65b50 msgr2=0x55dba4eceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f9212cf2f40 1 --2- 172.21.15.137:0/4114110734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65b50 0x55dba4eceb70 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f920400a520 tx=0x7f920404e000 comp rx=0 tx=0).stop 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f9212cf2f40 1 -- 172.21.15.137:0/4114110734 shutdown_connections 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f9212cf2f40 1 --2- 172.21.15.137:0/4114110734 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65b50 0x55dba4eceb70 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f9212cf2f40 1 --2- 172.21.15.137:0/4114110734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dba4f65f30 0x55dba4ecf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f9212cf2f40 1 --2- 172.21.15.137:0/4114110734 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dba4e90570 0x55dba4f62c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f9212cf2f40 1 -- 172.21.15.137:0/4114110734 >> 172.21.15.137:0/4114110734 conn(0x55dba4ed8fd0 msgr2=0x55dba4ed5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:11.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f9212cf2f40 1 -- 172.21.15.137:0/4114110734 shutdown_connections 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.019+0000 7f9212cf2f40 1 -- 172.21.15.137:0/4114110734 wait complete. 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.020+0000 7f9212cf2f40 1 Processor -- start 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.020+0000 7f9212cf2f40 1 -- start start 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.020+0000 7f9212cf2f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dba4e90570 0x55dba4f57870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.020+0000 7f9212cf2f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dba4f65b50 0x55dba4f5d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.020+0000 7f9212cf2f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65f30 0x55dba4f63620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.020+0000 7f9212cf2f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55dba4ece620 con 0x55dba4f65f30 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.020+0000 7f9212cf2f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55dba4f64fc0 con 0x55dba4f65b50 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9212cf2f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55dba4f652a0 con 0x55dba4e90570 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9210fed640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65f30 0x55dba4f63620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9210fed640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65f30 0x55dba4f63620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59390/0 (socket says 172.21.15.137:59390) 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9210fed640 1 -- 172.21.15.137:0/64129938 learned_addr learned my addr 172.21.15.137:0/64129938 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f920ffeb640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dba4f65b50 0x55dba4f5d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f92107ec640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dba4e90570 0x55dba4f57870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9210fed640 1 -- 172.21.15.137:0/64129938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dba4e90570 msgr2=0x55dba4f57870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9210fed640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55dba4e90570 0x55dba4f57870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9210fed640 1 -- 172.21.15.137:0/64129938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dba4f65b50 msgr2=0x55dba4f5d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9210fed640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dba4f65b50 0x55dba4f5d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9210fed640 1 -- 172.21.15.137:0/64129938 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dba4f63e80 con 0x55dba4f65f30 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9210fed640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65f30 0x55dba4f63620 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f9208006530 tx=0x7f9208001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f920dfe7640 1 -- 172.21.15.137:0/64129938 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208005e30 con 0x55dba4f65f30 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f920dfe7640 1 -- 172.21.15.137:0/64129938 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208017070 con 0x55dba4f65f30 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f920dfe7640 1 -- 172.21.15.137:0/64129938 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92080117c0 con 0x55dba4f65f30 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dba4f64160 con 0x55dba4f65f30 2024-04-26T22:06:11.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.021+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dba4f5b3d0 con 0x55dba4f65f30 2024-04-26T22:06:11.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.023+0000 7f920dfe7640 1 -- 172.21.15.137:0/64129938 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9208011960 con 0x55dba4f65f30 2024-04-26T22:06:11.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.023+0000 7f920dfe7640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91fc06b2d0 0x7f91fc06d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.023+0000 7f92107ec640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91fc06b2d0 0x7f91fc06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.023+0000 7f920dfe7640 1 -- 172.21.15.137:0/64129938 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f920808a3d0 con 0x55dba4f65f30 2024-04-26T22:06:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.023+0000 7f9212cf2f40 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55dba4f5bbd0 0x55dba4f5bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.023+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) -- 0x55dba4f5c4f0 con 0x55dba4f5bbd0 2024-04-26T22:06:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.023+0000 7f920ffeb640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55dba4f5bbd0 0x55dba4f5bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.023+0000 7f92107ec640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91fc06b2d0 0x7f91fc06d790 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9200011560 tx=0x7f92000017b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f920ffeb640 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55dba4f5bbd0 0x55dba4f5bfb0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:11.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f920ffeb640 1 -- 172.21.15.137:0/64129938 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x7f920405c040 con 0x55dba4f5bbd0 2024-04-26T22:06:11.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55dba4f5bbd0 msgr2=0x55dba4f5bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55dba4f5bbd0 0x55dba4f5bfb0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91fc06b2d0 msgr2=0x7f91fc06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91fc06b2d0 0x7f91fc06d790 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9200011560 tx=0x7f92000017b0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65f30 msgr2=0x55dba4f63620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 --2- 172.21.15.137:0/64129938 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55dba4f65f30 0x55dba4f63620 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f9208006530 tx=0x7f9208001a20 comp rx=0 tx=0).stop 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9210fed640 1 -- 172.21.15.137:0/64129938 reap_dead start 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 shutdown_connections 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 >> 172.21.15.137:0/64129938 conn(0x55dba4ed8fd0 msgr2=0x55dba4ed01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 shutdown_connections 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.024+0000 7f9212cf2f40 1 -- 172.21.15.137:0/64129938 wait complete. 2024-04-26T22:06:11.029 INFO:teuthology.orchestra.run.smithi137.stdout:����� 2024-04-26T22:06:11.030 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:06:11.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.165+0000 7f6e09de2640 1 Processor -- start 2024-04-26T22:06:11.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.165+0000 7f6e09de2640 1 -- start start 2024-04-26T22:06:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e09de2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e04145980 0x7f6e04160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e09de2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e040b3de0 0x7f6e040b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e09de2640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e040b4260 con 0x7f6e040b5fd0 2024-04-26T22:06:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e09de2640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6e040b6440 con 0x7f6e040b3de0 2024-04-26T22:06:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e09de2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6e040b5140 con 0x7f6e04145980 2024-04-26T22:06:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e02ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e040b3de0 0x7f6e040b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e02ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6e040b3de0 0x7f6e040b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59396/0 (socket says 172.21.15.137:59396) 2024-04-26T22:06:11.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e02ffd640 1 -- 172.21.15.137:0/2492447189 learned_addr learned my addr 172.21.15.137:0/2492447189 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e037fe640 1 --2- 172.21.15.137:0/2492447189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e04145980 0x7f6e04160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.166+0000 7f6e02ffd640 1 -- 172.21.15.137:0/2492447189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e04145980 msgr2=0x7f6e04160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.167+0000 7f6e02ffd640 1 --2- 172.21.15.137:0/2492447189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e04145980 0x7f6e04160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.167+0000 7f6e02ffd640 1 -- 172.21.15.137:0/2492447189 >> v1:172.21.15.170:6789/0 conn(0x7f6e040b5fd0 legacy=0x7f6e0415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.167+0000 7f6e02ffd640 1 -- 172.21.15.137:0/2492447189 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e040b4530 con 0x7f6e040b3de0 2024-04-26T22:06:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.167+0000 7f6e02ffd640 1 --2- 172.21.15.137:0/2492447189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e040b3de0 0x7f6e040b5a90 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009870 tx=0x7f6df802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21ae16edd240d08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.167+0000 7f6e027fc640 1 -- 172.21.15.137:0/2492447189 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8037070 con 0x7f6e040b3de0 2024-04-26T22:06:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.167+0000 7f6e027fc640 1 -- 172.21.15.137:0/2492447189 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df8032440 con 0x7f6e040b3de0 2024-04-26T22:06:11.168 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.167+0000 7f6e027fc640 1 -- 172.21.15.137:0/2492447189 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df8032810 con 0x7f6e040b3de0 2024-04-26T22:06:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.168+0000 7f6e09de2640 1 -- 172.21.15.137:0/2492447189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e040b3de0 msgr2=0x7f6e040b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.168+0000 7f6e09de2640 1 --2- 172.21.15.137:0/2492447189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e040b3de0 0x7f6e040b5a90 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009870 tx=0x7f6df802a1c0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.168+0000 7f6e09de2640 1 -- 172.21.15.137:0/2492447189 shutdown_connections 2024-04-26T22:06:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.168+0000 7f6e09de2640 1 --2- 172.21.15.137:0/2492447189 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e040b3de0 0x7f6e040b5a90 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.168+0000 7f6e09de2640 1 --2- 172.21.15.137:0/2492447189 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e04145980 0x7f6e04160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.168+0000 7f6e09de2640 1 -- 172.21.15.137:0/2492447189 >> 172.21.15.137:0/2492447189 conn(0x7f6e040d0d30 msgr2=0x7f6e040d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.168+0000 7f6e09de2640 1 -- 172.21.15.137:0/2492447189 shutdown_connections 2024-04-26T22:06:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.168+0000 7f6e09de2640 1 -- 172.21.15.137:0/2492447189 wait complete. 2024-04-26T22:06:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.169+0000 7f6e09de2640 1 Processor -- start 2024-04-26T22:06:11.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.169+0000 7f6e09de2640 1 -- start start 2024-04-26T22:06:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e09de2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e040b3de0 0x7f6e04136320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e09de2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e040b5fd0 0x7f6e040cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e09de2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e04145980 0x7f6e040cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e09de2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6e040b4dd0 con 0x7f6e04145980 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e09de2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6e040b4af0 con 0x7f6e040b5fd0 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e09de2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6e040730e0 con 0x7f6e040b3de0 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e03fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e04145980 0x7f6e040cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e03fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e04145980 0x7f6e040cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59410/0 (socket says 172.21.15.137:59410) 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e037fe640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e040b3de0 0x7f6e04136320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e03fff640 1 -- 172.21.15.137:0/4266601904 learned_addr learned my addr 172.21.15.137:0/4266601904 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e02ffd640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e040b5fd0 0x7f6e040cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e037fe640 1 -- 172.21.15.137:0/4266601904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e040b5fd0 msgr2=0x7f6e040cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e037fe640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e040b5fd0 0x7f6e040cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e037fe640 1 -- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e04145980 msgr2=0x7f6e040cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e037fe640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e04145980 0x7f6e040cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e037fe640 1 -- 172.21.15.137:0/4266601904 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0415a250 con 0x7f6e040b3de0 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.170+0000 7f6e03fff640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e04145980 0x7f6e040cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:06:11.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.171+0000 7f6e037fe640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e040b3de0 0x7f6e04136320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6df400e870 tx=0x7f6df400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.171+0000 7f6debfff640 1 -- 172.21.15.137:0/4266601904 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df4017070 con 0x7f6e040b3de0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.171+0000 7f6debfff640 1 -- 172.21.15.137:0/4266601904 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df400ee60 con 0x7f6e040b3de0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.171+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e04136860 con 0x7f6e040b3de0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.171+0000 7f6debfff640 1 -- 172.21.15.137:0/4266601904 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df400cb60 con 0x7f6e040b3de0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.171+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0413b020 con 0x7f6e040b3de0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.172+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0406a290 con 0x7f6e040b3de0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.172+0000 7f6debfff640 1 -- 172.21.15.137:0/4266601904 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6df401a070 con 0x7f6e040b3de0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.173+0000 7f6debfff640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006c920 0x7f6df006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.173+0000 7f6debfff640 1 -- 172.21.15.137:0/4266601904 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f6df408b920 con 0x7f6e040b3de0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.173+0000 7f6e02ffd640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006c920 0x7f6df006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:11.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.173+0000 7f6e02ffd640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006c920 0x7f6df006ede0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6df8034000 tx=0x7f6df802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:11.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.177+0000 7f6debfff640 1 -- 172.21.15.137:0/4266601904 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6df4059660 con 0x7f6e040b3de0 2024-04-26T22:06:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.390+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6e04073cc0 con 0x7f6e040b3de0 2024-04-26T22:06:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.391+0000 7f6debfff640 1 -- 172.21.15.137:0/4266601904 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7f6df405d960 con 0x7f6e040b3de0 2024-04-26T22:06:11.391 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:06:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006c920 msgr2=0x7f6df006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006c920 0x7f6df006ede0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6df8034000 tx=0x7f6df802e000 comp rx=0 tx=0).stop 2024-04-26T22:06:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e040b3de0 msgr2=0x7f6e04136320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e040b3de0 0x7f6e04136320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6df400e870 tx=0x7f6df400ed30 comp rx=0 tx=0).stop 2024-04-26T22:06:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 shutdown_connections 2024-04-26T22:06:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6df006c920 0x7f6df006ede0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6e04145980 0x7f6e040cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e040b5fd0 0x7f6e040cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 --2- 172.21.15.137:0/4266601904 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6e040b3de0 0x7f6e04136320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 >> 172.21.15.137:0/4266601904 conn(0x7f6e040d0d30 msgr2=0x7f6e040b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 shutdown_connections 2024-04-26T22:06:11.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11.393+0000 7f6e09de2640 1 -- 172.21.15.137:0/4266601904 wait complete. 2024-04-26T22:06:11.404 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:06:11.404 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:06:11.404 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:06:11.404 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:06:11.404 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:11.404 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:06:11.404 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:06:11.404 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:06:11.404 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:06:11.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:11.405 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:06:11.420 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42335sec preferred_lft 42335sec 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:11.421 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:06:11.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:11.423 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:06:11.483 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:06:11.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:11.484 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:06:11.540 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:06:11.540 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:06:11.540 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:06:11.540 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:06:11.540 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:06:11.541 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:06:11.541 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:06:11.541 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:06:11.541 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:06:11.541 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:06:11.541 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:06:11.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:06:11.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:06:11.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:11.665 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:06:11.679 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:06:11.680 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:06:11.680 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:06:11.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:11.680 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:06:11.743 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:06:11.743 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:11.799 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:06:11.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:06:11.800 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:11.854 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:06:11.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:11.854 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:06:11.935 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:06:11.935 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:06:11.942 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:06:11.942 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:06:11.942 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:06:11.942 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:06:11.943 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:06:11.943 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:06:11.943 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:06:11.943 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:06:11.943 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:06:11.943 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:06:11.945 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:06:11.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:11.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:12.009 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:06:12.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:06:12.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:06:12.107 INFO:teuthology.orchestra.run.smithi137.stdout:client6377 2024-04-26T22:06:12.107 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:12.107 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:12.123 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:12.123 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:12.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:12.178 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-26T22:06:12.277 INFO:teuthology.orchestra.run.smithi137.stderr:6+0 records in 2024-04-26T22:06:12.277 INFO:teuthology.orchestra.run.smithi137.stderr:6+0 records out 2024-04-26T22:06:12.278 INFO:teuthology.orchestra.run.smithi137.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.040835 s, 154 MB/s 2024-04-26T22:06:12.278 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:12.278 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:12.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:12.294 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-26T22:06:12.382 INFO:teuthology.orchestra.run.smithi137.stderr:6+0 records in 2024-04-26T22:06:12.382 INFO:teuthology.orchestra.run.smithi137.stderr:6+0 records out 2024-04-26T22:06:12.382 INFO:teuthology.orchestra.run.smithi137.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0321476 s, 196 MB/s 2024-04-26T22:06:12.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:12.383 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-26T22:06:12.399 INFO:teuthology.orchestra.run.smithi137.stdout:./ 2024-04-26T22:06:12.399 INFO:teuthology.orchestra.run.smithi137.stdout:./file2_sixmegs 2024-04-26T22:06:12.400 INFO:teuthology.orchestra.run.smithi137.stdout:./file3_sixmegs 2024-04-26T22:06:12.400 INFO:teuthology.orchestra.run.smithi137.stdout:./file1_sixmegs 2024-04-26T22:06:12.400 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:06:12.400 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:06:12.400 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:06:12.400 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:06:12.400 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-26T22:06:12.400 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:06:12.504 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:06:12.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:06:12.513 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:06:12.513 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:06:12.513 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:06:12.514 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:06:12.514 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-04-26T22:06:12.514 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:06:12.618 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627777 2024-04-26T22:06:12.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:06:12.627 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:06:12.627 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:06:12.627 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:06:12.628 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:06:12.628 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-04-26T22:06:12.628 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:06:12.732 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627778 2024-04-26T22:06:12.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:06:12.741 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:06:12.741 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:06:12.741 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:06:12.741 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:06:12.741 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-04-26T22:06:12.742 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:06:12.846 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627776 2024-04-26T22:06:12.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:06:12.856 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:12.856 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:12.911 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:12.911 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:12.966 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:06:13.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.103+0000 7f59149e6640 1 Processor -- start 2024-04-26T22:06:13.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.103+0000 7f59149e6640 1 -- start start 2024-04-26T22:06:13.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f59149e6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59100d1370 0x7f59100cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f59149e6640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f59100b28c0 0x7f59100ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f59149e6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f59100d1750 0x7f59100b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f59149e6640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f59100b0620 con 0x7f59100d1750 2024-04-26T22:06:13.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f59149e6640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5910074070 con 0x7f59100b28c0 2024-04-26T22:06:13.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f59149e6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5910074350 con 0x7f59100d1370 2024-04-26T22:06:13.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f590ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f59100d1750 0x7f59100b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.105 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f590ed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f59100d1750 0x7f59100b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59418/0 (socket says 172.21.15.137:59418) 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f590ed9d640 1 -- 172.21.15.137:0/1338135070 learned_addr learned my addr 172.21.15.137:0/1338135070 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f590ed9d640 1 -- 172.21.15.137:0/1338135070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59100d1370 msgr2=0x7f59100cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f590e59c640 1 --2- 172.21.15.137:0/1338135070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59100d1370 0x7f59100cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f5907fff640 1 --2- 172.21.15.137:0/1338135070 >> v2:172.21.15.170:3300/0 conn(0x7f59100b28c0 0x7f59100ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f590ed9d640 1 --2- 172.21.15.137:0/1338135070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59100d1370 0x7f59100cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f590ed9d640 1 -- 172.21.15.137:0/1338135070 >> v2:172.21.15.170:3300/0 conn(0x7f59100b28c0 msgr2=0x7f59100ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f590ed9d640 1 --2- 172.21.15.137:0/1338135070 >> v2:172.21.15.170:3300/0 conn(0x7f59100b28c0 0x7f59100ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.104+0000 7f590ed9d640 1 -- 172.21.15.137:0/1338135070 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5910074630 con 0x7f59100d1750 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.105+0000 7f590ed9d640 1 --2- 172.21.15.137:0/1338135070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100d1750 0x7f59100b0dd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f5910069f00 tx=0x7f590802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45099c645fcfae51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.105+0000 7f590dd9b640 1 -- 172.21.15.137:0/1338135070 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908036070 con 0x7f59100d1750 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.105+0000 7f590dd9b640 1 -- 172.21.15.137:0/1338135070 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5908031600 con 0x7f59100d1750 2024-04-26T22:06:13.106 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.105+0000 7f590dd9b640 1 -- 172.21.15.137:0/1338135070 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59080319d0 con 0x7f59100d1750 2024-04-26T22:06:13.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.106+0000 7f59149e6640 1 -- 172.21.15.137:0/1338135070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100d1750 msgr2=0x7f59100b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.106+0000 7f59149e6640 1 --2- 172.21.15.137:0/1338135070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100d1750 0x7f59100b0dd0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f5910069f00 tx=0x7f590802a610 comp rx=0 tx=0).stop 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.106+0000 7f59149e6640 1 -- 172.21.15.137:0/1338135070 shutdown_connections 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.106+0000 7f59149e6640 1 --2- 172.21.15.137:0/1338135070 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100d1750 0x7f59100b0dd0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.106+0000 7f59149e6640 1 --2- 172.21.15.137:0/1338135070 >> v2:172.21.15.170:3300/0 conn(0x7f59100b28c0 0x7f59100ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.106+0000 7f59149e6640 1 --2- 172.21.15.137:0/1338135070 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59100d1370 0x7f59100cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.106+0000 7f59149e6640 1 -- 172.21.15.137:0/1338135070 >> 172.21.15.137:0/1338135070 conn(0x7f59100b6800 msgr2=0x7f59100738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.106+0000 7f59149e6640 1 -- 172.21.15.137:0/1338135070 shutdown_connections 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.106+0000 7f59149e6640 1 -- 172.21.15.137:0/1338135070 wait complete. 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.107+0000 7f59149e6640 1 Processor -- start 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.107+0000 7f59149e6640 1 -- start start 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f59149e6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100b28c0 0x7f5910156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f59149e6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59100d1370 0x7f591009b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f59149e6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59100d1750 0x7f5910152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f59149e6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f59100d1d60 con 0x7f59100b28c0 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f59149e6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f59100d1be0 con 0x7f59100d1750 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f59149e6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f59100d1ee0 con 0x7f59100d1370 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f590e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100b28c0 0x7f5910156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f590e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100b28c0 0x7f5910156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59424/0 (socket says 172.21.15.137:59424) 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f590e59c640 1 -- 172.21.15.137:0/898906784 learned_addr learned my addr 172.21.15.137:0/898906784 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f590e59c640 1 -- 172.21.15.137:0/898906784 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59100d1370 msgr2=0x7f591009b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f590e59c640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59100d1370 0x7f591009b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f590e59c640 1 -- 172.21.15.137:0/898906784 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59100d1750 msgr2=0x7f5910152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f590e59c640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59100d1750 0x7f5910152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f590e59c640 1 -- 172.21.15.137:0/898906784 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5910154e60 con 0x7f59100b28c0 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f590e59c640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100b28c0 0x7f5910156a90 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f590000c7f0 tx=0x7f590000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f5906ffd640 1 -- 172.21.15.137:0/898906784 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900015070 con 0x7f59100b28c0 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f5906ffd640 1 -- 172.21.15.137:0/898906784 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5900004220 con 0x7f59100b28c0 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5910155140 con 0x7f59100b28c0 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.108+0000 7f5906ffd640 1 -- 172.21.15.137:0/898906784 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900007620 con 0x7f59100b28c0 2024-04-26T22:06:13.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.109+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5910155700 con 0x7f59100b28c0 2024-04-26T22:06:13.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.109+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f591006a290 con 0x7f59100b28c0 2024-04-26T22:06:13.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.110+0000 7f5906ffd640 1 -- 172.21.15.137:0/898906784 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59000077c0 con 0x7f59100b28c0 2024-04-26T22:06:13.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.110+0000 7f5906ffd640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f58f006c8f0 0x7f58f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.110+0000 7f5906ffd640 1 -- 172.21.15.137:0/898906784 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f590008b900 con 0x7f59100b28c0 2024-04-26T22:06:13.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.110+0000 7f5907fff640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f58f006c8f0 0x7f58f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.111+0000 7f5907fff640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f58f006c8f0 0x7f58f006edb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f59101f64b0 tx=0x7f58f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:13.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.115+0000 7f5906ffd640 1 -- 172.21.15.137:0/898906784 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5900059dc0 con 0x7f59100b28c0 2024-04-26T22:06:13.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.290+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59100730e0 con 0x7f59100b28c0 2024-04-26T22:06:13.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.291+0000 7f5906ffd640 1 -- 172.21.15.137:0/898906784 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16631 (secure 0 0 0) 0x7f59000596c0 con 0x7f59100b28c0 2024-04-26T22:06:13.291 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:13.291 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":103,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:06:03.589665+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:06:00.152074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-26T22:06:00.894660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:06:13.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f58f006c8f0 msgr2=0x7f58f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f58f006c8f0 0x7f58f006edb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f59101f64b0 tx=0x7f58f8008040 comp rx=0 tx=0).stop 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100b28c0 msgr2=0x7f5910156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100b28c0 0x7f5910156a90 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f590000c7f0 tx=0x7f590000ccb0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 shutdown_connections 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f58f006c8f0 0x7f58f006edb0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59100d1750 0x7f5910152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f59100d1370 0x7f591009b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 --2- 172.21.15.137:0/898906784 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f59100b28c0 0x7f5910156a90 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 >> 172.21.15.137:0/898906784 conn(0x7f59100b6800 msgr2=0x7f591015f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 shutdown_connections 2024-04-26T22:06:13.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.293+0000 7f59149e6640 1 -- 172.21.15.137:0/898906784 wait complete. 2024-04-26T22:06:13.305 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:06:00.152074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:06:00.894660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:06:13.305 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:06:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.404+0000 7fa970e93640 1 Processor -- start 2024-04-26T22:06:13.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.404+0000 7fa970e93640 1 -- start start 2024-04-26T22:06:13.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.405+0000 7fa970e93640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa96c15f680 0x7fa96c0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.405+0000 7fa970e93640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa96c163aa0 0x7fa96c0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.405+0000 7fa970e93640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c0b60b0 0x7fa96c0d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.405+0000 7fa970e93640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa96c15fa60 con 0x7fa96c15f680 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.405+0000 7fa970e93640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa96c0d3f50 con 0x7fa96c163aa0 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.405+0000 7fa970e93640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa96c0b5090 con 0x7fa96c0b60b0 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.405+0000 7fa96a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa96c15f680 0x7fa96c0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa96a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa96c15f680 0x7fa96c0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59438/0 (socket says 172.21.15.137:59438) 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa96a59c640 1 -- 172.21.15.137:0/3547120343 learned_addr learned my addr 172.21.15.137:0/3547120343 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa96ad9d640 1 --2- 172.21.15.137:0/3547120343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c0b60b0 0x7fa96c0d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa969d9b640 1 --2- 172.21.15.137:0/3547120343 >> v2:172.21.15.170:3300/0 conn(0x7fa96c163aa0 0x7fa96c0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa96a59c640 1 -- 172.21.15.137:0/3547120343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c0b60b0 msgr2=0x7fa96c0d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa96a59c640 1 --2- 172.21.15.137:0/3547120343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c0b60b0 0x7fa96c0d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa96a59c640 1 -- 172.21.15.137:0/3547120343 >> v2:172.21.15.170:3300/0 conn(0x7fa96c163aa0 msgr2=0x7fa96c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:13.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa96a59c640 1 --2- 172.21.15.137:0/3547120343 >> v2:172.21.15.170:3300/0 conn(0x7fa96c163aa0 0x7fa96c0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa96a59c640 1 -- 172.21.15.137:0/3547120343 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c0b5370 con 0x7fa96c15f680 2024-04-26T22:06:13.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.406+0000 7fa969d9b640 1 --2- 172.21.15.137:0/3547120343 >> v2:172.21.15.170:3300/0 conn(0x7fa96c163aa0 0x7fa96c0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:13.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa96a59c640 1 --2- 172.21.15.137:0/3547120343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c15f680 0x7fa96c0d3820 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fa96c163040 tx=0x7fa95c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa13eee15d032d55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:13.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa96959a640 1 -- 172.21.15.137:0/3547120343 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c036070 con 0x7fa96c15f680 2024-04-26T22:06:13.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa96959a640 1 -- 172.21.15.137:0/3547120343 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c031600 con 0x7fa96c15f680 2024-04-26T22:06:13.408 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa96959a640 1 -- 172.21.15.137:0/3547120343 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c0319d0 con 0x7fa96c15f680 2024-04-26T22:06:13.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa970e93640 1 -- 172.21.15.137:0/3547120343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c15f680 msgr2=0x7fa96c0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa970e93640 1 --2- 172.21.15.137:0/3547120343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c15f680 0x7fa96c0d3820 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fa96c163040 tx=0x7fa95c02a6a0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa970e93640 1 -- 172.21.15.137:0/3547120343 shutdown_connections 2024-04-26T22:06:13.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa970e93640 1 --2- 172.21.15.137:0/3547120343 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c0b60b0 0x7fa96c0d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa970e93640 1 --2- 172.21.15.137:0/3547120343 >> v2:172.21.15.170:3300/0 conn(0x7fa96c163aa0 0x7fa96c0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa970e93640 1 --2- 172.21.15.137:0/3547120343 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c15f680 0x7fa96c0d3820 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.412 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa970e93640 1 -- 172.21.15.137:0/3547120343 >> 172.21.15.137:0/3547120343 conn(0x7fa96c08eca0 msgr2=0x7fa96c09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa970e93640 1 -- 172.21.15.137:0/3547120343 shutdown_connections 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.407+0000 7fa970e93640 1 -- 172.21.15.137:0/3547120343 wait complete. 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa970e93640 1 Processor -- start 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa970e93640 1 -- start start 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa970e93640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c0b60b0 0x7fa96c161a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa970e93640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa96c15f680 0x7fa96c15ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa970e93640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c163aa0 0x7fa96c1577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa970e93640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c0d55e0 con 0x7fa96c0b60b0 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa970e93640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c0d5460 con 0x7fa96c15f680 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa970e93640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa96c0d5760 con 0x7fa96c163aa0 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa96a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c0b60b0 0x7fa96c161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.413 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa96a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c0b60b0 0x7fa96c161a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59446/0 (socket says 172.21.15.137:59446) 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.409+0000 7fa96a59c640 1 -- 172.21.15.137:0/825364560 learned_addr learned my addr 172.21.15.137:0/825364560 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa96ad9d640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c163aa0 0x7fa96c1577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa969d9b640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa96c15f680 0x7fa96c15ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa96a59c640 1 -- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c163aa0 msgr2=0x7fa96c1577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa96a59c640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c163aa0 0x7fa96c1577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa96a59c640 1 -- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa96c15f680 msgr2=0x7fa96c15ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa96a59c640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa96c15f680 0x7fa96c15ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa96a59c640 1 -- 172.21.15.137:0/825364560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c0ce3b0 con 0x7fa96c0b60b0 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa96ad9d640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c163aa0 0x7fa96c1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa969d9b640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa96c15f680 0x7fa96c15ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa96a59c640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c0b60b0 0x7fa96c161a30 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fa95c034040 tx=0x7fa95c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:13.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa95affd640 1 -- 172.21.15.137:0/825364560 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c03f020 con 0x7fa96c0b60b0 2024-04-26T22:06:13.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa95affd640 1 -- 172.21.15.137:0/825364560 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa95c037040 con 0x7fa96c0b60b0 2024-04-26T22:06:13.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c0cd310 con 0x7fa96c0b60b0 2024-04-26T22:06:13.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa95affd640 1 -- 172.21.15.137:0/825364560 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c036070 con 0x7fa96c0b60b0 2024-04-26T22:06:13.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.410+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c0cd8d0 con 0x7fa96c0b60b0 2024-04-26T22:06:13.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.411+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa96c06a290 con 0x7fa96c0b60b0 2024-04-26T22:06:13.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.412+0000 7fa95affd640 1 -- 172.21.15.137:0/825364560 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa95c042020 con 0x7fa96c0b60b0 2024-04-26T22:06:13.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.412+0000 7fa95affd640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa94c06c8f0 0x7fa94c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.412+0000 7fa95affd640 1 -- 172.21.15.137:0/825364560 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fa95c0ac0a0 con 0x7fa96c0b60b0 2024-04-26T22:06:13.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.412+0000 7fa969d9b640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa94c06c8f0 0x7fa94c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.412+0000 7fa969d9b640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa94c06c8f0 0x7fa94c06edb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa960006fd0 tx=0x7fa960008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:13.416 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.416+0000 7fa95affd640 1 -- 172.21.15.137:0/825364560 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa95c049030 con 0x7fa96c0b60b0 2024-04-26T22:06:13.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.589+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa96c0b4cd0 con 0x7fa96c0b60b0 2024-04-26T22:06:13.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.590+0000 7fa95affd640 1 -- 172.21.15.137:0/825364560 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7fa95c07a4d0 con 0x7fa96c0b60b0 2024-04-26T22:06:13.590 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa94c06c8f0 msgr2=0x7fa94c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa94c06c8f0 0x7fa94c06edb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa960006fd0 tx=0x7fa960008040 comp rx=0 tx=0).stop 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c0b60b0 msgr2=0x7fa96c161a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c0b60b0 0x7fa96c161a30 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fa95c034040 tx=0x7fa95c004a40 comp rx=0 tx=0).stop 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 shutdown_connections 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa94c06c8f0 0x7fa94c06edb0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa96c163aa0 0x7fa96c1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa96c15f680 0x7fa96c15ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 --2- 172.21.15.137:0/825364560 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa96c0b60b0 0x7fa96c161a30 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 >> 172.21.15.137:0/825364560 conn(0x7fa96c08eca0 msgr2=0x7fa96c0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:13.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 shutdown_connections 2024-04-26T22:06:13.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.592+0000 7fa970e93640 1 -- 172.21.15.137:0/825364560 wait complete. 2024-04-26T22:06:13.603 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:06:13.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.704+0000 7f672d196640 1 Processor -- start 2024-04-26T22:06:13.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.705+0000 7f672d196640 1 -- start start 2024-04-26T22:06:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.705+0000 7f672d196640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f672806c9b0 0x7f672806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.705+0000 7f672d196640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6728070b30 con 0x7f672815f2b0 2024-04-26T22:06:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.705+0000 7f672d196640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6728070e10 con 0x7f67280706a0 2024-04-26T22:06:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.705+0000 7f672d196640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f67280af610 con 0x7f672806c9b0 2024-04-26T22:06:13.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.705+0000 7f6726d9d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f672815f2b0 0x7f672806c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38180/0 (socket says 172.21.15.137:38180) 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.705+0000 7f6726d9d640 1 -- 172.21.15.137:0/868883499 learned_addr learned my addr 172.21.15.137:0/868883499 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688662605 0 0) 0x7f6728070b30 con 0x7f672815f2b0 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6714003520 con 0x7f672815f2b0 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672759e640 1 --2- 172.21.15.137:0/868883499 >> v2:172.21.15.170:3300/0 conn(0x7f672806c9b0 0x7f672806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2461217788 0 0) 0x7f6714003520 con 0x7f672815f2b0 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 >> v2:172.21.15.170:3300/0 conn(0x7f672806c9b0 msgr2=0x7f672806fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 --2- 172.21.15.137:0/868883499 >> v2:172.21.15.170:3300/0 conn(0x7f672806c9b0 0x7f672806fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 >> v1:172.21.15.170:6789/0 conn(0x7f67280706a0 legacy=0x7f67280afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67280710f0 con 0x7f672815f2b0 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6718001670 con 0x7f672815f2b0 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 >> v1:172.21.15.137:6789/0 conn(0x7f672815f2b0 legacy=0x7f672806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67140039b0 0x7f6714003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714004800 0x7f6714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67140051c0 0x7f671400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f671400c030 con 0x7f6714004800 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f671400c1e0 con 0x7f67140039b0 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f671400c3e0 con 0x7f67140051c0 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f671ffff640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714004800 0x7f6714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f6726d9d640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67140039b0 0x7f6714003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672759e640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67140051c0 0x7f671400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f671ffff640 1 -- 172.21.15.137:0/868883499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67140051c0 msgr2=0x7f671400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f671ffff640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67140051c0 0x7f671400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f671ffff640 1 -- 172.21.15.137:0/868883499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67140039b0 msgr2=0x7f6714003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f671ffff640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67140039b0 0x7f6714003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f671ffff640 1 -- 172.21.15.137:0/868883499 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6714003520 con 0x7f6714004800 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.706+0000 7f672759e640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f67140051c0 0x7f671400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:13.710 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.707+0000 7f672759e640 1 -- 172.21.15.137:0/868883499 reap_dead start 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.707+0000 7f671ffff640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714004800 0x7f6714004c80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f6710001750 tx=0x7f6714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cbf96beb9ab515 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.707+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710001370 con 0x7f6714004800 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.707+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67100052d0 con 0x7f6714004800 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.707+0000 7f672659c640 1 -- 172.21.15.137:0/868883499 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671002abc0 con 0x7f6714004800 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.708+0000 7f672d196640 1 -- 172.21.15.137:0/868883499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714004800 msgr2=0x7f6714004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.708+0000 7f672d196640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714004800 0x7f6714004c80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f6710001750 tx=0x7f6714005830 comp rx=0 tx=0).stop 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.708+0000 7f672d196640 1 -- 172.21.15.137:0/868883499 shutdown_connections 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.708+0000 7f672d196640 1 --2- 172.21.15.137:0/868883499 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6714004800 0x7f6714004c80 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.708+0000 7f672d196640 1 -- 172.21.15.137:0/868883499 >> 172.21.15.137:0/868883499 conn(0x7f672806f050 msgr2=0x7f672806f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.708+0000 7f672d196640 1 -- 172.21.15.137:0/868883499 shutdown_connections 2024-04-26T22:06:13.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.708+0000 7f672d196640 1 -- 172.21.15.137:0/868883499 wait complete. 2024-04-26T22:06:13.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.709+0000 7f672d196640 1 Processor -- start 2024-04-26T22:06:13.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.709+0000 7f672d196640 1 -- start start 2024-04-26T22:06:13.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f672d196640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6714004800 0x7f67280b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f672d196640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f672815cbb0 0x7f672815d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f672d196640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6728147f60 0x7f67281483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f672d196640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f67280b1890 con 0x7f672815cbb0 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f672d196640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f67280b4f40 con 0x7f6728147f60 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f672d196640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f672815f690 con 0x7f6714004800 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f671ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f672815cbb0 0x7f672815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f671ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f672815cbb0 0x7f672815d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59462/0 (socket says 172.21.15.137:59462) 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f671ffff640 1 -- 172.21.15.137:0/3079096888 learned_addr learned my addr 172.21.15.137:0/3079096888 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f6726d9d640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6714004800 0x7f67280b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f672759e640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6728147f60 0x7f67281483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f671ffff640 1 -- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6714004800 msgr2=0x7f67280b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f671ffff640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6714004800 0x7f67280b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f671ffff640 1 -- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6728147f60 msgr2=0x7f67281483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f671ffff640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6728147f60 0x7f67281483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f671ffff640 1 -- 172.21.15.137:0/3079096888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672815fa10 con 0x7f672815cbb0 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f672759e640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6728147f60 0x7f67281483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:13.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f6726d9d640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6714004800 0x7f67280b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.710+0000 7f671ffff640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f672815cbb0 0x7f672815d010 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6710001870 tx=0x7f6710001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.711+0000 7f671f7fe640 1 -- 172.21.15.137:0/3079096888 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710040030 con 0x7f672815cbb0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.711+0000 7f671f7fe640 1 -- 172.21.15.137:0/3079096888 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f671002be50 con 0x7f672815cbb0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.711+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672815fcf0 con 0x7f672815cbb0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.711+0000 7f671f7fe640 1 -- 172.21.15.137:0/3079096888 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710001370 con 0x7f672815cbb0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.711+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672815d550 con 0x7f672815cbb0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.712+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672806a290 con 0x7f672815cbb0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.712+0000 7f671f7fe640 1 -- 172.21.15.137:0/3079096888 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6710043070 con 0x7f672815cbb0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.712+0000 7f671f7fe640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f670806c8f0 0x7f670806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.713+0000 7f671f7fe640 1 -- 172.21.15.137:0/3079096888 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f67100ab320 con 0x7f672815cbb0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.713+0000 7f6726d9d640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f670806c8f0 0x7f670806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:13.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.713+0000 7f6726d9d640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f670806c8f0 0x7f670806edb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6718001eb0 tx=0x7f6718009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:13.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.717+0000 7f671f7fe640 1 -- 172.21.15.137:0/3079096888 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f671004b020 con 0x7f672815cbb0 2024-04-26T22:06:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.891+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f67281599a0 con 0x7f672815cbb0 2024-04-26T22:06:13.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.892+0000 7f671f7fe640 1 -- 172.21.15.137:0/3079096888 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7f67100796c0 con 0x7f672815cbb0 2024-04-26T22:06:13.892 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.893+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f670806c8f0 msgr2=0x7f670806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.893+0000 7f672d196640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f670806c8f0 0x7f670806edb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6718001eb0 tx=0x7f6718009040 comp rx=0 tx=0).stop 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.893+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f672815cbb0 msgr2=0x7f672815d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.893+0000 7f672d196640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f672815cbb0 0x7f672815d010 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f6710001870 tx=0x7f6710001120 comp rx=0 tx=0).stop 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.894+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 shutdown_connections 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.894+0000 7f672d196640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f670806c8f0 0x7f670806edb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.894+0000 7f672d196640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f672815cbb0 0x7f672815d010 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.894+0000 7f672d196640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6728147f60 0x7f67281483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.894+0000 7f672d196640 1 --2- 172.21.15.137:0/3079096888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6714004800 0x7f67280b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.894+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 >> 172.21.15.137:0/3079096888 conn(0x7f672806f050 msgr2=0x7f67280af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.894+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 shutdown_connections 2024-04-26T22:06:13.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:13.894+0000 7f672d196640 1 -- 172.21.15.137:0/3079096888 wait complete. 2024-04-26T22:06:13.905 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:06:14.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.005+0000 7f6b0374e640 1 Processor -- start 2024-04-26T22:06:14.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.005+0000 7f6b0374e640 1 -- start start 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b0374e640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6afc0d0300 0x7f6afc0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b0374e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6afc0b3e50 0x7f6afc0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b0374e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6afc0b46a0 con 0x7f6afc06f340 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b0374e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6afc0b5db0 con 0x7f6afc0b3e50 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b0374e640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6afc0b6090 con 0x7f6afc0d0300 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b01ceb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6afc0b3e50 0x7f6afc0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b01ceb640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6afc0b3e50 0x7f6afc0720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59474/0 (socket says 172.21.15.137:59474) 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b01ceb640 1 -- 172.21.15.137:0/1797123128 learned_addr learned my addr 172.21.15.137:0/1797123128 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b00ce9640 1 --2- 172.21.15.137:0/1797123128 >> v2:172.21.15.170:3300/0 conn(0x7f6afc0d0300 0x7f6afc0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b01ceb640 1 -- 172.21.15.137:0/1797123128 >> v2:172.21.15.170:3300/0 conn(0x7f6afc0d0300 msgr2=0x7f6afc0b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b01ceb640 1 --2- 172.21.15.137:0/1797123128 >> v2:172.21.15.170:3300/0 conn(0x7f6afc0d0300 0x7f6afc0b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b01ceb640 1 -- 172.21.15.137:0/1797123128 >> v1:172.21.15.170:6789/0 conn(0x7f6afc06f340 legacy=0x7f6afc06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b01ceb640 1 -- 172.21.15.137:0/1797123128 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc0b6370 con 0x7f6afc0b3e50 2024-04-26T22:06:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.006+0000 7f6b00ce9640 1 --2- 172.21.15.137:0/1797123128 >> v2:172.21.15.170:3300/0 conn(0x7f6afc0d0300 0x7f6afc0b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.007+0000 7f6b01ceb640 1 --2- 172.21.15.137:0/1797123128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 0x7f6afc0720f0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f6afc068b90 tx=0x7f6af402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a8e7fc258b598a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.007+0000 7f6af3fff640 1 -- 172.21.15.137:0/1797123128 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4036070 con 0x7f6afc0b3e50 2024-04-26T22:06:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.007+0000 7f6af3fff640 1 -- 172.21.15.137:0/1797123128 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af4031600 con 0x7f6afc0b3e50 2024-04-26T22:06:14.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.007+0000 7f6af3fff640 1 -- 172.21.15.137:0/1797123128 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af40319d0 con 0x7f6afc0b3e50 2024-04-26T22:06:14.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.008+0000 7f6b0374e640 1 -- 172.21.15.137:0/1797123128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 msgr2=0x7f6afc0720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.008+0000 7f6b0374e640 1 --2- 172.21.15.137:0/1797123128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 0x7f6afc0720f0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f6afc068b90 tx=0x7f6af402a5d0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.008+0000 7f6b0374e640 1 -- 172.21.15.137:0/1797123128 shutdown_connections 2024-04-26T22:06:14.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.008+0000 7f6b0374e640 1 --2- 172.21.15.137:0/1797123128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 0x7f6afc0720f0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.008+0000 7f6b0374e640 1 --2- 172.21.15.137:0/1797123128 >> v2:172.21.15.170:3300/0 conn(0x7f6afc0d0300 0x7f6afc0b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.008+0000 7f6b0374e640 1 -- 172.21.15.137:0/1797123128 >> 172.21.15.137:0/1797123128 conn(0x7f6afc0cd8a0 msgr2=0x7f6afc0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:14.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.008+0000 7f6b0374e640 1 -- 172.21.15.137:0/1797123128 shutdown_connections 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.008+0000 7f6b0374e640 1 -- 172.21.15.137:0/1797123128 wait complete. 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.009+0000 7f6b0374e640 1 Processor -- start 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.009+0000 7f6b0374e640 1 -- start start 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b0374e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6afc06f340 0x7f6afc13f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b0374e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 0x7f6afc1416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b0374e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6afc0d0300 0x7f6afc141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b0374e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc0b4460 con 0x7f6afc0b3e50 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b0374e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc0b42e0 con 0x7f6afc0d0300 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b0374e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6afc142a30 con 0x7f6afc06f340 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b00ce9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 0x7f6afc1416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b00ce9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 0x7f6afc1416b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59482/0 (socket says 172.21.15.137:59482) 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b00ce9640 1 -- 172.21.15.137:0/435010639 learned_addr learned my addr 172.21.15.137:0/435010639 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b014ea640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6afc06f340 0x7f6afc13f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b01ceb640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6afc0d0300 0x7f6afc141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b00ce9640 1 -- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6afc06f340 msgr2=0x7f6afc13f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b00ce9640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6afc06f340 0x7f6afc13f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b00ce9640 1 -- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6afc0d0300 msgr2=0x7f6afc141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b00ce9640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6afc0d0300 0x7f6afc141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b00ce9640 1 -- 172.21.15.137:0/435010639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc140020 con 0x7f6afc0b3e50 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b014ea640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6afc06f340 0x7f6afc13f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b01ceb640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6afc0d0300 0x7f6afc141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b00ce9640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 0x7f6afc1416b0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c7f0 tx=0x7f6aec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6af1ffb640 1 -- 172.21.15.137:0/435010639 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec015070 con 0x7f6afc0b3e50 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6af1ffb640 1 -- 172.21.15.137:0/435010639 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aec007820 con 0x7f6afc0b3e50 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6afc140300 con 0x7f6afc0b3e50 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.010+0000 7f6af1ffb640 1 -- 172.21.15.137:0/435010639 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec007bd0 con 0x7f6afc0b3e50 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.011+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6afc1408c0 con 0x7f6afc0b3e50 2024-04-26T22:06:14.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.012+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6afc06a290 con 0x7f6afc0b3e50 2024-04-26T22:06:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.012+0000 7f6af1ffb640 1 -- 172.21.15.137:0/435010639 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6aec018070 con 0x7f6afc0b3e50 2024-04-26T22:06:14.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.012+0000 7f6af1ffb640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ae006c8f0 0x7f6ae006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.013+0000 7f6b014ea640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ae006c8f0 0x7f6ae006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.013+0000 7f6af1ffb640 1 -- 172.21.15.137:0/435010639 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f6aec08bcc0 con 0x7f6afc0b3e50 2024-04-26T22:06:14.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.013+0000 7f6b014ea640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ae006c8f0 0x7f6ae006edb0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6af8003eb0 tx=0x7f6af8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:14.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.017+0000 7f6af1ffb640 1 -- 172.21.15.137:0/435010639 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6aec05a0f0 con 0x7f6afc0b3e50 2024-04-26T22:06:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.191+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6afc072170 con 0x7f6afc0b3e50 2024-04-26T22:06:14.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.191+0000 7f6af1ffb640 1 -- 172.21.15.137:0/435010639 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7f6aec0599f0 con 0x7f6afc0b3e50 2024-04-26T22:06:14.191 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:06:14.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ae006c8f0 msgr2=0x7f6ae006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ae006c8f0 0x7f6ae006edb0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6af8003eb0 tx=0x7f6af8009040 comp rx=0 tx=0).stop 2024-04-26T22:06:14.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 msgr2=0x7f6afc1416b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 0x7f6afc1416b0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c7f0 tx=0x7f6aec00ccb0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 shutdown_connections 2024-04-26T22:06:14.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6ae006c8f0 0x7f6ae006edb0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6afc0b3e50 0x7f6afc1416b0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6afc0d0300 0x7f6afc141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 --2- 172.21.15.137:0/435010639 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6afc06f340 0x7f6afc13f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 >> 172.21.15.137:0/435010639 conn(0x7f6afc0cd8a0 msgr2=0x7f6afc072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:14.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 shutdown_connections 2024-04-26T22:06:14.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.193+0000 7f6b0374e640 1 -- 172.21.15.137:0/435010639 wait complete. 2024-04-26T22:06:14.204 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:06:14.263 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:06:14.266 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:06:14.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.305+0000 7f7f6d852640 1 Processor -- start 2024-04-26T22:06:14.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.305+0000 7f7f6d852640 1 -- start start 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.305+0000 7f7f6d852640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7f6815d360 0x7f7f680d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.305+0000 7f7f6d852640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f6809c450 0x7f7f680ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f6d852640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f680d1510 0x7f7f680d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f6d852640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6815d740 con 0x7f7f680d1510 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f6d852640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7f680cda60 con 0x7f7f6815d360 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f6d852640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7f680d1100 con 0x7f7f6809c450 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f677fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f680d1510 0x7f7f680d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f677fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7f680d1510 0x7f7f680d19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59494/0 (socket says 172.21.15.137:59494) 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f677fe640 1 -- 172.21.15.137:0/2392509649 learned_addr learned my addr 172.21.15.137:0/2392509649 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f5ffff640 1 --2- 172.21.15.137:0/2392509649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f6809c450 0x7f7f680ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f66ffd640 1 --2- 172.21.15.137:0/2392509649 >> v2:172.21.15.170:3300/0 conn(0x7f7f6815d360 0x7f7f680d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f677fe640 1 -- 172.21.15.137:0/2392509649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f6809c450 msgr2=0x7f7f680ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:14.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f677fe640 1 --2- 172.21.15.137:0/2392509649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f6809c450 0x7f7f680ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f677fe640 1 -- 172.21.15.137:0/2392509649 >> v2:172.21.15.170:3300/0 conn(0x7f7f6815d360 msgr2=0x7f7f680d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f677fe640 1 --2- 172.21.15.137:0/2392509649 >> v2:172.21.15.170:3300/0 conn(0x7f7f6815d360 0x7f7f680d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.306+0000 7f7f677fe640 1 -- 172.21.15.137:0/2392509649 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f680cdd00 con 0x7f7f680d1510 2024-04-26T22:06:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f677fe640 1 --2- 172.21.15.137:0/2392509649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f680d1510 0x7f7f680d19a0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f7f68068ff0 tx=0x7f7f6002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8672a7ef09162d8a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f667fc640 1 -- 172.21.15.137:0/2392509649 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60036070 con 0x7f7f680d1510 2024-04-26T22:06:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f667fc640 1 -- 172.21.15.137:0/2392509649 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f60031600 con 0x7f7f680d1510 2024-04-26T22:06:14.308 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f667fc640 1 -- 172.21.15.137:0/2392509649 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f600319d0 con 0x7f7f680d1510 2024-04-26T22:06:14.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f6d852640 1 -- 172.21.15.137:0/2392509649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f680d1510 msgr2=0x7f7f680d19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f6d852640 1 --2- 172.21.15.137:0/2392509649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f680d1510 0x7f7f680d19a0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f7f68068ff0 tx=0x7f7f6002a6a0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f6d852640 1 -- 172.21.15.137:0/2392509649 shutdown_connections 2024-04-26T22:06:14.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f6d852640 1 --2- 172.21.15.137:0/2392509649 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f680d1510 0x7f7f680d19a0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f6d852640 1 --2- 172.21.15.137:0/2392509649 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f6809c450 0x7f7f680ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.307+0000 7f7f6d852640 1 --2- 172.21.15.137:0/2392509649 >> v2:172.21.15.170:3300/0 conn(0x7f7f6815d360 0x7f7f680d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.308+0000 7f7f6d852640 1 -- 172.21.15.137:0/2392509649 >> 172.21.15.137:0/2392509649 conn(0x7f7f680b4a40 msgr2=0x7f7f680b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:14.311 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.308+0000 7f7f6d852640 1 -- 172.21.15.137:0/2392509649 shutdown_connections 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.308+0000 7f7f6d852640 1 -- 172.21.15.137:0/2392509649 wait complete. 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f6d852640 1 Processor -- start 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f6d852640 1 -- start start 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f6d852640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6809c450 0x7f7f6815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f6d852640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f680d1510 0x7f7f68148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f6d852640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f6815d360 0x7f7f6815f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f6d852640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7f680ced20 con 0x7f7f6809c450 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f6d852640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6809c8b0 con 0x7f7f680d1510 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f6d852640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7f680ceea0 con 0x7f7f6815d360 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f66ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6809c450 0x7f7f6815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f66ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6809c450 0x7f7f6815e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59508/0 (socket says 172.21.15.137:59508) 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.309+0000 7f7f66ffd640 1 -- 172.21.15.137:0/4028061531 learned_addr learned my addr 172.21.15.137:0/4028061531 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f66ffd640 1 -- 172.21.15.137:0/4028061531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f6815d360 msgr2=0x7f7f6815f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f66ffd640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f6815d360 0x7f7f6815f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f66ffd640 1 -- 172.21.15.137:0/4028061531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f680d1510 msgr2=0x7f7f68148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f66ffd640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f680d1510 0x7f7f68148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f66ffd640 1 -- 172.21.15.137:0/4028061531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f68152660 con 0x7f7f6809c450 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f66ffd640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6809c450 0x7f7f6815e540 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800d800 tx=0x7f7f5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f64ff9640 1 -- 172.21.15.137:0/4028061531 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5800b6c0 con 0x7f7f6809c450 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f64ff9640 1 -- 172.21.15.137:0/4028061531 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58019070 con 0x7f7f6809c450 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6815fbc0 con 0x7f7f6809c450 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f64ff9640 1 -- 172.21.15.137:0/4028061531 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5800ba80 con 0x7f7f6809c450 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.310+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6815dd40 con 0x7f7f6809c450 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.311+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f680693d0 con 0x7f7f6809c450 2024-04-26T22:06:14.313 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.311+0000 7f7f64ff9640 1 -- 172.21.15.137:0/4028061531 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f5800bc20 con 0x7f7f6809c450 2024-04-26T22:06:14.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.312+0000 7f7f64ff9640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7f4806c8f0 0x7f7f4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.312+0000 7f7f5ffff640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7f4806c8f0 0x7f7f4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.312+0000 7f7f64ff9640 1 -- 172.21.15.137:0/4028061531 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f7f5808c000 con 0x7f7f6809c450 2024-04-26T22:06:14.314 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.312+0000 7f7f5ffff640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7f4806c8f0 0x7f7f4806edb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7f680c7290 tx=0x7f7f50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:14.316 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.316+0000 7f7f64ff9640 1 -- 172.21.15.137:0/4028061531 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7f58011340 con 0x7f7f6809c450 2024-04-26T22:06:14.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.507+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7f680d2c60 con 0x7f7f6809c450 2024-04-26T22:06:14.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.507+0000 7f7f64ff9640 1 -- 172.21.15.137:0/4028061531 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) ==== 80+0+0 (secure 0 0 0) 0x7f7f5805a430 con 0x7f7f6809c450 2024-04-26T22:06:14.507 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T22:06:14.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7f4806c8f0 msgr2=0x7f7f4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7f4806c8f0 0x7f7f4806edb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7f680c7290 tx=0x7f7f50008040 comp rx=0 tx=0).stop 2024-04-26T22:06:14.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6809c450 msgr2=0x7f7f6815e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6809c450 0x7f7f6815e540 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800d800 tx=0x7f7f5800dcc0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 shutdown_connections 2024-04-26T22:06:14.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7f4806c8f0 0x7f7f4806edb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7f6815d360 0x7f7f6815f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7f680d1510 0x7f7f68148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 --2- 172.21.15.137:0/4028061531 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7f6809c450 0x7f7f6815e540 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 >> 172.21.15.137:0/4028061531 conn(0x7f7f680b4a40 msgr2=0x7f7f6809bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:14.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 shutdown_connections 2024-04-26T22:06:14.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.509+0000 7f7f6d852640 1 -- 172.21.15.137:0/4028061531 wait complete. 2024-04-26T22:06:14.520 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:06:14.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:14.520 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:06:14.619 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:06:14.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:14.619 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:06:14.639 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:06:14.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.777+0000 7f4bf8be7640 1 Processor -- start 2024-04-26T22:06:14.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.777+0000 7f4bf8be7640 1 -- start start 2024-04-26T22:06:14.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.777+0000 7f4bf8be7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413ff70 0x7f4bf4146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf8be7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4bf40cff20 0x7f4bf41465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf8be7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bf40d05b0 con 0x7f4bf4140350 2024-04-26T22:06:14.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf8be7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4bf40d0390 con 0x7f4bf40cff20 2024-04-26T22:06:14.780 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf8be7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf40d0890 con 0x7f4bf413ff70 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bebfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4bf4140350 0x7f4bf40cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38184/0 (socket says 172.21.15.137:38184) 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bebfff640 1 -- 172.21.15.137:0/1632992263 learned_addr learned my addr 172.21.15.137:0/1632992263 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633877931 0 0) 0x7f4bf40d05b0 con 0x7f4bf4140350 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be0003520 con 0x7f4bf4140350 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf259c640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413ff70 0x7f4bf4146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf2d9d640 1 --2- 172.21.15.137:0/1632992263 >> v2:172.21.15.170:3300/0 conn(0x7f4bf40cff20 0x7f4bf41465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1487088362 0 0) 0x7f4be0003520 con 0x7f4bf4140350 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413ff70 msgr2=0x7f4bf4146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413ff70 0x7f4bf4146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 >> v2:172.21.15.170:3300/0 conn(0x7f4bf40cff20 msgr2=0x7f4bf41465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 --2- 172.21.15.137:0/1632992263 >> v2:172.21.15.170:3300/0 conn(0x7f4bf40cff20 0x7f4bf41465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf406e450 con 0x7f4bf4140350 2024-04-26T22:06:14.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f4bdc001670 con 0x7f4bf4140350 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 >> v1:172.21.15.137:6789/0 conn(0x7f4bf4140350 legacy=0x7f4bf40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be00039b0 0x7f4be0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4be0004800 0x7f4be0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413ff70 0x7f4be00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf40d0390 con 0x7f4be00039b0 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf40d0890 con 0x7f4be0004800 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4be000b9c0 con 0x7f4bf413ff70 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf259c640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be00039b0 0x7f4be0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bebfff640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4be0004800 0x7f4be0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.778+0000 7f4bf2d9d640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413ff70 0x7f4be00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.779+0000 7f4bf259c640 1 -- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413ff70 msgr2=0x7f4be00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:14.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.779+0000 7f4bf259c640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413ff70 0x7f4be00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.779+0000 7f4bf259c640 1 -- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4be0004800 msgr2=0x7f4be0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.779+0000 7f4bf259c640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4be0004800 0x7f4be0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.779+0000 7f4bf259c640 1 -- 172.21.15.137:0/1632992263 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be0003520 con 0x7f4be00039b0 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.779+0000 7f4bf259c640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be00039b0 0x7f4be0003dd0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009af0 tx=0x7f4be0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b24367ae0590e0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.779+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4036070 con 0x7f4be00039b0 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.779+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be4031400 con 0x7f4be00039b0 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.779+0000 7f4bf1d9b640 1 -- 172.21.15.137:0/1632992263 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4009690 con 0x7f4be00039b0 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.780+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1632992263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be00039b0 msgr2=0x7f4be0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.780+0000 7f4bf8be7640 1 --2- 172.21.15.137:0/1632992263 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4be00039b0 0x7f4be0003dd0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009af0 tx=0x7f4be0005830 comp rx=0 tx=0).stop 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.780+0000 7f4bf2d9d640 1 -- 172.21.15.137:0/1632992263 reap_dead start 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.780+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1632992263 shutdown_connections 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.780+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1632992263 >> 172.21.15.137:0/1632992263 conn(0x7f4bf40d0d30 msgr2=0x7f4bf40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:14.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.780+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1632992263 shutdown_connections 2024-04-26T22:06:14.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.780+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1632992263 wait complete. 2024-04-26T22:06:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.781+0000 7f4bf8be7640 1 Processor -- start 2024-04-26T22:06:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.781+0000 7f4bf8be7640 1 -- start start 2024-04-26T22:06:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf8be7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4be00039b0 0x7f4bf41e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf8be7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413b270 0x7f4bf41e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf8be7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf41e8300 0x7f4bf41e59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf8be7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf4146200 con 0x7f4bf41e8300 2024-04-26T22:06:14.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf8be7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf4146080 con 0x7f4be00039b0 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf8be7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4bf4146380 con 0x7f4bf413b270 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf2d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf41e8300 0x7f4bf41e59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf2d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf41e8300 0x7f4bf41e59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59532/0 (socket says 172.21.15.137:59532) 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf2d9d640 1 -- 172.21.15.137:0/1534275918 learned_addr learned my addr 172.21.15.137:0/1534275918 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf2d9d640 1 -- 172.21.15.137:0/1534275918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413b270 msgr2=0x7f4bf41e7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf259c640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4be00039b0 0x7f4bf41e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bebfff640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413b270 0x7f4bf41e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf2d9d640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413b270 0x7f4bf41e7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf2d9d640 1 -- 172.21.15.137:0/1534275918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4be00039b0 msgr2=0x7f4bf41e77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf2d9d640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4be00039b0 0x7f4bf41e77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.782+0000 7f4bf2d9d640 1 -- 172.21.15.137:0/1534275918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf41e6740 con 0x7f4bf41e8300 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.783+0000 7f4bf2d9d640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf41e8300 0x7f4bf41e59a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40b4090 tx=0x7f4bec00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.783+0000 7f4beaffd640 1 -- 172.21.15.137:0/1534275918 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec015430 con 0x7f4bf41e8300 2024-04-26T22:06:14.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.783+0000 7f4beaffd640 1 -- 172.21.15.137:0/1534275918 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bec01d070 con 0x7f4bf41e8300 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.783+0000 7f4beaffd640 1 -- 172.21.15.137:0/1534275918 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec015830 con 0x7f4bf41e8300 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.783+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf41e6a20 con 0x7f4bf41e8300 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.783+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf41e6fe0 con 0x7f4bf41e8300 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.784+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf413b650 con 0x7f4bf41e8300 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.784+0000 7f4beaffd640 1 -- 172.21.15.137:0/1534275918 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4bec0159d0 con 0x7f4bf41e8300 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.784+0000 7f4beaffd640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd406c8f0 0x7f4bd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.785+0000 7f4beaffd640 1 -- 172.21.15.137:0/1534275918 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f4bec08c480 con 0x7f4bf41e8300 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.785+0000 7f4bf259c640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd406c8f0 0x7f4bd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.785+0000 7f4bf259c640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd406c8f0 0x7f4bd406edb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4be4033000 tx=0x7f4be4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:14.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:14.789+0000 7f4beaffd640 1 -- 172.21.15.137:0/1534275918 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4bec010040 con 0x7f4bf41e8300 2024-04-26T22:06:15.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.000+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bf406a290 con 0x7f4bf41e8300 2024-04-26T22:06:15.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.000+0000 7f4beaffd640 1 -- 172.21.15.137:0/1534275918 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5195 (secure 0 0 0) 0x7f4bec05a8b0 con 0x7f4bf41e8300 2024-04-26T22:06:15.000 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:15.000 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":66,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8223,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1187927282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1187927282},{"type":"v1","addr":"172.21.15.137:6836","nonce":1187927282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:06:03.956752+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"b","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6835/2219855149","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2219855149},{"type":"v1","addr":"172.21.15.170:6835","nonce":2219855149}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8232,"qdb_cluster":[8232]},"id":7}]} 2024-04-26T22:06:15.001 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 66 2024-04-26T22:06:15.002 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd406c8f0 msgr2=0x7f4bd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd406c8f0 0x7f4bd406edb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4be4033000 tx=0x7f4be4008030 comp rx=0 tx=0).stop 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf41e8300 msgr2=0x7f4bf41e59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf41e8300 0x7f4bf41e59a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40b4090 tx=0x7f4bec00f580 comp rx=0 tx=0).stop 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 shutdown_connections 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4bd406c8f0 0x7f4bd406edb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4bf41e8300 0x7f4bf41e59a0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4bf413b270 0x7f4bf41e7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 --2- 172.21.15.137:0/1534275918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4be00039b0 0x7f4bf41e77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 >> 172.21.15.137:0/1534275918 conn(0x7f4bf40d0d30 msgr2=0x7f4bf40b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 shutdown_connections 2024-04-26T22:06:15.003 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.002+0000 7f4bf8be7640 1 -- 172.21.15.137:0/1534275918 wait complete. 2024-04-26T22:06:15.013 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-26T22:06:15.143 INFO:teuthology.orchestra.run.smithi170.stdout:{"message":"","return_code":0} 2024-04-26T22:06:15.144 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-26T22:06:15.144 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:06:15.144 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:06:15.160 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:06:15.160 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:06:15.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:15.160 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:06:15.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:06:15.214 INFO:teuthology.orchestra.run.smithi137.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-26T22:06:15.215 DEBUG:teuthology.orchestra.run.smithi137:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-26T22:06:15.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:15.257 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-26T22:06:15.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.358+0000 7f42e4215640 1 Processor -- start 2024-04-26T22:06:15.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.359+0000 7f42e4215640 1 -- start start 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.359+0000 7f42e4215640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f42dc146a40 0x7f42dc0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.359+0000 7f42e4215640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42dc0d0220 0x7f42dc0d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.359+0000 7f42e4215640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42dc160e80 con 0x7f42dc0b5190 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.359+0000 7f42e4215640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f42dc161160 con 0x7f42dc0d0220 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.359+0000 7f42e4215640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f42dc161440 con 0x7f42dc146a40 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.359+0000 7f42e27b2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42dc0d0220 0x7f42dc0d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.360+0000 7f42e27b2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42dc0d0220 0x7f42dc0d1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59536/0 (socket says 172.21.15.137:59536) 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.360+0000 7f42e27b2640 1 -- 172.21.15.137:0/3303224826 learned_addr learned my addr 172.21.15.137:0/3303224826 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.360+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/3303224826 >> v2:172.21.15.170:3300/0 conn(0x7f42dc146a40 0x7f42dc0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.360+0000 7f42e27b2640 1 -- 172.21.15.137:0/3303224826 >> v2:172.21.15.170:3300/0 conn(0x7f42dc146a40 msgr2=0x7f42dc0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.360+0000 7f42e27b2640 1 --2- 172.21.15.137:0/3303224826 >> v2:172.21.15.170:3300/0 conn(0x7f42dc146a40 0x7f42dc0b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.360+0000 7f42e27b2640 1 -- 172.21.15.137:0/3303224826 >> v1:172.21.15.170:6789/0 conn(0x7f42dc0b5190 legacy=0x7f42dc0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.360+0000 7f42e0faf640 1 -- 172.21.15.137:0/3303224826 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302368267 0 0) 0x7f42dc160e80 con 0x7f42dc0b5190 2024-04-26T22:06:15.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.360+0000 7f42e27b2640 1 -- 172.21.15.137:0/3303224826 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc161720 con 0x7f42dc0d0220 2024-04-26T22:06:15.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.360+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/3303224826 >> v2:172.21.15.170:3300/0 conn(0x7f42dc146a40 0x7f42dc0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:06:15.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e27b2640 1 --2- 172.21.15.137:0/3303224826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 0x7f42dc0d1c00 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0d2ff0 tx=0x7f42d802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9819244654d6f770 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e0faf640 1 -- 172.21.15.137:0/3303224826 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d8036070 con 0x7f42dc0d0220 2024-04-26T22:06:15.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e0faf640 1 -- 172.21.15.137:0/3303224826 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d8031600 con 0x7f42dc0d0220 2024-04-26T22:06:15.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e0faf640 1 -- 172.21.15.137:0/3303224826 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d80319d0 con 0x7f42dc0d0220 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e4215640 1 -- 172.21.15.137:0/3303224826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 msgr2=0x7f42dc0d1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e4215640 1 --2- 172.21.15.137:0/3303224826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 0x7f42dc0d1c00 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f42dc0d2ff0 tx=0x7f42d802a6a0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e4215640 1 -- 172.21.15.137:0/3303224826 shutdown_connections 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e4215640 1 --2- 172.21.15.137:0/3303224826 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 0x7f42dc0d1c00 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e4215640 1 --2- 172.21.15.137:0/3303224826 >> v2:172.21.15.170:3300/0 conn(0x7f42dc146a40 0x7f42dc0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.361+0000 7f42e4215640 1 -- 172.21.15.137:0/3303224826 >> 172.21.15.137:0/3303224826 conn(0x7f42dc06c960 msgr2=0x7f42dc0b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.362+0000 7f42e4215640 1 -- 172.21.15.137:0/3303224826 shutdown_connections 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.362+0000 7f42e4215640 1 -- 172.21.15.137:0/3303224826 wait complete. 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.363+0000 7f42e4215640 1 Processor -- start 2024-04-26T22:06:15.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.363+0000 7f42e4215640 1 -- start start 2024-04-26T22:06:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.363+0000 7f42e4215640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42dc0b5190 0x7f42dc15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.363+0000 7f42e4215640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 0x7f42dc140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.363+0000 7f42e4215640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42dc146a40 0x7f42dc13f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.363+0000 7f42e4215640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc0d22c0 con 0x7f42dc0d0220 2024-04-26T22:06:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.363+0000 7f42e4215640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc0d2140 con 0x7f42dc146a40 2024-04-26T22:06:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.363+0000 7f42e4215640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42dc0d2440 con 0x7f42dc0b5190 2024-04-26T22:06:15.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.363+0000 7f42e17b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 0x7f42dc140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e17b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 0x7f42dc140ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59538/0 (socket says 172.21.15.137:59538) 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e17b0640 1 -- 172.21.15.137:0/1797820634 learned_addr learned my addr 172.21.15.137:0/1797820634 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e27b2640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42dc146a40 0x7f42dc13f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42dc0b5190 0x7f42dc15cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e17b0640 1 -- 172.21.15.137:0/1797820634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42dc0b5190 msgr2=0x7f42dc15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e17b0640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42dc0b5190 0x7f42dc15cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e17b0640 1 -- 172.21.15.137:0/1797820634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42dc146a40 msgr2=0x7f42dc13f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e17b0640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42dc146a40 0x7f42dc13f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e17b0640 1 -- 172.21.15.137:0/1797820634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc0ccc20 con 0x7f42dc0d0220 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e17b0640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 0x7f42dc140ab0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00c4b0 tx=0x7f42cc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42d27fc640 1 -- 172.21.15.137:0/1797820634 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc017070 con 0x7f42dc0d0220 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42d27fc640 1 -- 172.21.15.137:0/1797820634 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc005480 con 0x7f42dc0d0220 2024-04-26T22:06:15.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e4215640 1 -- 172.21.15.137:0/1797820634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42dc06df90 con 0x7f42dc0d0220 2024-04-26T22:06:15.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42d27fc640 1 -- 172.21.15.137:0/1797820634 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc003830 con 0x7f42dc0d0220 2024-04-26T22:06:15.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.364+0000 7f42e4215640 1 -- 172.21.15.137:0/1797820634 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc0ccee0 con 0x7f42dc0d0220 2024-04-26T22:06:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.366+0000 7f42d27fc640 1 -- 172.21.15.137:0/1797820634 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42cc01a070 con 0x7f42dc0d0220 2024-04-26T22:06:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.366+0000 7f42d27fc640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42c006c8f0 0x7f42c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.366+0000 7f42d27fc640 1 -- 172.21.15.137:0/1797820634 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f42cc08af30 con 0x7f42dc0d0220 2024-04-26T22:06:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.366+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42c006c8f0 0x7f42c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.367+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42c006c8f0 0x7f42c006edb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009560 tx=0x7f42d4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.367+0000 7f42e7008740 1 Processor -- start 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.367+0000 7f42e7008740 1 -- start start 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e7008740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x560743130960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e7008740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x560743160470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e7008740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431609b0 0x5607431357c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e7008740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56074309ab00 con 0x5607431610f0 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e7008740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x560743036920 con 0x56074317dfd0 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e7008740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560743096ac0 con 0x5607431609b0 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e17b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x560743160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e17b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x560743160470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59540/0 (socket says 172.21.15.137:59540) 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e17b0640 1 -- 172.21.15.137:0/1369869731 learned_addr learned my addr 172.21.15.137:0/1369869731 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x560743130960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e27b2640 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431609b0 0x5607431357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e17b0640 1 -- 172.21.15.137:0/1369869731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431609b0 msgr2=0x5607431357c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e17b0640 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431609b0 0x5607431357c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e17b0640 1 -- 172.21.15.137:0/1369869731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 msgr2=0x560743130960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e17b0640 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x560743130960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e17b0640 1 -- 172.21.15.137:0/1369869731 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560742e747e0 con 0x5607431610f0 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.368+0000 7f42e27b2640 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431609b0 0x5607431357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e17b0640 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x560743160470 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f42cc061310 tx=0x7f42cc05d0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709a56f887200914 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42bf7fe640 1 -- 172.21.15.137:0/1369869731 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc071120 con 0x5607431610f0 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42bf7fe640 1 -- 172.21.15.137:0/1369869731 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc0552f0 con 0x5607431610f0 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42bf7fe640 1 -- 172.21.15.137:0/1369869731 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0615d0 con 0x5607431610f0 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e7008740 1 -- 172.21.15.137:0/1369869731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 msgr2=0x560743160470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e7008740 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x560743160470 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f42cc061310 tx=0x7f42cc05d0c0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e7008740 1 -- 172.21.15.137:0/1369869731 shutdown_connections 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e7008740 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x560743160470 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e7008740 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431609b0 0x5607431357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e7008740 1 --2- 172.21.15.137:0/1369869731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x560743130960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e7008740 1 -- 172.21.15.137:0/1369869731 >> 172.21.15.137:0/1369869731 conn(0x560743132bd0 msgr2=0x56074317b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e7008740 1 -- 172.21.15.137:0/1369869731 shutdown_connections 2024-04-26T22:06:15.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.369+0000 7f42e7008740 1 -- 172.21.15.137:0/1369869731 wait complete. 2024-04-26T22:06:15.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.370+0000 7f42e7008740 1 -- start start 2024-04-26T22:06:15.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.370+0000 7f42e7008740 1 Processor -- start 2024-04-26T22:06:15.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e7008740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5607431610f0 0x5607431615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e7008740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074317dfd0 0x56074317c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e7008740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 0x56074314d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e7008740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x560743134d80 con 0x56074317dfd0 2024-04-26T22:06:15.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e7008740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5607430345d0 con 0x5607431610f0 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e7008740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x560743134170 con 0x560743172130 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e7008740 10 client.0 _ll_register_callbacks cb 0x560743022080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e17b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074317dfd0 0x56074317c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e1fb1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5607431610f0 0x5607431615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e17b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074317dfd0 0x56074317c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59554/0 (socket says 172.21.15.137:59554) 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e27b2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 0x56074314d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e17b0640 1 -- 172.21.15.137:0/4083279694 learned_addr learned my addr 172.21.15.137:0/4083279694 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e1fb1640 1 -- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 msgr2=0x56074314d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 0x56074314d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e1fb1640 1 -- 172.21.15.137:0/4083279694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074317dfd0 msgr2=0x56074317c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074317dfd0 0x56074317c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.371+0000 7f42e1fb1640 1 -- 172.21.15.137:0/4083279694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560742ed4f70 con 0x5607431610f0 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5607431610f0 0x5607431615e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f42d4011fb0 tx=0x7f42d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7b775d77c58206e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42bcff9640 1 -- 172.21.15.137:0/4083279694 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4026070 con 0x5607431610f0 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42bcff9640 1 -- 172.21.15.137:0/4083279694 <== mon.1 v2:172.21.15.170:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f42d4003da0 con 0x5607431610f0 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e7008740 1 -- 172.21.15.137:0/4083279694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42cc0552f0 con 0x5607431610f0 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42bcff9640 1 -- 172.21.15.137:0/4083279694 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f42d4031050 con 0x5607431610f0 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e7008740 10 client.7108 fetch_fsmap learned FSMap version 66 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e7008740 1 -- 172.21.15.137:0/4083279694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x560742d6c170 con 0x5607431610f0 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42bcff9640 1 -- 172.21.15.137:0/4083279694 <== mon.1 v2:172.21.15.170:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc0552f0 con 0x5607431610f0 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42bcff9640 1 -- 172.21.15.137:0/4083279694 <== mon.1 v2:172.21.15.170:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f42d4034020 con 0x5607431610f0 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e7008740 10 client.7108 fetch_fsmap finished waiting for FSMap version 66 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e7008740 10 client.7108 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e7008740 20 client.7108 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e7008740 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x56074318eb20 0x56074318ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e7008740 4 client.7108 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:06:15.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.372+0000 7f42e7008740 1 -- 172.21.15.137:0/4083279694 --> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607430a8710 con 0x56074318eb20 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.373+0000 7f42e17b0640 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x56074318eb20 0x56074318ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.373+0000 7f42bcff9640 10 client.7108 ms_handle_connect on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.373+0000 7f42e17b0640 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x56074318eb20 0x56074318ef50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d2f7cce7c9987d8 server_cookie=92d9d3c5ea57eb69 in_seq=0 out_seq=0 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.373+0000 7f42bcff9640 1 -- 172.21.15.137:0/4083279694 <== mds.0 v2:172.21.15.170:6832/2219855149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5607430a8710 con 0x56074318eb20 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.373+0000 7f42bcff9640 10 client.7108 handle_command_reply: tid=0 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 client.7108 shutdown 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 -- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5607431610f0 msgr2=0x5607431615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5607431610f0 0x5607431615e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f42d4011fb0 tx=0x7f42d40046c0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 -- 172.21.15.137:0/4083279694 shutdown_connections 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x56074318eb20 0x56074318ef50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x56074317dfd0 0x56074317c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 0x56074314d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42bcff9640 0 client.7108 ms_handle_reset on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:15.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 --2- 172.21.15.137:0/4083279694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5607431610f0 0x5607431615e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 -- 172.21.15.137:0/4083279694 >> 172.21.15.137:0/4083279694 conn(0x5607431609b0 msgr2=0x560743135210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 -- 172.21.15.137:0/4083279694 shutdown_connections 2024-04-26T22:06:15.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 1 -- 172.21.15.137:0/4083279694 wait complete. 2024-04-26T22:06:15.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.374+0000 7f42e7008740 20 client.7108 trim_cache size 0 max 16384 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.378+0000 7fb9604b0640 1 Processor -- start 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.378+0000 7fb9604b0640 1 -- start start 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb9604b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb95815f5a0 0x7fb9580d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb9604b0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb9580d0e20 0x7fb9580d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb9604b0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9580d5dc0 con 0x7fb9580b4160 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb9604b0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb9580d3640 con 0x7fb9580d0e20 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb9604b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb9580d60a0 con 0x7fb95815f5a0 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95ea4d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb9580d0e20 0x7fb9580d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95e24c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb95815f5a0 0x7fb9580d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95ea4d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb9580d0e20 0x7fb9580d3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:34588/0 (socket says 172.21.15.137:34588) 2024-04-26T22:06:15.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95ea4d640 1 -- 172.21.15.137:0/2234706274 learned_addr learned my addr 172.21.15.137:0/2234706274 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95da4b640 1 --1- 172.21.15.137:0/2234706274 >> v1:172.21.15.170:6789/0 conn(0x7fb9580b4160 0x7fb9580b4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:52266/0 (socket says 172.21.15.137:52266) 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95e24c640 1 --2- 172.21.15.137:0/2234706274 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb95815f5a0 0x7fb9580d37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:55946/0 (socket says 172.21.15.137:55946) 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95ea4d640 1 -- 172.21.15.137:0/2234706274 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb95815f5a0 msgr2=0x7fb9580d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95ea4d640 1 --2- 172.21.15.137:0/2234706274 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb95815f5a0 0x7fb9580d37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95ea4d640 1 -- 172.21.15.137:0/2234706274 >> v1:172.21.15.170:6789/0 conn(0x7fb9580b4160 legacy=0x7fb9580b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95ea4d640 1 -- 172.21.15.137:0/2234706274 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9580d3080 con 0x7fb9580d0e20 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95d24a640 1 -- 172.21.15.137:0/2234706274 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1992363234 0 0) 0x7fb9580d5dc0 con 0x7fb9580b4160 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.379+0000 7fb95e24c640 1 --2- 172.21.15.137:0/2234706274 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb95815f5a0 0x7fb9580d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.380+0000 7fb95ea4d640 1 --2- 172.21.15.137:0/2234706274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9580d0e20 0x7fb9580d3d20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb950009e50 tx=0x7fb95002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d585ce9f3175bdd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.380+0000 7fb95d24a640 1 -- 172.21.15.137:0/2234706274 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950036070 con 0x7fb9580d0e20 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.380+0000 7fb95d24a640 1 -- 172.21.15.137:0/2234706274 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb950031600 con 0x7fb9580d0e20 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.380+0000 7fb95d24a640 1 -- 172.21.15.137:0/2234706274 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9500319d0 con 0x7fb9580d0e20 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.381+0000 7fb9604b0640 1 -- 172.21.15.137:0/2234706274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9580d0e20 msgr2=0x7fb9580d3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.381+0000 7fb9604b0640 1 --2- 172.21.15.137:0/2234706274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9580d0e20 0x7fb9580d3d20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb950009e50 tx=0x7fb95002a710 comp rx=0 tx=0).stop 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.381+0000 7fb9604b0640 1 -- 172.21.15.137:0/2234706274 shutdown_connections 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.381+0000 7fb9604b0640 1 --2- 172.21.15.137:0/2234706274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9580d0e20 0x7fb9580d3d20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.381+0000 7fb9604b0640 1 --2- 172.21.15.137:0/2234706274 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb95815f5a0 0x7fb9580d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.381+0000 7fb9604b0640 1 -- 172.21.15.137:0/2234706274 >> 172.21.15.137:0/2234706274 conn(0x7fb9580d5200 msgr2=0x7fb9580d5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.381+0000 7fb9604b0640 1 -- 172.21.15.137:0/2234706274 shutdown_connections 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.381+0000 7fb9604b0640 1 -- 172.21.15.137:0/2234706274 wait complete. 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.382+0000 7fb9604b0640 1 Processor -- start 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.382+0000 7fb9604b0640 1 -- start start 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb9604b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9580b4160 0x7fb9581e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb9604b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9580d0e20 0x7fb9580ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb9604b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb95815f5a0 0x7fb9580cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb9604b0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb9580d2500 con 0x7fb95815f5a0 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb9604b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb9580d3360 con 0x7fb9580d0e20 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb9604b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb95815f980 con 0x7fb9580b4160 2024-04-26T22:06:15.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95ea4d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb95815f5a0 0x7fb9580cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95ea4d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb95815f5a0 0x7fb9580cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59568/0 (socket says 172.21.15.137:59568) 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95ea4d640 1 -- 172.21.15.137:0/3529175223 learned_addr learned my addr 172.21.15.137:0/3529175223 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95da4b640 1 --2- 172.21.15.137:0/3529175223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9580d0e20 0x7fb9580ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95e24c640 1 --2- 172.21.15.137:0/3529175223 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9580b4160 0x7fb9581e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95ea4d640 1 -- 172.21.15.137:0/3529175223 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9580b4160 msgr2=0x7fb9581e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95ea4d640 1 --2- 172.21.15.137:0/3529175223 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb9580b4160 0x7fb9581e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95ea4d640 1 -- 172.21.15.137:0/3529175223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9580d0e20 msgr2=0x7fb9580ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95ea4d640 1 --2- 172.21.15.137:0/3529175223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9580d0e20 0x7fb9580ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95ea4d640 1 -- 172.21.15.137:0/3529175223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95815c700 con 0x7fb95815f5a0 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb95ea4d640 1 --2- 172.21.15.137:0/3529175223 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb95815f5a0 0x7fb9580cec90 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb950009e50 tx=0x7fb950004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.383+0000 7fb94effd640 1 -- 172.21.15.137:0/3529175223 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950041070 con 0x7fb95815f5a0 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.384+0000 7fb94effd640 1 -- 172.21.15.137:0/3529175223 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb950003990 con 0x7fb95815f5a0 2024-04-26T22:06:15.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.384+0000 7fb94effd640 1 -- 172.21.15.137:0/3529175223 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950036040 con 0x7fb95815f5a0 2024-04-26T22:06:15.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.384+0000 7fb9604b0640 1 -- 172.21.15.137:0/3529175223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9580b7f60 con 0x7fb95815f5a0 2024-04-26T22:06:15.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.384+0000 7fb9604b0640 1 -- 172.21.15.137:0/3529175223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9580b8520 con 0x7fb95815f5a0 2024-04-26T22:06:15.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.384+0000 7fb9604b0640 1 -- 172.21.15.137:0/3529175223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fb9580bb0c0 con 0x7fb95815f5a0 2024-04-26T22:06:15.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.385+0000 7fb94effd640 1 -- 172.21.15.137:0/3529175223 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb950007820 con 0x7fb95815f5a0 2024-04-26T22:06:15.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.386+0000 7fb94effd640 1 --2- 172.21.15.137:0/3529175223 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb93c06c8f0 0x7fb93c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.386+0000 7fb95e24c640 1 --2- 172.21.15.137:0/3529175223 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb93c06c8f0 0x7fb93c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.386+0000 7fb94effd640 1 -- 172.21.15.137:0/3529175223 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fb9500ad280 con 0x7fb95815f5a0 2024-04-26T22:06:15.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.386+0000 7fb94effd640 1 -- 172.21.15.137:0/3529175223 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+512 (secure 0 0 0) 0x7fb9580bb0c0 con 0x7fb95815f5a0 2024-04-26T22:06:15.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.386+0000 7fb9604b0640 1 -- 172.21.15.137:0/3529175223 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7fb95806a290 con 0x7fb95815f5a0 2024-04-26T22:06:15.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.386+0000 7fb95e24c640 1 --2- 172.21.15.137:0/3529175223 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb93c06c8f0 0x7fb93c06edb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb948009560 tx=0x7fb948009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.393+0000 7f42e7008740 1 Processor -- start 2024-04-26T22:06:15.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.393+0000 7f42e7008740 1 -- start start 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e7008740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x56074319f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e7008740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 0x56074317c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e7008740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x56074317e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e7008740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc201620 con 0x5607431610f0 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e7008740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc2006e0 con 0x56074317dfd0 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e7008740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f42dc1f8680 con 0x560743172130 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e1fb1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x56074319f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e1fb1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x56074319f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59572/0 (socket says 172.21.15.137:59572) 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e1fb1640 1 -- 172.21.15.137:0/2777014352 learned_addr learned my addr 172.21.15.137:0/2777014352 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e17b0640 1 --2- 172.21.15.137:0/2777014352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 0x56074317c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e27b2640 1 --2- 172.21.15.137:0/2777014352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x56074317e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e1fb1640 1 -- 172.21.15.137:0/2777014352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 msgr2=0x56074317c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/2777014352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 0x56074317c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e1fb1640 1 -- 172.21.15.137:0/2777014352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 msgr2=0x56074317e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/2777014352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x56074317e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e1fb1640 1 -- 172.21.15.137:0/2777014352 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56074318e520 con 0x5607431610f0 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.394+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/2777014352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x56074319f470 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f42d4006c10 tx=0x7f42d401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0ff6d9c5f2b05f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42beffd640 1 -- 172.21.15.137:0/2777014352 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4026070 con 0x5607431610f0 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42beffd640 1 -- 172.21.15.137:0/2777014352 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d403a070 con 0x5607431610f0 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42beffd640 1 -- 172.21.15.137:0/2777014352 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d402ba60 con 0x5607431610f0 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42e7008740 1 -- 172.21.15.137:0/2777014352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 msgr2=0x56074319f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42e7008740 1 --2- 172.21.15.137:0/2777014352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x56074319f470 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f42d4006c10 tx=0x7f42d401d000 comp rx=0 tx=0).stop 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42e7008740 1 -- 172.21.15.137:0/2777014352 shutdown_connections 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42e7008740 1 --2- 172.21.15.137:0/2777014352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x56074317e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42e7008740 1 --2- 172.21.15.137:0/2777014352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x560743172130 0x56074317c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42e7008740 1 --2- 172.21.15.137:0/2777014352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5607431610f0 0x56074319f470 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42e7008740 1 -- 172.21.15.137:0/2777014352 >> 172.21.15.137:0/2777014352 conn(0x5607431609b0 msgr2=0x560743174500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42e7008740 1 -- 172.21.15.137:0/2777014352 shutdown_connections 2024-04-26T22:06:15.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.395+0000 7f42e7008740 1 -- 172.21.15.137:0/2777014352 wait complete. 2024-04-26T22:06:15.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.396+0000 7f42e7008740 1 -- start start 2024-04-26T22:06:15.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.396+0000 7f42e7008740 1 Processor -- start 2024-04-26T22:06:15.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e7008740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431610f0 0x56074318a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e7008740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560743172130 0x5607431fec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e7008740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x5607431f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e7008740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x56074317f850 con 0x560743172130 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e7008740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc1f8cd0 con 0x56074317dfd0 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e7008740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56074301fa60 con 0x5607431610f0 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e7008740 10 client.0 _ll_register_callbacks cb 0x7f42d4011c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e17b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560743172130 0x5607431fec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e17b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560743172130 0x5607431fec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59576/0 (socket says 172.21.15.137:59576) 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e17b0640 1 -- 172.21.15.137:0/1919751949 learned_addr learned my addr 172.21.15.137:0/1919751949 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431610f0 0x56074318a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e27b2640 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x5607431f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e17b0640 1 -- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431610f0 msgr2=0x56074318a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e17b0640 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431610f0 0x56074318a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e17b0640 1 -- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 msgr2=0x5607431f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e17b0640 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x5607431f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e17b0640 1 -- 172.21.15.137:0/1919751949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56074319ecc0 con 0x560743172130 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42e17b0640 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560743172130 0x5607431fec60 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0011e0 tx=0x7f42cc014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c4c7edeb319c2f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.397+0000 7f42bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42bcff9640 1 -- 172.21.15.137:0/1919751949 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc057040 con 0x560743172130 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42bcff9640 1 -- 172.21.15.137:0/1919751949 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f42cc0613b0 con 0x560743172130 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e7008740 1 -- 172.21.15.137:0/1919751949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42d403a070 con 0x560743172130 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42bcff9640 1 -- 172.21.15.137:0/1919751949 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f42cc0615b0 con 0x560743172130 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e7008740 10 client.8487 fetch_fsmap learned FSMap version 66 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e7008740 1 -- 172.21.15.137:0/1919751949 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x5607431fe110 con 0x560743172130 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42bcff9640 1 -- 172.21.15.137:0/1919751949 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d403a070 con 0x560743172130 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42bcff9640 1 -- 172.21.15.137:0/1919751949 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f42cc0580d0 con 0x560743172130 2024-04-26T22:06:15.403 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e7008740 10 client.8487 fetch_fsmap finished waiting for FSMap version 66 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e7008740 10 client.8487 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e7008740 20 client.8487 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e7008740 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x56074319dfd0 0x560743179000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e7008740 4 client.8487 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e7008740 1 -- 172.21.15.137:0/1919751949 --> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x5607430a2580 con 0x56074319dfd0 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x56074319dfd0 0x560743179000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.398+0000 7f42bcff9640 10 client.8487 ms_handle_connect on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e1fb1640 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x56074319dfd0 0x560743179000 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc487cf324e7d946 server_cookie=78f0805c87363489 in_seq=0 out_seq=0 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42bcff9640 1 -- 172.21.15.137:0/1919751949 <== mds.0 v2:172.21.15.170:6832/2219855149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5607430a2580 con 0x56074319dfd0 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42bcff9640 10 client.8487 handle_command_reply: tid=0 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 client.8487 shutdown 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 -- 172.21.15.137:0/1919751949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560743172130 msgr2=0x5607431fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560743172130 0x5607431fec60 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0011e0 tx=0x7f42cc014040 comp rx=0 tx=0).stop 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 -- 172.21.15.137:0/1919751949 shutdown_connections 2024-04-26T22:06:15.404 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x56074319dfd0 0x560743179000 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x560743172130 0x5607431fec60 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56074317dfd0 0x5607431f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 --2- 172.21.15.137:0/1919751949 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5607431610f0 0x56074318a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 -- 172.21.15.137:0/1919751949 >> 172.21.15.137:0/1919751949 conn(0x5607431609b0 msgr2=0x56074315c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42bcff9640 0 client.8487 ms_handle_reset on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.399+0000 7f42e7008740 1 -- 172.21.15.137:0/1919751949 shutdown_connections 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e7008740 1 -- 172.21.15.137:0/1919751949 wait complete. 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e7008740 20 client.8487 trim_cache size 0 max 16384 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:06:15.405 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "26282181-90a6-409f-8df6-cb0304f879f5", 2024-04-26T22:06:15.406 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:06:15.406 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:06:15.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 -- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42c006c8f0 msgr2=0x7f42c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42c006c8f0 0x7f42c006edb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009560 tx=0x7f42d4009190 comp rx=0 tx=0).stop 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 -- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 msgr2=0x7f42dc140ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 0x7f42dc140ab0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00c4b0 tx=0x7f42cc00c970 comp rx=0 tx=0).stop 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 -- 172.21.15.137:0/1797820634 shutdown_connections 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f42c006c8f0 0x7f42c006edb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42dc0d0220 0x7f42dc140ab0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f42dc146a40 0x7f42dc13f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 --2- 172.21.15.137:0/1797820634 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42dc0b5190 0x7f42dc15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 -- 172.21.15.137:0/1797820634 >> 172.21.15.137:0/1797820634 conn(0x7f42dc06c960 msgr2=0x7f42dc075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 -- 172.21.15.137:0/1797820634 shutdown_connections 2024-04-26T22:06:15.407 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.400+0000 7f42e4215640 1 -- 172.21.15.137:0/1797820634 wait complete. 2024-04-26T22:06:15.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:15.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-26T22:06:15.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.508+0000 7f26bbcf1640 1 Processor -- start 2024-04-26T22:06:15.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.509+0000 7f26bbcf1640 1 -- start start 2024-04-26T22:06:15.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.509+0000 7f26bbcf1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b415f680 0x7f26b40d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.509+0000 7f26bbcf1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f26b40d4f20 0x7f26b40d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.509+0000 7f26bbcf1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b40d58f0 con 0x7f26b4163aa0 2024-04-26T22:06:15.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.509+0000 7f26bbcf1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f26b415fa60 con 0x7f26b40d4f20 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.509+0000 7f26bbcf1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f26b40d3f50 con 0x7f26b415f680 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26b928c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f26b4163aa0 0x7f26b40b5b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:38200/0 (socket says 172.21.15.137:38200) 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26b928c640 1 -- 172.21.15.137:0/3791420615 learned_addr learned my addr 172.21.15.137:0/3791420615 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26ba28e640 1 --2- 172.21.15.137:0/3791420615 >> v2:172.21.15.170:3300/0 conn(0x7f26b40d4f20 0x7f26b40d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/3791420615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b415f680 0x7f26b40d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26b8a8b640 1 -- 172.21.15.137:0/3791420615 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991047857 0 0) 0x7f26b40d58f0 con 0x7f26b4163aa0 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26b8a8b640 1 -- 172.21.15.137:0/3791420615 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26a0003520 con 0x7f26b4163aa0 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26ba28e640 1 -- 172.21.15.137:0/3791420615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b415f680 msgr2=0x7f26b40d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26ba28e640 1 --2- 172.21.15.137:0/3791420615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b415f680 0x7f26b40d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26ba28e640 1 -- 172.21.15.137:0/3791420615 >> v1:172.21.15.137:6789/0 conn(0x7f26b4163aa0 legacy=0x7f26b40b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26b8a8b640 1 -- 172.21.15.137:0/3791420615 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2706788844 0 0) 0x7f26a0003520 con 0x7f26b4163aa0 2024-04-26T22:06:15.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.510+0000 7f26ba28e640 1 -- 172.21.15.137:0/3791420615 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b40b5090 con 0x7f26b40d4f20 2024-04-26T22:06:15.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.511+0000 7f26ba28e640 1 --2- 172.21.15.137:0/3791420615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26b40d4f20 0x7f26b40d53b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009d90 tx=0x7f26ac02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0c9c07397cfe0f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.511+0000 7f26b8a8b640 1 -- 172.21.15.137:0/3791420615 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac007740 con 0x7f26b40d4f20 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.511+0000 7f26b8a8b640 1 -- 172.21.15.137:0/3791420615 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ac0078e0 con 0x7f26b40d4f20 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.511+0000 7f26b8a8b640 1 -- 172.21.15.137:0/3791420615 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac007c90 con 0x7f26b40d4f20 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.511+0000 7f26bbcf1640 1 -- 172.21.15.137:0/3791420615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26b40d4f20 msgr2=0x7f26b40d53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.511+0000 7f26bbcf1640 1 --2- 172.21.15.137:0/3791420615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26b40d4f20 0x7f26b40d53b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009d90 tx=0x7f26ac02a660 comp rx=0 tx=0).stop 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.512+0000 7f26bbcf1640 1 -- 172.21.15.137:0/3791420615 shutdown_connections 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.512+0000 7f26bbcf1640 1 --2- 172.21.15.137:0/3791420615 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26b40d4f20 0x7f26b40d53b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.512+0000 7f26bbcf1640 1 --2- 172.21.15.137:0/3791420615 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b415f680 0x7f26b40d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.512+0000 7f26bbcf1640 1 -- 172.21.15.137:0/3791420615 >> 172.21.15.137:0/3791420615 conn(0x7f26b408eca0 msgr2=0x7f26b409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.512+0000 7f26bbcf1640 1 -- 172.21.15.137:0/3791420615 shutdown_connections 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.512+0000 7f26bbcf1640 1 -- 172.21.15.137:0/3791420615 wait complete. 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.513+0000 7f26bbcf1640 1 Processor -- start 2024-04-26T22:06:15.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.513+0000 7f26bbcf1640 1 -- start start 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.513+0000 7f26bbcf1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b40d4f20 0x7f26b414cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.513+0000 7f26bbcf1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26b415f680 0x7f26b40ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.513+0000 7f26bbcf1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b4163aa0 0x7f26b41498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.513+0000 7f26bbcf1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4163f00 con 0x7f26b4163aa0 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.513+0000 7f26bbcf1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f26b40b6280 con 0x7f26b415f680 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.513+0000 7f26bbcf1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f26b40cfd80 con 0x7f26b40d4f20 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26ba28e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b4163aa0 0x7f26b41498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26ba28e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b4163aa0 0x7f26b41498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59578/0 (socket says 172.21.15.137:59578) 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26ba28e640 1 -- 172.21.15.137:0/133804309 learned_addr learned my addr 172.21.15.137:0/133804309 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b40d4f20 0x7f26b414cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26b928c640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26b415f680 0x7f26b40ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26ba28e640 1 -- 172.21.15.137:0/133804309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b40d4f20 msgr2=0x7f26b414cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26ba28e640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b40d4f20 0x7f26b414cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26ba28e640 1 -- 172.21.15.137:0/133804309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26b415f680 msgr2=0x7f26b40ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26ba28e640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26b415f680 0x7f26b40ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26ba28e640 1 -- 172.21.15.137:0/133804309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b414a2f0 con 0x7f26b4163aa0 2024-04-26T22:06:15.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26ba28e640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b4163aa0 0x7f26b41498c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009eb0 tx=0x7f26ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26aa7fc640 1 -- 172.21.15.137:0/133804309 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac040070 con 0x7f26b4163aa0 2024-04-26T22:06:15.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26aa7fc640 1 -- 172.21.15.137:0/133804309 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ac031c60 con 0x7f26b4163aa0 2024-04-26T22:06:15.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26bbcf1640 1 -- 172.21.15.137:0/133804309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b40ce850 con 0x7f26b4163aa0 2024-04-26T22:06:15.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26aa7fc640 1 -- 172.21.15.137:0/133804309 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac009450 con 0x7f26b4163aa0 2024-04-26T22:06:15.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.514+0000 7f26bbcf1640 1 -- 172.21.15.137:0/133804309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b40cee10 con 0x7f26b4163aa0 2024-04-26T22:06:15.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.516+0000 7f26aa7fc640 1 -- 172.21.15.137:0/133804309 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f26ac039040 con 0x7f26b4163aa0 2024-04-26T22:06:15.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.516+0000 7f26aa7fc640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f269806c8f0 0x7f269806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.516+0000 7f26aa7fc640 1 -- 172.21.15.137:0/133804309 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f26ac0acb40 con 0x7f26b4163aa0 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.516+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f269806c8f0 0x7f269806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.517+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f269806c8f0 0x7f269806edb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009b40 tx=0x7f26a4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.517+0000 7f26bea07740 1 Processor -- start 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.517+0000 7f26bea07740 1 -- start start 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26bea07740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 0x558faac2a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26bea07740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac24e10 0x558faac28b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26bea07740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac290c0 0x558faac29500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26bea07740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558faab8ed80 con 0x558faac24e10 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26bea07740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558faab488b0 con 0x558faac29f80 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26bea07740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558faab8ad40 con 0x558faac290c0 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26b928c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac24e10 0x558faac28b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.525 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26b928c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac24e10 0x558faac28b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59584/0 (socket says 172.21.15.137:59584) 2024-04-26T22:06:15.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26b928c640 1 -- 172.21.15.137:0/3988850511 learned_addr learned my addr 172.21.15.137:0/3988850511 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/3988850511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 0x558faac2a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.518+0000 7f26ba28e640 1 --2- 172.21.15.137:0/3988850511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac290c0 0x558faac29500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26b928c640 1 -- 172.21.15.137:0/3988850511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac290c0 msgr2=0x558faac29500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26b928c640 1 --2- 172.21.15.137:0/3988850511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac290c0 0x558faac29500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26b928c640 1 -- 172.21.15.137:0/3988850511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 msgr2=0x558faac2a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26b928c640 1 --2- 172.21.15.137:0/3988850511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 0x558faac2a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26b928c640 1 -- 172.21.15.137:0/3988850511 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558faab19a40 con 0x558faac24e10 2024-04-26T22:06:15.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26b928c640 1 --2- 172.21.15.137:0/3988850511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac24e10 0x558faac28b80 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f26b0006f20 tx=0x7f26b00074d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c05fdac8a8cf489 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26977fe640 1 -- 172.21.15.137:0/3988850511 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b001a070 con 0x558faac24e10 2024-04-26T22:06:15.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26977fe640 1 -- 172.21.15.137:0/3988850511 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b00017d0 con 0x558faac24e10 2024-04-26T22:06:15.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26977fe640 1 -- 172.21.15.137:0/3988850511 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0001bc0 con 0x558faac24e10 2024-04-26T22:06:15.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26bea07740 1 -- 172.21.15.137:0/3988850511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac24e10 msgr2=0x558faac28b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.519+0000 7f26bea07740 1 --2- 172.21.15.137:0/3988850511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac24e10 0x558faac28b80 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f26b0006f20 tx=0x7f26b00074d0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.520+0000 7f26bea07740 1 -- 172.21.15.137:0/3988850511 shutdown_connections 2024-04-26T22:06:15.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.520+0000 7f26bea07740 1 --2- 172.21.15.137:0/3988850511 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac24e10 0x558faac28b80 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.520+0000 7f26bea07740 1 --2- 172.21.15.137:0/3988850511 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac290c0 0x558faac29500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.520+0000 7f26bea07740 1 --2- 172.21.15.137:0/3988850511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 0x558faac2a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.520+0000 7f26bea07740 1 -- 172.21.15.137:0/3988850511 >> 172.21.15.137:0/3988850511 conn(0x558faac27080 msgr2=0x558faac6fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.520+0000 7f26bea07740 1 -- 172.21.15.137:0/3988850511 shutdown_connections 2024-04-26T22:06:15.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.520+0000 7f26bea07740 1 -- 172.21.15.137:0/3988850511 wait complete. 2024-04-26T22:06:15.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.520+0000 7f26bea07740 1 -- start start 2024-04-26T22:06:15.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.520+0000 7f26bea07740 1 Processor -- start 2024-04-26T22:06:15.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26bea07740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 0x558faac7ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26bea07740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac29f80 0x558faac75430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26bea07740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac4b3c0 0x558faac73390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26bea07740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558faac55b10 con 0x558faac4b3c0 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26bea07740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558faab15d10 con 0x558faac290c0 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26bea07740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558faac54f90 con 0x558faac29f80 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26bea07740 10 client.0 _ll_register_callbacks cb 0x558faab42210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26ba28e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac4b3c0 0x558faac73390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26ba28e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac4b3c0 0x558faac73390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:59590/0 (socket says 172.21.15.137:59590) 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26ba28e640 1 -- 172.21.15.137:0/2663565610 learned_addr learned my addr 172.21.15.137:0/2663565610 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 0x558faac7ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26b928c640 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac29f80 0x558faac75430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26ba28e640 1 -- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac29f80 msgr2=0x558faac75430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26ba28e640 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac29f80 0x558faac75430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26ba28e640 1 -- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 msgr2=0x558faac7ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26ba28e640 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 0x558faac7ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.521+0000 7f26ba28e640 1 -- 172.21.15.137:0/2663565610 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558faa96a7d0 con 0x558faac4b3c0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26ba28e640 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac4b3c0 0x558faac73390 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f26ac02a6a0 tx=0x7f26ac07a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532abb4c6833a585 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f2694ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f2694ff9640 1 -- 172.21.15.137:0/2663565610 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac049040 con 0x558faac4b3c0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f2694ff9640 1 -- 172.21.15.137:0/2663565610 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f26ac083140 con 0x558faac4b3c0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26bea07740 1 -- 172.21.15.137:0/2663565610 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b00017d0 con 0x558faac4b3c0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f2694ff9640 1 -- 172.21.15.137:0/2663565610 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f26ac031e10 con 0x558faac4b3c0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26bea07740 10 client.8499 fetch_fsmap learned FSMap version 66 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26bea07740 1 -- 172.21.15.137:0/2663565610 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x558faa8a03f0 con 0x558faac4b3c0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f2694ff9640 1 -- 172.21.15.137:0/2663565610 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b00017d0 con 0x558faac4b3c0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f2694ff9640 1 -- 172.21.15.137:0/2663565610 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f26ac04c020 con 0x558faac4b3c0 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26bea07740 10 client.8499 fetch_fsmap finished waiting for FSMap version 66 2024-04-26T22:06:15.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26bea07740 10 client.8499 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26bea07740 20 client.8499 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26bea07740 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x558faac741f0 0x558faac74600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26bea07740 4 client.8499 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26bea07740 1 -- 172.21.15.137:0/2663565610 --> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558faab9c990 con 0x558faac741f0 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.522+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x558faac741f0 0x558faac74600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x558faac741f0 0x558faac74600 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b3e6e68b28cb77c server_cookie=d9678fefd69adade in_seq=0 out_seq=0 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f2694ff9640 10 client.8499 ms_handle_connect on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f2694ff9640 1 -- 172.21.15.137:0/2663565610 <== mds.0 v2:172.21.15.170:6832/2219855149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558faab9c990 con 0x558faac741f0 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f2694ff9640 10 client.8499 handle_command_reply: tid=0 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26bea07740 1 client.8499 shutdown 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26bea07740 1 -- 172.21.15.137:0/2663565610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac4b3c0 msgr2=0x558faac73390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26bea07740 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac4b3c0 0x558faac73390 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f26ac02a6a0 tx=0x7f26ac07a960 comp rx=0 tx=0).stop 2024-04-26T22:06:15.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26bea07740 1 -- 172.21.15.137:0/2663565610 shutdown_connections 2024-04-26T22:06:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26bea07740 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x558faac741f0 0x558faac74600 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26bea07740 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac4b3c0 0x558faac73390 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f2694ff9640 0 client.8499 ms_handle_reset on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26bea07740 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac29f80 0x558faac75430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26bea07740 1 --2- 172.21.15.137:0/2663565610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 0x558faac7ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.523+0000 7f26bea07740 1 -- 172.21.15.137:0/2663565610 >> 172.21.15.137:0/2663565610 conn(0x558faac24e10 msgr2=0x558faac2aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.524+0000 7f26bea07740 1 -- 172.21.15.137:0/2663565610 shutdown_connections 2024-04-26T22:06:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.524+0000 7f26bea07740 1 -- 172.21.15.137:0/2663565610 wait complete. 2024-04-26T22:06:15.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.524+0000 7f26bea07740 20 client.8499 trim_cache size 0 max 16384 2024-04-26T22:06:15.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.541+0000 7f26bea07740 1 Processor -- start 2024-04-26T22:06:15.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.541+0000 7f26bea07740 1 -- start start 2024-04-26T22:06:15.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26bea07740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac290c0 0x558faac4a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26bea07740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 0x558faace0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26bea07740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 0x558faac2a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26bea07740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4201640 con 0x558faac290c0 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26bea07740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4200780 con 0x558faac29f80 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26bea07740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f26b406dd50 con 0x558faac4b3c0 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b9a8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac290c0 0x558faac4a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b9a8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac290c0 0x558faac4a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56674/0 (socket says 172.21.15.137:56674) 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b9a8d640 1 -- 172.21.15.137:0/1856277034 learned_addr learned my addr 172.21.15.137:0/1856277034 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b9a8d640 1 -- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 msgr2=0x558faac2a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26ba28e640 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 0x558faac2a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b928c640 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 0x558faace0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 0x558faac2a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b9a8d640 1 -- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 msgr2=0x558faace0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 0x558faace0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b9a8d640 1 -- 172.21.15.137:0/1856277034 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558faa8600f0 con 0x558faac290c0 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b928c640 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 0x558faace0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26ba28e640 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 0x558faac2a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac290c0 0x558faac4a7e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f26a4004240 tx=0x7f26a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192c61eb7cf02c0c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f2696ffd640 1 -- 172.21.15.137:0/1856277034 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4032070 con 0x558faac290c0 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f2696ffd640 1 -- 172.21.15.137:0/1856277034 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a40044b0 con 0x558faac290c0 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.542+0000 7f2696ffd640 1 -- 172.21.15.137:0/1856277034 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4003c90 con 0x558faac290c0 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 -- 172.21.15.137:0/1856277034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac290c0 msgr2=0x558faac4a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac290c0 0x558faac4a7e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f26a4004240 tx=0x7f26a4018000 comp rx=0 tx=0).stop 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 -- 172.21.15.137:0/1856277034 shutdown_connections 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 0x558faac2a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac29f80 0x558faace0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 --2- 172.21.15.137:0/1856277034 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac290c0 0x558faac4a7e0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 -- 172.21.15.137:0/1856277034 >> 172.21.15.137:0/1856277034 conn(0x558faac24e10 msgr2=0x558faac720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 -- 172.21.15.137:0/1856277034 shutdown_connections 2024-04-26T22:06:15.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 -- 172.21.15.137:0/1856277034 wait complete. 2024-04-26T22:06:15.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 -- start start 2024-04-26T22:06:15.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.543+0000 7f26bea07740 1 Processor -- start 2024-04-26T22:06:15.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26bea07740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 0x558faacc6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26bea07740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac29f80 0x558faac2a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26bea07740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 0x558faac2a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26bea07740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f26b406e3a0 con 0x558faac29f80 2024-04-26T22:06:15.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26bea07740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558faac27c20 con 0x558faac290c0 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26bea07740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558faacea7a0 con 0x558faac4b3c0 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26bea07740 10 client.0 _ll_register_callbacks cb 0x7f26ac07a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26b928c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac29f80 0x558faac2a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26b928c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac29f80 0x558faac2a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:56686/0 (socket says 172.21.15.137:56686) 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.544+0000 7f26b928c640 1 -- 172.21.15.137:0/2296891381 learned_addr learned my addr 172.21.15.137:0/2296891381 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26ba28e640 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 0x558faac2a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 0x558faacc6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26b928c640 1 -- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 msgr2=0x558faac2a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26b928c640 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 0x558faac2a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26b928c640 1 -- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 msgr2=0x558faacc6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26b928c640 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 0x558faacc6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26b928c640 1 -- 172.21.15.137:0/2296891381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558faab4f4b0 con 0x558faac29f80 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26b928c640 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac29f80 0x558faac2a360 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f26b0006ef0 tx=0x7f26b0007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6502238fcad265d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:15.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f2694ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f2694ff9640 1 -- 172.21.15.137:0/2296891381 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b001a070 con 0x558faac29f80 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f2694ff9640 1 -- 172.21.15.137:0/2296891381 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f26b00049e0 con 0x558faac29f80 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26bea07740 1 -- 172.21.15.137:0/2296891381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a40044b0 con 0x558faac29f80 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f2694ff9640 1 -- 172.21.15.137:0/2296891381 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f26b002f050 con 0x558faac29f80 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26bea07740 10 client.8505 fetch_fsmap learned FSMap version 66 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26bea07740 1 -- 172.21.15.137:0/2296891381 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x558faacde010 con 0x558faac29f80 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f2694ff9640 1 -- 172.21.15.137:0/2296891381 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a40044b0 con 0x558faac29f80 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f2694ff9640 1 -- 172.21.15.137:0/2296891381 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f26b0032020 con 0x558faac29f80 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26bea07740 10 client.8505 fetch_fsmap finished waiting for FSMap version 66 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26bea07740 10 client.8505 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26bea07740 20 client.8505 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26bea07740 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x558faac2b860 0x558faace97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26bea07740 4 client.8505 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:06:15.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.545+0000 7f26bea07740 1 -- 172.21.15.137:0/2296891381 --> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558faab96800 con 0x558faac2b860 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x558faac2b860 0x558faace97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26b9a8d640 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x558faac2b860 0x558faace97b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aad514d26b5eefc server_cookie=89ea46453faff7f4 in_seq=0 out_seq=0 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f2694ff9640 10 client.8505 ms_handle_connect on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f2694ff9640 1 -- 172.21.15.137:0/2296891381 <== mds.0 v2:172.21.15.170:6832/2219855149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x558faab96800 con 0x558faac2b860 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f2694ff9640 10 client.8505 handle_command_reply: tid=0 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 client.8505 shutdown 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 -- 172.21.15.137:0/2296891381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac29f80 msgr2=0x558faac2a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac29f80 0x558faac2a360 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f26b0006ef0 tx=0x7f26b0007cd0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 -- 172.21.15.137:0/2296891381 shutdown_connections 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x558faac2b860 0x558faace97b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558faac29f80 0x558faac2a360 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558faac4b3c0 0x558faac2a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f2694ff9640 0 client.8505 ms_handle_reset on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 --2- 172.21.15.137:0/2296891381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558faac290c0 0x558faacc6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 -- 172.21.15.137:0/2296891381 >> 172.21.15.137:0/2296891381 conn(0x558faac24e10 msgr2=0x558faac71de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 -- 172.21.15.137:0/2296891381 shutdown_connections 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 1 -- 172.21.15.137:0/2296891381 wait complete. 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.546+0000 7f26bea07740 20 client.8505 trim_cache size 0 max 16384 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stdout: "26282181-90a6-409f-8df6-cb0304f879f5": { 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "26282181-90a6-409f-8df6-cb0304f879f5", 2024-04-26T22:06:15.553 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,repair" 2024-04-26T22:06:15.554 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:06:15.554 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:06:15.554 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:06:15.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 -- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f269806c8f0 msgr2=0x7f269806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f269806c8f0 0x7f269806edb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f26a4009b40 tx=0x7f26a4009190 comp rx=0 tx=0).stop 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 -- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b4163aa0 msgr2=0x7f26b41498c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b4163aa0 0x7f26b41498c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009eb0 tx=0x7f26ac004a40 comp rx=0 tx=0).stop 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 -- 172.21.15.137:0/133804309 shutdown_connections 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f269806c8f0 0x7f269806edb0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f26b4163aa0 0x7f26b41498c0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26b415f680 0x7f26b40ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 --2- 172.21.15.137:0/133804309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f26b40d4f20 0x7f26b414cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 -- 172.21.15.137:0/133804309 >> 172.21.15.137:0/133804309 conn(0x7f26b408eca0 msgr2=0x7f26b40d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 -- 172.21.15.137:0/133804309 shutdown_connections 2024-04-26T22:06:15.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.547+0000 7f26bbcf1640 1 -- 172.21.15.137:0/133804309 wait complete. 2024-04-26T22:06:15.557 INFO:tasks.cephfs.filesystem:scrub status for tag:26282181-90a6-409f-8df6-cb0304f879f5 - {'path': '/', 'tag': '26282181-90a6-409f-8df6-cb0304f879f5', 'options': 'recursive,repair'} 2024-04-26T22:06:15.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:15.663+0000 7fb94effd640 1 -- 172.21.15.137:0/3529175223 <== mon.0 v2:172.21.15.137:3300/0 7 ==== log(4 entries from seq 1 at 2024-04-26T22:06:15.400452+0000) ==== 695+0+0 (secure 0 0 0) 0x7fb9500ab8c0 con 0x7fb95815f5a0 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: cluster: 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: id: 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: health: HEALTH_OK 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: services: 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: mon: 3 daemons, quorum a,b,c (age 7m) 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: mgr: y(active, since 7m), standbys: x 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: mds: 1/1 daemons up, 3 standby 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: osd: 8 osds: 8 up (since 7m), 8 in (since 7m) 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:15.664 INFO:teuthology.orchestra.run.smithi137.stdout: data: 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: volumes: 1/1 healthy 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: pools: 3 pools, 97 pgs 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: objects: 30 objects, 19 MiB 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: usage: 287 MiB used, 720 GiB / 720 GiB avail 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: pgs: 97 active+clean 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: io: 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: client: 102 B/s rd, 1.8 MiB/s wr, 0 op/s rd, 3 op/s wr 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:15.400452+0000 mds.b [INF] scrub queued for path: / 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:15.400456+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:15.400461+0000 mds.b [INF] scrub summary: active paths [/] 2024-04-26T22:06:15.665 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:15.401598+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-04-26T22:06:18.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:18.855+0000 7fb94effd640 1 -- 172.21.15.137:0/3529175223 <== mon.0 v2:172.21.15.137:3300/0 8 ==== log(1 entries from seq 5 at 2024-04-26T22:06:17.553046+0000) ==== 189+0+0 (secure 0 0 0) 0x7fb9500791c0 con 0x7fb95815f5a0 2024-04-26T22:06:18.856 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:17.553046+0000 mds.b [INF] scrub summary: idle 2024-04-26T22:06:44.475 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:06:44.479 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:06:45.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:45.559 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-26T22:06:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.662+0000 7f5387967640 1 Processor -- start 2024-04-26T22:06:45.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.662+0000 7f5387967640 1 -- start start 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.663+0000 7f5387967640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 0x7f53800b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.663+0000 7f5387967640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53800ceff0 0x7f53800cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.663+0000 7f5387967640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538015dca0 con 0x7f5380143840 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.663+0000 7f5387967640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5380143c20 con 0x7f53800ceff0 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.663+0000 7f5387967640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f538015df80 con 0x7f53800b4eb0 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.663+0000 7f5385f04640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53800ceff0 0x7f53800cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.663+0000 7f5385f04640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f53800ceff0 0x7f53800cf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54446/0 (socket says 172.21.15.137:54446) 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.663+0000 7f5385f04640 1 -- 172.21.15.137:0/761441948 learned_addr learned my addr 172.21.15.137:0/761441948 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.663+0000 7f5384f02640 1 --2- 172.21.15.137:0/761441948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 0x7f53800b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.664+0000 7f5385f04640 1 -- 172.21.15.137:0/761441948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 msgr2=0x7f53800b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.664+0000 7f5385f04640 1 --2- 172.21.15.137:0/761441948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 0x7f53800b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.664+0000 7f5385f04640 1 -- 172.21.15.137:0/761441948 >> v1:172.21.15.170:6789/0 conn(0x7f5380143840 legacy=0x7f53800b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.664+0000 7f5385f04640 1 -- 172.21.15.137:0/761441948 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538015e260 con 0x7f53800ceff0 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5385f04640 1 --2- 172.21.15.137:0/761441948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53800ceff0 0x7f53800cf450 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e50 tx=0x7f537802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2af52d75e4eb03 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5377fff640 1 -- 172.21.15.137:0/761441948 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378036070 con 0x7f53800ceff0 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5377fff640 1 -- 172.21.15.137:0/761441948 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5378031600 con 0x7f53800ceff0 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5377fff640 1 -- 172.21.15.137:0/761441948 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53780319d0 con 0x7f53800ceff0 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5387967640 1 -- 172.21.15.137:0/761441948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53800ceff0 msgr2=0x7f53800cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5387967640 1 --2- 172.21.15.137:0/761441948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53800ceff0 0x7f53800cf450 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e50 tx=0x7f537802a710 comp rx=0 tx=0).stop 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5387967640 1 -- 172.21.15.137:0/761441948 shutdown_connections 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5387967640 1 --2- 172.21.15.137:0/761441948 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f53800ceff0 0x7f53800cf450 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5387967640 1 --2- 172.21.15.137:0/761441948 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 0x7f53800b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5387967640 1 -- 172.21.15.137:0/761441948 >> 172.21.15.137:0/761441948 conn(0x7f53800cd8a0 msgr2=0x7f53800cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5387967640 1 -- 172.21.15.137:0/761441948 shutdown_connections 2024-04-26T22:06:45.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.665+0000 7f5387967640 1 -- 172.21.15.137:0/761441948 wait complete. 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5387967640 1 Processor -- start 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5387967640 1 -- start start 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5387967640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 0x7f53801f73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5387967640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53800ceff0 0x7f5380158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5387967640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5380143840 0x7f538015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5387967640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f538015d8c0 con 0x7f5380143840 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5387967640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f53800b46f0 con 0x7f53800ceff0 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5387967640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f538015da40 con 0x7f53800b4eb0 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5385f04640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5380143840 0x7f538015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.667+0000 7f5385f04640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5380143840 0x7f538015c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54448/0 (socket says 172.21.15.137:54448) 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5385f04640 1 -- 172.21.15.137:0/1922643229 learned_addr learned my addr 172.21.15.137:0/1922643229 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5384f02640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53800ceff0 0x7f5380158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5385703640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 0x7f53801f73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5385f04640 1 -- 172.21.15.137:0/1922643229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 msgr2=0x7f53801f73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5385f04640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 0x7f53801f73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5385f04640 1 -- 172.21.15.137:0/1922643229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53800ceff0 msgr2=0x7f5380158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5385f04640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53800ceff0 0x7f5380158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5385f04640 1 -- 172.21.15.137:0/1922643229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53801e6db0 con 0x7f5380143840 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5384f02640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53800ceff0 0x7f5380158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5385f04640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5380143840 0x7f538015c490 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e50 tx=0x7f5378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5375ffb640 1 -- 172.21.15.137:0/1922643229 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378036050 con 0x7f5380143840 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5375ffb640 1 -- 172.21.15.137:0/1922643229 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5378042070 con 0x7f5380143840 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5387967640 1 -- 172.21.15.137:0/1922643229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53801e7090 con 0x7f5380143840 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5375ffb640 1 -- 172.21.15.137:0/1922643229 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378009510 con 0x7f5380143840 2024-04-26T22:06:45.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.668+0000 7f5387967640 1 -- 172.21.15.137:0/1922643229 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53801e7650 con 0x7f5380143840 2024-04-26T22:06:45.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.670+0000 7f5375ffb640 1 -- 172.21.15.137:0/1922643229 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5378007bd0 con 0x7f5380143840 2024-04-26T22:06:45.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.671+0000 7f5375ffb640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f536406c8f0 0x7f536406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.671+0000 7f5375ffb640 1 -- 172.21.15.137:0/1922643229 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f53780ac950 con 0x7f5380143840 2024-04-26T22:06:45.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.671+0000 7f5385703640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f536406c8f0 0x7f536406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.671+0000 7f538a67d740 1 Processor -- start 2024-04-26T22:06:45.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.671+0000 7f5385703640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f536406c8f0 0x7f536406edb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f53700016e0 tx=0x7f5370009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.671+0000 7f538a67d740 1 -- start start 2024-04-26T22:06:45.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f538a67d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c66110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f538a67d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 0x55a5f1c35e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f538a67d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c36350 0x55a5f1c39850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f538a67d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a5f1b9fd80 con 0x55a5f1c65d30 2024-04-26T22:06:45.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f538a67d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a5f1b598b0 con 0x55a5f1c816f0 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f538a67d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a5f1b9bd40 con 0x55a5f1c36350 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5385703640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c66110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5385703640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c66110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54460/0 (socket says 172.21.15.137:54460) 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5385703640 1 -- 172.21.15.137:0/2869526859 learned_addr learned my addr 172.21.15.137:0/2869526859 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5385f04640 1 --2- 172.21.15.137:0/2869526859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c36350 0x55a5f1c39850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5384f02640 1 --2- 172.21.15.137:0/2869526859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 0x55a5f1c35e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5385703640 1 -- 172.21.15.137:0/2869526859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c36350 msgr2=0x55a5f1c39850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5385703640 1 --2- 172.21.15.137:0/2869526859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c36350 0x55a5f1c39850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5385703640 1 -- 172.21.15.137:0/2869526859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 msgr2=0x55a5f1c35e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5385703640 1 --2- 172.21.15.137:0/2869526859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 0x55a5f1c35e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.672+0000 7f5385703640 1 -- 172.21.15.137:0/2869526859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f1b2aa40 con 0x55a5f1c65d30 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f5385703640 1 --2- 172.21.15.137:0/2869526859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c66110 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f5370007bc0 tx=0x7f5370012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1af1f2079ad239 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f536affd640 1 -- 172.21.15.137:0/2869526859 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370026070 con 0x55a5f1c65d30 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f536affd640 1 -- 172.21.15.137:0/2869526859 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53700067d0 con 0x55a5f1c65d30 2024-04-26T22:06:45.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f536affd640 1 -- 172.21.15.137:0/2869526859 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370006b80 con 0x55a5f1c65d30 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f538a67d740 1 -- 172.21.15.137:0/2869526859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 msgr2=0x55a5f1c66110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f538a67d740 1 --2- 172.21.15.137:0/2869526859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c66110 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f5370007bc0 tx=0x7f5370012000 comp rx=0 tx=0).stop 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f538a67d740 1 -- 172.21.15.137:0/2869526859 shutdown_connections 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f538a67d740 1 --2- 172.21.15.137:0/2869526859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c36350 0x55a5f1c39850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f538a67d740 1 --2- 172.21.15.137:0/2869526859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 0x55a5f1c35e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f538a67d740 1 --2- 172.21.15.137:0/2869526859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c66110 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f538a67d740 1 -- 172.21.15.137:0/2869526859 >> 172.21.15.137:0/2869526859 conn(0x55a5f1c38080 msgr2=0x55a5f1c80b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.673+0000 7f538a67d740 1 -- 172.21.15.137:0/2869526859 shutdown_connections 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.674+0000 7f538a67d740 1 -- 172.21.15.137:0/2869526859 wait complete. 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.674+0000 7f538a67d740 1 -- start start 2024-04-26T22:06:45.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.674+0000 7f538a67d740 1 Processor -- start 2024-04-26T22:06:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f538a67d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c67900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f538a67d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 0x55a5f1c5ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f538a67d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c69340 0x55a5f1c3a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f538a67d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a5f1c3b840 con 0x55a5f1c65d30 2024-04-26T22:06:45.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f538a67d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a5f1b26d10 con 0x55a5f1c816f0 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f538a67d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a5f1c3bae0 con 0x55a5f1c69340 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f538a67d740 10 client.0 _ll_register_callbacks cb 0x55a5f1b53210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5385703640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c67900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5385703640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c67900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54464/0 (socket says 172.21.15.137:54464) 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5385703640 1 -- 172.21.15.137:0/1138892480 learned_addr learned my addr 172.21.15.137:0/1138892480 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5385f04640 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c69340 0x55a5f1c3a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5384f02640 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 0x55a5f1c5ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5385703640 1 -- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c69340 msgr2=0x55a5f1c3a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5385703640 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c69340 0x55a5f1c3a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5385703640 1 -- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 msgr2=0x55a5f1c5ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5385703640 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 0x55a5f1c5ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.675+0000 7f5385703640 1 -- 172.21.15.137:0/1138892480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f197b7d0 con 0x55a5f1c65d30 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f5385703640 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c67900 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f5370024040 tx=0x7f5370000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b038c0fdfee67a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f535ffff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f535ffff640 1 -- 172.21.15.137:0/1138892480 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370030060 con 0x55a5f1c65d30 2024-04-26T22:06:45.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f535ffff640 1 -- 172.21.15.137:0/1138892480 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f5370020830 con 0x55a5f1c65d30 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f538a67d740 1 -- 172.21.15.137:0/1138892480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53700067d0 con 0x55a5f1c65d30 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f535ffff640 1 -- 172.21.15.137:0/1138892480 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f5370036050 con 0x55a5f1c65d30 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f538a67d740 10 client.8517 fetch_fsmap learned FSMap version 66 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f538a67d740 1 -- 172.21.15.137:0/1138892480 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55a5f18b13f0 con 0x55a5f1c65d30 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f535ffff640 1 -- 172.21.15.137:0/1138892480 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53700067d0 con 0x55a5f1c65d30 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f535ffff640 1 -- 172.21.15.137:0/1138892480 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f5370039020 con 0x55a5f1c65d30 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f538a67d740 10 client.8517 fetch_fsmap finished waiting for FSMap version 66 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f538a67d740 10 client.8517 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f538a67d740 20 client.8517 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f538a67d740 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a5f1c99170 0x55a5f1c995b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f538a67d740 4 client.8517 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.676+0000 7f538a67d740 1 -- 172.21.15.137:0/1138892480 --> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5f1bad990 con 0x55a5f1c99170 2024-04-26T22:06:45.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.677+0000 7f5384f02640 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a5f1c99170 0x55a5f1c995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.677+0000 7f5384f02640 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a5f1c99170 0x55a5f1c995b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7877644beaff655 server_cookie=24d76557df1fbae1 in_seq=0 out_seq=0 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.677+0000 7f535ffff640 10 client.8517 ms_handle_connect on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f535ffff640 1 -- 172.21.15.137:0/1138892480 <== mds.0 v2:172.21.15.170:6832/2219855149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a5f1bad990 con 0x55a5f1c99170 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f535ffff640 10 client.8517 handle_command_reply: tid=0 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 client.8517 shutdown 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 -- 172.21.15.137:0/1138892480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 msgr2=0x55a5f1c67900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c67900 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f5370024040 tx=0x7f5370000ed0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 -- 172.21.15.137:0/1138892480 shutdown_connections 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a5f1c99170 0x55a5f1c995b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c69340 0x55a5f1c3a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f535ffff640 0 client.8517 ms_handle_reset on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c816f0 0x55a5f1c5ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 --2- 172.21.15.137:0/1138892480 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c67900 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 -- 172.21.15.137:0/1138892480 >> 172.21.15.137:0/1138892480 conn(0x55a5f1c36350 msgr2=0x55a5f1c82470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:45.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 -- 172.21.15.137:0/1138892480 shutdown_connections 2024-04-26T22:06:45.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 1 -- 172.21.15.137:0/1138892480 wait complete. 2024-04-26T22:06:45.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.678+0000 7f538a67d740 20 client.8517 trim_cache size 0 max 16384 2024-04-26T22:06:45.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.695+0000 7f538a67d740 1 Processor -- start 2024-04-26T22:06:45.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.695+0000 7f538a67d740 1 -- start start 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f538a67d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c5ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f538a67d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c69340 0x55a5f1c9fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f538a67d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c816f0 0x55a5f1c3ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f538a67d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5380073df0 con 0x55a5f1c65d30 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f538a67d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5380072e30 con 0x55a5f1c69340 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f538a67d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5380072190 con 0x55a5f1c816f0 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f5385703640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c5ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f5385703640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c5ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54474/0 (socket says 172.21.15.137:54474) 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f5385703640 1 -- 172.21.15.137:0/1685108498 learned_addr learned my addr 172.21.15.137:0/1685108498 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f5385703640 1 -- 172.21.15.137:0/1685108498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c816f0 msgr2=0x55a5f1c3ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f5385703640 1 --2- 172.21.15.137:0/1685108498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c816f0 0x55a5f1c3ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f5384f02640 1 --2- 172.21.15.137:0/1685108498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c69340 0x55a5f1c9fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f5385703640 1 -- 172.21.15.137:0/1685108498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c69340 msgr2=0x55a5f1c9fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f5385703640 1 --2- 172.21.15.137:0/1685108498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c69340 0x55a5f1c9fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.696+0000 7f5385703640 1 -- 172.21.15.137:0/1685108498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5f18710f0 con 0x55a5f1c65d30 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f5385703640 1 --2- 172.21.15.137:0/1685108498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c5ed20 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f537000f640 tx=0x7f5370026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8721e7196cc894 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f536a7fc640 1 -- 172.21.15.137:0/1685108498 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537003e070 con 0x55a5f1c65d30 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f536a7fc640 1 -- 172.21.15.137:0/1685108498 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5370027040 con 0x55a5f1c65d30 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f536a7fc640 1 -- 172.21.15.137:0/1685108498 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370026070 con 0x55a5f1c65d30 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f538a67d740 1 -- 172.21.15.137:0/1685108498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 msgr2=0x55a5f1c5ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f538a67d740 1 --2- 172.21.15.137:0/1685108498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c5ed20 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f537000f640 tx=0x7f5370026000 comp rx=0 tx=0).stop 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f538a67d740 1 -- 172.21.15.137:0/1685108498 shutdown_connections 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f538a67d740 1 --2- 172.21.15.137:0/1685108498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c816f0 0x55a5f1c3ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f538a67d740 1 --2- 172.21.15.137:0/1685108498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c69340 0x55a5f1c9fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f538a67d740 1 --2- 172.21.15.137:0/1685108498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c65d30 0x55a5f1c5ed20 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f538a67d740 1 -- 172.21.15.137:0/1685108498 >> 172.21.15.137:0/1685108498 conn(0x55a5f1c36350 msgr2=0x55a5f1c69720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f538a67d740 1 -- 172.21.15.137:0/1685108498 shutdown_connections 2024-04-26T22:06:45.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.697+0000 7f538a67d740 1 -- 172.21.15.137:0/1685108498 wait complete. 2024-04-26T22:06:45.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.698+0000 7f538a67d740 1 -- start start 2024-04-26T22:06:45.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.698+0000 7f538a67d740 1 Processor -- start 2024-04-26T22:06:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f538a67d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c65d30 0x55a5f1d016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f538a67d740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c69340 0x55a5f1c3ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.703 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f538a67d740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c816f0 0x55a5f1c985c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f538a67d740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a5f1c607c0 con 0x55a5f1c69340 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f538a67d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f53800727e0 con 0x55a5f1c65d30 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f538a67d740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a5f1c81330 con 0x55a5f1c816f0 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f538a67d740 10 client.0 _ll_register_callbacks cb 0x7f5370024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5384f02640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c69340 0x55a5f1c3ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5384f02640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c69340 0x55a5f1c3ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54486/0 (socket says 172.21.15.137:54486) 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5384f02640 1 -- 172.21.15.137:0/3480916754 learned_addr learned my addr 172.21.15.137:0/3480916754 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5385f04640 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c816f0 0x55a5f1c985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5385703640 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c65d30 0x55a5f1d016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5384f02640 1 -- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c816f0 msgr2=0x55a5f1c985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5384f02640 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c816f0 0x55a5f1c985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.704 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5384f02640 1 -- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c65d30 msgr2=0x55a5f1d016a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5384f02640 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c65d30 0x55a5f1d016a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.699+0000 7f5384f02640 1 -- 172.21.15.137:0/3480916754 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5f1b604b0 con 0x55a5f1c69340 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f535ffff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f5384f02640 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c69340 0x55a5f1c3ce30 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f538015d1c0 tx=0x7f537c01df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4efc02f3ca94724 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f535ffff640 1 -- 172.21.15.137:0/3480916754 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c004030 con 0x55a5f1c69340 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f535ffff640 1 -- 172.21.15.137:0/3480916754 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f537c0041d0 con 0x55a5f1c69340 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f538a67d740 1 -- 172.21.15.137:0/3480916754 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5370027040 con 0x55a5f1c69340 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f535ffff640 1 -- 172.21.15.137:0/3480916754 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f537c02b050 con 0x55a5f1c69340 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f538a67d740 10 client.8523 fetch_fsmap learned FSMap version 66 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f538a67d740 1 -- 172.21.15.137:0/3480916754 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55a5f1ca94c0 con 0x55a5f1c69340 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f535ffff640 1 -- 172.21.15.137:0/3480916754 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5370027040 con 0x55a5f1c69340 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f535ffff640 1 -- 172.21.15.137:0/3480916754 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 66) ==== 3494+0+0 (secure 0 0 0) 0x7f537c02e020 con 0x55a5f1c69340 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f538a67d740 10 client.8523 fetch_fsmap finished waiting for FSMap version 66 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f538a67d740 10 client.8523 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2024-04-26T22:06:45.705 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f538a67d740 20 client.8523 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f538a67d740 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a5f1c98b00 0x55a5f1c39850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f538a67d740 4 client.8523 mds_command: new command op to 8232 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f538a67d740 1 -- 172.21.15.137:0/3480916754 --> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a5f1ba7800 con 0x55a5f1c98b00 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.700+0000 7f5385703640 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a5f1c98b00 0x55a5f1c39850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f535ffff640 10 client.8523 ms_handle_connect on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f5385703640 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a5f1c98b00 0x55a5f1c39850 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3b3b38446d1255 server_cookie=30c647b89004da29 in_seq=0 out_seq=0 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f535ffff640 1 -- 172.21.15.137:0/3480916754 <== mds.0 v2:172.21.15.170:6832/2219855149 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a5f1ba7800 con 0x55a5f1c98b00 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f535ffff640 10 client.8523 handle_command_reply: tid=0 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 client.8523 shutdown 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 -- 172.21.15.137:0/3480916754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c69340 msgr2=0x55a5f1c3ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c69340 0x55a5f1c3ce30 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f538015d1c0 tx=0x7f537c01df20 comp rx=0 tx=0).stop 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 -- 172.21.15.137:0/3480916754 shutdown_connections 2024-04-26T22:06:45.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:6832/2219855149,v1:172.21.15.170:6835/2219855149] conn(0x55a5f1c98b00 0x55a5f1c39850 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a5f1c69340 0x55a5f1c3ce30 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a5f1c816f0 0x55a5f1c985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f535ffff640 0 client.8523 ms_handle_reset on v2:172.21.15.170:6832/2219855149 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 --2- 172.21.15.137:0/3480916754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5f1c65d30 0x55a5f1d016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 -- 172.21.15.137:0/3480916754 >> 172.21.15.137:0/3480916754 conn(0x55a5f1c36350 msgr2=0x55a5f1c80580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 -- 172.21.15.137:0/3480916754 shutdown_connections 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 1 -- 172.21.15.137:0/3480916754 wait complete. 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.701+0000 7f538a67d740 20 client.8523 trim_cache size 0 max 16384 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:06:45.707 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:06:45.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 -- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f536406c8f0 msgr2=0x7f536406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f536406c8f0 0x7f536406edb0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f53700016e0 tx=0x7f5370009040 comp rx=0 tx=0).stop 2024-04-26T22:06:45.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 -- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5380143840 msgr2=0x7f538015c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5380143840 0x7f538015c490 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f5378009e50 tx=0x7f5378004a40 comp rx=0 tx=0).stop 2024-04-26T22:06:45.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 -- 172.21.15.137:0/1922643229 shutdown_connections 2024-04-26T22:06:45.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f536406c8f0 0x7f536406edb0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5380143840 0x7f538015c490 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f53800ceff0 0x7f5380158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 --2- 172.21.15.137:0/1922643229 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f53800b4eb0 0x7f53801f73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 -- 172.21.15.137:0/1922643229 >> 172.21.15.137:0/1922643229 conn(0x7f53800cd8a0 msgr2=0x7f53800cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:45.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 -- 172.21.15.137:0/1922643229 shutdown_connections 2024-04-26T22:06:45.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.702+0000 7f5387967640 1 -- 172.21.15.137:0/1922643229 wait complete. 2024-04-26T22:06:45.712 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:06:45.813 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.912+0000 7f34d9d78640 1 Processor -- start 2024-04-26T22:06:45.912 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.912+0000 7f34d9d78640 1 -- start start 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.913+0000 7f34d9d78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d415f370 0x7f34d40cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.913+0000 7f34d9d78640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d40d03a0 con 0x7f34d40d3ee0 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.913+0000 7f34d9d78640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d40d0680 con 0x7f34d415f750 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.913+0000 7f34d9d78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f34d40d0960 con 0x7f34d415f370 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.913+0000 7f34d3fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f34d40d3ee0 0x7f34d40b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57338/0 (socket says 172.21.15.137:57338) 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.913+0000 7f34d3fff640 1 -- 172.21.15.137:0/2848258650 learned_addr learned my addr 172.21.15.137:0/2848258650 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.913+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584834492 0 0) 0x7f34d40d03a0 con 0x7f34d40d3ee0 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.913+0000 7f34d37fe640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d415f370 0x7f34d40cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.916 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.913+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c0003520 con 0x7f34d40d3ee0 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4248838736 0 0) 0x7f34c0003520 con 0x7f34d40d3ee0 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d415f370 msgr2=0x7f34d40cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d415f370 0x7f34d40cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 >> v1:172.21.15.170:6789/0 conn(0x7f34d415f750 legacy=0x7f34d40d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d40d0c40 con 0x7f34d40d3ee0 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f34cc0019f0 con 0x7f34d40d3ee0 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 >> v1:172.21.15.137:6789/0 conn(0x7f34d40d3ee0 legacy=0x7f34d40b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c00039e0 0x7f34c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d415f370 0x7f34c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c0004d40 0x7f34c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34d40d0960 con 0x7f34c00039e0 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f34c000baf0 con 0x7f34c0004d40 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f34c000bcf0 con 0x7f34d415f370 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d37fe640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c00039e0 0x7f34c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34cbfff640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d415f370 0x7f34c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d3fff640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c0004d40 0x7f34c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d37fe640 1 -- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d415f370 msgr2=0x7f34c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d37fe640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34d415f370 0x7f34c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d37fe640 1 -- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c0004d40 msgr2=0x7f34c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d37fe640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c0004d40 0x7f34c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d37fe640 1 -- 172.21.15.137:0/2848258650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c0003520 con 0x7f34c00039e0 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.914+0000 7f34d3fff640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c0004d40 0x7f34c00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.915+0000 7f34d37fe640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c00039e0 0x7f34c0003e00 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009ac0 tx=0x7f34c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed37a8fb8d9350a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.915+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4036070 con 0x7f34c00039e0 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.915+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c4031400 con 0x7f34c00039e0 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.915+0000 7f34d2ffd640 1 -- 172.21.15.137:0/2848258650 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4009690 con 0x7f34c00039e0 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.916+0000 7f34d9d78640 1 -- 172.21.15.137:0/2848258650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c00039e0 msgr2=0x7f34c0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.916+0000 7f34d9d78640 1 --2- 172.21.15.137:0/2848258650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34c00039e0 0x7f34c0003e00 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f34c4009ac0 tx=0x7f34c0005830 comp rx=0 tx=0).stop 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.916+0000 7f34d3fff640 1 -- 172.21.15.137:0/2848258650 reap_dead start 2024-04-26T22:06:45.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.916+0000 7f34d9d78640 1 -- 172.21.15.137:0/2848258650 shutdown_connections 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.916+0000 7f34d9d78640 1 -- 172.21.15.137:0/2848258650 >> 172.21.15.137:0/2848258650 conn(0x7f34d408ec10 msgr2=0x7f34d409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.916+0000 7f34d9d78640 1 -- 172.21.15.137:0/2848258650 shutdown_connections 2024-04-26T22:06:45.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.916+0000 7f34d9d78640 1 -- 172.21.15.137:0/2848258650 wait complete. 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.917+0000 7f34d9d78640 1 Processor -- start 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.917+0000 7f34d9d78640 1 -- start start 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.917+0000 7f34d9d78640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34c00039e0 0x7f34d40b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d9d78640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d40b8760 0x7f34d415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d9d78640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d40cdef0 0x7f34d40ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d9d78640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f34d40cfef0 con 0x7f34d40b8760 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d9d78640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f34d40cfd70 con 0x7f34d40cdef0 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d9d78640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f34d40d0070 con 0x7f34c00039e0 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34cbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d40b8760 0x7f34d415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34cbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d40b8760 0x7f34d415ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54506/0 (socket says 172.21.15.137:54506) 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34cbfff640 1 -- 172.21.15.137:0/2898170637 learned_addr learned my addr 172.21.15.137:0/2898170637 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d37fe640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34c00039e0 0x7f34d40b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d3fff640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d40cdef0 0x7f34d40ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34cbfff640 1 -- 172.21.15.137:0/2898170637 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34c00039e0 msgr2=0x7f34d40b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34cbfff640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34c00039e0 0x7f34d40b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34cbfff640 1 -- 172.21.15.137:0/2898170637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d40cdef0 msgr2=0x7f34d40ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34cbfff640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d40cdef0 0x7f34d40ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34cbfff640 1 -- 172.21.15.137:0/2898170637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d40b8fe0 con 0x7f34d40b8760 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34cbfff640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d40b8760 0x7f34d415ca90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00f820 tx=0x7f34bc00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d0ff9640 1 -- 172.21.15.137:0/2898170637 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc0050d0 con 0x7f34d40b8760 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d0ff9640 1 -- 172.21.15.137:0/2898170637 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34bc018070 con 0x7f34d40b8760 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d40b92c0 con 0x7f34d40b8760 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d0ff9640 1 -- 172.21.15.137:0/2898170637 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc005490 con 0x7f34d40b8760 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.918+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d40b9880 con 0x7f34d40b8760 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.920+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d406a290 con 0x7f34d40b8760 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.920+0000 7f34d0ff9640 1 -- 172.21.15.137:0/2898170637 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34bc00d730 con 0x7f34d40b8760 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.920+0000 7f34d0ff9640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34b406c8f0 0x7f34b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.920+0000 7f34d0ff9640 1 -- 172.21.15.137:0/2898170637 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f34bc08bab0 con 0x7f34d40b8760 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.920+0000 7f34d37fe640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34b406c8f0 0x7f34b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:45.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.920+0000 7f34d37fe640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34b406c8f0 0x7f34b406edb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f34c4033000 tx=0x7f34c4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:45.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:45.924+0000 7f34d0ff9640 1 -- 172.21.15.137:0/2898170637 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f34bc059e40 con 0x7f34d40b8760 2024-04-26T22:06:46.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.171+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f34d40b5bf0 con 0x7f34d40b8760 2024-04-26T22:06:46.171 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:06:46.171+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:06:46.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.173+0000 7f34d0ff9640 1 -- 172.21.15.137:0/2898170637 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) ==== 161+0+0 (secure 0 0 0) 0x7f34bc059740 con 0x7f34d40b8760 2024-04-26T22:06:46.173 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:06:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34b406c8f0 msgr2=0x7f34b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34b406c8f0 0x7f34b406edb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f34c4033000 tx=0x7f34c4008030 comp rx=0 tx=0).stop 2024-04-26T22:06:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d40b8760 msgr2=0x7f34d415ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d40b8760 0x7f34d415ca90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00f820 tx=0x7f34bc00fce0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 shutdown_connections 2024-04-26T22:06:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f34b406c8f0 0x7f34b406edb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f34d40b8760 0x7f34d415ca90 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34d40cdef0 0x7f34d40ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.175 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 --2- 172.21.15.137:0/2898170637 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f34c00039e0 0x7f34d40b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 >> 172.21.15.137:0/2898170637 conn(0x7f34d408ec10 msgr2=0x7f34d40d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 shutdown_connections 2024-04-26T22:06:46.176 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.175+0000 7f34d9d78640 1 -- 172.21.15.137:0/2898170637 wait complete. 2024-04-26T22:06:46.180 INFO:tasks.ceph.mds.b.smithi170.stderr: -6975> 2024-04-26T22:06:07.871+0000 7f4af376d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:06:46.187 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-04-26T22:06:46.212 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T22:06:46.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.228+0000 7fc1f2a3c280 1 -- start start 2024-04-26T22:06:46.228 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.228+0000 7fc1f2a3c280 1 Processor -- start 2024-04-26T22:06:46.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f2a3c280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed516f4c00 0x55ed524c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f2a3c280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed516f5800 0x55ed524c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f2a3c280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed516f5c00 0x55ed524c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f2a3c280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed524d8180 con 0x55ed516f4c00 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f2a3c280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ed524d8300 con 0x55ed516f5c00 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f2a3c280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ed524d8480 con 0x55ed516f5800 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f11ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed516f4c00 0x55ed524c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f11ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed516f4c00 0x55ed524c0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54526/0 (socket says 172.21.15.137:54526) 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f11ea640 1 -- 172.21.15.137:0/2262061284 learned_addr learned my addr 172.21.15.137:0/2262061284 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f09e9640 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed516f5800 0x55ed524c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f19eb640 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed516f5c00 0x55ed524c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f11ea640 1 -- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed516f5800 msgr2=0x55ed524c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f11ea640 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed516f5800 0x55ed524c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f11ea640 1 -- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed516f5c00 msgr2=0x55ed524c0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f11ea640 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed516f5c00 0x55ed524c0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f11ea640 1 -- 172.21.15.137:0/2262061284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed5172a780 con 0x55ed516f4c00 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f09e9640 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed516f5800 0x55ed524c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:46.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f19eb640 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed516f5c00 0x55ed524c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.229+0000 7fc1f11ea640 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed516f4c00 0x55ed524c0000 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x55ed52515800 tx=0x55ed524940c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc191bec788f8a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1ee9e5640 1 -- 172.21.15.137:0/2262061284 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ed5171a680 con 0x55ed516f4c00 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1ee9e5640 1 -- 172.21.15.137:0/2262061284 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ed51720fc0 con 0x55ed516f4c00 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1ee9e5640 1 -- 172.21.15.137:0/2262061284 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ed5171ab60 con 0x55ed516f4c00 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2262061284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed5172a3c0 con 0x55ed516f4c00 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2262061284 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55ed5172b680 con 0x55ed516f4c00 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1f2a3c280 4 waiting for MDS map... 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1ee9e5640 1 -- 172.21.15.137:0/2262061284 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x55ed525d0600 con 0x55ed516f4c00 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1ee9e5640 1 -- 172.21.15.137:0/2262061284 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 67) ==== 2885+0+0 (secure 0 0 0) 0x55ed5174f180 con 0x55ed516f4c00 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1f2a3c280 4 Got MDS map 67 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1f2a3c280 10 main: JournalTool::main 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1f2a3c280 4 main: JournalTool: connecting to RADOS... 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1f2a3c280 1 Processor -- start 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.230+0000 7fc1f2a3c280 1 -- start start 2024-04-26T22:06:46.236 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f2a3c280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed525d3400 0x55ed524c1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f2a3c280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed525d3800 0x55ed524c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f2a3c280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f2a3c280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed524d8600 con 0x55ed525d3c00 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f2a3c280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ed524d8780 con 0x55ed525d3800 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f2a3c280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ed524d8900 con 0x55ed525d3400 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f09e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f09e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54532/0 (socket says 172.21.15.137:54532) 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f09e9640 1 -- 172.21.15.137:0/3297252051 learned_addr learned my addr 172.21.15.137:0/3297252051 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f11ea640 1 --2- 172.21.15.137:0/3297252051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed525d3800 0x55ed524c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f19eb640 1 --2- 172.21.15.137:0/3297252051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed525d3400 0x55ed524c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f09e9640 1 -- 172.21.15.137:0/3297252051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed525d3400 msgr2=0x55ed524c1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f09e9640 1 --2- 172.21.15.137:0/3297252051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed525d3400 0x55ed524c1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f09e9640 1 -- 172.21.15.137:0/3297252051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed525d3800 msgr2=0x55ed524c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.237 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f09e9640 1 --2- 172.21.15.137:0/3297252051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed525d3800 0x55ed524c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.231+0000 7fc1f09e9640 1 -- 172.21.15.137:0/3297252051 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed5172b4a0 con 0x55ed525d3c00 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f09e9640 1 --2- 172.21.15.137:0/3297252051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x55ed525e05a0 tx=0x55ed524925a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac92399b35c1b602 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1ec9e1640 1 -- 172.21.15.137:0/3297252051 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ed5171a9c0 con 0x55ed525d3c00 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1ec9e1640 1 -- 172.21.15.137:0/3297252051 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ed51720e00 con 0x55ed525d3c00 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1ec9e1640 1 -- 172.21.15.137:0/3297252051 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ed5171a680 con 0x55ed525d3c00 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/3297252051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 msgr2=0x55ed524c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/3297252051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x55ed525e05a0 tx=0x55ed524925a0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/3297252051 shutdown_connections 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/3297252051 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/3297252051 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed525d3800 0x55ed524c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/3297252051 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed525d3400 0x55ed524c1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/3297252051 >> 172.21.15.137:0/3297252051 conn(0x55ed525d3000 msgr2=0x55ed517ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/3297252051 shutdown_connections 2024-04-26T22:06:46.238 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.232+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/3297252051 wait complete. 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f2a3c280 1 Processor -- start 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f2a3c280 1 -- start start 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f2a3c280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed525d3400 0x55ed524c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f2a3c280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed525d3800 0x55ed524c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f2a3c280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f2a3c280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55ed524d9b00 con 0x55ed525d3c00 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f2a3c280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55ed524d9980 con 0x55ed525d3400 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f2a3c280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55ed524d9800 con 0x55ed525d3800 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f09e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f09e9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54544/0 (socket says 172.21.15.137:54544) 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f09e9640 1 -- 172.21.15.137:0/2286751995 learned_addr learned my addr 172.21.15.137:0/2286751995 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f19eb640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed525d3400 0x55ed524c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.233+0000 7fc1f11ea640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed525d3800 0x55ed524c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1f09e9640 1 -- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed525d3800 msgr2=0x55ed524c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1f09e9640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed525d3800 0x55ed524c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1f09e9640 1 -- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed525d3400 msgr2=0x55ed524c1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1f09e9640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed525d3400 0x55ed524c1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1f09e9640 1 -- 172.21.15.137:0/2286751995 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed5172a780 con 0x55ed525d3c00 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1f09e9640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x55ed525e08d0 tx=0x55ed52492ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1eb1de640 1 -- 172.21.15.137:0/2286751995 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ed5171ab60 con 0x55ed525d3c00 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1eb1de640 1 -- 172.21.15.137:0/2286751995 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55ed51720c40 con 0x55ed525d3c00 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed5172a3c0 con 0x55ed525d3c00 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1eb1de640 1 -- 172.21.15.137:0/2286751995 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ed5171a4e0 con 0x55ed525d3c00 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed5172a000 con 0x55ed525d3c00 2024-04-26T22:06:46.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.234+0000 7fc1f2a3c280 4 main: JournalTool: resolving pool 14 2024-04-26T22:06:46.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.235+0000 7fc1eb1de640 1 -- 172.21.15.137:0/2286751995 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55ed52636c00 con 0x55ed525d3c00 2024-04-26T22:06:46.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.235+0000 7fc1eb1de640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55ed51a72000 0x55ed524c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.235+0000 7fc1eb1de640 1 -- 172.21.15.137:0/2286751995 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x55ed52646600 con 0x55ed525d3c00 2024-04-26T22:06:46.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.235+0000 7fc1f19eb640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55ed51a72000 0x55ed524c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.235+0000 7fc1f2a3c280 4 main: JournalTool: creating IoCtx.. 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.235+0000 7fc1f2a3c280 4 main: Executing for rank 0 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.235+0000 7fc1f2a3c280 4 Filtering by inode '1099511627777' 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.236+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55ed51a72400 0x55ed524c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.236+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x55ed51a72800 con 0x55ed51a72400 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.236+0000 7fc1f11ea640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55ed51a72400 0x55ed524c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.236+0000 7fc1f19eb640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55ed51a72000 0x55ed524c2100 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55ed5186eea0 tx=0x55ed525e4f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.236+0000 7fc1f11ea640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55ed51a72400 0x55ed524c2680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.237+0000 7fc1f11ea640 1 -- 172.21.15.137:0/2286751995 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55ed52482000 con 0x55ed51a72400 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.237+0000 7fc1f2a3c280 4 Pointer 400.00000000 is readable 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.237+0000 7fc1f2a3c280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.237+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55ed51a72c00 0x55ed524c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.237+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x55ed51a73000 con 0x55ed51a72c00 2024-04-26T22:06:46.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.237+0000 7fc1f19eb640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55ed51a72c00 0x55ed524c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.237+0000 7fc1f19eb640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55ed51a72c00 0x55ed524c2c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.239+0000 7fc1f19eb640 1 -- 172.21.15.137:0/2286751995 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55ed52482500 con 0x55ed51a72c00 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.239+0000 7fc1f2a3c280 10 Header 0x400000 0x407d21 0x40809d 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.239+0000 7fc1f2a3c280 10 Starting journal scan from offset 0x407d21 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x55ed51a73400 con 0x55ed51a72c00 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f19eb640 1 -- 172.21.15.137:0/2286751995 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x55ed52482500 con 0x55ed51a72c00 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f2a3c280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f2a3c280 10 Parsing data, 0x37c bytes available 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f2a3c280 10 Attempting decode at 0x407d21 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f2a3c280 10 Consumed 0x37c bytes 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f2a3c280 10 Valid entry at 0x407d21 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55ed51a88000 0x55ed524c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x55ed51a88400 con 0x55ed51a88000 2024-04-26T22:06:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f11ea640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55ed51a88000 0x55ed524c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.240+0000 7fc1f11ea640 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55ed51a88000 0x55ed524c3180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.242+0000 7fc1f11ea640 1 -- 172.21.15.137:0/2286751995 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55ed52482000 con 0x55ed51a88000 2024-04-26T22:06:46.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.242+0000 7fc1f2a3c280 4 Reached end of journal objects 2024-04-26T22:06:46.246 INFO:teuthology.orchestra.run.smithi137.stdout:Events by type: 2024-04-26T22:06:46.246 INFO:teuthology.orchestra.run.smithi137.stdout:Errors: 0 2024-04-26T22:06:46.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.242+0000 7fc1f2a3c280 4 Scanned objects, 0 missing, 1 valid 2024-04-26T22:06:46.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.242+0000 7fc1f2a3c280 4 Events scanned, 0 gaps 2024-04-26T22:06:46.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.242+0000 7fc1f2a3c280 4 Found 1 valid events 2024-04-26T22:06:46.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.242+0000 7fc1f2a3c280 4 Selected 0 events events for processing 2024-04-26T22:06:46.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.242+0000 7fc1f2a3c280 4 0 events 2024-04-26T22:06:46.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55ed51a88000 msgr2=0x55ed524c3180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55ed51a88000 0x55ed524c3180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55ed51a72c00 msgr2=0x55ed524c2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55ed51a72c00 0x55ed524c2c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55ed51a72400 msgr2=0x55ed524c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55ed51a72400 0x55ed524c2680 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f09e9640 1 -- 172.21.15.137:0/2286751995 reap_dead start 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55ed51a72000 msgr2=0x55ed524c2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55ed51a72000 0x55ed524c2100 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55ed5186eea0 tx=0x55ed525e4f60 comp rx=0 tx=0).stop 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 msgr2=0x55ed524c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x55ed525e08d0 tx=0x55ed52492ae0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 shutdown_connections 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55ed51a72000 0x55ed524c2100 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2286751995 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed525d3c00 0x55ed524c1b80 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 >> 172.21.15.137:0/2286751995 conn(0x55ed525d3000 msgr2=0x55ed517ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 shutdown_connections 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2286751995 wait complete. 2024-04-26T22:06:46.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2262061284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed516f4c00 msgr2=0x55ed524c0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed516f4c00 0x55ed524c0000 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x55ed52515800 tx=0x55ed524940c0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2262061284 shutdown_connections 2024-04-26T22:06:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed516f5c00 0x55ed524c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55ed516f5800 0x55ed524c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 --2- 172.21.15.137:0/2262061284 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55ed516f4c00 0x55ed524c0000 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2262061284 >> 172.21.15.137:0/2262061284 conn(0x55ed516f5000 msgr2=0x55ed517ec800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2262061284 shutdown_connections 2024-04-26T22:06:46.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.243+0000 7fc1f2a3c280 1 -- 172.21.15.137:0/2262061284 wait complete. 2024-04-26T22:06:46.250 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.063424, result: Events by type: Errors: 0 2024-04-26T22:06:46.250 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-04-26T22:06:46.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.330+0000 7f0b332ce280 1 -- start start 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.330+0000 7f0b332ce280 1 Processor -- start 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b332ce280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ac970c00 0x55c9ad746000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b332ce280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ac971800 0x55c9ad746580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b332ce280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ac971c00 0x55c9ad746b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b332ce280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c9ad75e600 con 0x55c9ac971c00 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b332ce280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c9ad75e480 con 0x55c9ac970c00 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b332ce280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c9ad75e300 con 0x55c9ac971800 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b3227b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ac971c00 0x55c9ad746b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b3227b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ac971c00 0x55c9ad746b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54552/0 (socket says 172.21.15.137:54552) 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b3227b640 1 -- 172.21.15.137:0/2140546805 learned_addr learned my addr 172.21.15.137:0/2140546805 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ac970c00 0x55c9ad746000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b31279640 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ac971800 0x55c9ad746580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b3227b640 1 -- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ac971800 msgr2=0x55c9ad746580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b3227b640 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ac971800 0x55c9ad746580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b3227b640 1 -- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ac970c00 msgr2=0x55c9ad746000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b3227b640 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ac970c00 0x55c9ad746000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b3227b640 1 -- 172.21.15.137:0/2140546805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ac9a6780 con 0x55c9ac971c00 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ac970c00 0x55c9ad746000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b31279640 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ac971800 0x55c9ad746580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b3227b640 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ac971c00 0x55c9ad746b00 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x55c9ad79f800 tx=0x55c9ad7101e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f15ac0cf350c112 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b2f275640 1 -- 172.21.15.137:0/2140546805 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c9ac996680 con 0x55c9ac971c00 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b2f275640 1 -- 172.21.15.137:0/2140546805 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c9ac99ce00 con 0x55c9ac971c00 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b2f275640 1 -- 172.21.15.137:0/2140546805 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c9ac996b60 con 0x55c9ac971c00 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b332ce280 1 -- 172.21.15.137:0/2140546805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ac9a74a0 con 0x55c9ac971c00 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b332ce280 1 -- 172.21.15.137:0/2140546805 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55c9ac9a6000 con 0x55c9ac971c00 2024-04-26T22:06:46.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.331+0000 7f0b332ce280 4 waiting for MDS map... 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.332+0000 7f0b2f275640 1 -- 172.21.15.137:0/2140546805 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x55c9ad84ca00 con 0x55c9ac971c00 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.332+0000 7f0b2f275640 1 -- 172.21.15.137:0/2140546805 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 67) ==== 2885+0+0 (secure 0 0 0) 0x55c9ac9cb180 con 0x55c9ac971c00 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.332+0000 7f0b332ce280 4 Got MDS map 67 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.332+0000 7f0b332ce280 10 main: JournalTool::main 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.332+0000 7f0b332ce280 4 main: JournalTool: connecting to RADOS... 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.332+0000 7f0b332ce280 1 Processor -- start 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.332+0000 7f0b332ce280 1 -- start start 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b332ce280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ad84f400 0x55c9ad747080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b332ce280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f800 0x55c9ad747600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b332ce280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ad84fc00 0x55c9ad747b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b332ce280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c9ad75e180 con 0x55c9ad84f800 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b332ce280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c9ac9d2480 con 0x55c9ad84fc00 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b332ce280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c9ac9d2900 con 0x55c9ad84f400 2024-04-26T22:06:46.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31a7a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f800 0x55c9ad747600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31a7a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f800 0x55c9ad747600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54558/0 (socket says 172.21.15.137:54558) 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31a7a640 1 -- 172.21.15.137:0/1571833551 learned_addr learned my addr 172.21.15.137:0/1571833551 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31279640 1 --2- 172.21.15.137:0/1571833551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ad84f400 0x55c9ad747080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31279640 1 --2- 172.21.15.137:0/1571833551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ad84fc00 0x55c9ad747b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31a7a640 1 -- 172.21.15.137:0/1571833551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ad84f400 msgr2=0x55c9ad747080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/1571833551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ad84f400 0x55c9ad747080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31a7a640 1 -- 172.21.15.137:0/1571833551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ad84fc00 msgr2=0x55c9ad747b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/1571833551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ad84fc00 0x55c9ad747b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31a7a640 1 -- 172.21.15.137:0/1571833551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ac9a63c0 con 0x55c9ad84f800 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/1571833551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f800 0x55c9ad747600 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x55c9ad866660 tx=0x55c9ad70e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd4379623ca7334 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b2d271640 1 -- 172.21.15.137:0/1571833551 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c9ac9969c0 con 0x55c9ad84f800 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b2d271640 1 -- 172.21.15.137:0/1571833551 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c9ac99c1c0 con 0x55c9ad84f800 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.333+0000 7f0b2d271640 1 -- 172.21.15.137:0/1571833551 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c9ac996680 con 0x55c9ad84f800 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 -- 172.21.15.137:0/1571833551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f800 msgr2=0x55c9ad747600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 --2- 172.21.15.137:0/1571833551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f800 0x55c9ad747600 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x55c9ad866660 tx=0x55c9ad70e600 comp rx=0 tx=0).stop 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 -- 172.21.15.137:0/1571833551 shutdown_connections 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 --2- 172.21.15.137:0/1571833551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f800 0x55c9ad747600 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 --2- 172.21.15.137:0/1571833551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ad84fc00 0x55c9ad747b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 --2- 172.21.15.137:0/1571833551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ad84f400 0x55c9ad747080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 -- 172.21.15.137:0/1571833551 >> 172.21.15.137:0/1571833551 conn(0x55c9ad84f000 msgr2=0x55c9aca66800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 -- 172.21.15.137:0/1571833551 shutdown_connections 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 -- 172.21.15.137:0/1571833551 wait complete. 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 Processor -- start 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.334+0000 7f0b332ce280 1 -- start start 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b332ce280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f400 0x55c9ad747080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b332ce280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ad84f800 0x55c9ad747600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b332ce280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ad84fc00 0x55c9ad747b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b332ce280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c9ad75f200 con 0x55c9ad84f400 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b332ce280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c9ad75e180 con 0x55c9ad84f800 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b332ce280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c9ad75f380 con 0x55c9ad84fc00 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f400 0x55c9ad747080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f400 0x55c9ad747080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54574/0 (socket says 172.21.15.137:54574) 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 -- 172.21.15.137:0/3019873891 learned_addr learned my addr 172.21.15.137:0/3019873891 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ad84f800 0x55c9ad747600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ad84fc00 0x55c9ad747b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 -- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ad84fc00 msgr2=0x55c9ad747b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ad84fc00 0x55c9ad747b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 -- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ad84f800 msgr2=0x55c9ad747600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ad84f800 0x55c9ad747600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 -- 172.21.15.137:0/3019873891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ac9a6780 con 0x55c9ad84f400 2024-04-26T22:06:46.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.335+0000 7f0b31279640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f400 0x55c9ad747080 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x55c9ad867a40 tx=0x55c9ad7102a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.336+0000 7f0b2ba6e640 1 -- 172.21.15.137:0/3019873891 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c9ac9969c0 con 0x55c9ad84f400 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.336+0000 7f0b2ba6e640 1 -- 172.21.15.137:0/3019873891 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c9ac99c700 con 0x55c9ad84f400 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.336+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9ac9a74a0 con 0x55c9ad84f400 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.336+0000 7f0b2ba6e640 1 -- 172.21.15.137:0/3019873891 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55c9ac996680 con 0x55c9ad84f400 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.336+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ac9a6000 con 0x55c9ad84f400 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.336+0000 7f0b332ce280 4 main: JournalTool: resolving pool 14 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.337+0000 7f0b2ba6e640 1 -- 172.21.15.137:0/3019873891 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55c9ad8bac00 con 0x55c9ad84f400 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.337+0000 7f0b2ba6e640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c9ad780c00 0x55c9ad748100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.337+0000 7f0b2ba6e640 1 -- 172.21.15.137:0/3019873891 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x55c9ad8caa00 con 0x55c9ad84f400 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.337+0000 7f0b332ce280 4 main: JournalTool: creating IoCtx.. 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.337+0000 7f0b332ce280 4 main: Executing for rank 0 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.337+0000 7f0b332ce280 4 Filtering by inode '1099511627778' 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.337+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c9ad780c00 0x55c9ad748100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.337+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c9ad781000 0x55c9ad748680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.337+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x55c9ad781400 con 0x55c9ad781000 2024-04-26T22:06:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.338+0000 7f0b31279640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c9ad781000 0x55c9ad748680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.338+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c9ad780c00 0x55c9ad748100 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x55c9ad866660 tx=0x55c9ad710240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.338+0000 7f0b31279640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c9ad781000 0x55c9ad748680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.338+0000 7f0b31279640 1 -- 172.21.15.137:0/3019873891 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x55c9ad6fe000 con 0x55c9ad781000 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.338+0000 7f0b332ce280 4 Pointer 400.00000000 is readable 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.338+0000 7f0b332ce280 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.338+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9ad781800 0x55c9ad748c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.338+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x55c9ad781c00 con 0x55c9ad781800 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.338+0000 7f0b3227b640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9ad781800 0x55c9ad748c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b3227b640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9ad781800 0x55c9ad748c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b3227b640 1 -- 172.21.15.137:0/3019873891 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x55c9ad6fe500 con 0x55c9ad781800 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 10 Header 0x400000 0x407d21 0x40809d 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 10 Starting journal scan from offset 0x407d21 2024-04-26T22:06:46.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 32033~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x55c9acd04000 con 0x55c9ad781800 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b3227b640 1 -- 172.21.15.137:0/3019873891 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== osd_op_reply(3 200.00000001 [read 32033~892 out=892b] v0'0 uv28 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x55c9ad6fe500 con 0x55c9ad781800 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 10 Parsing data, 0x37c bytes available 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 10 Attempting decode at 0x407d21 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 10 Consumed 0x37c bytes 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 10 Valid entry at 0x407d21 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c9acd04400 0x55c9ad749180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.339+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) -- 0x55c9acd04800 con 0x55c9acd04400 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c9acd04400 0x55c9ad749180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b31a7a640 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c9acd04400 0x55c9ad749180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b31a7a640 1 -- 172.21.15.137:0/3019873891 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x55c9ad6fe780 con 0x55c9acd04400 2024-04-26T22:06:46.349 INFO:teuthology.orchestra.run.smithi137.stdout:Events by type: 2024-04-26T22:06:46.349 INFO:teuthology.orchestra.run.smithi137.stdout:Errors: 0 2024-04-26T22:06:46.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 4 Reached end of journal objects 2024-04-26T22:06:46.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 4 Scanned objects, 0 missing, 1 valid 2024-04-26T22:06:46.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 4 Events scanned, 0 gaps 2024-04-26T22:06:46.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 4 Found 1 valid events 2024-04-26T22:06:46.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 4 Selected 0 events events for processing 2024-04-26T22:06:46.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 4 0 events 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c9acd04400 msgr2=0x55c9ad749180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55c9acd04400 0x55c9ad749180 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9ad781800 msgr2=0x55c9ad748c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55c9ad781800 0x55c9ad748c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c9ad781000 msgr2=0x55c9ad748680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55c9ad781000 0x55c9ad748680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b31a7a640 1 -- 172.21.15.137:0/3019873891 reap_dead start 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c9ad780c00 msgr2=0x55c9ad748100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c9ad780c00 0x55c9ad748100 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x55c9ad866660 tx=0x55c9ad710240 comp rx=0 tx=0).stop 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f400 msgr2=0x55c9ad747080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f400 0x55c9ad747080 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x55c9ad867a40 tx=0x55c9ad7102a0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 shutdown_connections 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55c9ad780c00 0x55c9ad748100 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.352 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 --2- 172.21.15.137:0/3019873891 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ad84f400 0x55c9ad747080 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 >> 172.21.15.137:0/3019873891 conn(0x55c9ad84f000 msgr2=0x55c9aca66800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.340+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 shutdown_connections 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 -- 172.21.15.137:0/3019873891 wait complete. 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 -- 172.21.15.137:0/2140546805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ac971c00 msgr2=0x55c9ad746b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ac971c00 0x55c9ad746b00 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x55c9ad79f800 tx=0x55c9ad7101e0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 -- 172.21.15.137:0/2140546805 shutdown_connections 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c9ac971c00 0x55c9ad746b00 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c9ac971800 0x55c9ad746580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 --2- 172.21.15.137:0/2140546805 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9ac970c00 0x55c9ad746000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 -- 172.21.15.137:0/2140546805 >> 172.21.15.137:0/2140546805 conn(0x55c9ac971000 msgr2=0x55c9aca67000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 -- 172.21.15.137:0/2140546805 shutdown_connections 2024-04-26T22:06:46.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.341+0000 7f0b332ce280 1 -- 172.21.15.137:0/2140546805 wait complete. 2024-04-26T22:06:46.354 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.103263, result: Events by type: Errors: 0 2024-04-26T22:06:46.354 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-04-26T22:06:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.434+0000 7f70d058af40 1 Processor -- start 2024-04-26T22:06:46.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.434+0000 7f70d058af40 1 -- start start 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.434+0000 7f70d058af40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c07c260 0x564b4c07d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70d058af40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c124890 0x564b4c093ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70d058af40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4c124c70 0x564b4c122c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70d058af40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b4bff4e40 con 0x564b4c07c260 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70d058af40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564b4bff8e80 con 0x564b4c124c70 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70d058af40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564b4c0959b0 con 0x564b4c124890 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce084640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c07c260 0x564b4c07d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce084640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c07c260 0x564b4c07d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54580/0 (socket says 172.21.15.137:54580) 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce084640 1 -- 172.21.15.137:0/379411040 learned_addr learned my addr 172.21.15.137:0/379411040 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70cd883640 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c124890 0x564b4c093ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce885640 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4c124c70 0x564b4c122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce084640 1 -- 172.21.15.137:0/379411040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c124890 msgr2=0x564b4c093ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce084640 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c124890 0x564b4c093ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce084640 1 -- 172.21.15.137:0/379411040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4c124c70 msgr2=0x564b4c122c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce084640 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4c124c70 0x564b4c122c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce084640 1 -- 172.21.15.137:0/379411040 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b4c120980 con 0x564b4c07c260 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70cd883640 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c124890 0x564b4c093ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70ce084640 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c07c260 0x564b4c07d420 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f70c00017b0 tx=0x7f70c0001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264ebd8d5dc29c59 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70cc881640 1 -- 172.21.15.137:0/379411040 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0016070 con 0x564b4c07c260 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70cc881640 1 -- 172.21.15.137:0/379411040 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c0004520 con 0x564b4c07c260 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.435+0000 7f70cc881640 1 -- 172.21.15.137:0/379411040 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0004910 con 0x564b4c07c260 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 -- 172.21.15.137:0/379411040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c07c260 msgr2=0x564b4c07d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c07c260 0x564b4c07d420 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f70c00017b0 tx=0x7f70c0001c70 comp rx=0 tx=0).stop 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 -- 172.21.15.137:0/379411040 shutdown_connections 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4c124c70 0x564b4c122c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c124890 0x564b4c093ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 --2- 172.21.15.137:0/379411040 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c07c260 0x564b4c07d420 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 -- 172.21.15.137:0/379411040 >> 172.21.15.137:0/379411040 conn(0x564b4c097fd0 msgr2=0x564b4c123830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.440 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 -- 172.21.15.137:0/379411040 shutdown_connections 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 -- 172.21.15.137:0/379411040 wait complete. 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 Processor -- start 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.436+0000 7f70d058af40 1 -- start start 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70d058af40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c07c260 0x564b4c076d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70d058af40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4c124890 0x564b4c1be8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70d058af40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c124c70 0x564b4c1bedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70d058af40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564b4c122790 con 0x564b4c124c70 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70d058af40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564b4c1229e0 con 0x564b4c124890 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70d058af40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564b4c120070 con 0x564b4c07c260 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70ce885640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c124c70 0x564b4c1bedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70ce885640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c124c70 0x564b4c1bedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54588/0 (socket says 172.21.15.137:54588) 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70ce885640 1 -- 172.21.15.137:0/1218695722 learned_addr learned my addr 172.21.15.137:0/1218695722 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70cd883640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4c124890 0x564b4c1be8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70ce084640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c07c260 0x564b4c076d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.441 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70ce885640 1 -- 172.21.15.137:0/1218695722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c07c260 msgr2=0x564b4c076d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70ce885640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564b4c07c260 0x564b4c076d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70ce885640 1 -- 172.21.15.137:0/1218695722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4c124890 msgr2=0x564b4c1be8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70ce885640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4c124890 0x564b4c1be8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.437+0000 7f70ce885640 1 -- 172.21.15.137:0/1218695722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b4c0937c0 con 0x564b4c124c70 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.438+0000 7f70ce885640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c124c70 0x564b4c1bedf0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f70c800df70 tx=0x7f70c800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.438+0000 7f70bf7fe640 1 -- 172.21.15.137:0/1218695722 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80032d0 con 0x564b4c124c70 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.438+0000 7f70bf7fe640 1 -- 172.21.15.137:0/1218695722 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c8016070 con 0x564b4c124c70 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.438+0000 7f70bf7fe640 1 -- 172.21.15.137:0/1218695722 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80016d0 con 0x564b4c124c70 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.438+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b4c119a30 con 0x564b4c124c70 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.438+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b4c119ff0 con 0x564b4c124c70 2024-04-26T22:06:46.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.439+0000 7f70bf7fe640 1 -- 172.21.15.137:0/1218695722 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f70c8001870 con 0x564b4c124c70 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.439+0000 7f70bf7fe640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f70b006b2d0 0x7f70b006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.440+0000 7f70ce084640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f70b006b2d0 0x7f70b006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.440+0000 7f70bf7fe640 1 -- 172.21.15.137:0/1218695722 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f70c808a6b0 con 0x564b4c124c70 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.440+0000 7f70d058af40 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x564b4c04e7e0 0x564b4c117e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.440+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) -- 0x564b4c04ebc0 con 0x564b4c04e7e0 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.440+0000 7f70cd883640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x564b4c04e7e0 0x564b4c117e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.440+0000 7f70ce084640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f70b006b2d0 0x7f70b006d790 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x564b4c121b30 tx=0x7f70c0009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.440+0000 7f70cd883640 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x564b4c04e7e0 0x564b4c117e70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70cd883640 1 -- 172.21.15.137:0/1218695722 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v104'5 uv5 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x7f70c405c040 con 0x564b4c04e7e0 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x564b4c04e7e0 msgr2=0x564b4c117e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x564b4c04e7e0 0x564b4c117e70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f70b006b2d0 msgr2=0x7f70b006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f70b006b2d0 0x7f70b006d790 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x564b4c121b30 tx=0x7f70c0009000 comp rx=0 tx=0).stop 2024-04-26T22:06:46.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c124c70 msgr2=0x564b4c1bedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 --2- 172.21.15.137:0/1218695722 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564b4c124c70 0x564b4c1bedf0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f70c800df70 tx=0x7f70c800b5b0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70ce885640 1 -- 172.21.15.137:0/1218695722 reap_dead start 2024-04-26T22:06:46.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 shutdown_connections 2024-04-26T22:06:46.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 >> 172.21.15.137:0/1218695722 conn(0x564b4c097fd0 msgr2=0x564b4c123680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 shutdown_connections 2024-04-26T22:06:46.446 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.442+0000 7f70d058af40 1 -- 172.21.15.137:0/1218695722 wait complete. 2024-04-26T22:06:46.446 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-26T22:06:46.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.585+0000 7f15bff9d640 1 Processor -- start 2024-04-26T22:06:46.585 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.585+0000 7f15bff9d640 1 -- start start 2024-04-26T22:06:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bff9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f15b80b3c20 0x7f15b806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bff9d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b809c700 con 0x7f15b80b33e0 2024-04-26T22:06:46.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bff9d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15b80d1c50 con 0x7f15b80d0010 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bff9d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f15b80b4480 con 0x7f15b80b3c20 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15be53a640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f15b80b33e0 0x7f15b8163280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57374/0 (socket says 172.21.15.137:57374) 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15be53a640 1 -- 172.21.15.137:0/3378536076 learned_addr learned my addr 172.21.15.137:0/3378536076 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671886493 0 0) 0x7f15b809c700 con 0x7f15b80b33e0 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bd538640 1 --2- 172.21.15.137:0/3378536076 >> v2:172.21.15.170:3300/0 conn(0x7f15b80b3c20 0x7f15b806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a4003520 con 0x7f15b80b33e0 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4240392781 0 0) 0x7f15a4003520 con 0x7f15b80b33e0 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 >> v2:172.21.15.170:3300/0 conn(0x7f15b80b3c20 msgr2=0x7f15b806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 --2- 172.21.15.137:0/3378536076 >> v2:172.21.15.170:3300/0 conn(0x7f15b80b3c20 0x7f15b806db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 >> v1:172.21.15.170:6789/0 conn(0x7f15b80d0010 legacy=0x7f15b80b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b80d1f30 con 0x7f15b80b33e0 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f15b00019f0 con 0x7f15b80b33e0 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 >> v1:172.21.15.137:6789/0 conn(0x7f15b80b33e0 legacy=0x7f15b8163280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.586+0000 7f15bcd37640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15a40039b0 0x7f15a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bcd37640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bcd37640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15a40051c0 0x7f15a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15b80b4480 con 0x7f15a4004800 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f15a400c060 con 0x7f15a40039b0 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f15a400c260 con 0x7f15a40051c0 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bd538640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bdd39640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15a40039b0 0x7f15a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15be53a640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15a40051c0 0x7f15a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bd538640 1 -- 172.21.15.137:0/3378536076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15a40051c0 msgr2=0x7f15a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bd538640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15a40051c0 0x7f15a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bd538640 1 -- 172.21.15.137:0/3378536076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15a40039b0 msgr2=0x7f15a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bd538640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15a40039b0 0x7f15a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15bd538640 1 -- 172.21.15.137:0/3378536076 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a4003520 con 0x7f15a4004800 2024-04-26T22:06:46.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15be53a640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15a40051c0 0x7f15a400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.587+0000 7f15be53a640 1 -- 172.21.15.137:0/3378536076 reap_dead start 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bd538640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15a4004c80 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009ac0 tx=0x7f15a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c751166a1c9e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8036070 con 0x7f15a4004800 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15a8031400 con 0x7f15a4004800 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bcd37640 1 -- 172.21.15.137:0/3378536076 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8009690 con 0x7f15a4004800 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bff9d640 1 -- 172.21.15.137:0/3378536076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 msgr2=0x7f15a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bff9d640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15a4004c80 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009ac0 tx=0x7f15a4005830 comp rx=0 tx=0).stop 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bff9d640 1 -- 172.21.15.137:0/3378536076 shutdown_connections 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bff9d640 1 --2- 172.21.15.137:0/3378536076 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15a4004c80 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bff9d640 1 -- 172.21.15.137:0/3378536076 >> 172.21.15.137:0/3378536076 conn(0x7f15b809ba40 msgr2=0x7f15b809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bff9d640 1 -- 172.21.15.137:0/3378536076 shutdown_connections 2024-04-26T22:06:46.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.588+0000 7f15bff9d640 1 -- 172.21.15.137:0/3378536076 wait complete. 2024-04-26T22:06:46.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bff9d640 1 Processor -- start 2024-04-26T22:06:46.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bff9d640 1 -- start start 2024-04-26T22:06:46.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bff9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15b80b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bff9d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15b80b4f80 0x7f15b81f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bff9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15b81f5bd0 0x7f15b81f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bff9d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f15b806db10 con 0x7f15a4004800 2024-04-26T22:06:46.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bff9d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f15b80b3a20 con 0x7f15b81f5bd0 2024-04-26T22:06:46.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bff9d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f15b806dc90 con 0x7f15b80b4f80 2024-04-26T22:06:46.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bdd39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15b80b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bdd39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15b80b4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54610/0 (socket says 172.21.15.137:54610) 2024-04-26T22:06:46.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.590+0000 7f15bdd39640 1 -- 172.21.15.137:0/4218272093 learned_addr learned my addr 172.21.15.137:0/4218272093 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:46.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15bdd39640 1 -- 172.21.15.137:0/4218272093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15b80b4f80 msgr2=0x7f15b81f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15bdd39640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15b80b4f80 0x7f15b81f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15bdd39640 1 -- 172.21.15.137:0/4218272093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15b81f5bd0 msgr2=0x7f15b81f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:46.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15bdd39640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15b81f5bd0 0x7f15b81f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15bdd39640 1 -- 172.21.15.137:0/4218272093 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b80b56e0 con 0x7f15a4004800 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15bdd39640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15b80b4a40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f15b400f820 tx=0x7f15b400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15ae7fc640 1 -- 172.21.15.137:0/4218272093 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b40050d0 con 0x7f15a4004800 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15ae7fc640 1 -- 172.21.15.137:0/4218272093 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b4018070 con 0x7f15a4004800 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15ae7fc640 1 -- 172.21.15.137:0/4218272093 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4005490 con 0x7f15a4004800 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b80b59c0 con 0x7f15a4004800 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.591+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b80b5f80 con 0x7f15a4004800 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.592+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15b806a290 con 0x7f15a4004800 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.592+0000 7f15ae7fc640 1 -- 172.21.15.137:0/4218272093 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f15b400d6b0 con 0x7f15a4004800 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.593+0000 7f15ae7fc640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f159c06c8f0 0x7f159c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.593+0000 7f15ae7fc640 1 -- 172.21.15.137:0/4218272093 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f15b408b9c0 con 0x7f15a4004800 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.593+0000 7f15bd538640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f159c06c8f0 0x7f159c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:46.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.593+0000 7f15bd538640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f159c06c8f0 0x7f159c06edb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f15a8033000 tx=0x7f15a802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:46.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.597+0000 7f15ae7fc640 1 -- 172.21.15.137:0/4218272093 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f15b408de20 con 0x7f15a4004800 2024-04-26T22:06:46.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:46.812+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7f15b8068e00 con 0x7f15a4004800 2024-04-26T22:06:47.174 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.174+0000 7f15ae7fc640 1 -- 172.21.15.137:0/4218272093 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v68) ==== 162+0+0 (secure 0 0 0) 0x7f15b4059d90 con 0x7f15a4004800 2024-04-26T22:06:47.174 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-26T22:06:47.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f159c06c8f0 msgr2=0x7f159c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:47.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f159c06c8f0 0x7f159c06edb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f15a8033000 tx=0x7f15a802e000 comp rx=0 tx=0).stop 2024-04-26T22:06:47.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 msgr2=0x7f15b80b4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:47.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15b80b4a40 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f15b400f820 tx=0x7f15b400fce0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 shutdown_connections 2024-04-26T22:06:47.177 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f159c06c8f0 0x7f159c06edb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15b81f5bd0 0x7f15b81f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f15b80b4f80 0x7f15b81f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 --2- 172.21.15.137:0/4218272093 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f15a4004800 0x7f15b80b4a40 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 >> 172.21.15.137:0/4218272093 conn(0x7f15b809ba40 msgr2=0x7f15b80afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:47.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 shutdown_connections 2024-04-26T22:06:47.178 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.177+0000 7f15bff9d640 1 -- 172.21.15.137:0/4218272093 wait complete. 2024-04-26T22:06:47.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:06:47.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.289+0000 7fc45a8c5640 1 Processor -- start 2024-04-26T22:06:47.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.289+0000 7fc45a8c5640 1 -- start start 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc45a8c5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc4540cf2e0 0x7fc45406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc45a8c5640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc45406e490 0x7fc45415ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc45a8c5640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4540d1740 con 0x7fc4540d11b0 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc45a8c5640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc4540d1a20 con 0x7fc45406e490 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc45a8c5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc4540d1d00 con 0x7fc4540cf2e0 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc458e62640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc45406e490 0x7fc45415ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc4537fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc4540d11b0 0x7fc45406dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57384/0 (socket says 172.21.15.137:57384) 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc4537fe640 1 -- 172.21.15.137:0/372969561 learned_addr learned my addr 172.21.15.137:0/372969561 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc453fff640 1 --2- 172.21.15.137:0/372969561 >> v2:172.21.15.170:3300/0 conn(0x7fc4540cf2e0 0x7fc45406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc458e62640 1 -- 172.21.15.137:0/372969561 >> v2:172.21.15.170:3300/0 conn(0x7fc4540cf2e0 msgr2=0x7fc45406d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:47.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc458e62640 1 --2- 172.21.15.137:0/372969561 >> v2:172.21.15.170:3300/0 conn(0x7fc4540cf2e0 0x7fc45406d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc458e62640 1 -- 172.21.15.137:0/372969561 >> v1:172.21.15.137:6789/0 conn(0x7fc4540d11b0 legacy=0x7fc45406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:47.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc458e62640 1 -- 172.21.15.137:0/372969561 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4540d1fe0 con 0x7fc45406e490 2024-04-26T22:06:47.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc452ffd640 1 -- 172.21.15.137:0/372969561 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529145619 0 0) 0x7fc4540d1740 con 0x7fc4540d11b0 2024-04-26T22:06:47.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.290+0000 7fc453fff640 1 --2- 172.21.15.137:0/372969561 >> v2:172.21.15.170:3300/0 conn(0x7fc4540cf2e0 0x7fc45406d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:47.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.291+0000 7fc458e62640 1 --2- 172.21.15.137:0/372969561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 0x7fc45415ebe0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009d90 tx=0x7fc44c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb0ad8b67e34d34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:47.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.291+0000 7fc452ffd640 1 -- 172.21.15.137:0/372969561 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c007740 con 0x7fc45406e490 2024-04-26T22:06:47.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.291+0000 7fc452ffd640 1 -- 172.21.15.137:0/372969561 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c0078e0 con 0x7fc45406e490 2024-04-26T22:06:47.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.291+0000 7fc452ffd640 1 -- 172.21.15.137:0/372969561 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c007cb0 con 0x7fc45406e490 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.291+0000 7fc45a8c5640 1 -- 172.21.15.137:0/372969561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 msgr2=0x7fc45415ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.291+0000 7fc45a8c5640 1 --2- 172.21.15.137:0/372969561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 0x7fc45415ebe0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fc44c009d90 tx=0x7fc44c02a6a0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.292+0000 7fc45a8c5640 1 -- 172.21.15.137:0/372969561 shutdown_connections 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.292+0000 7fc45a8c5640 1 --2- 172.21.15.137:0/372969561 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 0x7fc45415ebe0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.292+0000 7fc45a8c5640 1 --2- 172.21.15.137:0/372969561 >> v2:172.21.15.170:3300/0 conn(0x7fc4540cf2e0 0x7fc45406d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.292+0000 7fc45a8c5640 1 -- 172.21.15.137:0/372969561 >> 172.21.15.137:0/372969561 conn(0x7fc4540b4a60 msgr2=0x7fc4540b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.292+0000 7fc45a8c5640 1 -- 172.21.15.137:0/372969561 shutdown_connections 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.292+0000 7fc45a8c5640 1 -- 172.21.15.137:0/372969561 wait complete. 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.293+0000 7fc45a8c5640 1 Processor -- start 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.293+0000 7fc45a8c5640 1 -- start start 2024-04-26T22:06:47.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc45a8c5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 0x7fc45409d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc45a8c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4540cf2e0 0x7fc4540a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc45a8c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4540d11b0 0x7fc4540b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc45a8c5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc4540cf6c0 con 0x7fc45406e490 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc45a8c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc45406da10 con 0x7fc4540d11b0 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc45a8c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc4540cf840 con 0x7fc4540cf2e0 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc453fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 0x7fc45409d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc453fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 0x7fc45409d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54632/0 (socket says 172.21.15.137:54632) 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc453fff640 1 -- 172.21.15.137:0/1567385162 learned_addr learned my addr 172.21.15.137:0/1567385162 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc453fff640 1 -- 172.21.15.137:0/1567385162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4540cf2e0 msgr2=0x7fc4540a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc453fff640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4540cf2e0 0x7fc4540a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc453fff640 1 -- 172.21.15.137:0/1567385162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4540d11b0 msgr2=0x7fc4540b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc453fff640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4540d11b0 0x7fc4540b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc453fff640 1 -- 172.21.15.137:0/1567385162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4540a0b20 con 0x7fc45406e490 2024-04-26T22:06:47.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc453fff640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 0x7fc45409d2d0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c7f0 tx=0x7fc44400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:47.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc450ff9640 1 -- 172.21.15.137:0/1567385162 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444015070 con 0x7fc45406e490 2024-04-26T22:06:47.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc450ff9640 1 -- 172.21.15.137:0/1567385162 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc444007820 con 0x7fc45406e490 2024-04-26T22:06:47.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4540afe50 con 0x7fc45406e490 2024-04-26T22:06:47.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc450ff9640 1 -- 172.21.15.137:0/1567385162 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444007bd0 con 0x7fc45406e490 2024-04-26T22:06:47.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.294+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4540b0410 con 0x7fc45406e490 2024-04-26T22:06:47.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.295+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc45406a290 con 0x7fc45406e490 2024-04-26T22:06:47.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.296+0000 7fc450ff9640 1 -- 172.21.15.137:0/1567385162 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc444018070 con 0x7fc45406e490 2024-04-26T22:06:47.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.296+0000 7fc450ff9640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc44006c8f0 0x7fc44006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:47.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.296+0000 7fc450ff9640 1 -- 172.21.15.137:0/1567385162 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7fc44408ba80 con 0x7fc45406e490 2024-04-26T22:06:47.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.296+0000 7fc4537fe640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc44006c8f0 0x7fc44006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:47.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.297+0000 7fc4537fe640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc44006c8f0 0x7fc44006edb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc448007fd0 tx=0x7fc448007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:47.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.301+0000 7fc450ff9640 1 -- 172.21.15.137:0/1567385162 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc444059ee0 con 0x7fc45406e490 2024-04-26T22:06:47.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.514+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4540b8ef0 con 0x7fc45406e490 2024-04-26T22:06:47.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.515+0000 7fc450ff9640 1 -- 172.21.15.137:0/1567385162 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5190 (secure 0 0 0) 0x7fc4440597e0 con 0x7fc45406e490 2024-04-26T22:06:47.515 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:47.515 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":69,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":7168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1497562955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1497562955},{"type":"v1","addr":"172.21.15.170:6835","nonce":1497562955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:06:47.177899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8223":{"gid":8223,"name":"c","rank":0,"incarnation":69,"state":"up:replay","state_seq":1,"addr":"172.21.15.137:6836/1187927282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1187927282},{"type":"v1","addr":"172.21.15.137:6836","nonce":1187927282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-26T22:06:47.515 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 69 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.516+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc44006c8f0 msgr2=0x7fc44006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.516+0000 7fc45a8c5640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc44006c8f0 0x7fc44006edb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc448007fd0 tx=0x7fc448007960 comp rx=0 tx=0).stop 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 msgr2=0x7fc45409d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 0x7fc45409d2d0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c7f0 tx=0x7fc44400ccb0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 shutdown_connections 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc44006c8f0 0x7fc44006edb0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4540d11b0 0x7fc4540b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc4540cf2e0 0x7fc4540a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 --2- 172.21.15.137:0/1567385162 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc45406e490 0x7fc45409d2d0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 >> 172.21.15.137:0/1567385162 conn(0x7fc4540b4a60 msgr2=0x7fc4540cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:47.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 shutdown_connections 2024-04-26T22:06:47.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:47.517+0000 7fc45a8c5640 1 -- 172.21.15.137:0/1567385162 wait complete. 2024-04-26T22:06:47.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:06:01.940531+0000', 'modified': '2024-04-26T22:06:47.177899+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8223}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8223': {'gid': 8223, 'name': 'c', 'rank': 0, 'incarnation': 69, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.137:6836/1187927282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 1187927282}, {'type': 'v1', 'addr': '172.21.15.137:6836', 'nonce': 1187927282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:06:47.930 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8223:up:replay 2024-04-26T22:06:48.930 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:06:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.039+0000 7f39aa6c5640 1 Processor -- start 2024-04-26T22:06:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.039+0000 7f39aa6c5640 1 -- start start 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39aa6c5640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f39a4145980 0x7f39a4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39aa6c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 0x7f39a40720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39aa6c5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39a40b4260 con 0x7f39a40b3de0 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39aa6c5640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f39a40b5140 con 0x7f39a4145980 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39aa6c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39a40b4530 con 0x7f39a40b61a0 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39a3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f39a4145980 0x7f39a4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39a3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f39a4145980 0x7f39a4160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54636/0 (socket says 172.21.15.137:54636) 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39a3fff640 1 -- 172.21.15.137:0/4024155961 learned_addr learned my addr 172.21.15.137:0/4024155961 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39a8c62640 1 --2- 172.21.15.137:0/4024155961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 0x7f39a40720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39a3fff640 1 -- 172.21.15.137:0/4024155961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 msgr2=0x7f39a40720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39a3fff640 1 --2- 172.21.15.137:0/4024155961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 0x7f39a40720d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39a3fff640 1 -- 172.21.15.137:0/4024155961 >> v1:172.21.15.170:6789/0 conn(0x7f39a40b3de0 legacy=0x7f39a40b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.040+0000 7f39a3fff640 1 -- 172.21.15.137:0/4024155961 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a40b4810 con 0x7f39a4145980 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.041+0000 7f39a3fff640 1 --2- 172.21.15.137:0/4024155961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 0x7f39a4160630 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f399400bb10 tx=0x7f399402c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc63129be72ca7a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.041+0000 7f39a2ffd640 1 -- 172.21.15.137:0/4024155961 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399403a070 con 0x7f39a4145980 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.041+0000 7f39a2ffd640 1 -- 172.21.15.137:0/4024155961 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39940326f0 con 0x7f39a4145980 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.041+0000 7f39a2ffd640 1 -- 172.21.15.137:0/4024155961 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994032ac0 con 0x7f39a4145980 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.042+0000 7f39aa6c5640 1 -- 172.21.15.137:0/4024155961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 msgr2=0x7f39a4160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.042+0000 7f39aa6c5640 1 --2- 172.21.15.137:0/4024155961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 0x7f39a4160630 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f399400bb10 tx=0x7f399402c830 comp rx=0 tx=0).stop 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.042+0000 7f39aa6c5640 1 -- 172.21.15.137:0/4024155961 shutdown_connections 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.042+0000 7f39aa6c5640 1 --2- 172.21.15.137:0/4024155961 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 0x7f39a40720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.042+0000 7f39aa6c5640 1 --2- 172.21.15.137:0/4024155961 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 0x7f39a4160630 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.042+0000 7f39aa6c5640 1 -- 172.21.15.137:0/4024155961 >> 172.21.15.137:0/4024155961 conn(0x7f39a40d0d30 msgr2=0x7f39a40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.042+0000 7f39aa6c5640 1 -- 172.21.15.137:0/4024155961 shutdown_connections 2024-04-26T22:06:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.042+0000 7f39aa6c5640 1 -- 172.21.15.137:0/4024155961 wait complete. 2024-04-26T22:06:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.043+0000 7f39aa6c5640 1 Processor -- start 2024-04-26T22:06:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.043+0000 7f39aa6c5640 1 -- start start 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39aa6c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39a40b3de0 0x7f39a415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39aa6c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 0x7f39a413ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39aa6c5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 0x7f39a413b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39aa6c5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4072610 con 0x7f39a4145980 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39aa6c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f39a40b4dd0 con 0x7f39a40b3de0 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39aa6c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f39a4072790 con 0x7f39a40b61a0 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a8c62640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 0x7f39a413b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a8c62640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 0x7f39a413b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54648/0 (socket says 172.21.15.137:54648) 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a8c62640 1 -- 172.21.15.137:0/301482517 learned_addr learned my addr 172.21.15.137:0/301482517 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a3fff640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39a40b3de0 0x7f39a415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a37fe640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 0x7f39a413ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a8c62640 1 -- 172.21.15.137:0/301482517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 msgr2=0x7f39a413ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a8c62640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 0x7f39a413ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a8c62640 1 -- 172.21.15.137:0/301482517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39a40b3de0 msgr2=0x7f39a415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a8c62640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39a40b3de0 0x7f39a415b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.044+0000 7f39a8c62640 1 -- 172.21.15.137:0/301482517 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a4140120 con 0x7f39a4145980 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.045+0000 7f39a8c62640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 0x7f39a413b490 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f399c007e40 tx=0x7f399c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.045+0000 7f39a0ff9640 1 -- 172.21.15.137:0/301482517 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c014620 con 0x7f39a4145980 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.045+0000 7f39a0ff9640 1 -- 172.21.15.137:0/301482517 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c019070 con 0x7f39a4145980 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.045+0000 7f39a0ff9640 1 -- 172.21.15.137:0/301482517 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c014a20 con 0x7f39a4145980 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.045+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a413c000 con 0x7f39a4145980 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.045+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a413a200 con 0x7f39a4145980 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.046+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a406a290 con 0x7f39a4145980 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.046+0000 7f39a0ff9640 1 -- 172.21.15.137:0/301482517 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f399c014bc0 con 0x7f39a4145980 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.047+0000 7f39a0ff9640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f399006c8f0 0x7f399006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.047+0000 7f39a0ff9640 1 -- 172.21.15.137:0/301482517 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f399c08c3a0 con 0x7f39a4145980 2024-04-26T22:06:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.047+0000 7f39a3fff640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f399006c8f0 0x7f399006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.047+0000 7f39a3fff640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f399006c8f0 0x7f399006edb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3994037000 tx=0x7f3994032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:49.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.051+0000 7f39a0ff9640 1 -- 172.21.15.137:0/301482517 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f399c05a120 con 0x7f39a4145980 2024-04-26T22:06:49.270 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.270+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39a4073cc0 con 0x7f39a4145980 2024-04-26T22:06:49.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.270+0000 7f39a0ff9640 1 -- 172.21.15.137:0/301482517 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5191 (secure 0 0 0) 0x7f399c05e420 con 0x7f39a4145980 2024-04-26T22:06:49.271 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:49.271 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":71,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":7168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1497562955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1497562955},{"type":"v1","addr":"172.21.15.170:6835","nonce":1497562955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:06:48.184100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8223":{"gid":8223,"name":"c","rank":0,"incarnation":69,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.137:6836/1187927282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1187927282},{"type":"v1","addr":"172.21.15.137:6836","nonce":1187927282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-26T22:06:49.272 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 71 2024-04-26T22:06:49.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f399006c8f0 msgr2=0x7f399006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:49.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f399006c8f0 0x7f399006edb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3994037000 tx=0x7f3994032000 comp rx=0 tx=0).stop 2024-04-26T22:06:49.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 msgr2=0x7f39a413b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:49.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 0x7f39a413b490 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f399c007e40 tx=0x7f399c00e4b0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.273 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 shutdown_connections 2024-04-26T22:06:49.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f399006c8f0 0x7f399006edb0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f39a4145980 0x7f39a413b490 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f39a40b61a0 0x7f39a413ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 --2- 172.21.15.137:0/301482517 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39a40b3de0 0x7f39a415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:49.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 >> 172.21.15.137:0/301482517 conn(0x7f39a40d0d30 msgr2=0x7f39a4139490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:49.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 shutdown_connections 2024-04-26T22:06:49.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:49.273+0000 7f39aa6c5640 1 -- 172.21.15.137:0/301482517 wait complete. 2024-04-26T22:06:49.686 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:06:01.940531+0000', 'modified': '2024-04-26T22:06:48.184100+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8223}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8223': {'gid': 8223, 'name': 'c', 'rank': 0, 'incarnation': 69, 'state': 'up:rejoin', 'state_seq': 15, 'addr': '172.21.15.137:6836/1187927282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 1187927282}, {'type': 'v1', 'addr': '172.21.15.137:6836', 'nonce': 1187927282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:06:49.686 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8223:up:rejoin 2024-04-26T22:06:50.687 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:06:50.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.796+0000 7f32f1069640 1 Processor -- start 2024-04-26T22:06:50.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.796+0000 7f32f1069640 1 -- start start 2024-04-26T22:06:50.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32f1069640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec145980 0x7f32ec160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:50.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32f1069640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f32ec0b3de0 0x7f32ec0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:50.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32f1069640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f32ec0b5fd0 0x7f32ec15c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:50.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32f1069640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f32ec0b6440 con 0x7f32ec0b3de0 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32f1069640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f32ec0b5140 con 0x7f32ec0b5fd0 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32f1069640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec0b4260 con 0x7f32ec145980 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32e3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f32ec0b3de0 0x7f32ec0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32e3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f32ec0b3de0 0x7f32ec0b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54654/0 (socket says 172.21.15.137:54654) 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32e3fff640 1 -- 172.21.15.137:0/4203757305 learned_addr learned my addr 172.21.15.137:0/4203757305 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32eb59e640 1 --2- 172.21.15.137:0/4203757305 >> v2:172.21.15.170:3300/0 conn(0x7f32ec0b5fd0 0x7f32ec15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.797+0000 7f32ead9d640 1 --2- 172.21.15.137:0/4203757305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec145980 0x7f32ec160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.798+0000 7f32e3fff640 1 -- 172.21.15.137:0/4203757305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec145980 msgr2=0x7f32ec160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.798+0000 7f32e3fff640 1 --2- 172.21.15.137:0/4203757305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec145980 0x7f32ec160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.798+0000 7f32e3fff640 1 -- 172.21.15.137:0/4203757305 >> v2:172.21.15.170:3300/0 conn(0x7f32ec0b5fd0 msgr2=0x7f32ec15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.798+0000 7f32e3fff640 1 --2- 172.21.15.137:0/4203757305 >> v2:172.21.15.170:3300/0 conn(0x7f32ec0b5fd0 0x7f32ec15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.798+0000 7f32e3fff640 1 -- 172.21.15.137:0/4203757305 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec0b4530 con 0x7f32ec0b3de0 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.798+0000 7f32ead9d640 1 --2- 172.21.15.137:0/4203757305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec145980 0x7f32ec160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:50.799 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.798+0000 7f32e3fff640 1 --2- 172.21.15.137:0/4203757305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec0b3de0 0x7f32ec0b5a90 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f32ec06e320 tx=0x7f32d402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ff19b2e5e772bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:50.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32ea59c640 1 -- 172.21.15.137:0/4203757305 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4037070 con 0x7f32ec0b3de0 2024-04-26T22:06:50.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32ea59c640 1 -- 172.21.15.137:0/4203757305 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d4032440 con 0x7f32ec0b3de0 2024-04-26T22:06:50.800 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32ea59c640 1 -- 172.21.15.137:0/4203757305 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4032810 con 0x7f32ec0b3de0 2024-04-26T22:06:50.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32f1069640 1 -- 172.21.15.137:0/4203757305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec0b3de0 msgr2=0x7f32ec0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:50.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32f1069640 1 --2- 172.21.15.137:0/4203757305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec0b3de0 0x7f32ec0b5a90 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f32ec06e320 tx=0x7f32d402a140 comp rx=0 tx=0).stop 2024-04-26T22:06:50.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32f1069640 1 -- 172.21.15.137:0/4203757305 shutdown_connections 2024-04-26T22:06:50.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32f1069640 1 --2- 172.21.15.137:0/4203757305 >> v2:172.21.15.170:3300/0 conn(0x7f32ec0b5fd0 0x7f32ec15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:50.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32f1069640 1 --2- 172.21.15.137:0/4203757305 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec0b3de0 0x7f32ec0b5a90 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:50.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32f1069640 1 --2- 172.21.15.137:0/4203757305 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec145980 0x7f32ec160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:50.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32f1069640 1 -- 172.21.15.137:0/4203757305 >> 172.21.15.137:0/4203757305 conn(0x7f32ec0d0d30 msgr2=0x7f32ec0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:50.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32f1069640 1 -- 172.21.15.137:0/4203757305 shutdown_connections 2024-04-26T22:06:50.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.799+0000 7f32f1069640 1 -- 172.21.15.137:0/4203757305 wait complete. 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32f1069640 1 Processor -- start 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32f1069640 1 -- start start 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32f1069640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec0b3de0 0x7f32ec157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32f1069640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec0b5fd0 0x7f32ec1682b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32f1069640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec145980 0x7f32ec13b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32f1069640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0b4dd0 con 0x7f32ec145980 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32f1069640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0b4af0 con 0x7f32ec0b5fd0 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32f1069640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec15ca50 con 0x7f32ec0b3de0 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32eb59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec145980 0x7f32ec13b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32eb59e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec145980 0x7f32ec13b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54668/0 (socket says 172.21.15.137:54668) 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.801+0000 7f32eb59e640 1 -- 172.21.15.137:0/3307489325 learned_addr learned my addr 172.21.15.137:0/3307489325 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32e3fff640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec0b5fd0 0x7f32ec1682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:50.804 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32ead9d640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec0b3de0 0x7f32ec157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32eb59e640 1 -- 172.21.15.137:0/3307489325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec0b3de0 msgr2=0x7f32ec157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32eb59e640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec0b3de0 0x7f32ec157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32eb59e640 1 -- 172.21.15.137:0/3307489325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec0b5fd0 msgr2=0x7f32ec1682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32eb59e640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec0b5fd0 0x7f32ec1682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32eb59e640 1 -- 172.21.15.137:0/3307489325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec15d370 con 0x7f32ec145980 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32e3fff640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec0b5fd0 0x7f32ec1682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32eb59e640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec145980 0x7f32ec13b5b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f32e400eed0 tx=0x7f32e400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32e37fe640 1 -- 172.21.15.137:0/3307489325 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4018020 con 0x7f32ec145980 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32e37fe640 1 -- 172.21.15.137:0/3307489325 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4014400 con 0x7f32ec145980 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec15d650 con 0x7f32ec145980 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32e37fe640 1 -- 172.21.15.137:0/3307489325 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40147f0 con 0x7f32ec145980 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.802+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec15dc10 con 0x7f32ec145980 2024-04-26T22:06:50.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.803+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec06a290 con 0x7f32ec145980 2024-04-26T22:06:50.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.804+0000 7f32e37fe640 1 -- 172.21.15.137:0/3307489325 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32e4005d10 con 0x7f32ec145980 2024-04-26T22:06:50.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.804+0000 7f32e37fe640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f32cc06c8f0 0x7f32cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:50.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.804+0000 7f32e37fe640 1 -- 172.21.15.137:0/3307489325 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f32e408c560 con 0x7f32ec145980 2024-04-26T22:06:50.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.804+0000 7f32ead9d640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f32cc06c8f0 0x7f32cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:50.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.805+0000 7f32ead9d640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f32cc06c8f0 0x7f32cc06edb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f32dc006fd0 tx=0x7f32dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:50.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:50.809+0000 7f32e37fe640 1 -- 172.21.15.137:0/3307489325 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f32e4022030 con 0x7f32ec145980 2024-04-26T22:06:51.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.020+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32ec166940 con 0x7f32ec145980 2024-04-26T22:06:51.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.020+0000 7f32e37fe640 1 -- 172.21.15.137:0/3307489325 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5198 (secure 0 0 0) 0x7f32e405a930 con 0x7f32ec145980 2024-04-26T22:06:51.020 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:51.021 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":72,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":7168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1497562955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1497562955},{"type":"v1","addr":"172.21.15.170:6835","nonce":1497562955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:06:50.183235+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8223},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8223":{"gid":8223,"name":"c","rank":0,"incarnation":69,"state":"up:active","state_seq":16,"addr":"172.21.15.137:6836/1187927282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1187927282},{"type":"v1","addr":"172.21.15.137:6836","nonce":1187927282}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8223,"qdb_cluster":[8223]},"id":7}]} 2024-04-26T22:06:51.021 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 72 2024-04-26T22:06:51.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f32cc06c8f0 msgr2=0x7f32cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f32cc06c8f0 0x7f32cc06edb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f32dc006fd0 tx=0x7f32dc008040 comp rx=0 tx=0).stop 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec145980 msgr2=0x7f32ec13b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec145980 0x7f32ec13b5b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f32e400eed0 tx=0x7f32e400b480 comp rx=0 tx=0).stop 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 shutdown_connections 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f32cc06c8f0 0x7f32cc06edb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f32ec145980 0x7f32ec13b5b0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32ec0b5fd0 0x7f32ec1682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 --2- 172.21.15.137:0/3307489325 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32ec0b3de0 0x7f32ec157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 >> 172.21.15.137:0/3307489325 conn(0x7f32ec0d0d30 msgr2=0x7f32ec0b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 shutdown_connections 2024-04-26T22:06:51.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.022+0000 7f32f1069640 1 -- 172.21.15.137:0/3307489325 wait complete. 2024-04-26T22:06:51.435 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:06:01.940531+0000', 'modified': '2024-04-26T22:06:50.183235+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8223}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8223': {'gid': 8223, 'name': 'c', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.137:6836/1187927282', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6834', 'nonce': 1187927282}, {'type': 'v1', 'addr': '172.21.15.137:6836', 'nonce': 1187927282}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8223, 'qdb_cluster': [8223]} 2024-04-26T22:06:51.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:06:51.436 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-26T22:06:51.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.539+0000 7f3fa3064640 1 Processor -- start 2024-04-26T22:06:51.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.539+0000 7f3fa3064640 1 -- start start 2024-04-26T22:06:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.540+0000 7f3fa3064640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3f9c146790 0x7f3f9c0cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.540+0000 7f3fa3064640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f9c0d05b0 con 0x7f3f9c13ff70 2024-04-26T22:06:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.540+0000 7f3fa3064640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f9c0d0890 con 0x7f3f9c140350 2024-04-26T22:06:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.540+0000 7f3fa3064640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3f9c06e450 con 0x7f3f9c146790 2024-04-26T22:06:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.540+0000 7f3fa0e00640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3f9c13ff70 0x7f3f9c146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57394/0 (socket says 172.21.15.137:57394) 2024-04-26T22:06:51.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.540+0000 7f3fa0e00640 1 -- 172.21.15.137:0/207344714 learned_addr learned my addr 172.21.15.137:0/207344714 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:51.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.540+0000 7f3fa1601640 1 --2- 172.21.15.137:0/207344714 >> v2:172.21.15.170:3300/0 conn(0x7f3f9c146790 0x7f3f9c0cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592524110 0 0) 0x7f3f9c0d05b0 con 0x7f3f9c13ff70 2024-04-26T22:06:51.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f84003520 con 0x7f3f9c13ff70 2024-04-26T22:06:51.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609484900 0 0) 0x7f3f9c0d0890 con 0x7f3f9c140350 2024-04-26T22:06:51.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f9c0d05b0 con 0x7f3f9c140350 2024-04-26T22:06:51.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1890033009 0 0) 0x7f3f84003520 con 0x7f3f9c13ff70 2024-04-26T22:06:51.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 >> v2:172.21.15.170:3300/0 conn(0x7f3f9c146790 msgr2=0x7f3f9c0cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 --2- 172.21.15.137:0/207344714 >> v2:172.21.15.170:3300/0 conn(0x7f3f9c146790 0x7f3f9c0cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 >> v1:172.21.15.170:6789/0 conn(0x7f3f9c140350 legacy=0x7f3f9c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9c06e730 con 0x7f3f9c13ff70 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f3f8c0019f0 con 0x7f3f9c13ff70 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3fa1601640 1 --2- 172.21.15.137:0/207344714 >> v2:172.21.15.170:3300/0 conn(0x7f3f9c146790 0x7f3f9c0cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 >> v1:172.21.15.137:6789/0 conn(0x7f3f9c13ff70 legacy=0x7f3f9c146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f84003b70 0x7f3f84003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f84004800 0x7f3f84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f840051c0 0x7f3f8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c06e450 con 0x7f3f84003b70 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8400c110 con 0x7f3f840051c0 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8400c310 con 0x7f3f84004800 2024-04-26T22:06:51.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f84003b70 0x7f3f84003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3fa1601640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f840051c0 0x7f3f8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f84004800 0x7f3f84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3fa0e00640 1 -- 172.21.15.137:0/207344714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f84004800 msgr2=0x7f3f84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f84004800 0x7f3f84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3fa0e00640 1 -- 172.21.15.137:0/207344714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f840051c0 msgr2=0x7f3f8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f840051c0 0x7f3f8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3fa0e00640 1 -- 172.21.15.137:0/207344714 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f84003520 con 0x7f3f84003b70 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3fa1601640 1 -- 172.21.15.137:0/207344714 reap_dead start 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.541+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f84004800 0x7f3f84004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.542+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f84003b70 0x7f3f84003f70 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00a800 tx=0x7f3f84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1487e5a5f9ccaab2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.542+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00a450 con 0x7f3f84003b70 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.542+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8c02f070 con 0x7f3f84003b70 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.542+0000 7f3f9b7fe640 1 -- 172.21.15.137:0/207344714 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c02bcb0 con 0x7f3f84003b70 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.543+0000 7f3fa3064640 1 -- 172.21.15.137:0/207344714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f84003b70 msgr2=0x7f3f84003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.543+0000 7f3fa3064640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f84003b70 0x7f3f84003f70 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00a800 tx=0x7f3f84005830 comp rx=0 tx=0).stop 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.543+0000 7f3fa3064640 1 -- 172.21.15.137:0/207344714 shutdown_connections 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.543+0000 7f3fa3064640 1 --2- 172.21.15.137:0/207344714 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f84003b70 0x7f3f84003f70 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.543+0000 7f3fa3064640 1 -- 172.21.15.137:0/207344714 >> 172.21.15.137:0/207344714 conn(0x7f3f9c0d0d30 msgr2=0x7f3f9c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.543+0000 7f3fa3064640 1 -- 172.21.15.137:0/207344714 shutdown_connections 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.543+0000 7f3fa3064640 1 -- 172.21.15.137:0/207344714 wait complete. 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.544+0000 7f3fa3064640 1 Processor -- start 2024-04-26T22:06:51.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.544+0000 7f3fa3064640 1 -- start start 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa3064640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f84003b70 0x7f3f9c158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa3064640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9c157400 0x7f3f9c15fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa3064640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0b5ac0 0x7f3f9c1f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa3064640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c146410 con 0x7f3f9c0b5ac0 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa3064640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c146290 con 0x7f3f84003b70 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa3064640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9c146590 con 0x7f3f9c157400 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa1601640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0b5ac0 0x7f3f9c1f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa1601640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0b5ac0 0x7f3f9c1f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54672/0 (socket says 172.21.15.137:54672) 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa1601640 1 -- 172.21.15.137:0/4115000378 learned_addr learned my addr 172.21.15.137:0/4115000378 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f84003b70 0x7f3f9c158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9c157400 0x7f3f9c15fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa1601640 1 -- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9c157400 msgr2=0x7f3f9c15fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa1601640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9c157400 0x7f3f9c15fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa1601640 1 -- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f84003b70 msgr2=0x7f3f9c158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa1601640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f84003b70 0x7f3f9c158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa1601640 1 -- 172.21.15.137:0/4115000378 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9c1578e0 con 0x7f3f9c0b5ac0 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9c157400 0x7f3f9c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f84003b70 0x7f3f9c158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.545+0000 7f3fa1601640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0b5ac0 0x7f3f9c1f5a90 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c146be0 tx=0x7f3f94011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.546+0000 7f3f997fa640 1 -- 172.21.15.137:0/4115000378 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400fa10 con 0x7f3f9c0b5ac0 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.546+0000 7f3f997fa640 1 -- 172.21.15.137:0/4115000378 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9400fbd0 con 0x7f3f9c0b5ac0 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.546+0000 7f3f997fa640 1 -- 172.21.15.137:0/4115000378 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400fdc0 con 0x7f3f9c0b5ac0 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.546+0000 7f3fa3064640 1 -- 172.21.15.137:0/4115000378 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9c157bc0 con 0x7f3f9c0b5ac0 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.546+0000 7f3fa3064640 1 -- 172.21.15.137:0/4115000378 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f9c158180 con 0x7f3f9c0b5ac0 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.547+0000 7f3f997fa640 1 -- 172.21.15.137:0/4115000378 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f9401f020 con 0x7f3f9c0b5ac0 2024-04-26T22:06:51.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.547+0000 7f3f997fa640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f8806c920 0x7f3f8806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.548+0000 7f3f997fa640 1 -- 172.21.15.137:0/4115000378 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f3f9408b730 con 0x7f3f9c0b5ac0 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.548+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f8806c920 0x7f3f8806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.548+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f8806c920 0x7f3f8806ede0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c033000 tx=0x7f3f8c007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa5d80740 1 Processor -- start 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa5d80740 1 -- start start 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97f9f0 0x55eb6f958050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f97fdd0 0x55eb6f982250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 0x55eb6f955ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eb6f8bc740 con 0x55eb6f97f9f0 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55eb6f8583a0 con 0x55eb6f982790 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55eb6f8b8700 con 0x55eb6f97fdd0 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97f9f0 0x55eb6f958050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa0e00640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97f9f0 0x55eb6f958050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54686/0 (socket says 172.21.15.137:54686) 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.549+0000 7f3fa0e00640 1 -- 172.21.15.137:0/2789375520 learned_addr learned my addr 172.21.15.137:0/2789375520 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f97fdd0 0x55eb6f982250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.559 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3fa1601640 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 0x55eb6f955ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3fa0e00640 1 -- 172.21.15.137:0/2789375520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f97fdd0 msgr2=0x55eb6f982250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f97fdd0 0x55eb6f982250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3fa0e00640 1 -- 172.21.15.137:0/2789375520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 msgr2=0x55eb6f955ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 0x55eb6f955ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3fa0e00640 1 -- 172.21.15.137:0/2789375520 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb6f874750 con 0x55eb6f97f9f0 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3fa1601640 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 0x55eb6f955ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97f9f0 0x55eb6f958050 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00a8f0 tx=0x7f3f8c02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202106c5b003a9d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3f827fc640 1 -- 172.21.15.137:0/2789375520 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c004d60 con 0x55eb6f97f9f0 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3f827fc640 1 -- 172.21.15.137:0/2789375520 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8c045030 con 0x55eb6f97f9f0 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.550+0000 7f3f827fc640 1 -- 172.21.15.137:0/2789375520 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c034bf0 con 0x55eb6f97f9f0 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2789375520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97f9f0 msgr2=0x55eb6f958050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97f9f0 0x55eb6f958050 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00a8f0 tx=0x7f3f8c02d000 comp rx=0 tx=0).stop 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2789375520 shutdown_connections 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 0x55eb6f955ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f97fdd0 0x55eb6f982250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2789375520 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97f9f0 0x55eb6f958050 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2789375520 >> 172.21.15.137:0/2789375520 conn(0x55eb6f954a50 msgr2=0x55eb6f99d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2789375520 shutdown_connections 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2789375520 wait complete. 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 -- start start 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.551+0000 7f3fa5d80740 1 Processor -- start 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f97fdd0 0x55eb6f969260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f982790 0x55eb6f99bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 0x55eb6f96c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eb6f843fe0 con 0x55eb6f982790 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55eb6f99af50 con 0x55eb6f97fdd0 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55eb6f96b990 con 0x55eb6f96bc00 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3fa5d80740 10 client.0 _ll_register_callbacks cb 0x55eb6f85a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3f9bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f982790 0x55eb6f99bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3f9bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f982790 0x55eb6f99bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54688/0 (socket says 172.21.15.137:54688) 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3f9bfff640 1 -- 172.21.15.137:0/2944752367 learned_addr learned my addr 172.21.15.137:0/2944752367 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f97fdd0 0x55eb6f969260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.552+0000 7f3fa1601640 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 0x55eb6f96c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f9bfff640 1 -- 172.21.15.137:0/2944752367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 msgr2=0x55eb6f96c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 0x55eb6f96c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f9bfff640 1 -- 172.21.15.137:0/2944752367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f97fdd0 msgr2=0x55eb6f969260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f97fdd0 0x55eb6f969260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f9bfff640 1 -- 172.21.15.137:0/2944752367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb6f5ce2d0 con 0x55eb6f982790 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f982790 0x55eb6f99bdf0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c051930 tx=0x7f3f90003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc091c3204128a85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/2944752367 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90001c50 con 0x55eb6f982790 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/2944752367 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f3f90016480 con 0x55eb6f982790 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2944752367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f8c045030 con 0x55eb6f982790 2024-04-26T22:06:51.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/2944752367 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f3f90022050 con 0x55eb6f982790 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3fa5d80740 10 client.8610 fetch_fsmap learned FSMap version 72 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2944752367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55eb6f6986b0 con 0x55eb6f982790 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/2944752367 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8c045030 con 0x55eb6f982790 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/2944752367 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 72) ==== 3494+0+0 (secure 0 0 0) 0x7f3f90025020 con 0x55eb6f982790 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3fa5d80740 10 client.8610 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3fa5d80740 10 client.8610 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3fa5d80740 20 client.8610 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eb6f96aa80 0x55eb6f96ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3fa5d80740 4 client.8610 mds_command: new command op to 8223 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.553+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2944752367 --> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb6f8ca350 con 0x55eb6f96aa80 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.554+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eb6f96aa80 0x55eb6f96ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.554+0000 7f3f7b7fe640 10 client.8610 ms_handle_connect on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.554+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eb6f96aa80 0x55eb6f96ae60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f42460572fd6fce server_cookie=8f7de01ae412f789 in_seq=0 out_seq=0 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.554+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/2944752367 <== mds.0 v2:172.21.15.137:6834/1187927282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eb6f8ca350 con 0x55eb6f96aa80 2024-04-26T22:06:51.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.554+0000 7f3f7b7fe640 10 client.8610 handle_command_reply: tid=0 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.554+0000 7f3fa5d80740 1 client.8610 shutdown 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2944752367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f982790 msgr2=0x55eb6f99bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f982790 0x55eb6f99bdf0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c051930 tx=0x7f3f90003dc0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2944752367 shutdown_connections 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eb6f96aa80 0x55eb6f96ae60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f982790 0x55eb6f99bdf0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 0x55eb6f96c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/2944752367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f97fdd0 0x55eb6f969260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2944752367 >> 172.21.15.137:0/2944752367 conn(0x55eb6f97f9f0 msgr2=0x55eb6f955ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3f7b7fe640 0 client.8610 ms_handle_reset on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2944752367 shutdown_connections 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 1 -- 172.21.15.137:0/2944752367 wait complete. 2024-04-26T22:06:51.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.555+0000 7f3fa5d80740 20 client.8610 trim_cache size 0 max 16384 2024-04-26T22:06:51.572 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.573+0000 7f3fa5d80740 1 Processor -- start 2024-04-26T22:06:51.573 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.573+0000 7f3fa5d80740 1 -- start start 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.573+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f96bc00 0x55eb6f9c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.573+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9939e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.573+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f982790 0x55eb6f994ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.573+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c073830 con 0x55eb6f97fdd0 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.573+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c15e090 con 0x55eb6f96bc00 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.573+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9c0731e0 con 0x55eb6f982790 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f9bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f9bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9939e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54694/0 (socket says 172.21.15.137:54694) 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f9bfff640 1 -- 172.21.15.137:0/1503594202 learned_addr learned my addr 172.21.15.137:0/1503594202 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f9bfff640 1 -- 172.21.15.137:0/1503594202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f982790 msgr2=0x55eb6f994ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/1503594202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f982790 0x55eb6f994ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f9bfff640 1 -- 172.21.15.137:0/1503594202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f96bc00 msgr2=0x55eb6f9c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/1503594202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f96bc00 0x55eb6f9c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f9bfff640 1 -- 172.21.15.137:0/1503594202 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb6f953f00 con 0x55eb6f97fdd0 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/1503594202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9939e0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f3f900011c0 tx=0x7f3f90010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39416299028597a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f81ffb640 1 -- 172.21.15.137:0/1503594202 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90001c50 con 0x55eb6f97fdd0 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f81ffb640 1 -- 172.21.15.137:0/1503594202 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f90016480 con 0x55eb6f97fdd0 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.574+0000 7f3f81ffb640 1 -- 172.21.15.137:0/1503594202 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90016c70 con 0x55eb6f97fdd0 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 -- 172.21.15.137:0/1503594202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 msgr2=0x55eb6f9939e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/1503594202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9939e0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f3f900011c0 tx=0x7f3f90010000 comp rx=0 tx=0).stop 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 -- 172.21.15.137:0/1503594202 shutdown_connections 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/1503594202 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9939e0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/1503594202 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f982790 0x55eb6f994ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/1503594202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f96bc00 0x55eb6f9c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 -- 172.21.15.137:0/1503594202 >> 172.21.15.137:0/1503594202 conn(0x55eb6f97f9f0 msgr2=0x55eb6f99a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 -- 172.21.15.137:0/1503594202 shutdown_connections 2024-04-26T22:06:51.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 -- 172.21.15.137:0/1503594202 wait complete. 2024-04-26T22:06:51.577 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 -- start start 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.575+0000 7f3fa5d80740 1 Processor -- start 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 0x55eb6fa1ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3fa5d80740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 0x55eb6f99b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eb6f99c330 con 0x55eb6f97fdd0 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55eb6f96b6d0 con 0x55eb6f982790 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3fa5d80740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55eb6f9b5240 con 0x55eb6f96bc00 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3fa5d80740 10 client.0 _ll_register_callbacks cb 0x7f3f90007dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3f9bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3f9bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54710/0 (socket says 172.21.15.137:54710) 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3f9bfff640 1 -- 172.21.15.137:0/423025429 learned_addr learned my addr 172.21.15.137:0/423025429 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 0x55eb6fa1ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.576+0000 7f3f9bfff640 1 -- 172.21.15.137:0/423025429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 msgr2=0x55eb6fa1ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 0x55eb6fa1ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f9bfff640 1 -- 172.21.15.137:0/423025429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 msgr2=0x55eb6f99b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa1601640 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 0x55eb6f99b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 0x55eb6f99b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f9bfff640 1 -- 172.21.15.137:0/423025429 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb6f9b36b0 con 0x55eb6f97fdd0 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f9bfff640 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9b3170 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f3f90007b60 tx=0x7f3f90000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497639ecbbd215d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/423025429 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90016e40 con 0x55eb6f97fdd0 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/423025429 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f3f90010050 con 0x55eb6f97fdd0 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa5d80740 1 -- 172.21.15.137:0/423025429 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f90016480 con 0x55eb6f97fdd0 2024-04-26T22:06:51.582 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/423025429 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f3f90040050 con 0x55eb6f97fdd0 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa5d80740 10 client.8616 fetch_fsmap learned FSMap version 72 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa5d80740 1 -- 172.21.15.137:0/423025429 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55eb6f9c46a0 con 0x55eb6f97fdd0 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/423025429 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f90016480 con 0x55eb6f97fdd0 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/423025429 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 72) ==== 3494+0+0 (secure 0 0 0) 0x7f3f90043020 con 0x55eb6f97fdd0 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa5d80740 10 client.8616 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa5d80740 10 client.8616 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa5d80740 20 client.8616 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eb6f993430 0x55eb6f957410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa5d80740 4 client.8616 mds_command: new command op to 8223 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa5d80740 1 -- 172.21.15.137:0/423025429 --> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] -- command(tid 0: {"prefix": "status"}) -- 0x55eb6f8c41c0 con 0x55eb6f993430 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.577+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eb6f993430 0x55eb6f957410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3f7b7fe640 10 client.8616 ms_handle_connect on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa0e00640 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eb6f993430 0x55eb6f957410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac21f28ba0f03c94 server_cookie=c68147a6890c45bc in_seq=0 out_seq=0 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3f7b7fe640 1 -- 172.21.15.137:0/423025429 <== mds.0 v2:172.21.15.137:6834/1187927282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55eb6f8c41c0 con 0x55eb6f993430 2024-04-26T22:06:51.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3f7b7fe640 10 client.8616 handle_command_reply: tid=0 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 client.8616 shutdown 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 -- 172.21.15.137:0/423025429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 msgr2=0x55eb6f9b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9b3170 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f3f90007b60 tx=0x7f3f90000bc0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 -- 172.21.15.137:0/423025429 shutdown_connections 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eb6f993430 0x55eb6f957410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eb6f97fdd0 0x55eb6f9b3170 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eb6f982790 0x55eb6f99b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3f7b7fe640 0 client.8616 ms_handle_reset on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 --2- 172.21.15.137:0/423025429 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eb6f96bc00 0x55eb6fa1ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 -- 172.21.15.137:0/423025429 >> 172.21.15.137:0/423025429 conn(0x55eb6f97f9f0 msgr2=0x55eb6f96ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 -- 172.21.15.137:0/423025429 shutdown_connections 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 1 -- 172.21.15.137:0/423025429 wait complete. 2024-04-26T22:06:51.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.578+0000 7f3fa5d80740 20 client.8616 trim_cache size 0 max 16384 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 8223, 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.3986299129999997, 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 72, 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 104, 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 104, 2024-04-26T22:06:51.585 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 54.041101834999999 2024-04-26T22:06:51.586 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:06:51.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 -- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f8806c920 msgr2=0x7f3f8806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f8806c920 0x7f3f8806ede0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c033000 tx=0x7f3f8c007000 comp rx=0 tx=0).stop 2024-04-26T22:06:51.586 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 -- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0b5ac0 msgr2=0x7f3f9c1f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0b5ac0 0x7f3f9c1f5a90 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c146be0 tx=0x7f3f94011e30 comp rx=0 tx=0).stop 2024-04-26T22:06:51.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 -- 172.21.15.137:0/4115000378 shutdown_connections 2024-04-26T22:06:51.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f8806c920 0x7f3f8806ede0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f9c0b5ac0 0x7f3f9c1f5a90 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f9c157400 0x7f3f9c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 --2- 172.21.15.137:0/4115000378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f84003b70 0x7f3f9c158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 -- 172.21.15.137:0/4115000378 >> 172.21.15.137:0/4115000378 conn(0x7f3f9c0d0d30 msgr2=0x7f3f9c1417b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 -- 172.21.15.137:0/4115000378 shutdown_connections 2024-04-26T22:06:51.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.579+0000 7f3fa3064640 1 -- 172.21.15.137:0/4115000378 wait complete. 2024-04-26T22:06:51.590 DEBUG:teuthology.orchestra.run.smithi137:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-26T22:06:51.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:51.592 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-26T22:06:51.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.694+0000 7fadd1d46640 1 Processor -- start 2024-04-26T22:06:51.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.694+0000 7fadd1d46640 1 -- start start 2024-04-26T22:06:51.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadd1d46640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fadcc146a40 0x7fadcc0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadd1d46640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0b5190 0x7fadcc0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadd1d46640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadcc160e80 con 0x7fadcc0d0050 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadd1d46640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fadcc161160 con 0x7fadcc146a40 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadd1d46640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc161440 con 0x7fadcc0b5190 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0b5190 0x7fadcc0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadcb7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fadcc146a40 0x7fadcc0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0b5190 0x7fadcc0cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:54658/0 (socket says 172.21.15.137:54658) 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadcaffd640 1 -- 172.21.15.137:0/185009872 learned_addr learned my addr 172.21.15.137:0/185009872 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadcbfff640 1 --1- 172.21.15.137:0/185009872 >> v1:172.21.15.170:6789/0 conn(0x7fadcc0d0050 0x7fadcc070580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:33896/0 (socket says 172.21.15.137:33896) 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadcaffd640 1 -- 172.21.15.137:0/185009872 >> v2:172.21.15.170:3300/0 conn(0x7fadcc146a40 msgr2=0x7fadcc0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadcaffd640 1 --2- 172.21.15.137:0/185009872 >> v2:172.21.15.170:3300/0 conn(0x7fadcc146a40 0x7fadcc0b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadcaffd640 1 -- 172.21.15.137:0/185009872 >> v1:172.21.15.170:6789/0 conn(0x7fadcc0d0050 legacy=0x7fadcc070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.695+0000 7fadcaffd640 1 -- 172.21.15.137:0/185009872 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc161720 con 0x7fadcc0b5190 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.696+0000 7fadcaffd640 1 --2- 172.21.15.137:0/185009872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0b5190 0x7fadcc0cfb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009870 tx=0x7fadc002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a92d78742bcae841 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.696+0000 7fadca7fc640 1 -- 172.21.15.137:0/185009872 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0037070 con 0x7fadcc0b5190 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.696+0000 7fadca7fc640 1 -- 172.21.15.137:0/185009872 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0032440 con 0x7fadcc0b5190 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.696+0000 7fadca7fc640 1 -- 172.21.15.137:0/185009872 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0032810 con 0x7fadcc0b5190 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.697+0000 7fadd1d46640 1 -- 172.21.15.137:0/185009872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0b5190 msgr2=0x7fadcc0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.697+0000 7fadd1d46640 1 --2- 172.21.15.137:0/185009872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0b5190 0x7fadcc0cfb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009870 tx=0x7fadc002a1c0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.697+0000 7fadd1d46640 1 -- 172.21.15.137:0/185009872 shutdown_connections 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.697+0000 7fadd1d46640 1 --2- 172.21.15.137:0/185009872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc0b5190 0x7fadcc0cfb10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.697+0000 7fadd1d46640 1 --2- 172.21.15.137:0/185009872 >> v2:172.21.15.170:3300/0 conn(0x7fadcc146a40 0x7fadcc0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.697+0000 7fadd1d46640 1 -- 172.21.15.137:0/185009872 >> 172.21.15.137:0/185009872 conn(0x7fadcc06c960 msgr2=0x7fadcc0b84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.697+0000 7fadd1d46640 1 -- 172.21.15.137:0/185009872 shutdown_connections 2024-04-26T22:06:51.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.697+0000 7fadd1d46640 1 -- 172.21.15.137:0/185009872 wait complete. 2024-04-26T22:06:51.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.698+0000 7fadd1d46640 1 Processor -- start 2024-04-26T22:06:51.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.698+0000 7fadd1d46640 1 -- start start 2024-04-26T22:06:51.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadd1d46640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadcc0b5190 0x7fadcc156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadd1d46640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadcc0d0050 0x7fadcc1426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadd1d46640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc146a40 0x7fadcc142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadd1d46640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc146e20 con 0x7fadcc0d0050 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadd1d46640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc0d2c10 con 0x7fadcc0b5190 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadd1d46640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc1e8360 con 0x7fadcc146a40 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadcc0d0050 0x7fadcc1426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadcc0d0050 0x7fadcc1426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54716/0 (socket says 172.21.15.137:54716) 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadcaffd640 1 -- 172.21.15.137:0/3072214186 learned_addr learned my addr 172.21.15.137:0/3072214186 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadcc0b5190 0x7fadcc156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadcbfff640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc146a40 0x7fadcc142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadcaffd640 1 -- 172.21.15.137:0/3072214186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc146a40 msgr2=0x7fadcc142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadcaffd640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc146a40 0x7fadcc142c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadcaffd640 1 -- 172.21.15.137:0/3072214186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadcc0b5190 msgr2=0x7fadcc156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.699+0000 7fadcaffd640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadcc0b5190 0x7fadcc156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.700+0000 7fadcaffd640 1 -- 172.21.15.137:0/3072214186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc1e87f0 con 0x7fadcc0d0050 2024-04-26T22:06:51.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.700+0000 7fadcaffd640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadcc0d0050 0x7fadcc1426d0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fadc0000c00 tx=0x7fadc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.700+0000 7fadb3fff640 1 -- 172.21.15.137:0/3072214186 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0037040 con 0x7fadcc0d0050 2024-04-26T22:06:51.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.700+0000 7fadb3fff640 1 -- 172.21.15.137:0/3072214186 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0042070 con 0x7fadcc0d0050 2024-04-26T22:06:51.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.700+0000 7fadd1d46640 1 -- 172.21.15.137:0/3072214186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc1e7750 con 0x7fadcc0d0050 2024-04-26T22:06:51.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.700+0000 7fadb3fff640 1 -- 172.21.15.137:0/3072214186 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0030880 con 0x7fadcc0d0050 2024-04-26T22:06:51.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.700+0000 7fadd1d46640 1 -- 172.21.15.137:0/3072214186 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1e7d10 con 0x7fadcc0d0050 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.701+0000 7fadb3fff640 1 -- 172.21.15.137:0/3072214186 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fadc002ad10 con 0x7fadcc0d0050 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.702+0000 7fadb3fff640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb806c8f0 0x7fadb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.702+0000 7fadb3fff640 1 -- 172.21.15.137:0/3072214186 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7fadc00abfa0 con 0x7fadcc0d0050 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.702+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb806c8f0 0x7fadb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.703+0000 7fadd4a67740 1 Processor -- start 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.703+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb806c8f0 0x7fadb806edb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009b40 tx=0x7fadbc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.703+0000 7fadd4a67740 1 -- start start 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.703+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.703+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930bafd0 0x5613930e36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.706 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.703+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 0x5613930e6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.703+0000 7fadd4a67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x561393020b00 con 0x5613930e32c0 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.703+0000 7fadd4a67740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561392fbc920 con 0x5613930e3be0 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.703+0000 7fadd4a67740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x56139301cac0 con 0x5613930bafd0 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54726/0 (socket says 172.21.15.137:54726) 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcb7fe640 1 -- 172.21.15.137:0/2627335777 learned_addr learned my addr 172.21.15.137:0/2627335777 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcaffd640 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930bafd0 0x5613930e36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcbfff640 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 0x5613930e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcb7fe640 1 -- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930bafd0 msgr2=0x5613930e36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.707 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930bafd0 0x5613930e36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcb7fe640 1 -- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 msgr2=0x5613930e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 0x5613930e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcb7fe640 1 -- 172.21.15.137:0/2627335777 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561392dfa7e0 con 0x5613930e32c0 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcaffd640 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930bafd0 0x5613930e36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcbfff640 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 0x5613930e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e70c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fadbc011f10 tx=0x7fadbc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3fb606c293b8ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadb17fa640 1 -- 172.21.15.137:0/2627335777 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc01b070 con 0x5613930e32c0 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadb17fa640 1 -- 172.21.15.137:0/2627335777 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc027070 con 0x5613930e32c0 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.704+0000 7fadb17fa640 1 -- 172.21.15.137:0/2627335777 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc003a40 con 0x5613930e32c0 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.705+0000 7fadd4a67740 1 -- 172.21.15.137:0/2627335777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 msgr2=0x5613930e70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.705+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e70c0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fadbc011f10 tx=0x7fadbc014000 comp rx=0 tx=0).stop 2024-04-26T22:06:51.708 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.705+0000 7fadd4a67740 1 -- 172.21.15.137:0/2627335777 shutdown_connections 2024-04-26T22:06:51.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.705+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 0x5613930e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.705+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930bafd0 0x5613930e36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.705+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2627335777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e70c0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.705+0000 7fadd4a67740 1 -- 172.21.15.137:0/2627335777 >> 172.21.15.137:0/2627335777 conn(0x5613930b8bd0 msgr2=0x561393101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.705+0000 7fadd4a67740 1 -- 172.21.15.137:0/2627335777 shutdown_connections 2024-04-26T22:06:51.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.705+0000 7fadd4a67740 1 -- 172.21.15.137:0/2627335777 wait complete. 2024-04-26T22:06:51.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.706+0000 7fadd4a67740 1 -- start start 2024-04-26T22:06:51.709 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.706+0000 7fadd4a67740 1 Processor -- start 2024-04-26T22:06:51.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.706+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e32c0 0x5613930d7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.706+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 0x5613930e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.706+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x5613930e1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.706+0000 7fadd4a67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5613930b6f20 con 0x5613930d7b20 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.706+0000 7fadd4a67740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x561392fba5d0 con 0x5613930e3be0 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.706+0000 7fadd4a67740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5613930b6960 con 0x5613930e32c0 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadd4a67740 10 client.0 _ll_register_callbacks cb 0x561392fa8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x5613930e1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x5613930e1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54734/0 (socket says 172.21.15.137:54734) 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcbfff640 1 -- 172.21.15.137:0/4159835670 learned_addr learned my addr 172.21.15.137:0/4159835670 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e32c0 0x5613930d7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcaffd640 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 0x5613930e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcbfff640 1 -- 172.21.15.137:0/4159835670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e32c0 msgr2=0x5613930d7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcbfff640 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e32c0 0x5613930d7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcbfff640 1 -- 172.21.15.137:0/4159835670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 msgr2=0x5613930e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcbfff640 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 0x5613930e4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcbfff640 1 -- 172.21.15.137:0/4159835670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561392e5af70 con 0x5613930d7b20 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadcbfff640 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x5613930e1df0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fadc4002090 tx=0x7fadc4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c022fb77f0ce2c9d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadaa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadaa7fc640 1 -- 172.21.15.137:0/4159835670 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4014400 con 0x5613930d7b20 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadaa7fc640 1 -- 172.21.15.137:0/4159835670 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7fadc400c7e0 con 0x5613930d7b20 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadd4a67740 1 -- 172.21.15.137:0/4159835670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadbc027070 con 0x5613930d7b20 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadaa7fc640 1 -- 172.21.15.137:0/4159835670 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fadc400c9e0 con 0x5613930d7b20 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadd4a67740 10 client.8625 fetch_fsmap learned FSMap version 72 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.707+0000 7fadd4a67740 1 -- 172.21.15.137:0/4159835670 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x561392cf2170 con 0x5613930d7b20 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadaa7fc640 1 -- 172.21.15.137:0/4159835670 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc027070 con 0x5613930d7b20 2024-04-26T22:06:51.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadaa7fc640 1 -- 172.21.15.137:0/4159835670 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 72) ==== 3494+0+0 (secure 0 0 0) 0x7fadc40145a0 con 0x5613930d7b20 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadd4a67740 10 client.8625 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadd4a67740 10 client.8625 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadd4a67740 20 client.8625 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadd4a67740 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x5613930d7fa0 0x561393103700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadd4a67740 4 client.8625 mds_command: new command op to 8223 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadd4a67740 1 -- 172.21.15.137:0/4159835670 --> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56139302e710 con 0x5613930d7fa0 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x5613930d7fa0 0x561393103700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadaa7fc640 10 client.8625 ms_handle_connect on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.708+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x5613930d7fa0 0x561393103700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c3f4df08f491fd server_cookie=815348ff8070288e in_seq=0 out_seq=0 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadaa7fc640 1 -- 172.21.15.137:0/4159835670 <== mds.0 v2:172.21.15.137:6834/1187927282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56139302e710 con 0x5613930d7fa0 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadaa7fc640 10 client.8625 handle_command_reply: tid=0 2024-04-26T22:06:51.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 client.8625 shutdown 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 -- 172.21.15.137:0/4159835670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 msgr2=0x5613930e1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x5613930e1df0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fadc4002090 tx=0x7fadc4007430 comp rx=0 tx=0).stop 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 -- 172.21.15.137:0/4159835670 shutdown_connections 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x5613930d7fa0 0x561393103700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x5613930e1df0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadaa7fc640 0 client.8625 ms_handle_reset on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e3be0 0x5613930e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 --2- 172.21.15.137:0/4159835670 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e32c0 0x5613930d7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 -- 172.21.15.137:0/4159835670 >> 172.21.15.137:0/4159835670 conn(0x5613930bafd0 msgr2=0x561393101db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 -- 172.21.15.137:0/4159835670 shutdown_connections 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 1 -- 172.21.15.137:0/4159835670 wait complete. 2024-04-26T22:06:51.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.709+0000 7fadd4a67740 20 client.8625 trim_cache size 0 max 16384 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.713+0000 7f6a5c23f640 1 Processor -- start 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.714+0000 7f6a5c23f640 1 -- start start 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.714+0000 7f6a5c23f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6a540d3a00 0x7f6a540b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.714+0000 7f6a5c23f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a540b47e0 con 0x7f6a540b4400 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.714+0000 7f6a5c23f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a540cd660 con 0x7f6a5406e4d0 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.714+0000 7f6a5c23f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6a540cd940 con 0x7f6a540d3a00 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a59fdb640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6a540b4400 0x7f6a5406ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:57396/0 (socket says 172.21.15.137:57396) 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a59fdb640 1 -- 172.21.15.137:0/2162195525 learned_addr learned my addr 172.21.15.137:0/2162195525 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a5a7dc640 1 --2- 172.21.15.137:0/2162195525 >> v2:172.21.15.170:3300/0 conn(0x7f6a540d3a00 0x7f6a540b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a58fd9640 1 -- 172.21.15.137:0/2162195525 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3490224593 0 0) 0x7f6a540b47e0 con 0x7f6a540b4400 2024-04-26T22:06:51.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a58fd9640 1 -- 172.21.15.137:0/2162195525 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a40003520 con 0x7f6a540b4400 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a58fd9640 1 -- 172.21.15.137:0/2162195525 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563585923 0 0) 0x7f6a540cd660 con 0x7f6a5406e4d0 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a58fd9640 1 -- 172.21.15.137:0/2162195525 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a540b47e0 con 0x7f6a5406e4d0 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a5a7dc640 1 -- 172.21.15.137:0/2162195525 >> v1:172.21.15.170:6789/0 conn(0x7f6a5406e4d0 legacy=0x7f6a540ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a5a7dc640 1 -- 172.21.15.137:0/2162195525 >> v1:172.21.15.137:6789/0 conn(0x7f6a540b4400 legacy=0x7f6a5406ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.715+0000 7f6a5a7dc640 1 -- 172.21.15.137:0/2162195525 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540cdc20 con 0x7f6a540d3a00 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.716+0000 7f6a5a7dc640 1 --2- 172.21.15.137:0/2162195525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a540d3a00 0x7f6a540b25f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009d90 tx=0x7f6a4c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82580bc23b79fd52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.716+0000 7f6a58fd9640 1 -- 172.21.15.137:0/2162195525 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c031600 con 0x7f6a540d3a00 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.716+0000 7f6a58fd9640 1 -- 172.21.15.137:0/2162195525 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4c0317a0 con 0x7f6a540d3a00 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.716+0000 7f6a58fd9640 1 -- 172.21.15.137:0/2162195525 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c031b70 con 0x7f6a540d3a00 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.717+0000 7f6a5c23f640 1 -- 172.21.15.137:0/2162195525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a540d3a00 msgr2=0x7f6a540b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.717+0000 7f6a5c23f640 1 --2- 172.21.15.137:0/2162195525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a540d3a00 0x7f6a540b25f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009d90 tx=0x7f6a4c02a5d0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.717+0000 7f6a5c23f640 1 -- 172.21.15.137:0/2162195525 shutdown_connections 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.717+0000 7f6a5c23f640 1 --2- 172.21.15.137:0/2162195525 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a540d3a00 0x7f6a540b25f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.717+0000 7f6a5c23f640 1 -- 172.21.15.137:0/2162195525 >> 172.21.15.137:0/2162195525 conn(0x7f6a540d2ee0 msgr2=0x7f6a540d32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.717+0000 7f6a5c23f640 1 -- 172.21.15.137:0/2162195525 shutdown_connections 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.717+0000 7f6a5c23f640 1 -- 172.21.15.137:0/2162195525 wait complete. 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.718+0000 7f6a5c23f640 1 Processor -- start 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.718+0000 7f6a5c23f640 1 -- start start 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a5c23f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a5406e4d0 0x7f6a5415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a5c23f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a540b4400 0x7f6a540c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a5c23f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a540d3a00 0x7f6a5415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a5c23f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540ce1e0 con 0x7f6a5406e4d0 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a5c23f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540cdf00 con 0x7f6a540d3a00 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a5c23f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5406d6e0 con 0x7f6a540b4400 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a59fdb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a5406e4d0 0x7f6a5415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a59fdb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a5406e4d0 0x7f6a5415bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54748/0 (socket says 172.21.15.137:54748) 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a59fdb640 1 -- 172.21.15.137:0/2157416786 learned_addr learned my addr 172.21.15.137:0/2157416786 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a5a7dc640 1 --2- 172.21.15.137:0/2157416786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a540d3a00 0x7f6a5415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a597da640 1 --2- 172.21.15.137:0/2157416786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a540b4400 0x7f6a540c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a59fdb640 1 -- 172.21.15.137:0/2157416786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a540b4400 msgr2=0x7f6a540c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a59fdb640 1 --2- 172.21.15.137:0/2157416786 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a540b4400 0x7f6a540c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a59fdb640 1 -- 172.21.15.137:0/2157416786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a540d3a00 msgr2=0x7f6a5415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a59fdb640 1 --2- 172.21.15.137:0/2157416786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a540d3a00 0x7f6a5415a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.719+0000 7f6a59fdb640 1 -- 172.21.15.137:0/2157416786 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540cb480 con 0x7f6a5406e4d0 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.720+0000 7f6a59fdb640 1 --2- 172.21.15.137:0/2157416786 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a5406e4d0 0x7f6a5415bda0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000c530 tx=0x7f6a5000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.720+0000 7f6a4a7fc640 1 -- 172.21.15.137:0/2157416786 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50017070 con 0x7f6a5406e4d0 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.720+0000 7f6a4a7fc640 1 -- 172.21.15.137:0/2157416786 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a50005ce0 con 0x7f6a5406e4d0 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.720+0000 7f6a5c23f640 1 -- 172.21.15.137:0/2157416786 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a540ca750 con 0x7f6a5406e4d0 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.720+0000 7f6a4a7fc640 1 -- 172.21.15.137:0/2157416786 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50007270 con 0x7f6a5406e4d0 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.720+0000 7f6a5c23f640 1 -- 172.21.15.137:0/2157416786 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a540cad10 con 0x7f6a5406e4d0 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.720+0000 7f6a5c23f640 1 -- 172.21.15.137:0/2157416786 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f6a5406a290 con 0x7f6a5406e4d0 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.721+0000 7f6a4a7fc640 1 -- 172.21.15.137:0/2157416786 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a5001a070 con 0x7f6a5406e4d0 2024-04-26T22:06:51.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.722+0000 7f6a4a7fc640 1 --2- 172.21.15.137:0/2157416786 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a3806c8f0 0x7f6a3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.722+0000 7f6a597da640 1 --2- 172.21.15.137:0/2157416786 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a3806c8f0 0x7f6a3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.722+0000 7f6a4a7fc640 1 -- 172.21.15.137:0/2157416786 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f6a5008b580 con 0x7f6a5406e4d0 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.722+0000 7f6a4a7fc640 1 -- 172.21.15.137:0/2157416786 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+512 (secure 0 0 0) 0x7f6a5008ba10 con 0x7f6a5406e4d0 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.722+0000 7f6a5c23f640 1 -- 172.21.15.137:0/2157416786 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({log-info=0+}) -- 0x7f6a5406eb10 con 0x7f6a5406e4d0 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.722+0000 7f6a597da640 1 --2- 172.21.15.137:0/2157416786 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a3806c8f0 0x7f6a3806edb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6a44007fd0 tx=0x7f6a44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.722+0000 7f6a4a7fc640 1 -- 172.21.15.137:0/2157416786 <== mon.0 v2:172.21.15.137:3300/0 7 ==== log(2 entries from seq 1005 at 2024-04-26T22:06:50.183289+0000) ==== 389+0+0 (secure 0 0 0) 0x7f6a50089b60 con 0x7f6a5406e4d0 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stdout: cluster: 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stdout: id: 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stdout: health: HEALTH_OK 2024-04-26T22:06:51.727 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: services: 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: mgr: y(active, since 8m), standbys: x 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: mds: 1/1 daemons up, 3 standby 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: data: 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: volumes: 1/1 healthy 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: pools: 3 pools, 97 pgs 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: objects: 30 objects, 19 MiB 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: usage: 307 MiB used, 720 GiB / 720 GiB avail 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: pgs: 97 active+clean 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:51.728 INFO:teuthology.orchestra.run.smithi137.stdout: io: 2024-04-26T22:06:51.729 INFO:teuthology.orchestra.run.smithi137.stdout: client: 1.8 KiB/s rd, 102 B/s wr, 1 op/s rd, 0 op/s wr 2024-04-26T22:06:51.729 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:51.729 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:06:51.729 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:50.183289+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-26T22:06:51.729 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:50.183309+0000 mon.a [INF] Cluster is now healthy 2024-04-26T22:06:51.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.729+0000 7fadd4a67740 1 Processor -- start 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.729+0000 7fadd4a67740 1 -- start start 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930d7b20 0x5613930d6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 0x5613930e0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadd4a67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc06ee20 con 0x5613930e32c0 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadd4a67740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc06de00 con 0x5613930d7b20 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadd4a67740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fadcc1418f0 con 0x5613930e3be0 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54752/0 (socket says 172.21.15.137:54752) 2024-04-26T22:06:51.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcaffd640 1 -- 172.21.15.137:0/1329414283 learned_addr learned my addr 172.21.15.137:0/1329414283 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcbfff640 1 --2- 172.21.15.137:0/1329414283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 0x5613930e0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/1329414283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930d7b20 0x5613930d6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcaffd640 1 -- 172.21.15.137:0/1329414283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 msgr2=0x5613930e0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcaffd640 1 --2- 172.21.15.137:0/1329414283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 0x5613930e0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcaffd640 1 -- 172.21.15.137:0/1329414283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930d7b20 msgr2=0x5613930d6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcaffd640 1 --2- 172.21.15.137:0/1329414283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930d7b20 0x5613930d6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcaffd640 1 -- 172.21.15.137:0/1329414283 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613930e5300 con 0x5613930e32c0 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadcaffd640 1 --2- 172.21.15.137:0/1329414283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e9c30 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fadc0079a20 tx=0x7fadc0079680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f08df7c02ed6f54 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadb0ff9640 1 -- 172.21.15.137:0/1329414283 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0082850 con 0x5613930e32c0 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadb0ff9640 1 -- 172.21.15.137:0/1329414283 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0092180 con 0x5613930e32c0 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.730+0000 7fadb0ff9640 1 -- 172.21.15.137:0/1329414283 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0076390 con 0x5613930e32c0 2024-04-26T22:06:51.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.731+0000 7fadd4a67740 1 -- 172.21.15.137:0/1329414283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 msgr2=0x5613930e9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.731+0000 7fadd4a67740 1 --2- 172.21.15.137:0/1329414283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e9c30 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fadc0079a20 tx=0x7fadc0079680 comp rx=0 tx=0).stop 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.731+0000 7fadd4a67740 1 -- 172.21.15.137:0/1329414283 shutdown_connections 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.731+0000 7fadd4a67740 1 --2- 172.21.15.137:0/1329414283 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930e32c0 0x5613930e9c30 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.731+0000 7fadd4a67740 1 --2- 172.21.15.137:0/1329414283 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 0x5613930e0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.731+0000 7fadd4a67740 1 --2- 172.21.15.137:0/1329414283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930d7b20 0x5613930d6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.731+0000 7fadd4a67740 1 -- 172.21.15.137:0/1329414283 >> 172.21.15.137:0/1329414283 conn(0x5613930bafd0 msgr2=0x561393103700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.731+0000 7fadd4a67740 1 -- 172.21.15.137:0/1329414283 shutdown_connections 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.731+0000 7fadd4a67740 1 -- 172.21.15.137:0/1329414283 wait complete. 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.732+0000 7fadd4a67740 1 -- start start 2024-04-26T22:06:51.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.732+0000 7fadd4a67740 1 Processor -- start 2024-04-26T22:06:51.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.732+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x561393104880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.732+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e32c0 0x561393104dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.732+0000 7fadd4a67740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 0x5613930dc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.732+0000 7fadd4a67740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc06d7b0 con 0x5613930d7b20 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.732+0000 7fadd4a67740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5613930b76f0 con 0x5613930e32c0 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.732+0000 7fadd4a67740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5613931809d0 con 0x5613930e3be0 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.732+0000 7fadd4a67740 10 client.0 _ll_register_callbacks cb 0x7fadc4004ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x561393104880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x561393104880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54762/0 (socket says 172.21.15.137:54762) 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcb7fe640 1 -- 172.21.15.137:0/2272938731 learned_addr learned my addr 172.21.15.137:0/2272938731 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcaffd640 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e32c0 0x561393104dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcbfff640 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 0x5613930dc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcb7fe640 1 -- 172.21.15.137:0/2272938731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 msgr2=0x5613930dc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 0x5613930dc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcb7fe640 1 -- 172.21.15.137:0/2272938731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e32c0 msgr2=0x561393104dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e32c0 0x561393104dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcb7fe640 1 -- 172.21.15.137:0/2272938731 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613930b9d10 con 0x5613930d7b20 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadcb7fe640 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x561393104880 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fadbc011690 tx=0x7fadbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5070ff99177ef3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadaa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadaa7fc640 1 -- 172.21.15.137:0/2272938731 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc01b040 con 0x5613930d7b20 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadaa7fc640 1 -- 172.21.15.137:0/2272938731 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7fadbc003d30 con 0x5613930d7b20 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadd4a67740 1 -- 172.21.15.137:0/2272938731 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc0092180 con 0x5613930d7b20 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadaa7fc640 1 -- 172.21.15.137:0/2272938731 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fadbc047050 con 0x5613930d7b20 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadd4a67740 10 client.8637 fetch_fsmap learned FSMap version 72 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadd4a67740 1 -- 172.21.15.137:0/2272938731 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x561393101100 con 0x5613930d7b20 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.733+0000 7fadaa7fc640 1 -- 172.21.15.137:0/2272938731 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc0092180 con 0x5613930d7b20 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadaa7fc640 1 -- 172.21.15.137:0/2272938731 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 72) ==== 3494+0+0 (secure 0 0 0) 0x7fadbc04a020 con 0x5613930d7b20 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadd4a67740 10 client.8637 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadd4a67740 10 client.8637 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadd4a67740 20 client.8637 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x5613930dceb0 0x5613930dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadd4a67740 4 client.8637 mds_command: new command op to 8223 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadd4a67740 1 -- 172.21.15.137:0/2272938731 --> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) -- 0x561393028580 con 0x5613930dceb0 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadcaffd640 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x5613930dceb0 0x5613930dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadaa7fc640 10 client.8637 ms_handle_connect on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.734+0000 7fadcaffd640 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x5613930dceb0 0x5613930dd2b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e1fc6bb57e2bb6f server_cookie=c783f1fd30fbc746 in_seq=0 out_seq=0 2024-04-26T22:06:51.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadaa7fc640 1 -- 172.21.15.137:0/2272938731 <== mds.0 v2:172.21.15.137:6834/1187927282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561393028580 con 0x5613930dceb0 2024-04-26T22:06:51.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadaa7fc640 10 client.8637 handle_command_reply: tid=0 2024-04-26T22:06:51.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 client.8637 shutdown 2024-04-26T22:06:51.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 -- 172.21.15.137:0/2272938731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 msgr2=0x561393104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x561393104880 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fadbc011690 tx=0x7fadbc004730 comp rx=0 tx=0).stop 2024-04-26T22:06:51.740 INFO:tasks.ceph.mds.c.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fa428cfe640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-26T22:06:51.740 INFO:tasks.ceph.mds.c.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fa428cfe640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-26T22:06:51.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 -- 172.21.15.137:0/2272938731 shutdown_connections 2024-04-26T22:06:51.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x5613930dceb0 0x5613930dd2b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.741 INFO:tasks.ceph.mds.c.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fa428cfe640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-26T22:06:51.741 INFO:tasks.ceph.mds.c.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fa428cfe640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-26T22:06:51.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5613930e3be0 0x5613930dc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613930e32c0 0x561393104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 --2- 172.21.15.137:0/2272938731 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5613930d7b20 0x561393104880 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadaa7fc640 0 client.8637 ms_handle_reset on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 -- 172.21.15.137:0/2272938731 >> 172.21.15.137:0/2272938731 conn(0x5613930bafd0 msgr2=0x5613930e9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 -- 172.21.15.137:0/2272938731 shutdown_connections 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 1 -- 172.21.15.137:0/2272938731 wait complete. 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.735+0000 7fadd4a67740 20 client.8637 trim_cache size 0 max 16384 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0, 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stdout: "scrub_tag": "657dc9a5-ea97-4cbc-b54f-8d23b271b72e", 2024-04-26T22:06:51.742 INFO:teuthology.orchestra.run.smithi137.stdout: "mode": "asynchronous" 2024-04-26T22:06:51.743 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:06:51.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 -- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb806c8f0 msgr2=0x7fadb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb806c8f0 0x7fadb806edb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009b40 tx=0x7fadbc009190 comp rx=0 tx=0).stop 2024-04-26T22:06:51.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 -- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadcc0d0050 msgr2=0x7fadcc1426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadcc0d0050 0x7fadcc1426d0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fadc0000c00 tx=0x7fadc00046c0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 -- 172.21.15.137:0/3072214186 shutdown_connections 2024-04-26T22:06:51.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fadb806c8f0 0x7fadb806edb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fadcc0d0050 0x7fadcc1426d0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fadcc146a40 0x7fadcc142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 --2- 172.21.15.137:0/3072214186 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadcc0b5190 0x7fadcc156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 -- 172.21.15.137:0/3072214186 >> 172.21.15.137:0/3072214186 conn(0x7fadcc06c960 msgr2=0x7fadcc15e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 -- 172.21.15.137:0/3072214186 shutdown_connections 2024-04-26T22:06:51.744 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.736+0000 7fadd1d46640 1 -- 172.21.15.137:0/3072214186 wait complete. 2024-04-26T22:06:51.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:06:51.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-26T22:06:51.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.846+0000 7f3f40852640 1 Processor -- start 2024-04-26T22:06:51.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.846+0000 7f3f40852640 1 -- start start 2024-04-26T22:06:51.847 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f40852640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f3c15f680 0x7f3f3c0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f40852640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 0x7f3f3c0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f40852640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f3c0d3f50 con 0x7f3f3c0b60b0 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f40852640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3f3c15fa60 con 0x7f3f3c15f680 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f40852640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3c0b5090 con 0x7f3f3c163aa0 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f3a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f3c15f680 0x7f3f3c0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f3a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3f3c15f680 0x7f3f3c0d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54772/0 (socket says 172.21.15.137:54772) 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f3a59c640 1 -- 172.21.15.137:0/3449353155 learned_addr learned my addr 172.21.15.137:0/3449353155 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f33fff640 1 --2- 172.21.15.137:0/3449353155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 0x7f3f3c0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f3a59c640 1 -- 172.21.15.137:0/3449353155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 msgr2=0x7f3f3c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/3449353155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 0x7f3f3c0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f3a59c640 1 -- 172.21.15.137:0/3449353155 >> v1:172.21.15.170:6789/0 conn(0x7f3f3c0b60b0 legacy=0x7f3f3c0d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.847+0000 7f3f3a59c640 1 -- 172.21.15.137:0/3449353155 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c0b5370 con 0x7f3f3c15f680 2024-04-26T22:06:51.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/3449353155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 0x7f3f3c0d3820 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009870 tx=0x7f3f2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e242e6a6a36199da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f39d9b640 1 -- 172.21.15.137:0/3449353155 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c037070 con 0x7f3f3c15f680 2024-04-26T22:06:51.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f39d9b640 1 -- 172.21.15.137:0/3449353155 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c032440 con 0x7f3f3c15f680 2024-04-26T22:06:51.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f39d9b640 1 -- 172.21.15.137:0/3449353155 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c032810 con 0x7f3f3c15f680 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f40852640 1 -- 172.21.15.137:0/3449353155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 msgr2=0x7f3f3c0d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f40852640 1 --2- 172.21.15.137:0/3449353155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 0x7f3f3c0d3820 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009870 tx=0x7f3f2c02a270 comp rx=0 tx=0).stop 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f40852640 1 -- 172.21.15.137:0/3449353155 shutdown_connections 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f40852640 1 --2- 172.21.15.137:0/3449353155 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 0x7f3f3c0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f40852640 1 --2- 172.21.15.137:0/3449353155 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 0x7f3f3c0d3820 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.848+0000 7f3f40852640 1 -- 172.21.15.137:0/3449353155 >> 172.21.15.137:0/3449353155 conn(0x7f3f3c08eca0 msgr2=0x7f3f3c09e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.849+0000 7f3f40852640 1 -- 172.21.15.137:0/3449353155 shutdown_connections 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.849+0000 7f3f40852640 1 -- 172.21.15.137:0/3449353155 wait complete. 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.850+0000 7f3f40852640 1 Processor -- start 2024-04-26T22:06:51.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.850+0000 7f3f40852640 1 -- start start 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f40852640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f3c0b60b0 0x7f3f3c154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f40852640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 0x7f3f3c0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f40852640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 0x7f3f3c0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f40852640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c0d57b0 con 0x7f3f3c15f680 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f40852640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c0d5630 con 0x7f3f3c0b60b0 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f40852640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3c0d5930 con 0x7f3f3c163aa0 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 0x7f3f3c0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 0x7f3f3c0d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54776/0 (socket says 172.21.15.137:54776) 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f33fff640 1 -- 172.21.15.137:0/2202906131 learned_addr learned my addr 172.21.15.137:0/2202906131 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f3c0b60b0 0x7f3f3c154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f3ad9d640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 0x7f3f3c0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f33fff640 1 -- 172.21.15.137:0/2202906131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 msgr2=0x7f3f3c0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f33fff640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 0x7f3f3c0d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f33fff640 1 -- 172.21.15.137:0/2202906131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f3c0b60b0 msgr2=0x7f3f3c154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f33fff640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f3c0b60b0 0x7f3f3c154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f33fff640 1 -- 172.21.15.137:0/2202906131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c15fc80 con 0x7f3f3c15f680 2024-04-26T22:06:51.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f33fff640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 0x7f3f3c0d0ff0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400d5f0 tx=0x7f3f2400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f32ffd640 1 -- 172.21.15.137:0/2202906131 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f240125f0 con 0x7f3f3c15f680 2024-04-26T22:06:51.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f32ffd640 1 -- 172.21.15.137:0/2202906131 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f24019070 con 0x7f3f3c15f680 2024-04-26T22:06:51.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f40852640 1 -- 172.21.15.137:0/2202906131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3c15ff60 con 0x7f3f3c15f680 2024-04-26T22:06:51.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f32ffd640 1 -- 172.21.15.137:0/2202906131 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f240129d0 con 0x7f3f3c15f680 2024-04-26T22:06:51.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.851+0000 7f3f40852640 1 -- 172.21.15.137:0/2202906131 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3c160520 con 0x7f3f3c15f680 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.853+0000 7f3f32ffd640 1 -- 172.21.15.137:0/2202906131 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f24012b70 con 0x7f3f3c15f680 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.853+0000 7f3f32ffd640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f1c06c920 0x7f3f1c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.853+0000 7f3f32ffd640 1 -- 172.21.15.137:0/2202906131 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f3f2408bf30 con 0x7f3f3c15f680 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.853+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f1c06c920 0x7f3f1c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.854+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f1c06c920 0x7f3f1c06ede0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c034000 tx=0x7f3f2c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.854+0000 7f3f4356b740 1 Processor -- start 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.854+0000 7f3f4356b740 1 -- start start 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fef80 0x55c6733ff360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c6733fdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 0x55c6733fe500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f4356b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c673363d80 con 0x55c6733f9e10 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f4356b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c67331d8b0 con 0x55c6733fe0c0 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f4356b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c67335fd40 con 0x55c6733fef80 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c6733fdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c6733fdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54790/0 (socket says 172.21.15.137:54790) 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f33fff640 1 -- 172.21.15.137:0/2581686811 learned_addr learned my addr 172.21.15.137:0/2581686811 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fef80 0x55c6733ff360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f3ad9d640 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 0x55c6733fe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f33fff640 1 -- 172.21.15.137:0/2581686811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fef80 msgr2=0x55c6733ff360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f33fff640 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fef80 0x55c6733ff360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.855+0000 7f3f33fff640 1 -- 172.21.15.137:0/2581686811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 msgr2=0x55c6733fe500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.856+0000 7f3f33fff640 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 0x55c6733fe500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.856+0000 7f3f33fff640 1 -- 172.21.15.137:0/2581686811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6732eea40 con 0x55c6733f9e10 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.856+0000 7f3f3ad9d640 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 0x55c6733fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:06:51.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.856+0000 7f3f33fff640 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c6733fdb80 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f3f2408a4b0 tx=0x7f3f2405a450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57305f1d74a8f70f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.856+0000 7f3f1bfff640 1 -- 172.21.15.137:0/2581686811 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24062870 con 0x55c6733f9e10 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.856+0000 7f3f1bfff640 1 -- 172.21.15.137:0/2581686811 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f24072200 con 0x55c6733f9e10 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.856+0000 7f3f1bfff640 1 -- 172.21.15.137:0/2581686811 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24057f90 con 0x55c6733f9e10 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.856+0000 7f3f4356b740 1 -- 172.21.15.137:0/2581686811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 msgr2=0x55c6733fdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.856+0000 7f3f4356b740 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c6733fdb80 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f3f2408a4b0 tx=0x7f3f2405a450 comp rx=0 tx=0).stop 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.857+0000 7f3f4356b740 1 -- 172.21.15.137:0/2581686811 shutdown_connections 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.857+0000 7f3f4356b740 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c6733fdb80 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.857+0000 7f3f4356b740 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 0x55c6733fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.857+0000 7f3f4356b740 1 --2- 172.21.15.137:0/2581686811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fef80 0x55c6733ff360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.857+0000 7f3f4356b740 1 -- 172.21.15.137:0/2581686811 >> 172.21.15.137:0/2581686811 conn(0x55c6733fc080 msgr2=0x55c673444b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.857+0000 7f3f4356b740 1 -- 172.21.15.137:0/2581686811 shutdown_connections 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.857+0000 7f3f4356b740 1 -- 172.21.15.137:0/2581686811 wait complete. 2024-04-26T22:06:51.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.857+0000 7f3f4356b740 1 -- start start 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.857+0000 7f3f4356b740 1 Processor -- start 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 0x55c67344ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fef80 0x55c673443620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c67341a940 0x55c673443b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f4356b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c67342ab10 con 0x55c6733fef80 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f4356b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55c6732ead10 con 0x55c6733fe0c0 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f4356b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c673429f90 con 0x55c67341a940 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f4356b740 10 client.0 _ll_register_callbacks cb 0x55c673317210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fef80 0x55c673443620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fef80 0x55c673443620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54800/0 (socket says 172.21.15.137:54800) 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f33fff640 1 -- 172.21.15.137:0/202654977 learned_addr learned my addr 172.21.15.137:0/202654977 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f3ad9d640 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c67341a940 0x55c673443b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 0x55c67344ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f33fff640 1 -- 172.21.15.137:0/202654977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c67341a940 msgr2=0x55c673443b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.858+0000 7f3f33fff640 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c67341a940 0x55c673443b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f33fff640 1 -- 172.21.15.137:0/202654977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 msgr2=0x55c67344ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f33fff640 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 0x55c67344ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f33fff640 1 -- 172.21.15.137:0/202654977 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c67313f7d0 con 0x55c6733fef80 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f33fff640 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fef80 0x55c673443620 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f3f24059e50 tx=0x7f3f24006f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9f63b14a1903a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f197fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f197fa640 1 -- 172.21.15.137:0/202654977 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24057db0 con 0x55c6733fef80 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f197fa640 1 -- 172.21.15.137:0/202654977 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f3f24060040 con 0x55c6733fef80 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f4356b740 1 -- 172.21.15.137:0/202654977 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f24072200 con 0x55c6733fef80 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f197fa640 1 -- 172.21.15.137:0/202654977 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f3f2407f050 con 0x55c6733fef80 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f4356b740 10 client.8649 fetch_fsmap learned FSMap version 72 2024-04-26T22:06:51.866 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f4356b740 1 -- 172.21.15.137:0/202654977 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55c6730753f0 con 0x55c6733fef80 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f197fa640 1 -- 172.21.15.137:0/202654977 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f24072200 con 0x55c6733fef80 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f197fa640 1 -- 172.21.15.137:0/202654977 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 72) ==== 3494+0+0 (secure 0 0 0) 0x7f3f24082020 con 0x55c6733fef80 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f4356b740 10 client.8649 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f4356b740 10 client.8649 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f4356b740 20 client.8649 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f4356b740 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55c67341ae40 0x55c67341b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f4356b740 4 client.8649 mds_command: new command op to 8223 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f4356b740 1 -- 172.21.15.137:0/202654977 --> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c673371990 con 0x55c67341ae40 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.859+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55c67341ae40 0x55c67341b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f197fa640 10 client.8649 ms_handle_connect on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55c67341ae40 0x55c67341b220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d9bf1f93be8b9c6 server_cookie=67adea1e7714fae9 in_seq=0 out_seq=0 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f197fa640 1 -- 172.21.15.137:0/202654977 <== mds.0 v2:172.21.15.137:6834/1187927282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c673371990 con 0x55c67341ae40 2024-04-26T22:06:51.867 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f197fa640 10 client.8649 handle_command_reply: tid=0 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 client.8649 shutdown 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 -- 172.21.15.137:0/202654977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fef80 msgr2=0x55c673443620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fef80 0x55c673443620 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f3f24059e50 tx=0x7f3f24006f30 comp rx=0 tx=0).stop 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 -- 172.21.15.137:0/202654977 shutdown_connections 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55c67341ae40 0x55c67341b220 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fef80 0x55c673443620 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c67341a940 0x55c673443b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f197fa640 0 client.8649 ms_handle_reset on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 --2- 172.21.15.137:0/202654977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fe0c0 0x55c67344ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 -- 172.21.15.137:0/202654977 >> 172.21.15.137:0/202654977 conn(0x55c6733f9e10 msgr2=0x55c6733f9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 -- 172.21.15.137:0/202654977 shutdown_connections 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.860+0000 7f3f4356b740 1 -- 172.21.15.137:0/202654977 wait complete. 2024-04-26T22:06:51.868 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.861+0000 7f3f4356b740 20 client.8649 trim_cache size 0 max 16384 2024-04-26T22:06:51.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.878+0000 7f3f4356b740 1 Processor -- start 2024-04-26T22:06:51.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.878+0000 7f3f4356b740 1 -- start start 2024-04-26T22:06:51.885 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.878+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c673446cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fe0c0 0x55c67344a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 0x55c67341c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f4356b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c201b00 con 0x55c6733f9e10 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f4356b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c200ae0 con 0x55c6733fef80 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f4356b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3c1ffe50 con 0x55c6733fe0c0 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c673446cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3a59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c673446cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54802/0 (socket says 172.21.15.137:54802) 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3a59c640 1 -- 172.21.15.137:0/1968049198 learned_addr learned my addr 172.21.15.137:0/1968049198 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f33fff640 1 --2- 172.21.15.137:0/1968049198 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fe0c0 0x55c67344a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3ad9d640 1 --2- 172.21.15.137:0/1968049198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 0x55c67341c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3a59c640 1 -- 172.21.15.137:0/1968049198 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fe0c0 msgr2=0x55c67344a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.886 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/1968049198 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fe0c0 0x55c67344a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3a59c640 1 -- 172.21.15.137:0/1968049198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 msgr2=0x55c67341c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/1968049198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 0x55c67341c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3a59c640 1 -- 172.21.15.137:0/1968049198 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6730350f0 con 0x55c6733f9e10 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/1968049198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c673446cc0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0090b0 tx=0x7f3f2c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d2c48af38150d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f1b7fe640 1 -- 172.21.15.137:0/1968049198 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c037040 con 0x55c6733f9e10 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f1b7fe640 1 -- 172.21.15.137:0/1968049198 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c053070 con 0x55c6733f9e10 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.879+0000 7f3f1b7fe640 1 -- 172.21.15.137:0/1968049198 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c04f5c0 con 0x55c6733f9e10 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 -- 172.21.15.137:0/1968049198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 msgr2=0x55c673446cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1968049198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c673446cc0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0090b0 tx=0x7f3f2c02c000 comp rx=0 tx=0).stop 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 -- 172.21.15.137:0/1968049198 shutdown_connections 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1968049198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 0x55c67341c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1968049198 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733fe0c0 0x55c67344a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1968049198 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733f9e10 0x55c673446cc0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 -- 172.21.15.137:0/1968049198 >> 172.21.15.137:0/1968049198 conn(0x55c673445bd0 msgr2=0x55c6734199d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 -- 172.21.15.137:0/1968049198 shutdown_connections 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 -- 172.21.15.137:0/1968049198 wait complete. 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 -- start start 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.880+0000 7f3f4356b740 1 Processor -- start 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733f9e10 0x55c6734a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fe0c0 0x55c673428da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f4356b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 0x55c6733f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f4356b740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55c6733f56c0 con 0x55c6733fe0c0 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f4356b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c200470 con 0x55c6733fef80 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f4356b740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55c67344a480 con 0x55c6733f9e10 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f4356b740 10 client.0 _ll_register_callbacks cb 0x7f3f240595f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fe0c0 0x55c673428da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fe0c0 0x55c673428da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54816/0 (socket says 172.21.15.137:54816) 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f33fff640 1 -- 172.21.15.137:0/1590621940 learned_addr learned my addr 172.21.15.137:0/1590621940 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:06:51.888 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733f9e10 0x55c6734a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.881+0000 7f3f3ad9d640 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 0x55c6733f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f33fff640 1 -- 172.21.15.137:0/1590621940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733f9e10 msgr2=0x55c6734a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f33fff640 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733f9e10 0x55c6734a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f33fff640 1 -- 172.21.15.137:0/1590621940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 msgr2=0x55c6733f8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f33fff640 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 0x55c6733f8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f33fff640 1 -- 172.21.15.137:0/1590621940 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6733244b0 con 0x55c6733fe0c0 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f33fff640 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fe0c0 0x55c673428da0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400dfb0 tx=0x7f3f24056060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e68873ca783fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f197fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f197fa640 1 -- 172.21.15.137:0/1590621940 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24057f90 con 0x55c6733fe0c0 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f197fa640 1 -- 172.21.15.137:0/1590621940 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f3f240623e0 con 0x55c6733fe0c0 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f4356b740 1 -- 172.21.15.137:0/1590621940 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f2c053070 con 0x55c6733fe0c0 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f197fa640 1 -- 172.21.15.137:0/1590621940 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f3f240625e0 con 0x55c6733fe0c0 2024-04-26T22:06:51.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f4356b740 10 client.8655 fetch_fsmap learned FSMap version 72 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f4356b740 1 -- 172.21.15.137:0/1590621940 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55c673446900 con 0x55c6733fe0c0 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f197fa640 1 -- 172.21.15.137:0/1590621940 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2c053070 con 0x55c6733fe0c0 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f197fa640 1 -- 172.21.15.137:0/1590621940 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 72) ==== 3494+0+0 (secure 0 0 0) 0x7f3f24082070 con 0x55c6733fe0c0 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f4356b740 10 client.8655 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f4356b740 10 client.8655 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f4356b740 20 client.8655 populate_metadata read hostname 'smithi137' 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55c67341a940 0x55c6733f9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f4356b740 4 client.8655 mds_command: new command op to 8223 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f4356b740 1 -- 172.21.15.137:0/1590621940 --> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c67336b800 con 0x55c67341a940 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.882+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55c67341a940 0x55c6733f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f197fa640 10 client.8655 ms_handle_connect on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f3a59c640 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55c67341a940 0x55c6733f9200 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a5a616d7dfbe0e5 server_cookie=47a7d8361a2971b5 in_seq=0 out_seq=0 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f197fa640 1 -- 172.21.15.137:0/1590621940 <== mds.0 v2:172.21.15.137:6834/1187927282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55c67336b800 con 0x55c67341a940 2024-04-26T22:06:51.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f197fa640 10 client.8655 handle_command_reply: tid=0 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 client.8655 shutdown 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 -- 172.21.15.137:0/1590621940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fe0c0 msgr2=0x55c673428da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fe0c0 0x55c673428da0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400dfb0 tx=0x7f3f24056060 comp rx=0 tx=0).stop 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 -- 172.21.15.137:0/1590621940 shutdown_connections 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55c67341a940 0x55c6733f9200 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55c6733fe0c0 0x55c673428da0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f197fa640 0 client.8655 ms_handle_reset on v2:172.21.15.137:6834/1187927282 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c6733fef80 0x55c6733f8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 --2- 172.21.15.137:0/1590621940 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55c6733f9e10 0x55c6734a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 -- 172.21.15.137:0/1590621940 >> 172.21.15.137:0/1590621940 conn(0x55c673445bd0 msgr2=0x55c67344a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 -- 172.21.15.137:0/1590621940 shutdown_connections 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 1 -- 172.21.15.137:0/1590621940 wait complete. 2024-04-26T22:06:51.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.883+0000 7f3f4356b740 20 client.8655 trim_cache size 0 max 16384 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": { 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout: "657dc9a5-ea97-4cbc-b54f-8d23b271b72e": { 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout: "path": "/", 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout: "tag": "657dc9a5-ea97-4cbc-b54f-8d23b271b72e", 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout: "options": "recursive,repair" 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:06:51.892 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:06:51.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 -- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f1c06c920 msgr2=0x7f3f1c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f1c06c920 0x7f3f1c06ede0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c034000 tx=0x7f3f2c02e000 comp rx=0 tx=0).stop 2024-04-26T22:06:51.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 -- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 msgr2=0x7f3f3c0d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:06:51.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 0x7f3f3c0d0ff0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400d5f0 tx=0x7f3f2400dab0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 -- 172.21.15.137:0/2202906131 shutdown_connections 2024-04-26T22:06:51.893 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3f1c06c920 0x7f3f1c06ede0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3f3c15f680 0x7f3f3c0d0ff0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3f3c163aa0 0x7f3f3c0d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 --2- 172.21.15.137:0/2202906131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f3c0b60b0 0x7f3f3c154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:06:51.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 -- 172.21.15.137:0/2202906131 >> 172.21.15.137:0/2202906131 conn(0x7f3f3c08eca0 msgr2=0x7f3f3c0d25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:06:51.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 -- 172.21.15.137:0/2202906131 shutdown_connections 2024-04-26T22:06:51.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:51.884+0000 7f3f40852640 1 -- 172.21.15.137:0/2202906131 wait complete. 2024-04-26T22:06:51.895 INFO:tasks.cephfs.filesystem:scrub status for tag:657dc9a5-ea97-4cbc-b54f-8d23b271b72e - {'path': '/', 'tag': '657dc9a5-ea97-4cbc-b54f-8d23b271b72e', 'options': 'recursive,repair'} 2024-04-26T22:06:52.871 INFO:tasks.ceph.mds.c.smithi137.stderr:2024-04-26T22:06:52.871+0000 7fa42cd06640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:06:53.195 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:06:53.194+0000 7f6a4a7fc640 1 -- 172.21.15.137:0/2157416786 <== mon.0 v2:172.21.15.137:3300/0 8 ==== log(9 entries from seq 1 at 2024-04-26T22:06:51.735660+0000) ==== 1558+0+0 (secure 0 0 0) 0x7f6a50057430 con 0x7f6a5406e4d0 2024-04-26T22:06:53.195 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:51.735660+0000 mds.c [INF] scrub queued for path: / 2024-04-26T22:06:53.195 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:51.735665+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-26T22:06:53.195 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:51.735672+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-26T22:06:53.195 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:51.736409+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-04-26T22:06:53.195 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:51.736416+0000 mds.c [ERR] inode table repaired for inode: 0x10000000001 2024-04-26T22:06:53.196 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:51.736495+0000 mds.c [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-04-26T22:06:53.196 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:51.736503+0000 mds.c [ERR] inode table repaired for inode: 0x10000000002 2024-04-26T22:06:53.196 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:51.737095+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-26T22:06:53.196 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:06:52.541956+0000 mds.c [INF] scrub summary: idle 2024-04-26T22:07:14.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:07:14.638 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:07:21.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:21.896 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-26T22:07:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.005+0000 7f4e9283f640 1 Processor -- start 2024-04-26T22:07:22.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.005+0000 7f4e9283f640 1 -- start start 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.006+0000 7f4e9283f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4e8c15b930 0x7f4e8c15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.006+0000 7f4e9283f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c074200 0x7f4e8c0cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.006+0000 7f4e9283f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e8c15c530 con 0x7f4e8c15f4f0 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.006+0000 7f4e9283f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8c15c810 con 0x7f4e8c15b930 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.006+0000 7f4e9283f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c15caf0 con 0x7f4e8c074200 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.006+0000 7f4e8bfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4e8c15b930 0x7f4e8c15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.006+0000 7f4e8b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4e8c15f4f0 0x7f4e8c073af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42338/0 (socket says 172.21.15.137:42338) 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.006+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/3291388362 learned_addr learned my addr 172.21.15.137:0/3291388362 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.007+0000 7f4e90ddc640 1 --2- 172.21.15.137:0/3291388362 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c074200 0x7f4e8c0cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.007+0000 7f4e8bfff640 1 -- 172.21.15.137:0/3291388362 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c074200 msgr2=0x7f4e8c0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.007+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/3291388362 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c074200 0x7f4e8c0cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.007+0000 7f4e8bfff640 1 -- 172.21.15.137:0/3291388362 >> v1:172.21.15.137:6789/0 conn(0x7f4e8c15f4f0 legacy=0x7f4e8c073af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.007 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.007+0000 7f4e8bfff640 1 -- 172.21.15.137:0/3291388362 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c15cdd0 con 0x7f4e8c15b930 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.007+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/3291388362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15b930 0x7f4e8c15bd10 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00a940 tx=0x7f4e7c02b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8c23ec40e6d51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.007+0000 7f4e8affd640 1 -- 172.21.15.137:0/3291388362 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c00b040 con 0x7f4e8c15b930 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e8affd640 1 -- 172.21.15.137:0/3291388362 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c030710 con 0x7f4e8c15b930 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e8affd640 1 -- 172.21.15.137:0/3291388362 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c030ae0 con 0x7f4e8c15b930 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e9283f640 1 -- 172.21.15.137:0/3291388362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15b930 msgr2=0x7f4e8c15bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e9283f640 1 --2- 172.21.15.137:0/3291388362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15b930 0x7f4e8c15bd10 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00a940 tx=0x7f4e7c02b550 comp rx=0 tx=0).stop 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e9283f640 1 -- 172.21.15.137:0/3291388362 shutdown_connections 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e9283f640 1 --2- 172.21.15.137:0/3291388362 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c074200 0x7f4e8c0cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e9283f640 1 --2- 172.21.15.137:0/3291388362 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c15b930 0x7f4e8c15bd10 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e9283f640 1 -- 172.21.15.137:0/3291388362 >> 172.21.15.137:0/3291388362 conn(0x7f4e8c0cd8a0 msgr2=0x7f4e8c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e9283f640 1 -- 172.21.15.137:0/3291388362 shutdown_connections 2024-04-26T22:07:22.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.008+0000 7f4e9283f640 1 -- 172.21.15.137:0/3291388362 wait complete. 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.009+0000 7f4e9283f640 1 Processor -- start 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.010+0000 7f4e9283f640 1 -- start start 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.010+0000 7f4e9283f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c074200 0x7f4e8c0aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.010+0000 7f4e9283f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c15b930 0x7f4e8c1444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.010+0000 7f4e9283f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f4f0 0x7f4e8c1449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.010+0000 7f4e9283f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c06fdd0 con 0x7f4e8c074200 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.010+0000 7f4e9283f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c15c250 con 0x7f4e8c15b930 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.010+0000 7f4e9283f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c06f340 con 0x7f4e8c15f4f0 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.010+0000 7f4e8bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c074200 0x7f4e8c0aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.010+0000 7f4e8bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c074200 0x7f4e8c0aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36016/0 (socket says 172.21.15.137:36016) 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e8bfff640 1 -- 172.21.15.137:0/1011844253 learned_addr learned my addr 172.21.15.137:0/1011844253 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c15b930 0x7f4e8c1444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.012 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e90ddc640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f4f0 0x7f4e8c1449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e8bfff640 1 -- 172.21.15.137:0/1011844253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f4f0 msgr2=0x7f4e8c1449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f4f0 0x7f4e8c1449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e8bfff640 1 -- 172.21.15.137:0/1011844253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c15b930 msgr2=0x7f4e8c1444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c15b930 0x7f4e8c1444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e8bfff640 1 -- 172.21.15.137:0/1011844253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c1424c0 con 0x7f4e8c074200 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c074200 0x7f4e8c0aff30 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00aa60 tx=0x7f4e7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e88ff9640 1 -- 172.21.15.137:0/1011844253 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c03f020 con 0x7f4e8c074200 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e88ff9640 1 -- 172.21.15.137:0/1011844253 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c033d50 con 0x7f4e8c074200 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e9283f640 1 -- 172.21.15.137:0/1011844253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8c0b0470 con 0x7f4e8c074200 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e88ff9640 1 -- 172.21.15.137:0/1011844253 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c006e10 con 0x7f4e8c074200 2024-04-26T22:07:22.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.011+0000 7f4e9283f640 1 -- 172.21.15.137:0/1011844253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e8c142730 con 0x7f4e8c074200 2024-04-26T22:07:22.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.013+0000 7f4e88ff9640 1 -- 172.21.15.137:0/1011844253 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e7c042020 con 0x7f4e8c074200 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.013+0000 7f4e88ff9640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.013+0000 7f4e88ff9640 1 -- 172.21.15.137:0/1011844253 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f4e7c0ac5a0 con 0x7f4e8c074200 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.013+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.014+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c150480 tx=0x7f4e80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.014+0000 7f4e95630740 1 Processor -- start 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.014+0000 7f4e95630740 1 -- start start 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e95630740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1bcb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e95630740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bc5e10 0x55eaf1bc9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e95630740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e95630740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eaf1b2fd80 con 0x55eaf1bca0c0 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e95630740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55eaf1ae98b0 con 0x55eaf1bcaf80 2024-04-26T22:07:22.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e95630740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55eaf1b2bd40 con 0x55eaf1bc5e10 2024-04-26T22:07:22.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e90ddc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e90ddc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36028/0 (socket says 172.21.15.137:36028) 2024-04-26T22:07:22.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e90ddc640 1 -- 172.21.15.137:0/3447595489 learned_addr learned my addr 172.21.15.137:0/3447595489 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/3447595489 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bc5e10 0x55eaf1bc9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/3447595489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1bcb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e90ddc640 1 -- 172.21.15.137:0/3447595489 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bc5e10 msgr2=0x55eaf1bc9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e90ddc640 1 --2- 172.21.15.137:0/3447595489 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bc5e10 0x55eaf1bc9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e90ddc640 1 -- 172.21.15.137:0/3447595489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 msgr2=0x55eaf1bcb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e90ddc640 1 --2- 172.21.15.137:0/3447595489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1bcb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.015+0000 7f4e90ddc640 1 -- 172.21.15.137:0/3447595489 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf1abaa40 con 0x55eaf1bca0c0 2024-04-26T22:07:22.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e90ddc640 1 --2- 172.21.15.137:0/3447595489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bca500 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f4e840073e0 tx=0x7f4e840078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51807718cc15926d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e71ffb640 1 -- 172.21.15.137:0/3447595489 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e840147e0 con 0x55eaf1bca0c0 2024-04-26T22:07:22.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e71ffb640 1 -- 172.21.15.137:0/3447595489 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8401a070 con 0x55eaf1bca0c0 2024-04-26T22:07:22.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e71ffb640 1 -- 172.21.15.137:0/3447595489 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84014ba0 con 0x55eaf1bca0c0 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e95630740 1 -- 172.21.15.137:0/3447595489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 msgr2=0x55eaf1bca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e95630740 1 --2- 172.21.15.137:0/3447595489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bca500 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f4e840073e0 tx=0x7f4e840078a0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e95630740 1 -- 172.21.15.137:0/3447595489 shutdown_connections 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e95630740 1 --2- 172.21.15.137:0/3447595489 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bca500 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e95630740 1 --2- 172.21.15.137:0/3447595489 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bc5e10 0x55eaf1bc9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e95630740 1 --2- 172.21.15.137:0/3447595489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1bcb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e95630740 1 -- 172.21.15.137:0/3447595489 >> 172.21.15.137:0/3447595489 conn(0x55eaf1bc8080 msgr2=0x55eaf1c10b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e95630740 1 -- 172.21.15.137:0/3447595489 shutdown_connections 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.016+0000 7f4e95630740 1 -- 172.21.15.137:0/3447595489 wait complete. 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.017+0000 7f4e95630740 1 -- start start 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.017+0000 7f4e95630740 1 Processor -- start 2024-04-26T22:07:22.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e95630740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bca0c0 0x55eaf1c146b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e95630740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e95630740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1beb1f0 0x55eaf1c15210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e95630740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eaf1bf6b10 con 0x55eaf1bcaf80 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e95630740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55eaf1ab6d10 con 0x55eaf1bca0c0 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e95630740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55eaf1bf5f90 con 0x55eaf1beb1f0 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e95630740 10 client.0 _ll_register_callbacks cb 0x55eaf1ae3210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36036/0 (socket says 172.21.15.137:36036) 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/1135475605 learned_addr learned my addr 172.21.15.137:0/1135475605 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bca0c0 0x55eaf1c146b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e90ddc640 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1beb1f0 0x55eaf1c15210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/1135475605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1beb1f0 msgr2=0x55eaf1c15210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1beb1f0 0x55eaf1c15210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/1135475605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bca0c0 msgr2=0x55eaf1c146b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bca0c0 0x55eaf1c146b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.018+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/1135475605 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaf190b7d0 con 0x55eaf1bcaf80 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14bf0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f4e80007180 tx=0x7f4e80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e57ec7ac3ad048 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e6affd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e6affd640 1 -- 172.21.15.137:0/1135475605 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80027060 con 0x55eaf1bcaf80 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e6affd640 1 -- 172.21.15.137:0/1135475605 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f4e80010040 con 0x55eaf1bcaf80 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e95630740 1 -- 172.21.15.137:0/1135475605 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e8401a070 con 0x55eaf1bcaf80 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e6affd640 1 -- 172.21.15.137:0/1135475605 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f4e80007700 con 0x55eaf1bcaf80 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e95630740 10 client.8670 fetch_fsmap learned FSMap version 72 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e95630740 1 -- 172.21.15.137:0/1135475605 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55eaf18413f0 con 0x55eaf1bcaf80 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e6affd640 1 -- 172.21.15.137:0/1135475605 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8401a070 con 0x55eaf1bcaf80 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e6affd640 1 -- 172.21.15.137:0/1135475605 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 72) ==== 3494+0+0 (secure 0 0 0) 0x7f4e8000ec30 con 0x55eaf1bcaf80 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e95630740 10 client.8670 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e95630740 10 client.8670 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-26T22:07:22.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e95630740 20 client.8670 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e95630740 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eaf1c15750 0x55eaf1c15bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e95630740 4 client.8670 mds_command: new command op to 8223 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e95630740 1 -- 172.21.15.137:0/1135475605 --> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eaf1b3d990 con 0x55eaf1c15750 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.019+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eaf1c15750 0x55eaf1c15bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e6affd640 10 client.8670 ms_handle_connect on v2:172.21.15.137:6834/1187927282 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eaf1c15750 0x55eaf1c15bd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71e1bf1f70101aaa server_cookie=8b89c5bfd609131 in_seq=0 out_seq=0 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e6affd640 1 -- 172.21.15.137:0/1135475605 <== mds.0 v2:172.21.15.137:6834/1187927282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eaf1b3d990 con 0x55eaf1c15750 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e6affd640 10 client.8670 handle_command_reply: tid=0 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e95630740 1 client.8670 shutdown 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e95630740 1 -- 172.21.15.137:0/1135475605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bcaf80 msgr2=0x55eaf1c14bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e95630740 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14bf0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f4e80007180 tx=0x7f4e80000ed0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e95630740 1 -- 172.21.15.137:0/1135475605 shutdown_connections 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e95630740 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eaf1c15750 0x55eaf1c15bd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e95630740 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14bf0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e95630740 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1beb1f0 0x55eaf1c15210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e6affd640 0 client.8670 ms_handle_reset on v2:172.21.15.137:6834/1187927282 2024-04-26T22:07:22.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e95630740 1 --2- 172.21.15.137:0/1135475605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bca0c0 0x55eaf1c146b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.020+0000 7f4e95630740 1 -- 172.21.15.137:0/1135475605 >> 172.21.15.137:0/1135475605 conn(0x55eaf1bc5e10 msgr2=0x55eaf1bcba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.021+0000 7f4e95630740 1 -- 172.21.15.137:0/1135475605 shutdown_connections 2024-04-26T22:07:22.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.021+0000 7f4e95630740 1 -- 172.21.15.137:0/1135475605 wait complete. 2024-04-26T22:07:22.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.021+0000 7f4e95630740 20 client.8670 trim_cache size 0 max 16384 2024-04-26T22:07:22.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.038+0000 7f4e95630740 1 Processor -- start 2024-04-26T22:07:22.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.038+0000 7f4e95630740 1 -- start start 2024-04-26T22:07:22.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e95630740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bf6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e95630740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e95630740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1beb1f0 0x55eaf1c145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e95630740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c1ff7f0 con 0x55eaf1bca0c0 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e95630740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c1fe810 con 0x55eaf1bcaf80 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e95630740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c1fdc20 con 0x55eaf1beb1f0 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bf6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bf6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36038/0 (socket says 172.21.15.137:36038) 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8bfff640 1 -- 172.21.15.137:0/2252638930 learned_addr learned my addr 172.21.15.137:0/2252638930 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8bfff640 1 -- 172.21.15.137:0/2252638930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1beb1f0 msgr2=0x55eaf1c145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/2252638930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1beb1f0 0x55eaf1c145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8bfff640 1 -- 172.21.15.137:0/2252638930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 msgr2=0x55eaf1c14090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/2252638930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/2252638930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8bfff640 1 -- 172.21.15.137:0/2252638930 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaf1c2b5f0 con 0x55eaf1bca0c0 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/2252638930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/2252638930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bf6020 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00aa30 tx=0x7f4e7c0aa940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40dbc198b39848b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e717fa640 1 -- 172.21.15.137:0/2252638930 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c07e620 con 0x55eaf1bca0c0 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e717fa640 1 -- 172.21.15.137:0/2252638930 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c082e50 con 0x55eaf1bca0c0 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.039+0000 7f4e717fa640 1 -- 172.21.15.137:0/2252638930 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c078570 con 0x55eaf1bca0c0 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.040+0000 7f4e95630740 1 -- 172.21.15.137:0/2252638930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 msgr2=0x55eaf1bf6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.040+0000 7f4e95630740 1 --2- 172.21.15.137:0/2252638930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bf6020 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00aa30 tx=0x7f4e7c0aa940 comp rx=0 tx=0).stop 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.040+0000 7f4e95630740 1 -- 172.21.15.137:0/2252638930 shutdown_connections 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.040+0000 7f4e95630740 1 --2- 172.21.15.137:0/2252638930 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1beb1f0 0x55eaf1c145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.040+0000 7f4e95630740 1 --2- 172.21.15.137:0/2252638930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c14090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.040+0000 7f4e95630740 1 --2- 172.21.15.137:0/2252638930 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1bca0c0 0x55eaf1bf6020 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.040+0000 7f4e95630740 1 -- 172.21.15.137:0/2252638930 >> 172.21.15.137:0/2252638930 conn(0x55eaf1bc5e10 msgr2=0x55eaf1c114f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.040+0000 7f4e95630740 1 -- 172.21.15.137:0/2252638930 shutdown_connections 2024-04-26T22:07:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.040+0000 7f4e95630740 1 -- 172.21.15.137:0/2252638930 wait complete. 2024-04-26T22:07:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.041+0000 7f4e95630740 1 -- start start 2024-04-26T22:07:22.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.041+0000 7f4e95630740 1 Processor -- start 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bca0c0 0x55eaf1c925b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c11f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1beb1f0 0x55eaf1c96860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55eaf1bf6a70 con 0x55eaf1beb1f0 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c1fe1c0 con 0x55eaf1bcaf80 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55eaf1bcbd20 con 0x55eaf1bca0c0 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 10 client.0 _ll_register_callbacks cb 0x7f4e80005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e90ddc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1beb1f0 0x55eaf1c96860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e90ddc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1beb1f0 0x55eaf1c96860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36054/0 (socket says 172.21.15.137:36054) 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e90ddc640 1 -- 172.21.15.137:0/338540218 learned_addr learned my addr 172.21.15.137:0/338540218 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c11f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bca0c0 0x55eaf1c925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e90ddc640 1 -- 172.21.15.137:0/338540218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bca0c0 msgr2=0x55eaf1c925b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e90ddc640 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bca0c0 0x55eaf1c925b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e90ddc640 1 -- 172.21.15.137:0/338540218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 msgr2=0x55eaf1c11f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e90ddc640 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c11f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e90ddc640 1 -- 172.21.15.137:0/338540218 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaf18010f0 con 0x55eaf1beb1f0 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e90ddc640 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1beb1f0 0x55eaf1c96860 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009f80 tx=0x7f4e84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2448274f69206cf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e6affd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e6affd640 1 -- 172.21.15.137:0/338540218 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84014c80 con 0x55eaf1beb1f0 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e6affd640 1 -- 172.21.15.137:0/338540218 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f4e84014e20 con 0x55eaf1beb1f0 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 1 -- 172.21.15.137:0/338540218 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e7c082e50 con 0x55eaf1beb1f0 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e6affd640 1 -- 172.21.15.137:0/338540218 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f4e84032050 con 0x55eaf1beb1f0 2024-04-26T22:07:22.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 10 client.8676 fetch_fsmap learned FSMap version 72 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.042+0000 7f4e95630740 1 -- 172.21.15.137:0/338540218 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) -- 0x55eaf1af04b0 con 0x55eaf1beb1f0 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e6affd640 1 -- 172.21.15.137:0/338540218 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e7c082e50 con 0x55eaf1beb1f0 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e6affd640 1 -- 172.21.15.137:0/338540218 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 72) ==== 3494+0+0 (secure 0 0 0) 0x7f4e84035020 con 0x55eaf1beb1f0 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e95630740 10 client.8676 fetch_fsmap finished waiting for FSMap version 72 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e95630740 10 client.8676 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e95630740 20 client.8676 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e95630740 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eaf1bf3080 0x55eaf1c183a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e95630740 4 client.8676 mds_command: new command op to 8223 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e95630740 1 -- 172.21.15.137:0/338540218 --> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eaf1b37800 con 0x55eaf1bf3080 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eaf1bf3080 0x55eaf1c183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e6affd640 10 client.8676 ms_handle_connect on v2:172.21.15.137:6834/1187927282 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eaf1bf3080 0x55eaf1c183a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5f5d35e043e1f4 server_cookie=2a4129630f044e42 in_seq=0 out_seq=0 2024-04-26T22:07:22.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e6affd640 1 -- 172.21.15.137:0/338540218 <== mds.0 v2:172.21.15.137:6834/1187927282 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55eaf1b37800 con 0x55eaf1bf3080 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e6affd640 10 client.8676 handle_command_reply: tid=0 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e95630740 1 client.8676 shutdown 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e95630740 1 -- 172.21.15.137:0/338540218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1beb1f0 msgr2=0x55eaf1c96860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.043+0000 7f4e95630740 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1beb1f0 0x55eaf1c96860 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009f80 tx=0x7f4e84004a40 comp rx=0 tx=0).stop 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e95630740 1 -- 172.21.15.137:0/338540218 shutdown_connections 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e95630740 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.137:6834/1187927282,v1:172.21.15.137:6836/1187927282] conn(0x55eaf1bf3080 0x55eaf1c183a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e95630740 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55eaf1beb1f0 0x55eaf1c96860 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e95630740 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eaf1bcaf80 0x55eaf1c11f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e6affd640 0 client.8676 ms_handle_reset on v2:172.21.15.137:6834/1187927282 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e95630740 1 --2- 172.21.15.137:0/338540218 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55eaf1bca0c0 0x55eaf1c925b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e95630740 1 -- 172.21.15.137:0/338540218 >> 172.21.15.137:0/338540218 conn(0x55eaf1bc5e10 msgr2=0x55eaf1bee180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e95630740 1 -- 172.21.15.137:0/338540218 shutdown_connections 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e95630740 1 -- 172.21.15.137:0/338540218 wait complete. 2024-04-26T22:07:22.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e95630740 20 client.8676 trim_cache size 0 max 16384 2024-04-26T22:07:22.051 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:07:22.051 INFO:teuthology.orchestra.run.smithi137.stdout: "status": "no active scrubs running", 2024-04-26T22:07:22.051 INFO:teuthology.orchestra.run.smithi137.stdout: "scrubs": {} 2024-04-26T22:07:22.051 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:07:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 -- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 msgr2=0x7f4e7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c150480 tx=0x7f4e80009040 comp rx=0 tx=0).stop 2024-04-26T22:07:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 -- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c074200 msgr2=0x7f4e8c0aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c074200 0x7f4e8c0aff30 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c00aa60 tx=0x7f4e7c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 -- 172.21.15.137:0/1011844253 shutdown_connections 2024-04-26T22:07:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c15f4f0 0x7f4e8c1449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c15b930 0x7f4e8c1444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 --2- 172.21.15.137:0/1011844253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c074200 0x7f4e8c0aff30 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 -- 172.21.15.137:0/1011844253 >> 172.21.15.137:0/1011844253 conn(0x7f4e8c0cd8a0 msgr2=0x7f4e8c0b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 -- 172.21.15.137:0/1011844253 shutdown_connections 2024-04-26T22:07:22.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.044+0000 7f4e9283f640 1 -- 172.21.15.137:0/1011844253 wait complete. 2024-04-26T22:07:22.055 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-26T22:07:22.156 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:07:22.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.254+0000 7f3cf95da640 1 Processor -- start 2024-04-26T22:07:22.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.254+0000 7f3cf95da640 1 -- start start 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.255+0000 7f3cf95da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 0x7f3cf4071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.255+0000 7f3cf95da640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3cf409c400 0x7f3cf4162f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.255+0000 7f3cf95da640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf40d14c0 con 0x7f3cf4070520 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.255+0000 7f3cf95da640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f3cf40d1290 con 0x7f3cf409c400 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.255+0000 7f3cf95da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf4071640 con 0x7f3cf4070d20 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.255+0000 7f3cf37fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f3cf4070520 0x7f3cf4163470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42346/0 (socket says 172.21.15.137:42346) 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.255+0000 7f3cf37fe640 1 -- 172.21.15.137:0/2871829206 learned_addr learned my addr 172.21.15.137:0/2871829206 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.255+0000 7f3cf27fc640 1 --2- 172.21.15.137:0/2871829206 >> v2:172.21.15.170:3300/0 conn(0x7f3cf409c400 0x7f3cf4162f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.255+0000 7f3cf2ffd640 1 --2- 172.21.15.137:0/2871829206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 0x7f3cf4071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.256+0000 7f3cf1ffb640 1 -- 172.21.15.137:0/2871829206 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193417261 0 0) 0x7f3cf40d14c0 con 0x7f3cf4070520 2024-04-26T22:07:22.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.256+0000 7f3cf1ffb640 1 -- 172.21.15.137:0/2871829206 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cdc003520 con 0x7f3cf4070520 2024-04-26T22:07:22.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.256+0000 7f3cf27fc640 1 -- 172.21.15.137:0/2871829206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 msgr2=0x7f3cf4071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.256+0000 7f3cf27fc640 1 --2- 172.21.15.137:0/2871829206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 0x7f3cf4071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.256+0000 7f3cf27fc640 1 -- 172.21.15.137:0/2871829206 >> v1:172.21.15.137:6789/0 conn(0x7f3cf4070520 legacy=0x7f3cf4163470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.256+0000 7f3cf27fc640 1 -- 172.21.15.137:0/2871829206 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf40ce5b0 con 0x7f3cf409c400 2024-04-26T22:07:22.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.256+0000 7f3cf27fc640 1 --2- 172.21.15.137:0/2871829206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf409c400 0x7f3cf4162f30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80097a0 tx=0x7f3ce802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c393aca51a2f96a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf1ffb640 1 -- 172.21.15.137:0/2871829206 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8037070 con 0x7f3cf409c400 2024-04-26T22:07:22.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf1ffb640 1 -- 172.21.15.137:0/2871829206 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce8032440 con 0x7f3cf409c400 2024-04-26T22:07:22.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf1ffb640 1 -- 172.21.15.137:0/2871829206 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80327f0 con 0x7f3cf409c400 2024-04-26T22:07:22.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf95da640 1 -- 172.21.15.137:0/2871829206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf409c400 msgr2=0x7f3cf4162f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf95da640 1 --2- 172.21.15.137:0/2871829206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf409c400 0x7f3cf4162f30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80097a0 tx=0x7f3ce802a180 comp rx=0 tx=0).stop 2024-04-26T22:07:22.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf95da640 1 -- 172.21.15.137:0/2871829206 shutdown_connections 2024-04-26T22:07:22.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf95da640 1 --2- 172.21.15.137:0/2871829206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf409c400 0x7f3cf4162f30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf95da640 1 --2- 172.21.15.137:0/2871829206 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 0x7f3cf4071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf95da640 1 -- 172.21.15.137:0/2871829206 >> 172.21.15.137:0/2871829206 conn(0x7f3cf40b4a40 msgr2=0x7f3cf40b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf95da640 1 -- 172.21.15.137:0/2871829206 shutdown_connections 2024-04-26T22:07:22.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.257+0000 7f3cf95da640 1 -- 172.21.15.137:0/2871829206 wait complete. 2024-04-26T22:07:22.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf95da640 1 Processor -- start 2024-04-26T22:07:22.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf95da640 1 -- start start 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf95da640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3cf4070520 0x7f3cf414c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf95da640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 0x7f3cf40afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf95da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf409c400 0x7f3cf40b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf95da640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf40d1d20 con 0x7f3cf4070520 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf95da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf40d1a40 con 0x7f3cf409c400 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf95da640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf40d2000 con 0x7f3cf4070d20 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3cf4070520 0x7f3cf414c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf2ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3cf4070520 0x7f3cf414c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36060/0 (socket says 172.21.15.137:36060) 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.259+0000 7f3cf2ffd640 1 -- 172.21.15.137:0/476570611 learned_addr learned my addr 172.21.15.137:0/476570611 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf27fc640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 0x7f3cf40afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf37fe640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf409c400 0x7f3cf40b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf2ffd640 1 -- 172.21.15.137:0/476570611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 msgr2=0x7f3cf40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf2ffd640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 0x7f3cf40afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf2ffd640 1 -- 172.21.15.137:0/476570611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf409c400 msgr2=0x7f3cf40b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf2ffd640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf409c400 0x7f3cf40b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf2ffd640 1 -- 172.21.15.137:0/476570611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf40b0670 con 0x7f3cf4070520 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf2ffd640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3cf4070520 0x7f3cf414c2d0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400efc0 tx=0x7f3ce400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cdb7fe640 1 -- 172.21.15.137:0/476570611 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4018020 con 0x7f3cf4070520 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cdb7fe640 1 -- 172.21.15.137:0/476570611 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce4014480 con 0x7f3cf4070520 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cdb7fe640 1 -- 172.21.15.137:0/476570611 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4014850 con 0x7f3cf4070520 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf40b0950 con 0x7f3cf4070520 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.260+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf40b0f10 con 0x7f3cf4070520 2024-04-26T22:07:22.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.261+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf40693d0 con 0x7f3cf4070520 2024-04-26T22:07:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.261+0000 7f3cdb7fe640 1 -- 172.21.15.137:0/476570611 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ce4005d10 con 0x7f3cf4070520 2024-04-26T22:07:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.262+0000 7f3cdb7fe640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3ce006c8f0 0x7f3ce006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.262+0000 7f3cdb7fe640 1 -- 172.21.15.137:0/476570611 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5795+0+0 (secure 0 0 0) 0x7f3ce408c640 con 0x7f3cf4070520 2024-04-26T22:07:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.262+0000 7f3cf27fc640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3ce006c8f0 0x7f3ce006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.262+0000 7f3cf27fc640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3ce006c8f0 0x7f3ce006edb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8034000 tx=0x7f3ce802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.266+0000 7f3cdb7fe640 1 -- 172.21.15.137:0/476570611 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3ce4022070 con 0x7f3cf4070520 2024-04-26T22:07:22.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.478+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3cf40b1330 con 0x7f3cf4070520 2024-04-26T22:07:22.479 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:07:22.479+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:07:22.480 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.481+0000 7f3cdb7fe640 1 -- 172.21.15.137:0/476570611 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) ==== 161+0+0 (secure 0 0 0) 0x7f3ce4010040 con 0x7f3cf4070520 2024-04-26T22:07:22.480 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:07:22.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3ce006c8f0 msgr2=0x7f3ce006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3ce006c8f0 0x7f3ce006edb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8034000 tx=0x7f3ce802e000 comp rx=0 tx=0).stop 2024-04-26T22:07:22.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3cf4070520 msgr2=0x7f3cf414c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3cf4070520 0x7f3cf414c2d0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400efc0 tx=0x7f3ce400c490 comp rx=0 tx=0).stop 2024-04-26T22:07:22.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 shutdown_connections 2024-04-26T22:07:22.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3ce006c8f0 0x7f3ce006edb0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.484 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cf409c400 0x7f3cf40b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3cf4070d20 0x7f3cf40afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 --2- 172.21.15.137:0/476570611 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3cf4070520 0x7f3cf414c2d0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 >> 172.21.15.137:0/476570611 conn(0x7f3cf40b4a40 msgr2=0x7f3cf40b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 shutdown_connections 2024-04-26T22:07:22.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.484+0000 7f3cf95da640 1 -- 172.21.15.137:0/476570611 wait complete. 2024-04-26T22:07:22.485 INFO:tasks.ceph.mds.c.smithi137.stderr: -1140> 2024-04-26T22:06:51.735+0000 7fa428cfe640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-26T22:07:22.485 INFO:tasks.ceph.mds.c.smithi137.stderr: -1137> 2024-04-26T22:06:51.735+0000 7fa428cfe640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-26T22:07:22.486 INFO:tasks.ceph.mds.c.smithi137.stderr: -1121> 2024-04-26T22:06:51.735+0000 7fa428cfe640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-26T22:07:22.486 INFO:tasks.ceph.mds.c.smithi137.stderr: -1118> 2024-04-26T22:06:51.735+0000 7fa428cfe640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-26T22:07:22.486 INFO:tasks.ceph.mds.c.smithi137.stderr: -939> 2024-04-26T22:06:52.871+0000 7fa42cd06640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:07:22.496 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-04-26T22:07:22.511 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:07:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.535+0000 7f87ea7b8280 1 -- start start 2024-04-26T22:07:22.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.535+0000 7f87ea7b8280 1 Processor -- start 2024-04-26T22:07:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87ea7b8280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b86f8c00 0x55a9b94c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87ea7b8280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b86f9800 0x55a9b94c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87ea7b8280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b86f9c00 0x55a9b94c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87ea7b8280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a9b9494600 con 0x55a9b86f9c00 2024-04-26T22:07:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87ea7b8280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a9b9494480 con 0x55a9b86f8c00 2024-04-26T22:07:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87ea7b8280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a9b9494300 con 0x55a9b86f9800 2024-04-26T22:07:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e9765640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b86f9c00 0x55a9b94c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e9765640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b86f9c00 0x55a9b94c0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36108/0 (socket says 172.21.15.137:36108) 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e9765640 1 -- 172.21.15.137:0/1238530900 learned_addr learned my addr 172.21.15.137:0/1238530900 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e8763640 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b86f9800 0x55a9b94c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e8f64640 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b86f8c00 0x55a9b94c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e9765640 1 -- 172.21.15.137:0/1238530900 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b86f9800 msgr2=0x55a9b94c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e9765640 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b86f9800 0x55a9b94c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e9765640 1 -- 172.21.15.137:0/1238530900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b86f8c00 msgr2=0x55a9b94c0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e9765640 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b86f8c00 0x55a9b94c0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e9765640 1 -- 172.21.15.137:0/1238530900 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b872e780 con 0x55a9b86f9c00 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e8f64640 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b86f8c00 0x55a9b94c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:22.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e9765640 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b86f9c00 0x55a9b94c0b00 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x55a9b951b380 tx=0x55a9b9496600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf24318405f6c8d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e675f640 1 -- 172.21.15.137:0/1238530900 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9b871e9c0 con 0x55a9b86f9c00 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e675f640 1 -- 172.21.15.137:0/1238530900 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a9b8724c40 con 0x55a9b86f9c00 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87ea7b8280 1 -- 172.21.15.137:0/1238530900 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b872e3c0 con 0x55a9b86f9c00 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87e675f640 1 -- 172.21.15.137:0/1238530900 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9b871e680 con 0x55a9b86f9c00 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.536+0000 7f87ea7b8280 1 -- 172.21.15.137:0/1238530900 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55a9b872f680 con 0x55a9b86f9c00 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.537+0000 7f87ea7b8280 4 waiting for MDS map... 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.537+0000 7f87e675f640 1 -- 172.21.15.137:0/1238530900 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x55a9b95d2600 con 0x55a9b86f9c00 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.537+0000 7f87e675f640 1 -- 172.21.15.137:0/1238530900 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 73) ==== 2885+0+0 (secure 0 0 0) 0x55a9b8753180 con 0x55a9b86f9c00 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.537+0000 7f87ea7b8280 4 Got MDS map 73 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.537+0000 7f87ea7b8280 10 main: main 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.537+0000 7f87ea7b8280 4 main: connecting to RADOS... 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.537+0000 7f87ea7b8280 1 Processor -- start 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.537+0000 7f87ea7b8280 1 -- start start 2024-04-26T22:07:22.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87ea7b8280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87ea7b8280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620400 0x55a9b94c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87ea7b8280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b9620800 0x55a9b94c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87ea7b8280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a9b9494180 con 0x55a9b9620000 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87ea7b8280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a9b875a480 con 0x55a9b9620400 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87ea7b8280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a9b875a900 con 0x55a9b9620800 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8763640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8763640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36110/0 (socket says 172.21.15.137:36110) 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8763640 1 -- 172.21.15.137:0/2500809065 learned_addr learned my addr 172.21.15.137:0/2500809065 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8f64640 1 --2- 172.21.15.137:0/2500809065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620400 0x55a9b94c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8763640 1 --2- 172.21.15.137:0/2500809065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b9620800 0x55a9b94c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8763640 1 -- 172.21.15.137:0/2500809065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b9620800 msgr2=0x55a9b94c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8763640 1 --2- 172.21.15.137:0/2500809065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b9620800 0x55a9b94c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8763640 1 -- 172.21.15.137:0/2500809065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620400 msgr2=0x55a9b94c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8763640 1 --2- 172.21.15.137:0/2500809065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620400 0x55a9b94c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.538+0000 7f87e8763640 1 -- 172.21.15.137:0/2500809065 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b872f4a0 con 0x55a9b9620000 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87e8763640 1 --2- 172.21.15.137:0/2500809065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x55a9b94f2510 tx=0x55a9b95d6d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a402da32de7d9f85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87e475b640 1 -- 172.21.15.137:0/2500809065 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9b871e9c0 con 0x55a9b9620000 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87e475b640 1 -- 172.21.15.137:0/2500809065 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a9b8724a80 con 0x55a9b9620000 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87e475b640 1 -- 172.21.15.137:0/2500809065 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9b871e680 con 0x55a9b9620000 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87ea7b8280 1 -- 172.21.15.137:0/2500809065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620000 msgr2=0x55a9b94c1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/2500809065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x55a9b94f2510 tx=0x55a9b95d6d20 comp rx=0 tx=0).stop 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87ea7b8280 1 -- 172.21.15.137:0/2500809065 shutdown_connections 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/2500809065 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b9620800 0x55a9b94c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/2500809065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620400 0x55a9b94c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/2500809065 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87ea7b8280 1 -- 172.21.15.137:0/2500809065 >> 172.21.15.137:0/2500809065 conn(0x55a9b94d5c00 msgr2=0x55a9b87ec800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87ea7b8280 1 -- 172.21.15.137:0/2500809065 shutdown_connections 2024-04-26T22:07:22.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.539+0000 7f87ea7b8280 1 -- 172.21.15.137:0/2500809065 wait complete. 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87ea7b8280 1 Processor -- start 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87ea7b8280 1 -- start start 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87ea7b8280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87ea7b8280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620400 0x55a9b94c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87ea7b8280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b9620800 0x55a9b94c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87ea7b8280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a9b9495380 con 0x55a9b9620400 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87ea7b8280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a9b9494180 con 0x55a9b9620000 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87ea7b8280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a9b9495500 con 0x55a9b9620800 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87e8f64640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620400 0x55a9b94c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87e8f64640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620400 0x55a9b94c1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36126/0 (socket says 172.21.15.137:36126) 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87e8f64640 1 -- 172.21.15.137:0/87550392 learned_addr learned my addr 172.21.15.137:0/87550392 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87e8763640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b9620800 0x55a9b94c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87e8763640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87e8f64640 1 -- 172.21.15.137:0/87550392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b9620800 msgr2=0x55a9b94c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.540+0000 7f87e8f64640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b9620800 0x55a9b94c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87e8f64640 1 -- 172.21.15.137:0/87550392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620000 msgr2=0x55a9b94c1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87e8f64640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87e8f64640 1 -- 172.21.15.137:0/87550392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b872e000 con 0x55a9b9620400 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87e8763640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b9620000 0x55a9b94c1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87e8f64640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620400 0x55a9b94c1600 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x55a9b94f37d0 tx=0x55a9b95d6de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87e2f58640 1 -- 172.21.15.137:0/87550392 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9b871e9c0 con 0x55a9b9620400 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87e2f58640 1 -- 172.21.15.137:0/87550392 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55a9b8724700 con 0x55a9b9620400 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9b872e960 con 0x55a9b9620400 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87e2f58640 1 -- 172.21.15.137:0/87550392 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55a9b871e680 con 0x55a9b9620400 2024-04-26T22:07:22.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b872f860 con 0x55a9b9620400 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.541+0000 7f87ea7b8280 4 main: resolving pool 14 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.542+0000 7f87e2f58640 1 -- 172.21.15.137:0/87550392 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55a9b95c2c00 con 0x55a9b9620400 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.542+0000 7f87e2f58640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55a9b9642c00 0x55a9b94c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.542+0000 7f87e2f58640 1 -- 172.21.15.137:0/87550392 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x55a9b95c1000 con 0x55a9b9620400 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.543+0000 7f87ea7b8280 4 main: creating IoCtx.. 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.543+0000 7f87e8763640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55a9b9642c00 0x55a9b94c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.543+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55a9b9620c00 0x55a9b94c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.543+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e105) -- 0x55a9b9621000 con 0x55a9b9620c00 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.543+0000 7f87e8763640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55a9b9620c00 0x55a9b94c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.543+0000 7f87e8763640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55a9b9642c00 0x55a9b94c2100 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x55a9b94f2660 tx=0x55a9b95d6cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.543+0000 7f87e8763640 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55a9b9620c00 0x55a9b94c2680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87e8763640 1 -- 172.21.15.137:0/87550392 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) ==== 157+0+34 (crc 0 0 0) 0x55a9b9486000 con 0x55a9b9620c00 2024-04-26T22:07:22.551 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:07:22.551 INFO:teuthology.orchestra.run.smithi137.stdout: "0": { 2024-04-26T22:07:22.551 INFO:teuthology.orchestra.run.smithi137.stdout: "data": { 2024-04-26T22:07:22.551 INFO:teuthology.orchestra.run.smithi137.stdout: "version": 5, 2024-04-26T22:07:22.551 INFO:teuthology.orchestra.run.smithi137.stdout: "inotable": { 2024-04-26T22:07:22.551 INFO:teuthology.orchestra.run.smithi137.stdout: "projected_free": [ 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: "start": 1099511627779, 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: "len": 1099511627773 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: ], 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: "free": [ 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: "start": 1099511627779, 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: "len": 1099511627773 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:22.552 INFO:teuthology.orchestra.run.smithi137.stdout: "result": 0 2024-04-26T22:07:22.553 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:22.553 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:07:22.553 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:22.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55a9b9620c00 msgr2=0x55a9b94c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55a9b9620c00 0x55a9b94c2680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55a9b9642c00 msgr2=0x55a9b94c2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55a9b9642c00 0x55a9b94c2100 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x55a9b94f2660 tx=0x55a9b95d6cc0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620400 msgr2=0x55a9b94c1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/87550392 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b9620400 0x55a9b94c1600 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x55a9b94f37d0 tx=0x55a9b95d6de0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87e8f64640 1 -- 172.21.15.137:0/87550392 reap_dead start 2024-04-26T22:07:22.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 shutdown_connections 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 >> 172.21.15.137:0/87550392 conn(0x55a9b94d5c00 msgr2=0x55a9b87ec800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 shutdown_connections 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.545+0000 7f87ea7b8280 1 -- 172.21.15.137:0/87550392 wait complete. 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.546+0000 7f87ea7b8280 1 -- 172.21.15.137:0/1238530900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b86f9c00 msgr2=0x55a9b94c0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.546+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b86f9c00 0x55a9b94c0b00 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x55a9b951b380 tx=0x55a9b9496600 comp rx=0 tx=0).stop 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.546+0000 7f87ea7b8280 1 -- 172.21.15.137:0/1238530900 shutdown_connections 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.546+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a9b86f9c00 0x55a9b94c0b00 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.546+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a9b86f9800 0x55a9b94c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.546+0000 7f87ea7b8280 1 --2- 172.21.15.137:0/1238530900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a9b86f8c00 0x55a9b94c0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.546+0000 7f87ea7b8280 1 -- 172.21.15.137:0/1238530900 >> 172.21.15.137:0/1238530900 conn(0x55a9b86f9000 msgr2=0x55a9b87ed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.546+0000 7f87ea7b8280 1 -- 172.21.15.137:0/1238530900 shutdown_connections 2024-04-26T22:07:22.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.546+0000 7f87ea7b8280 1 -- 172.21.15.137:0/1238530900 wait complete. 2024-04-26T22:07:22.557 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.060555, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-04-26T22:07:22.557 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:07:22.557 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:07:22.630 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:07:22.677 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:07:22.677 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:07:22.677 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:22.677 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:22.694 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:07:22.694 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:07:22.694 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:07:22.694 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:22.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:07:22.712 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:07:22.713 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:22.713 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:22.749 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:07:22.749 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:07:22.749 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:07:22.750 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:22.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:07:22.770 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:22.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.887+0000 7f6212971640 1 Processor -- start 2024-04-26T22:07:22.887 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.887+0000 7f6212971640 1 -- start start 2024-04-26T22:07:22.889 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f6212971640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f620c145980 0x7f620c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f6212971640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b3de0 0x7f620c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f6212971640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f620c0b5fd0 0x7f620c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f6212971640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f620c0b6440 con 0x7f620c0b5fd0 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f6212971640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f620c0b5140 con 0x7f620c145980 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f6212971640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f620c0b4260 con 0x7f620c0b3de0 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f6210f0e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f620c0b5fd0 0x7f620c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f6210f0e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f620c0b5fd0 0x7f620c15c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36138/0 (socket says 172.21.15.137:36138) 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f6210f0e640 1 -- 172.21.15.137:0/2057918944 learned_addr learned my addr 172.21.15.137:0/2057918944 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f620b7fe640 1 --2- 172.21.15.137:0/2057918944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b3de0 0x7f620c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.888+0000 7f620bfff640 1 --2- 172.21.15.137:0/2057918944 >> v2:172.21.15.170:3300/0 conn(0x7f620c145980 0x7f620c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f6210f0e640 1 -- 172.21.15.137:0/2057918944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b3de0 msgr2=0x7f620c0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.890 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f6210f0e640 1 --2- 172.21.15.137:0/2057918944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b3de0 0x7f620c0b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f6210f0e640 1 -- 172.21.15.137:0/2057918944 >> v2:172.21.15.170:3300/0 conn(0x7f620c145980 msgr2=0x7f620c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f6210f0e640 1 --2- 172.21.15.137:0/2057918944 >> v2:172.21.15.170:3300/0 conn(0x7f620c145980 0x7f620c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f6210f0e640 1 -- 172.21.15.137:0/2057918944 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c0b4530 con 0x7f620c0b5fd0 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f620b7fe640 1 --2- 172.21.15.137:0/2057918944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b3de0 0x7f620c0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f6210f0e640 1 --2- 172.21.15.137:0/2057918944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c0b5fd0 0x7f620c15c510 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f620c06ff10 tx=0x7f620402c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255ca63fb5db367a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f620affd640 1 -- 172.21.15.137:0/2057918944 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204039070 con 0x7f620c0b5fd0 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f620affd640 1 -- 172.21.15.137:0/2057918944 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6204009600 con 0x7f620c0b5fd0 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.889+0000 7f620affd640 1 -- 172.21.15.137:0/2057918944 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040099f0 con 0x7f620c0b5fd0 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.890+0000 7f6212971640 1 -- 172.21.15.137:0/2057918944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c0b5fd0 msgr2=0x7f620c15c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.890+0000 7f6212971640 1 --2- 172.21.15.137:0/2057918944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c0b5fd0 0x7f620c15c510 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f620c06ff10 tx=0x7f620402c810 comp rx=0 tx=0).stop 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.890+0000 7f6212971640 1 -- 172.21.15.137:0/2057918944 shutdown_connections 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.890+0000 7f6212971640 1 --2- 172.21.15.137:0/2057918944 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c0b5fd0 0x7f620c15c510 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.890+0000 7f6212971640 1 --2- 172.21.15.137:0/2057918944 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b3de0 0x7f620c0b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.891 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.890+0000 7f6212971640 1 --2- 172.21.15.137:0/2057918944 >> v2:172.21.15.170:3300/0 conn(0x7f620c145980 0x7f620c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.890+0000 7f6212971640 1 -- 172.21.15.137:0/2057918944 >> 172.21.15.137:0/2057918944 conn(0x7f620c0d0d30 msgr2=0x7f620c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:22.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.890+0000 7f6212971640 1 -- 172.21.15.137:0/2057918944 shutdown_connections 2024-04-26T22:07:22.892 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.890+0000 7f6212971640 1 -- 172.21.15.137:0/2057918944 wait complete. 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.891+0000 7f6212971640 1 Processor -- start 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.891+0000 7f6212971640 1 -- start start 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6212971640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f620c0b3de0 0x7f620c0afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6212971640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b5fd0 0x7f620c15e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6212971640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c145980 0x7f620c0ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6212971640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f620c0b4dd0 con 0x7f620c145980 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6212971640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f620c0b4af0 con 0x7f620c0b3de0 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6212971640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f620c15ca50 con 0x7f620c0b5fd0 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6210f0e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c145980 0x7f620c0ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6210f0e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c145980 0x7f620c0ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36140/0 (socket says 172.21.15.137:36140) 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6210f0e640 1 -- 172.21.15.137:0/903497913 learned_addr learned my addr 172.21.15.137:0/903497913 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f620bfff640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f620c0b3de0 0x7f620c0afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.895 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f620b7fe640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b5fd0 0x7f620c15e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6210f0e640 1 -- 172.21.15.137:0/903497913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b5fd0 msgr2=0x7f620c15e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6210f0e640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b5fd0 0x7f620c15e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6210f0e640 1 -- 172.21.15.137:0/903497913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f620c0b3de0 msgr2=0x7f620c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6210f0e640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f620c0b3de0 0x7f620c0afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.892+0000 7f6210f0e640 1 -- 172.21.15.137:0/903497913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c141b60 con 0x7f620c145980 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.893+0000 7f6210f0e640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c145980 0x7f620c0ae0e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f620402c850 tx=0x7f6204004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.893+0000 7f6208ff9640 1 -- 172.21.15.137:0/903497913 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204039040 con 0x7f620c145980 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.893+0000 7f6208ff9640 1 -- 172.21.15.137:0/903497913 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6204044070 con 0x7f620c145980 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.893+0000 7f6208ff9640 1 -- 172.21.15.137:0/903497913 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620400b720 con 0x7f620c145980 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.893+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620c133830 con 0x7f620c145980 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.893+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620c133df0 con 0x7f620c145980 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.894+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620c1603e0 con 0x7f620c145980 2024-04-26T22:07:22.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.894+0000 7f6208ff9640 1 -- 172.21.15.137:0/903497913 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6204004040 con 0x7f620c145980 2024-04-26T22:07:22.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.894+0000 7f6208ff9640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f61f806c8f0 0x7f61f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:22.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.895+0000 7f6208ff9640 1 -- 172.21.15.137:0/903497913 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f62040ae550 con 0x7f620c145980 2024-04-26T22:07:22.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.895+0000 7f620bfff640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f61f806c8f0 0x7f61f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:22.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.895+0000 7f620bfff640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f61f806c8f0 0x7f61f806edb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f620c073420 tx=0x7f61fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:22.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:22.899+0000 7f6208ff9640 1 -- 172.21.15.137:0/903497913 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f620c1603e0 con 0x7f620c145980 2024-04-26T22:07:23.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.110+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f620c15c830 con 0x7f620c145980 2024-04-26T22:07:23.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.111+0000 7f6208ff9640 1 -- 172.21.15.137:0/903497913 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+4354 (secure 0 0 0) 0x7f620407c430 con 0x7f620c145980 2024-04-26T22:07:23.111 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:23.111 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":73,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":7168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1497562955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1497562955},{"type":"v1","addr":"172.21.15.170:6835","nonce":1497562955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":73,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:07:22.480375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-26T22:07:23.111 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 73 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f61f806c8f0 msgr2=0x7f61f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f61f806c8f0 0x7f61f806edb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f620c073420 tx=0x7f61fc008040 comp rx=0 tx=0).stop 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c145980 msgr2=0x7f620c0ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c145980 0x7f620c0ae0e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f620402c850 tx=0x7f6204004a40 comp rx=0 tx=0).stop 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 shutdown_connections 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f61f806c8f0 0x7f61f806edb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f620c145980 0x7f620c0ae0e0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f620c0b5fd0 0x7f620c15e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 --2- 172.21.15.137:0/903497913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f620c0b3de0 0x7f620c0afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 >> 172.21.15.137:0/903497913 conn(0x7f620c0d0d30 msgr2=0x7f620c15f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:23.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 shutdown_connections 2024-04-26T22:07:23.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.113+0000 7f6212971640 1 -- 172.21.15.137:0/903497913 wait complete. 2024-04-26T22:07:23.125 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:23.222 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.222+0000 7f7e011f0640 1 Processor -- start 2024-04-26T22:07:23.223 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.222+0000 7f7e011f0640 1 -- start start 2024-04-26T22:07:23.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.223+0000 7f7e011f0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7dfc15d0c0 0x7f7dfc15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.224 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.223+0000 7f7e011f0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7dfc06f590 0x7f7dfc0d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.223+0000 7f7e011f0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dfc160780 con 0x7f7dfc160200 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.223+0000 7f7e011f0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7dfc160a60 con 0x7f7dfc06f590 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.223+0000 7f7e011f0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7dfc0cff90 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.223+0000 7f7dfb59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7dfc06f590 0x7f7dfc0d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.223+0000 7f7df3fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7dfc160200 0x7f7dfc06ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42360/0 (socket says 172.21.15.137:42360) 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.223+0000 7f7df3fff640 1 -- 172.21.15.137:0/1235453 learned_addr learned my addr 172.21.15.137:0/1235453 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.224+0000 7f7dfad9d640 1 --2- 172.21.15.137:0/1235453 >> v2:172.21.15.170:3300/0 conn(0x7f7dfc15d0c0 0x7f7dfc15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.224+0000 7f7dfb59e640 1 -- 172.21.15.137:0/1235453 >> v2:172.21.15.170:3300/0 conn(0x7f7dfc15d0c0 msgr2=0x7f7dfc15fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.224+0000 7f7dfb59e640 1 --2- 172.21.15.137:0/1235453 >> v2:172.21.15.170:3300/0 conn(0x7f7dfc15d0c0 0x7f7dfc15fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.224+0000 7f7dfb59e640 1 -- 172.21.15.137:0/1235453 >> v1:172.21.15.137:6789/0 conn(0x7f7dfc160200 legacy=0x7f7dfc06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.224+0000 7f7dfa59c640 1 -- 172.21.15.137:0/1235453 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864125427 0 0) 0x7f7dfc160780 con 0x7f7dfc160200 2024-04-26T22:07:23.225 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.224+0000 7f7dfb59e640 1 -- 172.21.15.137:0/1235453 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc0d0270 con 0x7f7dfc06f590 2024-04-26T22:07:23.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.224+0000 7f7dfb59e640 1 --2- 172.21.15.137:0/1235453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc06f590 0x7f7dfc0d0790 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc06e840 tx=0x7f7df402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d0246884ceb908 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:23.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7dfa59c640 1 -- 172.21.15.137:0/1235453 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4007740 con 0x7f7dfc06f590 2024-04-26T22:07:23.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7dfa59c640 1 -- 172.21.15.137:0/1235453 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df40078e0 con 0x7f7dfc06f590 2024-04-26T22:07:23.226 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7dfa59c640 1 -- 172.21.15.137:0/1235453 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4007cb0 con 0x7f7dfc06f590 2024-04-26T22:07:23.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7e011f0640 1 -- 172.21.15.137:0/1235453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc06f590 msgr2=0x7f7dfc0d0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7e011f0640 1 --2- 172.21.15.137:0/1235453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc06f590 0x7f7dfc0d0790 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc06e840 tx=0x7f7df402a680 comp rx=0 tx=0).stop 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7e011f0640 1 -- 172.21.15.137:0/1235453 shutdown_connections 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7e011f0640 1 --2- 172.21.15.137:0/1235453 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc06f590 0x7f7dfc0d0790 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7e011f0640 1 --2- 172.21.15.137:0/1235453 >> v2:172.21.15.170:3300/0 conn(0x7f7dfc15d0c0 0x7f7dfc15fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7e011f0640 1 -- 172.21.15.137:0/1235453 >> 172.21.15.137:0/1235453 conn(0x7f7dfc0b3b10 msgr2=0x7f7dfc0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7e011f0640 1 -- 172.21.15.137:0/1235453 shutdown_connections 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.225+0000 7f7e011f0640 1 -- 172.21.15.137:0/1235453 wait complete. 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.226+0000 7f7e011f0640 1 Processor -- start 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.226+0000 7f7e011f0640 1 -- start start 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7e011f0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dfc06f590 0x7f7dfc148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7e011f0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc15d0c0 0x7f7dfc09e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7e011f0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dfc160200 0x7f7dfc0b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7e011f0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc15d620 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7e011f0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc15d4a0 con 0x7f7dfc06f590 2024-04-26T22:07:23.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7e011f0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7dfc0d0cd0 con 0x7f7dfc160200 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7df3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc15d0c0 0x7f7dfc09e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7df3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc15d0c0 0x7f7dfc09e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36148/0 (socket says 172.21.15.137:36148) 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7df3fff640 1 -- 172.21.15.137:0/84294386 learned_addr learned my addr 172.21.15.137:0/84294386 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7dfb59e640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dfc160200 0x7f7dfc0b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.227+0000 7f7dfad9d640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dfc06f590 0x7f7dfc148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7df3fff640 1 -- 172.21.15.137:0/84294386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dfc160200 msgr2=0x7f7dfc0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7df3fff640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dfc160200 0x7f7dfc0b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7df3fff640 1 -- 172.21.15.137:0/84294386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dfc06f590 msgr2=0x7f7dfc148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7df3fff640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dfc06f590 0x7f7dfc148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7df3fff640 1 -- 172.21.15.137:0/84294386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc149160 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7df3fff640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc15d0c0 0x7f7dfc09e350 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f7de400c3c0 tx=0x7f7de400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7df37fe640 1 -- 172.21.15.137:0/84294386 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de40074e0 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7df37fe640 1 -- 172.21.15.137:0/84294386 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de40047e0 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dfc09ed30 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7df37fe640 1 -- 172.21.15.137:0/84294386 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de4004bd0 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.228+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dfc09f2f0 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.229+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dfc0693d0 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.229+0000 7f7df37fe640 1 -- 172.21.15.137:0/84294386 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7de4011070 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.229+0000 7f7df37fe640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ddc06c8f0 0x7f7ddc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.230+0000 7f7df37fe640 1 -- 172.21.15.137:0/84294386 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f7de408b750 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.230+0000 7f7dfad9d640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ddc06c8f0 0x7f7ddc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.230+0000 7f7dfad9d640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ddc06c8f0 0x7f7ddc06edb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7dec006fd0 tx=0x7f7dec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:23.235 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.234+0000 7f7df37fe640 1 -- 172.21.15.137:0/84294386 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7de401a2b0 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.410 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.411+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dfc0b80f0 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.411 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.412+0000 7f7df37fe640 1 -- 172.21.15.137:0/84294386 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+16894 (secure 0 0 0) 0x7f7de4059ad0 con 0x7f7dfc15d0c0 2024-04-26T22:07:23.412 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:23.412 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":105,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:22.480240+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:06:00.152074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-26T22:06:00.894660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6834/1187927282":"2024-04-27T22:07:22.480221+0000","172.21.15.137:6836/1187927282":"2024-04-27T22:07:22.480221+0000","172.21.15.170:6835/2219855149":"2024-04-27T22:06:46.172594+0000","172.21.15.170:6832/2219855149":"2024-04-27T22:06:46.172594+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:23.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ddc06c8f0 msgr2=0x7f7ddc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ddc06c8f0 0x7f7ddc06edb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7dec006fd0 tx=0x7f7dec008040 comp rx=0 tx=0).stop 2024-04-26T22:07:23.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc15d0c0 msgr2=0x7f7dfc09e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc15d0c0 0x7f7dfc09e350 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f7de400c3c0 tx=0x7f7de400c880 comp rx=0 tx=0).stop 2024-04-26T22:07:23.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 shutdown_connections 2024-04-26T22:07:23.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7ddc06c8f0 0x7f7ddc06edb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7dfc15d0c0 0x7f7dfc09e350 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7dfc160200 0x7f7dfc0b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.414 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 --2- 172.21.15.137:0/84294386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dfc06f590 0x7f7dfc148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 >> 172.21.15.137:0/84294386 conn(0x7f7dfc0b3b10 msgr2=0x7f7dfc15dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:23.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 shutdown_connections 2024-04-26T22:07:23.415 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.414+0000 7f7e011f0640 1 -- 172.21.15.137:0/84294386 wait complete. 2024-04-26T22:07:23.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:06:00.152074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:06:00.894660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:07:23.425 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:07:23.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.527+0000 7f227b559640 1 Processor -- start 2024-04-26T22:07:23.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.527+0000 7f227b559640 1 -- start start 2024-04-26T22:07:23.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f227b559640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f22740b5930 0x7f22740cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f227b559640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22740b4890 con 0x7f22740ce450 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f227b559640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22740b4b70 con 0x7f227415d010 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f227b559640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f22740b4e50 con 0x7f22740b5930 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f2278af4640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f22740ce450 0x7f227406c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42370/0 (socket says 172.21.15.137:42370) 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f2278af4640 1 -- 172.21.15.137:0/3467301216 learned_addr learned my addr 172.21.15.137:0/3467301216 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617380015 0 0) 0x7f22740b4890 con 0x7f22740ce450 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f2279af6640 1 --2- 172.21.15.137:0/3467301216 >> v2:172.21.15.170:3300/0 conn(0x7f22740b5930 0x7f22740cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2260003520 con 0x7f22740ce450 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2054291181 0 0) 0x7f2260003520 con 0x7f22740ce450 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 >> v2:172.21.15.170:3300/0 conn(0x7f22740b5930 msgr2=0x7f22740cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 --2- 172.21.15.137:0/3467301216 >> v2:172.21.15.170:3300/0 conn(0x7f22740b5930 0x7f22740cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 >> v1:172.21.15.170:6789/0 conn(0x7f227415d010 legacy=0x7f22740cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22740b5130 con 0x7f22740ce450 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f2264001670 con 0x7f22740ce450 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 >> v1:172.21.15.137:6789/0 conn(0x7f22740ce450 legacy=0x7f227406c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22600039b0 0x7f2260003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2260004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22600051c0 0x7f226000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22740b4e50 con 0x7f2260004800 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f226000c060 con 0x7f22600051c0 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.528+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f226000c260 con 0x7f22600039b0 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f2278af4640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2260004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f2279af6640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22600051c0 0x7f226000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f22792f5640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22600039b0 0x7f2260003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f2278af4640 1 -- 172.21.15.137:0/3467301216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22600039b0 msgr2=0x7f2260003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f2278af4640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22600039b0 0x7f2260003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f2278af4640 1 -- 172.21.15.137:0/3467301216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22600051c0 msgr2=0x7f226000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f2278af4640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22600051c0 0x7f226000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f2279af6640 1 -- 172.21.15.137:0/3467301216 reap_dead start 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f2278af4640 1 -- 172.21.15.137:0/3467301216 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2260003520 con 0x7f2260004800 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f22792f5640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f22600039b0 0x7f2260003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.529+0000 7f2278af4640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2260004c80 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f226400c240 tx=0x7f2260005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ff2fc01934b20f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264007cf0 con 0x7f2260004800 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2264005af0 con 0x7f2260004800 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f226bfff640 1 -- 172.21.15.137:0/3467301216 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264007070 con 0x7f2260004800 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f227b559640 1 -- 172.21.15.137:0/3467301216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 msgr2=0x7f2260004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f227b559640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2260004c80 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f226400c240 tx=0x7f2260005830 comp rx=0 tx=0).stop 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f227b559640 1 -- 172.21.15.137:0/3467301216 shutdown_connections 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f227b559640 1 --2- 172.21.15.137:0/3467301216 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2260004c80 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f227b559640 1 -- 172.21.15.137:0/3467301216 >> 172.21.15.137:0/3467301216 conn(0x7f22740d1660 msgr2=0x7f22740d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f227b559640 1 -- 172.21.15.137:0/3467301216 shutdown_connections 2024-04-26T22:07:23.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.530+0000 7f227b559640 1 -- 172.21.15.137:0/3467301216 wait complete. 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.531+0000 7f227b559640 1 Processor -- start 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.531+0000 7f227b559640 1 -- start start 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f227b559640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2274148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f227b559640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22740aa4a0 0x7f22740aa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f227b559640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2274157420 0x7f22741578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f227b559640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f22740cffb0 con 0x7f2260004800 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f227b559640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f227415d3f0 con 0x7f22740aa4a0 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f227b559640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f22740d0130 con 0x7f2274157420 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f22792f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2274148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f22792f5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2274148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36168/0 (socket says 172.21.15.137:36168) 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f22792f5640 1 -- 172.21.15.137:0/897794032 learned_addr learned my addr 172.21.15.137:0/897794032 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f2278af4640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22740aa4a0 0x7f22740aa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f2279af6640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2274157420 0x7f22741578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f22792f5640 1 -- 172.21.15.137:0/897794032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2274157420 msgr2=0x7f22741578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f22792f5640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2274157420 0x7f22741578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f22792f5640 1 -- 172.21.15.137:0/897794032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22740aa4a0 msgr2=0x7f22740aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f22792f5640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22740aa4a0 0x7f22740aa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.532+0000 7f22792f5640 1 -- 172.21.15.137:0/897794032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227415d570 con 0x7f2260004800 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.533+0000 7f22792f5640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2274148160 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f227000e480 tx=0x7f227000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.533+0000 7f2269ffb640 1 -- 172.21.15.137:0/897794032 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22700052e0 con 0x7f2260004800 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.533+0000 7f2269ffb640 1 -- 172.21.15.137:0/897794032 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2270007020 con 0x7f2260004800 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.533+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227415d810 con 0x7f2260004800 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.533+0000 7f2269ffb640 1 -- 172.21.15.137:0/897794032 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2270007210 con 0x7f2260004800 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.533+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227415ddd0 con 0x7f2260004800 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.534+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2274157de0 con 0x7f2260004800 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.534+0000 7f2269ffb640 1 -- 172.21.15.137:0/897794032 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f227001a020 con 0x7f2260004800 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.535+0000 7f2269ffb640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c920 0x7f225806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.535+0000 7f2278af4640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c920 0x7f225806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.535+0000 7f2269ffb640 1 -- 172.21.15.137:0/897794032 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f227008af90 con 0x7f2260004800 2024-04-26T22:07:23.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.535+0000 7f2278af4640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c920 0x7f225806ede0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2264032000 tx=0x7f2264009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:23.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.539+0000 7f2269ffb640 1 -- 172.21.15.137:0/897794032 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2270058d50 con 0x7f2260004800 2024-04-26T22:07:23.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.712+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f227406a290 con 0x7f2260004800 2024-04-26T22:07:23.713 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.713+0000 7f2269ffb640 1 -- 172.21.15.137:0/897794032 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) ==== 93+0+10 (secure 0 0 0) 0x7f227005d050 con 0x7f2260004800 2024-04-26T22:07:23.713 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:07:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c920 msgr2=0x7f225806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c920 0x7f225806ede0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2264032000 tx=0x7f2264009030 comp rx=0 tx=0).stop 2024-04-26T22:07:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 msgr2=0x7f2274148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2274148160 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f227000e480 tx=0x7f227000e940 comp rx=0 tx=0).stop 2024-04-26T22:07:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 shutdown_connections 2024-04-26T22:07:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c920 0x7f225806ede0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2274157420 0x7f22741578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.715 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22740aa4a0 0x7f22740aa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 --2- 172.21.15.137:0/897794032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2260004800 0x7f2274148160 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 >> 172.21.15.137:0/897794032 conn(0x7f22740d1660 msgr2=0x7f22740b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 shutdown_connections 2024-04-26T22:07:23.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.715+0000 7f227b559640 1 -- 172.21.15.137:0/897794032 wait complete. 2024-04-26T22:07:23.726 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:07:23.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.827+0000 7fded5d40640 1 Processor -- start 2024-04-26T22:07:23.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.827+0000 7fded5d40640 1 -- start start 2024-04-26T22:07:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fded5d40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded0161080 0x7fded01614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fded5d40640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded00cdd40 con 0x7fded0161cb0 2024-04-26T22:07:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fded5d40640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded00cdfe0 con 0x7fded015e7e0 2024-04-26T22:07:23.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fded5d40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fded00d2280 con 0x7fded0161080 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdeceffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fded0161cb0 0x7fded00d1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42382/0 (socket says 172.21.15.137:42382) 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdeceffd640 1 -- 172.21.15.137:0/1211960471 learned_addr learned my addr 172.21.15.137:0/1211960471 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917009751 0 0) 0x7fded00cdd40 con 0x7fded0161cb0 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb8003520 con 0x7fded0161cb0 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdecffff640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded0161080 0x7fded01614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2487302166 0 0) 0x7fdeb8003520 con 0x7fded0161cb0 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded0161080 msgr2=0x7fded01614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded0161080 0x7fded01614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 >> v1:172.21.15.170:6789/0 conn(0x7fded015e7e0 legacy=0x7fded00ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded00ce2c0 con 0x7fded0161cb0 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fdec4001670 con 0x7fded0161cb0 2024-04-26T22:07:23.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 >> v1:172.21.15.137:6789/0 conn(0x7fded0161cb0 legacy=0x7fded00d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded0161080 0x7fdeb80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeb8003f60 0x7fdeb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeb8004d40 0x7fdeb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fded00d2280 con 0x7fdeb8004d40 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb800bb50 con 0x7fdeb8003f60 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb800bd50 con 0x7fded0161080 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.828+0000 7fdecffff640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeb8004d40 0x7fdeb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.829+0000 7fdeceffd640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeb8003f60 0x7fdeb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.829+0000 7fdecf7fe640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded0161080 0x7fdeb80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.829+0000 7fdecffff640 1 -- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded0161080 msgr2=0x7fdeb80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.829+0000 7fdecffff640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded0161080 0x7fdeb80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.829+0000 7fdecffff640 1 -- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeb8003f60 msgr2=0x7fdeb8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.829+0000 7fdecffff640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeb8003f60 0x7fdeb8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.829+0000 7fdecffff640 1 -- 172.21.15.137:0/1211960471 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb8003520 con 0x7fdeb8004d40 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.829+0000 7fdecffff640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeb8004d40 0x7fdeb80051c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009fc0 tx=0x7fdeb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a29979618999a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8009c10 con 0x7fdeb8004d40 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec8036070 con 0x7fdeb8004d40 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fdece7fc640 1 -- 172.21.15.137:0/1211960471 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8031880 con 0x7fdeb8004d40 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fded5d40640 1 -- 172.21.15.137:0/1211960471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeb8004d40 msgr2=0x7fdeb80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fded5d40640 1 --2- 172.21.15.137:0/1211960471 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeb8004d40 0x7fdeb80051c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009fc0 tx=0x7fdeb8005830 comp rx=0 tx=0).stop 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fdecffff640 1 -- 172.21.15.137:0/1211960471 reap_dead start 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fded5d40640 1 -- 172.21.15.137:0/1211960471 shutdown_connections 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fded5d40640 1 -- 172.21.15.137:0/1211960471 >> 172.21.15.137:0/1211960471 conn(0x7fded009ba40 msgr2=0x7fded009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fded5d40640 1 -- 172.21.15.137:0/1211960471 shutdown_connections 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.830+0000 7fded5d40640 1 -- 172.21.15.137:0/1211960471 wait complete. 2024-04-26T22:07:23.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.831+0000 7fded5d40640 1 Processor -- start 2024-04-26T22:07:23.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.831+0000 7fded5d40640 1 -- start start 2024-04-26T22:07:23.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fded5d40640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded0071710 0x7fded00ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fded5d40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00ccc10 0x7fded00cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fded5d40640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded00c5d30 0x7fded00cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fded5d40640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fded00d1f60 con 0x7fded00c5d30 2024-04-26T22:07:23.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fded5d40640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fded00ce880 con 0x7fded0071710 2024-04-26T22:07:23.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fded5d40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fded01614d0 con 0x7fded00ccc10 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fdecffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded00c5d30 0x7fded00cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fdecffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded00c5d30 0x7fded00cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36182/0 (socket says 172.21.15.137:36182) 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fdecffff640 1 -- 172.21.15.137:0/809926303 learned_addr learned my addr 172.21.15.137:0/809926303 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fdecf7fe640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded0071710 0x7fded00ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.832+0000 7fdeceffd640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00ccc10 0x7fded00cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdecffff640 1 -- 172.21.15.137:0/809926303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00ccc10 msgr2=0x7fded00cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdecffff640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00ccc10 0x7fded00cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdecffff640 1 -- 172.21.15.137:0/809926303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded0071710 msgr2=0x7fded00ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdecffff640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded0071710 0x7fded00ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdecffff640 1 -- 172.21.15.137:0/809926303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded00ca5a0 con 0x7fded00c5d30 2024-04-26T22:07:23.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdecf7fe640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded0071710 0x7fded00ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdecffff640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded00c5d30 0x7fded00cbf00 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fdec800e230 tx=0x7fdec8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdeb7fff640 1 -- 172.21.15.137:0/809926303 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8009c10 con 0x7fded00c5d30 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdeb7fff640 1 -- 172.21.15.137:0/809926303 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec8031df0 con 0x7fded00c5d30 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded006d770 con 0x7fded00c5d30 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fdeb7fff640 1 -- 172.21.15.137:0/809926303 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8003bd0 con 0x7fded00c5d30 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.833+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded006dd30 con 0x7fded00c5d30 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.834+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded006a290 con 0x7fded00c5d30 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.834+0000 7fdeb7fff640 1 -- 172.21.15.137:0/809926303 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdec8005d10 con 0x7fded00c5d30 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.835+0000 7fdeb7fff640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdebc06c920 0x7fdebc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.835+0000 7fdeb7fff640 1 -- 172.21.15.137:0/809926303 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7fdec80acf00 con 0x7fded00c5d30 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.835+0000 7fdecf7fe640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdebc06c920 0x7fdebc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:23.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.835+0000 7fdecf7fe640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdebc06c920 0x7fdebc06ede0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdec00036b0 tx=0x7fdec0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:23.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:23.839+0000 7fdeb7fff640 1 -- 172.21.15.137:0/809926303 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdec804a060 con 0x7fded00c5d30 2024-04-26T22:07:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.013+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fded00b8f10 con 0x7fded00c5d30 2024-04-26T22:07:24.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.014+0000 7fdeb7fff640 1 -- 172.21.15.137:0/809926303 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v105) ==== 104+0+11 (secure 0 0 0) 0x7fdec807b1f0 con 0x7fded00c5d30 2024-04-26T22:07:24.014 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:07:24.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdebc06c920 msgr2=0x7fdebc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdebc06c920 0x7fdebc06ede0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdec00036b0 tx=0x7fdec0009040 comp rx=0 tx=0).stop 2024-04-26T22:07:24.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded00c5d30 msgr2=0x7fded00cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded00c5d30 0x7fded00cbf00 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fdec800e230 tx=0x7fdec8009750 comp rx=0 tx=0).stop 2024-04-26T22:07:24.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 shutdown_connections 2024-04-26T22:07:24.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdebc06c920 0x7fdebc06ede0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fded00c5d30 0x7fded00cbf00 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fded00ccc10 0x7fded00cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 --2- 172.21.15.137:0/809926303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fded0071710 0x7fded00ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 >> 172.21.15.137:0/809926303 conn(0x7fded009ba40 msgr2=0x7fded00708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:24.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 shutdown_connections 2024-04-26T22:07:24.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.016+0000 7fded5d40640 1 -- 172.21.15.137:0/809926303 wait complete. 2024-04-26T22:07:24.027 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:07:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.125+0000 7f92042b0640 1 Processor -- start 2024-04-26T22:07:24.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.125+0000 7f92042b0640 1 -- start start 2024-04-26T22:07:24.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.126+0000 7f92042b0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f91fc0b4e00 0x7f91fc0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.126+0000 7f92042b0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91fc15f640 con 0x7f91fc15f260 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.126+0000 7f92042b0640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91fc06c2a0 con 0x7f91fc070560 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.126+0000 7f92042b0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f91fc06c580 con 0x7f91fc0b4e00 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.127+0000 7f920284d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f91fc0b4e00 0x7f91fc0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.127+0000 7f920204c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f91fc15f260 0x7f91fc06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42388/0 (socket says 172.21.15.137:42388) 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.127+0000 7f920204c640 1 -- 172.21.15.137:0/1052940298 learned_addr learned my addr 172.21.15.137:0/1052940298 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.127+0000 7f920284d640 1 -- 172.21.15.137:0/1052940298 >> v1:172.21.15.170:6789/0 conn(0x7f91fc070560 legacy=0x7f91fc0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.127+0000 7f920284d640 1 -- 172.21.15.137:0/1052940298 >> v1:172.21.15.137:6789/0 conn(0x7f91fc15f260 legacy=0x7f91fc06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.127+0000 7f920284d640 1 -- 172.21.15.137:0/1052940298 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc06c860 con 0x7f91fc0b4e00 2024-04-26T22:07:24.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.127+0000 7f920104a640 1 -- 172.21.15.137:0/1052940298 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319991887 0 0) 0x7f91fc15f640 con 0x7f91fc15f260 2024-04-26T22:07:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f920284d640 1 --2- 172.21.15.137:0/1052940298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 0x7f91fc0ae8b0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009d90 tx=0x7f91f402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7881b68935e8e41a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f920104a640 1 -- 172.21.15.137:0/1052940298 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4007740 con 0x7f91fc0b4e00 2024-04-26T22:07:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f920104a640 1 -- 172.21.15.137:0/1052940298 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f40078e0 con 0x7f91fc0b4e00 2024-04-26T22:07:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f920104a640 1 -- 172.21.15.137:0/1052940298 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4007cb0 con 0x7f91fc0b4e00 2024-04-26T22:07:24.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f92042b0640 1 -- 172.21.15.137:0/1052940298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 msgr2=0x7f91fc0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f92042b0640 1 --2- 172.21.15.137:0/1052940298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 0x7f91fc0ae8b0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009d90 tx=0x7f91f402a6f0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f92042b0640 1 -- 172.21.15.137:0/1052940298 shutdown_connections 2024-04-26T22:07:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f92042b0640 1 --2- 172.21.15.137:0/1052940298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 0x7f91fc0ae8b0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f92042b0640 1 -- 172.21.15.137:0/1052940298 >> 172.21.15.137:0/1052940298 conn(0x7f91fc0d1660 msgr2=0x7f91fc0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f92042b0640 1 -- 172.21.15.137:0/1052940298 shutdown_connections 2024-04-26T22:07:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.128+0000 7f92042b0640 1 -- 172.21.15.137:0/1052940298 wait complete. 2024-04-26T22:07:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.129+0000 7f92042b0640 1 Processor -- start 2024-04-26T22:07:24.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f92042b0640 1 -- start start 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f92042b0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91fc070560 0x7f91fc0ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f92042b0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 0x7f91fc0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f92042b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91fc15f260 0x7f91fc0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f92042b0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc06d100 con 0x7f91fc0b4e00 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f92042b0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc06ce20 con 0x7f91fc15f260 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f92042b0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f91fc06ebe0 con 0x7f91fc070560 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f920184b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 0x7f91fc0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f920184b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 0x7f91fc0ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36200/0 (socket says 172.21.15.137:36200) 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f920184b640 1 -- 172.21.15.137:0/691439068 learned_addr learned my addr 172.21.15.137:0/691439068 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f920204c640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91fc070560 0x7f91fc0ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.130+0000 7f920284d640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91fc15f260 0x7f91fc0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f920184b640 1 -- 172.21.15.137:0/691439068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91fc070560 msgr2=0x7f91fc0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f920184b640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91fc070560 0x7f91fc0ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f920184b640 1 -- 172.21.15.137:0/691439068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91fc15f260 msgr2=0x7f91fc0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f920184b640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91fc15f260 0x7f91fc0ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f920184b640 1 -- 172.21.15.137:0/691439068 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc14cda0 con 0x7f91fc0b4e00 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f920284d640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91fc15f260 0x7f91fc0ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f920184b640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 0x7f91fc0ce610 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c430 tx=0x7f91f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f91f2ffd640 1 -- 172.21.15.137:0/691439068 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8017070 con 0x7f91fc0b4e00 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f91f2ffd640 1 -- 172.21.15.137:0/691439068 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f80052d0 con 0x7f91fc0b4e00 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91fc14fb40 con 0x7f91fc0b4e00 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f91f2ffd640 1 -- 172.21.15.137:0/691439068 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f8003830 con 0x7f91fc0b4e00 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.131+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91fc14d320 con 0x7f91fc0b4e00 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.132+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91fc06a290 con 0x7f91fc0b4e00 2024-04-26T22:07:24.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.132+0000 7f91f2ffd640 1 -- 172.21.15.137:0/691439068 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91f801a070 con 0x7f91fc0b4e00 2024-04-26T22:07:24.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.133+0000 7f91f2ffd640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91e006c8f0 0x7f91e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.133+0000 7f91f2ffd640 1 -- 172.21.15.137:0/691439068 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f91f808ae60 con 0x7f91fc0b4e00 2024-04-26T22:07:24.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.133+0000 7f920204c640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91e006c8f0 0x7f91e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.133+0000 7f920204c640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91e006c8f0 0x7f91e006edb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f91ec000f60 tx=0x7f91ec007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:24.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.137+0000 7f91f2ffd640 1 -- 172.21.15.137:0/691439068 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f91f8058c20 con 0x7f91fc0b4e00 2024-04-26T22:07:24.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.312+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f91fc0682b0 con 0x7f91fc0b4e00 2024-04-26T22:07:24.312 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.313+0000 7f91f2ffd640 1 -- 172.21.15.137:0/691439068 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v105) ==== 100+0+11 (secure 0 0 0) 0x7f91f805cf20 con 0x7f91fc0b4e00 2024-04-26T22:07:24.313 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91e006c8f0 msgr2=0x7f91e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91e006c8f0 0x7f91e006edb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f91ec000f60 tx=0x7f91ec007e40 comp rx=0 tx=0).stop 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 msgr2=0x7f91fc0ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 0x7f91fc0ce610 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f91f800c430 tx=0x7f91f800c8f0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 shutdown_connections 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f91e006c8f0 0x7f91e006edb0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f91fc0b4e00 0x7f91fc0ce610 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91fc15f260 0x7f91fc0ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 --2- 172.21.15.137:0/691439068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f91fc070560 0x7f91fc0ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 >> 172.21.15.137:0/691439068 conn(0x7f91fc0d1660 msgr2=0x7f91fc0d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 shutdown_connections 2024-04-26T22:07:24.315 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.315+0000 7f92042b0640 1 -- 172.21.15.137:0/691439068 wait complete. 2024-04-26T22:07:24.326 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:24.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.422+0000 7f418b9f2640 1 Processor -- start 2024-04-26T22:07:24.422 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.422+0000 7f418b9f2640 1 -- start start 2024-04-26T22:07:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f418b9f2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f41840cf2e0 0x7f418406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f418b9f2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41840d1740 con 0x7f41840d11b0 2024-04-26T22:07:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f418b9f2640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41840d1a20 con 0x7f418406e490 2024-04-26T22:07:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f418b9f2640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f41840d1d00 con 0x7f41840cf2e0 2024-04-26T22:07:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f418978e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f41840cf2e0 0x7f418406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f4188f8d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f41840d11b0 0x7f418406dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42398/0 (socket says 172.21.15.137:42398) 2024-04-26T22:07:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f4188f8d640 1 -- 172.21.15.137:0/3201251798 learned_addr learned my addr 172.21.15.137:0/3201251798 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:24.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f418978e640 1 -- 172.21.15.137:0/3201251798 >> v1:172.21.15.170:6789/0 conn(0x7f418406e490 legacy=0x7f418415ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:24.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f418978e640 1 -- 172.21.15.137:0/3201251798 >> v1:172.21.15.137:6789/0 conn(0x7f41840d11b0 legacy=0x7f418406dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f417bfff640 1 -- 172.21.15.137:0/3201251798 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782645184 0 0) 0x7f41840d1740 con 0x7f41840d11b0 2024-04-26T22:07:24.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.423+0000 7f418978e640 1 -- 172.21.15.137:0/3201251798 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41840d1fe0 con 0x7f41840cf2e0 2024-04-26T22:07:24.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.424+0000 7f418978e640 1 --2- 172.21.15.137:0/3201251798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840cf2e0 0x7f418406d4d0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f41800097d0 tx=0x7f418002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949fa622282bcfd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:24.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.424+0000 7f417bfff640 1 -- 172.21.15.137:0/3201251798 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180037070 con 0x7f41840cf2e0 2024-04-26T22:07:24.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.424+0000 7f417bfff640 1 -- 172.21.15.137:0/3201251798 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4180032440 con 0x7f41840cf2e0 2024-04-26T22:07:24.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.424+0000 7f417bfff640 1 -- 172.21.15.137:0/3201251798 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180032810 con 0x7f41840cf2e0 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.425+0000 7f418b9f2640 1 -- 172.21.15.137:0/3201251798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840cf2e0 msgr2=0x7f418406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.425+0000 7f418b9f2640 1 --2- 172.21.15.137:0/3201251798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840cf2e0 0x7f418406d4d0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f41800097d0 tx=0x7f418002a210 comp rx=0 tx=0).stop 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.425+0000 7f418b9f2640 1 -- 172.21.15.137:0/3201251798 shutdown_connections 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.425+0000 7f418b9f2640 1 --2- 172.21.15.137:0/3201251798 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840cf2e0 0x7f418406d4d0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.425+0000 7f418b9f2640 1 -- 172.21.15.137:0/3201251798 >> 172.21.15.137:0/3201251798 conn(0x7f41840b4a60 msgr2=0x7f41840b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.425+0000 7f418b9f2640 1 -- 172.21.15.137:0/3201251798 shutdown_connections 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.425+0000 7f418b9f2640 1 -- 172.21.15.137:0/3201251798 wait complete. 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.426+0000 7f418b9f2640 1 Processor -- start 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.426+0000 7f418b9f2640 1 -- start start 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.426+0000 7f418b9f2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f418406e490 0x7f41841f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.426+0000 7f418b9f2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41840cf2e0 0x7f4184071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.426+0000 7f418b9f2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840d11b0 0x7f4184071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.426+0000 7f418b9f2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f41840cf6c0 con 0x7f41840d11b0 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.426+0000 7f418b9f2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f418406da10 con 0x7f41840cf2e0 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.426+0000 7f418b9f2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f41840cf840 con 0x7f418406e490 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4189f8f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840d11b0 0x7f4184071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4189f8f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840d11b0 0x7f4184071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36218/0 (socket says 172.21.15.137:36218) 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4189f8f640 1 -- 172.21.15.137:0/2026281577 learned_addr learned my addr 172.21.15.137:0/2026281577 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4189f8f640 1 -- 172.21.15.137:0/2026281577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f418406e490 msgr2=0x7f41841f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4189f8f640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f418406e490 0x7f41841f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4189f8f640 1 -- 172.21.15.137:0/2026281577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41840cf2e0 msgr2=0x7f4184071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4189f8f640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41840cf2e0 0x7f4184071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4189f8f640 1 -- 172.21.15.137:0/2026281577 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41840b6370 con 0x7f41840d11b0 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4189f8f640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840d11b0 0x7f4184071960 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b930 tx=0x7f417c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4179ffb640 1 -- 172.21.15.137:0/2026281577 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c019070 con 0x7f41840d11b0 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4179ffb640 1 -- 172.21.15.137:0/2026281577 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c00cb60 con 0x7f41840d11b0 2024-04-26T22:07:24.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41840b6650 con 0x7f41840d11b0 2024-04-26T22:07:24.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f4179ffb640 1 -- 172.21.15.137:0/2026281577 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c014440 con 0x7f41840d11b0 2024-04-26T22:07:24.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.427+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41840b6c10 con 0x7f41840d11b0 2024-04-26T22:07:24.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.428+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418406a290 con 0x7f41840d11b0 2024-04-26T22:07:24.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.429+0000 7f4179ffb640 1 -- 172.21.15.137:0/2026281577 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f417c01c070 con 0x7f41840d11b0 2024-04-26T22:07:24.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.429+0000 7f4179ffb640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f416806c8f0 0x7f416806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.429+0000 7f4179ffb640 1 -- 172.21.15.137:0/2026281577 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f417c08b7d0 con 0x7f41840d11b0 2024-04-26T22:07:24.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.429+0000 7f418978e640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f416806c8f0 0x7f416806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.430+0000 7f418978e640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f416806c8f0 0x7f416806edb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4180034000 tx=0x7f418002c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:24.433 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.433+0000 7f4179ffb640 1 -- 172.21.15.137:0/2026281577 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f417c059500 con 0x7f41840d11b0 2024-04-26T22:07:24.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.645+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41840b8ef0 con 0x7f41840d11b0 2024-04-26T22:07:24.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.646+0000 7f4179ffb640 1 -- 172.21.15.137:0/2026281577 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5182 (secure 0 0 0) 0x7f417c05d800 con 0x7f41840d11b0 2024-04-26T22:07:24.646 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:24.646 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":74,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":7168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1497562955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1497562955},{"type":"v1","addr":"172.21.15.170:6835","nonce":1497562955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2702617920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2702617920},{"type":"v1","addr":"172.21.15.137:6836","nonce":2702617920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":73,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:07:22.480375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-26T22:07:24.646 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 74 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f416806c8f0 msgr2=0x7f416806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f416806c8f0 0x7f416806edb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4180034000 tx=0x7f418002c000 comp rx=0 tx=0).stop 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840d11b0 msgr2=0x7f4184071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840d11b0 0x7f4184071960 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f417c00b930 tx=0x7f417c00bdf0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 shutdown_connections 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f416806c8f0 0x7f416806edb0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f41840d11b0 0x7f4184071960 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41840cf2e0 0x7f4184071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 --2- 172.21.15.137:0/2026281577 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f418406e490 0x7f41841f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 >> 172.21.15.137:0/2026281577 conn(0x7f41840b4a60 msgr2=0x7f41840b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:24.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 shutdown_connections 2024-04-26T22:07:24.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.648+0000 7f418b9f2640 1 -- 172.21.15.137:0/2026281577 wait complete. 2024-04-26T22:07:24.659 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.754+0000 7f452915f640 1 Processor -- start 2024-04-26T22:07:24.754 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.754+0000 7f452915f640 1 -- start start 2024-04-26T22:07:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452915f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f45240d3ee0 0x7f45240cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452915f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f452415f750 0x7f45240b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452915f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45240d03a0 con 0x7f452415f370 2024-04-26T22:07:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452915f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f45240b4d10 con 0x7f452415f750 2024-04-26T22:07:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452915f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f45240d0680 con 0x7f45240d3ee0 2024-04-26T22:07:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452359e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f452415f750 0x7f45240b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.756 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452359e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f452415f750 0x7f45240b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36222/0 (socket says 172.21.15.137:36222) 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452359e640 1 -- 172.21.15.137:0/1998449777 learned_addr learned my addr 172.21.15.137:0/1998449777 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452259c640 1 --2- 172.21.15.137:0/1998449777 >> v2:172.21.15.170:3300/0 conn(0x7f45240d3ee0 0x7f45240cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452359e640 1 -- 172.21.15.137:0/1998449777 >> v2:172.21.15.170:3300/0 conn(0x7f45240d3ee0 msgr2=0x7f45240cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452359e640 1 --2- 172.21.15.137:0/1998449777 >> v2:172.21.15.170:3300/0 conn(0x7f45240d3ee0 0x7f45240cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452359e640 1 -- 172.21.15.137:0/1998449777 >> v1:172.21.15.170:6789/0 conn(0x7f452415f370 legacy=0x7f45240d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.755+0000 7f452359e640 1 -- 172.21.15.137:0/1998449777 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45240d0960 con 0x7f452415f750 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.756+0000 7f452359e640 1 --2- 172.21.15.137:0/1998449777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452415f750 0x7f45240b47d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f451c009870 tx=0x7f451c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9ea30a9f4cd08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.756+0000 7f4521d9b640 1 -- 172.21.15.137:0/1998449777 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c037070 con 0x7f452415f750 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.756+0000 7f4521d9b640 1 -- 172.21.15.137:0/1998449777 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451c032440 con 0x7f452415f750 2024-04-26T22:07:24.757 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.756+0000 7f4521d9b640 1 -- 172.21.15.137:0/1998449777 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c032810 con 0x7f452415f750 2024-04-26T22:07:24.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.757+0000 7f452915f640 1 -- 172.21.15.137:0/1998449777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452415f750 msgr2=0x7f45240b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.757+0000 7f452915f640 1 --2- 172.21.15.137:0/1998449777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452415f750 0x7f45240b47d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f451c009870 tx=0x7f451c02a270 comp rx=0 tx=0).stop 2024-04-26T22:07:24.758 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.757+0000 7f452915f640 1 -- 172.21.15.137:0/1998449777 shutdown_connections 2024-04-26T22:07:24.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.757+0000 7f452915f640 1 --2- 172.21.15.137:0/1998449777 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f452415f750 0x7f45240b47d0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.757+0000 7f452915f640 1 --2- 172.21.15.137:0/1998449777 >> v2:172.21.15.170:3300/0 conn(0x7f45240d3ee0 0x7f45240cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.757+0000 7f452915f640 1 -- 172.21.15.137:0/1998449777 >> 172.21.15.137:0/1998449777 conn(0x7f452408ec10 msgr2=0x7f452409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:24.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.757+0000 7f452915f640 1 -- 172.21.15.137:0/1998449777 shutdown_connections 2024-04-26T22:07:24.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.757+0000 7f452915f640 1 -- 172.21.15.137:0/1998449777 wait complete. 2024-04-26T22:07:24.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.758+0000 7f452915f640 1 Processor -- start 2024-04-26T22:07:24.759 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.758+0000 7f452915f640 1 -- start start 2024-04-26T22:07:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f452915f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45240d3ee0 0x7f45240ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f452915f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452415f370 0x7f452415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f452915f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452415f750 0x7f45240cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f452915f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f45240b51c0 con 0x7f45240d3ee0 2024-04-26T22:07:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f452915f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f45240d0f20 con 0x7f452415f370 2024-04-26T22:07:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f452915f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f45240b5340 con 0x7f452415f750 2024-04-26T22:07:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f4522d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45240d3ee0 0x7f45240ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f4522d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45240d3ee0 0x7f45240ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36232/0 (socket says 172.21.15.137:36232) 2024-04-26T22:07:24.761 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f4522d9d640 1 -- 172.21.15.137:0/2805896704 learned_addr learned my addr 172.21.15.137:0/2805896704 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f452259c640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452415f370 0x7f452415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f452359e640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452415f750 0x7f45240cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f4522d9d640 1 -- 172.21.15.137:0/2805896704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452415f750 msgr2=0x7f45240cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f4522d9d640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452415f750 0x7f45240cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f4522d9d640 1 -- 172.21.15.137:0/2805896704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452415f370 msgr2=0x7f452415e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f4522d9d640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452415f370 0x7f452415e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.759+0000 7f4522d9d640 1 -- 172.21.15.137:0/2805896704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45240cd630 con 0x7f45240d3ee0 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.760+0000 7f4522d9d640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45240d3ee0 0x7f45240ce3f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f451400c7c0 tx=0x7f451400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.760+0000 7f450b7fe640 1 -- 172.21.15.137:0/2805896704 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514016020 con 0x7f45240d3ee0 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.760+0000 7f450b7fe640 1 -- 172.21.15.137:0/2805896704 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451400aa50 con 0x7f45240d3ee0 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.760+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45240cd910 con 0x7f45240d3ee0 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.760+0000 7f450b7fe640 1 -- 172.21.15.137:0/2805896704 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514012420 con 0x7f45240d3ee0 2024-04-26T22:07:24.762 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.760+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452415e5e0 con 0x7f45240d3ee0 2024-04-26T22:07:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.761+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4524162ea0 con 0x7f45240d3ee0 2024-04-26T22:07:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.761+0000 7f450b7fe640 1 -- 172.21.15.137:0/2805896704 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4514019020 con 0x7f45240d3ee0 2024-04-26T22:07:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.762+0000 7f450b7fe640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f451006c920 0x7f451006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.762+0000 7f452259c640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f451006c920 0x7f451006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.762+0000 7f450b7fe640 1 -- 172.21.15.137:0/2805896704 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f451408b7b0 con 0x7f45240d3ee0 2024-04-26T22:07:24.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.762+0000 7f452259c640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f451006c920 0x7f451006ede0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f452406e250 tx=0x7f4518008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:24.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.766+0000 7f450b7fe640 1 -- 172.21.15.137:0/2805896704 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4514020070 con 0x7f45240d3ee0 2024-04-26T22:07:24.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.943+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f452406a290 con 0x7f45240d3ee0 2024-04-26T22:07:24.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.944+0000 7f450b7fe640 1 -- 172.21.15.137:0/2805896704 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+16894 (secure 0 0 0) 0x7f45140594e0 con 0x7f45240d3ee0 2024-04-26T22:07:24.944 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:24.945 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":105,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:22.480240+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:06:00.152074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-26T22:06:00.894660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6834/1187927282":"2024-04-27T22:07:22.480221+0000","172.21.15.137:6836/1187927282":"2024-04-27T22:07:22.480221+0000","172.21.15.170:6835/2219855149":"2024-04-27T22:06:46.172594+0000","172.21.15.170:6832/2219855149":"2024-04-27T22:06:46.172594+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:24.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f451006c920 msgr2=0x7f451006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f451006c920 0x7f451006ede0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f452406e250 tx=0x7f4518008040 comp rx=0 tx=0).stop 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45240d3ee0 msgr2=0x7f45240ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45240d3ee0 0x7f45240ce3f0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f451400c7c0 tx=0x7f451400cc80 comp rx=0 tx=0).stop 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 shutdown_connections 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f451006c920 0x7f451006ede0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f452415f750 0x7f45240cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f452415f370 0x7f452415e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 --2- 172.21.15.137:0/2805896704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f45240d3ee0 0x7f45240ce3f0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 >> 172.21.15.137:0/2805896704 conn(0x7f452408ec10 msgr2=0x7f452409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 shutdown_connections 2024-04-26T22:07:24.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:24.946+0000 7f452915f640 1 -- 172.21.15.137:0/2805896704 wait complete. 2024-04-26T22:07:24.958 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:07:24.958 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:25.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.055+0000 7f27e250a640 1 Processor -- start 2024-04-26T22:07:25.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.055+0000 7f27e250a640 1 -- start start 2024-04-26T22:07:25.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27e250a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc0b47d0 0x7f27dc0b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27e250a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f27dc0afe30 0x7f27dc0b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27e250a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27dc0aed90 con 0x7f27dc15f4a0 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27e250a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f27dc15f880 con 0x7f27dc0afe30 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27e250a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27dc0af9a0 con 0x7f27dc0b47d0 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27dbfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f27dc15f4a0 0x7f27dc0b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:42414/0 (socket says 172.21.15.137:42414) 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27dbfff640 1 -- 172.21.15.137:0/2314357297 learned_addr learned my addr 172.21.15.137:0/2314357297 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27e0aa7640 1 --2- 172.21.15.137:0/2314357297 >> v2:172.21.15.170:3300/0 conn(0x7f27dc0afe30 0x7f27dc0b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27db7fe640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc0b47d0 0x7f27dc0b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592158267 0 0) 0x7f27dc0aed90 con 0x7f27dc15f4a0 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27c4003520 con 0x7f27dc15f4a0 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2781447675 0 0) 0x7f27c4003520 con 0x7f27dc15f4a0 2024-04-26T22:07:25.059 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc0b47d0 msgr2=0x7f27dc0b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc0b47d0 0x7f27dc0b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 >> v2:172.21.15.170:3300/0 conn(0x7f27dc0afe30 msgr2=0x7f27dc0b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 --2- 172.21.15.137:0/2314357297 >> v2:172.21.15.170:3300/0 conn(0x7f27dc0afe30 0x7f27dc0b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc0af070 con 0x7f27dc15f4a0 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f27cc001670 con 0x7f27dc15f4a0 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 >> v1:172.21.15.137:6789/0 conn(0x7f27dc15f4a0 legacy=0x7f27dc0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c40039b0 0x7f27c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.056+0000 7f27daffd640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc0b47d0 0x7f27c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc15f880 con 0x7f27c4004800 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc0af9a0 con 0x7f27c40039b0 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27c400b9c0 con 0x7f27dc0b47d0 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27db7fe640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27dbfff640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c40039b0 0x7f27c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27e0aa7640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc0b47d0 0x7f27c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27db7fe640 1 -- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc0b47d0 msgr2=0x7f27c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27db7fe640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc0b47d0 0x7f27c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27db7fe640 1 -- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c40039b0 msgr2=0x7f27c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27db7fe640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27c40039b0 0x7f27c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27db7fe640 1 -- 172.21.15.137:0/2314357297 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c4003520 con 0x7f27c4004800 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.057+0000 7f27e0aa7640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc0b47d0 0x7f27c40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27db7fe640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27c4004c80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009ac0 tx=0x7f27c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3461c9a7ae75b9f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0036070 con 0x7f27c4004800 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d0031400 con 0x7f27c4004800 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27daffd640 1 -- 172.21.15.137:0/2314357297 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0009690 con 0x7f27c4004800 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27e250a640 1 -- 172.21.15.137:0/2314357297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 msgr2=0x7f27c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27e250a640 1 --2- 172.21.15.137:0/2314357297 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27c4004c80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009ac0 tx=0x7f27c4005830 comp rx=0 tx=0).stop 2024-04-26T22:07:25.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27e0aa7640 1 -- 172.21.15.137:0/2314357297 reap_dead start 2024-04-26T22:07:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27e250a640 1 -- 172.21.15.137:0/2314357297 shutdown_connections 2024-04-26T22:07:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27e250a640 1 -- 172.21.15.137:0/2314357297 >> 172.21.15.137:0/2314357297 conn(0x7f27dc0b6800 msgr2=0x7f27dc0738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27e250a640 1 -- 172.21.15.137:0/2314357297 shutdown_connections 2024-04-26T22:07:25.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.058+0000 7f27e250a640 1 -- 172.21.15.137:0/2314357297 wait complete. 2024-04-26T22:07:25.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.059+0000 7f27e250a640 1 Processor -- start 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27e250a640 1 -- start start 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27e250a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27dc09b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27e250a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc09dec0 0x7f27dc14c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27e250a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27dc09e340 0x7f27dc14c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27e250a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc0aea80 con 0x7f27c4004800 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27e250a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27dc0af630 con 0x7f27dc09e340 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27e250a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27dc0b6320 con 0x7f27dc09dec0 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27dbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27dc09b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27dbfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27dc09b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36250/0 (socket says 172.21.15.137:36250) 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27dbfff640 1 -- 172.21.15.137:0/1064371713 learned_addr learned my addr 172.21.15.137:0/1064371713 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27db7fe640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc09dec0 0x7f27dc14c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.060+0000 7f27e0aa7640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27dc09e340 0x7f27dc14c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27dbfff640 1 -- 172.21.15.137:0/1064371713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc09dec0 msgr2=0x7f27dc14c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27dbfff640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc09dec0 0x7f27dc14c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27dbfff640 1 -- 172.21.15.137:0/1064371713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27dc09e340 msgr2=0x7f27dc14c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27dbfff640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27dc09e340 0x7f27dc14c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27dbfff640 1 -- 172.21.15.137:0/1064371713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27dc15dc40 con 0x7f27c4004800 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27dbfff640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27dc09b410 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0072c0 tx=0x7f27cc007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27d8ff9640 1 -- 172.21.15.137:0/1064371713 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00f940 con 0x7f27c4004800 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27d8ff9640 1 -- 172.21.15.137:0/1064371713 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27cc018070 con 0x7f27c4004800 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27dc15d0c0 con 0x7f27c4004800 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27d8ff9640 1 -- 172.21.15.137:0/1064371713 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00fd20 con 0x7f27c4004800 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.061+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27dc15d680 con 0x7f27c4004800 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.062+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27dc06a290 con 0x7f27c4004800 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.062+0000 7f27d8ff9640 1 -- 172.21.15.137:0/1064371713 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27cc01d460 con 0x7f27c4004800 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.063+0000 7f27d8ff9640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.063+0000 7f27d8ff9640 1 -- 172.21.15.137:0/1064371713 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f27cc08bba0 con 0x7f27c4004800 2024-04-26T22:07:25.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.063+0000 7f27db7fe640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.063+0000 7f27db7fe640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f27d0033000 tx=0x7f27d0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:25.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.067+0000 7f27d8ff9640 1 -- 172.21.15.137:0/1064371713 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f27cc0598d0 con 0x7f27c4004800 2024-04-26T22:07:25.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.278+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27dc0743e0 con 0x7f27c4004800 2024-04-26T22:07:25.278 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.278+0000 7f27d8ff9640 1 -- 172.21.15.137:0/1064371713 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5182 (secure 0 0 0) 0x7f27cc05dbd0 con 0x7f27c4004800 2024-04-26T22:07:25.280 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:25.280 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":74,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":7168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1497562955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1497562955},{"type":"v1","addr":"172.21.15.170:6835","nonce":1497562955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2702617920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2702617920},{"type":"v1","addr":"172.21.15.137:6836","nonce":2702617920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":73,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:07:22.480375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 74 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 msgr2=0x7f27c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f27d0033000 tx=0x7f27d0008030 comp rx=0 tx=0).stop 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 msgr2=0x7f27dc09b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27dc09b410 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0072c0 tx=0x7f27cc007780 comp rx=0 tx=0).stop 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 shutdown_connections 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27dc09e340 0x7f27dc14c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27dc09dec0 0x7f27dc14c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 --2- 172.21.15.137:0/1064371713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27c4004800 0x7f27dc09b410 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.281 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.280+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 >> 172.21.15.137:0/1064371713 conn(0x7f27dc0b6800 msgr2=0x7f27dc161040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:25.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.281+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 shutdown_connections 2024-04-26T22:07:25.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.281+0000 7f27e250a640 1 -- 172.21.15.137:0/1064371713 wait complete. 2024-04-26T22:07:25.292 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:25.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.388+0000 7f4913396640 1 Processor -- start 2024-04-26T22:07:25.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.388+0000 7f4913396640 1 -- start start 2024-04-26T22:07:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.389+0000 7f4913396640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f490c09c400 0x7f490c0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.389+0000 7f4913396640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f490c070520 0x7f490c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.389+0000 7f4913396640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f490c0d14c0 con 0x7f490c070d20 2024-04-26T22:07:25.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.389+0000 7f4913396640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f490c0d1290 con 0x7f490c070520 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.389+0000 7f4913396640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f490c0d1760 con 0x7f490c09c400 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.389+0000 7f4911933640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f490c070520 0x7f490c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.389+0000 7f4911933640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f490c070520 0x7f490c0cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36260/0 (socket says 172.21.15.137:36260) 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.389+0000 7f4911933640 1 -- 172.21.15.137:0/742260718 learned_addr learned my addr 172.21.15.137:0/742260718 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.390+0000 7f4910931640 1 --2- 172.21.15.137:0/742260718 >> v2:172.21.15.170:3300/0 conn(0x7f490c09c400 0x7f490c0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.390+0000 7f4911933640 1 -- 172.21.15.137:0/742260718 >> v2:172.21.15.170:3300/0 conn(0x7f490c09c400 msgr2=0x7f490c0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.390+0000 7f4911933640 1 --2- 172.21.15.137:0/742260718 >> v2:172.21.15.170:3300/0 conn(0x7f490c09c400 0x7f490c0cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.390+0000 7f4911933640 1 -- 172.21.15.137:0/742260718 >> v1:172.21.15.170:6789/0 conn(0x7f490c070d20 legacy=0x7f490c071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.390+0000 7f4911933640 1 -- 172.21.15.137:0/742260718 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c0d1a40 con 0x7f490c070520 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.390+0000 7f4910931640 1 --2- 172.21.15.137:0/742260718 >> v2:172.21.15.170:3300/0 conn(0x7f490c09c400 0x7f490c0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.390+0000 7f4911933640 1 --2- 172.21.15.137:0/742260718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c070520 0x7f490c0cdae0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f490c0d0cb0 tx=0x7f490402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44328f4f965d4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.390+0000 7f4903fff640 1 -- 172.21.15.137:0/742260718 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904037070 con 0x7f490c070520 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4903fff640 1 -- 172.21.15.137:0/742260718 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4904032440 con 0x7f490c070520 2024-04-26T22:07:25.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4903fff640 1 -- 172.21.15.137:0/742260718 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904032810 con 0x7f490c070520 2024-04-26T22:07:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4913396640 1 -- 172.21.15.137:0/742260718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c070520 msgr2=0x7f490c0cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4913396640 1 --2- 172.21.15.137:0/742260718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c070520 0x7f490c0cdae0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f490c0d0cb0 tx=0x7f490402a230 comp rx=0 tx=0).stop 2024-04-26T22:07:25.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4913396640 1 -- 172.21.15.137:0/742260718 shutdown_connections 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4913396640 1 --2- 172.21.15.137:0/742260718 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c070520 0x7f490c0cdae0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4913396640 1 --2- 172.21.15.137:0/742260718 >> v2:172.21.15.170:3300/0 conn(0x7f490c09c400 0x7f490c0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4913396640 1 -- 172.21.15.137:0/742260718 >> 172.21.15.137:0/742260718 conn(0x7f490c0b4a40 msgr2=0x7f490c0b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4913396640 1 -- 172.21.15.137:0/742260718 shutdown_connections 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.391+0000 7f4913396640 1 -- 172.21.15.137:0/742260718 wait complete. 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.392+0000 7f4913396640 1 Processor -- start 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.392+0000 7f4913396640 1 -- start start 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4913396640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f490c070520 0x7f490c158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4913396640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f490c070d20 0x7f490c0b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4913396640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c09c400 0x7f490c0b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4913396640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f490c0cf350 con 0x7f490c09c400 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4913396640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f490c0d2000 con 0x7f490c070520 2024-04-26T22:07:25.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4913396640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f490c0d2520 con 0x7f490c070d20 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4911933640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c09c400 0x7f490c0b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4911933640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c09c400 0x7f490c0b0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36262/0 (socket says 172.21.15.137:36262) 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4911933640 1 -- 172.21.15.137:0/856056116 learned_addr learned my addr 172.21.15.137:0/856056116 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4911132640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f490c070520 0x7f490c158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.393+0000 7f4910931640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f490c070d20 0x7f490c0b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4911933640 1 -- 172.21.15.137:0/856056116 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f490c070d20 msgr2=0x7f490c0b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4911933640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f490c070d20 0x7f490c0b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4911933640 1 -- 172.21.15.137:0/856056116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f490c070520 msgr2=0x7f490c158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4911933640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f490c070520 0x7f490c158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4911933640 1 -- 172.21.15.137:0/856056116 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f490c0b7760 con 0x7f490c09c400 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4911132640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f490c070520 0x7f490c158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4911933640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c09c400 0x7f490c0b0ee0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f49040090b0 tx=0x7f49040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:25.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4901ffb640 1 -- 172.21.15.137:0/856056116 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904041070 con 0x7f490c09c400 2024-04-26T22:07:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4901ffb640 1 -- 172.21.15.137:0/856056116 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490403c950 con 0x7f490c09c400 2024-04-26T22:07:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f490c0b7a40 con 0x7f490c09c400 2024-04-26T22:07:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4901ffb640 1 -- 172.21.15.137:0/856056116 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4904037040 con 0x7f490c09c400 2024-04-26T22:07:25.397 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.394+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f490c0b8000 con 0x7f490c09c400 2024-04-26T22:07:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.395+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f490c0693d0 con 0x7f490c09c400 2024-04-26T22:07:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.395+0000 7f4901ffb640 1 -- 172.21.15.137:0/856056116 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4904044070 con 0x7f490c09c400 2024-04-26T22:07:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.396+0000 7f4901ffb640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48f006c8f0 0x7f48f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.396+0000 7f4901ffb640 1 -- 172.21.15.137:0/856056116 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f49040ac830 con 0x7f490c09c400 2024-04-26T22:07:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.396+0000 7f4911132640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48f006c8f0 0x7f48f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.396+0000 7f4911132640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48f006c8f0 0x7f48f006edb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4908009fc0 tx=0x7f4908009550 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:25.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.400+0000 7f4901ffb640 1 -- 172.21.15.137:0/856056116 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f490407acd0 con 0x7f490c09c400 2024-04-26T22:07:25.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.611+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f490c074880 con 0x7f490c09c400 2024-04-26T22:07:25.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.612+0000 7f4901ffb640 1 -- 172.21.15.137:0/856056116 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5182 (secure 0 0 0) 0x7f490407a5d0 con 0x7f490c09c400 2024-04-26T22:07:25.612 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:25.612 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":74,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":7168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1497562955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1497562955},{"type":"v1","addr":"172.21.15.170:6835","nonce":1497562955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2702617920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2702617920},{"type":"v1","addr":"172.21.15.137:6836","nonce":2702617920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":73,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:06:01.940531+0000","modified":"2024-04-26T22:07:22.480375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":7}]} 2024-04-26T22:07:25.612 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 74 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48f006c8f0 msgr2=0x7f48f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48f006c8f0 0x7f48f006edb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4908009fc0 tx=0x7f4908009550 comp rx=0 tx=0).stop 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c09c400 msgr2=0x7f490c0b0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c09c400 0x7f490c0b0ee0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f49040090b0 tx=0x7f49040046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 shutdown_connections 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f48f006c8f0 0x7f48f006edb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f490c09c400 0x7f490c0b0ee0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f490c070d20 0x7f490c0b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 --2- 172.21.15.137:0/856056116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f490c070520 0x7f490c158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 >> 172.21.15.137:0/856056116 conn(0x7f490c0b4a40 msgr2=0x7f490c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 shutdown_connections 2024-04-26T22:07:25.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.614+0000 7f4913396640 1 -- 172.21.15.137:0/856056116 wait complete. 2024-04-26T22:07:25.625 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:25.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.722+0000 7fc99d922640 1 Processor -- start 2024-04-26T22:07:25.722 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.722+0000 7fc99d922640 1 -- start start 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc99d922640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc9980d3ee0 0x7fc9980cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc99d922640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc99815f750 0x7fc9980b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc99d922640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9980d03a0 con 0x7fc99815f370 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc99d922640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc9980b4d10 con 0x7fc9980d3ee0 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc99d922640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc9980d0680 con 0x7fc99815f750 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc98ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc9980d3ee0 0x7fc9980cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc98ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc9980d3ee0 0x7fc9980cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40432/0 (socket says 172.21.15.137:40432) 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc98ffff640 1 -- 172.21.15.137:0/182358412 learned_addr learned my addr 172.21.15.137:0/182358412 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc996ffd640 1 --1- 172.21.15.137:0/182358412 >> v1:172.21.15.137:6789/0 conn(0x7fc99815f370 0x7fc9980d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39808/0 (socket says 172.21.15.137:39808) 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc9977fe640 1 --2- 172.21.15.137:0/182358412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc99815f750 0x7fc9980b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc98ffff640 1 -- 172.21.15.137:0/182358412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc99815f750 msgr2=0x7fc9980b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:25.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc98ffff640 1 --2- 172.21.15.137:0/182358412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc99815f750 0x7fc9980b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc98ffff640 1 -- 172.21.15.137:0/182358412 >> v1:172.21.15.137:6789/0 conn(0x7fc99815f370 legacy=0x7fc9980d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc9967fc640 1 -- 172.21.15.137:0/182358412 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132064216 0 0) 0x7fc9980d03a0 con 0x7fc99815f370 2024-04-26T22:07:25.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.723+0000 7fc98ffff640 1 -- 172.21.15.137:0/182358412 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9980d0960 con 0x7fc9980d3ee0 2024-04-26T22:07:25.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.724+0000 7fc98ffff640 1 --2- 172.21.15.137:0/182358412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980d3ee0 0x7fc9980cfd70 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fc980009870 tx=0x7fc98002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d9348460a9654d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:25.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.724+0000 7fc9967fc640 1 -- 172.21.15.137:0/182358412 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980037070 con 0x7fc9980d3ee0 2024-04-26T22:07:25.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.724+0000 7fc9967fc640 1 -- 172.21.15.137:0/182358412 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc980032440 con 0x7fc9980d3ee0 2024-04-26T22:07:25.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.724+0000 7fc9967fc640 1 -- 172.21.15.137:0/182358412 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980032810 con 0x7fc9980d3ee0 2024-04-26T22:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.725+0000 7fc99d922640 1 -- 172.21.15.137:0/182358412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980d3ee0 msgr2=0x7fc9980cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.725+0000 7fc99d922640 1 --2- 172.21.15.137:0/182358412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980d3ee0 0x7fc9980cfd70 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fc980009870 tx=0x7fc98002a270 comp rx=0 tx=0).stop 2024-04-26T22:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.725+0000 7fc99d922640 1 -- 172.21.15.137:0/182358412 shutdown_connections 2024-04-26T22:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.725+0000 7fc99d922640 1 --2- 172.21.15.137:0/182358412 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc99815f750 0x7fc9980b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.725+0000 7fc99d922640 1 --2- 172.21.15.137:0/182358412 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc9980d3ee0 0x7fc9980cfd70 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.725+0000 7fc99d922640 1 -- 172.21.15.137:0/182358412 >> 172.21.15.137:0/182358412 conn(0x7fc99808ec10 msgr2=0x7fc99809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.725+0000 7fc99d922640 1 -- 172.21.15.137:0/182358412 shutdown_connections 2024-04-26T22:07:25.730 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.725+0000 7fc99d922640 1 -- 172.21.15.137:0/182358412 wait complete. 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.726+0000 7fc99d922640 1 Processor -- start 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.726+0000 7fc99d922640 1 -- start start 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.726+0000 7fc99d922640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9980d3ee0 0x7fc9980ba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc99d922640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99815f370 0x7fc99806de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc99d922640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc99815f750 0x7fc998152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc99d922640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980b51c0 con 0x7fc99815f750 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc99d922640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc9980d0f20 con 0x7fc99815f370 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc99d922640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc9980b5340 con 0x7fc9980d3ee0 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc9977fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc99815f750 0x7fc998152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc9977fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc99815f750 0x7fc998152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40446/0 (socket says 172.21.15.137:40446) 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc9977fe640 1 -- 172.21.15.137:0/4077275358 learned_addr learned my addr 172.21.15.137:0/4077275358 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc996ffd640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9980d3ee0 0x7fc9980ba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc9977fe640 1 -- 172.21.15.137:0/4077275358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9980d3ee0 msgr2=0x7fc9980ba8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc9977fe640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9980d3ee0 0x7fc9980ba8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.731 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc9977fe640 1 -- 172.21.15.137:0/4077275358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99815f370 msgr2=0x7fc99806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc9977fe640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99815f370 0x7fc99806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc9977fe640 1 -- 172.21.15.137:0/4077275358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9980cc780 con 0x7fc99815f750 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc9977fe640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc99815f750 0x7fc998152cd0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fc990007e60 tx=0x7fc99000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc994ff9640 1 -- 172.21.15.137:0/4077275358 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990014420 con 0x7fc99815f750 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc994ff9640 1 -- 172.21.15.137:0/4077275358 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc990019070 con 0x7fc99815f750 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9980cca60 con 0x7fc99815f750 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc994ff9640 1 -- 172.21.15.137:0/4077275358 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990014820 con 0x7fc99815f750 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.727+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9980cd020 con 0x7fc99815f750 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.728+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99806a290 con 0x7fc99815f750 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.729+0000 7fc994ff9640 1 -- 172.21.15.137:0/4077275358 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9900149c0 con 0x7fc99815f750 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.729+0000 7fc994ff9640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc97806c8f0 0x7fc97806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.729+0000 7fc994ff9640 1 -- 172.21.15.137:0/4077275358 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7fc99008c480 con 0x7fc99815f750 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.729+0000 7fc996ffd640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc97806c8f0 0x7fc97806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:25.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.729+0000 7fc996ffd640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc97806c8f0 0x7fc97806edb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc988007fd0 tx=0x7fc988009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:25.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.733+0000 7fc994ff9640 1 -- 172.21.15.137:0/4077275358 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc99005a800 con 0x7fc99815f750 2024-04-26T22:07:25.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.910+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc99806d1a0 con 0x7fc99815f750 2024-04-26T22:07:25.911 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.911+0000 7fc994ff9640 1 -- 172.21.15.137:0/4077275358 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+16894 (secure 0 0 0) 0x7fc99005a100 con 0x7fc99815f750 2024-04-26T22:07:25.911 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:25.911 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":105,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:22.480240+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:06:00.152074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-26T22:06:00.894660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6834/1187927282":"2024-04-27T22:07:22.480221+0000","172.21.15.137:6836/1187927282":"2024-04-27T22:07:22.480221+0000","172.21.15.170:6835/2219855149":"2024-04-27T22:06:46.172594+0000","172.21.15.170:6832/2219855149":"2024-04-27T22:06:46.172594+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:25.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc97806c8f0 msgr2=0x7fc97806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc97806c8f0 0x7fc97806edb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc988007fd0 tx=0x7fc988009040 comp rx=0 tx=0).stop 2024-04-26T22:07:25.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc99815f750 msgr2=0x7fc998152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:25.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc99815f750 0x7fc998152cd0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fc990007e60 tx=0x7fc99000e4b0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.913 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 shutdown_connections 2024-04-26T22:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc97806c8f0 0x7fc97806edb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc99815f750 0x7fc998152cd0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99815f370 0x7fc99806de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 --2- 172.21.15.137:0/4077275358 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc9980d3ee0 0x7fc9980ba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 >> 172.21.15.137:0/4077275358 conn(0x7fc99808ec10 msgr2=0x7fc9980d4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 shutdown_connections 2024-04-26T22:07:25.914 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:25.913+0000 7fc99d922640 1 -- 172.21.15.137:0/4077275358 wait complete. 2024-04-26T22:07:25.924 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:07:26.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.023+0000 7f8f50037640 1 Processor -- start 2024-04-26T22:07:26.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.023+0000 7f8f50037640 1 -- start start 2024-04-26T22:07:26.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f50037640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f4815d130 0x7f8f4806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f50037640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8f48070d00 0x7f8f4806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f50037640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f4815d510 con 0x7f8f480733c0 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f50037640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8f480b0e80 con 0x7f8f48070d00 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f50037640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8f480b54f0 con 0x7f8f4815d130 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f4e5d4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8f48070d00 0x7f8f4806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f4ddd3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f4815d130 0x7f8f4806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f4d5d2640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8f480733c0 0x7f8f48160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:36470/0 (socket says 172.21.15.137:36470) 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f4ddd3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f4815d130 0x7f8f4806d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:37156/0 (socket says 172.21.15.137:37156) 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f4e5d4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8f48070d00 0x7f8f4806d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35126/0 (socket says 172.21.15.137:35126) 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.024+0000 7f8f4d5d2640 1 -- 172.21.15.137:0/2603821455 learned_addr learned my addr 172.21.15.137:0/2603821455 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.025+0000 7f8f4ddd3640 1 -- 172.21.15.137:0/2603821455 >> v2:172.21.15.170:3300/0 conn(0x7f8f48070d00 msgr2=0x7f8f4806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.025+0000 7f8f4ddd3640 1 --2- 172.21.15.137:0/2603821455 >> v2:172.21.15.170:3300/0 conn(0x7f8f48070d00 0x7f8f4806d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.025+0000 7f8f4ddd3640 1 -- 172.21.15.137:0/2603821455 >> v1:172.21.15.170:6789/0 conn(0x7f8f480733c0 legacy=0x7f8f48160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.025+0000 7f8f4ddd3640 1 -- 172.21.15.137:0/2603821455 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f480d12c0 con 0x7f8f4815d130 2024-04-26T22:07:26.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.025+0000 7f8f4cdd1640 1 -- 172.21.15.137:0/2603821455 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396495586 0 0) 0x7f8f4815d510 con 0x7f8f480733c0 2024-04-26T22:07:26.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.025+0000 7f8f4e5d4640 1 --2- 172.21.15.137:0/2603821455 >> v2:172.21.15.170:3300/0 conn(0x7f8f48070d00 0x7f8f4806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:26.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.025+0000 7f8f4ddd3640 1 --2- 172.21.15.137:0/2603821455 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f4815d130 0x7f8f4806d2b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f440097a0 tx=0x7f8f4402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc4dfb1d560d7d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:26.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.025+0000 7f8f4cdd1640 1 -- 172.21.15.137:0/2603821455 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44037070 con 0x7f8f4815d130 2024-04-26T22:07:26.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.025+0000 7f8f4cdd1640 1 -- 172.21.15.137:0/2603821455 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f44032440 con 0x7f8f4815d130 2024-04-26T22:07:26.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.026+0000 7f8f4cdd1640 1 -- 172.21.15.137:0/2603821455 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44032810 con 0x7f8f4815d130 2024-04-26T22:07:26.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.026+0000 7f8f50037640 1 -- 172.21.15.137:0/2603821455 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f4815d130 msgr2=0x7f8f4806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.026+0000 7f8f50037640 1 --2- 172.21.15.137:0/2603821455 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f4815d130 0x7f8f4806d2b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f440097a0 tx=0x7f8f4402a180 comp rx=0 tx=0).stop 2024-04-26T22:07:26.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.026+0000 7f8f50037640 1 -- 172.21.15.137:0/2603821455 shutdown_connections 2024-04-26T22:07:26.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.026+0000 7f8f50037640 1 --2- 172.21.15.137:0/2603821455 >> v2:172.21.15.170:3300/0 conn(0x7f8f48070d00 0x7f8f4806d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.026+0000 7f8f50037640 1 --2- 172.21.15.137:0/2603821455 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f4815d130 0x7f8f4806d2b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.026+0000 7f8f50037640 1 -- 172.21.15.137:0/2603821455 >> 172.21.15.137:0/2603821455 conn(0x7f8f480728a0 msgr2=0x7f8f48072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:26.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.026+0000 7f8f50037640 1 -- 172.21.15.137:0/2603821455 shutdown_connections 2024-04-26T22:07:26.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.026+0000 7f8f50037640 1 -- 172.21.15.137:0/2603821455 wait complete. 2024-04-26T22:07:26.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.027+0000 7f8f50037640 1 Processor -- start 2024-04-26T22:07:26.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.027+0000 7f8f50037640 1 -- start start 2024-04-26T22:07:26.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f50037640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f48070d00 0x7f8f480ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f50037640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f480733c0 0x7f8f481f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f50037640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f4815d130 0x7f8f4814f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f50037640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8f480d07e0 con 0x7f8f4815d130 2024-04-26T22:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f50037640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8f480d0500 con 0x7f8f480733c0 2024-04-26T22:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f50037640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8f480d0ac0 con 0x7f8f48070d00 2024-04-26T22:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f4e5d4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f4815d130 0x7f8f4814f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f4d5d2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f480733c0 0x7f8f481f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f4ddd3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f48070d00 0x7f8f480ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f4e5d4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f4815d130 0x7f8f4814f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40456/0 (socket says 172.21.15.137:40456) 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f4ddd3640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f48070d00 0x7f8f480ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:37158/0 (socket says 172.21.15.137:37158) 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f4e5d4640 1 -- 172.21.15.137:0/4101657872 learned_addr learned my addr 172.21.15.137:0/4101657872 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f4d5d2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f480733c0 0x7f8f481f6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35128/0 (socket says 172.21.15.137:35128) 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f4e5d4640 1 -- 172.21.15.137:0/4101657872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f48070d00 msgr2=0x7f8f480ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.028+0000 7f8f4e5d4640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f48070d00 0x7f8f480ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.029+0000 7f8f4e5d4640 1 -- 172.21.15.137:0/4101657872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f480733c0 msgr2=0x7f8f481f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.029+0000 7f8f4e5d4640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f480733c0 0x7f8f481f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.029+0000 7f8f4e5d4640 1 -- 172.21.15.137:0/4101657872 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f480c6450 con 0x7f8f4815d130 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.029+0000 7f8f4e5d4640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f4815d130 0x7f8f4814f490 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009f00 tx=0x7f8f4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.029+0000 7f8f3e7fc640 1 -- 172.21.15.137:0/4101657872 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40018030 con 0x7f8f4815d130 2024-04-26T22:07:26.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.029+0000 7f8f3e7fc640 1 -- 172.21.15.137:0/4101657872 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f4000ce50 con 0x7f8f4815d130 2024-04-26T22:07:26.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.029+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f481f6bb0 con 0x7f8f4815d130 2024-04-26T22:07:26.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.029+0000 7f8f3e7fc640 1 -- 172.21.15.137:0/4101657872 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40003bb0 con 0x7f8f4815d130 2024-04-26T22:07:26.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.029+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f481f7170 con 0x7f8f4815d130 2024-04-26T22:07:26.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.030+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4806a290 con 0x7f8f4815d130 2024-04-26T22:07:26.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.030+0000 7f8f3e7fc640 1 -- 172.21.15.137:0/4101657872 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f4001b070 con 0x7f8f4815d130 2024-04-26T22:07:26.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.031+0000 7f8f3e7fc640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8f2c06c8f0 0x7f8f2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.031+0000 7f8f3e7fc640 1 -- 172.21.15.137:0/4101657872 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f8f4008c500 con 0x7f8f4815d130 2024-04-26T22:07:26.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.031+0000 7f8f4ddd3640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8f2c06c8f0 0x7f8f2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.031+0000 7f8f4ddd3640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8f2c06c8f0 0x7f8f2c06edb0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8f44034000 tx=0x7f8f4402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:26.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.035+0000 7f8f3e7fc640 1 -- 172.21.15.137:0/4101657872 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8f40010040 con 0x7f8f4815d130 2024-04-26T22:07:26.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.248+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8f48160000 con 0x7f8f4815d130 2024-04-26T22:07:26.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.498+0000 7f8f3e7fc640 1 -- 172.21.15.137:0/4101657872 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) ==== 161+0+0 (secure 0 0 0) 0x7f8f4005a240 con 0x7f8f4815d130 2024-04-26T22:07:26.498 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:07:26.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8f2c06c8f0 msgr2=0x7f8f2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8f2c06c8f0 0x7f8f2c06edb0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8f44034000 tx=0x7f8f4402e000 comp rx=0 tx=0).stop 2024-04-26T22:07:26.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f4815d130 msgr2=0x7f8f4814f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.500 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f4815d130 0x7f8f4814f490 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009f00 tx=0x7f8f4000c490 comp rx=0 tx=0).stop 2024-04-26T22:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 shutdown_connections 2024-04-26T22:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8f2c06c8f0 0x7f8f2c06edb0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8f4815d130 0x7f8f4814f490 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f480733c0 0x7f8f481f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 --2- 172.21.15.137:0/4101657872 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8f48070d00 0x7f8f480ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 >> 172.21.15.137:0/4101657872 conn(0x7f8f480728a0 msgr2=0x7f8f480b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 shutdown_connections 2024-04-26T22:07:26.501 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.500+0000 7f8f50037640 1 -- 172.21.15.137:0/4101657872 wait complete. 2024-04-26T22:07:26.511 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:07:26.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.610+0000 7fe328fc6640 1 Processor -- start 2024-04-26T22:07:26.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.610+0000 7fe328fc6640 1 -- start start 2024-04-26T22:07:26.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.611+0000 7fe328fc6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe3240cd940 0x7fe324070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.616 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.611+0000 7fe328fc6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240737a0 0x7fe32406f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.611+0000 7fe328fc6640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3240cfec0 con 0x7fe3240d14d0 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.611+0000 7fe328fc6640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe3240d07f0 con 0x7fe3240cd940 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.611+0000 7fe328fc6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe3240d01a0 con 0x7fe3240737a0 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.611+0000 7fe32259c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe3240cd940 0x7fe324070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.611+0000 7fe32259c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe3240cd940 0x7fe324070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40462/0 (socket says 172.21.15.137:40462) 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.611+0000 7fe32259c640 1 -- 172.21.15.137:0/2094320477 learned_addr learned my addr 172.21.15.137:0/2094320477 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.611+0000 7fe322d9d640 1 --2- 172.21.15.137:0/2094320477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240737a0 0x7fe32406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.612+0000 7fe32259c640 1 -- 172.21.15.137:0/2094320477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240737a0 msgr2=0x7fe32406f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.612+0000 7fe32259c640 1 --2- 172.21.15.137:0/2094320477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240737a0 0x7fe32406f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.612+0000 7fe32259c640 1 -- 172.21.15.137:0/2094320477 >> v1:172.21.15.170:6789/0 conn(0x7fe3240d14d0 legacy=0x7fe324073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.612+0000 7fe32259c640 1 -- 172.21.15.137:0/2094320477 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3240d0480 con 0x7fe3240cd940 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.612+0000 7fe32259c640 1 --2- 172.21.15.137:0/2094320477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 0x7fe324070710 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe314009e50 tx=0x7fe31402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204bda4e26a3a8f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.612+0000 7fe32159a640 1 -- 172.21.15.137:0/2094320477 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe314036070 con 0x7fe3240cd940 2024-04-26T22:07:26.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.612+0000 7fe32159a640 1 -- 172.21.15.137:0/2094320477 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe314031600 con 0x7fe3240cd940 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.612+0000 7fe32159a640 1 -- 172.21.15.137:0/2094320477 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3140319d0 con 0x7fe3240cd940 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.613+0000 7fe328fc6640 1 -- 172.21.15.137:0/2094320477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 msgr2=0x7fe324070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.613+0000 7fe328fc6640 1 --2- 172.21.15.137:0/2094320477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 0x7fe324070710 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe314009e50 tx=0x7fe31402a6c0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.613+0000 7fe328fc6640 1 -- 172.21.15.137:0/2094320477 shutdown_connections 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.613+0000 7fe328fc6640 1 --2- 172.21.15.137:0/2094320477 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240737a0 0x7fe32406f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.613+0000 7fe328fc6640 1 --2- 172.21.15.137:0/2094320477 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 0x7fe324070710 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.613+0000 7fe328fc6640 1 -- 172.21.15.137:0/2094320477 >> 172.21.15.137:0/2094320477 conn(0x7fe3240d1e40 msgr2=0x7fe3240d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.613+0000 7fe328fc6640 1 -- 172.21.15.137:0/2094320477 shutdown_connections 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.613+0000 7fe328fc6640 1 -- 172.21.15.137:0/2094320477 wait complete. 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.614+0000 7fe328fc6640 1 Processor -- start 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.614+0000 7fe328fc6640 1 -- start start 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe328fc6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3240737a0 0x7fe32415d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe328fc6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 0x7fe32415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe328fc6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240d14d0 0x7fe3240caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe328fc6640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240cdea0 con 0x7fe3240cd940 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe328fc6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240cdd20 con 0x7fe3240737a0 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe328fc6640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe3240d0c80 con 0x7fe3240d14d0 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe321d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 0x7fe32415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe321d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 0x7fe32415b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40476/0 (socket says 172.21.15.137:40476) 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe321d9b640 1 -- 172.21.15.137:0/627129729 learned_addr learned my addr 172.21.15.137:0/627129729 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe32259c640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3240737a0 0x7fe32415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.615+0000 7fe322d9d640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240d14d0 0x7fe3240caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe321d9b640 1 -- 172.21.15.137:0/627129729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240d14d0 msgr2=0x7fe3240caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe321d9b640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240d14d0 0x7fe3240caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe321d9b640 1 -- 172.21.15.137:0/627129729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3240737a0 msgr2=0x7fe32415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe321d9b640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3240737a0 0x7fe32415d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:26.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe321d9b640 1 -- 172.21.15.137:0/627129729 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32415c1a0 con 0x7fe3240cd940 2024-04-26T22:07:26.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe32259c640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3240737a0 0x7fe32415d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:26.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe321d9b640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 0x7fe32415b7c0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c3c0 tx=0x7fe31800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:26.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe312ffd640 1 -- 172.21.15.137:0/627129729 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318011790 con 0x7fe3240cd940 2024-04-26T22:07:26.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe312ffd640 1 -- 172.21.15.137:0/627129729 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe318017070 con 0x7fe3240cd940 2024-04-26T22:07:26.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32415c4e0 con 0x7fe3240cd940 2024-04-26T22:07:26.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe312ffd640 1 -- 172.21.15.137:0/627129729 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318011b70 con 0x7fe3240cd940 2024-04-26T22:07:26.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.616+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32415cd20 con 0x7fe3240cd940 2024-04-26T22:07:26.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.617+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe32415cf20 con 0x7fe3240cd940 2024-04-26T22:07:26.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.617+0000 7fe312ffd640 1 -- 172.21.15.137:0/627129729 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe318011d10 con 0x7fe3240cd940 2024-04-26T22:07:26.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.618+0000 7fe312ffd640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe30406c8f0 0x7fe30406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:26.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.618+0000 7fe312ffd640 1 -- 172.21.15.137:0/627129729 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7fe31808b9a0 con 0x7fe3240cd940 2024-04-26T22:07:26.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.618+0000 7fe32259c640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe30406c8f0 0x7fe30406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:26.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.618+0000 7fe32259c640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe30406c8f0 0x7fe30406edb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe314033000 tx=0x7fe314009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:26.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.622+0000 7fe312ffd640 1 -- 172.21.15.137:0/627129729 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe32415cf20 con 0x7fe3240cd940 2024-04-26T22:07:26.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:26.838+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe32415d840 con 0x7fe3240cd940 2024-04-26T22:07:27.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.505+0000 7fe312ffd640 1 -- 172.21.15.137:0/627129729 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) ==== 104+0+0 (secure 0 0 0) 0x7fe32415c4e0 con 0x7fe3240cd940 2024-04-26T22:07:27.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe30406c8f0 msgr2=0x7fe30406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:27.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe30406c8f0 0x7fe30406edb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe314033000 tx=0x7fe314009000 comp rx=0 tx=0).stop 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 msgr2=0x7fe32415b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 0x7fe32415b7c0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe31800c3c0 tx=0x7fe31800c880 comp rx=0 tx=0).stop 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 shutdown_connections 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe30406c8f0 0x7fe30406edb0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe3240cd940 0x7fe32415b7c0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe3240d14d0 0x7fe3240caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 --2- 172.21.15.137:0/627129729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3240737a0 0x7fe32415d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 >> 172.21.15.137:0/627129729 conn(0x7fe3240d1e40 msgr2=0x7fe3240ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 shutdown_connections 2024-04-26T22:07:27.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.507+0000 7fe328fc6640 1 -- 172.21.15.137:0/627129729 wait complete. 2024-04-26T22:07:27.519 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:07:27.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.620+0000 7f5340cfc640 1 Processor -- start 2024-04-26T22:07:27.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.620+0000 7f5340cfc640 1 -- start start 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.621+0000 7f5340cfc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.621+0000 7f5340cfc640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f533c06e330 0x7f533c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.621+0000 7f5340cfc640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c0d0140 con 0x7f533c0d16d0 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.621+0000 7f5340cfc640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f533c0721a0 con 0x7f533c06e330 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.621+0000 7f5340cfc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f533c0d1b20 con 0x7f533c1454c0 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f5339d9b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f533c06e330 0x7f533c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f533a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f533a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c0d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:37190/0 (socket says 172.21.15.137:37190) 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f533a59c640 1 -- 172.21.15.137:0/60907338 learned_addr learned my addr 172.21.15.137:0/60907338 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f533ad9d640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f533c0d16d0 0x7f533c15c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:36502/0 (socket says 172.21.15.137:36502) 2024-04-26T22:07:27.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f533a59c640 1 -- 172.21.15.137:0/60907338 >> v2:172.21.15.170:3300/0 conn(0x7f533c06e330 msgr2=0x7f533c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:27.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f533a59c640 1 --2- 172.21.15.137:0/60907338 >> v2:172.21.15.170:3300/0 conn(0x7f533c06e330 0x7f533c0d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:27.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f533a59c640 1 -- 172.21.15.137:0/60907338 >> v1:172.21.15.170:6789/0 conn(0x7f533c0d16d0 legacy=0x7f533c15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:27.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f533a59c640 1 -- 172.21.15.137:0/60907338 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c06e830 con 0x7f533c1454c0 2024-04-26T22:07:27.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.622+0000 7f5339d9b640 1 --2- 172.21.15.137:0/60907338 >> v2:172.21.15.170:3300/0 conn(0x7f533c06e330 0x7f533c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:27.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.623+0000 7f533a59c640 1 --2- 172.21.15.137:0/60907338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c0d05a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5334009e50 tx=0x7f533402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=709999d0a61de383 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:27.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.623+0000 7f533959a640 1 -- 172.21.15.137:0/60907338 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334036070 con 0x7f533c1454c0 2024-04-26T22:07:27.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.623+0000 7f533959a640 1 -- 172.21.15.137:0/60907338 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5334031600 con 0x7f533c1454c0 2024-04-26T22:07:27.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.623+0000 7f533959a640 1 -- 172.21.15.137:0/60907338 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53340319d0 con 0x7f533c1454c0 2024-04-26T22:07:27.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.623+0000 7f5340cfc640 1 -- 172.21.15.137:0/60907338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 msgr2=0x7f533c0d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:27.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.623+0000 7f5340cfc640 1 --2- 172.21.15.137:0/60907338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c0d05a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5334009e50 tx=0x7f533402a710 comp rx=0 tx=0).stop 2024-04-26T22:07:27.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.624+0000 7f5340cfc640 1 -- 172.21.15.137:0/60907338 shutdown_connections 2024-04-26T22:07:27.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.624+0000 7f5340cfc640 1 --2- 172.21.15.137:0/60907338 >> v2:172.21.15.170:3300/0 conn(0x7f533c06e330 0x7f533c0d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:27.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.624+0000 7f5340cfc640 1 --2- 172.21.15.137:0/60907338 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c0d05a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:27.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.624+0000 7f5340cfc640 1 -- 172.21.15.137:0/60907338 >> 172.21.15.137:0/60907338 conn(0x7f533c06c690 msgr2=0x7f533c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:27.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.624+0000 7f5340cfc640 1 -- 172.21.15.137:0/60907338 shutdown_connections 2024-04-26T22:07:27.625 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.624+0000 7f5340cfc640 1 -- 172.21.15.137:0/60907338 wait complete. 2024-04-26T22:07:27.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.625+0000 7f5340cfc640 1 Processor -- start 2024-04-26T22:07:27.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.625+0000 7f5340cfc640 1 -- start start 2024-04-26T22:07:27.627 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5340cfc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f533c06e330 0x7f533c14b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5340cfc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0d16d0 0x7f533c13c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5340cfc640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c13c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5340cfc640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f533c06edf0 con 0x7f533c0d16d0 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5340cfc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f533c0ceca0 con 0x7f533c06e330 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5340cfc640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f533c06f0d0 con 0x7f533c1454c0 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5339d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0d16d0 0x7f533c13c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5339d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0d16d0 0x7f533c13c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40484/0 (socket says 172.21.15.137:40484) 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5339d9b640 1 -- 172.21.15.137:0/2273301047 learned_addr learned my addr 172.21.15.137:0/2273301047 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f533ad9d640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c13c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f533a59c640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f533c06e330 0x7f533c14b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5339d9b640 1 -- 172.21.15.137:0/2273301047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 msgr2=0x7f533c13c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5339d9b640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c13c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5339d9b640 1 -- 172.21.15.137:0/2273301047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f533c06e330 msgr2=0x7f533c14b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5339d9b640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f533c06e330 0x7f533c14b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:27.628 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5339d9b640 1 -- 172.21.15.137:0/2273301047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c14ba70 con 0x7f533c0d16d0 2024-04-26T22:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5339d9b640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0d16d0 0x7f533c13c1e0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f5324010b70 tx=0x7f532400e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5332ffd640 1 -- 172.21.15.137:0/2273301047 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532401e070 con 0x7f533c0d16d0 2024-04-26T22:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5332ffd640 1 -- 172.21.15.137:0/2273301047 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5324011650 con 0x7f533c0d16d0 2024-04-26T22:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c14bd50 con 0x7f533c0d16d0 2024-04-26T22:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.626+0000 7f5332ffd640 1 -- 172.21.15.137:0/2273301047 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324011a00 con 0x7f533c0d16d0 2024-04-26T22:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.627+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c14c310 con 0x7f533c0d16d0 2024-04-26T22:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.627+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f533c06a290 con 0x7f533c0d16d0 2024-04-26T22:07:27.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.628+0000 7f5332ffd640 1 -- 172.21.15.137:0/2273301047 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5324021070 con 0x7f533c0d16d0 2024-04-26T22:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.628+0000 7f5332ffd640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f531c06c920 0x7f531c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.628+0000 7f5332ffd640 1 -- 172.21.15.137:0/2273301047 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5881+0+0 (secure 0 0 0) 0x7f532408dd00 con 0x7f533c0d16d0 2024-04-26T22:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.628+0000 7f533a59c640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f531c06c920 0x7f531c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:27.630 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.629+0000 7f533a59c640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f531c06c920 0x7f531c06ede0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5334033000 tx=0x7f5334009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:27.632 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.633+0000 7f5332ffd640 1 -- 172.21.15.137:0/2273301047 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f532405b9b0 con 0x7f533c0d16d0 2024-04-26T22:07:27.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:27.809+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f533c0cd4a0 con 0x7f533c0d16d0 2024-04-26T22:07:28.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.512+0000 7f5332ffd640 1 -- 172.21.15.137:0/2273301047 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v106) ==== 181+0+0 (secure 0 0 0) 0x7f532405fcb0 con 0x7f533c0d16d0 2024-04-26T22:07:28.512 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:07:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f531c06c920 msgr2=0x7f531c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f531c06c920 0x7f531c06ede0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5334033000 tx=0x7f5334009000 comp rx=0 tx=0).stop 2024-04-26T22:07:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0d16d0 msgr2=0x7f533c13c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0d16d0 0x7f533c13c1e0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f5324010b70 tx=0x7f532400e730 comp rx=0 tx=0).stop 2024-04-26T22:07:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 shutdown_connections 2024-04-26T22:07:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f531c06c920 0x7f531c06ede0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f533c0d16d0 0x7f533c13c1e0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f533c1454c0 0x7f533c13c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:28.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 --2- 172.21.15.137:0/2273301047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f533c06e330 0x7f533c14b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 >> 172.21.15.137:0/2273301047 conn(0x7f533c06c690 msgr2=0x7f533c142cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 shutdown_connections 2024-04-26T22:07:28.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.515+0000 7f5340cfc640 1 -- 172.21.15.137:0/2273301047 wait complete. 2024-04-26T22:07:28.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:07:28.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.637+0000 7f64de485640 1 Processor -- start 2024-04-26T22:07:28.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.637+0000 7f64de485640 1 -- start start 2024-04-26T22:07:28.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.638+0000 7f64de485640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f64d8068090 0x7f64d80b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:28.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.638+0000 7f64de485640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f64d80b4c30 0x7f64d806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:28.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.638+0000 7f64de485640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64d80cde80 con 0x7f64d8068470 2024-04-26T22:07:28.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.638+0000 7f64de485640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f64d806ebf0 con 0x7f64d8068090 2024-04-26T22:07:28.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.638+0000 7f64de485640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f64d806eed0 con 0x7f64d80b4c30 2024-04-26T22:07:28.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.640+0000 7f64d77fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f64d80b4c30 0x7f64d806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:28.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.640+0000 7f64d77fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f64d80b4c30 0x7f64d806d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:35162/0 (socket says 172.21.15.137:35162) 2024-04-26T22:07:28.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.640+0000 7f64d77fe640 1 -- 172.21.15.137:0/346729991 learned_addr learned my addr 172.21.15.137:0/346729991 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:28.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.640+0000 7f64d7fff640 1 --2- 172.21.15.137:0/346729991 >> v2:172.21.15.137:3300/0 conn(0x7f64d8068090 0x7f64d80b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:28.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.640+0000 7f64d77fe640 1 -- 172.21.15.137:0/346729991 >> v2:172.21.15.137:3300/0 conn(0x7f64d8068090 msgr2=0x7f64d80b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:28.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.640+0000 7f64d77fe640 1 --2- 172.21.15.137:0/346729991 >> v2:172.21.15.137:3300/0 conn(0x7f64d8068090 0x7f64d80b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:28.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.640+0000 7f64d77fe640 1 -- 172.21.15.137:0/346729991 >> v1:172.21.15.137:6789/0 conn(0x7f64d8068470 legacy=0x7f64d806fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:28.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.640+0000 7f64d77fe640 1 -- 172.21.15.137:0/346729991 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d806f1b0 con 0x7f64d80b4c30 2024-04-26T22:07:28.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.642+0000 7f64d77fe640 1 --2- 172.21.15.137:0/346729991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64d80b4c30 0x7f64d806d2b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f64d80ce200 tx=0x7f64d002a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4912a0b9a7a5029 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:28.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.642+0000 7f64d6ffd640 1 -- 172.21.15.137:0/346729991 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d0036070 con 0x7f64d80b4c30 2024-04-26T22:07:28.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.643+0000 7f64d6ffd640 1 -- 172.21.15.137:0/346729991 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d0031600 con 0x7f64d80b4c30 2024-04-26T22:07:28.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.644+0000 7f64d6ffd640 1 -- 172.21.15.137:0/346729991 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d00319d0 con 0x7f64d80b4c30 2024-04-26T22:07:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.644+0000 7f64de485640 1 -- 172.21.15.137:0/346729991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64d80b4c30 msgr2=0x7f64d806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:28.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.644+0000 7f64de485640 1 --2- 172.21.15.137:0/346729991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64d80b4c30 0x7f64d806d2b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f64d80ce200 tx=0x7f64d002a630 comp rx=0 tx=0).stop 2024-04-26T22:07:28.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.644+0000 7f64de485640 1 -- 172.21.15.137:0/346729991 shutdown_connections 2024-04-26T22:07:28.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.644+0000 7f64de485640 1 --2- 172.21.15.137:0/346729991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64d80b4c30 0x7f64d806d2b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:28.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.644+0000 7f64de485640 1 --2- 172.21.15.137:0/346729991 >> v2:172.21.15.137:3300/0 conn(0x7f64d8068090 0x7f64d80b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:28.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.644+0000 7f64de485640 1 -- 172.21.15.137:0/346729991 >> 172.21.15.137:0/346729991 conn(0x7f64d80729d0 msgr2=0x7f64d8072db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:28.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.645+0000 7f64de485640 1 -- 172.21.15.137:0/346729991 shutdown_connections 2024-04-26T22:07:28.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.645+0000 7f64de485640 1 -- 172.21.15.137:0/346729991 wait complete. 2024-04-26T22:07:28.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.646+0000 7f64de485640 1 Processor -- start 2024-04-26T22:07:28.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.646+0000 7f64de485640 1 -- start start 2024-04-26T22:07:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64de485640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d8068090 0x7f64d81514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64de485640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64d8068470 0x7f64d80b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64de485640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64d80b4c30 0x7f64d80b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:28.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64de485640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f64d80d10b0 con 0x7f64d8068090 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64de485640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f64d806f770 con 0x7f64d8068470 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64de485640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f64d806e870 con 0x7f64d80b4c30 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64d7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d8068090 0x7f64d81514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64d7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d8068090 0x7f64d81514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40506/0 (socket says 172.21.15.137:40506) 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64d7fff640 1 -- 172.21.15.137:0/65721680 learned_addr learned my addr 172.21.15.137:0/65721680 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64d77fe640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64d8068470 0x7f64d80b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.647+0000 7f64dca22640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64d80b4c30 0x7f64d80b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64d7fff640 1 -- 172.21.15.137:0/65721680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64d80b4c30 msgr2=0x7f64d80b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64d7fff640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64d80b4c30 0x7f64d80b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64d7fff640 1 -- 172.21.15.137:0/65721680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64d8068470 msgr2=0x7f64d80b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64d7fff640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64d8068470 0x7f64d80b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64d7fff640 1 -- 172.21.15.137:0/65721680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d8156fc0 con 0x7f64d8068090 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64d7fff640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d8068090 0x7f64d81514a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f64c800d830 tx=0x7f64c800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:28.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64d4ff9640 1 -- 172.21.15.137:0/65721680 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c800b6c0 con 0x7f64d8068090 2024-04-26T22:07:28.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64d4ff9640 1 -- 172.21.15.137:0/65721680 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64c8019070 con 0x7f64d8068090 2024-04-26T22:07:28.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d81572a0 con 0x7f64d8068090 2024-04-26T22:07:28.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64d4ff9640 1 -- 172.21.15.137:0/65721680 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c800ba80 con 0x7f64d8068090 2024-04-26T22:07:28.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.648+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d8153c40 con 0x7f64d8068090 2024-04-26T22:07:28.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.649+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64d80693d0 con 0x7f64d8068090 2024-04-26T22:07:28.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.649+0000 7f64d4ff9640 1 -- 172.21.15.137:0/65721680 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64c801e460 con 0x7f64d8068090 2024-04-26T22:07:28.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.650+0000 7f64d4ff9640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f64c406c8f0 0x7f64c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:28.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.650+0000 7f64d4ff9640 1 -- 172.21.15.137:0/65721680 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5443+0+0 (secure 0 0 0) 0x7f64c808bff0 con 0x7f64d8068090 2024-04-26T22:07:28.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.650+0000 7f64d77fe640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f64c406c8f0 0x7f64c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:28.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.650+0000 7f64d77fe640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f64c406c8f0 0x7f64c406edb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f64d0033000 tx=0x7f64d0009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:28.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.654+0000 7f64d4ff9640 1 -- 172.21.15.137:0/65721680 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f64c805a5b0 con 0x7f64d8068090 2024-04-26T22:07:28.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:28.829+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f64d8073bc0 con 0x7f64d8068090 2024-04-26T22:07:29.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.514+0000 7f64d4ff9640 1 -- 172.21.15.137:0/65721680 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v107) ==== 169+0+0 (secure 0 0 0) 0x7f64c8059eb0 con 0x7f64d8068090 2024-04-26T22:07:29.514 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f64c406c8f0 msgr2=0x7f64c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f64c406c8f0 0x7f64c406edb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f64d0033000 tx=0x7f64d0009000 comp rx=0 tx=0).stop 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d8068090 msgr2=0x7f64d81514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d8068090 0x7f64d81514a0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f64c800d830 tx=0x7f64c800dcf0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 shutdown_connections 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f64c406c8f0 0x7f64c406edb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f64d80b4c30 0x7f64d80b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64d8068470 0x7f64d80b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 --2- 172.21.15.137:0/65721680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f64d8068090 0x7f64d81514a0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 >> 172.21.15.137:0/65721680 conn(0x7f64d80729d0 msgr2=0x7f64d80ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:29.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 shutdown_connections 2024-04-26T22:07:29.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.517+0000 7f64de485640 1 -- 172.21.15.137:0/65721680 wait complete. 2024-04-26T22:07:29.531 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T22:07:29.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.636+0000 7f7547c17640 1 Processor -- start 2024-04-26T22:07:29.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.637+0000 7f7547c17640 1 -- start start 2024-04-26T22:07:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.637+0000 7f7547c17640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f75400d3820 0x7f75400b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.637+0000 7f7547c17640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75400b60b0 0x7f75400d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.637+0000 7f7547c17640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75400d3c90 con 0x7f754015f680 2024-04-26T22:07:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.637+0000 7f7547c17640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f754015fa60 con 0x7f75400d3820 2024-04-26T22:07:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.637+0000 7f7547c17640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f75400d3f50 con 0x7f75400b60b0 2024-04-26T22:07:29.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75459b3640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f754015f680 0x7f7540163aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39824/0 (socket says 172.21.15.137:39824) 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75459b3640 1 -- 172.21.15.137:0/2674439713 learned_addr learned my addr 172.21.15.137:0/2674439713 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75451b2640 1 --2- 172.21.15.137:0/2674439713 >> v2:172.21.15.170:3300/0 conn(0x7f75400d3820 0x7f75400b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190872079 0 0) 0x7f75400d3c90 con 0x7f754015f680 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75461b4640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75400b60b0 0x7f75400d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f752c003520 con 0x7f754015f680 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1737918135 0 0) 0x7f752c003520 con 0x7f754015f680 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75400b60b0 msgr2=0x7f75400d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75400b60b0 0x7f75400d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 >> v2:172.21.15.170:3300/0 conn(0x7f75400d3820 msgr2=0x7f75400b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 --2- 172.21.15.137:0/2674439713 >> v2:172.21.15.170:3300/0 conn(0x7f75400d3820 0x7f75400b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75400b5090 con 0x7f754015f680 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f7538001a10 con 0x7f754015f680 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 >> v1:172.21.15.137:6789/0 conn(0x7f754015f680 legacy=0x7f7540163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f752c0039b0 0x7f752c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75400b60b0 0x7f752c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f752c004d40 0x7f752c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f754015fa60 con 0x7f752c0039b0 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f75400d3f50 con 0x7f752c004d40 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f752c00b9c0 con 0x7f75400b60b0 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75459b3640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f752c0039b0 0x7f752c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75451b2640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75400b60b0 0x7f752c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.638+0000 7f75461b4640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f752c004d40 0x7f752c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.639+0000 7f75459b3640 1 -- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75400b60b0 msgr2=0x7f752c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.639+0000 7f75459b3640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f75400b60b0 0x7f752c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.639+0000 7f75459b3640 1 -- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f752c004d40 msgr2=0x7f752c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.639+0000 7f75459b3640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f752c004d40 0x7f752c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.639+0000 7f75459b3640 1 -- 172.21.15.137:0/2674439713 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c003520 con 0x7f752c0039b0 2024-04-26T22:07:29.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.639+0000 7f75459b3640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f752c0039b0 0x7f752c003dd0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f753800a8b0 tx=0x7f752c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f42a24fc25353d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.639+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753800a500 con 0x7f752c0039b0 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.639+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753802f070 con 0x7f752c0039b0 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.639+0000 7f75449b1640 1 -- 172.21.15.137:0/2674439713 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753802bcb0 con 0x7f752c0039b0 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.640+0000 7f7547c17640 1 -- 172.21.15.137:0/2674439713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f752c0039b0 msgr2=0x7f752c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.640+0000 7f7547c17640 1 --2- 172.21.15.137:0/2674439713 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f752c0039b0 0x7f752c003dd0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f753800a8b0 tx=0x7f752c005830 comp rx=0 tx=0).stop 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.640+0000 7f75461b4640 1 -- 172.21.15.137:0/2674439713 reap_dead start 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.640+0000 7f7547c17640 1 -- 172.21.15.137:0/2674439713 shutdown_connections 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.640+0000 7f7547c17640 1 -- 172.21.15.137:0/2674439713 >> 172.21.15.137:0/2674439713 conn(0x7f754008eca0 msgr2=0x7f754009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.640+0000 7f7547c17640 1 -- 172.21.15.137:0/2674439713 shutdown_connections 2024-04-26T22:07:29.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.640+0000 7f7547c17640 1 -- 172.21.15.137:0/2674439713 wait complete. 2024-04-26T22:07:29.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.641+0000 7f7547c17640 1 Processor -- start 2024-04-26T22:07:29.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.641+0000 7f7547c17640 1 -- start start 2024-04-26T22:07:29.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f7547c17640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f752c0039b0 0x7f7540161910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f7547c17640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540156b40 0x7f75400cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f7547c17640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f754015d100 0x7f754015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f7547c17640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f75400d50a0 con 0x7f7540156b40 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f7547c17640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f75400d4f20 con 0x7f754015d100 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f7547c17640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f75400d5220 con 0x7f752c0039b0 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75451b2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540156b40 0x7f75400cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75451b2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540156b40 0x7f75400cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40524/0 (socket says 172.21.15.137:40524) 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75451b2640 1 -- 172.21.15.137:0/975135140 learned_addr learned my addr 172.21.15.137:0/975135140 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75461b4640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f754015d100 0x7f754015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75459b3640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f752c0039b0 0x7f7540161910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75451b2640 1 -- 172.21.15.137:0/975135140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f752c0039b0 msgr2=0x7f7540161910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75451b2640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f752c0039b0 0x7f7540161910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75451b2640 1 -- 172.21.15.137:0/975135140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f754015d100 msgr2=0x7f754015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75451b2640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f754015d100 0x7f754015d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75451b2640 1 -- 172.21.15.137:0/975135140 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7540161fa0 con 0x7f7540156b40 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75461b4640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f754015d100 0x7f754015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.642+0000 7f75451b2640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540156b40 0x7f75400cd540 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f7530011a70 tx=0x7f7530011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.643+0000 7f75367fc640 1 -- 172.21.15.137:0/975135140 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753000fb50 con 0x7f7540156b40 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.643+0000 7f75367fc640 1 -- 172.21.15.137:0/975135140 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753000fcf0 con 0x7f7540156b40 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.643+0000 7f75367fc640 1 -- 172.21.15.137:0/975135140 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753000fea0 con 0x7f7540156b40 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.643+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7540162280 con 0x7f7540156b40 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.643+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7540162840 con 0x7f7540156b40 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.644+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754006a290 con 0x7f7540156b40 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.644+0000 7f75367fc640 1 -- 172.21.15.137:0/975135140 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7530012040 con 0x7f7540156b40 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.644+0000 7f75367fc640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f752406c920 0x7f752406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.645+0000 7f75459b3640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f752406c920 0x7f752406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.645+0000 7f75367fc640 1 -- 172.21.15.137:0/975135140 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5029+0+0 (secure 0 0 0) 0x7f753008bf20 con 0x7f7540156b40 2024-04-26T22:07:29.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.645+0000 7f75459b3640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f752406c920 0x7f752406ede0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7538033000 tx=0x7f7538038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:29.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.649+0000 7f75367fc640 1 -- 172.21.15.137:0/975135140 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7530019030 con 0x7f7540156b40 2024-04-26T22:07:29.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.823+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f75400cbbd0 con 0x7f7540156b40 2024-04-26T22:07:29.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.826+0000 7f75367fc640 1 -- 172.21.15.137:0/975135140 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f7530059fa0 con 0x7f7540156b40 2024-04-26T22:07:29.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f752406c920 msgr2=0x7f752406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f752406c920 0x7f752406ede0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7538033000 tx=0x7f7538038040 comp rx=0 tx=0).stop 2024-04-26T22:07:29.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540156b40 msgr2=0x7f75400cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540156b40 0x7f75400cd540 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f7530011a70 tx=0x7f7530011f30 comp rx=0 tx=0).stop 2024-04-26T22:07:29.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 shutdown_connections 2024-04-26T22:07:29.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f752406c920 0x7f752406ede0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7540156b40 0x7f75400cd540 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f754015d100 0x7f754015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 --2- 172.21.15.137:0/975135140 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f752c0039b0 0x7f7540161910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 >> 172.21.15.137:0/975135140 conn(0x7f754008eca0 msgr2=0x7f75400d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:29.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 shutdown_connections 2024-04-26T22:07:29.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.828+0000 7f7547c17640 1 -- 172.21.15.137:0/975135140 wait complete. 2024-04-26T22:07:29.839 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-26T22:07:29.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.936+0000 7f8ac8db4640 1 Processor -- start 2024-04-26T22:07:29.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.936+0000 7f8ac8db4640 1 -- start start 2024-04-26T22:07:29.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac8db4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8ac4145980 0x7f8ac4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac8db4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8ac40b3de0 0x7f8ac40b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac8db4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac40b4260 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac8db4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac40b5140 con 0x7f8ac40b3de0 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac8db4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac40b6410 con 0x7f8ac4145980 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac1d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8ac40b3de0 0x7f8ac40b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac1d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f8ac40b3de0 0x7f8ac40b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40538/0 (socket says 172.21.15.137:40538) 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac1d9b640 1 -- 172.21.15.137:0/3205229322 learned_addr learned my addr 172.21.15.137:0/3205229322 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac259c640 1 --2- 172.21.15.137:0/3205229322 >> v2:172.21.15.170:3300/0 conn(0x7f8ac4145980 0x7f8ac4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac1d9b640 1 -- 172.21.15.137:0/3205229322 >> v2:172.21.15.170:3300/0 conn(0x7f8ac4145980 msgr2=0x7f8ac4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac1d9b640 1 --2- 172.21.15.137:0/3205229322 >> v2:172.21.15.170:3300/0 conn(0x7f8ac4145980 0x7f8ac4160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac1d9b640 1 -- 172.21.15.137:0/3205229322 >> v1:172.21.15.170:6789/0 conn(0x7f8ac40b5fd0 legacy=0x7f8ac415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac1d9b640 1 -- 172.21.15.137:0/3205229322 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac40b4530 con 0x7f8ac40b3de0 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.937+0000 7f8ac259c640 1 --2- 172.21.15.137:0/3205229322 >> v2:172.21.15.170:3300/0 conn(0x7f8ac4145980 0x7f8ac4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.938+0000 7f8ac1d9b640 1 --2- 172.21.15.137:0/3205229322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b3de0 0x7f8ac40b5a90 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f8ac406ff10 tx=0x7f8ab802c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b9a4833ad9e709 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:29.939 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.938+0000 7f8ac159a640 1 -- 172.21.15.137:0/3205229322 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8032710 con 0x7f8ac40b3de0 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.938+0000 7f8ac159a640 1 -- 172.21.15.137:0/3205229322 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab80328b0 con 0x7f8ac40b3de0 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.938+0000 7f8ac159a640 1 -- 172.21.15.137:0/3205229322 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8032ca0 con 0x7f8ac40b3de0 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.938+0000 7f8ac8db4640 1 -- 172.21.15.137:0/3205229322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b3de0 msgr2=0x7f8ac40b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.938+0000 7f8ac8db4640 1 --2- 172.21.15.137:0/3205229322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b3de0 0x7f8ac40b5a90 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f8ac406ff10 tx=0x7f8ab802c850 comp rx=0 tx=0).stop 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.938+0000 7f8ac8db4640 1 -- 172.21.15.137:0/3205229322 shutdown_connections 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.938+0000 7f8ac8db4640 1 --2- 172.21.15.137:0/3205229322 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b3de0 0x7f8ac40b5a90 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.938+0000 7f8ac8db4640 1 --2- 172.21.15.137:0/3205229322 >> v2:172.21.15.170:3300/0 conn(0x7f8ac4145980 0x7f8ac4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.939+0000 7f8ac8db4640 1 -- 172.21.15.137:0/3205229322 >> 172.21.15.137:0/3205229322 conn(0x7f8ac40d0d30 msgr2=0x7f8ac40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.939+0000 7f8ac8db4640 1 -- 172.21.15.137:0/3205229322 shutdown_connections 2024-04-26T22:07:29.940 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.939+0000 7f8ac8db4640 1 -- 172.21.15.137:0/3205229322 wait complete. 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.940+0000 7f8ac8db4640 1 Processor -- start 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.940+0000 7f8ac8db4640 1 -- start start 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.940+0000 7f8ac8db4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac40b3de0 0x7f8ac41f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.940+0000 7f8ac8db4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b5fd0 0x7f8ac413a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.940+0000 7f8ac8db4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ac4145980 0x7f8ac415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.940+0000 7f8ac8db4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40b4dd0 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.940+0000 7f8ac8db4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40b4af0 con 0x7f8ac40b3de0 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.940+0000 7f8ac8db4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac40730e0 con 0x7f8ac4145980 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac1d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b5fd0 0x7f8ac413a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac1d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b5fd0 0x7f8ac413a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40552/0 (socket says 172.21.15.137:40552) 2024-04-26T22:07:29.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac1d9b640 1 -- 172.21.15.137:0/1055518368 learned_addr learned my addr 172.21.15.137:0/1055518368 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac2d9d640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ac4145980 0x7f8ac415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac259c640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac40b3de0 0x7f8ac41f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac1d9b640 1 -- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ac4145980 msgr2=0x7f8ac415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac1d9b640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ac4145980 0x7f8ac415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac1d9b640 1 -- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac40b3de0 msgr2=0x7f8ac41f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac1d9b640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac40b3de0 0x7f8ac41f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac1d9b640 1 -- 172.21.15.137:0/1055518368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac413aae0 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac2d9d640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ac4145980 0x7f8ac415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac259c640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac40b3de0 0x7f8ac41f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac1d9b640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b5fd0 0x7f8ac413a5a0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800b2c0 tx=0x7f8ab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ab2ffd640 1 -- 172.21.15.137:0/1055518368 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8044070 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ab2ffd640 1 -- 172.21.15.137:0/1055518368 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab8003850 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac4139c00 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ab2ffd640 1 -- 172.21.15.137:0/1055518368 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8003c40 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.941+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac413a1c0 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.942+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac40cde70 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.943+0000 7f8ab2ffd640 1 -- 172.21.15.137:0/1055518368 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ab8047070 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.943+0000 7f8ab2ffd640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8aa406c8f0 0x7f8aa406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:29.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.943+0000 7f8ac259c640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8aa406c8f0 0x7f8aa406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:29.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.943+0000 7f8ab2ffd640 1 -- 172.21.15.137:0/1055518368 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5029+0+0 (secure 0 0 0) 0x7f8ab80aea60 con 0x7f8ac40b5fd0 2024-04-26T22:07:29.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.943+0000 7f8ac259c640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8aa406c8f0 0x7f8aa406edb0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4006fd0 tx=0x7f8ab4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:29.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:29.947+0000 7f8ab2ffd640 1 -- 172.21.15.137:0/1055518368 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8ac40cde70 con 0x7f8ac40b5fd0 2024-04-26T22:07:30.196 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.197+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) -- 0x7f8ac4073cc0 con 0x7f8ac40b5fd0 2024-04-26T22:07:30.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.520+0000 7f8ab2ffd640 1 -- 172.21.15.137:0/1055518368 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v412) ==== 146+0+0 (secure 0 0 0) 0x7f8ab807d2e0 con 0x7f8ac40b5fd0 2024-04-26T22:07:30.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8aa406c8f0 msgr2=0x7f8aa406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8aa406c8f0 0x7f8aa406edb0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4006fd0 tx=0x7f8ab4008040 comp rx=0 tx=0).stop 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b5fd0 msgr2=0x7f8ac413a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b5fd0 0x7f8ac413a5a0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f8ab800b2c0 tx=0x7f8ab80046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 shutdown_connections 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8aa406c8f0 0x7f8aa406edb0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ac40b5fd0 0x7f8ac413a5a0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ac4145980 0x7f8ac415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 --2- 172.21.15.137:0/1055518368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ac40b3de0 0x7f8ac41f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.522+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 >> 172.21.15.137:0/1055518368 conn(0x7f8ac40d0d30 msgr2=0x7f8ac40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.523+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 shutdown_connections 2024-04-26T22:07:30.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.523+0000 7f8ac8db4640 1 -- 172.21.15.137:0/1055518368 wait complete. 2024-04-26T22:07:30.534 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-26T22:07:30.534 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-26T22:07:30.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:30.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.637+0000 7ff11fcf1640 1 Processor -- start 2024-04-26T22:07:30.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.637+0000 7ff11fcf1640 1 -- start start 2024-04-26T22:07:30.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11fcf1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff11815f1e0 0x7ff11806e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11fcf1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff1180b44e0 0x7ff1180ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11fcf1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1180b4a10 con 0x7ff11806d2b0 2024-04-26T22:07:30.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11fcf1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff11806eeb0 con 0x7ff11815f1e0 2024-04-26T22:07:30.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11fcf1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff1180b4cf0 con 0x7ff1180b44e0 2024-04-26T22:07:30.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11da8d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff11815f1e0 0x7ff11806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11da8d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff11815f1e0 0x7ff11806e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40564/0 (socket says 172.21.15.137:40564) 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11da8d640 1 -- 172.21.15.137:0/2468129457 learned_addr learned my addr 172.21.15.137:0/2468129457 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11d28c640 1 --2- 172.21.15.137:0/2468129457 >> v2:172.21.15.170:3300/0 conn(0x7ff1180b44e0 0x7ff1180ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11da8d640 1 -- 172.21.15.137:0/2468129457 >> v2:172.21.15.170:3300/0 conn(0x7ff1180b44e0 msgr2=0x7ff1180ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11da8d640 1 --2- 172.21.15.137:0/2468129457 >> v2:172.21.15.170:3300/0 conn(0x7ff1180b44e0 0x7ff1180ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.638+0000 7ff11da8d640 1 -- 172.21.15.137:0/2468129457 >> v1:172.21.15.170:6789/0 conn(0x7ff11806d2b0 legacy=0x7ff1180b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.639+0000 7ff11da8d640 1 -- 172.21.15.137:0/2468129457 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1180b4fd0 con 0x7ff11815f1e0 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.639+0000 7ff11da8d640 1 --2- 172.21.15.137:0/2468129457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11815f1e0 0x7ff11806e970 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff11806e5c0 tx=0x7ff11402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9954d9403db536f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.639+0000 7ff11ca8b640 1 -- 172.21.15.137:0/2468129457 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114036070 con 0x7ff11815f1e0 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.639+0000 7ff11ca8b640 1 -- 172.21.15.137:0/2468129457 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff114031600 con 0x7ff11815f1e0 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.639+0000 7ff11ca8b640 1 -- 172.21.15.137:0/2468129457 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1140319d0 con 0x7ff11815f1e0 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.640+0000 7ff11fcf1640 1 -- 172.21.15.137:0/2468129457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11815f1e0 msgr2=0x7ff11806e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.640+0000 7ff11fcf1640 1 --2- 172.21.15.137:0/2468129457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11815f1e0 0x7ff11806e970 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff11806e5c0 tx=0x7ff11402a730 comp rx=0 tx=0).stop 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.640+0000 7ff11fcf1640 1 -- 172.21.15.137:0/2468129457 shutdown_connections 2024-04-26T22:07:30.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.640+0000 7ff11fcf1640 1 --2- 172.21.15.137:0/2468129457 >> v2:172.21.15.170:3300/0 conn(0x7ff1180b44e0 0x7ff1180ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.640+0000 7ff11fcf1640 1 --2- 172.21.15.137:0/2468129457 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11815f1e0 0x7ff11806e970 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.640+0000 7ff11fcf1640 1 -- 172.21.15.137:0/2468129457 >> 172.21.15.137:0/2468129457 conn(0x7ff1180728a0 msgr2=0x7ff118072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:30.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.640+0000 7ff11fcf1640 1 -- 172.21.15.137:0/2468129457 shutdown_connections 2024-04-26T22:07:30.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.640+0000 7ff11fcf1640 1 -- 172.21.15.137:0/2468129457 wait complete. 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.641+0000 7ff11fcf1640 1 Processor -- start 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.641+0000 7ff11fcf1640 1 -- start start 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11fcf1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11806d2b0 0x7ff11814d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11fcf1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1180b44e0 0x7ff11815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11fcf1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff11815f1e0 0x7ff118162de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11fcf1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff1180aedf0 con 0x7ff11806d2b0 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11fcf1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff1180b5590 con 0x7ff11815f1e0 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11fcf1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff11815f5c0 con 0x7ff1180b44e0 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11da8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11806d2b0 0x7ff11814d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11da8d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11806d2b0 0x7ff11814d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40568/0 (socket says 172.21.15.137:40568) 2024-04-26T22:07:30.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11da8d640 1 -- 172.21.15.137:0/566675549 learned_addr learned my addr 172.21.15.137:0/566675549 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11e28e640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff11815f1e0 0x7ff118162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11da8d640 1 -- 172.21.15.137:0/566675549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1180b44e0 msgr2=0x7ff11815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11d28c640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1180b44e0 0x7ff11815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11da8d640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1180b44e0 0x7ff11815dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11da8d640 1 -- 172.21.15.137:0/566675549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff11815f1e0 msgr2=0x7ff118162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11da8d640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff11815f1e0 0x7ff118162de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11da8d640 1 -- 172.21.15.137:0/566675549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff118160f00 con 0x7ff11806d2b0 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11e28e640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff11815f1e0 0x7ff118162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11da8d640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11806d2b0 0x7ff11814d770 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7ff114034040 tx=0x7ff114004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff10e7fc640 1 -- 172.21.15.137:0/566675549 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114036050 con 0x7ff11806d2b0 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff10e7fc640 1 -- 172.21.15.137:0/566675549 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff114042070 con 0x7ff11806d2b0 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff10e7fc640 1 -- 172.21.15.137:0/566675549 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114009510 con 0x7ff11806d2b0 2024-04-26T22:07:30.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.642+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1181611a0 con 0x7ff11806d2b0 2024-04-26T22:07:30.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.643+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff118161760 con 0x7ff11806d2b0 2024-04-26T22:07:30.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.643+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11806a290 con 0x7ff11806d2b0 2024-04-26T22:07:30.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.644+0000 7ff10e7fc640 1 -- 172.21.15.137:0/566675549 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff114007c50 con 0x7ff11806d2b0 2024-04-26T22:07:30.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.644+0000 7ff10e7fc640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0fc06c920 0x7ff0fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.644+0000 7ff11d28c640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0fc06c920 0x7ff0fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.644+0000 7ff10e7fc640 1 -- 172.21.15.137:0/566675549 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5029+0+0 (secure 0 0 0) 0x7ff1140ac630 con 0x7ff11806d2b0 2024-04-26T22:07:30.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.645+0000 7ff11d28c640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0fc06c920 0x7ff0fc06ede0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff118155f40 tx=0x7ff108008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:30.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.649+0000 7ff10e7fc640 1 -- 172.21.15.137:0/566675549 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff11407ad90 con 0x7ff11806d2b0 2024-04-26T22:07:30.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.827+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff118155920 con 0x7ff11806d2b0 2024-04-26T22:07:30.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.827+0000 7ff10e7fc640 1 -- 172.21.15.137:0/566675549 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+13176 (secure 0 0 0) 0x7ff11407a690 con 0x7ff11806d2b0 2024-04-26T22:07:30.827 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:30.827 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":107,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:29.513571+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6834/1187927282":"2024-04-27T22:07:22.480221+0000","172.21.15.137:6836/1187927282":"2024-04-27T22:07:22.480221+0000","172.21.15.170:6835/2219855149":"2024-04-27T22:06:46.172594+0000","172.21.15.170:6832/2219855149":"2024-04-27T22:06:46.172594+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:30.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0fc06c920 msgr2=0x7ff0fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0fc06c920 0x7ff0fc06ede0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff118155f40 tx=0x7ff108008040 comp rx=0 tx=0).stop 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11806d2b0 msgr2=0x7ff11814d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11806d2b0 0x7ff11814d770 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7ff114034040 tx=0x7ff114004a40 comp rx=0 tx=0).stop 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 shutdown_connections 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff0fc06c920 0x7ff0fc06ede0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff11815f1e0 0x7ff118162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff1180b44e0 0x7ff11815dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 --2- 172.21.15.137:0/566675549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff11806d2b0 0x7ff11814d770 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.829+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 >> 172.21.15.137:0/566675549 conn(0x7ff1180728a0 msgr2=0x7ff118075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.830+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 shutdown_connections 2024-04-26T22:07:30.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.830+0000 7ff11fcf1640 1 -- 172.21.15.137:0/566675549 wait complete. 2024-04-26T22:07:30.842 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:07:30.843 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:07:30.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.946+0000 7f3281a45640 1 Processor -- start 2024-04-26T22:07:30.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.946+0000 7f3281a45640 1 -- start start 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f3281a45640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f327c0d0010 0x7f327c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f3281a45640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f327c0b33e0 0x7f327c163280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f3281a45640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f327c09c700 con 0x7f327c0b3c20 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f3281a45640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f327c0b4480 con 0x7f327c0b33e0 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f3281a45640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f327c06e050 con 0x7f327c0d0010 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f327b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f327c0b33e0 0x7f327c163280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f327b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f327c0b33e0 0x7f327c163280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40570/0 (socket says 172.21.15.137:40570) 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f327b7fe640 1 -- 172.21.15.137:0/2669357201 learned_addr learned my addr 172.21.15.137:0/2669357201 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f327affd640 1 --2- 172.21.15.137:0/2669357201 >> v2:172.21.15.170:3300/0 conn(0x7f327c0d0010 0x7f327c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f327b7fe640 1 -- 172.21.15.137:0/2669357201 >> v2:172.21.15.170:3300/0 conn(0x7f327c0d0010 msgr2=0x7f327c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:30.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f327b7fe640 1 --2- 172.21.15.137:0/2669357201 >> v2:172.21.15.170:3300/0 conn(0x7f327c0d0010 0x7f327c06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f327b7fe640 1 -- 172.21.15.137:0/2669357201 >> v1:172.21.15.170:6789/0 conn(0x7f327c0b3c20 legacy=0x7f327c0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.947+0000 7f327b7fe640 1 -- 172.21.15.137:0/2669357201 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327c0d1c50 con 0x7f327c0b33e0 2024-04-26T22:07:30.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.948+0000 7f327b7fe640 1 --2- 172.21.15.137:0/2669357201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b33e0 0x7f327c163280 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f327c073530 tx=0x7f327402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bc608695db8616 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:30.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.948+0000 7f3279ffb640 1 -- 172.21.15.137:0/2669357201 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3274036070 con 0x7f327c0b33e0 2024-04-26T22:07:30.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.948+0000 7f3279ffb640 1 -- 172.21.15.137:0/2669357201 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3274031600 con 0x7f327c0b33e0 2024-04-26T22:07:30.949 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.948+0000 7f3279ffb640 1 -- 172.21.15.137:0/2669357201 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32740319d0 con 0x7f327c0b33e0 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.949+0000 7f3281a45640 1 -- 172.21.15.137:0/2669357201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b33e0 msgr2=0x7f327c163280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.949+0000 7f3281a45640 1 --2- 172.21.15.137:0/2669357201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b33e0 0x7f327c163280 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f327c073530 tx=0x7f327402a730 comp rx=0 tx=0).stop 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.949+0000 7f3281a45640 1 -- 172.21.15.137:0/2669357201 shutdown_connections 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.949+0000 7f3281a45640 1 --2- 172.21.15.137:0/2669357201 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b33e0 0x7f327c163280 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.949+0000 7f3281a45640 1 --2- 172.21.15.137:0/2669357201 >> v2:172.21.15.170:3300/0 conn(0x7f327c0d0010 0x7f327c06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.949+0000 7f3281a45640 1 -- 172.21.15.137:0/2669357201 >> 172.21.15.137:0/2669357201 conn(0x7f327c09ba40 msgr2=0x7f327c09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.949+0000 7f3281a45640 1 -- 172.21.15.137:0/2669357201 shutdown_connections 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.949+0000 7f3281a45640 1 -- 172.21.15.137:0/2669357201 wait complete. 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.950+0000 7f3281a45640 1 Processor -- start 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.950+0000 7f3281a45640 1 -- start start 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3281a45640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f327c0b33e0 0x7f327c15d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.952 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3281a45640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b3c20 0x7f327c0a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3281a45640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f327c0d0010 0x7f327c1f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3281a45640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f327c0b3990 con 0x7f327c0b3c20 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3281a45640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f327c0b3810 con 0x7f327c0d0010 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3281a45640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f327c1637c0 con 0x7f327c0b33e0 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b3c20 0x7f327c0a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b3c20 0x7f327c0a03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40578/0 (socket says 172.21.15.137:40578) 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327a7fc640 1 -- 172.21.15.137:0/2918825096 learned_addr learned my addr 172.21.15.137:0/2918825096 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327b7fe640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f327c0d0010 0x7f327c1f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327affd640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f327c0b33e0 0x7f327c15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327a7fc640 1 -- 172.21.15.137:0/2918825096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f327c0b33e0 msgr2=0x7f327c15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327a7fc640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f327c0b33e0 0x7f327c15d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327a7fc640 1 -- 172.21.15.137:0/2918825096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f327c0d0010 msgr2=0x7f327c1f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:30.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327a7fc640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f327c0d0010 0x7f327c1f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:30.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327a7fc640 1 -- 172.21.15.137:0/2918825096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327c0a0a70 con 0x7f327c0b3c20 2024-04-26T22:07:30.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f327a7fc640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b3c20 0x7f327c0a03b0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f327000c480 tx=0x7f327000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:30.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3263fff640 1 -- 172.21.15.137:0/2918825096 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32700052d0 con 0x7f327c0b3c20 2024-04-26T22:07:30.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3263fff640 1 -- 172.21.15.137:0/2918825096 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3270005470 con 0x7f327c0b3c20 2024-04-26T22:07:30.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3263fff640 1 -- 172.21.15.137:0/2918825096 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270012870 con 0x7f327c0b3c20 2024-04-26T22:07:30.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327c1f69d0 con 0x7f327c0b3c20 2024-04-26T22:07:30.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.951+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f327c1e8890 con 0x7f327c0b3c20 2024-04-26T22:07:30.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.952+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327c06a290 con 0x7f327c0b3c20 2024-04-26T22:07:30.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.953+0000 7f3263fff640 1 -- 172.21.15.137:0/2918825096 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3270012a10 con 0x7f327c0b3c20 2024-04-26T22:07:30.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.953+0000 7f3263fff640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f326806c8f0 0x7f326806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:30.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.953+0000 7f3263fff640 1 -- 172.21.15.137:0/2918825096 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5029+0+0 (secure 0 0 0) 0x7f327008b4c0 con 0x7f327c0b3c20 2024-04-26T22:07:30.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.953+0000 7f327affd640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f326806c8f0 0x7f326806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:30.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.954+0000 7f327affd640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f326806c8f0 0x7f326806edb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f326c006fd0 tx=0x7f326c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:30.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:30.958+0000 7f3263fff640 1 -- 172.21.15.137:0/2918825096 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3270059c20 con 0x7f327c0b3c20 2024-04-26T22:07:31.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.130+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f327c0c9a40 con 0x7f327c0b3c20 2024-04-26T22:07:31.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.130+0000 7f3263fff640 1 -- 172.21.15.137:0/2918825096 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) ==== 93+0+10 (secure 0 0 0) 0x7f3270059520 con 0x7f327c0b3c20 2024-04-26T22:07:31.130 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:07:31.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f326806c8f0 msgr2=0x7f326806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f326806c8f0 0x7f326806edb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f326c006fd0 tx=0x7f326c008040 comp rx=0 tx=0).stop 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b3c20 msgr2=0x7f327c0a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b3c20 0x7f327c0a03b0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f327000c480 tx=0x7f327000c940 comp rx=0 tx=0).stop 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 shutdown_connections 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f326806c8f0 0x7f326806edb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f327c0b3c20 0x7f327c0a03b0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f327c0d0010 0x7f327c1f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 --2- 172.21.15.137:0/2918825096 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f327c0b33e0 0x7f327c15d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 >> 172.21.15.137:0/2918825096 conn(0x7f327c09ba40 msgr2=0x7f327c161c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 shutdown_connections 2024-04-26T22:07:31.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.132+0000 7f3281a45640 1 -- 172.21.15.137:0/2918825096 wait complete. 2024-04-26T22:07:31.143 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-26T22:07:31.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.243+0000 7f8eb0778640 1 Processor -- start 2024-04-26T22:07:31.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.243+0000 7f8eb0778640 1 -- start start 2024-04-26T22:07:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.244+0000 7f8eb0778640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea815c290 0x7f8ea8074210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.244+0000 7f8eb0778640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8ea80b4cb0 0x7f8ea80b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.244+0000 7f8eb0778640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea815c670 con 0x7f8ea80b4160 2024-04-26T22:07:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.244+0000 7f8eb0778640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea80b0c10 con 0x7f8ea80b4cb0 2024-04-26T22:07:31.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.244+0000 7f8eb0778640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea8074750 con 0x7f8ea815c290 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.244+0000 7f8eadd13640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8ea80b4160 0x7f8ea80b45a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39832/0 (socket says 172.21.15.137:39832) 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.244+0000 7f8eadd13640 1 -- 172.21.15.137:0/840114012 learned_addr learned my addr 172.21.15.137:0/840114012 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344757148 0 0) 0x7f8ea815c670 con 0x7f8ea80b4160 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e94003520 con 0x7f8ea80b4160 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eae514640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea815c290 0x7f8ea8074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eaed15640 1 --2- 172.21.15.137:0/840114012 >> v2:172.21.15.170:3300/0 conn(0x7f8ea80b4cb0 0x7f8ea80b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3356224529 0 0) 0x7f8e94003520 con 0x7f8ea80b4160 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea815c290 msgr2=0x7f8ea8074210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea815c290 0x7f8ea8074210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 >> v2:172.21.15.170:3300/0 conn(0x7f8ea80b4cb0 msgr2=0x7f8ea80b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 --2- 172.21.15.137:0/840114012 >> v2:172.21.15.170:3300/0 conn(0x7f8ea80b4cb0 0x7f8ea80b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea80afb10 con 0x7f8ea80b4160 2024-04-26T22:07:31.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f8e98001690 con 0x7f8ea80b4160 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 >> v1:172.21.15.137:6789/0 conn(0x7f8ea80b4160 legacy=0x7f8ea80b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e940039b0 0x7f8e94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8e94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea815c290 0x7f8e940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea80b0c10 con 0x7f8e94004800 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8074750 con 0x7f8e940039b0 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8e9400b9c0 con 0x7f8ea815c290 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eadd13640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8e94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eae514640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e940039b0 0x7f8e94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eaed15640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea815c290 0x7f8e940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eadd13640 1 -- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea815c290 msgr2=0x7f8e940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:31.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eadd13640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea815c290 0x7f8e940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eadd13640 1 -- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e940039b0 msgr2=0x7f8e94003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eadd13640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e940039b0 0x7f8e94003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eadd13640 1 -- 172.21.15.137:0/840114012 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e94003520 con 0x7f8e94004800 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.245+0000 7f8eaed15640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea815c290 0x7f8e940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.246+0000 7f8eadd13640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8e94004c80 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c210 tx=0x7f8e94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a04da50a11efb2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.246+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9802e070 con 0x7f8e94004800 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.246+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e98005af0 con 0x7f8e94004800 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.246+0000 7f8ead512640 1 -- 172.21.15.137:0/840114012 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98007d70 con 0x7f8e94004800 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.247+0000 7f8eb0778640 1 -- 172.21.15.137:0/840114012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 msgr2=0x7f8e94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.247+0000 7f8eb0778640 1 --2- 172.21.15.137:0/840114012 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8e94004c80 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f8e9800c210 tx=0x7f8e94005830 comp rx=0 tx=0).stop 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.247+0000 7f8eaed15640 1 -- 172.21.15.137:0/840114012 reap_dead start 2024-04-26T22:07:31.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.247+0000 7f8eb0778640 1 -- 172.21.15.137:0/840114012 shutdown_connections 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.247+0000 7f8eb0778640 1 -- 172.21.15.137:0/840114012 >> 172.21.15.137:0/840114012 conn(0x7f8ea80b68a0 msgr2=0x7f8ea8073950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.247+0000 7f8eb0778640 1 -- 172.21.15.137:0/840114012 shutdown_connections 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.247+0000 7f8eb0778640 1 -- 172.21.15.137:0/840114012 wait complete. 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.248+0000 7f8eb0778640 1 Processor -- start 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.248+0000 7f8eb0778640 1 -- start start 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eb0778640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8ea80b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eb0778640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8151c60 0x7f8ea81f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eb0778640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ea81f2da0 0x7f8ea815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eb0778640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea80b05c0 con 0x7f8e94004800 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eb0778640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea80b02e0 con 0x7f8ea81f2da0 2024-04-26T22:07:31.256 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eb0778640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea80b08a0 con 0x7f8ea8151c60 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eae514640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8ea80b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eae514640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8ea80b1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40586/0 (socket says 172.21.15.137:40586) 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eae514640 1 -- 172.21.15.137:0/2066344607 learned_addr learned my addr 172.21.15.137:0/2066344607 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eae514640 1 -- 172.21.15.137:0/2066344607 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8151c60 msgr2=0x7f8ea81f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eae514640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8151c60 0x7f8ea81f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eae514640 1 -- 172.21.15.137:0/2066344607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ea81f2da0 msgr2=0x7f8ea815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eae514640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ea81f2da0 0x7f8ea815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eae514640 1 -- 172.21.15.137:0/2066344607 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea8152140 con 0x7f8e94004800 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eae514640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8ea80b1c80 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40118e0 tx=0x7f8ea4011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8e9effd640 1 -- 172.21.15.137:0/2066344607 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400fa70 con 0x7f8e94004800 2024-04-26T22:07:31.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8e9effd640 1 -- 172.21.15.137:0/2066344607 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea400fc10 con 0x7f8e94004800 2024-04-26T22:07:31.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea8152420 con 0x7f8e94004800 2024-04-26T22:07:31.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8e9effd640 1 -- 172.21.15.137:0/2066344607 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4014440 con 0x7f8e94004800 2024-04-26T22:07:31.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.249+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea81529e0 con 0x7f8e94004800 2024-04-26T22:07:31.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.250+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea80693d0 con 0x7f8e94004800 2024-04-26T22:07:31.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.251+0000 7f8e9effd640 1 -- 172.21.15.137:0/2066344607 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ea4012040 con 0x7f8e94004800 2024-04-26T22:07:31.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.251+0000 7f8e9effd640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.251+0000 7f8e9effd640 1 -- 172.21.15.137:0/2066344607 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5029+0+0 (secure 0 0 0) 0x7f8ea408bf20 con 0x7f8e94004800 2024-04-26T22:07:31.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.251+0000 7f8eadd13640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.252+0000 7f8eadd13640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8e98033000 tx=0x7f8e98009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:31.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.256+0000 7f8e9effd640 1 -- 172.21.15.137:0/2066344607 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8ea4019030 con 0x7f8e94004800 2024-04-26T22:07:31.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.498+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7f8ea806e6a0 con 0x7f8e94004800 2024-04-26T22:07:31.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.521+0000 7f8e9effd640 1 -- 172.21.15.137:0/2066344607 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v413) ==== 147+0+0 (secure 0 0 0) 0x7f8ea4059fa0 con 0x7f8e94004800 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e8c06c8f0 msgr2=0x7f8e8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8e98033000 tx=0x7f8e98009030 comp rx=0 tx=0).stop 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 msgr2=0x7f8ea80b1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8ea80b1c80 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40118e0 tx=0x7f8ea4011da0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 shutdown_connections 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e8c06c8f0 0x7f8e8c06edb0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ea81f2da0 0x7f8ea815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8151c60 0x7f8ea81f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 --2- 172.21.15.137:0/2066344607 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e94004800 0x7f8ea80b1c80 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 >> 172.21.15.137:0/2066344607 conn(0x7f8ea80b68a0 msgr2=0x7f8ea806ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 shutdown_connections 2024-04-26T22:07:31.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.524+0000 7f8eb0778640 1 -- 172.21.15.137:0/2066344607 wait complete. 2024-04-26T22:07:31.535 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T22:07:31.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.634+0000 7f90b75b4640 1 Processor -- start 2024-04-26T22:07:31.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.634+0000 7f90b75b4640 1 -- start start 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b75b4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f90b006f340 0x7f90b00b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b75b4640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b00b46a0 con 0x7f90b00b3e50 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b75b4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b00b5db0 con 0x7f90b00d0300 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b75b4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f90b00b6090 con 0x7f90b006f340 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b5350640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f90b006f340 0x7f90b00b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b5b51640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f90b00b3e50 0x7f90b00720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39842/0 (socket says 172.21.15.137:39842) 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b5b51640 1 -- 172.21.15.137:0/834763769 learned_addr learned my addr 172.21.15.137:0/834763769 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b5350640 1 -- 172.21.15.137:0/834763769 >> v1:172.21.15.170:6789/0 conn(0x7f90b00d0300 legacy=0x7f90b006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b5350640 1 -- 172.21.15.137:0/834763769 >> v1:172.21.15.137:6789/0 conn(0x7f90b00b3e50 legacy=0x7f90b00720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90b5350640 1 -- 172.21.15.137:0/834763769 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b00b6370 con 0x7f90b006f340 2024-04-26T22:07:31.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.635+0000 7f90a7fff640 1 -- 172.21.15.137:0/834763769 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864518354 0 0) 0x7f90b00b46a0 con 0x7f90b00b3e50 2024-04-26T22:07:31.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.636+0000 7f90b5350640 1 --2- 172.21.15.137:0/834763769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b006f340 0x7f90b00b6b70 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0097a0 tx=0x7f90ac02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626a94fefd0f3be8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:31.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.636+0000 7f90a7fff640 1 -- 172.21.15.137:0/834763769 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac037070 con 0x7f90b006f340 2024-04-26T22:07:31.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.636+0000 7f90a7fff640 1 -- 172.21.15.137:0/834763769 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ac02adc0 con 0x7f90b006f340 2024-04-26T22:07:31.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.636+0000 7f90a7fff640 1 -- 172.21.15.137:0/834763769 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac032660 con 0x7f90b006f340 2024-04-26T22:07:31.639 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.637+0000 7f90b75b4640 1 -- 172.21.15.137:0/834763769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b006f340 msgr2=0x7f90b00b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.637+0000 7f90b75b4640 1 --2- 172.21.15.137:0/834763769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b006f340 0x7f90b00b6b70 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0097a0 tx=0x7f90ac02a0b0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.637+0000 7f90b75b4640 1 -- 172.21.15.137:0/834763769 shutdown_connections 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.637+0000 7f90b75b4640 1 --2- 172.21.15.137:0/834763769 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b006f340 0x7f90b00b6b70 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.637+0000 7f90b75b4640 1 -- 172.21.15.137:0/834763769 >> 172.21.15.137:0/834763769 conn(0x7f90b00cd8a0 msgr2=0x7f90b00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.637+0000 7f90b75b4640 1 -- 172.21.15.137:0/834763769 shutdown_connections 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.637+0000 7f90b75b4640 1 -- 172.21.15.137:0/834763769 wait complete. 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.638+0000 7f90b75b4640 1 Processor -- start 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.638+0000 7f90b75b4640 1 -- start start 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.638+0000 7f90b75b4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90b006f340 0x7f90b013e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.638+0000 7f90b75b4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b00b3e50 0x7f90b01e4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.638+0000 7f90b75b4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f90b00d0300 0x7f90b01403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b75b4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00b4460 con 0x7f90b00b3e50 2024-04-26T22:07:31.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b75b4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00b42e0 con 0x7f90b006f340 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b75b4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f90b0142a30 con 0x7f90b00d0300 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b4b4f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b00b3e50 0x7f90b01e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b4b4f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b00b3e50 0x7f90b01e4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40596/0 (socket says 172.21.15.137:40596) 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b4b4f640 1 -- 172.21.15.137:0/259361578 learned_addr learned my addr 172.21.15.137:0/259361578 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b4b4f640 1 -- 172.21.15.137:0/259361578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f90b00d0300 msgr2=0x7f90b01403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b4b4f640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f90b00d0300 0x7f90b01403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b4b4f640 1 -- 172.21.15.137:0/259361578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90b006f340 msgr2=0x7f90b013e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b5350640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90b006f340 0x7f90b013e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b4b4f640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90b006f340 0x7f90b013e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b4b4f640 1 -- 172.21.15.137:0/259361578 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b01e53b0 con 0x7f90b00b3e50 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b4b4f640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b00b3e50 0x7f90b01e4960 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c410 tx=0x7f90a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90a5ffb640 1 -- 172.21.15.137:0/259361578 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0017070 con 0x7f90b00b3e50 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90a5ffb640 1 -- 172.21.15.137:0/259361578 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a00035f0 con 0x7f90b00b3e50 2024-04-26T22:07:31.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90a5ffb640 1 -- 172.21.15.137:0/259361578 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0003a20 con 0x7f90b00b3e50 2024-04-26T22:07:31.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.639+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b01e5690 con 0x7f90b00b3e50 2024-04-26T22:07:31.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.640+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b01e5c50 con 0x7f90b00b3e50 2024-04-26T22:07:31.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.640+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b006a290 con 0x7f90b00b3e50 2024-04-26T22:07:31.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.641+0000 7f90a5ffb640 1 -- 172.21.15.137:0/259361578 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90a0003bc0 con 0x7f90b00b3e50 2024-04-26T22:07:31.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.641+0000 7f90a5ffb640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f909406c8f0 0x7f909406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:31.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.641+0000 7f90a5ffb640 1 -- 172.21.15.137:0/259361578 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5029+0+0 (secure 0 0 0) 0x7f90a008aaf0 con 0x7f90b00b3e50 2024-04-26T22:07:31.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.641+0000 7f90b5350640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f909406c8f0 0x7f909406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:31.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.642+0000 7f90b5350640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f909406c8f0 0x7f909406edb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f90ac034000 tx=0x7f90ac02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:31.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.645+0000 7f90a5ffb640 1 -- 172.21.15.137:0/259361578 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f90a0059250 con 0x7f90b00b3e50 2024-04-26T22:07:31.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.820+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f90b0075760 con 0x7f90b00b3e50 2024-04-26T22:07:31.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.825+0000 7f90a5ffb640 1 -- 172.21.15.137:0/259361578 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f90a0058b50 con 0x7f90b00b3e50 2024-04-26T22:07:31.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f909406c8f0 msgr2=0x7f909406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f909406c8f0 0x7f909406edb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f90ac034000 tx=0x7f90ac02e000 comp rx=0 tx=0).stop 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b00b3e50 msgr2=0x7f90b01e4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b00b3e50 0x7f90b01e4960 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c410 tx=0x7f90a000c8d0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 shutdown_connections 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f909406c8f0 0x7f909406edb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f90b00b3e50 0x7f90b01e4960 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f90b00d0300 0x7f90b01403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 --2- 172.21.15.137:0/259361578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90b006f340 0x7f90b013e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 >> 172.21.15.137:0/259361578 conn(0x7f90b00cd8a0 msgr2=0x7f90b015e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 shutdown_connections 2024-04-26T22:07:31.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:31.827+0000 7f90b75b4640 1 -- 172.21.15.137:0/259361578 wait complete. 2024-04-26T22:07:31.838 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:07:31.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:07:31.884 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:07:31.924 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:07:31.925 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:31.925 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:31.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:07:31.940 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:07:31.940 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:31.983 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:07:31.983 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:31.983 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:32.001 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:07:32.001 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:07:32.001 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:32.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:07:32.041 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T22:07:32.041 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.139+0000 7fedaadf7640 1 Processor -- start 2024-04-26T22:07:32.139 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.139+0000 7fedaadf7640 1 -- start start 2024-04-26T22:07:32.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7fedaadf7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feda415d130 0x7feda406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7fedaadf7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4070d00 0x7feda406d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7fedaadf7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda415d510 con 0x7feda40733c0 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7fedaadf7640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7feda40b0e80 con 0x7feda415d130 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7fedaadf7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feda40b54f0 con 0x7feda4070d00 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7feda8b93640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7feda415d130 0x7feda406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7feda3fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7feda40733c0 0x7feda4160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39854/0 (socket says 172.21.15.137:39854) 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7feda3fff640 1 -- 172.21.15.137:0/2211656049 learned_addr learned my addr 172.21.15.137:0/2211656049 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7feda8b93640 1 -- 172.21.15.137:0/2211656049 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4070d00 msgr2=0x7feda406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7feda8b93640 1 --2- 172.21.15.137:0/2211656049 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4070d00 0x7feda406d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7feda8b93640 1 -- 172.21.15.137:0/2211656049 >> v1:172.21.15.137:6789/0 conn(0x7feda40733c0 legacy=0x7feda4160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7feda8b93640 1 -- 172.21.15.137:0/2211656049 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda40d12c0 con 0x7feda415d130 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.140+0000 7feda37fe640 1 -- 172.21.15.137:0/2211656049 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480010662 0 0) 0x7feda415d510 con 0x7feda40733c0 2024-04-26T22:07:32.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7feda8b93640 1 --2- 172.21.15.137:0/2211656049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda415d130 0x7feda406d2b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fed980097a0 tx=0x7fed9802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5666748ee7443d8f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7feda37fe640 1 -- 172.21.15.137:0/2211656049 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98037070 con 0x7feda415d130 2024-04-26T22:07:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7feda37fe640 1 -- 172.21.15.137:0/2211656049 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed98032440 con 0x7feda415d130 2024-04-26T22:07:32.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7feda37fe640 1 -- 172.21.15.137:0/2211656049 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98032810 con 0x7feda415d130 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7fedaadf7640 1 -- 172.21.15.137:0/2211656049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda415d130 msgr2=0x7feda406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7fedaadf7640 1 --2- 172.21.15.137:0/2211656049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda415d130 0x7feda406d2b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fed980097a0 tx=0x7fed9802a180 comp rx=0 tx=0).stop 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7fedaadf7640 1 -- 172.21.15.137:0/2211656049 shutdown_connections 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7fedaadf7640 1 --2- 172.21.15.137:0/2211656049 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda4070d00 0x7feda406d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7fedaadf7640 1 --2- 172.21.15.137:0/2211656049 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda415d130 0x7feda406d2b0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.141+0000 7fedaadf7640 1 -- 172.21.15.137:0/2211656049 >> 172.21.15.137:0/2211656049 conn(0x7feda40728a0 msgr2=0x7feda4072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.142+0000 7fedaadf7640 1 -- 172.21.15.137:0/2211656049 shutdown_connections 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.142+0000 7fedaadf7640 1 -- 172.21.15.137:0/2211656049 wait complete. 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.143+0000 7fedaadf7640 1 Processor -- start 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.143+0000 7fedaadf7640 1 -- start start 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.143+0000 7fedaadf7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4070d00 0x7feda40ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7fedaadf7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40733c0 0x7feda40701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7fedaadf7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda415d130 0x7feda4147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7fedaadf7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7feda40d07e0 con 0x7feda40733c0 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7fedaadf7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7feda40d0500 con 0x7feda4070d00 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7fedaadf7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7feda40d0ac0 con 0x7feda415d130 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40733c0 0x7feda40701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40733c0 0x7feda40701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40614/0 (socket says 172.21.15.137:40614) 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda3fff640 1 -- 172.21.15.137:0/4247783980 learned_addr learned my addr 172.21.15.137:0/4247783980 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda8b93640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4070d00 0x7feda40ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda9394640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda415d130 0x7feda4147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda3fff640 1 -- 172.21.15.137:0/4247783980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda415d130 msgr2=0x7feda4147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda3fff640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda415d130 0x7feda4147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda3fff640 1 -- 172.21.15.137:0/4247783980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4070d00 msgr2=0x7feda40ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda3fff640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4070d00 0x7feda40ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda3fff640 1 -- 172.21.15.137:0/4247783980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda40aa4a0 con 0x7feda40733c0 2024-04-26T22:07:32.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda3fff640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40733c0 0x7feda40701f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fed9000c4e0 tx=0x7fed9000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda17fa640 1 -- 172.21.15.137:0/4247783980 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90018070 con 0x7feda40733c0 2024-04-26T22:07:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda17fa640 1 -- 172.21.15.137:0/4247783980 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed90007500 con 0x7feda40733c0 2024-04-26T22:07:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7feda17fa640 1 -- 172.21.15.137:0/4247783980 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90004a20 con 0x7feda40733c0 2024-04-26T22:07:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda40aa780 con 0x7feda40733c0 2024-04-26T22:07:32.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.144+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda40aad40 con 0x7feda40733c0 2024-04-26T22:07:32.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.145+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda406a290 con 0x7feda40733c0 2024-04-26T22:07:32.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.146+0000 7feda17fa640 1 -- 172.21.15.137:0/4247783980 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed9001b070 con 0x7feda40733c0 2024-04-26T22:07:32.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.146+0000 7feda17fa640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.146+0000 7feda17fa640 1 -- 172.21.15.137:0/4247783980 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5029+0+0 (secure 0 0 0) 0x7fed9008ab80 con 0x7feda40733c0 2024-04-26T22:07:32.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.146+0000 7feda8b93640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.147+0000 7feda8b93640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fed98034000 tx=0x7fed9802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:32.150 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.150+0000 7feda17fa640 1 -- 172.21.15.137:0/4247783980 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fed900593a0 con 0x7feda40733c0 2024-04-26T22:07:32.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.366+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feda4072ed0 con 0x7feda40733c0 2024-04-26T22:07:32.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.366+0000 7feda17fa640 1 -- 172.21.15.137:0/4247783980 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+3881 (secure 0 0 0) 0x7fed90058ca0 con 0x7feda40733c0 2024-04-26T22:07:32.366 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:32.367 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6931,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2811281197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":2811281197},{"type":"v1","addr":"172.21.15.170:6834","nonce":2811281197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":7168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1497562955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1497562955},{"type":"v1","addr":"172.21.15.170:6835","nonce":1497562955}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":8220,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1594915321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1594915321},{"type":"v1","addr":"172.21.15.137:6837","nonce":1594915321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8688,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/2702617920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":2702617920},{"type":"v1","addr":"172.21.15.137:6836","nonce":2702617920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74}],"filesystems":[]} 2024-04-26T22:07:32.367 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 76 2024-04-26T22:07:32.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 msgr2=0x7fed8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fed98034000 tx=0x7fed9802e000 comp rx=0 tx=0).stop 2024-04-26T22:07:32.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40733c0 msgr2=0x7feda40701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40733c0 0x7feda40701f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fed9000c4e0 tx=0x7fed9000c9a0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 shutdown_connections 2024-04-26T22:07:32.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fed8806c8f0 0x7fed8806edb0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7feda40733c0 0x7feda40701f0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7feda415d130 0x7feda4147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 --2- 172.21.15.137:0/4247783980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feda4070d00 0x7feda40ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 >> 172.21.15.137:0/4247783980 conn(0x7feda40728a0 msgr2=0x7feda40b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:32.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 shutdown_connections 2024-04-26T22:07:32.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.368+0000 7fedaadf7640 1 -- 172.21.15.137:0/4247783980 wait complete. 2024-04-26T22:07:32.380 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T22:07:32.380 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T22:07:32.380 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:07:32.380 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:07:32.380 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T22:07:32.380 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T22:07:32.381 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T22:07:32.381 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:07:32.381 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T22:07:32.381 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T22:07:32.381 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:07:32.381 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:07:32.382 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T22:07:32.382 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T22:07:32.382 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T22:07:32.382 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:07:32.391 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:07:32.391 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T22:07:32.392 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T22:07:32.392 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T22:07:32.396 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T22:07:32.396 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T22:07:32.397 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:07:32.397 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T22:07:32.434 INFO:tasks.ceph.mds.a:Started 2024-04-26T22:07:32.434 DEBUG:teuthology.parallel:result is None 2024-04-26T22:07:32.434 INFO:tasks.ceph.mds.c:Started 2024-04-26T22:07:32.435 DEBUG:teuthology.parallel:result is None 2024-04-26T22:07:32.438 INFO:tasks.ceph.mds.d:Started 2024-04-26T22:07:32.439 DEBUG:teuthology.parallel:result is None 2024-04-26T22:07:32.439 INFO:tasks.ceph.mds.b:Started 2024-04-26T22:07:32.439 DEBUG:teuthology.parallel:result is None 2024-04-26T22:07:32.440 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T22:07:32.507 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:07:32.507 INFO:tasks.ceph.mds.c.smithi137.stdout:starting mds.c at 2024-04-26T22:07:32.507 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:07:32.508+0000 7f768a117640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-26T22:07:32.523 INFO:tasks.ceph.mds.d.smithi170.stdout:starting mds.d at 2024-04-26T22:07:32.523 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T22:07:32.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.542+0000 7f0f2f31c640 1 Processor -- start 2024-04-26T22:07:32.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.542+0000 7f0f2f31c640 1 -- start start 2024-04-26T22:07:32.543 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.543+0000 7f0f2f31c640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0f2815f370 0x7f0f280cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.543+0000 7f0f2f31c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.543+0000 7f0f2f31c640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f280d03a0 con 0x7f0f2815f750 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.543+0000 7f0f2f31c640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0f280b4d10 con 0x7f0f2815f370 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.543+0000 7f0f2f31c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f280d0680 con 0x7f0f280d3ee0 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.544+0000 7f0f2d8b9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.544+0000 7f0f2d0b8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0f2815f370 0x7f0f280cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.544+0000 7f0f2d8b9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:37340/0 (socket says 172.21.15.137:37340) 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.544+0000 7f0f2d8b9640 1 -- 172.21.15.137:0/2896317919 learned_addr learned my addr 172.21.15.137:0/2896317919 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.544+0000 7f0f2d8b9640 1 -- 172.21.15.137:0/2896317919 >> v2:172.21.15.170:3300/0 conn(0x7f0f2815f370 msgr2=0x7f0f280cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.544+0000 7f0f2d8b9640 1 --2- 172.21.15.137:0/2896317919 >> v2:172.21.15.170:3300/0 conn(0x7f0f2815f370 0x7f0f280cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.544+0000 7f0f2d8b9640 1 -- 172.21.15.137:0/2896317919 >> v1:172.21.15.170:6789/0 conn(0x7f0f2815f750 legacy=0x7f0f280d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.544 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.544+0000 7f0f2d8b9640 1 -- 172.21.15.137:0/2896317919 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f280d0960 con 0x7f0f280d3ee0 2024-04-26T22:07:32.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f2d8b9640 1 --2- 172.21.15.137:0/2896317919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b47d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009e50 tx=0x7f0f2002a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed22a87b483f69ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:32.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f1ffff640 1 -- 172.21.15.137:0/2896317919 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f20036070 con 0x7f0f280d3ee0 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f1ffff640 1 -- 172.21.15.137:0/2896317919 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f20031600 con 0x7f0f280d3ee0 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f1ffff640 1 -- 172.21.15.137:0/2896317919 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f200319d0 con 0x7f0f280d3ee0 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f2f31c640 1 -- 172.21.15.137:0/2896317919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 msgr2=0x7f0f280b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f2f31c640 1 --2- 172.21.15.137:0/2896317919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b47d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009e50 tx=0x7f0f2002a630 comp rx=0 tx=0).stop 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f2f31c640 1 -- 172.21.15.137:0/2896317919 shutdown_connections 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f2f31c640 1 --2- 172.21.15.137:0/2896317919 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b47d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f2f31c640 1 --2- 172.21.15.137:0/2896317919 >> v2:172.21.15.170:3300/0 conn(0x7f0f2815f370 0x7f0f280cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f2f31c640 1 -- 172.21.15.137:0/2896317919 >> 172.21.15.137:0/2896317919 conn(0x7f0f2808ec10 msgr2=0x7f0f2809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f2f31c640 1 -- 172.21.15.137:0/2896317919 shutdown_connections 2024-04-26T22:07:32.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.545+0000 7f0f2f31c640 1 -- 172.21.15.137:0/2896317919 wait complete. 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.546+0000 7f0f2f31c640 1 Processor -- start 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.546+0000 7f0f2f31c640 1 -- start start 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2f31c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2f31c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f2815f370 0x7f0f28153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2f31c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f2815f750 0x7f0f28153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2f31c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0f280b51c0 con 0x7f0f2815f370 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2f31c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0f280d0f20 con 0x7f0f2815f750 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2f31c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0f280b5340 con 0x7f0f280d3ee0 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2c8b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f2815f370 0x7f0f28153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2c8b7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f2815f370 0x7f0f28153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40678/0 (socket says 172.21.15.137:40678) 2024-04-26T22:07:32.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2c8b7640 1 -- 172.21.15.137:0/163221419 learned_addr learned my addr 172.21.15.137:0/163221419 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2d0b8640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.547+0000 7f0f2d8b9640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f2815f750 0x7f0f28153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2d0b8640 1 -- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f2815f750 msgr2=0x7f0f28153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2d0b8640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f2815f750 0x7f0f28153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2d0b8640 1 -- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f2815f370 msgr2=0x7f0f28153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2d0b8640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f2815f370 0x7f0f28153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2d0b8640 1 -- 172.21.15.137:0/163221419 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f281f5bf0 con 0x7f0f280d3ee0 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2d8b9640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f2815f750 0x7f0f28153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2c8b7640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f2815f370 0x7f0f28153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2d0b8640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b9c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400e850 tx=0x7f0f2400ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f1dffb640 1 -- 172.21.15.137:0/163221419 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24017070 con 0x7f0f280d3ee0 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2815fde0 con 0x7f0f280d3ee0 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f1dffb640 1 -- 172.21.15.137:0/163221419 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2400c940 con 0x7f0f280d3ee0 2024-04-26T22:07:32.550 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f1dffb640 1 -- 172.21.15.137:0/163221419 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400cd10 con 0x7f0f280d3ee0 2024-04-26T22:07:32.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.548+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f281603a0 con 0x7f0f280d3ee0 2024-04-26T22:07:32.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.549+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f2806a290 con 0x7f0f280d3ee0 2024-04-26T22:07:32.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.550+0000 7f0f1dffb640 1 -- 172.21.15.137:0/163221419 <== mon.2 v2:172.21.15.170:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f2401a070 con 0x7f0f280d3ee0 2024-04-26T22:07:32.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.551+0000 7f0f1dffb640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0c06cb20 0x7f0f0c06efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:32.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.551+0000 7f0f2c8b7640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0c06cb20 0x7f0f0c06efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:32.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.551+0000 7f0f1dffb640 1 -- 172.21.15.137:0/163221419 <== mon.2 v2:172.21.15.170:3301/0 5 ==== osd_map(109..109 src has 1..109) ==== 5029+0+0 (secure 0 0 0) 0x7f0f2400caf0 con 0x7f0f280d3ee0 2024-04-26T22:07:32.552 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.551+0000 7f0f2c8b7640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0c06cb20 0x7f0f0c06efe0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0f280bab10 tx=0x7f0f18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:32.554 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.555+0000 7f0f1dffb640 1 -- 172.21.15.137:0/163221419 <== mon.2 v2:172.21.15.170:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0f24059e00 con 0x7f0f280d3ee0 2024-04-26T22:07:32.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:32.741+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0f280d1610 con 0x7f0f280d3ee0 2024-04-26T22:07:33.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.531+0000 7f0f1dffb640 1 -- 172.21.15.137:0/163221419 <== mon.2 v2:172.21.15.170:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) ==== 97+0+0 (secure 0 0 0) 0x7f0f2405e100 con 0x7f0f280d3ee0 2024-04-26T22:07:33.531 INFO:teuthology.orchestra.run.smithi137.stderr: removed all blocklist entries 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0c06cb20 msgr2=0x7f0f0c06efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0c06cb20 0x7f0f0c06efe0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0f280bab10 tx=0x7f0f18009040 comp rx=0 tx=0).stop 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 msgr2=0x7f0f280b9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b9c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400e850 tx=0x7f0f2400ed10 comp rx=0 tx=0).stop 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 shutdown_connections 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0f0c06cb20 0x7f0f0c06efe0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0f2815f370 0x7f0f28153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f2815f750 0x7f0f28153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 --2- 172.21.15.137:0/163221419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0f280d3ee0 0x7f0f280b9c00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.533+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 >> 172.21.15.137:0/163221419 conn(0x7f0f2808ec10 msgr2=0x7f0f2806d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.534+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 shutdown_connections 2024-04-26T22:07:33.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.534+0000 7f0f2f31c640 1 -- 172.21.15.137:0/163221419 wait complete. 2024-04-26T22:07:33.546 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T22:07:33.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.647+0000 7fd4891e2640 1 Processor -- start 2024-04-26T22:07:33.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.648+0000 7fd4891e2640 1 -- start start 2024-04-26T22:07:33.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.648+0000 7fd4891e2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd48415f4a0 0x7fd4840b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:33.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.648+0000 7fd4891e2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4840afe30 0x7fd4840b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:33.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.648+0000 7fd4891e2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4840b6320 0x7fd484162f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.648+0000 7fd4891e2640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd48415f880 con 0x7fd4840afe30 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.648+0000 7fd4891e2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd4840af9a0 con 0x7fd48415f4a0 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.648+0000 7fd4891e2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd4840aed90 con 0x7fd4840b6320 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.648+0000 7fd48259c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4840afe30 0x7fd4840b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd48259c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd4840afe30 0x7fd4840b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40690/0 (socket says 172.21.15.137:40690) 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd48259c640 1 -- 172.21.15.137:0/1338154088 learned_addr learned my addr 172.21.15.137:0/1338154088 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd48359e640 1 --2- 172.21.15.137:0/1338154088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4840b6320 0x7fd484162f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd482d9d640 1 --2- 172.21.15.137:0/1338154088 >> v2:172.21.15.170:3300/0 conn(0x7fd48415f4a0 0x7fd4840b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd48259c640 1 -- 172.21.15.137:0/1338154088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4840b6320 msgr2=0x7fd484162f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd48259c640 1 --2- 172.21.15.137:0/1338154088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4840b6320 0x7fd484162f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd48259c640 1 -- 172.21.15.137:0/1338154088 >> v2:172.21.15.170:3300/0 conn(0x7fd48415f4a0 msgr2=0x7fd4840b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd48259c640 1 --2- 172.21.15.137:0/1338154088 >> v2:172.21.15.170:3300/0 conn(0x7fd48415f4a0 0x7fd4840b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd48259c640 1 -- 172.21.15.137:0/1338154088 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840af070 con 0x7fd4840afe30 2024-04-26T22:07:33.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd482d9d640 1 --2- 172.21.15.137:0/1338154088 >> v2:172.21.15.170:3300/0 conn(0x7fd48415f4a0 0x7fd4840b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.649+0000 7fd48359e640 1 --2- 172.21.15.137:0/1338154088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4840b6320 0x7fd484162f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd48259c640 1 --2- 172.21.15.137:0/1338154088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840afe30 0x7fd4840b4600 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fd484072980 tx=0x7fd46c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac254dead9c0928 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd481d9b640 1 -- 172.21.15.137:0/1338154088 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c037070 con 0x7fd4840afe30 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd481d9b640 1 -- 172.21.15.137:0/1338154088 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46c032440 con 0x7fd4840afe30 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd481d9b640 1 -- 172.21.15.137:0/1338154088 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c032810 con 0x7fd4840afe30 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd4891e2640 1 -- 172.21.15.137:0/1338154088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840afe30 msgr2=0x7fd4840b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd4891e2640 1 --2- 172.21.15.137:0/1338154088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840afe30 0x7fd4840b4600 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fd484072980 tx=0x7fd46c02a1e0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd4891e2640 1 -- 172.21.15.137:0/1338154088 shutdown_connections 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd4891e2640 1 --2- 172.21.15.137:0/1338154088 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4840b6320 0x7fd484162f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd4891e2640 1 --2- 172.21.15.137:0/1338154088 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840afe30 0x7fd4840b4600 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd4891e2640 1 --2- 172.21.15.137:0/1338154088 >> v2:172.21.15.170:3300/0 conn(0x7fd48415f4a0 0x7fd4840b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd4891e2640 1 -- 172.21.15.137:0/1338154088 >> 172.21.15.137:0/1338154088 conn(0x7fd4840b6800 msgr2=0x7fd4840738c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd4891e2640 1 -- 172.21.15.137:0/1338154088 shutdown_connections 2024-04-26T22:07:33.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.650+0000 7fd4891e2640 1 -- 172.21.15.137:0/1338154088 wait complete. 2024-04-26T22:07:33.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.652+0000 7fd4891e2640 1 Processor -- start 2024-04-26T22:07:33.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.652+0000 7fd4891e2640 1 -- start start 2024-04-26T22:07:33.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.652+0000 7fd4891e2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4840afe30 0x7fd484156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:33.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.652+0000 7fd4891e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840b6320 0x7fd484160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:33.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd4891e2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd48415f4a0 0x7fd4841542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:33.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd4891e2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd4840aea80 con 0x7fd4840b6320 2024-04-26T22:07:33.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd4891e2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd4840af630 con 0x7fd4840afe30 2024-04-26T22:07:33.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd4891e2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd4841634c0 con 0x7fd48415f4a0 2024-04-26T22:07:33.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd48259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840b6320 0x7fd484160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd48259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840b6320 0x7fd484160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40700/0 (socket says 172.21.15.137:40700) 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd48259c640 1 -- 172.21.15.137:0/545004787 learned_addr learned my addr 172.21.15.137:0/545004787 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd48259c640 1 -- 172.21.15.137:0/545004787 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd48415f4a0 msgr2=0x7fd4841542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd48259c640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd48415f4a0 0x7fd4841542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd48259c640 1 -- 172.21.15.137:0/545004787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4840afe30 msgr2=0x7fd484156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd482d9d640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4840afe30 0x7fd484156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd48259c640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4840afe30 0x7fd484156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd48259c640 1 -- 172.21.15.137:0/545004787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd484160f90 con 0x7fd4840b6320 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd48259c640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840b6320 0x7fd484160a50 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000c00 tx=0x7fd46c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd47b7fe640 1 -- 172.21.15.137:0/545004787 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c041020 con 0x7fd4840b6320 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd47b7fe640 1 -- 172.21.15.137:0/545004787 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46c0306c0 con 0x7fd4840b6320 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd484161230 con 0x7fd4840b6320 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd47b7fe640 1 -- 172.21.15.137:0/545004787 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c037040 con 0x7fd4840b6320 2024-04-26T22:07:33.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.653+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd484161ad0 con 0x7fd4840b6320 2024-04-26T22:07:33.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.654+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484161620 con 0x7fd4840b6320 2024-04-26T22:07:33.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.655+0000 7fd47b7fe640 1 -- 172.21.15.137:0/545004787 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd46c044020 con 0x7fd4840b6320 2024-04-26T22:07:33.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.655+0000 7fd47b7fe640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd46406c8f0 0x7fd46406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:33.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.655+0000 7fd47b7fe640 1 -- 172.21.15.137:0/545004787 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7fd46c0ac050 con 0x7fd4840b6320 2024-04-26T22:07:33.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.655+0000 7fd482d9d640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd46406c8f0 0x7fd46406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:33.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.655+0000 7fd482d9d640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd46406c8f0 0x7fd46406edb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009ed0 tx=0x7fd47c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:33.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.659+0000 7fd47b7fe640 1 -- 172.21.15.137:0/545004787 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd46c04b030 con 0x7fd4840b6320 2024-04-26T22:07:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.904+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd4840b0d10 con 0x7fd4840b6320 2024-04-26T22:07:33.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.905+0000 7fd47b7fe640 1 -- 172.21.15.137:0/545004787 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fd4840b0d10 con 0x7fd4840b6320 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: "auth_dump": [ 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.a", 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmKffkBRAAh7EvvT0pmNbLKtJsBH/25Q==", 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.905 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.b", 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmd5UHERAAykWO/C56qwLwimzH2f6mcA==", 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.c", 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmMbCsDBAANF98tMtCSOy4TVN7I498cw==", 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:07:33.906 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mds.d", 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmQ47KFxAAsreL970BTH5yQLOol942iQ==", 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.907 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.0", 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBcIyxmY2T8NhAAMyJ5OP3dhuqMymrlUG4q2A==", 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.1", 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBfIyxmNfGnNRAAp+tTaVBwfAMUsyqRSgoRvw==", 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.908 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.2", 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBiIyxm3Q1yMxAAf7f6Me7uKYzM+Fp+2FCQsA==", 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.3", 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBlIyxmFcj2MRAAL/yPxOwtgMnfbmr0YUZs6Q==", 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:07:33.909 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.4", 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBpIyxmaaAqORAAfowCddy0wT/LptWvqD4CDw==", 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.5", 2024-04-26T22:07:33.910 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBsIyxmJaOFNhAAqjJAuU/SoVnjIAYCODWMnA==", 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.6", 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBvIyxmRkINNBAAjfFLMQ9/XMLLU8ZAoUxvkQ==", 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.911 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "osd.7", 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQByIyxmeF1gMRAAH0t727lSCZgkTgJ0ZXyA6g==", 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow profile osd", 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile osd", 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.0", 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ==", 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow r", 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T22:07:33.912 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.1", 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxms4U0JBAAMZ056L4EP1qzX2KVx8JiEg==", 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.2", 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmUnswIRAA5nYDanYzHiEVk98/041RHA==", 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.913 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.3", 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmHOORKRAA6Agn7TqBPywtop3Eo8+yFQ==", 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow", 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow r", 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow rw", 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow rwx" 2024-04-26T22:07:33.914 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "client.admin", 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxm7ue6JhAAyLiai4CKXmiB00fCAfp2WA==", 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "mgr": "allow *", 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow *", 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.x", 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBZIyxmFBrPAhAAfrkQvzF5SSyb5iQ0zr0eww==", 2024-04-26T22:07:33.915 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: }, 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: "entity": "mgr.y", 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: "key": "AQBYIyxmlrq3OhAA9Fd+zmECU9xK/pWp2Hg9kg==", 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: "caps": { 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: "mds": "allow *", 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: "mon": "allow profile mgr", 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: "osd": "allow *" 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout: ] 2024-04-26T22:07:33.916 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:07:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.906+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd46406c8f0 msgr2=0x7fd46406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.906+0000 7fd4891e2640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd46406c8f0 0x7fd46406edb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009ed0 tx=0x7fd47c00b040 comp rx=0 tx=0).stop 2024-04-26T22:07:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840b6320 msgr2=0x7fd484160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840b6320 0x7fd484160a50 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000c00 tx=0x7fd46c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 shutdown_connections 2024-04-26T22:07:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd46406c8f0 0x7fd46406edb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4840b6320 0x7fd484160a50 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd48415f4a0 0x7fd4841542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 --2- 172.21.15.137:0/545004787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd4840afe30 0x7fd484156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:33.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 >> 172.21.15.137:0/545004787 conn(0x7fd4840b6800 msgr2=0x7fd4840b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:33.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 shutdown_connections 2024-04-26T22:07:33.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:33.907+0000 7fd4891e2640 1 -- 172.21.15.137:0/545004787 wait complete. 2024-04-26T22:07:33.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.016+0000 7fa315d66640 1 Processor -- start 2024-04-26T22:07:34.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.016+0000 7fa315d66640 1 -- start start 2024-04-26T22:07:34.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa315d66640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa310145980 0x7fa310160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa315d66640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa3100b3de0 0x7fa3100b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa315d66640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3100b4260 con 0x7fa3100b5fd0 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa315d66640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa3100b5140 con 0x7fa310145980 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa315d66640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa3100b6410 con 0x7fa3100b3de0 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa30f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa310145980 0x7fa310160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa30f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa310145980 0x7fa310160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40716/0 (socket says 172.21.15.137:40716) 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa30f7fe640 1 -- 172.21.15.137:0/3592003237 learned_addr learned my addr 172.21.15.137:0/3592003237 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa30effd640 1 --2- 172.21.15.137:0/3592003237 >> v2:172.21.15.170:3300/0 conn(0x7fa3100b3de0 0x7fa3100b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa30f7fe640 1 -- 172.21.15.137:0/3592003237 >> v2:172.21.15.170:3300/0 conn(0x7fa3100b3de0 msgr2=0x7fa3100b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa30f7fe640 1 --2- 172.21.15.137:0/3592003237 >> v2:172.21.15.170:3300/0 conn(0x7fa3100b3de0 0x7fa3100b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa30f7fe640 1 -- 172.21.15.137:0/3592003237 >> v1:172.21.15.170:6789/0 conn(0x7fa3100b5fd0 legacy=0x7fa31015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.017+0000 7fa30f7fe640 1 -- 172.21.15.137:0/3592003237 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3100b4530 con 0x7fa310145980 2024-04-26T22:07:34.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.018+0000 7fa30f7fe640 1 --2- 172.21.15.137:0/3592003237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa310145980 0x7fa310160630 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fa3100d0d00 tx=0x7fa30002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f71d3545613675 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.018+0000 7fa30e7fc640 1 -- 172.21.15.137:0/3592003237 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300037070 con 0x7fa310145980 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.018+0000 7fa30e7fc640 1 -- 172.21.15.137:0/3592003237 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa300032440 con 0x7fa310145980 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.018+0000 7fa30e7fc640 1 -- 172.21.15.137:0/3592003237 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300032810 con 0x7fa310145980 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.019+0000 7fa315d66640 1 -- 172.21.15.137:0/3592003237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa310145980 msgr2=0x7fa310160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.019+0000 7fa315d66640 1 --2- 172.21.15.137:0/3592003237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa310145980 0x7fa310160630 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fa3100d0d00 tx=0x7fa30002a1e0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.019+0000 7fa315d66640 1 -- 172.21.15.137:0/3592003237 shutdown_connections 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.019+0000 7fa315d66640 1 --2- 172.21.15.137:0/3592003237 >> v2:172.21.15.170:3300/0 conn(0x7fa3100b3de0 0x7fa3100b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.019+0000 7fa315d66640 1 --2- 172.21.15.137:0/3592003237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa310145980 0x7fa310160630 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.019+0000 7fa315d66640 1 -- 172.21.15.137:0/3592003237 >> 172.21.15.137:0/3592003237 conn(0x7fa3100d0d30 msgr2=0x7fa3100d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.019+0000 7fa315d66640 1 -- 172.21.15.137:0/3592003237 shutdown_connections 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.019+0000 7fa315d66640 1 -- 172.21.15.137:0/3592003237 wait complete. 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.020+0000 7fa315d66640 1 Processor -- start 2024-04-26T22:07:34.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.020+0000 7fa315d66640 1 -- start start 2024-04-26T22:07:34.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa315d66640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3100b3de0 0x7fa3100cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa315d66640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3100b5fd0 0x7fa31015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa315d66640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310145980 0x7fa31015a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa315d66640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100b4dd0 con 0x7fa3100b3de0 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa315d66640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100b4af0 con 0x7fa310145980 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa315d66640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa3100730e0 con 0x7fa3100b5fd0 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3100b3de0 0x7fa3100cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3100b3de0 0x7fa3100cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40732/0 (socket says 172.21.15.137:40732) 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30f7fe640 1 -- 172.21.15.137:0/1996623017 learned_addr learned my addr 172.21.15.137:0/1996623017 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30ffff640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310145980 0x7fa31015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30effd640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3100b5fd0 0x7fa31015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30f7fe640 1 -- 172.21.15.137:0/1996623017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3100b5fd0 msgr2=0x7fa31015a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30f7fe640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3100b5fd0 0x7fa31015a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30f7fe640 1 -- 172.21.15.137:0/1996623017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310145980 msgr2=0x7fa31015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30f7fe640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310145980 0x7fa31015a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30f7fe640 1 -- 172.21.15.137:0/1996623017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3100cfeb0 con 0x7fa3100b3de0 2024-04-26T22:07:34.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30ffff640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310145980 0x7fa31015a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:34.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa30f7fe640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3100b3de0 0x7fa3100cef70 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fa30002a220 tx=0x7fa3000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.021+0000 7fa2f7fff640 1 -- 172.21.15.137:0/1996623017 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300041020 con 0x7fa3100b3de0 2024-04-26T22:07:34.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.022+0000 7fa2f7fff640 1 -- 172.21.15.137:0/1996623017 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3000306c0 con 0x7fa3100b3de0 2024-04-26T22:07:34.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.022+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3100d0190 con 0x7fa3100b3de0 2024-04-26T22:07:34.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.022+0000 7fa2f7fff640 1 -- 172.21.15.137:0/1996623017 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300037040 con 0x7fa3100b3de0 2024-04-26T22:07:34.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.022+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31015e950 con 0x7fa3100b3de0 2024-04-26T22:07:34.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.022+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa31006a290 con 0x7fa3100b3de0 2024-04-26T22:07:34.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.023+0000 7fa2f7fff640 1 -- 172.21.15.137:0/1996623017 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa300044020 con 0x7fa3100b3de0 2024-04-26T22:07:34.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.023+0000 7fa2f7fff640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2fc06c8f0 0x7fa2fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.023+0000 7fa2f7fff640 1 -- 172.21.15.137:0/1996623017 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7fa3000ac030 con 0x7fa3100b3de0 2024-04-26T22:07:34.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.023+0000 7fa30effd640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2fc06c8f0 0x7fa2fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.024+0000 7fa30effd640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2fc06c8f0 0x7fa2fc06edb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa310144680 tx=0x7fa304008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.028+0000 7fa2f7fff640 1 -- 172.21.15.137:0/1996623017 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa30004b030 con 0x7fa3100b3de0 2024-04-26T22:07:34.203 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.204+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa310073cc0 con 0x7fa3100b3de0 2024-04-26T22:07:34.205 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.205+0000 7fa2f7fff640 1 -- 172.21.15.137:0/1996623017 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+12913 (secure 0 0 0) 0x7fa30007a7b0 con 0x7fa3100b3de0 2024-04-26T22:07:34.205 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:34.205 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":111,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:33.527974+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.206+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2fc06c8f0 msgr2=0x7fa2fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.206+0000 7fa315d66640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2fc06c8f0 0x7fa2fc06edb0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fa310144680 tx=0x7fa304008040 comp rx=0 tx=0).stop 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.206+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3100b3de0 msgr2=0x7fa3100cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.206+0000 7fa315d66640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3100b3de0 0x7fa3100cef70 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fa30002a220 tx=0x7fa3000046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.207+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 shutdown_connections 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.207+0000 7fa315d66640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa2fc06c8f0 0x7fa2fc06edb0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.207+0000 7fa315d66640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa310145980 0x7fa31015a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.207+0000 7fa315d66640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa3100b5fd0 0x7fa31015a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.207+0000 7fa315d66640 1 --2- 172.21.15.137:0/1996623017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa3100b3de0 0x7fa3100cef70 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.207 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.207+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 >> 172.21.15.137:0/1996623017 conn(0x7fa3100d0d30 msgr2=0x7fa3100b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:34.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.207+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 shutdown_connections 2024-04-26T22:07:34.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.207+0000 7fa315d66640 1 -- 172.21.15.137:0/1996623017 wait complete. 2024-04-26T22:07:34.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:07:34.218 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:07:34.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.318+0000 7f2f60114640 1 Processor -- start 2024-04-26T22:07:34.318 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.318+0000 7f2f60114640 1 -- start start 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f60114640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2f580b2000 0x7f2f5806ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f60114640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f580d1170 0x7f2f580b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f60114640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5809c790 con 0x7f2f581631f0 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f60114640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2f580d1600 con 0x7f2f580b2000 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f60114640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2f58163ec0 con 0x7f2f580d1170 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f5deb0640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2f581631f0 0x7f2f581635d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39876/0 (socket says 172.21.15.137:39876) 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f5deb0640 1 -- 172.21.15.137:0/3758669476 learned_addr learned my addr 172.21.15.137:0/3758669476 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f5d6af640 1 --2- 172.21.15.137:0/3758669476 >> v2:172.21.15.170:3300/0 conn(0x7f2f580b2000 0x7f2f5806ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f5e6b1640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f580d1170 0x7f2f580b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2351720476 0 0) 0x7f2f5809c790 con 0x7f2f581631f0 2024-04-26T22:07:34.322 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f44003520 con 0x7f2f581631f0 2024-04-26T22:07:34.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2077191886 0 0) 0x7f2f44003520 con 0x7f2f581631f0 2024-04-26T22:07:34.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.319+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f580d1170 msgr2=0x7f2f580b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f580d1170 0x7f2f580b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 >> v2:172.21.15.170:3300/0 conn(0x7f2f580b2000 msgr2=0x7f2f5806ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 --2- 172.21.15.137:0/3758669476 >> v2:172.21.15.170:3300/0 conn(0x7f2f580b2000 0x7f2f5806ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f580d1a40 con 0x7f2f581631f0 2024-04-26T22:07:34.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f2f540019f0 con 0x7f2f581631f0 2024-04-26T22:07:34.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 >> v1:172.21.15.137:6789/0 conn(0x7f2f581631f0 legacy=0x7f2f581635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f440039b0 0x7f2f44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f44004800 0x7f2f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f580d1170 0x7f2f440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f58163ec0 con 0x7f2f44004800 2024-04-26T22:07:34.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4400b9c0 con 0x7f2f440039b0 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4400bb70 con 0x7f2f580d1170 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5d6af640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f44004800 0x7f2f44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5deb0640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f440039b0 0x7f2f44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5e6b1640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f580d1170 0x7f2f440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5d6af640 1 -- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f580d1170 msgr2=0x7f2f440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5d6af640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f580d1170 0x7f2f440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5d6af640 1 -- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f440039b0 msgr2=0x7f2f44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5d6af640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f440039b0 0x7f2f44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5d6af640 1 -- 172.21.15.137:0/3758669476 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f44003520 con 0x7f2f44004800 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.320+0000 7f2f5e6b1640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f580d1170 0x7f2f440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:34.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f5d6af640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f44004800 0x7f2f44004c80 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009ac0 tx=0x7f2f44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6302cd4a8dde24d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48036070 con 0x7f2f44004800 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f48031400 con 0x7f2f44004800 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f5ceae640 1 -- 172.21.15.137:0/3758669476 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48009690 con 0x7f2f44004800 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f60114640 1 -- 172.21.15.137:0/3758669476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f44004800 msgr2=0x7f2f44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f60114640 1 --2- 172.21.15.137:0/3758669476 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f44004800 0x7f2f44004c80 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009ac0 tx=0x7f2f44005830 comp rx=0 tx=0).stop 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f5e6b1640 1 -- 172.21.15.137:0/3758669476 reap_dead start 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f60114640 1 -- 172.21.15.137:0/3758669476 shutdown_connections 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f60114640 1 -- 172.21.15.137:0/3758669476 >> 172.21.15.137:0/3758669476 conn(0x7f2f5809ba40 msgr2=0x7f2f5809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f60114640 1 -- 172.21.15.137:0/3758669476 shutdown_connections 2024-04-26T22:07:34.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.321+0000 7f2f60114640 1 -- 172.21.15.137:0/3758669476 wait complete. 2024-04-26T22:07:34.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f60114640 1 Processor -- start 2024-04-26T22:07:34.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f60114640 1 -- start start 2024-04-26T22:07:34.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f60114640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f44004800 0x7f2f5815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f60114640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f5809e6f0 0x7f2f5809eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f60114640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f580cb1b0 0x7f2f580cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f60114640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2f580d0230 con 0x7f2f580cb1b0 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f60114640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2f580d2000 con 0x7f2f44004800 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f60114640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2f580ca1c0 con 0x7f2f5809e6f0 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f5e6b1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f580cb1b0 0x7f2f580cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f5e6b1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f580cb1b0 0x7f2f580cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40752/0 (socket says 172.21.15.137:40752) 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f5e6b1640 1 -- 172.21.15.137:0/2417976759 learned_addr learned my addr 172.21.15.137:0/2417976759 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f5d6af640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f5809e6f0 0x7f2f5809eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.323+0000 7f2f5deb0640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f44004800 0x7f2f5815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f5e6b1640 1 -- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f5809e6f0 msgr2=0x7f2f5809eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f5e6b1640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f5809e6f0 0x7f2f5809eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f5e6b1640 1 -- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f44004800 msgr2=0x7f2f5815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f5e6b1640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f44004800 0x7f2f5815d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f5e6b1640 1 -- 172.21.15.137:0/2417976759 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f581f9330 con 0x7f2f580cb1b0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f5deb0640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f44004800 0x7f2f5815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f5d6af640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f5809e6f0 0x7f2f5809eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f5e6b1640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f580cb1b0 0x7f2f580cb630 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f2f58163150 tx=0x7f2f50011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f4e7fc640 1 -- 172.21.15.137:0/2417976759 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50003610 con 0x7f2f580cb1b0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f4e7fc640 1 -- 172.21.15.137:0/2417976759 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5001b070 con 0x7f2f580cb1b0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f580ca3f0 con 0x7f2f580cb1b0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f4e7fc640 1 -- 172.21.15.137:0/2417976759 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50003a10 con 0x7f2f580cb1b0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.324+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f580ca9b0 con 0x7f2f580cb1b0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.325+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5806a290 con 0x7f2f580cb1b0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.325+0000 7f2f4e7fc640 1 -- 172.21.15.137:0/2417976759 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f50003bb0 con 0x7f2f580cb1b0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.326+0000 7f2f4e7fc640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2f3c06c920 0x7f2f3c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.326+0000 7f2f4e7fc640 1 -- 172.21.15.137:0/2417976759 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7f2f5008b440 con 0x7f2f580cb1b0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.326+0000 7f2f5deb0640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2f3c06c920 0x7f2f3c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.326+0000 7f2f5deb0640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2f3c06c920 0x7f2f3c06ede0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2f580ca110 tx=0x7f2f54006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.330+0000 7f2f4e7fc640 1 -- 172.21.15.137:0/2417976759 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2f50024020 con 0x7f2f580cb1b0 2024-04-26T22:07:34.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.505+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2f5815ea50 con 0x7f2f580cb1b0 2024-04-26T22:07:34.505 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.505+0000 7f2f4e7fc640 1 -- 172.21.15.137:0/2417976759 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) ==== 93+0+10 (secure 0 0 0) 0x7f2f500122d0 con 0x7f2f580cb1b0 2024-04-26T22:07:34.505 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:07:34.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2f3c06c920 msgr2=0x7f2f3c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2f3c06c920 0x7f2f3c06ede0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2f580ca110 tx=0x7f2f54006040 comp rx=0 tx=0).stop 2024-04-26T22:07:34.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f580cb1b0 msgr2=0x7f2f580cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f580cb1b0 0x7f2f580cb630 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f2f58163150 tx=0x7f2f50011920 comp rx=0 tx=0).stop 2024-04-26T22:07:34.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 shutdown_connections 2024-04-26T22:07:34.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2f3c06c920 0x7f2f3c06ede0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.507 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2f580cb1b0 0x7f2f580cb630 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2f5809e6f0 0x7f2f5809eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 --2- 172.21.15.137:0/2417976759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f44004800 0x7f2f5815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 >> 172.21.15.137:0/2417976759 conn(0x7f2f5809ba40 msgr2=0x7f2f580b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:34.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 shutdown_connections 2024-04-26T22:07:34.508 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.507+0000 7f2f60114640 1 -- 172.21.15.137:0/2417976759 wait complete. 2024-04-26T22:07:34.518 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T22:07:34.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.615+0000 7f4b3367b640 1 Processor -- start 2024-04-26T22:07:34.615 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.615+0000 7f4b3367b640 1 -- start start 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.616+0000 7f4b3367b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b2c15f370 0x7f4b2c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.616+0000 7f4b3367b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4b2c15f750 0x7f4b2c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.616+0000 7f4b3367b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b2c0d03a0 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.616+0000 7f4b3367b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4b2c0b4d10 con 0x7f4b2c15f750 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.616+0000 7f4b3367b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4b2c0d0680 con 0x7f4b2c15f370 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.616+0000 7f4b30c16640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4b2c15f750 0x7f4b2c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.616+0000 7f4b31c18640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4b2c0d37d0 0x7f4b2c0d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39882/0 (socket says 172.21.15.137:39882) 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.616+0000 7f4b31c18640 1 -- 172.21.15.137:0/634097227 learned_addr learned my addr 172.21.15.137:0/634097227 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.617+0000 7f4b30c16640 1 -- 172.21.15.137:0/634097227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b2c15f370 msgr2=0x7f4b2c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.617+0000 7f4b30c16640 1 --2- 172.21.15.137:0/634097227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b2c15f370 0x7f4b2c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.617+0000 7f4b30c16640 1 -- 172.21.15.137:0/634097227 >> v1:172.21.15.137:6789/0 conn(0x7f4b2c0d37d0 legacy=0x7f4b2c0d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.617+0000 7f4b23fff640 1 -- 172.21.15.137:0/634097227 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3178034037 0 0) 0x7f4b2c0d03a0 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.617+0000 7f4b30c16640 1 -- 172.21.15.137:0/634097227 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c0d0960 con 0x7f4b2c15f750 2024-04-26T22:07:34.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.617+0000 7f4b30c16640 1 --2- 172.21.15.137:0/634097227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c15f750 0x7f4b2c0b47d0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0097a0 tx=0x7f4b1c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc9e72c79aa4f2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b23fff640 1 -- 172.21.15.137:0/634097227 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c037070 con 0x7f4b2c15f750 2024-04-26T22:07:34.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b23fff640 1 -- 172.21.15.137:0/634097227 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c02ae50 con 0x7f4b2c15f750 2024-04-26T22:07:34.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b23fff640 1 -- 172.21.15.137:0/634097227 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c032660 con 0x7f4b2c15f750 2024-04-26T22:07:34.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b3367b640 1 -- 172.21.15.137:0/634097227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c15f750 msgr2=0x7f4b2c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b3367b640 1 --2- 172.21.15.137:0/634097227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c15f750 0x7f4b2c0b47d0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0097a0 tx=0x7f4b1c02a100 comp rx=0 tx=0).stop 2024-04-26T22:07:34.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b3367b640 1 -- 172.21.15.137:0/634097227 shutdown_connections 2024-04-26T22:07:34.619 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b3367b640 1 --2- 172.21.15.137:0/634097227 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c15f750 0x7f4b2c0b47d0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b3367b640 1 --2- 172.21.15.137:0/634097227 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b2c15f370 0x7f4b2c0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b3367b640 1 -- 172.21.15.137:0/634097227 >> 172.21.15.137:0/634097227 conn(0x7f4b2c08ec10 msgr2=0x7f4b2c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:34.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b3367b640 1 -- 172.21.15.137:0/634097227 shutdown_connections 2024-04-26T22:07:34.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.618+0000 7f4b3367b640 1 -- 172.21.15.137:0/634097227 wait complete. 2024-04-26T22:07:34.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.619+0000 7f4b3367b640 1 Processor -- start 2024-04-26T22:07:34.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.619+0000 7f4b3367b640 1 -- start start 2024-04-26T22:07:34.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b3367b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0d37d0 0x7f4b2c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b3367b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c15f370 0x7f4b2c0c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b3367b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b2c15f750 0x7f4b2c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.622 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b3367b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c0b51c0 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b3367b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2c0d0f20 con 0x7f4b2c15f370 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b3367b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4b2c0b5340 con 0x7f4b2c15f750 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b31417640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0d37d0 0x7f4b2c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b31417640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0d37d0 0x7f4b2c15d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40772/0 (socket says 172.21.15.137:40772) 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b31417640 1 -- 172.21.15.137:0/4196739035 learned_addr learned my addr 172.21.15.137:0/4196739035 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b31c18640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b2c15f750 0x7f4b2c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b30c16640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c15f370 0x7f4b2c0c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b31417640 1 -- 172.21.15.137:0/4196739035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b2c15f750 msgr2=0x7f4b2c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.620+0000 7f4b31417640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b2c15f750 0x7f4b2c15cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.621+0000 7f4b31417640 1 -- 172.21.15.137:0/4196739035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c15f370 msgr2=0x7f4b2c0c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.621+0000 7f4b31417640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c15f370 0x7f4b2c0c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.621+0000 7f4b31417640 1 -- 172.21.15.137:0/4196739035 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2c0c93e0 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.621+0000 7f4b31417640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0d37d0 0x7f4b2c15d4f0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800ba50 tx=0x7f4b2800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.621+0000 7f4b21ffb640 1 -- 172.21.15.137:0/4196739035 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b28019070 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.621+0000 7f4b21ffb640 1 -- 172.21.15.137:0/4196739035 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2800cc00 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.621+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2c0c96c0 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.621+0000 7f4b21ffb640 1 -- 172.21.15.137:0/4196739035 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b28014440 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.621+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2c0c9c80 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.622+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2c06a290 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.622+0000 7f4b21ffb640 1 -- 172.21.15.137:0/4196739035 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b2801c070 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.623+0000 7f4b21ffb640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b1006c8f0 0x7f4b1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.623+0000 7f4b21ffb640 1 -- 172.21.15.137:0/4196739035 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7f4b2808b4e0 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.623+0000 7f4b30c16640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b1006c8f0 0x7f4b1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.623+0000 7f4b30c16640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b1006c8f0 0x7f4b1006edb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c034000 tx=0x7f4b1c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.626 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.627+0000 7f4b21ffb640 1 -- 172.21.15.137:0/4196739035 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4b28059610 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.803+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4b2c075390 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.804+0000 7f4b21ffb640 1 -- 172.21.15.137:0/4196739035 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v111) ==== 84+0+65 (secure 0 0 0) 0x7f4b2805d910 con 0x7f4b2c0d37d0 2024-04-26T22:07:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:34.804 INFO:teuthology.orchestra.run.smithi137.stdout:[ 2024-04-26T22:07:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: { 2024-04-26T22:07:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: "poolnum": 1, 2024-04-26T22:07:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: "poolname": ".mgr" 2024-04-26T22:07:34.804 INFO:teuthology.orchestra.run.smithi137.stdout: } 2024-04-26T22:07:34.804 INFO:teuthology.orchestra.run.smithi137.stdout:] 2024-04-26T22:07:34.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.805+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b1006c8f0 msgr2=0x7f4b1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.805+0000 7f4b3367b640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b1006c8f0 0x7f4b1006edb0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c034000 tx=0x7f4b1c02e000 comp rx=0 tx=0).stop 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.805+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0d37d0 msgr2=0x7f4b2c15d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.805+0000 7f4b3367b640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0d37d0 0x7f4b2c15d4f0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800ba50 tx=0x7f4b2800bf10 comp rx=0 tx=0).stop 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.806+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 shutdown_connections 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.806+0000 7f4b3367b640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b1006c8f0 0x7f4b1006edb0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.806+0000 7f4b3367b640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b2c15f750 0x7f4b2c15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.806+0000 7f4b3367b640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b2c15f370 0x7f4b2c0c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.806+0000 7f4b3367b640 1 --2- 172.21.15.137:0/4196739035 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b2c0d37d0 0x7f4b2c15d4f0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.806+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 >> 172.21.15.137:0/4196739035 conn(0x7f4b2c08ec10 msgr2=0x7f4b2c0d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.806+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 shutdown_connections 2024-04-26T22:07:34.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.806+0000 7f4b3367b640 1 -- 172.21.15.137:0/4196739035 wait complete. 2024-04-26T22:07:34.816 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T22:07:34.816 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T22:07:34.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.917+0000 7f493fbb4640 1 Processor -- start 2024-04-26T22:07:34.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.917+0000 7f493fbb4640 1 -- start start 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493fbb4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f493806d520 0x7f49380cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493fbb4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4938070a50 0x7f49380b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493fbb4640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49380b4790 con 0x7f493806d900 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493fbb4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f49380b0ee0 con 0x7f493806d520 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493fbb4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f49380b4da0 con 0x7f4938070a50 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493e151640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f493806d900 0x7f4938160f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:39892/0 (socket says 172.21.15.137:39892) 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493e151640 1 -- 172.21.15.137:0/3609228214 learned_addr learned my addr 172.21.15.137:0/3609228214 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493d950640 1 --2- 172.21.15.137:0/3609228214 >> v2:172.21.15.170:3300/0 conn(0x7f493806d520 0x7f49380cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493d14f640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4938070a50 0x7f49380b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590890221 0 0) 0x7f49380b4790 con 0x7f493806d900 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.918+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4924003520 con 0x7f493806d900 2024-04-26T22:07:34.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1080176650 0 0) 0x7f4924003520 con 0x7f493806d900 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4938070a50 msgr2=0x7f49380b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4938070a50 0x7f49380b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 >> v2:172.21.15.170:3300/0 conn(0x7f493806d520 msgr2=0x7f49380cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 --2- 172.21.15.137:0/3609228214 >> v2:172.21.15.170:3300/0 conn(0x7f493806d520 0x7f49380cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4938068230 con 0x7f493806d900 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f4930001670 con 0x7f493806d900 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493d950640 1 --2- 172.21.15.137:0/3609228214 >> v2:172.21.15.170:3300/0 conn(0x7f493806d520 0x7f49380cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 >> v1:172.21.15.137:6789/0 conn(0x7f493806d900 legacy=0x7f4938160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49240039b0 0x7f4924003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4924004800 0x7f4924004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4938070a50 0x7f49240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49380b0ee0 con 0x7f49240039b0 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f49380b4da0 con 0x7f4924004800 2024-04-26T22:07:34.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f492400b9c0 con 0x7f4938070a50 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493d950640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49240039b0 0x7f4924003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493d14f640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4924004800 0x7f4924004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493e151640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4938070a50 0x7f49240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493d950640 1 -- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4938070a50 msgr2=0x7f49240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493d950640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4938070a50 0x7f49240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493d950640 1 -- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4924004800 msgr2=0x7f4924004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493d950640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4924004800 0x7f4924004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.919+0000 7f493d950640 1 -- 172.21.15.137:0/3609228214 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4924003520 con 0x7f49240039b0 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.920+0000 7f493d950640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49240039b0 0x7f4924003dd0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f493400e380 tx=0x7f4924005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542fa5d2b7a244f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.920+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934009de0 con 0x7f49240039b0 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.920+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493402c620 con 0x7f49240039b0 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.920+0000 7f493c94e640 1 -- 172.21.15.137:0/3609228214 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493402c9d0 con 0x7f49240039b0 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.920+0000 7f493fbb4640 1 -- 172.21.15.137:0/3609228214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49240039b0 msgr2=0x7f4924003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.920+0000 7f493fbb4640 1 --2- 172.21.15.137:0/3609228214 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f49240039b0 0x7f4924003dd0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f493400e380 tx=0x7f4924005830 comp rx=0 tx=0).stop 2024-04-26T22:07:34.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.920+0000 7f493e151640 1 -- 172.21.15.137:0/3609228214 reap_dead start 2024-04-26T22:07:34.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.920+0000 7f493fbb4640 1 -- 172.21.15.137:0/3609228214 shutdown_connections 2024-04-26T22:07:34.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.920+0000 7f493fbb4640 1 -- 172.21.15.137:0/3609228214 >> 172.21.15.137:0/3609228214 conn(0x7f4938072900 msgr2=0x7f4938072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:34.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.921+0000 7f493fbb4640 1 -- 172.21.15.137:0/3609228214 shutdown_connections 2024-04-26T22:07:34.924 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.921+0000 7f493fbb4640 1 -- 172.21.15.137:0/3609228214 wait complete. 2024-04-26T22:07:34.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.922+0000 7f493fbb4640 1 Processor -- start 2024-04-26T22:07:34.926 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.922+0000 7f493fbb4640 1 -- start start 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.922+0000 7f493fbb4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49240039b0 0x7f4938157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.922+0000 7f493fbb4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4938145240 0x7f4938144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.922+0000 7f493fbb4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49381f6df0 0x7f49381f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.922+0000 7f493fbb4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f49380b09a0 con 0x7f4938145240 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.922+0000 7f493fbb4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4938068510 con 0x7f49381f6df0 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.922+0000 7f493fbb4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f49380b0b20 con 0x7f49240039b0 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d14f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4938145240 0x7f4938144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d14f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4938145240 0x7f4938144610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:40786/0 (socket says 172.21.15.137:40786) 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d14f640 1 -- 172.21.15.137:0/3108719821 learned_addr learned my addr 172.21.15.137:0/3108719821 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493e151640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49381f6df0 0x7f49381f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d950640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49240039b0 0x7f4938157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d14f640 1 -- 172.21.15.137:0/3108719821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49240039b0 msgr2=0x7f4938157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d14f640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49240039b0 0x7f4938157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.927 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d14f640 1 -- 172.21.15.137:0/3108719821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49381f6df0 msgr2=0x7f49381f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d14f640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49381f6df0 0x7f49381f7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d14f640 1 -- 172.21.15.137:0/3108719821 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4938156770 con 0x7f4938145240 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493d14f640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4938145240 0x7f4938144610 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f49280119d0 tx=0x7f4928011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f492e7fc640 1 -- 172.21.15.137:0/3108719821 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800fb50 con 0x7f4938145240 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f492e7fc640 1 -- 172.21.15.137:0/3108719821 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492800fcf0 con 0x7f4938145240 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4938156a50 con 0x7f4938145240 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f492e7fc640 1 -- 172.21.15.137:0/3108719821 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800fea0 con 0x7f4938145240 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.923+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4938157a70 con 0x7f4938145240 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.924+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49380b3100 con 0x7f4938145240 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.925+0000 7f492e7fc640 1 -- 172.21.15.137:0/3108719821 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4928012040 con 0x7f4938145240 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.925+0000 7f492e7fc640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f491c06c8f0 0x7f491c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.925+0000 7f492e7fc640 1 -- 172.21.15.137:0/3108719821 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 4857+0+0 (secure 0 0 0) 0x7f492808be90 con 0x7f4938145240 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.925+0000 7f493d950640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f491c06c8f0 0x7f491c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:34.928 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.925+0000 7f493d950640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f491c06c8f0 0x7f491c06edb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4934035000 tx=0x7f493402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:34.929 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:34.929+0000 7f492e7fc640 1 -- 172.21.15.137:0/3108719821 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f49380b3100 con 0x7f4938145240 2024-04-26T22:07:35.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.103+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f493806a290 con 0x7f4938145240 2024-04-26T22:07:35.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.533+0000 7f492e7fc640 1 -- 172.21.15.137:0/3108719821 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v112) ==== 138+0+0 (secure 0 0 0) 0x7f4928019030 con 0x7f4938145240 2024-04-26T22:07:35.533 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' created 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f491c06c8f0 msgr2=0x7f491c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f491c06c8f0 0x7f491c06edb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4934035000 tx=0x7f493402f000 comp rx=0 tx=0).stop 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4938145240 msgr2=0x7f4938144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4938145240 0x7f4938144610 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f49280119d0 tx=0x7f4928011e90 comp rx=0 tx=0).stop 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 shutdown_connections 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f491c06c8f0 0x7f491c06edb0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4938145240 0x7f4938144610 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49381f6df0 0x7f49381f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 --2- 172.21.15.137:0/3108719821 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f49240039b0 0x7f4938157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 >> 172.21.15.137:0/3108719821 conn(0x7f4938072900 msgr2=0x7f49380b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:35.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 shutdown_connections 2024-04-26T22:07:35.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.536+0000 7f493fbb4640 1 -- 172.21.15.137:0/3108719821 wait complete. 2024-04-26T22:07:35.551 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T22:07:35.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.656+0000 7ff3b7446640 1 Processor -- start 2024-04-26T22:07:35.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.656+0000 7ff3b7446640 1 -- start start 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b7446640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff3b006d2b0 0x7ff3b00682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b7446640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff3b006d690 0x7ff3b015f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b7446640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b015ffe0 con 0x7ff3b0162d80 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b7446640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b01602c0 con 0x7ff3b006d2b0 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b7446640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b01605a0 con 0x7ff3b006d690 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b51e2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff3b006d2b0 0x7ff3b00682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b51e2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff3b006d2b0 0x7ff3b00682a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36264/0 (socket says 172.21.15.137:36264) 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b51e2640 1 -- 172.21.15.137:0/740707160 learned_addr learned my addr 172.21.15.137:0/740707160 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b51e2640 1 -- 172.21.15.137:0/740707160 >> v2:172.21.15.170:3300/0 conn(0x7ff3b006d690 msgr2=0x7ff3b015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b51e2640 1 --2- 172.21.15.137:0/740707160 >> v2:172.21.15.170:3300/0 conn(0x7ff3b006d690 0x7ff3b015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b51e2640 1 -- 172.21.15.137:0/740707160 >> v1:172.21.15.170:6789/0 conn(0x7ff3b0162d80 legacy=0x7ff3b01631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:35.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.657+0000 7ff3b51e2640 1 -- 172.21.15.137:0/740707160 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b00b4860 con 0x7ff3b006d2b0 2024-04-26T22:07:35.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3b51e2640 1 --2- 172.21.15.137:0/740707160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 0x7ff3b00682a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7ff3b006de90 tx=0x7ff3ac02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7bab6be47b3375 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:35.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3a7fff640 1 -- 172.21.15.137:0/740707160 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac037070 con 0x7ff3b006d2b0 2024-04-26T22:07:35.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3a7fff640 1 -- 172.21.15.137:0/740707160 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac032440 con 0x7ff3b006d2b0 2024-04-26T22:07:35.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3a7fff640 1 -- 172.21.15.137:0/740707160 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac032810 con 0x7ff3b006d2b0 2024-04-26T22:07:35.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3b7446640 1 -- 172.21.15.137:0/740707160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 msgr2=0x7ff3b00682a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:35.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3b7446640 1 --2- 172.21.15.137:0/740707160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 0x7ff3b00682a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7ff3b006de90 tx=0x7ff3ac02a2c0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3b7446640 1 -- 172.21.15.137:0/740707160 shutdown_connections 2024-04-26T22:07:35.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3b7446640 1 --2- 172.21.15.137:0/740707160 >> v2:172.21.15.170:3300/0 conn(0x7ff3b006d690 0x7ff3b015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3b7446640 1 --2- 172.21.15.137:0/740707160 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 0x7ff3b00682a0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.658+0000 7ff3b7446640 1 -- 172.21.15.137:0/740707160 >> 172.21.15.137:0/740707160 conn(0x7ff3b0072900 msgr2=0x7ff3b0072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:35.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.659+0000 7ff3b7446640 1 -- 172.21.15.137:0/740707160 shutdown_connections 2024-04-26T22:07:35.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.659+0000 7ff3b7446640 1 -- 172.21.15.137:0/740707160 wait complete. 2024-04-26T22:07:35.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b7446640 1 Processor -- start 2024-04-26T22:07:35.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b7446640 1 -- start start 2024-04-26T22:07:35.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b7446640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 0x7ff3b0158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:35.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b7446640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b006d690 0x7ff3b00c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:35.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b7446640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0162d80 0x7ff3b00c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:35.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b7446640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b00afc10 con 0x7ff3b006d2b0 2024-04-26T22:07:35.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b7446640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b006daf0 con 0x7ff3b006d690 2024-04-26T22:07:35.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b7446640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff3b00afd90 con 0x7ff3b0162d80 2024-04-26T22:07:35.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b51e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 0x7ff3b0158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:35.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b51e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 0x7ff3b0158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36276/0 (socket says 172.21.15.137:36276) 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.660+0000 7ff3b51e2640 1 -- 172.21.15.137:0/3137685871 learned_addr learned my addr 172.21.15.137:0/3137685871 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b51e2640 1 -- 172.21.15.137:0/3137685871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0162d80 msgr2=0x7ff3b00c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b59e3640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0162d80 0x7ff3b00c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b49e1640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b006d690 0x7ff3b00c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b51e2640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0162d80 0x7ff3b00c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b51e2640 1 -- 172.21.15.137:0/3137685871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b006d690 msgr2=0x7ff3b00c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b51e2640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b006d690 0x7ff3b00c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b51e2640 1 -- 172.21.15.137:0/3137685871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b015b930 con 0x7ff3b006d2b0 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b49e1640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b006d690 0x7ff3b00c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b51e2640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 0x7ff3b0158b60 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac000c00 tx=0x7ff3ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3a5ffb640 1 -- 172.21.15.137:0/3137685871 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac041070 con 0x7ff3b006d2b0 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3a5ffb640 1 -- 172.21.15.137:0/3137685871 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac03c870 con 0x7ff3b006d2b0 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3a5ffb640 1 -- 172.21.15.137:0/3137685871 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac037040 con 0x7ff3b006d2b0 2024-04-26T22:07:35.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b015bc10 con 0x7ff3b006d2b0 2024-04-26T22:07:35.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.661+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b015c1d0 con 0x7ff3b006d2b0 2024-04-26T22:07:35.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.662+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b006a290 con 0x7ff3b006d2b0 2024-04-26T22:07:35.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.663+0000 7ff3a5ffb640 1 -- 172.21.15.137:0/3137685871 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff3ac044070 con 0x7ff3b006d2b0 2024-04-26T22:07:35.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.663+0000 7ff3a5ffb640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff39406c8f0 0x7ff39406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:35.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.663+0000 7ff3a5ffb640 1 -- 172.21.15.137:0/3137685871 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5227+0+0 (secure 0 0 0) 0x7ff3ac0ac500 con 0x7ff3b006d2b0 2024-04-26T22:07:35.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.663+0000 7ff3b49e1640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff39406c8f0 0x7ff39406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:35.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.664+0000 7ff3b49e1640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff39406c8f0 0x7ff39406edb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0006fd0 tx=0x7ff3a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:35.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.668+0000 7ff3a5ffb640 1 -- 172.21.15.137:0/3137685871 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff3ac07ab10 con 0x7ff3b006d2b0 2024-04-26T22:07:35.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:35.843+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff3b0068850 con 0x7ff3b006d2b0 2024-04-26T22:07:36.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.536+0000 7ff3a5ffb640 1 -- 172.21.15.137:0/3137685871 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v113) ==== 170+0+0 (secure 0 0 0) 0x7ff3ac07a410 con 0x7ff3b006d2b0 2024-04-26T22:07:36.536 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' created 2024-04-26T22:07:36.538 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.538+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff39406c8f0 msgr2=0x7ff39406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.538+0000 7ff3b7446640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff39406c8f0 0x7ff39406edb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0006fd0 tx=0x7ff3a0008040 comp rx=0 tx=0).stop 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.538+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 msgr2=0x7ff3b0158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.538+0000 7ff3b7446640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 0x7ff3b0158b60 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac000c00 tx=0x7ff3ac0046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.539+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 shutdown_connections 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.539+0000 7ff3b7446640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff39406c8f0 0x7ff39406edb0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.539+0000 7ff3b7446640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff3b0162d80 0x7ff3b00c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.539+0000 7ff3b7446640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff3b006d690 0x7ff3b00c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.539+0000 7ff3b7446640 1 --2- 172.21.15.137:0/3137685871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff3b006d2b0 0x7ff3b0158b60 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.539+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 >> 172.21.15.137:0/3137685871 conn(0x7ff3b0072900 msgr2=0x7ff3b00b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.539+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 shutdown_connections 2024-04-26T22:07:36.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.539+0000 7ff3b7446640 1 -- 172.21.15.137:0/3137685871 wait complete. 2024-04-26T22:07:36.567 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T22:07:36.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.668+0000 7fd44ad1b640 1 Processor -- start 2024-04-26T22:07:36.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.669+0000 7fd44ad1b640 1 -- start start 2024-04-26T22:07:36.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.669+0000 7fd44ad1b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd44415d340 0x7fd44409c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:36.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.669+0000 7fd44ad1b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4440d1940 0x7fd4440702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:36.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.669+0000 7fd44ad1b640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4440cee60 con 0x7fd4440b2420 2024-04-26T22:07:36.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.669+0000 7fd44ad1b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440ce9d0 con 0x7fd44415d340 2024-04-26T22:07:36.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.669+0000 7fd44ad1b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd4440d0ff0 con 0x7fd4440d1940 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.669+0000 7fd448ab7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd44415d340 0x7fd44409c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.669+0000 7fd448ab7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd44415d340 0x7fd44409c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36292/0 (socket says 172.21.15.137:36292) 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.669+0000 7fd448ab7640 1 -- 172.21.15.137:0/3937923132 learned_addr learned my addr 172.21.15.137:0/3937923132 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.670+0000 7fd448ab7640 1 -- 172.21.15.137:0/3937923132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4440d1940 msgr2=0x7fd4440702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.670+0000 7fd4492b8640 1 --2- 172.21.15.137:0/3937923132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4440d1940 0x7fd4440702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.670+0000 7fd448ab7640 1 --2- 172.21.15.137:0/3937923132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4440d1940 0x7fd4440702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.670+0000 7fd448ab7640 1 -- 172.21.15.137:0/3937923132 >> v1:172.21.15.170:6789/0 conn(0x7fd4440b2420 legacy=0x7fd4440d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.670+0000 7fd448ab7640 1 -- 172.21.15.137:0/3937923132 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4440d0d10 con 0x7fd44415d340 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.670+0000 7fd4492b8640 1 --2- 172.21.15.137:0/3937923132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4440d1940 0x7fd4440702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.670+0000 7fd448ab7640 1 --2- 172.21.15.137:0/3937923132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd44415d340 0x7fd44409c560 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fd438009870 tx=0x7fd43802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4172b6f81ecb156b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd4437fe640 1 -- 172.21.15.137:0/3937923132 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438037070 con 0x7fd44415d340 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd4437fe640 1 -- 172.21.15.137:0/3937923132 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd438032440 con 0x7fd44415d340 2024-04-26T22:07:36.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd4437fe640 1 -- 172.21.15.137:0/3937923132 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438032810 con 0x7fd44415d340 2024-04-26T22:07:36.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd44ad1b640 1 -- 172.21.15.137:0/3937923132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd44415d340 msgr2=0x7fd44409c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:36.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd44ad1b640 1 --2- 172.21.15.137:0/3937923132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd44415d340 0x7fd44409c560 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fd438009870 tx=0x7fd43802a210 comp rx=0 tx=0).stop 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd44ad1b640 1 -- 172.21.15.137:0/3937923132 shutdown_connections 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd44ad1b640 1 --2- 172.21.15.137:0/3937923132 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd4440d1940 0x7fd4440702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd44ad1b640 1 --2- 172.21.15.137:0/3937923132 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd44415d340 0x7fd44409c560 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd44ad1b640 1 -- 172.21.15.137:0/3937923132 >> 172.21.15.137:0/3937923132 conn(0x7fd44409ba40 msgr2=0x7fd44409be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd44ad1b640 1 -- 172.21.15.137:0/3937923132 shutdown_connections 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.671+0000 7fd44ad1b640 1 -- 172.21.15.137:0/3937923132 wait complete. 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.672+0000 7fd44ad1b640 1 Processor -- start 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.672+0000 7fd44ad1b640 1 -- start start 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.673+0000 7fd44ad1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4440d1940 0x7fd4441f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.673+0000 7fd44ad1b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd44415d340 0x7fd44406ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.673+0000 7fd44ad1b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd44406d3b0 0x7fd44415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.673+0000 7fd44ad1b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd4440b2090 con 0x7fd4440d1940 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.673+0000 7fd44ad1b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd44415d720 con 0x7fd44415d340 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.673+0000 7fd44ad1b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd4440b2210 con 0x7fd44406d3b0 2024-04-26T22:07:36.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.673+0000 7fd448ab7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4440d1940 0x7fd4441f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.673+0000 7fd448ab7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4440d1940 0x7fd4441f7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36304/0 (socket says 172.21.15.137:36304) 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.673+0000 7fd448ab7640 1 -- 172.21.15.137:0/98887431 learned_addr learned my addr 172.21.15.137:0/98887431 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd4492b8640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd44406d3b0 0x7fd44415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd443fff640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd44415d340 0x7fd44406ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd448ab7640 1 -- 172.21.15.137:0/98887431 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd44406d3b0 msgr2=0x7fd44415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd448ab7640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd44406d3b0 0x7fd44415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd448ab7640 1 -- 172.21.15.137:0/98887431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd44415d340 msgr2=0x7fd44406ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd448ab7640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd44415d340 0x7fd44406ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd448ab7640 1 -- 172.21.15.137:0/98887431 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd444157f20 con 0x7fd4440d1940 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd448ab7640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4440d1940 0x7fd4441f7f80 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fd438000c00 tx=0x7fd4380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd4417fa640 1 -- 172.21.15.137:0/98887431 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438037040 con 0x7fd4440d1940 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd4417fa640 1 -- 172.21.15.137:0/98887431 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd438042070 con 0x7fd4440d1940 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd444158200 con 0x7fd4440d1940 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd4417fa640 1 -- 172.21.15.137:0/98887431 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438030bb0 con 0x7fd4440d1940 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.674+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd444159170 con 0x7fd4440d1940 2024-04-26T22:07:36.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.675+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4440693d0 con 0x7fd4440d1940 2024-04-26T22:07:36.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.675+0000 7fd4417fa640 1 -- 172.21.15.137:0/98887431 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd438047460 con 0x7fd4440d1940 2024-04-26T22:07:36.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.676+0000 7fd4417fa640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd42806c920 0x7fd42806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:36.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.676+0000 7fd4417fa640 1 -- 172.21.15.137:0/98887431 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5609+0+0 (secure 0 0 0) 0x7fd4380ac730 con 0x7fd4440d1940 2024-04-26T22:07:36.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.676+0000 7fd443fff640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd42806c920 0x7fd42806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:36.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.676+0000 7fd443fff640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd42806c920 0x7fd42806ede0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd4440b19d0 tx=0x7fd430009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:36.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.681+0000 7fd4417fa640 1 -- 172.21.15.137:0/98887431 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd438045360 con 0x7fd4440d1940 2024-04-26T22:07:36.894 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:36.894+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd4440b0ab0 con 0x7fd4440d1940 2024-04-26T22:07:37.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.557+0000 7fd4417fa640 1 -- 172.21.15.137:0/98887431 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v79) ==== 174+0+0 (secure 0 0 0) 0x7fd43807abc0 con 0x7fd4440d1940 2024-04-26T22:07:37.558 INFO:teuthology.orchestra.run.smithi137.stderr:new fs with metadata pool 16 and data pool 17 2024-04-26T22:07:37.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.565+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd42806c920 msgr2=0x7fd42806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.565+0000 7fd44ad1b640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd42806c920 0x7fd42806ede0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd4440b19d0 tx=0x7fd430009040 comp rx=0 tx=0).stop 2024-04-26T22:07:37.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.565+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4440d1940 msgr2=0x7fd4441f7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.565+0000 7fd44ad1b640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4440d1940 0x7fd4441f7f80 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fd438000c00 tx=0x7fd4380046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.566+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 shutdown_connections 2024-04-26T22:07:37.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.566+0000 7fd44ad1b640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd42806c920 0x7fd42806ede0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.566+0000 7fd44ad1b640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd44406d3b0 0x7fd44415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.566+0000 7fd44ad1b640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd44415d340 0x7fd44406ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.566+0000 7fd44ad1b640 1 --2- 172.21.15.137:0/98887431 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd4440d1940 0x7fd4441f7f80 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.566+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 >> 172.21.15.137:0/98887431 conn(0x7fd44409ba40 msgr2=0x7fd4440afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:37.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.568+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 shutdown_connections 2024-04-26T22:07:37.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.568+0000 7fd44ad1b640 1 -- 172.21.15.137:0/98887431 wait complete. 2024-04-26T22:07:37.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:37.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.686+0000 7fafbfb71640 1 Processor -- start 2024-04-26T22:07:37.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.687+0000 7fafbfb71640 1 -- start start 2024-04-26T22:07:37.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.687+0000 7fafbfb71640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fafb813ff70 0x7fafb8146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.687+0000 7fafbfb71640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb80d05b0 con 0x7fafb8140350 2024-04-26T22:07:37.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.687+0000 7fafbfb71640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb80d0890 con 0x7fafb80cff20 2024-04-26T22:07:37.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.687+0000 7fafbfb71640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fafb806e450 con 0x7fafb813ff70 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbd10c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fafb8140350 0x7fafb80cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50658/0 (socket says 172.21.15.137:50658) 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbd10c640 1 -- 172.21.15.137:0/1152815007 learned_addr learned my addr 172.21.15.137:0/1152815007 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863359930 0 0) 0x7fafb80d05b0 con 0x7fafb8140350 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa4003520 con 0x7fafb8140350 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbd90d640 1 --2- 172.21.15.137:0/1152815007 >> v2:172.21.15.170:3300/0 conn(0x7fafb813ff70 0x7fafb8146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3103869262 0 0) 0x7fafa4003520 con 0x7fafb8140350 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 >> v2:172.21.15.170:3300/0 conn(0x7fafb813ff70 msgr2=0x7fafb8146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 --2- 172.21.15.137:0/1152815007 >> v2:172.21.15.170:3300/0 conn(0x7fafb813ff70 0x7fafb8146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 >> v1:172.21.15.170:6789/0 conn(0x7fafb80cff20 legacy=0x7fafb806ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb806e730 con 0x7fafb8140350 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fafa8001670 con 0x7fafb8140350 2024-04-26T22:07:37.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 >> v1:172.21.15.137:6789/0 conn(0x7fafb8140350 legacy=0x7fafb80cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40039b0 0x7fafa4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa40051c0 0x7fafa400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafb806e450 con 0x7fafa4004800 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fafa400c160 con 0x7fafa40039b0 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fafa400c360 con 0x7fafa40051c0 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbd10c640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbd90d640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40039b0 0x7fafa4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.688+0000 7fafbe10e640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa40051c0 0x7fafa400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbd10c640 1 -- 172.21.15.137:0/1152815007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa40051c0 msgr2=0x7fafa400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbd10c640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafa40051c0 0x7fafa400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbd10c640 1 -- 172.21.15.137:0/1152815007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40039b0 msgr2=0x7fafa4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbd10c640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40039b0 0x7fafa4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbe10e640 1 -- 172.21.15.137:0/1152815007 reap_dead start 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbd10c640 1 -- 172.21.15.137:0/1152815007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa4003520 con 0x7fafa4004800 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbd90d640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40039b0 0x7fafa4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbd10c640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafa4004c80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c240 tx=0x7fafa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e2681bb0b975a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8007cf0 con 0x7fafa4004800 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa8005af0 con 0x7fafa4004800 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.689+0000 7fafbc90b640 1 -- 172.21.15.137:0/1152815007 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8007070 con 0x7fafa4004800 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.690+0000 7fafbfb71640 1 -- 172.21.15.137:0/1152815007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 msgr2=0x7fafa4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.690+0000 7fafbfb71640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafa4004c80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c240 tx=0x7fafa4005830 comp rx=0 tx=0).stop 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.690+0000 7fafbfb71640 1 -- 172.21.15.137:0/1152815007 shutdown_connections 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.690+0000 7fafbfb71640 1 --2- 172.21.15.137:0/1152815007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafa4004c80 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.690+0000 7fafbfb71640 1 -- 172.21.15.137:0/1152815007 >> 172.21.15.137:0/1152815007 conn(0x7fafb80d0d30 msgr2=0x7fafb80d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:37.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.690+0000 7fafbfb71640 1 -- 172.21.15.137:0/1152815007 shutdown_connections 2024-04-26T22:07:37.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.690+0000 7fafbfb71640 1 -- 172.21.15.137:0/1152815007 wait complete. 2024-04-26T22:07:37.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.691+0000 7fafbfb71640 1 Processor -- start 2024-04-26T22:07:37.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.691+0000 7fafbfb71640 1 -- start start 2024-04-26T22:07:37.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbfb71640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafb81f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbfb71640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071fd0 0x7fafb8144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbfb71640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb81e7b60 0x7fafb8158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbfb71640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80cfba0 con 0x7fafa4004800 2024-04-26T22:07:37.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbfb71640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80cfa20 con 0x7fafb81e7b60 2024-04-26T22:07:37.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbfb71640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fafb80cfd20 con 0x7fafb8071fd0 2024-04-26T22:07:37.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd90d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafb81f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd90d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafb81f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36316/0 (socket says 172.21.15.137:36316) 2024-04-26T22:07:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd90d640 1 -- 172.21.15.137:0/4284351395 learned_addr learned my addr 172.21.15.137:0/4284351395 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbe10e640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb81e7b60 0x7fafb8158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd10c640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071fd0 0x7fafb8144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd90d640 1 -- 172.21.15.137:0/4284351395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071fd0 msgr2=0x7fafb8144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd90d640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071fd0 0x7fafb8144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd90d640 1 -- 172.21.15.137:0/4284351395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb81e7b60 msgr2=0x7fafb8158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd90d640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb81e7b60 0x7fafb8158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd90d640 1 -- 172.21.15.137:0/4284351395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb81f5f60 con 0x7fafa4004800 2024-04-26T22:07:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd10c640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071fd0 0x7fafb8144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.692+0000 7fafbd90d640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafb81f5a20 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fafb4006c00 tx=0x7fafb400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.693+0000 7fafae7fc640 1 -- 172.21.15.137:0/4284351395 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4009690 con 0x7fafa4004800 2024-04-26T22:07:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.693+0000 7fafae7fc640 1 -- 172.21.15.137:0/4284351395 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb4011c90 con 0x7fafa4004800 2024-04-26T22:07:37.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.693+0000 7fafae7fc640 1 -- 172.21.15.137:0/4284351395 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4014440 con 0x7fafa4004800 2024-04-26T22:07:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.693+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb81e8060 con 0x7fafa4004800 2024-04-26T22:07:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.693+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb81e8620 con 0x7fafa4004800 2024-04-26T22:07:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.694+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb806a290 con 0x7fafa4004800 2024-04-26T22:07:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.694+0000 7fafae7fc640 1 -- 172.21.15.137:0/4284351395 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fafb4012040 con 0x7fafa4004800 2024-04-26T22:07:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.694+0000 7fafae7fc640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf9c06c920 0x7faf9c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.695+0000 7fafae7fc640 1 -- 172.21.15.137:0/4284351395 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fafb408c0e0 con 0x7fafa4004800 2024-04-26T22:07:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.695+0000 7fafbd10c640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf9c06c920 0x7faf9c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.695+0000 7fafbd10c640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf9c06c920 0x7faf9c06ede0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fafa8032000 tx=0x7fafa8009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:37.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.699+0000 7fafae7fc640 1 -- 172.21.15.137:0/4284351395 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fafb4019030 con 0x7fafa4004800 2024-04-26T22:07:37.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.878+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafb815c210 con 0x7fafa4004800 2024-04-26T22:07:37.879 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.879+0000 7fafae7fc640 1 -- 172.21.15.137:0/4284351395 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16652 (secure 0 0 0) 0x7fafb405a510 con 0x7fafa4004800 2024-04-26T22:07:37.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:37.879 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":114,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:36.895686+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:37.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf9c06c920 msgr2=0x7faf9c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf9c06c920 0x7faf9c06ede0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fafa8032000 tx=0x7fafa8009030 comp rx=0 tx=0).stop 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 msgr2=0x7fafb81f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafb81f5a20 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fafb4006c00 tx=0x7fafb400f610 comp rx=0 tx=0).stop 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 shutdown_connections 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7faf9c06c920 0x7faf9c06ede0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafb81e7b60 0x7fafb8158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fafb8071fd0 0x7fafb8144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 --2- 172.21.15.137:0/4284351395 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fafa4004800 0x7fafb81f5a20 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 >> 172.21.15.137:0/4284351395 conn(0x7fafb80d0d30 msgr2=0x7fafb80b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 shutdown_connections 2024-04-26T22:07:37.882 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.881+0000 7fafbfb71640 1 -- 172.21.15.137:0/4284351395 wait complete. 2024-04-26T22:07:37.893 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:37.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.989+0000 7fe5ffb0a640 1 Processor -- start 2024-04-26T22:07:37.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.990+0000 7fe5ffb0a640 1 -- start start 2024-04-26T22:07:37.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.990+0000 7fe5ffb0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f80d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.990+0000 7fe5ffb0a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5f809c450 0x7fe5f80ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.990+0000 7fe5ffb0a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f80cda60 con 0x7fe5f80d1510 2024-04-26T22:07:37.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.990+0000 7fe5ffb0a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe5f815d740 con 0x7fe5f809c450 2024-04-26T22:07:37.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.990+0000 7fe5ffb0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f80d1100 con 0x7fe5f815d360 2024-04-26T22:07:37.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.991+0000 7fe5fd8a6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f80d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.991+0000 7fe5fd0a5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5f809c450 0x7fe5f80ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.991+0000 7fe5fd8a6640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f80d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:35126/0 (socket says 172.21.15.137:35126) 2024-04-26T22:07:37.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.991+0000 7fe5fd8a6640 1 -- 172.21.15.137:0/3159984090 learned_addr learned my addr 172.21.15.137:0/3159984090 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:37.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.991+0000 7fe5fd8a6640 1 -- 172.21.15.137:0/3159984090 >> v2:172.21.15.170:3300/0 conn(0x7fe5f809c450 msgr2=0x7fe5f80ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:37.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.991+0000 7fe5fd8a6640 1 --2- 172.21.15.137:0/3159984090 >> v2:172.21.15.170:3300/0 conn(0x7fe5f809c450 0x7fe5f80ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.991+0000 7fe5fd8a6640 1 -- 172.21.15.137:0/3159984090 >> v1:172.21.15.170:6789/0 conn(0x7fe5f80d1510 legacy=0x7fe5f8070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.991+0000 7fe5fd8a6640 1 -- 172.21.15.137:0/3159984090 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f80cdd00 con 0x7fe5f815d360 2024-04-26T22:07:37.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.991+0000 7fe5fd0a5640 1 --2- 172.21.15.137:0/3159984090 >> v2:172.21.15.170:3300/0 conn(0x7fe5f809c450 0x7fe5f80ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:37.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.992+0000 7fe5fd8a6640 1 --2- 172.21.15.137:0/3159984090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f80d0b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009e50 tx=0x7fe5f402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52c9aa7d208a9aa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:37.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.992+0000 7fe5fc8a4640 1 -- 172.21.15.137:0/3159984090 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4036070 con 0x7fe5f815d360 2024-04-26T22:07:37.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.992+0000 7fe5fc8a4640 1 -- 172.21.15.137:0/3159984090 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f4031600 con 0x7fe5f815d360 2024-04-26T22:07:37.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.992+0000 7fe5fc8a4640 1 -- 172.21.15.137:0/3159984090 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40319d0 con 0x7fe5f815d360 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.992+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/3159984090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 msgr2=0x7fe5f80d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.992+0000 7fe5ffb0a640 1 --2- 172.21.15.137:0/3159984090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f80d0b20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009e50 tx=0x7fe5f402a710 comp rx=0 tx=0).stop 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.992+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/3159984090 shutdown_connections 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.992+0000 7fe5ffb0a640 1 --2- 172.21.15.137:0/3159984090 >> v2:172.21.15.170:3300/0 conn(0x7fe5f809c450 0x7fe5f80ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.992+0000 7fe5ffb0a640 1 --2- 172.21.15.137:0/3159984090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f80d0b20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.993+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/3159984090 >> 172.21.15.137:0/3159984090 conn(0x7fe5f80b4a40 msgr2=0x7fe5f80b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.993+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/3159984090 shutdown_connections 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.993+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/3159984090 wait complete. 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.994+0000 7fe5ffb0a640 1 Processor -- start 2024-04-26T22:07:37.994 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.994+0000 7fe5ffb0a640 1 -- start start 2024-04-26T22:07:37.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.994+0000 7fe5ffb0a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5f809c450 0x7fe5f809da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.994+0000 7fe5ffb0a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f80d1510 0x7fe5f809f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.994+0000 7fe5ffb0a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.994+0000 7fe5ffb0a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f80ced20 con 0x7fe5f809c450 2024-04-26T22:07:37.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.994+0000 7fe5ffb0a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f809c8b0 con 0x7fe5f80d1510 2024-04-26T22:07:37.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.994+0000 7fe5ffb0a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f80ceea0 con 0x7fe5f815d360 2024-04-26T22:07:37.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd8a6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5f809c450 0x7fe5f809da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd8a6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5f809c450 0x7fe5f809da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36326/0 (socket says 172.21.15.137:36326) 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd8a6640 1 -- 172.21.15.137:0/1782783027 learned_addr learned my addr 172.21.15.137:0/1782783027 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fe0a7640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd0a5640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f80d1510 0x7fe5f809f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd8a6640 1 -- 172.21.15.137:0/1782783027 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 msgr2=0x7fe5f815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd8a6640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f815b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd8a6640 1 -- 172.21.15.137:0/1782783027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f80d1510 msgr2=0x7fe5f809f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd8a6640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f80d1510 0x7fe5f809f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd8a6640 1 -- 172.21.15.137:0/1782783027 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f809f8d0 con 0x7fe5f809c450 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5fd8a6640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5f809c450 0x7fe5f809da90 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4000f80 tx=0x7fe5f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5ee7fc640 1 -- 172.21.15.137:0/1782783027 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4036050 con 0x7fe5f809c450 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5ee7fc640 1 -- 172.21.15.137:0/1782783027 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f4042070 con 0x7fe5f809c450 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f809fb90 con 0x7fe5f809c450 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5ee7fc640 1 -- 172.21.15.137:0/1782783027 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4009510 con 0x7fe5f809c450 2024-04-26T22:07:37.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.995+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f80a0150 con 0x7fe5f809c450 2024-04-26T22:07:37.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.996+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f80693d0 con 0x7fe5f809c450 2024-04-26T22:07:37.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.997+0000 7fe5ee7fc640 1 -- 172.21.15.137:0/1782783027 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe5f4007c70 con 0x7fe5f809c450 2024-04-26T22:07:37.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.997+0000 7fe5ee7fc640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe5dc06c8f0 0x7fe5dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:37.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.997+0000 7fe5ee7fc640 1 -- 172.21.15.137:0/1782783027 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fe5f40ac770 con 0x7fe5f809c450 2024-04-26T22:07:37.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.997+0000 7fe5fd0a5640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe5dc06c8f0 0x7fe5dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:37.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:37.998+0000 7fe5fd0a5640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe5dc06c8f0 0x7fe5dc06edb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80b3f60 tx=0x7fe5e8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:38.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.001+0000 7fe5ee7fc640 1 -- 172.21.15.137:0/1782783027 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe5f407a5e0 con 0x7fe5f809c450 2024-04-26T22:07:38.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.181+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5f8074880 con 0x7fe5f809c450 2024-04-26T22:07:38.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.182+0000 7fe5ee7fc640 1 -- 172.21.15.137:0/1782783027 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16652 (secure 0 0 0) 0x7fe5f407e8e0 con 0x7fe5f809c450 2024-04-26T22:07:38.182 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:38.183 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":114,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:36.895686+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:38.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe5dc06c8f0 msgr2=0x7fe5dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe5dc06c8f0 0x7fe5dc06edb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80b3f60 tx=0x7fe5e8009190 comp rx=0 tx=0).stop 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5f809c450 msgr2=0x7fe5f809da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5f809c450 0x7fe5f809da90 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4000f80 tx=0x7fe5f4004a40 comp rx=0 tx=0).stop 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 shutdown_connections 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe5dc06c8f0 0x7fe5dc06edb0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe5f815d360 0x7fe5f815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5f80d1510 0x7fe5f809f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 --2- 172.21.15.137:0/1782783027 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe5f809c450 0x7fe5f809da90 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 >> 172.21.15.137:0/1782783027 conn(0x7fe5f80b4a40 msgr2=0x7fe5f80c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 shutdown_connections 2024-04-26T22:07:38.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.184+0000 7fe5ffb0a640 1 -- 172.21.15.137:0/1782783027 wait complete. 2024-04-26T22:07:38.196 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T22:07:38.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.296+0000 7fc625f04640 1 Processor -- start 2024-04-26T22:07:38.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.296+0000 7fc625f04640 1 -- start start 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.296+0000 7fc625f04640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200d0300 0x7fc6200b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.296+0000 7fc625f04640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc6200b3e50 0x7fc6200720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.296+0000 7fc625f04640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6200b46a0 con 0x7fc62006f340 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.296+0000 7fc625f04640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc6200b5db0 con 0x7fc6200b3e50 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.296+0000 7fc625f04640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc6200b6090 con 0x7fc6200d0300 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.297+0000 7fc61ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc6200b3e50 0x7fc6200720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.297+0000 7fc61ffff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc6200b3e50 0x7fc6200720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36340/0 (socket says 172.21.15.137:36340) 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.297+0000 7fc61ffff640 1 -- 172.21.15.137:0/1840439732 learned_addr learned my addr 172.21.15.137:0/1840439732 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.297+0000 7fc61effd640 1 --2- 172.21.15.137:0/1840439732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200d0300 0x7fc6200b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.297+0000 7fc61ffff640 1 -- 172.21.15.137:0/1840439732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200d0300 msgr2=0x7fc6200b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.297+0000 7fc61ffff640 1 --2- 172.21.15.137:0/1840439732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200d0300 0x7fc6200b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.297+0000 7fc61ffff640 1 -- 172.21.15.137:0/1840439732 >> v1:172.21.15.170:6789/0 conn(0x7fc62006f340 legacy=0x7fc62006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.298 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.297+0000 7fc61ffff640 1 -- 172.21.15.137:0/1840439732 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6200b6370 con 0x7fc6200b3e50 2024-04-26T22:07:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc61ffff640 1 --2- 172.21.15.137:0/1840439732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6200b3e50 0x7fc6200720f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fc618009e80 tx=0x7fc61802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4132587d9ea459 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc61e7fc640 1 -- 172.21.15.137:0/1840439732 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618036070 con 0x7fc6200b3e50 2024-04-26T22:07:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc61e7fc640 1 -- 172.21.15.137:0/1840439732 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc618031600 con 0x7fc6200b3e50 2024-04-26T22:07:38.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc61e7fc640 1 -- 172.21.15.137:0/1840439732 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6180319d0 con 0x7fc6200b3e50 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc625f04640 1 -- 172.21.15.137:0/1840439732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6200b3e50 msgr2=0x7fc6200720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc625f04640 1 --2- 172.21.15.137:0/1840439732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6200b3e50 0x7fc6200720f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fc618009e80 tx=0x7fc61802a630 comp rx=0 tx=0).stop 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc625f04640 1 -- 172.21.15.137:0/1840439732 shutdown_connections 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc625f04640 1 --2- 172.21.15.137:0/1840439732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc6200b3e50 0x7fc6200720f0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc625f04640 1 --2- 172.21.15.137:0/1840439732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200d0300 0x7fc6200b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc625f04640 1 -- 172.21.15.137:0/1840439732 >> 172.21.15.137:0/1840439732 conn(0x7fc6200cd8a0 msgr2=0x7fc6200cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc625f04640 1 -- 172.21.15.137:0/1840439732 shutdown_connections 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.298+0000 7fc625f04640 1 -- 172.21.15.137:0/1840439732 wait complete. 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.300+0000 7fc625f04640 1 Processor -- start 2024-04-26T22:07:38.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.300+0000 7fc625f04640 1 -- start start 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.300+0000 7fc625f04640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62006f340 0x7fc6200ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.300+0000 7fc625f04640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200b3e50 0x7fc6200cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.300+0000 7fc625f04640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6200d0300 0x7fc62013b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.300+0000 7fc625f04640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc6200b4460 con 0x7fc62006f340 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.300+0000 7fc625f04640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc6200b42e0 con 0x7fc6200d0300 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.300+0000 7fc625f04640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc620142a30 con 0x7fc6200b3e50 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.300+0000 7fc61f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62006f340 0x7fc6200ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61f7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62006f340 0x7fc6200ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36352/0 (socket says 172.21.15.137:36352) 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61f7fe640 1 -- 172.21.15.137:0/2458372015 learned_addr learned my addr 172.21.15.137:0/2458372015 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:38.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61ffff640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6200d0300 0x7fc62013b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61effd640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200b3e50 0x7fc6200cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61f7fe640 1 -- 172.21.15.137:0/2458372015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200b3e50 msgr2=0x7fc6200cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61f7fe640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200b3e50 0x7fc6200cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61f7fe640 1 -- 172.21.15.137:0/2458372015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6200d0300 msgr2=0x7fc62013b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61f7fe640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6200d0300 0x7fc62013b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61f7fe640 1 -- 172.21.15.137:0/2458372015 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62013bc70 con 0x7fc62006f340 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61ffff640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6200d0300 0x7fc62013b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc61f7fe640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62006f340 0x7fc6200ca1d0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fc61000c3f0 tx=0x7fc61000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc607fff640 1 -- 172.21.15.137:0/2458372015 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6100052d0 con 0x7fc62006f340 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc607fff640 1 -- 172.21.15.137:0/2458372015 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc610005490 con 0x7fc62006f340 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc607fff640 1 -- 172.21.15.137:0/2458372015 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610007260 con 0x7fc62006f340 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6200ca7b0 con 0x7fc62006f340 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.301+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6200cad70 con 0x7fc62006f340 2024-04-26T22:07:38.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.302+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6200cb480 con 0x7fc62006f340 2024-04-26T22:07:38.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.303+0000 7fc607fff640 1 -- 172.21.15.137:0/2458372015 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc610007400 con 0x7fc62006f340 2024-04-26T22:07:38.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.303+0000 7fc607fff640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc60c06c920 0x7fc60c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.303+0000 7fc607fff640 1 -- 172.21.15.137:0/2458372015 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fc61008b050 con 0x7fc62006f340 2024-04-26T22:07:38.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.303+0000 7fc61effd640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc60c06c920 0x7fc60c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.303+0000 7fc61effd640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc60c06c920 0x7fc60c06ede0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc62015f4c0 tx=0x7fc614008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:38.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.307+0000 7fc607fff640 1 -- 172.21.15.137:0/2458372015 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc62013bc70 con 0x7fc62006f340 2024-04-26T22:07:38.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.522+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc6200739a0 con 0x7fc62006f340 2024-04-26T22:07:38.555 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.555+0000 7fc607fff640 1 -- 172.21.15.137:0/2458372015 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v80) ==== 118+0+0 (secure 0 0 0) 0x7fc610059480 con 0x7fc62006f340 2024-04-26T22:07:38.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc60c06c920 msgr2=0x7fc60c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc60c06c920 0x7fc60c06ede0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc62015f4c0 tx=0x7fc614008040 comp rx=0 tx=0).stop 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62006f340 msgr2=0x7fc6200ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62006f340 0x7fc6200ca1d0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fc61000c3f0 tx=0x7fc61000c8b0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 shutdown_connections 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc60c06c920 0x7fc60c06ede0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6200d0300 0x7fc62013b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc6200b3e50 0x7fc6200cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 --2- 172.21.15.137:0/2458372015 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc62006f340 0x7fc6200ca1d0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.557+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 >> 172.21.15.137:0/2458372015 conn(0x7fc6200cd8a0 msgr2=0x7fc62006f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.558+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 shutdown_connections 2024-04-26T22:07:38.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.558+0000 7fc625f04640 1 -- 172.21.15.137:0/2458372015 wait complete. 2024-04-26T22:07:38.569 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T22:07:38.569 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T22:07:38.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.670+0000 7fde63f5f640 1 Processor -- start 2024-04-26T22:07:38.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.670+0000 7fde63f5f640 1 -- start start 2024-04-26T22:07:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde63f5f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fde5c0d1be0 0x7fde5c0d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde63f5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c0ba3a0 0x7fde5c0ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde63f5f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde5c0d4240 con 0x7fde5c15f490 2024-04-26T22:07:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde63f5f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fde5c0d31a0 con 0x7fde5c0d1be0 2024-04-26T22:07:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde63f5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fde5c0d3480 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde61cfb640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fde5c15f490 0x7fde5c0d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50670/0 (socket says 172.21.15.137:50670) 2024-04-26T22:07:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde61cfb640 1 -- 172.21.15.137:0/1026822861 learned_addr learned my addr 172.21.15.137:0/1026822861 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde614fa640 1 --2- 172.21.15.137:0/1026822861 >> v2:172.21.15.137:3300/0 conn(0x7fde5c0d1be0 0x7fde5c0d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde624fc640 1 --2- 172.21.15.137:0/1026822861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c0ba3a0 0x7fde5c0ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde60cf9640 1 -- 172.21.15.137:0/1026822861 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681818710 0 0) 0x7fde5c0d4240 con 0x7fde5c15f490 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde60cf9640 1 -- 172.21.15.137:0/1026822861 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde48003520 con 0x7fde5c15f490 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde614fa640 1 -- 172.21.15.137:0/1026822861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c0ba3a0 msgr2=0x7fde5c0ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde614fa640 1 --2- 172.21.15.137:0/1026822861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c0ba3a0 0x7fde5c0ba7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde614fa640 1 -- 172.21.15.137:0/1026822861 >> v1:172.21.15.137:6789/0 conn(0x7fde5c15f490 legacy=0x7fde5c0d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde614fa640 1 -- 172.21.15.137:0/1026822861 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c0d3760 con 0x7fde5c0d1be0 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.671+0000 7fde624fc640 1 --2- 172.21.15.137:0/1026822861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c0ba3a0 0x7fde5c0ba7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.672+0000 7fde614fa640 1 --2- 172.21.15.137:0/1026822861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0d1be0 0x7fde5c0d2070 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097a0 tx=0x7fde4c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e048f4262a0c0c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.672+0000 7fde60cf9640 1 -- 172.21.15.137:0/1026822861 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c037070 con 0x7fde5c0d1be0 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.672+0000 7fde60cf9640 1 -- 172.21.15.137:0/1026822861 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4c032440 con 0x7fde5c0d1be0 2024-04-26T22:07:38.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.672+0000 7fde60cf9640 1 -- 172.21.15.137:0/1026822861 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0327f0 con 0x7fde5c0d1be0 2024-04-26T22:07:38.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.673+0000 7fde63f5f640 1 -- 172.21.15.137:0/1026822861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0d1be0 msgr2=0x7fde5c0d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.673+0000 7fde63f5f640 1 --2- 172.21.15.137:0/1026822861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0d1be0 0x7fde5c0d2070 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097a0 tx=0x7fde4c02a180 comp rx=0 tx=0).stop 2024-04-26T22:07:38.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.673+0000 7fde63f5f640 1 -- 172.21.15.137:0/1026822861 shutdown_connections 2024-04-26T22:07:38.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.673+0000 7fde63f5f640 1 --2- 172.21.15.137:0/1026822861 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c0ba3a0 0x7fde5c0ba7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.673+0000 7fde63f5f640 1 --2- 172.21.15.137:0/1026822861 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0d1be0 0x7fde5c0d2070 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.673+0000 7fde63f5f640 1 -- 172.21.15.137:0/1026822861 >> 172.21.15.137:0/1026822861 conn(0x7fde5c09e530 msgr2=0x7fde5c0d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:38.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.673+0000 7fde63f5f640 1 -- 172.21.15.137:0/1026822861 shutdown_connections 2024-04-26T22:07:38.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.673+0000 7fde63f5f640 1 -- 172.21.15.137:0/1026822861 wait complete. 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.674+0000 7fde63f5f640 1 Processor -- start 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.674+0000 7fde63f5f640 1 -- start start 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde63f5f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0ba3a0 0x7fde5c1f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde63f5f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5c0d1be0 0x7fde5c1f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde63f5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c15f490 0x7fde5c159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde63f5f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c0d11c0 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde63f5f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fde5c0d3d20 con 0x7fde5c0d1be0 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde63f5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fde5c15f870 con 0x7fde5c15f490 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde61cfb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0ba3a0 0x7fde5c1f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde61cfb640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0ba3a0 0x7fde5c1f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36372/0 (socket says 172.21.15.137:36372) 2024-04-26T22:07:38.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde61cfb640 1 -- 172.21.15.137:0/1981446493 learned_addr learned my addr 172.21.15.137:0/1981446493 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde624fc640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c15f490 0x7fde5c159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde614fa640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5c0d1be0 0x7fde5c1f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde61cfb640 1 -- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c15f490 msgr2=0x7fde5c159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde61cfb640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c15f490 0x7fde5c159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde61cfb640 1 -- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5c0d1be0 msgr2=0x7fde5c1f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde61cfb640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5c0d1be0 0x7fde5c1f8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde61cfb640 1 -- 172.21.15.137:0/1981446493 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5c160dd0 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde614fa640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5c0d1be0 0x7fde5c1f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde624fc640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c15f490 0x7fde5c159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde61cfb640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0ba3a0 0x7fde5c1f5530 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fde5800c390 tx=0x7fde5800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde527fc640 1 -- 172.21.15.137:0/1981446493 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde58017070 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde527fc640 1 -- 172.21.15.137:0/1981446493 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde58005ce0 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.675+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5c1610b0 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.676+0000 7fde527fc640 1 -- 172.21.15.137:0/1981446493 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde580072f0 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.676+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5c161670 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.676+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde5c06a290 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.677+0000 7fde527fc640 1 -- 172.21.15.137:0/1981446493 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde5801a070 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.677+0000 7fde527fc640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde4006c8f0 0x7fde4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:38.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.678+0000 7fde614fa640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde4006c8f0 0x7fde4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:38.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.678+0000 7fde527fc640 1 -- 172.21.15.137:0/1981446493 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fde5808af70 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.678+0000 7fde614fa640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde4006c8f0 0x7fde4006edb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fde4c034000 tx=0x7fde4c02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:38.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.682+0000 7fde527fc640 1 -- 172.21.15.137:0/1981446493 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fde580593a0 con 0x7fde5c0ba3a0 2024-04-26T22:07:38.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:38.896+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fde5c0d4240 con 0x7fde5c0ba3a0 2024-04-26T22:07:39.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.565+0000 7fde527fc640 1 -- 172.21.15.137:0/1981446493 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v81) ==== 122+0+0 (secure 0 0 0) 0x7fde58058ca0 con 0x7fde5c0ba3a0 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.567+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde4006c8f0 msgr2=0x7fde4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.567+0000 7fde63f5f640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde4006c8f0 0x7fde4006edb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fde4c034000 tx=0x7fde4c02e000 comp rx=0 tx=0).stop 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.567+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0ba3a0 msgr2=0x7fde5c1f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.567+0000 7fde63f5f640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0ba3a0 0x7fde5c1f5530 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fde5800c390 tx=0x7fde5800c850 comp rx=0 tx=0).stop 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.567+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 shutdown_connections 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.567+0000 7fde63f5f640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde4006c8f0 0x7fde4006edb0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.567+0000 7fde63f5f640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fde5c15f490 0x7fde5c159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.568+0000 7fde63f5f640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fde5c0d1be0 0x7fde5c1f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.568+0000 7fde63f5f640 1 --2- 172.21.15.137:0/1981446493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fde5c0ba3a0 0x7fde5c1f5530 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.568+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 >> 172.21.15.137:0/1981446493 conn(0x7fde5c09e530 msgr2=0x7fde5c162fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.568+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 shutdown_connections 2024-04-26T22:07:39.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.568+0000 7fde63f5f640 1 -- 172.21.15.137:0/1981446493 wait complete. 2024-04-26T22:07:39.580 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T22:07:39.580 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:39.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.679+0000 7f603cdda640 1 Processor -- start 2024-04-26T22:07:39.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.679+0000 7f603cdda640 1 -- start start 2024-04-26T22:07:39.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.680+0000 7f603cdda640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f60380d35b0 0x7f60380b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:39.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.680+0000 7f603cdda640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60380cfa50 0x7f60380cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.680+0000 7f603cdda640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60380d07d0 con 0x7f603815f2d0 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.680+0000 7f603cdda640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f603815f6b0 con 0x7f60380d35b0 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.680+0000 7f603cdda640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f60380b2ca0 con 0x7f60380cfa50 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.680+0000 7f6035d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f60380d35b0 0x7f60380b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.680+0000 7f6035d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f60380d35b0 0x7f60380b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36384/0 (socket says 172.21.15.137:36384) 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.680+0000 7f6035d9b640 1 -- 172.21.15.137:0/1422284663 learned_addr learned my addr 172.21.15.137:0/1422284663 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.681+0000 7f6035d9b640 1 -- 172.21.15.137:0/1422284663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60380cfa50 msgr2=0x7f60380cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.681+0000 7f6035d9b640 1 --2- 172.21.15.137:0/1422284663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60380cfa50 0x7f60380cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.681+0000 7f6035d9b640 1 -- 172.21.15.137:0/1422284663 >> v1:172.21.15.170:6789/0 conn(0x7f603815f2d0 legacy=0x7f60380d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:39.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.681+0000 7f6035d9b640 1 -- 172.21.15.137:0/1422284663 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60380b2f80 con 0x7f60380d35b0 2024-04-26T22:07:39.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.681+0000 7f6035d9b640 1 --2- 172.21.15.137:0/1422284663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 0x7f60380b3a60 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f602c009870 tx=0x7f602c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a53ce5f7efb5a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:39.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.681+0000 7f603559a640 1 -- 172.21.15.137:0/1422284663 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c037070 con 0x7f60380d35b0 2024-04-26T22:07:39.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.681+0000 7f603559a640 1 -- 172.21.15.137:0/1422284663 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602c032440 con 0x7f60380d35b0 2024-04-26T22:07:39.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.681+0000 7f603559a640 1 -- 172.21.15.137:0/1422284663 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c032810 con 0x7f60380d35b0 2024-04-26T22:07:39.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.682+0000 7f603cdda640 1 -- 172.21.15.137:0/1422284663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 msgr2=0x7f60380b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:39.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.682+0000 7f603cdda640 1 --2- 172.21.15.137:0/1422284663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 0x7f60380b3a60 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f602c009870 tx=0x7f602c02a210 comp rx=0 tx=0).stop 2024-04-26T22:07:39.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.682+0000 7f603cdda640 1 -- 172.21.15.137:0/1422284663 shutdown_connections 2024-04-26T22:07:39.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.682+0000 7f603cdda640 1 --2- 172.21.15.137:0/1422284663 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f60380cfa50 0x7f60380cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.682+0000 7f603cdda640 1 --2- 172.21.15.137:0/1422284663 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 0x7f60380b3a60 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.682+0000 7f603cdda640 1 -- 172.21.15.137:0/1422284663 >> 172.21.15.137:0/1422284663 conn(0x7f603809ba40 msgr2=0x7f603809be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:39.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.682+0000 7f603cdda640 1 -- 172.21.15.137:0/1422284663 shutdown_connections 2024-04-26T22:07:39.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.682+0000 7f603cdda640 1 -- 172.21.15.137:0/1422284663 wait complete. 2024-04-26T22:07:39.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.683+0000 7f603cdda640 1 Processor -- start 2024-04-26T22:07:39.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.683+0000 7f603cdda640 1 -- start start 2024-04-26T22:07:39.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f603cdda640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60380cfa50 0x7f60380b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:39.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f603cdda640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 0x7f60380c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:39.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f603cdda640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f603815f2d0 0x7f6038152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:39.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f603cdda640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f60380d0440 con 0x7f60380d35b0 2024-04-26T22:07:39.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f603cdda640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f60380b3540 con 0x7f60380cfa50 2024-04-26T22:07:39.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f603cdda640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f603806d3b0 con 0x7f603815f2d0 2024-04-26T22:07:39.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6035d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 0x7f60380c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6035d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 0x7f60380c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36386/0 (socket says 172.21.15.137:36386) 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6035d9b640 1 -- 172.21.15.137:0/3233116779 learned_addr learned my addr 172.21.15.137:0/3233116779 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f603659c640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60380cfa50 0x7f60380b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6036d9d640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f603815f2d0 0x7f6038152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6035d9b640 1 -- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f603815f2d0 msgr2=0x7f6038152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6035d9b640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f603815f2d0 0x7f6038152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6035d9b640 1 -- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60380cfa50 msgr2=0x7f60380b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6035d9b640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60380cfa50 0x7f60380b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6035d9b640 1 -- 172.21.15.137:0/3233116779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60380c7d80 con 0x7f60380d35b0 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f603659c640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60380cfa50 0x7f60380b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.684+0000 7f6036d9d640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f603815f2d0 0x7f6038152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.685+0000 7f6035d9b640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 0x7f60380c72c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f602c009870 tx=0x7f602c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:39.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.685+0000 7f6026ffd640 1 -- 172.21.15.137:0/3233116779 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c041070 con 0x7f60380d35b0 2024-04-26T22:07:39.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.685+0000 7f6026ffd640 1 -- 172.21.15.137:0/3233116779 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602c03c870 con 0x7f60380d35b0 2024-04-26T22:07:39.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.685+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60381f8ef0 con 0x7f60380d35b0 2024-04-26T22:07:39.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.685+0000 7f6026ffd640 1 -- 172.21.15.137:0/3233116779 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c037040 con 0x7f60380d35b0 2024-04-26T22:07:39.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.685+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60381f94b0 con 0x7f60380d35b0 2024-04-26T22:07:39.687 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.686+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603806a290 con 0x7f60380d35b0 2024-04-26T22:07:39.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.686+0000 7f6026ffd640 1 -- 172.21.15.137:0/3233116779 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f602c044070 con 0x7f60380d35b0 2024-04-26T22:07:39.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.687+0000 7f6026ffd640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f601806c8f0 0x7f601806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:39.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.687+0000 7f6026ffd640 1 -- 172.21.15.137:0/3233116779 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f602c0ac640 con 0x7f60380d35b0 2024-04-26T22:07:39.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.687+0000 7f603659c640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f601806c8f0 0x7f601806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:39.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.687+0000 7f603659c640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f601806c8f0 0x7f601806edb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f602800c420 tx=0x7f6028009570 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:39.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.691+0000 7f6026ffd640 1 -- 172.21.15.137:0/3233116779 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f60380c7d80 con 0x7f60380d35b0 2024-04-26T22:07:39.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.906+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60380cf360 con 0x7f60380d35b0 2024-04-26T22:07:39.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.906+0000 7f6026ffd640 1 -- 172.21.15.137:0/3233116779 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5195 (secure 0 0 0) 0x7f602c07aa70 con 0x7f60380d35b0 2024-04-26T22:07:39.906 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:39.906 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/2830617564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2830617564},{"type":"v1","addr":"172.21.15.137:6837","nonce":2830617564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:07:38.897715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8871":{"gid":8871,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/1666946913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1666946913},{"type":"v1","addr":"172.21.15.170:6834","nonce":1666946913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8871,"qdb_cluster":[8871]},"id":8}]} 2024-04-26T22:07:39.907 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 81 2024-04-26T22:07:39.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f601806c8f0 msgr2=0x7f601806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:39.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f601806c8f0 0x7f601806edb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f602800c420 tx=0x7f6028009570 comp rx=0 tx=0).stop 2024-04-26T22:07:39.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 msgr2=0x7f60380c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:39.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 0x7f60380c72c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f602c009870 tx=0x7f602c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 shutdown_connections 2024-04-26T22:07:39.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f601806c8f0 0x7f601806edb0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f60380d35b0 0x7f60380c72c0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f603815f2d0 0x7f6038152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 --2- 172.21.15.137:0/3233116779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60380cfa50 0x7f60380b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:39.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 >> 172.21.15.137:0/3233116779 conn(0x7f603809ba40 msgr2=0x7f60380b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:39.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 shutdown_connections 2024-04-26T22:07:39.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:39.908+0000 7f603cdda640 1 -- 172.21.15.137:0/3233116779 wait complete. 2024-04-26T22:07:39.919 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:40.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.016+0000 7f6e01a7e640 1 Processor -- start 2024-04-26T22:07:40.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.016+0000 7f6e01a7e640 1 -- start start 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.017+0000 7f6e01a7e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc160640 0x7f6dfc1636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.017+0000 7f6e01a7e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc0cfa80 con 0x7f6dfc163be0 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.017+0000 7f6e01a7e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dfc0cfd60 con 0x7f6dfc148a30 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.017+0000 7f6e01a7e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6dfc0745e0 con 0x7f6dfc160640 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.017+0000 7f6dfbfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6dfc163be0 0x7f6dfc0b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50682/0 (socket says 172.21.15.137:50682) 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.017+0000 7f6dfbfff640 1 -- 172.21.15.137:0/3712362309 learned_addr learned my addr 172.21.15.137:0/3712362309 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.017+0000 7f6dfaffd640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc160640 0x7f6dfc1636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.017+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466754691 0 0) 0x7f6dfc0cfa80 con 0x7f6dfc163be0 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.017+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6de4003520 con 0x7f6dfc163be0 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457103785 0 0) 0x7f6dfc0cfd60 con 0x7f6dfc148a30 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dfc0cfa80 con 0x7f6dfc148a30 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4173238833 0 0) 0x7f6de4003520 con 0x7f6dfc163be0 2024-04-26T22:07:40.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc160640 msgr2=0x7f6dfc1636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc160640 0x7f6dfc1636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 >> v1:172.21.15.170:6789/0 conn(0x7f6dfc148a30 legacy=0x7f6dfc073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc0d0040 con 0x7f6dfc163be0 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f6df40019f0 con 0x7f6dfc163be0 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 >> v1:172.21.15.137:6789/0 conn(0x7f6dfc163be0 legacy=0x7f6dfc0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6de4003b70 0x7f6de4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc160640 0x7f6de4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6de4004d40 0x7f6de40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc0745e0 con 0x7f6de4004d40 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6de400bb50 con 0x7f6de4003b70 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6de400bd20 con 0x7f6dfc160640 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfbfff640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6de4004d40 0x7f6de40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfb7fe640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6de4003b70 0x7f6de4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfaffd640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc160640 0x7f6de4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfbfff640 1 -- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc160640 msgr2=0x7f6de4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfbfff640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc160640 0x7f6de4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfbfff640 1 -- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6de4003b70 msgr2=0x7f6de4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfbfff640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6de4003b70 0x7f6de4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.018+0000 7f6dfbfff640 1 -- 172.21.15.137:0/3712362309 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de4003520 con 0x7f6de4004d40 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.019+0000 7f6dfbfff640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6de4004d40 0x7f6de40051c0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f6df400a740 tx=0x7f6de4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef177db2a220747b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.019+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df400a330 con 0x7f6de4004d40 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.019+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df402f070 con 0x7f6de4004d40 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.019+0000 7f6dfa7fc640 1 -- 172.21.15.137:0/3712362309 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df402bb50 con 0x7f6de4004d40 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.020+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3712362309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6de4004d40 msgr2=0x7f6de40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.020+0000 7f6e01a7e640 1 --2- 172.21.15.137:0/3712362309 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6de4004d40 0x7f6de40051c0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f6df400a740 tx=0x7f6de4005830 comp rx=0 tx=0).stop 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.020+0000 7f6dfbfff640 1 -- 172.21.15.137:0/3712362309 reap_dead start 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.020+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3712362309 shutdown_connections 2024-04-26T22:07:40.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.020+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3712362309 >> 172.21.15.137:0/3712362309 conn(0x7f6dfc0ce8b0 msgr2=0x7f6dfc0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:40.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.020+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3712362309 shutdown_connections 2024-04-26T22:07:40.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.020+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3712362309 wait complete. 2024-04-26T22:07:40.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.021+0000 7f6e01a7e640 1 Processor -- start 2024-04-26T22:07:40.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.021+0000 7f6e01a7e640 1 -- start start 2024-04-26T22:07:40.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6e01a7e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc0d2060 0x7f6dfc0af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6e01a7e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dfc0afe40 0x7f6dfc1f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6e01a7e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc1f5810 0x7f6dfc0b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6e01a7e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc148e10 con 0x7f6dfc0afe40 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6e01a7e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6dfc163180 con 0x7f6dfc0d2060 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6e01a7e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6dfc148f90 con 0x7f6dfc1f5810 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfaffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dfc0afe40 0x7f6dfc1f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfaffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dfc0afe40 0x7f6dfc1f52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36396/0 (socket says 172.21.15.137:36396) 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfaffd640 1 -- 172.21.15.137:0/3043851757 learned_addr learned my addr 172.21.15.137:0/3043851757 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfb7fe640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc0d2060 0x7f6dfc0af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfbfff640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc1f5810 0x7f6dfc0b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfaffd640 1 -- 172.21.15.137:0/3043851757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc1f5810 msgr2=0x7f6dfc0b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfaffd640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc1f5810 0x7f6dfc0b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfaffd640 1 -- 172.21.15.137:0/3043851757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc0d2060 msgr2=0x7f6dfc0af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfaffd640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc0d2060 0x7f6dfc0af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfaffd640 1 -- 172.21.15.137:0/3043851757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dfc0b0350 con 0x7f6dfc0afe40 2024-04-26T22:07:40.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6dfaffd640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dfc0afe40 0x7f6dfc1f52d0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f6df0011940 tx=0x7f6df0011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6de3fff640 1 -- 172.21.15.137:0/3043851757 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df000faf0 con 0x7f6dfc0afe40 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6de3fff640 1 -- 172.21.15.137:0/3043851757 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df000fc90 con 0x7f6dfc0afe40 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dfc0b0630 con 0x7f6dfc0afe40 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6de3fff640 1 -- 172.21.15.137:0/3043851757 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df0014440 con 0x7f6dfc0afe40 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.022+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dfc0b4fd0 con 0x7f6dfc0afe40 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.023+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dfc06a290 con 0x7f6dfc0afe40 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.024+0000 7f6de3fff640 1 -- 172.21.15.137:0/3043851757 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6df0012040 con 0x7f6dfc0afe40 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.024+0000 7f6de3fff640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6de806c8f0 0x7f6de806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.024+0000 7f6dfb7fe640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6de806c8f0 0x7f6de806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.024+0000 7f6de3fff640 1 -- 172.21.15.137:0/3043851757 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f6df008c280 con 0x7f6dfc0afe40 2024-04-26T22:07:40.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.025+0000 7f6dfb7fe640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6de806c8f0 0x7f6de806edb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6dec000c00 tx=0x7f6dec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:40.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.028+0000 7f6de3fff640 1 -- 172.21.15.137:0/3043851757 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6df0019030 con 0x7f6dfc0afe40 2024-04-26T22:07:40.210 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.210+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6dfc0b09d0 con 0x7f6dfc0afe40 2024-04-26T22:07:40.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.211+0000 7f6de3fff640 1 -- 172.21.15.137:0/3043851757 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16639 (secure 0 0 0) 0x7f6df005a630 con 0x7f6dfc0afe40 2024-04-26T22:07:40.211 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:40.211 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":115,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:38.555671+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6de806c8f0 msgr2=0x7f6de806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6de806c8f0 0x7f6de806edb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6dec000c00 tx=0x7f6dec009040 comp rx=0 tx=0).stop 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dfc0afe40 msgr2=0x7f6dfc1f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dfc0afe40 0x7f6dfc1f52d0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f6df0011940 tx=0x7f6df0011e00 comp rx=0 tx=0).stop 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 shutdown_connections 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6de806c8f0 0x7f6de806edb0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6dfc0afe40 0x7f6dfc1f52d0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6dfc1f5810 0x7f6dfc0b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 --2- 172.21.15.137:0/3043851757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc0d2060 0x7f6dfc0af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.213+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 >> 172.21.15.137:0/3043851757 conn(0x7f6dfc0ce8b0 msgr2=0x7f6dfc073ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.214+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 shutdown_connections 2024-04-26T22:07:40.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.214+0000 7f6e01a7e640 1 -- 172.21.15.137:0/3043851757 wait complete. 2024-04-26T22:07:40.224 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T22:07:40.224 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.321+0000 7f9f773a4640 1 Processor -- start 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.321+0000 7f9f773a4640 1 -- start start 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f773a4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9f700742c0 0x7f9f7015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f773a4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70161850 0x7f9f7015dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f773a4640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7015e2e0 con 0x7f9f70146980 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f773a4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7015e5c0 con 0x7f9f700742c0 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f773a4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9f701613c0 con 0x7f9f70161850 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f75140640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9f70146980 0x7f9f70073bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50698/0 (socket says 172.21.15.137:50698) 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f75140640 1 -- 172.21.15.137:0/1747577031 learned_addr learned my addr 172.21.15.137:0/1747577031 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468682135 0 0) 0x7f9f7015e2e0 con 0x7f9f70146980 2024-04-26T22:07:40.324 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f75941640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70161850 0x7f9f7015dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f7493f640 1 --2- 172.21.15.137:0/1747577031 >> v2:172.21.15.170:3300/0 conn(0x7f9f700742c0 0x7f9f7015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f5c003520 con 0x7f9f70146980 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3377818572 0 0) 0x7f9f5c003520 con 0x7f9f70146980 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70161850 msgr2=0x7f9f7015dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70161850 0x7f9f7015dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 >> v2:172.21.15.170:3300/0 conn(0x7f9f700742c0 msgr2=0x7f9f7015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 --2- 172.21.15.137:0/1747577031 >> v2:172.21.15.170:3300/0 conn(0x7f9f700742c0 0x7f9f7015d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f70160d70 con 0x7f9f70146980 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f9f6c001670 con 0x7f9f70146980 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 >> v1:172.21.15.137:6789/0 conn(0x7f9f70146980 legacy=0x7f9f70073bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70161850 0x7f9f5c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f5c003f30 0x7f9f5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f5c004d40 0x7f9f5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7015e5c0 con 0x7f9f5c003f30 2024-04-26T22:07:40.325 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9f701613c0 con 0x7f9f5c004d40 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9f5c00b9c0 con 0x7f9f70161850 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.322+0000 7f9f7493f640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f5c003f30 0x7f9f5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.323+0000 7f9f75140640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70161850 0x7f9f5c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.323+0000 7f9f75941640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f5c004d40 0x7f9f5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.323+0000 7f9f7493f640 1 -- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70161850 msgr2=0x7f9f5c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.323+0000 7f9f7493f640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70161850 0x7f9f5c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.323+0000 7f9f7493f640 1 -- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f5c004d40 msgr2=0x7f9f5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.323+0000 7f9f7493f640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f5c004d40 0x7f9f5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.323+0000 7f9f7493f640 1 -- 172.21.15.137:0/1747577031 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c003520 con 0x7f9f5c003f30 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.323+0000 7f9f7493f640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f5c003f30 0x7f9f5c004800 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009ac0 tx=0x7f9f5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f864d429664d94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.323+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60036070 con 0x7f9f5c003f30 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.324+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f60031400 con 0x7f9f5c003f30 2024-04-26T22:07:40.326 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.324+0000 7f9f67fff640 1 -- 172.21.15.137:0/1747577031 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60009690 con 0x7f9f5c003f30 2024-04-26T22:07:40.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.324+0000 7f9f773a4640 1 -- 172.21.15.137:0/1747577031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f5c003f30 msgr2=0x7f9f5c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.324+0000 7f9f773a4640 1 --2- 172.21.15.137:0/1747577031 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f5c003f30 0x7f9f5c004800 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009ac0 tx=0x7f9f5c005830 comp rx=0 tx=0).stop 2024-04-26T22:07:40.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.324+0000 7f9f75941640 1 -- 172.21.15.137:0/1747577031 reap_dead start 2024-04-26T22:07:40.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.324+0000 7f9f773a4640 1 -- 172.21.15.137:0/1747577031 shutdown_connections 2024-04-26T22:07:40.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.324+0000 7f9f773a4640 1 -- 172.21.15.137:0/1747577031 >> 172.21.15.137:0/1747577031 conn(0x7f9f700ce8b0 msgr2=0x7f9f700cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:40.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.324+0000 7f9f773a4640 1 -- 172.21.15.137:0/1747577031 shutdown_connections 2024-04-26T22:07:40.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.324+0000 7f9f773a4640 1 -- 172.21.15.137:0/1747577031 wait complete. 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.325+0000 7f9f773a4640 1 Processor -- start 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.325+0000 7f9f773a4640 1 -- start start 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f773a4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f5c003f30 0x7f9f7015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f773a4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f700cc300 0x7f9f70160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f773a4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70160550 0x7f9f701f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f773a4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9f70146d60 con 0x7f9f700cc300 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f773a4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9f700b5120 con 0x7f9f5c003f30 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f773a4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7015dbf0 con 0x7f9f70160550 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f7493f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f700cc300 0x7f9f70160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f7493f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f700cc300 0x7f9f70160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36408/0 (socket says 172.21.15.137:36408) 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f7493f640 1 -- 172.21.15.137:0/601633258 learned_addr learned my addr 172.21.15.137:0/601633258 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f75941640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70160550 0x7f9f701f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f75140640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f5c003f30 0x7f9f7015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f7493f640 1 -- 172.21.15.137:0/601633258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70160550 msgr2=0x7f9f701f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f7493f640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70160550 0x7f9f701f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f7493f640 1 -- 172.21.15.137:0/601633258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f5c003f30 msgr2=0x7f9f7015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f7493f640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f5c003f30 0x7f9f7015cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.326+0000 7f9f7493f640 1 -- 172.21.15.137:0/601633258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f700c8170 con 0x7f9f700cc300 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.327+0000 7f9f7493f640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f700cc300 0x7f9f70160010 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f9f60000c00 tx=0x7f9f60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.327+0000 7f9f65ffb640 1 -- 172.21.15.137:0/601633258 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60040020 con 0x7f9f700cc300 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.327+0000 7f9f65ffb640 1 -- 172.21.15.137:0/601633258 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f60003a40 con 0x7f9f700cc300 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.327+0000 7f9f65ffb640 1 -- 172.21.15.137:0/601633258 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60036040 con 0x7f9f700cc300 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.327+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f700c8450 con 0x7f9f700cc300 2024-04-26T22:07:40.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.327+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f700c8a10 con 0x7f9f700cc300 2024-04-26T22:07:40.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.328+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7006a290 con 0x7f9f700cc300 2024-04-26T22:07:40.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.328+0000 7f9f65ffb640 1 -- 172.21.15.137:0/601633258 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f60043020 con 0x7f9f700cc300 2024-04-26T22:07:40.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.329+0000 7f9f65ffb640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f5406c8f0 0x7f9f5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.329+0000 7f9f65ffb640 1 -- 172.21.15.137:0/601633258 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f9f600abea0 con 0x7f9f700cc300 2024-04-26T22:07:40.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.329+0000 7f9f75140640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f5406c8f0 0x7f9f5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.329+0000 7f9f75140640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f5406c8f0 0x7f9f5406edb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c001eb0 tx=0x7f9f6c007970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:40.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.333+0000 7f9f65ffb640 1 -- 172.21.15.137:0/601633258 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9f6004a030 con 0x7f9f700cc300 2024-04-26T22:07:40.504 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.505+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f70160930 con 0x7f9f5406c8f0 2024-04-26T22:07:40.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.510+0000 7f9f65ffb640 1 -- 172.21.15.137:0/601633258 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252410 (secure 0 0 0) 0x7f9f70160930 con 0x7f9f5406c8f0 2024-04-26T22:07:40.513 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:40.514 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:07:40.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f5406c8f0 msgr2=0x7f9f5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f5406c8f0 0x7f9f5406edb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c001eb0 tx=0x7f9f6c007970 comp rx=0 tx=0).stop 2024-04-26T22:07:40.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f700cc300 msgr2=0x7f9f70160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f700cc300 0x7f9f70160010 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f9f60000c00 tx=0x7f9f60004730 comp rx=0 tx=0).stop 2024-04-26T22:07:40.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 shutdown_connections 2024-04-26T22:07:40.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9f5406c8f0 0x7f9f5406edb0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9f700cc300 0x7f9f70160010 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9f70160550 0x7f9f701f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 --2- 172.21.15.137:0/601633258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f5c003f30 0x7f9f7015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 >> 172.21.15.137:0/601633258 conn(0x7f9f700ce8b0 msgr2=0x7f9f70145c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:40.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 shutdown_connections 2024-04-26T22:07:40.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.514+0000 7f9f773a4640 1 -- 172.21.15.137:0/601633258 wait complete. 2024-04-26T22:07:40.524 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":384,"stamp":"2024-04-26T22:07:38.814411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278264,"kb_used_data":12176,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754696456,"statfs":{"total":773094113280,"available":772809170944,"internally_reserved":0,"allocated":12468224,"data_stored":6057758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000628"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573823+0000","last_change":"2024-04-26T22:07:37.570247+0000","last_active":"2024-04-26T22:07:37.573823+0000","last_peered":"2024-04-26T22:07:37.573823+0000","last_clean":"2024-04-26T22:07:37.573823+0000","last_became_active":"2024-04-26T22:07:37.570000+0000","last_became_peered":"2024-04-26T22:07:37.570000+0000","last_unstale":"2024-04-26T22:07:37.573823+0000","last_undegraded":"2024-04-26T22:07:37.573823+0000","last_fullsized":"2024-04-26T22:07:37.573823+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:02.843539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575189+0000","last_change":"2024-04-26T22:07:37.574031+0000","last_active":"2024-04-26T22:07:37.575189+0000","last_peered":"2024-04-26T22:07:37.575189+0000","last_clean":"2024-04-26T22:07:37.575189+0000","last_became_active":"2024-04-26T22:07:37.573198+0000","last_became_peered":"2024-04-26T22:07:37.573198+0000","last_unstale":"2024-04-26T22:07:37.575189+0000","last_undegraded":"2024-04-26T22:07:37.575189+0000","last_fullsized":"2024-04-26T22:07:37.575189+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:58.056862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.560413+0000","last_change":"2024-04-26T22:07:37.555784+0000","last_active":"2024-04-26T22:07:37.560413+0000","last_peered":"2024-04-26T22:07:37.560413+0000","last_clean":"2024-04-26T22:07:37.560413+0000","last_became_active":"2024-04-26T22:07:37.555424+0000","last_became_peered":"2024-04-26T22:07:37.555424+0000","last_unstale":"2024-04-26T22:07:37.560413+0000","last_undegraded":"2024-04-26T22:07:37.560413+0000","last_fullsized":"2024-04-26T22:07:37.560413+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:20.153663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578873+0000","last_change":"2024-04-26T22:07:37.575300+0000","last_active":"2024-04-26T22:07:37.578873+0000","last_peered":"2024-04-26T22:07:37.578873+0000","last_clean":"2024-04-26T22:07:37.578873+0000","last_became_active":"2024-04-26T22:07:37.575014+0000","last_became_peered":"2024-04-26T22:07:37.575014+0000","last_unstale":"2024-04-26T22:07:37.578873+0000","last_undegraded":"2024-04-26T22:07:37.578873+0000","last_fullsized":"2024-04-26T22:07:37.578873+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:19.407481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.566666+0000","last_change":"2024-04-26T22:07:37.561455+0000","last_active":"2024-04-26T22:07:37.566666+0000","last_peered":"2024-04-26T22:07:37.566666+0000","last_clean":"2024-04-26T22:07:37.566666+0000","last_became_active":"2024-04-26T22:07:37.561188+0000","last_became_peered":"2024-04-26T22:07:37.561188+0000","last_unstale":"2024-04-26T22:07:37.566666+0000","last_undegraded":"2024-04-26T22:07:37.566666+0000","last_fullsized":"2024-04-26T22:07:37.566666+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:47.848803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565465+0000","last_change":"2024-04-26T22:07:37.560858+0000","last_active":"2024-04-26T22:07:37.565465+0000","last_peered":"2024-04-26T22:07:37.565465+0000","last_clean":"2024-04-26T22:07:37.565465+0000","last_became_active":"2024-04-26T22:07:37.560597+0000","last_became_peered":"2024-04-26T22:07:37.560597+0000","last_unstale":"2024-04-26T22:07:37.565465+0000","last_undegraded":"2024-04-26T22:07:37.565465+0000","last_fullsized":"2024-04-26T22:07:37.565465+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:25.059236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.571713+0000","last_change":"2024-04-26T22:07:37.570241+0000","last_active":"2024-04-26T22:07:37.571713+0000","last_peered":"2024-04-26T22:07:37.571713+0000","last_clean":"2024-04-26T22:07:37.571713+0000","last_became_active":"2024-04-26T22:07:37.569945+0000","last_became_peered":"2024-04-26T22:07:37.569945+0000","last_unstale":"2024-04-26T22:07:37.571713+0000","last_undegraded":"2024-04-26T22:07:37.571713+0000","last_fullsized":"2024-04-26T22:07:37.571713+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:21.768882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.563621+0000","last_change":"2024-04-26T22:07:37.558835+0000","last_active":"2024-04-26T22:07:37.563621+0000","last_peered":"2024-04-26T22:07:37.563621+0000","last_clean":"2024-04-26T22:07:37.563621+0000","last_became_active":"2024-04-26T22:07:37.558554+0000","last_became_peered":"2024-04-26T22:07:37.558554+0000","last_unstale":"2024-04-26T22:07:37.563621+0000","last_undegraded":"2024-04-26T22:07:37.563621+0000","last_fullsized":"2024-04-26T22:07:37.563621+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:58.056862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573806+0000","last_change":"2024-04-26T22:07:37.568822+0000","last_active":"2024-04-26T22:07:37.573806+0000","last_peered":"2024-04-26T22:07:37.573806+0000","last_clean":"2024-04-26T22:07:37.573806+0000","last_became_active":"2024-04-26T22:07:37.568567+0000","last_became_peered":"2024-04-26T22:07:37.568567+0000","last_unstale":"2024-04-26T22:07:37.573806+0000","last_undegraded":"2024-04-26T22:07:37.573806+0000","last_fullsized":"2024-04-26T22:07:37.573806+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:31.059383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567289+0000","last_change":"2024-04-26T22:07:37.562648+0000","last_active":"2024-04-26T22:07:37.567289+0000","last_peered":"2024-04-26T22:07:37.567289+0000","last_clean":"2024-04-26T22:07:37.567289+0000","last_became_active":"2024-04-26T22:07:37.562116+0000","last_became_peered":"2024-04-26T22:07:37.562116+0000","last_unstale":"2024-04-26T22:07:37.567289+0000","last_undegraded":"2024-04-26T22:07:37.567289+0000","last_fullsized":"2024-04-26T22:07:37.567289+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:49.102224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575109+0000","last_change":"2024-04-26T22:07:37.573659+0000","last_active":"2024-04-26T22:07:37.575109+0000","last_peered":"2024-04-26T22:07:37.575109+0000","last_clean":"2024-04-26T22:07:37.575109+0000","last_became_active":"2024-04-26T22:07:37.573333+0000","last_became_peered":"2024-04-26T22:07:37.573333+0000","last_unstale":"2024-04-26T22:07:37.575109+0000","last_undegraded":"2024-04-26T22:07:37.575109+0000","last_fullsized":"2024-04-26T22:07:37.575109+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:21.287067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.576248+0000","last_change":"2024-04-26T22:07:37.571949+0000","last_active":"2024-04-26T22:07:37.576248+0000","last_peered":"2024-04-26T22:07:37.576248+0000","last_clean":"2024-04-26T22:07:37.576248+0000","last_became_active":"2024-04-26T22:07:37.571343+0000","last_became_peered":"2024-04-26T22:07:37.571343+0000","last_unstale":"2024-04-26T22:07:37.576248+0000","last_undegraded":"2024-04-26T22:07:37.576248+0000","last_fullsized":"2024-04-26T22:07:37.576248+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:24:41.505060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565989+0000","last_change":"2024-04-26T22:07:37.563432+0000","last_active":"2024-04-26T22:07:37.565989+0000","last_peered":"2024-04-26T22:07:37.565989+0000","last_clean":"2024-04-26T22:07:37.565989+0000","last_became_active":"2024-04-26T22:07:37.563153+0000","last_became_peered":"2024-04-26T22:07:37.563153+0000","last_unstale":"2024-04-26T22:07:37.565989+0000","last_undegraded":"2024-04-26T22:07:37.565989+0000","last_fullsized":"2024-04-26T22:07:37.565989+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:01.343063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.568745+0000","last_change":"2024-04-26T22:07:37.567298+0000","last_active":"2024-04-26T22:07:37.568745+0000","last_peered":"2024-04-26T22:07:37.568745+0000","last_clean":"2024-04-26T22:07:37.568745+0000","last_became_active":"2024-04-26T22:07:37.567004+0000","last_became_peered":"2024-04-26T22:07:37.567004+0000","last_unstale":"2024-04-26T22:07:37.568745+0000","last_undegraded":"2024-04-26T22:07:37.568745+0000","last_fullsized":"2024-04-26T22:07:37.568745+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:46.980260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565711+0000","last_change":"2024-04-26T22:07:37.562654+0000","last_active":"2024-04-26T22:07:37.565711+0000","last_peered":"2024-04-26T22:07:37.565711+0000","last_clean":"2024-04-26T22:07:37.565711+0000","last_became_active":"2024-04-26T22:07:37.562370+0000","last_became_peered":"2024-04-26T22:07:37.562370+0000","last_unstale":"2024-04-26T22:07:37.565711+0000","last_undegraded":"2024-04-26T22:07:37.565711+0000","last_fullsized":"2024-04-26T22:07:37.565711+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:41.170155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573832+0000","last_change":"2024-04-26T22:07:37.569211+0000","last_active":"2024-04-26T22:07:37.573832+0000","last_peered":"2024-04-26T22:07:37.573832+0000","last_clean":"2024-04-26T22:07:37.573832+0000","last_became_active":"2024-04-26T22:07:37.568931+0000","last_became_peered":"2024-04-26T22:07:37.568931+0000","last_unstale":"2024-04-26T22:07:37.573832+0000","last_undegraded":"2024-04-26T22:07:37.573832+0000","last_fullsized":"2024-04-26T22:07:37.573832+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:22.278037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575139+0000","last_change":"2024-04-26T22:07:37.574204+0000","last_active":"2024-04-26T22:07:37.575139+0000","last_peered":"2024-04-26T22:07:37.575139+0000","last_clean":"2024-04-26T22:07:37.575139+0000","last_became_active":"2024-04-26T22:07:37.573523+0000","last_became_peered":"2024-04-26T22:07:37.573523+0000","last_unstale":"2024-04-26T22:07:37.575139+0000","last_undegraded":"2024-04-26T22:07:37.575139+0000","last_fullsized":"2024-04-26T22:07:37.575139+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:56.385421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.576409+0000","last_change":"2024-04-26T22:07:37.575902+0000","last_active":"2024-04-26T22:07:37.576409+0000","last_peered":"2024-04-26T22:07:37.576409+0000","last_clean":"2024-04-26T22:07:37.576409+0000","last_became_active":"2024-04-26T22:07:37.575606+0000","last_became_peered":"2024-04-26T22:07:37.575606+0000","last_unstale":"2024-04-26T22:07:37.576409+0000","last_undegraded":"2024-04-26T22:07:37.576409+0000","last_fullsized":"2024-04-26T22:07:37.576409+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:01.343063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.569468+0000","last_change":"2024-04-26T22:07:37.568433+0000","last_active":"2024-04-26T22:07:37.569468+0000","last_peered":"2024-04-26T22:07:37.569468+0000","last_clean":"2024-04-26T22:07:37.569468+0000","last_became_active":"2024-04-26T22:07:37.567937+0000","last_became_peered":"2024-04-26T22:07:37.567937+0000","last_unstale":"2024-04-26T22:07:37.569468+0000","last_undegraded":"2024-04-26T22:07:37.569468+0000","last_fullsized":"2024-04-26T22:07:37.569468+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:58.178322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.561778+0000","last_change":"2024-04-26T22:07:37.558119+0000","last_active":"2024-04-26T22:07:37.561778+0000","last_peered":"2024-04-26T22:07:37.561778+0000","last_clean":"2024-04-26T22:07:37.561778+0000","last_became_active":"2024-04-26T22:07:37.557861+0000","last_became_peered":"2024-04-26T22:07:37.557861+0000","last_unstale":"2024-04-26T22:07:37.561778+0000","last_undegraded":"2024-04-26T22:07:37.561778+0000","last_fullsized":"2024-04-26T22:07:37.561778+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:23.036385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574728+0000","last_change":"2024-04-26T22:07:37.571467+0000","last_active":"2024-04-26T22:07:37.574728+0000","last_peered":"2024-04-26T22:07:37.574728+0000","last_clean":"2024-04-26T22:07:37.574728+0000","last_became_active":"2024-04-26T22:07:37.571033+0000","last_became_peered":"2024-04-26T22:07:37.571033+0000","last_unstale":"2024-04-26T22:07:37.574728+0000","last_undegraded":"2024-04-26T22:07:37.574728+0000","last_fullsized":"2024-04-26T22:07:37.574728+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:30.884634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573389+0000","last_change":"2024-04-26T22:07:37.567466+0000","last_active":"2024-04-26T22:07:37.573389+0000","last_peered":"2024-04-26T22:07:37.573389+0000","last_clean":"2024-04-26T22:07:37.573389+0000","last_became_active":"2024-04-26T22:07:37.567169+0000","last_became_peered":"2024-04-26T22:07:37.567169+0000","last_unstale":"2024-04-26T22:07:37.573389+0000","last_undegraded":"2024-04-26T22:07:37.573389+0000","last_fullsized":"2024-04-26T22:07:37.573389+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:44.354182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567453+0000","last_change":"2024-04-26T22:07:37.558797+0000","last_active":"2024-04-26T22:07:37.567453+0000","last_peered":"2024-04-26T22:07:37.567453+0000","last_clean":"2024-04-26T22:07:37.567453+0000","last_became_active":"2024-04-26T22:07:37.558499+0000","last_became_peered":"2024-04-26T22:07:37.558499+0000","last_unstale":"2024-04-26T22:07:37.567453+0000","last_undegraded":"2024-04-26T22:07:37.567453+0000","last_fullsized":"2024-04-26T22:07:37.567453+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:15.979434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565798+0000","last_change":"2024-04-26T22:07:37.564038+0000","last_active":"2024-04-26T22:07:37.565798+0000","last_peered":"2024-04-26T22:07:37.565798+0000","last_clean":"2024-04-26T22:07:37.565798+0000","last_became_active":"2024-04-26T22:07:37.563695+0000","last_became_peered":"2024-04-26T22:07:37.563695+0000","last_unstale":"2024-04-26T22:07:37.565798+0000","last_undegraded":"2024-04-26T22:07:37.565798+0000","last_fullsized":"2024-04-26T22:07:37.565798+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:58.178322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574759+0000","last_change":"2024-04-26T22:07:37.573005+0000","last_active":"2024-04-26T22:07:37.574759+0000","last_peered":"2024-04-26T22:07:37.574759+0000","last_clean":"2024-04-26T22:07:37.574759+0000","last_became_active":"2024-04-26T22:07:37.572361+0000","last_became_peered":"2024-04-26T22:07:37.572361+0000","last_unstale":"2024-04-26T22:07:37.574759+0000","last_undegraded":"2024-04-26T22:07:37.574759+0000","last_fullsized":"2024-04-26T22:07:37.574759+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:53.421289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573694+0000","last_change":"2024-04-26T22:07:37.568448+0000","last_active":"2024-04-26T22:07:37.573694+0000","last_peered":"2024-04-26T22:07:37.573694+0000","last_clean":"2024-04-26T22:07:37.573694+0000","last_became_active":"2024-04-26T22:07:37.568156+0000","last_became_peered":"2024-04-26T22:07:37.568156+0000","last_unstale":"2024-04-26T22:07:37.573694+0000","last_undegraded":"2024-04-26T22:07:37.573694+0000","last_fullsized":"2024-04-26T22:07:37.573694+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:42:15.521460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.571615+0000","last_change":"2024-04-26T22:07:37.570013+0000","last_active":"2024-04-26T22:07:37.571615+0000","last_peered":"2024-04-26T22:07:37.571615+0000","last_clean":"2024-04-26T22:07:37.571615+0000","last_became_active":"2024-04-26T22:07:37.569743+0000","last_became_peered":"2024-04-26T22:07:37.569743+0000","last_unstale":"2024-04-26T22:07:37.571615+0000","last_undegraded":"2024-04-26T22:07:37.571615+0000","last_fullsized":"2024-04-26T22:07:37.571615+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:48.986752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575926+0000","last_change":"2024-04-26T22:07:37.570188+0000","last_active":"2024-04-26T22:07:37.575926+0000","last_peered":"2024-04-26T22:07:37.575926+0000","last_clean":"2024-04-26T22:07:37.575926+0000","last_became_active":"2024-04-26T22:07:37.569877+0000","last_became_peered":"2024-04-26T22:07:37.569877+0000","last_unstale":"2024-04-26T22:07:37.575926+0000","last_undegraded":"2024-04-26T22:07:37.575926+0000","last_fullsized":"2024-04-26T22:07:37.575926+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:23.678906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.566870+0000","last_change":"2024-04-26T22:07:37.563892+0000","last_active":"2024-04-26T22:07:37.566870+0000","last_peered":"2024-04-26T22:07:37.566870+0000","last_clean":"2024-04-26T22:07:37.566870+0000","last_became_active":"2024-04-26T22:07:37.563409+0000","last_became_peered":"2024-04-26T22:07:37.563409+0000","last_unstale":"2024-04-26T22:07:37.566870+0000","last_undegraded":"2024-04-26T22:07:37.566870+0000","last_fullsized":"2024-04-26T22:07:37.566870+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:36.375841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.564971+0000","last_change":"2024-04-26T22:07:37.561948+0000","last_active":"2024-04-26T22:07:37.564971+0000","last_peered":"2024-04-26T22:07:37.564971+0000","last_clean":"2024-04-26T22:07:37.564971+0000","last_became_active":"2024-04-26T22:07:37.561468+0000","last_became_peered":"2024-04-26T22:07:37.561468+0000","last_unstale":"2024-04-26T22:07:37.564971+0000","last_undegraded":"2024-04-26T22:07:37.564971+0000","last_fullsized":"2024-04-26T22:07:37.564971+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:48.986752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567949+0000","last_change":"2024-04-26T22:07:37.562595+0000","last_active":"2024-04-26T22:07:37.567949+0000","last_peered":"2024-04-26T22:07:37.567949+0000","last_clean":"2024-04-26T22:07:37.567949+0000","last_became_active":"2024-04-26T22:07:37.562267+0000","last_became_peered":"2024-04-26T22:07:37.562267+0000","last_unstale":"2024-04-26T22:07:37.567949+0000","last_undegraded":"2024-04-26T22:07:37.567949+0000","last_fullsized":"2024-04-26T22:07:37.567949+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:34.565140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565447+0000","last_change":"2024-04-26T22:07:37.561624+0000","last_active":"2024-04-26T22:07:37.565447+0000","last_peered":"2024-04-26T22:07:37.565447+0000","last_clean":"2024-04-26T22:07:37.565447+0000","last_became_active":"2024-04-26T22:07:37.561361+0000","last_became_peered":"2024-04-26T22:07:37.561361+0000","last_unstale":"2024-04-26T22:07:37.565447+0000","last_undegraded":"2024-04-26T22:07:37.565447+0000","last_fullsized":"2024-04-26T22:07:37.565447+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:26.937036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.562035+0000","last_change":"2024-04-26T22:07:37.558474+0000","last_active":"2024-04-26T22:07:37.562035+0000","last_peered":"2024-04-26T22:07:37.562035+0000","last_clean":"2024-04-26T22:07:37.562035+0000","last_became_active":"2024-04-26T22:07:37.558213+0000","last_became_peered":"2024-04-26T22:07:37.558213+0000","last_unstale":"2024-04-26T22:07:37.562035+0000","last_undegraded":"2024-04-26T22:07:37.562035+0000","last_fullsized":"2024-04-26T22:07:37.562035+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:47.848803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"114'4","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.572242+0000","last_change":"2024-04-26T22:07:36.545122+0000","last_active":"2024-04-26T22:07:37.572242+0000","last_peered":"2024-04-26T22:07:37.572242+0000","last_clean":"2024-04-26T22:07:37.572242+0000","last_became_active":"2024-04-26T22:07:36.544840+0000","last_became_peered":"2024-04-26T22:07:36.544840+0000","last_unstale":"2024-04-26T22:07:37.572242+0000","last_undegraded":"2024-04-26T22:07:37.572242+0000","last_fullsized":"2024-04-26T22:07:37.572242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:19.308146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567997+0000","last_change":"2024-04-26T22:07:37.567046+0000","last_active":"2024-04-26T22:07:37.567997+0000","last_peered":"2024-04-26T22:07:37.567997+0000","last_clean":"2024-04-26T22:07:37.567997+0000","last_became_active":"2024-04-26T22:07:37.566785+0000","last_became_peered":"2024-04-26T22:07:37.566785+0000","last_unstale":"2024-04-26T22:07:37.567997+0000","last_undegraded":"2024-04-26T22:07:37.567997+0000","last_fullsized":"2024-04-26T22:07:37.567997+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:56.385421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573661+0000","last_change":"2024-04-26T22:07:36.551291+0000","last_active":"2024-04-26T22:07:37.573661+0000","last_peered":"2024-04-26T22:07:37.573661+0000","last_clean":"2024-04-26T22:07:37.573661+0000","last_became_active":"2024-04-26T22:07:36.551011+0000","last_became_peered":"2024-04-26T22:07:36.551011+0000","last_unstale":"2024-04-26T22:07:37.573661+0000","last_undegraded":"2024-04-26T22:07:37.573661+0000","last_fullsized":"2024-04-26T22:07:37.573661+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:52.417031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565456+0000","last_change":"2024-04-26T22:07:37.561580+0000","last_active":"2024-04-26T22:07:37.565456+0000","last_peered":"2024-04-26T22:07:37.565456+0000","last_clean":"2024-04-26T22:07:37.565456+0000","last_became_active":"2024-04-26T22:07:37.561311+0000","last_became_peered":"2024-04-26T22:07:37.561311+0000","last_unstale":"2024-04-26T22:07:37.565456+0000","last_undegraded":"2024-04-26T22:07:37.565456+0000","last_fullsized":"2024-04-26T22:07:37.565456+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:20.312405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573277+0000","last_change":"2024-04-26T22:07:36.557531+0000","last_active":"2024-04-26T22:07:37.573277+0000","last_peered":"2024-04-26T22:07:37.573277+0000","last_clean":"2024-04-26T22:07:37.573277+0000","last_became_active":"2024-04-26T22:07:36.557239+0000","last_became_peered":"2024-04-26T22:07:36.557239+0000","last_unstale":"2024-04-26T22:07:37.573277+0000","last_undegraded":"2024-04-26T22:07:37.573277+0000","last_fullsized":"2024-04-26T22:07:37.573277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:46.730286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567599+0000","last_change":"2024-04-26T22:07:37.562770+0000","last_active":"2024-04-26T22:07:37.567599+0000","last_peered":"2024-04-26T22:07:37.567599+0000","last_clean":"2024-04-26T22:07:37.567599+0000","last_became_active":"2024-04-26T22:07:37.562473+0000","last_became_peered":"2024-04-26T22:07:37.562473+0000","last_unstale":"2024-04-26T22:07:37.567599+0000","last_undegraded":"2024-04-26T22:07:37.567599+0000","last_fullsized":"2024-04-26T22:07:37.567599+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:43.291180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.576360+0000","last_change":"2024-04-26T22:07:36.557633+0000","last_active":"2024-04-26T22:07:37.576360+0000","last_peered":"2024-04-26T22:07:37.576360+0000","last_clean":"2024-04-26T22:07:37.576360+0000","last_became_active":"2024-04-26T22:07:36.557352+0000","last_became_peered":"2024-04-26T22:07:36.557352+0000","last_unstale":"2024-04-26T22:07:37.576360+0000","last_undegraded":"2024-04-26T22:07:37.576360+0000","last_fullsized":"2024-04-26T22:07:37.576360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.020412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.570477+0000","last_change":"2024-04-26T22:07:37.567765+0000","last_active":"2024-04-26T22:07:37.570477+0000","last_peered":"2024-04-26T22:07:37.570477+0000","last_clean":"2024-04-26T22:07:37.570477+0000","last_became_active":"2024-04-26T22:07:37.567489+0000","last_became_peered":"2024-04-26T22:07:37.567489+0000","last_unstale":"2024-04-26T22:07:37.570477+0000","last_undegraded":"2024-04-26T22:07:37.570477+0000","last_fullsized":"2024-04-26T22:07:37.570477+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:33.854729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574496+0000","last_change":"2024-04-26T22:07:36.550151+0000","last_active":"2024-04-26T22:07:37.574496+0000","last_peered":"2024-04-26T22:07:37.574496+0000","last_clean":"2024-04-26T22:07:37.574496+0000","last_became_active":"2024-04-26T22:07:36.549831+0000","last_became_peered":"2024-04-26T22:07:36.549831+0000","last_unstale":"2024-04-26T22:07:37.574496+0000","last_undegraded":"2024-04-26T22:07:37.574496+0000","last_fullsized":"2024-04-26T22:07:37.574496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:55.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575066+0000","last_change":"2024-04-26T22:07:37.573365+0000","last_active":"2024-04-26T22:07:37.575066+0000","last_peered":"2024-04-26T22:07:37.575066+0000","last_clean":"2024-04-26T22:07:37.575066+0000","last_became_active":"2024-04-26T22:07:37.573087+0000","last_became_peered":"2024-04-26T22:07:37.573087+0000","last_unstale":"2024-04-26T22:07:37.575066+0000","last_undegraded":"2024-04-26T22:07:37.575066+0000","last_fullsized":"2024-04-26T22:07:37.575066+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:20.153663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573916+0000","last_change":"2024-04-26T22:07:36.554860+0000","last_active":"2024-04-26T22:07:37.573916+0000","last_peered":"2024-04-26T22:07:37.573916+0000","last_clean":"2024-04-26T22:07:37.573916+0000","last_became_active":"2024-04-26T22:07:36.554395+0000","last_became_peered":"2024-04-26T22:07:36.554395+0000","last_unstale":"2024-04-26T22:07:37.573916+0000","last_undegraded":"2024-04-26T22:07:37.573916+0000","last_fullsized":"2024-04-26T22:07:37.573916+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:00.338805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573813+0000","last_change":"2024-04-26T22:07:37.568558+0000","last_active":"2024-04-26T22:07:37.573813+0000","last_peered":"2024-04-26T22:07:37.573813+0000","last_clean":"2024-04-26T22:07:37.573813+0000","last_became_active":"2024-04-26T22:07:37.568268+0000","last_became_peered":"2024-04-26T22:07:37.568268+0000","last_unstale":"2024-04-26T22:07:37.573813+0000","last_undegraded":"2024-04-26T22:07:37.573813+0000","last_fullsized":"2024-04-26T22:07:37.573813+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:38.035039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.551035+0000","last_change":"2024-04-26T22:07:36.551205+0000","last_active":"2024-04-26T22:07:37.551035+0000","last_peered":"2024-04-26T22:07:37.551035+0000","last_clean":"2024-04-26T22:07:37.551035+0000","last_became_active":"2024-04-26T22:07:36.550711+0000","last_became_peered":"2024-04-26T22:07:36.550711+0000","last_unstale":"2024-04-26T22:07:37.551035+0000","last_undegraded":"2024-04-26T22:07:37.551035+0000","last_fullsized":"2024-04-26T22:07:37.551035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:41.076109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.571732+0000","last_change":"2024-04-26T22:07:37.570207+0000","last_active":"2024-04-26T22:07:37.571732+0000","last_peered":"2024-04-26T22:07:37.571732+0000","last_clean":"2024-04-26T22:07:37.571732+0000","last_became_active":"2024-04-26T22:07:37.569598+0000","last_became_peered":"2024-04-26T22:07:37.569598+0000","last_unstale":"2024-04-26T22:07:37.571732+0000","last_undegraded":"2024-04-26T22:07:37.571732+0000","last_fullsized":"2024-04-26T22:07:37.571732+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:41.492225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.559569+0000","last_change":"2024-04-26T22:07:36.552879+0000","last_active":"2024-04-26T22:07:37.559569+0000","last_peered":"2024-04-26T22:07:37.559569+0000","last_clean":"2024-04-26T22:07:37.559569+0000","last_became_active":"2024-04-26T22:07:36.552608+0000","last_became_peered":"2024-04-26T22:07:36.552608+0000","last_unstale":"2024-04-26T22:07:37.559569+0000","last_undegraded":"2024-04-26T22:07:37.559569+0000","last_fullsized":"2024-04-26T22:07:37.559569+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:33.719644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.561524+0000","last_change":"2024-04-26T22:07:37.560400+0000","last_active":"2024-04-26T22:07:37.561524+0000","last_peered":"2024-04-26T22:07:37.561524+0000","last_clean":"2024-04-26T22:07:37.561524+0000","last_became_active":"2024-04-26T22:07:37.560126+0000","last_became_peered":"2024-04-26T22:07:37.560126+0000","last_unstale":"2024-04-26T22:07:37.561524+0000","last_undegraded":"2024-04-26T22:07:37.561524+0000","last_fullsized":"2024-04-26T22:07:37.561524+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:12.766341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.549121+0000","last_change":"2024-04-26T22:07:36.554844+0000","last_active":"2024-04-26T22:07:37.549121+0000","last_peered":"2024-04-26T22:07:37.549121+0000","last_clean":"2024-04-26T22:07:37.549121+0000","last_became_active":"2024-04-26T22:07:36.554575+0000","last_became_peered":"2024-04-26T22:07:36.554575+0000","last_unstale":"2024-04-26T22:07:37.549121+0000","last_undegraded":"2024-04-26T22:07:37.549121+0000","last_fullsized":"2024-04-26T22:07:37.549121+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:58:37.931763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567206+0000","last_change":"2024-04-26T22:07:37.566297+0000","last_active":"2024-04-26T22:07:37.567206+0000","last_peered":"2024-04-26T22:07:37.567206+0000","last_clean":"2024-04-26T22:07:37.567206+0000","last_became_active":"2024-04-26T22:07:37.566011+0000","last_became_peered":"2024-04-26T22:07:37.566011+0000","last_unstale":"2024-04-26T22:07:37.567206+0000","last_undegraded":"2024-04-26T22:07:37.567206+0000","last_fullsized":"2024-04-26T22:07:37.567206+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:58.056862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.552179+0000","last_change":"2024-04-26T22:07:36.553225+0000","last_active":"2024-04-26T22:07:37.552179+0000","last_peered":"2024-04-26T22:07:37.552179+0000","last_clean":"2024-04-26T22:07:37.552179+0000","last_became_active":"2024-04-26T22:07:36.552945+0000","last_became_peered":"2024-04-26T22:07:36.552945+0000","last_unstale":"2024-04-26T22:07:37.552179+0000","last_undegraded":"2024-04-26T22:07:37.552179+0000","last_fullsized":"2024-04-26T22:07:37.552179+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:32.734978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578495+0000","last_change":"2024-04-26T22:07:37.574712+0000","last_active":"2024-04-26T22:07:37.578495+0000","last_peered":"2024-04-26T22:07:37.578495+0000","last_clean":"2024-04-26T22:07:37.578495+0000","last_became_active":"2024-04-26T22:07:37.574432+0000","last_became_peered":"2024-04-26T22:07:37.574432+0000","last_unstale":"2024-04-26T22:07:37.578495+0000","last_undegraded":"2024-04-26T22:07:37.578495+0000","last_fullsized":"2024-04-26T22:07:37.578495+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:46.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.581385+0000","last_change":"2024-04-26T22:07:36.557661+0000","last_active":"2024-04-26T22:07:37.581385+0000","last_peered":"2024-04-26T22:07:37.581385+0000","last_clean":"2024-04-26T22:07:37.581385+0000","last_became_active":"2024-04-26T22:07:36.557408+0000","last_became_peered":"2024-04-26T22:07:36.557408+0000","last_unstale":"2024-04-26T22:07:37.581385+0000","last_undegraded":"2024-04-26T22:07:37.581385+0000","last_fullsized":"2024-04-26T22:07:37.581385+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:54.274773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.559803+0000","last_change":"2024-04-26T22:07:37.558145+0000","last_active":"2024-04-26T22:07:37.559803+0000","last_peered":"2024-04-26T22:07:37.559803+0000","last_clean":"2024-04-26T22:07:37.559803+0000","last_became_active":"2024-04-26T22:07:37.557841+0000","last_became_peered":"2024-04-26T22:07:37.557841+0000","last_unstale":"2024-04-26T22:07:37.559803+0000","last_undegraded":"2024-04-26T22:07:37.559803+0000","last_fullsized":"2024-04-26T22:07:37.559803+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:41.170155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"114'6","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.586647+0000","last_change":"2024-04-26T22:07:36.552513+0000","last_active":"2024-04-26T22:07:37.586647+0000","last_peered":"2024-04-26T22:07:37.586647+0000","last_clean":"2024-04-26T22:07:37.586647+0000","last_became_active":"2024-04-26T22:07:36.552233+0000","last_became_peered":"2024-04-26T22:07:36.552233+0000","last_unstale":"2024-04-26T22:07:37.586647+0000","last_undegraded":"2024-04-26T22:07:37.586647+0000","last_fullsized":"2024-04-26T22:07:37.586647+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:21.244361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565924+0000","last_change":"2024-04-26T22:07:37.563140+0000","last_active":"2024-04-26T22:07:37.565924+0000","last_peered":"2024-04-26T22:07:37.565924+0000","last_clean":"2024-04-26T22:07:37.565924+0000","last_became_active":"2024-04-26T22:07:37.562827+0000","last_became_peered":"2024-04-26T22:07:37.562827+0000","last_unstale":"2024-04-26T22:07:37.565924+0000","last_undegraded":"2024-04-26T22:07:37.565924+0000","last_fullsized":"2024-04-26T22:07:37.565924+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:57.056073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573590+0000","last_change":"2024-04-26T22:07:36.550693+0000","last_active":"2024-04-26T22:07:37.573590+0000","last_peered":"2024-04-26T22:07:37.573590+0000","last_clean":"2024-04-26T22:07:37.573590+0000","last_became_active":"2024-04-26T22:07:36.550394+0000","last_became_peered":"2024-04-26T22:07:36.550394+0000","last_unstale":"2024-04-26T22:07:37.573590+0000","last_undegraded":"2024-04-26T22:07:37.573590+0000","last_fullsized":"2024-04-26T22:07:37.573590+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.020412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565934+0000","last_change":"2024-04-26T22:07:37.564301+0000","last_active":"2024-04-26T22:07:37.565934+0000","last_peered":"2024-04-26T22:07:37.565934+0000","last_clean":"2024-04-26T22:07:37.565934+0000","last_became_active":"2024-04-26T22:07:37.563976+0000","last_became_peered":"2024-04-26T22:07:37.563976+0000","last_unstale":"2024-04-26T22:07:37.565934+0000","last_undegraded":"2024-04-26T22:07:37.565934+0000","last_fullsized":"2024-04-26T22:07:37.565934+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:14.437024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.563294+0000","last_change":"2024-04-26T22:07:36.560482+0000","last_active":"2024-04-26T22:07:37.563294+0000","last_peered":"2024-04-26T22:07:37.563294+0000","last_clean":"2024-04-26T22:07:37.563294+0000","last_became_active":"2024-04-26T22:07:36.560213+0000","last_became_peered":"2024-04-26T22:07:36.560213+0000","last_unstale":"2024-04-26T22:07:37.563294+0000","last_undegraded":"2024-04-26T22:07:37.563294+0000","last_fullsized":"2024-04-26T22:07:37.563294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:19.149405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578643+0000","last_change":"2024-04-26T22:07:37.575297+0000","last_active":"2024-04-26T22:07:37.578643+0000","last_peered":"2024-04-26T22:07:37.578643+0000","last_clean":"2024-04-26T22:07:37.578643+0000","last_became_active":"2024-04-26T22:07:37.575030+0000","last_became_peered":"2024-04-26T22:07:37.575030+0000","last_unstale":"2024-04-26T22:07:37.578643+0000","last_undegraded":"2024-04-26T22:07:37.578643+0000","last_fullsized":"2024-04-26T22:07:37.578643+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:55:42.563407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"114'8","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.581363+0000","last_change":"2024-04-26T22:07:36.557661+0000","last_active":"2024-04-26T22:07:37.581363+0000","last_peered":"2024-04-26T22:07:37.581363+0000","last_clean":"2024-04-26T22:07:37.581363+0000","last_became_active":"2024-04-26T22:07:36.557373+0000","last_became_peered":"2024-04-26T22:07:36.557373+0000","last_unstale":"2024-04-26T22:07:37.581363+0000","last_undegraded":"2024-04-26T22:07:37.581363+0000","last_fullsized":"2024-04-26T22:07:37.581363+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:00.774202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578326+0000","last_change":"2024-04-26T22:07:37.570601+0000","last_active":"2024-04-26T22:07:37.578326+0000","last_peered":"2024-04-26T22:07:37.578326+0000","last_clean":"2024-04-26T22:07:37.578326+0000","last_became_active":"2024-04-26T22:07:37.570336+0000","last_became_peered":"2024-04-26T22:07:37.570336+0000","last_unstale":"2024-04-26T22:07:37.578326+0000","last_undegraded":"2024-04-26T22:07:37.578326+0000","last_fullsized":"2024-04-26T22:07:37.578326+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:25.059236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.581405+0000","last_change":"2024-04-26T22:07:36.551722+0000","last_active":"2024-04-26T22:07:37.581405+0000","last_peered":"2024-04-26T22:07:37.581405+0000","last_clean":"2024-04-26T22:07:37.581405+0000","last_became_active":"2024-04-26T22:07:36.551447+0000","last_became_peered":"2024-04-26T22:07:36.551447+0000","last_unstale":"2024-04-26T22:07:37.581405+0000","last_undegraded":"2024-04-26T22:07:37.581405+0000","last_fullsized":"2024-04-26T22:07:37.581405+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:26:07.746163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567178+0000","last_change":"2024-04-26T22:07:37.566432+0000","last_active":"2024-04-26T22:07:37.567178+0000","last_peered":"2024-04-26T22:07:37.567178+0000","last_clean":"2024-04-26T22:07:37.567178+0000","last_became_active":"2024-04-26T22:07:37.566134+0000","last_became_peered":"2024-04-26T22:07:37.566134+0000","last_unstale":"2024-04-26T22:07:37.567178+0000","last_undegraded":"2024-04-26T22:07:37.567178+0000","last_fullsized":"2024-04-26T22:07:37.567178+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:12.766341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574525+0000","last_change":"2024-04-26T22:07:36.558117+0000","last_active":"2024-04-26T22:07:37.574525+0000","last_peered":"2024-04-26T22:07:37.574525+0000","last_clean":"2024-04-26T22:07:37.574525+0000","last_became_active":"2024-04-26T22:07:36.557855+0000","last_became_peered":"2024-04-26T22:07:36.557855+0000","last_unstale":"2024-04-26T22:07:37.574525+0000","last_undegraded":"2024-04-26T22:07:37.574525+0000","last_fullsized":"2024-04-26T22:07:37.574525+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:55.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.571827+0000","last_change":"2024-04-26T22:07:37.570035+0000","last_active":"2024-04-26T22:07:37.571827+0000","last_peered":"2024-04-26T22:07:37.571827+0000","last_clean":"2024-04-26T22:07:37.571827+0000","last_became_active":"2024-04-26T22:07:37.569685+0000","last_became_peered":"2024-04-26T22:07:37.569685+0000","last_unstale":"2024-04-26T22:07:37.571827+0000","last_undegraded":"2024-04-26T22:07:37.571827+0000","last_fullsized":"2024-04-26T22:07:37.571827+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:14.437024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.572313+0000","last_change":"2024-04-26T22:07:36.552585+0000","last_active":"2024-04-26T22:07:37.572313+0000","last_peered":"2024-04-26T22:07:37.572313+0000","last_clean":"2024-04-26T22:07:37.572313+0000","last_became_active":"2024-04-26T22:07:36.552190+0000","last_became_peered":"2024-04-26T22:07:36.552190+0000","last_unstale":"2024-04-26T22:07:37.572313+0000","last_undegraded":"2024-04-26T22:07:37.572313+0000","last_fullsized":"2024-04-26T22:07:37.572313+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:20.282809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.560435+0000","last_change":"2024-04-26T22:07:37.557073+0000","last_active":"2024-04-26T22:07:37.560435+0000","last_peered":"2024-04-26T22:07:37.560435+0000","last_clean":"2024-04-26T22:07:37.560435+0000","last_became_active":"2024-04-26T22:07:37.556825+0000","last_became_peered":"2024-04-26T22:07:37.556825+0000","last_unstale":"2024-04-26T22:07:37.560435+0000","last_undegraded":"2024-04-26T22:07:37.560435+0000","last_fullsized":"2024-04-26T22:07:37.560435+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:21.287067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.553383+0000","last_change":"2024-04-26T22:07:36.548120+0000","last_active":"2024-04-26T22:07:37.553383+0000","last_peered":"2024-04-26T22:07:37.553383+0000","last_clean":"2024-04-26T22:07:37.553383+0000","last_became_active":"2024-04-26T22:07:36.547841+0000","last_became_peered":"2024-04-26T22:07:36.547841+0000","last_unstale":"2024-04-26T22:07:37.553383+0000","last_undegraded":"2024-04-26T22:07:37.553383+0000","last_fullsized":"2024-04-26T22:07:37.553383+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:24.054977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565128+0000","last_change":"2024-04-26T22:07:37.562019+0000","last_active":"2024-04-26T22:07:37.565128+0000","last_peered":"2024-04-26T22:07:37.565128+0000","last_clean":"2024-04-26T22:07:37.565128+0000","last_became_active":"2024-04-26T22:07:37.561738+0000","last_became_peered":"2024-04-26T22:07:37.561738+0000","last_unstale":"2024-04-26T22:07:37.565128+0000","last_undegraded":"2024-04-26T22:07:37.565128+0000","last_fullsized":"2024-04-26T22:07:37.565128+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:33.739237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578851+0000","last_change":"2024-04-26T22:07:36.554698+0000","last_active":"2024-04-26T22:07:37.578851+0000","last_peered":"2024-04-26T22:07:37.578851+0000","last_clean":"2024-04-26T22:07:37.578851+0000","last_became_active":"2024-04-26T22:07:36.554452+0000","last_became_peered":"2024-04-26T22:07:36.554452+0000","last_unstale":"2024-04-26T22:07:37.578851+0000","last_undegraded":"2024-04-26T22:07:37.578851+0000","last_fullsized":"2024-04-26T22:07:37.578851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:55.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567252+0000","last_change":"2024-04-26T22:07:37.562910+0000","last_active":"2024-04-26T22:07:37.567252+0000","last_peered":"2024-04-26T22:07:37.567252+0000","last_clean":"2024-04-26T22:07:37.567252+0000","last_became_active":"2024-04-26T22:07:37.560859+0000","last_became_peered":"2024-04-26T22:07:37.560859+0000","last_unstale":"2024-04-26T22:07:37.567252+0000","last_undegraded":"2024-04-26T22:07:37.567252+0000","last_fullsized":"2024-04-26T22:07:37.567252+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:53.999161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.549227+0000","last_change":"2024-04-26T22:07:36.558064+0000","last_active":"2024-04-26T22:07:37.549227+0000","last_peered":"2024-04-26T22:07:37.549227+0000","last_clean":"2024-04-26T22:07:37.549227+0000","last_became_active":"2024-04-26T22:07:36.557295+0000","last_became_peered":"2024-04-26T22:07:36.557295+0000","last_unstale":"2024-04-26T22:07:37.549227+0000","last_undegraded":"2024-04-26T22:07:37.549227+0000","last_fullsized":"2024-04-26T22:07:37.549227+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:17.390596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567605+0000","last_change":"2024-04-26T22:07:37.561842+0000","last_active":"2024-04-26T22:07:37.567605+0000","last_peered":"2024-04-26T22:07:37.567605+0000","last_clean":"2024-04-26T22:07:37.567605+0000","last_became_active":"2024-04-26T22:07:37.561565+0000","last_became_peered":"2024-04-26T22:07:37.561565+0000","last_unstale":"2024-04-26T22:07:37.567605+0000","last_undegraded":"2024-04-26T22:07:37.567605+0000","last_fullsized":"2024-04-26T22:07:37.567605+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:56.385421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.552520+0000","last_change":"2024-04-26T22:07:36.558010+0000","last_active":"2024-04-26T22:07:37.552520+0000","last_peered":"2024-04-26T22:07:37.552520+0000","last_clean":"2024-04-26T22:07:37.552520+0000","last_became_active":"2024-04-26T22:07:36.557748+0000","last_became_peered":"2024-04-26T22:07:36.557748+0000","last_unstale":"2024-04-26T22:07:37.552520+0000","last_undegraded":"2024-04-26T22:07:37.552520+0000","last_fullsized":"2024-04-26T22:07:37.552520+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:17.390596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.576090+0000","last_change":"2024-04-26T22:07:37.570685+0000","last_active":"2024-04-26T22:07:37.576090+0000","last_peered":"2024-04-26T22:07:37.576090+0000","last_clean":"2024-04-26T22:07:37.576090+0000","last_became_active":"2024-04-26T22:07:37.570426+0000","last_became_peered":"2024-04-26T22:07:37.570426+0000","last_unstale":"2024-04-26T22:07:37.576090+0000","last_undegraded":"2024-04-26T22:07:37.576090+0000","last_fullsized":"2024-04-26T22:07:37.576090+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:25.439106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.559593+0000","last_change":"2024-04-26T22:07:36.555580+0000","last_active":"2024-04-26T22:07:37.559593+0000","last_peered":"2024-04-26T22:07:37.559593+0000","last_clean":"2024-04-26T22:07:37.559593+0000","last_became_active":"2024-04-26T22:07:36.555269+0000","last_became_peered":"2024-04-26T22:07:36.555269+0000","last_unstale":"2024-04-26T22:07:37.559593+0000","last_undegraded":"2024-04-26T22:07:37.559593+0000","last_fullsized":"2024-04-26T22:07:37.559593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.747914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574041+0000","last_change":"2024-04-26T22:07:37.572505+0000","last_active":"2024-04-26T22:07:37.574041+0000","last_peered":"2024-04-26T22:07:37.574041+0000","last_clean":"2024-04-26T22:07:37.574041+0000","last_became_active":"2024-04-26T22:07:37.572211+0000","last_became_peered":"2024-04-26T22:07:37.572211+0000","last_unstale":"2024-04-26T22:07:37.574041+0000","last_undegraded":"2024-04-26T22:07:37.574041+0000","last_fullsized":"2024-04-26T22:07:37.574041+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:43.291180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.577112+0000","last_change":"2024-04-26T22:07:36.557678+0000","last_active":"2024-04-26T22:07:37.577112+0000","last_peered":"2024-04-26T22:07:37.577112+0000","last_clean":"2024-04-26T22:07:37.577112+0000","last_became_active":"2024-04-26T22:07:36.557419+0000","last_became_peered":"2024-04-26T22:07:36.557419+0000","last_unstale":"2024-04-26T22:07:37.577112+0000","last_undegraded":"2024-04-26T22:07:37.577112+0000","last_fullsized":"2024-04-26T22:07:37.577112+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:55.381163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578819+0000","last_change":"2024-04-26T22:07:37.574467+0000","last_active":"2024-04-26T22:07:37.578819+0000","last_peered":"2024-04-26T22:07:37.578819+0000","last_clean":"2024-04-26T22:07:37.578819+0000","last_became_active":"2024-04-26T22:07:37.574205+0000","last_became_peered":"2024-04-26T22:07:37.574205+0000","last_unstale":"2024-04-26T22:07:37.578819+0000","last_undegraded":"2024-04-26T22:07:37.578819+0000","last_fullsized":"2024-04-26T22:07:37.578819+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:24.487258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.562171+0000","last_change":"2024-04-26T22:07:36.554011+0000","last_active":"2024-04-26T22:07:37.562171+0000","last_peered":"2024-04-26T22:07:37.562171+0000","last_clean":"2024-04-26T22:07:37.562171+0000","last_became_active":"2024-04-26T22:07:36.553668+0000","last_became_peered":"2024-04-26T22:07:36.553668+0000","last_unstale":"2024-04-26T22:07:37.562171+0000","last_undegraded":"2024-04-26T22:07:37.562171+0000","last_fullsized":"2024-04-26T22:07:37.562171+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:52.417031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578804+0000","last_change":"2024-04-26T22:07:37.573474+0000","last_active":"2024-04-26T22:07:37.578804+0000","last_peered":"2024-04-26T22:07:37.578804+0000","last_clean":"2024-04-26T22:07:37.578804+0000","last_became_active":"2024-04-26T22:07:37.571692+0000","last_became_peered":"2024-04-26T22:07:37.571692+0000","last_unstale":"2024-04-26T22:07:37.578804+0000","last_undegraded":"2024-04-26T22:07:37.578804+0000","last_fullsized":"2024-04-26T22:07:37.578804+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:42.799507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.558727+0000","last_change":"2024-04-26T22:07:36.554007+0000","last_active":"2024-04-26T22:07:37.558727+0000","last_peered":"2024-04-26T22:07:37.558727+0000","last_clean":"2024-04-26T22:07:37.558727+0000","last_became_active":"2024-04-26T22:07:36.553724+0000","last_became_peered":"2024-04-26T22:07:36.553724+0000","last_unstale":"2024-04-26T22:07:37.558727+0000","last_undegraded":"2024-04-26T22:07:37.558727+0000","last_fullsized":"2024-04-26T22:07:37.558727+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:10.712063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.572375+0000","last_change":"2024-04-26T22:07:37.569992+0000","last_active":"2024-04-26T22:07:37.572375+0000","last_peered":"2024-04-26T22:07:37.572375+0000","last_clean":"2024-04-26T22:07:37.572375+0000","last_became_active":"2024-04-26T22:07:37.569705+0000","last_became_peered":"2024-04-26T22:07:37.569705+0000","last_unstale":"2024-04-26T22:07:37.572375+0000","last_undegraded":"2024-04-26T22:07:37.572375+0000","last_fullsized":"2024-04-26T22:07:37.572375+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:33.739237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.553313+0000","last_change":"2024-04-26T22:07:36.558651+0000","last_active":"2024-04-26T22:07:37.553313+0000","last_peered":"2024-04-26T22:07:37.553313+0000","last_clean":"2024-04-26T22:07:37.553313+0000","last_became_active":"2024-04-26T22:07:36.558388+0000","last_became_peered":"2024-04-26T22:07:36.558388+0000","last_unstale":"2024-04-26T22:07:37.553313+0000","last_undegraded":"2024-04-26T22:07:37.553313+0000","last_fullsized":"2024-04-26T22:07:37.553313+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:42.286922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.561736+0000","last_change":"2024-04-26T22:07:37.560746+0000","last_active":"2024-04-26T22:07:37.561736+0000","last_peered":"2024-04-26T22:07:37.561736+0000","last_clean":"2024-04-26T22:07:37.561736+0000","last_became_active":"2024-04-26T22:07:37.556854+0000","last_became_peered":"2024-04-26T22:07:37.556854+0000","last_unstale":"2024-04-26T22:07:37.561736+0000","last_undegraded":"2024-04-26T22:07:37.561736+0000","last_fullsized":"2024-04-26T22:07:37.561736+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:04.896657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.553322+0000","last_change":"2024-04-26T22:07:36.552090+0000","last_active":"2024-04-26T22:07:37.553322+0000","last_peered":"2024-04-26T22:07:37.553322+0000","last_clean":"2024-04-26T22:07:37.553322+0000","last_became_active":"2024-04-26T22:07:36.551825+0000","last_became_peered":"2024-04-26T22:07:36.551825+0000","last_unstale":"2024-04-26T22:07:37.553322+0000","last_undegraded":"2024-04-26T22:07:37.553322+0000","last_fullsized":"2024-04-26T22:07:37.553322+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:46.844545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.563017+0000","last_change":"2024-04-26T22:07:37.559955+0000","last_active":"2024-04-26T22:07:37.563017+0000","last_peered":"2024-04-26T22:07:37.563017+0000","last_clean":"2024-04-26T22:07:37.563017+0000","last_became_active":"2024-04-26T22:07:37.559625+0000","last_became_peered":"2024-04-26T22:07:37.559625+0000","last_unstale":"2024-04-26T22:07:37.563017+0000","last_undegraded":"2024-04-26T22:07:37.563017+0000","last_fullsized":"2024-04-26T22:07:37.563017+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:19.570434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.550612+0000","last_change":"2024-04-26T22:07:36.553923+0000","last_active":"2024-04-26T22:07:37.550612+0000","last_peered":"2024-04-26T22:07:37.550612+0000","last_clean":"2024-04-26T22:07:37.550612+0000","last_became_active":"2024-04-26T22:07:36.553608+0000","last_became_peered":"2024-04-26T22:07:36.553608+0000","last_unstale":"2024-04-26T22:07:37.550612+0000","last_undegraded":"2024-04-26T22:07:37.550612+0000","last_fullsized":"2024-04-26T22:07:37.550612+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:26:12.573757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.568822+0000","last_change":"2024-04-26T22:07:37.567862+0000","last_active":"2024-04-26T22:07:37.568822+0000","last_peered":"2024-04-26T22:07:37.568822+0000","last_clean":"2024-04-26T22:07:37.568822+0000","last_became_active":"2024-04-26T22:07:37.567521+0000","last_became_peered":"2024-04-26T22:07:37.567521+0000","last_unstale":"2024-04-26T22:07:37.568822+0000","last_undegraded":"2024-04-26T22:07:37.568822+0000","last_fullsized":"2024-04-26T22:07:37.568822+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:57.056073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.549115+0000","last_change":"2024-04-26T22:07:36.556826+0000","last_active":"2024-04-26T22:07:37.549115+0000","last_peered":"2024-04-26T22:07:37.549115+0000","last_clean":"2024-04-26T22:07:37.549115+0000","last_became_active":"2024-04-26T22:07:36.556570+0000","last_became_peered":"2024-04-26T22:07:36.556570+0000","last_unstale":"2024-04-26T22:07:37.549115+0000","last_undegraded":"2024-04-26T22:07:37.549115+0000","last_fullsized":"2024-04-26T22:07:37.549115+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:33.129394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.568359+0000","last_change":"2024-04-26T22:07:37.563103+0000","last_active":"2024-04-26T22:07:37.568359+0000","last_peered":"2024-04-26T22:07:37.568359+0000","last_clean":"2024-04-26T22:07:37.568359+0000","last_became_active":"2024-04-26T22:07:37.560931+0000","last_became_peered":"2024-04-26T22:07:37.560931+0000","last_unstale":"2024-04-26T22:07:37.568359+0000","last_undegraded":"2024-04-26T22:07:37.568359+0000","last_fullsized":"2024-04-26T22:07:37.568359+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:18.184220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.559720+0000","last_change":"2024-04-26T22:07:36.555674+0000","last_active":"2024-04-26T22:07:37.559720+0000","last_peered":"2024-04-26T22:07:37.559720+0000","last_clean":"2024-04-26T22:07:37.559720+0000","last_became_active":"2024-04-26T22:07:36.555286+0000","last_became_peered":"2024-04-26T22:07:36.555286+0000","last_unstale":"2024-04-26T22:07:37.559720+0000","last_undegraded":"2024-04-26T22:07:37.559720+0000","last_fullsized":"2024-04-26T22:07:37.559720+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:36.108216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565689+0000","last_change":"2024-04-26T22:07:37.562891+0000","last_active":"2024-04-26T22:07:37.565689+0000","last_peered":"2024-04-26T22:07:37.565689+0000","last_clean":"2024-04-26T22:07:37.565689+0000","last_became_active":"2024-04-26T22:07:37.562630+0000","last_became_peered":"2024-04-26T22:07:37.562630+0000","last_unstale":"2024-04-26T22:07:37.565689+0000","last_undegraded":"2024-04-26T22:07:37.565689+0000","last_fullsized":"2024-04-26T22:07:37.565689+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:46.980260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.554652+0000","last_change":"2024-04-26T22:07:36.548520+0000","last_active":"2024-04-26T22:07:37.554652+0000","last_peered":"2024-04-26T22:07:37.554652+0000","last_clean":"2024-04-26T22:07:37.554652+0000","last_became_active":"2024-04-26T22:07:36.548219+0000","last_became_peered":"2024-04-26T22:07:36.548219+0000","last_unstale":"2024-04-26T22:07:37.554652+0000","last_undegraded":"2024-04-26T22:07:37.554652+0000","last_fullsized":"2024-04-26T22:07:37.554652+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:25.932778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":360,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.552241+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:07:37.552241+0000","last_peered":"2024-04-26T22:07:37.552241+0000","last_clean":"2024-04-26T22:07:37.552241+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:07:37.552241+0000","last_undegraded":"2024-04-26T22:07:37.552241+0000","last_fullsized":"2024-04-26T22:07:37.552241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37292,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334548,"statfs":{"total":96636764160,"available":96598577152,"internally_reserved":0,"allocated":1998848,"data_stored":1198211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":1404928,"data_stored":607843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":1425408,"data_stored":615222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":1404928,"data_stored":607843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1404928,"data_stored":607843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1404928,"data_stored":607843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1425408,"data_stored":614742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1998848,"data_stored":1198211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:07:40.529 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:07:40.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.661+0000 7f22728c5640 1 Processor -- start 2024-04-26T22:07:40.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.661+0000 7f22728c5640 1 -- start start 2024-04-26T22:07:40.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f22728c5640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f226c073900 0x7f226c06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f22728c5640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f226c0ae8b0 con 0x7f226c06fa50 2024-04-26T22:07:40.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f22728c5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f226c0aeb90 con 0x7f226c1485b0 2024-04-26T22:07:40.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f22728c5640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f226c0aee70 con 0x7f226c073900 2024-04-26T22:07:40.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f226b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f226c06fa50 0x7f226c0731f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50714/0 (socket says 172.21.15.137:50714) 2024-04-26T22:07:40.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f226b7fe640 1 -- 172.21.15.137:0/3933627061 learned_addr learned my addr 172.21.15.137:0/3933627061 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:40.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f2270e62640 1 --2- 172.21.15.137:0/3933627061 >> v2:172.21.15.170:3300/0 conn(0x7f226c073900 0x7f226c06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f226affd640 1 -- 172.21.15.137:0/3933627061 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680531474 0 0) 0x7f226c0ae8b0 con 0x7f226c06fa50 2024-04-26T22:07:40.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f226affd640 1 -- 172.21.15.137:0/3933627061 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2254003520 con 0x7f226c06fa50 2024-04-26T22:07:40.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f2270e62640 1 -- 172.21.15.137:0/3933627061 >> v1:172.21.15.170:6789/0 conn(0x7f226c1485b0 legacy=0x7f226c0afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f226affd640 1 -- 172.21.15.137:0/3933627061 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308507838 0 0) 0x7f226c0aeb90 con 0x7f226c1485b0 2024-04-26T22:07:40.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f2270e62640 1 -- 172.21.15.137:0/3933627061 >> v1:172.21.15.137:6789/0 conn(0x7f226c06fa50 legacy=0x7f226c0731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.662+0000 7f2270e62640 1 -- 172.21.15.137:0/3933627061 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c0af150 con 0x7f226c073900 2024-04-26T22:07:40.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.663+0000 7f2270e62640 1 --2- 172.21.15.137:0/3933627061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 0x7f226c06fee0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2264009d90 tx=0x7f226402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81103f641f24ced6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:40.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.663+0000 7f226affd640 1 -- 172.21.15.137:0/3933627061 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264007740 con 0x7f226c073900 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.663+0000 7f226affd640 1 -- 172.21.15.137:0/3933627061 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22640078e0 con 0x7f226c073900 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.663+0000 7f226affd640 1 -- 172.21.15.137:0/3933627061 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264007c90 con 0x7f226c073900 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.664+0000 7f22728c5640 1 -- 172.21.15.137:0/3933627061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 msgr2=0x7f226c06fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.664+0000 7f22728c5640 1 --2- 172.21.15.137:0/3933627061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 0x7f226c06fee0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2264009d90 tx=0x7f226402a6f0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.664+0000 7f22728c5640 1 -- 172.21.15.137:0/3933627061 shutdown_connections 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.664+0000 7f22728c5640 1 --2- 172.21.15.137:0/3933627061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 0x7f226c06fee0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.664+0000 7f22728c5640 1 -- 172.21.15.137:0/3933627061 >> 172.21.15.137:0/3933627061 conn(0x7f226c0d0d30 msgr2=0x7f226c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.664+0000 7f22728c5640 1 -- 172.21.15.137:0/3933627061 shutdown_connections 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.664+0000 7f22728c5640 1 -- 172.21.15.137:0/3933627061 wait complete. 2024-04-26T22:07:40.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.665+0000 7f22728c5640 1 Processor -- start 2024-04-26T22:07:40.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.665+0000 7f22728c5640 1 -- start start 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f22728c5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f226c06fa50 0x7f226c158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f22728c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 0x7f226c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f22728c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f226c1485b0 0x7f226c15ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f22728c5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f226c0b4cd0 con 0x7f226c06fa50 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f22728c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f226c0af710 con 0x7f226c073900 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f22728c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f226c0b4e50 con 0x7f226c1485b0 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f226c06fa50 0x7f226c158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226bfff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f226c06fa50 0x7f226c158d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36412/0 (socket says 172.21.15.137:36412) 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226bfff640 1 -- 172.21.15.137:0/3720132037 learned_addr learned my addr 172.21.15.137:0/3720132037 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226b7fe640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 0x7f226c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f2270e62640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f226c1485b0 0x7f226c15ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226bfff640 1 -- 172.21.15.137:0/3720132037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f226c1485b0 msgr2=0x7f226c15ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226bfff640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f226c1485b0 0x7f226c15ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226bfff640 1 -- 172.21.15.137:0/3720132037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 msgr2=0x7f226c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226bfff640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 0x7f226c15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226bfff640 1 -- 172.21.15.137:0/3720132037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c0b2920 con 0x7f226c06fa50 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.666+0000 7f226b7fe640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 0x7f226c15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.667+0000 7f226bfff640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f226c06fa50 0x7f226c158d00 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c440 tx=0x7f225c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.667+0000 7f2268ff9640 1 -- 172.21.15.137:0/3720132037 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c017070 con 0x7f226c06fa50 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.667+0000 7f2268ff9640 1 -- 172.21.15.137:0/3720132037 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225c005480 con 0x7f226c06fa50 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.667+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226c0b2c00 con 0x7f226c06fa50 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.667+0000 7f2268ff9640 1 -- 172.21.15.137:0/3720132037 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c003830 con 0x7f226c06fa50 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.667+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f226c0b31c0 con 0x7f226c06fa50 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.668+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f226c06a290 con 0x7f226c06fa50 2024-04-26T22:07:40.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.668+0000 7f2268ff9640 1 -- 172.21.15.137:0/3720132037 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f225c01a070 con 0x7f226c06fa50 2024-04-26T22:07:40.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.668+0000 7f2268ff9640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c8f0 0x7f225806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:40.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.669+0000 7f2268ff9640 1 -- 172.21.15.137:0/3720132037 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f225c08ad30 con 0x7f226c06fa50 2024-04-26T22:07:40.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.669+0000 7f226b7fe640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c8f0 0x7f225806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:40.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.669+0000 7f226b7fe640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c8f0 0x7f225806edb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f226c15e510 tx=0x7f2260007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:40.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.673+0000 7f2268ff9640 1 -- 172.21.15.137:0/3720132037 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f225c058ba0 con 0x7f226c06fa50 2024-04-26T22:07:40.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.844+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f226c140680 con 0x7f225806c8f0 2024-04-26T22:07:40.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.850+0000 7f2268ff9640 1 -- 172.21.15.137:0/3720132037 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252410 (secure 0 0 0) 0x7f226c140680 con 0x7f225806c8f0 2024-04-26T22:07:40.853 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:40.854 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:07:40.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c8f0 msgr2=0x7f225806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c8f0 0x7f225806edb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f226c15e510 tx=0x7f2260007d30 comp rx=0 tx=0).stop 2024-04-26T22:07:40.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f226c06fa50 msgr2=0x7f226c158d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:40.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f226c06fa50 0x7f226c158d00 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c440 tx=0x7f225c00c900 comp rx=0 tx=0).stop 2024-04-26T22:07:40.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 shutdown_connections 2024-04-26T22:07:40.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f225806c8f0 0x7f225806edb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f226c1485b0 0x7f226c15ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f226c073900 0x7f226c15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 --2- 172.21.15.137:0/3720132037 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f226c06fa50 0x7f226c158d00 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:40.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 >> 172.21.15.137:0/3720132037 conn(0x7f226c0d0d30 msgr2=0x7f226c0cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:40.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 shutdown_connections 2024-04-26T22:07:40.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:40.853+0000 7f22728c5640 1 -- 172.21.15.137:0/3720132037 wait complete. 2024-04-26T22:07:40.864 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":385,"stamp":"2024-04-26T22:07:40.814711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":278264,"kb_used_data":12176,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754696456,"statfs":{"total":773094113280,"available":772809170944,"internally_reserved":0,"allocated":12468224,"data_stored":6057758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.279291"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573823+0000","last_change":"2024-04-26T22:07:37.570247+0000","last_active":"2024-04-26T22:07:37.573823+0000","last_peered":"2024-04-26T22:07:37.573823+0000","last_clean":"2024-04-26T22:07:37.573823+0000","last_became_active":"2024-04-26T22:07:37.570000+0000","last_became_peered":"2024-04-26T22:07:37.570000+0000","last_unstale":"2024-04-26T22:07:37.573823+0000","last_undegraded":"2024-04-26T22:07:37.573823+0000","last_fullsized":"2024-04-26T22:07:37.573823+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:02.843539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575189+0000","last_change":"2024-04-26T22:07:37.574031+0000","last_active":"2024-04-26T22:07:37.575189+0000","last_peered":"2024-04-26T22:07:37.575189+0000","last_clean":"2024-04-26T22:07:37.575189+0000","last_became_active":"2024-04-26T22:07:37.573198+0000","last_became_peered":"2024-04-26T22:07:37.573198+0000","last_unstale":"2024-04-26T22:07:37.575189+0000","last_undegraded":"2024-04-26T22:07:37.575189+0000","last_fullsized":"2024-04-26T22:07:37.575189+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:58.056862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.560413+0000","last_change":"2024-04-26T22:07:37.555784+0000","last_active":"2024-04-26T22:07:37.560413+0000","last_peered":"2024-04-26T22:07:37.560413+0000","last_clean":"2024-04-26T22:07:37.560413+0000","last_became_active":"2024-04-26T22:07:37.555424+0000","last_became_peered":"2024-04-26T22:07:37.555424+0000","last_unstale":"2024-04-26T22:07:37.560413+0000","last_undegraded":"2024-04-26T22:07:37.560413+0000","last_fullsized":"2024-04-26T22:07:37.560413+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:20.153663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578873+0000","last_change":"2024-04-26T22:07:37.575300+0000","last_active":"2024-04-26T22:07:37.578873+0000","last_peered":"2024-04-26T22:07:37.578873+0000","last_clean":"2024-04-26T22:07:37.578873+0000","last_became_active":"2024-04-26T22:07:37.575014+0000","last_became_peered":"2024-04-26T22:07:37.575014+0000","last_unstale":"2024-04-26T22:07:37.578873+0000","last_undegraded":"2024-04-26T22:07:37.578873+0000","last_fullsized":"2024-04-26T22:07:37.578873+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:02:19.407481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.566666+0000","last_change":"2024-04-26T22:07:37.561455+0000","last_active":"2024-04-26T22:07:37.566666+0000","last_peered":"2024-04-26T22:07:37.566666+0000","last_clean":"2024-04-26T22:07:37.566666+0000","last_became_active":"2024-04-26T22:07:37.561188+0000","last_became_peered":"2024-04-26T22:07:37.561188+0000","last_unstale":"2024-04-26T22:07:37.566666+0000","last_undegraded":"2024-04-26T22:07:37.566666+0000","last_fullsized":"2024-04-26T22:07:37.566666+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:47.848803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565465+0000","last_change":"2024-04-26T22:07:37.560858+0000","last_active":"2024-04-26T22:07:37.565465+0000","last_peered":"2024-04-26T22:07:37.565465+0000","last_clean":"2024-04-26T22:07:37.565465+0000","last_became_active":"2024-04-26T22:07:37.560597+0000","last_became_peered":"2024-04-26T22:07:37.560597+0000","last_unstale":"2024-04-26T22:07:37.565465+0000","last_undegraded":"2024-04-26T22:07:37.565465+0000","last_fullsized":"2024-04-26T22:07:37.565465+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:25.059236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.571713+0000","last_change":"2024-04-26T22:07:37.570241+0000","last_active":"2024-04-26T22:07:37.571713+0000","last_peered":"2024-04-26T22:07:37.571713+0000","last_clean":"2024-04-26T22:07:37.571713+0000","last_became_active":"2024-04-26T22:07:37.569945+0000","last_became_peered":"2024-04-26T22:07:37.569945+0000","last_unstale":"2024-04-26T22:07:37.571713+0000","last_undegraded":"2024-04-26T22:07:37.571713+0000","last_fullsized":"2024-04-26T22:07:37.571713+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:21.768882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.563621+0000","last_change":"2024-04-26T22:07:37.558835+0000","last_active":"2024-04-26T22:07:37.563621+0000","last_peered":"2024-04-26T22:07:37.563621+0000","last_clean":"2024-04-26T22:07:37.563621+0000","last_became_active":"2024-04-26T22:07:37.558554+0000","last_became_peered":"2024-04-26T22:07:37.558554+0000","last_unstale":"2024-04-26T22:07:37.563621+0000","last_undegraded":"2024-04-26T22:07:37.563621+0000","last_fullsized":"2024-04-26T22:07:37.563621+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:58.056862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573806+0000","last_change":"2024-04-26T22:07:37.568822+0000","last_active":"2024-04-26T22:07:37.573806+0000","last_peered":"2024-04-26T22:07:37.573806+0000","last_clean":"2024-04-26T22:07:37.573806+0000","last_became_active":"2024-04-26T22:07:37.568567+0000","last_became_peered":"2024-04-26T22:07:37.568567+0000","last_unstale":"2024-04-26T22:07:37.573806+0000","last_undegraded":"2024-04-26T22:07:37.573806+0000","last_fullsized":"2024-04-26T22:07:37.573806+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:42:31.059383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567289+0000","last_change":"2024-04-26T22:07:37.562648+0000","last_active":"2024-04-26T22:07:37.567289+0000","last_peered":"2024-04-26T22:07:37.567289+0000","last_clean":"2024-04-26T22:07:37.567289+0000","last_became_active":"2024-04-26T22:07:37.562116+0000","last_became_peered":"2024-04-26T22:07:37.562116+0000","last_unstale":"2024-04-26T22:07:37.567289+0000","last_undegraded":"2024-04-26T22:07:37.567289+0000","last_fullsized":"2024-04-26T22:07:37.567289+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:49.102224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575109+0000","last_change":"2024-04-26T22:07:37.573659+0000","last_active":"2024-04-26T22:07:37.575109+0000","last_peered":"2024-04-26T22:07:37.575109+0000","last_clean":"2024-04-26T22:07:37.575109+0000","last_became_active":"2024-04-26T22:07:37.573333+0000","last_became_peered":"2024-04-26T22:07:37.573333+0000","last_unstale":"2024-04-26T22:07:37.575109+0000","last_undegraded":"2024-04-26T22:07:37.575109+0000","last_fullsized":"2024-04-26T22:07:37.575109+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:21.287067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.576248+0000","last_change":"2024-04-26T22:07:37.571949+0000","last_active":"2024-04-26T22:07:37.576248+0000","last_peered":"2024-04-26T22:07:37.576248+0000","last_clean":"2024-04-26T22:07:37.576248+0000","last_became_active":"2024-04-26T22:07:37.571343+0000","last_became_peered":"2024-04-26T22:07:37.571343+0000","last_unstale":"2024-04-26T22:07:37.576248+0000","last_undegraded":"2024-04-26T22:07:37.576248+0000","last_fullsized":"2024-04-26T22:07:37.576248+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:24:41.505060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565989+0000","last_change":"2024-04-26T22:07:37.563432+0000","last_active":"2024-04-26T22:07:37.565989+0000","last_peered":"2024-04-26T22:07:37.565989+0000","last_clean":"2024-04-26T22:07:37.565989+0000","last_became_active":"2024-04-26T22:07:37.563153+0000","last_became_peered":"2024-04-26T22:07:37.563153+0000","last_unstale":"2024-04-26T22:07:37.565989+0000","last_undegraded":"2024-04-26T22:07:37.565989+0000","last_fullsized":"2024-04-26T22:07:37.565989+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:01.343063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.568745+0000","last_change":"2024-04-26T22:07:37.567298+0000","last_active":"2024-04-26T22:07:37.568745+0000","last_peered":"2024-04-26T22:07:37.568745+0000","last_clean":"2024-04-26T22:07:37.568745+0000","last_became_active":"2024-04-26T22:07:37.567004+0000","last_became_peered":"2024-04-26T22:07:37.567004+0000","last_unstale":"2024-04-26T22:07:37.568745+0000","last_undegraded":"2024-04-26T22:07:37.568745+0000","last_fullsized":"2024-04-26T22:07:37.568745+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:46.980260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565711+0000","last_change":"2024-04-26T22:07:37.562654+0000","last_active":"2024-04-26T22:07:37.565711+0000","last_peered":"2024-04-26T22:07:37.565711+0000","last_clean":"2024-04-26T22:07:37.565711+0000","last_became_active":"2024-04-26T22:07:37.562370+0000","last_became_peered":"2024-04-26T22:07:37.562370+0000","last_unstale":"2024-04-26T22:07:37.565711+0000","last_undegraded":"2024-04-26T22:07:37.565711+0000","last_fullsized":"2024-04-26T22:07:37.565711+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:41.170155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573832+0000","last_change":"2024-04-26T22:07:37.569211+0000","last_active":"2024-04-26T22:07:37.573832+0000","last_peered":"2024-04-26T22:07:37.573832+0000","last_clean":"2024-04-26T22:07:37.573832+0000","last_became_active":"2024-04-26T22:07:37.568931+0000","last_became_peered":"2024-04-26T22:07:37.568931+0000","last_unstale":"2024-04-26T22:07:37.573832+0000","last_undegraded":"2024-04-26T22:07:37.573832+0000","last_fullsized":"2024-04-26T22:07:37.573832+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:04:22.278037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575139+0000","last_change":"2024-04-26T22:07:37.574204+0000","last_active":"2024-04-26T22:07:37.575139+0000","last_peered":"2024-04-26T22:07:37.575139+0000","last_clean":"2024-04-26T22:07:37.575139+0000","last_became_active":"2024-04-26T22:07:37.573523+0000","last_became_peered":"2024-04-26T22:07:37.573523+0000","last_unstale":"2024-04-26T22:07:37.575139+0000","last_undegraded":"2024-04-26T22:07:37.575139+0000","last_fullsized":"2024-04-26T22:07:37.575139+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:56.385421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.576409+0000","last_change":"2024-04-26T22:07:37.575902+0000","last_active":"2024-04-26T22:07:37.576409+0000","last_peered":"2024-04-26T22:07:37.576409+0000","last_clean":"2024-04-26T22:07:37.576409+0000","last_became_active":"2024-04-26T22:07:37.575606+0000","last_became_peered":"2024-04-26T22:07:37.575606+0000","last_unstale":"2024-04-26T22:07:37.576409+0000","last_undegraded":"2024-04-26T22:07:37.576409+0000","last_fullsized":"2024-04-26T22:07:37.576409+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:01.343063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.569468+0000","last_change":"2024-04-26T22:07:37.568433+0000","last_active":"2024-04-26T22:07:37.569468+0000","last_peered":"2024-04-26T22:07:37.569468+0000","last_clean":"2024-04-26T22:07:37.569468+0000","last_became_active":"2024-04-26T22:07:37.567937+0000","last_became_peered":"2024-04-26T22:07:37.567937+0000","last_unstale":"2024-04-26T22:07:37.569468+0000","last_undegraded":"2024-04-26T22:07:37.569468+0000","last_fullsized":"2024-04-26T22:07:37.569468+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:58.178322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.561778+0000","last_change":"2024-04-26T22:07:37.558119+0000","last_active":"2024-04-26T22:07:37.561778+0000","last_peered":"2024-04-26T22:07:37.561778+0000","last_clean":"2024-04-26T22:07:37.561778+0000","last_became_active":"2024-04-26T22:07:37.557861+0000","last_became_peered":"2024-04-26T22:07:37.557861+0000","last_unstale":"2024-04-26T22:07:37.561778+0000","last_undegraded":"2024-04-26T22:07:37.561778+0000","last_fullsized":"2024-04-26T22:07:37.561778+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:23.036385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574728+0000","last_change":"2024-04-26T22:07:37.571467+0000","last_active":"2024-04-26T22:07:37.574728+0000","last_peered":"2024-04-26T22:07:37.574728+0000","last_clean":"2024-04-26T22:07:37.574728+0000","last_became_active":"2024-04-26T22:07:37.571033+0000","last_became_peered":"2024-04-26T22:07:37.571033+0000","last_unstale":"2024-04-26T22:07:37.574728+0000","last_undegraded":"2024-04-26T22:07:37.574728+0000","last_fullsized":"2024-04-26T22:07:37.574728+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:20:30.884634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573389+0000","last_change":"2024-04-26T22:07:37.567466+0000","last_active":"2024-04-26T22:07:37.573389+0000","last_peered":"2024-04-26T22:07:37.573389+0000","last_clean":"2024-04-26T22:07:37.573389+0000","last_became_active":"2024-04-26T22:07:37.567169+0000","last_became_peered":"2024-04-26T22:07:37.567169+0000","last_unstale":"2024-04-26T22:07:37.573389+0000","last_undegraded":"2024-04-26T22:07:37.573389+0000","last_fullsized":"2024-04-26T22:07:37.573389+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:44.354182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567453+0000","last_change":"2024-04-26T22:07:37.558797+0000","last_active":"2024-04-26T22:07:37.567453+0000","last_peered":"2024-04-26T22:07:37.567453+0000","last_clean":"2024-04-26T22:07:37.567453+0000","last_became_active":"2024-04-26T22:07:37.558499+0000","last_became_peered":"2024-04-26T22:07:37.558499+0000","last_unstale":"2024-04-26T22:07:37.567453+0000","last_undegraded":"2024-04-26T22:07:37.567453+0000","last_fullsized":"2024-04-26T22:07:37.567453+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:17:15.979434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565798+0000","last_change":"2024-04-26T22:07:37.564038+0000","last_active":"2024-04-26T22:07:37.565798+0000","last_peered":"2024-04-26T22:07:37.565798+0000","last_clean":"2024-04-26T22:07:37.565798+0000","last_became_active":"2024-04-26T22:07:37.563695+0000","last_became_peered":"2024-04-26T22:07:37.563695+0000","last_unstale":"2024-04-26T22:07:37.565798+0000","last_undegraded":"2024-04-26T22:07:37.565798+0000","last_fullsized":"2024-04-26T22:07:37.565798+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:58.178322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574759+0000","last_change":"2024-04-26T22:07:37.573005+0000","last_active":"2024-04-26T22:07:37.574759+0000","last_peered":"2024-04-26T22:07:37.574759+0000","last_clean":"2024-04-26T22:07:37.574759+0000","last_became_active":"2024-04-26T22:07:37.572361+0000","last_became_peered":"2024-04-26T22:07:37.572361+0000","last_unstale":"2024-04-26T22:07:37.574759+0000","last_undegraded":"2024-04-26T22:07:37.574759+0000","last_fullsized":"2024-04-26T22:07:37.574759+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:53.421289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573694+0000","last_change":"2024-04-26T22:07:37.568448+0000","last_active":"2024-04-26T22:07:37.573694+0000","last_peered":"2024-04-26T22:07:37.573694+0000","last_clean":"2024-04-26T22:07:37.573694+0000","last_became_active":"2024-04-26T22:07:37.568156+0000","last_became_peered":"2024-04-26T22:07:37.568156+0000","last_unstale":"2024-04-26T22:07:37.573694+0000","last_undegraded":"2024-04-26T22:07:37.573694+0000","last_fullsized":"2024-04-26T22:07:37.573694+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:42:15.521460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.571615+0000","last_change":"2024-04-26T22:07:37.570013+0000","last_active":"2024-04-26T22:07:37.571615+0000","last_peered":"2024-04-26T22:07:37.571615+0000","last_clean":"2024-04-26T22:07:37.571615+0000","last_became_active":"2024-04-26T22:07:37.569743+0000","last_became_peered":"2024-04-26T22:07:37.569743+0000","last_unstale":"2024-04-26T22:07:37.571615+0000","last_undegraded":"2024-04-26T22:07:37.571615+0000","last_fullsized":"2024-04-26T22:07:37.571615+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:48.986752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575926+0000","last_change":"2024-04-26T22:07:37.570188+0000","last_active":"2024-04-26T22:07:37.575926+0000","last_peered":"2024-04-26T22:07:37.575926+0000","last_clean":"2024-04-26T22:07:37.575926+0000","last_became_active":"2024-04-26T22:07:37.569877+0000","last_became_peered":"2024-04-26T22:07:37.569877+0000","last_unstale":"2024-04-26T22:07:37.575926+0000","last_undegraded":"2024-04-26T22:07:37.575926+0000","last_fullsized":"2024-04-26T22:07:37.575926+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:07:23.678906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.566870+0000","last_change":"2024-04-26T22:07:37.563892+0000","last_active":"2024-04-26T22:07:37.566870+0000","last_peered":"2024-04-26T22:07:37.566870+0000","last_clean":"2024-04-26T22:07:37.566870+0000","last_became_active":"2024-04-26T22:07:37.563409+0000","last_became_peered":"2024-04-26T22:07:37.563409+0000","last_unstale":"2024-04-26T22:07:37.566870+0000","last_undegraded":"2024-04-26T22:07:37.566870+0000","last_fullsized":"2024-04-26T22:07:37.566870+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:36.375841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.564971+0000","last_change":"2024-04-26T22:07:37.561948+0000","last_active":"2024-04-26T22:07:37.564971+0000","last_peered":"2024-04-26T22:07:37.564971+0000","last_clean":"2024-04-26T22:07:37.564971+0000","last_became_active":"2024-04-26T22:07:37.561468+0000","last_became_peered":"2024-04-26T22:07:37.561468+0000","last_unstale":"2024-04-26T22:07:37.564971+0000","last_undegraded":"2024-04-26T22:07:37.564971+0000","last_fullsized":"2024-04-26T22:07:37.564971+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:48.986752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567949+0000","last_change":"2024-04-26T22:07:37.562595+0000","last_active":"2024-04-26T22:07:37.567949+0000","last_peered":"2024-04-26T22:07:37.567949+0000","last_clean":"2024-04-26T22:07:37.567949+0000","last_became_active":"2024-04-26T22:07:37.562267+0000","last_became_peered":"2024-04-26T22:07:37.562267+0000","last_unstale":"2024-04-26T22:07:37.567949+0000","last_undegraded":"2024-04-26T22:07:37.567949+0000","last_fullsized":"2024-04-26T22:07:37.567949+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:35:34.565140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565447+0000","last_change":"2024-04-26T22:07:37.561624+0000","last_active":"2024-04-26T22:07:37.565447+0000","last_peered":"2024-04-26T22:07:37.565447+0000","last_clean":"2024-04-26T22:07:37.565447+0000","last_became_active":"2024-04-26T22:07:37.561361+0000","last_became_peered":"2024-04-26T22:07:37.561361+0000","last_unstale":"2024-04-26T22:07:37.565447+0000","last_undegraded":"2024-04-26T22:07:37.565447+0000","last_fullsized":"2024-04-26T22:07:37.565447+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:26.937036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.562035+0000","last_change":"2024-04-26T22:07:37.558474+0000","last_active":"2024-04-26T22:07:37.562035+0000","last_peered":"2024-04-26T22:07:37.562035+0000","last_clean":"2024-04-26T22:07:37.562035+0000","last_became_active":"2024-04-26T22:07:37.558213+0000","last_became_peered":"2024-04-26T22:07:37.558213+0000","last_unstale":"2024-04-26T22:07:37.562035+0000","last_undegraded":"2024-04-26T22:07:37.562035+0000","last_fullsized":"2024-04-26T22:07:37.562035+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:47.848803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"114'4","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.572242+0000","last_change":"2024-04-26T22:07:36.545122+0000","last_active":"2024-04-26T22:07:37.572242+0000","last_peered":"2024-04-26T22:07:37.572242+0000","last_clean":"2024-04-26T22:07:37.572242+0000","last_became_active":"2024-04-26T22:07:36.544840+0000","last_became_peered":"2024-04-26T22:07:36.544840+0000","last_unstale":"2024-04-26T22:07:37.572242+0000","last_undegraded":"2024-04-26T22:07:37.572242+0000","last_fullsized":"2024-04-26T22:07:37.572242+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:19.308146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567997+0000","last_change":"2024-04-26T22:07:37.567046+0000","last_active":"2024-04-26T22:07:37.567997+0000","last_peered":"2024-04-26T22:07:37.567997+0000","last_clean":"2024-04-26T22:07:37.567997+0000","last_became_active":"2024-04-26T22:07:37.566785+0000","last_became_peered":"2024-04-26T22:07:37.566785+0000","last_unstale":"2024-04-26T22:07:37.567997+0000","last_undegraded":"2024-04-26T22:07:37.567997+0000","last_fullsized":"2024-04-26T22:07:37.567997+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:56.385421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573661+0000","last_change":"2024-04-26T22:07:36.551291+0000","last_active":"2024-04-26T22:07:37.573661+0000","last_peered":"2024-04-26T22:07:37.573661+0000","last_clean":"2024-04-26T22:07:37.573661+0000","last_became_active":"2024-04-26T22:07:36.551011+0000","last_became_peered":"2024-04-26T22:07:36.551011+0000","last_unstale":"2024-04-26T22:07:37.573661+0000","last_undegraded":"2024-04-26T22:07:37.573661+0000","last_fullsized":"2024-04-26T22:07:37.573661+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:52.417031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565456+0000","last_change":"2024-04-26T22:07:37.561580+0000","last_active":"2024-04-26T22:07:37.565456+0000","last_peered":"2024-04-26T22:07:37.565456+0000","last_clean":"2024-04-26T22:07:37.565456+0000","last_became_active":"2024-04-26T22:07:37.561311+0000","last_became_peered":"2024-04-26T22:07:37.561311+0000","last_unstale":"2024-04-26T22:07:37.565456+0000","last_undegraded":"2024-04-26T22:07:37.565456+0000","last_fullsized":"2024-04-26T22:07:37.565456+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:20.312405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573277+0000","last_change":"2024-04-26T22:07:36.557531+0000","last_active":"2024-04-26T22:07:37.573277+0000","last_peered":"2024-04-26T22:07:37.573277+0000","last_clean":"2024-04-26T22:07:37.573277+0000","last_became_active":"2024-04-26T22:07:36.557239+0000","last_became_peered":"2024-04-26T22:07:36.557239+0000","last_unstale":"2024-04-26T22:07:37.573277+0000","last_undegraded":"2024-04-26T22:07:37.573277+0000","last_fullsized":"2024-04-26T22:07:37.573277+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:46.730286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567599+0000","last_change":"2024-04-26T22:07:37.562770+0000","last_active":"2024-04-26T22:07:37.567599+0000","last_peered":"2024-04-26T22:07:37.567599+0000","last_clean":"2024-04-26T22:07:37.567599+0000","last_became_active":"2024-04-26T22:07:37.562473+0000","last_became_peered":"2024-04-26T22:07:37.562473+0000","last_unstale":"2024-04-26T22:07:37.567599+0000","last_undegraded":"2024-04-26T22:07:37.567599+0000","last_fullsized":"2024-04-26T22:07:37.567599+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:43.291180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.576360+0000","last_change":"2024-04-26T22:07:36.557633+0000","last_active":"2024-04-26T22:07:37.576360+0000","last_peered":"2024-04-26T22:07:37.576360+0000","last_clean":"2024-04-26T22:07:37.576360+0000","last_became_active":"2024-04-26T22:07:36.557352+0000","last_became_peered":"2024-04-26T22:07:36.557352+0000","last_unstale":"2024-04-26T22:07:37.576360+0000","last_undegraded":"2024-04-26T22:07:37.576360+0000","last_fullsized":"2024-04-26T22:07:37.576360+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.020412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.570477+0000","last_change":"2024-04-26T22:07:37.567765+0000","last_active":"2024-04-26T22:07:37.570477+0000","last_peered":"2024-04-26T22:07:37.570477+0000","last_clean":"2024-04-26T22:07:37.570477+0000","last_became_active":"2024-04-26T22:07:37.567489+0000","last_became_peered":"2024-04-26T22:07:37.567489+0000","last_unstale":"2024-04-26T22:07:37.570477+0000","last_undegraded":"2024-04-26T22:07:37.570477+0000","last_fullsized":"2024-04-26T22:07:37.570477+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:33.854729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574496+0000","last_change":"2024-04-26T22:07:36.550151+0000","last_active":"2024-04-26T22:07:37.574496+0000","last_peered":"2024-04-26T22:07:37.574496+0000","last_clean":"2024-04-26T22:07:37.574496+0000","last_became_active":"2024-04-26T22:07:36.549831+0000","last_became_peered":"2024-04-26T22:07:36.549831+0000","last_unstale":"2024-04-26T22:07:37.574496+0000","last_undegraded":"2024-04-26T22:07:37.574496+0000","last_fullsized":"2024-04-26T22:07:37.574496+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:55.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.575066+0000","last_change":"2024-04-26T22:07:37.573365+0000","last_active":"2024-04-26T22:07:37.575066+0000","last_peered":"2024-04-26T22:07:37.575066+0000","last_clean":"2024-04-26T22:07:37.575066+0000","last_became_active":"2024-04-26T22:07:37.573087+0000","last_became_peered":"2024-04-26T22:07:37.573087+0000","last_unstale":"2024-04-26T22:07:37.575066+0000","last_undegraded":"2024-04-26T22:07:37.575066+0000","last_fullsized":"2024-04-26T22:07:37.575066+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:20.153663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573916+0000","last_change":"2024-04-26T22:07:36.554860+0000","last_active":"2024-04-26T22:07:37.573916+0000","last_peered":"2024-04-26T22:07:37.573916+0000","last_clean":"2024-04-26T22:07:37.573916+0000","last_became_active":"2024-04-26T22:07:36.554395+0000","last_became_peered":"2024-04-26T22:07:36.554395+0000","last_unstale":"2024-04-26T22:07:37.573916+0000","last_undegraded":"2024-04-26T22:07:37.573916+0000","last_fullsized":"2024-04-26T22:07:37.573916+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:00.338805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573813+0000","last_change":"2024-04-26T22:07:37.568558+0000","last_active":"2024-04-26T22:07:37.573813+0000","last_peered":"2024-04-26T22:07:37.573813+0000","last_clean":"2024-04-26T22:07:37.573813+0000","last_became_active":"2024-04-26T22:07:37.568268+0000","last_became_peered":"2024-04-26T22:07:37.568268+0000","last_unstale":"2024-04-26T22:07:37.573813+0000","last_undegraded":"2024-04-26T22:07:37.573813+0000","last_fullsized":"2024-04-26T22:07:37.573813+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:35:38.035039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.551035+0000","last_change":"2024-04-26T22:07:36.551205+0000","last_active":"2024-04-26T22:07:37.551035+0000","last_peered":"2024-04-26T22:07:37.551035+0000","last_clean":"2024-04-26T22:07:37.551035+0000","last_became_active":"2024-04-26T22:07:36.550711+0000","last_became_peered":"2024-04-26T22:07:36.550711+0000","last_unstale":"2024-04-26T22:07:37.551035+0000","last_undegraded":"2024-04-26T22:07:37.551035+0000","last_fullsized":"2024-04-26T22:07:37.551035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:41.076109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.571732+0000","last_change":"2024-04-26T22:07:37.570207+0000","last_active":"2024-04-26T22:07:37.571732+0000","last_peered":"2024-04-26T22:07:37.571732+0000","last_clean":"2024-04-26T22:07:37.571732+0000","last_became_active":"2024-04-26T22:07:37.569598+0000","last_became_peered":"2024-04-26T22:07:37.569598+0000","last_unstale":"2024-04-26T22:07:37.571732+0000","last_undegraded":"2024-04-26T22:07:37.571732+0000","last_fullsized":"2024-04-26T22:07:37.571732+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:41.492225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.559569+0000","last_change":"2024-04-26T22:07:36.552879+0000","last_active":"2024-04-26T22:07:37.559569+0000","last_peered":"2024-04-26T22:07:37.559569+0000","last_clean":"2024-04-26T22:07:37.559569+0000","last_became_active":"2024-04-26T22:07:36.552608+0000","last_became_peered":"2024-04-26T22:07:36.552608+0000","last_unstale":"2024-04-26T22:07:37.559569+0000","last_undegraded":"2024-04-26T22:07:37.559569+0000","last_fullsized":"2024-04-26T22:07:37.559569+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:42:33.719644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.561524+0000","last_change":"2024-04-26T22:07:37.560400+0000","last_active":"2024-04-26T22:07:37.561524+0000","last_peered":"2024-04-26T22:07:37.561524+0000","last_clean":"2024-04-26T22:07:37.561524+0000","last_became_active":"2024-04-26T22:07:37.560126+0000","last_became_peered":"2024-04-26T22:07:37.560126+0000","last_unstale":"2024-04-26T22:07:37.561524+0000","last_undegraded":"2024-04-26T22:07:37.561524+0000","last_fullsized":"2024-04-26T22:07:37.561524+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:12.766341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.549121+0000","last_change":"2024-04-26T22:07:36.554844+0000","last_active":"2024-04-26T22:07:37.549121+0000","last_peered":"2024-04-26T22:07:37.549121+0000","last_clean":"2024-04-26T22:07:37.549121+0000","last_became_active":"2024-04-26T22:07:36.554575+0000","last_became_peered":"2024-04-26T22:07:36.554575+0000","last_unstale":"2024-04-26T22:07:37.549121+0000","last_undegraded":"2024-04-26T22:07:37.549121+0000","last_fullsized":"2024-04-26T22:07:37.549121+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:58:37.931763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567206+0000","last_change":"2024-04-26T22:07:37.566297+0000","last_active":"2024-04-26T22:07:37.567206+0000","last_peered":"2024-04-26T22:07:37.567206+0000","last_clean":"2024-04-26T22:07:37.567206+0000","last_became_active":"2024-04-26T22:07:37.566011+0000","last_became_peered":"2024-04-26T22:07:37.566011+0000","last_unstale":"2024-04-26T22:07:37.567206+0000","last_undegraded":"2024-04-26T22:07:37.567206+0000","last_fullsized":"2024-04-26T22:07:37.567206+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:38:58.056862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.552179+0000","last_change":"2024-04-26T22:07:36.553225+0000","last_active":"2024-04-26T22:07:37.552179+0000","last_peered":"2024-04-26T22:07:37.552179+0000","last_clean":"2024-04-26T22:07:37.552179+0000","last_became_active":"2024-04-26T22:07:36.552945+0000","last_became_peered":"2024-04-26T22:07:36.552945+0000","last_unstale":"2024-04-26T22:07:37.552179+0000","last_undegraded":"2024-04-26T22:07:37.552179+0000","last_fullsized":"2024-04-26T22:07:37.552179+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:32.734978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578495+0000","last_change":"2024-04-26T22:07:37.574712+0000","last_active":"2024-04-26T22:07:37.578495+0000","last_peered":"2024-04-26T22:07:37.578495+0000","last_clean":"2024-04-26T22:07:37.578495+0000","last_became_active":"2024-04-26T22:07:37.574432+0000","last_became_peered":"2024-04-26T22:07:37.574432+0000","last_unstale":"2024-04-26T22:07:37.578495+0000","last_undegraded":"2024-04-26T22:07:37.578495+0000","last_fullsized":"2024-04-26T22:07:37.578495+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:34:46.701746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"114'3","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.581385+0000","last_change":"2024-04-26T22:07:36.557661+0000","last_active":"2024-04-26T22:07:37.581385+0000","last_peered":"2024-04-26T22:07:37.581385+0000","last_clean":"2024-04-26T22:07:37.581385+0000","last_became_active":"2024-04-26T22:07:36.557408+0000","last_became_peered":"2024-04-26T22:07:36.557408+0000","last_unstale":"2024-04-26T22:07:37.581385+0000","last_undegraded":"2024-04-26T22:07:37.581385+0000","last_fullsized":"2024-04-26T22:07:37.581385+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:54.274773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.559803+0000","last_change":"2024-04-26T22:07:37.558145+0000","last_active":"2024-04-26T22:07:37.559803+0000","last_peered":"2024-04-26T22:07:37.559803+0000","last_clean":"2024-04-26T22:07:37.559803+0000","last_became_active":"2024-04-26T22:07:37.557841+0000","last_became_peered":"2024-04-26T22:07:37.557841+0000","last_unstale":"2024-04-26T22:07:37.559803+0000","last_undegraded":"2024-04-26T22:07:37.559803+0000","last_fullsized":"2024-04-26T22:07:37.559803+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:41.170155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"114'6","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.586647+0000","last_change":"2024-04-26T22:07:36.552513+0000","last_active":"2024-04-26T22:07:37.586647+0000","last_peered":"2024-04-26T22:07:37.586647+0000","last_clean":"2024-04-26T22:07:37.586647+0000","last_became_active":"2024-04-26T22:07:36.552233+0000","last_became_peered":"2024-04-26T22:07:36.552233+0000","last_unstale":"2024-04-26T22:07:37.586647+0000","last_undegraded":"2024-04-26T22:07:37.586647+0000","last_fullsized":"2024-04-26T22:07:37.586647+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:21.244361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565924+0000","last_change":"2024-04-26T22:07:37.563140+0000","last_active":"2024-04-26T22:07:37.565924+0000","last_peered":"2024-04-26T22:07:37.565924+0000","last_clean":"2024-04-26T22:07:37.565924+0000","last_became_active":"2024-04-26T22:07:37.562827+0000","last_became_peered":"2024-04-26T22:07:37.562827+0000","last_unstale":"2024-04-26T22:07:37.565924+0000","last_undegraded":"2024-04-26T22:07:37.565924+0000","last_fullsized":"2024-04-26T22:07:37.565924+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:57.056073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.573590+0000","last_change":"2024-04-26T22:07:36.550693+0000","last_active":"2024-04-26T22:07:37.573590+0000","last_peered":"2024-04-26T22:07:37.573590+0000","last_clean":"2024-04-26T22:07:37.573590+0000","last_became_active":"2024-04-26T22:07:36.550394+0000","last_became_peered":"2024-04-26T22:07:36.550394+0000","last_unstale":"2024-04-26T22:07:37.573590+0000","last_undegraded":"2024-04-26T22:07:37.573590+0000","last_fullsized":"2024-04-26T22:07:37.573590+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:41:13.020412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565934+0000","last_change":"2024-04-26T22:07:37.564301+0000","last_active":"2024-04-26T22:07:37.565934+0000","last_peered":"2024-04-26T22:07:37.565934+0000","last_clean":"2024-04-26T22:07:37.565934+0000","last_became_active":"2024-04-26T22:07:37.563976+0000","last_became_peered":"2024-04-26T22:07:37.563976+0000","last_unstale":"2024-04-26T22:07:37.565934+0000","last_undegraded":"2024-04-26T22:07:37.565934+0000","last_fullsized":"2024-04-26T22:07:37.565934+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:14.437024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.563294+0000","last_change":"2024-04-26T22:07:36.560482+0000","last_active":"2024-04-26T22:07:37.563294+0000","last_peered":"2024-04-26T22:07:37.563294+0000","last_clean":"2024-04-26T22:07:37.563294+0000","last_became_active":"2024-04-26T22:07:36.560213+0000","last_became_peered":"2024-04-26T22:07:36.560213+0000","last_unstale":"2024-04-26T22:07:37.563294+0000","last_undegraded":"2024-04-26T22:07:37.563294+0000","last_fullsized":"2024-04-26T22:07:37.563294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:45:19.149405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578643+0000","last_change":"2024-04-26T22:07:37.575297+0000","last_active":"2024-04-26T22:07:37.578643+0000","last_peered":"2024-04-26T22:07:37.578643+0000","last_clean":"2024-04-26T22:07:37.578643+0000","last_became_active":"2024-04-26T22:07:37.575030+0000","last_became_peered":"2024-04-26T22:07:37.575030+0000","last_unstale":"2024-04-26T22:07:37.578643+0000","last_undegraded":"2024-04-26T22:07:37.578643+0000","last_fullsized":"2024-04-26T22:07:37.578643+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:55:42.563407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"114'8","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.581363+0000","last_change":"2024-04-26T22:07:36.557661+0000","last_active":"2024-04-26T22:07:37.581363+0000","last_peered":"2024-04-26T22:07:37.581363+0000","last_clean":"2024-04-26T22:07:37.581363+0000","last_became_active":"2024-04-26T22:07:36.557373+0000","last_became_peered":"2024-04-26T22:07:36.557373+0000","last_unstale":"2024-04-26T22:07:37.581363+0000","last_undegraded":"2024-04-26T22:07:37.581363+0000","last_fullsized":"2024-04-26T22:07:37.581363+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:00.774202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578326+0000","last_change":"2024-04-26T22:07:37.570601+0000","last_active":"2024-04-26T22:07:37.578326+0000","last_peered":"2024-04-26T22:07:37.578326+0000","last_clean":"2024-04-26T22:07:37.578326+0000","last_became_active":"2024-04-26T22:07:37.570336+0000","last_became_peered":"2024-04-26T22:07:37.570336+0000","last_unstale":"2024-04-26T22:07:37.578326+0000","last_undegraded":"2024-04-26T22:07:37.578326+0000","last_fullsized":"2024-04-26T22:07:37.578326+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:25.059236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.581405+0000","last_change":"2024-04-26T22:07:36.551722+0000","last_active":"2024-04-26T22:07:37.581405+0000","last_peered":"2024-04-26T22:07:37.581405+0000","last_clean":"2024-04-26T22:07:37.581405+0000","last_became_active":"2024-04-26T22:07:36.551447+0000","last_became_peered":"2024-04-26T22:07:36.551447+0000","last_unstale":"2024-04-26T22:07:37.581405+0000","last_undegraded":"2024-04-26T22:07:37.581405+0000","last_fullsized":"2024-04-26T22:07:37.581405+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:26:07.746163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567178+0000","last_change":"2024-04-26T22:07:37.566432+0000","last_active":"2024-04-26T22:07:37.567178+0000","last_peered":"2024-04-26T22:07:37.567178+0000","last_clean":"2024-04-26T22:07:37.567178+0000","last_became_active":"2024-04-26T22:07:37.566134+0000","last_became_peered":"2024-04-26T22:07:37.566134+0000","last_unstale":"2024-04-26T22:07:37.567178+0000","last_undegraded":"2024-04-26T22:07:37.567178+0000","last_fullsized":"2024-04-26T22:07:37.567178+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:12.766341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574525+0000","last_change":"2024-04-26T22:07:36.558117+0000","last_active":"2024-04-26T22:07:37.574525+0000","last_peered":"2024-04-26T22:07:37.574525+0000","last_clean":"2024-04-26T22:07:37.574525+0000","last_became_active":"2024-04-26T22:07:36.557855+0000","last_became_peered":"2024-04-26T22:07:36.557855+0000","last_unstale":"2024-04-26T22:07:37.574525+0000","last_undegraded":"2024-04-26T22:07:37.574525+0000","last_fullsized":"2024-04-26T22:07:37.574525+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:55.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.571827+0000","last_change":"2024-04-26T22:07:37.570035+0000","last_active":"2024-04-26T22:07:37.571827+0000","last_peered":"2024-04-26T22:07:37.571827+0000","last_clean":"2024-04-26T22:07:37.571827+0000","last_became_active":"2024-04-26T22:07:37.569685+0000","last_became_peered":"2024-04-26T22:07:37.569685+0000","last_unstale":"2024-04-26T22:07:37.571827+0000","last_undegraded":"2024-04-26T22:07:37.571827+0000","last_fullsized":"2024-04-26T22:07:37.571827+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:45:14.437024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"114'1","reported_seq":13,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.572313+0000","last_change":"2024-04-26T22:07:36.552585+0000","last_active":"2024-04-26T22:07:37.572313+0000","last_peered":"2024-04-26T22:07:37.572313+0000","last_clean":"2024-04-26T22:07:37.572313+0000","last_became_active":"2024-04-26T22:07:36.552190+0000","last_became_peered":"2024-04-26T22:07:36.552190+0000","last_unstale":"2024-04-26T22:07:37.572313+0000","last_undegraded":"2024-04-26T22:07:37.572313+0000","last_fullsized":"2024-04-26T22:07:37.572313+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:20.282809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.560435+0000","last_change":"2024-04-26T22:07:37.557073+0000","last_active":"2024-04-26T22:07:37.560435+0000","last_peered":"2024-04-26T22:07:37.560435+0000","last_clean":"2024-04-26T22:07:37.560435+0000","last_became_active":"2024-04-26T22:07:37.556825+0000","last_became_peered":"2024-04-26T22:07:37.556825+0000","last_unstale":"2024-04-26T22:07:37.560435+0000","last_undegraded":"2024-04-26T22:07:37.560435+0000","last_fullsized":"2024-04-26T22:07:37.560435+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:18:21.287067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.553383+0000","last_change":"2024-04-26T22:07:36.548120+0000","last_active":"2024-04-26T22:07:37.553383+0000","last_peered":"2024-04-26T22:07:37.553383+0000","last_clean":"2024-04-26T22:07:37.553383+0000","last_became_active":"2024-04-26T22:07:36.547841+0000","last_became_peered":"2024-04-26T22:07:36.547841+0000","last_unstale":"2024-04-26T22:07:37.553383+0000","last_undegraded":"2024-04-26T22:07:37.553383+0000","last_fullsized":"2024-04-26T22:07:37.553383+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:24.054977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565128+0000","last_change":"2024-04-26T22:07:37.562019+0000","last_active":"2024-04-26T22:07:37.565128+0000","last_peered":"2024-04-26T22:07:37.565128+0000","last_clean":"2024-04-26T22:07:37.565128+0000","last_became_active":"2024-04-26T22:07:37.561738+0000","last_became_peered":"2024-04-26T22:07:37.561738+0000","last_unstale":"2024-04-26T22:07:37.565128+0000","last_undegraded":"2024-04-26T22:07:37.565128+0000","last_fullsized":"2024-04-26T22:07:37.565128+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:33.739237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578851+0000","last_change":"2024-04-26T22:07:36.554698+0000","last_active":"2024-04-26T22:07:37.578851+0000","last_peered":"2024-04-26T22:07:37.578851+0000","last_clean":"2024-04-26T22:07:37.578851+0000","last_became_active":"2024-04-26T22:07:36.554452+0000","last_became_peered":"2024-04-26T22:07:36.554452+0000","last_unstale":"2024-04-26T22:07:37.578851+0000","last_undegraded":"2024-04-26T22:07:37.578851+0000","last_fullsized":"2024-04-26T22:07:37.578851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:55.926732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567252+0000","last_change":"2024-04-26T22:07:37.562910+0000","last_active":"2024-04-26T22:07:37.567252+0000","last_peered":"2024-04-26T22:07:37.567252+0000","last_clean":"2024-04-26T22:07:37.567252+0000","last_became_active":"2024-04-26T22:07:37.560859+0000","last_became_peered":"2024-04-26T22:07:37.560859+0000","last_unstale":"2024-04-26T22:07:37.567252+0000","last_undegraded":"2024-04-26T22:07:37.567252+0000","last_fullsized":"2024-04-26T22:07:37.567252+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:10:53.999161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.549227+0000","last_change":"2024-04-26T22:07:36.558064+0000","last_active":"2024-04-26T22:07:37.549227+0000","last_peered":"2024-04-26T22:07:37.549227+0000","last_clean":"2024-04-26T22:07:37.549227+0000","last_became_active":"2024-04-26T22:07:36.557295+0000","last_became_peered":"2024-04-26T22:07:36.557295+0000","last_unstale":"2024-04-26T22:07:37.549227+0000","last_undegraded":"2024-04-26T22:07:37.549227+0000","last_fullsized":"2024-04-26T22:07:37.549227+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:17.390596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.567605+0000","last_change":"2024-04-26T22:07:37.561842+0000","last_active":"2024-04-26T22:07:37.567605+0000","last_peered":"2024-04-26T22:07:37.567605+0000","last_clean":"2024-04-26T22:07:37.567605+0000","last_became_active":"2024-04-26T22:07:37.561565+0000","last_became_peered":"2024-04-26T22:07:37.561565+0000","last_unstale":"2024-04-26T22:07:37.567605+0000","last_undegraded":"2024-04-26T22:07:37.567605+0000","last_fullsized":"2024-04-26T22:07:37.567605+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:56.385421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.552520+0000","last_change":"2024-04-26T22:07:36.558010+0000","last_active":"2024-04-26T22:07:37.552520+0000","last_peered":"2024-04-26T22:07:37.552520+0000","last_clean":"2024-04-26T22:07:37.552520+0000","last_became_active":"2024-04-26T22:07:36.557748+0000","last_became_peered":"2024-04-26T22:07:36.557748+0000","last_unstale":"2024-04-26T22:07:37.552520+0000","last_undegraded":"2024-04-26T22:07:37.552520+0000","last_fullsized":"2024-04-26T22:07:37.552520+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:19:17.390596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.576090+0000","last_change":"2024-04-26T22:07:37.570685+0000","last_active":"2024-04-26T22:07:37.576090+0000","last_peered":"2024-04-26T22:07:37.576090+0000","last_clean":"2024-04-26T22:07:37.576090+0000","last_became_active":"2024-04-26T22:07:37.570426+0000","last_became_peered":"2024-04-26T22:07:37.570426+0000","last_unstale":"2024-04-26T22:07:37.576090+0000","last_undegraded":"2024-04-26T22:07:37.576090+0000","last_fullsized":"2024-04-26T22:07:37.576090+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:54:25.439106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.559593+0000","last_change":"2024-04-26T22:07:36.555580+0000","last_active":"2024-04-26T22:07:37.559593+0000","last_peered":"2024-04-26T22:07:37.559593+0000","last_clean":"2024-04-26T22:07:37.559593+0000","last_became_active":"2024-04-26T22:07:36.555269+0000","last_became_peered":"2024-04-26T22:07:36.555269+0000","last_unstale":"2024-04-26T22:07:37.559593+0000","last_undegraded":"2024-04-26T22:07:37.559593+0000","last_fullsized":"2024-04-26T22:07:37.559593+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:53.747914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.574041+0000","last_change":"2024-04-26T22:07:37.572505+0000","last_active":"2024-04-26T22:07:37.574041+0000","last_peered":"2024-04-26T22:07:37.574041+0000","last_clean":"2024-04-26T22:07:37.574041+0000","last_became_active":"2024-04-26T22:07:37.572211+0000","last_became_peered":"2024-04-26T22:07:37.572211+0000","last_unstale":"2024-04-26T22:07:37.574041+0000","last_undegraded":"2024-04-26T22:07:37.574041+0000","last_fullsized":"2024-04-26T22:07:37.574041+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:43.291180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"114'2","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.577112+0000","last_change":"2024-04-26T22:07:36.557678+0000","last_active":"2024-04-26T22:07:37.577112+0000","last_peered":"2024-04-26T22:07:37.577112+0000","last_clean":"2024-04-26T22:07:37.577112+0000","last_became_active":"2024-04-26T22:07:36.557419+0000","last_became_peered":"2024-04-26T22:07:36.557419+0000","last_unstale":"2024-04-26T22:07:37.577112+0000","last_undegraded":"2024-04-26T22:07:37.577112+0000","last_fullsized":"2024-04-26T22:07:37.577112+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:29:55.381163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578819+0000","last_change":"2024-04-26T22:07:37.574467+0000","last_active":"2024-04-26T22:07:37.578819+0000","last_peered":"2024-04-26T22:07:37.578819+0000","last_clean":"2024-04-26T22:07:37.578819+0000","last_became_active":"2024-04-26T22:07:37.574205+0000","last_became_peered":"2024-04-26T22:07:37.574205+0000","last_unstale":"2024-04-26T22:07:37.578819+0000","last_undegraded":"2024-04-26T22:07:37.578819+0000","last_fullsized":"2024-04-26T22:07:37.578819+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:24.487258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.562171+0000","last_change":"2024-04-26T22:07:36.554011+0000","last_active":"2024-04-26T22:07:37.562171+0000","last_peered":"2024-04-26T22:07:37.562171+0000","last_clean":"2024-04-26T22:07:37.562171+0000","last_became_active":"2024-04-26T22:07:36.553668+0000","last_became_peered":"2024-04-26T22:07:36.553668+0000","last_unstale":"2024-04-26T22:07:37.562171+0000","last_undegraded":"2024-04-26T22:07:37.562171+0000","last_fullsized":"2024-04-26T22:07:37.562171+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:17:52.417031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.578804+0000","last_change":"2024-04-26T22:07:37.573474+0000","last_active":"2024-04-26T22:07:37.578804+0000","last_peered":"2024-04-26T22:07:37.578804+0000","last_clean":"2024-04-26T22:07:37.578804+0000","last_became_active":"2024-04-26T22:07:37.571692+0000","last_became_peered":"2024-04-26T22:07:37.571692+0000","last_unstale":"2024-04-26T22:07:37.578804+0000","last_undegraded":"2024-04-26T22:07:37.578804+0000","last_fullsized":"2024-04-26T22:07:37.578804+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:42.799507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.558727+0000","last_change":"2024-04-26T22:07:36.554007+0000","last_active":"2024-04-26T22:07:37.558727+0000","last_peered":"2024-04-26T22:07:37.558727+0000","last_clean":"2024-04-26T22:07:37.558727+0000","last_became_active":"2024-04-26T22:07:36.553724+0000","last_became_peered":"2024-04-26T22:07:36.553724+0000","last_unstale":"2024-04-26T22:07:37.558727+0000","last_undegraded":"2024-04-26T22:07:37.558727+0000","last_fullsized":"2024-04-26T22:07:37.558727+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:10.712063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.572375+0000","last_change":"2024-04-26T22:07:37.569992+0000","last_active":"2024-04-26T22:07:37.572375+0000","last_peered":"2024-04-26T22:07:37.572375+0000","last_clean":"2024-04-26T22:07:37.572375+0000","last_became_active":"2024-04-26T22:07:37.569705+0000","last_became_peered":"2024-04-26T22:07:37.569705+0000","last_unstale":"2024-04-26T22:07:37.572375+0000","last_undegraded":"2024-04-26T22:07:37.572375+0000","last_fullsized":"2024-04-26T22:07:37.572375+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:33.739237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.553313+0000","last_change":"2024-04-26T22:07:36.558651+0000","last_active":"2024-04-26T22:07:37.553313+0000","last_peered":"2024-04-26T22:07:37.553313+0000","last_clean":"2024-04-26T22:07:37.553313+0000","last_became_active":"2024-04-26T22:07:36.558388+0000","last_became_peered":"2024-04-26T22:07:36.558388+0000","last_unstale":"2024-04-26T22:07:37.553313+0000","last_undegraded":"2024-04-26T22:07:37.553313+0000","last_fullsized":"2024-04-26T22:07:37.553313+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:29:42.286922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.561736+0000","last_change":"2024-04-26T22:07:37.560746+0000","last_active":"2024-04-26T22:07:37.561736+0000","last_peered":"2024-04-26T22:07:37.561736+0000","last_clean":"2024-04-26T22:07:37.561736+0000","last_became_active":"2024-04-26T22:07:37.556854+0000","last_became_peered":"2024-04-26T22:07:37.556854+0000","last_unstale":"2024-04-26T22:07:37.561736+0000","last_undegraded":"2024-04-26T22:07:37.561736+0000","last_fullsized":"2024-04-26T22:07:37.561736+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:42:04.896657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.553322+0000","last_change":"2024-04-26T22:07:36.552090+0000","last_active":"2024-04-26T22:07:37.553322+0000","last_peered":"2024-04-26T22:07:37.553322+0000","last_clean":"2024-04-26T22:07:37.553322+0000","last_became_active":"2024-04-26T22:07:36.551825+0000","last_became_peered":"2024-04-26T22:07:36.551825+0000","last_unstale":"2024-04-26T22:07:37.553322+0000","last_undegraded":"2024-04-26T22:07:37.553322+0000","last_fullsized":"2024-04-26T22:07:37.553322+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:22:46.844545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.563017+0000","last_change":"2024-04-26T22:07:37.559955+0000","last_active":"2024-04-26T22:07:37.563017+0000","last_peered":"2024-04-26T22:07:37.563017+0000","last_clean":"2024-04-26T22:07:37.563017+0000","last_became_active":"2024-04-26T22:07:37.559625+0000","last_became_peered":"2024-04-26T22:07:37.559625+0000","last_unstale":"2024-04-26T22:07:37.563017+0000","last_undegraded":"2024-04-26T22:07:37.563017+0000","last_fullsized":"2024-04-26T22:07:37.563017+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:05:19.570434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.550612+0000","last_change":"2024-04-26T22:07:36.553923+0000","last_active":"2024-04-26T22:07:37.550612+0000","last_peered":"2024-04-26T22:07:37.550612+0000","last_clean":"2024-04-26T22:07:37.550612+0000","last_became_active":"2024-04-26T22:07:36.553608+0000","last_became_peered":"2024-04-26T22:07:36.553608+0000","last_unstale":"2024-04-26T22:07:37.550612+0000","last_undegraded":"2024-04-26T22:07:37.550612+0000","last_fullsized":"2024-04-26T22:07:37.550612+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:26:12.573757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.568822+0000","last_change":"2024-04-26T22:07:37.567862+0000","last_active":"2024-04-26T22:07:37.568822+0000","last_peered":"2024-04-26T22:07:37.568822+0000","last_clean":"2024-04-26T22:07:37.568822+0000","last_became_active":"2024-04-26T22:07:37.567521+0000","last_became_peered":"2024-04-26T22:07:37.567521+0000","last_unstale":"2024-04-26T22:07:37.568822+0000","last_undegraded":"2024-04-26T22:07:37.568822+0000","last_fullsized":"2024-04-26T22:07:37.568822+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:57.056073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.549115+0000","last_change":"2024-04-26T22:07:36.556826+0000","last_active":"2024-04-26T22:07:37.549115+0000","last_peered":"2024-04-26T22:07:37.549115+0000","last_clean":"2024-04-26T22:07:37.549115+0000","last_became_active":"2024-04-26T22:07:36.556570+0000","last_became_peered":"2024-04-26T22:07:36.556570+0000","last_unstale":"2024-04-26T22:07:37.549115+0000","last_undegraded":"2024-04-26T22:07:37.549115+0000","last_fullsized":"2024-04-26T22:07:37.549115+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:33.129394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.568359+0000","last_change":"2024-04-26T22:07:37.563103+0000","last_active":"2024-04-26T22:07:37.568359+0000","last_peered":"2024-04-26T22:07:37.568359+0000","last_clean":"2024-04-26T22:07:37.568359+0000","last_became_active":"2024-04-26T22:07:37.560931+0000","last_became_peered":"2024-04-26T22:07:37.560931+0000","last_unstale":"2024-04-26T22:07:37.568359+0000","last_undegraded":"2024-04-26T22:07:37.568359+0000","last_fullsized":"2024-04-26T22:07:37.568359+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:18.184220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.559720+0000","last_change":"2024-04-26T22:07:36.555674+0000","last_active":"2024-04-26T22:07:37.559720+0000","last_peered":"2024-04-26T22:07:37.559720+0000","last_clean":"2024-04-26T22:07:37.559720+0000","last_became_active":"2024-04-26T22:07:36.555286+0000","last_became_peered":"2024-04-26T22:07:36.555286+0000","last_unstale":"2024-04-26T22:07:37.559720+0000","last_undegraded":"2024-04-26T22:07:37.559720+0000","last_fullsized":"2024-04-26T22:07:37.559720+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:36.108216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.565689+0000","last_change":"2024-04-26T22:07:37.562891+0000","last_active":"2024-04-26T22:07:37.565689+0000","last_peered":"2024-04-26T22:07:37.565689+0000","last_clean":"2024-04-26T22:07:37.565689+0000","last_became_active":"2024-04-26T22:07:37.562630+0000","last_became_peered":"2024-04-26T22:07:37.562630+0000","last_unstale":"2024-04-26T22:07:37.565689+0000","last_undegraded":"2024-04-26T22:07:37.565689+0000","last_fullsized":"2024-04-26T22:07:37.565689+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:36.534583+0000","last_clean_scrub_stamp":"2024-04-26T22:07:36.534583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:46.980260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.554652+0000","last_change":"2024-04-26T22:07:36.548520+0000","last_active":"2024-04-26T22:07:37.554652+0000","last_peered":"2024-04-26T22:07:37.554652+0000","last_clean":"2024-04-26T22:07:37.554652+0000","last_became_active":"2024-04-26T22:07:36.548219+0000","last_became_peered":"2024-04-26T22:07:36.548219+0000","last_unstale":"2024-04-26T22:07:37.554652+0000","last_undegraded":"2024-04-26T22:07:37.554652+0000","last_fullsized":"2024-04-26T22:07:37.554652+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T22:07:35.530325+0000","last_clean_scrub_stamp":"2024-04-26T22:07:35.530325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:05:25.932778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":360,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-04-26T22:07:37.552241+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:07:37.552241+0000","last_peered":"2024-04-26T22:07:37.552241+0000","last_clean":"2024-04-26T22:07:37.552241+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:07:37.552241+0000","last_undegraded":"2024-04-26T22:07:37.552241+0000","last_fullsized":"2024-04-26T22:07:37.552241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37292,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334548,"statfs":{"total":96636764160,"available":96598577152,"internally_reserved":0,"allocated":1998848,"data_stored":1198211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":1404928,"data_stored":607843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36736,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335104,"statfs":{"total":96636764160,"available":96599146496,"internally_reserved":0,"allocated":1425408,"data_stored":615222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":1404928,"data_stored":607843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1404928,"data_stored":607843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574962,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1404928,"data_stored":607843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32576,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339264,"statfs":{"total":96636764160,"available":96603406336,"internally_reserved":0,"allocated":1425408,"data_stored":614742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33132,"kb_used_data":1952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338708,"statfs":{"total":96636764160,"available":96602836992,"internally_reserved":0,"allocated":1998848,"data_stored":1198211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:07:40.867 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T22:07:40.868 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T22:07:41.008 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.009+0000 7f20f8493640 1 Processor -- start 2024-04-26T22:07:41.009 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.009+0000 7f20f8493640 1 -- start start 2024-04-26T22:07:41.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f8493640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f20f01459a0 0x7f20f00b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f8493640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20f015d030 0x7f20f00b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f8493640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f00b4480 con 0x7f20f00b6130 2024-04-26T22:07:41.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f8493640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f20f00b65a0 con 0x7f20f015d030 2024-04-26T22:07:41.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f8493640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f20f00b4760 con 0x7f20f01459a0 2024-04-26T22:07:41.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f5a2e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f20f015d030 0x7f20f00b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.010 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f6a30640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f20f00b6130 0x7f20f015fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50722/0 (socket says 172.21.15.137:50722) 2024-04-26T22:07:41.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f6a30640 1 -- 172.21.15.137:0/3727388307 learned_addr learned my addr 172.21.15.137:0/3727388307 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:41.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f622f640 1 --2- 172.21.15.137:0/3727388307 >> v2:172.21.15.170:3300/0 conn(0x7f20f01459a0 0x7f20f00b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f5a2e640 1 -- 172.21.15.137:0/3727388307 >> v2:172.21.15.170:3300/0 conn(0x7f20f01459a0 msgr2=0x7f20f00b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:41.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f5a2e640 1 --2- 172.21.15.137:0/3727388307 >> v2:172.21.15.170:3300/0 conn(0x7f20f01459a0 0x7f20f00b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f5a2e640 1 -- 172.21.15.137:0/3727388307 >> v1:172.21.15.137:6789/0 conn(0x7f20f00b6130 legacy=0x7f20f015fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f5a2e640 1 -- 172.21.15.137:0/3727388307 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f00b4a40 con 0x7f20f015d030 2024-04-26T22:07:41.011 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.010+0000 7f20f522d640 1 -- 172.21.15.137:0/3727388307 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076802309 0 0) 0x7f20f00b4480 con 0x7f20f00b6130 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.011+0000 7f20f5a2e640 1 --2- 172.21.15.137:0/3727388307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f015d030 0x7f20f00b5bf0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f20f006eb70 tx=0x7f20e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef3a4897fa35104 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.011+0000 7f20f522d640 1 -- 172.21.15.137:0/3727388307 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0037070 con 0x7f20f015d030 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.011+0000 7f20f522d640 1 -- 172.21.15.137:0/3727388307 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e0032440 con 0x7f20f015d030 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.011+0000 7f20f522d640 1 -- 172.21.15.137:0/3727388307 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e0032810 con 0x7f20f015d030 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.012+0000 7f20f8493640 1 -- 172.21.15.137:0/3727388307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f015d030 msgr2=0x7f20f00b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.012+0000 7f20f8493640 1 --2- 172.21.15.137:0/3727388307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f015d030 0x7f20f00b5bf0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f20f006eb70 tx=0x7f20e002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.012+0000 7f20f8493640 1 -- 172.21.15.137:0/3727388307 shutdown_connections 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.012+0000 7f20f8493640 1 --2- 172.21.15.137:0/3727388307 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f015d030 0x7f20f00b5bf0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.012+0000 7f20f8493640 1 --2- 172.21.15.137:0/3727388307 >> v2:172.21.15.170:3300/0 conn(0x7f20f01459a0 0x7f20f00b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.012+0000 7f20f8493640 1 -- 172.21.15.137:0/3727388307 >> 172.21.15.137:0/3727388307 conn(0x7f20f00d0d30 msgr2=0x7f20f00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.012+0000 7f20f8493640 1 -- 172.21.15.137:0/3727388307 shutdown_connections 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.012+0000 7f20f8493640 1 -- 172.21.15.137:0/3727388307 wait complete. 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.013+0000 7f20f8493640 1 Processor -- start 2024-04-26T22:07:41.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.013+0000 7f20f8493640 1 -- start start 2024-04-26T22:07:41.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.013+0000 7f20f8493640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00b6130 0x7f20f006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.013+0000 7f20f8493640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f01459a0 0x7f20f015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.013+0000 7f20f8493640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d030 0x7f20f015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.013+0000 7f20f8493640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20f015d470 con 0x7f20f00b6130 2024-04-26T22:07:41.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.013+0000 7f20f8493640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f20f00b5000 con 0x7f20f01459a0 2024-04-26T22:07:41.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f8493640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f20f0073100 con 0x7f20f015d030 2024-04-26T22:07:41.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f622f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00b6130 0x7f20f006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f622f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00b6130 0x7f20f006ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36428/0 (socket says 172.21.15.137:36428) 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f622f640 1 -- 172.21.15.137:0/2343557348 learned_addr learned my addr 172.21.15.137:0/2343557348 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f5a2e640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f01459a0 0x7f20f015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f6a30640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d030 0x7f20f015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f622f640 1 -- 172.21.15.137:0/2343557348 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d030 msgr2=0x7f20f015b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f622f640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d030 0x7f20f015b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f622f640 1 -- 172.21.15.137:0/2343557348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f01459a0 msgr2=0x7f20f015b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f622f640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f01459a0 0x7f20f015b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f622f640 1 -- 172.21.15.137:0/2343557348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f00b0890 con 0x7f20f00b6130 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f622f640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00b6130 0x7f20f006ee50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00e9b0 tx=0x7f20ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20e6ffd640 1 -- 172.21.15.137:0/2343557348 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec017070 con 0x7f20f00b6130 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20e6ffd640 1 -- 172.21.15.137:0/2343557348 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec00c9a0 con 0x7f20f00b6130 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f00b0b70 con 0x7f20f00b6130 2024-04-26T22:07:41.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20e6ffd640 1 -- 172.21.15.137:0/2343557348 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec00cd90 con 0x7f20f00b6130 2024-04-26T22:07:41.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.014+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f00b1130 con 0x7f20f00b6130 2024-04-26T22:07:41.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.015+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f00b5ef0 con 0x7f20f00b6130 2024-04-26T22:07:41.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.016+0000 7f20e6ffd640 1 -- 172.21.15.137:0/2343557348 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f20ec01a070 con 0x7f20f00b6130 2024-04-26T22:07:41.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.016+0000 7f20e6ffd640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20d406c8f0 0x7f20d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.016+0000 7f20f5a2e640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20d406c8f0 0x7f20d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.016+0000 7f20e6ffd640 1 -- 172.21.15.137:0/2343557348 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f20ec08bf20 con 0x7f20f00b6130 2024-04-26T22:07:41.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.017+0000 7f20f5a2e640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20d406c8f0 0x7f20d406edb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f20e0034000 tx=0x7f20e002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:41.020 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.021+0000 7f20e6ffd640 1 -- 172.21.15.137:0/2343557348 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f20f00b5ef0 con 0x7f20f00b6130 2024-04-26T22:07:41.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.260+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f20f006a290 con 0x7f20f00b6130 2024-04-26T22:07:41.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.262+0000 7f20e6ffd640 1 -- 172.21.15.137:0/2343557348 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f20ec05a350 con 0x7f20f00b6130 2024-04-26T22:07:41.262 INFO:teuthology.orchestra.run.smithi137.stdout:[client.0] 2024-04-26T22:07:41.262 INFO:teuthology.orchestra.run.smithi137.stdout: key = AQBZIyxmZsO7GxAAzU7FbqY+a2BnLk3i8kpvOQ== 2024-04-26T22:07:41.262 INFO:teuthology.orchestra.run.smithi137.stdout: caps mds = "allow" 2024-04-26T22:07:41.262 INFO:teuthology.orchestra.run.smithi137.stdout: caps mon = "allow r" 2024-04-26T22:07:41.262 INFO:teuthology.orchestra.run.smithi137.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T22:07:41.262 INFO:teuthology.orchestra.run.smithi137.stderr:updated caps for client.0 2024-04-26T22:07:41.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20d406c8f0 msgr2=0x7f20d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20d406c8f0 0x7f20d406edb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f20e0034000 tx=0x7f20e002e000 comp rx=0 tx=0).stop 2024-04-26T22:07:41.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00b6130 msgr2=0x7f20f006ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00b6130 0x7f20f006ee50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00e9b0 tx=0x7f20ec00ee70 comp rx=0 tx=0).stop 2024-04-26T22:07:41.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 shutdown_connections 2024-04-26T22:07:41.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f20d406c8f0 0x7f20d406edb0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20f015d030 0x7f20f015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20f01459a0 0x7f20f015b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 --2- 172.21.15.137:0/2343557348 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f20f00b6130 0x7f20f006ee50 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 >> 172.21.15.137:0/2343557348 conn(0x7f20f00d0d30 msgr2=0x7f20f00b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:41.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 shutdown_connections 2024-04-26T22:07:41.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.264+0000 7f20f8493640 1 -- 172.21.15.137:0/2343557348 wait complete. 2024-04-26T22:07:41.275 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:41.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.370+0000 7f4bb02f1640 1 Processor -- start 2024-04-26T22:07:41.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.370+0000 7f4bb02f1640 1 -- start start 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.371+0000 7f4bb02f1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4ba8160640 0x7f4ba81636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.371+0000 7f4bb02f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ba8163be0 0x7f4ba80b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.371+0000 7f4bb02f1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ba80cfa80 con 0x7f4ba8148a30 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.371+0000 7f4bb02f1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba80745e0 con 0x7f4ba8160640 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.371+0000 7f4bb02f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba80cfd60 con 0x7f4ba8163be0 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bae08d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4ba8148a30 0x7f4ba8073ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50724/0 (socket says 172.21.15.137:50724) 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bae08d640 1 -- 172.21.15.137:0/656428282 learned_addr learned my addr 172.21.15.137:0/656428282 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad88c640 1 --2- 172.21.15.137:0/656428282 >> v2:172.21.15.170:3300/0 conn(0x7f4ba8160640 0x7f4ba81636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bae88e640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ba8163be0 0x7f4ba80b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902570195 0 0) 0x7f4ba80cfa80 con 0x7f4ba8148a30 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b94003520 con 0x7f4ba8148a30 2024-04-26T22:07:41.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2697526014 0 0) 0x7f4b94003520 con 0x7f4ba8148a30 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ba8163be0 msgr2=0x7f4ba80b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ba8163be0 0x7f4ba80b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 >> v2:172.21.15.170:3300/0 conn(0x7f4ba8160640 msgr2=0x7f4ba81636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 --2- 172.21.15.137:0/656428282 >> v2:172.21.15.170:3300/0 conn(0x7f4ba8160640 0x7f4ba81636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba80d0040 con 0x7f4ba8148a30 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f4b9c001670 con 0x7f4ba8148a30 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 >> v1:172.21.15.137:6789/0 conn(0x7f4ba8148a30 legacy=0x7f4ba8073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ba8163be0 0x7f4b940039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94003f30 0x7f4b94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94004d40 0x7f4b940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba80745e0 con 0x7f4b94004d40 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba80cfd60 con 0x7f4b94003f30 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9400ba10 con 0x7f4ba8163be0 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bae88e640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94004d40 0x7f4b940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bae08d640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ba8163be0 0x7f4b940039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.372+0000 7f4bad88c640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94003f30 0x7f4b94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.373+0000 7f4bae88e640 1 -- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ba8163be0 msgr2=0x7f4b940039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.373+0000 7f4bae88e640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4ba8163be0 0x7f4b940039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.373+0000 7f4bae88e640 1 -- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94003f30 msgr2=0x7f4b94004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.373+0000 7f4bae88e640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b94003f30 0x7f4b94004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.373+0000 7f4bae88e640 1 -- 172.21.15.137:0/656428282 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b94003520 con 0x7f4b94004d40 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.373+0000 7f4bae88e640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94004d40 0x7f4b940051c0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009f90 tx=0x7f4b94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a60b9cd7f48392 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.373+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0009c10 con 0x7f4b94004d40 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.373+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba0036070 con 0x7f4b94004d40 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.373+0000 7f4bad08b640 1 -- 172.21.15.137:0/656428282 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0031850 con 0x7f4b94004d40 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.374+0000 7f4bb02f1640 1 -- 172.21.15.137:0/656428282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94004d40 msgr2=0x7f4b940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.374+0000 7f4bb02f1640 1 --2- 172.21.15.137:0/656428282 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4b94004d40 0x7f4b940051c0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009f90 tx=0x7f4b94005830 comp rx=0 tx=0).stop 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.374+0000 7f4bae88e640 1 -- 172.21.15.137:0/656428282 reap_dead start 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.374+0000 7f4bb02f1640 1 -- 172.21.15.137:0/656428282 shutdown_connections 2024-04-26T22:07:41.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.374+0000 7f4bb02f1640 1 -- 172.21.15.137:0/656428282 >> 172.21.15.137:0/656428282 conn(0x7f4ba80ce8b0 msgr2=0x7f4ba80cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:41.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.374+0000 7f4bb02f1640 1 -- 172.21.15.137:0/656428282 shutdown_connections 2024-04-26T22:07:41.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.374+0000 7f4bb02f1640 1 -- 172.21.15.137:0/656428282 wait complete. 2024-04-26T22:07:41.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.375+0000 7f4bb02f1640 1 Processor -- start 2024-04-26T22:07:41.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.375+0000 7f4bb02f1640 1 -- start start 2024-04-26T22:07:41.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bb02f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b94004d40 0x7f4ba80cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bb02f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ba806f5d0 0x7f4ba806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bb02f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba81f8440 0x7f4ba81f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bb02f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8148e10 con 0x7f4ba81f8440 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bb02f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8163180 con 0x7f4ba806f5d0 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bb02f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba8148f90 con 0x7f4b94004d40 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae88e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba81f8440 0x7f4ba81f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae88e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba81f8440 0x7f4ba81f88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36434/0 (socket says 172.21.15.137:36434) 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae88e640 1 -- 172.21.15.137:0/3643249356 learned_addr learned my addr 172.21.15.137:0/3643249356 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae08d640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b94004d40 0x7f4ba80cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bad88c640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ba806f5d0 0x7f4ba806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae88e640 1 -- 172.21.15.137:0/3643249356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b94004d40 msgr2=0x7f4ba80cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae88e640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b94004d40 0x7f4ba80cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae88e640 1 -- 172.21.15.137:0/3643249356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ba806f5d0 msgr2=0x7f4ba806fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae88e640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ba806f5d0 0x7f4ba806fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae88e640 1 -- 172.21.15.137:0/3643249356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba81f8e00 con 0x7f4ba81f8440 2024-04-26T22:07:41.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bad88c640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ba806f5d0 0x7f4ba806fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.376+0000 7f4bae88e640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba81f8440 0x7f4ba81f88c0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009f90 tx=0x7f4ba0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.377+0000 7f4b9affd640 1 -- 172.21.15.137:0/3643249356 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0009c10 con 0x7f4ba81f8440 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.377+0000 7f4b9affd640 1 -- 172.21.15.137:0/3643249356 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba0003990 con 0x7f4ba81f8440 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.377+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba81f9090 con 0x7f4ba81f8440 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.377+0000 7f4b9affd640 1 -- 172.21.15.137:0/3643249356 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0003d80 con 0x7f4ba81f8440 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.377+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba80b5bd0 con 0x7f4ba81f8440 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.378+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba806a290 con 0x7f4ba81f8440 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.378+0000 7f4b9affd640 1 -- 172.21.15.137:0/3643249356 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ba0005d10 con 0x7f4ba81f8440 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.378+0000 7f4b9affd640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b8c06c8f0 0x7f4b8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.379+0000 7f4b9affd640 1 -- 172.21.15.137:0/3643249356 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f4ba00ad260 con 0x7f4ba81f8440 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.379+0000 7f4bae08d640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b8c06c8f0 0x7f4b8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:41.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.379+0000 7f4bae08d640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b8c06c8f0 0x7f4b8c06edb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c001050 tx=0x7f4b9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:41.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.383+0000 7f4b9affd640 1 -- 172.21.15.137:0/3643249356 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4ba004a060 con 0x7f4ba81f8440 2024-04-26T22:07:41.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.594+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ba81431e0 con 0x7f4ba81f8440 2024-04-26T22:07:41.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.594+0000 7f4b9affd640 1 -- 172.21.15.137:0/3643249356 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5195 (secure 0 0 0) 0x7f4ba002e050 con 0x7f4ba81f8440 2024-04-26T22:07:41.595 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:41.595 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":81,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/2830617564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2830617564},{"type":"v1","addr":"172.21.15.137:6837","nonce":2830617564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:07:38.897715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8871},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8871":{"gid":8871,"name":"b","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.170:6834/1666946913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":1666946913},{"type":"v1","addr":"172.21.15.170:6834","nonce":1666946913}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8871,"qdb_cluster":[8871]},"id":8}]} 2024-04-26T22:07:41.595 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 81 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.596+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b8c06c8f0 msgr2=0x7f4b8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.596+0000 7f4bb02f1640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b8c06c8f0 0x7f4b8c06edb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c001050 tx=0x7f4b9c009040 comp rx=0 tx=0).stop 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.596+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba81f8440 msgr2=0x7f4ba81f88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.596+0000 7f4bb02f1640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba81f8440 0x7f4ba81f88c0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009f90 tx=0x7f4ba0009750 comp rx=0 tx=0).stop 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.596+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 shutdown_connections 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.596+0000 7f4bb02f1640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4b8c06c8f0 0x7f4b8c06edb0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.596+0000 7f4bb02f1640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4ba81f8440 0x7f4ba81f88c0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.596+0000 7f4bb02f1640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ba806f5d0 0x7f4ba806fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.596+0000 7f4bb02f1640 1 --2- 172.21.15.137:0/3643249356 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4b94004d40 0x7f4ba80cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.597+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 >> 172.21.15.137:0/3643249356 conn(0x7f4ba80ce8b0 msgr2=0x7f4ba80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:41.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.597+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 shutdown_connections 2024-04-26T22:07:41.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:41.597+0000 7f4bb02f1640 1 -- 172.21.15.137:0/3643249356 wait complete. 2024-04-26T22:07:42.010 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:07:36.895650+0000', 'modified': '2024-04-26T22:07:38.897715+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8871}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8871': {'gid': 8871, 'name': 'b', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.170:6834/1666946913', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6832', 'nonce': 1666946913}, {'type': 'v1', 'addr': '172.21.15.170:6834', 'nonce': 1666946913}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8871, 'qdb_cluster': [8871]} 2024-04-26T22:07:42.010 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:07:42.010 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T22:07:42.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.111+0000 7fb927f40640 1 Processor -- start 2024-04-26T22:07:42.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.111+0000 7fb927f40640 1 -- start start 2024-04-26T22:07:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb927f40640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb9200b44e0 0x7fb92006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb927f40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006d2b0 0x7fb92006d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb927f40640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9200b4a10 con 0x7fb92015f1e0 2024-04-26T22:07:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb927f40640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb92006eeb0 con 0x7fb9200b44e0 2024-04-26T22:07:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb927f40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb9200b4cf0 con 0x7fb92006d2b0 2024-04-26T22:07:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb9254db640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb9200b44e0 0x7fb92006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb9254db640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb9200b44e0 0x7fb92006e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36440/0 (socket says 172.21.15.137:36440) 2024-04-26T22:07:42.112 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb9254db640 1 -- 172.21.15.137:0/3792918108 learned_addr learned my addr 172.21.15.137:0/3792918108 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:42.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb9264dd640 1 --2- 172.21.15.137:0/3792918108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006d2b0 0x7fb92006d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb9254db640 1 -- 172.21.15.137:0/3792918108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006d2b0 msgr2=0x7fb92006d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb9254db640 1 --2- 172.21.15.137:0/3792918108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006d2b0 0x7fb92006d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb9254db640 1 -- 172.21.15.137:0/3792918108 >> v1:172.21.15.170:6789/0 conn(0x7fb92015f1e0 legacy=0x7fb9200ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb9254db640 1 -- 172.21.15.137:0/3792918108 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9200b4fd0 con 0x7fb9200b44e0 2024-04-26T22:07:42.113 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.112+0000 7fb9264dd640 1 --2- 172.21.15.137:0/3792918108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006d2b0 0x7fb92006d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:42.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb9254db640 1 --2- 172.21.15.137:0/3792918108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200b44e0 0x7fb92006e970 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fb910009870 tx=0x7fb91002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33faa72e4a2e34c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb924cda640 1 -- 172.21.15.137:0/3792918108 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910037070 con 0x7fb9200b44e0 2024-04-26T22:07:42.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb924cda640 1 -- 172.21.15.137:0/3792918108 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb910032440 con 0x7fb9200b44e0 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb924cda640 1 -- 172.21.15.137:0/3792918108 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910032810 con 0x7fb9200b44e0 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb927f40640 1 -- 172.21.15.137:0/3792918108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200b44e0 msgr2=0x7fb92006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb927f40640 1 --2- 172.21.15.137:0/3792918108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200b44e0 0x7fb92006e970 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fb910009870 tx=0x7fb91002a270 comp rx=0 tx=0).stop 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb927f40640 1 -- 172.21.15.137:0/3792918108 shutdown_connections 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb927f40640 1 --2- 172.21.15.137:0/3792918108 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92006d2b0 0x7fb92006d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb927f40640 1 --2- 172.21.15.137:0/3792918108 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb9200b44e0 0x7fb92006e970 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.113+0000 7fb927f40640 1 -- 172.21.15.137:0/3792918108 >> 172.21.15.137:0/3792918108 conn(0x7fb9200728a0 msgr2=0x7fb920072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.114+0000 7fb927f40640 1 -- 172.21.15.137:0/3792918108 shutdown_connections 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.114+0000 7fb927f40640 1 -- 172.21.15.137:0/3792918108 wait complete. 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb927f40640 1 Processor -- start 2024-04-26T22:07:42.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb927f40640 1 -- start start 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb927f40640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92006d2b0 0x7fb9201431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb927f40640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9200b44e0 0x7fb920161c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb927f40640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92015f1e0 0x7fb920144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb927f40640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb92015f5c0 con 0x7fb92006d2b0 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb927f40640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb9200b5590 con 0x7fb9200b44e0 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb927f40640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb920144630 con 0x7fb92015f1e0 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb925cdc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92006d2b0 0x7fb9201431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb925cdc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92006d2b0 0x7fb9201431d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36448/0 (socket says 172.21.15.137:36448) 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.115+0000 7fb925cdc640 1 -- 172.21.15.137:0/1692002097 learned_addr learned my addr 172.21.15.137:0/1692002097 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:42.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb9254db640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9200b44e0 0x7fb920161c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb9264dd640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92015f1e0 0x7fb920144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb925cdc640 1 -- 172.21.15.137:0/1692002097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92015f1e0 msgr2=0x7fb920144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb925cdc640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92015f1e0 0x7fb920144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb925cdc640 1 -- 172.21.15.137:0/1692002097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9200b44e0 msgr2=0x7fb920161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb925cdc640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9200b44e0 0x7fb920161c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb925cdc640 1 -- 172.21.15.137:0/1692002097 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb920143a20 con 0x7fb92006d2b0 2024-04-26T22:07:42.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb925cdc640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92006d2b0 0x7fb9201431d0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c3f0 tx=0x7fb91c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb9167fc640 1 -- 172.21.15.137:0/1692002097 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0052d0 con 0x7fb92006d2b0 2024-04-26T22:07:42.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb9167fc640 1 -- 172.21.15.137:0/1692002097 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c005490 con 0x7fb92006d2b0 2024-04-26T22:07:42.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb927f40640 1 -- 172.21.15.137:0/1692002097 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb920143d00 con 0x7fb92006d2b0 2024-04-26T22:07:42.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb9167fc640 1 -- 172.21.15.137:0/1692002097 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c007260 con 0x7fb92006d2b0 2024-04-26T22:07:42.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.116+0000 7fb927f40640 1 -- 172.21.15.137:0/1692002097 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9201442c0 con 0x7fb92006d2b0 2024-04-26T22:07:42.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.118+0000 7fb9167fc640 1 -- 172.21.15.137:0/1692002097 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb91c007400 con 0x7fb92006d2b0 2024-04-26T22:07:42.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.118+0000 7fb9167fc640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb90406c8f0 0x7fb90406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.118+0000 7fb9167fc640 1 -- 172.21.15.137:0/1692002097 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fb91c08aff0 con 0x7fb92006d2b0 2024-04-26T22:07:42.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.118+0000 7fb9254db640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb90406c8f0 0x7fb90406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.118+0000 7fb9254db640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb90406c8f0 0x7fb90406edb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb910034000 tx=0x7fb91002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.119+0000 7fb92ac59740 1 Processor -- start 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.119+0000 7fb92ac59740 1 -- start start 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 0x558a3acd5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acf3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acab120 0x558a3acf13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb92ac59740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a3ac0f740 con 0x558a3acab120 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb92ac59740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a3abab3a0 con 0x558a3acf2ce0 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb92ac59740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a3ac0b700 con 0x558a3acd5440 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9264dd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acab120 0x558a3acf13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9264dd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acab120 0x558a3acf13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36458/0 (socket says 172.21.15.137:36458) 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9264dd640 1 -- 172.21.15.137:0/3651680685 learned_addr learned my addr 172.21.15.137:0/3651680685 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb925cdc640 1 --2- 172.21.15.137:0/3651680685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 0x558a3acd5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9254db640 1 --2- 172.21.15.137:0/3651680685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acf3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9264dd640 1 -- 172.21.15.137:0/3651680685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 msgr2=0x558a3acd5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9264dd640 1 --2- 172.21.15.137:0/3651680685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 0x558a3acd5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9264dd640 1 -- 172.21.15.137:0/3651680685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 msgr2=0x558a3acf3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9264dd640 1 --2- 172.21.15.137:0/3651680685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acf3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9264dd640 1 -- 172.21.15.137:0/3651680685 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a3abc7750 con 0x558a3acab120 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9264dd640 1 --2- 172.21.15.137:0/3651680685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acab120 0x558a3acf13a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fb9180074e0 tx=0x7fb9180079a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4677dfb7b65d99f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9037fe640 1 -- 172.21.15.137:0/3651680685 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91801a020 con 0x558a3acab120 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9037fe640 1 -- 172.21.15.137:0/3651680685 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb918015850 con 0x558a3acab120 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.120+0000 7fb9037fe640 1 -- 172.21.15.137:0/3651680685 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918015c40 con 0x558a3acab120 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.121+0000 7fb92ac59740 1 -- 172.21.15.137:0/3651680685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acab120 msgr2=0x558a3acf13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.121+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3651680685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acab120 0x558a3acf13a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fb9180074e0 tx=0x7fb9180079a0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.121+0000 7fb92ac59740 1 -- 172.21.15.137:0/3651680685 shutdown_connections 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.121+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3651680685 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acab120 0x558a3acf13a0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.121+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3651680685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acf3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.121+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3651680685 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 0x558a3acd5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.121+0000 7fb92ac59740 1 -- 172.21.15.137:0/3651680685 >> 172.21.15.137:0/3651680685 conn(0x558a3aca7a50 msgr2=0x558a3acf0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.121+0000 7fb92ac59740 1 -- 172.21.15.137:0/3651680685 shutdown_connections 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.121+0000 7fb92ac59740 1 -- 172.21.15.137:0/3651680685 wait complete. 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.122+0000 7fb92ac59740 1 -- start start 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.122+0000 7fb92ac59740 1 Processor -- start 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acd5440 0x558a3acecc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acf2ce0 0x558a3acef410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acebb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb92ac59740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a3acabec0 con 0x558a3aceb6c0 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb92ac59740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a3ab96fe0 con 0x558a3acd5440 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb92ac59740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a3aca5980 con 0x558a3acf2ce0 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb92ac59740 10 client.0 _ll_register_callbacks cb 0x558a3abad150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:42.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9264dd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acebb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9264dd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acebb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36466/0 (socket says 172.21.15.137:36466) 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9264dd640 1 -- 172.21.15.137:0/3713980772 learned_addr learned my addr 172.21.15.137:0/3713980772 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9254db640 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acf2ce0 0x558a3acef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb925cdc640 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acd5440 0x558a3acecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9264dd640 1 -- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acf2ce0 msgr2=0x558a3acef410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9264dd640 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acf2ce0 0x558a3acef410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9264dd640 1 -- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acd5440 msgr2=0x558a3acecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9264dd640 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acd5440 0x558a3acecc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9264dd640 1 -- 172.21.15.137:0/3713980772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a3a9212d0 con 0x558a3aceb6c0 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9254db640 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acf2ce0 0x558a3acef410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb9264dd640 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acebb00 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fb918019040 tx=0x7fb918004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa10499e7e641ef3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb900ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb900ff9640 1 -- 172.21.15.137:0/3713980772 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91801a040 con 0x558a3aceb6c0 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb900ff9640 1 -- 172.21.15.137:0/3713980772 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fb91802aaa0 con 0x558a3aceb6c0 2024-04-26T22:07:42.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb92ac59740 1 -- 172.21.15.137:0/3713980772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb918015850 con 0x558a3aceb6c0 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb900ff9640 1 -- 172.21.15.137:0/3713980772 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fb91802ace0 con 0x558a3aceb6c0 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.123+0000 7fb92ac59740 10 client.8994 fetch_fsmap learned FSMap version 81 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb92ac59740 1 -- 172.21.15.137:0/3713980772 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x558a3a9eb6b0 con 0x558a3aceb6c0 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb900ff9640 1 -- 172.21.15.137:0/3713980772 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb918015850 con 0x558a3aceb6c0 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb900ff9640 1 -- 172.21.15.137:0/3713980772 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7fb91801f630 con 0x558a3aceb6c0 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb92ac59740 10 client.8994 fetch_fsmap finished waiting for FSMap version 81 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb92ac59740 10 client.8994 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb92ac59740 20 client.8994 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x558a3ace9ec0 0x558a3ad03b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb92ac59740 4 client.8994 mds_command: new command op to 8871 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb92ac59740 1 -- 172.21.15.137:0/3713980772 --> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a3ac1d350 con 0x558a3ace9ec0 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb925cdc640 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x558a3ace9ec0 0x558a3ad03b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb925cdc640 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x558a3ace9ec0 0x558a3ad03b20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c32febc2f182066c server_cookie=d9da24b199d92168 in_seq=0 out_seq=0 2024-04-26T22:07:42.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.124+0000 7fb900ff9640 10 client.8994 ms_handle_connect on v2:172.21.15.170:6832/1666946913 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb900ff9640 1 -- 172.21.15.137:0/3713980772 <== mds.0 v2:172.21.15.170:6832/1666946913 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558a3ac1d350 con 0x558a3ace9ec0 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb900ff9640 10 client.8994 handle_command_reply: tid=0 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb92ac59740 1 client.8994 shutdown 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb92ac59740 1 -- 172.21.15.137:0/3713980772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 msgr2=0x558a3acebb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acebb00 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fb918019040 tx=0x7fb918004ab0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb92ac59740 1 -- 172.21.15.137:0/3713980772 shutdown_connections 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acebb00 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x558a3ace9ec0 0x558a3ad03b20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acf2ce0 0x558a3acef410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb92ac59740 1 --2- 172.21.15.137:0/3713980772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acd5440 0x558a3acecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb900ff9640 0 client.8994 ms_handle_reset on v2:172.21.15.170:6832/1666946913 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.125+0000 7fb92ac59740 1 -- 172.21.15.137:0/3713980772 >> 172.21.15.137:0/3713980772 conn(0x558a3acab120 msgr2=0x558a3acf4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.126+0000 7fb92ac59740 1 -- 172.21.15.137:0/3713980772 shutdown_connections 2024-04-26T22:07:42.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.126+0000 7fb92ac59740 1 -- 172.21.15.137:0/3713980772 wait complete. 2024-04-26T22:07:42.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.126+0000 7fb92ac59740 20 client.8994 trim_cache size 0 max 16384 2024-04-26T22:07:42.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.143+0000 7fb92ac59740 1 Processor -- start 2024-04-26T22:07:42.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.143+0000 7fb92ac59740 1 -- start start 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 0x558a3ad6c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acedd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb92ac59740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb920200a10 con 0x558a3aceb6c0 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb92ac59740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb92015c8a0 con 0x558a3acf2ce0 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb92ac59740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb92015cef0 con 0x558a3acd5440 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb9254db640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acedd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb9254db640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acedd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36482/0 (socket says 172.21.15.137:36482) 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb9254db640 1 -- 172.21.15.137:0/1211139943 learned_addr learned my addr 172.21.15.137:0/1211139943 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb925cdc640 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 0x558a3ad6c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb9264dd640 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb9254db640 1 -- 172.21.15.137:0/1211139943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 msgr2=0x558a3ad6c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.146 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb9254db640 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 0x558a3ad6c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb9254db640 1 -- 172.21.15.137:0/1211139943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 msgr2=0x558a3acab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.144+0000 7fb9254db640 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb9254db640 1 -- 172.21.15.137:0/1211139943 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a3acff550 con 0x558a3aceb6c0 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb9264dd640 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb9254db640 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acedd70 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fb910000c00 tx=0x7fb91002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cadc9b9b876dcd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb902ffd640 1 -- 172.21.15.137:0/1211139943 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910037040 con 0x558a3aceb6c0 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb902ffd640 1 -- 172.21.15.137:0/1211139943 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb910032c30 con 0x558a3aceb6c0 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb902ffd640 1 -- 172.21.15.137:0/1211139943 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91003c440 con 0x558a3aceb6c0 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb92ac59740 1 -- 172.21.15.137:0/1211139943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 msgr2=0x558a3acedd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb92ac59740 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acedd70 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fb910000c00 tx=0x7fb91002c000 comp rx=0 tx=0).stop 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb92ac59740 1 -- 172.21.15.137:0/1211139943 shutdown_connections 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb92ac59740 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3aceb6c0 0x558a3acedd70 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb92ac59740 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.147 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb92ac59740 1 --2- 172.21.15.137:0/1211139943 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3acd5440 0x558a3ad6c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb92ac59740 1 -- 172.21.15.137:0/1211139943 >> 172.21.15.137:0/1211139943 conn(0x558a3acab120 msgr2=0x558a3ad0a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:42.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb92ac59740 1 -- 172.21.15.137:0/1211139943 shutdown_connections 2024-04-26T22:07:42.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.145+0000 7fb92ac59740 1 -- 172.21.15.137:0/1211139943 wait complete. 2024-04-26T22:07:42.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.146+0000 7fb92ac59740 1 -- start start 2024-04-26T22:07:42.148 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.146+0000 7fb92ac59740 1 Processor -- start 2024-04-26T22:07:42.151 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acd5440 0x558a3ad06ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3aceb6c0 0x558a3acd43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb92ac59740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acd48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb92ac59740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x558a3acec0c0 con 0x558a3acd5440 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb92ac59740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x558a3ace7d00 con 0x558a3acf2ce0 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb92ac59740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x558a3acef9a0 con 0x558a3aceb6c0 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb92ac59740 10 client.0 _ll_register_callbacks cb 0x7fb918007330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb925cdc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acd5440 0x558a3ad06ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb925cdc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acd5440 0x558a3ad06ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36498/0 (socket says 172.21.15.137:36498) 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb925cdc640 1 -- 172.21.15.137:0/735681811 learned_addr learned my addr 172.21.15.137:0/735681811 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb9264dd640 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acd48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb9254db640 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3aceb6c0 0x558a3acd43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb925cdc640 1 -- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3aceb6c0 msgr2=0x558a3acd43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb925cdc640 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3aceb6c0 0x558a3acd43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb925cdc640 1 -- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 msgr2=0x558a3acd48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb925cdc640 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acd48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb925cdc640 1 -- 172.21.15.137:0/735681811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a3ace5d80 con 0x558a3acd5440 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.147+0000 7fb9264dd640 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acd48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb925cdc640 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acd5440 0x558a3ad06ba0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fb91c058cd0 tx=0x7fb91c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa20646ee0f8afe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb900ff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb900ff9640 1 -- 172.21.15.137:0/735681811 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c061470 con 0x558a3acd5440 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb900ff9640 1 -- 172.21.15.137:0/735681811 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fb91c061610 con 0x558a3acd5440 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb92ac59740 1 -- 172.21.15.137:0/735681811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb910032c30 con 0x558a3acd5440 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb900ff9640 1 -- 172.21.15.137:0/735681811 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fb91c058190 con 0x558a3acd5440 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb92ac59740 10 client.9000 fetch_fsmap learned FSMap version 81 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb92ac59740 1 -- 172.21.15.137:0/735681811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x558a3ace6620 con 0x558a3acd5440 2024-04-26T22:07:42.153 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb900ff9640 1 -- 172.21.15.137:0/735681811 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb910032c30 con 0x558a3acd5440 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb900ff9640 1 -- 172.21.15.137:0/735681811 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7fb91c058330 con 0x558a3acd5440 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb92ac59740 10 client.9000 fetch_fsmap finished waiting for FSMap version 81 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb92ac59740 10 client.9000 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb92ac59740 20 client.9000 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb92ac59740 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x558a3ad02f60 0x558a3acea6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb92ac59740 4 client.9000 mds_command: new command op to 8871 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb92ac59740 1 -- 172.21.15.137:0/735681811 --> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] -- command(tid 0: {"prefix": "status"}) -- 0x558a3ac171c0 con 0x558a3ad02f60 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.148+0000 7fb9254db640 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x558a3ad02f60 0x558a3acea6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb900ff9640 10 client.9000 ms_handle_connect on v2:172.21.15.170:6832/1666946913 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb9254db640 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x558a3ad02f60 0x558a3acea6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccd64b8c5e9e1eb7 server_cookie=3e014ab6959c00cd in_seq=0 out_seq=0 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb900ff9640 1 -- 172.21.15.137:0/735681811 <== mds.0 v2:172.21.15.170:6832/1666946913 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x558a3ac171c0 con 0x558a3ad02f60 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb900ff9640 10 client.9000 handle_command_reply: tid=0 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 client.9000 shutdown 2024-04-26T22:07:42.154 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 -- 172.21.15.137:0/735681811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acd5440 msgr2=0x558a3ad06ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acd5440 0x558a3ad06ba0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fb91c058cd0 tx=0x7fb91c00cee0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 -- 172.21.15.137:0/735681811 shutdown_connections 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x558a3ad02f60 0x558a3acea6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558a3acf2ce0 0x558a3acd48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x558a3aceb6c0 0x558a3acd43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 --2- 172.21.15.137:0/735681811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x558a3acd5440 0x558a3ad06ba0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb900ff9640 0 client.9000 ms_handle_reset on v2:172.21.15.170:6832/1666946913 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 -- 172.21.15.137:0/735681811 >> 172.21.15.137:0/735681811 conn(0x558a3acab120 msgr2=0x558a3aceca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 -- 172.21.15.137:0/735681811 shutdown_connections 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 1 -- 172.21.15.137:0/735681811 wait complete. 2024-04-26T22:07:42.155 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.149+0000 7fb92ac59740 20 client.9000 trim_cache size 0 max 16384 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 8871, 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.5937502459999999, 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 81, 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 115, 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 115, 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 9.6231689219999996 2024-04-26T22:07:42.156 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:07:42.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 -- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb90406c8f0 msgr2=0x7fb90406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb90406c8f0 0x7fb90406edb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb910034000 tx=0x7fb91002e000 comp rx=0 tx=0).stop 2024-04-26T22:07:42.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 -- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92006d2b0 msgr2=0x7fb9201431d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92006d2b0 0x7fb9201431d0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00c3f0 tx=0x7fb91c00c8b0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 -- 172.21.15.137:0/1692002097 shutdown_connections 2024-04-26T22:07:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb90406c8f0 0x7fb90406edb0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb92015f1e0 0x7fb920144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9200b44e0 0x7fb920161c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 --2- 172.21.15.137:0/1692002097 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb92006d2b0 0x7fb9201431d0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 -- 172.21.15.137:0/1692002097 >> 172.21.15.137:0/1692002097 conn(0x7fb9200728a0 msgr2=0x7fb9201633a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 -- 172.21.15.137:0/1692002097 shutdown_connections 2024-04-26T22:07:42.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.150+0000 7fb927f40640 1 -- 172.21.15.137:0/1692002097 wait complete. 2024-04-26T22:07:42.160 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:07:42.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.257+0000 7f3235262640 1 Processor -- start 2024-04-26T22:07:42.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.257+0000 7f3235262640 1 -- start start 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f3235262640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32300d3ee0 0x7f32300cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f3235262640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f323015f750 0x7f32300b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f3235262640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32300d03a0 con 0x7f323015f370 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f3235262640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f32300b4d10 con 0x7f323015f750 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f3235262640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f32300d0680 con 0x7f32300d3ee0 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f322f7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f323015f750 0x7f32300b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f322effd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f323015f370 0x7f32300d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50740/0 (socket says 172.21.15.137:50740) 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f322effd640 1 -- 172.21.15.137:0/4216127824 learned_addr learned my addr 172.21.15.137:0/4216127824 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f3227fff640 1 --2- 172.21.15.137:0/4216127824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32300d3ee0 0x7f32300cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f322f7fe640 1 -- 172.21.15.137:0/4216127824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32300d3ee0 msgr2=0x7f32300cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f322f7fe640 1 --2- 172.21.15.137:0/4216127824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32300d3ee0 0x7f32300cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f322f7fe640 1 -- 172.21.15.137:0/4216127824 >> v1:172.21.15.137:6789/0 conn(0x7f323015f370 legacy=0x7f32300d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f322f7fe640 1 -- 172.21.15.137:0/4216127824 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32300d0960 con 0x7f323015f750 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.258+0000 7f322e7fc640 1 -- 172.21.15.137:0/4216127824 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455963267 0 0) 0x7f32300d03a0 con 0x7f323015f370 2024-04-26T22:07:42.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.259+0000 7f322f7fe640 1 --2- 172.21.15.137:0/4216127824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f750 0x7f32300b47d0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f3228009d90 tx=0x7f322802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642d0841003f54ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.259+0000 7f322e7fc640 1 -- 172.21.15.137:0/4216127824 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228007740 con 0x7f323015f750 2024-04-26T22:07:42.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.259+0000 7f322e7fc640 1 -- 172.21.15.137:0/4216127824 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280078e0 con 0x7f323015f750 2024-04-26T22:07:42.260 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.259+0000 7f322e7fc640 1 -- 172.21.15.137:0/4216127824 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228007cb0 con 0x7f323015f750 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.260+0000 7f3235262640 1 -- 172.21.15.137:0/4216127824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f750 msgr2=0x7f32300b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.260+0000 7f3235262640 1 --2- 172.21.15.137:0/4216127824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f750 0x7f32300b47d0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f3228009d90 tx=0x7f322802a660 comp rx=0 tx=0).stop 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.260+0000 7f3235262640 1 -- 172.21.15.137:0/4216127824 shutdown_connections 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.260+0000 7f3235262640 1 --2- 172.21.15.137:0/4216127824 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f750 0x7f32300b47d0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.260+0000 7f3235262640 1 --2- 172.21.15.137:0/4216127824 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f32300d3ee0 0x7f32300cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.260+0000 7f3235262640 1 -- 172.21.15.137:0/4216127824 >> 172.21.15.137:0/4216127824 conn(0x7f323008ec10 msgr2=0x7f323009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.260+0000 7f3235262640 1 -- 172.21.15.137:0/4216127824 shutdown_connections 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.260+0000 7f3235262640 1 -- 172.21.15.137:0/4216127824 wait complete. 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.261+0000 7f3235262640 1 Processor -- start 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.261+0000 7f3235262640 1 -- start start 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.261+0000 7f3235262640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32300d3ee0 0x7f323015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3235262640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f370 0x7f32300babb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3235262640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f323015f750 0x7f32300ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3235262640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f32300b51c0 con 0x7f323015f370 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3235262640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f32300d0f20 con 0x7f32300d3ee0 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3235262640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f32300b5340 con 0x7f323015f750 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3227fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f370 0x7f32300babb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3227fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f370 0x7f32300babb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36526/0 (socket says 172.21.15.137:36526) 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3227fff640 1 -- 172.21.15.137:0/3619856996 learned_addr learned my addr 172.21.15.137:0/3619856996 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f322effd640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32300d3ee0 0x7f323015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3227fff640 1 -- 172.21.15.137:0/3619856996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f323015f750 msgr2=0x7f32300ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f322f7fe640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f323015f750 0x7f32300ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3227fff640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f323015f750 0x7f32300ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3227fff640 1 -- 172.21.15.137:0/3619856996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32300d3ee0 msgr2=0x7f323015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3227fff640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32300d3ee0 0x7f323015cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3227fff640 1 -- 172.21.15.137:0/3619856996 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32300bb0f0 con 0x7f323015f370 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3227fff640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f370 0x7f32300babb0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f321800d830 tx=0x7f321800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.264 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f32277fe640 1 -- 172.21.15.137:0/3619856996 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321800b6c0 con 0x7f323015f370 2024-04-26T22:07:42.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f32277fe640 1 -- 172.21.15.137:0/3619856996 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3218019070 con 0x7f323015f370 2024-04-26T22:07:42.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32300c96c0 con 0x7f323015f370 2024-04-26T22:07:42.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f32277fe640 1 -- 172.21.15.137:0/3619856996 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321800ba80 con 0x7f323015f370 2024-04-26T22:07:42.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.262+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32300c9c70 con 0x7f323015f370 2024-04-26T22:07:42.265 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.263+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f323006a290 con 0x7f323015f370 2024-04-26T22:07:42.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.264+0000 7f32277fe640 1 -- 172.21.15.137:0/3619856996 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f321801e460 con 0x7f323015f370 2024-04-26T22:07:42.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.264+0000 7f32277fe640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f321006c8f0 0x7f321006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:42.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.264+0000 7f32277fe640 1 -- 172.21.15.137:0/3619856996 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f321808c230 con 0x7f323015f370 2024-04-26T22:07:42.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.264+0000 7f322effd640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f321006c8f0 0x7f321006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:42.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.265+0000 7f322effd640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f321006c8f0 0x7f321006edb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3220000f60 tx=0x7f3220009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:42.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.269+0000 7f32277fe640 1 -- 172.21.15.137:0/3619856996 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f32300bb0f0 con 0x7f323015f370 2024-04-26T22:07:42.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.482+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f32300d56b0 con 0x7f323015f370 2024-04-26T22:07:42.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.483+0000 7f32277fe640 1 -- 172.21.15.137:0/3619856996 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) ==== 53+0+73 (secure 0 0 0) 0x7f321805a660 con 0x7f323015f370 2024-04-26T22:07:42.483 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.484+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f321006c8f0 msgr2=0x7f321006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.484+0000 7f3235262640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f321006c8f0 0x7f321006edb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3220000f60 tx=0x7f3220009040 comp rx=0 tx=0).stop 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.484+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f370 msgr2=0x7f32300babb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.484+0000 7f3235262640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f370 0x7f32300babb0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f321800d830 tx=0x7f321800dcf0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.485+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 shutdown_connections 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.485+0000 7f3235262640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f321006c8f0 0x7f321006edb0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.485+0000 7f3235262640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f323015f370 0x7f32300babb0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.485+0000 7f3235262640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f323015f750 0x7f32300ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.485+0000 7f3235262640 1 --2- 172.21.15.137:0/3619856996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32300d3ee0 0x7f323015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.485+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 >> 172.21.15.137:0/3619856996 conn(0x7f323008ec10 msgr2=0x7f323006da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.485+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 shutdown_connections 2024-04-26T22:07:42.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42.485+0000 7f3235262640 1 -- 172.21.15.137:0/3619856996 wait complete. 2024-04-26T22:07:42.495 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:07:42.496 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:07:42.496 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:07:42.496 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:07:42.496 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:42.496 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:07:42.496 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:07:42.496 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:07:42.496 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:07:42.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:42.496 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:07:42.511 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:07:42.511 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:07:42.511 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:07:42.511 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:42.512 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42244sec preferred_lft 42244sec 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:42.513 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:07:42.514 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:07:42.514 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:07:42.514 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:42.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:42.514 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:07:42.574 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:07:42.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:42.575 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:07:42.632 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:07:42.632 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:07:42.632 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:07:42.632 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:07:42.632 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:07:42.633 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:07:42.633 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:07:42.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:07:42.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:07:42.633 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:07:42.633 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:07:42.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:07:42.750 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:42.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:42.757 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:07:42.771 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:07:42.771 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:07:42.771 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:07:42.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:42.772 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:07:42.832 INFO:tasks.ceph.mds.b.smithi170.stderr:2024-04-26T22:07:42.833+0000 7f10a5148640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:07:42.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:07:42.835 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:42.890 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:07:42.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:07:42.890 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:42.947 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:07:42.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:42.947 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:07:43.029 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:07:43.029 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:07:43.036 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:07:43.036 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:07:43.036 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:07:43.037 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:07:43.037 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:07:43.037 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:07:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:07:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:07:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:07:43.037 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:07:43.039 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:07:43.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:43.039 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:43.104 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:07:43.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:07:43.199 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:43.205 INFO:teuthology.orchestra.run.smithi137.stdout:client6734 2024-04-26T22:07:43.206 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:43.206 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:43.222 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:43.222 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:43.222 DEBUG:teuthology.orchestra.run.smithi137:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T22:07:43.222 DEBUG:teuthology.orchestra.run.smithi137:> parent = os.path.join(mount_point, "parent") 2024-04-26T22:07:43.222 DEBUG:teuthology.orchestra.run.smithi137:> os.mkdir(parent) 2024-04-26T22:07:43.222 DEBUG:teuthology.orchestra.run.smithi137:> flushed = os.path.join(parent, "flushed") 2024-04-26T22:07:43.222 DEBUG:teuthology.orchestra.run.smithi137:> os.mkdir(flushed) 2024-04-26T22:07:43.222 DEBUG:teuthology.orchestra.run.smithi137:> for f in ["alpha", "bravo", "charlie"]: 2024-04-26T22:07:43.223 DEBUG:teuthology.orchestra.run.smithi137:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-04-26T22:07:43.223 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:43.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:43.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:43.345 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-26T22:07:43.407 INFO:teuthology.orchestra.run.smithi137.stdout:./ 2024-04-26T22:07:43.407 INFO:teuthology.orchestra.run.smithi137.stdout:./parent 2024-04-26T22:07:43.407 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed 2024-04-26T22:07:43.407 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed/charlie 2024-04-26T22:07:43.407 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed/alpha 2024-04-26T22:07:43.407 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed/bravo 2024-04-26T22:07:43.407 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:43.407 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:43.407 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:43.408 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:43.408 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-26T22:07:43.408 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:43.510 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:07:43.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:43.519 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:43.519 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:43.519 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:43.520 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:43.520 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-26T22:07:43.520 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:43.626 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627776 2024-04-26T22:07:43.629 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:43.635 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:43.635 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:43.636 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:43.636 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:43.636 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-26T22:07:43.636 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:43.740 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627777 2024-04-26T22:07:43.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:43.750 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:43.750 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:43.750 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:43.750 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:43.750 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-26T22:07:43.750 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:43.854 INFO:teuthology.orchestra.run.smithi137.stdout:1099511628280 2024-04-26T22:07:43.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:43.863 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:43.863 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:43.863 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:43.863 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:43.863 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-26T22:07:43.864 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:43.970 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627778 2024-04-26T22:07:43.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:43.977 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:43.978 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:43.978 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:43.978 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:43.978 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-26T22:07:43.978 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:44.082 INFO:teuthology.orchestra.run.smithi137.stdout:1099511628279 2024-04-26T22:07:44.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:44.091 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:44.091 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:44.146 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:44.146 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:44.201 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:44.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.337+0000 7fb5a7093640 1 Processor -- start 2024-04-26T22:07:44.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.337+0000 7fb5a7093640 1 -- start start 2024-04-26T22:07:44.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb5a7093640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5a013ff70 0x7fb5a0146080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb5a7093640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a00d05b0 con 0x7fb5a00cff20 2024-04-26T22:07:44.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb5a7093640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a00d0890 con 0x7fb5a0140350 2024-04-26T22:07:44.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb5a7093640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a00d0390 con 0x7fb5a013ff70 2024-04-26T22:07:44.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb5a5630640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fb5a00cff20 0x7fb5a006ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:50752/0 (socket says 172.21.15.137:50752) 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb5a5630640 1 -- 172.21.15.137:0/1179503953 learned_addr learned my addr 172.21.15.137:0/1179503953 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806321911 0 0) 0x7fb5a00d05b0 con 0x7fb5a00cff20 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb590003520 con 0x7fb5a00cff20 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb5a4e2f640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5a013ff70 0x7fb5a0146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4045948500 0 0) 0x7fb590003520 con 0x7fb5a00cff20 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5a013ff70 msgr2=0x7fb5a0146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5a013ff70 0x7fb5a0146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 >> v1:172.21.15.170:6789/0 conn(0x7fb5a0140350 legacy=0x7fb5a00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a006e450 con 0x7fb5a00cff20 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fb5980019f0 con 0x7fb5a00cff20 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 >> v1:172.21.15.137:6789/0 conn(0x7fb5a00cff20 legacy=0x7fb5a006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5900039e0 0x7fb590003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb590004800 0x7fb590004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5a013ff70 0x7fb590005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a00d0390 con 0x7fb590004800 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb59000baf0 con 0x7fb5900039e0 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb59000bcf0 con 0x7fb5a013ff70 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.338+0000 7fb59ffff640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb590004800 0x7fb590004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb5a4e2f640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5900039e0 0x7fb590003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb5a5630640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5a013ff70 0x7fb590005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb59ffff640 1 -- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5a013ff70 msgr2=0x7fb590005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb59ffff640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb5a013ff70 0x7fb590005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb59ffff640 1 -- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5900039e0 msgr2=0x7fb590003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb59ffff640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5900039e0 0x7fb590003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb59ffff640 1 -- 172.21.15.137:0/1179503953 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb590003520 con 0x7fb590004800 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb5a4e2f640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5900039e0 0x7fb590003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:44.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb59ffff640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb590004800 0x7fb590004c80 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001750 tx=0x7fb590005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcdec84098fa0fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c001370 con 0x7fb590004800 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c0052d0 con 0x7fb590004800 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.339+0000 7fb59f7fe640 1 -- 172.21.15.137:0/1179503953 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c02abe0 con 0x7fb590004800 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.340+0000 7fb5a7093640 1 -- 172.21.15.137:0/1179503953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb590004800 msgr2=0x7fb590004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.340+0000 7fb5a7093640 1 --2- 172.21.15.137:0/1179503953 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb590004800 0x7fb590004c80 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fb58c001750 tx=0x7fb590005830 comp rx=0 tx=0).stop 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.340+0000 7fb5a5630640 1 -- 172.21.15.137:0/1179503953 reap_dead start 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.340+0000 7fb5a7093640 1 -- 172.21.15.137:0/1179503953 shutdown_connections 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.340+0000 7fb5a7093640 1 -- 172.21.15.137:0/1179503953 >> 172.21.15.137:0/1179503953 conn(0x7fb5a00d0d30 msgr2=0x7fb5a00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.340+0000 7fb5a7093640 1 -- 172.21.15.137:0/1179503953 shutdown_connections 2024-04-26T22:07:44.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.340+0000 7fb5a7093640 1 -- 172.21.15.137:0/1179503953 wait complete. 2024-04-26T22:07:44.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.341+0000 7fb5a7093640 1 Processor -- start 2024-04-26T22:07:44.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.341+0000 7fb5a7093640 1 -- start start 2024-04-26T22:07:44.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a7093640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb590004800 0x7fb5a01f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a7093640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a01f3d90 0x7fb5a0157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a7093640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5a0158190 0x7fb5a00b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a7093640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0146200 con 0x7fb5a01f3d90 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a7093640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0146080 con 0x7fb5a0158190 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a7093640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a0146380 con 0x7fb590004800 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb59ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a01f3d90 0x7fb5a0157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb59ffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a01f3d90 0x7fb5a0157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36532/0 (socket says 172.21.15.137:36532) 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb59ffff640 1 -- 172.21.15.137:0/3642354482 learned_addr learned my addr 172.21.15.137:0/3642354482 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a5630640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5a0158190 0x7fb5a00b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a4e2f640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb590004800 0x7fb5a01f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb59ffff640 1 -- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb590004800 msgr2=0x7fb5a01f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb59ffff640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb590004800 0x7fb5a01f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb59ffff640 1 -- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5a0158190 msgr2=0x7fb5a00b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb59ffff640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5a0158190 0x7fb5a00b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb59ffff640 1 -- 172.21.15.137:0/3642354482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a0158860 con 0x7fb5a01f3d90 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a5630640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5a0158190 0x7fb5a00b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.342+0000 7fb5a4e2f640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb590004800 0x7fb5a01f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.343+0000 7fb59ffff640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a01f3d90 0x7fb5a0157c50 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fb58c008fd0 tx=0x7fb58c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.343+0000 7fb59d7fa640 1 -- 172.21.15.137:0/3642354482 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c042070 con 0x7fb5a01f3d90 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.343+0000 7fb59d7fa640 1 -- 172.21.15.137:0/3642354482 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c02be50 con 0x7fb5a01f3d90 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.343+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a0158b40 con 0x7fb5a01f3d90 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.343+0000 7fb59d7fa640 1 -- 172.21.15.137:0/3642354482 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c037040 con 0x7fb5a01f3d90 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.343+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a01f4a90 con 0x7fb5a01f3d90 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.344+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a006a290 con 0x7fb5a01f3d90 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.344+0000 7fb59d7fa640 1 -- 172.21.15.137:0/3642354482 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb58c045070 con 0x7fb5a01f3d90 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.344+0000 7fb59d7fa640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb58406c8f0 0x7fb58406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.345+0000 7fb59d7fa640 1 -- 172.21.15.137:0/3642354482 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fb58c0ab310 con 0x7fb5a01f3d90 2024-04-26T22:07:44.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.345+0000 7fb5a4e2f640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb58406c8f0 0x7fb58406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.345+0000 7fb5a4e2f640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb58406c8f0 0x7fb58406edb0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb594009a00 tx=0x7fb594008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:44.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.349+0000 7fb59d7fa640 1 -- 172.21.15.137:0/3642354482 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb58c079740 con 0x7fb5a01f3d90 2024-04-26T22:07:44.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.523+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5a00b45e0 con 0x7fb5a01f3d90 2024-04-26T22:07:44.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.525+0000 7fb59d7fa640 1 -- 172.21.15.137:0/3642354482 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16639 (secure 0 0 0) 0x7fb58c079040 con 0x7fb5a01f3d90 2024-04-26T22:07:44.525 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:44.525 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":115,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:38.555671+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:44.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb58406c8f0 msgr2=0x7fb58406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb58406c8f0 0x7fb58406edb0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb594009a00 tx=0x7fb594008040 comp rx=0 tx=0).stop 2024-04-26T22:07:44.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a01f3d90 msgr2=0x7fb5a0157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a01f3d90 0x7fb5a0157c50 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fb58c008fd0 tx=0x7fb58c001120 comp rx=0 tx=0).stop 2024-04-26T22:07:44.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 shutdown_connections 2024-04-26T22:07:44.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb58406c8f0 0x7fb58406edb0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb5a01f3d90 0x7fb5a0157c50 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5a0158190 0x7fb5a00b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 --2- 172.21.15.137:0/3642354482 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb590004800 0x7fb5a01f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 >> 172.21.15.137:0/3642354482 conn(0x7fb5a00d0d30 msgr2=0x7fb5a00d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:44.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 shutdown_connections 2024-04-26T22:07:44.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.527+0000 7fb5a7093640 1 -- 172.21.15.137:0/3642354482 wait complete. 2024-04-26T22:07:44.538 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:07:35.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:07:35.848066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:07:44.538 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:07:44.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.640+0000 7f426b19d640 1 Processor -- start 2024-04-26T22:07:44.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.640+0000 7f426b19d640 1 -- start start 2024-04-26T22:07:44.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426b19d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f42640b4eb0 0x7f42640b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426b19d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42640ceff0 0x7f42640cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426b19d640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f426415dca0 con 0x7f4264143840 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426b19d640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4264143c20 con 0x7f42640ceff0 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426b19d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f426415df80 con 0x7f42640b4eb0 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426973a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42640ceff0 0x7f42640cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426973a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f42640ceff0 0x7f42640cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36544/0 (socket says 172.21.15.137:36544) 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426973a640 1 -- 172.21.15.137:0/643374407 learned_addr learned my addr 172.21.15.137:0/643374407 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f4263fff640 1 --2- 172.21.15.137:0/643374407 >> v2:172.21.15.170:3300/0 conn(0x7f42640b4eb0 0x7f42640b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426973a640 1 -- 172.21.15.137:0/643374407 >> v2:172.21.15.170:3300/0 conn(0x7f42640b4eb0 msgr2=0x7f42640b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426973a640 1 --2- 172.21.15.137:0/643374407 >> v2:172.21.15.170:3300/0 conn(0x7f42640b4eb0 0x7f42640b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426973a640 1 -- 172.21.15.137:0/643374407 >> v1:172.21.15.170:6789/0 conn(0x7f4264143840 legacy=0x7f42640b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:44.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.641+0000 7f426973a640 1 -- 172.21.15.137:0/643374407 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426415e260 con 0x7f42640ceff0 2024-04-26T22:07:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.642+0000 7f426973a640 1 --2- 172.21.15.137:0/643374407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640ceff0 0x7f42640cf480 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f42640b0a90 tx=0x7f425c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79cf37183f4d08d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.642+0000 7f42637fe640 1 -- 172.21.15.137:0/643374407 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c036070 con 0x7f42640ceff0 2024-04-26T22:07:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.642+0000 7f42637fe640 1 -- 172.21.15.137:0/643374407 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c031600 con 0x7f42640ceff0 2024-04-26T22:07:44.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.642+0000 7f42637fe640 1 -- 172.21.15.137:0/643374407 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0319d0 con 0x7f42640ceff0 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.642+0000 7f426b19d640 1 -- 172.21.15.137:0/643374407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640ceff0 msgr2=0x7f42640cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.642+0000 7f426b19d640 1 --2- 172.21.15.137:0/643374407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640ceff0 0x7f42640cf480 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f42640b0a90 tx=0x7f425c02a6f0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.643+0000 7f426b19d640 1 -- 172.21.15.137:0/643374407 shutdown_connections 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.643+0000 7f426b19d640 1 --2- 172.21.15.137:0/643374407 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640ceff0 0x7f42640cf480 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.643+0000 7f426b19d640 1 --2- 172.21.15.137:0/643374407 >> v2:172.21.15.170:3300/0 conn(0x7f42640b4eb0 0x7f42640b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.643+0000 7f426b19d640 1 -- 172.21.15.137:0/643374407 >> 172.21.15.137:0/643374407 conn(0x7f42640cd8a0 msgr2=0x7f42640cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.643+0000 7f426b19d640 1 -- 172.21.15.137:0/643374407 shutdown_connections 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.643+0000 7f426b19d640 1 -- 172.21.15.137:0/643374407 wait complete. 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.644+0000 7f426b19d640 1 Processor -- start 2024-04-26T22:07:44.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.644+0000 7f426b19d640 1 -- start start 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.644+0000 7f426b19d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640b4eb0 0x7f426415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.644+0000 7f426b19d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42640ceff0 0x7f426415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.644+0000 7f426b19d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4264143840 0x7f4264131340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.644+0000 7f426b19d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f426415d8c0 con 0x7f42640b4eb0 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.644+0000 7f426b19d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f42640b46f0 con 0x7f4264143840 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.644+0000 7f426b19d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f426415da40 con 0x7f42640ceff0 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4268f39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640b4eb0 0x7f426415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4268f39640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640b4eb0 0x7f426415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36558/0 (socket says 172.21.15.137:36558) 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4268f39640 1 -- 172.21.15.137:0/628838062 learned_addr learned my addr 172.21.15.137:0/628838062 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f426973a640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4264143840 0x7f4264131340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4263fff640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42640ceff0 0x7f426415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4268f39640 1 -- 172.21.15.137:0/628838062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42640ceff0 msgr2=0x7f426415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4268f39640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42640ceff0 0x7f426415ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4268f39640 1 -- 172.21.15.137:0/628838062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4264143840 msgr2=0x7f4264131340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4268f39640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4264143840 0x7f4264131340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4268f39640 1 -- 172.21.15.137:0/628838062 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4264132090 con 0x7f42640b4eb0 2024-04-26T22:07:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f4268f39640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640b4eb0 0x7f426415c4c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f425800b3f0 tx=0x7f425800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f42617fa640 1 -- 172.21.15.137:0/628838062 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258015020 con 0x7f42640b4eb0 2024-04-26T22:07:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f42617fa640 1 -- 172.21.15.137:0/628838062 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4258011830 con 0x7f42640b4eb0 2024-04-26T22:07:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426412f200 con 0x7f42640b4eb0 2024-04-26T22:07:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f42617fa640 1 -- 172.21.15.137:0/628838062 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258011c20 con 0x7f42640b4eb0 2024-04-26T22:07:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.645+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426412f7c0 con 0x7f42640b4eb0 2024-04-26T22:07:44.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.646+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426406a290 con 0x7f42640b4eb0 2024-04-26T22:07:44.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.647+0000 7f42617fa640 1 -- 172.21.15.137:0/628838062 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4258018020 con 0x7f42640b4eb0 2024-04-26T22:07:44.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.647+0000 7f42617fa640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424806c8f0 0x7f424806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.647+0000 7f4263fff640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424806c8f0 0x7f424806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.647+0000 7f42617fa640 1 -- 172.21.15.137:0/628838062 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f425808b760 con 0x7f42640b4eb0 2024-04-26T22:07:44.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.648+0000 7f4263fff640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424806c8f0 0x7f424806edb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f42640b4100 tx=0x7f4250008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:44.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.652+0000 7f42617fa640 1 -- 172.21.15.137:0/628838062 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f425801f030 con 0x7f42640b4eb0 2024-04-26T22:07:44.779 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:07:44.781 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:07:44.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.828+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f42641f3bd0 con 0x7f42640b4eb0 2024-04-26T22:07:44.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.828+0000 7f42617fa640 1 -- 172.21.15.137:0/628838062 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) ==== 93+0+10 (secure 0 0 0) 0x7f42580172c0 con 0x7f42640b4eb0 2024-04-26T22:07:44.828 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:07:44.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424806c8f0 msgr2=0x7f424806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424806c8f0 0x7f424806edb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f42640b4100 tx=0x7f4250008040 comp rx=0 tx=0).stop 2024-04-26T22:07:44.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640b4eb0 msgr2=0x7f426415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640b4eb0 0x7f426415c4c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f425800b3f0 tx=0x7f425800b8b0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 shutdown_connections 2024-04-26T22:07:44.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f424806c8f0 0x7f424806edb0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4264143840 0x7f4264131340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f42640ceff0 0x7f426415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 --2- 172.21.15.137:0/628838062 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f42640b4eb0 0x7f426415c4c0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 >> 172.21.15.137:0/628838062 conn(0x7f42640cd8a0 msgr2=0x7f42640b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:44.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 shutdown_connections 2024-04-26T22:07:44.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.830+0000 7f426b19d640 1 -- 172.21.15.137:0/628838062 wait complete. 2024-04-26T22:07:44.841 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:07:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.981+0000 7f6a6b50a640 1 Processor -- start 2024-04-26T22:07:44.981 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.982+0000 7f6a6b50a640 1 -- start start 2024-04-26T22:07:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.982+0000 7f6a6b50a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 0x7f6a640b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.982+0000 7f6a6b50a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a640d0300 0x7f6a6406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.982+0000 7f6a6b50a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6a640b3e50 0x7f6a640720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.982+0000 7f6a6b50a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6406fc60 con 0x7f6a640d0300 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.982+0000 7f6a6b50a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6a640b46a0 con 0x7f6a640b3e50 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.982+0000 7f6a6b50a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a640b5db0 con 0x7f6a6406f340 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.982+0000 7f6a68aa5640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a640d0300 0x7f6a6406f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a68aa5640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6a640d0300 0x7f6a6406f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36564/0 (socket says 172.21.15.137:36564) 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a68aa5640 1 -- 172.21.15.137:0/68940538 learned_addr learned my addr 172.21.15.137:0/68940538 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a69aa7640 1 --2- 172.21.15.137:0/68940538 >> v2:172.21.15.170:3300/0 conn(0x7f6a640b3e50 0x7f6a640720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a692a6640 1 --2- 172.21.15.137:0/68940538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 0x7f6a640b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a68aa5640 1 -- 172.21.15.137:0/68940538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 msgr2=0x7f6a640b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a68aa5640 1 --2- 172.21.15.137:0/68940538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 0x7f6a640b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a68aa5640 1 -- 172.21.15.137:0/68940538 >> v2:172.21.15.170:3300/0 conn(0x7f6a640b3e50 msgr2=0x7f6a640720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a68aa5640 1 --2- 172.21.15.137:0/68940538 >> v2:172.21.15.170:3300/0 conn(0x7f6a640b3e50 0x7f6a640720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a68aa5640 1 -- 172.21.15.137:0/68940538 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a640b6090 con 0x7f6a640d0300 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a692a6640 1 --2- 172.21.15.137:0/68940538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 0x7f6a640b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:44.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.983+0000 7f6a68aa5640 1 --2- 172.21.15.137:0/68940538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 0x7f6a6406f720 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6a64072080 tx=0x7f6a5402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0108ce35d15644 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a5bfff640 1 -- 172.21.15.137:0/68940538 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54037070 con 0x7f6a640d0300 2024-04-26T22:07:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a5bfff640 1 -- 172.21.15.137:0/68940538 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5402ae00 con 0x7f6a640d0300 2024-04-26T22:07:44.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a5bfff640 1 -- 172.21.15.137:0/68940538 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54032660 con 0x7f6a640d0300 2024-04-26T22:07:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a6b50a640 1 -- 172.21.15.137:0/68940538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 msgr2=0x7f6a6406f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/68940538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 0x7f6a6406f720 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6a64072080 tx=0x7f6a5402a0b0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a6b50a640 1 -- 172.21.15.137:0/68940538 shutdown_connections 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/68940538 >> v2:172.21.15.170:3300/0 conn(0x7f6a640b3e50 0x7f6a640720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/68940538 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 0x7f6a6406f720 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/68940538 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 0x7f6a640b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a6b50a640 1 -- 172.21.15.137:0/68940538 >> 172.21.15.137:0/68940538 conn(0x7f6a640cd8a0 msgr2=0x7f6a640cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a6b50a640 1 -- 172.21.15.137:0/68940538 shutdown_connections 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.984+0000 7f6a6b50a640 1 -- 172.21.15.137:0/68940538 wait complete. 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.985+0000 7f6a6b50a640 1 Processor -- start 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.985+0000 7f6a6b50a640 1 -- start start 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.986+0000 7f6a6b50a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 0x7f6a6413edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.986+0000 7f6a6b50a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a640b3e50 0x7f6a6413e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.986+0000 7f6a6b50a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 0x7f6a6415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.986+0000 7f6a6b50a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6a640b42e0 con 0x7f6a640d0300 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.986+0000 7f6a6b50a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6a640b6650 con 0x7f6a640b3e50 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.986+0000 7f6a6b50a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6a640b4460 con 0x7f6a6406f340 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.986+0000 7f6a69aa7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 0x7f6a6415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.986+0000 7f6a69aa7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 0x7f6a6415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36576/0 (socket says 172.21.15.137:36576) 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.986+0000 7f6a69aa7640 1 -- 172.21.15.137:0/4115820546 learned_addr learned my addr 172.21.15.137:0/4115820546 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a68aa5640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a640b3e50 0x7f6a6413e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a692a6640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 0x7f6a6413edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a69aa7640 1 -- 172.21.15.137:0/4115820546 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 msgr2=0x7f6a6413edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a69aa7640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 0x7f6a6413edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a69aa7640 1 -- 172.21.15.137:0/4115820546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a640b3e50 msgr2=0x7f6a6413e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a69aa7640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a640b3e50 0x7f6a6413e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a69aa7640 1 -- 172.21.15.137:0/4115820546 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6413eba0 con 0x7f6a640d0300 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a69aa7640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 0x7f6a6415d7b0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c007e90 tx=0x7f6a5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a59ffb640 1 -- 172.21.15.137:0/4115820546 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c014420 con 0x7f6a640d0300 2024-04-26T22:07:44.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a59ffb640 1 -- 172.21.15.137:0/4115820546 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c019070 con 0x7f6a640d0300 2024-04-26T22:07:44.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6415f0a0 con 0x7f6a640d0300 2024-04-26T22:07:44.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a59ffb640 1 -- 172.21.15.137:0/4115820546 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c014800 con 0x7f6a640d0300 2024-04-26T22:07:44.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.987+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6415d290 con 0x7f6a640d0300 2024-04-26T22:07:44.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.988+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6415f5c0 con 0x7f6a640d0300 2024-04-26T22:07:44.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.989+0000 7f6a59ffb640 1 -- 172.21.15.137:0/4115820546 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a5c0149a0 con 0x7f6a640d0300 2024-04-26T22:07:44.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.989+0000 7f6a59ffb640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a4806c8f0 0x7f6a4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:44.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.989+0000 7f6a59ffb640 1 -- 172.21.15.137:0/4115820546 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f6a5c08c2a0 con 0x7f6a640d0300 2024-04-26T22:07:44.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.989+0000 7f6a692a6640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a4806c8f0 0x7f6a4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:44.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.989+0000 7f6a692a6640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a4806c8f0 0x7f6a4806edb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6a64145140 tx=0x7f6a60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:44.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:44.993+0000 7f6a59ffb640 1 -- 172.21.15.137:0/4115820546 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6a6415f5c0 con 0x7f6a640d0300 2024-04-26T22:07:45.169 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.170+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6a6415d490 con 0x7f6a640d0300 2024-04-26T22:07:45.170 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.170+0000 7f6a59ffb640 1 -- 172.21.15.137:0/4115820546 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) ==== 104+0+11 (secure 0 0 0) 0x7f6a6415d490 con 0x7f6a640d0300 2024-04-26T22:07:45.170 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:07:45.172 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a4806c8f0 msgr2=0x7f6a4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a4806c8f0 0x7f6a4806edb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6a64145140 tx=0x7f6a60008040 comp rx=0 tx=0).stop 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 msgr2=0x7f6a6415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 0x7f6a6415d7b0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c007e90 tx=0x7f6a5c00e4b0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 shutdown_connections 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6a4806c8f0 0x7f6a4806edb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6a640d0300 0x7f6a6415d7b0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a640b3e50 0x7f6a6413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 --2- 172.21.15.137:0/4115820546 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6a6406f340 0x7f6a6413edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.172+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 >> 172.21.15.137:0/4115820546 conn(0x7f6a640cd8a0 msgr2=0x7f6a6415a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.173+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 shutdown_connections 2024-04-26T22:07:45.173 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.173+0000 7f6a6b50a640 1 -- 172.21.15.137:0/4115820546 wait complete. 2024-04-26T22:07:45.183 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:07:45.282 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.282+0000 7f2c100c4640 1 Processor -- start 2024-04-26T22:07:45.283 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.283+0000 7f2c100c4640 1 -- start start 2024-04-26T22:07:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.283+0000 7f2c100c4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c0815f260 0x7f2c0806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.283+0000 7f2c100c4640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2c080b4e00 0x7f2c080ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.283+0000 7f2c100c4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c0815f640 con 0x7f2c08070560 2024-04-26T22:07:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.283+0000 7f2c100c4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2c0806c2a0 con 0x7f2c0815f260 2024-04-26T22:07:45.284 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.283+0000 7f2c100c4640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2c0806c580 con 0x7f2c080b4e00 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.284+0000 7f2c0de60640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c0815f260 0x7f2c0806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.284+0000 7f2c0de60640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c0815f260 0x7f2c0806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36592/0 (socket says 172.21.15.137:36592) 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.284+0000 7f2c0de60640 1 -- 172.21.15.137:0/4268642106 learned_addr learned my addr 172.21.15.137:0/4268642106 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.284+0000 7f2c0de60640 1 -- 172.21.15.137:0/4268642106 >> v2:172.21.15.170:3300/0 conn(0x7f2c080b4e00 msgr2=0x7f2c080ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.284+0000 7f2c0de60640 1 --2- 172.21.15.137:0/4268642106 >> v2:172.21.15.170:3300/0 conn(0x7f2c080b4e00 0x7f2c080ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.284+0000 7f2c0de60640 1 -- 172.21.15.137:0/4268642106 >> v1:172.21.15.170:6789/0 conn(0x7f2c08070560 legacy=0x7f2c080b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.284+0000 7f2c0de60640 1 -- 172.21.15.137:0/4268642106 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0806c860 con 0x7f2c0815f260 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.284+0000 7f2c0de60640 1 --2- 172.21.15.137:0/4268642106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 0x7f2c0806d620 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f2c08163ea0 tx=0x7f2c0402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af71ddd5fb716303 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c0ce5e640 1 -- 172.21.15.137:0/4268642106 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04036070 con 0x7f2c0815f260 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c0ce5e640 1 -- 172.21.15.137:0/4268642106 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04031600 con 0x7f2c0815f260 2024-04-26T22:07:45.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c0ce5e640 1 -- 172.21.15.137:0/4268642106 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c040319d0 con 0x7f2c0815f260 2024-04-26T22:07:45.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c100c4640 1 -- 172.21.15.137:0/4268642106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 msgr2=0x7f2c0806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c100c4640 1 --2- 172.21.15.137:0/4268642106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 0x7f2c0806d620 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f2c08163ea0 tx=0x7f2c0402a6f0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c100c4640 1 -- 172.21.15.137:0/4268642106 shutdown_connections 2024-04-26T22:07:45.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c100c4640 1 --2- 172.21.15.137:0/4268642106 >> v2:172.21.15.170:3300/0 conn(0x7f2c080b4e00 0x7f2c080ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c100c4640 1 --2- 172.21.15.137:0/4268642106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 0x7f2c0806d620 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c100c4640 1 -- 172.21.15.137:0/4268642106 >> 172.21.15.137:0/4268642106 conn(0x7f2c080d1660 msgr2=0x7f2c080d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:45.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c100c4640 1 -- 172.21.15.137:0/4268642106 shutdown_connections 2024-04-26T22:07:45.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.285+0000 7f2c100c4640 1 -- 172.21.15.137:0/4268642106 wait complete. 2024-04-26T22:07:45.288 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.286+0000 7f2c100c4640 1 Processor -- start 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.286+0000 7f2c100c4640 1 -- start start 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.287+0000 7f2c100c4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c08070560 0x7f2c08154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.287+0000 7f2c100c4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c080b4e00 0x7f2c08152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.287+0000 7f2c100c4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 0x7f2c08144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.287+0000 7f2c100c4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0806d100 con 0x7f2c0815f260 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.287+0000 7f2c100c4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0806ce20 con 0x7f2c08070560 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.287+0000 7f2c100c4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0806db60 con 0x7f2c080b4e00 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.287+0000 7f2c0e661640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 0x7f2c08144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.287+0000 7f2c0e661640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 0x7f2c08144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:36598/0 (socket says 172.21.15.137:36598) 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.287+0000 7f2c0e661640 1 -- 172.21.15.137:0/3328981745 learned_addr learned my addr 172.21.15.137:0/3328981745 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2c0de60640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c08070560 0x7f2c08154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2c0e661640 1 -- 172.21.15.137:0/3328981745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c080b4e00 msgr2=0x7f2c08152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2c0e661640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c080b4e00 0x7f2c08152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2c0e661640 1 -- 172.21.15.137:0/3328981745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c08070560 msgr2=0x7f2c08154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2c0e661640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c08070560 0x7f2c08154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2c0e661640 1 -- 172.21.15.137:0/3328981745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c080d0a50 con 0x7f2c0815f260 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2c0e661640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 0x7f2c08144020 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000b420 tx=0x7f2c0000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2bfe7fc640 1 -- 172.21.15.137:0/3328981745 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00011830 con 0x7f2c0815f260 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2bfe7fc640 1 -- 172.21.15.137:0/3328981745 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c00016070 con 0x7f2c0815f260 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2bfe7fc640 1 -- 172.21.15.137:0/3328981745 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c00011c10 con 0x7f2c0815f260 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c080d0d30 con 0x7f2c0815f260 2024-04-26T22:07:45.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.288+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c08144560 con 0x7f2c0815f260 2024-04-26T22:07:45.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.289+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c08153360 con 0x7f2c0815f260 2024-04-26T22:07:45.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.289+0000 7f2bfe7fc640 1 -- 172.21.15.137:0/3328981745 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c0001b460 con 0x7f2c0815f260 2024-04-26T22:07:45.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.290+0000 7f2bfe7fc640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bec06c920 0x7f2bec06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.290+0000 7f2c0de60640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bec06c920 0x7f2bec06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.291 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.290+0000 7f2bfe7fc640 1 -- 172.21.15.137:0/3328981745 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f2c0008b7a0 con 0x7f2c0815f260 2024-04-26T22:07:45.292 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.290+0000 7f2c0de60640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bec06c920 0x7f2bec06ede0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2c04033000 tx=0x7f2c04009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:45.294 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.294+0000 7f2bfe7fc640 1 -- 172.21.15.137:0/3328981745 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2c00059c60 con 0x7f2c0815f260 2024-04-26T22:07:45.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.470+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2c0806a290 con 0x7f2c0815f260 2024-04-26T22:07:45.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.470+0000 7f2bfe7fc640 1 -- 172.21.15.137:0/3328981745 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) ==== 100+0+11 (secure 0 0 0) 0x7f2c00059560 con 0x7f2c0815f260 2024-04-26T22:07:45.470 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:07:45.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bec06c920 msgr2=0x7f2bec06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bec06c920 0x7f2bec06ede0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2c04033000 tx=0x7f2c04009000 comp rx=0 tx=0).stop 2024-04-26T22:07:45.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 msgr2=0x7f2c08144020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 0x7f2c08144020 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000b420 tx=0x7f2c0000b8e0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 shutdown_connections 2024-04-26T22:07:45.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bec06c920 0x7f2bec06ede0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0815f260 0x7f2c08144020 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c080b4e00 0x7f2c08152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 --2- 172.21.15.137:0/3328981745 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c08070560 0x7f2c08154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 >> 172.21.15.137:0/3328981745 conn(0x7f2c080d1660 msgr2=0x7f2c080d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:45.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 shutdown_connections 2024-04-26T22:07:45.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.472+0000 7f2c100c4640 1 -- 172.21.15.137:0/3328981745 wait complete. 2024-04-26T22:07:45.483 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:07:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.584+0000 7fa0fef22640 1 Processor -- start 2024-04-26T22:07:45.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.584+0000 7fa0fef22640 1 -- start start 2024-04-26T22:07:45.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fef22640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa0f815f370 0x7fa0f80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fef22640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f750 0x7fa0f80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fef22640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa0f80d37d0 0x7fa0f80d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fef22640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f80b4d10 con 0x7fa0f80d37d0 2024-04-26T22:07:45.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fef22640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa0f80d4120 con 0x7fa0f815f370 2024-04-26T22:07:45.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fef22640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f80d03a0 con 0x7fa0f815f750 2024-04-26T22:07:45.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fd4bf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa0f80d37d0 0x7fa0f80d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fd4bf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa0f80d37d0 0x7fa0f80d3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54722/0 (socket says 172.21.15.137:54722) 2024-04-26T22:07:45.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fd4bf640 1 -- 172.21.15.137:0/1518523391 learned_addr learned my addr 172.21.15.137:0/1518523391 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0f7fff640 1 --2- 172.21.15.137:0/1518523391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f750 0x7fa0f80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fccbe640 1 --2- 172.21.15.137:0/1518523391 >> v2:172.21.15.170:3300/0 conn(0x7fa0f815f370 0x7fa0f80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fd4bf640 1 -- 172.21.15.137:0/1518523391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f750 msgr2=0x7fa0f80b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.585+0000 7fa0fd4bf640 1 --2- 172.21.15.137:0/1518523391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f750 0x7fa0f80b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.586+0000 7fa0fd4bf640 1 -- 172.21.15.137:0/1518523391 >> v2:172.21.15.170:3300/0 conn(0x7fa0f815f370 msgr2=0x7fa0f80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.586+0000 7fa0fd4bf640 1 --2- 172.21.15.137:0/1518523391 >> v2:172.21.15.170:3300/0 conn(0x7fa0f815f370 0x7fa0f80cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.586+0000 7fa0fd4bf640 1 -- 172.21.15.137:0/1518523391 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f80d0680 con 0x7fa0f80d37d0 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.586+0000 7fa0fd4bf640 1 --2- 172.21.15.137:0/1518523391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 0x7fa0f80d3be0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80d2d10 tx=0x7fa0f002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df35f0cb9fd3746b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.586+0000 7fa0f77fe640 1 -- 172.21.15.137:0/1518523391 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0036070 con 0x7fa0f80d37d0 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.586+0000 7fa0f77fe640 1 -- 172.21.15.137:0/1518523391 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f0031600 con 0x7fa0f80d37d0 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.586+0000 7fa0f77fe640 1 -- 172.21.15.137:0/1518523391 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f00319d0 con 0x7fa0f80d37d0 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.587+0000 7fa0fef22640 1 -- 172.21.15.137:0/1518523391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 msgr2=0x7fa0f80d3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.587+0000 7fa0fef22640 1 --2- 172.21.15.137:0/1518523391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 0x7fa0f80d3be0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fa0f80d2d10 tx=0x7fa0f002a610 comp rx=0 tx=0).stop 2024-04-26T22:07:45.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.587+0000 7fa0fef22640 1 -- 172.21.15.137:0/1518523391 shutdown_connections 2024-04-26T22:07:45.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.587+0000 7fa0fef22640 1 --2- 172.21.15.137:0/1518523391 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 0x7fa0f80d3be0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.587+0000 7fa0fef22640 1 --2- 172.21.15.137:0/1518523391 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f750 0x7fa0f80b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.587+0000 7fa0fef22640 1 --2- 172.21.15.137:0/1518523391 >> v2:172.21.15.170:3300/0 conn(0x7fa0f815f370 0x7fa0f80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.587+0000 7fa0fef22640 1 -- 172.21.15.137:0/1518523391 >> 172.21.15.137:0/1518523391 conn(0x7fa0f808ec10 msgr2=0x7fa0f809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:45.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.587+0000 7fa0fef22640 1 -- 172.21.15.137:0/1518523391 shutdown_connections 2024-04-26T22:07:45.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.587+0000 7fa0fef22640 1 -- 172.21.15.137:0/1518523391 wait complete. 2024-04-26T22:07:45.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.588+0000 7fa0fef22640 1 Processor -- start 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.588+0000 7fa0fef22640 1 -- start start 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fef22640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 0x7fa0f81f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fef22640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f370 0x7fa0f81f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fef22640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f815f750 0x7fa0f80b5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fef22640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f80d0f20 con 0x7fa0f80d37d0 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fef22640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f80d0c40 con 0x7fa0f815f750 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fef22640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f80d1bd0 con 0x7fa0f815f370 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fccbe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 0x7fa0f81f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fccbe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 0x7fa0f81f8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54724/0 (socket says 172.21.15.137:54724) 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fccbe640 1 -- 172.21.15.137:0/3448942013 learned_addr learned my addr 172.21.15.137:0/3448942013 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0f7fff640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f370 0x7fa0f81f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fd4bf640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f815f750 0x7fa0f80b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.592 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fccbe640 1 -- 172.21.15.137:0/3448942013 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f370 msgr2=0x7fa0f81f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fccbe640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f370 0x7fa0f81f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fccbe640 1 -- 172.21.15.137:0/3448942013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f815f750 msgr2=0x7fa0f80b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fccbe640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f815f750 0x7fa0f80b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fccbe640 1 -- 172.21.15.137:0/3448942013 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f81f9190 con 0x7fa0f80d37d0 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.589+0000 7fa0fccbe640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 0x7fa0f81f8c50 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c7f0 tx=0x7fa0e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.590+0000 7fa0f57fa640 1 -- 172.21.15.137:0/3448942013 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8015070 con 0x7fa0f80d37d0 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.590+0000 7fa0f57fa640 1 -- 172.21.15.137:0/3448942013 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e8004220 con 0x7fa0f80d37d0 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.590+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f80ca860 con 0x7fa0f80d37d0 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.590+0000 7fa0f57fa640 1 -- 172.21.15.137:0/3448942013 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8007620 con 0x7fa0f80d37d0 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.590+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f80cb0c0 con 0x7fa0f80d37d0 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.591+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f806a290 con 0x7fa0f80d37d0 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.591+0000 7fa0f57fa640 1 -- 172.21.15.137:0/3448942013 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa0e80079d0 con 0x7fa0f80d37d0 2024-04-26T22:07:45.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.592+0000 7fa0f57fa640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:45.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.592+0000 7fa0f7fff640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:45.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.592+0000 7fa0f57fa640 1 -- 172.21.15.137:0/3448942013 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fa0e808bac0 con 0x7fa0f80d37d0 2024-04-26T22:07:45.594 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.592+0000 7fa0f7fff640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0006fd0 tx=0x7fa0e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:45.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.596+0000 7fa0f57fa640 1 -- 172.21.15.137:0/3448942013 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa0f81f9190 con 0x7fa0f80d37d0 2024-04-26T22:07:45.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.782+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa0f80cff70 con 0x7fa0f80d37d0 2024-04-26T22:07:45.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.782+0000 7fa0f57fa640 1 -- 172.21.15.137:0/3448942013 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v115) ==== 80+0+0 (secure 0 0 0) 0x7fa0e8059f80 con 0x7fa0f80d37d0 2024-04-26T22:07:45.783 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T22:07:45.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.784+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 msgr2=0x7fa0d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.784+0000 7fa0fef22640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0006fd0 tx=0x7fa0e0008040 comp rx=0 tx=0).stop 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.784+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 msgr2=0x7fa0f81f8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.784+0000 7fa0fef22640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 0x7fa0f81f8c50 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fa0e800c7f0 tx=0x7fa0e800ccb0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.784+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 shutdown_connections 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.785+0000 7fa0fef22640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa0d806c8f0 0x7fa0d806edb0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.785+0000 7fa0fef22640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0f815f750 0x7fa0f80b5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.785+0000 7fa0fef22640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa0f815f370 0x7fa0f81f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.785+0000 7fa0fef22640 1 --2- 172.21.15.137:0/3448942013 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa0f80d37d0 0x7fa0f81f8c50 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.785+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 >> 172.21.15.137:0/3448942013 conn(0x7fa0f808ec10 msgr2=0x7fa0f815e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.785+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 shutdown_connections 2024-04-26T22:07:45.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:45.785+0000 7fa0fef22640 1 -- 172.21.15.137:0/3448942013 wait complete. 2024-04-26T22:07:45.795 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:07:45.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:45.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:45.842 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:07:45.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:45.842 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:07:45.865 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-26T22:07:46.004 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.004+0000 7ff2bea2a640 1 Processor -- start 2024-04-26T22:07:46.005 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.005+0000 7ff2bea2a640 1 -- start start 2024-04-26T22:07:46.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.005+0000 7ff2bea2a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff2b815f680 0x7ff2b80d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.005+0000 7ff2bea2a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 0x7ff2b80b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.005+0000 7ff2bea2a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2b80b60b0 0x7ff2b80d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.005+0000 7ff2bea2a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b815fa60 con 0x7ff2b80b60b0 2024-04-26T22:07:46.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.005+0000 7ff2bea2a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b80d3f50 con 0x7ff2b815f680 2024-04-26T22:07:46.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.005+0000 7ff2bea2a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b80b5090 con 0x7ff2b8163aa0 2024-04-26T22:07:46.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.005+0000 7ff2bcfc7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2b80b60b0 0x7ff2b80d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2bcfc7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7ff2b80b60b0 0x7ff2b80d4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54740/0 (socket says 172.21.15.137:54740) 2024-04-26T22:07:46.013 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/715250167 learned_addr learned my addr 172.21.15.137:0/715250167 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:46.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2b77fe640 1 --2- 172.21.15.137:0/715250167 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 0x7ff2b80b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/715250167 >> v2:172.21.15.170:3300/0 conn(0x7ff2b815f680 0x7ff2b80d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/715250167 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 msgr2=0x7ff2b80b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/715250167 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 0x7ff2b80b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/715250167 >> v2:172.21.15.170:3300/0 conn(0x7ff2b815f680 msgr2=0x7ff2b80d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/715250167 >> v2:172.21.15.170:3300/0 conn(0x7ff2b815f680 0x7ff2b80d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/715250167 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b80b5370 con 0x7ff2b80b60b0 2024-04-26T22:07:46.014 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.006+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/715250167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 0x7ff2b80d4f20 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80d6370 tx=0x7ff2b002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44537a33f7ab3bb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2b6ffd640 1 -- 172.21.15.137:0/715250167 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0036070 con 0x7ff2b80b60b0 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2b6ffd640 1 -- 172.21.15.137:0/715250167 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b0031600 con 0x7ff2b80b60b0 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2b6ffd640 1 -- 172.21.15.137:0/715250167 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00319d0 con 0x7ff2b80b60b0 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2bea2a640 1 -- 172.21.15.137:0/715250167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 msgr2=0x7ff2b80d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/715250167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 0x7ff2b80d4f20 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80d6370 tx=0x7ff2b002a6a0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2bea2a640 1 -- 172.21.15.137:0/715250167 shutdown_connections 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/715250167 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 0x7ff2b80d4f20 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/715250167 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 0x7ff2b80b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/715250167 >> v2:172.21.15.170:3300/0 conn(0x7ff2b815f680 0x7ff2b80d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2bea2a640 1 -- 172.21.15.137:0/715250167 >> 172.21.15.137:0/715250167 conn(0x7ff2b808eca0 msgr2=0x7ff2b809e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2bea2a640 1 -- 172.21.15.137:0/715250167 shutdown_connections 2024-04-26T22:07:46.015 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.007+0000 7ff2bea2a640 1 -- 172.21.15.137:0/715250167 wait complete. 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.008+0000 7ff2bea2a640 1 Processor -- start 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2bea2a640 1 -- start start 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2bea2a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 0x7ff2b80cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2bea2a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b815f680 0x7ff2b8156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2bea2a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 0x7ff2b80cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2bea2a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b80d55e0 con 0x7ff2b80b60b0 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2bea2a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b80d5460 con 0x7ff2b815f680 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2bea2a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b80d5760 con 0x7ff2b8163aa0 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 0x7ff2b80cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 0x7ff2b80cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54742/0 (socket says 172.21.15.137:54742) 2024-04-26T22:07:46.016 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.009+0000 7ff2b7fff640 1 -- 172.21.15.137:0/2952523041 learned_addr learned my addr 172.21.15.137:0/2952523041 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b7fff640 1 -- 172.21.15.137:0/2952523041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 msgr2=0x7ff2b80cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b77fe640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b815f680 0x7ff2b8156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 0x7ff2b80cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 0x7ff2b80cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b7fff640 1 -- 172.21.15.137:0/2952523041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b815f680 msgr2=0x7ff2b8156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b815f680 0x7ff2b8156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b7fff640 1 -- 172.21.15.137:0/2952523041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b80cc9d0 con 0x7ff2b80b60b0 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b77fe640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b815f680 0x7ff2b8156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 0x7ff2b80cc340 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800d800 tx=0x7ff2a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b4ff9640 1 -- 172.21.15.137:0/2952523041 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8018020 con 0x7ff2b80b60b0 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b4ff9640 1 -- 172.21.15.137:0/2952523041 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a80096a0 con 0x7ff2b80b60b0 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2bea2a640 1 -- 172.21.15.137:0/2952523041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b8160560 con 0x7ff2b80b60b0 2024-04-26T22:07:46.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2b4ff9640 1 -- 172.21.15.137:0/2952523041 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8009a70 con 0x7ff2b80b60b0 2024-04-26T22:07:46.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.010+0000 7ff2bea2a640 1 -- 172.21.15.137:0/2952523041 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b8160b20 con 0x7ff2b80b60b0 2024-04-26T22:07:46.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.011+0000 7ff2b4ff9640 1 -- 172.21.15.137:0/2952523041 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2a801b020 con 0x7ff2b80b60b0 2024-04-26T22:07:46.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.012+0000 7ff2b4ff9640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2a406c920 0x7ff2a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.012+0000 7ff2b4ff9640 1 -- 172.21.15.137:0/2952523041 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7ff2a808be10 con 0x7ff2b80b60b0 2024-04-26T22:07:46.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.012+0000 7ff2b77fe640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2a406c920 0x7ff2a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.012+0000 7ff2b77fe640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2a406c920 0x7ff2a406ede0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac006fd0 tx=0x7ff2ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2c1823740 1 Processor -- start 2024-04-26T22:07:46.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2c1823740 1 -- start start 2024-04-26T22:07:46.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e3180360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317ae10 0x55a3e317eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317f0c0 0x55a3e317f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2c1823740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a3e30e4d80 con 0x55a3e317ff80 2024-04-26T22:07:46.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2c1823740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a3e309e8b0 con 0x55a3e317f0c0 2024-04-26T22:07:46.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2c1823740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a3e30e0d40 con 0x55a3e317ae10 2024-04-26T22:07:46.025 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e3180360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e3180360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54744/0 (socket says 172.21.15.137:54744) 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.013+0000 7ff2b7fff640 1 -- 172.21.15.137:0/4022438428 learned_addr learned my addr 172.21.15.137:0/4022438428 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317f0c0 0x55a3e317f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff2b77fe640 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317ae10 0x55a3e317eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff2b7fff640 1 -- 172.21.15.137:0/4022438428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317ae10 msgr2=0x55a3e317eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317ae10 0x55a3e317eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff2b7fff640 1 -- 172.21.15.137:0/4022438428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317f0c0 msgr2=0x55a3e317f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317f0c0 0x55a3e317f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff2b7fff640 1 -- 172.21.15.137:0/4022438428 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e306fa40 con 0x55a3e317ff80 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317f0c0 0x55a3e317f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e3180360 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8055fa0 tx=0x7ff2a805a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12ea127f3f58508 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.026 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff29dffb640 1 -- 172.21.15.137:0/4022438428 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8072020 con 0x55a3e317ff80 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff29dffb640 1 -- 172.21.15.137:0/4022438428 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a8062720 con 0x55a3e317ff80 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.014+0000 7ff29dffb640 1 -- 172.21.15.137:0/4022438428 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8024d80 con 0x55a3e317ff80 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 -- 172.21.15.137:0/4022438428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 msgr2=0x55a3e3180360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e3180360 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8055fa0 tx=0x7ff2a805a300 comp rx=0 tx=0).stop 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 -- 172.21.15.137:0/4022438428 shutdown_connections 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317f0c0 0x55a3e317f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317ae10 0x55a3e317eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 --2- 172.21.15.137:0/4022438428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e3180360 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 -- 172.21.15.137:0/4022438428 >> 172.21.15.137:0/4022438428 conn(0x55a3e317d080 msgr2=0x55a3e31c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 -- 172.21.15.137:0/4022438428 shutdown_connections 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 -- 172.21.15.137:0/4022438428 wait complete. 2024-04-26T22:07:46.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 -- start start 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.015+0000 7ff2c1823740 1 Processor -- start 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e31a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ff80 0x55a3e31cc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e31cc5d0 0x55a3e31a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2c1823740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a3e31abb10 con 0x55a3e31cc5d0 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2c1823740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a3e306bd10 con 0x55a3e317ff80 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2c1823740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a3e31aaf90 con 0x55a3e317f0c0 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2c1823740 10 client.0 _ll_register_callbacks cb 0x55a3e3098210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2bcfc7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e31cc5d0 0x55a3e31a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2bcfc7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e31cc5d0 0x55a3e31a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54756/0 (socket says 172.21.15.137:54756) 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2b7fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e31a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/2859071892 learned_addr learned my addr 172.21.15.137:0/2859071892 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:46.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2b77fe640 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ff80 0x55a3e31cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.016+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 msgr2=0x55a3e31a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e31a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ff80 msgr2=0x55a3e31cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ff80 0x55a3e31cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/2859071892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e2ec07d0 con 0x55a3e31cc5d0 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e31cc5d0 0x55a3e31a0be0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009f40 tx=0x7ff2b0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecf805996ab9676 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff296ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff296ffd640 1 -- 172.21.15.137:0/2859071892 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0042070 con 0x55a3e31cc5d0 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff296ffd640 1 -- 172.21.15.137:0/2859071892 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7ff2b003c450 con 0x55a3e31cc5d0 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2c1823740 1 -- 172.21.15.137:0/2859071892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2a8062720 con 0x55a3e31cc5d0 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff296ffd640 1 -- 172.21.15.137:0/2859071892 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ff2b004d050 con 0x55a3e31cc5d0 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2c1823740 10 client.9051 fetch_fsmap learned FSMap version 81 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2c1823740 1 -- 172.21.15.137:0/2859071892 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55a3e2df63f0 con 0x55a3e31cc5d0 2024-04-26T22:07:46.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff296ffd640 1 -- 172.21.15.137:0/2859071892 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a8062720 con 0x55a3e31cc5d0 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff296ffd640 1 -- 172.21.15.137:0/2859071892 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7ff2b0050020 con 0x55a3e31cc5d0 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2c1823740 10 client.9051 fetch_fsmap finished waiting for FSMap version 81 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2c1823740 10 client.9051 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2c1823740 20 client.9051 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2c1823740 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x55a3e31ca3a0 0x55a3e31ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2c1823740 4 client.9051 mds_command: new command op to 8871 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2c1823740 1 -- 172.21.15.137:0/2859071892 --> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3e30f2990 con 0x55a3e31ca3a0 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.017+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x55a3e31ca3a0 0x55a3e31ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.018+0000 7ff296ffd640 10 client.9051 ms_handle_connect on v2:172.21.15.170:6832/1666946913 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.018+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x55a3e31ca3a0 0x55a3e31ca7b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b40dc2ec96bc23be server_cookie=61986be7b54853c5 in_seq=0 out_seq=0 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.018+0000 7ff296ffd640 1 -- 172.21.15.137:0/2859071892 <== mds.0 v2:172.21.15.170:6832/1666946913 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a3e30f2990 con 0x55a3e31ca3a0 2024-04-26T22:07:46.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.018+0000 7ff296ffd640 10 client.9051 handle_command_reply: tid=0 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.018+0000 7ff2c1823740 1 client.9051 shutdown 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 -- 172.21.15.137:0/2859071892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e31cc5d0 msgr2=0x55a3e31a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e31cc5d0 0x55a3e31a0be0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009f40 tx=0x7ff2b0004ab0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 -- 172.21.15.137:0/2859071892 shutdown_connections 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e31cc5d0 0x55a3e31a0be0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x55a3e31ca3a0 0x55a3e31ca7b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ff80 0x55a3e31cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 --2- 172.21.15.137:0/2859071892 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e31a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff296ffd640 0 client.9051 ms_handle_reset on v2:172.21.15.170:6832/1666946913 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 -- 172.21.15.137:0/2859071892 >> 172.21.15.137:0/2859071892 conn(0x55a3e317ae10 msgr2=0x55a3e3180a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 -- 172.21.15.137:0/2859071892 shutdown_connections 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 1 -- 172.21.15.137:0/2859071892 wait complete. 2024-04-26T22:07:46.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.019+0000 7ff2c1823740 20 client.9051 trim_cache size 0 max 16384 2024-04-26T22:07:46.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.033+0000 7ff2c1823740 1 Processor -- start 2024-04-26T22:07:46.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.033+0000 7ff2c1823740 1 -- start start 2024-04-26T22:07:46.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 0x55a3e31c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e31aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31ab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2c1823740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8201990 con 0x55a3e317ff80 2024-04-26T22:07:46.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2c1823740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8200b20 con 0x55a3e317ae10 2024-04-26T22:07:46.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2c1823740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b80cf1c0 con 0x55a3e317f0c0 2024-04-26T22:07:46.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2bcfc7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2bcfc7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54768/0 (socket says 172.21.15.137:54768) 2024-04-26T22:07:46.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/1336191380 learned_addr learned my addr 172.21.15.137:0/1336191380 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2b77fe640 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e31aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 0x55a3e31c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/1336191380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 msgr2=0x55a3e31aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e31aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/1336191380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 msgr2=0x55a3e31c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 0x55a3e31c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/1336191380 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e2db60f0 con 0x55a3e317ff80 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 0x55a3e31c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31ab430 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00094a0 tx=0x7ff2b003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d7bc2395a3db00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff29d7fa640 1 -- 172.21.15.137:0/1336191380 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0042040 con 0x55a3e317ff80 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.034+0000 7ff29d7fa640 1 -- 172.21.15.137:0/1336191380 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b0031c40 con 0x55a3e317ff80 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff29d7fa640 1 -- 172.21.15.137:0/1336191380 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0036040 con 0x55a3e317ff80 2024-04-26T22:07:46.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff2c1823740 1 -- 172.21.15.137:0/1336191380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 msgr2=0x55a3e31ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31ab430 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00094a0 tx=0x7ff2b003c000 comp rx=0 tx=0).stop 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff2c1823740 1 -- 172.21.15.137:0/1336191380 shutdown_connections 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31ab430 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e31aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1336191380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 0x55a3e31c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff2c1823740 1 -- 172.21.15.137:0/1336191380 >> 172.21.15.137:0/1336191380 conn(0x55a3e317df90 msgr2=0x55a3e31a2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff2c1823740 1 -- 172.21.15.137:0/1336191380 shutdown_connections 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.035+0000 7ff2c1823740 1 -- 172.21.15.137:0/1336191380 wait complete. 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.036+0000 7ff2c1823740 1 -- start start 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.036+0000 7ff2c1823740 1 Processor -- start 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.036+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 0x55a3e31d8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.041 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.036+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e3235950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.036+0000 7ff2c1823740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31a2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.036+0000 7ff2c1823740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b81620d0 con 0x55a3e317ff80 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.036+0000 7ff2c1823740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a3e317ef20 con 0x55a3e317ae10 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.036+0000 7ff2c1823740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a3e31cc450 con 0x55a3e317f0c0 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2c1823740 10 client.0 _ll_register_callbacks cb 0x7ff2b0034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2bcfc7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2bcfc7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31a2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54780/0 (socket says 172.21.15.137:54780) 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/1477287144 learned_addr learned my addr 172.21.15.137:0/1477287144 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2b77fe640 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e3235950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 0x55a3e31d8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 msgr2=0x55a3e3235950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e3235950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 msgr2=0x55a3e31d8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 0x55a3e31d8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2bcfc7640 1 -- 172.21.15.137:0/1477287144 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e30a54b0 con 0x55a3e317ff80 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2bcfc7640 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31a2180 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009f40 tx=0x7ff2b0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58eedaeeef14f7e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff296ffd640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff296ffd640 1 -- 172.21.15.137:0/1477287144 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0036050 con 0x55a3e317ff80 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff296ffd640 1 -- 172.21.15.137:0/1477287144 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7ff2b0004230 con 0x55a3e317ff80 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2c1823740 1 -- 172.21.15.137:0/1477287144 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b0031c40 con 0x55a3e317ff80 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff296ffd640 1 -- 172.21.15.137:0/1477287144 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ff2b0064050 con 0x55a3e317ff80 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2c1823740 10 client.9057 fetch_fsmap learned FSMap version 81 2024-04-26T22:07:46.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.037+0000 7ff2c1823740 1 -- 172.21.15.137:0/1477287144 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55a3e31cbf00 con 0x55a3e317ff80 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff296ffd640 1 -- 172.21.15.137:0/1477287144 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2b0031c40 con 0x55a3e317ff80 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff296ffd640 1 -- 172.21.15.137:0/1477287144 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 81) ==== 3494+0+0 (secure 0 0 0) 0x7ff2b0067020 con 0x55a3e317ff80 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff2c1823740 10 client.9057 fetch_fsmap finished waiting for FSMap version 81 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff2c1823740 10 client.9057 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.b 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff2c1823740 20 client.9057 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x55a3e31cc5d0 0x55a3e31a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff2c1823740 4 client.9057 mds_command: new command op to 8871 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff2c1823740 1 -- 172.21.15.137:0/1477287144 --> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3e30ec800 con 0x55a3e31cc5d0 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x55a3e31cc5d0 0x55a3e31a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff296ffd640 10 client.9057 ms_handle_connect on v2:172.21.15.170:6832/1666946913 2024-04-26T22:07:46.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.038+0000 7ff2b7fff640 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x55a3e31cc5d0 0x55a3e31a26c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dfccc64c7accf6 server_cookie=10b90dfe07a7583a in_seq=0 out_seq=0 2024-04-26T22:07:46.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff296ffd640 1 -- 172.21.15.137:0/1477287144 <== mds.0 v2:172.21.15.170:6832/1666946913 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3e30ec800 con 0x55a3e31cc5d0 2024-04-26T22:07:46.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff296ffd640 10 client.9057 handle_command_reply: tid=0 2024-04-26T22:07:46.047 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 client.9057 shutdown 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 -- 172.21.15.137:0/1477287144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 msgr2=0x55a3e31a2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31a2180 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009f40 tx=0x7ff2b0009810 comp rx=0 tx=0).stop 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 -- 172.21.15.137:0/1477287144 shutdown_connections 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a3e317ff80 0x55a3e31a2180 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:6832/1666946913,v1:172.21.15.170:6834/1666946913] conn(0x55a3e31cc5d0 0x55a3e31a26c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a3e317f0c0 0x55a3e3235950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 --2- 172.21.15.137:0/1477287144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a3e317ae10 0x55a3e31d8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff296ffd640 0 client.9057 ms_handle_reset on v2:172.21.15.170:6832/1666946913 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 -- 172.21.15.137:0/1477287144 >> 172.21.15.137:0/1477287144 conn(0x55a3e317df90 msgr2=0x55a3e31c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 -- 172.21.15.137:0/1477287144 shutdown_connections 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 1 -- 172.21.15.137:0/1477287144 wait complete. 2024-04-26T22:07:46.048 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.047+0000 7ff2c1823740 20 client.9057 trim_cache size 0 max 16384 2024-04-26T22:07:46.049 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:07:46.049 INFO:teuthology.orchestra.run.smithi137.stdout: "message": "", 2024-04-26T22:07:46.049 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0 2024-04-26T22:07:46.049 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:07:46.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 -- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2a406c920 msgr2=0x7ff2a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2a406c920 0x7ff2a406ede0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac006fd0 tx=0x7ff2ac008040 comp rx=0 tx=0).stop 2024-04-26T22:07:46.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 -- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 msgr2=0x7ff2b80cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 0x7ff2b80cc340 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800d800 tx=0x7ff2a800dcc0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 -- 172.21.15.137:0/2952523041 shutdown_connections 2024-04-26T22:07:46.050 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff2a406c920 0x7ff2a406ede0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff2b8163aa0 0x7ff2b80cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2b815f680 0x7ff2b8156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 --2- 172.21.15.137:0/2952523041 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff2b80b60b0 0x7ff2b80cc340 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 -- 172.21.15.137:0/2952523041 >> 172.21.15.137:0/2952523041 conn(0x7ff2b808eca0 msgr2=0x7ff2b80b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:46.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 -- 172.21.15.137:0/2952523041 shutdown_connections 2024-04-26T22:07:46.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.048+0000 7ff2bea2a640 1 -- 172.21.15.137:0/2952523041 wait complete. 2024-04-26T22:07:46.059 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:07:46.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.156+0000 7f6c5572b640 1 Processor -- start 2024-04-26T22:07:46.156 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.156+0000 7f6c5572b640 1 -- start start 2024-04-26T22:07:46.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c5572b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c500d3ee0 0x7f6c500cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c5572b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6c5015f750 0x7f6c500b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c5572b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c500d03a0 con 0x7f6c5015f370 2024-04-26T22:07:46.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c5572b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f6c500b4d10 con 0x7f6c5015f750 2024-04-26T22:07:46.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c5572b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c500d0680 con 0x7f6c500d3ee0 2024-04-26T22:07:46.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4effd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f6c5015f370 0x7f6c500d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58620/0 (socket says 172.21.15.137:58620) 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4effd640 1 -- 172.21.15.137:0/1589761068 learned_addr learned my addr 172.21.15.137:0/1589761068 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4f7fe640 1 --2- 172.21.15.137:0/1589761068 >> v2:172.21.15.170:3300/0 conn(0x7f6c5015f750 0x7f6c500b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4e7fc640 1 --2- 172.21.15.137:0/1589761068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c500d3ee0 0x7f6c500cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4dffb640 1 -- 172.21.15.137:0/1589761068 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519533085 0 0) 0x7f6c500d03a0 con 0x7f6c5015f370 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4dffb640 1 -- 172.21.15.137:0/1589761068 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c38003520 con 0x7f6c5015f370 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4f7fe640 1 -- 172.21.15.137:0/1589761068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c500d3ee0 msgr2=0x7f6c500cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4f7fe640 1 --2- 172.21.15.137:0/1589761068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c500d3ee0 0x7f6c500cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4f7fe640 1 -- 172.21.15.137:0/1589761068 >> v1:172.21.15.137:6789/0 conn(0x7f6c5015f370 legacy=0x7f6c500d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4f7fe640 1 -- 172.21.15.137:0/1589761068 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c500d0960 con 0x7f6c5015f750 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.157+0000 7f6c4e7fc640 1 --2- 172.21.15.137:0/1589761068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c500d3ee0 0x7f6c500cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.158+0000 7f6c4f7fe640 1 --2- 172.21.15.137:0/1589761068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5015f750 0x7f6c500b47d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009d90 tx=0x7f6c4802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd55e1f1ad75fc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.158+0000 7f6c4dffb640 1 -- 172.21.15.137:0/1589761068 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48007740 con 0x7f6c5015f750 2024-04-26T22:07:46.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.158+0000 7f6c4dffb640 1 -- 172.21.15.137:0/1589761068 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c480078e0 con 0x7f6c5015f750 2024-04-26T22:07:46.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.158+0000 7f6c4dffb640 1 -- 172.21.15.137:0/1589761068 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c48007c90 con 0x7f6c5015f750 2024-04-26T22:07:46.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.159+0000 7f6c5572b640 1 -- 172.21.15.137:0/1589761068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5015f750 msgr2=0x7f6c500b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.159+0000 7f6c5572b640 1 --2- 172.21.15.137:0/1589761068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5015f750 0x7f6c500b47d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009d90 tx=0x7f6c4802a660 comp rx=0 tx=0).stop 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.159+0000 7f6c5572b640 1 -- 172.21.15.137:0/1589761068 shutdown_connections 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.159+0000 7f6c5572b640 1 --2- 172.21.15.137:0/1589761068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5015f750 0x7f6c500b47d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.159+0000 7f6c5572b640 1 --2- 172.21.15.137:0/1589761068 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c500d3ee0 0x7f6c500cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.159+0000 7f6c5572b640 1 -- 172.21.15.137:0/1589761068 >> 172.21.15.137:0/1589761068 conn(0x7f6c5008ec10 msgr2=0x7f6c5009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.159+0000 7f6c5572b640 1 -- 172.21.15.137:0/1589761068 shutdown_connections 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.159+0000 7f6c5572b640 1 -- 172.21.15.137:0/1589761068 wait complete. 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.160+0000 7f6c5572b640 1 Processor -- start 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.160+0000 7f6c5572b640 1 -- start start 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c5572b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c500d3ee0 0x7f6c500cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c5572b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5015f370 0x7f6c500ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c5572b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5015f750 0x7f6c50155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c5572b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500b51c0 con 0x7f6c500d3ee0 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c5572b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500d0f20 con 0x7f6c5015f370 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c5572b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f6c500b5340 con 0x7f6c5015f750 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c500d3ee0 0x7f6c500cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c500d3ee0 0x7f6c500cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54788/0 (socket says 172.21.15.137:54788) 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4effd640 1 -- 172.21.15.137:0/3624096811 learned_addr learned my addr 172.21.15.137:0/3624096811 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4f7fe640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5015f750 0x7f6c50155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4e7fc640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5015f370 0x7f6c500ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4effd640 1 -- 172.21.15.137:0/3624096811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5015f750 msgr2=0x7f6c50155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4effd640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5015f750 0x7f6c50155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4effd640 1 -- 172.21.15.137:0/3624096811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5015f370 msgr2=0x7f6c500ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4effd640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5015f370 0x7f6c500ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4effd640 1 -- 172.21.15.137:0/3624096811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c500cd7d0 con 0x7f6c500d3ee0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.161+0000 7f6c4effd640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c500d3ee0 0x7f6c500cefa0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000c460 tx=0x7f6c4000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.162+0000 7f6c377fe640 1 -- 172.21.15.137:0/3624096811 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40017070 con 0x7f6c500d3ee0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.162+0000 7f6c377fe640 1 -- 172.21.15.137:0/3624096811 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c40005ce0 con 0x7f6c500d3ee0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.162+0000 7f6c377fe640 1 -- 172.21.15.137:0/3624096811 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c40007290 con 0x7f6c500d3ee0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.162+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c500cdab0 con 0x7f6c500d3ee0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.162+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c500ce070 con 0x7f6c500d3ee0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.163+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c500ce450 con 0x7f6c500d3ee0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.163+0000 7f6c377fe640 1 -- 172.21.15.137:0/3624096811 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c4001a070 con 0x7f6c500d3ee0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.163+0000 7f6c377fe640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c3c06c8f0 0x7f6c3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.163+0000 7f6c377fe640 1 -- 172.21.15.137:0/3624096811 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f6c4008aea0 con 0x7f6c500d3ee0 2024-04-26T22:07:46.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.163+0000 7f6c4e7fc640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c3c06c8f0 0x7f6c3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:46.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.164+0000 7f6c4e7fc640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c3c06c8f0 0x7f6c3c06edb0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009560 tx=0x7f6c44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:46.167 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.168+0000 7f6c377fe640 1 -- 172.21.15.137:0/3624096811 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f6c500ce450 con 0x7f6c500d3ee0 2024-04-26T22:07:46.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.383+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6c5006eae0 con 0x7f6c500d3ee0 2024-04-26T22:07:46.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.383+0000 7f6c377fe640 1 -- 172.21.15.137:0/3624096811 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) ==== 53+0+73 (secure 0 0 0) 0x7f6c40059360 con 0x7f6c500d3ee0 2024-04-26T22:07:46.383 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:07:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c3c06c8f0 msgr2=0x7f6c3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c3c06c8f0 0x7f6c3c06edb0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009560 tx=0x7f6c44008040 comp rx=0 tx=0).stop 2024-04-26T22:07:46.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c500d3ee0 msgr2=0x7f6c500cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c500d3ee0 0x7f6c500cefa0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000c460 tx=0x7f6c4000c920 comp rx=0 tx=0).stop 2024-04-26T22:07:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 shutdown_connections 2024-04-26T22:07:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f6c3c06c8f0 0x7f6c3c06edb0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6c5015f750 0x7f6c50155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6c5015f370 0x7f6c500ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 --2- 172.21.15.137:0/3624096811 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6c500d3ee0 0x7f6c500cefa0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 >> 172.21.15.137:0/3624096811 conn(0x7f6c5008ec10 msgr2=0x7f6c500d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 shutdown_connections 2024-04-26T22:07:46.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46.385+0000 7f6c5572b640 1 -- 172.21.15.137:0/3624096811 wait complete. 2024-04-26T22:07:46.396 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:07:46.396 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:07:46.397 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:07:46.397 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:07:46.397 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:46.397 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:07:46.397 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:07:46.397 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:07:46.397 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:07:46.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:46.397 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:07:46.412 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:07:46.412 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:07:46.412 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:07:46.412 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:46.412 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42240sec preferred_lft 42240sec 2024-04-26T22:07:46.413 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:07:46.414 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:46.415 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:07:46.415 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:07:46.415 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:07:46.415 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:46.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:46.415 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:07:46.475 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:07:46.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:46.476 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:07:46.532 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:07:46.532 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:07:46.532 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:07:46.532 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:07:46.532 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:07:46.533 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:07:46.533 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:07:46.533 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:07:46.533 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:07:46.533 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:07:46.533 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:07:46.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:07:46.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:46.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:46.656 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:07:46.670 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:07:46.670 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:07:46.670 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:07:46.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:46.671 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:07:46.734 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:07:46.734 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:46.789 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:07:46.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:07:46.789 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:46.843 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:07:46.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:46.844 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:07:46.924 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:07:46.925 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:07:46.932 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:07:46.932 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:07:46.932 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:07:46.932 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:07:46.932 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:07:46.932 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:07:46.932 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:07:46.932 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:07:46.933 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:07:46.933 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:07:46.934 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:07:46.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:46.934 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:46.998 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:07:47.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:07:47.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:47.094 INFO:teuthology.orchestra.run.smithi137.stdout:client7570 2024-04-26T22:07:47.094 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:47.094 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:47.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:47.110 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-04-26T22:07:47.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:47.169 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-04-26T22:07:47.251 INFO:teuthology.orchestra.run.smithi137.stderr:8+0 records in 2024-04-26T22:07:47.251 INFO:teuthology.orchestra.run.smithi137.stderr:8+0 records out 2024-04-26T22:07:47.251 INFO:teuthology.orchestra.run.smithi137.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0241529 s, 347 MB/s 2024-04-26T22:07:47.251 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:47.252 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:47.252 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:47.252 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:47.252 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-26T22:07:47.252 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:47.356 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627779 2024-04-26T22:07:47.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:47.366 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:47.366 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:47.366 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:47.366 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:47.366 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-26T22:07:47.366 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:47.470 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627780 2024-04-26T22:07:47.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:47.479 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:47.479 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:47.536 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:47.536 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:47.592 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:47.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.729+0000 7fe4f183f640 1 Processor -- start 2024-04-26T22:07:47.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.729+0000 7fe4f183f640 1 -- start start 2024-04-26T22:07:47.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.729+0000 7fe4f183f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec0b61a0 0x7fe4ec160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:47.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4f183f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec0b4530 con 0x7fe4ec0b3de0 2024-04-26T22:07:47.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4f183f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ec0b4810 con 0x7fe4ec145980 2024-04-26T22:07:47.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4f183f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ec0b5140 con 0x7fe4ec0b61a0 2024-04-26T22:07:47.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4eb7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe4ec0b3de0 0x7fe4ec0720d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58622/0 (socket says 172.21.15.137:58622) 2024-04-26T22:07:47.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4eb7fe640 1 -- 172.21.15.137:0/2698134980 learned_addr learned my addr 172.21.15.137:0/2698134980 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:47.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390310345 0 0) 0x7fe4ec0b4530 con 0x7fe4ec0b3de0 2024-04-26T22:07:47.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4ea7fc640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec0b61a0 0x7fe4ec160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:47.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4d4003520 con 0x7fe4ec0b3de0 2024-04-26T22:07:47.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3350720208 0 0) 0x7fe4d4003520 con 0x7fe4ec0b3de0 2024-04-26T22:07:47.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec0b61a0 msgr2=0x7fe4ec160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:47.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec0b61a0 0x7fe4ec160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:47.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 >> v1:172.21.15.170:6789/0 conn(0x7fe4ec145980 legacy=0x7fe4ec0b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:47.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec0b4af0 con 0x7fe4ec0b3de0 2024-04-26T22:07:47.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fe4e40019f0 con 0x7fe4ec0b3de0 2024-04-26T22:07:47.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 >> v1:172.21.15.137:6789/0 conn(0x7fe4ec0b3de0 legacy=0x7fe4ec0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:47.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4d40039e0 0x7fe4d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d4004800 0x7fe4d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec0b61a0 0x7fe4d4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec0b5140 con 0x7fe4d40039e0 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d40099e0 con 0x7fe4d4004800 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d4009be0 con 0x7fe4ec0b61a0 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4eaffd640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4d40039e0 0x7fe4d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.730+0000 7fe4ea7fc640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d4004800 0x7fe4d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.731+0000 7fe4eb7fe640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec0b61a0 0x7fe4d4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.731+0000 7fe4eaffd640 1 -- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec0b61a0 msgr2=0x7fe4d4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.731+0000 7fe4eaffd640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec0b61a0 0x7fe4d4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.731+0000 7fe4eaffd640 1 -- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d4004800 msgr2=0x7fe4d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.731+0000 7fe4eaffd640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d4004800 0x7fe4d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.731+0000 7fe4eaffd640 1 -- 172.21.15.137:0/2698134980 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d4003520 con 0x7fe4d40039e0 2024-04-26T22:07:47.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.731+0000 7fe4eaffd640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4d40039e0 0x7fe4d4003e00 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc012d20 tx=0x7fe4d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7613e42a4fabf9a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.731+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc0129f0 con 0x7fe4d40039e0 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.732+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4dc0052d0 con 0x7fe4d40039e0 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.732+0000 7fe4e9ffb640 1 -- 172.21.15.137:0/2698134980 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc012310 con 0x7fe4d40039e0 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.732+0000 7fe4f183f640 1 -- 172.21.15.137:0/2698134980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4d40039e0 msgr2=0x7fe4d4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.732+0000 7fe4f183f640 1 --2- 172.21.15.137:0/2698134980 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4d40039e0 0x7fe4d4003e00 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc012d20 tx=0x7fe4d4005830 comp rx=0 tx=0).stop 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.732+0000 7fe4eb7fe640 1 -- 172.21.15.137:0/2698134980 reap_dead start 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.732+0000 7fe4f183f640 1 -- 172.21.15.137:0/2698134980 shutdown_connections 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.732+0000 7fe4f183f640 1 -- 172.21.15.137:0/2698134980 >> 172.21.15.137:0/2698134980 conn(0x7fe4ec0d0d30 msgr2=0x7fe4ec0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.732+0000 7fe4f183f640 1 -- 172.21.15.137:0/2698134980 shutdown_connections 2024-04-26T22:07:47.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.732+0000 7fe4f183f640 1 -- 172.21.15.137:0/2698134980 wait complete. 2024-04-26T22:07:47.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.733+0000 7fe4f183f640 1 Processor -- start 2024-04-26T22:07:47.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.733+0000 7fe4f183f640 1 -- start start 2024-04-26T22:07:47.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4f183f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d40039e0 0x7fe4ec1e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:47.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4f183f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ec139620 0x7fe4ec13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:47.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4f183f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec13bb20 0x7fe4ec0b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:47.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4f183f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec160630 con 0x7fe4ec139620 2024-04-26T22:07:47.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4f183f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec0b4240 con 0x7fe4d40039e0 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4f183f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ec1607b0 con 0x7fe4ec13bb20 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4ea7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ec139620 0x7fe4ec13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4ea7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ec139620 0x7fe4ec13b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54794/0 (socket says 172.21.15.137:54794) 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4ea7fc640 1 -- 172.21.15.137:0/714116298 learned_addr learned my addr 172.21.15.137:0/714116298 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4eb7fe640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec13bb20 0x7fe4ec0b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4eaffd640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d40039e0 0x7fe4ec1e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4ea7fc640 1 -- 172.21.15.137:0/714116298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec13bb20 msgr2=0x7fe4ec0b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4ea7fc640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec13bb20 0x7fe4ec0b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4ea7fc640 1 -- 172.21.15.137:0/714116298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d40039e0 msgr2=0x7fe4ec1e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4ea7fc640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d40039e0 0x7fe4ec1e6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.734+0000 7fe4ea7fc640 1 -- 172.21.15.137:0/714116298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec139ab0 con 0x7fe4ec139620 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.735+0000 7fe4ea7fc640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ec139620 0x7fe4ec13b5e0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00119d0 tx=0x7fe4e0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.735+0000 7fe4d3fff640 1 -- 172.21.15.137:0/714116298 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000fb50 con 0x7fe4ec139620 2024-04-26T22:07:47.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.735+0000 7fe4d3fff640 1 -- 172.21.15.137:0/714116298 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e000fcf0 con 0x7fe4ec139620 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.735+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ec139d90 con 0x7fe4ec139620 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.735+0000 7fe4d3fff640 1 -- 172.21.15.137:0/714116298 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000fea0 con 0x7fe4ec139620 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.735+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ec13a350 con 0x7fe4ec139620 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.736+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4ec0d1640 con 0x7fe4ec139620 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.736+0000 7fe4d3fff640 1 -- 172.21.15.137:0/714116298 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe4e0012040 con 0x7fe4ec139620 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.737+0000 7fe4d3fff640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4d806c8f0 0x7fe4d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.737+0000 7fe4d3fff640 1 -- 172.21.15.137:0/714116298 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7fe4e008c150 con 0x7fe4ec139620 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.737+0000 7fe4eaffd640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4d806c8f0 0x7fe4d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.737+0000 7fe4eaffd640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4d806c8f0 0x7fe4d806edb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc039000 tx=0x7fe4dc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:47.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.741+0000 7fe4d3fff640 1 -- 172.21.15.137:0/714116298 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe4ec0d1640 con 0x7fe4ec139620 2024-04-26T22:07:47.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.918+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4ec06a290 con 0x7fe4ec139620 2024-04-26T22:07:47.919 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.920+0000 7fe4d3fff640 1 -- 172.21.15.137:0/714116298 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) ==== 74+0+16639 (secure 0 0 0) 0x7fe4e0019030 con 0x7fe4ec139620 2024-04-26T22:07:47.920 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:47.920 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":115,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:38.555671+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:47.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4d806c8f0 msgr2=0x7fe4d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:47.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4d806c8f0 0x7fe4d806edb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc039000 tx=0x7fe4dc03c040 comp rx=0 tx=0).stop 2024-04-26T22:07:47.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ec139620 msgr2=0x7fe4ec13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:47.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ec139620 0x7fe4ec13b5e0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fe4e00119d0 tx=0x7fe4e0011e90 comp rx=0 tx=0).stop 2024-04-26T22:07:47.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 shutdown_connections 2024-04-26T22:07:47.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe4d806c8f0 0x7fe4d806edb0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:47.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe4ec139620 0x7fe4ec13b5e0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:47.922 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe4ec13bb20 0x7fe4ec0b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:47.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 --2- 172.21.15.137:0/714116298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4d40039e0 0x7fe4ec1e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:47.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 >> 172.21.15.137:0/714116298 conn(0x7fe4ec0d0d30 msgr2=0x7fe4ec1436a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:47.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 shutdown_connections 2024-04-26T22:07:47.923 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:47.922+0000 7fe4f183f640 1 -- 172.21.15.137:0/714116298 wait complete. 2024-04-26T22:07:47.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:07:35.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:07:35.848066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:07:47.933 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:07:48.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.033+0000 7f2e8bff2640 1 Processor -- start 2024-04-26T22:07:48.033 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.033+0000 7f2e8bff2640 1 -- start start 2024-04-26T22:07:48.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e8bff2640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2e840b4e00 0x7f2e840ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e8bff2640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8415f640 con 0x7f2e84070560 2024-04-26T22:07:48.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e8bff2640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8406c2a0 con 0x7f2e8415f260 2024-04-26T22:07:48.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e8bff2640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2e8406c580 con 0x7f2e840b4e00 2024-04-26T22:07:48.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e8958d640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2e84070560 0x7f2e840b46f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58632/0 (socket says 172.21.15.137:58632) 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e8958d640 1 -- 172.21.15.137:0/3785620371 learned_addr learned my addr 172.21.15.137:0/3785620371 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e8a58f640 1 --2- 172.21.15.137:0/3785620371 >> v2:172.21.15.170:3300/0 conn(0x7f2e840b4e00 0x7f2e840ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328230932 0 0) 0x7f2e8415f640 con 0x7f2e84070560 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e70003520 con 0x7f2e84070560 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 859532455 0 0) 0x7f2e70003520 con 0x7f2e84070560 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 >> v2:172.21.15.170:3300/0 conn(0x7f2e840b4e00 msgr2=0x7f2e840ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 --2- 172.21.15.137:0/3785620371 >> v2:172.21.15.170:3300/0 conn(0x7f2e840b4e00 0x7f2e840ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 >> v1:172.21.15.170:6789/0 conn(0x7f2e8415f260 legacy=0x7f2e8406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8406c860 con 0x7f2e84070560 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f2e74001670 con 0x7f2e84070560 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 >> v1:172.21.15.137:6789/0 conn(0x7f2e84070560 legacy=0x7f2e840b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e700039b0 0x7f2e70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e70004800 0x7f2e70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e700051c0 0x7f2e7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8406c580 con 0x7f2e700051c0 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7000c060 con 0x7f2e70004800 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.034+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e7000c260 con 0x7f2e700039b0 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e8a58f640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e700051c0 0x7f2e7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e8958d640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e70004800 0x7f2e70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e89d8e640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e700039b0 0x7f2e70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e8a58f640 1 -- 172.21.15.137:0/3785620371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e700039b0 msgr2=0x7f2e70003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e8a58f640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e700039b0 0x7f2e70003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e8a58f640 1 -- 172.21.15.137:0/3785620371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e70004800 msgr2=0x7f2e70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e8a58f640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e70004800 0x7f2e70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e8a58f640 1 -- 172.21.15.137:0/3785620371 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e70003520 con 0x7f2e700051c0 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e8a58f640 1 -- 172.21.15.137:0/3785620371 reap_dead start 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.035+0000 7f2e8a58f640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e700051c0 0x7f2e7000b9c0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009f90 tx=0x7f2e70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2797a3950a8b33fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c035020 con 0x7f2e700051c0 2024-04-26T22:07:48.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c003b90 con 0x7f2e700051c0 2024-04-26T22:07:48.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e88d8c640 1 -- 172.21.15.137:0/3785620371 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c009c10 con 0x7f2e700051c0 2024-04-26T22:07:48.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e8bff2640 1 -- 172.21.15.137:0/3785620371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e700051c0 msgr2=0x7f2e7000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e8bff2640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e700051c0 0x7f2e7000b9c0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009f90 tx=0x7f2e70005830 comp rx=0 tx=0).stop 2024-04-26T22:07:48.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e8bff2640 1 -- 172.21.15.137:0/3785620371 shutdown_connections 2024-04-26T22:07:48.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e8bff2640 1 --2- 172.21.15.137:0/3785620371 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e700051c0 0x7f2e7000b9c0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e8bff2640 1 -- 172.21.15.137:0/3785620371 >> 172.21.15.137:0/3785620371 conn(0x7f2e840d1660 msgr2=0x7f2e840d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:48.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e8bff2640 1 -- 172.21.15.137:0/3785620371 shutdown_connections 2024-04-26T22:07:48.039 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.036+0000 7f2e8bff2640 1 -- 172.21.15.137:0/3785620371 wait complete. 2024-04-26T22:07:48.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.037+0000 7f2e8bff2640 1 Processor -- start 2024-04-26T22:07:48.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.037+0000 7f2e8bff2640 1 -- start start 2024-04-26T22:07:48.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8bff2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e700051c0 0x7f2e8414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8bff2640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e841f9330 0x7f2e84161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8bff2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e84161f40 0x7f2e8406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8bff2640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8406d100 con 0x7f2e84161f40 2024-04-26T22:07:48.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8bff2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8406ce20 con 0x7f2e700051c0 2024-04-26T22:07:48.042 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8bff2640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8406ebe0 con 0x7f2e841f9330 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8a58f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e84161f40 0x7f2e8406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8a58f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e84161f40 0x7f2e8406ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54804/0 (socket says 172.21.15.137:54804) 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8a58f640 1 -- 172.21.15.137:0/199058090 learned_addr learned my addr 172.21.15.137:0/199058090 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8958d640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e841f9330 0x7f2e84161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e89d8e640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e700051c0 0x7f2e8414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8a58f640 1 -- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e841f9330 msgr2=0x7f2e84161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8a58f640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e841f9330 0x7f2e84161a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8a58f640 1 -- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e700051c0 msgr2=0x7f2e8414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8a58f640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e700051c0 0x7f2e8414c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8a58f640 1 -- 172.21.15.137:0/199058090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8414c6e0 con 0x7f2e84161f40 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e8958d640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e841f9330 0x7f2e84161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.038+0000 7f2e89d8e640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e700051c0 0x7f2e8414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.039+0000 7f2e8a58f640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e84161f40 0x7f2e8406ef70 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00e230 tx=0x7f2e7c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.043 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.039+0000 7f2e7a7fc640 1 -- 172.21.15.137:0/199058090 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c035070 con 0x7f2e84161f40 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.039+0000 7f2e7a7fc640 1 -- 172.21.15.137:0/199058090 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7c041070 con 0x7f2e84161f40 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.039+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e841624c0 con 0x7f2e84161f40 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.039+0000 7f2e7a7fc640 1 -- 172.21.15.137:0/199058090 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c009c10 con 0x7f2e84161f40 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.039+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e841f8b30 con 0x7f2e84161f40 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.040+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8406a290 con 0x7f2e84161f40 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.040+0000 7f2e7a7fc640 1 -- 172.21.15.137:0/199058090 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e7c005d10 con 0x7f2e84161f40 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.041+0000 7f2e7a7fc640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e6806c920 0x7f2e6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.041+0000 7f2e89d8e640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e6806c920 0x7f2e6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.041+0000 7f2e7a7fc640 1 -- 172.21.15.137:0/199058090 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f2e7c0ac2b0 con 0x7f2e84161f40 2024-04-26T22:07:48.044 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.041+0000 7f2e89d8e640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e6806c920 0x7f2e6806ede0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2e80005580 tx=0x7f2e80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.045 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.045+0000 7f2e7a7fc640 1 -- 172.21.15.137:0/199058090 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2e7c07a6e0 con 0x7f2e84161f40 2024-04-26T22:07:48.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.218+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2e84163ca0 con 0x7f2e84161f40 2024-04-26T22:07:48.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.219+0000 7f2e7a7fc640 1 -- 172.21.15.137:0/199058090 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) ==== 93+0+10 (secure 0 0 0) 0x7f2e7c0ac0d0 con 0x7f2e84161f40 2024-04-26T22:07:48.219 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e6806c920 msgr2=0x7f2e6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e6806c920 0x7f2e6806ede0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2e80005580 tx=0x7f2e80009040 comp rx=0 tx=0).stop 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e84161f40 msgr2=0x7f2e8406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e84161f40 0x7f2e8406ef70 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c00e230 tx=0x7f2e7c009750 comp rx=0 tx=0).stop 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 shutdown_connections 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e6806c920 0x7f2e6806ede0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2e84161f40 0x7f2e8406ef70 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2e841f9330 0x7f2e84161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 --2- 172.21.15.137:0/199058090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e700051c0 0x7f2e8414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 >> 172.21.15.137:0/199058090 conn(0x7f2e840d1660 msgr2=0x7f2e8415cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 shutdown_connections 2024-04-26T22:07:48.221 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.221+0000 7f2e8bff2640 1 -- 172.21.15.137:0/199058090 wait complete. 2024-04-26T22:07:48.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:07:48.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.333+0000 7f657fed9640 1 Processor -- start 2024-04-26T22:07:48.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.333+0000 7f657fed9640 1 -- start start 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657fed9640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6578070560 0x7f65780b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657fed9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f657806ebe0 0x7f65780b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657fed9640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657815f640 con 0x7f657815f260 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657fed9640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f657806c2a0 con 0x7f6578070560 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657fed9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f657806c580 con 0x7f657806ebe0 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657d474640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f6578070560 0x7f65780b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657dc75640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f657815f260 0x7f657806d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58642/0 (socket says 172.21.15.137:58642) 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657dc75640 1 -- 172.21.15.137:0/3670428854 learned_addr learned my addr 172.21.15.137:0/3670428854 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657e476640 1 --2- 172.21.15.137:0/3670428854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f657806ebe0 0x7f65780b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657d474640 1 -- 172.21.15.137:0/3670428854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f657806ebe0 msgr2=0x7f65780b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:48.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657d474640 1 --2- 172.21.15.137:0/3670428854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f657806ebe0 0x7f65780b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657d474640 1 -- 172.21.15.137:0/3670428854 >> v1:172.21.15.137:6789/0 conn(0x7f657815f260 legacy=0x7f657806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657d474640 1 -- 172.21.15.137:0/3670428854 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657806c860 con 0x7f6578070560 2024-04-26T22:07:48.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657cc73640 1 -- 172.21.15.137:0/3670428854 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978402280 0 0) 0x7f657815f640 con 0x7f657815f260 2024-04-26T22:07:48.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.334+0000 7f657e476640 1 --2- 172.21.15.137:0/3670428854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f657806ebe0 0x7f65780b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:48.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.335+0000 7f657d474640 1 --2- 172.21.15.137:0/3670428854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6578070560 0x7f65780b46f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f65680097a0 tx=0x7f656802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268d295260f3928b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.335+0000 7f657cc73640 1 -- 172.21.15.137:0/3670428854 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568037070 con 0x7f6578070560 2024-04-26T22:07:48.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.335+0000 7f657cc73640 1 -- 172.21.15.137:0/3670428854 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6568032440 con 0x7f6578070560 2024-04-26T22:07:48.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.335+0000 7f657cc73640 1 -- 172.21.15.137:0/3670428854 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568032810 con 0x7f6578070560 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.336+0000 7f657fed9640 1 -- 172.21.15.137:0/3670428854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6578070560 msgr2=0x7f65780b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.336+0000 7f657fed9640 1 --2- 172.21.15.137:0/3670428854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6578070560 0x7f65780b46f0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f65680097a0 tx=0x7f656802a180 comp rx=0 tx=0).stop 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.336+0000 7f657fed9640 1 -- 172.21.15.137:0/3670428854 shutdown_connections 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.336+0000 7f657fed9640 1 --2- 172.21.15.137:0/3670428854 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f657806ebe0 0x7f65780b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.336+0000 7f657fed9640 1 --2- 172.21.15.137:0/3670428854 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f6578070560 0x7f65780b46f0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.336+0000 7f657fed9640 1 -- 172.21.15.137:0/3670428854 >> 172.21.15.137:0/3670428854 conn(0x7f65780d1660 msgr2=0x7f65780d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.336+0000 7f657fed9640 1 -- 172.21.15.137:0/3670428854 shutdown_connections 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.336+0000 7f657fed9640 1 -- 172.21.15.137:0/3670428854 wait complete. 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.337+0000 7f657fed9640 1 Processor -- start 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.337+0000 7f657fed9640 1 -- start start 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657fed9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657806ebe0 0x7f65781f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657fed9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6578070560 0x7f65781f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657fed9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657815f260 0x7f65780ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657fed9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f657806d100 con 0x7f657806ebe0 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657fed9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f657806ce20 con 0x7f657815f260 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657fed9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f65780ae8b0 con 0x7f6578070560 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657dc75640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657806ebe0 0x7f65781f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657dc75640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657806ebe0 0x7f65781f4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54818/0 (socket says 172.21.15.137:54818) 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657dc75640 1 -- 172.21.15.137:0/2006015032 learned_addr learned my addr 172.21.15.137:0/2006015032 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657dc75640 1 -- 172.21.15.137:0/2006015032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6578070560 msgr2=0x7f65781f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657dc75640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6578070560 0x7f65781f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657dc75640 1 -- 172.21.15.137:0/2006015032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657815f260 msgr2=0x7f65780ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657dc75640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657815f260 0x7f65780ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657dc75640 1 -- 172.21.15.137:0/2006015032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65781622f0 con 0x7f657806ebe0 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657dc75640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657806ebe0 0x7f65781f4890 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f657400c430 tx=0x7f657400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f656e7fc640 1 -- 172.21.15.137:0/2006015032 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740074e0 con 0x7f657806ebe0 2024-04-26T22:07:48.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f656e7fc640 1 -- 172.21.15.137:0/2006015032 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65740047e0 con 0x7f657806ebe0 2024-04-26T22:07:48.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f656e7fc640 1 -- 172.21.15.137:0/2006015032 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574004bd0 con 0x7f657806ebe0 2024-04-26T22:07:48.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65781625d0 con 0x7f657806ebe0 2024-04-26T22:07:48.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.338+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65781e8f20 con 0x7f657806ebe0 2024-04-26T22:07:48.341 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.339+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65780b0370 con 0x7f657806ebe0 2024-04-26T22:07:48.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.340+0000 7f656e7fc640 1 -- 172.21.15.137:0/2006015032 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6574011070 con 0x7f657806ebe0 2024-04-26T22:07:48.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.340+0000 7f656e7fc640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655c06c8f0 0x7f655c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.340+0000 7f657d474640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655c06c8f0 0x7f655c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.340+0000 7f656e7fc640 1 -- 172.21.15.137:0/2006015032 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f657408b8a0 con 0x7f657806ebe0 2024-04-26T22:07:48.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.341+0000 7f657d474640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655c06c8f0 0x7f655c06edb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6568034000 tx=0x7f656802c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.345+0000 7f656e7fc640 1 -- 172.21.15.137:0/2006015032 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f65780b0370 con 0x7f657806ebe0 2024-04-26T22:07:48.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.520+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f65780682b0 con 0x7f657806ebe0 2024-04-26T22:07:48.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.520+0000 7f656e7fc640 1 -- 172.21.15.137:0/2006015032 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) ==== 104+0+11 (secure 0 0 0) 0x7f6574059c40 con 0x7f657806ebe0 2024-04-26T22:07:48.521 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:07:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655c06c8f0 msgr2=0x7f655c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655c06c8f0 0x7f655c06edb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6568034000 tx=0x7f656802c000 comp rx=0 tx=0).stop 2024-04-26T22:07:48.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657806ebe0 msgr2=0x7f65781f4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657806ebe0 0x7f65781f4890 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f657400c430 tx=0x7f657400c8f0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 shutdown_connections 2024-04-26T22:07:48.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f655c06c8f0 0x7f655c06edb0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f657815f260 0x7f65780ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f6578070560 0x7f65781f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 --2- 172.21.15.137:0/2006015032 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f657806ebe0 0x7f65781f4890 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 >> 172.21.15.137:0/2006015032 conn(0x7f65780d1660 msgr2=0x7f657815da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:48.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 shutdown_connections 2024-04-26T22:07:48.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.522+0000 7f657fed9640 1 -- 172.21.15.137:0/2006015032 wait complete. 2024-04-26T22:07:48.534 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:07:48.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.633+0000 7f991e0bd640 1 Processor -- start 2024-04-26T22:07:48.634 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.633+0000 7f991e0bd640 1 -- start start 2024-04-26T22:07:48.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.634+0000 7f991e0bd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f991806f340 0x7f99180b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.634+0000 7f991e0bd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99180d0300 0x7f991806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.634+0000 7f991e0bd640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f991806fc60 con 0x7f99180b3e50 2024-04-26T22:07:48.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.634+0000 7f991e0bd640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f99180b46a0 con 0x7f991806f340 2024-04-26T22:07:48.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.634+0000 7f991e0bd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f99180b5db0 con 0x7f99180d0300 2024-04-26T22:07:48.635 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.634+0000 7f99177fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f991806f340 0x7f99180b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.634+0000 7f9916ffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99180d0300 0x7f991806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.634+0000 7f99177fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f991806f340 0x7f99180b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:55760/0 (socket says 172.21.15.137:55760) 2024-04-26T22:07:48.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.634+0000 7f99177fe640 1 -- 172.21.15.137:0/1404452560 learned_addr learned my addr 172.21.15.137:0/1404452560 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:48.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.635+0000 7f9916ffd640 1 -- 172.21.15.137:0/1404452560 >> v2:172.21.15.170:3300/0 conn(0x7f991806f340 msgr2=0x7f99180b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:48.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.635+0000 7f9916ffd640 1 --2- 172.21.15.137:0/1404452560 >> v2:172.21.15.170:3300/0 conn(0x7f991806f340 0x7f99180b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.635+0000 7f9916ffd640 1 -- 172.21.15.137:0/1404452560 >> v1:172.21.15.170:6789/0 conn(0x7f99180b3e50 legacy=0x7f99180720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.635+0000 7f9916ffd640 1 -- 172.21.15.137:0/1404452560 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99180b6090 con 0x7f99180d0300 2024-04-26T22:07:48.636 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.635+0000 7f99177fe640 1 --2- 172.21.15.137:0/1404452560 >> v2:172.21.15.170:3300/0 conn(0x7f991806f340 0x7f99180b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:48.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.635+0000 7f9916ffd640 1 --2- 172.21.15.137:0/1404452560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99180d0300 0x7f991806f720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f990c0097a0 tx=0x7f990c02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a22eebf2e46c762 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.635+0000 7f99167fc640 1 -- 172.21.15.137:0/1404452560 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c037070 con 0x7f99180d0300 2024-04-26T22:07:48.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.635+0000 7f99167fc640 1 -- 172.21.15.137:0/1404452560 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990c02adb0 con 0x7f99180d0300 2024-04-26T22:07:48.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.635+0000 7f99167fc640 1 -- 172.21.15.137:0/1404452560 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c032660 con 0x7f99180d0300 2024-04-26T22:07:48.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.636+0000 7f991e0bd640 1 -- 172.21.15.137:0/1404452560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99180d0300 msgr2=0x7f991806f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.636+0000 7f991e0bd640 1 --2- 172.21.15.137:0/1404452560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99180d0300 0x7f991806f720 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f990c0097a0 tx=0x7f990c02a060 comp rx=0 tx=0).stop 2024-04-26T22:07:48.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.636+0000 7f991e0bd640 1 -- 172.21.15.137:0/1404452560 shutdown_connections 2024-04-26T22:07:48.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.636+0000 7f991e0bd640 1 --2- 172.21.15.137:0/1404452560 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f99180d0300 0x7f991806f720 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.637 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.636+0000 7f991e0bd640 1 --2- 172.21.15.137:0/1404452560 >> v2:172.21.15.170:3300/0 conn(0x7f991806f340 0x7f99180b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.636+0000 7f991e0bd640 1 -- 172.21.15.137:0/1404452560 >> 172.21.15.137:0/1404452560 conn(0x7f99180cd8a0 msgr2=0x7f99180cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:48.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.636+0000 7f991e0bd640 1 -- 172.21.15.137:0/1404452560 shutdown_connections 2024-04-26T22:07:48.638 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.636+0000 7f991e0bd640 1 -- 172.21.15.137:0/1404452560 wait complete. 2024-04-26T22:07:48.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.637+0000 7f991e0bd640 1 Processor -- start 2024-04-26T22:07:48.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.637+0000 7f991e0bd640 1 -- start start 2024-04-26T22:07:48.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f991e0bd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f991806f340 0x7f991813cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f991e0bd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99180b3e50 0x7f991815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f991e0bd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99180d0300 0x7f991813e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f991e0bd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f99180b42e0 con 0x7f99180b3e50 2024-04-26T22:07:48.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f991e0bd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f99180b6650 con 0x7f99180d0300 2024-04-26T22:07:48.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f991e0bd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f99180b4460 con 0x7f991806f340 2024-04-26T22:07:48.640 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f9916ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99180b3e50 0x7f991815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f9916ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99180b3e50 0x7f991815e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54830/0 (socket says 172.21.15.137:54830) 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f9916ffd640 1 -- 172.21.15.137:0/657111403 learned_addr learned my addr 172.21.15.137:0/657111403 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f99177fe640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f991806f340 0x7f991813cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f9917fff640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99180d0300 0x7f991813e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f9916ffd640 1 -- 172.21.15.137:0/657111403 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f991806f340 msgr2=0x7f991813cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f9916ffd640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f991806f340 0x7f991813cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f9916ffd640 1 -- 172.21.15.137:0/657111403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99180d0300 msgr2=0x7f991813e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f9916ffd640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99180d0300 0x7f991813e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.638+0000 7f9916ffd640 1 -- 172.21.15.137:0/657111403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99181e6fb0 con 0x7f99180b3e50 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.639+0000 7f9916ffd640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99180b3e50 0x7f991815e8f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f990c000c00 tx=0x7f990c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.639+0000 7f98fffff640 1 -- 172.21.15.137:0/657111403 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c041070 con 0x7f99180b3e50 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.639+0000 7f98fffff640 1 -- 172.21.15.137:0/657111403 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990c03c460 con 0x7f99180b3e50 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.639+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991815ee30 con 0x7f99180b3e50 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.639+0000 7f98fffff640 1 -- 172.21.15.137:0/657111403 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c037040 con 0x7f99180b3e50 2024-04-26T22:07:48.641 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.639+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99181f8a60 con 0x7f99180b3e50 2024-04-26T22:07:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.640+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991806a290 con 0x7f99180b3e50 2024-04-26T22:07:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.640+0000 7f98fffff640 1 -- 172.21.15.137:0/657111403 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f990c044070 con 0x7f99180b3e50 2024-04-26T22:07:48.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.641+0000 7f98fffff640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f990406c8f0 0x7f990406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.641+0000 7f98fffff640 1 -- 172.21.15.137:0/657111403 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f990c0ac180 con 0x7f99180b3e50 2024-04-26T22:07:48.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.641+0000 7f99177fe640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f990406c8f0 0x7f990406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.641+0000 7f99177fe640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f990406c8f0 0x7f990406edb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9908006ca0 tx=0x7f9908009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.645+0000 7f98fffff640 1 -- 172.21.15.137:0/657111403 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f990c079f60 con 0x7f99180b3e50 2024-04-26T22:07:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.821+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9918141800 con 0x7f99180b3e50 2024-04-26T22:07:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.822+0000 7f98fffff640 1 -- 172.21.15.137:0/657111403 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) ==== 100+0+11 (secure 0 0 0) 0x7f990c07e260 con 0x7f99180b3e50 2024-04-26T22:07:48.823 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:07:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f990406c8f0 msgr2=0x7f990406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f990406c8f0 0x7f990406edb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9908006ca0 tx=0x7f9908009240 comp rx=0 tx=0).stop 2024-04-26T22:07:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99180b3e50 msgr2=0x7f991815e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99180b3e50 0x7f991815e8f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f990c000c00 tx=0x7f990c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 shutdown_connections 2024-04-26T22:07:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f990406c8f0 0x7f990406edb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f99180b3e50 0x7f991815e8f0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f99180d0300 0x7f991813e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 --2- 172.21.15.137:0/657111403 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f991806f340 0x7f991813cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 >> 172.21.15.137:0/657111403 conn(0x7f99180cd8a0 msgr2=0x7f9918140120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 shutdown_connections 2024-04-26T22:07:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.824+0000 7f991e0bd640 1 -- 172.21.15.137:0/657111403 wait complete. 2024-04-26T22:07:48.836 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:07:48.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.933+0000 7f7e39b1b640 1 Processor -- start 2024-04-26T22:07:48.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.933+0000 7f7e39b1b640 1 -- start start 2024-04-26T22:07:48.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.933+0000 7f7e39b1b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7e3415f370 0x7f7e340cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.933+0000 7f7e39b1b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e340d3ee0 0x7f7e340b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.933+0000 7f7e39b1b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e340d03a0 con 0x7f7e3415f750 2024-04-26T22:07:48.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.933+0000 7f7e39b1b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f7e340b4d10 con 0x7f7e3415f370 2024-04-26T22:07:48.935 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.933+0000 7f7e39b1b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340d0680 con 0x7f7e340d3ee0 2024-04-26T22:07:48.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.934+0000 7f7e337fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f7e3415f370 0x7f7e340cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.934+0000 7f7e32ffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7e3415f750 0x7f7e340d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58652/0 (socket says 172.21.15.137:58652) 2024-04-26T22:07:48.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.934+0000 7f7e32ffd640 1 -- 172.21.15.137:0/2332613006 learned_addr learned my addr 172.21.15.137:0/2332613006 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:48.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.934+0000 7f7e33fff640 1 --2- 172.21.15.137:0/2332613006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e340d3ee0 0x7f7e340b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.934+0000 7f7e337fe640 1 -- 172.21.15.137:0/2332613006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e340d3ee0 msgr2=0x7f7e340b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:48.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.934+0000 7f7e337fe640 1 --2- 172.21.15.137:0/2332613006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e340d3ee0 0x7f7e340b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.934+0000 7f7e337fe640 1 -- 172.21.15.137:0/2332613006 >> v1:172.21.15.137:6789/0 conn(0x7f7e3415f750 legacy=0x7f7e340d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.934+0000 7f7e337fe640 1 -- 172.21.15.137:0/2332613006 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e340d0960 con 0x7f7e3415f370 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.934+0000 7f7e337fe640 1 --2- 172.21.15.137:0/2332613006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 0x7f7e340cfd70 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0097a0 tx=0x7f7e1c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c9216b4e3eb715 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e327fc640 1 -- 172.21.15.137:0/2332613006 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c037070 con 0x7f7e3415f370 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e327fc640 1 -- 172.21.15.137:0/2332613006 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c032440 con 0x7f7e3415f370 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e327fc640 1 -- 172.21.15.137:0/2332613006 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c032810 con 0x7f7e3415f370 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e39b1b640 1 -- 172.21.15.137:0/2332613006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 msgr2=0x7f7e340cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e39b1b640 1 --2- 172.21.15.137:0/2332613006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 0x7f7e340cfd70 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0097a0 tx=0x7f7e1c02a180 comp rx=0 tx=0).stop 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e39b1b640 1 -- 172.21.15.137:0/2332613006 shutdown_connections 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e39b1b640 1 --2- 172.21.15.137:0/2332613006 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e340d3ee0 0x7f7e340b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e39b1b640 1 --2- 172.21.15.137:0/2332613006 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 0x7f7e340cfd70 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e39b1b640 1 -- 172.21.15.137:0/2332613006 >> 172.21.15.137:0/2332613006 conn(0x7f7e3408ec10 msgr2=0x7f7e3409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:48.941 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e39b1b640 1 -- 172.21.15.137:0/2332613006 shutdown_connections 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.935+0000 7f7e39b1b640 1 -- 172.21.15.137:0/2332613006 wait complete. 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.936+0000 7f7e39b1b640 1 Processor -- start 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.936+0000 7f7e39b1b640 1 -- start start 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e39b1b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e340d3ee0 0x7f7e340ba670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e39b1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 0x7f7e340b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e39b1b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e3415f750 0x7f7e340ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e39b1b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340b51c0 con 0x7f7e3415f370 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e39b1b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340d0f20 con 0x7f7e3415f750 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e39b1b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340b5340 con 0x7f7e340d3ee0 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e32ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 0x7f7e340b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e32ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 0x7f7e340b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54850/0 (socket says 172.21.15.137:54850) 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e32ffd640 1 -- 172.21.15.137:0/952933706 learned_addr learned my addr 172.21.15.137:0/952933706 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:48.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e32ffd640 1 -- 172.21.15.137:0/952933706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e340d3ee0 msgr2=0x7f7e340ba670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e32ffd640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e340d3ee0 0x7f7e340ba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e32ffd640 1 -- 172.21.15.137:0/952933706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e3415f750 msgr2=0x7f7e340ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e32ffd640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e3415f750 0x7f7e340ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.937+0000 7f7e32ffd640 1 -- 172.21.15.137:0/952933706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e340b3730 con 0x7f7e3415f370 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.938+0000 7f7e32ffd640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 0x7f7e340b30a0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c480 tx=0x7f7e2400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.938+0000 7f7e2bfff640 1 -- 172.21.15.137:0/952933706 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24017070 con 0x7f7e3415f370 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.938+0000 7f7e2bfff640 1 -- 172.21.15.137:0/952933706 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e24005ce0 con 0x7f7e3415f370 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.938+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e340b3a10 con 0x7f7e3415f370 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.938+0000 7f7e2bfff640 1 -- 172.21.15.137:0/952933706 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e240072f0 con 0x7f7e3415f370 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.938+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e340c98b0 con 0x7f7e3415f370 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.939+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e340b47d0 con 0x7f7e3415f370 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.939+0000 7f7e2bfff640 1 -- 172.21.15.137:0/952933706 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e2401a070 con 0x7f7e3415f370 2024-04-26T22:07:48.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.940+0000 7f7e2bfff640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e1406c8f0 0x7f7e1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:48.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.940+0000 7f7e2bfff640 1 -- 172.21.15.137:0/952933706 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f7e2408ade0 con 0x7f7e3415f370 2024-04-26T22:07:48.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.940+0000 7f7e337fe640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e1406c8f0 0x7f7e1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:48.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.940+0000 7f7e337fe640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e1406c8f0 0x7f7e1406edb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c034000 tx=0x7f7e1c02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:48.945 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:48.944+0000 7f7e2bfff640 1 -- 172.21.15.137:0/952933706 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f7e340b47d0 con 0x7f7e3415f370 2024-04-26T22:07:49.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.130+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7e3406a290 con 0x7f7e3415f370 2024-04-26T22:07:49.132 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.130+0000 7f7e2bfff640 1 -- 172.21.15.137:0/952933706 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v115) ==== 80+0+0 (secure 0 0 0) 0x7f7e24058c50 con 0x7f7e3415f370 2024-04-26T22:07:49.132 INFO:teuthology.orchestra.run.smithi137.stderr:listed 0 entries 2024-04-26T22:07:49.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.132+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e1406c8f0 msgr2=0x7f7e1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.132+0000 7f7e39b1b640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e1406c8f0 0x7f7e1406edb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c034000 tx=0x7f7e1c02c000 comp rx=0 tx=0).stop 2024-04-26T22:07:49.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.132+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 msgr2=0x7f7e340b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.132+0000 7f7e39b1b640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 0x7f7e340b30a0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c480 tx=0x7f7e2400c940 comp rx=0 tx=0).stop 2024-04-26T22:07:49.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.132+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 shutdown_connections 2024-04-26T22:07:49.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.132+0000 7f7e39b1b640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7e1406c8f0 0x7f7e1406edb0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.132+0000 7f7e39b1b640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7e3415f370 0x7f7e340b30a0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.133+0000 7f7e39b1b640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e3415f750 0x7f7e340ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.133+0000 7f7e39b1b640 1 --2- 172.21.15.137:0/952933706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7e340d3ee0 0x7f7e340ba670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.133+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 >> 172.21.15.137:0/952933706 conn(0x7f7e3408ec10 msgr2=0x7f7e340d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:49.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.133+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 shutdown_connections 2024-04-26T22:07:49.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.133+0000 7f7e39b1b640 1 -- 172.21.15.137:0/952933706 wait complete. 2024-04-26T22:07:49.144 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:07:49.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:49.145 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:49.212 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:07:49.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:49.212 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:07:49.237 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:49.237 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:49.292 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:07:49.292 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:07:49.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:49.293 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:07:49.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:07:49.347 INFO:teuthology.orchestra.run.smithi137.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-26T22:07:49.348 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:07:49.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.484+0000 7f4c8935f640 1 Processor -- start 2024-04-26T22:07:49.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.484+0000 7f4c8935f640 1 -- start start 2024-04-26T22:07:49.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c8935f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4c8415f340 0x7f4c840b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c8935f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4c840d5610 0x7f4c840d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c8935f640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c840b2510 con 0x7f4c8415f720 2024-04-26T22:07:49.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c8935f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4c840b27f0 con 0x7f4c840d5610 2024-04-26T22:07:49.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c8935f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4c840b2ad0 con 0x7f4c8415f340 2024-04-26T22:07:49.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c837fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4c840d5610 0x7f4c840d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c837fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4c840d5610 0x7f4c840d3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54858/0 (socket says 172.21.15.137:54858) 2024-04-26T22:07:49.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c837fe640 1 -- 172.21.15.137:0/3196955814 learned_addr learned my addr 172.21.15.137:0/3196955814 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c82ffd640 1 --2- 172.21.15.137:0/3196955814 >> v2:172.21.15.170:3300/0 conn(0x7f4c8415f340 0x7f4c840b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c837fe640 1 -- 172.21.15.137:0/3196955814 >> v2:172.21.15.170:3300/0 conn(0x7f4c8415f340 msgr2=0x7f4c840b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c837fe640 1 --2- 172.21.15.137:0/3196955814 >> v2:172.21.15.170:3300/0 conn(0x7f4c8415f340 0x7f4c840b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c837fe640 1 -- 172.21.15.137:0/3196955814 >> v1:172.21.15.170:6789/0 conn(0x7f4c8415f720 legacy=0x7f4c840d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.485+0000 7f4c837fe640 1 -- 172.21.15.137:0/3196955814 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c840b2db0 con 0x7f4c840d5610 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.486+0000 7f4c837fe640 1 --2- 172.21.15.137:0/3196955814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c840d5610 0x7f4c840d3d40 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f4c840d6000 tx=0x7f4c7c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a745491ad2b39 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.486+0000 7f4c81ffb640 1 -- 172.21.15.137:0/3196955814 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c036070 con 0x7f4c840d5610 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.486+0000 7f4c81ffb640 1 -- 172.21.15.137:0/3196955814 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7c031600 con 0x7f4c840d5610 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.486+0000 7f4c81ffb640 1 -- 172.21.15.137:0/3196955814 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0319d0 con 0x7f4c840d5610 2024-04-26T22:07:49.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.487+0000 7f4c8935f640 1 -- 172.21.15.137:0/3196955814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c840d5610 msgr2=0x7f4c840d3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.487+0000 7f4c8935f640 1 --2- 172.21.15.137:0/3196955814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c840d5610 0x7f4c840d3d40 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f4c840d6000 tx=0x7f4c7c02a660 comp rx=0 tx=0).stop 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.487+0000 7f4c8935f640 1 -- 172.21.15.137:0/3196955814 shutdown_connections 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.487+0000 7f4c8935f640 1 --2- 172.21.15.137:0/3196955814 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c840d5610 0x7f4c840d3d40 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.487+0000 7f4c8935f640 1 --2- 172.21.15.137:0/3196955814 >> v2:172.21.15.170:3300/0 conn(0x7f4c8415f340 0x7f4c840b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.487+0000 7f4c8935f640 1 -- 172.21.15.137:0/3196955814 >> 172.21.15.137:0/3196955814 conn(0x7f4c8408ec70 msgr2=0x7f4c8409e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.487+0000 7f4c8935f640 1 -- 172.21.15.137:0/3196955814 shutdown_connections 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.487+0000 7f4c8935f640 1 -- 172.21.15.137:0/3196955814 wait complete. 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.488+0000 7f4c8935f640 1 Processor -- start 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.488+0000 7f4c8935f640 1 -- start start 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c8935f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c840d5610 0x7f4c840b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c8935f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c8415f340 0x7f4c8409f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c8935f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c8415f720 0x7f4c841f5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c8935f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4c840b3940 con 0x7f4c8415f340 2024-04-26T22:07:49.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c8935f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4c840b37c0 con 0x7f4c840d5610 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c8935f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4c840b3ac0 con 0x7f4c8415f720 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c827fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c8415f340 0x7f4c8409f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c827fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c8415f340 0x7f4c8409f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54870/0 (socket says 172.21.15.137:54870) 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c827fc640 1 -- 172.21.15.137:0/1795107657 learned_addr learned my addr 172.21.15.137:0/1795107657 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c827fc640 1 -- 172.21.15.137:0/1795107657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c8415f720 msgr2=0x7f4c841f5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c82ffd640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c840d5610 0x7f4c840b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c837fe640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c8415f720 0x7f4c841f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c827fc640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c8415f720 0x7f4c841f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c827fc640 1 -- 172.21.15.137:0/1795107657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c840d5610 msgr2=0x7f4c840b9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c827fc640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c840d5610 0x7f4c840b9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c827fc640 1 -- 172.21.15.137:0/1795107657 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8415ea20 con 0x7f4c8415f340 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c827fc640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c8415f340 0x7f4c8409f000 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800b3c0 tx=0x7f4c7800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:49.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c6b7fe640 1 -- 172.21.15.137:0/1795107657 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011830 con 0x7f4c8415f340 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c6b7fe640 1 -- 172.21.15.137:0/1795107657 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c78016070 con 0x7f4c8415f340 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c6b7fe640 1 -- 172.21.15.137:0/1795107657 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011c50 con 0x7f4c8415f340 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.489+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c840cf0a0 con 0x7f4c8415f340 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.490+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c840b92d0 con 0x7f4c8415f340 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.490+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8406a290 con 0x7f4c8415f340 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.491+0000 7f4c6b7fe640 1 -- 172.21.15.137:0/1795107657 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c7801b460 con 0x7f4c8415f340 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.491+0000 7f4c6b7fe640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c7006c8f0 0x7f4c7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.491+0000 7f4c6b7fe640 1 -- 172.21.15.137:0/1795107657 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5709+0+0 (secure 0 0 0) 0x7f4c7808b520 con 0x7f4c8415f340 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.491+0000 7f4c82ffd640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c7006c8f0 0x7f4c7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.497 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.492+0000 7f4c82ffd640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c7006c8f0 0x7f4c7006edb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4c74006fd0 tx=0x7f4c74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:49.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.495+0000 7f4c6b7fe640 1 -- 172.21.15.137:0/1795107657 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4c78020020 con 0x7f4c8415f340 2024-04-26T22:07:49.711 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.710+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4c840d0e60 con 0x7f4c8415f340 2024-04-26T22:07:49.711 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:07:49.711+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:07:49.714 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.714+0000 7f4c6b7fe640 1 -- 172.21.15.137:0/1795107657 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) ==== 161+0+0 (secure 0 0 0) 0x7f4c780599e0 con 0x7f4c8415f340 2024-04-26T22:07:49.715 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:07:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c7006c8f0 msgr2=0x7f4c7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c7006c8f0 0x7f4c7006edb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4c74006fd0 tx=0x7f4c74008040 comp rx=0 tx=0).stop 2024-04-26T22:07:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c8415f340 msgr2=0x7f4c8409f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c8415f340 0x7f4c8409f000 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800b3c0 tx=0x7f4c7800b880 comp rx=0 tx=0).stop 2024-04-26T22:07:49.717 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 shutdown_connections 2024-04-26T22:07:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4c7006c8f0 0x7f4c7006edb0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4c8415f340 0x7f4c8409f000 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4c8415f720 0x7f4c841f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 --2- 172.21.15.137:0/1795107657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c840d5610 0x7f4c840b9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 >> 172.21.15.137:0/1795107657 conn(0x7f4c8408ec70 msgr2=0x7f4c840cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 shutdown_connections 2024-04-26T22:07:49.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.716+0000 7f4c8935f640 1 -- 172.21.15.137:0/1795107657 wait complete. 2024-04-26T22:07:49.722 INFO:tasks.ceph.mds.b.smithi170.stderr: -8325> 2024-04-26T22:07:42.833+0000 7f10a5148640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:07:49.729 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:07:49.731 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:07:49.757 INFO:tasks.ceph.mds.b.smithi170.stdout:starting mds.b at 2024-04-26T22:07:49.769 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-26T22:07:49.769 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-26T22:07:49.769 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:07:49.769 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-26T22:07:49.769 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.769 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-26T22:07:49.769 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.769 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-26T22:07:49.769 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.770 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-26T22:07:49.770 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-26T22:07:49.770 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.770 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-26T22:07:49.770 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-26T22:07:49.770 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.771 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:07:49.771 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-26T22:07:49.771 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.771 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:07:49.771 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:07:49.771 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.771 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-26T22:07:49.771 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.772 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on skipped message = False 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-26T22:07:49.773 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-26T22:07:49.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-26T22:07:49.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:07:49.774 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-26T22:07:49.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-26T22:07:49.774 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-26T22:07:49.774 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:07:49.775 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-04-26T22:07:49.776 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-26T22:07:49.777 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:07:49.778 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-26T22:07:49.779 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T22:07:49.780 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = False 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T22:07:49.781 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T22:07:49.782 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-26T22:07:49.782 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-26T22:07:49.782 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:07:49.782 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-26T22:07:49.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.782 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-26T22:07:49.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.782 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-26T22:07:49.782 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-26T22:07:49.783 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.784 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on skipped message = False 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.785 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-26T22:07:49.786 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-26T22:07:49.787 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.788 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T22:07:49.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:07:49.790 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: mon down mkfs grace = 300 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T22:07:49.791 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.792 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2024-04-26T22:07:49.793 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = True 2024-04-26T22:07:49.793 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2024-04-26T22:07:49.793 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = False 2024-04-26T22:07:49.793 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T22:07:49.793 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T22:07:49.793 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T22:07:49.795 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:07:49.836 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:07:49.874 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-26T22:07:49.874 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-26T22:07:49.875 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-26T22:07:49.876 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-26T22:07:49.877 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on skipped message = False 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-26T22:07:49.878 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-26T22:07:49.879 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.880 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T22:07:49.881 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-26T22:07:49.882 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.883 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-04-26T22:07:49.884 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = False 2024-04-26T22:07:49.885 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-26T22:07:49.886 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = False 2024-04-26T22:07:49.886 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T22:07:49.886 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T22:07:49.886 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T22:07:49.886 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-26T22:07:49.887 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:07:49.888 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-26T22:07:49.889 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on skipped message = False 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-26T22:07:49.890 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.891 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-26T22:07:49.892 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:07:49.893 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-26T22:07:49.894 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.895 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: mon down mkfs grace = 300 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T22:07:49.896 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = False 2024-04-26T22:07:49.897 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2024-04-26T22:07:49.898 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = False 2024-04-26T22:07:49.898 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T22:07:49.898 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T22:07:49.898 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T22:07:49.899 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-04-26T22:07:49.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.980+0000 7f0998fb7f40 1 Processor -- start 2024-04-26T22:07:49.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.980+0000 7f0998fb7f40 1 -- start start 2024-04-26T22:07:49.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.980+0000 7f0998fb7f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a26d058a10 0x55a26d0f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.980+0000 7f0998fb7f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d053d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.980+0000 7f0998fb7f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a26d0ffc70 0x55a26d06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.980+0000 7f0998fb7f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a26cfcfe40 con 0x55a26d0ff890 2024-04-26T22:07:49.983 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.980+0000 7f0998fb7f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a26cfd3e80 con 0x55a26d058a10 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.980+0000 7f0998fb7f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a26d0709b0 con 0x55a26d0ffc70 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.980+0000 7f09962b2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d053d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09962b2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d053d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54884/0 (socket says 172.21.15.137:54884) 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09962b2640 1 -- 172.21.15.137:0/54355154 learned_addr learned my addr 172.21.15.137:0/54355154 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09962b2640 1 -- 172.21.15.137:0/54355154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a26d0ffc70 msgr2=0x55a26d06ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09972b4640 1 --2- 172.21.15.137:0/54355154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a26d0ffc70 0x55a26d06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09962b2640 1 --2- 172.21.15.137:0/54355154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a26d0ffc70 0x55a26d06ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09962b2640 1 -- 172.21.15.137:0/54355154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a26d058a10 msgr2=0x55a26d0f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09962b2640 1 --2- 172.21.15.137:0/54355154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a26d058a10 0x55a26d0f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09962b2640 1 -- 172.21.15.137:0/54355154 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a26d0f5b90 con 0x55a26d0ff890 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09962b2640 1 --2- 172.21.15.137:0/54355154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d053d10 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f098c00b240 tx=0x7f098c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a78caf076f96ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09952b0640 1 -- 172.21.15.137:0/54355154 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c008070 con 0x55a26d0ff890 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09952b0640 1 -- 172.21.15.137:0/54355154 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098c00d500 con 0x55a26d0ff890 2024-04-26T22:07:49.984 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.981+0000 7f09952b0640 1 -- 172.21.15.137:0/54355154 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c00d8f0 con 0x55a26d0ff890 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 -- 172.21.15.137:0/54355154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 msgr2=0x55a26d053d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 --2- 172.21.15.137:0/54355154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d053d10 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f098c00b240 tx=0x7f098c00b700 comp rx=0 tx=0).stop 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 -- 172.21.15.137:0/54355154 shutdown_connections 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 --2- 172.21.15.137:0/54355154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d053d10 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 --2- 172.21.15.137:0/54355154 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a26d0ffc70 0x55a26d06ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 --2- 172.21.15.137:0/54355154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a26d058a10 0x55a26d0f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 -- 172.21.15.137:0/54355154 >> 172.21.15.137:0/54355154 conn(0x55a26d072fd0 msgr2=0x55a26d0fa2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 -- 172.21.15.137:0/54355154 shutdown_connections 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 -- 172.21.15.137:0/54355154 wait complete. 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 Processor -- start 2024-04-26T22:07:49.985 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.982+0000 7f0998fb7f40 1 -- start start 2024-04-26T22:07:49.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f0998fb7f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a26d058a10 0x55a26d0f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f0998fb7f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d0fd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f0998fb7f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a26d0ffc70 0x55a26d06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f0998fb7f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55a26d0fadb0 con 0x55a26d0ff890 2024-04-26T22:07:49.988 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f0998fb7f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55a26d02add0 con 0x55a26d058a10 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f0998fb7f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55a26d0fb000 con 0x55a26d0ffc70 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09962b2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d0fd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09962b2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d0fd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54892/0 (socket says 172.21.15.137:54892) 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09962b2640 1 -- 172.21.15.137:0/2351660870 learned_addr learned my addr 172.21.15.137:0/2351660870 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f0996ab3640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a26d058a10 0x55a26d0f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09972b4640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a26d0ffc70 0x55a26d06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09962b2640 1 -- 172.21.15.137:0/2351660870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a26d0ffc70 msgr2=0x55a26d06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09962b2640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55a26d0ffc70 0x55a26d06d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09962b2640 1 -- 172.21.15.137:0/2351660870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a26d058a10 msgr2=0x55a26d0f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09962b2640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a26d058a10 0x55a26d0f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09962b2640 1 -- 172.21.15.137:0/2351660870 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a26d0fd9e0 con 0x55a26d0ff890 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.983+0000 7f09962b2640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d0fd000 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f098c000c00 tx=0x7f098c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:49.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.984+0000 7f097ffff640 1 -- 172.21.15.137:0/2351660870 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c021030 con 0x55a26d0ff890 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.984+0000 7f097ffff640 1 -- 172.21.15.137:0/2351660870 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098c01c650 con 0x55a26d0ff890 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.984+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a26d0fdcc0 con 0x55a26d0ff890 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.984+0000 7f097ffff640 1 -- 172.21.15.137:0/2351660870 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c01c8c0 con 0x55a26d0ff890 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.984+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a26d0fe560 con 0x55a26d0ff890 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.985+0000 7f097ffff640 1 -- 172.21.15.137:0/2351660870 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f098c024070 con 0x55a26d0ff890 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.985+0000 7f097ffff640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f098406b2d0 0x7f098406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.985+0000 7f097ffff640 1 -- 172.21.15.137:0/2351660870 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f098c08bc20 con 0x55a26d0ff890 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.985+0000 7f0996ab3640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f098406b2d0 0x7f098406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.986+0000 7f0998fb7f40 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55a26d196ba0 0x55a26d1999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.986+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:1 16.7 16:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e116) -- 0x55a26d0fd540 con 0x55a26d196ba0 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.986+0000 7f09972b4640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55a26d196ba0 0x55a26d1999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.986+0000 7f0996ab3640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f098406b2d0 0x7f098406d790 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f099000b660 tx=0x7f09900058c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:49.990 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.986+0000 7f09972b4640 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55a26d196ba0 0x55a26d1999d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:49.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f09972b4640 1 -- 172.21.15.137:0/2351660870 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v116'5 uv5 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0988050960 con 0x55a26d196ba0 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55a26d196ba0 msgr2=0x55a26d1999d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55a26d196ba0 0x55a26d1999d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f098406b2d0 msgr2=0x7f098406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f098406b2d0 0x7f098406d790 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f099000b660 tx=0x7f09900058c0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 msgr2=0x55a26d0fd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 --2- 172.21.15.137:0/2351660870 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55a26d0ff890 0x55a26d0fd000 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f098c000c00 tx=0x7f098c000ed0 comp rx=0 tx=0).stop 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f09972b4640 1 -- 172.21.15.137:0/2351660870 reap_dead start 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 shutdown_connections 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 >> 172.21.15.137:0/2351660870 conn(0x55a26d072fd0 msgr2=0x55a26d0fb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 shutdown_connections 2024-04-26T22:07:49.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:49.989+0000 7f0998fb7f40 1 -- 172.21.15.137:0/2351660870 wait complete. 2024-04-26T22:07:49.993 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-26T22:07:50.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.132+0000 7fdb95485640 1 Processor -- start 2024-04-26T22:07:50.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.132+0000 7fdb95485640 1 -- start start 2024-04-26T22:07:50.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.133+0000 7fdb95485640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb9015d340 0x7fdb9009c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.135 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.133+0000 7fdb95485640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdb900d1940 0x7fdb900702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.133+0000 7fdb95485640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb900cee60 con 0x7fdb900b2420 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.133+0000 7fdb95485640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdb900ce9d0 con 0x7fdb900d1940 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.133+0000 7fdb95485640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdb900d0ff0 con 0x7fdb9015d340 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.133+0000 7fdb8e7fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdb900b2420 0x7fdb900d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58670/0 (socket says 172.21.15.137:58670) 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.133+0000 7fdb8e7fc640 1 -- 172.21.15.137:0/4246217818 learned_addr learned my addr 172.21.15.137:0/4246217818 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.133+0000 7fdb8effd640 1 --2- 172.21.15.137:0/4246217818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb9015d340 0x7fdb9009c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.133+0000 7fdb8f7fe640 1 --2- 172.21.15.137:0/4246217818 >> v2:172.21.15.170:3300/0 conn(0x7fdb900d1940 0x7fdb900702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.134+0000 7fdb8dffb640 1 -- 172.21.15.137:0/4246217818 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216450155 0 0) 0x7fdb900cee60 con 0x7fdb900b2420 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.134+0000 7fdb8dffb640 1 -- 172.21.15.137:0/4246217818 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb78003520 con 0x7fdb900b2420 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.134+0000 7fdb8f7fe640 1 -- 172.21.15.137:0/4246217818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb9015d340 msgr2=0x7fdb9009c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.134+0000 7fdb8f7fe640 1 --2- 172.21.15.137:0/4246217818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb9015d340 0x7fdb9009c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.136 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.134+0000 7fdb8f7fe640 1 -- 172.21.15.137:0/4246217818 >> v1:172.21.15.137:6789/0 conn(0x7fdb900b2420 legacy=0x7fdb900d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.134+0000 7fdb8f7fe640 1 -- 172.21.15.137:0/4246217818 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb900d0d10 con 0x7fdb900d1940 2024-04-26T22:07:50.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.134+0000 7fdb8effd640 1 --2- 172.21.15.137:0/4246217818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb9015d340 0x7fdb9009c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:07:50.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.134+0000 7fdb8f7fe640 1 --2- 172.21.15.137:0/4246217818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb900d1940 0x7fdb900702a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdb880097a0 tx=0x7fdb8802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=730eb8df4add8d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:50.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb8dffb640 1 -- 172.21.15.137:0/4246217818 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88037070 con 0x7fdb900d1940 2024-04-26T22:07:50.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb8dffb640 1 -- 172.21.15.137:0/4246217818 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb88032440 con 0x7fdb900d1940 2024-04-26T22:07:50.137 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb8dffb640 1 -- 172.21.15.137:0/4246217818 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb880327f0 con 0x7fdb900d1940 2024-04-26T22:07:50.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb95485640 1 -- 172.21.15.137:0/4246217818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb900d1940 msgr2=0x7fdb900702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb95485640 1 --2- 172.21.15.137:0/4246217818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb900d1940 0x7fdb900702a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdb880097a0 tx=0x7fdb8802a180 comp rx=0 tx=0).stop 2024-04-26T22:07:50.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb95485640 1 -- 172.21.15.137:0/4246217818 shutdown_connections 2024-04-26T22:07:50.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb95485640 1 --2- 172.21.15.137:0/4246217818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb900d1940 0x7fdb900702a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb95485640 1 --2- 172.21.15.137:0/4246217818 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb9015d340 0x7fdb9009c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.140 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb95485640 1 -- 172.21.15.137:0/4246217818 >> 172.21.15.137:0/4246217818 conn(0x7fdb9009ba40 msgr2=0x7fdb9009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb95485640 1 -- 172.21.15.137:0/4246217818 shutdown_connections 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.135+0000 7fdb95485640 1 -- 172.21.15.137:0/4246217818 wait complete. 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.136+0000 7fdb95485640 1 Processor -- start 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.136+0000 7fdb95485640 1 -- start start 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb95485640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb900d1940 0x7fdb90158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb95485640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9015d340 0x7fdb901f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb95485640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb901f3d10 0x7fdb901f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb95485640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb900b2090 con 0x7fdb9015d340 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb95485640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9015d720 con 0x7fdb900d1940 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb95485640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdb900b2210 con 0x7fdb901f3d10 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb8e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9015d340 0x7fdb901f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb8e7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9015d340 0x7fdb901f2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54896/0 (socket says 172.21.15.137:54896) 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb8e7fc640 1 -- 172.21.15.137:0/3130515066 learned_addr learned my addr 172.21.15.137:0/3130515066 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb8f7fe640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb901f3d10 0x7fdb901f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.141 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.137+0000 7fdb8effd640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb900d1940 0x7fdb90158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb8e7fc640 1 -- 172.21.15.137:0/3130515066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb901f3d10 msgr2=0x7fdb901f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb8e7fc640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb901f3d10 0x7fdb901f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb8e7fc640 1 -- 172.21.15.137:0/3130515066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb900d1940 msgr2=0x7fdb90158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb8e7fc640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb900d1940 0x7fdb90158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb8e7fc640 1 -- 172.21.15.137:0/3130515066 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb901f3730 con 0x7fdb9015d340 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb8e7fc640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9015d340 0x7fdb901f2b90 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c430 tx=0x7fdb8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb777fe640 1 -- 172.21.15.137:0/3130515066 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84017070 con 0x7fdb9015d340 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb777fe640 1 -- 172.21.15.137:0/3130515066 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb84005ce0 con 0x7fdb9015d340 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb901f3a10 con 0x7fdb9015d340 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb777fe640 1 -- 172.21.15.137:0/3130515066 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb840072f0 con 0x7fdb9015d340 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.138+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb900ca350 con 0x7fdb9015d340 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.139+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb900693d0 con 0x7fdb9015d340 2024-04-26T22:07:50.142 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.139+0000 7fdb777fe640 1 -- 172.21.15.137:0/3130515066 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb8401a070 con 0x7fdb9015d340 2024-04-26T22:07:50.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.140+0000 7fdb777fe640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb7c06c8f0 0x7fdb7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.140+0000 7fdb8effd640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb7c06c8f0 0x7fdb7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.140+0000 7fdb777fe640 1 -- 172.21.15.137:0/3130515066 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fdb8408afc0 con 0x7fdb9015d340 2024-04-26T22:07:50.143 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.140+0000 7fdb8effd640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb7c06c8f0 0x7fdb7c06edb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdb900cbc70 tx=0x7fdb8000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:50.145 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.144+0000 7fdb777fe640 1 -- 172.21.15.137:0/3130515066 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdb84058d40 con 0x7fdb9015d340 2024-04-26T22:07:50.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.359+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fdb900721f0 con 0x7fdb9015d340 2024-04-26T22:07:50.716 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.716+0000 7fdb777fe640 1 -- 172.21.15.137:0/3130515066 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v83) ==== 162+0+0 (secure 0 0 0) 0x7fdb8405d040 con 0x7fdb9015d340 2024-04-26T22:07:50.716 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.718+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb7c06c8f0 msgr2=0x7fdb7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.718+0000 7fdb95485640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb7c06c8f0 0x7fdb7c06edb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fdb900cbc70 tx=0x7fdb8000b040 comp rx=0 tx=0).stop 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.718+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9015d340 msgr2=0x7fdb901f2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.718+0000 7fdb95485640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9015d340 0x7fdb901f2b90 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c430 tx=0x7fdb8400c8f0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.718+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 shutdown_connections 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.718+0000 7fdb95485640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb7c06c8f0 0x7fdb7c06edb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.719+0000 7fdb95485640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb9015d340 0x7fdb901f2b90 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.719+0000 7fdb95485640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb901f3d10 0x7fdb901f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.719+0000 7fdb95485640 1 --2- 172.21.15.137:0/3130515066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb900d1940 0x7fdb90158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.719+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 >> 172.21.15.137:0/3130515066 conn(0x7fdb9009ba40 msgr2=0x7fdb900c6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.719+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 shutdown_connections 2024-04-26T22:07:50.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.719+0000 7fdb95485640 1 -- 172.21.15.137:0/3130515066 wait complete. 2024-04-26T22:07:50.731 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:50.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.828+0000 7fdeb36d1640 1 Processor -- start 2024-04-26T22:07:50.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.828+0000 7fdeb36d1640 1 -- start start 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.829+0000 7fdeb36d1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdeac0d35b0 0x7fdeac0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.829+0000 7fdeb36d1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeac0d07d0 con 0x7fdeac0cfa50 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.829+0000 7fdeb36d1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeac15f6b0 con 0x7fdeac15f2d0 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.829+0000 7fdeb36d1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdeac0b2ca0 con 0x7fdeac0d35b0 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.829+0000 7fdeb1c6e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdeac0cfa50 0x7fdeac0cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58672/0 (socket says 172.21.15.137:58672) 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.829+0000 7fdeb1c6e640 1 -- 172.21.15.137:0/4043927522 learned_addr learned my addr 172.21.15.137:0/4043927522 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.830+0000 7fdeb0c6c640 1 --2- 172.21.15.137:0/4043927522 >> v2:172.21.15.170:3300/0 conn(0x7fdeac0d35b0 0x7fdeac0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.830+0000 7fdea3fff640 1 -- 172.21.15.137:0/4043927522 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505864440 0 0) 0x7fdeac0d07d0 con 0x7fdeac0cfa50 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.830+0000 7fdea3fff640 1 -- 172.21.15.137:0/4043927522 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde98003520 con 0x7fdeac0cfa50 2024-04-26T22:07:50.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.830+0000 7fdeb0c6c640 1 -- 172.21.15.137:0/4043927522 >> v1:172.21.15.170:6789/0 conn(0x7fdeac15f2d0 legacy=0x7fdeac0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.830+0000 7fdeb0c6c640 1 -- 172.21.15.137:0/4043927522 >> v1:172.21.15.137:6789/0 conn(0x7fdeac0cfa50 legacy=0x7fdeac0cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.830+0000 7fdeb0c6c640 1 -- 172.21.15.137:0/4043927522 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac0b2f80 con 0x7fdeac0d35b0 2024-04-26T22:07:50.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdeb0c6c640 1 --2- 172.21.15.137:0/4043927522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0d35b0 0x7fdeac0b3a60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0097a0 tx=0x7fde9c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2d67635d07f46c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:50.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdea3fff640 1 -- 172.21.15.137:0/4043927522 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c037070 con 0x7fdeac0d35b0 2024-04-26T22:07:50.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdea3fff640 1 -- 172.21.15.137:0/4043927522 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c032440 con 0x7fdeac0d35b0 2024-04-26T22:07:50.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdea3fff640 1 -- 172.21.15.137:0/4043927522 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c032810 con 0x7fdeac0d35b0 2024-04-26T22:07:50.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdeb36d1640 1 -- 172.21.15.137:0/4043927522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0d35b0 msgr2=0x7fdeac0b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdeb36d1640 1 --2- 172.21.15.137:0/4043927522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0d35b0 0x7fdeac0b3a60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0097a0 tx=0x7fde9c02a230 comp rx=0 tx=0).stop 2024-04-26T22:07:50.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdeb36d1640 1 -- 172.21.15.137:0/4043927522 shutdown_connections 2024-04-26T22:07:50.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdeb36d1640 1 --2- 172.21.15.137:0/4043927522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0d35b0 0x7fdeac0b3a60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdeb36d1640 1 -- 172.21.15.137:0/4043927522 >> 172.21.15.137:0/4043927522 conn(0x7fdeac09ba40 msgr2=0x7fdeac09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:50.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdeb36d1640 1 -- 172.21.15.137:0/4043927522 shutdown_connections 2024-04-26T22:07:50.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.831+0000 7fdeb36d1640 1 -- 172.21.15.137:0/4043927522 wait complete. 2024-04-26T22:07:50.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.832+0000 7fdeb36d1640 1 Processor -- start 2024-04-26T22:07:50.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb36d1640 1 -- start start 2024-04-26T22:07:50.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb36d1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0cfa50 0x7fdeac0b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb36d1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeac0d35b0 0x7fdeac152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb36d1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdeac15f2d0 0x7fdeac1f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb36d1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac06d3b0 con 0x7fdeac0d35b0 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb36d1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac0b3540 con 0x7fdeac0cfa50 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb36d1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdeac06d530 con 0x7fdeac15f2d0 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb0c6c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeac0d35b0 0x7fdeac152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb0c6c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeac0d35b0 0x7fdeac152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54908/0 (socket says 172.21.15.137:54908) 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb0c6c640 1 -- 172.21.15.137:0/1475099000 learned_addr learned my addr 172.21.15.137:0/1475099000 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb1c6e640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdeac15f2d0 0x7fdeac1f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.833+0000 7fdeb146d640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0cfa50 0x7fdeac0b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdeb0c6c640 1 -- 172.21.15.137:0/1475099000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdeac15f2d0 msgr2=0x7fdeac1f5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdeb0c6c640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdeac15f2d0 0x7fdeac1f5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdeb0c6c640 1 -- 172.21.15.137:0/1475099000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0cfa50 msgr2=0x7fdeac0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdeb0c6c640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0cfa50 0x7fdeac0b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdeb0c6c640 1 -- 172.21.15.137:0/1475099000 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac0afbe0 con 0x7fdeac0d35b0 2024-04-26T22:07:50.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdeb146d640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0cfa50 0x7fdeac0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:50.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdeb0c6c640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeac0d35b0 0x7fdeac152f60 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fde9c035040 tx=0x7fde9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:50.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdea1ffb640 1 -- 172.21.15.137:0/1475099000 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c037040 con 0x7fdeac0d35b0 2024-04-26T22:07:50.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdea1ffb640 1 -- 172.21.15.137:0/1475099000 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c030500 con 0x7fdeac0d35b0 2024-04-26T22:07:50.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeac0afec0 con 0x7fdeac0d35b0 2024-04-26T22:07:50.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdea1ffb640 1 -- 172.21.15.137:0/1475099000 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0308d0 con 0x7fdeac0d35b0 2024-04-26T22:07:50.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.834+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeac0b0480 con 0x7fdeac0d35b0 2024-04-26T22:07:50.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.835+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeac06a290 con 0x7fdeac0d35b0 2024-04-26T22:07:50.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.836+0000 7fdea1ffb640 1 -- 172.21.15.137:0/1475099000 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde9c044020 con 0x7fdeac0d35b0 2024-04-26T22:07:50.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.836+0000 7fdea1ffb640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde9006c8f0 0x7fde9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:50.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.836+0000 7fdeb146d640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde9006c8f0 0x7fde9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:50.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.836+0000 7fdea1ffb640 1 -- 172.21.15.137:0/1475099000 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fde9c0abd60 con 0x7fdeac0d35b0 2024-04-26T22:07:50.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.837+0000 7fdeb146d640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde9006c8f0 0x7fde9006edb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0b5340 tx=0x7fdea8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:50.840 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:50.841+0000 7fdea1ffb640 1 -- 172.21.15.137:0/1475099000 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fde9c07a130 con 0x7fdeac0d35b0 2024-04-26T22:07:51.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.052+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdeac0d22f0 con 0x7fdeac0d35b0 2024-04-26T22:07:51.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.052+0000 7fdea1ffb640 1 -- 172.21.15.137:0/1475099000 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5190 (secure 0 0 0) 0x7fde9c079a30 con 0x7fdeac0d35b0 2024-04-26T22:07:51.052 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:51.053 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":84,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:07:50.719400+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8859":{"gid":8859,"name":"a","rank":0,"incarnation":84,"state":"up:replay","state_seq":1,"addr":"172.21.15.137:6837/2830617564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2830617564},{"type":"v1","addr":"172.21.15.137:6837","nonce":2830617564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-26T22:07:51.053 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 84 2024-04-26T22:07:51.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde9006c8f0 msgr2=0x7fde9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde9006c8f0 0x7fde9006edb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fdeac0b5340 tx=0x7fdea8009040 comp rx=0 tx=0).stop 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeac0d35b0 msgr2=0x7fdeac152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeac0d35b0 0x7fdeac152f60 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fde9c035040 tx=0x7fde9c0046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 shutdown_connections 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fde9006c8f0 0x7fde9006edb0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdeac0d35b0 0x7fdeac152f60 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdeac15f2d0 0x7fdeac1f5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 --2- 172.21.15.137:0/1475099000 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdeac0cfa50 0x7fdeac0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.054+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 >> 172.21.15.137:0/1475099000 conn(0x7fdeac09ba40 msgr2=0x7fdeac0d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.055+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 shutdown_connections 2024-04-26T22:07:51.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:51.055+0000 7fdeb36d1640 1 -- 172.21.15.137:0/1475099000 wait complete. 2024-04-26T22:07:51.468 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:07:36.895650+0000', 'modified': '2024-04-26T22:07:50.719400+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 116, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8859}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8859': {'gid': 8859, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.137:6837/2830617564', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 2830617564}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 2830617564}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:07:51.468 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8859:up:replay 2024-04-26T22:07:52.469 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:52.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.581+0000 7fc213883640 1 Processor -- start 2024-04-26T22:07:52.581 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.581+0000 7fc213883640 1 -- start start 2024-04-26T22:07:52.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.582+0000 7fc213883640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc20c145980 0x7fc20c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:52.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.582+0000 7fc213883640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc20c0b3de0 0x7fc20c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:52.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.582+0000 7fc213883640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20c0b4260 con 0x7fc20c0b5fd0 2024-04-26T22:07:52.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.582+0000 7fc213883640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc20c0b5140 con 0x7fc20c0b3de0 2024-04-26T22:07:52.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.582+0000 7fc213883640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc20c0b6410 con 0x7fc20c145980 2024-04-26T22:07:52.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.582+0000 7fc210e1e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc20c0b3de0 0x7fc20c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:52.583 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.582+0000 7fc211e20640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fc20c0b5fd0 0x7fc20c15c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58676/0 (socket says 172.21.15.137:58676) 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.582+0000 7fc211e20640 1 -- 172.21.15.137:0/211762128 learned_addr learned my addr 172.21.15.137:0/211762128 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.583+0000 7fc21161f640 1 --2- 172.21.15.137:0/211762128 >> v2:172.21.15.170:3300/0 conn(0x7fc20c145980 0x7fc20c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.583+0000 7fc210e1e640 1 -- 172.21.15.137:0/211762128 >> v2:172.21.15.170:3300/0 conn(0x7fc20c145980 msgr2=0x7fc20c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.583+0000 7fc210e1e640 1 --2- 172.21.15.137:0/211762128 >> v2:172.21.15.170:3300/0 conn(0x7fc20c145980 0x7fc20c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.583+0000 7fc210e1e640 1 -- 172.21.15.137:0/211762128 >> v1:172.21.15.137:6789/0 conn(0x7fc20c0b5fd0 legacy=0x7fc20c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.583+0000 7fc203fff640 1 -- 172.21.15.137:0/211762128 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797731828 0 0) 0x7fc20c0b4260 con 0x7fc20c0b5fd0 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.583+0000 7fc210e1e640 1 -- 172.21.15.137:0/211762128 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c0b4530 con 0x7fc20c0b3de0 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.583+0000 7fc21161f640 1 --2- 172.21.15.137:0/211762128 >> v2:172.21.15.170:3300/0 conn(0x7fc20c145980 0x7fc20c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.583+0000 7fc210e1e640 1 --2- 172.21.15.137:0/211762128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c0b3de0 0x7fc20c0b5a90 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fc20c06ff10 tx=0x7fc1fc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa4308f78513e06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.583+0000 7fc203fff640 1 -- 172.21.15.137:0/211762128 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc037070 con 0x7fc20c0b3de0 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc203fff640 1 -- 172.21.15.137:0/211762128 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc032440 con 0x7fc20c0b3de0 2024-04-26T22:07:52.584 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc203fff640 1 -- 172.21.15.137:0/211762128 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc02ae60 con 0x7fc20c0b3de0 2024-04-26T22:07:52.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc213883640 1 -- 172.21.15.137:0/211762128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c0b3de0 msgr2=0x7fc20c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:52.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc213883640 1 --2- 172.21.15.137:0/211762128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c0b3de0 0x7fc20c0b5a90 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fc20c06ff10 tx=0x7fc1fc02a110 comp rx=0 tx=0).stop 2024-04-26T22:07:52.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc213883640 1 -- 172.21.15.137:0/211762128 shutdown_connections 2024-04-26T22:07:52.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc213883640 1 --2- 172.21.15.137:0/211762128 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c0b3de0 0x7fc20c0b5a90 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:52.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc213883640 1 --2- 172.21.15.137:0/211762128 >> v2:172.21.15.170:3300/0 conn(0x7fc20c145980 0x7fc20c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc213883640 1 -- 172.21.15.137:0/211762128 >> 172.21.15.137:0/211762128 conn(0x7fc20c0d0d30 msgr2=0x7fc20c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc213883640 1 -- 172.21.15.137:0/211762128 shutdown_connections 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.584+0000 7fc213883640 1 -- 172.21.15.137:0/211762128 wait complete. 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.585+0000 7fc213883640 1 Processor -- start 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.585+0000 7fc213883640 1 -- start start 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc213883640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc20c0b3de0 0x7fc20c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc213883640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc20c0b5fd0 0x7fc20c159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc213883640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c145980 0x7fc20c15e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc213883640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c0b4dd0 con 0x7fc20c145980 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc213883640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c0b4af0 con 0x7fc20c0b5fd0 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc213883640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc20c0730e0 con 0x7fc20c0b3de0 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc211e20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c145980 0x7fc20c15e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc211e20640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c145980 0x7fc20c15e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54938/0 (socket says 172.21.15.137:54938) 2024-04-26T22:07:52.588 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc211e20640 1 -- 172.21.15.137:0/2529991852 learned_addr learned my addr 172.21.15.137:0/2529991852 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc21161f640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc20c0b3de0 0x7fc20c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc210e1e640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc20c0b5fd0 0x7fc20c159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.586+0000 7fc211e20640 1 -- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc20c0b3de0 msgr2=0x7fc20c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc211e20640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc20c0b3de0 0x7fc20c156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc211e20640 1 -- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc20c0b5fd0 msgr2=0x7fc20c159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc211e20640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc20c0b5fd0 0x7fc20c159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc211e20640 1 -- 172.21.15.137:0/2529991852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c132220 con 0x7fc20c145980 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc210e1e640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc20c0b5fd0 0x7fc20c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc21161f640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc20c0b3de0 0x7fc20c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc211e20640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c145980 0x7fc20c15e130 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc20400c7a0 tx=0x7fc20400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc201ffb640 1 -- 172.21.15.137:0/2529991852 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc204018070 con 0x7fc20c145980 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc201ffb640 1 -- 172.21.15.137:0/2529991852 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20400a640 con 0x7fc20c145980 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20c159480 con 0x7fc20c145980 2024-04-26T22:07:52.589 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc201ffb640 1 -- 172.21.15.137:0/2529991852 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20400aa70 con 0x7fc20c145980 2024-04-26T22:07:52.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.587+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20c159a40 con 0x7fc20c145980 2024-04-26T22:07:52.590 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.588+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc20c159270 con 0x7fc20c145980 2024-04-26T22:07:52.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.588+0000 7fc201ffb640 1 -- 172.21.15.137:0/2529991852 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc20401b070 con 0x7fc20c145980 2024-04-26T22:07:52.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.589+0000 7fc201ffb640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1f006c8f0 0x7fc1f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:52.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.589+0000 7fc201ffb640 1 -- 172.21.15.137:0/2529991852 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fc20408b1e0 con 0x7fc20c145980 2024-04-26T22:07:52.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.589+0000 7fc21161f640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1f006c8f0 0x7fc1f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:52.591 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.589+0000 7fc21161f640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1f006c8f0 0x7fc1f006edb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc208006fd0 tx=0x7fc208008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:52.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.593+0000 7fc201ffb640 1 -- 172.21.15.137:0/2529991852 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc2040595b0 con 0x7fc20c145980 2024-04-26T22:07:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.808+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc20c06a290 con 0x7fc20c145980 2024-04-26T22:07:52.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.808+0000 7fc201ffb640 1 -- 172.21.15.137:0/2529991852 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5190 (secure 0 0 0) 0x7fc204058eb0 con 0x7fc20c145980 2024-04-26T22:07:52.808 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:52.809 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":86,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:07:51.726630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8859":{"gid":8859,"name":"a","rank":0,"incarnation":84,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.137:6837/2830617564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2830617564},{"type":"v1","addr":"172.21.15.137:6837","nonce":2830617564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-26T22:07:52.809 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 86 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1f006c8f0 msgr2=0x7fc1f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1f006c8f0 0x7fc1f006edb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc208006fd0 tx=0x7fc208008040 comp rx=0 tx=0).stop 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c145980 msgr2=0x7fc20c15e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c145980 0x7fc20c15e130 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc20400c7a0 tx=0x7fc20400cc60 comp rx=0 tx=0).stop 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 shutdown_connections 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1f006c8f0 0x7fc1f006edb0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc20c145980 0x7fc20c15e130 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc20c0b5fd0 0x7fc20c159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 --2- 172.21.15.137:0/2529991852 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc20c0b3de0 0x7fc20c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.810+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 >> 172.21.15.137:0/2529991852 conn(0x7fc20c0d0d30 msgr2=0x7fc20c15c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.811+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 shutdown_connections 2024-04-26T22:07:52.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:52.811+0000 7fc213883640 1 -- 172.21.15.137:0/2529991852 wait complete. 2024-04-26T22:07:53.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:07:36.895650+0000', 'modified': '2024-04-26T22:07:51.726630+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 116, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8859}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8859': {'gid': 8859, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:rejoin', 'state_seq': 7, 'addr': '172.21.15.137:6837/2830617564', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 2830617564}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 2830617564}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:07:53.224 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8859:up:rejoin 2024-04-26T22:07:54.225 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:54.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.334+0000 7f0469a85640 1 Processor -- start 2024-04-26T22:07:54.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.334+0000 7f0469a85640 1 -- start start 2024-04-26T22:07:54.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0469a85640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0464145980 0x7f0464160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:54.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0469a85640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f04640b61a0 0x7f04640720d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:54.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0469a85640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04640b4260 con 0x7f04640b3de0 2024-04-26T22:07:54.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0469a85640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f04640b5140 con 0x7f04640b61a0 2024-04-26T22:07:54.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0469a85640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f04640b4530 con 0x7f0464145980 2024-04-26T22:07:54.343 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0463fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f04640b61a0 0x7f04640720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:54.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0463fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f04640b61a0 0x7f04640720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54954/0 (socket says 172.21.15.137:54954) 2024-04-26T22:07:54.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0463fff640 1 -- 172.21.15.137:0/23591643 learned_addr learned my addr 172.21.15.137:0/23591643 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:54.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f04637fe640 1 --2- 172.21.15.137:0/23591643 >> v2:172.21.15.170:3300/0 conn(0x7f0464145980 0x7f0464160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:54.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0463fff640 1 -- 172.21.15.137:0/23591643 >> v2:172.21.15.170:3300/0 conn(0x7f0464145980 msgr2=0x7f0464160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:54.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0463fff640 1 --2- 172.21.15.137:0/23591643 >> v2:172.21.15.170:3300/0 conn(0x7f0464145980 0x7f0464160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.335+0000 7f0463fff640 1 -- 172.21.15.137:0/23591643 >> v1:172.21.15.170:6789/0 conn(0x7f04640b3de0 legacy=0x7f04640b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:54.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.336+0000 7f0463fff640 1 -- 172.21.15.137:0/23591643 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04640b4810 con 0x7f04640b61a0 2024-04-26T22:07:54.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.336+0000 7f0463fff640 1 --2- 172.21.15.137:0/23591643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 0x7f04640720d0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f046406ff10 tx=0x7f045c02c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85048b9b46c2ffca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.336+0000 7f04627fc640 1 -- 172.21.15.137:0/23591643 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c039070 con 0x7f04640b61a0 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.336+0000 7f04627fc640 1 -- 172.21.15.137:0/23591643 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c00b2e0 con 0x7f04640b61a0 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.336+0000 7f04627fc640 1 -- 172.21.15.137:0/23591643 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c009820 con 0x7f04640b61a0 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.337+0000 7f0469a85640 1 -- 172.21.15.137:0/23591643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 msgr2=0x7f04640720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.337+0000 7f0469a85640 1 --2- 172.21.15.137:0/23591643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 0x7f04640720d0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f046406ff10 tx=0x7f045c02c860 comp rx=0 tx=0).stop 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.337+0000 7f0469a85640 1 -- 172.21.15.137:0/23591643 shutdown_connections 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.337+0000 7f0469a85640 1 --2- 172.21.15.137:0/23591643 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 0x7f04640720d0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.337+0000 7f0469a85640 1 --2- 172.21.15.137:0/23591643 >> v2:172.21.15.170:3300/0 conn(0x7f0464145980 0x7f0464160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.337+0000 7f0469a85640 1 -- 172.21.15.137:0/23591643 >> 172.21.15.137:0/23591643 conn(0x7f04640d0d30 msgr2=0x7f04640d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.337+0000 7f0469a85640 1 -- 172.21.15.137:0/23591643 shutdown_connections 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.337+0000 7f0469a85640 1 -- 172.21.15.137:0/23591643 wait complete. 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.338+0000 7f0469a85640 1 Processor -- start 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.338+0000 7f0469a85640 1 -- start start 2024-04-26T22:07:54.345 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0469a85640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04640b3de0 0x7f046415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0469a85640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 0x7f0464072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0469a85640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0464145980 0x7f0464073000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0469a85640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0464072610 con 0x7f04640b61a0 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0469a85640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f04640b4dd0 con 0x7f04640b3de0 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0469a85640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0464072790 con 0x7f0464145980 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0462ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 0x7f0464072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0462ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 0x7f0464072ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54962/0 (socket says 172.21.15.137:54962) 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0462ffd640 1 -- 172.21.15.137:0/2549612874 learned_addr learned my addr 172.21.15.137:0/2549612874 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f04637fe640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04640b3de0 0x7f046415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:54.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.339+0000 7f0463fff640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0464145980 0x7f0464073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f0462ffd640 1 -- 172.21.15.137:0/2549612874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0464145980 msgr2=0x7f0464073000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f0462ffd640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0464145980 0x7f0464073000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f0462ffd640 1 -- 172.21.15.137:0/2549612874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04640b3de0 msgr2=0x7f046415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f0462ffd640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04640b3de0 0x7f046415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f0462ffd640 1 -- 172.21.15.137:0/2549612874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046413d480 con 0x7f04640b61a0 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f04637fe640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04640b3de0 0x7f046415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f0462ffd640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 0x7f0464072ac0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f045800c430 tx=0x7f045800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f044bfff640 1 -- 172.21.15.137:0/2549612874 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458011790 con 0x7f04640b61a0 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f044bfff640 1 -- 172.21.15.137:0/2549612874 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0458017070 con 0x7f04640b61a0 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04640b2f60 con 0x7f04640b61a0 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f044bfff640 1 -- 172.21.15.137:0/2549612874 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458011bb0 con 0x7f04640b61a0 2024-04-26T22:07:54.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.340+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04640b3520 con 0x7f04640b61a0 2024-04-26T22:07:54.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.341+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f046406a290 con 0x7f04640b61a0 2024-04-26T22:07:54.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.341+0000 7f044bfff640 1 -- 172.21.15.137:0/2549612874 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f045801c460 con 0x7f04640b61a0 2024-04-26T22:07:54.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.342+0000 7f044bfff640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f045006c8f0 0x7f045006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:54.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.342+0000 7f044bfff640 1 -- 172.21.15.137:0/2549612874 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f045808ba40 con 0x7f04640b61a0 2024-04-26T22:07:54.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.342+0000 7f04637fe640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f045006c8f0 0x7f045006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:54.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.342+0000 7f04637fe640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f045006c8f0 0x7f045006edb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0454006fd0 tx=0x7f0454008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:54.349 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.346+0000 7f044bfff640 1 -- 172.21.15.137:0/2549612874 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0458059ea0 con 0x7f04640b61a0 2024-04-26T22:07:54.557 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.557+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0464073cc0 con 0x7f04640b61a0 2024-04-26T22:07:54.558 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.558+0000 7f044bfff640 1 -- 172.21.15.137:0/2549612874 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5197 (secure 0 0 0) 0x7f045808be20 con 0x7f04640b61a0 2024-04-26T22:07:54.558 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:54.558 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:07:53.730191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8859":{"gid":8859,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":8,"addr":"172.21.15.137:6837/2830617564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2830617564},{"type":"v1","addr":"172.21.15.137:6837","nonce":2830617564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8859,"qdb_cluster":[8859]},"id":8}]} 2024-04-26T22:07:54.558 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 87 2024-04-26T22:07:54.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f045006c8f0 msgr2=0x7f045006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:54.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f045006c8f0 0x7f045006edb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0454006fd0 tx=0x7f0454008040 comp rx=0 tx=0).stop 2024-04-26T22:07:54.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 msgr2=0x7f0464072ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:54.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 0x7f0464072ac0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f045800c430 tx=0x7f045800c8f0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 shutdown_connections 2024-04-26T22:07:54.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f045006c8f0 0x7f045006edb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f04640b61a0 0x7f0464072ac0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.560 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0464145980 0x7f0464073000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 --2- 172.21.15.137:0/2549612874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f04640b3de0 0x7f046415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:54.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 >> 172.21.15.137:0/2549612874 conn(0x7f04640d0d30 msgr2=0x7f04640cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:54.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 shutdown_connections 2024-04-26T22:07:54.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:54.560+0000 7f0469a85640 1 -- 172.21.15.137:0/2549612874 wait complete. 2024-04-26T22:07:54.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:07:36.895650+0000', 'modified': '2024-04-26T22:07:53.730191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 116, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8859}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8859': {'gid': 8859, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.137:6837/2830617564', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 2830617564}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 2830617564}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8859, 'qdb_cluster': [8859]} 2024-04-26T22:07:54.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:07:54.974 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T22:07:55.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.073+0000 7f8203ac8640 1 Processor -- start 2024-04-26T22:07:55.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.074+0000 7f8203ac8640 1 -- start start 2024-04-26T22:07:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.074+0000 7f8203ac8640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f81fc15d0c0 0x7f81fc15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.074+0000 7f8203ac8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc160200 0x7f81fc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8203ac8640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81fc160780 con 0x7f81fc06f3c0 2024-04-26T22:07:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8203ac8640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f81fc06f800 con 0x7f81fc15d0c0 2024-04-26T22:07:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8203ac8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81fc160a60 con 0x7f81fc160200 2024-04-26T22:07:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8202065640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f81fc06f3c0 0x7f81fc073100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:58692/0 (socket says 172.21.15.137:58692) 2024-04-26T22:07:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8202065640 1 -- 172.21.15.137:0/2401020819 learned_addr learned my addr 172.21.15.137:0/2401020819 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8201864640 1 --2- 172.21.15.137:0/2401020819 >> v2:172.21.15.170:3300/0 conn(0x7f81fc15d0c0 0x7f81fc15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163481931 0 0) 0x7f81fc160780 con 0x7f81fc06f3c0 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8201063640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc160200 0x7f81fc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81e8003520 con 0x7f81fc06f3c0 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1415002036 0 0) 0x7f81e8003520 con 0x7f81fc06f3c0 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc160200 msgr2=0x7f81fc06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc160200 0x7f81fc06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 >> v2:172.21.15.170:3300/0 conn(0x7f81fc15d0c0 msgr2=0x7f81fc15fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 --2- 172.21.15.137:0/2401020819 >> v2:172.21.15.170:3300/0 conn(0x7f81fc15d0c0 0x7f81fc15fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc0cff90 con 0x7f81fc06f3c0 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f81f40019f0 con 0x7f81fc06f3c0 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 >> v1:172.21.15.137:6789/0 conn(0x7f81fc06f3c0 legacy=0x7f81fc073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e80039b0 0x7f81e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e8004800 0x7f81e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc160200 0x7f81e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.078 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc06f800 con 0x7f81e8004800 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc160a60 con 0x7f81e80039b0 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81e800b9c0 con 0x7f81fc160200 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8201063640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e8004800 0x7f81e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8201864640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e80039b0 0x7f81e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.075+0000 7f8202065640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc160200 0x7f81e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8201063640 1 -- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc160200 msgr2=0x7f81e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8201063640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc160200 0x7f81e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8201063640 1 -- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e80039b0 msgr2=0x7f81e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8201063640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e80039b0 0x7f81e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8201063640 1 -- 172.21.15.137:0/2401020819 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e8003520 con 0x7f81e8004800 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8202065640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc160200 0x7f81e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8201063640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e8004800 0x7f81e8004c80 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009ac0 tx=0x7f81e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12332835708f977 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec036070 con 0x7f81e8004800 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec031400 con 0x7f81e8004800 2024-04-26T22:07:55.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.076+0000 7f8200862640 1 -- 172.21.15.137:0/2401020819 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec009690 con 0x7f81e8004800 2024-04-26T22:07:55.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.077+0000 7f8203ac8640 1 -- 172.21.15.137:0/2401020819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e8004800 msgr2=0x7f81e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.077+0000 7f8203ac8640 1 --2- 172.21.15.137:0/2401020819 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e8004800 0x7f81e8004c80 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009ac0 tx=0x7f81e8005830 comp rx=0 tx=0).stop 2024-04-26T22:07:55.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.077+0000 7f8202065640 1 -- 172.21.15.137:0/2401020819 reap_dead start 2024-04-26T22:07:55.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.077+0000 7f8203ac8640 1 -- 172.21.15.137:0/2401020819 shutdown_connections 2024-04-26T22:07:55.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.077+0000 7f8203ac8640 1 -- 172.21.15.137:0/2401020819 >> 172.21.15.137:0/2401020819 conn(0x7f81fc0b3b10 msgr2=0x7f81fc0b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:55.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.077+0000 7f8203ac8640 1 -- 172.21.15.137:0/2401020819 shutdown_connections 2024-04-26T22:07:55.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.077+0000 7f8203ac8640 1 -- 172.21.15.137:0/2401020819 wait complete. 2024-04-26T22:07:55.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.078+0000 7f8203ac8640 1 Processor -- start 2024-04-26T22:07:55.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.078+0000 7f8203ac8640 1 -- start start 2024-04-26T22:07:55.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8203ac8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e8004800 0x7f81fc147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8203ac8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81fc144120 0x7f81fc14a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8203ac8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc0b5880 0x7f81fc0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8203ac8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc15d4a0 con 0x7f81fc144120 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8203ac8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc15c9b0 con 0x7f81e8004800 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8203ac8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81fc15d620 con 0x7f81fc0b5880 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201063640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81fc144120 0x7f81fc14a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201063640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81fc144120 0x7f81fc14a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54978/0 (socket says 172.21.15.137:54978) 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201063640 1 -- 172.21.15.137:0/2107592720 learned_addr learned my addr 172.21.15.137:0/2107592720 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8202065640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc0b5880 0x7f81fc0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201864640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e8004800 0x7f81fc147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201063640 1 -- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc0b5880 msgr2=0x7f81fc0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201063640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc0b5880 0x7f81fc0b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201063640 1 -- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e8004800 msgr2=0x7f81fc147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201063640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e8004800 0x7f81fc147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201063640 1 -- 172.21.15.137:0/2107592720 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81fc1445a0 con 0x7f81fc144120 2024-04-26T22:07:55.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201864640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e8004800 0x7f81fc147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8202065640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc0b5880 0x7f81fc0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.079+0000 7f8201063640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81fc144120 0x7f81fc14a580 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009be0 tx=0x7f81ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.080+0000 7f81f27fc640 1 -- 172.21.15.137:0/2107592720 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec041020 con 0x7f81fc144120 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.080+0000 7f81f27fc640 1 -- 172.21.15.137:0/2107592720 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81ec03c470 con 0x7f81fc144120 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.080+0000 7f8203ac8640 1 -- 172.21.15.137:0/2107592720 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81fc1449f0 con 0x7f81fc144120 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.080+0000 7f81f27fc640 1 -- 172.21.15.137:0/2107592720 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec036040 con 0x7f81fc144120 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.080+0000 7f8203ac8640 1 -- 172.21.15.137:0/2107592720 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81fc144fb0 con 0x7f81fc144120 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.081+0000 7f81f27fc640 1 -- 172.21.15.137:0/2107592720 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81ec044020 con 0x7f81fc144120 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.082+0000 7f81f27fc640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e006c920 0x7f81e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.082+0000 7f81f27fc640 1 -- 172.21.15.137:0/2107592720 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f81ec0ab960 con 0x7f81fc144120 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.082+0000 7f8201864640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e006c920 0x7f81e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.082+0000 7f8201864640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e006c920 0x7f81e006ede0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009c40 tx=0x7f81f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.083+0000 7f82067e9740 1 Processor -- start 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.083+0000 7f82067e9740 1 -- start start 2024-04-26T22:07:55.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.083+0000 7f82067e9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 0x562e10860820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.083+0000 7f82067e9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e1087dce0 0x562e1087e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.083+0000 7f82067e9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10836120 0x562e1087c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.083+0000 7f82067e9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562e1079a740 con 0x562e10836120 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.083+0000 7f82067e9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562e107363a0 con 0x562e1087dce0 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.083+0000 7f82067e9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562e10796700 con 0x562e10860440 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f8202065640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10836120 0x562e1087c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f8202065640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10836120 0x562e1087c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54988/0 (socket says 172.21.15.137:54988) 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f8202065640 1 -- 172.21.15.137:0/1636210423 learned_addr learned my addr 172.21.15.137:0/1636210423 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f8202065640 1 -- 172.21.15.137:0/1636210423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 msgr2=0x562e10860820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f8202065640 1 --2- 172.21.15.137:0/1636210423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 0x562e10860820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f8202065640 1 -- 172.21.15.137:0/1636210423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e1087dce0 msgr2=0x562e1087e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f8202065640 1 --2- 172.21.15.137:0/1636210423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e1087dce0 0x562e1087e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f8202065640 1 -- 172.21.15.137:0/1636210423 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e10752750 con 0x562e10836120 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f8202065640 1 --2- 172.21.15.137:0/1636210423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10836120 0x562e1087c3a0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f81f4002230 tx=0x7f81f4005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526afbd311cb1f21 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f81df7fe640 1 -- 172.21.15.137:0/1636210423 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f40077e0 con 0x562e10836120 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f81df7fe640 1 -- 172.21.15.137:0/1636210423 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f4007980 con 0x562e10836120 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.084+0000 7f81df7fe640 1 -- 172.21.15.137:0/1636210423 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4014620 con 0x562e10836120 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 -- 172.21.15.137:0/1636210423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10836120 msgr2=0x562e1087c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 --2- 172.21.15.137:0/1636210423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10836120 0x562e1087c3a0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f81f4002230 tx=0x7f81f4005f40 comp rx=0 tx=0).stop 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 -- 172.21.15.137:0/1636210423 shutdown_connections 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 --2- 172.21.15.137:0/1636210423 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10836120 0x562e1087c3a0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 --2- 172.21.15.137:0/1636210423 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e1087dce0 0x562e1087e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 --2- 172.21.15.137:0/1636210423 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 0x562e10860820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 -- 172.21.15.137:0/1636210423 >> 172.21.15.137:0/1636210423 conn(0x562e10832a50 msgr2=0x562e1087b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 -- 172.21.15.137:0/1636210423 shutdown_connections 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 -- 172.21.15.137:0/1636210423 wait complete. 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 -- start start 2024-04-26T22:07:55.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.085+0000 7f82067e9740 1 Processor -- start 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f82067e9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10860440 0x562e1085ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f82067e9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10874040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f82067e9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10874580 0x562e1087c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f82067e9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562e10836ec0 con 0x562e1087dce0 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f82067e9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562e10721fe0 con 0x562e10860440 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f82067e9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562e10830980 con 0x562e10874580 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f82067e9740 10 client.0 _ll_register_callbacks cb 0x562e10738150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f8201063640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10874040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f8201063640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10874040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55000/0 (socket says 172.21.15.137:55000) 2024-04-26T22:07:55.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.086+0000 7f8201063640 1 -- 172.21.15.137:0/3351254219 learned_addr learned my addr 172.21.15.137:0/3351254219 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f8202065640 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10874580 0x562e1087c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f8201864640 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10860440 0x562e1085ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f8201063640 1 -- 172.21.15.137:0/3351254219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10874580 msgr2=0x562e1087c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f8201063640 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10874580 0x562e1087c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f8201063640 1 -- 172.21.15.137:0/3351254219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10860440 msgr2=0x562e1085ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f8201063640 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10860440 0x562e1085ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f8201063640 1 -- 172.21.15.137:0/3351254219 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e104ac2d0 con 0x562e1087dce0 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f8201063640 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10874040 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f81ec081d70 tx=0x7f81ec009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc7c7ad2cedf03d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f81dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f81dcff9640 1 -- 172.21.15.137:0/3351254219 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec090060 con 0x562e1087dce0 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f81dcff9640 1 -- 172.21.15.137:0/3351254219 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f81ec082010 con 0x562e1087dce0 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f82067e9740 1 -- 172.21.15.137:0/3351254219 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81f4007980 con 0x562e1087dce0 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f81dcff9640 1 -- 172.21.15.137:0/3351254219 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f81ec0a8050 con 0x562e1087dce0 2024-04-26T22:07:55.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f82067e9740 10 client.9162 fetch_fsmap learned FSMap version 87 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f82067e9740 1 -- 172.21.15.137:0/3351254219 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x562e105766b0 con 0x562e1087dce0 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f81dcff9640 1 -- 172.21.15.137:0/3351254219 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f4007980 con 0x562e1087dce0 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f81dcff9640 1 -- 172.21.15.137:0/3351254219 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7f81ec078b10 con 0x562e1087dce0 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f82067e9740 10 client.9162 fetch_fsmap finished waiting for FSMap version 87 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f82067e9740 10 client.9162 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f82067e9740 20 client.9162 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f82067e9740 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x562e108623d0 0x562e108627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.087+0000 7f82067e9740 4 client.9162 mds_command: new command op to 8859 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.088+0000 7f82067e9740 1 -- 172.21.15.137:0/3351254219 --> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e107a8350 con 0x562e108623d0 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.088+0000 7f8201864640 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x562e108623d0 0x562e108627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.088+0000 7f81dcff9640 10 client.9162 ms_handle_connect on v2:172.21.15.137:6835/2830617564 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.088+0000 7f8201864640 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x562e108623d0 0x562e108627b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c41de35bfc1f760 server_cookie=e0533f4171724406 in_seq=0 out_seq=0 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.088+0000 7f81dcff9640 1 -- 172.21.15.137:0/3351254219 <== mds.0 v2:172.21.15.137:6835/2830617564 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562e107a8350 con 0x562e108623d0 2024-04-26T22:07:55.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.088+0000 7f81dcff9640 10 client.9162 handle_command_reply: tid=0 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 client.9162 shutdown 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 -- 172.21.15.137:0/3351254219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 msgr2=0x562e10874040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10874040 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f81ec081d70 tx=0x7f81ec009810 comp rx=0 tx=0).stop 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 -- 172.21.15.137:0/3351254219 shutdown_connections 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x562e108623d0 0x562e108627b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10874040 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10874580 0x562e1087c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 --2- 172.21.15.137:0/3351254219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10860440 0x562e1085ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f81dcff9640 0 client.9162 ms_handle_reset on v2:172.21.15.137:6835/2830617564 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 -- 172.21.15.137:0/3351254219 >> 172.21.15.137:0/3351254219 conn(0x562e10836120 msgr2=0x562e1087e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 -- 172.21.15.137:0/3351254219 shutdown_connections 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 1 -- 172.21.15.137:0/3351254219 wait complete. 2024-04-26T22:07:55.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.089+0000 7f82067e9740 20 client.9162 trim_cache size 0 max 16384 2024-04-26T22:07:55.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.107+0000 7f82067e9740 1 Processor -- start 2024-04-26T22:07:55.107 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.107+0000 7f82067e9740 1 -- start start 2024-04-26T22:07:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f82067e9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10860440 0x562e10873d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f82067e9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 0x562e1087b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f82067e9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e1087dce0 0x562e1087b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f82067e9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc1feea0 con 0x562e10860440 2024-04-26T22:07:55.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f82067e9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f81fc09c5e0 con 0x562e10874580 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f82067e9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81fc1fe850 con 0x562e1087dce0 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201864640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10860440 0x562e10873d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201864640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10860440 0x562e10873d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55014/0 (socket says 172.21.15.137:55014) 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201864640 1 -- 172.21.15.137:0/749270419 learned_addr learned my addr 172.21.15.137:0/749270419 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201063640 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 0x562e1087b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8202065640 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e1087dce0 0x562e1087b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201864640 1 -- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e1087dce0 msgr2=0x562e1087b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201864640 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e1087dce0 0x562e1087b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201864640 1 -- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 msgr2=0x562e1087b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201864640 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 0x562e1087b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201864640 1 -- 172.21.15.137:0/749270419 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e10830d40 con 0x562e10860440 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201063640 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 0x562e1087b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8202065640 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e1087dce0 0x562e1087b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:55.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f8201864640 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10860440 0x562e10873d10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009660 tx=0x7f81f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abe11f4be224f60 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f81deffd640 1 -- 172.21.15.137:0/749270419 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8033070 con 0x562e10860440 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f81deffd640 1 -- 172.21.15.137:0/749270419 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f8025b20 con 0x562e10860440 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.108+0000 7f81deffd640 1 -- 172.21.15.137:0/749270419 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8004030 con 0x562e10860440 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 -- 172.21.15.137:0/749270419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10860440 msgr2=0x562e10873d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10860440 0x562e10873d10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009660 tx=0x7f81f8017000 comp rx=0 tx=0).stop 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 -- 172.21.15.137:0/749270419 shutdown_connections 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e1087dce0 0x562e1087b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 0x562e1087b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 --2- 172.21.15.137:0/749270419 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e10860440 0x562e10873d10 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 -- 172.21.15.137:0/749270419 >> 172.21.15.137:0/749270419 conn(0x562e10836120 msgr2=0x562e1089f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 -- 172.21.15.137:0/749270419 shutdown_connections 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 -- 172.21.15.137:0/749270419 wait complete. 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 -- start start 2024-04-26T22:07:55.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.109+0000 7f82067e9740 1 Processor -- start 2024-04-26T22:07:55.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f82067e9740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 0x562e10833ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f82067e9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 0x562e10834530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f82067e9740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10889970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f82067e9740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x562e10836ec0 con 0x562e1087dce0 2024-04-26T22:07:55.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f82067e9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x562e10721fe0 con 0x562e10874580 2024-04-26T22:07:55.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f82067e9740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x562e1088ecf0 con 0x562e10860440 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f82067e9740 10 client.0 _ll_register_callbacks cb 0x7f81ec006c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f8202065640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10889970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f8202065640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10889970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55028/0 (socket says 172.21.15.137:55028) 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.110+0000 7f8202065640 1 -- 172.21.15.137:0/3825158081 learned_addr learned my addr 172.21.15.137:0/3825158081 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f8201063640 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 0x562e10834530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f8201864640 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 0x562e10833ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f8202065640 1 -- 172.21.15.137:0/3825158081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 msgr2=0x562e10833ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f8202065640 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 0x562e10833ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f8202065640 1 -- 172.21.15.137:0/3825158081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 msgr2=0x562e10834530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f8202065640 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 0x562e10834530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f8202065640 1 -- 172.21.15.137:0/3825158081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e1085fdc0 con 0x562e1087dce0 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f8201864640 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 0x562e10833ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f8202065640 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10889970 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f81f40013d0 tx=0x7f81f4001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47677a789796602c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f81dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f81dcff9640 1 -- 172.21.15.137:0/3825158081 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4014c10 con 0x562e1087dce0 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f81dcff9640 1 -- 172.21.15.137:0/3825158081 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f81f4014db0 con 0x562e1087dce0 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f82067e9740 1 -- 172.21.15.137:0/3825158081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81f8025b20 con 0x562e1087dce0 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f81dcff9640 1 -- 172.21.15.137:0/3825158081 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f81f4031050 con 0x562e1087dce0 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f82067e9740 10 client.9168 fetch_fsmap learned FSMap version 87 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f82067e9740 1 -- 172.21.15.137:0/3825158081 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x562e10871a20 con 0x562e1087dce0 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f81dcff9640 1 -- 172.21.15.137:0/3825158081 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f8025b20 con 0x562e1087dce0 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f81dcff9640 1 -- 172.21.15.137:0/3825158081 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7f81f4034020 con 0x562e1087dce0 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f82067e9740 10 client.9168 fetch_fsmap finished waiting for FSMap version 87 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f82067e9740 10 client.9168 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f82067e9740 20 client.9168 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f82067e9740 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x562e1088a2b0 0x562e10878050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f82067e9740 4 client.9168 mds_command: new command op to 8859 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.111+0000 7f82067e9740 1 -- 172.21.15.137:0/3825158081 --> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] -- command(tid 0: {"prefix": "status"}) -- 0x562e107a21c0 con 0x562e1088a2b0 2024-04-26T22:07:55.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f8201864640 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x562e1088a2b0 0x562e10878050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f81dcff9640 10 client.9168 ms_handle_connect on v2:172.21.15.137:6835/2830617564 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f8201864640 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x562e1088a2b0 0x562e10878050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26b5a0f221df978 server_cookie=7a836260a553d8f4 in_seq=0 out_seq=0 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f81dcff9640 1 -- 172.21.15.137:0/3825158081 <== mds.0 v2:172.21.15.137:6835/2830617564 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562e107a21c0 con 0x562e1088a2b0 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f81dcff9640 10 client.9168 handle_command_reply: tid=0 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 client.9168 shutdown 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 -- 172.21.15.137:0/3825158081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 msgr2=0x562e10889970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10889970 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f81f40013d0 tx=0x7f81f4001360 comp rx=0 tx=0).stop 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 -- 172.21.15.137:0/3825158081 shutdown_connections 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x562e1088a2b0 0x562e10878050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x562e1087dce0 0x562e10889970 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e10874580 0x562e10834530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 --2- 172.21.15.137:0/3825158081 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x562e10860440 0x562e10833ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f81dcff9640 0 client.9168 ms_handle_reset on v2:172.21.15.137:6835/2830617564 2024-04-26T22:07:55.118 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 -- 172.21.15.137:0/3825158081 >> 172.21.15.137:0/3825158081 conn(0x562e10836120 msgr2=0x562e1088ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 -- 172.21.15.137:0/3825158081 shutdown_connections 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 1 -- 172.21.15.137:0/3825158081 wait complete. 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.112+0000 7f82067e9740 20 client.9168 trim_cache size 0 max 16384 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 8859, 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:07:55.119 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:07:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.3924240909999996, 2024-04-26T22:07:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 87, 2024-04-26T22:07:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 116, 2024-04-26T22:07:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 116, 2024-04-26T22:07:55.120 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 22.603537349 2024-04-26T22:07:55.120 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 -- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e006c920 msgr2=0x7f81e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e006c920 0x7f81e006ede0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009c40 tx=0x7f81f8008040 comp rx=0 tx=0).stop 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 -- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81fc144120 msgr2=0x7f81fc14a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81fc144120 0x7f81fc14a580 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009be0 tx=0x7f81ec004730 comp rx=0 tx=0).stop 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 -- 172.21.15.137:0/2107592720 shutdown_connections 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81e006c920 0x7f81e006ede0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81fc144120 0x7f81fc14a580 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81fc0b5880 0x7f81fc0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 --2- 172.21.15.137:0/2107592720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e8004800 0x7f81fc147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 -- 172.21.15.137:0/2107592720 >> 172.21.15.137:0/2107592720 conn(0x7f81fc0b3b10 msgr2=0x7f81fc06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 -- 172.21.15.137:0/2107592720 shutdown_connections 2024-04-26T22:07:55.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.113+0000 7f8203ac8640 1 -- 172.21.15.137:0/2107592720 wait complete. 2024-04-26T22:07:55.123 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:07:55.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.220+0000 7f5af8789640 1 Processor -- start 2024-04-26T22:07:55.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.220+0000 7f5af8789640 1 -- start start 2024-04-26T22:07:55.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af8789640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5af015f1e0 0x7f5af006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.229 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af8789640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5af00b44e0 0x7f5af00ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af8789640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5af006d2b0 0x7f5af006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af8789640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5af006dc60 con 0x7f5af00b44e0 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af8789640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5af006eeb0 con 0x7f5af006d2b0 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af8789640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00b4a10 con 0x7f5af015f1e0 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af5d24640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5af00b44e0 0x7f5af00ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af5d24640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5af00b44e0 0x7f5af00ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55034/0 (socket says 172.21.15.137:55034) 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af5d24640 1 -- 172.21.15.137:0/3406368255 learned_addr learned my addr 172.21.15.137:0/3406368255 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af5d24640 1 -- 172.21.15.137:0/3406368255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5af015f1e0 msgr2=0x7f5af006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af5d24640 1 --2- 172.21.15.137:0/3406368255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5af015f1e0 0x7f5af006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af5d24640 1 -- 172.21.15.137:0/3406368255 >> v2:172.21.15.170:3300/0 conn(0x7f5af006d2b0 msgr2=0x7f5af006d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af5d24640 1 --2- 172.21.15.137:0/3406368255 >> v2:172.21.15.170:3300/0 conn(0x7f5af006d2b0 0x7f5af006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.230 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.221+0000 7f5af5d24640 1 -- 172.21.15.137:0/3406368255 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af00b4cf0 con 0x7f5af00b44e0 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.222+0000 7f5af5d24640 1 --2- 172.21.15.137:0/3406368255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af00b44e0 0x7f5af00ae8b0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f5af0163ef0 tx=0x7f5ae002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff41519435be0f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.222+0000 7f5af5523640 1 -- 172.21.15.137:0/3406368255 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0037070 con 0x7f5af00b44e0 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.222+0000 7f5af5523640 1 -- 172.21.15.137:0/3406368255 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae0032440 con 0x7f5af00b44e0 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.222+0000 7f5af5523640 1 -- 172.21.15.137:0/3406368255 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0032810 con 0x7f5af00b44e0 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.222+0000 7f5af8789640 1 -- 172.21.15.137:0/3406368255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af00b44e0 msgr2=0x7f5af00ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.222+0000 7f5af8789640 1 --2- 172.21.15.137:0/3406368255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af00b44e0 0x7f5af00ae8b0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f5af0163ef0 tx=0x7f5ae002a1e0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.223+0000 7f5af8789640 1 -- 172.21.15.137:0/3406368255 shutdown_connections 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.223+0000 7f5af8789640 1 --2- 172.21.15.137:0/3406368255 >> v2:172.21.15.170:3300/0 conn(0x7f5af006d2b0 0x7f5af006d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.223+0000 7f5af8789640 1 --2- 172.21.15.137:0/3406368255 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af00b44e0 0x7f5af00ae8b0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.223+0000 7f5af8789640 1 --2- 172.21.15.137:0/3406368255 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5af015f1e0 0x7f5af006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.223+0000 7f5af8789640 1 -- 172.21.15.137:0/3406368255 >> 172.21.15.137:0/3406368255 conn(0x7f5af00728a0 msgr2=0x7f5af0072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.223+0000 7f5af8789640 1 -- 172.21.15.137:0/3406368255 shutdown_connections 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.223+0000 7f5af8789640 1 -- 172.21.15.137:0/3406368255 wait complete. 2024-04-26T22:07:55.231 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af8789640 1 Processor -- start 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af8789640 1 -- start start 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af8789640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af006d2b0 0x7f5af014b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af8789640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5af00b44e0 0x7f5af014d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af8789640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5af015f1e0 0x7f5af00b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af8789640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00b5590 con 0x7f5af006d2b0 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af8789640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00b52b0 con 0x7f5af00b44e0 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af8789640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00aedf0 con 0x7f5af015f1e0 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af6525640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af006d2b0 0x7f5af014b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.224+0000 7f5af6525640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af006d2b0 0x7f5af014b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:55048/0 (socket says 172.21.15.137:55048) 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af6525640 1 -- 172.21.15.137:0/1598850871 learned_addr learned my addr 172.21.15.137:0/1598850871 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af6525640 1 -- 172.21.15.137:0/1598850871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5af015f1e0 msgr2=0x7f5af00b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.232 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af6525640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5af015f1e0 0x7f5af00b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af6525640 1 -- 172.21.15.137:0/1598850871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5af00b44e0 msgr2=0x7f5af014d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af5d24640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5af00b44e0 0x7f5af014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af6525640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5af00b44e0 0x7f5af014d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af6525640 1 -- 172.21.15.137:0/1598850871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af0152200 con 0x7f5af006d2b0 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af6525640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af006d2b0 0x7f5af014b940 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00b4d0 tx=0x7f5aec00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5ae6ffd640 1 -- 172.21.15.137:0/1598850871 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec014070 con 0x7f5af006d2b0 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5ae6ffd640 1 -- 172.21.15.137:0/1598850871 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aec010870 con 0x7f5af006d2b0 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af01524e0 con 0x7f5af006d2b0 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5ae6ffd640 1 -- 172.21.15.137:0/1598850871 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec010c60 con 0x7f5af006d2b0 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.225+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af0152aa0 con 0x7f5af006d2b0 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.226+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af006a290 con 0x7f5af006d2b0 2024-04-26T22:07:55.233 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.227+0000 7f5ae6ffd640 1 -- 172.21.15.137:0/1598850871 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5aec017070 con 0x7f5af006d2b0 2024-04-26T22:07:55.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.227+0000 7f5ae6ffd640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5ad406c8f0 0x7f5ad406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:55.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.227+0000 7f5ae6ffd640 1 -- 172.21.15.137:0/1598850871 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f5aec08ba40 con 0x7f5af006d2b0 2024-04-26T22:07:55.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.227+0000 7f5af5d24640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5ad406c8f0 0x7f5ad406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:55.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.227+0000 7f5af5d24640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5ad406c8f0 0x7f5ad406edb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0034000 tx=0x7f5ae002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:55.234 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.231+0000 7f5ae6ffd640 1 -- 172.21.15.137:0/1598850871 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5aec059d80 con 0x7f5af006d2b0 2024-04-26T22:07:55.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.443+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5af015b370 con 0x7f5af006d2b0 2024-04-26T22:07:55.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.444+0000 7f5ae6ffd640 1 -- 172.21.15.137:0/1598850871 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v87) ==== 53+0+73 (secure 0 0 0) 0x7f5aec08be20 con 0x7f5af006d2b0 2024-04-26T22:07:55.444 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:07:55.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5ad406c8f0 msgr2=0x7f5ad406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5ad406c8f0 0x7f5ad406edb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0034000 tx=0x7f5ae002e000 comp rx=0 tx=0).stop 2024-04-26T22:07:55.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af006d2b0 msgr2=0x7f5af014b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:55.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af006d2b0 0x7f5af014b940 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00b4d0 tx=0x7f5aec00b990 comp rx=0 tx=0).stop 2024-04-26T22:07:55.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 shutdown_connections 2024-04-26T22:07:55.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5ad406c8f0 0x7f5ad406edb0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5af015f1e0 0x7f5af00b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5af00b44e0 0x7f5af014d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 --2- 172.21.15.137:0/1598850871 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5af006d2b0 0x7f5af014b940 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 >> 172.21.15.137:0/1598850871 conn(0x7f5af00728a0 msgr2=0x7f5af00d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 shutdown_connections 2024-04-26T22:07:55.448 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55.446+0000 7f5af8789640 1 -- 172.21.15.137:0/1598850871 wait complete. 2024-04-26T22:07:55.457 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:07:55.457 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:07:55.458 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:07:55.458 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:07:55.458 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:55.458 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:07:55.458 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:07:55.458 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:07:55.459 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:07:55.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:55.459 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:07:55.475 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:07:55.475 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:07:55.475 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:07:55.475 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:55.475 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:07:55.475 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42231sec preferred_lft 42231sec 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:07:55.476 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:55.477 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:07:55.477 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:07:55.477 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:07:55.477 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:55.477 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:07:55.477 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:55.477 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:07:55.477 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:07:55.477 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:07:55.478 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:55.478 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:07:55.478 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:07:55.478 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:07:55.478 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:07:55.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:55.478 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:07:55.537 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:07:55.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:55.539 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:07:55.595 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:07:55.595 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:07:55.595 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:07:55.595 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:07:55.595 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:07:55.596 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:07:55.596 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:07:55.596 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:07:55.596 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:07:55.596 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:07:55.596 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:07:55.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:07:55.712 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:55.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:55.718 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:07:55.733 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:07:55.733 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:07:55.733 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:07:55.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:55.734 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:07:55.797 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:07:55.797 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:55.852 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:07:55.853 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:07:55.853 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:55.907 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:07:55.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:55.907 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:07:55.988 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:07:55.989 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:07:56.002 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:07:56.003 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:07:56.003 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:07:56.003 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:07:56.003 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:07:56.003 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:07:56.004 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:07:56.004 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:07:56.004 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:07:56.004 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:07:56.005 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:07:56.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:56.006 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:56.069 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:07:56.158 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:07:56.159 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:56.164 INFO:teuthology.orchestra.run.smithi137.stdout:client7630 2024-04-26T22:07:56.165 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:56.165 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:56.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:56.181 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-26T22:07:56.240 INFO:teuthology.orchestra.run.smithi137.stdout:./ 2024-04-26T22:07:56.240 INFO:teuthology.orchestra.run.smithi137.stdout:./parent 2024-04-26T22:07:56.240 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed 2024-04-26T22:07:56.240 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed/charlie 2024-04-26T22:07:56.240 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed/alpha 2024-04-26T22:07:56.240 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/unflushed 2024-04-26T22:07:56.241 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/unflushed/jfile 2024-04-26T22:07:56.241 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:56.241 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:56.241 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:56.241 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:56.241 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-26T22:07:56.241 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:56.345 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:07:56.348 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:56.354 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:56.354 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:56.354 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:56.354 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:56.355 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-26T22:07:56.355 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:56.459 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627776 2024-04-26T22:07:56.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:56.469 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:56.469 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:56.469 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:56.470 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:56.470 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-26T22:07:56.470 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:56.573 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627777 2024-04-26T22:07:56.576 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:56.582 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:56.582 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:56.583 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:56.583 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:56.583 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-26T22:07:56.583 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:56.688 INFO:teuthology.orchestra.run.smithi137.stdout:1099511628280 2024-04-26T22:07:56.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:56.697 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:56.697 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:56.697 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:56.697 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:56.697 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-26T22:07:56.698 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:56.801 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627778 2024-04-26T22:07:56.803 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:56.810 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:56.810 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:56.810 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:56.810 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:56.810 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-26T22:07:56.811 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:56.916 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627779 2024-04-26T22:07:56.918 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:56.924 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:07:56.924 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:07:56.924 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:07:56.924 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:07:56.925 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-26T22:07:56.925 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:07:57.029 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627780 2024-04-26T22:07:57.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:07:57.038 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:57.038 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:57.097 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:07:57.097 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:07:57.152 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:07:57.289 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.289+0000 7fa001eda640 1 Processor -- start 2024-04-26T22:07:57.290 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.289+0000 7fa001eda640 1 -- start start 2024-04-26T22:07:57.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.290+0000 7fa001eda640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9ffc15b8c0 0x7f9ffc071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.290+0000 7fa001eda640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ffc0733e0 con 0x7f9ffc06f2c0 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.290+0000 7fa001eda640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ffc072f00 con 0x7f9ffc15b4e0 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.290+0000 7fa001eda640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f9ffc072660 con 0x7f9ffc15b8c0 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.290+0000 7f9ffaffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f9ffc06f2c0 0x7f9ffc0b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47798/0 (socket says 172.21.15.137:47798) 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.290+0000 7f9ffaffd640 1 -- 172.21.15.137:0/452458954 learned_addr learned my addr 172.21.15.137:0/452458954 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.290+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937219989 0 0) 0x7f9ffc0733e0 con 0x7f9ffc06f2c0 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.290+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fe4003520 con 0x7f9ffc06f2c0 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.290+0000 7f9ffbfff640 1 --2- 172.21.15.137:0/452458954 >> v2:172.21.15.170:3300/0 conn(0x7f9ffc15b8c0 0x7f9ffc071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1438656396 0 0) 0x7f9fe4003520 con 0x7f9ffc06f2c0 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 >> v2:172.21.15.170:3300/0 conn(0x7f9ffc15b8c0 msgr2=0x7f9ffc071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 --2- 172.21.15.137:0/452458954 >> v2:172.21.15.170:3300/0 conn(0x7f9ffc15b8c0 0x7f9ffc071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 >> v1:172.21.15.170:6789/0 conn(0x7f9ffc15b4e0 legacy=0x7f9ffc06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc072940 con 0x7f9ffc06f2c0 2024-04-26T22:07:57.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f9ff0001670 con 0x7f9ffc06f2c0 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 >> v1:172.21.15.137:6789/0 conn(0x7f9ffc06f2c0 legacy=0x7f9ffc0b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9fe4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe4004800 0x7f9fe4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fe40051c0 0x7f9fe400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc072660 con 0x7f9fe40039b0 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe400c160 con 0x7f9fe4004800 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9fe400c360 con 0x7f9fe40051c0 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffb7fe640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9fe4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffaffd640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe4004800 0x7f9fe4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffbfff640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fe40051c0 0x7f9fe400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffb7fe640 1 -- 172.21.15.137:0/452458954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fe40051c0 msgr2=0x7f9fe400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffb7fe640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9fe40051c0 0x7f9fe400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffb7fe640 1 -- 172.21.15.137:0/452458954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe4004800 msgr2=0x7f9fe4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffb7fe640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fe4004800 0x7f9fe4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffb7fe640 1 -- 172.21.15.137:0/452458954 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe4003520 con 0x7f9fe40039b0 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.291+0000 7f9ffbfff640 1 -- 172.21.15.137:0/452458954 reap_dead start 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.292+0000 7f9ffb7fe640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9fe4003dd0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f9fec001750 tx=0x7f9fe4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e522b99b0117dce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.292+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec001370 con 0x7f9fe40039b0 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.292+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fec02cd90 con 0x7f9fe40039b0 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.292+0000 7f9ffa7fc640 1 -- 172.21.15.137:0/452458954 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec005310 con 0x7f9fe40039b0 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.292+0000 7fa001eda640 1 -- 172.21.15.137:0/452458954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 msgr2=0x7f9fe4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.292+0000 7fa001eda640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9fe4003dd0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f9fec001750 tx=0x7f9fe4005830 comp rx=0 tx=0).stop 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.292+0000 7fa001eda640 1 -- 172.21.15.137:0/452458954 shutdown_connections 2024-04-26T22:07:57.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.292+0000 7fa001eda640 1 --2- 172.21.15.137:0/452458954 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9fe4003dd0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.292+0000 7fa001eda640 1 -- 172.21.15.137:0/452458954 >> 172.21.15.137:0/452458954 conn(0x7f9ffc0d0d30 msgr2=0x7f9ffc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.293+0000 7fa001eda640 1 -- 172.21.15.137:0/452458954 shutdown_connections 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.293+0000 7fa001eda640 1 -- 172.21.15.137:0/452458954 wait complete. 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.294+0000 7fa001eda640 1 Processor -- start 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.294+0000 7fa001eda640 1 -- start start 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7fa001eda640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9ffc147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7fa001eda640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ffc1483e0 0x7f9ffc148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7fa001eda640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ffc1f5200 0x7f9ffc1f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7fa001eda640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc073820 con 0x7f9fe40039b0 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7fa001eda640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc0b3e80 con 0x7f9ffc1f5200 2024-04-26T22:07:57.303 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7fa001eda640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc0739a0 con 0x7f9ffc1483e0 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9ffc147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9ffc147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38946/0 (socket says 172.21.15.137:38946) 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffb7fe640 1 -- 172.21.15.137:0/394204535 learned_addr learned my addr 172.21.15.137:0/394204535 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffaffd640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ffc1483e0 0x7f9ffc148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffbfff640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ffc1f5200 0x7f9ffc1f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffb7fe640 1 -- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ffc1483e0 msgr2=0x7f9ffc148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffb7fe640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ffc1483e0 0x7f9ffc148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffb7fe640 1 -- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ffc1f5200 msgr2=0x7f9ffc1f56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffb7fe640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ffc1f5200 0x7f9ffc1f56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffb7fe640 1 -- 172.21.15.137:0/394204535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc15e210 con 0x7f9fe40039b0 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffbfff640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ffc1f5200 0x7f9ffc1f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffaffd640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ffc1483e0 0x7f9ffc148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9ffb7fe640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9ffc147ea0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9fec001870 tx=0x7f9fec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:57.304 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9fe3fff640 1 -- 172.21.15.137:0/394204535 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec040020 con 0x7f9fe40039b0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9fe3fff640 1 -- 172.21.15.137:0/394204535 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fec02cb90 con 0x7f9fe40039b0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7f9fe3fff640 1 -- 172.21.15.137:0/394204535 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec001370 con 0x7f9fe40039b0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc15e4f0 con 0x7f9fe40039b0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.295+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc15eab0 con 0x7f9fe40039b0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.296+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc06a290 con 0x7f9fe40039b0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.297+0000 7f9fe3fff640 1 -- 172.21.15.137:0/394204535 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9fec006c20 con 0x7f9fe40039b0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.297+0000 7f9fe3fff640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9fe806c8f0 0x7f9fe806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.297+0000 7f9fe3fff640 1 -- 172.21.15.137:0/394204535 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f9fec0ab750 con 0x7f9fe40039b0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.297+0000 7f9ffaffd640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9fe806c8f0 0x7f9fe806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.298+0000 7f9ffaffd640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9fe806c8f0 0x7f9fe806edb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0001200 tx=0x7f9ff0000f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:57.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.302+0000 7f9fe3fff640 1 -- 172.21.15.137:0/394204535 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f9fec04a020 con 0x7f9fe40039b0 2024-04-26T22:07:57.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.478+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ffc06d2b0 con 0x7f9fe40039b0 2024-04-26T22:07:57.479 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.479+0000 7f9fe3fff640 1 -- 172.21.15.137:0/394204535 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16770 (secure 0 0 0) 0x7f9fec079bb0 con 0x7f9fe40039b0 2024-04-26T22:07:57.479 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:57.480 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":116,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:07:49.712938+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:6834/1666946913":"2024-04-27T22:07:49.712915+0000","172.21.15.170:6832/1666946913":"2024-04-27T22:07:49.712915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.481+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9fe806c8f0 msgr2=0x7f9fe806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.481+0000 7fa001eda640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9fe806c8f0 0x7f9fe806edb0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0001200 tx=0x7f9ff0000f30 comp rx=0 tx=0).stop 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.481+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 msgr2=0x7f9ffc147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.481+0000 7fa001eda640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9ffc147ea0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9fec001870 tx=0x7f9fec001120 comp rx=0 tx=0).stop 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.481+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 shutdown_connections 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.481+0000 7fa001eda640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f9fe806c8f0 0x7f9fe806edb0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.481+0000 7fa001eda640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ffc1f5200 0x7f9ffc1f56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.481+0000 7fa001eda640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9ffc1483e0 0x7f9ffc148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.481+0000 7fa001eda640 1 --2- 172.21.15.137:0/394204535 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f9fe40039b0 0x7f9ffc147ea0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.482 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.482+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 >> 172.21.15.137:0/394204535 conn(0x7f9ffc0d0d30 msgr2=0x7f9ffc14f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:57.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.482+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 shutdown_connections 2024-04-26T22:07:57.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.482+0000 7fa001eda640 1 -- 172.21.15.137:0/394204535 wait complete. 2024-04-26T22:07:57.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:07:35.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:07:35.848066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:07:57.495 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:07:57.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.596+0000 7fc8bd409640 1 Processor -- start 2024-04-26T22:07:57.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.596+0000 7fc8bd409640 1 -- start start 2024-04-26T22:07:57.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8bd409640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc8b806f340 0x7fc8b80b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8bd409640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc8b80d0300 0x7fc8b806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8bd409640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b80b3e50 0x7fc8b80720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8bd409640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b806fc60 con 0x7fc8b80d0300 2024-04-26T22:07:57.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8bd409640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b80b46a0 con 0x7fc8b806f340 2024-04-26T22:07:57.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8bd409640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b80b5db0 con 0x7fc8b80b3e50 2024-04-26T22:07:57.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b67fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc8b80d0300 0x7fc8b806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b67fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc8b80d0300 0x7fc8b806f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38958/0 (socket says 172.21.15.137:38958) 2024-04-26T22:07:57.598 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b67fc640 1 -- 172.21.15.137:0/1312421303 learned_addr learned my addr 172.21.15.137:0/1312421303 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b6ffd640 1 --2- 172.21.15.137:0/1312421303 >> v2:172.21.15.170:3300/0 conn(0x7fc8b806f340 0x7fc8b80b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b77fe640 1 --2- 172.21.15.137:0/1312421303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b80b3e50 0x7fc8b80720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b67fc640 1 -- 172.21.15.137:0/1312421303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b80b3e50 msgr2=0x7fc8b80720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b67fc640 1 --2- 172.21.15.137:0/1312421303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b80b3e50 0x7fc8b80720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b67fc640 1 -- 172.21.15.137:0/1312421303 >> v2:172.21.15.170:3300/0 conn(0x7fc8b806f340 msgr2=0x7fc8b80b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b67fc640 1 --2- 172.21.15.137:0/1312421303 >> v2:172.21.15.170:3300/0 conn(0x7fc8b806f340 0x7fc8b80b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b67fc640 1 -- 172.21.15.137:0/1312421303 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b80b6090 con 0x7fc8b80d0300 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.597+0000 7fc8b77fe640 1 --2- 172.21.15.137:0/1312421303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b80b3e50 0x7fc8b80720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.598+0000 7fc8b67fc640 1 --2- 172.21.15.137:0/1312421303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80d0300 0x7fc8b806f720 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8076180 tx=0x7fc8ac02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea09811283cf890c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.598+0000 7fc8b5ffb640 1 -- 172.21.15.137:0/1312421303 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac037070 con 0x7fc8b80d0300 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.598+0000 7fc8b5ffb640 1 -- 172.21.15.137:0/1312421303 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac02ae00 con 0x7fc8b80d0300 2024-04-26T22:07:57.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.598+0000 7fc8b5ffb640 1 -- 172.21.15.137:0/1312421303 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac032660 con 0x7fc8b80d0300 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.599+0000 7fc8bd409640 1 -- 172.21.15.137:0/1312421303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80d0300 msgr2=0x7fc8b806f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.599+0000 7fc8bd409640 1 --2- 172.21.15.137:0/1312421303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80d0300 0x7fc8b806f720 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8076180 tx=0x7fc8ac02a0b0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.599+0000 7fc8bd409640 1 -- 172.21.15.137:0/1312421303 shutdown_connections 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.599+0000 7fc8bd409640 1 --2- 172.21.15.137:0/1312421303 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b80b3e50 0x7fc8b80720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.599+0000 7fc8bd409640 1 --2- 172.21.15.137:0/1312421303 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80d0300 0x7fc8b806f720 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.599+0000 7fc8bd409640 1 --2- 172.21.15.137:0/1312421303 >> v2:172.21.15.170:3300/0 conn(0x7fc8b806f340 0x7fc8b80b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.599+0000 7fc8bd409640 1 -- 172.21.15.137:0/1312421303 >> 172.21.15.137:0/1312421303 conn(0x7fc8b80cd8a0 msgr2=0x7fc8b80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.599+0000 7fc8bd409640 1 -- 172.21.15.137:0/1312421303 shutdown_connections 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.599+0000 7fc8bd409640 1 -- 172.21.15.137:0/1312421303 wait complete. 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.600+0000 7fc8bd409640 1 Processor -- start 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.600+0000 7fc8bd409640 1 -- start start 2024-04-26T22:07:57.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8bd409640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b806f340 0x7fc8b81439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8bd409640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80b3e50 0x7fc8b815e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8bd409640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8b80d0300 0x7fc8b8141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8bd409640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8142a30 con 0x7fc8b80b3e50 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8bd409640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b80b6650 con 0x7fc8b80d0300 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8bd409640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b8142bb0 con 0x7fc8b806f340 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80b3e50 0x7fc8b815e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80b3e50 0x7fc8b815e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38974/0 (socket says 172.21.15.137:38974) 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b67fc640 1 -- 172.21.15.137:0/2522993704 learned_addr learned my addr 172.21.15.137:0/2522993704 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b6ffd640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b806f340 0x7fc8b81439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b77fe640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8b80d0300 0x7fc8b8141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b67fc640 1 -- 172.21.15.137:0/2522993704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b806f340 msgr2=0x7fc8b81439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b67fc640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b806f340 0x7fc8b81439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.605 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b67fc640 1 -- 172.21.15.137:0/2522993704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8b80d0300 msgr2=0x7fc8b8141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b67fc640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8b80d0300 0x7fc8b8141070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b67fc640 1 -- 172.21.15.137:0/2522993704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b815e9c0 con 0x7fc8b80b3e50 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.601+0000 7fc8b77fe640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8b80d0300 0x7fc8b8141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.602+0000 7fc8b67fc640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80b3e50 0x7fc8b815e480 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000c00 tx=0x7fc8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.602+0000 7fc89f7fe640 1 -- 172.21.15.137:0/2522993704 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac041030 con 0x7fc8b80b3e50 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.602+0000 7fc89f7fe640 1 -- 172.21.15.137:0/2522993704 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac02ac00 con 0x7fc8b80b3e50 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.602+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b8145050 con 0x7fc8b80b3e50 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.602+0000 7fc89f7fe640 1 -- 172.21.15.137:0/2522993704 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac037040 con 0x7fc8b80b3e50 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.602+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b81431f0 con 0x7fc8b80b3e50 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.603+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b806a290 con 0x7fc8b80b3e50 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.603+0000 7fc89f7fe640 1 -- 172.21.15.137:0/2522993704 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc8ac044070 con 0x7fc8b80b3e50 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.603+0000 7fc89f7fe640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc8a406c920 0x7fc8a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.604+0000 7fc89f7fe640 1 -- 172.21.15.137:0/2522993704 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fc8ac0abf80 con 0x7fc8b80b3e50 2024-04-26T22:07:57.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.604+0000 7fc8b6ffd640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc8a406c920 0x7fc8a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.604+0000 7fc8b6ffd640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc8a406c920 0x7fc8a406ede0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80073f0 tx=0x7fc8a800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:57.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.608+0000 7fc89f7fe640 1 -- 172.21.15.137:0/2522993704 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc8ac04b070 con 0x7fc8b80b3e50 2024-04-26T22:07:57.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.782+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc8b8069460 con 0x7fc8b80b3e50 2024-04-26T22:07:57.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.782+0000 7fc89f7fe640 1 -- 172.21.15.137:0/2522993704 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) ==== 93+0+10 (secure 0 0 0) 0x7fc8ac044e40 con 0x7fc8b80b3e50 2024-04-26T22:07:57.782 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc8a406c920 msgr2=0x7fc8a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc8a406c920 0x7fc8a406ede0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80073f0 tx=0x7fc8a800b040 comp rx=0 tx=0).stop 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80b3e50 msgr2=0x7fc8b815e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80b3e50 0x7fc8b815e480 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac000c00 tx=0x7fc8ac0046c0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 shutdown_connections 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc8a406c920 0x7fc8a406ede0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc8b80b3e50 0x7fc8b815e480 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc8b80d0300 0x7fc8b8141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 --2- 172.21.15.137:0/2522993704 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc8b806f340 0x7fc8b81439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 >> 172.21.15.137:0/2522993704 conn(0x7fc8b80cd8a0 msgr2=0x7fc8b8072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 shutdown_connections 2024-04-26T22:07:57.785 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.785+0000 7fc8bd409640 1 -- 172.21.15.137:0/2522993704 wait complete. 2024-04-26T22:07:57.796 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:07:57.832 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:07:57.832+0000 7f768410b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:07:57.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.897+0000 7fbc0b704640 1 Processor -- start 2024-04-26T22:07:57.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.897+0000 7fbc0b704640 1 -- start start 2024-04-26T22:07:57.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc0b704640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbc040b4eb0 0x7fbc040b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc0b704640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc040ceff0 0x7fbc040cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc0b704640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0415dca0 con 0x7fbc04143840 2024-04-26T22:07:57.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc0b704640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fbc04143c20 con 0x7fbc040b4eb0 2024-04-26T22:07:57.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc0b704640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0415df80 con 0x7fbc040ceff0 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc08c9f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbc040b4eb0 0x7fbc040b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc09ca1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc040ceff0 0x7fbc040cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc094a0640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fbc04143840 0x7fbc040b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:36138/0 (socket says 172.21.15.137:36138) 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc094a0640 1 -- 172.21.15.137:0/1557795804 learned_addr learned my addr 172.21.15.137:0/1557795804 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc08c9f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbc040b4eb0 0x7fbc040b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:39798/0 (socket says 172.21.15.137:39798) 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc09ca1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc040ceff0 0x7fbc040cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:44628/0 (socket says 172.21.15.137:44628) 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc08c9f640 1 -- 172.21.15.137:0/1557795804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc040ceff0 msgr2=0x7fbc040cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc08c9f640 1 --2- 172.21.15.137:0/1557795804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc040ceff0 0x7fbc040cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc08c9f640 1 -- 172.21.15.137:0/1557795804 >> v1:172.21.15.170:6789/0 conn(0x7fbc04143840 legacy=0x7fbc040b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbc08c9f640 1 -- 172.21.15.137:0/1557795804 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0415e260 con 0x7fbc040b4eb0 2024-04-26T22:07:57.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.898+0000 7fbbfbfff640 1 -- 172.21.15.137:0/1557795804 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134852188 0 0) 0x7fbc0415dca0 con 0x7fbc04143840 2024-04-26T22:07:57.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.899+0000 7fbc08c9f640 1 --2- 172.21.15.137:0/1557795804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc040b4eb0 0x7fbc040b5330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097a0 tx=0x7fbbf402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63080c7d3eb940f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:57.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbbfbfff640 1 -- 172.21.15.137:0/1557795804 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4037070 con 0x7fbc040b4eb0 2024-04-26T22:07:57.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbbfbfff640 1 -- 172.21.15.137:0/1557795804 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf4032440 con 0x7fbc040b4eb0 2024-04-26T22:07:57.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbbfbfff640 1 -- 172.21.15.137:0/1557795804 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4032810 con 0x7fbc040b4eb0 2024-04-26T22:07:57.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbc0b704640 1 -- 172.21.15.137:0/1557795804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc040b4eb0 msgr2=0x7fbc040b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbc0b704640 1 --2- 172.21.15.137:0/1557795804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc040b4eb0 0x7fbc040b5330 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40097a0 tx=0x7fbbf402a180 comp rx=0 tx=0).stop 2024-04-26T22:07:57.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbc0b704640 1 -- 172.21.15.137:0/1557795804 shutdown_connections 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbc0b704640 1 --2- 172.21.15.137:0/1557795804 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc040ceff0 0x7fbc040cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbc0b704640 1 --2- 172.21.15.137:0/1557795804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc040b4eb0 0x7fbc040b5330 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbc0b704640 1 -- 172.21.15.137:0/1557795804 >> 172.21.15.137:0/1557795804 conn(0x7fbc040cd8a0 msgr2=0x7fbc040cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbc0b704640 1 -- 172.21.15.137:0/1557795804 shutdown_connections 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.900+0000 7fbc0b704640 1 -- 172.21.15.137:0/1557795804 wait complete. 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.901+0000 7fbc0b704640 1 Processor -- start 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.901+0000 7fbc0b704640 1 -- start start 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc0b704640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc040b4eb0 0x7fbc041f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc0b704640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc040ceff0 0x7fbc040cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc0b704640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc04143840 0x7fbc04131ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc0b704640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0415d8c0 con 0x7fbc040b4eb0 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc0b704640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fbc040b46f0 con 0x7fbc040ceff0 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc0b704640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0415da40 con 0x7fbc04143840 2024-04-26T22:07:57.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc094a0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc040b4eb0 0x7fbc041f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc094a0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc040b4eb0 0x7fbc041f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:38984/0 (socket says 172.21.15.137:38984) 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc094a0640 1 -- 172.21.15.137:0/1898977242 learned_addr learned my addr 172.21.15.137:0/1898977242 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc08c9f640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc040ceff0 0x7fbc040cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.902+0000 7fbc09ca1640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc04143840 0x7fbc04131ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbc094a0640 1 -- 172.21.15.137:0/1898977242 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc04143840 msgr2=0x7fbc04131ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbc094a0640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc04143840 0x7fbc04131ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbc094a0640 1 -- 172.21.15.137:0/1898977242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc040ceff0 msgr2=0x7fbc040cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbc094a0640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc040ceff0 0x7fbc040cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbc094a0640 1 -- 172.21.15.137:0/1898977242 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc040c6010 con 0x7fbc040b4eb0 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbc094a0640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc040b4eb0 0x7fbc041f6bf0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c430 tx=0x7fbc0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbbf9ffb640 1 -- 172.21.15.137:0/1898977242 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc000074e0 con 0x7fbc040b4eb0 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbbf9ffb640 1 -- 172.21.15.137:0/1898977242 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc000047e0 con 0x7fbc040b4eb0 2024-04-26T22:07:57.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc040c62f0 con 0x7fbc040b4eb0 2024-04-26T22:07:57.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbbf9ffb640 1 -- 172.21.15.137:0/1898977242 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00004bd0 con 0x7fbc040b4eb0 2024-04-26T22:07:57.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.903+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc040ccbb0 con 0x7fbc040b4eb0 2024-04-26T22:07:57.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.904+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc0406a290 con 0x7fbc040b4eb0 2024-04-26T22:07:57.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.904+0000 7fbbf9ffb640 1 -- 172.21.15.137:0/1898977242 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc00011070 con 0x7fbc040b4eb0 2024-04-26T22:07:57.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.905+0000 7fbbf9ffb640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbbe806c8f0 0x7fbbe806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:57.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.905+0000 7fbbf9ffb640 1 -- 172.21.15.137:0/1898977242 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fbc0008b660 con 0x7fbc040b4eb0 2024-04-26T22:07:57.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.905+0000 7fbc08c9f640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbbe806c8f0 0x7fbbe806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:57.908 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.905+0000 7fbc08c9f640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbbe806c8f0 0x7fbbe806edb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4034000 tx=0x7fbbf402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:57.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:57.909+0000 7fbbf9ffb640 1 -- 172.21.15.137:0/1898977242 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fbc00059470 con 0x7fbc040b4eb0 2024-04-26T22:07:58.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.085+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbc040ce420 con 0x7fbc040b4eb0 2024-04-26T22:07:58.085 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.085+0000 7fbbf9ffb640 1 -- 172.21.15.137:0/1898977242 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) ==== 104+0+11 (secure 0 0 0) 0x7fbc0005d770 con 0x7fbc040b4eb0 2024-04-26T22:07:58.085 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:07:58.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbbe806c8f0 msgr2=0x7fbbe806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbbe806c8f0 0x7fbbe806edb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4034000 tx=0x7fbbf402e000 comp rx=0 tx=0).stop 2024-04-26T22:07:58.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc040b4eb0 msgr2=0x7fbc041f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc040b4eb0 0x7fbc041f6bf0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c430 tx=0x7fbc0000c8f0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 shutdown_connections 2024-04-26T22:07:58.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbbe806c8f0 0x7fbbe806edb0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fbc04143840 0x7fbc04131ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbc040ceff0 0x7fbc040cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 --2- 172.21.15.137:0/1898977242 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fbc040b4eb0 0x7fbc041f6bf0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 >> 172.21.15.137:0/1898977242 conn(0x7fbc040cd8a0 msgr2=0x7fbc0415f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:58.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 shutdown_connections 2024-04-26T22:07:58.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.087+0000 7fbc0b704640 1 -- 172.21.15.137:0/1898977242 wait complete. 2024-04-26T22:07:58.099 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:07:58.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.239+0000 7f27eae2a640 1 Processor -- start 2024-04-26T22:07:58.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.239+0000 7f27eae2a640 1 -- start start 2024-04-26T22:07:58.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27eae2a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27e406f340 0x7f27e40b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27eae2a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e40b46a0 con 0x7f27e40b3e50 2024-04-26T22:07:58.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27eae2a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e40b5db0 con 0x7f27e40d0300 2024-04-26T22:07:58.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27eae2a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f27e40b6090 con 0x7f27e406f340 2024-04-26T22:07:58.242 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27e8bc6640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f27e406f340 0x7f27e40b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27e93c7640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f27e40b3e50 0x7f27e40720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47802/0 (socket says 172.21.15.137:47802) 2024-04-26T22:07:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27e93c7640 1 -- 172.21.15.137:0/4208652737 learned_addr learned my addr 172.21.15.137:0/4208652737 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27e8bc6640 1 -- 172.21.15.137:0/4208652737 >> v1:172.21.15.170:6789/0 conn(0x7f27e40d0300 legacy=0x7f27e406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27e8bc6640 1 -- 172.21.15.137:0/4208652737 >> v1:172.21.15.137:6789/0 conn(0x7f27e40b3e50 legacy=0x7f27e40720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27e8bc6640 1 -- 172.21.15.137:0/4208652737 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e40b6370 con 0x7f27e406f340 2024-04-26T22:07:58.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.240+0000 7f27e37fe640 1 -- 172.21.15.137:0/4208652737 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545361600 0 0) 0x7f27e40b46a0 con 0x7f27e40b3e50 2024-04-26T22:07:58.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27e8bc6640 1 --2- 172.21.15.137:0/4208652737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e406f340 0x7f27e40b6b70 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f27d80097a0 tx=0x7f27d802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3397d2359aa6ddb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:58.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27e37fe640 1 -- 172.21.15.137:0/4208652737 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8037070 con 0x7f27e406f340 2024-04-26T22:07:58.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27e37fe640 1 -- 172.21.15.137:0/4208652737 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d802adc0 con 0x7f27e406f340 2024-04-26T22:07:58.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27e37fe640 1 -- 172.21.15.137:0/4208652737 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8032660 con 0x7f27e406f340 2024-04-26T22:07:58.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27eae2a640 1 -- 172.21.15.137:0/4208652737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e406f340 msgr2=0x7f27e40b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27eae2a640 1 --2- 172.21.15.137:0/4208652737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e406f340 0x7f27e40b6b70 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f27d80097a0 tx=0x7f27d802a0b0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27eae2a640 1 -- 172.21.15.137:0/4208652737 shutdown_connections 2024-04-26T22:07:58.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27eae2a640 1 --2- 172.21.15.137:0/4208652737 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e406f340 0x7f27e40b6b70 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27eae2a640 1 -- 172.21.15.137:0/4208652737 >> 172.21.15.137:0/4208652737 conn(0x7f27e40cd8a0 msgr2=0x7f27e40cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:58.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27eae2a640 1 -- 172.21.15.137:0/4208652737 shutdown_connections 2024-04-26T22:07:58.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.241+0000 7f27eae2a640 1 -- 172.21.15.137:0/4208652737 wait complete. 2024-04-26T22:07:58.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.243+0000 7f27eae2a640 1 Processor -- start 2024-04-26T22:07:58.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.243+0000 7f27eae2a640 1 -- start start 2024-04-26T22:07:58.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.243+0000 7f27eae2a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e406f340 0x7f27e4144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.243+0000 7f27eae2a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e40b3e50 0x7f27e4142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.243+0000 7f27eae2a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27e40d0300 0x7f27e40cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.243+0000 7f27eae2a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f27e40b4460 con 0x7f27e40b3e50 2024-04-26T22:07:58.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.243+0000 7f27eae2a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f27e40b42e0 con 0x7f27e406f340 2024-04-26T22:07:58.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.243+0000 7f27eae2a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f27e4142a30 con 0x7f27e40d0300 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.243+0000 7f27e3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e40b3e50 0x7f27e4142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e40b3e50 0x7f27e4142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39004/0 (socket says 172.21.15.137:39004) 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e3fff640 1 -- 172.21.15.137:0/2273446853 learned_addr learned my addr 172.21.15.137:0/2273446853 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e8bc6640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e406f340 0x7f27e4144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e93c7640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27e40d0300 0x7f27e40cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e3fff640 1 -- 172.21.15.137:0/2273446853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27e40d0300 msgr2=0x7f27e40cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e3fff640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27e40d0300 0x7f27e40cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e3fff640 1 -- 172.21.15.137:0/2273446853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e406f340 msgr2=0x7f27e4144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e3fff640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e406f340 0x7f27e4144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e3fff640 1 -- 172.21.15.137:0/2273446853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e4134000 con 0x7f27e40b3e50 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e93c7640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27e40d0300 0x7f27e40cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e3fff640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e40b3e50 0x7f27e4142d60 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c410 tx=0x7f27d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e17fa640 1 -- 172.21.15.137:0/2273446853 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0017070 con 0x7f27e40b3e50 2024-04-26T22:07:58.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e17fa640 1 -- 172.21.15.137:0/2273446853 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d00035f0 con 0x7f27e40b3e50 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27e17fa640 1 -- 172.21.15.137:0/2273446853 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0003a20 con 0x7f27e40b3e50 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e41433f0 con 0x7f27e40b3e50 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.244+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e41439b0 con 0x7f27e40b3e50 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.245+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e406a290 con 0x7f27e40b3e50 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.246+0000 7f27e17fa640 1 -- 172.21.15.137:0/2273446853 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27d001a070 con 0x7f27e40b3e50 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.246+0000 7f27e17fa640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.246+0000 7f27e17fa640 1 -- 172.21.15.137:0/2273446853 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f27d008afe0 con 0x7f27e40b3e50 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.246+0000 7f27e8bc6640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.246+0000 7f27e8bc6640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f27d8034000 tx=0x7f27d802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:58.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.250+0000 7f27e17fa640 1 -- 172.21.15.137:0/2273446853 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f27e4134000 con 0x7f27e40b3e50 2024-04-26T22:07:58.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.424+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f27e415e7d0 con 0x7f27e40b3e50 2024-04-26T22:07:58.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.425+0000 7f27e17fa640 1 -- 172.21.15.137:0/2273446853 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) ==== 100+0+11 (secure 0 0 0) 0x7f27d00010c0 con 0x7f27e40b3e50 2024-04-26T22:07:58.425 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:07:58.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 msgr2=0x7f27c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f27d8034000 tx=0x7f27d802e000 comp rx=0 tx=0).stop 2024-04-26T22:07:58.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e40b3e50 msgr2=0x7f27e4142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e40b3e50 0x7f27e4142d60 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c410 tx=0x7f27d000c8d0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 shutdown_connections 2024-04-26T22:07:58.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27c806c8f0 0x7f27c806edb0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f27e40b3e50 0x7f27e4142d60 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f27e40d0300 0x7f27e40cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 --2- 172.21.15.137:0/2273446853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27e406f340 0x7f27e4144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 >> 172.21.15.137:0/2273446853 conn(0x7f27e40cd8a0 msgr2=0x7f27e415c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:58.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 shutdown_connections 2024-04-26T22:07:58.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.427+0000 7f27eae2a640 1 -- 172.21.15.137:0/2273446853 wait complete. 2024-04-26T22:07:58.438 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:07:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.536+0000 7f71a8837640 1 Processor -- start 2024-04-26T22:07:58.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.536+0000 7f71a8837640 1 -- start start 2024-04-26T22:07:58.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a8837640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a406f2c0 0x7f71a4071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a8837640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f71a415b8c0 0x7f71a40cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a8837640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a40733e0 con 0x7f71a415b4e0 2024-04-26T22:07:58.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a8837640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f71a40ce230 con 0x7f71a415b8c0 2024-04-26T22:07:58.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a8837640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f71a4072f00 con 0x7f71a406f2c0 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a259c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f71a415b4e0 0x7f71a406ebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47804/0 (socket says 172.21.15.137:47804) 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a259c640 1 -- 172.21.15.137:0/1343561532 learned_addr learned my addr 172.21.15.137:0/1343561532 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3145487588 0 0) 0x7f71a40733e0 con 0x7f71a415b4e0 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f719bfff640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a406f2c0 0x7f71a4071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7190003520 con 0x7f71a415b4e0 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a2d9d640 1 --2- 172.21.15.137:0/1343561532 >> v2:172.21.15.170:3300/0 conn(0x7f71a415b8c0 0x7f71a40cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.537+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1102919325 0 0) 0x7f7190003520 con 0x7f71a415b4e0 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a406f2c0 msgr2=0x7f71a4071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a406f2c0 0x7f71a4071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 >> v2:172.21.15.170:3300/0 conn(0x7f71a415b8c0 msgr2=0x7f71a40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 --2- 172.21.15.137:0/1343561532 >> v2:172.21.15.170:3300/0 conn(0x7f71a415b8c0 0x7f71a40cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a4072660 con 0x7f71a415b4e0 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f7194001670 con 0x7f71a415b4e0 2024-04-26T22:07:58.540 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 >> v1:172.21.15.137:6789/0 conn(0x7f71a415b4e0 legacy=0x7f71a406ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a406f2c0 0x7f71900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f7190004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190004d40 0x7f71900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71a40ce230 con 0x7f7190003f30 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f71a4072f00 con 0x7f7190004d40 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f719000b9c0 con 0x7f71a406f2c0 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f719bfff640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f7190004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a259c640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a406f2c0 0x7f71900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a2d9d640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190004d40 0x7f71900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f719bfff640 1 -- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a406f2c0 msgr2=0x7f71900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f719bfff640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a406f2c0 0x7f71900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f719bfff640 1 -- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190004d40 msgr2=0x7f71900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f719bfff640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190004d40 0x7f71900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f719bfff640 1 -- 172.21.15.137:0/1343561532 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7190003520 con 0x7f7190003f30 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.538+0000 7f71a2d9d640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7190004d40 0x7f71900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f719bfff640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f7190004800 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f718c009ac0 tx=0x7f7190005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2679be1b6b7b7cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c036070 con 0x7f7190003f30 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c031400 con 0x7f7190003f30 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a1d9b640 1 -- 172.21.15.137:0/1343561532 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c009690 con 0x7f7190003f30 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a8837640 1 -- 172.21.15.137:0/1343561532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 msgr2=0x7f7190004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a8837640 1 --2- 172.21.15.137:0/1343561532 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f7190004800 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f718c009ac0 tx=0x7f7190005830 comp rx=0 tx=0).stop 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a2d9d640 1 -- 172.21.15.137:0/1343561532 reap_dead start 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a8837640 1 -- 172.21.15.137:0/1343561532 shutdown_connections 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a8837640 1 -- 172.21.15.137:0/1343561532 >> 172.21.15.137:0/1343561532 conn(0x7f71a40d0d30 msgr2=0x7f71a40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a8837640 1 -- 172.21.15.137:0/1343561532 shutdown_connections 2024-04-26T22:07:58.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.539+0000 7f71a8837640 1 -- 172.21.15.137:0/1343561532 wait complete. 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.541+0000 7f71a8837640 1 Processor -- start 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.541+0000 7f71a8837640 1 -- start start 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.541+0000 7f71a8837640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f71a4150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.541+0000 7f71a8837640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a414bae0 0x7f71a41497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.541+0000 7f71a8837640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a4149f90 0x7f71a40b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.541+0000 7f71a8837640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f71a40b3e80 con 0x7f7190003f30 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.541+0000 7f71a8837640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f71a4072c20 con 0x7f71a414bae0 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.541+0000 7f71a8837640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f71a4073820 con 0x7f71a4149f90 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f71a4150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f71a4150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39032/0 (socket says 172.21.15.137:39032) 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a259c640 1 -- 172.21.15.137:0/4265922994 learned_addr learned my addr 172.21.15.137:0/4265922994 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f719bfff640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a414bae0 0x7f71a41497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a2d9d640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a4149f90 0x7f71a40b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a259c640 1 -- 172.21.15.137:0/4265922994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a4149f90 msgr2=0x7f71a40b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a259c640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a4149f90 0x7f71a40b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a259c640 1 -- 172.21.15.137:0/4265922994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a414bae0 msgr2=0x7f71a41497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a259c640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a414bae0 0x7f71a41497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a259c640 1 -- 172.21.15.137:0/4265922994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a41510e0 con 0x7f7190003f30 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f719bfff640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a414bae0 0x7f71a41497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a259c640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f71a4150ba0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f7194007370 tx=0x7f7194007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f719affd640 1 -- 172.21.15.137:0/4265922994 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719400f9c0 con 0x7f7190003f30 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f719affd640 1 -- 172.21.15.137:0/4265922994 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7194018070 con 0x7f7190003f30 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f719affd640 1 -- 172.21.15.137:0/4265922994 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719400fda0 con 0x7f7190003f30 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a41360d0 con 0x7f7190003f30 2024-04-26T22:07:58.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.542+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a4136690 con 0x7f7190003f30 2024-04-26T22:07:58.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.543+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a406a290 con 0x7f7190003f30 2024-04-26T22:07:58.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.544+0000 7f719affd640 1 -- 172.21.15.137:0/4265922994 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f719401d460 con 0x7f7190003f30 2024-04-26T22:07:58.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.544+0000 7f719affd640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718406c8f0 0x7f718406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.544+0000 7f719affd640 1 -- 172.21.15.137:0/4265922994 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f719408bd60 con 0x7f7190003f30 2024-04-26T22:07:58.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.544+0000 7f719bfff640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718406c8f0 0x7f718406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.545+0000 7f719bfff640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718406c8f0 0x7f718406edb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f718c033000 tx=0x7f718c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:58.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.548+0000 7f719affd640 1 -- 172.21.15.137:0/4265922994 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f71a41510e0 con 0x7f7190003f30 2024-04-26T22:07:58.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.734+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f71a4071ff0 con 0x7f7190003f30 2024-04-26T22:07:58.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.734+0000 7f719affd640 1 -- 172.21.15.137:0/4265922994 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v116) ==== 80+0+124 (secure 0 0 0) 0x7f719405a130 con 0x7f7190003f30 2024-04-26T22:07:58.734 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.170:6834/1666946913 2024-04-27T22:07:49.712915+0000 2024-04-26T22:07:58.735 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.170:6832/1666946913 2024-04-27T22:07:49.712915+0000 2024-04-26T22:07:58.735 INFO:teuthology.orchestra.run.smithi137.stderr:listed 2 entries 2024-04-26T22:07:58.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718406c8f0 msgr2=0x7f718406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718406c8f0 0x7f718406edb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f718c033000 tx=0x7f718c008030 comp rx=0 tx=0).stop 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 msgr2=0x7f71a4150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f71a4150ba0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f7194007370 tx=0x7f7194007830 comp rx=0 tx=0).stop 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 shutdown_connections 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f718406c8f0 0x7f718406edb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f71a4149f90 0x7f71a40b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a414bae0 0x7f71a41497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 --2- 172.21.15.137:0/4265922994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7190003f30 0x7f71a4150ba0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 >> 172.21.15.137:0/4265922994 conn(0x7f71a40d0d30 msgr2=0x7f71a40b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 shutdown_connections 2024-04-26T22:07:58.737 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.736+0000 7f71a8837640 1 -- 172.21.15.137:0/4265922994 wait complete. 2024-04-26T22:07:58.747 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:07:58.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:58.747 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:07:58.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:07:58.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:07:58.773 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:07:58.829 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:07:58.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.965+0000 7fdb76817640 1 Processor -- start 2024-04-26T22:07:58.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.965+0000 7fdb76817640 1 -- start start 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.966+0000 7fdb76817640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb7015d130 0x7fdb7006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.966+0000 7fdb76817640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb70161ad0 con 0x7fdb70070d00 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.966+0000 7fdb76817640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7015d510 con 0x7fdb700733c0 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.966+0000 7fdb76817640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdb700b0e80 con 0x7fdb7015d130 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.966+0000 7fdb74db4640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fdb70070d00 0x7fdb701613c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47812/0 (socket says 172.21.15.137:47812) 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.966+0000 7fdb74db4640 1 -- 172.21.15.137:0/3702724656 learned_addr learned my addr 172.21.15.137:0/3702724656 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6ffff640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb7015d130 0x7fdb7006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638566308 0 0) 0x7fdb70161ad0 con 0x7fdb70070d00 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb58003520 con 0x7fdb70070d00 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1340307985 0 0) 0x7fdb58003520 con 0x7fdb70070d00 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb7015d130 msgr2=0x7fdb7006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:58.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb7015d130 0x7fdb7006d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 >> v1:172.21.15.170:6789/0 conn(0x7fdb700733c0 legacy=0x7fdb70160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb700b54f0 con 0x7fdb70070d00 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fdb680019f0 con 0x7fdb70070d00 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 >> v1:172.21.15.137:6789/0 conn(0x7fdb70070d00 legacy=0x7fdb701613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb7015d130 0x7fdb580039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb58003f60 0x7fdb58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58004d40 0x7fdb580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700b0e80 con 0x7fdb58003f60 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5800baa0 con 0x7fdb58004d40 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5800bca0 con 0x7fdb7015d130 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6f7fe640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb58003f60 0x7fdb58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6ffff640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb7015d130 0x7fdb580039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb74db4640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58004d40 0x7fdb580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6f7fe640 1 -- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb7015d130 msgr2=0x7fdb580039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6f7fe640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb7015d130 0x7fdb580039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6f7fe640 1 -- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58004d40 msgr2=0x7fdb580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6f7fe640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58004d40 0x7fdb580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.967+0000 7fdb6f7fe640 1 -- 172.21.15.137:0/3702724656 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb58003520 con 0x7fdb58003f60 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.968+0000 7fdb6f7fe640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb58003f60 0x7fdb58004800 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fdb64001720 tx=0x7fdb58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475b641464a2bb38 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.968+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64001370 con 0x7fdb58003f60 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.968+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb640052d0 con 0x7fdb58003f60 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.968+0000 7fdb6effd640 1 -- 172.21.15.137:0/3702724656 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6402abc0 con 0x7fdb58003f60 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.969+0000 7fdb76817640 1 -- 172.21.15.137:0/3702724656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb58003f60 msgr2=0x7fdb58004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.969+0000 7fdb76817640 1 --2- 172.21.15.137:0/3702724656 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb58003f60 0x7fdb58004800 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fdb64001720 tx=0x7fdb58005830 comp rx=0 tx=0).stop 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.969+0000 7fdb74db4640 1 -- 172.21.15.137:0/3702724656 reap_dead start 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.969+0000 7fdb76817640 1 -- 172.21.15.137:0/3702724656 shutdown_connections 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.969+0000 7fdb76817640 1 -- 172.21.15.137:0/3702724656 >> 172.21.15.137:0/3702724656 conn(0x7fdb700728a0 msgr2=0x7fdb70072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:58.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.969+0000 7fdb76817640 1 -- 172.21.15.137:0/3702724656 shutdown_connections 2024-04-26T22:07:58.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.969+0000 7fdb76817640 1 -- 172.21.15.137:0/3702724656 wait complete. 2024-04-26T22:07:58.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.970+0000 7fdb76817640 1 Processor -- start 2024-04-26T22:07:58.974 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.970+0000 7fdb76817640 1 -- start start 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb76817640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58003f60 0x7fdb7013c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb76817640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb70154950 0x7fdb70152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb76817640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb70153370 0x7fdb70154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb76817640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700d0500 con 0x7fdb70153370 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb76817640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdb700d0220 con 0x7fdb58003f60 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb76817640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdb700d07e0 con 0x7fdb70154950 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb74db4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb70153370 0x7fdb70154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb74db4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb70153370 0x7fdb70154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39046/0 (socket says 172.21.15.137:39046) 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb74db4640 1 -- 172.21.15.137:0/3021802243 learned_addr learned my addr 172.21.15.137:0/3021802243 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb6ffff640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58003f60 0x7fdb7013c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb6f7fe640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb70154950 0x7fdb70152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb74db4640 1 -- 172.21.15.137:0/3021802243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb70154950 msgr2=0x7fdb70152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb74db4640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb70154950 0x7fdb70152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb74db4640 1 -- 172.21.15.137:0/3021802243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58003f60 msgr2=0x7fdb7013c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb74db4640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58003f60 0x7fdb7013c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb74db4640 1 -- 172.21.15.137:0/3021802243 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7013c680 con 0x7fdb70153370 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb6ffff640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58003f60 0x7fdb7013c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb74db4640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb70153370 0x7fdb70154e70 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fdb7006e690 tx=0x7fdb6800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb6cff9640 1 -- 172.21.15.137:0/3021802243 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800ec40 con 0x7fdb70153370 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb6cff9640 1 -- 172.21.15.137:0/3021802243 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb6800ede0 con 0x7fdb70153370 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.971+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701538b0 con 0x7fdb70153370 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.972+0000 7fdb6cff9640 1 -- 172.21.15.137:0/3021802243 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68014670 con 0x7fdb70153370 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.972+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb70153e70 con 0x7fdb70153370 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.973+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb70069be0 con 0x7fdb70153370 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.973+0000 7fdb6cff9640 1 -- 172.21.15.137:0/3021802243 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb68014810 con 0x7fdb70153370 2024-04-26T22:07:58.976 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.973+0000 7fdb6cff9640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:58.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.974+0000 7fdb6ffff640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:58.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.974+0000 7fdb6cff9640 1 -- 172.21.15.137:0/3021802243 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fdb6808b950 con 0x7fdb70153370 2024-04-26T22:07:58.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.974+0000 7fdb6ffff640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009bc0 tx=0x7fdb60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:58.977 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:58.978+0000 7fdb6cff9640 1 -- 172.21.15.137:0/3021802243 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdb70069be0 con 0x7fdb70153370 2024-04-26T22:07:59.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.190+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb700d0ab0 con 0x7fdb70153370 2024-04-26T22:07:59.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.191+0000 7fdb6cff9640 1 -- 172.21.15.137:0/3021802243 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+5197 (secure 0 0 0) 0x7fdb68059e70 con 0x7fdb70153370 2024-04-26T22:07:59.191 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:07:59.191 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":87,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:07:53.730191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8859},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8859":{"gid":8859,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":8,"addr":"172.21.15.137:6837/2830617564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":2830617564},{"type":"v1","addr":"172.21.15.137:6837","nonce":2830617564}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8859,"qdb_cluster":[8859]},"id":8}]} 2024-04-26T22:07:59.191 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 87 2024-04-26T22:07:59.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb5c06c8f0 msgr2=0x7fdb5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009bc0 tx=0x7fdb60008040 comp rx=0 tx=0).stop 2024-04-26T22:07:59.193 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb70153370 msgr2=0x7fdb70154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb70153370 0x7fdb70154e70 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fdb7006e690 tx=0x7fdb6800e530 comp rx=0 tx=0).stop 2024-04-26T22:07:59.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 shutdown_connections 2024-04-26T22:07:59.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb5c06c8f0 0x7fdb5c06edb0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb70153370 0x7fdb70154e70 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb70154950 0x7fdb70152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 --2- 172.21.15.137:0/3021802243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb58003f60 0x7fdb7013c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 >> 172.21.15.137:0/3021802243 conn(0x7fdb700728a0 msgr2=0x7fdb700b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 shutdown_connections 2024-04-26T22:07:59.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.193+0000 7fdb76817640 1 -- 172.21.15.137:0/3021802243 wait complete. 2024-04-26T22:07:59.204 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parent mytag123 2024-04-26T22:07:59.322 INFO:teuthology.orchestra.run.smithi137.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-04-26T22:07:59.323 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-04-26T22:07:59.323 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-26T22:07:59.365 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.366+0000 7f41b5e0bf40 1 Processor -- start 2024-04-26T22:07:59.366 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.366+0000 7f41b5e0bf40 1 -- start start 2024-04-26T22:07:59.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.366+0000 7f41b5e0bf40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f2117ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.366+0000 7f41b5e0bf40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5610f2116910 0x5610f203d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.366+0000 7f41b5e0bf40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 0x5610f203d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.366+0000 7f41b5e0bf40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5610f2086a80 con 0x5610f2089d40 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.366+0000 7f41b5e0bf40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5610f1fe6e40 con 0x5610f2116cf0 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.366+0000 7f41b5e0bf40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5610f20860b0 con 0x5610f2116910 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b2bf7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f2117ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b2bf7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f2117ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39060/0 (socket says 172.21.15.137:39060) 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b2bf7640 1 -- 172.21.15.137:0/2706610929 learned_addr learned my addr 172.21.15.137:0/2706610929 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b23f6640 1 --2- 172.21.15.137:0/2706610929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5610f2116910 0x5610f203d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b33f8640 1 --2- 172.21.15.137:0/2706610929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 0x5610f203d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b2bf7640 1 -- 172.21.15.137:0/2706610929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5610f2116910 msgr2=0x5610f203d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b2bf7640 1 --2- 172.21.15.137:0/2706610929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5610f2116910 0x5610f203d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b2bf7640 1 -- 172.21.15.137:0/2706610929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 msgr2=0x5610f203d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b2bf7640 1 --2- 172.21.15.137:0/2706610929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 0x5610f203d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b2bf7640 1 -- 172.21.15.137:0/2706610929 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f2118b00 con 0x5610f2089d40 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b2bf7640 1 --2- 172.21.15.137:0/2706610929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f2117ff0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f41a4055040 tx=0x7f41a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163a62e64d7d65f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b13f4640 1 -- 172.21.15.137:0/2706610929 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a4053780 con 0x5610f2089d40 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b13f4640 1 -- 172.21.15.137:0/2706610929 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a4053920 con 0x5610f2089d40 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.367+0000 7f41b13f4640 1 -- 172.21.15.137:0/2706610929 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a4053d10 con 0x5610f2089d40 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/2706610929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 msgr2=0x5610f2117ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 --2- 172.21.15.137:0/2706610929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f2117ff0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f41a4055040 tx=0x7f41a4051000 comp rx=0 tx=0).stop 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/2706610929 shutdown_connections 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 --2- 172.21.15.137:0/2706610929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 0x5610f203d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 --2- 172.21.15.137:0/2706610929 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5610f2116910 0x5610f203d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 --2- 172.21.15.137:0/2706610929 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f2117ff0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/2706610929 >> 172.21.15.137:0/2706610929 conn(0x5610f203e210 msgr2=0x5610f2088f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/2706610929 shutdown_connections 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/2706610929 wait complete. 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 Processor -- start 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.368+0000 7f41b5e0bf40 1 -- start start 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b5e0bf40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f20fc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b5e0bf40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5610f2116910 0x5610f21a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b5e0bf40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 0x5610f206ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b5e0bf40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5610f2118de0 con 0x5610f2089d40 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b5e0bf40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5610f2117b60 con 0x5610f2116cf0 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b5e0bf40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5610f21190c0 con 0x5610f2116910 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b2bf7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f20fc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b2bf7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f20fc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39070/0 (socket says 172.21.15.137:39070) 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b2bf7640 1 -- 172.21.15.137:0/140107237 learned_addr learned my addr 172.21.15.137:0/140107237 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b23f6640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5610f2116910 0x5610f21a79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b33f8640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 0x5610f206ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b2bf7640 1 -- 172.21.15.137:0/140107237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5610f2116910 msgr2=0x5610f21a79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b2bf7640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5610f2116910 0x5610f21a79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b2bf7640 1 -- 172.21.15.137:0/140107237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 msgr2=0x5610f206ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b2bf7640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 0x5610f206ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.369+0000 7f41b2bf7640 1 -- 172.21.15.137:0/140107237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f20fc640 con 0x5610f2089d40 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.370+0000 7f41b33f8640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5610f2116cf0 0x5610f206ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.370+0000 7f41b2bf7640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f20fc100 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f41a4045f50 tx=0x7f41a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.370+0000 7f419bfff640 1 -- 172.21.15.137:0/140107237 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a40536c0 con 0x5610f2089d40 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.370+0000 7f419bfff640 1 -- 172.21.15.137:0/140107237 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a4074070 con 0x5610f2089d40 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.370+0000 7f419bfff640 1 -- 172.21.15.137:0/140107237 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a4053cf0 con 0x5610f2089d40 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.370+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610f20fc8b0 con 0x5610f2089d40 2024-04-26T22:07:59.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.370+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f21a71c0 con 0x5610f2089d40 2024-04-26T22:07:59.377 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:07:59.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.371+0000 7f419bfff640 1 -- 172.21.15.137:0/140107237 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41a4079460 con 0x5610f2089d40 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.371+0000 7f419bfff640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a006b2d0 0x7f41a006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.372+0000 7f419bfff640 1 -- 172.21.15.137:0/140107237 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f41a40d05b0 con 0x5610f2089d40 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.372+0000 7f41b23f6640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a006b2d0 0x7f41a006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.372+0000 7f41b5e0bf40 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5610f21a7f00 0x5610f2112200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.372+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:1 17.36 17:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e116) -- 0x5610f20ff510 con 0x5610f21a7f00 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.372+0000 7f41b33f8640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5610f21a7f00 0x5610f2112200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.372+0000 7f41b23f6640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a006b2d0 0x7f41a006d790 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f41a8005fd0 tx=0x7f41a800c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.372+0000 7f41b33f8640 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5610f21a7f00 0x5610f2112200 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.372+0000 7f41b33f8640 1 -- 172.21.15.137:0/140107237 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f41ac0026e0 con 0x5610f21a7f00 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5610f21a7f00 msgr2=0x5610f2112200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5610f21a7f00 0x5610f2112200 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a006b2d0 msgr2=0x7f41a006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f41a006b2d0 0x7f41a006d790 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f41a8005fd0 tx=0x7f41a800c040 comp rx=0 tx=0).stop 2024-04-26T22:07:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 msgr2=0x5610f20fc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 --2- 172.21.15.137:0/140107237 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5610f2089d40 0x5610f20fc100 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f41a4045f50 tx=0x7f41a4002fb0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b33f8640 1 -- 172.21.15.137:0/140107237 reap_dead start 2024-04-26T22:07:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 shutdown_connections 2024-04-26T22:07:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 >> 172.21.15.137:0/140107237 conn(0x5610f203e210 msgr2=0x5610f2117ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 shutdown_connections 2024-04-26T22:07:59.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.373+0000 7f41b5e0bf40 1 -- 172.21.15.137:0/140107237 wait complete. 2024-04-26T22:07:59.379 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-26T22:07:59.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.460+0000 7f27c59b7f40 1 Processor -- start 2024-04-26T22:07:59.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.460+0000 7f27c59b7f40 1 -- start start 2024-04-26T22:07:59.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c59b7f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d91625cbd0 0x55d916266930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c59b7f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d91625e8b0 0x55d9161d8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c59b7f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d9161d9320 0x55d9161d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c59b7f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d916138e40 con 0x55d91625e8b0 2024-04-26T22:07:59.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c59b7f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d91613ce80 con 0x55d91625cbd0 2024-04-26T22:07:59.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c59b7f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d9161d99b0 con 0x55d9161d9320 2024-04-26T22:07:59.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c2cb0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d91625e8b0 0x55d9161d8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c2cb0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d91625e8b0 0x55d9161d8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39084/0 (socket says 172.21.15.137:39084) 2024-04-26T22:07:59.465 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c2cb0640 1 -- 172.21.15.137:0/663740955 learned_addr learned my addr 172.21.15.137:0/663740955 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c2cb0640 1 -- 172.21.15.137:0/663740955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d9161d9320 msgr2=0x55d9161d7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c2cb0640 1 --2- 172.21.15.137:0/663740955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d9161d9320 0x55d9161d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c2cb0640 1 -- 172.21.15.137:0/663740955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d91625cbd0 msgr2=0x55d916266930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c2cb0640 1 --2- 172.21.15.137:0/663740955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d91625cbd0 0x55d916266930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c2cb0640 1 -- 172.21.15.137:0/663740955 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d91625e360 con 0x55d91625e8b0 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c2cb0640 1 --2- 172.21.15.137:0/663740955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d91625e8b0 0x55d9161d8de0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009810 tx=0x7f27b8005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334b1ebec4735820 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c1cae640 1 -- 172.21.15.137:0/663740955 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8008890 con 0x55d91625e8b0 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c1cae640 1 -- 172.21.15.137:0/663740955 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b801a070 con 0x55d91625e8b0 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.461+0000 7f27c1cae640 1 -- 172.21.15.137:0/663740955 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8008c50 con 0x55d91625e8b0 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 -- 172.21.15.137:0/663740955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d91625e8b0 msgr2=0x55d9161d8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 --2- 172.21.15.137:0/663740955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d91625e8b0 0x55d9161d8de0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009810 tx=0x7f27b8005a00 comp rx=0 tx=0).stop 2024-04-26T22:07:59.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 -- 172.21.15.137:0/663740955 shutdown_connections 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 --2- 172.21.15.137:0/663740955 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d91625e8b0 0x55d9161d8de0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 --2- 172.21.15.137:0/663740955 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d9161d9320 0x55d9161d7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 --2- 172.21.15.137:0/663740955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d91625cbd0 0x55d916266930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 -- 172.21.15.137:0/663740955 >> 172.21.15.137:0/663740955 conn(0x55d9161dbfd0 msgr2=0x55d9161d7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 -- 172.21.15.137:0/663740955 shutdown_connections 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 -- 172.21.15.137:0/663740955 wait complete. 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 Processor -- start 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.462+0000 7f27c59b7f40 1 -- start start 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c59b7f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9161d9320 0x55d9162569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c59b7f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d91625cbd0 0x55d9162598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c59b7f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d91625e8b0 0x55d91626cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c59b7f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55d9161bb270 con 0x55d9161d9320 2024-04-26T22:07:59.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c59b7f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55d916267d90 con 0x55d91625e8b0 2024-04-26T22:07:59.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c59b7f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55d9162678b0 con 0x55d91625cbd0 2024-04-26T22:07:59.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c34b1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9161d9320 0x55d9162569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c34b1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9161d9320 0x55d9162569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39098/0 (socket says 172.21.15.137:39098) 2024-04-26T22:07:59.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c34b1640 1 -- 172.21.15.137:0/2064067584 learned_addr learned my addr 172.21.15.137:0/2064067584 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c2cb0640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d91625cbd0 0x55d9162598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c3cb2640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d91625e8b0 0x55d91626cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c34b1640 1 -- 172.21.15.137:0/2064067584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d91625cbd0 msgr2=0x55d9162598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c34b1640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55d91625cbd0 0x55d9162598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c34b1640 1 -- 172.21.15.137:0/2064067584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d91625e8b0 msgr2=0x55d91626cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c34b1640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d91625e8b0 0x55d91626cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c34b1640 1 -- 172.21.15.137:0/2064067584 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d916259de0 con 0x55d9161d9320 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.463+0000 7f27c3cb2640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d91625e8b0 0x55d91626cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.464+0000 7f27c34b1640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9161d9320 0x55d9162569c0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009bc0 tx=0x7f27b401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.464+0000 7f27c0cac640 1 -- 172.21.15.137:0/2064067584 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4069070 con 0x55d9161d9320 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.464+0000 7f27c0cac640 1 -- 172.21.15.137:0/2064067584 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b4000ed0 con 0x55d9161d9320 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.464+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d916258800 con 0x55d9161d9320 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.464+0000 7f27c0cac640 1 -- 172.21.15.137:0/2064067584 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b4009760 con 0x55d9161d9320 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.464+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d916258dc0 con 0x55d9161d9320 2024-04-26T22:07:59.469 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.465+0000 7f27c0cac640 1 -- 172.21.15.137:0/2064067584 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f27b406c070 con 0x55d9161d9320 2024-04-26T22:07:59.471 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.465+0000 7f27c0cac640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27b006b300 0x7f27b006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c0cac640 1 -- 172.21.15.137:0/2064067584 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f27b40ce430 con 0x55d9161d9320 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c2cb0640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27b006b300 0x7f27b006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c59b7f40 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d91625d4c0 0x55d916300080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:1 17.12 17:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e116) -- 0x55d9163005c0 con 0x55d91625d4c0 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c3cb2640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d91625d4c0 0x55d916300080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c2cb0640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27b006b300 0x7f27b006d7c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x55d9161bd530 tx=0x7f27b8008000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c3cb2640 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d91625d4c0 0x55d916300080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c3cb2640 1 -- 172.21.15.137:0/2064067584 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7f27bc006c70 con 0x55d91625d4c0 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d91625d4c0 msgr2=0x55d916300080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c59b7f40 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55d91625d4c0 0x55d916300080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27b006b300 msgr2=0x7f27b006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c59b7f40 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f27b006b300 0x7f27b006d7c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x55d9161bd530 tx=0x7f27b8008000 comp rx=0 tx=0).stop 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9161d9320 msgr2=0x55d9162569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c59b7f40 1 --2- 172.21.15.137:0/2064067584 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55d9161d9320 0x55d9162569c0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009bc0 tx=0x7f27b401c240 comp rx=0 tx=0).stop 2024-04-26T22:07:59.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.466+0000 7f27c3cb2640 1 -- 172.21.15.137:0/2064067584 reap_dead start 2024-04-26T22:07:59.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.467+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 shutdown_connections 2024-04-26T22:07:59.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.467+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 >> 172.21.15.137:0/2064067584 conn(0x55d9161dbfd0 msgr2=0x55d9161d7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.467+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 shutdown_connections 2024-04-26T22:07:59.473 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.467+0000 7f27c59b7f40 1 -- 172.21.15.137:0/2064067584 wait complete. 2024-04-26T22:07:59.474 INFO:teuthology.orchestra.run.smithi137.stdout:mytag123 2024-04-26T22:07:59.474 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-26T22:07:59.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.556+0000 7f38e4b1df40 1 Processor -- start 2024-04-26T22:07:59.556 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e4b1df40 1 -- start start 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e4b1df40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559a401d740 0x5559a40ea630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e4b1df40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5559a40f2b50 0x5559a401bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e4b1df40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a40f2f30 0x5559a401c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e4b1df40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5559a404ac20 con 0x5559a40f2f30 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e4b1df40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5559a3fc2e40 con 0x5559a401d740 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e4b1df40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5559a404bc60 con 0x5559a40f2b50 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e2369640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a40f2f30 0x5559a401c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e2369640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a40f2f30 0x5559a401c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39122/0 (socket says 172.21.15.137:39122) 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e2369640 1 -- 172.21.15.137:0/995068587 learned_addr learned my addr 172.21.15.137:0/995068587 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.561 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e1b68640 1 --2- 172.21.15.137:0/995068587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559a401d740 0x5559a40ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.557+0000 7f38e1367640 1 --2- 172.21.15.137:0/995068587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5559a40f2b50 0x5559a401bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e2369640 1 -- 172.21.15.137:0/995068587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5559a40f2b50 msgr2=0x5559a401bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e2369640 1 --2- 172.21.15.137:0/995068587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5559a40f2b50 0x5559a401bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e2369640 1 -- 172.21.15.137:0/995068587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559a401d740 msgr2=0x5559a40ea630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e2369640 1 --2- 172.21.15.137:0/995068587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559a401d740 0x5559a40ea630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e2369640 1 -- 172.21.15.137:0/995068587 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a4064930 con 0x5559a40f2f30 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e2369640 1 --2- 172.21.15.137:0/995068587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a40f2f30 0x5559a401c170 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00a4e0 tx=0x7f38dc00a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30331bca1633eec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38d3fff640 1 -- 172.21.15.137:0/995068587 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0089c0 con 0x5559a40f2f30 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38d3fff640 1 -- 172.21.15.137:0/995068587 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc008b80 con 0x5559a40f2f30 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38d3fff640 1 -- 172.21.15.137:0/995068587 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc013440 con 0x5559a40f2f30 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e4b1df40 1 -- 172.21.15.137:0/995068587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a40f2f30 msgr2=0x5559a401c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e4b1df40 1 --2- 172.21.15.137:0/995068587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a40f2f30 0x5559a401c170 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00a4e0 tx=0x7f38dc00a9a0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.562 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e4b1df40 1 -- 172.21.15.137:0/995068587 shutdown_connections 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e4b1df40 1 --2- 172.21.15.137:0/995068587 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a40f2f30 0x5559a401c170 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e4b1df40 1 --2- 172.21.15.137:0/995068587 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5559a40f2b50 0x5559a401bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e4b1df40 1 --2- 172.21.15.137:0/995068587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559a401d740 0x5559a40ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e4b1df40 1 -- 172.21.15.137:0/995068587 >> 172.21.15.137:0/995068587 conn(0x5559a4065fd0 msgr2=0x5559a40663b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e4b1df40 1 -- 172.21.15.137:0/995068587 shutdown_connections 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.558+0000 7f38e4b1df40 1 -- 172.21.15.137:0/995068587 wait complete. 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.559+0000 7f38e4b1df40 1 Processor -- start 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.559+0000 7f38e4b1df40 1 -- start start 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e4b1df40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a401d740 0x5559a401bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e4b1df40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559a40f2b50 0x5559a40d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e4b1df40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5559a40f2f30 0x5559a4063970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e4b1df40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5559a4064bf0 con 0x5559a401d740 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e4b1df40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5559a4064ed0 con 0x5559a40f2b50 2024-04-26T22:07:59.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e4b1df40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5559a40651b0 con 0x5559a40f2f30 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1b68640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a401d740 0x5559a401bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1b68640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a401d740 0x5559a401bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39130/0 (socket says 172.21.15.137:39130) 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1b68640 1 -- 172.21.15.137:0/4155418102 learned_addr learned my addr 172.21.15.137:0/4155418102 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1367640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559a40f2b50 0x5559a40d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e2369640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5559a40f2f30 0x5559a4063970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1b68640 1 -- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5559a40f2f30 msgr2=0x5559a4063970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1b68640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5559a40f2f30 0x5559a4063970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1b68640 1 -- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559a40f2b50 msgr2=0x5559a40d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1b68640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559a40f2b50 0x5559a40d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1b68640 1 -- 172.21.15.137:0/4155418102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559a40456d0 con 0x5559a401d740 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e1b68640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a401d740 0x5559a401bc10 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f38d400a4b0 tx=0x7f38d4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38d2ffd640 1 -- 172.21.15.137:0/4155418102 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d4054040 con 0x5559a401d740 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38d2ffd640 1 -- 172.21.15.137:0/4155418102 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d4059450 con 0x5559a401d740 2024-04-26T22:07:59.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559a401c310 con 0x5559a401d740 2024-04-26T22:07:59.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.560+0000 7f38d2ffd640 1 -- 172.21.15.137:0/4155418102 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d4059800 con 0x5559a401d740 2024-04-26T22:07:59.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.561+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559a40ecb60 con 0x5559a401d740 2024-04-26T22:07:59.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.562+0000 7f38d2ffd640 1 -- 172.21.15.137:0/4155418102 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38d4057070 con 0x5559a401d740 2024-04-26T22:07:59.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.562+0000 7f38d2ffd640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f38c406b2d0 0x7f38c406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.562+0000 7f38d2ffd640 1 -- 172.21.15.137:0/4155418102 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f38d40ce8a0 con 0x5559a401d740 2024-04-26T22:07:59.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.562+0000 7f38e1367640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f38c406b2d0 0x7f38c406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.562+0000 7f38e4b1df40 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5559a405cf90 0x5559a405d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.562+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:1 17.19 17:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e116) -- 0x5559a405d8b0 con 0x5559a405cf90 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.563+0000 7f38e1367640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f38c406b2d0 0x7f38c406d790 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f38d8005fd0 tx=0x7f38d800f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.563+0000 7f38e2369640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5559a405cf90 0x5559a405d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.563+0000 7f38e2369640 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5559a405cf90 0x5559a405d370 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.563+0000 7f38e2369640 1 -- 172.21.15.137:0/4155418102 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7f38dc0087c0 con 0x5559a405cf90 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.563+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5559a405cf90 msgr2=0x5559a405d370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e4b1df40 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5559a405cf90 0x5559a405d370 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f38c406b2d0 msgr2=0x7f38c406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e4b1df40 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f38c406b2d0 0x7f38c406d790 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f38d8005fd0 tx=0x7f38d800f040 comp rx=0 tx=0).stop 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a401d740 msgr2=0x5559a401bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e4b1df40 1 --2- 172.21.15.137:0/4155418102 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5559a401d740 0x5559a401bc10 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f38d400a4b0 tx=0x7f38d4003330 comp rx=0 tx=0).stop 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e2369640 1 -- 172.21.15.137:0/4155418102 reap_dead start 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 shutdown_connections 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 >> 172.21.15.137:0/4155418102 conn(0x5559a4065fd0 msgr2=0x5559a401b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 shutdown_connections 2024-04-26T22:07:59.569 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.564+0000 7f38e4b1df40 1 -- 172.21.15.137:0/4155418102 wait complete. 2024-04-26T22:07:59.569 INFO:teuthology.orchestra.run.smithi137.stdout:mytag123 2024-04-26T22:07:59.570 DEBUG:teuthology.orchestra.run.smithi137:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-04-26T22:07:59.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.651+0000 7fc013a49f40 1 Processor -- start 2024-04-26T22:07:59.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.651+0000 7fc013a49f40 1 -- start start 2024-04-26T22:07:59.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc013a49f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebc84d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc013a49f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 0x5637ebd1cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc013a49f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5637ebbe4420 0x5637ebd1d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc013a49f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5637ebbe35a0 con 0x5637ebbb8190 2024-04-26T22:07:59.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc013a49f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5637ebb5de40 con 0x5637ebbb8570 2024-04-26T22:07:59.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc013a49f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5637ebbe3880 con 0x5637ebbe4420 2024-04-26T22:07:59.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc011545640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebc84d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc011545640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebc84d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39140/0 (socket says 172.21.15.137:39140) 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc011545640 1 -- 172.21.15.137:0/2640370253 learned_addr learned my addr 172.21.15.137:0/2640370253 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.652+0000 7fc010d44640 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 0x5637ebd1cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc011545640 1 -- 172.21.15.137:0/2640370253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5637ebbe4420 msgr2=0x5637ebd1d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc011d46640 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5637ebbe4420 0x5637ebd1d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc011545640 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5637ebbe4420 0x5637ebd1d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc011545640 1 -- 172.21.15.137:0/2640370253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 msgr2=0x5637ebd1cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc011545640 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 0x5637ebd1cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc011545640 1 -- 172.21.15.137:0/2640370253 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ebbd76d0 con 0x5637ebbb8190 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc010d44640 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 0x5637ebd1cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc011545640 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebc84d20 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fc00c001e50 tx=0x7fc00c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1167f8023bf74bbb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc0037fe640 1 -- 172.21.15.137:0/2640370253 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00e5c0 con 0x5637ebbb8190 2024-04-26T22:07:59.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc0037fe640 1 -- 172.21.15.137:0/2640370253 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00c006070 con 0x5637ebbb8190 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc0037fe640 1 -- 172.21.15.137:0/2640370253 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00e980 con 0x5637ebbb8190 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc013a49f40 1 -- 172.21.15.137:0/2640370253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 msgr2=0x5637ebc84d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc013a49f40 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebc84d20 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fc00c001e50 tx=0x7fc00c00b6c0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc013a49f40 1 -- 172.21.15.137:0/2640370253 shutdown_connections 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc013a49f40 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5637ebbe4420 0x5637ebd1d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc013a49f40 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 0x5637ebd1cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc013a49f40 1 --2- 172.21.15.137:0/2640370253 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebc84d20 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc013a49f40 1 -- 172.21.15.137:0/2640370253 >> 172.21.15.137:0/2640370253 conn(0x5637ebbb4dd0 msgr2=0x5637ebbb5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc013a49f40 1 -- 172.21.15.137:0/2640370253 shutdown_connections 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.653+0000 7fc013a49f40 1 -- 172.21.15.137:0/2640370253 wait complete. 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.654+0000 7fc013a49f40 1 Processor -- start 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.654+0000 7fc013a49f40 1 -- start start 2024-04-26T22:07:59.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc013a49f40 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebbb7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc013a49f40 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 0x5637ebbb6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc013a49f40 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5637ebbe4420 0x5637ebc7d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc013a49f40 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5637ebc85820 con 0x5637ebbb8190 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc013a49f40 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5637ebbd7a40 con 0x5637ebbb8570 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc013a49f40 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5637ebbb6700 con 0x5637ebbe4420 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011545640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebbb7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011545640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebbb7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39156/0 (socket says 172.21.15.137:39156) 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011545640 1 -- 172.21.15.137:0/3098838537 learned_addr learned my addr 172.21.15.137:0/3098838537 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011d46640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5637ebbe4420 0x5637ebc7d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc010d44640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 0x5637ebbb6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011545640 1 -- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5637ebbe4420 msgr2=0x5637ebc7d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011545640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5637ebbe4420 0x5637ebc7d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011545640 1 -- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 msgr2=0x5637ebbb6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011545640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5637ebbb8570 0x5637ebbb6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011545640 1 -- 172.21.15.137:0/3098838537 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ebbb72b0 con 0x5637ebbb8190 2024-04-26T22:07:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc011545640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebbb7510 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00ef90 tx=0x7fc00c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc0027fc640 1 -- 172.21.15.137:0/3098838537 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c021030 con 0x5637ebbb8190 2024-04-26T22:07:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc0027fc640 1 -- 172.21.15.137:0/3098838537 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00c0011f0 con 0x5637ebbb8190 2024-04-26T22:07:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5637ebbb7af0 con 0x5637ebbb8190 2024-04-26T22:07:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc0027fc640 1 -- 172.21.15.137:0/3098838537 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00f660 con 0x5637ebbb8190 2024-04-26T22:07:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.655+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637ebc81630 con 0x5637ebbb8190 2024-04-26T22:07:59.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.657+0000 7fc0027fc640 1 -- 172.21.15.137:0/3098838537 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc00c024070 con 0x5637ebbb8190 2024-04-26T22:07:59.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.657+0000 7fc0027fc640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbff406b2d0 0x7fbff406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.657+0000 7fc0027fc640 1 -- 172.21.15.137:0/3098838537 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fc00c08c4a0 con 0x5637ebbb8190 2024-04-26T22:07:59.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.657+0000 7fc010d44640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbff406b2d0 0x7fbff406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.657+0000 7fc013a49f40 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5637ebd22200 0x5637ebd22610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.657+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:1 17.5 17:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e116) -- 0x5637ebd22b50 con 0x5637ebd22200 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.657+0000 7fc010d44640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbff406b2d0 0x7fbff406d790 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc008056000 tx=0x7fc008007030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.657+0000 7fc011d46640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5637ebd22200 0x5637ebd22610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc011d46640 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5637ebd22200 0x5637ebd22610 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc011d46640 1 -- 172.21.15.137:0/3098838537 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) ==== 164+0+12 (crc 0 0 0) 0x7fc004009780 con 0x5637ebd22200 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5637ebd22200 msgr2=0x5637ebd22610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5637ebd22200 0x5637ebd22610 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbff406b2d0 msgr2=0x7fbff406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fbff406b2d0 0x7fbff406d790 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc008056000 tx=0x7fc008007030 comp rx=0 tx=0).stop 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 msgr2=0x5637ebbb7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 --2- 172.21.15.137:0/3098838537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5637ebbb8190 0x5637ebbb7510 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00ef90 tx=0x7fc00c000bc0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc011d46640 1 -- 172.21.15.137:0/3098838537 reap_dead start 2024-04-26T22:07:59.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 shutdown_connections 2024-04-26T22:07:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 >> 172.21.15.137:0/3098838537 conn(0x5637ebbb4dd0 msgr2=0x5637ebbb5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 shutdown_connections 2024-04-26T22:07:59.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.658+0000 7fc013a49f40 1 -- 172.21.15.137:0/3098838537 wait complete. 2024-04-26T22:07:59.665 INFO:teuthology.orchestra.run.smithi137.stdout:mytag123 2024-04-26T22:07:59.665 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-26T22:07:59.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.805+0000 7f03e3378640 1 Processor -- start 2024-04-26T22:07:59.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.805+0000 7f03e3378640 1 -- start start 2024-04-26T22:07:59.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.806+0000 7f03e3378640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f03dc15d520 0x7f03dc161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.806+0000 7f03e3378640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03dc070b00 con 0x7f03dc0737a0 2024-04-26T22:07:59.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.806+0000 7f03e3378640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03dc070de0 con 0x7f03dc0cfd40 2024-04-26T22:07:59.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.806+0000 7f03e3378640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f03dc161dd0 con 0x7f03dc15d520 2024-04-26T22:07:59.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.806+0000 7f03e1915640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f03dc0737a0 0x7f03dc15da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47826/0 (socket says 172.21.15.137:47826) 2024-04-26T22:07:59.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.806+0000 7f03e1915640 1 -- 172.21.15.137:0/2838443837 learned_addr learned my addr 172.21.15.137:0/2838443837 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:59.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.807+0000 7f03e1114640 1 --2- 172.21.15.137:0/2838443837 >> v2:172.21.15.170:3300/0 conn(0x7f03dc15d520 0x7f03dc161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.807+0000 7f03d3fff640 1 -- 172.21.15.137:0/2838443837 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1497323219 0 0) 0x7f03dc070b00 con 0x7f03dc0737a0 2024-04-26T22:07:59.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.807+0000 7f03d3fff640 1 -- 172.21.15.137:0/2838443837 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03c8003520 con 0x7f03dc0737a0 2024-04-26T22:07:59.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.807+0000 7f03d3fff640 1 -- 172.21.15.137:0/2838443837 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118805972 0 0) 0x7f03dc070de0 con 0x7f03dc0cfd40 2024-04-26T22:07:59.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.807+0000 7f03d3fff640 1 -- 172.21.15.137:0/2838443837 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03dc070b00 con 0x7f03dc0cfd40 2024-04-26T22:07:59.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.807+0000 7f03d3fff640 1 -- 172.21.15.137:0/2838443837 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2721302142 0 0) 0x7f03c8003520 con 0x7f03dc0737a0 2024-04-26T22:07:59.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.807+0000 7f03e1114640 1 -- 172.21.15.137:0/2838443837 >> v1:172.21.15.170:6789/0 conn(0x7f03dc0cfd40 legacy=0x7f03dc073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.807+0000 7f03e1114640 1 -- 172.21.15.137:0/2838443837 >> v1:172.21.15.137:6789/0 conn(0x7f03dc0737a0 legacy=0x7f03dc15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.807+0000 7f03e1114640 1 -- 172.21.15.137:0/2838443837 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc06dd60 con 0x7f03dc15d520 2024-04-26T22:07:59.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03e1114640 1 --2- 172.21.15.137:0/2838443837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03dc15d520 0x7f03dc161890 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009d90 tx=0x7f03d802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e684d116196670f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03d3fff640 1 -- 172.21.15.137:0/2838443837 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d4001670 con 0x7f03dc15d520 2024-04-26T22:07:59.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03d3fff640 1 -- 172.21.15.137:0/2838443837 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d8007540 con 0x7f03dc15d520 2024-04-26T22:07:59.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03d3fff640 1 -- 172.21.15.137:0/2838443837 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d80078f0 con 0x7f03dc15d520 2024-04-26T22:07:59.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03e3378640 1 -- 172.21.15.137:0/2838443837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03dc15d520 msgr2=0x7f03dc161890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03e3378640 1 --2- 172.21.15.137:0/2838443837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03dc15d520 0x7f03dc161890 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009d90 tx=0x7f03d802a5f0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03e3378640 1 -- 172.21.15.137:0/2838443837 shutdown_connections 2024-04-26T22:07:59.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03e3378640 1 --2- 172.21.15.137:0/2838443837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03dc15d520 0x7f03dc161890 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03e3378640 1 -- 172.21.15.137:0/2838443837 >> 172.21.15.137:0/2838443837 conn(0x7f03dc0d1e40 msgr2=0x7f03dc0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03e3378640 1 -- 172.21.15.137:0/2838443837 shutdown_connections 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.808+0000 7f03e3378640 1 -- 172.21.15.137:0/2838443837 wait complete. 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e3378640 1 Processor -- start 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e3378640 1 -- start start 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e3378640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03dc0737a0 0x7f03dc15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e3378640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03dc0cfd40 0x7f03dc1f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e3378640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03dc1f4520 0x7f03dc0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e3378640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc0d18a0 con 0x7f03dc1f4520 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e3378640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc070790 con 0x7f03dc0cfd40 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e3378640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f03dc15e120 con 0x7f03dc0737a0 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e1915640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03dc1f4520 0x7f03dc0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e1915640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03dc1f4520 0x7f03dc0b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39164/0 (socket says 172.21.15.137:39164) 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.810+0000 7f03e1915640 1 -- 172.21.15.137:0/1550645143 learned_addr learned my addr 172.21.15.137:0/1550645143 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03e1915640 1 -- 172.21.15.137:0/1550645143 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03dc0737a0 msgr2=0x7f03dc15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03e1915640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03dc0737a0 0x7f03dc15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03e1915640 1 -- 172.21.15.137:0/1550645143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03dc0cfd40 msgr2=0x7f03dc1f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03e0913640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03dc0cfd40 0x7f03dc1f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03e1915640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03dc0cfd40 0x7f03dc1f3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03e1915640 1 -- 172.21.15.137:0/1550645143 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc0b4da0 con 0x7f03dc1f4520 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03e1915640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03dc1f4520 0x7f03dc0b5e40 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f03d400c580 tx=0x7f03d400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03d1ffb640 1 -- 172.21.15.137:0/1550645143 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d4017070 con 0x7f03dc1f4520 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03d1ffb640 1 -- 172.21.15.137:0/1550645143 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d4005ce0 con 0x7f03dc1f4520 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03e3378640 1 -- 172.21.15.137:0/1550645143 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03dc0b5080 con 0x7f03dc1f4520 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03d1ffb640 1 -- 172.21.15.137:0/1550645143 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d40072f0 con 0x7f03dc1f4520 2024-04-26T22:07:59.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.811+0000 7f03e3378640 1 -- 172.21.15.137:0/1550645143 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03dc0b5640 con 0x7f03dc1f4520 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.813+0000 7f03d1ffb640 1 -- 172.21.15.137:0/1550645143 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f03d401a070 con 0x7f03dc1f4520 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.813+0000 7f03d1ffb640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03c006c8f0 0x7f03c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.813+0000 7f03d1ffb640 1 -- 172.21.15.137:0/1550645143 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f03d408af60 con 0x7f03dc1f4520 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.813+0000 7f03e1114640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03c006c8f0 0x7f03c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.813+0000 7f03e1114640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03c006c8f0 0x7f03c006edb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f03d8034000 tx=0x7f03d802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.814+0000 7f03e616a740 1 Processor -- start 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.814+0000 7f03e616a740 1 -- start start 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e616a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 0x557cdf3e4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e616a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3dee10 0x557cdf3e2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e616a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e30c0 0x557cdf3e3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e616a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557cdf348d80 con 0x557cdf3dee10 2024-04-26T22:07:59.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e616a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557cdf3028b0 con 0x557cdf3e3f80 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e616a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x557cdf344d40 con 0x557cdf3e30c0 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e0913640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3dee10 0x557cdf3e2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e0913640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3dee10 0x557cdf3e2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39180/0 (socket says 172.21.15.137:39180) 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e0913640 1 -- 172.21.15.137:0/550703145 learned_addr learned my addr 172.21.15.137:0/550703145 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e1915640 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e30c0 0x557cdf3e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e1114640 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 0x557cdf3e4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e0913640 1 -- 172.21.15.137:0/550703145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e30c0 msgr2=0x557cdf3e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e0913640 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e30c0 0x557cdf3e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e0913640 1 -- 172.21.15.137:0/550703145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 msgr2=0x557cdf3e4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e0913640 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 0x557cdf3e4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e0913640 1 -- 172.21.15.137:0/550703145 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdf2d3a40 con 0x557cdf3dee10 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e1114640 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 0x557cdf3e4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:59.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03e0913640 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3dee10 0x557cdf3e2b80 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0d0160 tx=0x7f03cc001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b618e0a15e265b29 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.815+0000 7f03c6ffd640 1 -- 172.21.15.137:0/550703145 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc016020 con 0x557cdf3dee10 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03c6ffd640 1 -- 172.21.15.137:0/550703145 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03cc00db40 con 0x557cdf3dee10 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03c6ffd640 1 -- 172.21.15.137:0/550703145 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0123f0 con 0x557cdf3dee10 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03e616a740 1 -- 172.21.15.137:0/550703145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3dee10 msgr2=0x557cdf3e2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03e616a740 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3dee10 0x557cdf3e2b80 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0d0160 tx=0x7f03cc001b10 comp rx=0 tx=0).stop 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03e616a740 1 -- 172.21.15.137:0/550703145 shutdown_connections 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03e616a740 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3dee10 0x557cdf3e2b80 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03e616a740 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e30c0 0x557cdf3e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03e616a740 1 --2- 172.21.15.137:0/550703145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 0x557cdf3e4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03e616a740 1 -- 172.21.15.137:0/550703145 >> 172.21.15.137:0/550703145 conn(0x557cdf3e1080 msgr2=0x557cdf429b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03e616a740 1 -- 172.21.15.137:0/550703145 shutdown_connections 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.816+0000 7f03e616a740 1 -- 172.21.15.137:0/550703145 wait complete. 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.817+0000 7f03e616a740 1 -- start start 2024-04-26T22:07:59.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.817+0000 7f03e616a740 1 Processor -- start 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf40b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 0x557cdf408960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf43a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557cdf40fb10 con 0x557cdf439eb0 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x557cdf2cfd10 con 0x557cdf3e30c0 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x557cdf40ef90 con 0x557cdf3e3f80 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 10 client.0 _ll_register_callbacks cb 0x557cdf2fc210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1915640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf43a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1915640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf43a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39194/0 (socket says 172.21.15.137:39194) 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1915640 1 -- 172.21.15.137:0/2727023280 learned_addr learned my addr 172.21.15.137:0/2727023280 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e0913640 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 0x557cdf408960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1114640 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf40b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1915640 1 -- 172.21.15.137:0/2727023280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 msgr2=0x557cdf408960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1915640 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 0x557cdf408960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1915640 1 -- 172.21.15.137:0/2727023280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 msgr2=0x557cdf40b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1915640 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf40b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1915640 1 -- 172.21.15.137:0/2727023280 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cdf1247d0 con 0x557cdf439eb0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1114640 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf40b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e1915640 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf43a330 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f03d40551d0 tx=0x7f03d4061960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d35869055574412 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03bbfff640 1 -- 172.21.15.137:0/2727023280 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d4087060 con 0x557cdf439eb0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03bbfff640 1 -- 172.21.15.137:0/2727023280 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f03d4007490 con 0x557cdf439eb0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 1 -- 172.21.15.137:0/2727023280 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03cc00db40 con 0x557cdf439eb0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03bbfff640 1 -- 172.21.15.137:0/2727023280 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f03d4071070 con 0x557cdf439eb0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 10 client.9252 fetch_fsmap learned FSMap version 87 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.818+0000 7f03e616a740 1 -- 172.21.15.137:0/2727023280 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x557cdf05a3f0 con 0x557cdf439eb0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03bbfff640 1 -- 172.21.15.137:0/2727023280 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03cc00db40 con 0x557cdf439eb0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03bbfff640 1 -- 172.21.15.137:0/2727023280 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7f03d40581c0 con 0x557cdf439eb0 2024-04-26T22:07:59.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03e616a740 10 client.9252 fetch_fsmap finished waiting for FSMap version 87 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03e616a740 10 client.9252 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03e616a740 20 client.9252 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03e616a740 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x557cdf409440 0x557cdf42c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03e616a740 4 client.9252 mds_command: new command op to 8859 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03e616a740 1 -- 172.21.15.137:0/2727023280 --> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cdf356990 con 0x557cdf409440 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03e1114640 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x557cdf409440 0x557cdf42c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03e1114640 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x557cdf409440 0x557cdf42c740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=100070e1d9e49965 server_cookie=a395e5cc7deec79a in_seq=0 out_seq=0 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.819+0000 7f03bbfff640 10 client.9252 ms_handle_connect on v2:172.21.15.137:6835/2830617564 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03bbfff640 1 -- 172.21.15.137:0/2727023280 <== mds.0 v2:172.21.15.137:6835/2830617564 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557cdf356990 con 0x557cdf409440 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03bbfff640 10 client.9252 handle_command_reply: tid=0 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 client.9252 shutdown 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 -- 172.21.15.137:0/2727023280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 msgr2=0x557cdf43a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf43a330 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f03d40551d0 tx=0x7f03d4061960 comp rx=0 tx=0).stop 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 -- 172.21.15.137:0/2727023280 shutdown_connections 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x557cdf409440 0x557cdf42c740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf43a330 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03bbfff640 0 client.9252 ms_handle_reset on v2:172.21.15.137:6835/2830617564 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 0x557cdf408960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 --2- 172.21.15.137:0/2727023280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf40b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 -- 172.21.15.137:0/2727023280 >> 172.21.15.137:0/2727023280 conn(0x557cdf3dee10 msgr2=0x557cdf3e4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 -- 172.21.15.137:0/2727023280 shutdown_connections 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 1 -- 172.21.15.137:0/2727023280 wait complete. 2024-04-26T22:07:59.827 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.820+0000 7f03e616a740 20 client.9252 trim_cache size 0 max 16384 2024-04-26T22:07:59.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.835+0000 7f03e616a740 1 Processor -- start 2024-04-26T22:07:59.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.835+0000 7f03e616a740 1 -- start start 2024-04-26T22:07:59.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.835+0000 7f03e616a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3e30c0 0x557cdf44dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.835+0000 7f03e616a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 0x557cdf40b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.835+0000 7f03e616a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf439eb0 0x557cdf428c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.835+0000 7f03e616a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc1ff630 con 0x557cdf3e30c0 2024-04-26T22:07:59.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.835+0000 7f03e616a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc1fe7a0 con 0x557cdf3e3f80 2024-04-26T22:07:59.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.835+0000 7f03e616a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f03dc1f6650 con 0x557cdf439eb0 2024-04-26T22:07:59.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03e1114640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3e30c0 0x557cdf44dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03e1114640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3e30c0 0x557cdf44dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39204/0 (socket says 172.21.15.137:39204) 2024-04-26T22:07:59.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03e1114640 1 -- 172.21.15.137:0/3830416080 learned_addr learned my addr 172.21.15.137:0/3830416080 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03e1114640 1 -- 172.21.15.137:0/3830416080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf439eb0 msgr2=0x557cdf428c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03e1114640 1 --2- 172.21.15.137:0/3830416080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf439eb0 0x557cdf428c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03e1114640 1 -- 172.21.15.137:0/3830416080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 msgr2=0x557cdf40b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03e1114640 1 --2- 172.21.15.137:0/3830416080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 0x557cdf40b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03e1114640 1 -- 172.21.15.137:0/3830416080 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cdf01a0f0 con 0x557cdf3e30c0 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03e1114640 1 --2- 172.21.15.137:0/3830416080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3e30c0 0x557cdf44dc50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f03d803f040 tx=0x7f03d8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1651c97e5124b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03c67fc640 1 -- 172.21.15.137:0/3830416080 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8007e90 con 0x557cdf3e30c0 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03c67fc640 1 -- 172.21.15.137:0/3830416080 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d8056070 con 0x557cdf3e30c0 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.836+0000 7f03c67fc640 1 -- 172.21.15.137:0/3830416080 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8051dc0 con 0x557cdf3e30c0 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 -- 172.21.15.137:0/3830416080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3e30c0 msgr2=0x557cdf44dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 --2- 172.21.15.137:0/3830416080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3e30c0 0x557cdf44dc50 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f03d803f040 tx=0x7f03d8030000 comp rx=0 tx=0).stop 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 -- 172.21.15.137:0/3830416080 shutdown_connections 2024-04-26T22:07:59.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 --2- 172.21.15.137:0/3830416080 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf439eb0 0x557cdf428c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 --2- 172.21.15.137:0/3830416080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e3f80 0x557cdf40b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 --2- 172.21.15.137:0/3830416080 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf3e30c0 0x557cdf44dc50 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 -- 172.21.15.137:0/3830416080 >> 172.21.15.137:0/3830416080 conn(0x557cdf3dee10 msgr2=0x557cdf3ddcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 -- 172.21.15.137:0/3830416080 shutdown_connections 2024-04-26T22:07:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 -- 172.21.15.137:0/3830416080 wait complete. 2024-04-26T22:07:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 -- start start 2024-04-26T22:07:59.839 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.837+0000 7f03e616a740 1 Processor -- start 2024-04-26T22:07:59.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e616a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf4a0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e616a740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 0x557cdf3e4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.841 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e616a740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf3e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e616a740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x557cdf3e28a0 con 0x557cdf439eb0 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e616a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc1f6ca0 con 0x557cdf3e30c0 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e616a740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x557cdf2ea4b0 con 0x557cdf3e3f80 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e616a740 10 client.0 _ll_register_callbacks cb 0x7f03d40588b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1915640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf3e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1915640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf3e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39212/0 (socket says 172.21.15.137:39212) 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1915640 1 -- 172.21.15.137:0/2581645369 learned_addr learned my addr 172.21.15.137:0/2581645369 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1114640 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf4a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e0913640 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 0x557cdf3e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1915640 1 -- 172.21.15.137:0/2581645369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 msgr2=0x557cdf3e4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1915640 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 0x557cdf3e4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1915640 1 -- 172.21.15.137:0/2581645369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 msgr2=0x557cdf4a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1915640 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf4a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.842 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1915640 1 -- 172.21.15.137:0/2581645369 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cdf3094b0 con 0x557cdf439eb0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.838+0000 7f03e1114640 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf4a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e1915640 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf3e4a40 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f03d4005fd0 tx=0x7f03d4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f4ff79ad900e13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03bbfff640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03bbfff640 1 -- 172.21.15.137:0/2581645369 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d4087040 con 0x557cdf439eb0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03bbfff640 1 -- 172.21.15.137:0/2581645369 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7f03d4007690 con 0x557cdf439eb0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e616a740 1 -- 172.21.15.137:0/2581645369 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03d8056070 con 0x557cdf439eb0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03bbfff640 1 -- 172.21.15.137:0/2581645369 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f03d4058b40 con 0x557cdf439eb0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e616a740 10 client.9258 fetch_fsmap learned FSMap version 87 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e616a740 1 -- 172.21.15.137:0/2581645369 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) -- 0x557cdf40eab0 con 0x557cdf439eb0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03bbfff640 1 -- 172.21.15.137:0/2581645369 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d8056070 con 0x557cdf439eb0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03bbfff640 1 -- 172.21.15.137:0/2581645369 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 87) ==== 3494+0+0 (secure 0 0 0) 0x7f03d405f270 con 0x557cdf439eb0 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e616a740 10 client.9258 fetch_fsmap finished waiting for FSMap version 87 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e616a740 10 client.9258 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e616a740 20 client.9258 populate_metadata read hostname 'smithi137' 2024-04-26T22:07:59.843 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e616a740 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x557cdf43a440 0x557cdf4a3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e616a740 4 client.9258 mds_command: new command op to 8859 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-26T22:07:59.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e616a740 1 -- 172.21.15.137:0/2581645369 --> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557cdf350800 con 0x557cdf43a440 2024-04-26T22:07:59.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.839+0000 7f03e1114640 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x557cdf43a440 0x557cdf4a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.840+0000 7f03bbfff640 10 client.9258 ms_handle_connect on v2:172.21.15.137:6835/2830617564 2024-04-26T22:07:59.844 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.840+0000 7f03e1114640 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x557cdf43a440 0x557cdf4a3370 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20c228fc531971be server_cookie=d41e8d4873245a87 in_seq=0 out_seq=0 2024-04-26T22:07:59.848 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03bbfff640 1 -- 172.21.15.137:0/2581645369 <== mds.0 v2:172.21.15.137:6835/2830617564 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557cdf350800 con 0x557cdf43a440 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03bbfff640 10 client.9258 handle_command_reply: tid=0 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 client.9258 shutdown 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 -- 172.21.15.137:0/2581645369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 msgr2=0x557cdf3e4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf3e4a40 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f03d4005fd0 tx=0x7f03d4000ed0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 -- 172.21.15.137:0/2581645369 shutdown_connections 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.137:6835/2830617564,v1:172.21.15.137:6837/2830617564] conn(0x557cdf43a440 0x557cdf4a3370 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x557cdf439eb0 0x557cdf3e4a40 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x557cdf3e3f80 0x557cdf3e4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 --2- 172.21.15.137:0/2581645369 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557cdf3e30c0 0x557cdf4a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 -- 172.21.15.137:0/2581645369 >> 172.21.15.137:0/2581645369 conn(0x557cdf3dee10 msgr2=0x557cdf40abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03bbfff640 0 client.9258 ms_handle_reset on v2:172.21.15.137:6835/2830617564 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 -- 172.21.15.137:0/2581645369 shutdown_connections 2024-04-26T22:07:59.849 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.848+0000 7f03e616a740 1 -- 172.21.15.137:0/2581645369 wait complete. 2024-04-26T22:07:59.850 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e616a740 20 client.9258 trim_cache size 0 max 16384 2024-04-26T22:07:59.850 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:07:59.850 INFO:teuthology.orchestra.run.smithi137.stdout: "message": "", 2024-04-26T22:07:59.850 INFO:teuthology.orchestra.run.smithi137.stdout: "return_code": 0 2024-04-26T22:07:59.850 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:07:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 -- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03c006c8f0 msgr2=0x7f03c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03c006c8f0 0x7f03c006edb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f03d8034000 tx=0x7f03d802e000 comp rx=0 tx=0).stop 2024-04-26T22:07:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 -- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03dc1f4520 msgr2=0x7f03dc0b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03dc1f4520 0x7f03dc0b5e40 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f03d400c580 tx=0x7f03d400ca40 comp rx=0 tx=0).stop 2024-04-26T22:07:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 -- 172.21.15.137:0/1550645143 shutdown_connections 2024-04-26T22:07:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f03c006c8f0 0x7f03c006edb0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f03dc1f4520 0x7f03dc0b5e40 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f03dc0cfd40 0x7f03dc1f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 --2- 172.21.15.137:0/1550645143 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f03dc0737a0 0x7f03dc15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 -- 172.21.15.137:0/1550645143 >> 172.21.15.137:0/1550645143 conn(0x7f03dc0d1e40 msgr2=0x7f03dc15d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 -- 172.21.15.137:0/1550645143 shutdown_connections 2024-04-26T22:07:59.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.849+0000 7f03e3378640 1 -- 172.21.15.137:0/1550645143 wait complete. 2024-04-26T22:07:59.860 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:07:59.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.958+0000 7fd719a7b640 1 Processor -- start 2024-04-26T22:07:59.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.958+0000 7fd719a7b640 1 -- start start 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd719a7b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd714140350 0x7fd7140cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd719a7b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd714146790 0x7fd7140cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd719a7b640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7140d05b0 con 0x7fd71413ff70 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd719a7b640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd7140d0890 con 0x7fd714146790 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd719a7b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd71406e450 con 0x7fd714140350 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd713fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd714146790 0x7fd7140cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd7137fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd71413ff70 0x7fd714146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47828/0 (socket says 172.21.15.137:47828) 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd7137fe640 1 -- 172.21.15.137:0/2416049059 learned_addr learned my addr 172.21.15.137:0/2416049059 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd712ffd640 1 --2- 172.21.15.137:0/2416049059 >> v2:172.21.15.170:3300/0 conn(0x7fd714140350 0x7fd7140cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd713fff640 1 -- 172.21.15.137:0/2416049059 >> v2:172.21.15.170:3300/0 conn(0x7fd714140350 msgr2=0x7fd7140cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd713fff640 1 --2- 172.21.15.137:0/2416049059 >> v2:172.21.15.170:3300/0 conn(0x7fd714140350 0x7fd7140cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd713fff640 1 -- 172.21.15.137:0/2416049059 >> v1:172.21.15.137:6789/0 conn(0x7fd71413ff70 legacy=0x7fd714146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd713fff640 1 -- 172.21.15.137:0/2416049059 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71406e730 con 0x7fd714146790 2024-04-26T22:07:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.959+0000 7fd7127fc640 1 -- 172.21.15.137:0/2416049059 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3805760841 0 0) 0x7fd7140d05b0 con 0x7fd71413ff70 2024-04-26T22:07:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.960+0000 7fd713fff640 1 --2- 172.21.15.137:0/2416049059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714146790 0x7fd7140cfd50 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009d90 tx=0x7fd70c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ebec5b0626a37b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.960+0000 7fd7127fc640 1 -- 172.21.15.137:0/2416049059 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c031600 con 0x7fd714146790 2024-04-26T22:07:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.960+0000 7fd7127fc640 1 -- 172.21.15.137:0/2416049059 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd70c0317a0 con 0x7fd714146790 2024-04-26T22:07:59.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.960+0000 7fd7127fc640 1 -- 172.21.15.137:0/2416049059 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70c031b70 con 0x7fd714146790 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.960+0000 7fd719a7b640 1 -- 172.21.15.137:0/2416049059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714146790 msgr2=0x7fd7140cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.960+0000 7fd719a7b640 1 --2- 172.21.15.137:0/2416049059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714146790 0x7fd7140cfd50 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009d90 tx=0x7fd70c02a610 comp rx=0 tx=0).stop 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.961+0000 7fd719a7b640 1 -- 172.21.15.137:0/2416049059 shutdown_connections 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.961+0000 7fd719a7b640 1 --2- 172.21.15.137:0/2416049059 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714146790 0x7fd7140cfd50 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.961+0000 7fd719a7b640 1 --2- 172.21.15.137:0/2416049059 >> v2:172.21.15.170:3300/0 conn(0x7fd714140350 0x7fd7140cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.961+0000 7fd719a7b640 1 -- 172.21.15.137:0/2416049059 >> 172.21.15.137:0/2416049059 conn(0x7fd7140d0d30 msgr2=0x7fd7140d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.961+0000 7fd719a7b640 1 -- 172.21.15.137:0/2416049059 shutdown_connections 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.961+0000 7fd719a7b640 1 -- 172.21.15.137:0/2416049059 wait complete. 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.962+0000 7fd719a7b640 1 Processor -- start 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.962+0000 7fd719a7b640 1 -- start start 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd719a7b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71413ff70 0x7fd7140aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd719a7b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714140350 0x7fd71415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd719a7b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd714146790 0x7fd714144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd719a7b640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd71406edd0 con 0x7fd714140350 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd719a7b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd71406ec50 con 0x7fd71413ff70 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd719a7b640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd71406ef50 con 0x7fd714146790 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd712ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714140350 0x7fd71415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd712ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714140350 0x7fd71415af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39230/0 (socket says 172.21.15.137:39230) 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd712ffd640 1 -- 172.21.15.137:0/281470498 learned_addr learned my addr 172.21.15.137:0/281470498 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd712ffd640 1 -- 172.21.15.137:0/281470498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd714146790 msgr2=0x7fd714144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd712ffd640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd714146790 0x7fd714144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd712ffd640 1 -- 172.21.15.137:0/281470498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71413ff70 msgr2=0x7fd7140aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd712ffd640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71413ff70 0x7fd7140aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd712ffd640 1 -- 172.21.15.137:0/281470498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71413ed40 con 0x7fd714140350 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd712ffd640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714140350 0x7fd71415af50 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fd70800d830 tx=0x7fd70800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd6fbfff640 1 -- 172.21.15.137:0/281470498 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70800b6c0 con 0x7fd714140350 2024-04-26T22:07:59.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd6fbfff640 1 -- 172.21.15.137:0/281470498 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd708019070 con 0x7fd714140350 2024-04-26T22:07:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd6fbfff640 1 -- 172.21.15.137:0/281470498 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70800ba80 con 0x7fd714140350 2024-04-26T22:07:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71413f020 con 0x7fd714140350 2024-04-26T22:07:59.966 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.963+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd71415bf60 con 0x7fd714140350 2024-04-26T22:07:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.964+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd71406a290 con 0x7fd714140350 2024-04-26T22:07:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.965+0000 7fd6fbfff640 1 -- 172.21.15.137:0/281470498 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd70801e460 con 0x7fd714140350 2024-04-26T22:07:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.965+0000 7fd6fbfff640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd70006c940 0x7fd70006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:07:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.965+0000 7fd6fbfff640 1 -- 172.21.15.137:0/281470498 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5795+0+0 (secure 0 0 0) 0x7fd70808c1a0 con 0x7fd714140350 2024-04-26T22:07:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.965+0000 7fd7137fe640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd70006c940 0x7fd70006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:07:59.967 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.966+0000 7fd7137fe640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd70006c940 0x7fd70006ee00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd704007fd0 tx=0x7fd704007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:07:59.969 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:07:59.970+0000 7fd6fbfff640 1 -- 172.21.15.137:0/281470498 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd70805a650 con 0x7fd714140350 2024-04-26T22:08:00.181 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.181+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd71415e870 con 0x7fd714140350 2024-04-26T22:08:00.182 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:08:00.182+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:08:00.183 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.183+0000 7fd6fbfff640 1 -- 172.21.15.137:0/281470498 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v88) ==== 161+0+0 (secure 0 0 0) 0x7fd708059f50 con 0x7fd714140350 2024-04-26T22:08:00.183 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:08:00.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd70006c940 msgr2=0x7fd70006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.186 INFO:tasks.ceph.mds.a.smithi137.stderr: -3609> 2024-04-26T22:07:32.508+0000 7f768a117640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd70006c940 0x7fd70006ee00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd704007fd0 tx=0x7fd704007920 comp rx=0 tx=0).stop 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714140350 msgr2=0x7fd71415af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714140350 0x7fd71415af50 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fd70800d830 tx=0x7fd70800dcf0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 shutdown_connections 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd70006c940 0x7fd70006ee00 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd714140350 0x7fd71415af50 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd714146790 0x7fd714144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 --2- 172.21.15.137:0/281470498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd71413ff70 0x7fd7140aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 >> 172.21.15.137:0/281470498 conn(0x7fd7140d0d30 msgr2=0x7fd714141820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 shutdown_connections 2024-04-26T22:08:00.187 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.186+0000 7fd719a7b640 1 -- 172.21.15.137:0/281470498 wait complete. 2024-04-26T22:08:00.189 INFO:tasks.ceph.mds.a.smithi137.stderr: -946> 2024-04-26T22:07:57.832+0000 7f768410b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:08:00.198 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-04-26T22:08:00.214 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:08:00.239 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feaba1ee280 1 -- start start 2024-04-26T22:08:00.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feaba1ee280 1 Processor -- start 2024-04-26T22:08:00.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8684c00 0x564fd9450000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8685800 0x564fd9450580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd8685c00 0x564fd9450b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feaba1ee280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564fd9468600 con 0x564fd8685800 2024-04-26T22:08:00.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feaba1ee280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564fd9468480 con 0x564fd8685c00 2024-04-26T22:08:00.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feaba1ee280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564fd9468300 con 0x564fd8684c00 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feab819b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8685800 0x564fd9450580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feab819b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8685800 0x564fd9450580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39254/0 (socket says 172.21.15.137:39254) 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feab819b640 1 -- 172.21.15.137:0/3089078941 learned_addr learned my addr 172.21.15.137:0/3089078941 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feab899c640 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8684c00 0x564fd9450000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.240+0000 7feab919d640 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd8685c00 0x564fd9450b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab819b640 1 -- 172.21.15.137:0/3089078941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8684c00 msgr2=0x564fd9450000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab819b640 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8684c00 0x564fd9450000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab819b640 1 -- 172.21.15.137:0/3089078941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd8685c00 msgr2=0x564fd9450b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab819b640 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd8685c00 0x564fd9450b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab819b640 1 -- 172.21.15.137:0/3089078941 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd86ba780 con 0x564fd8685800 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab899c640 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8684c00 0x564fd9450000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab819b640 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8685800 0x564fd9450580 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x564fd94a1800 tx=0x564fd94240c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443521aae79912f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab6197640 1 -- 172.21.15.137:0/3089078941 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564fd86aa680 con 0x564fd8685800 2024-04-26T22:08:00.248 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab6197640 1 -- 172.21.15.137:0/3089078941 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564fd86b0a80 con 0x564fd8685800 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab6197640 1 -- 172.21.15.137:0/3089078941 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564fd86aab60 con 0x564fd8685800 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feaba1ee280 1 -- 172.21.15.137:0/3089078941 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd86ba3c0 con 0x564fd8685800 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feaba1ee280 1 -- 172.21.15.137:0/3089078941 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564fd86bb680 con 0x564fd8685800 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feaba1ee280 4 waiting for MDS map... 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab6197640 1 -- 172.21.15.137:0/3089078941 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x564fd9562a00 con 0x564fd8685800 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feab6197640 1 -- 172.21.15.137:0/3089078941 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 88) ==== 2885+0+0 (secure 0 0 0) 0x564fd86df180 con 0x564fd8685800 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feaba1ee280 4 Got MDS map 88 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feaba1ee280 10 main: JournalTool::main 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.241+0000 7feaba1ee280 4 main: JournalTool: connecting to RADOS... 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feaba1ee280 1 Processor -- start 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feaba1ee280 1 -- start start 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 0x564fd9451080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 0x564fd9451b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feaba1ee280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564fd9468180 con 0x564fd954d800 2024-04-26T22:08:00.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feaba1ee280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564fd86e6480 con 0x564fd954d400 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feaba1ee280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564fd86e6900 con 0x564fd954dc00 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feab899c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feab899c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39266/0 (socket says 172.21.15.137:39266) 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.242+0000 7feab899c640 1 -- 172.21.15.137:0/2123832107 learned_addr learned my addr 172.21.15.137:0/2123832107 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab919d640 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 0x564fd9451080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab819b640 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 0x564fd9451b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab899c640 1 -- 172.21.15.137:0/2123832107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 msgr2=0x564fd9451b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab899c640 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 0x564fd9451b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab899c640 1 -- 172.21.15.137:0/2123832107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 msgr2=0x564fd9451080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab899c640 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 0x564fd9451080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab899c640 1 -- 172.21.15.137:0/2123832107 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd86bb4a0 con 0x564fd954d800 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab919d640 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 0x564fd9451080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:00.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab899c640 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x564fd956e5a0 tx=0x564fd9422ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4e2169ffb09cf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab4193640 1 -- 172.21.15.137:0/2123832107 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564fd86aa9c0 con 0x564fd954d800 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab4193640 1 -- 172.21.15.137:0/2123832107 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564fd86b0c40 con 0x564fd954d800 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feab4193640 1 -- 172.21.15.137:0/2123832107 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564fd86aa680 con 0x564fd954d800 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feaba1ee280 1 -- 172.21.15.137:0/2123832107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 msgr2=0x564fd9451600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x564fd956e5a0 tx=0x564fd9422ae0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feaba1ee280 1 -- 172.21.15.137:0/2123832107 shutdown_connections 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 0x564fd9451b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2123832107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 0x564fd9451080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feaba1ee280 1 -- 172.21.15.137:0/2123832107 >> 172.21.15.137:0/2123832107 conn(0x564fd954d000 msgr2=0x564fd877a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feaba1ee280 1 -- 172.21.15.137:0/2123832107 shutdown_connections 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.243+0000 7feaba1ee280 1 -- 172.21.15.137:0/2123832107 wait complete. 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.244+0000 7feaba1ee280 1 Processor -- start 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.244+0000 7feaba1ee280 1 -- start start 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.244+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 0x564fd9451080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.244+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.244+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 0x564fd9451b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.244+0000 7feaba1ee280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564fd9469200 con 0x564fd954d800 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.244+0000 7feaba1ee280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564fd9468180 con 0x564fd954d400 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.244+0000 7feaba1ee280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564fd9469380 con 0x564fd954dc00 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab899c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab899c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39278/0 (socket says 172.21.15.137:39278) 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab899c640 1 -- 172.21.15.137:0/2118880549 learned_addr learned my addr 172.21.15.137:0/2118880549 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab919d640 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 0x564fd9451080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab819b640 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 0x564fd9451b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab899c640 1 -- 172.21.15.137:0/2118880549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 msgr2=0x564fd9451b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab899c640 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 0x564fd9451b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab899c640 1 -- 172.21.15.137:0/2118880549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 msgr2=0x564fd9451080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab899c640 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 0x564fd9451080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab899c640 1 -- 172.21.15.137:0/2118880549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd86ba780 con 0x564fd954d800 2024-04-26T22:08:00.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab899c640 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x564fd956e8d0 tx=0x564fd9422ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab2990640 1 -- 172.21.15.137:0/2118880549 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564fd86aab60 con 0x564fd954d800 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab2990640 1 -- 172.21.15.137:0/2118880549 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564fd86b01c0 con 0x564fd954d800 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feaba1ee280 1 -- 172.21.15.137:0/2118880549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fd86ba3c0 con 0x564fd954d800 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feab2990640 1 -- 172.21.15.137:0/2118880549 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564fd86aa4e0 con 0x564fd954d800 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feaba1ee280 1 -- 172.21.15.137:0/2118880549 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd86bb680 con 0x564fd954d800 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.245+0000 7feaba1ee280 4 main: JournalTool: resolving pool 16 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.246+0000 7feab2990640 1 -- 172.21.15.137:0/2118880549 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x564fd95ccc00 con 0x564fd954d800 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.247+0000 7feab2990640 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x564fd8a02000 0x564fd9452100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.247+0000 7feab2990640 1 -- 172.21.15.137:0/2118880549 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x564fd95d0600 con 0x564fd954d800 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.247+0000 7feaba1ee280 4 main: JournalTool: creating IoCtx.. 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.247+0000 7feaba1ee280 4 main: Executing for rank 0 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.247+0000 7feab919d640 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x564fd8a02000 0x564fd9452100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.247+0000 7feab919d640 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x564fd8a02000 0x564fd9452100 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x564fd87fedb0 tx=0x564fd9570f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.247+0000 7feaba1ee280 1 -- start start 2024-04-26T22:08:00.253 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.247+0000 7feaba1ee280 1 Processor -- start 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd8a03400 0x564fd9452680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8a03800 0x564fd9452c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feaba1ee280 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8a03c00 0x564fd9453180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feaba1ee280 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x564fd9469680 con 0x564fd8a03c00 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feaba1ee280 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x564fd9469800 con 0x564fd8a03400 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feaba1ee280 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x564fd86e6900 con 0x564fd8a03800 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab819b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8a03c00 0x564fd9453180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab819b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8a03c00 0x564fd9453180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39290/0 (socket says 172.21.15.137:39290) 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab819b640 1 -- 172.21.15.137:0/1306261367 learned_addr learned my addr 172.21.15.137:0/1306261367 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab899c640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8a03800 0x564fd9452c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab919d640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd8a03400 0x564fd9452680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab819b640 1 -- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8a03800 msgr2=0x564fd9452c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab819b640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8a03800 0x564fd9452c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.257 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab819b640 1 -- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd8a03400 msgr2=0x564fd9452680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab819b640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd8a03400 0x564fd9452680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.248+0000 7feab819b640 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd86ba000 con 0x564fd8a03c00 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feab819b640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8a03c00 0x564fd9453180 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x564fd89ad5c0 tx=0x564fd9422240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca141778b1d4d21a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaaf98a640 1 -- 172.21.15.137:0/1306261367 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564fd86aa820 con 0x564fd8a03c00 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaaf98a640 1 -- 172.21.15.137:0/1306261367 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564fd86b0c40 con 0x564fd8a03c00 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaaf98a640 1 -- 172.21.15.137:0/1306261367 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564fd898b860 con 0x564fd8a03c00 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd86ba960 con 0x564fd8a03c00 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x564fd86bb860 con 0x564fd8a03c00 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaba1ee280 4 waiting for MDS map... 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaaf98a640 1 -- 172.21.15.137:0/1306261367 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x564fd8a68600 con 0x564fd8a03c00 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaaf98a640 1 -- 172.21.15.137:0/1306261367 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 88) ==== 2885+0+0 (secure 0 0 0) 0x564fd86df500 con 0x564fd8a03c00 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaba1ee280 4 Got MDS map 88 2024-04-26T22:08:00.258 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564fd8a6b800 0x564fd9453700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:1 16.f 16:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564fd8a6bc00 con 0x564fd8a6b800 2024-04-26T22:08:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.249+0000 7feab919d640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564fd8a6b800 0x564fd9453700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.250+0000 7feab919d640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564fd8a6b800 0x564fd9453700 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=b8d86c1c2de45ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.253+0000 7feab919d640 1 -- 172.21.15.137:0/1306261367 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v117'2 uv2 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564fd9412000 con 0x564fd8a6b800 2024-04-26T22:08:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.253+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:2 16.14 16:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564fd8a82000 con 0x564fd8a6b800 2024-04-26T22:08:00.259 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feab919d640 1 -- 172.21.15.137:0/1306261367 <== osd.0 v2:172.21.15.137:6820/109358669 2 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v117'39 uv39 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564fd9412000 con 0x564fd8a6b800 2024-04-26T22:08:00.259 INFO:teuthology.orchestra.run.smithi137.stdout:writing EResetJournal entry 2024-04-26T22:08:00.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:3 16.14 16:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564fd8a82400 con 0x564fd8a6b800 2024-04-26T22:08:00.261 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x564fd8a82800 0x564fd8a90000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:4 16.1b 16:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564fd8a82c00 con 0x564fd8a82800 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x564fd8a83000 0x564fd8a90580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:5 16.b 16:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564fd8a83400 con 0x564fd8a83000 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:6 16.1f 16:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564fd8a83800 con 0x564fd8a82800 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x564fd8a82000 0x564fd8a90b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:7 16.1a 16:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564fd8a82400 con 0x564fd8a82000 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x564fd8a83c00 0x564fd8a91080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:8 16.1e 16:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564fd8a6bc00 con 0x564fd8a83c00 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feab919d640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x564fd8a83000 0x564fd8a90580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feab899c640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x564fd8a82000 0x564fd8a90b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feab899c640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x564fd8a82800 0x564fd8a90000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feab819b640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x564fd8a83c00 0x564fd8a91080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.262 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.257+0000 7feab919d640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x564fd8a83000 0x564fd8a90580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=227cc8d7d2d8fb77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.258+0000 7feab899c640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x564fd8a82000 0x564fd8a90b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=57a92252637583dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.258+0000 7feab899c640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x564fd8a82800 0x564fd8a90000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=ae13038a0c5163a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.258+0000 7feab819b640 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x564fd8a83c00 0x564fd8a91080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=be37c69686c13b4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.259+0000 7feab899c640 1 -- 172.21.15.137:0/1306261367 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(6 200.00000004 [delete] v117'9 uv8 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564fd9412500 con 0x564fd8a82800 2024-04-26T22:08:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.259+0000 7feab919d640 1 -- 172.21.15.137:0/1306261367 <== osd.0 v2:172.21.15.137:6820/109358669 3 ==== osd_op_reply(3 200.00000001 [delete] v117'40 uv40 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564fd9412000 con 0x564fd8a6b800 2024-04-26T22:08:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.259+0000 7feab819b640 1 -- 172.21.15.137:0/1306261367 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== osd_op_reply(8 200.00000006 [delete] v117'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564fd9412780 con 0x564fd8a83c00 2024-04-26T22:08:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.260+0000 7feab899c640 1 -- 172.21.15.137:0/1306261367 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== osd_op_reply(4 200.00000002 [delete] v117'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564fd9412500 con 0x564fd8a82800 2024-04-26T22:08:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.260+0000 7feab899c640 1 -- 172.21.15.137:0/1306261367 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(7 200.00000005 [delete] v117'3 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564fd9412500 con 0x564fd8a82000 2024-04-26T22:08:00.263 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.260+0000 7feaae187640 1 -- 172.21.15.137:0/1306261367 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:9 16.14 16:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x564fd8aa8000 con 0x564fd8a6b800 2024-04-26T22:08:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feab919d640 1 -- 172.21.15.137:0/1306261367 <== osd.0 v2:172.21.15.137:6820/109358669 4 ==== osd_op_reply(9 200.00000001 [write 0~48] v117'41 uv41 ondisk = 0) ==== 156+0+0 (crc 0 0 0) 0x564fd9412000 con 0x564fd8a6b800 2024-04-26T22:08:00.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feab919d640 1 -- 172.21.15.137:0/1306261367 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(5 200.00000003 [delete] v117'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x564fd9412000 con 0x564fd8a83000 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feaba1ee280 4 Successfully wrote new journal pointer and header for rank 8:0 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564fd8a6b800 msgr2=0x564fd9453700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x564fd8a6b800 0x564fd9453700 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x564fd8a83000 msgr2=0x564fd8a90580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x564fd8a83000 0x564fd8a90580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x564fd8a82000 msgr2=0x564fd8a90b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x564fd8a82000 0x564fd8a90b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feab819b640 1 -- 172.21.15.137:0/1306261367 reap_dead start 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x564fd8a82800 msgr2=0x564fd8a90000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.262+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x564fd8a82800 0x564fd8a90000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x564fd8a83c00 msgr2=0x564fd8a91080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x564fd8a83c00 0x564fd8a91080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8a03c00 msgr2=0x564fd9453180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8a03c00 0x564fd9453180 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x564fd89ad5c0 tx=0x564fd9422240 comp rx=0 tx=0).stop 2024-04-26T22:08:00.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 shutdown_connections 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x564fd8a82800 0x564fd8a90000 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x564fd8a83c00 0x564fd8a91080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/1306261367 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8a03c00 0x564fd9453180 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 >> 172.21.15.137:0/1306261367 conn(0x564fd8a03000 msgr2=0x564fd877a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 shutdown_connections 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/1306261367 wait complete. 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x564fd8a02000 msgr2=0x564fd9452100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x564fd8a02000 0x564fd9452100 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x564fd87fedb0 tx=0x564fd9570f60 comp rx=0 tx=0).stop 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 msgr2=0x564fd9451600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x564fd956e8d0 tx=0x564fd9422ba0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/2118880549 shutdown_connections 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x564fd8a02000 0x564fd9452100 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd954d800 0x564fd9451600 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd954dc00 0x564fd9451b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 --2- 172.21.15.137:0/2118880549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd954d400 0x564fd9451080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/2118880549 >> 172.21.15.137:0/2118880549 conn(0x564fd954d000 msgr2=0x564fd877a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.263+0000 7feaba1ee280 1 -- 172.21.15.137:0/2118880549 shutdown_connections 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 -- 172.21.15.137:0/2118880549 wait complete. 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 -- 172.21.15.137:0/3089078941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8685800 msgr2=0x564fd9450580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8685800 0x564fd9450580 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x564fd94a1800 tx=0x564fd94240c0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 -- 172.21.15.137:0/3089078941 shutdown_connections 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x564fd8685800 0x564fd9450580 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564fd8685c00 0x564fd9450b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 --2- 172.21.15.137:0/3089078941 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x564fd8684c00 0x564fd9450000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 -- 172.21.15.137:0/3089078941 >> 172.21.15.137:0/3089078941 conn(0x564fd8685000 msgr2=0x564fd877b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 -- 172.21.15.137:0/3089078941 shutdown_connections 2024-04-26T22:08:00.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.264+0000 7feaba1ee280 1 -- 172.21.15.137:0/3089078941 wait complete. 2024-04-26T22:08:00.270 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.071428, result: writing EResetJournal entry 2024-04-26T22:08:00.270 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-26T22:08:00.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.345+0000 7f411cc14740 1 -- start start 2024-04-26T22:08:00.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.345+0000 7f411cc14740 1 Processor -- start 2024-04-26T22:08:00.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411cc14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d1ae2c00 0x5638d28b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411cc14740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d1ae3800 0x5638d28b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411cc14740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d1ae3c00 0x5638d28b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411cc14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5638d28ca180 con 0x5638d1ae2c00 2024-04-26T22:08:00.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411cc14740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5638d1b42900 con 0x5638d1ae3c00 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411cc14740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5638d1b42480 con 0x5638d1ae3800 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a8c0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d1ae2c00 0x5638d28b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a8c0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d1ae2c00 0x5638d28b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39308/0 (socket says 172.21.15.137:39308) 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a8c0640 1 -- 172.21.15.137:0/795521500 learned_addr learned my addr 172.21.15.137:0/795521500 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a0bf640 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d1ae3800 0x5638d28b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411b0c1640 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d1ae3c00 0x5638d28b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a8c0640 1 -- 172.21.15.137:0/795521500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d1ae3800 msgr2=0x5638d28b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a8c0640 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d1ae3800 0x5638d28b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a8c0640 1 -- 172.21.15.137:0/795521500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d1ae3c00 msgr2=0x5638d28b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a8c0640 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d1ae3c00 0x5638d28b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a8c0640 1 -- 172.21.15.137:0/795521500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d1b0f680 con 0x5638d1ae2c00 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411b0c1640 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d1ae3c00 0x5638d28b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:00.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f411a8c0640 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d1ae2c00 0x5638d28b2000 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x5638d2909f80 tx=0x5638d288a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b345b8ac7fc0bbe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.346+0000 7f41180bb640 1 -- 172.21.15.137:0/795521500 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5638d1b08680 con 0x5638d1ae2c00 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f41180bb640 1 -- 172.21.15.137:0/795521500 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5638d1b2a1c0 con 0x5638d1ae2c00 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f41180bb640 1 -- 172.21.15.137:0/795521500 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5638d1b08b60 con 0x5638d1ae2c00 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f411cc14740 1 -- 172.21.15.137:0/795521500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d1b0f860 con 0x5638d1ae2c00 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f411cc14740 1 -- 172.21.15.137:0/795521500 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5638d1b0f2c0 con 0x5638d1ae2c00 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f411cc14740 4 waiting for MDS map... 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f41180bb640 1 -- 172.21.15.137:0/795521500 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x5638d29bc600 con 0x5638d1ae2c00 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f41180bb640 1 -- 172.21.15.137:0/795521500 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 88) ==== 2885+0+0 (secure 0 0 0) 0x5638d1b3b180 con 0x5638d1ae2c00 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f411cc14740 4 Got MDS map 88 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f411cc14740 4 datascan.main: Using metadata pool output 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f411cc14740 4 datascan.main: connecting to RADOS... 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f411cc14740 1 Processor -- start 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.347+0000 7f411cc14740 1 -- start start 2024-04-26T22:08:00.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411cc14740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 0x5638d28b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411cc14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411cc14740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 0x5638d28b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411cc14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5638d1b42180 con 0x5638d29bf800 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411cc14740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5638d28cad80 con 0x5638d29bfc00 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411cc14740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5638d28caf00 con 0x5638d29bf400 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a8c0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a8c0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39310/0 (socket says 172.21.15.137:39310) 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a8c0640 1 -- 172.21.15.137:0/3885582793 learned_addr learned my addr 172.21.15.137:0/3885582793 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411b0c1640 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 0x5638d28b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a0bf640 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 0x5638d28b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a8c0640 1 -- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 msgr2=0x5638d28b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a8c0640 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 0x5638d28b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a8c0640 1 -- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 msgr2=0x5638d28b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.356 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a8c0640 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 0x5638d28b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a8c0640 1 -- 172.21.15.137:0/3885582793 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d1b0f4a0 con 0x5638d29bf800 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a0bf640 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 0x5638d28b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411b0c1640 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 0x5638d28b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.348+0000 7f411a8c0640 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x5638d29c1410 tx=0x5638d2886c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa4c9dc38effa6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f41160b7640 1 -- 172.21.15.137:0/3885582793 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5638d1b08820 con 0x5638d29bf800 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f41160b7640 1 -- 172.21.15.137:0/3885582793 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5638d1b2ae00 con 0x5638d29bf800 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f41160b7640 1 -- 172.21.15.137:0/3885582793 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5638d1b08680 con 0x5638d29bf800 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f411cc14740 1 -- 172.21.15.137:0/3885582793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 msgr2=0x5638d28b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f411cc14740 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x5638d29c1410 tx=0x5638d2886c00 comp rx=0 tx=0).stop 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f411cc14740 1 -- 172.21.15.137:0/3885582793 shutdown_connections 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f411cc14740 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f411cc14740 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 0x5638d28b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f411cc14740 1 --2- 172.21.15.137:0/3885582793 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 0x5638d28b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f411cc14740 1 -- 172.21.15.137:0/3885582793 >> 172.21.15.137:0/3885582793 conn(0x5638d29bf000 msgr2=0x5638d1bd3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.357 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f411cc14740 1 -- 172.21.15.137:0/3885582793 shutdown_connections 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.349+0000 7f411cc14740 1 -- 172.21.15.137:0/3885582793 wait complete. 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411cc14740 1 Processor -- start 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411cc14740 1 -- start start 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411cc14740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 0x5638d28b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411cc14740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411cc14740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 0x5638d28b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411cc14740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5638d28cb200 con 0x5638d29bf800 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411cc14740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5638d28cb080 con 0x5638d29bfc00 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411cc14740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5638d28cb380 con 0x5638d29bf400 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411a8c0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411a8c0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39314/0 (socket says 172.21.15.137:39314) 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 learned_addr learned my addr 172.21.15.137:0/4098651974 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 0x5638d28b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.350+0000 7f411a0bf640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 0x5638d28b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 msgr2=0x5638d28b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411a8c0640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 0x5638d28b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 msgr2=0x5638d28b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411a8c0640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 0x5638d28b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d1b0f680 con 0x5638d29bf800 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d29bf400 0x5638d28b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411a0bf640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d29bfc00 0x5638d28b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411a8c0640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x5638d2a36090 tx=0x5638d28cec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f41148b4640 1 -- 172.21.15.137:0/4098651974 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5638d1b08b60 con 0x5638d29bf800 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f41148b4640 1 -- 172.21.15.137:0/4098651974 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5638d1b2ac40 con 0x5638d29bf800 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638d1b0f860 con 0x5638d29bf800 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f41148b4640 1 -- 172.21.15.137:0/4098651974 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5638d1b084e0 con 0x5638d29bf800 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d1b0f0e0 con 0x5638d29bf800 2024-04-26T22:08:00.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.351+0000 7f411cc14740 4 datascan.init: resolving metadata pool 16 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.352+0000 7f41148b4640 1 -- 172.21.15.137:0/4098651974 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x5638d2a32c00 con 0x5638d29bf800 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.352+0000 7f41148b4640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5638d2a31000 0x5638d28b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.352+0000 7f41148b4640 1 -- 172.21.15.137:0/4098651974 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x5638d2a38600 con 0x5638d29bf800 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.352+0000 7f411cc14740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.352+0000 7f411cc14740 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.352+0000 7f411cc14740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.352+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5638d2a31000 0x5638d28b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.352+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5638d2a31400 0x5638d28b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.352+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a31800 con 0x5638d2a31400 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.353+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5638d2a31000 0x5638d28b4100 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x5638d2888750 tx=0x5638d2886480 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.353+0000 7f411a0bf640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5638d2a31400 0x5638d28b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.353+0000 7f411a0bf640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5638d2a31400 0x5638d28b4680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.354+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== osd_op_reply(1 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.354+0000 7f41158b6640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5638d28e8000 0x5638d28ee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.354+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:2 17.20 17:04000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e8400 con 0x5638d28e8000 2024-04-26T22:08:00.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.354+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5638d28e8000 0x5638d28ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.354+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5638d28e8000 0x5638d28ee000 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.354+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(2 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d28e8000 2024-04-26T22:08:00.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.354+0000 7f41160b7640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5638d28e8c00 0x5638d28ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.354+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:3 17.10 17:08000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9000 con 0x5638d28e8c00 2024-04-26T22:08:00.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.354+0000 7f411a8c0640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5638d28e8c00 0x5638d28ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.355+0000 7f411a8c0640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5638d28e8c00 0x5638d28ee580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.355+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(3 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.355+0000 7f41158b6640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5638d28e8800 0x5638d28eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.355+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:4 17.30 17:0c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9800 con 0x5638d28e8800 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.355+0000 7f411a0bf640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5638d28e8800 0x5638d28eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.355+0000 7f411a0bf640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5638d28e8800 0x5638d28eeb00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.355+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(4 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.356+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:5 17.8 17:10000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9400 con 0x5638d2a31400 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.356+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 2 ==== osd_op_reply(5 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.356+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:6 17.28 17:14000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9c00 con 0x5638d28e8c00 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.356+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 2 ==== osd_op_reply(6 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.356+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:7 17.18 17:18000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9800 con 0x5638d28e8800 2024-04-26T22:08:00.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.357+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 2 ==== osd_op_reply(7 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.357+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:8 17.38 17:1c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82000 con 0x5638d2a31400 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.357+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 3 ==== osd_op_reply(8 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.357+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:9 17.4 17:20000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a31800 con 0x5638d28e8800 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.357+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 3 ==== osd_op_reply(9 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.357+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:10 17.24 17:24000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82400 con 0x5638d28e8c00 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.357+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 3 ==== osd_op_reply(10 [pgnls start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.357+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:11 17.14 17:28000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82000 con 0x5638d28e8c00 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.358+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 4 ==== osd_op_reply(11 [pgnls start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.358+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:12 17.34 17:2c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82800 con 0x5638d28e8800 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.358+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 4 ==== osd_op_reply(12 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.358+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:13 17.c 17:30000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e83000 con 0x5638d2a31400 2024-04-26T22:08:00.374 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.358+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 4 ==== osd_op_reply(13 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.358+0000 7f41158b6640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5638d1e82c00 0x5638d28ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.358+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:14 17.2c 17:34000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82400 con 0x5638d1e82c00 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.358+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5638d1e82c00 0x5638d28ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.359+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5638d1e82c00 0x5638d28ef080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.361+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(14 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.361+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:15 17.1c 17:38000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9400 con 0x5638d28e8000 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.362+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.1 v2:172.21.15.137:6800/757189714 2 ==== osd_op_reply(15 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d28e8000 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.362+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:16 17.3c 17:3c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9000 con 0x5638d28e8800 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.362+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 5 ==== osd_op_reply(16 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.362+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:17 17.2 17:40000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9800 con 0x5638d1e82c00 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.362+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== osd_op_reply(17 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.362+0000 7f41158b6640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5638d28e9c00 0x5638d28ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.362+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:18 17.22 17:44000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a30c00 con 0x5638d28e9c00 2024-04-26T22:08:00.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.362+0000 7f411a8c0640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5638d28e9c00 0x5638d28ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.363+0000 7f411a8c0640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5638d28e9c00 0x5638d28ef600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.363+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(18 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e9c00 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.363+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:19 17.12 17:48000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9000 con 0x5638d28e8c00 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.363+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 5 ==== osd_op_reply(19 [pgnls start_epoch 117 out=81b] v116'22 uv22 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.363+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:20 17.12 17:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a31c00 con 0x5638d28e8c00 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.364+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 6 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.364+0000 7f411cc14740 10 datascan.operator(): handling object 1099511627778.0 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.364+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:21 17.12 17:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82800 con 0x5638d28e8c00 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.365+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 7 ==== osd_op_reply(21 10000000002.00000000 [call] v117'23 uv23 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.365+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:22 17.32 17:4c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e83000 con 0x5638d2a31400 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.365+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 5 ==== osd_op_reply(22 [pgnls start_epoch 117 out=49b] v115'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.365+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:23 17.a 17:50000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e8400 con 0x5638d2a31400 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.366+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 6 ==== osd_op_reply(23 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.366+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:24 17.2a 17:54000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a30800 con 0x5638d28e8c00 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.366+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 8 ==== osd_op_reply(24 [pgnls start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.366+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:25 17.1a 17:58000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28d1400 con 0x5638d28e8800 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.366+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 6 ==== osd_op_reply(25 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.366+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:26 17.3a 17:5c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e83800 con 0x5638d28e8000 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.366+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.1 v2:172.21.15.137:6800/757189714 3 ==== osd_op_reply(26 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d28e8000 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.366+0000 7f41160b7640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5638d28d1000 0x5638d28f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.366+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:27 17.6 17:60000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a31800 con 0x5638d28d1000 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.367+0000 7f411a0bf640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5638d28d1000 0x5638d28f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.367+0000 7f411a0bf640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5638d28d1000 0x5638d28f0680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.367+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(27 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28d1000 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.367+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:28 17.26 17:64000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e83c00 con 0x5638d28e8800 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.368+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 7 ==== osd_op_reply(28 [pgnls start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.368+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:29 17.16 17:68000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e83000 con 0x5638d28e9c00 2024-04-26T22:08:00.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.368+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== osd_op_reply(29 [pgnls start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e9c00 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.368+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:30 17.36 17:6c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea6000 con 0x5638d28e8800 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.368+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 8 ==== osd_op_reply(30 [pgnls start_epoch 117 out=81b] v115'33 uv17 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.368+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:31 17.36 17:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82400 con 0x5638d28e8800 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.369+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 9 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.369+0000 7f411cc14740 10 datascan.operator(): handling object 1099511628279.0 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.369+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:32 17.36 17:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82000 con 0x5638d28e8800 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.370+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 10 ==== osd_op_reply(32 100000001f7.00000000 [call] v117'34 uv34 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.370+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5638d1e83400 0x5638d28b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.370+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:33 17.e 17:70000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9400 con 0x5638d1e83400 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.370+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5638d1e83400 0x5638d28b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.370+0000 7f411b0c1640 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5638d1e83400 0x5638d28b4c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.370+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== osd_op_reply(33 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e83400 2024-04-26T22:08:00.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.370+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:34 17.2e 17:74000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea6400 con 0x5638d28d1000 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.371+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.6 v2:172.21.15.170:6800/3855301024 2 ==== osd_op_reply(34 [pgnls start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28d1000 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.371+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:35 17.1e 17:78000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e83c00 con 0x5638d28e8000 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.371+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.1 v2:172.21.15.137:6800/757189714 4 ==== osd_op_reply(35 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d28e8000 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.371+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:36 17.3e 17:7c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea6800 con 0x5638d1e82c00 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.371+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 3 ==== osd_op_reply(36 [pgnls start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.372+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:37 17.1 17:80000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a31800 con 0x5638d28e8800 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.372+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 11 ==== osd_op_reply(37 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.372+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:38 17.21 17:84000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea6c00 con 0x5638d28e8800 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.372+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 12 ==== osd_op_reply(38 [pgnls start_epoch 117 out=49b] v115'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.372+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:39 17.11 17:88000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28d1400 con 0x5638d28e8c00 2024-04-26T22:08:00.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.372+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 9 ==== osd_op_reply(39 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.372+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:40 17.31 17:8c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea7000 con 0x5638d28e8000 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.373+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.1 v2:172.21.15.137:6800/757189714 5 ==== osd_op_reply(40 [pgnls start_epoch 117 out=81b] v115'15 uv8 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5638d286e500 con 0x5638d28e8000 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.373+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:41 17.31 17:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e83800 con 0x5638d28e8000 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.373+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.1 v2:172.21.15.137:6800/757189714 6 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5638d286e500 con 0x5638d28e8000 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.373+0000 7f411cc14740 10 datascan.operator(): handling object 1099511627780.1 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.373+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:42 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e83c00 con 0x5638d28d1000 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.374+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.6 v2:172.21.15.170:6800/3855301024 3 ==== osd_op_reply(42 10000000004.00000000 [call] v117'14 uv14 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5638d286e000 con 0x5638d28d1000 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.374+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:43 17.9 17:90000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82800 con 0x5638d28e8c00 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.375+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 10 ==== osd_op_reply(43 [pgnls start_epoch 117 out=49b] v115'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.375+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:44 17.29 17:94000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea7400 con 0x5638d1e82c00 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.375+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 4 ==== osd_op_reply(44 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.375+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:45 17.19 17:98000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e8400 con 0x5638d28e9c00 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.375+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.5 v2:172.21.15.170:6808/205812566 3 ==== osd_op_reply(45 [pgnls start_epoch 117 out=81b] v116'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e9c00 2024-04-26T22:08:00.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.375+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:46 17.19 17:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5638d28d1400 con 0x5638d28e9c00 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.376+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.5 v2:172.21.15.170:6808/205812566 4 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e9c00 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.376+0000 7f411cc14740 10 datascan.operator(): handling object 1099511628280.0 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.376+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:47 17.19 17:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9800 con 0x5638d28e9c00 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.377+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.5 v2:172.21.15.170:6808/205812566 5 ==== osd_op_reply(47 100000001f8.00000000 [call] v117'24 uv24 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e9c00 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.377+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:48 17.39 17:9c000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9400 con 0x5638d28e9c00 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.377+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.5 v2:172.21.15.170:6808/205812566 6 ==== osd_op_reply(48 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e9c00 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.377+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:49 17.5 17:a0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a30c00 con 0x5638d28d1000 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.378+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.6 v2:172.21.15.170:6800/3855301024 4 ==== osd_op_reply(49 [pgnls start_epoch 117 out=81b] v117'14 uv14 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5638d286e000 con 0x5638d28d1000 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.378+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:50 17.5 17:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9000 con 0x5638d28d1000 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.378+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.6 v2:172.21.15.170:6800/3855301024 5 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) ==== 164+0+16 (crc 0 0 0) 0x5638d286e000 con 0x5638d28d1000 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.378+0000 7f411cc14740 10 datascan.operator(): handling object 1099511627780.0 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.378+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:51 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea6800 con 0x5638d28d1000 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.380+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.6 v2:172.21.15.170:6800/3855301024 6 ==== osd_op_reply(51 10000000004.00000000 [call] v117'15 uv15 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5638d286e000 con 0x5638d28d1000 2024-04-26T22:08:00.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.380+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:52 17.25 17:a4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea7000 con 0x5638d28e8000 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.380+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.1 v2:172.21.15.137:6800/757189714 7 ==== osd_op_reply(52 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d28e8000 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.380+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:53 17.15 17:a8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a31c00 con 0x5638d28e9c00 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.380+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.5 v2:172.21.15.170:6808/205812566 7 ==== osd_op_reply(53 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e9c00 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.380+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:54 17.35 17:ac000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea7800 con 0x5638d1e82c00 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.381+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 5 ==== osd_op_reply(54 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.381+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:55 17.d 17:b0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a30800 con 0x5638d2a31400 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.381+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 7 ==== osd_op_reply(55 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.381+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:56 17.2d 17:b4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1eb0000 con 0x5638d2a31400 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.381+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 8 ==== osd_op_reply(56 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.381+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:57 17.1d 17:b8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a31800 con 0x5638d2a31400 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.381+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 9 ==== osd_op_reply(57 [pgnls start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.381+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:58 17.3d 17:bc000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1eb0400 con 0x5638d2a31400 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.382+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 10 ==== osd_op_reply(58 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.382+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:59 17.3 17:c0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e83000 con 0x5638d1e82c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.382+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 6 ==== osd_op_reply(59 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.382+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:60 17.23 17:c4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1eb0800 con 0x5638d1e82c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.382+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 7 ==== osd_op_reply(60 [pgnls start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.382+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:61 17.13 17:c8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82400 con 0x5638d28e8c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.383+0000 7f411a8c0640 1 -- 172.21.15.137:0/4098651974 <== osd.3 v2:172.21.15.137:6808/492121506 11 ==== osd_op_reply(61 [pgnls start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e780 con 0x5638d28e8c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.383+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:62 17.33 17:cc000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1eb0c00 con 0x5638d2a31400 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.383+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.7 v2:172.21.15.170:6816/3085321649 11 ==== osd_op_reply(62 [pgnls start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d2a31400 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.383+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:63 17.b 17:d0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1e82000 con 0x5638d28e8800 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.383+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 13 ==== osd_op_reply(63 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.383+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:64 17.2b 17:d4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1eb1000 con 0x5638d1e82c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.384+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 8 ==== osd_op_reply(64 [pgnls start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.384+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:65 17.1b 17:d8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea7400 con 0x5638d1e82c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.384+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 9 ==== osd_op_reply(65 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.384+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:66 17.3b 17:dc000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1eb1400 con 0x5638d1e83400 2024-04-26T22:08:00.392 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.384+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.2 v2:172.21.15.137:6816/1304816807 2 ==== osd_op_reply(66 [pgnls start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e83400 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.384+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:67 17.7 17:e0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea7000 con 0x5638d28e8800 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.384+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 14 ==== osd_op_reply(67 [pgnls start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.384+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:68 17.27 17:e4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1eb1800 con 0x5638d1e82c00 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.385+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 10 ==== osd_op_reply(68 [pgnls start_epoch 117 out=49b] v115'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.385+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:69 17.17 17:e8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea7800 con 0x5638d28d1000 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.385+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.6 v2:172.21.15.170:6800/3855301024 7 ==== osd_op_reply(69 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28d1000 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.385+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:70 17.37 17:ec000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1eb1c00 con 0x5638d28e8800 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.385+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 15 ==== osd_op_reply(70 [pgnls start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.385+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:71 17.f 17:f0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d1ea6800 con 0x5638d28e8000 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.386+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.1 v2:172.21.15.137:6800/757189714 8 ==== osd_op_reply(71 [pgnls start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d28e8000 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.386+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:72 17.2f 17:f4000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a30c00 con 0x5638d1e82c00 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.386+0000 7f411b0c1640 1 -- 172.21.15.137:0/4098651974 <== osd.4 v2:172.21.15.170:6824/2080414701 11 ==== osd_op_reply(72 [pgnls start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e500 con 0x5638d1e82c00 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.386+0000 7f41160b7640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:73 17.1f 17:f8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d28e9000 con 0x5638d28d1000 2024-04-26T22:08:00.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.386+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.6 v2:172.21.15.170:6800/3855301024 8 ==== osd_op_reply(73 [pgnls start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28d1000 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.386+0000 7f41158b6640 1 -- 172.21.15.137:0/4098651974 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:74 17.3f 17:fc000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5638d2a30800 con 0x5638d28e8800 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 <== osd.0 v2:172.21.15.137:6820/109358669 16 ==== osd_op_reply(74 [pgnls start_epoch 117 out=49b] v115'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5638d286e000 con 0x5638d28e8800 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5638d28e8800 msgr2=0x5638d28eeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5638d28e8800 0x5638d28eeb00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5638d28e8000 msgr2=0x5638d28ee000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5638d28e8000 0x5638d28ee000 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5638d1e83400 msgr2=0x5638d28b4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5638d1e83400 0x5638d28b4c00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5638d28e8c00 msgr2=0x5638d28ee580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5638d28e8c00 0x5638d28ee580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 reap_dead start 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5638d1e82c00 msgr2=0x5638d28ef080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5638d1e82c00 0x5638d28ef080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.394 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5638d28e9c00 msgr2=0x5638d28ef600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5638d28e9c00 0x5638d28ef600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5638d28d1000 msgr2=0x5638d28f0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5638d28d1000 0x5638d28f0680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5638d2a31400 msgr2=0x5638d28b4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5638d2a31400 0x5638d28b4680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411a0bf640 1 -- 172.21.15.137:0/4098651974 reap_dead start 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5638d2a31000 msgr2=0x5638d28b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5638d2a31000 0x5638d28b4100 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x5638d2888750 tx=0x5638d2886480 comp rx=0 tx=0).stop 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 msgr2=0x5638d28b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x5638d2a36090 tx=0x5638d28cec00 comp rx=0 tx=0).stop 2024-04-26T22:08:00.395 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 shutdown_connections 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5638d2a31000 0x5638d28b4100 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/4098651974 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d29bf800 0x5638d28b3600 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 >> 172.21.15.137:0/4098651974 conn(0x5638d29bf000 msgr2=0x5638d1bd3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 shutdown_connections 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/4098651974 wait complete. 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/795521500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d1ae2c00 msgr2=0x5638d28b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d1ae2c00 0x5638d28b2000 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x5638d2909f80 tx=0x5638d288a0c0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/795521500 shutdown_connections 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5638d1ae3c00 0x5638d28b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5638d1ae3800 0x5638d28b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 --2- 172.21.15.137:0/795521500 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5638d1ae2c00 0x5638d28b2000 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/795521500 >> 172.21.15.137:0/795521500 conn(0x5638d1ae3000 msgr2=0x5638d1bd2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/795521500 shutdown_connections 2024-04-26T22:08:00.396 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.387+0000 7f411cc14740 1 -- 172.21.15.137:0/795521500 wait complete. 2024-04-26T22:08:00.397 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.127631, result: 2024-04-26T22:08:00.398 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-04-26T22:08:00.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffcc15740 1 -- start start 2024-04-26T22:08:00.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffcc15740 1 Processor -- start 2024-04-26T22:08:00.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffcc15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cbf40c00 0x55e2cccba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffcc15740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cbf41800 0x55e2cccba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffcc15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cbf41c00 0x55e2cccbab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffcc15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e2cccbe180 con 0x55e2cbf41c00 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffcc15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbfa0900 con 0x55e2cbf40c00 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffcc15740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e2cbfa0480 con 0x55e2cbf41800 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffb10f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cbf41c00 0x55e2cccbab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffb10f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cbf41c00 0x55e2cccbab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39320/0 (socket says 172.21.15.137:39320) 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffb10f640 1 -- 172.21.15.137:0/3806019374 learned_addr learned my addr 172.21.15.137:0/3806019374 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/3806019374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cbf41800 0x55e2cccba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.478+0000 7f1ffa90e640 1 --2- 172.21.15.137:0/3806019374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cbf40c00 0x55e2cccba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffb10f640 1 -- 172.21.15.137:0/3806019374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cbf41800 msgr2=0x55e2cccba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffb10f640 1 --2- 172.21.15.137:0/3806019374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cbf41800 0x55e2cccba580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffb10f640 1 -- 172.21.15.137:0/3806019374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cbf40c00 msgr2=0x55e2cccba000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffb10f640 1 --2- 172.21.15.137:0/3806019374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cbf40c00 0x55e2cccba000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffb10f640 1 -- 172.21.15.137:0/3806019374 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbf6d680 con 0x55e2cbf41c00 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffb10f640 1 --2- 172.21.15.137:0/3806019374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cbf41c00 0x55e2cccbab00 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x55e2ccd69440 tx=0x55e2ccce4ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b788762ce1edf975 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ff8109640 1 -- 172.21.15.137:0/3806019374 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e2cbf669c0 con 0x55e2cbf41c00 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ff8109640 1 -- 172.21.15.137:0/3806019374 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e2cbf881c0 con 0x55e2cbf41c00 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffcc15740 1 -- 172.21.15.137:0/3806019374 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2cbf6d860 con 0x55e2cbf41c00 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ff8109640 1 -- 172.21.15.137:0/3806019374 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e2cbf66680 con 0x55e2cbf41c00 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffcc15740 1 -- 172.21.15.137:0/3806019374 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x55e2cbf6d2c0 con 0x55e2cbf41c00 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffcc15740 4 waiting for MDS map... 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ff8109640 1 -- 172.21.15.137:0/3806019374 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x55e2cce1e600 con 0x55e2cbf41c00 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ff8109640 1 -- 172.21.15.137:0/3806019374 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 88) ==== 2885+0+0 (secure 0 0 0) 0x55e2cbf99180 con 0x55e2cbf41c00 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffcc15740 4 Got MDS map 88 2024-04-26T22:08:00.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffcc15740 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffcc15740 4 datascan.main: Using metadata pool output 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.479+0000 7f1ffcc15740 4 datascan.main: connecting to RADOS... 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.480+0000 7f1ffcc15740 1 Processor -- start 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.480+0000 7f1ffcc15740 1 -- start start 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.480+0000 7f1ffcc15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.480+0000 7f1ffcc15740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cce7c400 0x55e2cccbb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.480+0000 7f1ffcc15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c800 0x55e2cccbbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.480+0000 7f1ffcc15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e2cbfa0180 con 0x55e2cce7c800 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.480+0000 7f1ffcc15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e2cccbed80 con 0x55e2cce7c000 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.480+0000 7f1ffcc15740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e2cccbef00 con 0x55e2cce7c400 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c800 0x55e2cccbbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c800 0x55e2cccbbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39334/0 (socket says 172.21.15.137:39334) 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 -- 172.21.15.137:0/654004989 learned_addr learned my addr 172.21.15.137:0/654004989 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.488 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa90e640 1 --2- 172.21.15.137:0/654004989 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cce7c400 0x55e2cccbb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/654004989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 -- 172.21.15.137:0/654004989 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cce7c400 msgr2=0x55e2cccbb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/654004989 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cce7c400 0x55e2cccbb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 -- 172.21.15.137:0/654004989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cce7c000 msgr2=0x55e2cccbb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/654004989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 -- 172.21.15.137:0/654004989 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbf6d4a0 con 0x55e2cce7c800 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/654004989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c800 0x55e2cccbbb80 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x55e2ccd2f080 tx=0x55e2cce2ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55dcf218e1f5f1f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ff6105640 1 -- 172.21.15.137:0/654004989 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e2cbf669c0 con 0x55e2cce7c800 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ff6105640 1 -- 172.21.15.137:0/654004989 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e2cbf88c40 con 0x55e2cce7c800 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.481+0000 7f1ff6105640 1 -- 172.21.15.137:0/654004989 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e2cbf66680 con 0x55e2cce7c800 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 -- 172.21.15.137:0/654004989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c800 msgr2=0x55e2cccbbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/654004989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c800 0x55e2cccbbb80 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x55e2ccd2f080 tx=0x55e2cce2ccc0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 -- 172.21.15.137:0/654004989 shutdown_connections 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/654004989 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c800 0x55e2cccbbb80 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/654004989 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cce7c400 0x55e2cccbb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/654004989 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 -- 172.21.15.137:0/654004989 >> 172.21.15.137:0/654004989 conn(0x55e2ccce3c00 msgr2=0x55e2cc031000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 -- 172.21.15.137:0/654004989 shutdown_connections 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 -- 172.21.15.137:0/654004989 wait complete. 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 Processor -- start 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.482+0000 7f1ffcc15740 1 -- start start 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffcc15740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffcc15740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cce7c400 0x55e2cccbb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffcc15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cce7c800 0x55e2cccbbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffcc15740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55e2cccbf200 con 0x55e2cce7c000 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffcc15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55e2cccbf080 con 0x55e2cce7c800 2024-04-26T22:08:00.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffcc15740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55e2cccbf380 con 0x55e2cce7c400 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39350/0 (socket says 172.21.15.137:39350) 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 learned_addr learned my addr 172.21.15.137:0/1401184877 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa90e640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cce7c400 0x55e2cccbb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cce7c800 0x55e2cccbbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cce7c400 msgr2=0x55e2cccbb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cce7c400 0x55e2cccbb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cce7c800 msgr2=0x55e2cccbbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cce7c800 0x55e2cccbbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2cbf6d0e0 con 0x55e2cce7c000 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x55e2ccd2fd40 tx=0x55e2ccce4720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ff4902640 1 -- 172.21.15.137:0/1401184877 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e2cbf664e0 con 0x55e2cce7c000 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ff4902640 1 -- 172.21.15.137:0/1401184877 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e2cbf88540 con 0x55e2cce7c000 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2cbf6da40 con 0x55e2cce7c000 2024-04-26T22:08:00.491 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ff4902640 1 -- 172.21.15.137:0/1401184877 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e2cbf669c0 con 0x55e2cce7c000 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2cbf6c3c0 con 0x55e2cce7c000 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.483+0000 7f1ffcc15740 4 datascan.init: resolving metadata pool 16 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ff4902640 1 -- 172.21.15.137:0/1401184877 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x55e2ccea6c00 con 0x55e2cce7c000 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ff4902640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55e2cc2d8000 0x55e2cccbc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ff4902640 1 -- 172.21.15.137:0/1401184877 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x55e2ccea4a00 con 0x55e2cce7c000 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ffcc15740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ffa90e640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55e2cc2d8000 0x55e2cccbc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ffcc15740 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ffcc15740 4 datascan.main: opening data pool 'cephfs_data' 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55e2cce7cc00 0x55e2cccbc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:1 16.14 16:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x55e2cce7d000 con 0x55e2cce7cc00 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55e2cce7cc00 0x55e2cccbc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.492 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ffa90e640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55e2cc2d8000 0x55e2cccbc100 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55e2ccce7110 tx=0x55e2cce2cea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.485+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55e2cce7cc00 0x55e2cccbc680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.486+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv34 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.486+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55e2cc2d9000 0x55e2cccbcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.486+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:2 16.1f 16:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2d9400 con 0x55e2cc2d9000 2024-04-26T22:08:00.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.486+0000 7f1ffb10f640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55e2cc2d9000 0x55e2cccbcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.486+0000 7f1ffb10f640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55e2cc2d9000 0x55e2cccbcc00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.487+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) ==== 162+0+16 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2d9000 2024-04-26T22:08:00.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.487+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55e2cc2d9800 0x55e2cccbd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.487+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:3 17.0 17:00000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2d9c00 con 0x55e2cc2d9800 2024-04-26T22:08:00.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.487+0000 7f1ffa90e640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55e2cc2d9800 0x55e2cccbd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.487+0000 7f1ffa90e640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55e2cc2d9800 0x55e2cccbd180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.488+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.488+0000 7f1ff5904640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55e2cc2fa000 0x55e2cc300000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.509 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.488+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:4 17.20 17:04000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fa400 con 0x55e2cc2fa000 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.488+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55e2cc2fa000 0x55e2cc300000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.488+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55e2cc2fa000 0x55e2cc300000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.488+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc2fa000 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.488+0000 7f1ff6105640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55e2cc2fac00 0x55e2cc300580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.488+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:5 17.10 17:08000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb000 con 0x55e2cc2fac00 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.489+0000 7f1ffb10f640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55e2cc2fac00 0x55e2cc300580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.489+0000 7f1ffb10f640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55e2cc2fac00 0x55e2cc300580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.489+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.489+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:6 17.30 17:0c000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fa800 con 0x55e2cce7cc00 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.489+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.489+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:7 17.8 17:10000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb400 con 0x55e2cc2d9800 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.490+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.510 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.490+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:8 17.28 17:14000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb800 con 0x55e2cc2fac00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.490+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.490+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:9 17.18 17:18000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306000 con 0x55e2cce7cc00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.490+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 3 ==== osd_op_reply(9 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.490+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:10 17.38 17:1c000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fbc00 con 0x55e2cc2d9800 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.491+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.491+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:11 17.4 17:20000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306400 con 0x55e2cce7cc00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.491+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.491+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:12 17.24 17:24000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb400 con 0x55e2cc2fac00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.491+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.491+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:13 17.14 17:28000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306800 con 0x55e2cc2fac00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.491+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 4 ==== osd_op_reply(13 [pgnls-filter start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.491+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:14 17.34 17:2c000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cce7d000 con 0x55e2cce7cc00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.492+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.511 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.492+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:15 17.c 17:30000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb000 con 0x55e2cc2d9800 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.492+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 4 ==== osd_op_reply(15 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.492+0000 7f1ff5904640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55e2cc2d8c00 0x55e2cc300b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.492+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:16 17.2c 17:34000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2d9c00 con 0x55e2cc2d8c00 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.492+0000 7f1ffa90e640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55e2cc2d8c00 0x55e2cc300b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.493+0000 7f1ffa90e640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55e2cc2d8c00 0x55e2cc300b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.493+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.493+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:17 17.1c 17:38000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb800 con 0x55e2cc2fa000 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.493+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.1 v2:172.21.15.137:6800/757189714 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc2fa000 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.493+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:18 17.3c 17:3c000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306800 con 0x55e2cce7cc00 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.494+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 6 ==== osd_op_reply(18 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.494+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:19 17.2 17:40000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb400 con 0x55e2cc2d8c00 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.494+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.494+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:20 17.22 17:44000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306000 con 0x55e2cc2d9000 2024-04-26T22:08:00.512 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.494+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2d9000 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.494+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:21 17.12 17:48000000::::head [pgnls-filter start_epoch 117 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2d9400 con 0x55e2cc2fac00 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.495+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 5 ==== osd_op_reply(21 [pgnls-filter start_epoch 117 out=81b] v117'23 uv23 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.495+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:22 17.0 17:00000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306c00 con 0x55e2cc2d9800 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.495+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.495+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:23 17.20 17:04000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc308000 con 0x55e2cc2fa000 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.495+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.1 v2:172.21.15.137:6800/757189714 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc2fa000 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.495+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:24 17.10 17:08000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fbc00 con 0x55e2cc2fac00 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.496+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 6 ==== osd_op_reply(24 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.496+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:25 17.30 17:0c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc308400 con 0x55e2cce7cc00 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.496+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.496+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:26 17.8 17:10000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fa400 con 0x55e2cc2d9800 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.496+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 6 ==== osd_op_reply(26 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.496+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:27 17.28 17:14000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc308800 con 0x55e2cc2fac00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.496+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 7 ==== osd_op_reply(27 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.496+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:28 17.18 17:18000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fa800 con 0x55e2cce7cc00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.497+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 8 ==== osd_op_reply(28 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.497+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:29 17.38 17:1c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc308c00 con 0x55e2cc2d9800 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.497+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 7 ==== osd_op_reply(29 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.497+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:30 17.4 17:20000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb000 con 0x55e2cce7cc00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.497+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 9 ==== osd_op_reply(30 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.497+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:31 17.24 17:24000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc309000 con 0x55e2cc2fac00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.497+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 8 ==== osd_op_reply(31 [pgnls-filter start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.497+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:32 17.14 17:28000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb400 con 0x55e2cc2fac00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.498+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 9 ==== osd_op_reply(32 [pgnls-filter start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.498+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:33 17.34 17:2c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306000 con 0x55e2cce7cc00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.498+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 10 ==== osd_op_reply(33 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.498+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:34 17.c 17:30000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fa400 con 0x55e2cc2d9800 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.498+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 8 ==== osd_op_reply(34 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.498+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:35 17.2c 17:34000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306c00 con 0x55e2cc2d8c00 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.499+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.499+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:36 17.1c 17:38000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb800 con 0x55e2cc2fa000 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.499+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.1 v2:172.21.15.137:6800/757189714 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc2fa000 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.499+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:37 17.3c 17:3c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306400 con 0x55e2cce7cc00 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.499+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 11 ==== osd_op_reply(37 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.499+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:38 17.2 17:40000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cce7d000 con 0x55e2cc2d8c00 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.499+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.499+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:39 17.22 17:44000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fbc00 con 0x55e2cc2d9000 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.500+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.5 v2:172.21.15.170:6808/205812566 3 ==== osd_op_reply(39 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2d9000 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.500+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:40 17.12 17:48000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2d9c00 con 0x55e2cc2fac00 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.500+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 10 ==== osd_op_reply(40 [pgnls-filter start_epoch 117 out=49b] v117'23 uv23 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.500+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:41 17.32 17:4c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb400 con 0x55e2cc2d9800 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.500+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 9 ==== osd_op_reply(41 [pgnls-filter start_epoch 117 out=49b] v115'15 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.500+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:42 17.a 17:50000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc308400 con 0x55e2cc2d9800 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.501+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 10 ==== osd_op_reply(42 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.501+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:43 17.2a 17:54000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2d9400 con 0x55e2cc2fac00 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.501+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 11 ==== osd_op_reply(43 [pgnls-filter start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.501+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:44 17.1a 17:58000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306000 con 0x55e2cce7cc00 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.501+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 12 ==== osd_op_reply(44 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.501+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:45 17.3a 17:5c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fa400 con 0x55e2cc2fa000 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.501+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.1 v2:172.21.15.137:6800/757189714 5 ==== osd_op_reply(45 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc2fa000 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.501+0000 7f1ff5904640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55e2cc306400 0x55e2cc301080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.501+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:46 17.6 17:60000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306800 con 0x55e2cc306400 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.502+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55e2cc306400 0x55e2cc301080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.502+0000 7f1ffa10d640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55e2cc306400 0x55e2cc301080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.502+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(46 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc306400 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.502+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:47 17.26 17:64000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb400 con 0x55e2cce7cc00 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.502+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 13 ==== osd_op_reply(47 [pgnls-filter start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.502+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:48 17.16 17:68000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fa800 con 0x55e2cc2d9000 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.5 v2:172.21.15.170:6808/205812566 4 ==== osd_op_reply(48 [pgnls-filter start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2d9000 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:49 17.36 17:6c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cce7d000 con 0x55e2cce7cc00 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 14 ==== osd_op_reply(49 [pgnls-filter start_epoch 117 out=81b] v117'34 uv34 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffcc15740 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffcc15740 10 datascan.operator(): handling object 100000001f7.0 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:50 17.36 17:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc307400 con 0x55e2cce7cc00 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 15 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) ==== 416+0+194 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffcc15740 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffcc15740 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffcc15740 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-04-26T22:08:00.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.503+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:51 16.7 16:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc307800 con 0x55e2cc2fac00 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 12 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffcc15740 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55e2cc307c00 0x55e2cccbd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:52 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306000 con 0x55e2cc307c00 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffb10f640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55e2cc307c00 0x55e2cccbd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffb10f640 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55e2cc307c00 0x55e2cccbd700 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=585b] v0'0 uv12 ondisk = 0) ==== 164+0+585 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc307c00 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffcc15740 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffcc15740 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*) 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffcc15740 20 datascan.get_frag_of: frag is * 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.504+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:53 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306800 con 0x55e2cc2fac00 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.505+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 13 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) ==== 164+0+274 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.505+0000 7f1ffcc15740 10 datascan.find_or_create_dirfrag: read_version = 8 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.505+0000 7f1ffcc15740 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.505+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:54 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc307400 con 0x55e2cc2fac00 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.505+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 14 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) ==== 164+0+4 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.505+0000 7f1ffcc15740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.505+0000 7f1ffcc15740 20 datascan.read_dentry: bravo_head not found in result 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.505+0000 7f1ffcc15740 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.505+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:55 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc307000 con 0x55e2cc2fac00 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.506+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 15 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v117'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.506+0000 7f1ffcc15740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.506+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:56 17.e 17:70000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cce7d000 con 0x55e2cc307c00 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.506+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.2 v2:172.21.15.137:6816/1304816807 2 ==== osd_op_reply(56 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc307c00 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.506+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:57 17.2e 17:74000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306c00 con 0x55e2cc306400 2024-04-26T22:08:00.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.507+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.6 v2:172.21.15.170:6800/3855301024 2 ==== osd_op_reply(57 [pgnls-filter start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc306400 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.507+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:58 17.1e 17:78000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb000 con 0x55e2cc2fa000 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.507+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.1 v2:172.21.15.137:6800/757189714 6 ==== osd_op_reply(58 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc2fa000 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.507+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:59 17.3e 17:7c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc307800 con 0x55e2cc2d8c00 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.508+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 5 ==== osd_op_reply(59 [pgnls-filter start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.508+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:60 17.1 17:80000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fb800 con 0x55e2cce7cc00 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.508+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 16 ==== osd_op_reply(60 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.508+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:61 17.21 17:84000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306000 con 0x55e2cce7cc00 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.508+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 17 ==== osd_op_reply(61 [pgnls-filter start_epoch 117 out=49b] v115'24 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.508+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:62 17.11 17:88000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31a000 con 0x55e2cc2fac00 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.508+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 16 ==== osd_op_reply(62 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.508+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:63 17.31 17:8c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc306800 con 0x55e2cc2fa000 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.509+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.1 v2:172.21.15.137:6800/757189714 7 ==== osd_op_reply(63 [pgnls-filter start_epoch 117 out=49b] v115'15 uv8 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc2fa000 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.509+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:64 17.9 17:90000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31a400 con 0x55e2cc2fac00 2024-04-26T22:08:00.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.509+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 17 ==== osd_op_reply(64 [pgnls-filter start_epoch 117 out=49b] v115'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.509+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:65 17.29 17:94000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fbc00 con 0x55e2cc2d8c00 2024-04-26T22:08:00.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.509+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.509+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:66 17.19 17:98000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31a800 con 0x55e2cc2d9000 2024-04-26T22:08:00.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.510+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.5 v2:172.21.15.170:6808/205812566 5 ==== osd_op_reply(66 [pgnls-filter start_epoch 117 out=49b] v117'24 uv24 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2d9000 2024-04-26T22:08:00.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.510+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:67 17.39 17:9c000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fa800 con 0x55e2cc2d9000 2024-04-26T22:08:00.528 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.510+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.5 v2:172.21.15.170:6808/205812566 6 ==== osd_op_reply(67 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2d9000 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.510+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31ac00 con 0x55e2cc306400 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.510+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.6 v2:172.21.15.170:6800/3855301024 3 ==== osd_op_reply(68 [pgnls-filter start_epoch 117 out=49b] v117'15 uv15 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc306400 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.510+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:69 17.25 17:a4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2d9c00 con 0x55e2cc2fa000 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.511+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.1 v2:172.21.15.137:6800/757189714 8 ==== osd_op_reply(69 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc2fa000 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.511+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:70 17.15 17:a8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31b000 con 0x55e2cc2d9000 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.511+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.5 v2:172.21.15.170:6808/205812566 7 ==== osd_op_reply(70 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2d9000 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.511+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:71 17.35 17:ac000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2d9400 con 0x55e2cc2d8c00 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.512+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 7 ==== osd_op_reply(71 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.512+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:72 17.d 17:b0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31b400 con 0x55e2cc2d9800 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.512+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 11 ==== osd_op_reply(72 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.512+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:73 17.2d 17:b4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31a000 con 0x55e2cc2d9800 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.512+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.529 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.512+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:74 17.1d 17:b8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31b800 con 0x55e2cc2d9800 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.512+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 13 ==== osd_op_reply(74 [pgnls-filter start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.512+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:75 17.3d 17:bc000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31a400 con 0x55e2cc2d9800 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.513+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 14 ==== osd_op_reply(75 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.513+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:76 17.3 17:c0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31bc00 con 0x55e2cc2d8c00 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.513+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.513+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:77 17.23 17:c4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31a800 con 0x55e2cc2d8c00 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.513+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 9 ==== osd_op_reply(77 [pgnls-filter start_epoch 117 out=49b] v115'14 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.513+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:78 17.13 17:c8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31b400 con 0x55e2cc2fac00 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.513+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.3 v2:172.21.15.137:6808/492121506 18 ==== osd_op_reply(78 [pgnls-filter start_epoch 117 out=49b] v115'30 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc2fac00 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.513+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:79 17.33 17:cc000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31b000 con 0x55e2cc2d9800 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.514+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.7 v2:172.21.15.170:6816/3085321649 15 ==== osd_op_reply(79 [pgnls-filter start_epoch 117 out=49b] v115'20 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d9800 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.514+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:80 17.b 17:d0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31a000 con 0x55e2cce7cc00 2024-04-26T22:08:00.530 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.514+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 18 ==== osd_op_reply(80 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.514+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:81 17.2b 17:d4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fa800 con 0x55e2cc2d8c00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.514+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 10 ==== osd_op_reply(81 [pgnls-filter start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.514+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:82 17.1b 17:d8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31b800 con 0x55e2cc2d8c00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.515+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 11 ==== osd_op_reply(82 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.515+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:83 17.3b 17:dc000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cce7d000 con 0x55e2cc307c00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.515+0000 7f1ffb10f640 1 -- 172.21.15.137:0/1401184877 <== osd.2 v2:172.21.15.137:6816/1304816807 3 ==== osd_op_reply(83 [pgnls-filter start_epoch 117 out=49b] v115'8 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2500 con 0x55e2cc307c00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.515+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:84 17.7 17:e0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31a400 con 0x55e2cce7cc00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.515+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 19 ==== osd_op_reply(84 [pgnls-filter start_epoch 117 out=49b] v115'10 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.515+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:85 17.27 17:e4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc307400 con 0x55e2cc2d8c00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.515+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 117 out=49b] v115'4 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.516+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:86 17.17 17:e8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2d9400 con 0x55e2cc306400 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.516+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.6 v2:172.21.15.170:6800/3855301024 4 ==== osd_op_reply(86 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc306400 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.516+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:87 17.37 17:ec000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc307000 con 0x55e2cce7cc00 2024-04-26T22:08:00.531 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.516+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 20 ==== osd_op_reply(87 [pgnls-filter start_epoch 117 out=49b] v115'22 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.516+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:88 17.f 17:f0000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc2fbc00 con 0x55e2cc2fa000 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.516+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.1 v2:172.21.15.137:6800/757189714 9 ==== osd_op_reply(88 [pgnls-filter start_epoch 117 out=49b] v115'18 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc2fa000 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.516+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:89 17.2f 17:f4000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31ac00 con 0x55e2cc2d8c00 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.517+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 <== osd.4 v2:172.21.15.170:6824/2080414701 13 ==== osd_op_reply(89 [pgnls-filter start_epoch 117 out=49b] v115'16 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2780 con 0x55e2cc2d8c00 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.517+0000 7f1ff5904640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:90 17.1f 17:f8000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc307800 con 0x55e2cc306400 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.517+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.6 v2:172.21.15.170:6800/3855301024 5 ==== osd_op_reply(90 [pgnls-filter start_epoch 117 out=49b] v115'12 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cc306400 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.517+0000 7f1ff6105640 1 -- 172.21.15.137:0/1401184877 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:91 17.3f 17:fc000000::::head [pgnls-filter start_epoch 117 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x55e2cc31a000 con 0x55e2cce7cc00 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffa10d640 1 -- 172.21.15.137:0/1401184877 <== osd.0 v2:172.21.15.137:6820/109358669 21 ==== osd_op_reply(91 [pgnls-filter start_epoch 117 out=49b] v115'17 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x55e2cccd2000 con 0x55e2cce7cc00 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55e2cce7cc00 msgr2=0x55e2cccbc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x55e2cce7cc00 0x55e2cccbc680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55e2cc2fa000 msgr2=0x55e2cc300000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x55e2cc2fa000 0x55e2cc300000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55e2cc307c00 msgr2=0x55e2cccbd700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.532 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x55e2cc307c00 0x55e2cccbd700 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55e2cc2fac00 msgr2=0x55e2cc300580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x55e2cc2fac00 0x55e2cc300580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 reap_dead start 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55e2cc2d8c00 msgr2=0x55e2cc300b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x55e2cc2d8c00 0x55e2cc300b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55e2cc2d9000 msgr2=0x55e2cccbcc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x55e2cc2d9000 0x55e2cccbcc00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55e2cc306400 msgr2=0x55e2cc301080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x55e2cc306400 0x55e2cc301080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55e2cc2d9800 msgr2=0x55e2cccbd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x55e2cc2d9800 0x55e2cccbd180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55e2cc2d8000 msgr2=0x55e2cccbc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x55e2cc2d8000 0x55e2cccbc100 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55e2ccce7110 tx=0x55e2cce2cea0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c000 msgr2=0x55e2cccbb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffa90e640 1 -- 172.21.15.137:0/1401184877 reap_dead start 2024-04-26T22:08:00.533 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x55e2ccd2fd40 tx=0x55e2ccce4720 comp rx=0 tx=0).stop 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 shutdown_connections 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/1401184877 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cce7c000 0x55e2cccbb080 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 >> 172.21.15.137:0/1401184877 conn(0x55e2ccce3c00 msgr2=0x55e2cc031000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 shutdown_connections 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/1401184877 wait complete. 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/3806019374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cbf41c00 msgr2=0x55e2cccbab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/3806019374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cbf41c00 0x55e2cccbab00 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x55e2ccd69440 tx=0x55e2ccce4ae0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/3806019374 shutdown_connections 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/3806019374 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55e2cbf41c00 0x55e2cccbab00 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/3806019374 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55e2cbf41800 0x55e2cccba580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 --2- 172.21.15.137:0/3806019374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e2cbf40c00 0x55e2cccba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/3806019374 >> 172.21.15.137:0/3806019374 conn(0x55e2cbf41000 msgr2=0x55e2cc030800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.518+0000 7f1ffcc15740 1 -- 172.21.15.137:0/3806019374 shutdown_connections 2024-04-26T22:08:00.535 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.519+0000 7f1ffcc15740 1 -- 172.21.15.137:0/3806019374 wait complete. 2024-04-26T22:08:00.535 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.136993, result: 2024-04-26T22:08:00.535 DEBUG:teuthology.orchestra.run.smithi137:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-26T22:08:00.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.606+0000 7fc112214740 1 -- start start 2024-04-26T22:08:00.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.606+0000 7fc112214740 1 Processor -- start 2024-04-26T22:08:00.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc112214740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a0f48c00 0x5632a1d22000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc112214740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a0f49800 0x5632a1d22580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc112214740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a0f49c00 0x5632a1d22b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc112214740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632a1d40180 con 0x5632a0f49c00 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc112214740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5632a1d40300 con 0x5632a0f49800 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc112214740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5632a1d40480 con 0x5632a0f48c00 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc11070f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a0f49c00 0x5632a1d22b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc11070f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a0f49c00 0x5632a1d22b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39362/0 (socket says 172.21.15.137:39362) 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc11070f640 1 -- 172.21.15.137:0/2057665501 learned_addr learned my addr 172.21.15.137:0/2057665501 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc10ff0e640 1 --2- 172.21.15.137:0/2057665501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a0f48c00 0x5632a1d22000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.607+0000 7fc10f70d640 1 --2- 172.21.15.137:0/2057665501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a0f49800 0x5632a1d22580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc11070f640 1 -- 172.21.15.137:0/2057665501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a0f48c00 msgr2=0x5632a1d22000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc11070f640 1 --2- 172.21.15.137:0/2057665501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a0f48c00 0x5632a1d22000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc11070f640 1 -- 172.21.15.137:0/2057665501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a0f49800 msgr2=0x5632a1d22580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc11070f640 1 --2- 172.21.15.137:0/2057665501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a0f49800 0x5632a1d22580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc11070f640 1 -- 172.21.15.137:0/2057665501 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632a0f75680 con 0x5632a0f49c00 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc11070f640 1 --2- 172.21.15.137:0/2057665501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a0f49c00 0x5632a1d22b00 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x5632a1d7d410 tx=0x5632a1cec540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec74d74823fb475 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc10d709640 1 -- 172.21.15.137:0/2057665501 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632a0f6e9c0 con 0x5632a0f49c00 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc10d709640 1 -- 172.21.15.137:0/2057665501 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5632a0f90e00 con 0x5632a0f49c00 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc10d709640 1 -- 172.21.15.137:0/2057665501 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632a0f6e680 con 0x5632a0f49c00 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc112214740 1 -- 172.21.15.137:0/2057665501 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632a0f754a0 con 0x5632a0f49c00 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc112214740 1 -- 172.21.15.137:0/2057665501 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5632a0f75a40 con 0x5632a0f49c00 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc112214740 4 waiting for MDS map... 2024-04-26T22:08:00.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc10d709640 1 -- 172.21.15.137:0/2057665501 <== mon.0 v2:172.21.15.137:3300/0 4 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x5632a1d30600 con 0x5632a0f49c00 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc10d709640 1 -- 172.21.15.137:0/2057665501 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 88) ==== 2885+0+0 (secure 0 0 0) 0x5632a0fa1180 con 0x5632a0f49c00 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc112214740 4 Got MDS map 88 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc112214740 4 datascan.main: Using metadata pool output 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.608+0000 7fc112214740 4 datascan.main: connecting to RADOS... 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.609+0000 7fc112214740 1 Processor -- start 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.609+0000 7fc112214740 1 -- start start 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.609+0000 7fc112214740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a1e7e000 0x5632a1d23080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.609+0000 7fc112214740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.609+0000 7fc112214740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e800 0x5632a1d23b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.609+0000 7fc112214740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632a1d40600 con 0x5632a1e7e800 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.609+0000 7fc112214740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5632a1d40780 con 0x5632a1e7e400 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.609+0000 7fc112214740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5632a1d40900 con 0x5632a1e7e000 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.609+0000 7fc10f70d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e800 0x5632a1d23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10f70d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e800 0x5632a1d23b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39370/0 (socket says 172.21.15.137:39370) 2024-04-26T22:08:00.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10f70d640 1 -- 172.21.15.137:0/1625057715 learned_addr learned my addr 172.21.15.137:0/1625057715 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10f70d640 1 --2- 172.21.15.137:0/1625057715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a1e7e000 0x5632a1d23080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10ff0e640 1 --2- 172.21.15.137:0/1625057715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10f70d640 1 -- 172.21.15.137:0/1625057715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a1e7e000 msgr2=0x5632a1d23080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10f70d640 1 --2- 172.21.15.137:0/1625057715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a1e7e000 0x5632a1d23080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10f70d640 1 -- 172.21.15.137:0/1625057715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a1e7e400 msgr2=0x5632a1d23600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:00.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10f70d640 1 --2- 172.21.15.137:0/1625057715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10f70d640 1 -- 172.21.15.137:0/1625057715 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632a0f75860 con 0x5632a1e7e800 2024-04-26T22:08:00.648 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10f70d640 1 --2- 172.21.15.137:0/1625057715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e800 0x5632a1d23b80 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x5632a1e211a0 tx=0x5632a1e26cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2b2c695235e50d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10b705640 1 -- 172.21.15.137:0/1625057715 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632a0f6e9c0 con 0x5632a1e7e800 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10b705640 1 -- 172.21.15.137:0/1625057715 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5632a0f90540 con 0x5632a1e7e800 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc10b705640 1 -- 172.21.15.137:0/1625057715 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632a0f6e680 con 0x5632a1e7e800 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc112214740 1 -- 172.21.15.137:0/1625057715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e800 msgr2=0x5632a1d23b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc112214740 1 --2- 172.21.15.137:0/1625057715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e800 0x5632a1d23b80 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x5632a1e211a0 tx=0x5632a1e26cc0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc112214740 1 -- 172.21.15.137:0/1625057715 shutdown_connections 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc112214740 1 --2- 172.21.15.137:0/1625057715 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e800 0x5632a1d23b80 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc112214740 1 --2- 172.21.15.137:0/1625057715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc112214740 1 --2- 172.21.15.137:0/1625057715 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a1e7e000 0x5632a1d23080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc112214740 1 -- 172.21.15.137:0/1625057715 >> 172.21.15.137:0/1625057715 conn(0x5632a1d45c00 msgr2=0x5632a1039000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc112214740 1 -- 172.21.15.137:0/1625057715 shutdown_connections 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.610+0000 7fc112214740 1 -- 172.21.15.137:0/1625057715 wait complete. 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.611+0000 7fc112214740 1 Processor -- start 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.611+0000 7fc112214740 1 -- start start 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc112214740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a1e7e000 0x5632a1d23080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc112214740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc112214740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a1e7e800 0x5632a1d23b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc112214740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x5632a1d41c80 con 0x5632a1e7e400 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc112214740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x5632a1d41b00 con 0x5632a1e7e800 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc112214740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x5632a1d41980 con 0x5632a1e7e000 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10ff0e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10ff0e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39384/0 (socket says 172.21.15.137:39384) 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 learned_addr learned my addr 172.21.15.137:0/4282124597 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:00.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a1e7e000 0x5632a1d23080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a1e7e800 0x5632a1d23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a1e7e000 msgr2=0x5632a1d23080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10ff0e640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a1e7e000 0x5632a1d23080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a1e7e800 msgr2=0x5632a1d23b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10ff0e640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a1e7e800 0x5632a1d23b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632a0f752c0 con 0x5632a1e7e400 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc10ff0e640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x5632a1e21ef0 tx=0x5632a1e26d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc109f02640 1 -- 172.21.15.137:0/4282124597 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632a0f6e9c0 con 0x5632a1e7e400 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc109f02640 1 -- 172.21.15.137:0/4282124597 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5632a0f90a80 con 0x5632a1e7e400 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632a0f750e0 con 0x5632a1e7e400 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc109f02640 1 -- 172.21.15.137:0/4282124597 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5632a0f6e680 con 0x5632a1e7e400 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632a0f743c0 con 0x5632a1e7e400 2024-04-26T22:08:00.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.612+0000 7fc112214740 4 datascan.init: resolving metadata pool 16 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.613+0000 7fc109f02640 1 -- 172.21.15.137:0/4282124597 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x5632a1ea0c00 con 0x5632a1e7e400 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc109f02640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5632a1ea2c00 0x5632a1d24100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc109f02640 1 -- 172.21.15.137:0/4282124597 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x5632a1e9f000 con 0x5632a1e7e400 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc112214740 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc112214740 4 datascan.main: resolving metadata pool 16 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5632a1ea2c00 0x5632a1d24100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5632a1e7ec00 0x5632a1d24680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:1 16.0 16:00000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1e7f000 con 0x5632a1e7ec00 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5632a1e7ec00 0x5632a1d24680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5632a1ea2c00 0x5632a1d24100 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5632a1e21230 tx=0x5632a1e26c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.614+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5632a1e7ec00 0x5632a1d24680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.615+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== osd_op_reply(1 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.615+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5632a1e7f000 0x5632a12da000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.615+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:2 16.10 16:08000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1e7fc00 con 0x5632a1e7f000 2024-04-26T22:08:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.615+0000 7fc11070f640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5632a1e7f000 0x5632a12da000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.615+0000 7fc11070f640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5632a1e7f000 0x5632a12da000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.615+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== osd_op_reply(2 [pgnls start_epoch 117 out=177b] v116'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.615+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:3 16.8 16:10000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1e7fc00 con 0x5632a1e7ec00 2024-04-26T22:08:00.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.616+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 2 ==== osd_op_reply(3 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.616+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:4 16.18 16:18000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1e7fc00 con 0x5632a1e7ec00 2024-04-26T22:08:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.616+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 3 ==== osd_op_reply(4 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.616+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5632a1e7fc00 0x5632a12da580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.616+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:5 16.4 16:20000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3000 con 0x5632a1e7fc00 2024-04-26T22:08:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.616+0000 7fc10ff0e640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5632a1e7fc00 0x5632a12da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.616+0000 7fc10ff0e640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5632a1e7fc00 0x5632a12da580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.616+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== osd_op_reply(5 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.616+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:6 16.14 16:28000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3000 con 0x5632a1e7ec00 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.617+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 4 ==== osd_op_reply(6 [pgnls start_epoch 117 out=149b] v117'41 uv41 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.617+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5632a1ea3000 0x5632a12dab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.617+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:7 16.c 16:30000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3400 con 0x5632a1ea3000 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.617+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5632a1ea3000 0x5632a12dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.617+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5632a1ea3000 0x5632a12dab00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.618+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== osd_op_reply(7 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.618+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:8 16.1c 16:38000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3400 con 0x5632a1e7f000 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.618+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 2 ==== osd_op_reply(8 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.618+0000 7fc11070f640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5632a1ea3400 0x5632a12db080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.618+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:9 16.2 16:40000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3c00 con 0x5632a1ea3400 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.618+0000 7fc11070f640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5632a1ea3400 0x5632a12db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.618+0000 7fc11070f640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5632a1ea3400 0x5632a12db080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.619+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== osd_op_reply(9 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1ea3400 2024-04-26T22:08:00.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.619+0000 7fc11070f640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5632a1ea3c00 0x5632a12db600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.619+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:10 16.12 16:48000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6000 con 0x5632a1ea3c00 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.619+0000 7fc10ff0e640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5632a1ea3c00 0x5632a12db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.619+0000 7fc10ff0e640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5632a1ea3c00 0x5632a12db600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== osd_op_reply(10 [pgnls start_epoch 117 out=81b] v116'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1ea3c00 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:11 16.a 16:50000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6000 con 0x5632a1e7f000 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 3 ==== osd_op_reply(11 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:12 16.1a 16:58000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6000 con 0x5632a1e7fc00 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 2 ==== osd_op_reply(12 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:13 16.6 16:60000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6000 con 0x5632a1ea3c00 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.6 v2:172.21.15.170:6800/3855301024 2 ==== osd_op_reply(13 [pgnls start_epoch 117 out=77b] v116'9 uv9 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1ea3c00 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:14 16.16 16:68000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6000 con 0x5632a1e7fc00 2024-04-26T22:08:00.656 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 3 ==== osd_op_reply(14 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.620+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:15 16.e 16:70000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6000 con 0x5632a1e7f000 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.621+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 4 ==== osd_op_reply(15 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.621+0000 7fc11070f640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5632a12f6000 0x5632a12dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.621+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:16 16.1e 16:78000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6400 con 0x5632a12f6000 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.621+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5632a12f6000 0x5632a12dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.621+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5632a12f6000 0x5632a12dbb80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.622+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== osd_op_reply(16 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a12f6000 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.622+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:17 16.1 16:80000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6400 con 0x5632a1e7f000 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.622+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 5 ==== osd_op_reply(17 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.622+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:18 16.11 16:88000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6400 con 0x5632a1ea3000 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.622+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== osd_op_reply(18 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.622+0000 7fc10f70d640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5632a12f6400 0x5632a12dc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:00.657 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.622+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:19 16.9 16:90000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a12f6400 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.622+0000 7fc11070f640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5632a12f6400 0x5632a12dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.623+0000 7fc11070f640 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5632a12f6400 0x5632a12dc100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.623+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== osd_op_reply(19 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.623+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:20 16.19 16:98000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1ea3400 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.623+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== osd_op_reply(20 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1ea3400 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.623+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:21 16.5 16:a0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1e7ec00 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.623+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 5 ==== osd_op_reply(21 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.623+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:22 16.15 16:a8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1e7ec00 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.624+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 6 ==== osd_op_reply(22 [pgnls start_epoch 117 out=97b] v116'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.624+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:23 16.d 16:b0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1ea3c00 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.624+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.6 v2:172.21.15.170:6800/3855301024 3 ==== osd_op_reply(23 [pgnls start_epoch 117 out=74b] v114'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1ea3c00 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.624+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:24 16.1d 16:b8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1e7f000 2024-04-26T22:08:00.658 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.624+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 6 ==== osd_op_reply(24 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.624+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:25 16.3 16:c0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1ea3000 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.625+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 3 ==== osd_op_reply(25 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.625+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:26 16.13 16:c8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a12f6400 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.625+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 2 ==== osd_op_reply(26 [pgnls start_epoch 117 out=98b] v116'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.625+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:27 16.b 16:d0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a12f6400 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.625+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 3 ==== osd_op_reply(27 [pgnls start_epoch 117 out=76b] v117'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.625+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:28 16.1b 16:d8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1ea3000 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.625+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 4 ==== osd_op_reply(28 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.625+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:29 16.7 16:e0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1e7fc00 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.626+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 4 ==== osd_op_reply(29 [pgnls start_epoch 117 out=105b] v117'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.626+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:30 16.17 16:e8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1e7f000 2024-04-26T22:08:00.659 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.626+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 7 ==== osd_op_reply(30 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.626+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:31 16.f 16:f0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1e7ec00 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.626+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 7 ==== osd_op_reply(31 [pgnls start_epoch 117 out=73b] v117'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.626+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:32 16.1f 16:f8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1ea3000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 5 ==== osd_op_reply(32 [pgnls start_epoch 117 out=101b] v117'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:33 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7400 con 0x5632a1e7f000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:34 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7800 con 0x5632a1e7f000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-26T22:08:00.660 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:35 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7c00 con 0x5632a1e7f000 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.627+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:36 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1302000 con 0x5632a1e7f000 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:37 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1302400 con 0x5632a1e7f000 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-26T22:08:00.661 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:38 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1302800 con 0x5632a1e7ec00 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 8 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.628+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:39 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1302c00 con 0x5632a1e7f000 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:40 16.12 16:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1303000 con 0x5632a1ea3c00 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.6 v2:172.21.15.170:6800/3855301024 4 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1ea3c00 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-26T22:08:00.662 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:41 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1303400 con 0x5632a1e7f000 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:42 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1303800 con 0x5632a1e7ec00 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.629+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:43 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1302000 con 0x5632a1e7f000 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-26T22:08:00.663 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:44 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1303c00 con 0x5632a12f6400 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 4 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:45 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7fc00 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 5 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.630+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:46 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6c00 con 0x5632a1e7fc00 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 6 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc112214740 20 datascan.scan_links: injected ino detected 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-26T22:08:00.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc112214740 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:47 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6800 con 0x5632a1ea3000 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 6 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:48 16.0 16:00000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7400 con 0x5632a1e7ec00 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 10 ==== osd_op_reply(48 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.631+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:49 16.10 16:08000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6800 con 0x5632a1e7f000 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 16 ==== osd_op_reply(49 [pgnls start_epoch 117 out=177b] v116'16 uv16 ondisk = 1) ==== 144+0+177 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:50 16.8 16:10000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6800 con 0x5632a1e7ec00 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 11 ==== osd_op_reply(50 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:51 16.18 16:18000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6800 con 0x5632a1e7ec00 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 12 ==== osd_op_reply(51 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:52 16.4 16:20000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f6800 con 0x5632a1e7fc00 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 7 ==== osd_op_reply(52 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:53 16.14 16:28000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7ec00 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 13 ==== osd_op_reply(53 [pgnls start_epoch 117 out=149b] v117'41 uv41 ondisk = 1) ==== 144+0+149 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.632+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:54 16.c 16:30000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3000 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.633+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 7 ==== osd_op_reply(54 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.633+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:55 16.1c 16:38000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7f000 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.633+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 17 ==== osd_op_reply(55 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.633+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:56 16.2 16:40000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3400 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.633+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.4 v2:172.21.15.170:6824/2080414701 3 ==== osd_op_reply(56 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1ea3400 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.633+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:57 16.12 16:48000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3c00 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.634+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.6 v2:172.21.15.170:6800/3855301024 5 ==== osd_op_reply(57 [pgnls start_epoch 117 out=81b] v116'3 uv3 ondisk = 1) ==== 144+0+81 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1ea3c00 2024-04-26T22:08:00.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.634+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:58 16.a 16:50000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7f000 2024-04-26T22:08:00.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.634+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 18 ==== osd_op_reply(58 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.634+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:59 16.1a 16:58000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7fc00 2024-04-26T22:08:00.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.634+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 8 ==== osd_op_reply(59 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.634+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:60 16.6 16:60000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3c00 2024-04-26T22:08:00.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.634+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.6 v2:172.21.15.170:6800/3855301024 6 ==== osd_op_reply(60 [pgnls start_epoch 117 out=77b] v116'9 uv9 ondisk = 1) ==== 144+0+77 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1ea3c00 2024-04-26T22:08:00.667 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.635+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:61 16.16 16:68000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7fc00 2024-04-26T22:08:00.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.635+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 9 ==== osd_op_reply(61 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.635+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:62 16.e 16:70000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7f000 2024-04-26T22:08:00.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.635+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 19 ==== osd_op_reply(62 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.635+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- osd_op(unknown.0.0:63 16.1e 16:78000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a12f6000 2024-04-26T22:08:00.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.635+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.7 v2:172.21.15.170:6816/3085321649 2 ==== osd_op_reply(63 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a12f6000 2024-04-26T22:08:00.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.635+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:64 16.1 16:80000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7f000 2024-04-26T22:08:00.668 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.636+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 20 ==== osd_op_reply(64 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.636+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:65 16.11 16:88000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3000 2024-04-26T22:08:00.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.636+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 8 ==== osd_op_reply(65 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.636+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:66 16.9 16:90000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a12f6400 2024-04-26T22:08:00.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.636+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 5 ==== osd_op_reply(66 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.636+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- osd_op(unknown.0.0:67 16.19 16:98000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3400 2024-04-26T22:08:00.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.636+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.4 v2:172.21.15.170:6824/2080414701 4 ==== osd_op_reply(67 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1ea3400 2024-04-26T22:08:00.669 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.636+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:68 16.5 16:a0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7ec00 2024-04-26T22:08:00.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.637+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 14 ==== osd_op_reply(68 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.637+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:69 16.15 16:a8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7ec00 2024-04-26T22:08:00.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.637+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 15 ==== osd_op_reply(69 [pgnls start_epoch 117 out=97b] v116'4 uv4 ondisk = 1) ==== 144+0+97 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.637+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:70 16.d 16:b0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3c00 2024-04-26T22:08:00.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.637+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.6 v2:172.21.15.170:6800/3855301024 7 ==== osd_op_reply(70 [pgnls start_epoch 117 out=74b] v114'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1ea3c00 2024-04-26T22:08:00.670 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.637+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:71 16.1d 16:b8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7f000 2024-04-26T22:08:00.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.638+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 21 ==== osd_op_reply(71 [pgnls start_epoch 117 out=73b] v116'3 uv3 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.638+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:72 16.3 16:c0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3000 2024-04-26T22:08:00.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.638+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 9 ==== osd_op_reply(72 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.638+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:73 16.13 16:c8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a12f6400 2024-04-26T22:08:00.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.638+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 6 ==== osd_op_reply(73 [pgnls start_epoch 117 out=98b] v116'5 uv5 ondisk = 1) ==== 144+0+98 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.671 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.638+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:74 16.b 16:d0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a12f6400 2024-04-26T22:08:00.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.638+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 7 ==== osd_op_reply(74 [pgnls start_epoch 117 out=76b] v117'6 uv5 ondisk = 1) ==== 144+0+76 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.638+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:75 16.1b 16:d8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3000 2024-04-26T22:08:00.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.639+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 10 ==== osd_op_reply(75 [pgnls start_epoch 117 out=49b] v117'3 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.639+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:76 16.7 16:e0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7fc00 2024-04-26T22:08:00.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.639+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 10 ==== osd_op_reply(76 [pgnls start_epoch 117 out=105b] v117'9 uv9 ondisk = 1) ==== 144+0+105 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.639+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:77 16.17 16:e8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7f000 2024-04-26T22:08:00.672 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.639+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 22 ==== osd_op_reply(77 [pgnls start_epoch 117 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.639+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:78 16.f 16:f0000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1e7ec00 2024-04-26T22:08:00.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.639+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 16 ==== osd_op_reply(78 [pgnls start_epoch 117 out=73b] v117'2 uv2 ondisk = 1) ==== 144+0+73 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.639+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:79 16.1f 16:f8000000::::head [pgnls start_epoch 117 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a1ea3000 2024-04-26T22:08:00.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.640+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 11 ==== osd_op_reply(79 [pgnls start_epoch 117 out=101b] v117'9 uv8 ondisk = 1) ==== 144+0+101 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.640+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-26T22:08:00.673 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.640+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:80 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7800 con 0x5632a1e7f000 2024-04-26T22:08:00.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.640+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 23 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.640+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-26T22:08:00.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.640+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:81 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7c00 con 0x5632a1e7f000 2024-04-26T22:08:00.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 24 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-26T22:08:00.674 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:82 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1310000 con 0x5632a1e7f000 2024-04-26T22:08:00.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 25 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1169b] v0'0 uv12 ondisk = 0) ==== 164+0+1169 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-26T22:08:00.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:83 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1310400 con 0x5632a1e7f000 2024-04-26T22:08:00.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 26 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-26T22:08:00.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:84 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1310800 con 0x5632a1e7f000 2024-04-26T22:08:00.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 27 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-26T22:08:00.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-26T22:08:00.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-26T22:08:00.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-26T22:08:00.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-26T22:08:00.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-26T22:08:00.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-26T22:08:00.676 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.641+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:85 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1310c00 con 0x5632a1e7ec00 2024-04-26T22:08:00.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 17 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-26T22:08:00.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:86 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1311000 con 0x5632a1e7f000 2024-04-26T22:08:00.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 28 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2024-04-26T22:08:00.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:87 16.12 16:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1311400 con 0x5632a1ea3c00 2024-04-26T22:08:00.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.6 v2:172.21.15.170:6800/3855301024 8 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=584b] v0'0 uv3 ondisk = 0) ==== 164+0+584 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1ea3c00 2024-04-26T22:08:00.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc112214740 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-26T22:08:00.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-26T22:08:00.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-26T22:08:00.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.642+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:88 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1311800 con 0x5632a1e7f000 2024-04-26T22:08:00.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 29 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-26T22:08:00.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- osd_op(unknown.0.0:89 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1311c00 con 0x5632a1e7ec00 2024-04-26T22:08:00.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.0 v2:172.21.15.137:6820/109358669 18 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1e7ec00 2024-04-26T22:08:00.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-26T22:08:00.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-26T22:08:00.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-26T22:08:00.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-26T22:08:00.679 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-26T22:08:00.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- osd_op(unknown.0.0:90 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7400 con 0x5632a1e7f000 2024-04-26T22:08:00.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.2 v2:172.21.15.137:6816/1304816807 30 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a1e7f000 2024-04-26T22:08:00.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-26T22:08:00.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-26T22:08:00.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-26T22:08:00.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:91 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a12f7000 con 0x5632a12f6400 2024-04-26T22:08:00.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 8 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) ==== 156+0+5195 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-26T22:08:00.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-26T22:08:00.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-26T22:08:00.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.643+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:92 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1303800 con 0x5632a1e7fc00 2024-04-26T22:08:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 11 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) ==== 156+0+5 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-04-26T22:08:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:93 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1302800 con 0x5632a1e7fc00 2024-04-26T22:08:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 12 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1667b] v0'0 uv9 ondisk = 0) ==== 164+0+1667 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 20 datascan.scan_links: injected ino detected 2024-04-26T22:08:00.682 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2024-04-26T22:08:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-26T22:08:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-26T22:08:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-26T22:08:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-26T22:08:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-26T22:08:00.683 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- osd_op(unknown.0.0:94 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1302400 con 0x5632a1ea3000 2024-04-26T22:08:00.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc10f70d640 1 -- 172.21.15.137:0/4282124597 <== osd.5 v2:172.21.15.170:6808/205812566 12 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=585b] v0'0 uv8 ondisk = 0) ==== 154+0+585 (crc 0 0 0) 0x5632a1cd4000 con 0x5632a1ea3000 2024-04-26T22:08:00.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-26T22:08:00.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-26T22:08:00.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-26T22:08:00.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: processing 1 injected_inos 2024-04-26T22:08:00.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 10 datascan.scan_links: handling injected_ino 0x100000001f7 2024-04-26T22:08:00.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-04-26T22:08:00.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.644+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:95 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1302c00 con 0x5632a1e7fc00 2024-04-26T22:08:00.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.645+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 13 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) ==== 164+0+506 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.645+0000 7fc112214740 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-26T22:08:00.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.645+0000 7fc112214740 20 datascan.scan_links: first is now 2 2024-04-26T22:08:00.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.645+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- osd_op(unknown.0.0:96 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5632a1303400 con 0x5632a1e7fc00 2024-04-26T22:08:00.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.646+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.3 v2:172.21.15.137:6808/492121506 14 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v117'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1e7fc00 2024-04-26T22:08:00.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.646+0000 7fc112214740 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-04-26T22:08:00.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.646+0000 7fc112214740 10 datascan.scan_links: updating inotable 2024-04-26T22:08:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.646+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:97 16.13 16:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1302000 con 0x5632a12f6400 2024-04-26T22:08:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.646+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 9 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) ==== 157+0+50 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.646+0000 7fc112214740 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2024-04-26T22:08:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.646+0000 7fc112214740 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2024-04-26T22:08:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.646+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- osd_op(unknown.0.0:98 16.13 16:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e117) -- 0x5632a1303c00 con 0x5632a12f6400 2024-04-26T22:08:00.694 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc11070f640 1 -- 172.21.15.137:0/4282124597 <== osd.1 v2:172.21.15.137:6800/757189714 10 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v117'6 uv6 ondisk = 0) ==== 157+0+0 (crc 0 0 0) 0x5632a1cd4500 con 0x5632a12f6400 2024-04-26T22:08:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 10 datascan.scan_links: updating snaptable 2024-04-26T22:08:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- osd_op(unknown.0.0:99 16.d 16:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e117) -- 0x5632a1ea3800 con 0x5632a1ea3c00 2024-04-26T22:08:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 <== osd.6 v2:172.21.15.170:6800/3855301024 9 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) ==== 157+0+70 (crc 0 0 0) 0x5632a1cd4780 con 0x5632a1ea3c00 2024-04-26T22:08:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5632a1e7ec00 msgr2=0x5632a1d24680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x5632a1e7ec00 0x5632a1d24680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.695 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5632a12f6400 msgr2=0x5632a12dc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x5632a12f6400 0x5632a12dc100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5632a1e7f000 msgr2=0x5632a12da000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x5632a1e7f000 0x5632a12da000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5632a1e7fc00 msgr2=0x5632a12da580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 reap_dead start 2024-04-26T22:08:00.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x5632a1e7fc00 0x5632a12da580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5632a1ea3400 msgr2=0x5632a12db080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x5632a1ea3400 0x5632a12db080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5632a1ea3000 msgr2=0x5632a12dab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x5632a1ea3000 0x5632a12dab00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5632a1ea3c00 msgr2=0x5632a12db600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x5632a1ea3c00 0x5632a12db600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5632a12f6000 msgr2=0x5632a12dbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x5632a12f6000 0x5632a12dbb80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc10ff0e640 1 -- 172.21.15.137:0/4282124597 reap_dead start 2024-04-26T22:08:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5632a1ea2c00 msgr2=0x5632a1d24100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5632a1ea2c00 0x5632a1d24100 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x5632a1e21230 tx=0x5632a1e26c00 comp rx=0 tx=0).stop 2024-04-26T22:08:00.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e400 msgr2=0x5632a1d23600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x5632a1e21ef0 tx=0x5632a1e26d20 comp rx=0 tx=0).stop 2024-04-26T22:08:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 shutdown_connections 2024-04-26T22:08:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x5632a1ea2c00 0x5632a1d24100 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 --2- 172.21.15.137:0/4282124597 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a1e7e400 0x5632a1d23600 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.648+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 >> 172.21.15.137:0/4282124597 conn(0x5632a1d45c00 msgr2=0x5632a1039000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 shutdown_connections 2024-04-26T22:08:00.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 -- 172.21.15.137:0/4282124597 wait complete. 2024-04-26T22:08:00.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 -- 172.21.15.137:0/2057665501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a0f49c00 msgr2=0x5632a1d22b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:00.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 --2- 172.21.15.137:0/2057665501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a0f49c00 0x5632a1d22b00 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x5632a1d7d410 tx=0x5632a1cec540 comp rx=0 tx=0).stop 2024-04-26T22:08:00.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 -- 172.21.15.137:0/2057665501 shutdown_connections 2024-04-26T22:08:00.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 --2- 172.21.15.137:0/2057665501 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x5632a0f49c00 0x5632a1d22b00 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 --2- 172.21.15.137:0/2057665501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5632a0f49800 0x5632a1d22580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 --2- 172.21.15.137:0/2057665501 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x5632a0f48c00 0x5632a1d22000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:00.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 -- 172.21.15.137:0/2057665501 >> 172.21.15.137:0/2057665501 conn(0x5632a0f49000 msgr2=0x5632a1038800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:00.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 -- 172.21.15.137:0/2057665501 shutdown_connections 2024-04-26T22:08:00.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:00.649+0000 7fc112214740 1 -- 172.21.15.137:0/2057665501 wait complete. 2024-04-26T22:08:00.701 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.166417, result: 2024-04-26T22:08:00.703 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:08:00.736 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:08:00.774 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-26T22:08:00.774 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-26T22:08:00.774 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.775 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-26T22:08:00.776 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-26T22:08:00.777 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on skipped message = False 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-26T22:08:00.778 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.779 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-26T22:08:00.780 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-26T22:08:00.781 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-26T22:08:00.782 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-26T22:08:00.783 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.784 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-26T22:08:00.785 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = False 2024-04-26T22:08:00.786 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-26T22:08:00.786 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-04-26T22:08:00.786 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T22:08:00.786 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T22:08:00.786 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.787 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:08:00.788 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-26T22:08:00.789 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on skipped message = False 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-26T22:08:00.790 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-26T22:08:00.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.792 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-26T22:08:00.792 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.792 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:08:00.792 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-26T22:08:00.792 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.792 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-26T22:08:00.792 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-26T22:08:00.793 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-26T22:08:00.793 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-26T22:08:00.793 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-04-26T22:08:00.793 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-26T22:08:00.793 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-26T22:08:00.793 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-26T22:08:00.794 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-26T22:08:00.794 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.794 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-26T22:08:00.794 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-26T22:08:00.794 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:08:00.794 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-26T22:08:00.795 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:08:00.795 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:08:00.795 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-26T22:08:00.795 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T22:08:00.795 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.795 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-26T22:08:00.796 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.796 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-26T22:08:00.796 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T22:08:00.796 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T22:08:00.796 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:08:00.796 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:08:00.797 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-26T22:08:00.797 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T22:08:00.797 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.797 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-26T22:08:00.797 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.797 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T22:08:00.798 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-26T22:08:00.798 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T22:08:00.798 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-26T22:08:00.798 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-26T22:08:00.798 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:08:00.798 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-26T22:08:00.799 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-26T22:08:00.799 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:08:00.799 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.799 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:08:00.799 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:08:00.799 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:08:00.800 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.800 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:08:00.800 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:08:00.800 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:08:00.800 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.801 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-26T22:08:00.801 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:08:00.801 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.801 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:08:00.801 INFO:teuthology.orchestra.run.smithi170.stdout: mon down mkfs grace = 300 2024-04-26T22:08:00.801 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2024-04-26T22:08:00.802 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.802 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-26T22:08:00.802 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-26T22:08:00.802 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-26T22:08:00.802 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-26T22:08:00.802 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:08:00.802 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:08:00.803 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2024-04-26T22:08:00.803 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T22:08:00.803 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.803 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2024-04-26T22:08:00.803 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T22:08:00.803 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T22:08:00.804 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-26T22:08:00.804 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-04-26T22:08:00.804 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-04-26T22:08:00.804 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T22:08:00.804 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T22:08:00.804 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T22:08:00.805 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T22:08:00.805 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-04-26T22:08:00.805 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2024-04-26T22:08:00.805 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2024-04-26T22:08:00.805 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.805 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2024-04-26T22:08:00.806 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = False 2024-04-26T22:08:00.806 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2024-04-26T22:08:00.806 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = True 2024-04-26T22:08:00.806 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T22:08:00.806 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T22:08:00.806 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T22:08:00.810 DEBUG:teuthology.orchestra.run.smithi137:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:08:00.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T22:08:00.889 INFO:teuthology.orchestra.run.smithi137.stdout:[global] 2024-04-26T22:08:00.889 INFO:teuthology.orchestra.run.smithi137.stdout: chdir = "" 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: auth supported = cephx 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: filestore xattr use omap = true 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: mon clock drift allowed = 1.000 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: osd crush chooseleaf type = 0 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: auth debug = true 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.890 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on old message = true 2024-04-26T22:08:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on bug = true 2024-04-26T22:08:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:08:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: mon pg warn max object skew = 0 2024-04-26T22:08:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.891 INFO:teuthology.orchestra.run.smithi137.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default size = 2 2024-04-26T22:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow primary affinity = true 2024-04-26T22:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd allow pg remap = true 2024-04-26T22:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:08:00.892 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on no sortbitwise = false 2024-04-26T22:08:00.893 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:08:00.893 INFO:teuthology.orchestra.run.smithi137.stdout: mon warn on too few osds = false 2024-04-26T22:08:00.893 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:08:00.893 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:08:00.893 INFO:teuthology.orchestra.run.smithi137.stdout: mon_allow_pool_size_one = true 2024-04-26T22:08:00.893 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.894 INFO:teuthology.orchestra.run.smithi137.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:08:00.894 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.894 INFO:teuthology.orchestra.run.smithi137.stdout: osd default data pool replay window = 5 2024-04-26T22:08:00.894 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.894 INFO:teuthology.orchestra.run.smithi137.stdout: mon allow pool delete = true 2024-04-26T22:08:00.895 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.895 INFO:teuthology.orchestra.run.smithi137.stdout: mon cluster log file level = debug 2024-04-26T22:08:00.895 INFO:teuthology.orchestra.run.smithi137.stdout: debug asserts on shutdown = true 2024-04-26T22:08:00.895 INFO:teuthology.orchestra.run.smithi137.stdout: mon health detail to clog = false 2024-04-26T22:08:00.895 INFO:teuthology.orchestra.run.smithi137.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T22:08:00.895 INFO:teuthology.orchestra.run.smithi137.stdout: ms die on skipped message = False 2024-04-26T22:08:00.896 INFO:teuthology.orchestra.run.smithi137.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:08:00.896 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.896 INFO:teuthology.orchestra.run.smithi137.stdout:[osd] 2024-04-26T22:08:00.896 INFO:teuthology.orchestra.run.smithi137.stdout: osd journal size = 100 2024-04-26T22:08:00.896 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.897 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub load threshold = 5.0 2024-04-26T22:08:00.897 INFO:teuthology.orchestra.run.smithi137.stdout: osd scrub max interval = 600 2024-04-26T22:08:00.897 INFO:teuthology.orchestra.run.smithi137.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:08:00.897 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.897 INFO:teuthology.orchestra.run.smithi137.stdout: osd recover clone overlap = true 2024-04-26T22:08:00.897 INFO:teuthology.orchestra.run.smithi137.stdout: osd recovery max chunk = 1048576 2024-04-26T22:08:00.898 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.898 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug shutdown = true 2024-04-26T22:08:00.898 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug op order = true 2024-04-26T22:08:00.898 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug verify stray on activate = true 2024-04-26T22:08:00.898 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug trim objects = true 2024-04-26T22:08:00.898 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.899 INFO:teuthology.orchestra.run.smithi137.stdout: osd open classes on start = true 2024-04-26T22:08:00.899 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug pg log writeout = true 2024-04-26T22:08:00.899 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.899 INFO:teuthology.orchestra.run.smithi137.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:08:00.899 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.899 INFO:teuthology.orchestra.run.smithi137.stdout: osd map max advance = 10 2024-04-26T22:08:00.900 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.900 INFO:teuthology.orchestra.run.smithi137.stdout: journal zero on create = true 2024-04-26T22:08:00.900 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.900 INFO:teuthology.orchestra.run.smithi137.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:08:00.900 INFO:teuthology.orchestra.run.smithi137.stdout: filestore apply finisher threads = 3 2024-04-26T22:08:00.900 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.900 INFO:teuthology.orchestra.run.smithi137.stdout: bdev debug aio = true 2024-04-26T22:08:00.901 INFO:teuthology.orchestra.run.smithi137.stdout: osd debug misdirected ops = true 2024-04-26T22:08:00.901 INFO:teuthology.orchestra.run.smithi137.stdout: bdev async discard = True 2024-04-26T22:08:00.901 INFO:teuthology.orchestra.run.smithi137.stdout: bdev enable discard = True 2024-04-26T22:08:00.901 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore allocator = bitmap 2024-04-26T22:08:00.901 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore block size = 96636764160 2024-04-26T22:08:00.901 INFO:teuthology.orchestra.run.smithi137.stdout: bluestore fsck on mount = True 2024-04-26T22:08:00.902 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluefs = 1/20 2024-04-26T22:08:00.902 INFO:teuthology.orchestra.run.smithi137.stdout: debug bluestore = 1/20 2024-04-26T22:08:00.902 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.902 INFO:teuthology.orchestra.run.smithi137.stdout: debug osd = 20 2024-04-26T22:08:00.902 INFO:teuthology.orchestra.run.smithi137.stdout: debug rocksdb = 4/10 2024-04-26T22:08:00.902 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:08:00.903 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd full ratio = 0.9 2024-04-26T22:08:00.903 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:08:00.903 INFO:teuthology.orchestra.run.smithi137.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:08:00.903 INFO:teuthology.orchestra.run.smithi137.stdout: osd objectstore = bluestore 2024-04-26T22:08:00.903 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T22:08:00.904 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.904 INFO:teuthology.orchestra.run.smithi137.stdout:[mgr] 2024-04-26T22:08:00.904 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.904 INFO:teuthology.orchestra.run.smithi137.stdout: debug mgr = 20 2024-04-26T22:08:00.904 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T22:08:00.904 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T22:08:00.905 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:08:00.905 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:08:00.905 INFO:teuthology.orchestra.run.smithi137.stdout: mgr/telemetry/nag = false 2024-04-26T22:08:00.905 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T22:08:00.905 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.905 INFO:teuthology.orchestra.run.smithi137.stdout:[mon] 2024-04-26T22:08:00.906 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.906 INFO:teuthology.orchestra.run.smithi137.stdout: debug mon = 20 2024-04-26T22:08:00.906 INFO:teuthology.orchestra.run.smithi137.stdout: debug paxos = 20 2024-04-26T22:08:00.906 INFO:teuthology.orchestra.run.smithi137.stdout: debug auth = 20 2024-04-26T22:08:00.906 INFO:teuthology.orchestra.run.smithi137.stdout: mon data avail warn = 5 2024-04-26T22:08:00.906 INFO:teuthology.orchestra.run.smithi137.stdout: mon mgr mkfs grace = 240 2024-04-26T22:08:00.907 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:08:00.907 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd reporter subtree level = osd 2024-04-26T22:08:00.907 INFO:teuthology.orchestra.run.smithi137.stdout: mon osd prime pg temp = true 2024-04-26T22:08:00.907 INFO:teuthology.orchestra.run.smithi137.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:08:00.907 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.907 INFO:teuthology.orchestra.run.smithi137.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:08:00.908 INFO:teuthology.orchestra.run.smithi137.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:08:00.908 INFO:teuthology.orchestra.run.smithi137.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:08:00.908 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.908 INFO:teuthology.orchestra.run.smithi137.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:08:00.908 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:08:00.908 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:08:00.908 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.909 INFO:teuthology.orchestra.run.smithi137.stdout: # 1m isn't quite enough 2024-04-26T22:08:00.909 INFO:teuthology.orchestra.run.smithi137.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:08:00.909 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.909 INFO:teuthology.orchestra.run.smithi137.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:08:00.909 INFO:teuthology.orchestra.run.smithi137.stdout: mon down mkfs grace = 300 2024-04-26T22:08:00.909 INFO:teuthology.orchestra.run.smithi137.stdout: mon op complaint time = 120 2024-04-26T22:08:00.910 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:00.910 INFO:teuthology.orchestra.run.smithi137.stdout:[client] 2024-04-26T22:08:00.910 INFO:teuthology.orchestra.run.smithi137.stdout: rgw cache enabled = true 2024-04-26T22:08:00.910 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable ops log = true 2024-04-26T22:08:00.910 INFO:teuthology.orchestra.run.smithi137.stdout: rgw enable usage log = true 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout: client mount timeout = 600 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout: debug client = 20 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout: pid file = "" 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.a] 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.b] 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:[mon.c] 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.a] 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.c] 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.b] 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:[mds.d] 2024-04-26T22:08:00.911 INFO:teuthology.orchestra.run.smithi137.stdout:[mds] 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds = 20 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: debug mds balancer = 20 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: debug ms = 1 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug frag = True 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: mds debug scatterstat = True 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: mds op complaint time = 180 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: mds verify scatter = True 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: osd op complaint time = 180 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: rados mon op timeout = 900 2024-04-26T22:08:00.912 INFO:teuthology.orchestra.run.smithi137.stdout: rados osd op timeout = 900 2024-04-26T22:08:00.913 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-26T22:08:00.914 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-26T22:08:00.915 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-26T22:08:00.916 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.137,172.21.15.170,[v2:172.21.15.170:3301,v1:172.21.15.170:6790]" 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on skipped message = False 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 30fb29b0-57db-44cb-a9e0-8033deb0a091 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-26T22:08:00.917 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-26T22:08:00.918 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-26T22:08:00.919 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.920 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-26T22:08:00.921 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T22:08:00.921 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T22:08:00.921 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:08:00.921 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:08:00.921 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-26T22:08:00.921 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T22:08:00.921 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.921 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-26T22:08:00.921 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.922 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-26T22:08:00.922 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-26T22:08:00.922 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-26T22:08:00.922 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-26T22:08:00.922 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-26T22:08:00.922 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-26T22:08:00.922 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-26T22:08:00.922 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-26T22:08:00.923 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: mon down mkfs grace = 300 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = "" 2024-04-26T22:08:00.924 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = True 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2024-04-26T22:08:00.925 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = True 2024-04-26T22:08:00.926 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-04-26T22:08:00.926 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-04-26T22:08:00.926 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-04-26T22:08:00.926 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-26T22:08:01.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.053+0000 7fae7b0ea640 1 Processor -- start 2024-04-26T22:08:01.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.053+0000 7fae7b0ea640 1 -- start start 2024-04-26T22:08:01.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae7b0ea640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74073af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae7b0ea640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fae74074030 0x7fae740cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae7b0ea640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7415c530 con 0x7fae7415b930 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae7b0ea640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fae7415c810 con 0x7fae74074030 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae7b0ea640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fae7415caf0 con 0x7fae7415f4f0 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae73fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74073af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae79687640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fae74074030 0x7fae740cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae73fff640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74073af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:45028/0 (socket says 172.21.15.137:45028) 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae79687640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fae74074030 0x7fae740cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:40222/0 (socket says 172.21.15.137:40222) 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae78e86640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fae7415b930 0x7fae7415bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.137:36240/0 (socket says 172.21.15.137:36240) 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.054+0000 7fae73fff640 1 -- 172.21.15.137:0/1060024748 learned_addr learned my addr 172.21.15.137:0/1060024748 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.055+0000 7fae73fff640 1 -- 172.21.15.137:0/1060024748 >> v2:172.21.15.170:3300/0 conn(0x7fae74074030 msgr2=0x7fae740cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.055+0000 7fae73fff640 1 --2- 172.21.15.137:0/1060024748 >> v2:172.21.15.170:3300/0 conn(0x7fae74074030 0x7fae740cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.055 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.055+0000 7fae73fff640 1 -- 172.21.15.137:0/1060024748 >> v1:172.21.15.170:6789/0 conn(0x7fae7415b930 legacy=0x7fae7415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.055+0000 7fae73fff640 1 -- 172.21.15.137:0/1060024748 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7415cdd0 con 0x7fae7415f4f0 2024-04-26T22:08:01.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.055+0000 7fae737fe640 1 -- 172.21.15.137:0/1060024748 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171266826 0 0) 0x7fae7415c530 con 0x7fae7415b930 2024-04-26T22:08:01.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.055+0000 7fae79687640 1 --2- 172.21.15.137:0/1060024748 >> v2:172.21.15.170:3300/0 conn(0x7fae74074030 0x7fae740cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:08:01.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.055+0000 7fae73fff640 1 --2- 172.21.15.137:0/1060024748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74073af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fae68009870 tx=0x7fae6802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d089abb4bac12ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:01.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.055+0000 7fae737fe640 1 -- 172.21.15.137:0/1060024748 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68037070 con 0x7fae7415f4f0 2024-04-26T22:08:01.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae737fe640 1 -- 172.21.15.137:0/1060024748 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae68032440 con 0x7fae7415f4f0 2024-04-26T22:08:01.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae737fe640 1 -- 172.21.15.137:0/1060024748 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68032810 con 0x7fae7415f4f0 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae7b0ea640 1 -- 172.21.15.137:0/1060024748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 msgr2=0x7fae74073af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae7b0ea640 1 --2- 172.21.15.137:0/1060024748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74073af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fae68009870 tx=0x7fae6802a270 comp rx=0 tx=0).stop 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae7b0ea640 1 -- 172.21.15.137:0/1060024748 shutdown_connections 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae7b0ea640 1 --2- 172.21.15.137:0/1060024748 >> v2:172.21.15.170:3300/0 conn(0x7fae74074030 0x7fae740cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae7b0ea640 1 --2- 172.21.15.137:0/1060024748 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74073af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae7b0ea640 1 -- 172.21.15.137:0/1060024748 >> 172.21.15.137:0/1060024748 conn(0x7fae740cd8a0 msgr2=0x7fae740cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae7b0ea640 1 -- 172.21.15.137:0/1060024748 shutdown_connections 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.056+0000 7fae7b0ea640 1 -- 172.21.15.137:0/1060024748 wait complete. 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.057+0000 7fae7b0ea640 1 Processor -- start 2024-04-26T22:08:01.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.057+0000 7fae7b0ea640 1 -- start start 2024-04-26T22:08:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae7b0ea640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae74074030 0x7fae741f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae7b0ea640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae7415b930 0x7fae740afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae7b0ea640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae7b0ea640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fae740cf7a0 con 0x7fae74074030 2024-04-26T22:08:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae7b0ea640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fae7406fdd0 con 0x7fae7415b930 2024-04-26T22:08:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae7b0ea640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fae740cf920 con 0x7fae7415f4f0 2024-04-26T22:08:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae78e86640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae74074030 0x7fae741f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae78e86640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae74074030 0x7fae741f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39390/0 (socket says 172.21.15.137:39390) 2024-04-26T22:08:01.061 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae73fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae7415b930 0x7fae740afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae79687640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.058+0000 7fae78e86640 1 -- 172.21.15.137:0/2105463706 learned_addr learned my addr 172.21.15.137:0/2105463706 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae78e86640 1 -- 172.21.15.137:0/2105463706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 msgr2=0x7fae74156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae78e86640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae78e86640 1 -- 172.21.15.137:0/2105463706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae7415b930 msgr2=0x7fae740afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae78e86640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae7415b930 0x7fae740afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae78e86640 1 -- 172.21.15.137:0/2105463706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae740b0160 con 0x7fae74074030 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae73fff640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae7415b930 0x7fae740afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae79687640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae78e86640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae74074030 0x7fae741f5b50 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fae6400c500 tx=0x7fae6400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae717fa640 1 -- 172.21.15.137:0/2105463706 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64018070 con 0x7fae74074030 2024-04-26T22:08:01.062 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae717fa640 1 -- 172.21.15.137:0/2105463706 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae64007500 con 0x7fae74074030 2024-04-26T22:08:01.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae717fa640 1 -- 172.21.15.137:0/2105463706 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64004a20 con 0x7fae74074030 2024-04-26T22:08:01.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae740b0400 con 0x7fae74074030 2024-04-26T22:08:01.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.059+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae741e5610 con 0x7fae74074030 2024-04-26T22:08:01.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.060+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7406a290 con 0x7fae74074030 2024-04-26T22:08:01.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.060+0000 7fae717fa640 1 -- 172.21.15.137:0/2105463706 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae64004bc0 con 0x7fae74074030 2024-04-26T22:08:01.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.061+0000 7fae717fa640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae6006c8f0 0x7fae6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.061+0000 7fae717fa640 1 -- 172.21.15.137:0/2105463706 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fae6408ad60 con 0x7fae74074030 2024-04-26T22:08:01.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.061+0000 7fae73fff640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae6006c8f0 0x7fae6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.063 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.061+0000 7fae73fff640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae6006c8f0 0x7fae6006edb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fae68034000 tx=0x7fae6802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:01.065 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.065+0000 7fae717fa640 1 -- 172.21.15.137:0/2105463706 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fae64058aa0 con 0x7fae74074030 2024-04-26T22:08:01.285 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.285+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) -- 0x7fae740d0560 con 0x7fae74074030 2024-04-26T22:08:01.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.427+0000 7fae717fa640 1 -- 172.21.15.137:0/2105463706 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v90) ==== 162+0+0 (secure 0 0 0) 0x7fae6405cda0 con 0x7fae74074030 2024-04-26T22:08:01.427 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-26T22:08:01.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae6006c8f0 msgr2=0x7fae6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae6006c8f0 0x7fae6006edb0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fae68034000 tx=0x7fae6802e000 comp rx=0 tx=0).stop 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae74074030 msgr2=0x7fae741f5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae74074030 0x7fae741f5b50 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fae6400c500 tx=0x7fae6400c900 comp rx=0 tx=0).stop 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 shutdown_connections 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fae6006c8f0 0x7fae6006edb0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fae7415f4f0 0x7fae74156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae7415b930 0x7fae740afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 --2- 172.21.15.137:0/2105463706 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fae74074030 0x7fae741f5b50 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 >> 172.21.15.137:0/2105463706 conn(0x7fae740cd8a0 msgr2=0x7fae740b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 shutdown_connections 2024-04-26T22:08:01.431 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.430+0000 7fae7b0ea640 1 -- 172.21.15.137:0/2105463706 wait complete. 2024-04-26T22:08:01.443 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:08:01.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.540+0000 7fe16136a640 1 Processor -- start 2024-04-26T22:08:01.539 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.540+0000 7fe16136a640 1 -- start start 2024-04-26T22:08:01.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.540+0000 7fe16136a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe15c15f370 0x7fe15c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.540+0000 7fe16136a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 0x7fe15c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.540+0000 7fe16136a640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe15c0d03a0 con 0x7fe15c15f750 2024-04-26T22:08:01.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.540+0000 7fe16136a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe15c0b4d10 con 0x7fe15c15f370 2024-04-26T22:08:01.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.540+0000 7fe16136a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c0d0680 con 0x7fe15c0d3ee0 2024-04-26T22:08:01.541 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.540+0000 7fe15a7fc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fe15c15f750 0x7fe15c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47848/0 (socket says 172.21.15.137:47848) 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe15a7fc640 1 -- 172.21.15.137:0/2477451702 learned_addr learned my addr 172.21.15.137:0/2477451702 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe15b7fe640 1 --2- 172.21.15.137:0/2477451702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 0x7fe15c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe15affd640 1 --2- 172.21.15.137:0/2477451702 >> v2:172.21.15.170:3300/0 conn(0x7fe15c15f370 0x7fe15c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe159ffb640 1 -- 172.21.15.137:0/2477451702 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081835928 0 0) 0x7fe15c0d03a0 con 0x7fe15c15f750 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe159ffb640 1 -- 172.21.15.137:0/2477451702 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe144003520 con 0x7fe15c15f750 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe15affd640 1 -- 172.21.15.137:0/2477451702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 msgr2=0x7fe15c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe15affd640 1 --2- 172.21.15.137:0/2477451702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 0x7fe15c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe15affd640 1 -- 172.21.15.137:0/2477451702 >> v1:172.21.15.137:6789/0 conn(0x7fe15c15f750 legacy=0x7fe15c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe15affd640 1 -- 172.21.15.137:0/2477451702 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c0d0960 con 0x7fe15c15f370 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.541+0000 7fe15b7fe640 1 --2- 172.21.15.137:0/2477451702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 0x7fe15c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:08:01.542 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe15affd640 1 --2- 172.21.15.137:0/2477451702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe15c15f370 0x7fe15c0cfd70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe1540097a0 tx=0x7fe15402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f16575fcb373d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:01.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe159ffb640 1 -- 172.21.15.137:0/2477451702 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154037070 con 0x7fe15c15f370 2024-04-26T22:08:01.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe159ffb640 1 -- 172.21.15.137:0/2477451702 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe154032440 con 0x7fe15c15f370 2024-04-26T22:08:01.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe159ffb640 1 -- 172.21.15.137:0/2477451702 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1540327f0 con 0x7fe15c15f370 2024-04-26T22:08:01.545 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe16136a640 1 -- 172.21.15.137:0/2477451702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe15c15f370 msgr2=0x7fe15c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe16136a640 1 --2- 172.21.15.137:0/2477451702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe15c15f370 0x7fe15c0cfd70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe1540097a0 tx=0x7fe15402a180 comp rx=0 tx=0).stop 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe16136a640 1 -- 172.21.15.137:0/2477451702 shutdown_connections 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe16136a640 1 --2- 172.21.15.137:0/2477451702 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 0x7fe15c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe16136a640 1 --2- 172.21.15.137:0/2477451702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe15c15f370 0x7fe15c0cfd70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe16136a640 1 -- 172.21.15.137:0/2477451702 >> 172.21.15.137:0/2477451702 conn(0x7fe15c08ec10 msgr2=0x7fe15c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe16136a640 1 -- 172.21.15.137:0/2477451702 shutdown_connections 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.542+0000 7fe16136a640 1 -- 172.21.15.137:0/2477451702 wait complete. 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.544+0000 7fe16136a640 1 Processor -- start 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.544+0000 7fe16136a640 1 -- start start 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.544+0000 7fe16136a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 0x7fe15c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.544+0000 7fe16136a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c15f370 0x7fe15c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.546 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.544+0000 7fe16136a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe15c15f750 0x7fe15c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.544+0000 7fe16136a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c0b51c0 con 0x7fe15c15f370 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.544+0000 7fe16136a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c0d0f20 con 0x7fe15c15f750 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.544+0000 7fe16136a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c0b5340 con 0x7fe15c0d3ee0 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c15f370 0x7fe15c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c15f370 0x7fe15c0ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39392/0 (socket says 172.21.15.137:39392) 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15a7fc640 1 -- 172.21.15.137:0/2626600550 learned_addr learned my addr 172.21.15.137:0/2626600550 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15affd640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 0x7fe15c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15b7fe640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe15c15f750 0x7fe15c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15a7fc640 1 -- 172.21.15.137:0/2626600550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 msgr2=0x7fe15c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15a7fc640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 0x7fe15c153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15a7fc640 1 -- 172.21.15.137:0/2626600550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe15c15f750 msgr2=0x7fe15c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15a7fc640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe15c15f750 0x7fe15c0ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15a7fc640 1 -- 172.21.15.137:0/2626600550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c0cb990 con 0x7fe15c15f370 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe15a7fc640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c15f370 0x7fe15c0ce490 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fe15000caa0 tx=0x7fe15000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:01.547 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe1437fe640 1 -- 172.21.15.137:0/2626600550 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe150017070 con 0x7fe15c15f370 2024-04-26T22:08:01.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe1437fe640 1 -- 172.21.15.137:0/2626600550 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15000ac00 con 0x7fe15c15f370 2024-04-26T22:08:01.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15c161830 con 0x7fe15c15f370 2024-04-26T22:08:01.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe1437fe640 1 -- 172.21.15.137:0/2626600550 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe150012400 con 0x7fe15c15f370 2024-04-26T22:08:01.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.545+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15c161df0 con 0x7fe15c15f370 2024-04-26T22:08:01.548 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.546+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe15c06a290 con 0x7fe15c15f370 2024-04-26T22:08:01.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.547+0000 7fe1437fe640 1 -- 172.21.15.137:0/2626600550 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe15001a070 con 0x7fe15c15f370 2024-04-26T22:08:01.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.547+0000 7fe1437fe640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe14806c920 0x7fe14806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:01.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.547+0000 7fe1437fe640 1 -- 172.21.15.137:0/2626600550 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fe15008ba30 con 0x7fe15c15f370 2024-04-26T22:08:01.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.547+0000 7fe15affd640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe14806c920 0x7fe14806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:01.549 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.547+0000 7fe15affd640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe14806c920 0x7fe14806ede0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe154034000 tx=0x7fe15402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:01.551 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.551+0000 7fe1437fe640 1 -- 172.21.15.137:0/2626600550 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe150059d30 con 0x7fe15c15f370 2024-04-26T22:08:01.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.768+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe15c153a80 con 0x7fe15c15f370 2024-04-26T22:08:01.769 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.769+0000 7fe1437fe640 1 -- 172.21.15.137:0/2626600550 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+5190 (secure 0 0 0) 0x7fe150059630 con 0x7fe15c15f370 2024-04-26T22:08:01.769 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:01.769 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":90,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:08:01.427343+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9270":{"gid":9270,"name":"a","rank":0,"incarnation":90,"state":"up:replay","state_seq":1,"addr":"172.21.15.137:6837/3437790809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3437790809},{"type":"v1","addr":"172.21.15.137:6837","nonce":3437790809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-26T22:08:01.769 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 90 2024-04-26T22:08:01.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe14806c920 msgr2=0x7fe14806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe14806c920 0x7fe14806ede0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe154034000 tx=0x7fe15402e000 comp rx=0 tx=0).stop 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c15f370 msgr2=0x7fe15c0ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c15f370 0x7fe15c0ce490 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fe15000caa0 tx=0x7fe15000cf60 comp rx=0 tx=0).stop 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 shutdown_connections 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe14806c920 0x7fe14806ede0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe15c15f370 0x7fe15c0ce490 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe15c15f750 0x7fe15c0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 --2- 172.21.15.137:0/2626600550 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe15c0d3ee0 0x7fe15c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 >> 172.21.15.137:0/2626600550 conn(0x7fe15c08ec10 msgr2=0x7fe15c06d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 shutdown_connections 2024-04-26T22:08:01.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:01.771+0000 7fe16136a640 1 -- 172.21.15.137:0/2626600550 wait complete. 2024-04-26T22:08:02.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:07:36.895650+0000', 'modified': '2024-04-26T22:08:01.427343+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 117, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9270': {'gid': 9270, 'name': 'a', 'rank': 0, 'incarnation': 90, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.137:6837/3437790809', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 3437790809}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 3437790809}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:08:02.185 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9270:up:replay 2024-04-26T22:08:03.186 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:08:03.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.295+0000 7fa5c44c5640 1 Processor -- start 2024-04-26T22:08:03.295 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.295+0000 7fa5c44c5640 1 -- start start 2024-04-26T22:08:03.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.296+0000 7fa5c44c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0d3ee0 0x7fa5bc0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:03.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.296+0000 7fa5c44c5640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc0d03a0 con 0x7fa5bc15f370 2024-04-26T22:08:03.299 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.296+0000 7fa5c44c5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc0d0680 con 0x7fa5bc15f750 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.296+0000 7fa5c44c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa5bc0d0960 con 0x7fa5bc0d3ee0 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c2261640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa5bc15f370 0x7fa5bc0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47854/0 (socket says 172.21.15.137:47854) 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c2261640 1 -- 172.21.15.137:0/268285352 learned_addr learned my addr 172.21.15.137:0/268285352 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c1a60640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0d3ee0 0x7fa5bc0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860080068 0 0) 0x7fa5bc0d03a0 con 0x7fa5bc15f370 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5a8003520 con 0x7fa5bc15f370 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2567802347 0 0) 0x7fa5a8003520 con 0x7fa5bc15f370 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0d3ee0 msgr2=0x7fa5bc0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0d3ee0 0x7fa5bc0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 >> v1:172.21.15.170:6789/0 conn(0x7fa5bc15f750 legacy=0x7fa5bc0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc0d0c40 con 0x7fa5bc15f370 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fa5b0001670 con 0x7fa5bc15f370 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 >> v1:172.21.15.137:6789/0 conn(0x7fa5bc15f370 legacy=0x7fa5bc0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:03.300 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0d3ee0 0x7fa5a80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc0d0960 con 0x7fa5a8003f60 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a800baa0 con 0x7fa5a8004d40 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a800bca0 con 0x7fa5bc0d3ee0 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c1a60640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.297+0000 7fa5c2261640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0d3ee0 0x7fa5a80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.298+0000 7fa5c2a62640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.298+0000 7fa5c1a60640 1 -- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0d3ee0 msgr2=0x7fa5a80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.298+0000 7fa5c1a60640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0d3ee0 0x7fa5a80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.298+0000 7fa5c1a60640 1 -- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a8004d40 msgr2=0x7fa5a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.298+0000 7fa5c1a60640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a8004d40 0x7fa5a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.298+0000 7fa5c1a60640 1 -- 172.21.15.137:0/268285352 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a8003520 con 0x7fa5a8003f60 2024-04-26T22:08:03.301 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.298+0000 7fa5c2261640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0d3ee0 0x7fa5a80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.298+0000 7fa5c1a60640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5a8004800 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009ac0 tx=0x7fa5a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e6f10c2a1c75ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8036070 con 0x7fa5a8003f60 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b8031400 con 0x7fa5a8003f60 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c125f640 1 -- 172.21.15.137:0/268285352 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8009690 con 0x7fa5a8003f60 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c44c5640 1 -- 172.21.15.137:0/268285352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 msgr2=0x7fa5a8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c44c5640 1 --2- 172.21.15.137:0/268285352 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5a8004800 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009ac0 tx=0x7fa5a8005830 comp rx=0 tx=0).stop 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c2a62640 1 -- 172.21.15.137:0/268285352 reap_dead start 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c44c5640 1 -- 172.21.15.137:0/268285352 shutdown_connections 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c44c5640 1 -- 172.21.15.137:0/268285352 >> 172.21.15.137:0/268285352 conn(0x7fa5bc08ec10 msgr2=0x7fa5bc09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c44c5640 1 -- 172.21.15.137:0/268285352 shutdown_connections 2024-04-26T22:08:03.302 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.299+0000 7fa5c44c5640 1 -- 172.21.15.137:0/268285352 wait complete. 2024-04-26T22:08:03.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.300+0000 7fa5c44c5640 1 Processor -- start 2024-04-26T22:08:03.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c44c5640 1 -- start start 2024-04-26T22:08:03.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c44c5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5bc1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:03.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c44c5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0b9f10 0x7fa5bc0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:03.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c44c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5bc0cec30 0x7fa5bc0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:03.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c44c5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc0cfef0 con 0x7fa5a8003f60 2024-04-26T22:08:03.305 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c44c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc0cfd70 con 0x7fa5bc0cec30 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c44c5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa5bc0d0070 con 0x7fa5bc0b9f10 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c2261640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5bc1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c2261640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5bc1f5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39412/0 (socket says 172.21.15.137:39412) 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.301+0000 7fa5c2261640 1 -- 172.21.15.137:0/129152445 learned_addr learned my addr 172.21.15.137:0/129152445 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5c1a60640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0b9f10 0x7fa5bc0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5c2261640 1 -- 172.21.15.137:0/129152445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0b9f10 msgr2=0x7fa5bc0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5c2261640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0b9f10 0x7fa5bc0ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5c2261640 1 -- 172.21.15.137:0/129152445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5bc0cec30 msgr2=0x7fa5bc0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5c2261640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5bc0cec30 0x7fa5bc0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5c2261640 1 -- 172.21.15.137:0/129152445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc0c8e10 con 0x7fa5a8003f60 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5c2261640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5bc1f5c20 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0007b60 tx=0x7fa5b0004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5aeffd640 1 -- 172.21.15.137:0/129152445 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b001a070 con 0x7fa5a8003f60 2024-04-26T22:08:03.306 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5aeffd640 1 -- 172.21.15.137:0/129152445 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b000faf0 con 0x7fa5a8003f60 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5bc0c90f0 con 0x7fa5a8003f60 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5aeffd640 1 -- 172.21.15.137:0/129152445 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000fea0 con 0x7fa5a8003f60 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.302+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5bc0c96b0 con 0x7fa5a8003f60 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.303+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5bc0cf050 con 0x7fa5a8003f60 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.303+0000 7fa5aeffd640 1 -- 172.21.15.137:0/129152445 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5b001d070 con 0x7fa5a8003f60 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.304+0000 7fa5aeffd640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa5a006c8f0 0x7fa5a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.304+0000 7fa5c1a60640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa5a006c8f0 0x7fa5a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.304+0000 7fa5aeffd640 1 -- 172.21.15.137:0/129152445 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fa5b008b860 con 0x7fa5a8003f60 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.304+0000 7fa5c1a60640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa5a006c8f0 0x7fa5a006edb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8033000 tx=0x7fa5b8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:03.307 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.308+0000 7fa5aeffd640 1 -- 172.21.15.137:0/129152445 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa5b0059c70 con 0x7fa5a8003f60 2024-04-26T22:08:03.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.523+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5bc0c9a90 con 0x7fa5a8003f60 2024-04-26T22:08:03.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.524+0000 7fa5aeffd640 1 -- 172.21.15.137:0/129152445 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+5190 (secure 0 0 0) 0x7fa5bc0c9a90 con 0x7fa5a8003f60 2024-04-26T22:08:03.524 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:03.524 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":92,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:08:02.433845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9270":{"gid":9270,"name":"a","rank":0,"incarnation":90,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.137:6837/3437790809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3437790809},{"type":"v1","addr":"172.21.15.137:6837","nonce":3437790809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":8}]} 2024-04-26T22:08:03.525 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 92 2024-04-26T22:08:03.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.525+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa5a006c8f0 msgr2=0x7fa5a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:03.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.525+0000 7fa5c44c5640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa5a006c8f0 0x7fa5a006edb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8033000 tx=0x7fa5b8008030 comp rx=0 tx=0).stop 2024-04-26T22:08:03.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 msgr2=0x7fa5bc1f5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:03.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5bc1f5c20 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0007b60 tx=0x7fa5b0004f70 comp rx=0 tx=0).stop 2024-04-26T22:08:03.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 shutdown_connections 2024-04-26T22:08:03.526 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa5a006c8f0 0x7fa5a006edb0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:03.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5bc0cec30 0x7fa5bc0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:03.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa5bc0b9f10 0x7fa5bc0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:03.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 --2- 172.21.15.137:0/129152445 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa5a8003f60 0x7fa5bc1f5c20 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:03.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 >> 172.21.15.137:0/129152445 conn(0x7fa5bc08ec10 msgr2=0x7fa5bc06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:03.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 shutdown_connections 2024-04-26T22:08:03.527 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:03.526+0000 7fa5c44c5640 1 -- 172.21.15.137:0/129152445 wait complete. 2024-04-26T22:08:03.939 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:07:36.895650+0000', 'modified': '2024-04-26T22:08:02.433845+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 117, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9270': {'gid': 9270, 'name': 'a', 'rank': 0, 'incarnation': 90, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.137:6837/3437790809', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 3437790809}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 3437790809}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-26T22:08:03.939 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9270:up:rejoin 2024-04-26T22:08:04.940 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:08:05.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.049+0000 7fca05baf640 1 Processor -- start 2024-04-26T22:08:05.049 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.049+0000 7fca05baf640 1 -- start start 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fca05baf640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fca0015b4e0 0x7fca00071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fca05baf640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fca0015b8c0 0x7fca000cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fca05baf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 0x7fca0006ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fca05baf640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fca000ce230 con 0x7fca0015b8c0 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fca05baf640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fca000733e0 con 0x7fca0015b4e0 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fca05baf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fca00072f00 con 0x7fca00073820 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fc9feffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fca0015b8c0 0x7fca000cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fc9feffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fca0015b8c0 0x7fca000cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39424/0 (socket says 172.21.15.137:39424) 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fc9feffd640 1 -- 172.21.15.137:0/2802176898 learned_addr learned my addr 172.21.15.137:0/2802176898 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fc9fffff640 1 --2- 172.21.15.137:0/2802176898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 0x7fca0006ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.051 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fc9feffd640 1 -- 172.21.15.137:0/2802176898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 msgr2=0x7fca0006ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fc9feffd640 1 --2- 172.21.15.137:0/2802176898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 0x7fca0006ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fc9feffd640 1 -- 172.21.15.137:0/2802176898 >> v2:172.21.15.170:3300/0 conn(0x7fca0015b4e0 msgr2=0x7fca00071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fc9feffd640 1 --2- 172.21.15.137:0/2802176898 >> v2:172.21.15.170:3300/0 conn(0x7fca0015b4e0 0x7fca00071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.050+0000 7fc9feffd640 1 -- 172.21.15.137:0/2802176898 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca00072660 con 0x7fca0015b8c0 2024-04-26T22:08:05.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.051+0000 7fc9feffd640 1 --2- 172.21.15.137:0/2802176898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 0x7fca000cdcf0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fca000b3ba0 tx=0x7fc9e802b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cec58d5cdf4b15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.051+0000 7fc9fe7fc640 1 -- 172.21.15.137:0/2802176898 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e800b040 con 0x7fca0015b8c0 2024-04-26T22:08:05.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.051+0000 7fc9fe7fc640 1 -- 172.21.15.137:0/2802176898 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8030710 con 0x7fca0015b8c0 2024-04-26T22:08:05.052 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.051+0000 7fc9fe7fc640 1 -- 172.21.15.137:0/2802176898 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8030ae0 con 0x7fca0015b8c0 2024-04-26T22:08:05.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.052+0000 7fca05baf640 1 -- 172.21.15.137:0/2802176898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 msgr2=0x7fca000cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.052+0000 7fca05baf640 1 --2- 172.21.15.137:0/2802176898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 0x7fca000cdcf0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fca000b3ba0 tx=0x7fc9e802b5a0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.052+0000 7fca05baf640 1 -- 172.21.15.137:0/2802176898 shutdown_connections 2024-04-26T22:08:05.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.052+0000 7fca05baf640 1 --2- 172.21.15.137:0/2802176898 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 0x7fca0006ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.053 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.052+0000 7fca05baf640 1 --2- 172.21.15.137:0/2802176898 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 0x7fca000cdcf0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.052+0000 7fca05baf640 1 --2- 172.21.15.137:0/2802176898 >> v2:172.21.15.170:3300/0 conn(0x7fca0015b4e0 0x7fca00071fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.052+0000 7fca05baf640 1 -- 172.21.15.137:0/2802176898 >> 172.21.15.137:0/2802176898 conn(0x7fca000d0d30 msgr2=0x7fca000d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:05.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.052+0000 7fca05baf640 1 -- 172.21.15.137:0/2802176898 shutdown_connections 2024-04-26T22:08:05.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.052+0000 7fca05baf640 1 -- 172.21.15.137:0/2802176898 wait complete. 2024-04-26T22:08:05.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.053+0000 7fca05baf640 1 Processor -- start 2024-04-26T22:08:05.054 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.053+0000 7fca05baf640 1 -- start start 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fca05baf640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 0x7fca000cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fca05baf640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca0015b4e0 0x7fca00153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fca05baf640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 0x7fca00154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fca05baf640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fca000b3e80 con 0x7fca0015b8c0 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fca05baf640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fca00072c20 con 0x7fca0015b4e0 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fca05baf640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fca0006f0f0 con 0x7fca00073820 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9fffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 0x7fca00154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9fffff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 0x7fca00154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:39426/0 (socket says 172.21.15.137:39426) 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9fffff640 1 -- 172.21.15.137:0/1131055859 learned_addr learned my addr 172.21.15.137:0/1131055859 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.056 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9ff7fe640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 0x7fca000cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9feffd640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca0015b4e0 0x7fca00153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9fffff640 1 -- 172.21.15.137:0/1131055859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 msgr2=0x7fca000cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9fffff640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 0x7fca000cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9fffff640 1 -- 172.21.15.137:0/1131055859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca0015b4e0 msgr2=0x7fca00153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9fffff640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca0015b4e0 0x7fca00153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9fffff640 1 -- 172.21.15.137:0/1131055859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0014b0f0 con 0x7fca0015b8c0 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.054+0000 7fc9feffd640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca0015b4e0 0x7fca00153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.055+0000 7fc9fffff640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 0x7fca00154420 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800cd70 tx=0x7fc9f800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.055+0000 7fc9f7fff640 1 -- 172.21.15.137:0/1131055859 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8003b90 con 0x7fca0015b8c0 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.055+0000 7fc9f7fff640 1 -- 172.21.15.137:0/1131055859 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f8003d30 con 0x7fca0015b8c0 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.055+0000 7fc9f7fff640 1 -- 172.21.15.137:0/1131055859 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8004240 con 0x7fca0015b8c0 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.055+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca000d00f0 con 0x7fca0015b8c0 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.055+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0015bd90 con 0x7fca0015b8c0 2024-04-26T22:08:05.057 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.056+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca0006a290 con 0x7fca0015b8c0 2024-04-26T22:08:05.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.056+0000 7fc9f7fff640 1 -- 172.21.15.137:0/1131055859 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9f80043e0 con 0x7fca0015b8c0 2024-04-26T22:08:05.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.057+0000 7fc9f7fff640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc9e006c8f0 0x7fc9e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.057+0000 7fc9ff7fe640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc9e006c8f0 0x7fc9e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.057+0000 7fc9f7fff640 1 -- 172.21.15.137:0/1131055859 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fc9f808c680 con 0x7fca0015b8c0 2024-04-26T22:08:05.058 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.057+0000 7fc9ff7fe640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc9e006c8f0 0x7fc9e006edb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009990 tx=0x7fc9f0009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.060 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.061+0000 7fc9f7fff640 1 -- 172.21.15.137:0/1131055859 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fca000d00f0 con 0x7fca0015b8c0 2024-04-26T22:08:05.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.271+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca0015f480 con 0x7fca0015b8c0 2024-04-26T22:08:05.271 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.272+0000 7fc9f7fff640 1 -- 172.21.15.137:0/1131055859 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5197 (secure 0 0 0) 0x7fc9f805aa00 con 0x7fca0015b8c0 2024-04-26T22:08:05.272 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:05.272 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:08:04.441136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9270":{"gid":9270,"name":"a","rank":0,"incarnation":90,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/3437790809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3437790809},{"type":"v1","addr":"172.21.15.137:6837","nonce":3437790809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9270,"qdb_cluster":[9270]},"id":8}]} 2024-04-26T22:08:05.272 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 93 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.273+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc9e006c8f0 msgr2=0x7fc9e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.273+0000 7fca05baf640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc9e006c8f0 0x7fc9e006edb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009990 tx=0x7fc9f0009110 comp rx=0 tx=0).stop 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 msgr2=0x7fca00154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 0x7fca00154420 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800cd70 tx=0x7fc9f800a660 comp rx=0 tx=0).stop 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 shutdown_connections 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc9e006c8f0 0x7fc9e006edb0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fca0015b8c0 0x7fca00154420 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca0015b4e0 0x7fca00153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 --2- 172.21.15.137:0/1131055859 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fca00073820 0x7fca000cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 >> 172.21.15.137:0/1131055859 conn(0x7fca000d0d30 msgr2=0x7fca000b5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:05.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 shutdown_connections 2024-04-26T22:08:05.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.274+0000 7fca05baf640 1 -- 172.21.15.137:0/1131055859 wait complete. 2024-04-26T22:08:05.688 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T22:07:36.895650+0000', 'modified': '2024-04-26T22:08:04.441136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 117, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9270': {'gid': 9270, 'name': 'a', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.137:6837/3437790809', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.137:6835', 'nonce': 3437790809}, {'type': 'v1', 'addr': '172.21.15.137:6837', 'nonce': 3437790809}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9270, 'qdb_cluster': [9270]} 2024-04-26T22:08:05.688 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T22:08:05.689 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T22:08:05.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.789+0000 7fc204a46640 1 Processor -- start 2024-04-26T22:08:05.789 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.789+0000 7fc204a46640 1 -- start start 2024-04-26T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc204a46640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc200148a30 0x7fc200073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc204a46640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2000b3af0 0x7fc2000b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc204a46640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2000cfa80 con 0x7fc200160640 2024-04-26T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc204a46640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc2000cfd60 con 0x7fc2000b3af0 2024-04-26T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc204a46640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc2000d0040 con 0x7fc200148a30 2024-04-26T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc1fed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2000b3af0 0x7fc2000b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc1fed9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2000b3af0 0x7fc2000b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52500/0 (socket says 172.21.15.137:52500) 2024-04-26T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc1fed9d640 1 -- 172.21.15.137:0/3879627537 learned_addr learned my addr 172.21.15.137:0/3879627537 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.790 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc1fed9d640 1 -- 172.21.15.137:0/3879627537 >> v2:172.21.15.170:3300/0 conn(0x7fc200148a30 msgr2=0x7fc200073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/3879627537 >> v2:172.21.15.170:3300/0 conn(0x7fc200148a30 0x7fc200073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc1fed9d640 1 -- 172.21.15.137:0/3879627537 >> v1:172.21.15.170:6789/0 conn(0x7fc200160640 legacy=0x7fc2001636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.791 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.790+0000 7fc1fed9d640 1 -- 172.21.15.137:0/3879627537 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc200162ea0 con 0x7fc2000b3af0 2024-04-26T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/3879627537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 0x7fc2000b3fa0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fc2000cf6d0 tx=0x7fc1f802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82904cc51501516a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc1fd59a640 1 -- 172.21.15.137:0/3879627537 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8036070 con 0x7fc2000b3af0 2024-04-26T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc1fd59a640 1 -- 172.21.15.137:0/3879627537 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f8031600 con 0x7fc2000b3af0 2024-04-26T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc1fd59a640 1 -- 172.21.15.137:0/3879627537 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f80319d0 con 0x7fc2000b3af0 2024-04-26T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc204a46640 1 -- 172.21.15.137:0/3879627537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 msgr2=0x7fc2000b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc204a46640 1 --2- 172.21.15.137:0/3879627537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 0x7fc2000b3fa0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fc2000cf6d0 tx=0x7fc1f802a660 comp rx=0 tx=0).stop 2024-04-26T22:08:05.792 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc204a46640 1 -- 172.21.15.137:0/3879627537 shutdown_connections 2024-04-26T22:08:05.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc204a46640 1 --2- 172.21.15.137:0/3879627537 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 0x7fc2000b3fa0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc204a46640 1 --2- 172.21.15.137:0/3879627537 >> v2:172.21.15.170:3300/0 conn(0x7fc200148a30 0x7fc200073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.791+0000 7fc204a46640 1 -- 172.21.15.137:0/3879627537 >> 172.21.15.137:0/3879627537 conn(0x7fc2000ce8b0 msgr2=0x7fc2000cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:05.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.792+0000 7fc204a46640 1 -- 172.21.15.137:0/3879627537 shutdown_connections 2024-04-26T22:08:05.793 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.792+0000 7fc204a46640 1 -- 172.21.15.137:0/3879627537 wait complete. 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.793+0000 7fc204a46640 1 Processor -- start 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.793+0000 7fc204a46640 1 -- start start 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.793+0000 7fc204a46640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 0x7fc20013ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.793+0000 7fc204a46640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc200148a30 0x7fc2000aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.793+0000 7fc204a46640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc200160640 0x7fc2000af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.793+0000 7fc204a46640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc200074410 con 0x7fc2000b3af0 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.793+0000 7fc204a46640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc200163db0 con 0x7fc200160640 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.793+0000 7fc204a46640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc200074590 con 0x7fc200148a30 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1fe59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 0x7fc20013ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.796 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1fe59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 0x7fc20013ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52506/0 (socket says 172.21.15.137:52506) 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1fe59c640 1 -- 172.21.15.137:0/3870562125 learned_addr learned my addr 172.21.15.137:0/3870562125 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1fe59c640 1 -- 172.21.15.137:0/3870562125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc200148a30 msgr2=0x7fc2000aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc200148a30 0x7fc2000aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1fe59c640 1 -- 172.21.15.137:0/3870562125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc200160640 msgr2=0x7fc2000af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc200160640 0x7fc2000af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1fe59c640 1 -- 172.21.15.137:0/3870562125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc200141440 con 0x7fc2000b3af0 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 0x7fc20013ff40 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400b4d0 tx=0x7fc1f400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1eeffd640 1 -- 172.21.15.137:0/3870562125 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4014070 con 0x7fc2000b3af0 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1eeffd640 1 -- 172.21.15.137:0/3870562125 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f4010870 con 0x7fc2000b3af0 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc204a46640 1 -- 172.21.15.137:0/3870562125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc200141720 con 0x7fc2000b3af0 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc1eeffd640 1 -- 172.21.15.137:0/3870562125 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4010c60 con 0x7fc2000b3af0 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.794+0000 7fc204a46640 1 -- 172.21.15.137:0/3870562125 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2001423f0 con 0x7fc2000b3af0 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.796+0000 7fc1eeffd640 1 -- 172.21.15.137:0/3870562125 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc1f4017070 con 0x7fc2000b3af0 2024-04-26T22:08:05.797 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.796+0000 7fc1eeffd640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1e006c8f0 0x7fc1e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.796+0000 7fc1eeffd640 1 -- 172.21.15.137:0/3870562125 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fc1f408ba20 con 0x7fc2000b3af0 2024-04-26T22:08:05.798 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.796+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1e006c8f0 0x7fc1e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.797+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1e006c8f0 0x7fc1e006edb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0006fd0 tx=0x7fc1f0006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.797+0000 7fc207835740 1 Processor -- start 2024-04-26T22:08:05.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.797+0000 7fc207835740 1 -- start start 2024-04-26T22:08:05.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc207835740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 0x55883bf98820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc207835740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfb5ce0 0x55883bfb6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc207835740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf6e120 0x55883bfb43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc207835740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55883bed2740 con 0x55883bf6e120 2024-04-26T22:08:05.805 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc207835740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55883be6e3a0 con 0x55883bf98440 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc207835740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55883bece700 con 0x55883bfb5ce0 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf6e120 0x55883bfb43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf6e120 0x55883bfb43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52514/0 (socket says 172.21.15.137:52514) 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fed9d640 1 -- 172.21.15.137:0/3132015479 learned_addr learned my addr 172.21.15.137:0/3132015479 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfb5ce0 0x55883bfb6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 0x55883bf98820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fed9d640 1 -- 172.21.15.137:0/3132015479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfb5ce0 msgr2=0x55883bfb6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfb5ce0 0x55883bfb6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fed9d640 1 -- 172.21.15.137:0/3132015479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 msgr2=0x55883bf98820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 0x55883bf98820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fed9d640 1 -- 172.21.15.137:0/3132015479 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883be8a750 con 0x55883bf6e120 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfb5ce0 0x55883bfb6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:05.806 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.798+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf6e120 0x55883bfb43a0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80093e0 tx=0x7fc1f802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9684855f52cbcd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc1dffff640 1 -- 172.21.15.137:0/3132015479 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8036040 con 0x55883bf6e120 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc1dffff640 1 -- 172.21.15.137:0/3132015479 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f8042070 con 0x55883bf6e120 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc1dffff640 1 -- 172.21.15.137:0/3132015479 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f803c8b0 con 0x55883bf6e120 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc207835740 1 -- 172.21.15.137:0/3132015479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf6e120 msgr2=0x55883bfb43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc207835740 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf6e120 0x55883bfb43a0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80093e0 tx=0x7fc1f802c000 comp rx=0 tx=0).stop 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc207835740 1 -- 172.21.15.137:0/3132015479 shutdown_connections 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc207835740 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf6e120 0x55883bfb43a0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc207835740 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfb5ce0 0x55883bfb6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc207835740 1 --2- 172.21.15.137:0/3132015479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 0x55883bf98820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc207835740 1 -- 172.21.15.137:0/3132015479 >> 172.21.15.137:0/3132015479 conn(0x55883bf6aa50 msgr2=0x55883bfb3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc207835740 1 -- 172.21.15.137:0/3132015479 shutdown_connections 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.799+0000 7fc207835740 1 -- 172.21.15.137:0/3132015479 wait complete. 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.800+0000 7fc207835740 1 -- start start 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.800+0000 7fc207835740 1 Processor -- start 2024-04-26T22:08:05.807 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc207835740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bf93ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc207835740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 0x55883bfaa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc207835740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf9b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc207835740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55883bf6eec0 con 0x55883bf98440 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc207835740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55883be59fe0 con 0x55883bfb5ce0 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc207835740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55883bf68980 con 0x55883bfaa840 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc207835740 10 client.0 _ll_register_callbacks cb 0x55883be70150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fe59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bf93ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fe59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bf93ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52522/0 (socket says 172.21.15.137:52522) 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fe59c640 1 -- 172.21.15.137:0/1279888220 learned_addr learned my addr 172.21.15.137:0/1279888220 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf9b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 0x55883bfaa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fe59c640 1 -- 172.21.15.137:0/1279888220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 msgr2=0x55883bf9b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf9b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fe59c640 1 -- 172.21.15.137:0/1279888220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 msgr2=0x55883bfaa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.808 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 0x55883bfaa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fe59c640 1 -- 172.21.15.137:0/1279888220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883bbe42d0 con 0x55883bf98440 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bf93ef0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4055b00 tx=0x7fc1f40597e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbf4e341254eead server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.801+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1279888220 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f401e040 con 0x55883bf98440 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1279888220 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fc1f4062000 con 0x55883bf98440 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc207835740 1 -- 172.21.15.137:0/1279888220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1f8042070 con 0x55883bf98440 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1279888220 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fc1f4058af0 con 0x55883bf98440 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc207835740 10 client.9354 fetch_fsmap learned FSMap version 93 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc207835740 1 -- 172.21.15.137:0/1279888220 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55883bcae6b0 con 0x55883bf98440 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1279888220 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f8042070 con 0x55883bf98440 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1279888220 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 93) ==== 3494+0+0 (secure 0 0 0) 0x7fc1f4058c90 con 0x55883bf98440 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc207835740 10 client.9354 fetch_fsmap finished waiting for FSMap version 93 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc207835740 10 client.9354 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:08:05.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc207835740 20 client.9354 populate_metadata read hostname 'smithi137' 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc207835740 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] conn(0x55883bfc6d20 0x55883bf947c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc207835740 4 client.9354 mds_command: new command op to 9270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc207835740 1 -- 172.21.15.137:0/1279888220 --> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55883bee0350 con 0x55883bfc6d20 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] conn(0x55883bfc6d20 0x55883bf947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc1dd7fa640 10 client.9354 ms_handle_connect on v2:172.21.15.137:6835/3437790809 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.802+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] conn(0x55883bfc6d20 0x55883bf947c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a70cd193d8f5c7ad server_cookie=155655c458d8afd7 in_seq=0 out_seq=0 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1279888220 <== mds.0 v2:172.21.15.137:6835/3437790809 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55883bee0350 con 0x55883bfc6d20 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc1dd7fa640 10 client.9354 handle_command_reply: tid=0 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 client.9354 shutdown 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 -- 172.21.15.137:0/1279888220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 msgr2=0x55883bf93ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bf93ef0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4055b00 tx=0x7fc1f40597e0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 -- 172.21.15.137:0/1279888220 shutdown_connections 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] conn(0x55883bfc6d20 0x55883bf947c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.810 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf9b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 0x55883bfaa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc1dd7fa640 0 client.9354 ms_handle_reset on v2:172.21.15.137:6835/3437790809 2024-04-26T22:08:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 --2- 172.21.15.137:0/1279888220 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bf93ef0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 -- 172.21.15.137:0/1279888220 >> 172.21.15.137:0/1279888220 conn(0x55883bf6e120 msgr2=0x55883bfb7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 -- 172.21.15.137:0/1279888220 shutdown_connections 2024-04-26T22:08:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 1 -- 172.21.15.137:0/1279888220 wait complete. 2024-04-26T22:08:05.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.803+0000 7fc207835740 20 client.9354 trim_cache size 0 max 16384 2024-04-26T22:08:05.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.821+0000 7fc207835740 1 Processor -- start 2024-04-26T22:08:05.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.821+0000 7fc207835740 1 -- start start 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc207835740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bfb1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc207835740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf97840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc207835740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 0x55883bf6e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc207835740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc200200ad0 con 0x55883bf98440 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc207835740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc200143760 con 0x55883bfb5ce0 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc207835740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc200200480 con 0x55883bfaa840 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fe59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bfb1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fe59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bfb1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52528/0 (socket says 172.21.15.137:52528) 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fe59c640 1 -- 172.21.15.137:0/1149051984 learned_addr learned my addr 172.21.15.137:0/1149051984 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf97840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 0x55883bf6e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fe59c640 1 -- 172.21.15.137:0/1149051984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 msgr2=0x55883bf97840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf97840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fe59c640 1 -- 172.21.15.137:0/1149051984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 msgr2=0x55883bf6e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 0x55883bf6e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fe59c640 1 -- 172.21.15.137:0/1149051984 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883bed4be0 con 0x55883bf98440 2024-04-26T22:08:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.822+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf97840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bfb1730 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40590e0 tx=0x7fc1f401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4668e86d894486f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc1df7fe640 1 -- 172.21.15.137:0/1149051984 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f401e040 con 0x55883bf98440 2024-04-26T22:08:05.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc1df7fe640 1 -- 172.21.15.137:0/1149051984 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f4089de0 con 0x55883bf98440 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc1df7fe640 1 -- 172.21.15.137:0/1149051984 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4058c90 con 0x55883bf98440 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc207835740 1 -- 172.21.15.137:0/1149051984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 msgr2=0x55883bfb1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc207835740 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bfb1730 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40590e0 tx=0x7fc1f401b000 comp rx=0 tx=0).stop 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc207835740 1 -- 172.21.15.137:0/1149051984 shutdown_connections 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc207835740 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bfb5ce0 0x55883bf6e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc207835740 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf97840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc207835740 1 --2- 172.21.15.137:0/1149051984 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bf98440 0x55883bfb1730 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc207835740 1 -- 172.21.15.137:0/1149051984 >> 172.21.15.137:0/1149051984 conn(0x55883bf6e120 msgr2=0x55883bf93360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc207835740 1 -- 172.21.15.137:0/1149051984 shutdown_connections 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.823+0000 7fc207835740 1 -- 172.21.15.137:0/1149051984 wait complete. 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.824+0000 7fc207835740 1 -- start start 2024-04-26T22:08:05.826 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.824+0000 7fc207835740 1 Processor -- start 2024-04-26T22:08:05.830 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc207835740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 0x55883c02d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc207835740 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf6e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc207835740 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bfb5ce0 0x55883bf6ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc207835740 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x55883bfc6ba0 con 0x55883bfb5ce0 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc207835740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x55883bfc3d80 con 0x55883bf98440 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc207835740 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x55883bfc7130 con 0x55883bfaa840 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc207835740 10 client.0 _ll_register_callbacks cb 0x7fc1f40594f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bfb5ce0 0x55883bf6ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fed9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bfb5ce0 0x55883bf6ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52536/0 (socket says 172.21.15.137:52536) 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fed9d640 1 -- 172.21.15.137:0/1182682039 learned_addr learned my addr 172.21.15.137:0/1182682039 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 0x55883c02d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fdd9b640 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf6e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fed9d640 1 -- 172.21.15.137:0/1182682039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 msgr2=0x55883bf6e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.831 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf6e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fed9d640 1 -- 172.21.15.137:0/1182682039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 msgr2=0x55883c02d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 0x55883c02d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fed9d640 1 -- 172.21.15.137:0/1182682039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883bfc2ea0 con 0x55883bfb5ce0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1fed9d640 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bfb5ce0 0x55883bf6ea40 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80093e0 tx=0x7fc1f8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2521600ee110 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.137:3300/0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1182682039 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8036040 con 0x55883bfb5ce0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1182682039 <== mon.0 v2:172.21.15.137:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fc1f8052b80 con 0x55883bfb5ce0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.825+0000 7fc207835740 1 -- 172.21.15.137:0/1182682039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1f4089de0 con 0x55883bfb5ce0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1182682039 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fc1f8059050 con 0x55883bfb5ce0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc207835740 10 client.9360 fetch_fsmap learned FSMap version 93 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc207835740 1 -- 172.21.15.137:0/1182682039 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55883c02f080 con 0x55883bfb5ce0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1182682039 <== mon.0 v2:172.21.15.137:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1f4089de0 con 0x55883bfb5ce0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1182682039 <== mon.0 v2:172.21.15.137:3300/0 5 ==== fsmap(e 93) ==== 3494+0+0 (secure 0 0 0) 0x7fc1f805c020 con 0x55883bfb5ce0 2024-04-26T22:08:05.832 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc207835740 10 client.9360 fetch_fsmap finished waiting for FSMap version 93 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc207835740 10 client.9360 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc207835740 20 client.9360 populate_metadata read hostname 'smithi137' 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc207835740 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] conn(0x55883bf6c8c0 0x55883c02e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc207835740 4 client.9360 mds_command: new command op to 9270 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc207835740 1 -- 172.21.15.137:0/1182682039 --> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] -- command(tid 0: {"prefix": "status"}) -- 0x55883bfacdd0 con 0x55883bf6c8c0 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] conn(0x55883bf6c8c0 0x55883c02e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc1dd7fa640 10 client.9360 ms_handle_connect on v2:172.21.15.137:6835/3437790809 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc1fe59c640 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] conn(0x55883bf6c8c0 0x55883c02e000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bec4237582dd86d server_cookie=d7c16e88d97d7c67 in_seq=0 out_seq=0 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc1dd7fa640 1 -- 172.21.15.137:0/1182682039 <== mds.0 v2:172.21.15.137:6835/3437790809 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55883bfacdd0 con 0x55883bf6c8c0 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc1dd7fa640 10 client.9360 handle_command_reply: tid=0 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.826+0000 7fc207835740 1 client.9360 shutdown 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 -- 172.21.15.137:0/1182682039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bfb5ce0 msgr2=0x55883bf6ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bfb5ce0 0x55883bf6ea40 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80093e0 tx=0x7fc1f8004ab0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 -- 172.21.15.137:0/1182682039 shutdown_connections 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.137:6835/3437790809,v1:172.21.15.137:6837/3437790809] conn(0x55883bf6c8c0 0x55883c02e000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.833 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x55883bfb5ce0 0x55883bf6ea40 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x55883bfaa840 0x55883bf6e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 --2- 172.21.15.137:0/1182682039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55883bf98440 0x55883c02d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc1dd7fa640 0 client.9360 ms_handle_reset on v2:172.21.15.137:6835/3437790809 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 -- 172.21.15.137:0/1182682039 >> 172.21.15.137:0/1182682039 conn(0x55883bf6e120 msgr2=0x55883bfb16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 -- 172.21.15.137:0/1182682039 shutdown_connections 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 1 -- 172.21.15.137:0/1182682039 wait complete. 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc207835740 20 client.9360 trim_cache size 0 max 16384 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stdout: "cluster_fsid": "30fb29b0-57db-44cb-a9e0-8033deb0a091", 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stdout: "whoami": 0, 2024-04-26T22:08:05.834 INFO:teuthology.orchestra.run.smithi137.stdout: "id": 9270, 2024-04-26T22:08:05.835 INFO:teuthology.orchestra.run.smithi137.stdout: "want_state": "up:active", 2024-04-26T22:08:05.835 INFO:teuthology.orchestra.run.smithi137.stdout: "state": "up:active", 2024-04-26T22:08:05.835 INFO:teuthology.orchestra.run.smithi137.stdout: "fs_name": "cephfs", 2024-04-26T22:08:05.835 INFO:teuthology.orchestra.run.smithi137.stdout: "rank_uptime": 4.3986342799999996, 2024-04-26T22:08:05.835 INFO:teuthology.orchestra.run.smithi137.stdout: "mdsmap_epoch": 93, 2024-04-26T22:08:05.835 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch": 117, 2024-04-26T22:08:05.835 INFO:teuthology.orchestra.run.smithi137.stdout: "osdmap_epoch_barrier": 117, 2024-04-26T22:08:05.835 INFO:teuthology.orchestra.run.smithi137.stdout: "uptime": 5.6104289139999999 2024-04-26T22:08:05.835 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:08:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 -- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1e006c8f0 msgr2=0x7fc1e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1e006c8f0 0x7fc1e006edb0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0006fd0 tx=0x7fc1f0006bc0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 -- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 msgr2=0x7fc20013ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 0x7fc20013ff40 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400b4d0 tx=0x7fc1f400b990 comp rx=0 tx=0).stop 2024-04-26T22:08:05.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 -- 172.21.15.137:0/3870562125 shutdown_connections 2024-04-26T22:08:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc1e006c8f0 0x7fc1e006edb0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc200160640 0x7fc2000af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc200148a30 0x7fc2000aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 --2- 172.21.15.137:0/3870562125 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2000b3af0 0x7fc20013ff40 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 -- 172.21.15.137:0/3870562125 >> 172.21.15.137:0/3870562125 conn(0x7fc2000ce8b0 msgr2=0x7fc2000cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 -- 172.21.15.137:0/3870562125 shutdown_connections 2024-04-26T22:08:05.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.827+0000 7fc204a46640 1 -- 172.21.15.137:0/3870562125 wait complete. 2024-04-26T22:08:05.838 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T22:08:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.934+0000 7f3e34a45640 1 Processor -- start 2024-04-26T22:08:05.934 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.934+0000 7f3e34a45640 1 -- start start 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.935+0000 7f3e34a45640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3015f370 0x7f3e300cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.935+0000 7f3e34a45640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e3015f750 0x7f3e300b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.935+0000 7f3e34a45640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e300d03a0 con 0x7f3e300d37d0 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.935+0000 7f3e34a45640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f3e300b4d10 con 0x7f3e3015f750 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.935+0000 7f3e34a45640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3e300d0680 con 0x7f3e3015f370 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.935+0000 7f3e2dd9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e3015f750 0x7f3e300b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.935+0000 7f3e2dd9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f3e3015f750 0x7f3e300b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52550/0 (socket says 172.21.15.137:52550) 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.935+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/2024334353 learned_addr learned my addr 172.21.15.137:0/2024334353 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.936+0000 7f3e2e59c640 1 --2- 172.21.15.137:0/2024334353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3015f370 0x7f3e300cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.936+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/2024334353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3015f370 msgr2=0x7f3e300cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.936+0000 7f3e2dd9b640 1 --2- 172.21.15.137:0/2024334353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3015f370 0x7f3e300cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.936 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.936+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/2024334353 >> v1:172.21.15.170:6789/0 conn(0x7f3e300d37d0 legacy=0x7f3e300d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:05.937 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.936+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/2024334353 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e300d0960 con 0x7f3e3015f750 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.936+0000 7f3e2dd9b640 1 --2- 172.21.15.137:0/2024334353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f750 0x7f3e300b47d0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009870 tx=0x7f3e2402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99fee797f46edcf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e2d59a640 1 -- 172.21.15.137:0/2024334353 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24037070 con 0x7f3e3015f750 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e2d59a640 1 -- 172.21.15.137:0/2024334353 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e24032440 con 0x7f3e3015f750 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e2d59a640 1 -- 172.21.15.137:0/2024334353 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24032810 con 0x7f3e3015f750 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e34a45640 1 -- 172.21.15.137:0/2024334353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f750 msgr2=0x7f3e300b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e34a45640 1 --2- 172.21.15.137:0/2024334353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f750 0x7f3e300b47d0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009870 tx=0x7f3e2402a180 comp rx=0 tx=0).stop 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e34a45640 1 -- 172.21.15.137:0/2024334353 shutdown_connections 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e34a45640 1 --2- 172.21.15.137:0/2024334353 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f750 0x7f3e300b47d0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e34a45640 1 --2- 172.21.15.137:0/2024334353 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e3015f370 0x7f3e300cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e34a45640 1 -- 172.21.15.137:0/2024334353 >> 172.21.15.137:0/2024334353 conn(0x7f3e3008ec10 msgr2=0x7f3e3009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e34a45640 1 -- 172.21.15.137:0/2024334353 shutdown_connections 2024-04-26T22:08:05.938 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.937+0000 7f3e34a45640 1 -- 172.21.15.137:0/2024334353 wait complete. 2024-04-26T22:08:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e34a45640 1 Processor -- start 2024-04-26T22:08:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e34a45640 1 -- start start 2024-04-26T22:08:05.942 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e34a45640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e300d37d0 0x7f3e3015d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e34a45640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f370 0x7f3e300cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e34a45640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e3015f750 0x7f3e300b9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e34a45640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f3e300b51c0 con 0x7f3e3015f370 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e34a45640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f3e300d0f20 con 0x7f3e3015f750 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e34a45640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f3e300b5340 con 0x7f3e300d37d0 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e2dd9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f370 0x7f3e300cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e2dd9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f370 0x7f3e300cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52566/0 (socket says 172.21.15.137:52566) 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.939+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/1588712438 learned_addr learned my addr 172.21.15.137:0/1588712438 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e2e59c640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e300d37d0 0x7f3e3015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/1588712438 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e300d37d0 msgr2=0x7f3e3015d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e2dd9b640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e300d37d0 0x7f3e3015d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/1588712438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e3015f750 msgr2=0x7f3e300b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e2ed9d640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e3015f750 0x7f3e300b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e2dd9b640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e3015f750 0x7f3e300b9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:05.943 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e2dd9b640 1 -- 172.21.15.137:0/1588712438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e300cb960 con 0x7f3e3015f370 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e2dd9b640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f370 0x7f3e300cad30 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009870 tx=0x7f3e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e1effd640 1 -- 172.21.15.137:0/1588712438 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24041020 con 0x7f3e3015f370 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e1effd640 1 -- 172.21.15.137:0/1588712438 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e240306c0 con 0x7f3e3015f370 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e1effd640 1 -- 172.21.15.137:0/1588712438 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24037040 con 0x7f3e3015f370 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e300b8800 con 0x7f3e3015f370 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.940+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e300b8dc0 con 0x7f3e3015f370 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.941+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3006a290 con 0x7f3e3015f370 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.941+0000 7f3e1effd640 1 -- 172.21.15.137:0/1588712438 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e24044020 con 0x7f3e3015f370 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.942+0000 7f3e1effd640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.942+0000 7f3e1effd640 1 -- 172.21.15.137:0/1588712438 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f3e240ac430 con 0x7f3e3015f370 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.942+0000 7f3e2e59c640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:05.944 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.942+0000 7f3e2e59c640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009f30 tx=0x7f3e2000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:05.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:05.946+0000 7f3e1effd640 1 -- 172.21.15.137:0/1588712438 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f3e2404b030 con 0x7f3e3015f370 2024-04-26T22:08:06.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.157+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3e3015ea90 con 0x7f3e3015f370 2024-04-26T22:08:06.157 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.158+0000 7f3e1effd640 1 -- 172.21.15.137:0/1588712438 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) ==== 53+0+73 (secure 0 0 0) 0x7f3e2407a7b0 con 0x7f3e3015f370 2024-04-26T22:08:06.158 INFO:teuthology.orchestra.run.smithi137.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 msgr2=0x7f3e1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009f30 tx=0x7f3e2000b040 comp rx=0 tx=0).stop 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f370 msgr2=0x7f3e300cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f370 0x7f3e300cad30 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009870 tx=0x7f3e240046c0 comp rx=0 tx=0).stop 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 shutdown_connections 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f3e1006c8f0 0x7f3e1006edb0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f3e3015f370 0x7f3e300cad30 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3e3015f750 0x7f3e300b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 --2- 172.21.15.137:0/1588712438 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f3e300d37d0 0x7f3e3015d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 >> 172.21.15.137:0/1588712438 conn(0x7f3e3008ec10 msgr2=0x7f3e30075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:06.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 shutdown_connections 2024-04-26T22:08:06.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06.160+0000 7f3e34a45640 1 -- 172.21.15.137:0/1588712438 wait complete. 2024-04-26T22:08:06.171 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T22:08:06.171 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T22:08:06.171 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi137.front.sepia.ceph.com 2024-04-26T22:08:06.171 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T22:08:06.171 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T22:08:06.171 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T22:08:06.171 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-26T22:08:06.171 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T22:08:06.171 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:08:06.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:06.172 DEBUG:teuthology.orchestra.run.smithi137:> ip addr 2024-04-26T22:08:06.186 INFO:teuthology.orchestra.run.smithi137.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 ::1/128 scope host 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7e brd ff:ff:ff:ff:ff:ff 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f0 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:d9:36:7f brd ff:ff:ff:ff:ff:ff 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: altname enp7s0f1 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T22:08:06.187 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:36 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 0c:c4:7a:88:81:37 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: inet 172.21.15.137/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft 42220sec preferred_lft 42220sec 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::db69:a194:7717:e807/64 scope link noprefixroute 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::9475:80ff:fea3:46f2/64 scope link 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:08:06.188 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether 6e:17:19:8e:75:79 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:08:06.189 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::6c17:19ff:fe8e:7579/64 scope link 2024-04-26T22:08:06.189 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:08:06.189 INFO:teuthology.orchestra.run.smithi137.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T22:08:06.189 INFO:teuthology.orchestra.run.smithi137.stdout: link/ether c2:28:55:4e:48:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:08:06.189 INFO:teuthology.orchestra.run.smithi137.stdout: inet6 fe80::c028:55ff:fe4e:480c/64 scope link 2024-04-26T22:08:06.189 INFO:teuthology.orchestra.run.smithi137.stdout: valid_lft forever preferred_lft forever 2024-04-26T22:08:06.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:06.189 DEBUG:teuthology.orchestra.run.smithi137:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T22:08:06.193 INFO:tasks.ceph.mds.a.smithi137.stderr:2024-04-26T22:08:06.193+0000 7fab3c8ba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:08:06.214 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:08:06.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:06.216 DEBUG:teuthology.orchestra.run.smithi137:> route 2024-04-26T22:08:06.272 INFO:teuthology.orchestra.run.smithi137.stdout:Kernel IP routing table 2024-04-26T22:08:06.272 INFO:teuthology.orchestra.run.smithi137.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T22:08:06.272 INFO:teuthology.orchestra.run.smithi137.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T22:08:06.272 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T22:08:06.272 INFO:teuthology.orchestra.run.smithi137.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T22:08:06.272 DEBUG:teuthology.orchestra.run.smithi137:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T22:08:06.273 DEBUG:teuthology.orchestra.run.smithi137:> set -e 2024-04-26T22:08:06.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T22:08:06.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T22:08:06.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T22:08:06.273 DEBUG:teuthology.orchestra.run.smithi137:> ') 2024-04-26T22:08:06.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T22:08:06.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:06.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:06.396 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:08:06.410 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:08:06.410 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:08:06.411 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:08:06.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:06.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link set brx.0 up 2024-04-26T22:08:06.475 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:08:06.475 DEBUG:teuthology.orchestra.run.smithi137:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T22:08:06.530 INFO:teuthology.orchestra.run.smithi137.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T22:08:06.530 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T22:08:06.530 DEBUG:teuthology.orchestra.run.smithi137:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:08:06.584 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T22:08:06.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:06.585 DEBUG:teuthology.orchestra.run.smithi137:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:08:06.665 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:08:06.665 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:08:06.672 INFO:teuthology.orchestra.run.smithi137.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T22:08:06.672 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T22:08:06.672 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: resolved to: "172.21.15.137:3300,172.21.15.170:3300,172.21.15.170:3301" 2024-04-26T22:08:06.673 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: trying mount with new device syntax: 0@30fb29b0-57db-44cb-a9e0-8033deb0a091.cephfs=/ 2024-04-26T22:08:06.673 INFO:teuthology.orchestra.run.smithi137.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.137:3300/172.21.15.170:3300/172.21.15.170:3301" will pass to kernel 2024-04-26T22:08:06.673 INFO:teuthology.orchestra.run.smithi137.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T22:08:06.673 INFO:teuthology.orchestra.run.smithi137.stdout: You just mounted a file system that supports labels which does not 2024-04-26T22:08:06.673 INFO:teuthology.orchestra.run.smithi137.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T22:08:06.673 INFO:teuthology.orchestra.run.smithi137.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T22:08:06.673 INFO:teuthology.orchestra.run.smithi137.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T22:08:06.675 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T22:08:06.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:06.675 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T22:08:06.739 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T22:08:06.828 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T22:08:06.829 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:06.835 INFO:teuthology.orchestra.run.smithi137.stdout:client6941 2024-04-26T22:08:06.835 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:08:06.835 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:06.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:06.851 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-26T22:08:06.910 INFO:teuthology.orchestra.run.smithi137.stdout:./ 2024-04-26T22:08:06.910 INFO:teuthology.orchestra.run.smithi137.stdout:./parent 2024-04-26T22:08:06.910 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed 2024-04-26T22:08:06.910 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed/charlie 2024-04-26T22:08:06.910 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed/alpha 2024-04-26T22:08:06.910 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/flushed/bravo 2024-04-26T22:08:06.910 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/unflushed 2024-04-26T22:08:06.910 INFO:teuthology.orchestra.run.smithi137.stdout:./parent/unflushed/jfile 2024-04-26T22:08:06.911 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:08:06.911 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:08:06.911 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:08:06.911 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:08:06.911 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-26T22:08:06.911 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:08:07.014 INFO:teuthology.orchestra.run.smithi137.stdout:1 2024-04-26T22:08:07.017 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:07.024 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:08:07.024 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:08:07.024 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:08:07.024 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:08:07.024 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-26T22:08:07.024 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:08:07.129 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627776 2024-04-26T22:08:07.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:07.138 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:08:07.138 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:08:07.138 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:08:07.138 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:08:07.138 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-26T22:08:07.138 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:08:07.242 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627777 2024-04-26T22:08:07.245 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:07.251 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:08:07.251 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:08:07.251 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:08:07.252 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:08:07.252 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-26T22:08:07.252 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:08:07.356 INFO:teuthology.orchestra.run.smithi137.stdout:1099511628280 2024-04-26T22:08:07.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:07.364 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:08:07.364 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:08:07.364 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:08:07.364 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:08:07.364 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-26T22:08:07.364 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:08:07.470 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627778 2024-04-26T22:08:07.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:07.479 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:08:07.479 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:08:07.479 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:08:07.479 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:08:07.479 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-26T22:08:07.479 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:08:07.584 INFO:teuthology.orchestra.run.smithi137.stdout:1099511628279 2024-04-26T22:08:07.587 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:07.593 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:08:07.593 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:08:07.593 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:08:07.593 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:08:07.594 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-26T22:08:07.594 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:08:07.698 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627779 2024-04-26T22:08:07.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:07.707 DEBUG:teuthology.orchestra.run.smithi137:> stdin-killer -- python3 -c ' 2024-04-26T22:08:07.707 DEBUG:teuthology.orchestra.run.smithi137:> import os 2024-04-26T22:08:07.707 DEBUG:teuthology.orchestra.run.smithi137:> import stat 2024-04-26T22:08:07.707 DEBUG:teuthology.orchestra.run.smithi137:> 2024-04-26T22:08:07.707 DEBUG:teuthology.orchestra.run.smithi137:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-26T22:08:07.707 DEBUG:teuthology.orchestra.run.smithi137:> ' 2024-04-26T22:08:07.812 INFO:teuthology.orchestra.run.smithi137.stdout:1099511627780 2024-04-26T22:08:07.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T22:08:07.821 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T22:08:07.821 DEBUG:teuthology.orchestra.run.smithi137:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:08:07.903 DEBUG:teuthology.orchestra.run.smithi170:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T22:08:07.945 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T22:08:07.945 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:08:07.945 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:08:07.945 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:07.960 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:08:07.960 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:08.016 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:08:08.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.152+0000 7f9491ad9640 1 Processor -- start 2024-04-26T22:08:08.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.152+0000 7f9491ad9640 1 -- start start 2024-04-26T22:08:08.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.153+0000 7f9491ad9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f948c15f750 0x7f948c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.153+0000 7f9491ad9640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948c0d03a0 con 0x7f948c15f370 2024-04-26T22:08:08.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.153+0000 7f9491ad9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948c0d0680 con 0x7f948c0d3ee0 2024-04-26T22:08:08.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.153+0000 7f9491ad9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f948c0d0960 con 0x7f948c15f750 2024-04-26T22:08:08.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.153+0000 7f948b7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f948c15f370 0x7f948c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55314/0 (socket says 172.21.15.137:55314) 2024-04-26T22:08:08.160 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.153+0000 7f948b7fe640 1 -- 172.21.15.137:0/374440882 learned_addr learned my addr 172.21.15.137:0/374440882 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948bfff640 1 --2- 172.21.15.137:0/374440882 >> v2:172.21.15.170:3300/0 conn(0x7f948c15f750 0x7f948c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188809564 0 0) 0x7f948c0d03a0 con 0x7f948c15f370 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9478003520 con 0x7f948c15f370 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2338304165 0 0) 0x7f9478003520 con 0x7f948c15f370 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 >> v2:172.21.15.170:3300/0 conn(0x7f948c15f750 msgr2=0x7f948c0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 --2- 172.21.15.137:0/374440882 >> v2:172.21.15.170:3300/0 conn(0x7f948c15f750 0x7f948c0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 >> v1:172.21.15.170:6789/0 conn(0x7f948c0d3ee0 legacy=0x7f948c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c0d0c40 con 0x7f948c15f370 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f947c001670 con 0x7f948c15f370 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 >> v1:172.21.15.137:6789/0 conn(0x7f948c15f370 legacy=0x7f948c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780039b0 0x7f9478003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9478004800 0x7f9478004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.161 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94780051c0 0x7f947800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0d0960 con 0x7f94780051c0 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f947800c060 con 0x7f94780039b0 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f947800c260 con 0x7f9478004800 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948bfff640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94780051c0 0x7f947800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948b7fe640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780039b0 0x7f9478003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f9482ffd640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9478004800 0x7f9478004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948bfff640 1 -- 172.21.15.137:0/374440882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9478004800 msgr2=0x7f9478004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948bfff640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9478004800 0x7f9478004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948bfff640 1 -- 172.21.15.137:0/374440882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780039b0 msgr2=0x7f9478003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948bfff640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780039b0 0x7f9478003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f948bfff640 1 -- 172.21.15.137:0/374440882 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9478003520 con 0x7f94780051c0 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.154+0000 7f9482ffd640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f9478004800 0x7f9478004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.155+0000 7f948bfff640 1 -- 172.21.15.137:0/374440882 reap_dead start 2024-04-26T22:08:08.162 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.155+0000 7f948bfff640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94780051c0 0x7f947800b9c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f9484009fc0 tx=0x7f9478005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07e7c873e4d1e7e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.155+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484035020 con 0x7f94780051c0 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.155+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9484003b90 con 0x7f94780051c0 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.155+0000 7f948affd640 1 -- 172.21.15.137:0/374440882 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484009c10 con 0x7f94780051c0 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.156+0000 7f9491ad9640 1 -- 172.21.15.137:0/374440882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94780051c0 msgr2=0x7f947800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.156+0000 7f9491ad9640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94780051c0 0x7f947800b9c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f9484009fc0 tx=0x7f9478005830 comp rx=0 tx=0).stop 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.156+0000 7f9491ad9640 1 -- 172.21.15.137:0/374440882 shutdown_connections 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.156+0000 7f9491ad9640 1 --2- 172.21.15.137:0/374440882 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f94780051c0 0x7f947800b9c0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.156+0000 7f9491ad9640 1 -- 172.21.15.137:0/374440882 >> 172.21.15.137:0/374440882 conn(0x7f948c08ec10 msgr2=0x7f948c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.156+0000 7f9491ad9640 1 -- 172.21.15.137:0/374440882 shutdown_connections 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.156+0000 7f9491ad9640 1 -- 172.21.15.137:0/374440882 wait complete. 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.157+0000 7f9491ad9640 1 Processor -- start 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.157+0000 7f9491ad9640 1 -- start start 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9491ad9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780051c0 0x7f948c0b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9491ad9640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c0b1e20 0x7f948c14ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.163 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9491ad9640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f948c0ba5b0 0x7f948c1f8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9491ad9640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0cfef0 con 0x7f948c0b1e20 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9491ad9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0cfd70 con 0x7f94780051c0 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9491ad9640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f948c0d0070 con 0x7f948c0ba5b0 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9482ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c0b1e20 0x7f948c14ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9482ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c0b1e20 0x7f948c14ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52590/0 (socket says 172.21.15.137:52590) 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9482ffd640 1 -- 172.21.15.137:0/995859541 learned_addr learned my addr 172.21.15.137:0/995859541 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f948bfff640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f948c0ba5b0 0x7f948c1f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f948b7fe640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780051c0 0x7f948c0b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9482ffd640 1 -- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f948c0ba5b0 msgr2=0x7f948c1f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9482ffd640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f948c0ba5b0 0x7f948c1f8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9482ffd640 1 -- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780051c0 msgr2=0x7f948c0b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9482ffd640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780051c0 0x7f948c0b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9482ffd640 1 -- 172.21.15.137:0/995859541 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c14f1d0 con 0x7f948c0b1e20 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f948bfff640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f948c0ba5b0 0x7f948c1f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:08.164 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f948b7fe640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780051c0 0x7f948c0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9482ffd640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c0b1e20 0x7f948c14ec90 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f947400e480 tx=0x7f947400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.158+0000 7f9488ff9640 1 -- 172.21.15.137:0/995859541 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94740052e0 con 0x7f948c0b1e20 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.159+0000 7f9488ff9640 1 -- 172.21.15.137:0/995859541 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474018070 con 0x7f948c0b1e20 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.159+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c0b23c0 con 0x7f948c0b1e20 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.159+0000 7f9488ff9640 1 -- 172.21.15.137:0/995859541 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474003830 con 0x7f948c0b1e20 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.159+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c0b2980 con 0x7f948c0b1e20 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.160+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948c06a290 con 0x7f948c0b1e20 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.160+0000 7f9488ff9640 1 -- 172.21.15.137:0/995859541 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94740039d0 con 0x7f948c0b1e20 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.160+0000 7f9488ff9640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f946c06c8f0 0x7f946c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.160+0000 7f948b7fe640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f946c06c8f0 0x7f946c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.165 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.160+0000 7f9488ff9640 1 -- 172.21.15.137:0/995859541 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f947408b8c0 con 0x7f948c0b1e20 2024-04-26T22:08:08.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.161+0000 7f948b7fe640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f946c06c8f0 0x7f946c06edb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f947c001430 tx=0x7f947c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:08.166 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.165+0000 7f9488ff9640 1 -- 172.21.15.137:0/995859541 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f948c14f1d0 con 0x7f948c0b1e20 2024-04-26T22:08:08.342 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.343+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f948c0b4b30 con 0x7f948c0b1e20 2024-04-26T22:08:08.344 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.344+0000 7f9488ff9640 1 -- 172.21.15.137:0/995859541 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16902 (secure 0 0 0) 0x7f9474059d90 con 0x7f948c0b1e20 2024-04-26T22:08:08.344 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:08.344 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":117,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:08:00.183114+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.137:6835/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.170:6834/1666946913":"2024-04-27T22:07:49.712915+0000","172.21.15.170:6832/1666946913":"2024-04-27T22:07:49.712915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:08:08.346 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f946c06c8f0 msgr2=0x7f946c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f946c06c8f0 0x7f946c06edb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f947c001430 tx=0x7f947c009040 comp rx=0 tx=0).stop 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c0b1e20 msgr2=0x7f948c14ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c0b1e20 0x7f948c14ec90 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f947400e480 tx=0x7f947400e940 comp rx=0 tx=0).stop 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 shutdown_connections 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f946c06c8f0 0x7f946c06edb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f948c0b1e20 0x7f948c14ec90 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f948c0ba5b0 0x7f948c1f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 --2- 172.21.15.137:0/995859541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94780051c0 0x7f948c0b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 >> 172.21.15.137:0/995859541 conn(0x7f948c08ec10 msgr2=0x7f948c06dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 shutdown_connections 2024-04-26T22:08:08.347 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.346+0000 7f9491ad9640 1 -- 172.21.15.137:0/995859541 wait complete. 2024-04-26T22:08:08.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:07:35.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:07:35.848066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:08:08.358 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:08:08.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.458+0000 7efcd5904640 1 Processor -- start 2024-04-26T22:08:08.458 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.458+0000 7efcd5904640 1 -- start start 2024-04-26T22:08:08.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcd5904640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efcd015f680 0x7efcd00d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcd5904640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd0163aa0 0x7efcd00b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.459 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcd5904640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7efcd00b60b0 0x7efcd00d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcd5904640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7efcd015fa60 con 0x7efcd015f680 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcd5904640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7efcd00d3f50 con 0x7efcd00b60b0 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcd5904640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efcd00b5090 con 0x7efcd0163aa0 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcceffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efcd015f680 0x7efcd00d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcceffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7efcd015f680 0x7efcd00d3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52604/0 (socket says 172.21.15.137:52604) 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcceffd640 1 -- 172.21.15.137:0/399530106 learned_addr learned my addr 172.21.15.137:0/399530106 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcce7fc640 1 --2- 172.21.15.137:0/399530106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd0163aa0 0x7efcd00b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efccf7fe640 1 --2- 172.21.15.137:0/399530106 >> v2:172.21.15.170:3300/0 conn(0x7efcd00b60b0 0x7efcd00d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcceffd640 1 -- 172.21.15.137:0/399530106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd0163aa0 msgr2=0x7efcd00b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcceffd640 1 --2- 172.21.15.137:0/399530106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd0163aa0 0x7efcd00b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcceffd640 1 -- 172.21.15.137:0/399530106 >> v2:172.21.15.170:3300/0 conn(0x7efcd00b60b0 msgr2=0x7efcd00d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcceffd640 1 --2- 172.21.15.137:0/399530106 >> v2:172.21.15.170:3300/0 conn(0x7efcd00b60b0 0x7efcd00d4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efcceffd640 1 -- 172.21.15.137:0/399530106 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd00b5370 con 0x7efcd015f680 2024-04-26T22:08:08.460 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.459+0000 7efccf7fe640 1 --2- 172.21.15.137:0/399530106 >> v2:172.21.15.170:3300/0 conn(0x7efcd00b60b0 0x7efcd00d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:08.461 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.460+0000 7efcceffd640 1 --2- 172.21.15.137:0/399530106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd015f680 0x7efcd00d3820 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7efcd00b4b10 tx=0x7efcc002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b126db839792816a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:08.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.460+0000 7efccdffb640 1 -- 172.21.15.137:0/399530106 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0036070 con 0x7efcd015f680 2024-04-26T22:08:08.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.460+0000 7efccdffb640 1 -- 172.21.15.137:0/399530106 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc0031600 con 0x7efcd015f680 2024-04-26T22:08:08.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.460+0000 7efccdffb640 1 -- 172.21.15.137:0/399530106 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc00319d0 con 0x7efcd015f680 2024-04-26T22:08:08.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.461+0000 7efcd5904640 1 -- 172.21.15.137:0/399530106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd015f680 msgr2=0x7efcd00d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.461+0000 7efcd5904640 1 --2- 172.21.15.137:0/399530106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd015f680 0x7efcd00d3820 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7efcd00b4b10 tx=0x7efcc002a6a0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.461+0000 7efcd5904640 1 -- 172.21.15.137:0/399530106 shutdown_connections 2024-04-26T22:08:08.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.461+0000 7efcd5904640 1 --2- 172.21.15.137:0/399530106 >> v2:172.21.15.170:3300/0 conn(0x7efcd00b60b0 0x7efcd00d4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.462 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.461+0000 7efcd5904640 1 --2- 172.21.15.137:0/399530106 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd0163aa0 0x7efcd00b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.461+0000 7efcd5904640 1 --2- 172.21.15.137:0/399530106 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd015f680 0x7efcd00d3820 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.461+0000 7efcd5904640 1 -- 172.21.15.137:0/399530106 >> 172.21.15.137:0/399530106 conn(0x7efcd008eca0 msgr2=0x7efcd009e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.461+0000 7efcd5904640 1 -- 172.21.15.137:0/399530106 shutdown_connections 2024-04-26T22:08:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.461+0000 7efcd5904640 1 -- 172.21.15.137:0/399530106 wait complete. 2024-04-26T22:08:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.462+0000 7efcd5904640 1 Processor -- start 2024-04-26T22:08:08.463 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.462+0000 7efcd5904640 1 -- start start 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efcd5904640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd00b60b0 0x7efcd00cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efcd5904640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd015f680 0x7efcd0161970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efcd5904640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd0163aa0 0x7efcd0161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efcd5904640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7efcd00d55e0 con 0x7efcd0163aa0 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efcd5904640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7efcd00d5460 con 0x7efcd015f680 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efcd5904640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7efcd00d5760 con 0x7efcd00b60b0 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efccf7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd0163aa0 0x7efcd0161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efccf7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd0163aa0 0x7efcd0161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52616/0 (socket says 172.21.15.137:52616) 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efccf7fe640 1 -- 172.21.15.137:0/1535752448 learned_addr learned my addr 172.21.15.137:0/1535752448 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efcce7fc640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd015f680 0x7efcd0161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efcceffd640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd00b60b0 0x7efcd00cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.466 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efccf7fe640 1 -- 172.21.15.137:0/1535752448 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd00b60b0 msgr2=0x7efcd00cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efccf7fe640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd00b60b0 0x7efcd00cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efccf7fe640 1 -- 172.21.15.137:0/1535752448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd015f680 msgr2=0x7efcd0161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efccf7fe640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd015f680 0x7efcd0161970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efccf7fe640 1 -- 172.21.15.137:0/1535752448 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd00cf170 con 0x7efcd0163aa0 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efcceffd640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd00b60b0 0x7efcd00cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.463+0000 7efccf7fe640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd0163aa0 0x7efcd0161eb0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7efcc800c7f0 tx=0x7efcc800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.464+0000 7efcb7fff640 1 -- 172.21.15.137:0/1535752448 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8015070 con 0x7efcd0163aa0 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.464+0000 7efcb7fff640 1 -- 172.21.15.137:0/1535752448 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc8007820 con 0x7efcd0163aa0 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.464+0000 7efcb7fff640 1 -- 172.21.15.137:0/1535752448 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8007c10 con 0x7efcd0163aa0 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.464+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd00c8ed0 con 0x7efcd0163aa0 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.464+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd00c9490 con 0x7efcd0163aa0 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.465+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd006a290 con 0x7efcd0163aa0 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.465+0000 7efcb7fff640 1 -- 172.21.15.137:0/1535752448 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efcc8018070 con 0x7efcd0163aa0 2024-04-26T22:08:08.467 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.465+0000 7efcb7fff640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efcbc06c8f0 0x7efcbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.466+0000 7efcb7fff640 1 -- 172.21.15.137:0/1535752448 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7efcc808bcb0 con 0x7efcd0163aa0 2024-04-26T22:08:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.466+0000 7efcceffd640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efcbc06c8f0 0x7efcbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.468 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.466+0000 7efcceffd640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efcbc06c8f0 0x7efcbc06edb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7efcc0033000 tx=0x7efcc0009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:08.470 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.470+0000 7efcb7fff640 1 -- 172.21.15.137:0/1535752448 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7efcc805a180 con 0x7efcd0163aa0 2024-04-26T22:08:08.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.651+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efcd00b4cd0 con 0x7efcd0163aa0 2024-04-26T22:08:08.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.651+0000 7efcb7fff640 1 -- 172.21.15.137:0/1535752448 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) ==== 93+0+10 (secure 0 0 0) 0x7efcc8059a80 con 0x7efcd0163aa0 2024-04-26T22:08:08.651 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:08:08.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efcbc06c8f0 msgr2=0x7efcbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efcbc06c8f0 0x7efcbc06edb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7efcc0033000 tx=0x7efcc0009000 comp rx=0 tx=0).stop 2024-04-26T22:08:08.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd0163aa0 msgr2=0x7efcd0161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd0163aa0 0x7efcd0161eb0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7efcc800c7f0 tx=0x7efcc800ccb0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 shutdown_connections 2024-04-26T22:08:08.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7efcbc06c8f0 0x7efcbc06edb0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7efcd0163aa0 0x7efcd0161eb0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efcd015f680 0x7efcd0161970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 --2- 172.21.15.137:0/1535752448 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7efcd00b60b0 0x7efcd00cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 >> 172.21.15.137:0/1535752448 conn(0x7efcd008eca0 msgr2=0x7efcd0163070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:08.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.653+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 shutdown_connections 2024-04-26T22:08:08.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.654+0000 7efcd5904640 1 -- 172.21.15.137:0/1535752448 wait complete. 2024-04-26T22:08:08.664 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:08:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.763+0000 7f85e46c8640 1 Processor -- start 2024-04-26T22:08:08.763 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.763+0000 7f85e46c8640 1 -- start start 2024-04-26T22:08:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e46c8640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85dc0d0090 0x7f85dc0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e46c8640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85dc0d07e0 con 0x7f85dc160950 2024-04-26T22:08:08.764 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e46c8640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85dc0d2090 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e46c8640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f85dc09c700 con 0x7f85dc0d0090 2024-04-26T22:08:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e1c63640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85dc0d0090 0x7f85dc0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e2464640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f85dc160950 0x7f85dc0cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55330/0 (socket says 172.21.15.137:55330) 2024-04-26T22:08:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e2464640 1 -- 172.21.15.137:0/2543306264 learned_addr learned my addr 172.21.15.137:0/2543306264 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e1c63640 1 -- 172.21.15.137:0/2543306264 >> v1:172.21.15.170:6789/0 conn(0x7f85dc0b1ef0 legacy=0x7f85dc0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e1c63640 1 -- 172.21.15.137:0/2543306264 >> v1:172.21.15.137:6789/0 conn(0x7f85dc160950 legacy=0x7f85dc0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e1c63640 1 -- 172.21.15.137:0/2543306264 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc0d1a40 con 0x7f85dc0d0090 2024-04-26T22:08:08.765 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.764+0000 7f85e1462640 1 -- 172.21.15.137:0/2543306264 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392839898 0 0) 0x7f85dc0d07e0 con 0x7f85dc160950 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.765+0000 7f85e1c63640 1 --2- 172.21.15.137:0/2543306264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0d0090 0x7f85dc0ce030 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0097a0 tx=0x7f85cc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9813be4810164059 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.765+0000 7f85e1462640 1 -- 172.21.15.137:0/2543306264 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc037070 con 0x7f85dc0d0090 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.765+0000 7f85e1462640 1 -- 172.21.15.137:0/2543306264 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc032440 con 0x7f85dc0d0090 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.765+0000 7f85e1462640 1 -- 172.21.15.137:0/2543306264 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc032810 con 0x7f85dc0d0090 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.766+0000 7f85e46c8640 1 -- 172.21.15.137:0/2543306264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0d0090 msgr2=0x7f85dc0ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.766+0000 7f85e46c8640 1 --2- 172.21.15.137:0/2543306264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0d0090 0x7f85dc0ce030 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0097a0 tx=0x7f85cc02a1e0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.766+0000 7f85e46c8640 1 -- 172.21.15.137:0/2543306264 shutdown_connections 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.766+0000 7f85e46c8640 1 --2- 172.21.15.137:0/2543306264 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0d0090 0x7f85dc0ce030 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.766+0000 7f85e46c8640 1 -- 172.21.15.137:0/2543306264 >> 172.21.15.137:0/2543306264 conn(0x7f85dc09ba40 msgr2=0x7f85dc09be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.766+0000 7f85e46c8640 1 -- 172.21.15.137:0/2543306264 shutdown_connections 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.766+0000 7f85e46c8640 1 -- 172.21.15.137:0/2543306264 wait complete. 2024-04-26T22:08:08.767 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.767+0000 7f85e46c8640 1 Processor -- start 2024-04-26T22:08:08.768 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.767+0000 7f85e46c8640 1 -- start start 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e46c8640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0b1ef0 0x7f85dc1f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e46c8640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85dc0d0090 0x7f85dc0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e46c8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85dc160950 0x7f85dc0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e46c8640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc0b28f0 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e46c8640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc160d30 con 0x7f85dc160950 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e46c8640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f85dc0b2a70 con 0x7f85dc0d0090 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e2464640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0b1ef0 0x7f85dc1f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e2464640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0b1ef0 0x7f85dc1f3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52632/0 (socket says 172.21.15.137:52632) 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e2464640 1 -- 172.21.15.137:0/3733846351 learned_addr learned my addr 172.21.15.137:0/3733846351 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e2464640 1 -- 172.21.15.137:0/3733846351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85dc0d0090 msgr2=0x7f85dc0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e2464640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85dc0d0090 0x7f85dc0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e2464640 1 -- 172.21.15.137:0/3733846351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85dc160950 msgr2=0x7f85dc0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.770 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e2464640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85dc160950 0x7f85dc0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e2464640 1 -- 172.21.15.137:0/3733846351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc0c7d00 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e2464640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0b1ef0 0x7f85dc1f3160 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f85d800c500 tx=0x7f85d800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85d2ffd640 1 -- 172.21.15.137:0/3733846351 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8018070 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85d2ffd640 1 -- 172.21.15.137:0/3733846351 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d8007580 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85dc0c7a20 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85d2ffd640 1 -- 172.21.15.137:0/3733846351 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8004a20 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.768+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85dc15ba70 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.769+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85dc06a290 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.770+0000 7f85d2ffd640 1 -- 172.21.15.137:0/3733846351 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85d801b070 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.771 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.770+0000 7f85d2ffd640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85c006c8f0 0x7f85c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.770+0000 7f85d2ffd640 1 -- 172.21.15.137:0/3733846351 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f85d808ae70 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.770+0000 7f85e1c63640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85c006c8f0 0x7f85c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:08.772 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.771+0000 7f85e1c63640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85c006c8f0 0x7f85c006edb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f85cc034000 tx=0x7f85cc02c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:08.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.774+0000 7f85d2ffd640 1 -- 172.21.15.137:0/3733846351 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f85d8059280 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.951+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f85dc0b8f10 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.951+0000 7f85d2ffd640 1 -- 172.21.15.137:0/3733846351 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) ==== 104+0+11 (secure 0 0 0) 0x7f85d8058b80 con 0x7f85dc0b1ef0 2024-04-26T22:08:08.951 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:08:08.953 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85c006c8f0 msgr2=0x7f85c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85c006c8f0 0x7f85c006edb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f85cc034000 tx=0x7f85cc02c000 comp rx=0 tx=0).stop 2024-04-26T22:08:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0b1ef0 msgr2=0x7f85dc1f3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0b1ef0 0x7f85dc1f3160 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f85d800c500 tx=0x7f85d800c9c0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 shutdown_connections 2024-04-26T22:08:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85c006c8f0 0x7f85c006edb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85dc160950 0x7f85dc0cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85dc0d0090 0x7f85dc0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 --2- 172.21.15.137:0/3733846351 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85dc0b1ef0 0x7f85dc1f3160 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.953+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 >> 172.21.15.137:0/3733846351 conn(0x7f85dc09ba40 msgr2=0x7f85dc0b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.954+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 shutdown_connections 2024-04-26T22:08:08.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:08.954+0000 7f85e46c8640 1 -- 172.21.15.137:0/3733846351 wait complete. 2024-04-26T22:08:08.964 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:08:09.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.064+0000 7f8959207640 1 Processor -- start 2024-04-26T22:08:09.064 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.064+0000 7f8959207640 1 -- start start 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f8959207640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f895406f340 0x7f89540b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f8959207640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89540d0300 0x7f895406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f8959207640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f895406fc60 con 0x7f89540b3e50 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f8959207640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f89540b46a0 con 0x7f89540d0300 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f8959207640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89540b5db0 con 0x7f895406f340 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f895259c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f89540d0300 0x7f895406f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f895359e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f89540b3e50 0x7f89540720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55336/0 (socket says 172.21.15.137:55336) 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f895359e640 1 -- 172.21.15.137:0/3465034030 learned_addr learned my addr 172.21.15.137:0/3465034030 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f895259c640 1 -- 172.21.15.137:0/3465034030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f895406f340 msgr2=0x7f89540b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f895259c640 1 --2- 172.21.15.137:0/3465034030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f895406f340 0x7f89540b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f895259c640 1 -- 172.21.15.137:0/3465034030 >> v1:172.21.15.137:6789/0 conn(0x7f89540b3e50 legacy=0x7f89540720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.066 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f895259c640 1 -- 172.21.15.137:0/3465034030 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89540b6090 con 0x7f89540d0300 2024-04-26T22:08:09.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.065+0000 7f8951d9b640 1 -- 172.21.15.137:0/3465034030 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423792099 0 0) 0x7f895406fc60 con 0x7f89540b3e50 2024-04-26T22:08:09.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.066+0000 7f895259c640 1 --2- 172.21.15.137:0/3465034030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540d0300 0x7f895406f720 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f89480097a0 tx=0x7f894802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7d2557044bb578 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:09.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.066+0000 7f8951d9b640 1 -- 172.21.15.137:0/3465034030 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948037070 con 0x7f89540d0300 2024-04-26T22:08:09.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.066+0000 7f8951d9b640 1 -- 172.21.15.137:0/3465034030 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894802adb0 con 0x7f89540d0300 2024-04-26T22:08:09.067 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.066+0000 7f8951d9b640 1 -- 172.21.15.137:0/3465034030 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948032660 con 0x7f89540d0300 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.067+0000 7f8959207640 1 -- 172.21.15.137:0/3465034030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540d0300 msgr2=0x7f895406f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.067+0000 7f8959207640 1 --2- 172.21.15.137:0/3465034030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540d0300 0x7f895406f720 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f89480097a0 tx=0x7f894802a060 comp rx=0 tx=0).stop 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.067+0000 7f8959207640 1 -- 172.21.15.137:0/3465034030 shutdown_connections 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.067+0000 7f8959207640 1 --2- 172.21.15.137:0/3465034030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540d0300 0x7f895406f720 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.067+0000 7f8959207640 1 --2- 172.21.15.137:0/3465034030 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f895406f340 0x7f89540b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.067+0000 7f8959207640 1 -- 172.21.15.137:0/3465034030 >> 172.21.15.137:0/3465034030 conn(0x7f89540cd8a0 msgr2=0x7f89540cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.067+0000 7f8959207640 1 -- 172.21.15.137:0/3465034030 shutdown_connections 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.067+0000 7f8959207640 1 -- 172.21.15.137:0/3465034030 wait complete. 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.068+0000 7f8959207640 1 Processor -- start 2024-04-26T22:08:09.068 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.068+0000 7f8959207640 1 -- start start 2024-04-26T22:08:09.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f8959207640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f895406f340 0x7f895413b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f8959207640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540b3e50 0x7f895413a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f8959207640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89540d0300 0x7f895413a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f8959207640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f89540b42e0 con 0x7f89540b3e50 2024-04-26T22:08:09.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f8959207640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f89540b6650 con 0x7f895406f340 2024-04-26T22:08:09.070 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f8959207640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f89540b4460 con 0x7f89540d0300 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540b3e50 0x7f895413a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540b3e50 0x7f895413a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52656/0 (socket says 172.21.15.137:52656) 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895259c640 1 -- 172.21.15.137:0/2811160543 learned_addr learned my addr 172.21.15.137:0/2811160543 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f8952d9d640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f895406f340 0x7f895413b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895359e640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89540d0300 0x7f895413a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895259c640 1 -- 172.21.15.137:0/2811160543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89540d0300 msgr2=0x7f895413a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895259c640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89540d0300 0x7f895413a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895259c640 1 -- 172.21.15.137:0/2811160543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f895406f340 msgr2=0x7f895413b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895259c640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f895406f340 0x7f895413b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895259c640 1 -- 172.21.15.137:0/2811160543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8954154c00 con 0x7f89540b3e50 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f895259c640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540b3e50 0x7f895413a1b0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f89480097a0 tx=0x7f89480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.069+0000 7f893b7fe640 1 -- 172.21.15.137:0/2811160543 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948042070 con 0x7f89540b3e50 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.070+0000 7f893b7fe640 1 -- 172.21.15.137:0/2811160543 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894803e670 con 0x7f89540b3e50 2024-04-26T22:08:09.071 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.070+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8954154ee0 con 0x7f89540b3e50 2024-04-26T22:08:09.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.070+0000 7f893b7fe640 1 -- 172.21.15.137:0/2811160543 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948037040 con 0x7f89540b3e50 2024-04-26T22:08:09.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.070+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895413ba50 con 0x7f89540b3e50 2024-04-26T22:08:09.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.071+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f895406a290 con 0x7f89540b3e50 2024-04-26T22:08:09.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.071+0000 7f893b7fe640 1 -- 172.21.15.137:0/2811160543 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8948045070 con 0x7f89540b3e50 2024-04-26T22:08:09.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.072+0000 7f893b7fe640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f894006c8f0 0x7f894006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.072+0000 7f893b7fe640 1 -- 172.21.15.137:0/2811160543 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f89480ac5f0 con 0x7f89540b3e50 2024-04-26T22:08:09.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.072+0000 7f8952d9d640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f894006c8f0 0x7f894006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.073 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.072+0000 7f8952d9d640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f894006c8f0 0x7f894006edb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f895413fe40 tx=0x7f8944007310 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:09.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.076+0000 7f893b7fe640 1 -- 172.21.15.137:0/2811160543 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f894807aa90 con 0x7f89540b3e50 2024-04-26T22:08:09.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.249+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f89540b4bd0 con 0x7f89540b3e50 2024-04-26T22:08:09.249 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.249+0000 7f893b7fe640 1 -- 172.21.15.137:0/2811160543 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) ==== 100+0+11 (secure 0 0 0) 0x7f894807a390 con 0x7f89540b3e50 2024-04-26T22:08:09.249 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:08:09.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f894006c8f0 msgr2=0x7f894006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f894006c8f0 0x7f894006edb0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f895413fe40 tx=0x7f8944007310 comp rx=0 tx=0).stop 2024-04-26T22:08:09.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540b3e50 msgr2=0x7f895413a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540b3e50 0x7f895413a1b0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f89480097a0 tx=0x7f89480046c0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 shutdown_connections 2024-04-26T22:08:09.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f894006c8f0 0x7f894006edb0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f89540b3e50 0x7f895413a1b0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f89540d0300 0x7f895413a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 --2- 172.21.15.137:0/2811160543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f895406f340 0x7f895413b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 >> 172.21.15.137:0/2811160543 conn(0x7f89540cd8a0 msgr2=0x7f89540cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:09.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 shutdown_connections 2024-04-26T22:08:09.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.251+0000 7f8959207640 1 -- 172.21.15.137:0/2811160543 wait complete. 2024-04-26T22:08:09.263 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T22:08:09.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.361+0000 7f51418f1640 1 Processor -- start 2024-04-26T22:08:09.361 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.361+0000 7f51418f1640 1 -- start start 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f51418f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c15f750 0x7f513c0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f51418f1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513c0d03a0 con 0x7f513c15f370 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f51418f1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513c0d0680 con 0x7f513c0d3ee0 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f51418f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f513c0d0960 con 0x7f513c15f750 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f513affd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f513c15f370 0x7f513c0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55338/0 (socket says 172.21.15.137:55338) 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f513affd640 1 -- 172.21.15.137:0/1653127855 learned_addr learned my addr 172.21.15.137:0/1653127855 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f513b7fe640 1 --2- 172.21.15.137:0/1653127855 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c15f750 0x7f513c0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f5139ffb640 1 -- 172.21.15.137:0/1653127855 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597376736 0 0) 0x7f513c0d03a0 con 0x7f513c15f370 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f5139ffb640 1 -- 172.21.15.137:0/1653127855 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5124003520 con 0x7f513c15f370 2024-04-26T22:08:09.363 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f5139ffb640 1 -- 172.21.15.137:0/1653127855 <== mon.1 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 880603787 0 0) 0x7f513c0d0680 con 0x7f513c0d3ee0 2024-04-26T22:08:09.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f5139ffb640 1 -- 172.21.15.137:0/1653127855 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f513c0d03a0 con 0x7f513c0d3ee0 2024-04-26T22:08:09.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f5139ffb640 1 -- 172.21.15.137:0/1653127855 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3500113528 0 0) 0x7f5124003520 con 0x7f513c15f370 2024-04-26T22:08:09.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f513b7fe640 1 -- 172.21.15.137:0/1653127855 >> v1:172.21.15.170:6789/0 conn(0x7f513c0d3ee0 legacy=0x7f513c0b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f513b7fe640 1 -- 172.21.15.137:0/1653127855 >> v1:172.21.15.137:6789/0 conn(0x7f513c15f370 legacy=0x7f513c0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.362+0000 7f513b7fe640 1 -- 172.21.15.137:0/1653127855 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c0d0c40 con 0x7f513c15f750 2024-04-26T22:08:09.364 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.363+0000 7f513b7fe640 1 --2- 172.21.15.137:0/1653127855 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c15f750 0x7f513c0cfd70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5134009dc0 tx=0x7f513402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62347804bc96abc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:09.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.363+0000 7f5139ffb640 1 -- 172.21.15.137:0/1653127855 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c001670 con 0x7f513c15f750 2024-04-26T22:08:09.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.363+0000 7f5139ffb640 1 -- 172.21.15.137:0/1653127855 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5134007540 con 0x7f513c15f750 2024-04-26T22:08:09.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.363+0000 7f5139ffb640 1 -- 172.21.15.137:0/1653127855 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51340078f0 con 0x7f513c15f750 2024-04-26T22:08:09.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.364+0000 7f51418f1640 1 -- 172.21.15.137:0/1653127855 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c15f750 msgr2=0x7f513c0cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.364+0000 7f51418f1640 1 --2- 172.21.15.137:0/1653127855 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c15f750 0x7f513c0cfd70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5134009dc0 tx=0x7f513402a660 comp rx=0 tx=0).stop 2024-04-26T22:08:09.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.364+0000 7f51418f1640 1 -- 172.21.15.137:0/1653127855 shutdown_connections 2024-04-26T22:08:09.367 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.364+0000 7f51418f1640 1 --2- 172.21.15.137:0/1653127855 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c15f750 0x7f513c0cfd70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.364+0000 7f51418f1640 1 -- 172.21.15.137:0/1653127855 >> 172.21.15.137:0/1653127855 conn(0x7f513c08ec10 msgr2=0x7f513c09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.364+0000 7f51418f1640 1 -- 172.21.15.137:0/1653127855 shutdown_connections 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.364+0000 7f51418f1640 1 -- 172.21.15.137:0/1653127855 wait complete. 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.365+0000 7f51418f1640 1 Processor -- start 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.365+0000 7f51418f1640 1 -- start start 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.366+0000 7f51418f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0d3ee0 0x7f513c158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.366+0000 7f51418f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c15f370 0x7f513c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.366+0000 7f51418f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15f750 0x7f513c0ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.366+0000 7f51418f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f513c0b4950 con 0x7f513c15f370 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.366+0000 7f51418f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f513c0b47d0 con 0x7f513c15f750 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.366+0000 7f51418f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f513c0b4ad0 con 0x7f513c0d3ee0 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.366+0000 7f513a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c15f370 0x7f513c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.368 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.366+0000 7f513a7fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c15f370 0x7f513c0cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52662/0 (socket says 172.21.15.137:52662) 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.366+0000 7f513a7fc640 1 -- 172.21.15.137:0/2518524455 learned_addr learned my addr 172.21.15.137:0/2518524455 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f513affd640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0d3ee0 0x7f513c158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f513a7fc640 1 -- 172.21.15.137:0/2518524455 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0d3ee0 msgr2=0x7f513c158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f513a7fc640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0d3ee0 0x7f513c158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f513a7fc640 1 -- 172.21.15.137:0/2518524455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15f750 msgr2=0x7f513c0ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f513b7fe640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15f750 0x7f513c0ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f513a7fc640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15f750 0x7f513c0ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f513a7fc640 1 -- 172.21.15.137:0/2518524455 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c0c9630 con 0x7f513c15f370 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f513a7fc640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c15f370 0x7f513c0cb290 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f513000c390 tx=0x7f513000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f5123fff640 1 -- 172.21.15.137:0/2518524455 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130017070 con 0x7f513c15f370 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f5123fff640 1 -- 172.21.15.137:0/2518524455 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51300052f0 con 0x7f513c15f370 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513c0c9910 con 0x7f513c15f370 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f5123fff640 1 -- 172.21.15.137:0/2518524455 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130003830 con 0x7f513c15f370 2024-04-26T22:08:09.369 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.367+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513c0b3e00 con 0x7f513c15f370 2024-04-26T22:08:09.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.368+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f513c06a290 con 0x7f513c15f370 2024-04-26T22:08:09.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.368+0000 7f5123fff640 1 -- 172.21.15.137:0/2518524455 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f513001a070 con 0x7f513c15f370 2024-04-26T22:08:09.370 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.369+0000 7f5123fff640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c8f0 0x7f512806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.369+0000 7f5123fff640 1 -- 172.21.15.137:0/2518524455 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f513008af50 con 0x7f513c15f370 2024-04-26T22:08:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.369+0000 7f513affd640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c8f0 0x7f512806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.371 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.369+0000 7f513affd640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c8f0 0x7f512806edb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f512c001340 tx=0x7f512c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:09.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.373+0000 7f5123fff640 1 -- 172.21.15.137:0/2518524455 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5130059420 con 0x7f513c15f370 2024-04-26T22:08:09.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.564+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f513c0cf690 con 0x7f513c15f370 2024-04-26T22:08:09.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.565+0000 7f5123fff640 1 -- 172.21.15.137:0/2518524455 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v117) ==== 80+0+248 (secure 0 0 0) 0x7f5130058d20 con 0x7f513c15f370 2024-04-26T22:08:09.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6837/2830617564 2024-04-27T22:08:00.183091+0000 2024-04-26T22:08:09.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137:6835/2830617564 2024-04-27T22:08:00.183091+0000 2024-04-26T22:08:09.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.170:6834/1666946913 2024-04-27T22:07:49.712915+0000 2024-04-26T22:08:09.565 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.170:6832/1666946913 2024-04-27T22:07:49.712915+0000 2024-04-26T22:08:09.565 INFO:teuthology.orchestra.run.smithi137.stderr:listed 4 entries 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c8f0 msgr2=0x7f512806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c8f0 0x7f512806edb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f512c001340 tx=0x7f512c009040 comp rx=0 tx=0).stop 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c15f370 msgr2=0x7f513c0cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c15f370 0x7f513c0cb290 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f513000c390 tx=0x7f513000c850 comp rx=0 tx=0).stop 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 shutdown_connections 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f512806c8f0 0x7f512806edb0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f513c15f370 0x7f513c0cb290 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f513c15f750 0x7f513c0ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 --2- 172.21.15.137:0/2518524455 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f513c0d3ee0 0x7f513c158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 >> 172.21.15.137:0/2518524455 conn(0x7f513c08ec10 msgr2=0x7f513c0b63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:09.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 shutdown_connections 2024-04-26T22:08:09.568 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.567+0000 7f51418f1640 1 -- 172.21.15.137:0/2518524455 wait complete. 2024-04-26T22:08:09.578 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T22:08:09.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:09.578 DEBUG:teuthology.orchestra.run.smithi137:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T22:08:09.605 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:08:09.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:09.605 DEBUG:teuthology.orchestra.run.smithi137:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T22:08:09.660 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:08:09.660 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:08:09.660 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:09.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:08:09.679 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:08:09.679 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:08:09.679 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:09.714 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:08:09.715 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T22:08:09.715 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:08:09.715 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:09.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:08:09.736 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:08:09.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.851+0000 7f4ff2f46640 1 Processor -- start 2024-04-26T22:08:09.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.851+0000 7f4ff2f46640 1 -- start start 2024-04-26T22:08:09.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.851+0000 7f4ff2f46640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4fec15f370 0x7f4fec0cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.851+0000 7f4ff2f46640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fec0d3ee0 0x7f4fec0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.851+0000 7f4ff2f46640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fec0d03a0 con 0x7f4fec15f750 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.851+0000 7f4ff2f46640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4fec0b4d10 con 0x7f4fec15f370 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.851+0000 7f4ff2f46640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4fec0d0680 con 0x7f4fec0d3ee0 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.851+0000 7f4febfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f4fec15f750 0x7f4fec0d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55340/0 (socket says 172.21.15.137:55340) 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.851+0000 7f4febfff640 1 -- 172.21.15.137:0/598909276 learned_addr learned my addr 172.21.15.137:0/598909276 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1944799476 0 0) 0x7f4fec0d03a0 con 0x7f4fec15f750 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fd8003520 con 0x7f4fec15f750 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/598909276 >> v2:172.21.15.170:3300/0 conn(0x7f4fec15f370 0x7f4fec0cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff14e3640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fec0d3ee0 0x7f4fec0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 399005476 0 0) 0x7f4fd8003520 con 0x7f4fec15f750 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fec0d3ee0 msgr2=0x7f4fec0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fec0d3ee0 0x7f4fec0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.856 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 >> v2:172.21.15.170:3300/0 conn(0x7f4fec15f370 msgr2=0x7f4fec0cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 --2- 172.21.15.137:0/598909276 >> v2:172.21.15.170:3300/0 conn(0x7f4fec15f370 0x7f4fec0cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec0d0960 con 0x7f4fec15f750 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f4fdc001670 con 0x7f4fec15f750 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 >> v1:172.21.15.137:6789/0 conn(0x7f4fec15f750 legacy=0x7f4fec0d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/598909276 >> v2:172.21.15.170:3300/0 conn(0x7f4fec15f370 0x7f4fec0cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd80039b0 0x7f4fd8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fd8004800 0x7f4fd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fec0d3ee0 0x7f4fd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec0b4d10 con 0x7f4fd80039b0 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec0d0680 con 0x7f4fd8004800 2024-04-26T22:08:09.857 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd800b9f0 con 0x7f4fec0d3ee0 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd80039b0 0x7f4fd8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff14e3640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fec0d3ee0 0x7f4fd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4febfff640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fd8004800 0x7f4fd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff0ce2640 1 -- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fec0d3ee0 msgr2=0x7f4fd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fec0d3ee0 0x7f4fd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff0ce2640 1 -- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fd8004800 msgr2=0x7f4fd8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fd8004800 0x7f4fd8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4ff0ce2640 1 -- 172.21.15.137:0/598909276 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd8003520 con 0x7f4fd80039b0 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.852+0000 7f4febfff640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fd8004800 0x7f4fd8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.853+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd80039b0 0x7f4fd8003dd0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40073e0 tx=0x7f4fd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db64ffae1a2fcdf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:09.858 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.853+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4009c80 con 0x7f4fd80039b0 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.853+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe402c680 con 0x7f4fd80039b0 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.853+0000 7f4feb7fe640 1 -- 172.21.15.137:0/598909276 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe402ca30 con 0x7f4fd80039b0 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.854+0000 7f4ff2f46640 1 -- 172.21.15.137:0/598909276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd80039b0 msgr2=0x7f4fd8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.854+0000 7f4ff2f46640 1 --2- 172.21.15.137:0/598909276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fd80039b0 0x7f4fd8003dd0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40073e0 tx=0x7f4fd8005830 comp rx=0 tx=0).stop 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.854+0000 7f4ff14e3640 1 -- 172.21.15.137:0/598909276 reap_dead start 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.854+0000 7f4ff2f46640 1 -- 172.21.15.137:0/598909276 shutdown_connections 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.854+0000 7f4ff2f46640 1 -- 172.21.15.137:0/598909276 >> 172.21.15.137:0/598909276 conn(0x7f4fec08ec10 msgr2=0x7f4fec09e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.854+0000 7f4ff2f46640 1 -- 172.21.15.137:0/598909276 shutdown_connections 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.854+0000 7f4ff2f46640 1 -- 172.21.15.137:0/598909276 wait complete. 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.855+0000 7f4ff2f46640 1 Processor -- start 2024-04-26T22:08:09.859 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.855+0000 7f4ff2f46640 1 -- start start 2024-04-26T22:08:09.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff2f46640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fd80039b0 0x7f4fec0b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff2f46640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fec0b3f70 0x7f4fec15fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff2f46640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec14ef90 0x7f4fec160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff2f46640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec0b47d0 con 0x7f4fec14ef90 2024-04-26T22:08:09.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff2f46640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec0d0f20 con 0x7f4fec0b3f70 2024-04-26T22:08:09.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff2f46640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4fec0b4950 con 0x7f4fd80039b0 2024-04-26T22:08:09.862 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff14e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec14ef90 0x7f4fec160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff14e3640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec14ef90 0x7f4fec160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52690/0 (socket says 172.21.15.137:52690) 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff14e3640 1 -- 172.21.15.137:0/2096590558 learned_addr learned my addr 172.21.15.137:0/2096590558 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fd80039b0 0x7f4fec0b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4febfff640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fec0b3f70 0x7f4fec15fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff14e3640 1 -- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fd80039b0 msgr2=0x7f4fec0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff14e3640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fd80039b0 0x7f4fec0b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff14e3640 1 -- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fec0b3f70 msgr2=0x7f4fec15fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff14e3640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fec0b3f70 0x7f4fec15fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff14e3640 1 -- 172.21.15.137:0/2096590558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec162820 con 0x7f4fec14ef90 2024-04-26T22:08:09.863 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fd80039b0 0x7f4fec0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4febfff640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fec0b3f70 0x7f4fec15fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4ff14e3640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec14ef90 0x7f4fec160280 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4011860 tx=0x7f4fd4011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4fe97fa640 1 -- 172.21.15.137:0/2096590558 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4019020 con 0x7f4fec14ef90 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.856+0000 7f4fe97fa640 1 -- 172.21.15.137:0/2096590558 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd4004240 con 0x7f4fec14ef90 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.857+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fec14e4b0 con 0x7f4fec14ef90 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.857+0000 7f4fe97fa640 1 -- 172.21.15.137:0/2096590558 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400f7a0 con 0x7f4fec14ef90 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.857+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fec14ea70 con 0x7f4fec14ef90 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.858+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fec14ec70 con 0x7f4fec14ef90 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.858+0000 7f4fe97fa640 1 -- 172.21.15.137:0/2096590558 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4fd401c020 con 0x7f4fec14ef90 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.858+0000 7f4fe97fa640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4fcc06c8f0 0x7f4fcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:09.864 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.858+0000 7f4fe97fa640 1 -- 172.21.15.137:0/2096590558 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f4fd408be40 con 0x7f4fec14ef90 2024-04-26T22:08:09.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.858+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4fcc06c8f0 0x7f4fcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:09.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.859+0000 7f4ff0ce2640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4fcc06c8f0 0x7f4fcc06edb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4035000 tx=0x7f4fe400b030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:09.865 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:09.863+0000 7f4fe97fa640 1 -- 172.21.15.137:0/2096590558 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4fec14ec70 con 0x7f4fec14ef90 2024-04-26T22:08:10.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.072+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fec06a290 con 0x7f4fec14ef90 2024-04-26T22:08:10.072 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.073+0000 7f4fe97fa640 1 -- 172.21.15.137:0/2096590558 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5197 (secure 0 0 0) 0x7f4fd4023020 con 0x7f4fec14ef90 2024-04-26T22:08:10.073 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:10.073 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:08:04.441136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9270":{"gid":9270,"name":"a","rank":0,"incarnation":90,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/3437790809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3437790809},{"type":"v1","addr":"172.21.15.137:6837","nonce":3437790809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9270,"qdb_cluster":[9270]},"id":8}]} 2024-04-26T22:08:10.073 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 93 2024-04-26T22:08:10.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4fcc06c8f0 msgr2=0x7f4fcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4fcc06c8f0 0x7f4fcc06edb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4035000 tx=0x7f4fe400b030 comp rx=0 tx=0).stop 2024-04-26T22:08:10.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec14ef90 msgr2=0x7f4fec160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec14ef90 0x7f4fec160280 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4011860 tx=0x7f4fd4011d20 comp rx=0 tx=0).stop 2024-04-26T22:08:10.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 shutdown_connections 2024-04-26T22:08:10.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4fcc06c8f0 0x7f4fcc06edb0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4fec14ef90 0x7f4fec160280 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4fec0b3f70 0x7f4fec15fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.075 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 --2- 172.21.15.137:0/2096590558 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4fd80039b0 0x7f4fec0b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 >> 172.21.15.137:0/2096590558 conn(0x7f4fec08ec10 msgr2=0x7f4fec15e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:10.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 shutdown_connections 2024-04-26T22:08:10.076 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.075+0000 7f4ff2f46640 1 -- 172.21.15.137:0/2096590558 wait complete. 2024-04-26T22:08:10.086 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:08:10.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.182+0000 7fcc5fabd640 1 Processor -- start 2024-04-26T22:08:10.182 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.182+0000 7fcc5fabd640 1 -- start start 2024-04-26T22:08:10.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.183+0000 7fcc5fabd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58140190 0x7fcc580d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.183+0000 7fcc5fabd640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcc5806c2a0 0x7fcc5806c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.184 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.183+0000 7fcc5fabd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcc58073380 0x7fcc580737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.183+0000 7fcc5fabd640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcc580740f0 con 0x7fcc58073380 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.183+0000 7fcc5fabd640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcc580d0a40 con 0x7fcc5806c2a0 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.183+0000 7fcc5fabd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcc580d0d20 con 0x7fcc58140190 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.183+0000 7fcc5e05a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcc58073380 0x7fcc580737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5e05a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcc58073380 0x7fcc580737f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52700/0 (socket says 172.21.15.137:52700) 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5e05a640 1 -- 172.21.15.137:0/3773320680 learned_addr learned my addr 172.21.15.137:0/3773320680 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5d859640 1 --2- 172.21.15.137:0/3773320680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58140190 0x7fcc580d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5d058640 1 --2- 172.21.15.137:0/3773320680 >> v2:172.21.15.170:3300/0 conn(0x7fcc5806c2a0 0x7fcc5806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5e05a640 1 -- 172.21.15.137:0/3773320680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58140190 msgr2=0x7fcc580d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5e05a640 1 --2- 172.21.15.137:0/3773320680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58140190 0x7fcc580d1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5e05a640 1 -- 172.21.15.137:0/3773320680 >> v2:172.21.15.170:3300/0 conn(0x7fcc5806c2a0 msgr2=0x7fcc5806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5e05a640 1 --2- 172.21.15.137:0/3773320680 >> v2:172.21.15.170:3300/0 conn(0x7fcc5806c2a0 0x7fcc5806c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5e05a640 1 -- 172.21.15.137:0/3773320680 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc580d1000 con 0x7fcc58073380 2024-04-26T22:08:10.185 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.184+0000 7fcc5e05a640 1 --2- 172.21.15.137:0/3773320680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc58073380 0x7fcc580737f0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fcc58072e70 tx=0x7fcc5002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef100b8050c767a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:10.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5c857640 1 -- 172.21.15.137:0/3773320680 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50037070 con 0x7fcc58073380 2024-04-26T22:08:10.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5c857640 1 -- 172.21.15.137:0/3773320680 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc50032440 con 0x7fcc58073380 2024-04-26T22:08:10.186 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5c857640 1 -- 172.21.15.137:0/3773320680 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50032810 con 0x7fcc58073380 2024-04-26T22:08:10.188 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3773320680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc58073380 msgr2=0x7fcc580737f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3773320680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc58073380 0x7fcc580737f0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fcc58072e70 tx=0x7fcc5002a1e0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3773320680 shutdown_connections 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3773320680 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc58073380 0x7fcc580737f0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3773320680 >> v2:172.21.15.170:3300/0 conn(0x7fcc5806c2a0 0x7fcc5806c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3773320680 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58140190 0x7fcc580d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3773320680 >> 172.21.15.137:0/3773320680 conn(0x7fcc580b3c40 msgr2=0x7fcc580b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3773320680 shutdown_connections 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.185+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3773320680 wait complete. 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.186+0000 7fcc5fabd640 1 Processor -- start 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5fabd640 1 -- start start 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5fabd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5806c2a0 0x7fcc58132070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5fabd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58073380 0x7fcc580b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5fabd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc58140190 0x7fcc580b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.189 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5fabd640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcc58073eb0 con 0x7fcc5806c2a0 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5fabd640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcc58073d30 con 0x7fcc58140190 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5fabd640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcc581407b0 con 0x7fcc58073380 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5d859640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5806c2a0 0x7fcc58132070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5d859640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5806c2a0 0x7fcc58132070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52708/0 (socket says 172.21.15.137:52708) 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.187+0000 7fcc5d859640 1 -- 172.21.15.137:0/3917948934 learned_addr learned my addr 172.21.15.137:0/3917948934 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5d859640 1 -- 172.21.15.137:0/3917948934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58073380 msgr2=0x7fcc580b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5d058640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58073380 0x7fcc580b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5d859640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58073380 0x7fcc580b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5e05a640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc58140190 0x7fcc580b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5d859640 1 -- 172.21.15.137:0/3917948934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc58140190 msgr2=0x7fcc580b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5d859640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc58140190 0x7fcc580b2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.190 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5d859640 1 -- 172.21.15.137:0/3917948934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc581325b0 con 0x7fcc5806c2a0 2024-04-26T22:08:10.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5d859640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5806c2a0 0x7fcc58132070 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400efc0 tx=0x7fcc5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:10.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc4e7fc640 1 -- 172.21.15.137:0/3917948934 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54018020 con 0x7fcc5806c2a0 2024-04-26T22:08:10.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc4e7fc640 1 -- 172.21.15.137:0/3917948934 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc54014480 con 0x7fcc5806c2a0 2024-04-26T22:08:10.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc4e7fc640 1 -- 172.21.15.137:0/3917948934 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc54014850 con 0x7fcc5806c2a0 2024-04-26T22:08:10.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5815d5e0 con 0x7fcc5806c2a0 2024-04-26T22:08:10.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.188+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5815dba0 con 0x7fcc5806c2a0 2024-04-26T22:08:10.191 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.189+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc580693d0 con 0x7fcc5806c2a0 2024-04-26T22:08:10.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.189+0000 7fcc4e7fc640 1 -- 172.21.15.137:0/3917948934 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc54005d10 con 0x7fcc5806c2a0 2024-04-26T22:08:10.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.190+0000 7fcc4e7fc640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc3c06c920 0x7fcc3c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.190+0000 7fcc4e7fc640 1 -- 172.21.15.137:0/3917948934 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fcc5408c610 con 0x7fcc5806c2a0 2024-04-26T22:08:10.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.190+0000 7fcc5d058640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc3c06c920 0x7fcc3c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.192 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.190+0000 7fcc5d058640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc3c06c920 0x7fcc3c06ede0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fcc580b7220 tx=0x7fcc48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:10.194 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.194+0000 7fcc4e7fc640 1 -- 172.21.15.137:0/3917948934 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcc54022070 con 0x7fcc5806c2a0 2024-04-26T22:08:10.372 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.372+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc5815fd30 con 0x7fcc5806c2a0 2024-04-26T22:08:10.373 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.373+0000 7fcc4e7fc640 1 -- 172.21.15.137:0/3917948934 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16902 (secure 0 0 0) 0x7fcc581325b0 con 0x7fcc5806c2a0 2024-04-26T22:08:10.373 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:10.373 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":117,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:08:00.183114+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.137:6835/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.170:6834/1666946913":"2024-04-27T22:07:49.712915+0000","172.21.15.170:6832/1666946913":"2024-04-27T22:07:49.712915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:08:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc3c06c920 msgr2=0x7fcc3c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc3c06c920 0x7fcc3c06ede0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fcc580b7220 tx=0x7fcc48008040 comp rx=0 tx=0).stop 2024-04-26T22:08:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5806c2a0 msgr2=0x7fcc58132070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.375 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5806c2a0 0x7fcc58132070 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400efc0 tx=0x7fcc5400c490 comp rx=0 tx=0).stop 2024-04-26T22:08:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 shutdown_connections 2024-04-26T22:08:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc3c06c920 0x7fcc3c06ede0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc58140190 0x7fcc580b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc58073380 0x7fcc580b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 --2- 172.21.15.137:0/3917948934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5806c2a0 0x7fcc58132070 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 >> 172.21.15.137:0/3917948934 conn(0x7fcc580b3c40 msgr2=0x7fcc580d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 shutdown_connections 2024-04-26T22:08:10.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.375+0000 7fcc5fabd640 1 -- 172.21.15.137:0/3917948934 wait complete. 2024-04-26T22:08:10.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T21:58:28.712168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T22:07:35.108686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T22:07:35.848066+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T22:08:10.387 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T22:08:10.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.487+0000 7fd701847640 1 Processor -- start 2024-04-26T22:08:10.487 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.487+0000 7fd701847640 1 -- start start 2024-04-26T22:08:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd701847640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd6fc15f5b0 0x7fd6fc0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd701847640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd6fc15f990 0x7fd6fc0d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd701847640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6fc0b6aa0 con 0x7fd6fc0b55b0 2024-04-26T22:08:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd701847640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd6fc0d3eb0 con 0x7fd6fc15f5b0 2024-04-26T22:08:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd701847640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd6fc0d4190 con 0x7fd6fc15f990 2024-04-26T22:08:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd6faffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd6fc15f5b0 0x7fd6fc0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd6fb7fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd6fc0b55b0 0x7fd6fc0d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55356/0 (socket says 172.21.15.137:55356) 2024-04-26T22:08:10.489 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd6fb7fe640 1 -- 172.21.15.137:0/3985749154 learned_addr learned my addr 172.21.15.137:0/3985749154 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd6fa7fc640 1 --2- 172.21.15.137:0/3985749154 >> v2:172.21.15.170:3300/0 conn(0x7fd6fc15f990 0x7fd6fc0d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd6faffd640 1 -- 172.21.15.137:0/3985749154 >> v2:172.21.15.170:3300/0 conn(0x7fd6fc15f990 msgr2=0x7fd6fc0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.488+0000 7fd6faffd640 1 --2- 172.21.15.137:0/3985749154 >> v2:172.21.15.170:3300/0 conn(0x7fd6fc15f990 0x7fd6fc0d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.489+0000 7fd6faffd640 1 -- 172.21.15.137:0/3985749154 >> v1:172.21.15.137:6789/0 conn(0x7fd6fc0b55b0 legacy=0x7fd6fc0d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.489+0000 7fd6faffd640 1 -- 172.21.15.137:0/3985749154 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc0d0200 con 0x7fd6fc15f5b0 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.489+0000 7fd6f9ffb640 1 -- 172.21.15.137:0/3985749154 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275396333 0 0) 0x7fd6fc0b6aa0 con 0x7fd6fc0b55b0 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.489+0000 7fd6faffd640 1 --2- 172.21.15.137:0/3985749154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f5b0 0x7fd6fc0b5070 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc08ebd0 tx=0x7fd6ec02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a683667960788 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.489+0000 7fd6f9ffb640 1 -- 172.21.15.137:0/3985749154 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec007740 con 0x7fd6fc15f5b0 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.489+0000 7fd6f9ffb640 1 -- 172.21.15.137:0/3985749154 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6ec0078e0 con 0x7fd6fc15f5b0 2024-04-26T22:08:10.490 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.489+0000 7fd6f9ffb640 1 -- 172.21.15.137:0/3985749154 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec007cb0 con 0x7fd6fc15f5b0 2024-04-26T22:08:10.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.490+0000 7fd701847640 1 -- 172.21.15.137:0/3985749154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f5b0 msgr2=0x7fd6fc0b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.490+0000 7fd701847640 1 --2- 172.21.15.137:0/3985749154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f5b0 0x7fd6fc0b5070 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc08ebd0 tx=0x7fd6ec02a5f0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.490+0000 7fd701847640 1 -- 172.21.15.137:0/3985749154 shutdown_connections 2024-04-26T22:08:10.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.490+0000 7fd701847640 1 --2- 172.21.15.137:0/3985749154 >> v2:172.21.15.170:3300/0 conn(0x7fd6fc15f990 0x7fd6fc0d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.490+0000 7fd701847640 1 --2- 172.21.15.137:0/3985749154 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f5b0 0x7fd6fc0b5070 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.490+0000 7fd701847640 1 -- 172.21.15.137:0/3985749154 >> 172.21.15.137:0/3985749154 conn(0x7fd6fc08ec40 msgr2=0x7fd6fc09e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:10.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.490+0000 7fd701847640 1 -- 172.21.15.137:0/3985749154 shutdown_connections 2024-04-26T22:08:10.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.490+0000 7fd701847640 1 -- 172.21.15.137:0/3985749154 wait complete. 2024-04-26T22:08:10.493 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.491+0000 7fd701847640 1 Processor -- start 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.491+0000 7fd701847640 1 -- start start 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd701847640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6fc0b55b0 0x7fd6fc162780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd701847640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6fc15f5b0 0x7fd6fc1607e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd701847640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f990 0x7fd6fc0b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd701847640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc0d3bd0 con 0x7fd6fc15f990 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd701847640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc0d3a50 con 0x7fd6fc15f5b0 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd701847640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6fc0d0f40 con 0x7fd6fc0b55b0 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd6fb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f990 0x7fd6fc0b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd6fb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f990 0x7fd6fc0b9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52740/0 (socket says 172.21.15.137:52740) 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd6faffd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6fc0b55b0 0x7fd6fc162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd6fb7fe640 1 -- 172.21.15.137:0/1351813567 learned_addr learned my addr 172.21.15.137:0/1351813567 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd6fa7fc640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6fc15f5b0 0x7fd6fc1607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd6fb7fe640 1 -- 172.21.15.137:0/1351813567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6fc0b55b0 msgr2=0x7fd6fc162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.494 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd6fb7fe640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6fc0b55b0 0x7fd6fc162780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd6fb7fe640 1 -- 172.21.15.137:0/1351813567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6fc15f5b0 msgr2=0x7fd6fc1607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.492+0000 7fd6fb7fe640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6fc15f5b0 0x7fd6fc1607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.493+0000 7fd6fb7fe640 1 -- 172.21.15.137:0/1351813567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc160f50 con 0x7fd6fc15f990 2024-04-26T22:08:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.493+0000 7fd6fb7fe640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f990 0x7fd6fc0b9fb0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c450 tx=0x7fd6f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.493+0000 7fd6e3fff640 1 -- 172.21.15.137:0/1351813567 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4018070 con 0x7fd6fc15f990 2024-04-26T22:08:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.493+0000 7fd6e3fff640 1 -- 172.21.15.137:0/1351813567 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f4007500 con 0x7fd6fc15f990 2024-04-26T22:08:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.493+0000 7fd6e3fff640 1 -- 172.21.15.137:0/1351813567 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4004a20 con 0x7fd6fc15f990 2024-04-26T22:08:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.493+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6fc161230 con 0x7fd6fc15f990 2024-04-26T22:08:10.495 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.493+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6fc0ba4f0 con 0x7fd6fc15f990 2024-04-26T22:08:10.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.494+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6fc0c9570 con 0x7fd6fc15f990 2024-04-26T22:08:10.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.494+0000 7fd6e3fff640 1 -- 172.21.15.137:0/1351813567 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd6f401b070 con 0x7fd6fc15f990 2024-04-26T22:08:10.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.495+0000 7fd6e3fff640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6e806c920 0x7fd6e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.495+0000 7fd6faffd640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6e806c920 0x7fd6e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.495+0000 7fd6e3fff640 1 -- 172.21.15.137:0/1351813567 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fd6f408ad70 con 0x7fd6fc15f990 2024-04-26T22:08:10.496 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.495+0000 7fd6faffd640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6e806c920 0x7fd6e806ede0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec034000 tx=0x7fd6ec02f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:10.498 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.499+0000 7fd6e3fff640 1 -- 172.21.15.137:0/1351813567 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd6f4058bf0 con 0x7fd6fc15f990 2024-04-26T22:08:10.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.675+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd6fc06a290 con 0x7fd6fc15f990 2024-04-26T22:08:10.675 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.675+0000 7fd6e3fff640 1 -- 172.21.15.137:0/1351813567 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) ==== 93+0+10 (secure 0 0 0) 0x7fd6f405cef0 con 0x7fd6fc15f990 2024-04-26T22:08:10.675 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 1 2024-04-26T22:08:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6e806c920 msgr2=0x7fd6e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6e806c920 0x7fd6e806ede0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec034000 tx=0x7fd6ec02f000 comp rx=0 tx=0).stop 2024-04-26T22:08:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f990 msgr2=0x7fd6fc0b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f990 0x7fd6fc0b9fb0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c450 tx=0x7fd6f400c910 comp rx=0 tx=0).stop 2024-04-26T22:08:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 shutdown_connections 2024-04-26T22:08:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd6e806c920 0x7fd6e806ede0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd6fc15f990 0x7fd6fc0b9fb0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.677 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6fc15f5b0 0x7fd6fc1607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 --2- 172.21.15.137:0/1351813567 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6fc0b55b0 0x7fd6fc162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 >> 172.21.15.137:0/1351813567 conn(0x7fd6fc08ec40 msgr2=0x7fd6fc0d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:10.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 shutdown_connections 2024-04-26T22:08:10.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.677+0000 7fd701847640 1 -- 172.21.15.137:0/1351813567 wait complete. 2024-04-26T22:08:10.688 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T22:08:10.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.787+0000 7f0e61052640 1 Processor -- start 2024-04-26T22:08:10.846 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.787+0000 7f0e61052640 1 -- start start 2024-04-26T22:08:10.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e61052640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0e5c15f990 0x7f0e5c0d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e61052640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e5c0b6aa0 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e61052640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e5c0d3eb0 con 0x7f0e5c15f5b0 2024-04-26T22:08:10.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e61052640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0e5c0d4190 con 0x7f0e5c15f990 2024-04-26T22:08:10.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e5a59c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0e5c15f990 0x7f0e5c0d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.851 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e5b59e640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0e5c0d0f40 0x7f0e5c0d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55358/0 (socket says 172.21.15.137:55358) 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e5b59e640 1 -- 172.21.15.137:0/2265858644 learned_addr learned my addr 172.21.15.137:0/2265858644 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e5a59c640 1 -- 172.21.15.137:0/2265858644 >> v1:172.21.15.170:6789/0 conn(0x7f0e5c15f5b0 legacy=0x7f0e5c0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e5a59c640 1 -- 172.21.15.137:0/2265858644 >> v1:172.21.15.137:6789/0 conn(0x7f0e5c0d0f40 legacy=0x7f0e5c0d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e5a59c640 1 -- 172.21.15.137:0/2265858644 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c0d0200 con 0x7f0e5c15f990 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.788+0000 7f0e59d9b640 1 -- 172.21.15.137:0/2265858644 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610074127 0 0) 0x7f0e5c0b6aa0 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.789+0000 7f0e5a59c640 1 --2- 172.21.15.137:0/2265858644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c15f990 0x7f0e5c0d0a00 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f0e500097a0 tx=0x7f0e5002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7066e89d2b633 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.789+0000 7f0e59d9b640 1 -- 172.21.15.137:0/2265858644 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50037070 con 0x7f0e5c15f990 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.789+0000 7f0e59d9b640 1 -- 172.21.15.137:0/2265858644 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e50032440 con 0x7f0e5c15f990 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.789+0000 7f0e59d9b640 1 -- 172.21.15.137:0/2265858644 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50032810 con 0x7f0e5c15f990 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.790+0000 7f0e61052640 1 -- 172.21.15.137:0/2265858644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c15f990 msgr2=0x7f0e5c0d0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.790+0000 7f0e61052640 1 --2- 172.21.15.137:0/2265858644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c15f990 0x7f0e5c0d0a00 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f0e500097a0 tx=0x7f0e5002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.790+0000 7f0e61052640 1 -- 172.21.15.137:0/2265858644 shutdown_connections 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.790+0000 7f0e61052640 1 --2- 172.21.15.137:0/2265858644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c15f990 0x7f0e5c0d0a00 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.852 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.790+0000 7f0e61052640 1 -- 172.21.15.137:0/2265858644 >> 172.21.15.137:0/2265858644 conn(0x7f0e5c08ec40 msgr2=0x7f0e5c09e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.790+0000 7f0e61052640 1 -- 172.21.15.137:0/2265858644 shutdown_connections 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.790+0000 7f0e61052640 1 -- 172.21.15.137:0/2265858644 wait complete. 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.791+0000 7f0e61052640 1 Processor -- start 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.791+0000 7f0e61052640 1 -- start start 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e61052640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c0d0f40 0x7f0e5c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e61052640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e5c15f5b0 0x7f0e5c156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e61052640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e5c15f990 0x7f0e5c157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e61052640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c0b5900 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e61052640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c0b5780 con 0x7f0e5c15f990 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e61052640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5c0d3a50 con 0x7f0e5c15f5b0 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e5ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c0d0f40 0x7f0e5c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e5a59c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e5c15f5b0 0x7f0e5c156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.853 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e5ad9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c0d0f40 0x7f0e5c155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52758/0 (socket says 172.21.15.137:52758) 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e5ad9d640 1 -- 172.21.15.137:0/3084565094 learned_addr learned my addr 172.21.15.137:0/3084565094 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e5b59e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e5c15f990 0x7f0e5c157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.792+0000 7f0e5a59c640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e5c15f5b0 0x7f0e5c156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:50942/0 (socket says 172.21.15.137:50942) 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e5ad9d640 1 -- 172.21.15.137:0/3084565094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e5c15f5b0 msgr2=0x7f0e5c156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e5ad9d640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e5c15f5b0 0x7f0e5c156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e5ad9d640 1 -- 172.21.15.137:0/3084565094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e5c15f990 msgr2=0x7f0e5c157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e5ad9d640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e5c15f990 0x7f0e5c157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e5ad9d640 1 -- 172.21.15.137:0/3084565094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c161890 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e5ad9d640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c0d0f40 0x7f0e5c155230 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c870 tx=0x7f0e4c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e437fe640 1 -- 172.21.15.137:0/3084565094 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c003b70 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e437fe640 1 -- 172.21.15.137:0/3084565094 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c003d30 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5c161b70 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.854 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e437fe640 1 -- 172.21.15.137:0/3084565094 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00aa90 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.793+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5c162130 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.794+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5c06a290 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.794+0000 7f0e437fe640 1 -- 172.21.15.137:0/3084565094 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e4c00ac30 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.795+0000 7f0e437fe640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0e4806c8f0 0x7f0e4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:10.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.795+0000 7f0e5a59c640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0e4806c8f0 0x7f0e4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:10.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.795+0000 7f0e437fe640 1 -- 172.21.15.137:0/3084565094 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f0e4c08b9c0 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.795+0000 7f0e5a59c640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0e4806c8f0 0x7f0e4806edb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0e50034000 tx=0x7f0e5002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:10.855 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.799+0000 7f0e437fe640 1 -- 172.21.15.137:0/3084565094 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0e4c08de20 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.975+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0e5c15ea90 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.975 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.976+0000 7f0e437fe640 1 -- 172.21.15.137:0/3084565094 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) ==== 104+0+11 (secure 0 0 0) 0x7f0e4c059780 con 0x7f0e5c0d0f40 2024-04-26T22:08:10.975 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 32 2024-04-26T22:08:10.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.977+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0e4806c8f0 msgr2=0x7f0e4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.977+0000 7f0e61052640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0e4806c8f0 0x7f0e4806edb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0e50034000 tx=0x7f0e5002e000 comp rx=0 tx=0).stop 2024-04-26T22:08:10.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.977+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c0d0f40 msgr2=0x7f0e5c155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:10.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.977+0000 7f0e61052640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c0d0f40 0x7f0e5c155230 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c870 tx=0x7f0e4c00cd30 comp rx=0 tx=0).stop 2024-04-26T22:08:10.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.978+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 shutdown_connections 2024-04-26T22:08:10.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.978+0000 7f0e61052640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0e4806c8f0 0x7f0e4806edb0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.978+0000 7f0e61052640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e5c15f990 0x7f0e5c157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.978+0000 7f0e61052640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0e5c15f5b0 0x7f0e5c156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.978 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.978+0000 7f0e61052640 1 --2- 172.21.15.137:0/3084565094 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0e5c0d0f40 0x7f0e5c155230 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:10.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.978+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 >> 172.21.15.137:0/3084565094 conn(0x7f0e5c08ec40 msgr2=0x7f0e5c06e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:10.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.978+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 shutdown_connections 2024-04-26T22:08:10.979 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:10.978+0000 7f0e61052640 1 -- 172.21.15.137:0/3084565094 wait complete. 2024-04-26T22:08:10.988 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T22:08:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.087+0000 7f062767e640 1 Processor -- start 2024-04-26T22:08:11.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.087+0000 7f062767e640 1 -- start start 2024-04-26T22:08:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062767e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f062006f340 0x7f06200b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062767e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 0x7f06200720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062767e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06200b46a0 con 0x7f06200d0300 2024-04-26T22:08:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062767e640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f06200b5db0 con 0x7f062006f340 2024-04-26T22:08:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062767e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f06200b6090 con 0x7f06200b3e50 2024-04-26T22:08:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062541a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f062006f340 0x7f06200b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062541a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f062006f340 0x7f06200b6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52764/0 (socket says 172.21.15.137:52764) 2024-04-26T22:08:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062541a640 1 -- 172.21.15.137:0/581645269 learned_addr learned my addr 172.21.15.137:0/581645269 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f0625c1b640 1 --2- 172.21.15.137:0/581645269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 0x7f06200720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062541a640 1 -- 172.21.15.137:0/581645269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 msgr2=0x7f06200720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062541a640 1 --2- 172.21.15.137:0/581645269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 0x7f06200720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062541a640 1 -- 172.21.15.137:0/581645269 >> v1:172.21.15.170:6789/0 conn(0x7f06200d0300 legacy=0x7f062006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f062541a640 1 -- 172.21.15.137:0/581645269 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06200b6370 con 0x7f062006f340 2024-04-26T22:08:11.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.088+0000 7f0625c1b640 1 --2- 172.21.15.137:0/581645269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 0x7f06200720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f062541a640 1 --2- 172.21.15.137:0/581645269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062006f340 0x7f06200b6b70 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f061c00bb10 tx=0x7f061c02c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697e32cf927c92ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f0617fff640 1 -- 172.21.15.137:0/581645269 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c031710 con 0x7f062006f340 2024-04-26T22:08:11.092 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f0617fff640 1 -- 172.21.15.137:0/581645269 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061c0318b0 con 0x7f062006f340 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f0617fff640 1 -- 172.21.15.137:0/581645269 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c031c80 con 0x7f062006f340 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f062767e640 1 -- 172.21.15.137:0/581645269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062006f340 msgr2=0x7f06200b6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f062767e640 1 --2- 172.21.15.137:0/581645269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062006f340 0x7f06200b6b70 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f061c00bb10 tx=0x7f061c02c7a0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f062767e640 1 -- 172.21.15.137:0/581645269 shutdown_connections 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f062767e640 1 --2- 172.21.15.137:0/581645269 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 0x7f06200720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f062767e640 1 --2- 172.21.15.137:0/581645269 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f062006f340 0x7f06200b6b70 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.089+0000 7f062767e640 1 -- 172.21.15.137:0/581645269 >> 172.21.15.137:0/581645269 conn(0x7f06200cd8a0 msgr2=0x7f06200cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.090+0000 7f062767e640 1 -- 172.21.15.137:0/581645269 shutdown_connections 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.090+0000 7f062767e640 1 -- 172.21.15.137:0/581645269 wait complete. 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f062767e640 1 Processor -- start 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f062767e640 1 -- start start 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f062767e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f062006f340 0x7f06200ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f062767e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 0x7f06200cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f062767e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06200d0300 0x7f062015aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f062767e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f06200b4460 con 0x7f06200d0300 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f062767e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f06200b42e0 con 0x7f062006f340 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f062767e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0620142a30 con 0x7f06200b3e50 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f0625c1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06200d0300 0x7f062015aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f0625c1b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06200d0300 0x7f062015aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52770/0 (socket says 172.21.15.137:52770) 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.091+0000 7f0625c1b640 1 -- 172.21.15.137:0/2379272650 learned_addr learned my addr 172.21.15.137:0/2379272650 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0625c1b640 1 -- 172.21.15.137:0/2379272650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 msgr2=0x7f06200cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0624c19640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 0x7f06200cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f062541a640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f062006f340 0x7f06200ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0625c1b640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 0x7f06200cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0625c1b640 1 -- 172.21.15.137:0/2379272650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f062006f340 msgr2=0x7f06200ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0625c1b640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f062006f340 0x7f06200ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0625c1b640 1 -- 172.21.15.137:0/2379272650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06200ca860 con 0x7f06200d0300 2024-04-26T22:08:11.094 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0625c1b640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06200d0300 0x7f062015aa40 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f061800cef0 tx=0x7f061800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0615ffb640 1 -- 172.21.15.137:0/2379272650 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061801a070 con 0x7f06200d0300 2024-04-26T22:08:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0615ffb640 1 -- 172.21.15.137:0/2379272650 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061800d860 con 0x7f06200d0300 2024-04-26T22:08:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f0615ffb640 1 -- 172.21.15.137:0/2379272650 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061800dc50 con 0x7f06200d0300 2024-04-26T22:08:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06200cab40 con 0x7f06200d0300 2024-04-26T22:08:11.095 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.092+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06200cb100 con 0x7f06200d0300 2024-04-26T22:08:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.093+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062006a290 con 0x7f06200d0300 2024-04-26T22:08:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.094+0000 7f0615ffb640 1 -- 172.21.15.137:0/2379272650 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f061801d070 con 0x7f06200d0300 2024-04-26T22:08:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.094+0000 7f0615ffb640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.094+0000 7f0615ffb640 1 -- 172.21.15.137:0/2379272650 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f061808c4d0 con 0x7f06200d0300 2024-04-26T22:08:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.094+0000 7f062541a640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.096 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.094+0000 7f062541a640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f061c036000 tx=0x7f061c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:11.098 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.098+0000 7f0615ffb640 1 -- 172.21.15.137:0/2379272650 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f061805a910 con 0x7f06200d0300 2024-04-26T22:08:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.272+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f062006d2b0 con 0x7f06200d0300 2024-04-26T22:08:11.272 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.272+0000 7f0615ffb640 1 -- 172.21.15.137:0/2379272650 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) ==== 100+0+11 (secure 0 0 0) 0x7f061805a210 con 0x7f06200d0300 2024-04-26T22:08:11.272 INFO:teuthology.orchestra.run.smithi137.stdout:pg_num: 64 2024-04-26T22:08:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 msgr2=0x7f060406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f061c036000 tx=0x7f061c008040 comp rx=0 tx=0).stop 2024-04-26T22:08:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06200d0300 msgr2=0x7f062015aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06200d0300 0x7f062015aa40 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f061800cef0 tx=0x7f061800a710 comp rx=0 tx=0).stop 2024-04-26T22:08:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 shutdown_connections 2024-04-26T22:08:11.274 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f060406c8f0 0x7f060406edb0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f06200d0300 0x7f062015aa40 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f06200b3e50 0x7f06200cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 --2- 172.21.15.137:0/2379272650 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f062006f340 0x7f06200ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 >> 172.21.15.137:0/2379272650 conn(0x7f06200cd8a0 msgr2=0x7f0620143600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 shutdown_connections 2024-04-26T22:08:11.275 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.274+0000 7f062767e640 1 -- 172.21.15.137:0/2379272650 wait complete. 2024-04-26T22:08:11.285 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:08:11.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.382+0000 7fa265ff7640 1 Processor -- start 2024-04-26T22:08:11.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.382+0000 7fa265ff7640 1 -- start start 2024-04-26T22:08:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.382+0000 7fa265ff7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa26015f370 0x7fa2600cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.382+0000 7fa265ff7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.382+0000 7fa265ff7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2600d03a0 con 0x7fa2600d37d0 2024-04-26T22:08:11.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.382+0000 7fa265ff7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa2600b4d10 con 0x7fa26015f370 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.382+0000 7fa265ff7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa2600d0680 con 0x7fa26015f750 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.383+0000 7fa25effd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.383+0000 7fa25f7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa26015f370 0x7fa2600cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.383+0000 7fa25effd640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:50978/0 (socket says 172.21.15.137:50978) 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.383+0000 7fa25effd640 1 -- 172.21.15.137:0/4287182 learned_addr learned my addr 172.21.15.137:0/4287182 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.383+0000 7fa25f7fe640 1 -- 172.21.15.137:0/4287182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 msgr2=0x7fa2600b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.383+0000 7fa25f7fe640 1 --2- 172.21.15.137:0/4287182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.383+0000 7fa25f7fe640 1 -- 172.21.15.137:0/4287182 >> v1:172.21.15.170:6789/0 conn(0x7fa2600d37d0 legacy=0x7fa2600d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.383+0000 7fa25f7fe640 1 -- 172.21.15.137:0/4287182 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2600d0960 con 0x7fa26015f370 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.383+0000 7fa25effd640 1 --2- 172.21.15.137:0/4287182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:08:11.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.384+0000 7fa25f7fe640 1 --2- 172.21.15.137:0/4287182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26015f370 0x7fa2600cfd70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa2500097a0 tx=0x7fa25002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a92700805a8a5fb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.384+0000 7fa25e7fc640 1 -- 172.21.15.137:0/4287182 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250037070 con 0x7fa26015f370 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.384+0000 7fa25e7fc640 1 -- 172.21.15.137:0/4287182 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25002ae50 con 0x7fa26015f370 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.384+0000 7fa25e7fc640 1 -- 172.21.15.137:0/4287182 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250032660 con 0x7fa26015f370 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.385+0000 7fa265ff7640 1 -- 172.21.15.137:0/4287182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26015f370 msgr2=0x7fa2600cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.385+0000 7fa265ff7640 1 --2- 172.21.15.137:0/4287182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26015f370 0x7fa2600cfd70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa2500097a0 tx=0x7fa25002a100 comp rx=0 tx=0).stop 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.385+0000 7fa265ff7640 1 -- 172.21.15.137:0/4287182 shutdown_connections 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.385+0000 7fa265ff7640 1 --2- 172.21.15.137:0/4287182 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.385+0000 7fa265ff7640 1 --2- 172.21.15.137:0/4287182 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa26015f370 0x7fa2600cfd70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.385+0000 7fa265ff7640 1 -- 172.21.15.137:0/4287182 >> 172.21.15.137:0/4287182 conn(0x7fa26008ec10 msgr2=0x7fa26009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.385+0000 7fa265ff7640 1 -- 172.21.15.137:0/4287182 shutdown_connections 2024-04-26T22:08:11.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.385+0000 7fa265ff7640 1 -- 172.21.15.137:0/4287182 wait complete. 2024-04-26T22:08:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.386+0000 7fa265ff7640 1 Processor -- start 2024-04-26T22:08:11.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.386+0000 7fa265ff7640 1 -- start start 2024-04-26T22:08:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa265ff7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2600d37d0 0x7fa26014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa265ff7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa26015f370 0x7fa2600cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa265ff7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa265ff7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600b51c0 con 0x7fa26015f370 2024-04-26T22:08:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa265ff7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600d0f20 con 0x7fa2600d37d0 2024-04-26T22:08:11.389 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa265ff7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa2600b5340 con 0x7fa26015f750 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa26015f370 0x7fa2600cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa26015f370 0x7fa2600cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52776/0 (socket says 172.21.15.137:52776) 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25effd640 1 -- 172.21.15.137:0/4204653233 learned_addr learned my addr 172.21.15.137:0/4204653233 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25ffff640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25f7fe640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2600d37d0 0x7fa26014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25effd640 1 -- 172.21.15.137:0/4204653233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 msgr2=0x7fa2600cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25effd640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25effd640 1 -- 172.21.15.137:0/4204653233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2600d37d0 msgr2=0x7fa26014ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25effd640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2600d37d0 0x7fa26014ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25effd640 1 -- 172.21.15.137:0/4204653233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26009f380 con 0x7fa26015f370 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.387+0000 7fa25effd640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa26015f370 0x7fa2600cd310 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa25400e9e0 tx=0x7fa25400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.388+0000 7fa247fff640 1 -- 172.21.15.137:0/4204653233 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254017070 con 0x7fa26015f370 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.388+0000 7fa247fff640 1 -- 172.21.15.137:0/4204653233 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa25400c9d0 con 0x7fa26015f370 2024-04-26T22:08:11.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.388+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26014f930 con 0x7fa26015f370 2024-04-26T22:08:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.388+0000 7fa247fff640 1 -- 172.21.15.137:0/4204653233 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25400cd80 con 0x7fa26015f370 2024-04-26T22:08:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.388+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26014fef0 con 0x7fa26015f370 2024-04-26T22:08:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.389+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa26014f740 con 0x7fa26015f370 2024-04-26T22:08:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.389+0000 7fa247fff640 1 -- 172.21.15.137:0/4204653233 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa25401a070 con 0x7fa26015f370 2024-04-26T22:08:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.389+0000 7fa247fff640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa24c06c8f0 0x7fa24c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.390+0000 7fa247fff640 1 -- 172.21.15.137:0/4204653233 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fa25408bf00 con 0x7fa26015f370 2024-04-26T22:08:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.390+0000 7fa25f7fe640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa24c06c8f0 0x7fa24c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.391 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.390+0000 7fa25f7fe640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa24c06c8f0 0x7fa24c06edb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa250034000 tx=0x7fa25002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:11.393 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.394+0000 7fa247fff640 1 -- 172.21.15.137:0/4204653233 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa25405a200 con 0x7fa26015f370 2024-04-26T22:08:11.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.607+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa26006a290 con 0x7fa26015f370 2024-04-26T22:08:11.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.608+0000 7fa247fff640 1 -- 172.21.15.137:0/4204653233 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5197 (secure 0 0 0) 0x7fa254059b00 con 0x7fa26015f370 2024-04-26T22:08:11.608 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:11.608 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:08:04.441136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9270":{"gid":9270,"name":"a","rank":0,"incarnation":90,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/3437790809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3437790809},{"type":"v1","addr":"172.21.15.137:6837","nonce":3437790809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9270,"qdb_cluster":[9270]},"id":8}]} 2024-04-26T22:08:11.608 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 93 2024-04-26T22:08:11.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa24c06c8f0 msgr2=0x7fa24c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa24c06c8f0 0x7fa24c06edb0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa250034000 tx=0x7fa25002e000 comp rx=0 tx=0).stop 2024-04-26T22:08:11.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa26015f370 msgr2=0x7fa2600cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa26015f370 0x7fa2600cd310 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa25400e9e0 tx=0x7fa25400eea0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 shutdown_connections 2024-04-26T22:08:11.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa24c06c8f0 0x7fa24c06edb0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.610 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa26015f370 0x7fa2600cd310 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa26015f750 0x7fa2600cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 --2- 172.21.15.137:0/4204653233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2600d37d0 0x7fa26014ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 >> 172.21.15.137:0/4204653233 conn(0x7fa26008ec10 msgr2=0x7fa2600d4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:11.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 shutdown_connections 2024-04-26T22:08:11.611 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.610+0000 7fa265ff7640 1 -- 172.21.15.137:0/4204653233 wait complete. 2024-04-26T22:08:11.621 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:08:11.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.718+0000 7f5c02293640 1 Processor -- start 2024-04-26T22:08:11.718 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.718+0000 7f5c02293640 1 -- start start 2024-04-26T22:08:11.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.718+0000 7f5c02293640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5bfc1485b0 0x7f5bfc0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c02293640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5bfc073900 0x7f5bfc06fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.719 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c02293640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc0ae8b0 con 0x7f5bfc06fa50 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c02293640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f5bfc0aeb90 con 0x7f5bfc073900 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c02293640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f5bfc0aee70 con 0x7f5bfc1485b0 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c00830640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5bfc073900 0x7f5bfc06fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c00830640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f5bfc073900 0x7f5bfc06fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52788/0 (socket says 172.21.15.137:52788) 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c00830640 1 -- 172.21.15.137:0/1941431553 learned_addr learned my addr 172.21.15.137:0/1941431553 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c00830640 1 -- 172.21.15.137:0/1941431553 >> v2:172.21.15.170:3300/0 conn(0x7f5bfc1485b0 msgr2=0x7f5bfc0afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c00830640 1 --2- 172.21.15.137:0/1941431553 >> v2:172.21.15.170:3300/0 conn(0x7f5bfc1485b0 0x7f5bfc0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c00830640 1 -- 172.21.15.137:0/1941431553 >> v1:172.21.15.170:6789/0 conn(0x7f5bfc06fa50 legacy=0x7f5bfc0731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.719+0000 7f5c00830640 1 -- 172.21.15.137:0/1941431553 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc0af150 con 0x7f5bfc073900 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5c00830640 1 --2- 172.21.15.137:0/1941431553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 0x7f5bfc06fee0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc06e640 tx=0x7f5bf402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad580e372abcffe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5bfaffd640 1 -- 172.21.15.137:0/1941431553 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4036070 con 0x7f5bfc073900 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5bfaffd640 1 -- 172.21.15.137:0/1941431553 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4031600 con 0x7f5bfc073900 2024-04-26T22:08:11.720 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5bfaffd640 1 -- 172.21.15.137:0/1941431553 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40319d0 con 0x7f5bfc073900 2024-04-26T22:08:11.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5c02293640 1 -- 172.21.15.137:0/1941431553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 msgr2=0x7f5bfc06fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5c02293640 1 --2- 172.21.15.137:0/1941431553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 0x7f5bfc06fee0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc06e640 tx=0x7f5bf402a6f0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.723 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5c02293640 1 -- 172.21.15.137:0/1941431553 shutdown_connections 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5c02293640 1 --2- 172.21.15.137:0/1941431553 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 0x7f5bfc06fee0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5c02293640 1 --2- 172.21.15.137:0/1941431553 >> v2:172.21.15.170:3300/0 conn(0x7f5bfc1485b0 0x7f5bfc0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5c02293640 1 -- 172.21.15.137:0/1941431553 >> 172.21.15.137:0/1941431553 conn(0x7f5bfc0d0d30 msgr2=0x7f5bfc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5c02293640 1 -- 172.21.15.137:0/1941431553 shutdown_connections 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.720+0000 7f5c02293640 1 -- 172.21.15.137:0/1941431553 wait complete. 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.721+0000 7f5c02293640 1 Processor -- start 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.722+0000 7f5c02293640 1 -- start start 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.722+0000 7f5c02293640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bfc06fa50 0x7f5bfc0b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.722+0000 7f5c02293640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 0x7f5bfc15f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.722+0000 7f5c02293640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5bfc1485b0 0x7f5bfc15f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.722+0000 7f5c02293640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc0b0170 con 0x7f5bfc073900 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.722+0000 7f5c02293640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f5bfc0af710 con 0x7f5bfc06fa50 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.722+0000 7f5c02293640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f5bfc0b4cd0 con 0x7f5bfc1485b0 2024-04-26T22:08:11.724 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.722+0000 7f5bfb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 0x7f5bfc15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.722+0000 7f5bfb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 0x7f5bfc15f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52804/0 (socket says 172.21.15.137:52804) 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bfb7fe640 1 -- 172.21.15.137:0/1113095934 learned_addr learned my addr 172.21.15.137:0/1113095934 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5c00830640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5bfc1485b0 0x7f5bfc15f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bfbfff640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bfc06fa50 0x7f5bfc0b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bfb7fe640 1 -- 172.21.15.137:0/1113095934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5bfc1485b0 msgr2=0x7f5bfc15f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bfb7fe640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5bfc1485b0 0x7f5bfc15f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bfb7fe640 1 -- 172.21.15.137:0/1113095934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bfc06fa50 msgr2=0x7f5bfc0b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bfb7fe640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bfc06fa50 0x7f5bfc0b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bfb7fe640 1 -- 172.21.15.137:0/1113095934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc0b1f10 con 0x7f5bfc073900 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bfbfff640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bfc06fa50 0x7f5bfc0b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bfb7fe640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 0x7f5bfc15f020 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c410 tx=0x7f5bec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bf8ff9640 1 -- 172.21.15.137:0/1113095934 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec017070 con 0x7f5bfc073900 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bf8ff9640 1 -- 172.21.15.137:0/1113095934 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bec0035f0 con 0x7f5bfc073900 2024-04-26T22:08:11.725 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bfc0b21f0 con 0x7f5bfc073900 2024-04-26T22:08:11.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5bf8ff9640 1 -- 172.21.15.137:0/1113095934 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec003a20 con 0x7f5bfc073900 2024-04-26T22:08:11.726 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.723+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bfc0b27b0 con 0x7f5bfc073900 2024-04-26T22:08:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.724+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bfc06a290 con 0x7f5bfc073900 2024-04-26T22:08:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.725+0000 7f5bf8ff9640 1 -- 172.21.15.137:0/1113095934 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5bec01a070 con 0x7f5bfc073900 2024-04-26T22:08:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.725+0000 7f5bf8ff9640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5be806c8f0 0x7f5be806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.725+0000 7f5bfbfff640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5be806c8f0 0x7f5be806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.725+0000 7f5bf8ff9640 1 -- 172.21.15.137:0/1113095934 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f5bec08b110 con 0x7f5bfc073900 2024-04-26T22:08:11.727 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.725+0000 7f5bfbfff640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5be806c8f0 0x7f5be806edb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000a870 tx=0x7f5bf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:11.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.729+0000 7f5bf8ff9640 1 -- 172.21.15.137:0/1113095934 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f5bec059490 con 0x7f5bfc073900 2024-04-26T22:08:11.906 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.906+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5bfc06d2b0 con 0x7f5bfc073900 2024-04-26T22:08:11.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.907+0000 7f5bf8ff9640 1 -- 172.21.15.137:0/1113095934 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16902 (secure 0 0 0) 0x7f5bec058d90 con 0x7f5bfc073900 2024-04-26T22:08:11.907 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:11.907 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":117,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:08:00.183114+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.137:6835/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.170:6834/1666946913":"2024-04-27T22:07:49.712915+0000","172.21.15.170:6832/1666946913":"2024-04-27T22:07:49.712915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:08:11.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5be806c8f0 msgr2=0x7f5be806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5be806c8f0 0x7f5be806edb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000a870 tx=0x7f5bf0008040 comp rx=0 tx=0).stop 2024-04-26T22:08:11.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 msgr2=0x7f5bfc15f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:11.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 0x7f5bfc15f020 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00c410 tx=0x7f5bec00c8d0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.909 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 shutdown_connections 2024-04-26T22:08:11.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f5be806c8f0 0x7f5be806edb0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f5bfc073900 0x7f5bfc15f020 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f5bfc1485b0 0x7f5bfc15f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 --2- 172.21.15.137:0/1113095934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bfc06fa50 0x7f5bfc0b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:11.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 >> 172.21.15.137:0/1113095934 conn(0x7f5bfc0d0d30 msgr2=0x7f5bfc0b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:11.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 shutdown_connections 2024-04-26T22:08:11.910 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:11.909+0000 7f5c02293640 1 -- 172.21.15.137:0/1113095934 wait complete. 2024-04-26T22:08:11.920 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:08:11.921 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:08:12.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.018+0000 7fd69d914640 1 Processor -- start 2024-04-26T22:08:12.018 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.018+0000 7fd69d914640 1 -- start start 2024-04-26T22:08:12.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd69d914640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd69815f370 0x7fd6980cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.021 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd69d914640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69815f750 0x7fd6980b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd69d914640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6980d03a0 con 0x7fd6980d37d0 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd69d914640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fd6980b4d10 con 0x7fd69815f370 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd69d914640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6980d0680 con 0x7fd69815f750 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6977fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd6980d37d0 0x7fd6980d3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55372/0 (socket says 172.21.15.137:55372) 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6977fe640 1 -- 172.21.15.137:0/4266730090 learned_addr learned my addr 172.21.15.137:0/4266730090 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd68ffff640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69815f750 0x7fd6980b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297824297 0 0) 0x7fd6980d03a0 con 0x7fd6980d37d0 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd696ffd640 1 --2- 172.21.15.137:0/4266730090 >> v2:172.21.15.170:3300/0 conn(0x7fd69815f370 0x7fd6980cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd684003520 con 0x7fd6980d37d0 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4281347136 0 0) 0x7fd684003520 con 0x7fd6980d37d0 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69815f750 msgr2=0x7fd6980b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69815f750 0x7fd6980b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 >> v2:172.21.15.170:3300/0 conn(0x7fd69815f370 msgr2=0x7fd6980cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.022 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 --2- 172.21.15.137:0/4266730090 >> v2:172.21.15.170:3300/0 conn(0x7fd69815f370 0x7fd6980cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6980d0960 con 0x7fd6980d37d0 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fd6900019f0 con 0x7fd6980d37d0 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 >> v1:172.21.15.137:6789/0 conn(0x7fd6980d37d0 legacy=0x7fd6980d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.019+0000 7fd6967fc640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6840039b0 0x7fd684003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd6967fc640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd684004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd6967fc640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69815f750 0x7fd6840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6980b4d10 con 0x7fd684004800 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6980d0680 con 0x7fd6840039b0 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd68400b9c0 con 0x7fd69815f750 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd68ffff640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd684004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd696ffd640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6840039b0 0x7fd684003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd6977fe640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69815f750 0x7fd6840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd68ffff640 1 -- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69815f750 msgr2=0x7fd6840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.023 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd68ffff640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd69815f750 0x7fd6840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd68ffff640 1 -- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6840039b0 msgr2=0x7fd684003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd68ffff640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6840039b0 0x7fd684003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.020+0000 7fd68ffff640 1 -- 172.21.15.137:0/4266730090 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd684003520 con 0x7fd684004800 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd68ffff640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd684004c80 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fd680009af0 tx=0x7fd684005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392d4482b12594d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680036070 con 0x7fd684004800 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd680031400 con 0x7fd684004800 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd6967fc640 1 -- 172.21.15.137:0/4266730090 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680009690 con 0x7fd684004800 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd69d914640 1 -- 172.21.15.137:0/4266730090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 msgr2=0x7fd684004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd69d914640 1 --2- 172.21.15.137:0/4266730090 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd684004c80 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fd680009af0 tx=0x7fd684005830 comp rx=0 tx=0).stop 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd6977fe640 1 -- 172.21.15.137:0/4266730090 reap_dead start 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd69d914640 1 -- 172.21.15.137:0/4266730090 shutdown_connections 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd69d914640 1 -- 172.21.15.137:0/4266730090 >> 172.21.15.137:0/4266730090 conn(0x7fd69808ec10 msgr2=0x7fd69809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd69d914640 1 -- 172.21.15.137:0/4266730090 shutdown_connections 2024-04-26T22:08:12.024 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.021+0000 7fd69d914640 1 -- 172.21.15.137:0/4266730090 wait complete. 2024-04-26T22:08:12.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.022+0000 7fd69d914640 1 Processor -- start 2024-04-26T22:08:12.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd69d914640 1 -- start start 2024-04-26T22:08:12.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd69d914640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd6980ced90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd69d914640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6980cc2c0 0x7fd6980cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd69d914640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6980cdfa0 0x7fd6980ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd69d914640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd6980b47d0 con 0x7fd684004800 2024-04-26T22:08:12.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd69d914640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd6980d0f20 con 0x7fd6980cdfa0 2024-04-26T22:08:12.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd69d914640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd6980b4950 con 0x7fd6980cc2c0 2024-04-26T22:08:12.027 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd696ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd6980ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd696ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd6980ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52828/0 (socket says 172.21.15.137:52828) 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd696ffd640 1 -- 172.21.15.137:0/706201170 learned_addr learned my addr 172.21.15.137:0/706201170 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd68ffff640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6980cc2c0 0x7fd6980cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.023+0000 7fd6977fe640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6980cdfa0 0x7fd6980ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd696ffd640 1 -- 172.21.15.137:0/706201170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6980cc2c0 msgr2=0x7fd6980cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd696ffd640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6980cc2c0 0x7fd6980cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd696ffd640 1 -- 172.21.15.137:0/706201170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6980cdfa0 msgr2=0x7fd6980ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd696ffd640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6980cdfa0 0x7fd6980ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd696ffd640 1 -- 172.21.15.137:0/706201170 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6980cca30 con 0x7fd684004800 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd6977fe640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6980cdfa0 0x7fd6980ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd696ffd640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd6980ced90 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fd688011aa0 tx=0x7fd688011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd694ff9640 1 -- 172.21.15.137:0/706201170 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68800fb80 con 0x7fd684004800 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd694ff9640 1 -- 172.21.15.137:0/706201170 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68800fd20 con 0x7fd684004800 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69815fce0 con 0x7fd684004800 2024-04-26T22:08:12.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd694ff9640 1 -- 172.21.15.137:0/706201170 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688014660 con 0x7fd684004800 2024-04-26T22:08:12.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.024+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6981602a0 con 0x7fd684004800 2024-04-26T22:08:12.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.025+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69806a290 con 0x7fd684004800 2024-04-26T22:08:12.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.025+0000 7fd694ff9640 1 -- 172.21.15.137:0/706201170 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd688012040 con 0x7fd684004800 2024-04-26T22:08:12.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.026+0000 7fd694ff9640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd67806c920 0x7fd67806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.026+0000 7fd68ffff640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd67806c920 0x7fd67806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.026+0000 7fd694ff9640 1 -- 172.21.15.137:0/706201170 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fd68808c1b0 con 0x7fd684004800 2024-04-26T22:08:12.029 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.026+0000 7fd68ffff640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd67806c920 0x7fd67806ede0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd680033000 tx=0x7fd680008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.030+0000 7fd694ff9640 1 -- 172.21.15.137:0/706201170 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd688019030 con 0x7fd684004800 2024-04-26T22:08:12.240 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.241+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6980b6370 con 0x7fd684004800 2024-04-26T22:08:12.241 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.241+0000 7fd694ff9640 1 -- 172.21.15.137:0/706201170 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5197 (secure 0 0 0) 0x7fd68805a5c0 con 0x7fd684004800 2024-04-26T22:08:12.241 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:12.241 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:08:04.441136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9270":{"gid":9270,"name":"a","rank":0,"incarnation":90,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/3437790809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3437790809},{"type":"v1","addr":"172.21.15.137:6837","nonce":3437790809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9270,"qdb_cluster":[9270]},"id":8}]} 2024-04-26T22:08:12.242 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 93 2024-04-26T22:08:12.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd67806c920 msgr2=0x7fd67806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd67806c920 0x7fd67806ede0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd680033000 tx=0x7fd680008030 comp rx=0 tx=0).stop 2024-04-26T22:08:12.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 msgr2=0x7fd6980ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.243 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd6980ced90 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fd688011aa0 tx=0x7fd688011f60 comp rx=0 tx=0).stop 2024-04-26T22:08:12.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 shutdown_connections 2024-04-26T22:08:12.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd67806c920 0x7fd67806ede0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd6980cdfa0 0x7fd6980ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd6980cc2c0 0x7fd6980cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 --2- 172.21.15.137:0/706201170 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd684004800 0x7fd6980ced90 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 >> 172.21.15.137:0/706201170 conn(0x7fd69808ec10 msgr2=0x7fd69815e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:12.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 shutdown_connections 2024-04-26T22:08:12.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.243+0000 7fd69d914640 1 -- 172.21.15.137:0/706201170 wait complete. 2024-04-26T22:08:12.254 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:08:12.350 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.350+0000 7f4e928f1640 1 Processor -- start 2024-04-26T22:08:12.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.350+0000 7f4e928f1640 1 -- start start 2024-04-26T22:08:12.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.351+0000 7f4e928f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c145980 0x7f4e8c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.351+0000 7f4e928f1640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4e8c0b3de0 0x7f4e8c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.351+0000 7f4e928f1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4e8c0b5fd0 0x7f4e8c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.351+0000 7f4e928f1640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8c0b6440 con 0x7f4e8c0b3de0 2024-04-26T22:08:12.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.351+0000 7f4e928f1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8c0b5140 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.353 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.351+0000 7f4e928f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c0b4260 con 0x7f4e8c145980 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.351+0000 7f4e8b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4e8c0b3de0 0x7f4e8c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.351+0000 7f4e8b7fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f4e8c0b3de0 0x7f4e8c0b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52844/0 (socket says 172.21.15.137:52844) 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.351+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/3427334888 learned_addr learned my addr 172.21.15.137:0/3427334888 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.352+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/3427334888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c145980 0x7f4e8c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.352+0000 7f4e90e8e640 1 --2- 172.21.15.137:0/3427334888 >> v2:172.21.15.170:3300/0 conn(0x7f4e8c0b5fd0 0x7f4e8c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.352+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/3427334888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c145980 msgr2=0x7f4e8c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.352+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/3427334888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c145980 0x7f4e8c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.352+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/3427334888 >> v2:172.21.15.170:3300/0 conn(0x7f4e8c0b5fd0 msgr2=0x7f4e8c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.352+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/3427334888 >> v2:172.21.15.170:3300/0 conn(0x7f4e8c0b5fd0 0x7f4e8c15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.352+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/3427334888 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c0b4530 con 0x7f4e8c0b3de0 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.352+0000 7f4e90e8e640 1 --2- 172.21.15.137:0/3427334888 >> v2:172.21.15.170:3300/0 conn(0x7f4e8c0b5fd0 0x7f4e8c15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.352+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/3427334888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b3de0 0x7f4e8c0b5a90 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c06e320 tx=0x7f4e8002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80312927b6476af4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e8affd640 1 -- 172.21.15.137:0/3427334888 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80037070 con 0x7f4e8c0b3de0 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e8affd640 1 -- 172.21.15.137:0/3427334888 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e80032440 con 0x7f4e8c0b3de0 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e8affd640 1 -- 172.21.15.137:0/3427334888 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80032810 con 0x7f4e8c0b3de0 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e928f1640 1 -- 172.21.15.137:0/3427334888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b3de0 msgr2=0x7f4e8c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e928f1640 1 --2- 172.21.15.137:0/3427334888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b3de0 0x7f4e8c0b5a90 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c06e320 tx=0x7f4e8002a140 comp rx=0 tx=0).stop 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e928f1640 1 -- 172.21.15.137:0/3427334888 shutdown_connections 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e928f1640 1 --2- 172.21.15.137:0/3427334888 >> v2:172.21.15.170:3300/0 conn(0x7f4e8c0b5fd0 0x7f4e8c15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e928f1640 1 --2- 172.21.15.137:0/3427334888 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b3de0 0x7f4e8c0b5a90 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e928f1640 1 --2- 172.21.15.137:0/3427334888 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c145980 0x7f4e8c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e928f1640 1 -- 172.21.15.137:0/3427334888 >> 172.21.15.137:0/3427334888 conn(0x7f4e8c0d0d30 msgr2=0x7f4e8c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e928f1640 1 -- 172.21.15.137:0/3427334888 shutdown_connections 2024-04-26T22:08:12.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.353+0000 7f4e928f1640 1 -- 172.21.15.137:0/3427334888 wait complete. 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.354+0000 7f4e928f1640 1 Processor -- start 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e928f1640 1 -- start start 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e928f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0b3de0 0x7f4e8c159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e928f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b5fd0 0x7f4e8c13f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e928f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c145980 0x7f4e8c13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e928f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0b4dd0 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e928f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0b4af0 con 0x7f4e8c145980 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e928f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c15ca50 con 0x7f4e8c0b3de0 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b5fd0 0x7f4e8c13f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.358 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e8b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b5fd0 0x7f4e8c13f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52846/0 (socket says 172.21.15.137:52846) 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/2111917646 learned_addr learned my addr 172.21.15.137:0/2111917646 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.355+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0b3de0 0x7f4e8c159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e90e8e640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c145980 0x7f4e8c13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0b3de0 msgr2=0x7f4e8c159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0b3de0 0x7f4e8c159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c145980 msgr2=0x7f4e8c13fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c145980 0x7f4e8c13fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e8b7fe640 1 -- 172.21.15.137:0/2111917646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c0ccfd0 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0b3de0 0x7f4e8c159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e90e8e640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c145980 0x7f4e8c13fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e8b7fe640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b5fd0 0x7f4e8c13f620 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f4e8002a180 tx=0x7f4e800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e88ff9640 1 -- 172.21.15.137:0/2111917646 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80037040 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e88ff9640 1 -- 172.21.15.137:0/2111917646 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e80042070 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8c13e080 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.359 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e88ff9640 1 -- 172.21.15.137:0/2111917646 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e80030880 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.356+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e8c0cd570 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.357+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e8c1603e0 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.357+0000 7f4e88ff9640 1 -- 172.21.15.137:0/2111917646 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e80030a20 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.358+0000 7f4e88ff9640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.358+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.358+0000 7f4e88ff9640 1 -- 172.21.15.137:0/2111917646 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f4e800ac4f0 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.360 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.358+0000 7f4e8bfff640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009a20 tx=0x7f4e7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.362 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.362+0000 7f4e88ff9640 1 -- 172.21.15.137:0/2111917646 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f4e8c1603e0 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.575+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e8c06a290 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.575 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.576+0000 7f4e88ff9640 1 -- 172.21.15.137:0/2111917646 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5197 (secure 0 0 0) 0x7f4e8007a870 con 0x7f4e8c0b5fd0 2024-04-26T22:08:12.576 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:12.576 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T22:07:36.895650+0000","modified":"2024-04-26T22:08:04.441136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":117,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9270":{"gid":9270,"name":"a","rank":0,"incarnation":90,"state":"up:active","state_seq":4,"addr":"172.21.15.137:6837/3437790809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":3437790809},{"type":"v1","addr":"172.21.15.137:6837","nonce":3437790809}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9270,"qdb_cluster":[9270]},"id":8}]} 2024-04-26T22:08:12.576 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 93 2024-04-26T22:08:12.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 msgr2=0x7f4e7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009a20 tx=0x7f4e7c008040 comp rx=0 tx=0).stop 2024-04-26T22:08:12.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b5fd0 msgr2=0x7f4e8c13f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b5fd0 0x7f4e8c13f620 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f4e8002a180 tx=0x7f4e800046c0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 shutdown_connections 2024-04-26T22:08:12.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f4e7806c8f0 0x7f4e7806edb0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.578 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f4e8c0b5fd0 0x7f4e8c13f620 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e8c145980 0x7f4e8c13fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 --2- 172.21.15.137:0/2111917646 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4e8c0b3de0 0x7f4e8c159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 >> 172.21.15.137:0/2111917646 conn(0x7f4e8c0d0d30 msgr2=0x7f4e8c15b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:12.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 shutdown_connections 2024-04-26T22:08:12.579 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.578+0000 7f4e928f1640 1 -- 172.21.15.137:0/2111917646 wait complete. 2024-04-26T22:08:12.589 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:08:12.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.686+0000 7f7918d4e640 1 Processor -- start 2024-04-26T22:08:12.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.686+0000 7f7918d4e640 1 -- start start 2024-04-26T22:08:12.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.687+0000 7f7918d4e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f791415d360 0x7f79140d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.687+0000 7f7918d4e640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79140ceef0 con 0x7f791409c450 2024-04-26T22:08:12.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.687+0000 7f7918d4e640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79140cda60 con 0x7f79140d1510 2024-04-26T22:08:12.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.687+0000 7f7918d4e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f791415d740 con 0x7f791415d360 2024-04-26T22:08:12.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.687+0000 7f7911d9b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f791409c450 0x7f79140ce7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55386/0 (socket says 172.21.15.137:55386) 2024-04-26T22:08:12.690 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.687+0000 7f7911d9b640 1 -- 172.21.15.137:0/3554715593 learned_addr learned my addr 172.21.15.137:0/3554715593 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791259c640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f791415d360 0x7f79140d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 813038207 0 0) 0x7f79140ceef0 con 0x7f791409c450 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7900003520 con 0x7f791409c450 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4137731065 0 0) 0x7f7900003520 con 0x7f791409c450 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f791415d360 msgr2=0x7f79140d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f791415d360 0x7f79140d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 >> v1:172.21.15.170:6789/0 conn(0x7f79140d1510 legacy=0x7f7914070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79140d1100 con 0x7f791409c450 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f78fc001670 con 0x7f791409c450 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 >> v1:172.21.15.137:6789/0 conn(0x7f791409c450 legacy=0x7f79140ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79000039e0 0x7f7900003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f791415d360 0x7f7900004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7900004d40 0x7f79000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.691 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f791415d740 con 0x7f79000039e0 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f790000ba70 con 0x7f7900004d40 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f790000bc70 con 0x7f791415d360 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791259c640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79000039e0 0x7f7900003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f7911d9b640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f791415d360 0x7f7900004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f7912d9d640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7900004d40 0x7f79000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791259c640 1 -- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f791415d360 msgr2=0x7f7900004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791259c640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f791415d360 0x7f7900004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791259c640 1 -- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7900004d40 msgr2=0x7f79000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791259c640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7900004d40 0x7f79000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f791259c640 1 -- 172.21.15.137:0/3554715593 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7900003520 con 0x7f79000039e0 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f7912d9d640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7900004d40 0x7f79000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.688+0000 7f7911d9b640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f791415d360 0x7f7900004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.689+0000 7f791259c640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79000039e0 0x7f7900003e00 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f7904009f90 tx=0x7f7900005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f586ea7703066c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.692 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.689+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904009c10 con 0x7f79000039e0 2024-04-26T22:08:12.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.689+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7904036070 con 0x7f79000039e0 2024-04-26T22:08:12.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.689+0000 7f791159a640 1 -- 172.21.15.137:0/3554715593 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904031850 con 0x7f79000039e0 2024-04-26T22:08:12.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.690+0000 7f7918d4e640 1 -- 172.21.15.137:0/3554715593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79000039e0 msgr2=0x7f7900003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.690+0000 7f7918d4e640 1 --2- 172.21.15.137:0/3554715593 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79000039e0 0x7f7900003e00 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f7904009f90 tx=0x7f7900005830 comp rx=0 tx=0).stop 2024-04-26T22:08:12.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.690+0000 7f7912d9d640 1 -- 172.21.15.137:0/3554715593 reap_dead start 2024-04-26T22:08:12.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.690+0000 7f7918d4e640 1 -- 172.21.15.137:0/3554715593 shutdown_connections 2024-04-26T22:08:12.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.690+0000 7f7918d4e640 1 -- 172.21.15.137:0/3554715593 >> 172.21.15.137:0/3554715593 conn(0x7f79140b4a40 msgr2=0x7f79140b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:12.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.690+0000 7f7918d4e640 1 -- 172.21.15.137:0/3554715593 shutdown_connections 2024-04-26T22:08:12.693 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.690+0000 7f7918d4e640 1 -- 172.21.15.137:0/3554715593 wait complete. 2024-04-26T22:08:12.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.691+0000 7f7918d4e640 1 Processor -- start 2024-04-26T22:08:12.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.691+0000 7f7918d4e640 1 -- start start 2024-04-26T22:08:12.696 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7918d4e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79000039e0 0x7f79140ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7918d4e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914157890 0x7f7914157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7918d4e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f791406e6f0 0x7f79140cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7918d4e640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f791409c8b0 con 0x7f791406e6f0 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7918d4e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f79140cdfe0 con 0x7f7914157890 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7918d4e640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7914070a20 con 0x7f79000039e0 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7912d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f791406e6f0 0x7f79140cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7912d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f791406e6f0 0x7f79140cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52862/0 (socket says 172.21.15.137:52862) 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7912d9d640 1 -- 172.21.15.137:0/868486150 learned_addr learned my addr 172.21.15.137:0/868486150 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f791259c640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79000039e0 0x7f79140ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7911d9b640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914157890 0x7f7914157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7912d9d640 1 -- 172.21.15.137:0/868486150 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79000039e0 msgr2=0x7f79140ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7912d9d640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79000039e0 0x7f79140ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.697 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7912d9d640 1 -- 172.21.15.137:0/868486150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914157890 msgr2=0x7f7914157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7912d9d640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914157890 0x7f7914157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7912d9d640 1 -- 172.21.15.137:0/868486150 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7914157640 con 0x7f791406e6f0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7912d9d640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f791406e6f0 0x7f79140cc630 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f7914068ff0 tx=0x7f790c00e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f790affd640 1 -- 172.21.15.137:0/868486150 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c019070 con 0x7f791406e6f0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f790affd640 1 -- 172.21.15.137:0/868486150 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c0052e0 con 0x7f791406e6f0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79140cab50 con 0x7f791406e6f0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.692+0000 7f790affd640 1 -- 172.21.15.137:0/868486150 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c005490 con 0x7f791406e6f0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.693+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f791406def0 con 0x7f791406e6f0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.693+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79140693d0 con 0x7f791406e6f0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.694+0000 7f790affd640 1 -- 172.21.15.137:0/868486150 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f790c003810 con 0x7f791406e6f0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.694+0000 7f790affd640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f78f406c920 0x7f78f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.694+0000 7f790affd640 1 -- 172.21.15.137:0/868486150 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7f790c08aea0 con 0x7f791406e6f0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.694+0000 7f791259c640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f78f406c920 0x7f78f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.695+0000 7f791259c640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f78f406c920 0x7f78f406ede0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7904035000 tx=0x7f790402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.699+0000 7f790affd640 1 -- 172.21.15.137:0/868486150 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f790c0592b0 con 0x7f791406e6f0 2024-04-26T22:08:12.877 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.877+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7914161b50 con 0x7f791406e6f0 2024-04-26T22:08:12.878 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.878+0000 7f790affd640 1 -- 172.21.15.137:0/868486150 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16902 (secure 0 0 0) 0x7f790c058bb0 con 0x7f791406e6f0 2024-04-26T22:08:12.878 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:12.878 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":117,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:08:00.183114+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-26T22:07:35.108686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-26T22:07:35.848066+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.137:6835/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.170:6834/1666946913":"2024-04-27T22:07:49.712915+0000","172.21.15.170:6832/1666946913":"2024-04-27T22:07:49.712915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:08:12.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f78f406c920 msgr2=0x7f78f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f78f406c920 0x7f78f406ede0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7904035000 tx=0x7f790402f000 comp rx=0 tx=0).stop 2024-04-26T22:08:12.880 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f791406e6f0 msgr2=0x7f79140cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f791406e6f0 0x7f79140cc630 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f7914068ff0 tx=0x7f790c00e820 comp rx=0 tx=0).stop 2024-04-26T22:08:12.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 shutdown_connections 2024-04-26T22:08:12.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f78f406c920 0x7f78f406ede0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f791406e6f0 0x7f79140cc630 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7914157890 0x7f7914157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 --2- 172.21.15.137:0/868486150 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79000039e0 0x7f79140ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 >> 172.21.15.137:0/868486150 conn(0x7f79140b4a40 msgr2=0x7f7914160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:12.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 shutdown_connections 2024-04-26T22:08:12.881 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.880+0000 7f7918d4e640 1 -- 172.21.15.137:0/868486150 wait complete. 2024-04-26T22:08:12.891 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T22:08:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.989+0000 7fa9bcc2c640 1 Processor -- start 2024-04-26T22:08:12.989 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.989+0000 7fa9bcc2c640 1 -- start start 2024-04-26T22:08:12.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.990+0000 7fa9bcc2c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b815f370 0x7fa9b80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.990+0000 7fa9bcc2c640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9b80d3ee0 0x7fa9b80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.990+0000 7fa9bcc2c640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9b80d03a0 con 0x7fa9b815f750 2024-04-26T22:08:12.991 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.990+0000 7fa9bcc2c640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa9b80b4d10 con 0x7fa9b80d3ee0 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.990+0000 7fa9bcc2c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b80d0680 con 0x7fa9b815f370 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.990+0000 7fa9b6d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9b80d3ee0 0x7fa9b80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.990+0000 7fa9b5d9b640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa9b815f750 0x7fa9b80d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:55400/0 (socket says 172.21.15.137:55400) 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.990+0000 7fa9b6d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa9b80d3ee0 0x7fa9b80b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52874/0 (socket says 172.21.15.137:52874) 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.990+0000 7fa9b5d9b640 1 -- 172.21.15.137:0/2811540842 learned_addr learned my addr 172.21.15.137:0/2811540842 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.991+0000 7fa9b659c640 1 --2- 172.21.15.137:0/2811540842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b815f370 0x7fa9b80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.991+0000 7fa9b6d9d640 1 -- 172.21.15.137:0/2811540842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b815f370 msgr2=0x7fa9b80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.991+0000 7fa9b6d9d640 1 --2- 172.21.15.137:0/2811540842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b815f370 0x7fa9b80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.991+0000 7fa9b6d9d640 1 -- 172.21.15.137:0/2811540842 >> v1:172.21.15.137:6789/0 conn(0x7fa9b815f750 legacy=0x7fa9b80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.991+0000 7fa9b6d9d640 1 -- 172.21.15.137:0/2811540842 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b80d0960 con 0x7fa9b80d3ee0 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.991+0000 7fa9b559a640 1 -- 172.21.15.137:0/2811540842 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812120675 0 0) 0x7fa9b80d03a0 con 0x7fa9b815f750 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.991+0000 7fa9b659c640 1 --2- 172.21.15.137:0/2811540842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b815f370 0x7fa9b80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.991+0000 7fa9b6d9d640 1 --2- 172.21.15.137:0/2811540842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b80d3ee0 0x7fa9b80b47d0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00097a0 tx=0x7fa9b002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab2f08e48d3d853 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.992 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.991+0000 7fa9b559a640 1 -- 172.21.15.137:0/2811540842 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0037070 con 0x7fa9b80d3ee0 2024-04-26T22:08:12.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9b559a640 1 -- 172.21.15.137:0/2811540842 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b002ae50 con 0x7fa9b80d3ee0 2024-04-26T22:08:12.993 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9b559a640 1 -- 172.21.15.137:0/2811540842 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0032660 con 0x7fa9b80d3ee0 2024-04-26T22:08:12.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2811540842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b80d3ee0 msgr2=0x7fa9b80b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9bcc2c640 1 --2- 172.21.15.137:0/2811540842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b80d3ee0 0x7fa9b80b47d0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00097a0 tx=0x7fa9b002a100 comp rx=0 tx=0).stop 2024-04-26T22:08:12.995 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2811540842 shutdown_connections 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9bcc2c640 1 --2- 172.21.15.137:0/2811540842 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b80d3ee0 0x7fa9b80b47d0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9bcc2c640 1 --2- 172.21.15.137:0/2811540842 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b815f370 0x7fa9b80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2811540842 >> 172.21.15.137:0/2811540842 conn(0x7fa9b808ec10 msgr2=0x7fa9b809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2811540842 shutdown_connections 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.992+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2811540842 wait complete. 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.993+0000 7fa9bcc2c640 1 Processor -- start 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.993+0000 7fa9bcc2c640 1 -- start start 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9bcc2c640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b80d3ee0 0x7fa9b80cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9bcc2c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b815f370 0x7fa9b815b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9bcc2c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9b815f750 0x7fa9b814ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9bcc2c640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80b51c0 con 0x7fa9b815f370 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9bcc2c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80d0f20 con 0x7fa9b815f750 2024-04-26T22:08:12.996 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9bcc2c640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b80b5340 con 0x7fa9b80d3ee0 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9b5d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b815f370 0x7fa9b815b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9b5d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b815f370 0x7fa9b815b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52880/0 (socket says 172.21.15.137:52880) 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9b5d9b640 1 -- 172.21.15.137:0/2684940993 learned_addr learned my addr 172.21.15.137:0/2684940993 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9b6d9d640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9b815f750 0x7fa9b814ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.994+0000 7fa9b659c640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b80d3ee0 0x7fa9b80cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9b5d9b640 1 -- 172.21.15.137:0/2684940993 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b80d3ee0 msgr2=0x7fa9b80cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9b5d9b640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b80d3ee0 0x7fa9b80cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9b5d9b640 1 -- 172.21.15.137:0/2684940993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9b815f750 msgr2=0x7fa9b814ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9b5d9b640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9b815f750 0x7fa9b814ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9b5d9b640 1 -- 172.21.15.137:0/2684940993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b815c180 con 0x7fa9b815f370 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9b5d9b640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b815f370 0x7fa9b815b930 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00c3f0 tx=0x7fa9ac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9a6ffd640 1 -- 172.21.15.137:0/2684940993 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac0074e0 con 0x7fa9b815f370 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9a6ffd640 1 -- 172.21.15.137:0/2684940993 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ac0047e0 con 0x7fa9b815f370 2024-04-26T22:08:12.997 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b815c460 con 0x7fa9b815f370 2024-04-26T22:08:12.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9a6ffd640 1 -- 172.21.15.137:0/2684940993 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac004bd0 con 0x7fa9b815f370 2024-04-26T22:08:12.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.995+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b815ca20 con 0x7fa9b815f370 2024-04-26T22:08:12.998 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.996+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b80b47d0 con 0x7fa9b815f370 2024-04-26T22:08:12.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.996+0000 7fa9a6ffd640 1 -- 172.21.15.137:0/2684940993 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9ac011070 con 0x7fa9b815f370 2024-04-26T22:08:12.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.997+0000 7fa9a6ffd640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa99806c8f0 0x7fa99806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:12.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.997+0000 7fa9a6ffd640 1 -- 172.21.15.137:0/2684940993 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5881+0+0 (secure 0 0 0) 0x7fa9ac08b840 con 0x7fa9b815f370 2024-04-26T22:08:12.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.997+0000 7fa9b659c640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa99806c8f0 0x7fa99806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:12.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:12.997+0000 7fa9b659c640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa99806c8f0 0x7fa99806edb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8003fd0 tx=0x7fa9a80039f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:13.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.001+0000 7fa9a6ffd640 1 -- 172.21.15.137:0/2684940993 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa9b80b47d0 con 0x7fa9b815f370 2024-04-26T22:08:13.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.212+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa9b80b67b0 con 0x7fa9b815f370 2024-04-26T22:08:13.212 INFO:tasks.ceph.mon.a.smithi137.stderr:2024-04-26T22:08:13.212+0000 7f8abdc06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T22:08:13.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.213+0000 7fa9a6ffd640 1 -- 172.21.15.137:0/2684940993 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) ==== 161+0+0 (secure 0 0 0) 0x7fa9ac059bc0 con 0x7fa9b815f370 2024-04-26T22:08:13.213 INFO:teuthology.orchestra.run.smithi137.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T22:08:13.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa99806c8f0 msgr2=0x7fa99806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:13.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa99806c8f0 0x7fa99806edb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa9a8003fd0 tx=0x7fa9a80039f0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b815f370 msgr2=0x7fa9b815b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:13.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b815f370 0x7fa9b815b930 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00c3f0 tx=0x7fa9ac00c8b0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 shutdown_connections 2024-04-26T22:08:13.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa99806c8f0 0x7fa99806edb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.216 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa9b815f370 0x7fa9b815b930 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9b815f750 0x7fa9b814ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 --2- 172.21.15.137:0/2684940993 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa9b80d3ee0 0x7fa9b80cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 >> 172.21.15.137:0/2684940993 conn(0x7fa9b808ec10 msgr2=0x7fa9b806dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:13.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 shutdown_connections 2024-04-26T22:08:13.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.216+0000 7fa9bcc2c640 1 -- 172.21.15.137:0/2684940993 wait complete. 2024-04-26T22:08:13.217 INFO:tasks.ceph.mds.a.smithi137.stderr: -1287> 2024-04-26T22:08:06.193+0000 7fab3c8ba640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T22:08:13.228 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T22:08:13.242 INFO:tasks.ceph.mds.a.smithi137.stdout:starting mds.a at 2024-04-26T22:08:13.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.329+0000 7eff48c93640 1 Processor -- start 2024-04-26T22:08:13.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.329+0000 7eff48c93640 1 -- start start 2024-04-26T22:08:13.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.330+0000 7eff48c93640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7eff4415f680 0x7eff440d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:13.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.330+0000 7eff48c93640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff44163aa0 0x7eff440b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:13.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.330+0000 7eff48c93640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff440d3f50 con 0x7eff440b60b0 2024-04-26T22:08:13.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.330+0000 7eff48c93640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7eff4415fa60 con 0x7eff44163aa0 2024-04-26T22:08:13.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.330+0000 7eff48c93640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7eff440b5090 con 0x7eff4415f680 2024-04-26T22:08:13.331 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.330+0000 7eff41d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff44163aa0 0x7eff440b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.330+0000 7eff41d9b640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff44163aa0 0x7eff440b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52892/0 (socket says 172.21.15.137:52892) 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.330+0000 7eff41d9b640 1 -- 172.21.15.137:0/2981220030 learned_addr learned my addr 172.21.15.137:0/2981220030 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.331+0000 7eff4259c640 1 --2- 172.21.15.137:0/2981220030 >> v2:172.21.15.170:3300/0 conn(0x7eff4415f680 0x7eff440d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.331+0000 7eff41d9b640 1 -- 172.21.15.137:0/2981220030 >> v2:172.21.15.170:3300/0 conn(0x7eff4415f680 msgr2=0x7eff440d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.331+0000 7eff41d9b640 1 --2- 172.21.15.137:0/2981220030 >> v2:172.21.15.170:3300/0 conn(0x7eff4415f680 0x7eff440d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.331+0000 7eff41d9b640 1 -- 172.21.15.137:0/2981220030 >> v1:172.21.15.170:6789/0 conn(0x7eff440b60b0 legacy=0x7eff440d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.331+0000 7eff41d9b640 1 -- 172.21.15.137:0/2981220030 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff440b5370 con 0x7eff44163aa0 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.331+0000 7eff4259c640 1 --2- 172.21.15.137:0/2981220030 >> v2:172.21.15.170:3300/0 conn(0x7eff4415f680 0x7eff440d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.331+0000 7eff41d9b640 1 --2- 172.21.15.137:0/2981220030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff44163aa0 0x7eff440b5b70 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7eff440d6370 tx=0x7eff3802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd050196d3599ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.331+0000 7eff4159a640 1 -- 172.21.15.137:0/2981220030 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38037070 con 0x7eff44163aa0 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff4159a640 1 -- 172.21.15.137:0/2981220030 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38032440 con 0x7eff44163aa0 2024-04-26T22:08:13.332 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff4159a640 1 -- 172.21.15.137:0/2981220030 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38032810 con 0x7eff44163aa0 2024-04-26T22:08:13.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff48c93640 1 -- 172.21.15.137:0/2981220030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff44163aa0 msgr2=0x7eff440b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:13.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff48c93640 1 --2- 172.21.15.137:0/2981220030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff44163aa0 0x7eff440b5b70 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7eff440d6370 tx=0x7eff3802a230 comp rx=0 tx=0).stop 2024-04-26T22:08:13.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff48c93640 1 -- 172.21.15.137:0/2981220030 shutdown_connections 2024-04-26T22:08:13.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff48c93640 1 --2- 172.21.15.137:0/2981220030 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff44163aa0 0x7eff440b5b70 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff48c93640 1 --2- 172.21.15.137:0/2981220030 >> v2:172.21.15.170:3300/0 conn(0x7eff4415f680 0x7eff440d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff48c93640 1 -- 172.21.15.137:0/2981220030 >> 172.21.15.137:0/2981220030 conn(0x7eff4408eca0 msgr2=0x7eff4409e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff48c93640 1 -- 172.21.15.137:0/2981220030 shutdown_connections 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.332+0000 7eff48c93640 1 -- 172.21.15.137:0/2981220030 wait complete. 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.333+0000 7eff48c93640 1 Processor -- start 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff48c93640 1 -- start start 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff48c93640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff440b60b0 0x7eff440d1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff48c93640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4415f680 0x7eff440cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff48c93640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff44163aa0 0x7eff440cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff48c93640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff440d57b0 con 0x7eff440b60b0 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff48c93640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7eff440d5630 con 0x7eff4415f680 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff48c93640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7eff440d5930 con 0x7eff44163aa0 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff4259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff440b60b0 0x7eff440d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:13.336 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff4259c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff440b60b0 0x7eff440d1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52900/0 (socket says 172.21.15.137:52900) 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff4259c640 1 -- 172.21.15.137:0/553179007 learned_addr learned my addr 172.21.15.137:0/553179007 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff41d9b640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4415f680 0x7eff440cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.334+0000 7eff42d9d640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff44163aa0 0x7eff440cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff4259c640 1 -- 172.21.15.137:0/553179007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff44163aa0 msgr2=0x7eff440cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff4259c640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff44163aa0 0x7eff440cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff4259c640 1 -- 172.21.15.137:0/553179007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4415f680 msgr2=0x7eff440cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff4259c640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4415f680 0x7eff440cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff4259c640 1 -- 172.21.15.137:0/553179007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff440cde70 con 0x7eff440b60b0 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff42d9d640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff44163aa0 0x7eff440cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff4259c640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff440b60b0 0x7eff440d1690 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7eff3400cf90 tx=0x7eff3400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff32ffd640 1 -- 172.21.15.137:0/553179007 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3401a070 con 0x7eff440b60b0 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff32ffd640 1 -- 172.21.15.137:0/553179007 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3400d840 con 0x7eff440b60b0 2024-04-26T22:08:13.337 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff440ce150 con 0x7eff440b60b0 2024-04-26T22:08:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff32ffd640 1 -- 172.21.15.137:0/553179007 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3400dc10 con 0x7eff440b60b0 2024-04-26T22:08:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.335+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff440ce710 con 0x7eff440b60b0 2024-04-26T22:08:13.338 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.336+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff440d5f10 con 0x7eff440b60b0 2024-04-26T22:08:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.336+0000 7eff32ffd640 1 -- 172.21.15.137:0/553179007 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff3401d070 con 0x7eff440b60b0 2024-04-26T22:08:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.337+0000 7eff32ffd640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff2406c8f0 0x7eff2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.337+0000 7eff41d9b640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff2406c8f0 0x7eff2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.337+0000 7eff32ffd640 1 -- 172.21.15.137:0/553179007 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5967+0+0 (secure 0 0 0) 0x7eff3408c420 con 0x7eff440b60b0 2024-04-26T22:08:13.339 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.337+0000 7eff41d9b640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff2406c8f0 0x7eff2406edb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff38034000 tx=0x7eff3802e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:13.340 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.341+0000 7eff32ffd640 1 -- 172.21.15.137:0/553179007 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7eff440d5f10 con 0x7eff440b60b0 2024-04-26T22:08:13.553 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:13.553+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7eff4406a290 con 0x7eff440b60b0 2024-04-26T22:08:14.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.215+0000 7eff32ffd640 1 -- 172.21.15.137:0/553179007 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) ==== 104+0+0 (secure 0 0 0) 0x7eff3405a100 con 0x7eff440b60b0 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.217+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff2406c8f0 msgr2=0x7eff2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff2406c8f0 0x7eff2406edb0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7eff38034000 tx=0x7eff3802e000 comp rx=0 tx=0).stop 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff440b60b0 msgr2=0x7eff440d1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff440b60b0 0x7eff440d1690 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7eff3400cf90 tx=0x7eff3400a7d0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 shutdown_connections 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff2406c8f0 0x7eff2406edb0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff44163aa0 0x7eff440cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff4415f680 0x7eff440cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 --2- 172.21.15.137:0/553179007 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff440b60b0 0x7eff440d1690 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 >> 172.21.15.137:0/553179007 conn(0x7eff4408eca0 msgr2=0x7eff4415d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:14.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 shutdown_connections 2024-04-26T22:08:14.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.218+0000 7eff48c93640 1 -- 172.21.15.137:0/553179007 wait complete. 2024-04-26T22:08:14.231 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T22:08:14.376 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.377+0000 7fcc4aac4640 1 Processor -- start 2024-04-26T22:08:14.377 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.377+0000 7fcc4aac4640 1 -- start start 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.377+0000 7fcc4aac4640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcc4406fd60 0x7fcc440af570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.377+0000 7fcc4aac4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc440734f0 0x7fcc440739a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.377+0000 7fcc4aac4640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc44074240 con 0x7fcc4415cc90 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.377+0000 7fcc4aac4640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fcc440b5400 con 0x7fcc4406fd60 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.377+0000 7fcc4aac4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcc44074520 con 0x7fcc440734f0 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.378+0000 7fcc43fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcc4406fd60 0x7fcc440af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.378+0000 7fcc43fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fcc4406fd60 0x7fcc440af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52912/0 (socket says 172.21.15.137:52912) 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.378+0000 7fcc43fff640 1 -- 172.21.15.137:0/1749633691 learned_addr learned my addr 172.21.15.137:0/1749633691 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.378+0000 7fcc49061640 1 --2- 172.21.15.137:0/1749633691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc440734f0 0x7fcc440739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.378+0000 7fcc43fff640 1 -- 172.21.15.137:0/1749633691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc440734f0 msgr2=0x7fcc440739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:14.378 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.378+0000 7fcc43fff640 1 --2- 172.21.15.137:0/1749633691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc440734f0 0x7fcc440739a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.378+0000 7fcc43fff640 1 -- 172.21.15.137:0/1749633691 >> v1:172.21.15.170:6789/0 conn(0x7fcc4415cc90 legacy=0x7fcc4406f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:14.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.378+0000 7fcc43fff640 1 -- 172.21.15.137:0/1749633691 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc440b5650 con 0x7fcc4406fd60 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc43fff640 1 --2- 172.21.15.137:0/1749633691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc4406fd60 0x7fcc440af570 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009870 tx=0x7fcc3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc37a97523d18ed8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc437fe640 1 -- 172.21.15.137:0/1749633691 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30037070 con 0x7fcc4406fd60 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc437fe640 1 -- 172.21.15.137:0/1749633691 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc30032440 con 0x7fcc4406fd60 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc437fe640 1 -- 172.21.15.137:0/1749633691 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30032810 con 0x7fcc4406fd60 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc4aac4640 1 -- 172.21.15.137:0/1749633691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc4406fd60 msgr2=0x7fcc440af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc4aac4640 1 --2- 172.21.15.137:0/1749633691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc4406fd60 0x7fcc440af570 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fcc30009870 tx=0x7fcc3002a270 comp rx=0 tx=0).stop 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc4aac4640 1 -- 172.21.15.137:0/1749633691 shutdown_connections 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc4aac4640 1 --2- 172.21.15.137:0/1749633691 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc440734f0 0x7fcc440739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc4aac4640 1 --2- 172.21.15.137:0/1749633691 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc4406fd60 0x7fcc440af570 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc4aac4640 1 -- 172.21.15.137:0/1749633691 >> 172.21.15.137:0/1749633691 conn(0x7fcc440b7460 msgr2=0x7fcc440b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:14.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc4aac4640 1 -- 172.21.15.137:0/1749633691 shutdown_connections 2024-04-26T22:08:14.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.379+0000 7fcc4aac4640 1 -- 172.21.15.137:0/1749633691 wait complete. 2024-04-26T22:08:14.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.381+0000 7fcc4aac4640 1 Processor -- start 2024-04-26T22:08:14.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.381+0000 7fcc4aac4640 1 -- start start 2024-04-26T22:08:14.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.381+0000 7fcc4aac4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc4406fd60 0x7fcc440b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:14.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.381+0000 7fcc4aac4640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc440734f0 0x7fcc4414b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:14.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.381+0000 7fcc4aac4640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc4415cc90 0x7fcc440b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.381+0000 7fcc4aac4640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4415d070 con 0x7fcc440734f0 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.381+0000 7fcc4aac4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcc44073ee0 con 0x7fcc4406fd60 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.381+0000 7fcc4aac4640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4415d1f0 con 0x7fcc4415cc90 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc43fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc440734f0 0x7fcc4414b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc43fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc440734f0 0x7fcc4414b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:52916/0 (socket says 172.21.15.137:52916) 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc43fff640 1 -- 172.21.15.137:0/548224636 learned_addr learned my addr 172.21.15.137:0/548224636 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc49061640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc4415cc90 0x7fcc440b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc43fff640 1 -- 172.21.15.137:0/548224636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc4415cc90 msgr2=0x7fcc440b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc43fff640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc4415cc90 0x7fcc440b0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc43fff640 1 -- 172.21.15.137:0/548224636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc4406fd60 msgr2=0x7fcc440b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc48860640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc4406fd60 0x7fcc440b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc43fff640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc4406fd60 0x7fcc440b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc43fff640 1 -- 172.21.15.137:0/548224636 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4414bce0 con 0x7fcc440734f0 2024-04-26T22:08:14.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc43fff640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc440734f0 0x7fcc4414b7a0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fcc3002a2b0 tx=0x7fcc300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:14.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc417fa640 1 -- 172.21.15.137:0/548224636 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30041020 con 0x7fcc440734f0 2024-04-26T22:08:14.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc417fa640 1 -- 172.21.15.137:0/548224636 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc300306c0 con 0x7fcc440734f0 2024-04-26T22:08:14.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc440cfb90 con 0x7fcc440734f0 2024-04-26T22:08:14.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc417fa640 1 -- 172.21.15.137:0/548224636 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30037040 con 0x7fcc440734f0 2024-04-26T22:08:14.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.382+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc440d0150 con 0x7fcc440734f0 2024-04-26T22:08:14.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.383+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc440693d0 con 0x7fcc440734f0 2024-04-26T22:08:14.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.384+0000 7fcc417fa640 1 -- 172.21.15.137:0/548224636 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc30044020 con 0x7fcc440734f0 2024-04-26T22:08:14.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.384+0000 7fcc417fa640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc2806c8f0 0x7fcc2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:14.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.384+0000 7fcc417fa640 1 -- 172.21.15.137:0/548224636 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5967+0+0 (secure 0 0 0) 0x7fcc300ac380 con 0x7fcc440734f0 2024-04-26T22:08:14.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.384+0000 7fcc48860640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc2806c8f0 0x7fcc2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:14.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.385+0000 7fcc48860640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc2806c8f0 0x7fcc2806edb0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcc440d0bb0 tx=0x7fcc38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:14.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.389+0000 7fcc417fa640 1 -- 172.21.15.137:0/548224636 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcc3004b030 con 0x7fcc440734f0 2024-04-26T22:08:14.565 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:14.566+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcc4415d3d0 con 0x7fcc440734f0 2024-04-26T22:08:14.910 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:08:14.913 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:08:15.472 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.472+0000 7fcc417fa640 1 -- 172.21.15.137:0/548224636 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v119) ==== 181+0+0 (secure 0 0 0) 0x7fcc3007a740 con 0x7fcc440734f0 2024-04-26T22:08:15.473 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_metadata' removed 2024-04-26T22:08:15.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc2806c8f0 msgr2=0x7fcc2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:15.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc2806c8f0 0x7fcc2806edb0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fcc440d0bb0 tx=0x7fcc38009040 comp rx=0 tx=0).stop 2024-04-26T22:08:15.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc440734f0 msgr2=0x7fcc4414b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:15.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc440734f0 0x7fcc4414b7a0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fcc3002a2b0 tx=0x7fcc300046c0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.476 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 shutdown_connections 2024-04-26T22:08:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc2806c8f0 0x7fcc2806edb0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc440734f0 0x7fcc4414b7a0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc4415cc90 0x7fcc440b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 --2- 172.21.15.137:0/548224636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc4406fd60 0x7fcc440b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 >> 172.21.15.137:0/548224636 conn(0x7fcc440b7460 msgr2=0x7fcc4415bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 shutdown_connections 2024-04-26T22:08:15.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.476+0000 7fcc4aac4640 1 -- 172.21.15.137:0/548224636 wait complete. 2024-04-26T22:08:15.490 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T22:08:15.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.596+0000 7f44ab472640 1 Processor -- start 2024-04-26T22:08:15.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.597+0000 7f44ab472640 1 -- start start 2024-04-26T22:08:15.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.597+0000 7f44ab472640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f44a40b4620 0x7f44a40b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:15.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44ab472640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a415bed0 0x7f44a406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:15.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44ab472640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a40b4a00 con 0x7f44a40cd7e0 2024-04-26T22:08:15.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44ab472640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f44a406ff10 con 0x7f44a40b4620 2024-04-26T22:08:15.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44ab472640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f44a4141e10 con 0x7f44a415bed0 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a9a0f640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f44a40cd7e0 0x7f44a406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47412/0 (socket says 172.21.15.137:47412) 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a9a0f640 1 -- 172.21.15.137:0/3377338359 learned_addr learned my addr 172.21.15.137:0/3377338359 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a920e640 1 --2- 172.21.15.137:0/3377338359 >> v2:172.21.15.170:3300/0 conn(0x7f44a40b4620 0x7f44a40b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a8a0d640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a415bed0 0x7f44a406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843295042 0 0) 0x7f44a40b4a00 con 0x7f44a40cd7e0 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f448c003520 con 0x7f44a40cd7e0 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1464397958 0 0) 0x7f448c003520 con 0x7f44a40cd7e0 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a415bed0 msgr2=0x7f44a406f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a415bed0 0x7f44a406f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 >> v2:172.21.15.170:3300/0 conn(0x7f44a40b4620 msgr2=0x7f44a40b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 --2- 172.21.15.137:0/3377338359 >> v2:172.21.15.170:3300/0 conn(0x7f44a40b4620 0x7f44a40b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a4141200 con 0x7f44a40cd7e0 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f44940019f0 con 0x7f44a40cd7e0 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 >> v1:172.21.15.137:6789/0 conn(0x7f44a40cd7e0 legacy=0x7f44a406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:15.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a415bed0 0x7f448c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f448c003f30 0x7f448c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f448c004d40 0x7f448c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f44a406ff10 con 0x7f448c004d40 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4141e10 con 0x7f448c003f30 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f448c00baa0 con 0x7f44a415bed0 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a9a0f640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f448c004d40 0x7f448c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.598+0000 7f44a920e640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a415bed0 0x7f448c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.599+0000 7f44a8a0d640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f448c003f30 0x7f448c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.599+0000 7f44a9a0f640 1 -- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a415bed0 msgr2=0x7f448c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.599+0000 7f44a9a0f640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a415bed0 0x7f448c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.599+0000 7f44a9a0f640 1 -- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f448c003f30 msgr2=0x7f448c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.599+0000 7f44a9a0f640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f448c003f30 0x7f448c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.599+0000 7f44a9a0f640 1 -- 172.21.15.137:0/3377338359 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c003520 con 0x7f448c004d40 2024-04-26T22:08:15.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.599+0000 7f44a8a0d640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f448c003f30 0x7f448c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.599+0000 7f44a9a0f640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f448c004d40 0x7f448c0051c0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f449400cb20 tx=0x7f448c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459ff9c3fd0eccac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.599+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449400c740 con 0x7f448c004d40 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.600+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f449402de50 con 0x7f448c004d40 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.600+0000 7f44a3fff640 1 -- 172.21.15.137:0/3377338359 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44940358d0 con 0x7f448c004d40 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.600+0000 7f44ab472640 1 -- 172.21.15.137:0/3377338359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f448c004d40 msgr2=0x7f448c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.600+0000 7f44ab472640 1 --2- 172.21.15.137:0/3377338359 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f448c004d40 0x7f448c0051c0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f449400cb20 tx=0x7f448c005830 comp rx=0 tx=0).stop 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.600+0000 7f44a9a0f640 1 -- 172.21.15.137:0/3377338359 reap_dead start 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.600+0000 7f44ab472640 1 -- 172.21.15.137:0/3377338359 shutdown_connections 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.600+0000 7f44ab472640 1 -- 172.21.15.137:0/3377338359 >> 172.21.15.137:0/3377338359 conn(0x7f44a406c690 msgr2=0x7f44a406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.600+0000 7f44ab472640 1 -- 172.21.15.137:0/3377338359 shutdown_connections 2024-04-26T22:08:15.603 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.600+0000 7f44ab472640 1 -- 172.21.15.137:0/3377338359 wait complete. 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.601+0000 7f44ab472640 1 Processor -- start 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.601+0000 7f44ab472640 1 -- start start 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44ab472640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44a40afd10 0x7f44a4072090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44ab472640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a40725d0 0x7f44a415e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44ab472640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44a415e680 0x7f44a414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44ab472640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f44a4141aa0 con 0x7f44a40afd10 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44ab472640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f44a41417c0 con 0x7f44a415e680 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44ab472640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f44a406f9d0 con 0x7f44a40725d0 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a920e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44a40afd10 0x7f44a4072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a920e640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44a40afd10 0x7f44a4072090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53614/0 (socket says 172.21.15.137:53614) 2024-04-26T22:08:15.606 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a920e640 1 -- 172.21.15.137:0/3012123184 learned_addr learned my addr 172.21.15.137:0/3012123184 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a8a0d640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a40725d0 0x7f44a415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a9a0f640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44a415e680 0x7f44a414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a920e640 1 -- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a40725d0 msgr2=0x7f44a415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a920e640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a40725d0 0x7f44a415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a920e640 1 -- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44a415e680 msgr2=0x7f44a414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a920e640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44a415e680 0x7f44a414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a920e640 1 -- 172.21.15.137:0/3012123184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a40aa900 con 0x7f44a40afd10 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a8a0d640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a40725d0 0x7f44a415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.602+0000 7f44a9a0f640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44a415e680 0x7f44a414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.603+0000 7f44a920e640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44a40afd10 0x7f44a4072090 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f449c011aa0 tx=0x7f449c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.603+0000 7f44a1ffb640 1 -- 172.21.15.137:0/3012123184 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c00fb80 con 0x7f44a40afd10 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.603+0000 7f44a1ffb640 1 -- 172.21.15.137:0/3012123184 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f449c00fd20 con 0x7f44a40afd10 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.603+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a415ed20 con 0x7f44a40afd10 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.603+0000 7f44a1ffb640 1 -- 172.21.15.137:0/3012123184 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c014660 con 0x7f44a40afd10 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.603+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a415f2e0 con 0x7f44a40afd10 2024-04-26T22:08:15.607 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.604+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a406a290 con 0x7f44a40afd10 2024-04-26T22:08:15.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.605+0000 7f44a1ffb640 1 -- 172.21.15.137:0/3012123184 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f449c012040 con 0x7f44a40afd10 2024-04-26T22:08:15.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.605+0000 7f44a1ffb640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f449006c8f0 0x7f449006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:15.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.605+0000 7f44a8a0d640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f449006c8f0 0x7f449006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:15.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.605+0000 7f44a1ffb640 1 -- 172.21.15.137:0/3012123184 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5529+0+0 (secure 0 0 0) 0x7f449c08c180 con 0x7f44a40afd10 2024-04-26T22:08:15.608 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.606+0000 7f44a8a0d640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f449006c8f0 0x7f449006edb0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f44a415d6c0 tx=0x7f4498008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:15.609 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.609+0000 7f44a1ffb640 1 -- 172.21.15.137:0/3012123184 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f449c019030 con 0x7f44a40afd10 2024-04-26T22:08:15.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:15.788+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f44a40729b0 con 0x7f44a40afd10 2024-04-26T22:08:16.474 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.474+0000 7f44a1ffb640 1 -- 172.21.15.137:0/3012123184 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v120) ==== 169+0+0 (secure 0 0 0) 0x7f449c05a660 con 0x7f44a40afd10 2024-04-26T22:08:16.474 INFO:teuthology.orchestra.run.smithi137.stderr:pool 'cephfs_data' removed 2024-04-26T22:08:16.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f449006c8f0 msgr2=0x7f449006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f449006c8f0 0x7f449006edb0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f44a415d6c0 tx=0x7f4498008040 comp rx=0 tx=0).stop 2024-04-26T22:08:16.477 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44a40afd10 msgr2=0x7f44a4072090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44a40afd10 0x7f44a4072090 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f449c011aa0 tx=0x7f449c011f60 comp rx=0 tx=0).stop 2024-04-26T22:08:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 shutdown_connections 2024-04-26T22:08:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f449006c8f0 0x7f449006edb0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f44a415e680 0x7f44a414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f44a40725d0 0x7f44a415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 --2- 172.21.15.137:0/3012123184 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f44a40afd10 0x7f44a4072090 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.477+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 >> 172.21.15.137:0/3012123184 conn(0x7f44a406c690 msgr2=0x7f44a4140740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.478+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 shutdown_connections 2024-04-26T22:08:16.478 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.478+0000 7f44ab472640 1 -- 172.21.15.137:0/3012123184 wait complete. 2024-04-26T22:08:16.491 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T22:08:16.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.593+0000 7f2ea5215640 1 Processor -- start 2024-04-26T22:08:16.593 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.593+0000 7f2ea5215640 1 -- start start 2024-04-26T22:08:16.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.593+0000 7f2ea5215640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2ea006f340 0x7f2ea00b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.593+0000 7f2ea5215640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ea00b3e50 0x7f2ea00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.593+0000 7f2ea5215640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea00b46a0 con 0x7f2ea00d0300 2024-04-26T22:08:16.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.593+0000 7f2ea5215640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea00b5db0 con 0x7f2ea00b3e50 2024-04-26T22:08:16.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.593+0000 7f2ea5215640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea00b6090 con 0x7f2ea006f340 2024-04-26T22:08:16.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9f59e640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2ea00b3e50 0x7f2ea00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9e59c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f2ea00d0300 0x7f2ea006f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47420/0 (socket says 172.21.15.137:47420) 2024-04-26T22:08:16.595 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9e59c640 1 -- 172.21.15.137:0/2305033914 learned_addr learned my addr 172.21.15.137:0/2305033914 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9ed9d640 1 --2- 172.21.15.137:0/2305033914 >> v2:172.21.15.170:3300/0 conn(0x7f2ea006f340 0x7f2ea00b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9f59e640 1 -- 172.21.15.137:0/2305033914 >> v2:172.21.15.170:3300/0 conn(0x7f2ea006f340 msgr2=0x7f2ea00b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9f59e640 1 --2- 172.21.15.137:0/2305033914 >> v2:172.21.15.170:3300/0 conn(0x7f2ea006f340 0x7f2ea00b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9f59e640 1 -- 172.21.15.137:0/2305033914 >> v1:172.21.15.137:6789/0 conn(0x7f2ea00d0300 legacy=0x7f2ea006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9dd9b640 1 -- 172.21.15.137:0/2305033914 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729484226 0 0) 0x7f2ea00b46a0 con 0x7f2ea00d0300 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9f59e640 1 -- 172.21.15.137:0/2305033914 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea00b6370 con 0x7f2ea00b3e50 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.594+0000 7f2e9f59e640 1 --2- 172.21.15.137:0/2305033914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 0x7f2ea00720f0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0076180 tx=0x7f2e9802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af266a054972fc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2e9dd9b640 1 -- 172.21.15.137:0/2305033914 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98007740 con 0x7f2ea00b3e50 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2e9dd9b640 1 -- 172.21.15.137:0/2305033914 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e980078e0 con 0x7f2ea00b3e50 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2e9dd9b640 1 -- 172.21.15.137:0/2305033914 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98007cb0 con 0x7f2ea00b3e50 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2ea5215640 1 -- 172.21.15.137:0/2305033914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 msgr2=0x7f2ea00720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2ea5215640 1 --2- 172.21.15.137:0/2305033914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 0x7f2ea00720f0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0076180 tx=0x7f2e9802a560 comp rx=0 tx=0).stop 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2ea5215640 1 -- 172.21.15.137:0/2305033914 shutdown_connections 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2ea5215640 1 --2- 172.21.15.137:0/2305033914 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 0x7f2ea00720f0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.596 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2ea5215640 1 --2- 172.21.15.137:0/2305033914 >> v2:172.21.15.170:3300/0 conn(0x7f2ea006f340 0x7f2ea00b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2ea5215640 1 -- 172.21.15.137:0/2305033914 >> 172.21.15.137:0/2305033914 conn(0x7f2ea00cd8a0 msgr2=0x7f2ea00cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:16.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2ea5215640 1 -- 172.21.15.137:0/2305033914 shutdown_connections 2024-04-26T22:08:16.597 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.595+0000 7f2ea5215640 1 -- 172.21.15.137:0/2305033914 wait complete. 2024-04-26T22:08:16.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.597+0000 7f2ea5215640 1 Processor -- start 2024-04-26T22:08:16.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.597+0000 7f2ea5215640 1 -- start start 2024-04-26T22:08:16.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.597+0000 7f2ea5215640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea006f340 0x7f2ea00cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.597+0000 7f2ea5215640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 0x7f2ea0158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.597+0000 7f2ea5215640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea00d0300 0x7f2ea0155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.599 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.597+0000 7f2ea5215640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea00b4460 con 0x7f2ea00b3e50 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.597+0000 7f2ea5215640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea00b42e0 con 0x7f2ea006f340 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.597+0000 7f2ea5215640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea0142a30 con 0x7f2ea00d0300 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 0x7f2ea0158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9e59c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 0x7f2ea0158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53626/0 (socket says 172.21.15.137:53626) 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9e59c640 1 -- 172.21.15.137:0/3357026161 learned_addr learned my addr 172.21.15.137:0/3357026161 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9f59e640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea00d0300 0x7f2ea0155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9ed9d640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea006f340 0x7f2ea00cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9e59c640 1 -- 172.21.15.137:0/3357026161 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea00d0300 msgr2=0x7f2ea0155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9e59c640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea00d0300 0x7f2ea0155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9e59c640 1 -- 172.21.15.137:0/3357026161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea006f340 msgr2=0x7f2ea00cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9e59c640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea006f340 0x7f2ea00cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9e59c640 1 -- 172.21.15.137:0/3357026161 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea00caf90 con 0x7f2ea00b3e50 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e9e59c640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 0x7f2ea0158220 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c430 tx=0x7f2e9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e977fe640 1 -- 172.21.15.137:0/3357026161 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e900074e0 con 0x7f2ea00b3e50 2024-04-26T22:08:16.600 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e977fe640 1 -- 172.21.15.137:0/3357026161 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e900047e0 con 0x7f2ea00b3e50 2024-04-26T22:08:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea00cb270 con 0x7f2ea00b3e50 2024-04-26T22:08:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2e977fe640 1 -- 172.21.15.137:0/3357026161 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90004bd0 con 0x7f2ea00b3e50 2024-04-26T22:08:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.598+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea00cbb10 con 0x7f2ea00b3e50 2024-04-26T22:08:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.599+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea00cbd10 con 0x7f2ea00b3e50 2024-04-26T22:08:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.600+0000 7f2e977fe640 1 -- 172.21.15.137:0/3357026161 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e90011070 con 0x7f2ea00b3e50 2024-04-26T22:08:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.600+0000 7f2e977fe640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e8006c8f0 0x7f2e8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.601 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.600+0000 7f2e9ed9d640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e8006c8f0 0x7f2e8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.600+0000 7f2e977fe640 1 -- 172.21.15.137:0/3357026161 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f2e9008b430 con 0x7f2ea00b3e50 2024-04-26T22:08:16.602 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.601+0000 7f2e9ed9d640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e8006c8f0 0x7f2e8006edb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2e88006fd0 tx=0x7f2e88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:16.604 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.605+0000 7f2e977fe640 1 -- 172.21.15.137:0/3357026161 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2ea00cbd10 con 0x7f2ea00b3e50 2024-04-26T22:08:16.781 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.781+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2ea006a290 con 0x7f2ea00b3e50 2024-04-26T22:08:16.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.784+0000 7f2e977fe640 1 -- 172.21.15.137:0/3357026161 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f2e90059b40 con 0x7f2ea00b3e50 2024-04-26T22:08:16.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e8006c8f0 msgr2=0x7f2e8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e8006c8f0 0x7f2e8006edb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2e88006fd0 tx=0x7f2e88008040 comp rx=0 tx=0).stop 2024-04-26T22:08:16.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 msgr2=0x7f2ea0158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 0x7f2ea0158220 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c430 tx=0x7f2e9000c8f0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 shutdown_connections 2024-04-26T22:08:16.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2e8006c8f0 0x7f2e8006edb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2ea00b3e50 0x7f2ea0158220 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2ea00d0300 0x7f2ea0155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.787 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 --2- 172.21.15.137:0/3357026161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ea006f340 0x7f2ea00cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 >> 172.21.15.137:0/3357026161 conn(0x7f2ea00cd8a0 msgr2=0x7f2ea006f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:16.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 shutdown_connections 2024-04-26T22:08:16.788 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.787+0000 7f2ea5215640 1 -- 172.21.15.137:0/3357026161 wait complete. 2024-04-26T22:08:16.798 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-26T22:08:16.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.896+0000 7ff9b44f1640 1 Processor -- start 2024-04-26T22:08:16.896 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.896+0000 7ff9b44f1640 1 -- start start 2024-04-26T22:08:16.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.897+0000 7ff9b44f1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff9ac15f1e0 0x7ff9ac06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.897 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.897+0000 7ff9b44f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac06d2b0 0x7ff9ac06d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.897+0000 7ff9b44f1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac0b4a10 con 0x7ff9ac0b44e0 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.897+0000 7ff9b44f1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff9ac06eeb0 con 0x7ff9ac15f1e0 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.897+0000 7ff9b44f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b4cf0 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.897+0000 7ff9b2a8e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac06d2b0 0x7ff9ac06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.897+0000 7ff9b228d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff9ac15f1e0 0x7ff9ac06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.897+0000 7ff9b2a8e640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac06d2b0 0x7ff9ac06d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:60906/0 (socket says 172.21.15.137:60906) 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.897+0000 7ff9b2a8e640 1 -- 172.21.15.137:0/3324527409 learned_addr learned my addr 172.21.15.137:0/3324527409 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.898+0000 7ff9b2a8e640 1 -- 172.21.15.137:0/3324527409 >> v2:172.21.15.170:3300/0 conn(0x7ff9ac15f1e0 msgr2=0x7ff9ac06e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.898+0000 7ff9b2a8e640 1 --2- 172.21.15.137:0/3324527409 >> v2:172.21.15.170:3300/0 conn(0x7ff9ac15f1e0 0x7ff9ac06e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.898+0000 7ff9b2a8e640 1 -- 172.21.15.137:0/3324527409 >> v1:172.21.15.170:6789/0 conn(0x7ff9ac0b44e0 legacy=0x7ff9ac0ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.898 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.898+0000 7ff9b2a8e640 1 -- 172.21.15.137:0/3324527409 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0b4fd0 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.898+0000 7ff9b2a8e640 1 --2- 172.21.15.137:0/3324527409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac06d2b0 0x7ff9ac06d760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009870 tx=0x7ff9a402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f3ce8ed9324e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:16.899 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b128b640 1 -- 172.21.15.137:0/3324527409 <== mon.2 v2:172.21.15.170:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4037070 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b128b640 1 -- 172.21.15.137:0/3324527409 <== mon.2 v2:172.21.15.170:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a4032440 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b128b640 1 -- 172.21.15.137:0/3324527409 <== mon.2 v2:172.21.15.170:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4032810 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3324527409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac06d2b0 msgr2=0x7ff9ac06d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b44f1640 1 --2- 172.21.15.137:0/3324527409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac06d2b0 0x7ff9ac06d760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009870 tx=0x7ff9a402a270 comp rx=0 tx=0).stop 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3324527409 shutdown_connections 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b44f1640 1 --2- 172.21.15.137:0/3324527409 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac06d2b0 0x7ff9ac06d760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b44f1640 1 --2- 172.21.15.137:0/3324527409 >> v2:172.21.15.170:3300/0 conn(0x7ff9ac15f1e0 0x7ff9ac06e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3324527409 >> 172.21.15.137:0/3324527409 conn(0x7ff9ac0728a0 msgr2=0x7ff9ac072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3324527409 shutdown_connections 2024-04-26T22:08:16.900 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.899+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3324527409 wait complete. 2024-04-26T22:08:16.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.900+0000 7ff9b44f1640 1 Processor -- start 2024-04-26T22:08:16.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.900+0000 7ff9b44f1640 1 -- start start 2024-04-26T22:08:16.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b44f1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9ac06d2b0 0x7ff9ac159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.902 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b44f1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac0b44e0 0x7ff9ac147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b44f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9ac15f1e0 0x7ff9ac155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b44f1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac15f5c0 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b44f1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0b5590 con 0x7ff9ac15f1e0 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b44f1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac1562a0 con 0x7ff9ac0b44e0 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b228d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9ac06d2b0 0x7ff9ac159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b228d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9ac06d2b0 0x7ff9ac159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53634/0 (socket says 172.21.15.137:53634) 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b228d640 1 -- 172.21.15.137:0/3199819528 learned_addr learned my addr 172.21.15.137:0/3199819528 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b2a8e640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9ac15f1e0 0x7ff9ac155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b1a8c640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac0b44e0 0x7ff9ac147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b228d640 1 -- 172.21.15.137:0/3199819528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac0b44e0 msgr2=0x7ff9ac147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b228d640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac0b44e0 0x7ff9ac147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b228d640 1 -- 172.21.15.137:0/3199819528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9ac15f1e0 msgr2=0x7ff9ac155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b228d640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9ac15f1e0 0x7ff9ac155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:16.903 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.901+0000 7ff9b228d640 1 -- 172.21.15.137:0/3199819528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac1576e0 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.902+0000 7ff9b228d640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9ac06d2b0 0x7ff9ac159250 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800efc0 tx=0x7ff9a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:16.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.902+0000 7ff9a2ffd640 1 -- 172.21.15.137:0/3199819528 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8018020 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.902+0000 7ff9a2ffd640 1 -- 172.21.15.137:0/3199819528 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a8014480 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.902+0000 7ff9a2ffd640 1 -- 172.21.15.137:0/3199819528 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8014850 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.902+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac159930 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.902+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac159ef0 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.904 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.903+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac06a290 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.903+0000 7ff9a2ffd640 1 -- 172.21.15.137:0/3199819528 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9a8005d10 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.904+0000 7ff9a2ffd640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff99006c8f0 0x7ff99006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:16.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.904+0000 7ff9a2ffd640 1 -- 172.21.15.137:0/3199819528 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7ff9a808c6b0 con 0x7ff9ac06d2b0 2024-04-26T22:08:16.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.904+0000 7ff9b1a8c640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff99006c8f0 0x7ff99006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:16.905 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.904+0000 7ff9b1a8c640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff99006c8f0 0x7ff99006edb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac15c750 tx=0x7ff99c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:16.907 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:16.908+0000 7ff9a2ffd640 1 -- 172.21.15.137:0/3199819528 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7ff9a8022030 con 0x7ff9ac06d2b0 2024-04-26T22:08:17.152 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.152+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) -- 0x7ff9ac075b10 con 0x7ff9ac06d2b0 2024-04-26T22:08:17.483 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.483+0000 7ff9a2ffd640 1 -- 172.21.15.137:0/3199819528 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v454) ==== 144+0+0 (secure 0 0 0) 0x7ff9ac1576e0 con 0x7ff9ac06d2b0 2024-04-26T22:08:17.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff99006c8f0 msgr2=0x7ff99006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:17.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff99006c8f0 0x7ff99006edb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac15c750 tx=0x7ff99c009040 comp rx=0 tx=0).stop 2024-04-26T22:08:17.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9ac06d2b0 msgr2=0x7ff9ac159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:17.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9ac06d2b0 0x7ff9ac159250 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800efc0 tx=0x7ff9a800c490 comp rx=0 tx=0).stop 2024-04-26T22:08:17.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 shutdown_connections 2024-04-26T22:08:17.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff99006c8f0 0x7ff99006edb0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:17.485 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9ac15f1e0 0x7ff9ac155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:17.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff9ac0b44e0 0x7ff9ac147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:17.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 --2- 172.21.15.137:0/3199819528 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff9ac06d2b0 0x7ff9ac159250 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:17.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 >> 172.21.15.137:0/3199819528 conn(0x7ff9ac0728a0 msgr2=0x7ff9ac075390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:17.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 shutdown_connections 2024-04-26T22:08:17.486 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:17.485+0000 7ff9b44f1640 1 -- 172.21.15.137:0/3199819528 wait complete. 2024-04-26T22:08:17.496 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-26T22:08:17.496 INFO:tasks.cephfs_test_runner: 2024-04-26T22:08:17.496 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T22:08:17.497 INFO:tasks.cephfs_test_runner:Ran 7 tests in 546.971s 2024-04-26T22:08:17.497 INFO:tasks.cephfs_test_runner: 2024-04-26T22:08:17.497 INFO:tasks.cephfs_test_runner:OK 2024-04-26T22:08:17.497 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-26T22:08:17.508 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T22:08:17.524 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T22:08:17.524 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:08:17.524 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:17.540 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:08:17.540 DEBUG:teuthology.orchestra.run.smithi137:> set -ex 2024-04-26T22:08:17.540 DEBUG:teuthology.orchestra.run.smithi137:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:17.595 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056096,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15030 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T22:08:17.595 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:08:17.595 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:17.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:08:17.613 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-26T22:08:17.614 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T22:08:17.672 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056110,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15669 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T22:08:17.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:17.672 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:08:17.686 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T22:08:17.687 INFO:teuthology.orchestra.run.smithi137.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T22:08:17.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:17.687 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T22:08:17.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:17.750 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T22:08:17.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:17.815 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-26T22:08:17.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:17.910 DEBUG:teuthology.orchestra.run.smithi137:> ip netns list 2024-04-26T22:08:17.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:17.925 DEBUG:teuthology.orchestra.run.smithi137:> sudo ip link delete ceph-brx 2024-04-26T22:08:17.990 INFO:teuthology.orchestra.run.smithi137.stderr:Cannot find device "ceph-brx" 2024-04-26T22:08:17.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:08:17.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:17.992 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T22:08:18.010 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T22:08:18.010 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T22:08:18.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:18.011 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T22:08:18.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:18.079 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T22:08:18.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:18.146 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-04-26T22:08:18.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:18.241 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-04-26T22:08:18.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T22:08:18.257 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-04-26T22:08:18.324 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2024-04-26T22:08:18.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:08:18.326 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T22:08:18.335 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T22:08:18.335 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:08:18.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.435+0000 7fd85eb97640 1 Processor -- start 2024-04-26T22:08:18.435 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.435+0000 7fd85eb97640 1 -- start start 2024-04-26T22:08:18.436 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.436+0000 7fd85eb97640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd858145980 0x7fd858160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.436+0000 7fd85eb97640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd8580b3de0 0x7fd8580b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.436+0000 7fd85eb97640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8580b4260 con 0x7fd8580b5fd0 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.436+0000 7fd85eb97640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd8580b6440 con 0x7fd8580b3de0 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.436+0000 7fd85eb97640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd8580b5140 con 0x7fd858145980 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.436+0000 7fd857fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd8580b3de0 0x7fd8580b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.436+0000 7fd85d134640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd8580b5fd0 0x7fd85815c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47430/0 (socket says 172.21.15.137:47430) 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.436+0000 7fd857fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd8580b3de0 0x7fd8580b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53648/0 (socket says 172.21.15.137:53648) 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.436+0000 7fd85d134640 1 -- 172.21.15.137:0/808021644 learned_addr learned my addr 172.21.15.137:0/808021644 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.437+0000 7fd85c933640 1 --2- 172.21.15.137:0/808021644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd858145980 0x7fd858160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.437+0000 7fd857fff640 1 -- 172.21.15.137:0/808021644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd858145980 msgr2=0x7fd858160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.437+0000 7fd857fff640 1 --2- 172.21.15.137:0/808021644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd858145980 0x7fd858160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.437+0000 7fd857fff640 1 -- 172.21.15.137:0/808021644 >> v1:172.21.15.137:6789/0 conn(0x7fd8580b5fd0 legacy=0x7fd85815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.437+0000 7fd8577fe640 1 -- 172.21.15.137:0/808021644 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472067529 0 0) 0x7fd8580b4260 con 0x7fd8580b5fd0 2024-04-26T22:08:18.437 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.437+0000 7fd857fff640 1 -- 172.21.15.137:0/808021644 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8580b4530 con 0x7fd8580b3de0 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.437+0000 7fd857fff640 1 --2- 172.21.15.137:0/808021644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8580b3de0 0x7fd8580b5a90 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0097a0 tx=0x7fd84c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc00a3feac266ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd8577fe640 1 -- 172.21.15.137:0/808021644 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c037070 con 0x7fd8580b3de0 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd8577fe640 1 -- 172.21.15.137:0/808021644 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84c02ae50 con 0x7fd8580b3de0 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd8577fe640 1 -- 172.21.15.137:0/808021644 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c032660 con 0x7fd8580b3de0 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd85eb97640 1 -- 172.21.15.137:0/808021644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8580b3de0 msgr2=0x7fd8580b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd85eb97640 1 --2- 172.21.15.137:0/808021644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8580b3de0 0x7fd8580b5a90 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0097a0 tx=0x7fd84c02a100 comp rx=0 tx=0).stop 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd85eb97640 1 -- 172.21.15.137:0/808021644 shutdown_connections 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd85eb97640 1 --2- 172.21.15.137:0/808021644 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd8580b3de0 0x7fd8580b5a90 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd85eb97640 1 --2- 172.21.15.137:0/808021644 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd858145980 0x7fd858160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd85eb97640 1 -- 172.21.15.137:0/808021644 >> 172.21.15.137:0/808021644 conn(0x7fd8580d0d30 msgr2=0x7fd8580d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd85eb97640 1 -- 172.21.15.137:0/808021644 shutdown_connections 2024-04-26T22:08:18.439 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.438+0000 7fd85eb97640 1 -- 172.21.15.137:0/808021644 wait complete. 2024-04-26T22:08:18.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.439+0000 7fd85eb97640 1 Processor -- start 2024-04-26T22:08:18.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.440+0000 7fd85eb97640 1 -- start start 2024-04-26T22:08:18.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.440+0000 7fd85eb97640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8580b3de0 0x7fd85815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.440+0000 7fd85eb97640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8580b5fd0 0x7fd85813da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.440+0000 7fd85eb97640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd858145980 0x7fd85813f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.440+0000 7fd85eb97640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd8580b4dd0 con 0x7fd858145980 2024-04-26T22:08:18.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.440+0000 7fd85eb97640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd8580b4af0 con 0x7fd8580b5fd0 2024-04-26T22:08:18.442 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.440+0000 7fd85eb97640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd8580730e0 con 0x7fd8580b3de0 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.440+0000 7fd85d134640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd858145980 0x7fd85813f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85d134640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd858145980 0x7fd85813f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53660/0 (socket says 172.21.15.137:53660) 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85d134640 1 -- 172.21.15.137:0/164724728 learned_addr learned my addr 172.21.15.137:0/164724728 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85c933640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8580b3de0 0x7fd85815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd857fff640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8580b5fd0 0x7fd85813da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85d134640 1 -- 172.21.15.137:0/164724728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8580b3de0 msgr2=0x7fd85815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85d134640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8580b3de0 0x7fd85815a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85d134640 1 -- 172.21.15.137:0/164724728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8580b5fd0 msgr2=0x7fd85813da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85d134640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8580b5fd0 0x7fd85813da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85d134640 1 -- 172.21.15.137:0/164724728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85813d120 con 0x7fd858145980 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85d134640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd858145980 0x7fd85813f580 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fd85000cb60 tx=0x7fd85000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd8557fa640 1 -- 172.21.15.137:0/164724728 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850017070 con 0x7fd858145980 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd8557fa640 1 -- 172.21.15.137:0/164724728 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85000ad60 con 0x7fd858145980 2024-04-26T22:08:18.443 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85813d3c0 con 0x7fd858145980 2024-04-26T22:08:18.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd8557fa640 1 -- 172.21.15.137:0/164724728 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850012640 con 0x7fd858145980 2024-04-26T22:08:18.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.441+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8580ceef0 con 0x7fd858145980 2024-04-26T22:08:18.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.442+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85806a290 con 0x7fd858145980 2024-04-26T22:08:18.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.442+0000 7fd8557fa640 1 -- 172.21.15.137:0/164724728 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd85001a070 con 0x7fd858145980 2024-04-26T22:08:18.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.443+0000 7fd8557fa640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd84406c920 0x7fd84406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.443+0000 7fd8557fa640 1 -- 172.21.15.137:0/164724728 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7fd85008b620 con 0x7fd858145980 2024-04-26T22:08:18.444 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.443+0000 7fd85c933640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd84406c920 0x7fd84406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.445 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.443+0000 7fd85c933640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd84406c920 0x7fd84406ede0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd8480079a0 tx=0x7fd848008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:18.447 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.447+0000 7fd8557fa640 1 -- 172.21.15.137:0/164724728 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd850059650 con 0x7fd858145980 2024-04-26T22:08:18.620 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.621+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd858073cc0 con 0x7fd84406c920 2024-04-26T22:08:18.621 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.621+0000 7fd8557fa640 1 -- 172.21.15.137:0/164724728 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13411 (secure 0 0 0) 0x7fd858073cc0 con 0x7fd84406c920 2024-04-26T22:08:18.621 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:18.621 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:08:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd84406c920 msgr2=0x7fd84406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd84406c920 0x7fd84406ede0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd8480079a0 tx=0x7fd848008040 comp rx=0 tx=0).stop 2024-04-26T22:08:18.623 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd858145980 msgr2=0x7fd85813f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd858145980 0x7fd85813f580 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fd85000cb60 tx=0x7fd85000a430 comp rx=0 tx=0).stop 2024-04-26T22:08:18.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 shutdown_connections 2024-04-26T22:08:18.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd84406c920 0x7fd84406ede0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd858145980 0x7fd85813f580 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8580b5fd0 0x7fd85813da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 --2- 172.21.15.137:0/164724728 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd8580b3de0 0x7fd85815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 >> 172.21.15.137:0/164724728 conn(0x7fd8580d0d30 msgr2=0x7fd8580b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:18.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 shutdown_connections 2024-04-26T22:08:18.624 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.623+0000 7fd85eb97640 1 -- 172.21.15.137:0/164724728 wait complete. 2024-04-26T22:08:18.634 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-04-26T22:08:16.822215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295048,"kb_used_data":28992,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754679672,"statfs":{"total":773094113280,"available":772791984128,"internally_reserved":0,"allocated":29687808,"data_stored":23030568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390399,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-172,"num_write_kb":-8302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001062"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":366,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-04-26T22:08:00.188270+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:08:00.188270+0000","last_peered":"2024-04-26T22:08:00.188270+0000","last_clean":"2024-04-26T22:08:00.188270+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:08:00.188270+0000","last_undegraded":"2024-04-26T22:08:00.188270+0000","last_fullsized":"2024-04-26T22:08:00.188270+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574969,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37344,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334496,"statfs":{"total":96636764160,"available":96598523904,"internally_reserved":0,"allocated":2056192,"data_stored":1224150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40860,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330980,"statfs":{"total":96636764160,"available":96594923520,"internally_reserved":0,"allocated":5656576,"data_stored":4827547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36772,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335068,"statfs":{"total":96636764160,"available":96599109632,"internally_reserved":0,"allocated":1470464,"data_stored":633782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":1454080,"data_stored":633166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":5536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":5668864,"data_stored":4830374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1458176,"data_stored":633171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":5524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5656576,"data_stored":4827594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37296,"kb_used_data":6120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334544,"statfs":{"total":96636764160,"available":96598573056,"internally_reserved":0,"allocated":6266880,"data_stored":5420784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:08:18.635 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:08:18.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.732+0000 7f85bd874640 1 Processor -- start 2024-04-26T22:08:18.732 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.732+0000 7f85bd874640 1 -- start start 2024-04-26T22:08:18.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85bd874640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f85b815f370 0x7f85b80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85bd874640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85b80d3ee0 0x7f85b80b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85bd874640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b80d03a0 con 0x7f85b815f750 2024-04-26T22:08:18.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85bd874640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f85b80b4d10 con 0x7f85b80d3ee0 2024-04-26T22:08:18.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85bd874640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f85b80d0680 con 0x7f85b815f370 2024-04-26T22:08:18.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85b77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85b80d3ee0 0x7f85b80b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85b77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f85b80d3ee0 0x7f85b80b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53676/0 (socket says 172.21.15.137:53676) 2024-04-26T22:08:18.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85b77fe640 1 -- 172.21.15.137:0/3746837543 learned_addr learned my addr 172.21.15.137:0/3746837543 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:18.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85b77fe640 1 -- 172.21.15.137:0/3746837543 >> v2:172.21.15.170:3300/0 conn(0x7f85b815f370 msgr2=0x7f85b80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:18.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85b6ffd640 1 --2- 172.21.15.137:0/3746837543 >> v2:172.21.15.170:3300/0 conn(0x7f85b815f370 0x7f85b80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85b77fe640 1 --2- 172.21.15.137:0/3746837543 >> v2:172.21.15.170:3300/0 conn(0x7f85b815f370 0x7f85b80cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85b77fe640 1 -- 172.21.15.137:0/3746837543 >> v1:172.21.15.170:6789/0 conn(0x7f85b815f750 legacy=0x7f85b80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:18.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85b77fe640 1 -- 172.21.15.137:0/3746837543 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b80d0960 con 0x7f85b80d3ee0 2024-04-26T22:08:18.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.733+0000 7f85b6ffd640 1 --2- 172.21.15.137:0/3746837543 >> v2:172.21.15.170:3300/0 conn(0x7f85b815f370 0x7f85b80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:18.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.734+0000 7f85b77fe640 1 --2- 172.21.15.137:0/3746837543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 0x7f85b80b47d0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f85b80d2d10 tx=0x7f85b002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a38914086c9897 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:18.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.734+0000 7f85b5ffb640 1 -- 172.21.15.137:0/3746837543 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0036070 con 0x7f85b80d3ee0 2024-04-26T22:08:18.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.734+0000 7f85b5ffb640 1 -- 172.21.15.137:0/3746837543 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b0031600 con 0x7f85b80d3ee0 2024-04-26T22:08:18.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.734+0000 7f85b5ffb640 1 -- 172.21.15.137:0/3746837543 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b00319d0 con 0x7f85b80d3ee0 2024-04-26T22:08:18.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.735+0000 7f85bd874640 1 -- 172.21.15.137:0/3746837543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 msgr2=0x7f85b80b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.735+0000 7f85bd874640 1 --2- 172.21.15.137:0/3746837543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 0x7f85b80b47d0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f85b80d2d10 tx=0x7f85b002a6f0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.735+0000 7f85bd874640 1 -- 172.21.15.137:0/3746837543 shutdown_connections 2024-04-26T22:08:18.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.735+0000 7f85bd874640 1 --2- 172.21.15.137:0/3746837543 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 0x7f85b80b47d0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.735+0000 7f85bd874640 1 --2- 172.21.15.137:0/3746837543 >> v2:172.21.15.170:3300/0 conn(0x7f85b815f370 0x7f85b80cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.735+0000 7f85bd874640 1 -- 172.21.15.137:0/3746837543 >> 172.21.15.137:0/3746837543 conn(0x7f85b808ec10 msgr2=0x7f85b809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.735+0000 7f85bd874640 1 -- 172.21.15.137:0/3746837543 shutdown_connections 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.735+0000 7f85bd874640 1 -- 172.21.15.137:0/3746837543 wait complete. 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.736+0000 7f85bd874640 1 Processor -- start 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.736+0000 7f85bd874640 1 -- start start 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85bd874640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 0x7f85b80c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85bd874640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b815f370 0x7f85b815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85bd874640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85b815f750 0x7f85b8161e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85bd874640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f85b80b51c0 con 0x7f85b80d3ee0 2024-04-26T22:08:18.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85bd874640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f85b80d0f20 con 0x7f85b815f750 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85bd874640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f85b80b5340 con 0x7f85b815f370 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 0x7f85b80c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b6ffd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 0x7f85b80c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53680/0 (socket says 172.21.15.137:53680) 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b6ffd640 1 -- 172.21.15.137:0/2615652464 learned_addr learned my addr 172.21.15.137:0/2615652464 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b77fe640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85b815f750 0x7f85b8161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b67fc640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b815f370 0x7f85b815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b6ffd640 1 -- 172.21.15.137:0/2615652464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b815f370 msgr2=0x7f85b815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b6ffd640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b815f370 0x7f85b815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b6ffd640 1 -- 172.21.15.137:0/2615652464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85b815f750 msgr2=0x7f85b8161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b6ffd640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85b815f750 0x7f85b8161e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b6ffd640 1 -- 172.21.15.137:0/2615652464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b81f5ff0 con 0x7f85b80d3ee0 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85b6ffd640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 0x7f85b80c98e0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f85a800c7f0 tx=0x7f85a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f859ffff640 1 -- 172.21.15.137:0/2615652464 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8015070 con 0x7f85b80d3ee0 2024-04-26T22:08:18.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f859ffff640 1 -- 172.21.15.137:0/2615652464 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a8007a30 con 0x7f85b80d3ee0 2024-04-26T22:08:18.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.737+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b81f5d10 con 0x7f85b80d3ee0 2024-04-26T22:08:18.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.738+0000 7f859ffff640 1 -- 172.21.15.137:0/2615652464 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a8007e00 con 0x7f85b80d3ee0 2024-04-26T22:08:18.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.738+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b80c90e0 con 0x7f85b80d3ee0 2024-04-26T22:08:18.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.739+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b806a290 con 0x7f85b80d3ee0 2024-04-26T22:08:18.741 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.739+0000 7f859ffff640 1 -- 172.21.15.137:0/2615652464 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85a8018070 con 0x7f85b80d3ee0 2024-04-26T22:08:18.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.740+0000 7f859ffff640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85a406c8f0 0x7f85a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:18.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.740+0000 7f859ffff640 1 -- 172.21.15.137:0/2615652464 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f85a808b830 con 0x7f85b80d3ee0 2024-04-26T22:08:18.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.740+0000 7f85b67fc640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85a406c8f0 0x7f85a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:18.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.740+0000 7f85b67fc640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85a406c8f0 0x7f85a406edb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f85b80b7bc0 tx=0x7f85ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:18.743 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.744+0000 7f859ffff640 1 -- 172.21.15.137:0/2615652464 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f85a8059f40 con 0x7f85b80d3ee0 2024-04-26T22:08:18.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.917+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85b80d4fe0 con 0x7f85a406c8f0 2024-04-26T22:08:18.917 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.918+0000 7f859ffff640 1 -- 172.21.15.137:0/2615652464 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7f85b80d4fe0 con 0x7f85a406c8f0 2024-04-26T22:08:18.918 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:18.918 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:08:18.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85a406c8f0 msgr2=0x7f85a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85a406c8f0 0x7f85a406edb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f85b80b7bc0 tx=0x7f85ac008040 comp rx=0 tx=0).stop 2024-04-26T22:08:18.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 msgr2=0x7f85b80c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:18.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 0x7f85b80c98e0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f85a800c7f0 tx=0x7f85a800cbf0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 shutdown_connections 2024-04-26T22:08:18.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f85a406c8f0 0x7f85a406edb0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.920 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85b815f750 0x7f85b8161e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f85b815f370 0x7f85b815ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 --2- 172.21.15.137:0/2615652464 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f85b80d3ee0 0x7f85b80c98e0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:18.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 >> 172.21.15.137:0/2615652464 conn(0x7f85b808ec10 msgr2=0x7f85b806e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:18.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 shutdown_connections 2024-04-26T22:08:18.921 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:18.920+0000 7f85bd874640 1 -- 172.21.15.137:0/2615652464 wait complete. 2024-04-26T22:08:18.931 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-04-26T22:08:18.822545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":283032,"kb_used_data":16936,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754691688,"statfs":{"total":773094113280,"available":772804288512,"internally_reserved":0,"allocated":17342464,"data_stored":10568499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8392252,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-176,"num_write_kb":-8305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001088"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":372,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-04-26T22:08:16.485392+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:08:16.485392+0000","last_peered":"2024-04-26T22:08:16.485392+0000","last_clean":"2024-04-26T22:08:16.485392+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:08:16.485392+0000","last_undegraded":"2024-04-26T22:08:16.485392+0000","last_fullsized":"2024-04-26T22:08:16.485392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574970,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37384,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334456,"statfs":{"total":96636764160,"available":96598482944,"internally_reserved":0,"allocated":2093056,"data_stored":1241699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574970,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":645599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37308,"kb_used_data":6128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334532,"statfs":{"total":96636764160,"available":96598560768,"internally_reserved":0,"allocated":6275072,"data_stored":5430271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:08:18.931 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T22:08:18.931 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:08:19.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.028+0000 7f0a3b396640 1 Processor -- start 2024-04-26T22:08:19.028 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.029+0000 7f0a3b396640 1 -- start start 2024-04-26T22:08:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.029+0000 7f0a3b396640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0a3415f370 0x7f0a340cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.029+0000 7f0a3b396640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a3415f750 0x7f0a340b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.030 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.029+0000 7f0a3b396640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 0x7f0a340d3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.029+0000 7f0a3b396640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f0a340b4d10 con 0x7f0a3415f750 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.029+0000 7f0a3b396640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0a340d4160 con 0x7f0a3415f370 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.029+0000 7f0a3b396640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0a340d03a0 con 0x7f0a340d37d0 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a38931640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a3415f750 0x7f0a340b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a38931640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f0a3415f750 0x7f0a340b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53688/0 (socket says 172.21.15.137:53688) 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a38931640 1 -- 172.21.15.137:0/3065165493 learned_addr learned my addr 172.21.15.137:0/3065165493 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a39933640 1 --2- 172.21.15.137:0/3065165493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 0x7f0a340d3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a39132640 1 --2- 172.21.15.137:0/3065165493 >> v2:172.21.15.170:3300/0 conn(0x7f0a3415f370 0x7f0a340cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a38931640 1 -- 172.21.15.137:0/3065165493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 msgr2=0x7f0a340d3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a38931640 1 --2- 172.21.15.137:0/3065165493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 0x7f0a340d3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a38931640 1 -- 172.21.15.137:0/3065165493 >> v2:172.21.15.170:3300/0 conn(0x7f0a3415f370 msgr2=0x7f0a340cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a38931640 1 --2- 172.21.15.137:0/3065165493 >> v2:172.21.15.170:3300/0 conn(0x7f0a3415f370 0x7f0a340cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a38931640 1 -- 172.21.15.137:0/3065165493 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a340d0680 con 0x7f0a3415f750 2024-04-26T22:08:19.031 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.030+0000 7f0a38931640 1 --2- 172.21.15.137:0/3065165493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 0x7f0a340b47d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f0a340d2d10 tx=0x7f0a2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b924f65b6ed37f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:19.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a2bfff640 1 -- 172.21.15.137:0/3065165493 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24037070 con 0x7f0a3415f750 2024-04-26T22:08:19.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a2bfff640 1 -- 172.21.15.137:0/3065165493 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a24032440 con 0x7f0a3415f750 2024-04-26T22:08:19.032 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a2bfff640 1 -- 172.21.15.137:0/3065165493 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24032810 con 0x7f0a3415f750 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a3b396640 1 -- 172.21.15.137:0/3065165493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 msgr2=0x7f0a340b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3065165493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 0x7f0a340b47d0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f0a340d2d10 tx=0x7f0a2402a1e0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a3b396640 1 -- 172.21.15.137:0/3065165493 shutdown_connections 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3065165493 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 0x7f0a340d3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3065165493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 0x7f0a340b47d0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3065165493 >> v2:172.21.15.170:3300/0 conn(0x7f0a3415f370 0x7f0a340cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a3b396640 1 -- 172.21.15.137:0/3065165493 >> 172.21.15.137:0/3065165493 conn(0x7f0a3408ec10 msgr2=0x7f0a3409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a3b396640 1 -- 172.21.15.137:0/3065165493 shutdown_connections 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.031+0000 7f0a3b396640 1 -- 172.21.15.137:0/3065165493 wait complete. 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.032+0000 7f0a3b396640 1 Processor -- start 2024-04-26T22:08:19.035 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.032+0000 7f0a3b396640 1 -- start start 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a3b396640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 0x7f0a3414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a3b396640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3415f370 0x7f0a340cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a3b396640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 0x7f0a3406e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a3b396640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0a340d0f20 con 0x7f0a3415f750 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a3b396640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0a340d0c40 con 0x7f0a3415f370 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a3b396640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0a340d1bd0 con 0x7f0a340d37d0 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a39933640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 0x7f0a3406e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a39933640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 0x7f0a3406e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53700/0 (socket says 172.21.15.137:53700) 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a39933640 1 -- 172.21.15.137:0/3404369388 learned_addr learned my addr 172.21.15.137:0/3404369388 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a39132640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 0x7f0a3414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a38931640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3415f370 0x7f0a340cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a39933640 1 -- 172.21.15.137:0/3404369388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 msgr2=0x7f0a3414eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a39933640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 0x7f0a3414eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.036 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a39933640 1 -- 172.21.15.137:0/3404369388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3415f370 msgr2=0x7f0a340cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a39933640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3415f370 0x7f0a340cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.033+0000 7f0a39933640 1 -- 172.21.15.137:0/3404369388 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3414f070 con 0x7f0a3415f750 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.034+0000 7f0a39933640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 0x7f0a3406e210 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c007e90 tx=0x7f0a2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.034+0000 7f0a29ffb640 1 -- 172.21.15.137:0/3404369388 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c014420 con 0x7f0a3415f750 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.034+0000 7f0a29ffb640 1 -- 172.21.15.137:0/3404369388 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c019070 con 0x7f0a3415f750 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.034+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a341f8830 con 0x7f0a3415f750 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.034+0000 7f0a29ffb640 1 -- 172.21.15.137:0/3404369388 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c014820 con 0x7f0a3415f750 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.034+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a341f8df0 con 0x7f0a3415f750 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.035+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a340b60d0 con 0x7f0a3415f750 2024-04-26T22:08:19.037 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.035+0000 7f0a29ffb640 1 -- 172.21.15.137:0/3404369388 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a2c0149c0 con 0x7f0a3415f750 2024-04-26T22:08:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.036+0000 7f0a29ffb640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a1806c920 0x7f0a1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.036+0000 7f0a29ffb640 1 -- 172.21.15.137:0/3404369388 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f0a2c08bfc0 con 0x7f0a3415f750 2024-04-26T22:08:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.036+0000 7f0a39132640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a1806c920 0x7f0a1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.038 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.036+0000 7f0a39132640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a1806c920 0x7f0a1806ede0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0a30006fd0 tx=0x7f0a30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:19.040 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.040+0000 7f0a29ffb640 1 -- 172.21.15.137:0/3404369388 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0a340b60d0 con 0x7f0a3415f750 2024-04-26T22:08:19.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.212+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a340d4a80 con 0x7f0a1806c920 2024-04-26T22:08:19.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.213+0000 7f0a29ffb640 1 -- 172.21.15.137:0/3404369388 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7f0a340d4a80 con 0x7f0a1806c920 2024-04-26T22:08:19.213 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:19.213 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a1806c920 msgr2=0x7f0a1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a1806c920 0x7f0a1806ede0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0a30006fd0 tx=0x7f0a30008040 comp rx=0 tx=0).stop 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 msgr2=0x7f0a3406e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 0x7f0a3406e210 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c007e90 tx=0x7f0a2c00e4b0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 shutdown_connections 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0a1806c920 0x7f0a1806ede0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0a3415f750 0x7f0a3406e210 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a3415f370 0x7f0a340cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 --2- 172.21.15.137:0/3404369388 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0a340d37d0 0x7f0a3414eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 >> 172.21.15.137:0/3404369388 conn(0x7f0a3408ec10 msgr2=0x7f0a340d5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 shutdown_connections 2024-04-26T22:08:19.215 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.215+0000 7f0a3b396640 1 -- 172.21.15.137:0/3404369388 wait complete. 2024-04-26T22:08:19.226 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-04-26T22:08:18.822545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":283032,"kb_used_data":16936,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754691688,"statfs":{"total":773094113280,"available":772804288512,"internally_reserved":0,"allocated":17342464,"data_stored":10568499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8392252,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-176,"num_write_kb":-8305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001088"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":372,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-04-26T22:08:16.485392+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:08:16.485392+0000","last_peered":"2024-04-26T22:08:16.485392+0000","last_clean":"2024-04-26T22:08:16.485392+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:08:16.485392+0000","last_undegraded":"2024-04-26T22:08:16.485392+0000","last_fullsized":"2024-04-26T22:08:16.485392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574970,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37384,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334456,"statfs":{"total":96636764160,"available":96598482944,"internally_reserved":0,"allocated":2093056,"data_stored":1241699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574970,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36796,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335044,"statfs":{"total":96636764160,"available":96599085056,"internally_reserved":0,"allocated":1490944,"data_stored":645606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574970,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":645599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574969,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37308,"kb_used_data":6128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334532,"statfs":{"total":96636764160,"available":96598560768,"internally_reserved":0,"allocated":6275072,"data_stored":5430271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:08:19.226 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T22:08:19.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.323+0000 7f8eaeba5640 1 Processor -- start 2024-04-26T22:08:19.323 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.323+0000 7f8eaeba5640 1 -- start start 2024-04-26T22:08:19.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.324+0000 7f8eaeba5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 0x7f8ea8071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.324+0000 7f8eaeba5640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea8163d50 con 0x7f8ea809c400 2024-04-26T22:08:19.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.324+0000 7f8eaeba5640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea80d14c0 con 0x7f8ea8070520 2024-04-26T22:08:19.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.324+0000 7f8eaeba5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea80d1290 con 0x7f8ea8070d20 2024-04-26T22:08:19.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.324+0000 7f8ea7fff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f8ea809c400 0x7f8ea8162f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47436/0 (socket says 172.21.15.137:47436) 2024-04-26T22:08:19.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.324+0000 7f8ea7fff640 1 -- 172.21.15.137:0/3697317275 learned_addr learned my addr 172.21.15.137:0/3697317275 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:19.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8eac941640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 0x7f8ea8071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.327 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290097083 0 0) 0x7f8ea8163d50 con 0x7f8ea809c400 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e90003520 con 0x7f8ea809c400 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3115528765 0 0) 0x7f8e90003520 con 0x7f8ea809c400 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 msgr2=0x7f8ea8071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 0x7f8ea8071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 >> v1:172.21.15.170:6789/0 conn(0x7f8ea8070520 legacy=0x7f8ea8163640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea8071640 con 0x7f8ea809c400 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f8e9c001670 con 0x7f8ea809c400 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8eac941640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 0x7f8ea8071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 >> v1:172.21.15.137:6789/0 conn(0x7f8ea809c400 legacy=0x7f8ea8162f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 0x7f8e900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90003f20 0x7f8e90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e90004d40 0x7f8e900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9000ba70 con 0x7f8e90004d40 2024-04-26T22:08:19.328 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9000bbf0 con 0x7f8e90003f20 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8e9000bdf0 con 0x7f8ea8070d20 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ead142640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e90004d40 0x7f8e900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ea7fff640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90003f20 0x7f8e90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8eac941640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 0x7f8e900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ead142640 1 -- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 msgr2=0x7f8e900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ead142640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 0x7f8e900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ead142640 1 -- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90003f20 msgr2=0x7f8e90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ead142640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e90003f20 0x7f8e90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8ead142640 1 -- 172.21.15.137:0/3697317275 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e90003520 con 0x7f8e90004d40 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.325+0000 7f8eac941640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8ea8070d20 0x7f8e900039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.326+0000 7f8ead142640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e90004d40 0x7f8e900051c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0001e50 tx=0x7f8e90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdd3da04c7f5102 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.326+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0001a70 con 0x7f8e90004d40 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.326+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea0003970 con 0x7f8e90004d40 2024-04-26T22:08:19.329 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.326+0000 7f8ea77fe640 1 -- 172.21.15.137:0/3697317275 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0003d60 con 0x7f8e90004d40 2024-04-26T22:08:19.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.327+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3697317275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e90004d40 msgr2=0x7f8e900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.327+0000 7f8eaeba5640 1 --2- 172.21.15.137:0/3697317275 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8e90004d40 0x7f8e900051c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0001e50 tx=0x7f8e90005830 comp rx=0 tx=0).stop 2024-04-26T22:08:19.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.327+0000 7f8ead142640 1 -- 172.21.15.137:0/3697317275 reap_dead start 2024-04-26T22:08:19.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.327+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3697317275 shutdown_connections 2024-04-26T22:08:19.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.327+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3697317275 >> 172.21.15.137:0/3697317275 conn(0x7f8ea80b4a40 msgr2=0x7f8ea80b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:19.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.327+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3697317275 shutdown_connections 2024-04-26T22:08:19.330 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.327+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3697317275 wait complete. 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.328+0000 7f8eaeba5640 1 Processor -- start 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.328+0000 7f8eaeba5640 1 -- start start 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8eaeba5640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e90004d40 0x7f8ea81577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8eaeba5640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea80c8c50 0x7f8ea80c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8eaeba5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ea80ca020 0x7f8ea80ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8eaeba5640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea80d1a40 con 0x7f8ea80c8c50 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8eaeba5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea80d1760 con 0x7f8ea80ca020 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8eaeba5640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea80d1d20 con 0x7f8e90004d40 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ea7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea80c8c50 0x7f8ea80c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ea7fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea80c8c50 0x7f8ea80c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53720/0 (socket says 172.21.15.137:53720) 2024-04-26T22:08:19.333 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ea7fff640 1 -- 172.21.15.137:0/3268424428 learned_addr learned my addr 172.21.15.137:0/3268424428 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8eac941640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e90004d40 0x7f8ea81577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ead142640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ea80ca020 0x7f8ea80ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ea7fff640 1 -- 172.21.15.137:0/3268424428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e90004d40 msgr2=0x7f8ea81577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ea7fff640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e90004d40 0x7f8ea81577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ea7fff640 1 -- 172.21.15.137:0/3268424428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ea80ca020 msgr2=0x7f8ea80ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ea7fff640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ea80ca020 0x7f8ea80ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ea7fff640 1 -- 172.21.15.137:0/3268424428 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea80ca9e0 con 0x7f8ea80c8c50 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.329+0000 7f8ea7fff640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea80c8c50 0x7f8ea80c90d0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0072c0 tx=0x7f8e9c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.330+0000 7f8ea57fa640 1 -- 172.21.15.137:0/3268424428 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00f960 con 0x7f8ea80c8c50 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.330+0000 7f8ea57fa640 1 -- 172.21.15.137:0/3268424428 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e9c018070 con 0x7f8ea80c8c50 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.330+0000 7f8ea57fa640 1 -- 172.21.15.137:0/3268424428 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c00fd60 con 0x7f8ea80c8c50 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.330+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea81f50e0 con 0x7f8ea80c8c50 2024-04-26T22:08:19.334 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.330+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea81f56a0 con 0x7f8ea80c8c50 2024-04-26T22:08:19.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.331+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea80693d0 con 0x7f8ea80c8c50 2024-04-26T22:08:19.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.331+0000 7f8ea57fa640 1 -- 172.21.15.137:0/3268424428 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e9c01d460 con 0x7f8ea80c8c50 2024-04-26T22:08:19.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.331+0000 7f8ea57fa640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9406c8f0 0x7f8e9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:19.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.332+0000 7f8ea57fa640 1 -- 172.21.15.137:0/3268424428 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f8e9c08b9d0 con 0x7f8ea80c8c50 2024-04-26T22:08:19.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.332+0000 7f8eac941640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9406c8f0 0x7f8e9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:19.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.332+0000 7f8eac941640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9406c8f0 0x7f8e9406edb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80b40b0 tx=0x7f8e98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:19.335 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.336+0000 7f8ea57fa640 1 -- 172.21.15.137:0/3268424428 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f8e9c05a0e0 con 0x7f8ea80c8c50 2024-04-26T22:08:19.514 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.515+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ea80c9de0 con 0x7f8ea80c8c50 2024-04-26T22:08:19.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.515+0000 7f8ea57fa640 1 -- 172.21.15.137:0/3268424428 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+13308 (secure 0 0 0) 0x7f8e9c0599e0 con 0x7f8ea80c8c50 2024-04-26T22:08:19.515 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:19.515 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":120,"fsid":"30fb29b0-57db-44cb-a9e0-8033deb0a091","created":"2024-04-26T21:58:16.558465+0000","modified":"2024-04-26T22:08:16.473792+0000","last_up_change":"2024-04-26T21:58:27.174688+0000","last_in_change":"2024-04-26T21:58:18.685240+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T21:58:28.712168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"65ef699d-600a-49a7-ac5c-fd7c381048c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6820","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6822","nonce":109358669}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6824","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6826","nonce":109358669}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6830","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6831","nonce":109358669}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6828","nonce":109358669},{"type":"v1","addr":"172.21.15.137:6829","nonce":109358669}]},"public_addr":"172.21.15.137:6822/109358669","cluster_addr":"172.21.15.137:6826/109358669","heartbeat_back_addr":"172.21.15.137:6831/109358669","heartbeat_front_addr":"172.21.15.137:6829/109358669","state":["exists","up"]},{"osd":1,"uuid":"27e82e3b-da0a-4301-96f5-da02d5a1c04b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6800","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6801","nonce":757189714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6802","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6803","nonce":757189714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6806","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6807","nonce":757189714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6804","nonce":757189714},{"type":"v1","addr":"172.21.15.137:6805","nonce":757189714}]},"public_addr":"172.21.15.137:6801/757189714","cluster_addr":"172.21.15.137:6803/757189714","heartbeat_back_addr":"172.21.15.137:6807/757189714","heartbeat_front_addr":"172.21.15.137:6805/757189714","state":["exists","up"]},{"osd":2,"uuid":"0e111cca-a9ca-47a8-9a6d-a886691535dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6816","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6817","nonce":1304816807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6818","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6819","nonce":1304816807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6825","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6827","nonce":1304816807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6821","nonce":1304816807},{"type":"v1","addr":"172.21.15.137:6823","nonce":1304816807}]},"public_addr":"172.21.15.137:6817/1304816807","cluster_addr":"172.21.15.137:6819/1304816807","heartbeat_back_addr":"172.21.15.137:6827/1304816807","heartbeat_front_addr":"172.21.15.137:6823/1304816807","state":["exists","up"]},{"osd":3,"uuid":"48e0641a-7b85-4745-a1e5-ee936170edc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6808","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6809","nonce":492121506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6810","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6811","nonce":492121506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6814","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6815","nonce":492121506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6812","nonce":492121506},{"type":"v1","addr":"172.21.15.137:6813","nonce":492121506}]},"public_addr":"172.21.15.137:6809/492121506","cluster_addr":"172.21.15.137:6811/492121506","heartbeat_back_addr":"172.21.15.137:6815/492121506","heartbeat_front_addr":"172.21.15.137:6813/492121506","state":["exists","up"]},{"osd":4,"uuid":"d6197a0b-dd65-4cf7-a92c-349926f710ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6825","nonce":2080414701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6827","nonce":2080414701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6831","nonce":2080414701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2080414701},{"type":"v1","addr":"172.21.15.170:6829","nonce":2080414701}]},"public_addr":"172.21.15.170:6825/2080414701","cluster_addr":"172.21.15.170:6827/2080414701","heartbeat_back_addr":"172.21.15.170:6831/2080414701","heartbeat_front_addr":"172.21.15.170:6829/2080414701","state":["exists","up"]},{"osd":5,"uuid":"d5fb8513-8360-4aa0-aafe-471789c708c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6809","nonce":205812566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6811","nonce":205812566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6815","nonce":205812566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":205812566},{"type":"v1","addr":"172.21.15.170:6813","nonce":205812566}]},"public_addr":"172.21.15.170:6809/205812566","cluster_addr":"172.21.15.170:6811/205812566","heartbeat_back_addr":"172.21.15.170:6815/205812566","heartbeat_front_addr":"172.21.15.170:6813/205812566","state":["exists","up"]},{"osd":6,"uuid":"518fb394-0254-4274-90ef-52a4339aa194","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6801","nonce":3855301024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6803","nonce":3855301024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6807","nonce":3855301024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3855301024},{"type":"v1","addr":"172.21.15.170:6805","nonce":3855301024}]},"public_addr":"172.21.15.170:6801/3855301024","cluster_addr":"172.21.15.170:6803/3855301024","heartbeat_back_addr":"172.21.15.170:6807/3855301024","heartbeat_front_addr":"172.21.15.170:6805/3855301024","state":["exists","up"]},{"osd":7,"uuid":"0ea467d9-e6d0-4c3a-9729-58fcbd2f56fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6817","nonce":3085321649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6819","nonce":3085321649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6823","nonce":3085321649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3085321649},{"type":"v1","addr":"172.21.15.170:6821","nonce":3085321649}]},"public_addr":"172.21.15.170:6817/3085321649","cluster_addr":"172.21.15.170:6819/3085321649","heartbeat_back_addr":"172.21.15.170:6823/3085321649","heartbeat_front_addr":"172.21.15.170:6821/3085321649","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.899583+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.735017+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.813037+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.800967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903929+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.843990+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.808169+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T21:58:23.903554+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.137:6837/3437790809":"2024-04-27T22:08:13.213376+0000","172.21.15.137:6835/3437790809":"2024-04-27T22:08:13.213376+0000","172.21.15.137:6837/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.137:6835/2830617564":"2024-04-27T22:08:00.183091+0000","172.21.15.170:6834/1666946913":"2024-04-27T22:07:49.712915+0000","172.21.15.170:6832/1666946913":"2024-04-27T22:07:49.712915+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.517+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9406c8f0 msgr2=0x7f8e9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.517+0000 7f8eaeba5640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9406c8f0 0x7f8e9406edb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80b40b0 tx=0x7f8e98008040 comp rx=0 tx=0).stop 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.517+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea80c8c50 msgr2=0x7f8ea80c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.517+0000 7f8eaeba5640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea80c8c50 0x7f8ea80c90d0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0072c0 tx=0x7f8e9c007780 comp rx=0 tx=0).stop 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.518+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 shutdown_connections 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.518+0000 7f8eaeba5640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f8e9406c8f0 0x7f8e9406edb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.518+0000 7f8eaeba5640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f8ea80c8c50 0x7f8ea80c90d0 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.518+0000 7f8eaeba5640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8ea80ca020 0x7f8ea80ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.518+0000 7f8eaeba5640 1 --2- 172.21.15.137:0/3268424428 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f8e90004d40 0x7f8ea81577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.518+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 >> 172.21.15.137:0/3268424428 conn(0x7f8ea80b4a40 msgr2=0x7f8ea806e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.518+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 shutdown_connections 2024-04-26T22:08:19.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:19.518+0000 7f8eaeba5640 1 -- 172.21.15.137:0/3268424428 wait complete. 2024-04-26T22:08:20.529 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T22:08:20.529 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:08:20.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.642+0000 7f18aa55f640 1 Processor -- start 2024-04-26T22:08:20.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.642+0000 7f18aa55f640 1 -- start start 2024-04-26T22:08:20.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18aa55f640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f18a4070940 0x7f18a406f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18aa55f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f18a4148d40 0x7f18a40731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18aa55f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a40d21f0 0x7f18a40d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18aa55f640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f18a4163e20 con 0x7f18a4070940 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18aa55f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f18a40736e0 con 0x7f18a4148d40 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18aa55f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f18a41632c0 con 0x7f18a40d21f0 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f18a4070940 0x7f18a406f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a3fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f18a4070940 0x7f18a406f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53732/0 (socket says 172.21.15.137:53732) 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a3fff640 1 -- 172.21.15.137:0/2233720158 learned_addr learned my addr 172.21.15.137:0/2233720158 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a8afc640 1 --2- 172.21.15.137:0/2233720158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a40d21f0 0x7f18a40d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a37fe640 1 --2- 172.21.15.137:0/2233720158 >> v2:172.21.15.170:3300/0 conn(0x7f18a4148d40 0x7f18a40731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a3fff640 1 -- 172.21.15.137:0/2233720158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a40d21f0 msgr2=0x7f18a40d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:20.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a3fff640 1 --2- 172.21.15.137:0/2233720158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a40d21f0 0x7f18a40d26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a3fff640 1 -- 172.21.15.137:0/2233720158 >> v2:172.21.15.170:3300/0 conn(0x7f18a4148d40 msgr2=0x7f18a40731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a3fff640 1 --2- 172.21.15.137:0/2233720158 >> v2:172.21.15.170:3300/0 conn(0x7f18a4148d40 0x7f18a40731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a3fff640 1 -- 172.21.15.137:0/2233720158 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a4163580 con 0x7f18a4070940 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.643+0000 7f18a8afc640 1 --2- 172.21.15.137:0/2233720158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a40d21f0 0x7f18a40d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.644+0000 7f18a3fff640 1 --2- 172.21.15.137:0/2233720158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4070940 0x7f18a406f440 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f18a4149300 tx=0x7f189402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d612da538a379 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.644+0000 7f18a2ffd640 1 -- 172.21.15.137:0/2233720158 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894037070 con 0x7f18a4070940 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.644+0000 7f18a2ffd640 1 -- 172.21.15.137:0/2233720158 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1894032440 con 0x7f18a4070940 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.644+0000 7f18a2ffd640 1 -- 172.21.15.137:0/2233720158 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894032810 con 0x7f18a4070940 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.645+0000 7f18aa55f640 1 -- 172.21.15.137:0/2233720158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4070940 msgr2=0x7f18a406f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.645+0000 7f18aa55f640 1 --2- 172.21.15.137:0/2233720158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4070940 0x7f18a406f440 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f18a4149300 tx=0x7f189402a1e0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.645+0000 7f18aa55f640 1 -- 172.21.15.137:0/2233720158 shutdown_connections 2024-04-26T22:08:20.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.645+0000 7f18aa55f640 1 --2- 172.21.15.137:0/2233720158 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a40d21f0 0x7f18a40d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.645+0000 7f18aa55f640 1 --2- 172.21.15.137:0/2233720158 >> v2:172.21.15.170:3300/0 conn(0x7f18a4148d40 0x7f18a40731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.645+0000 7f18aa55f640 1 --2- 172.21.15.137:0/2233720158 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4070940 0x7f18a406f440 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.645+0000 7f18aa55f640 1 -- 172.21.15.137:0/2233720158 >> 172.21.15.137:0/2233720158 conn(0x7f18a406d590 msgr2=0x7f18a406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:20.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.645+0000 7f18aa55f640 1 -- 172.21.15.137:0/2233720158 shutdown_connections 2024-04-26T22:08:20.647 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.645+0000 7f18aa55f640 1 -- 172.21.15.137:0/2233720158 wait complete. 2024-04-26T22:08:20.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.646+0000 7f18aa55f640 1 Processor -- start 2024-04-26T22:08:20.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.646+0000 7f18aa55f640 1 -- start start 2024-04-26T22:08:20.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18aa55f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a4070940 0x7f18a415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18aa55f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a40d21f0 0x7f18a41e8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18aa55f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4148d40 0x7f18a40b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18aa55f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4162fb0 con 0x7f18a4148d40 2024-04-26T22:08:20.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18aa55f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4163b40 con 0x7f18a40d21f0 2024-04-26T22:08:20.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18aa55f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f18a40d1120 con 0x7f18a4070940 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a8afc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4148d40 0x7f18a40b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a8afc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4148d40 0x7f18a40b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53736/0 (socket says 172.21.15.137:53736) 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a8afc640 1 -- 172.21.15.137:0/2936623732 learned_addr learned my addr 172.21.15.137:0/2936623732 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a37fe640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a40d21f0 0x7f18a41e8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a3fff640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a4070940 0x7f18a415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a8afc640 1 -- 172.21.15.137:0/2936623732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a4070940 msgr2=0x7f18a415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a8afc640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f18a4070940 0x7f18a415ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a8afc640 1 -- 172.21.15.137:0/2936623732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a40d21f0 msgr2=0x7f18a41e8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a8afc640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a40d21f0 0x7f18a41e8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.647+0000 7f18a8afc640 1 -- 172.21.15.137:0/2936623732 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a41e9820 con 0x7f18a4148d40 2024-04-26T22:08:20.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.648+0000 7f18a8afc640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4148d40 0x7f18a40b01d0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f189c00cf20 tx=0x7f189c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:20.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.648+0000 7f18a0ff9640 1 -- 172.21.15.137:0/2936623732 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c01a070 con 0x7f18a4148d40 2024-04-26T22:08:20.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.648+0000 7f18a0ff9640 1 -- 172.21.15.137:0/2936623732 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189c00d840 con 0x7f18a4148d40 2024-04-26T22:08:20.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.648+0000 7f18a0ff9640 1 -- 172.21.15.137:0/2936623732 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c00dc30 con 0x7f18a4148d40 2024-04-26T22:08:20.653 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.648+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a41e9b00 con 0x7f18a4148d40 2024-04-26T22:08:20.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.648+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a41ea0c0 con 0x7f18a4148d40 2024-04-26T22:08:20.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.649+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f18a41ea8c0 con 0x7f18a4148d40 2024-04-26T22:08:20.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.649+0000 7f18a0ff9640 1 -- 172.21.15.137:0/2936623732 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f189c01d070 con 0x7f18a4148d40 2024-04-26T22:08:20.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.649+0000 7f18a0ff9640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f189006c8f0 0x7f189006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.650+0000 7f18a0ff9640 1 -- 172.21.15.137:0/2936623732 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f189c08c080 con 0x7f18a4148d40 2024-04-26T22:08:20.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.650+0000 7f18a3fff640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f189006c8f0 0x7f189006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.650+0000 7f18a0ff9640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f18900728f0 0x7f1890074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.650+0000 7f18a0ff9640 1 -- 172.21.15.137:0/2936623732 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18900753c0 con 0x7f18900728f0 2024-04-26T22:08:20.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.650+0000 7f18a0ff9640 1 -- 172.21.15.137:0/2936623732 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f189c093050 con 0x7f18a4148d40 2024-04-26T22:08:20.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.650+0000 7f18a37fe640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f18900728f0 0x7f1890074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.650+0000 7f18a3fff640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f189006c8f0 0x7f189006edb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1894034000 tx=0x7f189402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:20.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.650+0000 7f18a37fe640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f18900728f0 0x7f1890074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:20.655 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.651+0000 7f18a0ff9640 1 -- 172.21.15.137:0/2936623732 <== osd.0 v2:172.21.15.137:6820/109358669 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f18900753c0 con 0x7f18900728f0 2024-04-26T22:08:20.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.664+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 --> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f18a4069750 con 0x7f18900728f0 2024-04-26T22:08:20.664 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.664+0000 7f18a0ff9640 1 -- 172.21.15.137:0/2936623732 <== osd.0 v2:172.21.15.137:6820/109358669 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f18a4069750 con 0x7f18900728f0 2024-04-26T22:08:20.664 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:08:20.664 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:08:20.664 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:08:20.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.664+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f18900728f0 msgr2=0x7f1890074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.664+0000 7f18aa55f640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6820/109358669,v1:172.21.15.137:6822/109358669] conn(0x7f18900728f0 0x7f1890074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.665 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.664+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f189006c8f0 msgr2=0x7f189006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.664+0000 7f18aa55f640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f189006c8f0 0x7f189006edb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1894034000 tx=0x7f189402e000 comp rx=0 tx=0).stop 2024-04-26T22:08:20.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.665+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4148d40 msgr2=0x7f18a40b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.665+0000 7f18aa55f640 1 --2- 172.21.15.137:0/2936623732 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f18a4148d40 0x7f18a40b01d0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f189c00cf20 tx=0x7f189c00a7d0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.665+0000 7f18a8afc640 1 -- 172.21.15.137:0/2936623732 reap_dead start 2024-04-26T22:08:20.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.665+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 shutdown_connections 2024-04-26T22:08:20.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.665+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 >> 172.21.15.137:0/2936623732 conn(0x7f18a406d590 msgr2=0x7f18a406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:20.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.665+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 shutdown_connections 2024-04-26T22:08:20.666 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.665+0000 7f18aa55f640 1 -- 172.21.15.137:0/2936623732 wait complete. 2024-04-26T22:08:20.675 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T22:08:20.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.774+0000 7f205cc07640 1 Processor -- start 2024-04-26T22:08:20.774 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.774+0000 7f205cc07640 1 -- start start 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.775+0000 7f205cc07640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806ee80 0x7f205806f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.775+0000 7f205cc07640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f20580d0790 0x7f20580d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.775+0000 7f205cc07640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2058160780 con 0x7f205815d0c0 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.775+0000 7f205cc07640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2058160a60 con 0x7f20580d0790 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.775+0000 7f205cc07640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f20580cff90 con 0x7f205806ee80 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.775+0000 7f2055d9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806ee80 0x7f205806f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.776+0000 7f2056d9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f20580d0790 0x7f20580d0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.776+0000 7f2056d9d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f20580d0790 0x7f20580d0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.137:49474/0 (socket says 172.21.15.137:49474) 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.776+0000 7f2055d9b640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806ee80 0x7f205806f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3301/0 says I am v2:172.21.15.137:32798/0 (socket says 172.21.15.137:32798) 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.776+0000 7f2056d9d640 1 -- 172.21.15.137:0/600457585 learned_addr learned my addr 172.21.15.137:0/600457585 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:20.776 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.776+0000 7f2056d9d640 1 -- 172.21.15.137:0/600457585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806ee80 msgr2=0x7f205806f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:20.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.776+0000 7f2056d9d640 1 --2- 172.21.15.137:0/600457585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806ee80 0x7f205806f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.776+0000 7f2056d9d640 1 -- 172.21.15.137:0/600457585 >> v1:172.21.15.170:6789/0 conn(0x7f205815d0c0 legacy=0x7f205815fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.777 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.776+0000 7f2056d9d640 1 -- 172.21.15.137:0/600457585 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20580d0270 con 0x7f20580d0790 2024-04-26T22:08:20.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f2056d9d640 1 --2- 172.21.15.137:0/600457585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20580d0790 0x7f20580d0bd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f205000b920 tx=0x7f205002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a990831df6f4792 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:20.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205559a640 1 -- 172.21.15.137:0/600457585 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205002f710 con 0x7f20580d0790 2024-04-26T22:08:20.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205559a640 1 -- 172.21.15.137:0/600457585 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205002f8b0 con 0x7f20580d0790 2024-04-26T22:08:20.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205559a640 1 -- 172.21.15.137:0/600457585 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205002fc80 con 0x7f20580d0790 2024-04-26T22:08:20.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205cc07640 1 -- 172.21.15.137:0/600457585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20580d0790 msgr2=0x7f20580d0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205cc07640 1 --2- 172.21.15.137:0/600457585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20580d0790 0x7f20580d0bd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f205000b920 tx=0x7f205002a6f0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205cc07640 1 -- 172.21.15.137:0/600457585 shutdown_connections 2024-04-26T22:08:20.778 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205cc07640 1 --2- 172.21.15.137:0/600457585 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20580d0790 0x7f20580d0bd0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205cc07640 1 --2- 172.21.15.137:0/600457585 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f205806ee80 0x7f205806f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205cc07640 1 -- 172.21.15.137:0/600457585 >> 172.21.15.137:0/600457585 conn(0x7f20580b3b10 msgr2=0x7f20580b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:20.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205cc07640 1 -- 172.21.15.137:0/600457585 shutdown_connections 2024-04-26T22:08:20.779 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.777+0000 7f205cc07640 1 -- 172.21.15.137:0/600457585 wait complete. 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.779+0000 7f205cc07640 1 Processor -- start 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.779+0000 7f205cc07640 1 -- start start 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.779+0000 7f205cc07640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205806ee80 0x7f2058150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.779+0000 7f205cc07640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20580d0790 0x7f205809f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.779+0000 7f205cc07640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f205815d0c0 0x7f205809d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.779+0000 7f205cc07640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f20581603d0 con 0x7f205806ee80 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.779+0000 7f205cc07640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f205815d4a0 con 0x7f205815d0c0 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.779+0000 7f205cc07640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f205809de90 con 0x7f20580d0790 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205806ee80 0x7f2058150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.782 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205659c640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205806ee80 0x7f2058150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53744/0 (socket says 172.21.15.137:53744) 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205659c640 1 -- 172.21.15.137:0/3054416100 learned_addr learned my addr 172.21.15.137:0/3054416100 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f2055d9b640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20580d0790 0x7f205809f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f2056d9d640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f205815d0c0 0x7f205809d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205659c640 1 -- 172.21.15.137:0/3054416100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20580d0790 msgr2=0x7f205809f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205659c640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20580d0790 0x7f205809f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205659c640 1 -- 172.21.15.137:0/3054416100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f205815d0c0 msgr2=0x7f205809d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205659c640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f205815d0c0 0x7f205809d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205659c640 1 -- 172.21.15.137:0/3054416100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205809e130 con 0x7f205806ee80 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205659c640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205806ee80 0x7f2058150650 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f204800c760 tx=0x7f204800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f2046ffd640 1 -- 172.21.15.137:0/3054416100 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048016020 con 0x7f205806ee80 2024-04-26T22:08:20.783 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f2046ffd640 1 -- 172.21.15.137:0/3054416100 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2048006d50 con 0x7f205806ee80 2024-04-26T22:08:20.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205809e6a0 con 0x7f205806ee80 2024-04-26T22:08:20.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f2046ffd640 1 -- 172.21.15.137:0/3054416100 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048003bb0 con 0x7f205806ee80 2024-04-26T22:08:20.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.780+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205809ec60 con 0x7f205806ee80 2024-04-26T22:08:20.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.781+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2058150c50 con 0x7f205806ee80 2024-04-26T22:08:20.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.782+0000 7f2046ffd640 1 -- 172.21.15.137:0/3054416100 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f204800a850 con 0x7f205806ee80 2024-04-26T22:08:20.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.782+0000 7f2046ffd640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203806c8f0 0x7f203806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:20.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.782+0000 7f2046ffd640 1 -- 172.21.15.137:0/3054416100 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f204808b370 con 0x7f205806ee80 2024-04-26T22:08:20.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.782+0000 7f2055d9b640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203806c8f0 0x7f203806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:20.784 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.782+0000 7f2055d9b640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203806c8f0 0x7f203806edb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2058070fb0 tx=0x7f204c00f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:20.786 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.786+0000 7f2046ffd640 1 -- 172.21.15.137:0/3054416100 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2058150c50 con 0x7f205806ee80 2024-04-26T22:08:20.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.962+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f20580693d0 con 0x7f203806c8f0 2024-04-26T22:08:20.962 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.962+0000 7f2046ffd640 1 -- 172.21.15.137:0/3054416100 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f20580693d0 con 0x7f203806c8f0 2024-04-26T22:08:20.962 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T22:08:20.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203806c8f0 msgr2=0x7f203806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203806c8f0 0x7f203806edb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2058070fb0 tx=0x7f204c00f040 comp rx=0 tx=0).stop 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205806ee80 msgr2=0x7f2058150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205806ee80 0x7f2058150650 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f204800c760 tx=0x7f204800cc20 comp rx=0 tx=0).stop 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 shutdown_connections 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f203806c8f0 0x7f203806edb0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f205815d0c0 0x7f205809d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f20580d0790 0x7f205809f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 --2- 172.21.15.137:0/3054416100 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f205806ee80 0x7f2058150650 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 >> 172.21.15.137:0/3054416100 conn(0x7f20580b3b10 msgr2=0x7f20580d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 shutdown_connections 2024-04-26T22:08:20.965 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:20.964+0000 7f205cc07640 1 -- 172.21.15.137:0/3054416100 wait complete. 2024-04-26T22:08:20.975 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T22:08:20.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:08:21.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.077+0000 7ff6eab5f640 1 Processor -- start 2024-04-26T22:08:21.077 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.077+0000 7ff6eab5f640 1 -- start start 2024-04-26T22:08:21.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6eab5f640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff6e406e330 0x7ff6e40d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6eab5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e40d16d0 0x7ff6e40cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6eab5f640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e406e830 con 0x7ff6e41454c0 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6eab5f640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e40721a0 con 0x7ff6e406e330 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6eab5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e40ceca0 con 0x7ff6e40d16d0 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e88fb640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7ff6e41454c0 0x7ff6e40d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47446/0 (socket says 172.21.15.137:47446) 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e88fb640 1 -- 172.21.15.137:0/2571734017 learned_addr learned my addr 172.21.15.137:0/2571734017 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e90fc640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e40d16d0 0x7ff6e40cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e3fff640 1 --2- 172.21.15.137:0/2571734017 >> v2:172.21.15.170:3300/0 conn(0x7ff6e406e330 0x7ff6e40d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198929907 0 0) 0x7ff6e406e830 con 0x7ff6e41454c0 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6d4003520 con 0x7ff6e41454c0 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2330378463 0 0) 0x7ff6d4003520 con 0x7ff6e41454c0 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e40d16d0 msgr2=0x7ff6e40cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e40d16d0 0x7ff6e40cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 >> v2:172.21.15.170:3300/0 conn(0x7ff6e406e330 msgr2=0x7ff6e40d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 --2- 172.21.15.137:0/2571734017 >> v2:172.21.15.170:3300/0 conn(0x7ff6e406e330 0x7ff6e40d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e406eb10 con 0x7ff6e41454c0 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7ff6d8001670 con 0x7ff6e41454c0 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 >> v1:172.21.15.137:6789/0 conn(0x7ff6e41454c0 legacy=0x7ff6e40d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d40039b0 0x7ff6d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d4004800 0x7ff6d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e40d16d0 0x7ff6d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40ceca0 con 0x7ff6d4004800 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d400b9c0 con 0x7ff6d40039b0 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d400bb40 con 0x7ff6e40d16d0 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e3fff640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d4004800 0x7ff6d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.078+0000 7ff6e88fb640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d40039b0 0x7ff6d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.079+0000 7ff6e90fc640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e40d16d0 0x7ff6d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.079+0000 7ff6e3fff640 1 -- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e40d16d0 msgr2=0x7ff6d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.079+0000 7ff6e3fff640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e40d16d0 0x7ff6d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.079+0000 7ff6e3fff640 1 -- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d40039b0 msgr2=0x7ff6d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.079+0000 7ff6e3fff640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d40039b0 0x7ff6d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.079+0000 7ff6e3fff640 1 -- 172.21.15.137:0/2571734017 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d4003520 con 0x7ff6d4004800 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.079+0000 7ff6e3fff640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d4004800 0x7ff6d4004c80 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009a90 tx=0x7ff6d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cfdc4ef9d3d7cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.079+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0036070 con 0x7ff6d4004800 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.080+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d0031400 con 0x7ff6d4004800 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.080+0000 7ff6e37fe640 1 -- 172.21.15.137:0/2571734017 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0009690 con 0x7ff6d4004800 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.080+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2571734017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d4004800 msgr2=0x7ff6d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.080+0000 7ff6eab5f640 1 --2- 172.21.15.137:0/2571734017 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6d4004800 0x7ff6d4004c80 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009a90 tx=0x7ff6d4005830 comp rx=0 tx=0).stop 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.080+0000 7ff6e90fc640 1 -- 172.21.15.137:0/2571734017 reap_dead start 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.080+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2571734017 shutdown_connections 2024-04-26T22:08:21.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.080+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2571734017 >> 172.21.15.137:0/2571734017 conn(0x7ff6e406c690 msgr2=0x7ff6e406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.080+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2571734017 shutdown_connections 2024-04-26T22:08:21.084 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.080+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2571734017 wait complete. 2024-04-26T22:08:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.081+0000 7ff6eab5f640 1 Processor -- start 2024-04-26T22:08:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.081+0000 7ff6eab5f640 1 -- start start 2024-04-26T22:08:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6eab5f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d4004800 0x7ff6e415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6eab5f640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e41ee620 0x7ff6e415f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6eab5f640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e41f4060 0x7ff6e41f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6eab5f640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e406f0d0 con 0x7ff6e41ee620 2024-04-26T22:08:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6eab5f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40d1b00 con 0x7ff6d4004800 2024-04-26T22:08:21.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6eab5f640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e415d8a0 con 0x7ff6e41f4060 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6e3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e41ee620 0x7ff6e415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6e3fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e41ee620 0x7ff6e415f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53760/0 (socket says 172.21.15.137:53760) 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6e3fff640 1 -- 172.21.15.137:0/2011628576 learned_addr learned my addr 172.21.15.137:0/2011628576 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6e88fb640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d4004800 0x7ff6e415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6e3fff640 1 -- 172.21.15.137:0/2011628576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e41f4060 msgr2=0x7ff6e41f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6e3fff640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7ff6e41f4060 0x7ff6e41f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.082+0000 7ff6e3fff640 1 -- 172.21.15.137:0/2011628576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d4004800 msgr2=0x7ff6e415ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.083+0000 7ff6e3fff640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6d4004800 0x7ff6e415ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.083+0000 7ff6e3fff640 1 -- 172.21.15.137:0/2011628576 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e41f1e80 con 0x7ff6e41ee620 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.083+0000 7ff6e3fff640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e41ee620 0x7ff6e415f150 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0034040 tx=0x7ff6d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.083+0000 7ff6e17fa640 1 -- 172.21.15.137:0/2011628576 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0040020 con 0x7ff6e41ee620 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.083+0000 7ff6e17fa640 1 -- 172.21.15.137:0/2011628576 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d00038d0 con 0x7ff6e41ee620 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.083+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e41f2160 con 0x7ff6e41ee620 2024-04-26T22:08:21.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.083+0000 7ff6e17fa640 1 -- 172.21.15.137:0/2011628576 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0036040 con 0x7ff6e41ee620 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.083+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e41f2720 con 0x7ff6e41ee620 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.084+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6e406a290 con 0x7ff6e41ee620 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.084+0000 7ff6e17fa640 1 -- 172.21.15.137:0/2011628576 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff6d0043020 con 0x7ff6e41ee620 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.085+0000 7ff6e17fa640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff6c806c830 0x7ff6c806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.085+0000 7ff6e17fa640 1 -- 172.21.15.137:0/2011628576 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7ff6d00ab9a0 con 0x7ff6e41ee620 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.085+0000 7ff6e88fb640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff6c806c830 0x7ff6c806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.085+0000 7ff6e17fa640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7ff6c8072830 0x7ff6c8074c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.085+0000 7ff6e17fa640 1 -- 172.21.15.137:0/2011628576 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6d0042e50 con 0x7ff6c8072830 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.085+0000 7ff6e17fa640 1 -- 172.21.15.137:0/2011628576 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7ff6d00b02c0 con 0x7ff6e41ee620 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.085+0000 7ff6e90fc640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7ff6c8072830 0x7ff6c8074c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.085+0000 7ff6e88fb640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff6c806c830 0x7ff6c806ecf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80014f0 tx=0x7ff6d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.085+0000 7ff6e90fc640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7ff6c8072830 0x7ff6c8074c50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.086+0000 7ff6e17fa640 1 -- 172.21.15.137:0/2011628576 <== osd.1 v2:172.21.15.137:6800/757189714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6d0042e50 con 0x7ff6c8072830 2024-04-26T22:08:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.099+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 --> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff6e40ce630 con 0x7ff6c8072830 2024-04-26T22:08:21.099 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.099+0000 7ff6e17fa640 1 -- 172.21.15.137:0/2011628576 <== osd.1 v2:172.21.15.137:6800/757189714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff6e40ce630 con 0x7ff6c8072830 2024-04-26T22:08:21.100 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:08:21.100 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:08:21.100 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:08:21.101 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.099+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7ff6c8072830 msgr2=0x7ff6c8074c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.099+0000 7ff6eab5f640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6800/757189714,v1:172.21.15.137:6801/757189714] conn(0x7ff6c8072830 0x7ff6c8074c50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.099+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff6c806c830 msgr2=0x7ff6c806ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.099+0000 7ff6eab5f640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7ff6c806c830 0x7ff6c806ecf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80014f0 tx=0x7ff6d8009040 comp rx=0 tx=0).stop 2024-04-26T22:08:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.099+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e41ee620 msgr2=0x7ff6e415f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.099+0000 7ff6eab5f640 1 --2- 172.21.15.137:0/2011628576 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7ff6e41ee620 0x7ff6e415f150 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0034040 tx=0x7ff6d0004730 comp rx=0 tx=0).stop 2024-04-26T22:08:21.102 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.099+0000 7ff6e90fc640 1 -- 172.21.15.137:0/2011628576 reap_dead start 2024-04-26T22:08:21.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.100+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 shutdown_connections 2024-04-26T22:08:21.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.100+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 >> 172.21.15.137:0/2011628576 conn(0x7ff6e406c690 msgr2=0x7ff6e40cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.100+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 shutdown_connections 2024-04-26T22:08:21.103 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.100+0000 7ff6eab5f640 1 -- 172.21.15.137:0/2011628576 wait complete. 2024-04-26T22:08:21.110 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T22:08:21.208 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.208+0000 7fdb63b6a640 1 Processor -- start 2024-04-26T22:08:21.209 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.208+0000 7fdb63b6a640 1 -- start start 2024-04-26T22:08:21.211 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb63b6a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fdb5c145980 0x7fdb5c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb63b6a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdb5c0b3de0 0x7fdb5c0b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb63b6a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 0x7fdb5c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb63b6a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5c0b5140 con 0x7fdb5c0b3de0 2024-04-26T22:08:21.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb63b6a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5c0b6410 con 0x7fdb5c145980 2024-04-26T22:08:21.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb63b6a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c0b4260 con 0x7fdb5c0b5fd0 2024-04-26T22:08:21.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb61105640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdb5c0b3de0 0x7fdb5c0b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb61105640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fdb5c0b3de0 0x7fdb5c0b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53774/0 (socket says 172.21.15.137:53774) 2024-04-26T22:08:21.212 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb61105640 1 -- 172.21.15.137:0/1793167056 learned_addr learned my addr 172.21.15.137:0/1793167056 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb62107640 1 --2- 172.21.15.137:0/1793167056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 0x7fdb5c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb61906640 1 --2- 172.21.15.137:0/1793167056 >> v2:172.21.15.170:3300/0 conn(0x7fdb5c145980 0x7fdb5c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb61105640 1 -- 172.21.15.137:0/1793167056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 msgr2=0x7fdb5c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb61105640 1 --2- 172.21.15.137:0/1793167056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 0x7fdb5c15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb61105640 1 -- 172.21.15.137:0/1793167056 >> v2:172.21.15.170:3300/0 conn(0x7fdb5c145980 msgr2=0x7fdb5c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.209+0000 7fdb61105640 1 --2- 172.21.15.137:0/1793167056 >> v2:172.21.15.170:3300/0 conn(0x7fdb5c145980 0x7fdb5c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.210+0000 7fdb61105640 1 -- 172.21.15.137:0/1793167056 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c0b4530 con 0x7fdb5c0b3de0 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.210+0000 7fdb61906640 1 --2- 172.21.15.137:0/1793167056 >> v2:172.21.15.170:3300/0 conn(0x7fdb5c145980 0x7fdb5c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.210+0000 7fdb61105640 1 --2- 172.21.15.137:0/1793167056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c0b3de0 0x7fdb5c0b5a90 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0b6590 tx=0x7fdb4c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971aefb176738459 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.210+0000 7fdb60904640 1 -- 172.21.15.137:0/1793167056 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c037070 con 0x7fdb5c0b3de0 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.210+0000 7fdb60904640 1 -- 172.21.15.137:0/1793167056 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4c032440 con 0x7fdb5c0b3de0 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.210+0000 7fdb60904640 1 -- 172.21.15.137:0/1793167056 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c032810 con 0x7fdb5c0b3de0 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.211+0000 7fdb63b6a640 1 -- 172.21.15.137:0/1793167056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c0b3de0 msgr2=0x7fdb5c0b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.213 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.211+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/1793167056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c0b3de0 0x7fdb5c0b5a90 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0b6590 tx=0x7fdb4c02a130 comp rx=0 tx=0).stop 2024-04-26T22:08:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.211+0000 7fdb63b6a640 1 -- 172.21.15.137:0/1793167056 shutdown_connections 2024-04-26T22:08:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.211+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/1793167056 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 0x7fdb5c15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.211+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/1793167056 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c0b3de0 0x7fdb5c0b5a90 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.211+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/1793167056 >> v2:172.21.15.170:3300/0 conn(0x7fdb5c145980 0x7fdb5c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.211+0000 7fdb63b6a640 1 -- 172.21.15.137:0/1793167056 >> 172.21.15.137:0/1793167056 conn(0x7fdb5c0d0d30 msgr2=0x7fdb5c0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.211+0000 7fdb63b6a640 1 -- 172.21.15.137:0/1793167056 shutdown_connections 2024-04-26T22:08:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.211+0000 7fdb63b6a640 1 -- 172.21.15.137:0/1793167056 wait complete. 2024-04-26T22:08:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.212+0000 7fdb63b6a640 1 Processor -- start 2024-04-26T22:08:21.214 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.212+0000 7fdb63b6a640 1 -- start start 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb63b6a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb5c0b3de0 0x7fdb5c1f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb63b6a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 0x7fdb5c13c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb63b6a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c145980 0x7fdb5c13ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb63b6a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c0b4dd0 con 0x7fdb5c145980 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb63b6a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c0b4af0 con 0x7fdb5c0b3de0 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb63b6a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5c15ca50 con 0x7fdb5c0b5fd0 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb62107640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c145980 0x7fdb5c13ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb62107640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c145980 0x7fdb5c13ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53786/0 (socket says 172.21.15.137:53786) 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb62107640 1 -- 172.21.15.137:0/3788846970 learned_addr learned my addr 172.21.15.137:0/3788846970 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb61105640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 0x7fdb5c13c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.217 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb61906640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb5c0b3de0 0x7fdb5c1f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb62107640 1 -- 172.21.15.137:0/3788846970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 msgr2=0x7fdb5c13c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb62107640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 0x7fdb5c13c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb62107640 1 -- 172.21.15.137:0/3788846970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb5c0b3de0 msgr2=0x7fdb5c1f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb62107640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb5c0b3de0 0x7fdb5c1f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb62107640 1 -- 172.21.15.137:0/3788846970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c1f2e40 con 0x7fdb5c145980 2024-04-26T22:08:21.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.213+0000 7fdb62107640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c145980 0x7fdb5c13ccc0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400d830 tx=0x7fdb5400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.214+0000 7fdb527fc640 1 -- 172.21.15.137:0/3788846970 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54018020 con 0x7fdb5c145980 2024-04-26T22:08:21.218 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.214+0000 7fdb527fc640 1 -- 172.21.15.137:0/3788846970 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb54009660 con 0x7fdb5c145980 2024-04-26T22:08:21.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.214+0000 7fdb527fc640 1 -- 172.21.15.137:0/3788846970 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54009a30 con 0x7fdb5c145980 2024-04-26T22:08:21.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.214+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c13d2f0 con 0x7fdb5c145980 2024-04-26T22:08:21.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.214+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c13d8b0 con 0x7fdb5c145980 2024-04-26T22:08:21.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.215+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5c1f3010 con 0x7fdb5c145980 2024-04-26T22:08:21.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.215+0000 7fdb527fc640 1 -- 172.21.15.137:0/3788846970 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb5401b020 con 0x7fdb5c145980 2024-04-26T22:08:21.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.215+0000 7fdb527fc640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb4006c8f0 0x7fdb4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.219 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.216+0000 7fdb527fc640 1 -- 172.21.15.137:0/3788846970 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7fdb5408ba50 con 0x7fdb5c145980 2024-04-26T22:08:21.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.216+0000 7fdb61906640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb4006c8f0 0x7fdb4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.216+0000 7fdb61906640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb4006c8f0 0x7fdb4006edb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdb58003fd0 tx=0x7fdb580039f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.220 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.220+0000 7fdb527fc640 1 -- 172.21.15.137:0/3788846970 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fdb54022030 con 0x7fdb5c145980 2024-04-26T22:08:21.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.398+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fdb5c15c030 con 0x7fdb4006c8f0 2024-04-26T22:08:21.398 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.398+0000 7fdb527fc640 1 -- 172.21.15.137:0/3788846970 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdb58009c70 con 0x7fdb4006c8f0 2024-04-26T22:08:21.398 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T22:08:21.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb4006c8f0 msgr2=0x7fdb4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb4006c8f0 0x7fdb4006edb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fdb58003fd0 tx=0x7fdb580039f0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c145980 msgr2=0x7fdb5c13ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c145980 0x7fdb5c13ccc0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400d830 tx=0x7fdb5400dcf0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 shutdown_connections 2024-04-26T22:08:21.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fdb4006c8f0 0x7fdb4006edb0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.400 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fdb5c145980 0x7fdb5c13ccc0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fdb5c0b5fd0 0x7fdb5c13c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 --2- 172.21.15.137:0/3788846970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb5c0b3de0 0x7fdb5c1f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 >> 172.21.15.137:0/3788846970 conn(0x7fdb5c0d0d30 msgr2=0x7fdb5c0cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 shutdown_connections 2024-04-26T22:08:21.401 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.400+0000 7fdb63b6a640 1 -- 172.21.15.137:0/3788846970 wait complete. 2024-04-26T22:08:21.411 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T22:08:21.411 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:08:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.513+0000 7f81e8a15640 1 Processor -- start 2024-04-26T22:08:21.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.513+0000 7f81e8a15640 1 -- start start 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e8a15640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f81e40d0860 0x7f81e40d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e8a15640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f81e40d2800 0x7f81e415d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e8a15640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e415d610 con 0x7f81e40d0480 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e8a15640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f81e4070740 con 0x7f81e40d2800 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e8a15640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f81e40d2c70 con 0x7f81e40d0860 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e2d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f81e40d2800 0x7f81e415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e2d9d640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f81e40d2800 0x7f81e415d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53794/0 (socket says 172.21.15.137:53794) 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e2d9d640 1 -- 172.21.15.137:0/4094342660 learned_addr learned my addr 172.21.15.137:0/4094342660 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81dbfff640 1 --2- 172.21.15.137:0/4094342660 >> v2:172.21.15.170:3300/0 conn(0x7f81e40d0860 0x7f81e40d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e2d9d640 1 -- 172.21.15.137:0/4094342660 >> v2:172.21.15.170:3300/0 conn(0x7f81e40d0860 msgr2=0x7f81e40d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e2d9d640 1 --2- 172.21.15.137:0/4094342660 >> v2:172.21.15.170:3300/0 conn(0x7f81e40d0860 0x7f81e40d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e2d9d640 1 -- 172.21.15.137:0/4094342660 >> v1:172.21.15.170:6789/0 conn(0x7f81e40d0480 legacy=0x7f81e4070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.515 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.514+0000 7f81e2d9d640 1 -- 172.21.15.137:0/4094342660 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e415d330 con 0x7f81e40d2800 2024-04-26T22:08:21.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e2d9d640 1 --2- 172.21.15.137:0/4094342660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 0x7f81e415d800 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009e50 tx=0x7f81dc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49977038c434abea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e1d9b640 1 -- 172.21.15.137:0/4094342660 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc036070 con 0x7f81e40d2800 2024-04-26T22:08:21.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e1d9b640 1 -- 172.21.15.137:0/4094342660 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc031600 con 0x7f81e40d2800 2024-04-26T22:08:21.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e1d9b640 1 -- 172.21.15.137:0/4094342660 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc0319d0 con 0x7f81e40d2800 2024-04-26T22:08:21.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e8a15640 1 -- 172.21.15.137:0/4094342660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 msgr2=0x7f81e415d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e8a15640 1 --2- 172.21.15.137:0/4094342660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 0x7f81e415d800 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009e50 tx=0x7f81dc02a710 comp rx=0 tx=0).stop 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e8a15640 1 -- 172.21.15.137:0/4094342660 shutdown_connections 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e8a15640 1 --2- 172.21.15.137:0/4094342660 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 0x7f81e415d800 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e8a15640 1 --2- 172.21.15.137:0/4094342660 >> v2:172.21.15.170:3300/0 conn(0x7f81e40d0860 0x7f81e40d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.515+0000 7f81e8a15640 1 -- 172.21.15.137:0/4094342660 >> 172.21.15.137:0/4094342660 conn(0x7f81e406d590 msgr2=0x7f81e406d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.516+0000 7f81e8a15640 1 -- 172.21.15.137:0/4094342660 shutdown_connections 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.516+0000 7f81e8a15640 1 -- 172.21.15.137:0/4094342660 wait complete. 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.517+0000 7f81e8a15640 1 Processor -- start 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.517+0000 7f81e8a15640 1 -- start start 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.517+0000 7f81e8a15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e40d0480 0x7f81e40b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.517+0000 7f81e8a15640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81e40d0860 0x7f81e41522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.517+0000 7f81e8a15640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 0x7f81e415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.517+0000 7f81e8a15640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f81e406f830 con 0x7f81e40d2800 2024-04-26T22:08:21.519 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.517+0000 7f81e8a15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f81e406fba0 con 0x7f81e40d0480 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.517+0000 7f81e8a15640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f81e415dd40 con 0x7f81e40d0860 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e2d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 0x7f81e415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e2d9d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 0x7f81e415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53800/0 (socket says 172.21.15.137:53800) 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e2d9d640 1 -- 172.21.15.137:0/3985565355 learned_addr learned my addr 172.21.15.137:0/3985565355 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81dbfff640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81e40d0860 0x7f81e41522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e2d9d640 1 -- 172.21.15.137:0/3985565355 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81e40d0860 msgr2=0x7f81e41522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e259c640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e40d0480 0x7f81e40b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e2d9d640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f81e40d0860 0x7f81e41522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e2d9d640 1 -- 172.21.15.137:0/3985565355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e40d0480 msgr2=0x7f81e40b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e2d9d640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81e40d0480 0x7f81e40b62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e2d9d640 1 -- 172.21.15.137:0/3985565355 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e41f5570 con 0x7f81e40d2800 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e2d9d640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 0x7f81e415b110 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009f70 tx=0x7f81dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81daffd640 1 -- 172.21.15.137:0/3985565355 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc036050 con 0x7f81e40d2800 2024-04-26T22:08:21.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81daffd640 1 -- 172.21.15.137:0/3985565355 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc042070 con 0x7f81e40d2800 2024-04-26T22:08:21.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e41f5850 con 0x7f81e40d2800 2024-04-26T22:08:21.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81daffd640 1 -- 172.21.15.137:0/3985565355 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc009510 con 0x7f81e40d2800 2024-04-26T22:08:21.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.518+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e41f5e10 con 0x7f81e40d2800 2024-04-26T22:08:21.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.519+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81e406a290 con 0x7f81e40d2800 2024-04-26T22:08:21.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.520+0000 7f81daffd640 1 -- 172.21.15.137:0/3985565355 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81dc007bd0 con 0x7f81e40d2800 2024-04-26T22:08:21.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.520+0000 7f81daffd640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81c406c8f0 0x7f81c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.520+0000 7f81daffd640 1 -- 172.21.15.137:0/3985565355 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f81dc0ac870 con 0x7f81e40d2800 2024-04-26T22:08:21.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.520+0000 7f81e259c640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81c406c8f0 0x7f81c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.520+0000 7f81daffd640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7f81c40728f0 0x7f81c4074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.520+0000 7f81daffd640 1 -- 172.21.15.137:0/3985565355 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81dc04ae80 con 0x7f81c40728f0 2024-04-26T22:08:21.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.520+0000 7f81daffd640 1 -- 172.21.15.137:0/3985565355 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f81dc0b12c0 con 0x7f81e40d2800 2024-04-26T22:08:21.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.520+0000 7f81dbfff640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7f81c40728f0 0x7f81c4074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.520+0000 7f81e259c640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81c406c8f0 0x7f81c406edb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f81e4160b80 tx=0x7f81d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.521+0000 7f81dbfff640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7f81c40728f0 0x7f81c4074d10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.521+0000 7f81daffd640 1 -- 172.21.15.137:0/3985565355 <== osd.2 v2:172.21.15.137:6816/1304816807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f81dc04ae80 con 0x7f81c40728f0 2024-04-26T22:08:21.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.534+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 --> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f81e40b7060 con 0x7f81c40728f0 2024-04-26T22:08:21.534 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.534+0000 7f81daffd640 1 -- 172.21.15.137:0/3985565355 <== osd.2 v2:172.21.15.137:6816/1304816807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f81e40b7060 con 0x7f81c40728f0 2024-04-26T22:08:21.535 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:08:21.535 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:08:21.535 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:08:21.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.534+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7f81c40728f0 msgr2=0x7f81c4074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.534+0000 7f81e8a15640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6816/1304816807,v1:172.21.15.137:6817/1304816807] conn(0x7f81c40728f0 0x7f81c4074d10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.535+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81c406c8f0 msgr2=0x7f81c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.535+0000 7f81e8a15640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f81c406c8f0 0x7f81c406edb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f81e4160b80 tx=0x7f81d4009040 comp rx=0 tx=0).stop 2024-04-26T22:08:21.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.535+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 msgr2=0x7f81e415b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.535+0000 7f81e8a15640 1 --2- 172.21.15.137:0/3985565355 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f81e40d2800 0x7f81e415b110 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009f70 tx=0x7f81dc004a40 comp rx=0 tx=0).stop 2024-04-26T22:08:21.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.535+0000 7f81e2d9d640 1 -- 172.21.15.137:0/3985565355 reap_dead start 2024-04-26T22:08:21.536 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.535+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 shutdown_connections 2024-04-26T22:08:21.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.535+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 >> 172.21.15.137:0/3985565355 conn(0x7f81e406d590 msgr2=0x7f81e40b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.535+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 shutdown_connections 2024-04-26T22:08:21.537 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.535+0000 7f81e8a15640 1 -- 172.21.15.137:0/3985565355 wait complete. 2024-04-26T22:08:21.545 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T22:08:21.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.642+0000 7f79c0615640 1 Processor -- start 2024-04-26T22:08:21.642 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.642+0000 7f79c0615640 1 -- start start 2024-04-26T22:08:21.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.643+0000 7f79c0615640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f79b815f750 0x7f79b80cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.643 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.643+0000 7f79c0615640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79b80d03a0 con 0x7f79b815f370 2024-04-26T22:08:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.643+0000 7f79c0615640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79b80d0680 con 0x7f79b80d3ee0 2024-04-26T22:08:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.643+0000 7f79c0615640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f79b80d0960 con 0x7f79b815f750 2024-04-26T22:08:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.643+0000 7f79bebb2640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f79b815f750 0x7f79b80cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.643+0000 7f79be3b1640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f79b815f370 0x7f79b80d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47448/0 (socket says 172.21.15.137:47448) 2024-04-26T22:08:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.643+0000 7f79be3b1640 1 -- 172.21.15.137:0/2191983493 learned_addr learned my addr 172.21.15.137:0/2191983493 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.644+0000 7f79bebb2640 1 -- 172.21.15.137:0/2191983493 >> v1:172.21.15.170:6789/0 conn(0x7f79b80d3ee0 legacy=0x7f79b80b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.644+0000 7f79bebb2640 1 -- 172.21.15.137:0/2191983493 >> v1:172.21.15.137:6789/0 conn(0x7f79b815f370 legacy=0x7f79b80d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.644+0000 7f79bebb2640 1 -- 172.21.15.137:0/2191983493 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b80d0c40 con 0x7f79b815f750 2024-04-26T22:08:21.644 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.644+0000 7f79bd3af640 1 -- 172.21.15.137:0/2191983493 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838871775 0 0) 0x7f79b80d03a0 con 0x7f79b815f370 2024-04-26T22:08:21.645 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.644+0000 7f79bebb2640 1 --2- 172.21.15.137:0/2191983493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 0x7f79b80cfd70 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f79b00097a0 tx=0x7f79b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a271a5ea1cc36775 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.644+0000 7f79bd3af640 1 -- 172.21.15.137:0/2191983493 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0037070 con 0x7f79b815f750 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.644+0000 7f79bd3af640 1 -- 172.21.15.137:0/2191983493 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b0032440 con 0x7f79b815f750 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.644+0000 7f79bd3af640 1 -- 172.21.15.137:0/2191983493 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0032810 con 0x7f79b815f750 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.645+0000 7f79c0615640 1 -- 172.21.15.137:0/2191983493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 msgr2=0x7f79b80cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.645+0000 7f79c0615640 1 --2- 172.21.15.137:0/2191983493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 0x7f79b80cfd70 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f79b00097a0 tx=0x7f79b002a1e0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.645+0000 7f79c0615640 1 -- 172.21.15.137:0/2191983493 shutdown_connections 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.645+0000 7f79c0615640 1 --2- 172.21.15.137:0/2191983493 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 0x7f79b80cfd70 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.645+0000 7f79c0615640 1 -- 172.21.15.137:0/2191983493 >> 172.21.15.137:0/2191983493 conn(0x7f79b808ec10 msgr2=0x7f79b809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.645+0000 7f79c0615640 1 -- 172.21.15.137:0/2191983493 shutdown_connections 2024-04-26T22:08:21.646 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.645+0000 7f79c0615640 1 -- 172.21.15.137:0/2191983493 wait complete. 2024-04-26T22:08:21.649 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.646+0000 7f79c0615640 1 Processor -- start 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.646+0000 7f79c0615640 1 -- start start 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79c0615640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79b80d3ee0 0x7f79b80c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79c0615640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79b815f370 0x7f79b815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79c0615640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 0x7f79b815b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79c0615640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f79b80b4950 con 0x7f79b815f750 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79c0615640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f79b80b47d0 con 0x7f79b815f370 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79c0615640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f79b80b4ad0 con 0x7f79b80d3ee0 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79bebb2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 0x7f79b815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79bebb2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 0x7f79b815b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53820/0 (socket says 172.21.15.137:53820) 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79bebb2640 1 -- 172.21.15.137:0/3050254118 learned_addr learned my addr 172.21.15.137:0/3050254118 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:21.650 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79be3b1640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79b80d3ee0 0x7f79b80c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.647+0000 7f79bdbb0640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79b815f370 0x7f79b815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79bebb2640 1 -- 172.21.15.137:0/3050254118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79b80d3ee0 msgr2=0x7f79b80c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79bebb2640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79b80d3ee0 0x7f79b80c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79bebb2640 1 -- 172.21.15.137:0/3050254118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79b815f370 msgr2=0x7f79b815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79bebb2640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79b815f370 0x7f79b815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79bebb2640 1 -- 172.21.15.137:0/3050254118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b80cdf00 con 0x7f79b815f750 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79bebb2640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 0x7f79b815b900 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f79b00098c0 tx=0x7f79b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79aeffd640 1 -- 172.21.15.137:0/3050254118 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0041070 con 0x7f79b815f750 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79aeffd640 1 -- 172.21.15.137:0/3050254118 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b003c870 con 0x7f79b815f750 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b80ce1e0 con 0x7f79b815f750 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79aeffd640 1 -- 172.21.15.137:0/3050254118 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b0037040 con 0x7f79b815f750 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.648+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b80ce7a0 con 0x7f79b815f750 2024-04-26T22:08:21.651 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.649+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b806a290 con 0x7f79b815f750 2024-04-26T22:08:21.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.649+0000 7f79aeffd640 1 -- 172.21.15.137:0/3050254118 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f79b0044070 con 0x7f79b815f750 2024-04-26T22:08:21.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.650+0000 7f79aeffd640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f799c06c8f0 0x7f799c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.650+0000 7f79aeffd640 1 -- 172.21.15.137:0/3050254118 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f79b00ac3e0 con 0x7f79b815f750 2024-04-26T22:08:21.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.650+0000 7f79be3b1640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f799c06c8f0 0x7f799c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.652 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.650+0000 7f79be3b1640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f799c06c8f0 0x7f799c06edb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f79b40012e0 tx=0x7f79b4001700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.654 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.654+0000 7f79aeffd640 1 -- 172.21.15.137:0/3050254118 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f79b007a410 con 0x7f79b815f750 2024-04-26T22:08:21.834 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.835+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f79b80d4a70 con 0x7f799c06c8f0 2024-04-26T22:08:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.835+0000 7f79aeffd640 1 -- 172.21.15.137:0/3050254118 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f79b80d4a70 con 0x7f799c06c8f0 2024-04-26T22:08:21.835 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T22:08:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f799c06c8f0 msgr2=0x7f799c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f799c06c8f0 0x7f799c06edb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f79b40012e0 tx=0x7f79b4001700 comp rx=0 tx=0).stop 2024-04-26T22:08:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 msgr2=0x7f79b815b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 0x7f79b815b900 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f79b00098c0 tx=0x7f79b00046c0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 shutdown_connections 2024-04-26T22:08:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f799c06c8f0 0x7f799c06edb0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f79b815f750 0x7f79b815b900 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79b815f370 0x7f79b815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 --2- 172.21.15.137:0/3050254118 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f79b80d3ee0 0x7f79b80c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 >> 172.21.15.137:0/3050254118 conn(0x7f79b808ec10 msgr2=0x7f79b809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 shutdown_connections 2024-04-26T22:08:21.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.837+0000 7f79c0615640 1 -- 172.21.15.137:0/3050254118 wait complete. 2024-04-26T22:08:21.848 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T22:08:21.848 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:08:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.948+0000 7f7ed219d640 1 Processor -- start 2024-04-26T22:08:21.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.948+0000 7f7ed219d640 1 -- start start 2024-04-26T22:08:21.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7ed219d640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7ecc0b4620 0x7f7ecc0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7ed219d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc0cdef0 0x7f7ecc06f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7ed219d640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ecc0b4a00 con 0x7f7ecc15bed0 2024-04-26T22:08:21.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7ed219d640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f7ecc06ff10 con 0x7f7ecc0b4620 2024-04-26T22:08:21.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7ed219d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7ecc141e10 con 0x7f7ecc0cdef0 2024-04-26T22:08:21.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7ecaffd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f7ecc15bed0 0x7f7ecc0cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47464/0 (socket says 172.21.15.137:47464) 2024-04-26T22:08:21.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7ecaffd640 1 -- 172.21.15.137:0/1191144279 learned_addr learned my addr 172.21.15.137:0/1191144279 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550630513 0 0) 0x7f7ecc0b4a00 con 0x7f7ecc15bed0 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7ecbfff640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc0cdef0 0x7f7ecc06f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb4003520 con 0x7f7ecc15bed0 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.949+0000 7f7ecb7fe640 1 --2- 172.21.15.137:0/1191144279 >> v2:172.21.15.170:3300/0 conn(0x7f7ecc0b4620 0x7f7ecc0b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 845197686 0 0) 0x7f7eb4003520 con 0x7f7ecc15bed0 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc0cdef0 msgr2=0x7f7ecc06f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc0cdef0 0x7f7ecc06f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 >> v2:172.21.15.170:3300/0 conn(0x7f7ecc0b4620 msgr2=0x7f7ecc0b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 --2- 172.21.15.137:0/1191144279 >> v2:172.21.15.170:3300/0 conn(0x7f7ecc0b4620 0x7f7ecc0b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc141200 con 0x7f7ecc15bed0 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f7ec0001690 con 0x7f7ecc15bed0 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 >> v1:172.21.15.137:6789/0 conn(0x7f7ecc15bed0 legacy=0x7f7ecc0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb40039b0 0x7f7eb4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 0x7f7eb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc0cdef0 0x7f7eb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc06ff10 con 0x7f7eb4004800 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc141e10 con 0x7f7eb40039b0 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb400cad0 con 0x7f7ecc0cdef0 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7ecaffd640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 0x7f7eb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7ecbfff640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc0cdef0 0x7f7eb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7ecb7fe640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb40039b0 0x7f7eb4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7ecaffd640 1 -- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc0cdef0 msgr2=0x7f7eb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7ecaffd640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc0cdef0 0x7f7eb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7ecaffd640 1 -- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb40039b0 msgr2=0x7f7eb4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7ecaffd640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7eb40039b0 0x7f7eb4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.950+0000 7f7ecaffd640 1 -- 172.21.15.137:0/1191144279 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb4003520 con 0x7f7eb4004800 2024-04-26T22:08:21.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.951+0000 7f7ecaffd640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 0x7f7eb4004c80 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000c240 tx=0x7f7eb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15da9591abb94a46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.951+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0007d60 con 0x7f7eb4004800 2024-04-26T22:08:21.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.951+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec0005ad0 con 0x7f7eb4004800 2024-04-26T22:08:21.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.951+0000 7f7eca7fc640 1 -- 172.21.15.137:0/1191144279 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0007070 con 0x7f7eb4004800 2024-04-26T22:08:21.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.951+0000 7f7ed219d640 1 -- 172.21.15.137:0/1191144279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 msgr2=0x7f7eb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.951+0000 7f7ed219d640 1 --2- 172.21.15.137:0/1191144279 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 0x7f7eb4004c80 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f7ec000c240 tx=0x7f7eb4005830 comp rx=0 tx=0).stop 2024-04-26T22:08:21.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.951+0000 7f7ecbfff640 1 -- 172.21.15.137:0/1191144279 reap_dead start 2024-04-26T22:08:21.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.952+0000 7f7ed219d640 1 -- 172.21.15.137:0/1191144279 shutdown_connections 2024-04-26T22:08:21.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.952+0000 7f7ed219d640 1 -- 172.21.15.137:0/1191144279 >> 172.21.15.137:0/1191144279 conn(0x7f7ecc06c690 msgr2=0x7f7ecc06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.952+0000 7f7ed219d640 1 -- 172.21.15.137:0/1191144279 shutdown_connections 2024-04-26T22:08:21.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.952+0000 7f7ed219d640 1 -- 172.21.15.137:0/1191144279 wait complete. 2024-04-26T22:08:21.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.953+0000 7f7ed219d640 1 Processor -- start 2024-04-26T22:08:21.959 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.953+0000 7f7ed219d640 1 -- start start 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ed219d640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 0x7f7ecc072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ed219d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ecc1532e0 0x7f7ecc1f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ed219d640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc1f6a90 0x7f7ecc0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ed219d640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc141aa0 con 0x7f7eb4004800 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ed219d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc1417c0 con 0x7f7ecc1532e0 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ed219d640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f7ecc06f9d0 con 0x7f7ecc1f6a90 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 0x7f7ecc072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecb7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 0x7f7ecc072aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53844/0 (socket says 172.21.15.137:53844) 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecb7fe640 1 -- 172.21.15.137:0/340402648 learned_addr learned my addr 172.21.15.137:0/340402648 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecbfff640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc1f6a90 0x7f7ecc0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecaffd640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ecc1532e0 0x7f7ecc1f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecb7fe640 1 -- 172.21.15.137:0/340402648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc1f6a90 msgr2=0x7f7ecc0cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecb7fe640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f7ecc1f6a90 0x7f7ecc0cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecb7fe640 1 -- 172.21.15.137:0/340402648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ecc1532e0 msgr2=0x7f7ecc1f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecb7fe640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ecc1532e0 0x7f7ecc1f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecb7fe640 1 -- 172.21.15.137:0/340402648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc0733a0 con 0x7f7eb4004800 2024-04-26T22:08:21.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ecb7fe640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 0x7f7ecc072aa0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0118e0 tx=0x7f7ebc011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7eb3fff640 1 -- 172.21.15.137:0/340402648 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc00faf0 con 0x7f7eb4004800 2024-04-26T22:08:21.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7eb3fff640 1 -- 172.21.15.137:0/340402648 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ebc00fc90 con 0x7f7eb4004800 2024-04-26T22:08:21.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ecc073680 con 0x7f7eb4004800 2024-04-26T22:08:21.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7eb3fff640 1 -- 172.21.15.137:0/340402648 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc014440 con 0x7f7eb4004800 2024-04-26T22:08:21.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.954+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ecc150b60 con 0x7f7eb4004800 2024-04-26T22:08:21.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.955+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ecc06a290 con 0x7f7eb4004800 2024-04-26T22:08:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.956+0000 7f7eb3fff640 1 -- 172.21.15.137:0/340402648 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ebc012040 con 0x7f7eb4004800 2024-04-26T22:08:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.956+0000 7f7eb3fff640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb806c8f0 0x7f7eb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.956+0000 7f7eb3fff640 1 -- 172.21.15.137:0/340402648 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f7ebc08c090 con 0x7f7eb4004800 2024-04-26T22:08:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.956+0000 7f7ecaffd640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb806c8f0 0x7f7eb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.956+0000 7f7eb3fff640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f7eb80728f0 0x7f7eb8074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.956+0000 7f7eb3fff640 1 -- 172.21.15.137:0/340402648 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ebc025ec0 con 0x7f7eb80728f0 2024-04-26T22:08:21.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.956+0000 7f7eb3fff640 1 -- 172.21.15.137:0/340402648 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f7ebc093050 con 0x7f7eb4004800 2024-04-26T22:08:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.956+0000 7f7ecbfff640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f7eb80728f0 0x7f7eb8074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.957+0000 7f7ecaffd640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb806c8f0 0x7f7eb806edb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0033000 tx=0x7f7ec0007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.957+0000 7f7ecbfff640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f7eb80728f0 0x7f7eb8074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:21.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.957+0000 7f7eb3fff640 1 -- 172.21.15.137:0/340402648 <== osd.3 v2:172.21.15.137:6808/492121506 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ebc025ec0 con 0x7f7eb80728f0 2024-04-26T22:08:21.970 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.970+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 --> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7ecc06f7b0 con 0x7f7eb80728f0 2024-04-26T22:08:21.971 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7eb3fff640 1 -- 172.21.15.137:0/340402648 <== osd.3 v2:172.21.15.137:6808/492121506 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7ecc06f7b0 con 0x7f7eb80728f0 2024-04-26T22:08:21.971 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:08:21.971 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:08:21.971 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:08:21.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f7eb80728f0 msgr2=0x7f7eb8074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6808/492121506,v1:172.21.15.137:6809/492121506] conn(0x7f7eb80728f0 0x7f7eb8074d10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb806c8f0 msgr2=0x7f7eb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f7eb806c8f0 0x7f7eb806edb0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0033000 tx=0x7f7ec0007000 comp rx=0 tx=0).stop 2024-04-26T22:08:21.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 msgr2=0x7f7ecc072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:21.972 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 --2- 172.21.15.137:0/340402648 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f7eb4004800 0x7f7ecc072aa0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc0118e0 tx=0x7f7ebc011da0 comp rx=0 tx=0).stop 2024-04-26T22:08:21.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ecbfff640 1 -- 172.21.15.137:0/340402648 reap_dead start 2024-04-26T22:08:21.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 shutdown_connections 2024-04-26T22:08:21.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 >> 172.21.15.137:0/340402648 conn(0x7f7ecc06c690 msgr2=0x7f7ecc0cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:21.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 shutdown_connections 2024-04-26T22:08:21.973 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:21.971+0000 7f7ed219d640 1 -- 172.21.15.137:0/340402648 wait complete. 2024-04-26T22:08:21.982 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T22:08:22.079 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.080+0000 7f2c1416a640 1 Processor -- start 2024-04-26T22:08:22.080 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.080+0000 7f2c1416a640 1 -- start start 2024-04-26T22:08:22.081 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c1416a640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c0c15d130 0x7f2c0c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c1416a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2c0c0733c0 0x7f2c0c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c1416a640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c0c15d510 con 0x7f2c0c070d00 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c1416a640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f2c0c0b0e80 con 0x7f2c0c15d130 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c1416a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f2c0c0b54f0 con 0x7f2c0c0733c0 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c11f06640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c0c15d130 0x7f2c0c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c11f06640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f2c0c15d130 0x7f2c0c06d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53846/0 (socket says 172.21.15.137:53846) 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c11f06640 1 -- 172.21.15.137:0/1621969624 learned_addr learned my addr 172.21.15.137:0/1621969624 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c11f06640 1 -- 172.21.15.137:0/1621969624 >> v2:172.21.15.170:3300/0 conn(0x7f2c0c0733c0 msgr2=0x7f2c0c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c11705640 1 --2- 172.21.15.137:0/1621969624 >> v2:172.21.15.170:3300/0 conn(0x7f2c0c0733c0 0x7f2c0c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c11f06640 1 --2- 172.21.15.137:0/1621969624 >> v2:172.21.15.170:3300/0 conn(0x7f2c0c0733c0 0x7f2c0c06d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c11f06640 1 -- 172.21.15.137:0/1621969624 >> v1:172.21.15.170:6789/0 conn(0x7f2c0c070d00 legacy=0x7f2c0c160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c11f06640 1 -- 172.21.15.137:0/1621969624 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c0d12c0 con 0x7f2c0c15d130 2024-04-26T22:08:22.082 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.081+0000 7f2c11705640 1 --2- 172.21.15.137:0/1621969624 >> v2:172.21.15.170:3300/0 conn(0x7f2c0c0733c0 0x7f2c0c06d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:22.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c11f06640 1 --2- 172.21.15.137:0/1621969624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 0x7f2c0c06d2b0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c06e690 tx=0x7f2bfc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0035022932673b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c10f04640 1 -- 172.21.15.137:0/1621969624 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc037070 con 0x7f2c0c15d130 2024-04-26T22:08:22.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c10f04640 1 -- 172.21.15.137:0/1621969624 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc032440 con 0x7f2c0c15d130 2024-04-26T22:08:22.083 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c10f04640 1 -- 172.21.15.137:0/1621969624 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc032810 con 0x7f2c0c15d130 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c1416a640 1 -- 172.21.15.137:0/1621969624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 msgr2=0x7f2c0c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c1416a640 1 --2- 172.21.15.137:0/1621969624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 0x7f2c0c06d2b0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c06e690 tx=0x7f2bfc02a230 comp rx=0 tx=0).stop 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c1416a640 1 -- 172.21.15.137:0/1621969624 shutdown_connections 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c1416a640 1 --2- 172.21.15.137:0/1621969624 >> v2:172.21.15.170:3300/0 conn(0x7f2c0c0733c0 0x7f2c0c06d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c1416a640 1 --2- 172.21.15.137:0/1621969624 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 0x7f2c0c06d2b0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.082+0000 7f2c1416a640 1 -- 172.21.15.137:0/1621969624 >> 172.21.15.137:0/1621969624 conn(0x7f2c0c0728a0 msgr2=0x7f2c0c072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.083+0000 7f2c1416a640 1 -- 172.21.15.137:0/1621969624 shutdown_connections 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.083+0000 7f2c1416a640 1 -- 172.21.15.137:0/1621969624 wait complete. 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.084+0000 7f2c1416a640 1 Processor -- start 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.084+0000 7f2c1416a640 1 -- start start 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.084+0000 7f2c1416a640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c0c070d00 0x7f2c0c0af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.086 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.084+0000 7f2c1416a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c0c0733c0 0x7f2c0c160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.084+0000 7f2c1416a640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 0x7f2c0c160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.084+0000 7f2c1416a640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c0d07e0 con 0x7f2c0c15d130 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.084+0000 7f2c1416a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c0d0500 con 0x7f2c0c0733c0 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.084+0000 7f2c1416a640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0c0d0ac0 con 0x7f2c0c070d00 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.084+0000 7f2c12707640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 0x7f2c0c160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c12707640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 0x7f2c0c160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53854/0 (socket says 172.21.15.137:53854) 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c12707640 1 -- 172.21.15.137:0/1668645641 learned_addr learned my addr 172.21.15.137:0/1668645641 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c11f06640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c0c070d00 0x7f2c0c0af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c12707640 1 -- 172.21.15.137:0/1668645641 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c0c070d00 msgr2=0x7f2c0c0af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c12707640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c0c070d00 0x7f2c0c0af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c12707640 1 -- 172.21.15.137:0/1668645641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c0c0733c0 msgr2=0x7f2c0c160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c12707640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c0c0733c0 0x7f2c0c160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c12707640 1 -- 172.21.15.137:0/1668645641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c140f50 con 0x7f2c0c15d130 2024-04-26T22:08:22.087 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c12707640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 0x7f2c0c160eb0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c730 tx=0x7f2c0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c027fc640 1 -- 172.21.15.137:0/1668645641 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04016020 con 0x7f2c0c15d130 2024-04-26T22:08:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c027fc640 1 -- 172.21.15.137:0/1668645641 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0400aa50 con 0x7f2c0c15d130 2024-04-26T22:08:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0c141230 con 0x7f2c0c15d130 2024-04-26T22:08:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c027fc640 1 -- 172.21.15.137:0/1668645641 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0400ce40 con 0x7f2c0c15d130 2024-04-26T22:08:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.085+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0c1417f0 con 0x7f2c0c15d130 2024-04-26T22:08:22.088 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.086+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0c06d9e0 con 0x7f2c0c15d130 2024-04-26T22:08:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.087+0000 7f2c027fc640 1 -- 172.21.15.137:0/1668645641 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c04019020 con 0x7f2c0c15d130 2024-04-26T22:08:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.087+0000 7f2c027fc640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bf006c8f0 0x7f2bf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.087+0000 7f2c11f06640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bf006c8f0 0x7f2bf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.087+0000 7f2c027fc640 1 -- 172.21.15.137:0/1668645641 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f2c0408b800 con 0x7f2c0c15d130 2024-04-26T22:08:22.089 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.087+0000 7f2c11f06640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bf006c8f0 0x7f2bf006edb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc034000 tx=0x7f2bfc02e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.093 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.091+0000 7f2c027fc640 1 -- 172.21.15.137:0/1668645641 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f2c0c06d9e0 con 0x7f2c0c15d130 2024-04-26T22:08:22.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.266+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2c0c161970 con 0x7f2bf006c8f0 2024-04-26T22:08:22.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.266+0000 7f2c027fc640 1 -- 172.21.15.137:0/1668645641 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c0c161970 con 0x7f2bf006c8f0 2024-04-26T22:08:22.266 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T22:08:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bf006c8f0 msgr2=0x7f2bf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bf006c8f0 0x7f2bf006edb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc034000 tx=0x7f2bfc02e000 comp rx=0 tx=0).stop 2024-04-26T22:08:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 msgr2=0x7f2c0c160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 0x7f2c0c160eb0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c730 tx=0x7f2c0400cbf0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 shutdown_connections 2024-04-26T22:08:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f2bf006c8f0 0x7f2bf006edb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f2c0c15d130 0x7f2c0c160eb0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c0c0733c0 0x7f2c0c160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 --2- 172.21.15.137:0/1668645641 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f2c0c070d00 0x7f2c0c0af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 >> 172.21.15.137:0/1668645641 conn(0x7f2c0c0728a0 msgr2=0x7f2c0c15ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 shutdown_connections 2024-04-26T22:08:22.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.268+0000 7f2c1416a640 1 -- 172.21.15.137:0/1668645641 wait complete. 2024-04-26T22:08:22.279 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T22:08:22.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:08:22.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.380+0000 7f483e015640 1 Processor -- start 2024-04-26T22:08:22.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.380+0000 7f483e015640 1 -- start start 2024-04-26T22:08:22.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.381+0000 7f483e015640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f48380d2140 0x7f48380d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.381+0000 7f483e015640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48380b6020 0x7f48380cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.381+0000 7f483e015640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48380d33a0 con 0x7f4838162a10 2024-04-26T22:08:22.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.381+0000 7f483e015640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f48380b4970 con 0x7f48380b6020 2024-04-26T22:08:22.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.381+0000 7f483e015640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f48380d3680 con 0x7f48380d2140 2024-04-26T22:08:22.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.381+0000 7f4837fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48380b6020 0x7f48380cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.381+0000 7f4837fff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f48380b6020 0x7f48380cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53858/0 (socket says 172.21.15.137:53858) 2024-04-26T22:08:22.382 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.381+0000 7f4837fff640 1 -- 172.21.15.137:0/2506059770 learned_addr learned my addr 172.21.15.137:0/2506059770 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:22.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.381+0000 7f4836ffd640 1 --2- 172.21.15.137:0/2506059770 >> v2:172.21.15.170:3300/0 conn(0x7f48380d2140 0x7f48380d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.382+0000 7f4837fff640 1 -- 172.21.15.137:0/2506059770 >> v2:172.21.15.170:3300/0 conn(0x7f48380d2140 msgr2=0x7f48380d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:22.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.382+0000 7f4837fff640 1 --2- 172.21.15.137:0/2506059770 >> v2:172.21.15.170:3300/0 conn(0x7f48380d2140 0x7f48380d2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.382+0000 7f4837fff640 1 -- 172.21.15.137:0/2506059770 >> v1:172.21.15.170:6789/0 conn(0x7f4838162a10 legacy=0x7f48380d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:22.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.382+0000 7f4837fff640 1 -- 172.21.15.137:0/2506059770 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48380d3960 con 0x7f48380b6020 2024-04-26T22:08:22.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.382+0000 7f4837fff640 1 --2- 172.21.15.137:0/2506059770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 0x7f48380cffb0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f483808f0b0 tx=0x7f483002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4f2b897e2d5241 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.382+0000 7f48367fc640 1 -- 172.21.15.137:0/2506059770 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830036070 con 0x7f48380b6020 2024-04-26T22:08:22.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.382+0000 7f48367fc640 1 -- 172.21.15.137:0/2506059770 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4830031600 con 0x7f48380b6020 2024-04-26T22:08:22.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.382+0000 7f48367fc640 1 -- 172.21.15.137:0/2506059770 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48300319d0 con 0x7f48380b6020 2024-04-26T22:08:22.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.383+0000 7f483e015640 1 -- 172.21.15.137:0/2506059770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 msgr2=0x7f48380cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.383+0000 7f483e015640 1 --2- 172.21.15.137:0/2506059770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 0x7f48380cffb0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f483808f0b0 tx=0x7f483002a6f0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.383+0000 7f483e015640 1 -- 172.21.15.137:0/2506059770 shutdown_connections 2024-04-26T22:08:22.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.383+0000 7f483e015640 1 --2- 172.21.15.137:0/2506059770 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 0x7f48380cffb0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.383+0000 7f483e015640 1 --2- 172.21.15.137:0/2506059770 >> v2:172.21.15.170:3300/0 conn(0x7f48380d2140 0x7f48380d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.383+0000 7f483e015640 1 -- 172.21.15.137:0/2506059770 >> 172.21.15.137:0/2506059770 conn(0x7f483809e530 msgr2=0x7f48380d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:22.386 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.383+0000 7f483e015640 1 -- 172.21.15.137:0/2506059770 shutdown_connections 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.383+0000 7f483e015640 1 -- 172.21.15.137:0/2506059770 wait complete. 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.384+0000 7f483e015640 1 Processor -- start 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.384+0000 7f483e015640 1 -- start start 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f483e015640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 0x7f4838160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f483e015640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48380d2140 0x7f48380b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f483e015640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4838162a10 0x7f48380b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f483e015640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f4838162df0 con 0x7f48380b6020 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f483e015640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f48380d3f20 con 0x7f48380d2140 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f483e015640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f48380b6600 con 0x7f4838162a10 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f48377fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 0x7f4838160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f48377fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 0x7f4838160000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53872/0 (socket says 172.21.15.137:53872) 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f48377fe640 1 -- 172.21.15.137:0/3472010834 learned_addr learned my addr 172.21.15.137:0/3472010834 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f4836ffd640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48380d2140 0x7f48380b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f4837fff640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4838162a10 0x7f48380b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f48377fe640 1 -- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4838162a10 msgr2=0x7f48380b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f48377fe640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f4838162a10 0x7f48380b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f48377fe640 1 -- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48380d2140 msgr2=0x7f48380b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f48377fe640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f48380d2140 0x7f48380b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.385+0000 7f48377fe640 1 -- 172.21.15.137:0/3472010834 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48380cc6e0 con 0x7f48380b6020 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.386+0000 7f48377fe640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 0x7f4838160000 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f482800b420 tx=0x7f482800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.386+0000 7f481ffff640 1 -- 172.21.15.137:0/3472010834 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828011830 con 0x7f48380b6020 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.386+0000 7f481ffff640 1 -- 172.21.15.137:0/3472010834 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4828016070 con 0x7f48380b6020 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.386+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48380cc9c0 con 0x7f48380b6020 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.386+0000 7f481ffff640 1 -- 172.21.15.137:0/3472010834 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828011c10 con 0x7f48380b6020 2024-04-26T22:08:22.388 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.386+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48380ccf80 con 0x7f48380b6020 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.387+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f483806a290 con 0x7f48380b6020 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.387+0000 7f481ffff640 1 -- 172.21.15.137:0/3472010834 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f482801b460 con 0x7f48380b6020 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.388+0000 7f481ffff640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f482406c8f0 0x7f482406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.388+0000 7f481ffff640 1 -- 172.21.15.137:0/3472010834 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f482808b360 con 0x7f48380b6020 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.388+0000 7f4836ffd640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f482406c8f0 0x7f482406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.388+0000 7f481ffff640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7f48240728f0 0x7f4824074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.388+0000 7f481ffff640 1 -- 172.21.15.137:0/3472010834 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48240753c0 con 0x7f48240728f0 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.388+0000 7f481ffff640 1 -- 172.21.15.137:0/3472010834 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f4828092050 con 0x7f48380b6020 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.388+0000 7f4837fff640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7f48240728f0 0x7f4824074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.388+0000 7f4836ffd640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f482406c8f0 0x7f482406edb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f48380cb3d0 tx=0x7f482c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.389+0000 7f4837fff640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7f48240728f0 0x7f4824074d10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.390 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.389+0000 7f481ffff640 1 -- 172.21.15.137:0/3472010834 <== osd.4 v2:172.21.15.170:6824/2080414701 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f48240753c0 con 0x7f48240728f0 2024-04-26T22:08:22.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.402+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 --> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4838160840 con 0x7f48240728f0 2024-04-26T22:08:22.402 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f481ffff640 1 -- 172.21.15.137:0/3472010834 <== osd.4 v2:172.21.15.170:6824/2080414701 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4838160840 con 0x7f48240728f0 2024-04-26T22:08:22.403 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:08:22.403 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:08:22.403 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7f48240728f0 msgr2=0x7f4824074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.170:6824/2080414701,v1:172.21.15.170:6825/2080414701] conn(0x7f48240728f0 0x7f4824074d10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f482406c8f0 msgr2=0x7f482406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f482406c8f0 0x7f482406edb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f48380cb3d0 tx=0x7f482c008040 comp rx=0 tx=0).stop 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 msgr2=0x7f4838160000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 --2- 172.21.15.137:0/3472010834 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f48380b6020 0x7f4838160000 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f482800b420 tx=0x7f482800b8e0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f4837fff640 1 -- 172.21.15.137:0/3472010834 reap_dead start 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 shutdown_connections 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 >> 172.21.15.137:0/3472010834 conn(0x7f483809e530 msgr2=0x7f483815aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:22.405 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 shutdown_connections 2024-04-26T22:08:22.406 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.403+0000 7f483e015640 1 -- 172.21.15.137:0/3472010834 wait complete. 2024-04-26T22:08:22.414 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T22:08:22.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.513+0000 7fd06d533640 1 Processor -- start 2024-04-26T22:08:22.513 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.513+0000 7fd06d533640 1 -- start start 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd06d533640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd06815f340 0x7fd0680b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd06d533640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd06815f720 0x7fd0680d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd06d533640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0680b2510 con 0x7fd0680d4f00 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd06d533640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fd0680b27f0 con 0x7fd06815f340 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd06d533640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd0680b2ad0 con 0x7fd06815f720 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd066ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd06815f340 0x7fd0680b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd066ffd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fd06815f340 0x7fd0680b1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53886/0 (socket says 172.21.15.137:53886) 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd066ffd640 1 -- 172.21.15.137:0/1052297883 learned_addr learned my addr 172.21.15.137:0/1052297883 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd0677fe640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fd0680d4f00 0x7fd0680d5350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47476/0 (socket says 172.21.15.137:47476) 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd0667fc640 1 --2- 172.21.15.137:0/1052297883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd06815f720 0x7fd0680d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.516 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd066ffd640 1 -- 172.21.15.137:0/1052297883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd06815f720 msgr2=0x7fd0680d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd066ffd640 1 --2- 172.21.15.137:0/1052297883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd06815f720 0x7fd0680d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd066ffd640 1 -- 172.21.15.137:0/1052297883 >> v1:172.21.15.137:6789/0 conn(0x7fd0680d4f00 legacy=0x7fd0680d5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.514+0000 7fd066ffd640 1 -- 172.21.15.137:0/1052297883 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0680b2db0 con 0x7fd06815f340 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.515+0000 7fd066ffd640 1 --2- 172.21.15.137:0/1052297883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f340 0x7fd0680b1e80 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fd058009e50 tx=0x7fd05802a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933f7a698bffc194 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.515+0000 7fd065ffb640 1 -- 172.21.15.137:0/1052297883 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058036070 con 0x7fd06815f340 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.515+0000 7fd065ffb640 1 -- 172.21.15.137:0/1052297883 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd058031600 con 0x7fd06815f340 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.515+0000 7fd065ffb640 1 -- 172.21.15.137:0/1052297883 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0580319d0 con 0x7fd06815f340 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.516+0000 7fd06d533640 1 -- 172.21.15.137:0/1052297883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f340 msgr2=0x7fd0680b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.516+0000 7fd06d533640 1 --2- 172.21.15.137:0/1052297883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f340 0x7fd0680b1e80 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fd058009e50 tx=0x7fd05802a590 comp rx=0 tx=0).stop 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.516+0000 7fd06d533640 1 -- 172.21.15.137:0/1052297883 shutdown_connections 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.516+0000 7fd06d533640 1 --2- 172.21.15.137:0/1052297883 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd06815f720 0x7fd0680d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.516+0000 7fd06d533640 1 --2- 172.21.15.137:0/1052297883 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f340 0x7fd0680b1e80 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.516+0000 7fd06d533640 1 -- 172.21.15.137:0/1052297883 >> 172.21.15.137:0/1052297883 conn(0x7fd06808ec70 msgr2=0x7fd06809e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:22.517 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.516+0000 7fd06d533640 1 -- 172.21.15.137:0/1052297883 shutdown_connections 2024-04-26T22:08:22.518 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.516+0000 7fd06d533640 1 -- 172.21.15.137:0/1052297883 wait complete. 2024-04-26T22:08:22.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.517+0000 7fd06d533640 1 Processor -- start 2024-04-26T22:08:22.520 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.517+0000 7fd06d533640 1 -- start start 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd06d533640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0680d4f00 0x7fd068159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd06d533640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd06815f340 0x7fd0680c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd06d533640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f720 0x7fd0680c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd06d533640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fd0680b3980 con 0x7fd06815f720 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd06d533640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fd0680b3800 con 0x7fd06815f340 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd06d533640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fd0680b3b00 con 0x7fd0680d4f00 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f720 0x7fd0680c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0677fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f720 0x7fd0680c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53902/0 (socket says 172.21.15.137:53902) 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0677fe640 1 -- 172.21.15.137:0/1278368130 learned_addr learned my addr 172.21.15.137:0/1278368130 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0667fc640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd06815f340 0x7fd0680c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd066ffd640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0680d4f00 0x7fd068159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0677fe640 1 -- 172.21.15.137:0/1278368130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0680d4f00 msgr2=0x7fd068159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.521 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0677fe640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0680d4f00 0x7fd068159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0677fe640 1 -- 172.21.15.137:0/1278368130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd06815f340 msgr2=0x7fd0680c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0677fe640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd06815f340 0x7fd0680c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0677fe640 1 -- 172.21.15.137:0/1278368130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0680cd340 con 0x7fd06815f720 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd066ffd640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0680d4f00 0x7fd068159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.518+0000 7fd0677fe640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f720 0x7fd0680c99b0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c780 tx=0x7fd06000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.519+0000 7fd04f7fe640 1 -- 172.21.15.137:0/1278368130 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060018070 con 0x7fd06815f720 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.519+0000 7fd04f7fe640 1 -- 172.21.15.137:0/1278368130 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd060007270 con 0x7fd06815f720 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.519+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06806e750 con 0x7fd06815f720 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.519+0000 7fd04f7fe640 1 -- 172.21.15.137:0/1278368130 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060007620 con 0x7fd06815f720 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.519+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0680cd8e0 con 0x7fd06815f720 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.520+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06806a290 con 0x7fd06815f720 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.520+0000 7fd04f7fe640 1 -- 172.21.15.137:0/1278368130 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd06001b070 con 0x7fd06815f720 2024-04-26T22:08:22.522 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.520+0000 7fd04f7fe640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd05406c8f0 0x7fd05406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.520+0000 7fd04f7fe640 1 -- 172.21.15.137:0/1278368130 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7fd06008acb0 con 0x7fd06815f720 2024-04-26T22:08:22.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.520+0000 7fd066ffd640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd05406c8f0 0x7fd05406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.523 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.521+0000 7fd066ffd640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd05406c8f0 0x7fd05406edb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd058033000 tx=0x7fd058009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.524 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.525+0000 7fd04f7fe640 1 -- 172.21.15.137:0/1278368130 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fd060058d70 con 0x7fd06815f720 2024-04-26T22:08:22.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.698+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fd0680cdab0 con 0x7fd05406c8f0 2024-04-26T22:08:22.698 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.699+0000 7fd04f7fe640 1 -- 172.21.15.137:0/1278368130 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd0680cdab0 con 0x7fd05406c8f0 2024-04-26T22:08:22.698 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd05406c8f0 msgr2=0x7fd05406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd05406c8f0 0x7fd05406edb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd058033000 tx=0x7fd058009000 comp rx=0 tx=0).stop 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f720 msgr2=0x7fd0680c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f720 0x7fd0680c99b0 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c780 tx=0x7fd06000cc40 comp rx=0 tx=0).stop 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 shutdown_connections 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fd05406c8f0 0x7fd05406edb0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fd06815f720 0x7fd0680c99b0 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd06815f340 0x7fd0680c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 --2- 172.21.15.137:0/1278368130 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fd0680d4f00 0x7fd068159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.700+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 >> 172.21.15.137:0/1278368130 conn(0x7fd06808ec70 msgr2=0x7fd0680b5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.701+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 shutdown_connections 2024-04-26T22:08:22.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.701+0000 7fd06d533640 1 -- 172.21.15.137:0/1278368130 wait complete. 2024-04-26T22:08:22.711 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T22:08:22.712 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:08:22.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.813+0000 7eff7f946640 1 Processor -- start 2024-04-26T22:08:22.813 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.813+0000 7eff7f946640 1 -- start start 2024-04-26T22:08:22.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.814+0000 7eff7f946640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7eff780d2140 0x7eff780d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.814+0000 7eff7f946640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff780b6020 0x7eff780cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.814+0000 7eff7f946640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff780d33a0 con 0x7eff78162a10 2024-04-26T22:08:22.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.814+0000 7eff7f946640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7eff780b4970 con 0x7eff780b6020 2024-04-26T22:08:22.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.814+0000 7eff7f946640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7eff780d3680 con 0x7eff780d2140 2024-04-26T22:08:22.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.814+0000 7eff7dee3640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7eff780b6020 0x7eff780cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.814+0000 7eff7d6e2640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7eff78162a10 0x7eff780d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47488/0 (socket says 172.21.15.137:47488) 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.814+0000 7eff7d6e2640 1 -- 172.21.15.137:0/959678580 learned_addr learned my addr 172.21.15.137:0/959678580 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff7dee3640 1 -- 172.21.15.137:0/959678580 >> v2:172.21.15.170:3300/0 conn(0x7eff780d2140 msgr2=0x7eff780d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff7cee1640 1 --2- 172.21.15.137:0/959678580 >> v2:172.21.15.170:3300/0 conn(0x7eff780d2140 0x7eff780d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff7dee3640 1 --2- 172.21.15.137:0/959678580 >> v2:172.21.15.170:3300/0 conn(0x7eff780d2140 0x7eff780d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff7dee3640 1 -- 172.21.15.137:0/959678580 >> v1:172.21.15.137:6789/0 conn(0x7eff78162a10 legacy=0x7eff780d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff6ffff640 1 -- 172.21.15.137:0/959678580 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223824622 0 0) 0x7eff780d33a0 con 0x7eff78162a10 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff7dee3640 1 -- 172.21.15.137:0/959678580 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff780d3960 con 0x7eff780b6020 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff7dee3640 1 --2- 172.21.15.137:0/959678580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 0x7eff780cffb0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7eff7808f0b0 tx=0x7eff7002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eec81e556d85afd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff6ffff640 1 -- 172.21.15.137:0/959678580 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70037070 con 0x7eff780b6020 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff6ffff640 1 -- 172.21.15.137:0/959678580 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff70032440 con 0x7eff780b6020 2024-04-26T22:08:22.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.815+0000 7eff6ffff640 1 -- 172.21.15.137:0/959678580 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff70032810 con 0x7eff780b6020 2024-04-26T22:08:22.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.816+0000 7eff7f946640 1 -- 172.21.15.137:0/959678580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 msgr2=0x7eff780cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.816+0000 7eff7f946640 1 --2- 172.21.15.137:0/959678580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 0x7eff780cffb0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7eff7808f0b0 tx=0x7eff7002a1a0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.816+0000 7eff7f946640 1 -- 172.21.15.137:0/959678580 shutdown_connections 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.816+0000 7eff7f946640 1 --2- 172.21.15.137:0/959678580 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 0x7eff780cffb0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.816+0000 7eff7f946640 1 --2- 172.21.15.137:0/959678580 >> v2:172.21.15.170:3300/0 conn(0x7eff780d2140 0x7eff780d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.816+0000 7eff7f946640 1 -- 172.21.15.137:0/959678580 >> 172.21.15.137:0/959678580 conn(0x7eff7809e530 msgr2=0x7eff780d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.816+0000 7eff7f946640 1 -- 172.21.15.137:0/959678580 shutdown_connections 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.816+0000 7eff7f946640 1 -- 172.21.15.137:0/959678580 wait complete. 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.817+0000 7eff7f946640 1 Processor -- start 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.817+0000 7eff7f946640 1 -- start start 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7f946640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 0x7eff780d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7f946640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780d2140 0x7eff781506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7f946640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff78162a10 0x7eff780cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7f946640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7eff78162df0 con 0x7eff780b6020 2024-04-26T22:08:22.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7f946640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7eff780d3f20 con 0x7eff780d2140 2024-04-26T22:08:22.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7f946640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7eff780b6600 con 0x7eff78162a10 2024-04-26T22:08:22.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7d6e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 0x7eff780d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7d6e2640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 0x7eff780d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53910/0 (socket says 172.21.15.137:53910) 2024-04-26T22:08:22.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7d6e2640 1 -- 172.21.15.137:0/2385725574 learned_addr learned my addr 172.21.15.137:0/2385725574 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:22.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7cee1640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780d2140 0x7eff781506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7dee3640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff78162a10 0x7eff780cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.821 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7d6e2640 1 -- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff78162a10 msgr2=0x7eff780cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7d6e2640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7eff78162a10 0x7eff780cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7d6e2640 1 -- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780d2140 msgr2=0x7eff781506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7d6e2640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780d2140 0x7eff781506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7d6e2640 1 -- 172.21.15.137:0/2385725574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7815b1d0 con 0x7eff780b6020 2024-04-26T22:08:22.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7cee1640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff780d2140 0x7eff781506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:22.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff7d6e2640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 0x7eff780d08c0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c7f0 tx=0x7eff7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.818+0000 7eff6dffb640 1 -- 172.21.15.137:0/2385725574 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74018070 con 0x7eff780b6020 2024-04-26T22:08:22.822 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.819+0000 7eff6dffb640 1 -- 172.21.15.137:0/2385725574 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7400a640 con 0x7eff780b6020 2024-04-26T22:08:22.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.819+0000 7eff6dffb640 1 -- 172.21.15.137:0/2385725574 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7400aa30 con 0x7eff780b6020 2024-04-26T22:08:22.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.819+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff780cb810 con 0x7eff780b6020 2024-04-26T22:08:22.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.819+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff780d1180 con 0x7eff780b6020 2024-04-26T22:08:22.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.820+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff7806a290 con 0x7eff780b6020 2024-04-26T22:08:22.823 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.820+0000 7eff6dffb640 1 -- 172.21.15.137:0/2385725574 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff7401b070 con 0x7eff780b6020 2024-04-26T22:08:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.820+0000 7eff6dffb640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff5c06c8f0 0x7eff5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.820+0000 7eff6dffb640 1 -- 172.21.15.137:0/2385725574 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7eff7408af90 con 0x7eff780b6020 2024-04-26T22:08:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.820+0000 7eff7cee1640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff5c06c8f0 0x7eff5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.821+0000 7eff6dffb640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7eff5c0728f0 0x7eff5c074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.821+0000 7eff6dffb640 1 -- 172.21.15.137:0/2385725574 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff5c0753c0 con 0x7eff5c0728f0 2024-04-26T22:08:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.821+0000 7eff6dffb640 1 -- 172.21.15.137:0/2385725574 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7eff74092050 con 0x7eff780b6020 2024-04-26T22:08:22.824 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.821+0000 7eff7dee3640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7eff5c0728f0 0x7eff5c074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.821+0000 7eff7cee1640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff5c06c8f0 0x7eff5c06edb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7eff780caff0 tx=0x7eff68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.821+0000 7eff7dee3640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7eff5c0728f0 0x7eff5c074d10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.825 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.822+0000 7eff6dffb640 1 -- 172.21.15.137:0/2385725574 <== osd.5 v2:172.21.15.170:6808/205812566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff5c0753c0 con 0x7eff5c0728f0 2024-04-26T22:08:22.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.835+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 --> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7eff780d15d0 con 0x7eff5c0728f0 2024-04-26T22:08:22.835 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.835+0000 7eff6dffb640 1 -- 172.21.15.137:0/2385725574 <== osd.5 v2:172.21.15.170:6808/205812566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7eff780d15d0 con 0x7eff5c0728f0 2024-04-26T22:08:22.835 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:08:22.835 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:08:22.836 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:08:22.836 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7eff5c0728f0 msgr2=0x7eff5c074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.170:6808/205812566,v1:172.21.15.170:6809/205812566] conn(0x7eff5c0728f0 0x7eff5c074d10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff5c06c8f0 msgr2=0x7eff5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7eff5c06c8f0 0x7eff5c06edb0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7eff780caff0 tx=0x7eff68008040 comp rx=0 tx=0).stop 2024-04-26T22:08:22.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 msgr2=0x7eff780d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 --2- 172.21.15.137:0/2385725574 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7eff780b6020 0x7eff780d08c0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c7f0 tx=0x7eff7400ccb0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7dee3640 1 -- 172.21.15.137:0/2385725574 reap_dead start 2024-04-26T22:08:22.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 shutdown_connections 2024-04-26T22:08:22.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 >> 172.21.15.137:0/2385725574 conn(0x7eff7809e530 msgr2=0x7eff780b7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:22.837 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 shutdown_connections 2024-04-26T22:08:22.838 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.836+0000 7eff7f946640 1 -- 172.21.15.137:0/2385725574 wait complete. 2024-04-26T22:08:22.846 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T22:08:22.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.946+0000 7f3347620640 1 Processor -- start 2024-04-26T22:08:22.946 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.946+0000 7f3347620640 1 -- start start 2024-04-26T22:08:22.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3347620640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f33400b44e0 0x7f334006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3347620640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f334006d2b0 0x7f334006d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3347620640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33400b4a10 con 0x7f334015f1e0 2024-04-26T22:08:22.947 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3347620640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f334006dc60 con 0x7f334006d2b0 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3347620640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f334006eeb0 con 0x7f33400b44e0 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3345bbd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f334006d2b0 0x7f334006d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f33453bc640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f334015f1e0 0x7f33400ae8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47492/0 (socket says 172.21.15.137:47492) 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f33453bc640 1 -- 172.21.15.137:0/4231984738 learned_addr learned my addr 172.21.15.137:0/4231984738 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3345bbd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f334006d2b0 0x7f334006d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53912/0 (socket says 172.21.15.137:53912) 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3345bbd640 1 -- 172.21.15.137:0/4231984738 >> v2:172.21.15.170:3300/0 conn(0x7f33400b44e0 msgr2=0x7f334006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3345bbd640 1 --2- 172.21.15.137:0/4231984738 >> v2:172.21.15.170:3300/0 conn(0x7f33400b44e0 0x7f334006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3345bbd640 1 -- 172.21.15.137:0/4231984738 >> v1:172.21.15.137:6789/0 conn(0x7f334015f1e0 legacy=0x7f33400ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.947+0000 7f3337fff640 1 -- 172.21.15.137:0/4231984738 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551154233 0 0) 0x7f33400b4a10 con 0x7f334015f1e0 2024-04-26T22:08:22.948 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.948+0000 7f3345bbd640 1 -- 172.21.15.137:0/4231984738 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33400b4cf0 con 0x7f334006d2b0 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.948+0000 7f3345bbd640 1 --2- 172.21.15.137:0/4231984738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334006d2b0 0x7f334006d720 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f334006e5c0 tx=0x7f333802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e70f461f9d9c69 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.948+0000 7f3337fff640 1 -- 172.21.15.137:0/4231984738 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338007740 con 0x7f334006d2b0 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.948+0000 7f3337fff640 1 -- 172.21.15.137:0/4231984738 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33380078e0 con 0x7f334006d2b0 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.948+0000 7f3337fff640 1 -- 172.21.15.137:0/4231984738 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338007cb0 con 0x7f334006d2b0 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.949+0000 7f3347620640 1 -- 172.21.15.137:0/4231984738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334006d2b0 msgr2=0x7f334006d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.949+0000 7f3347620640 1 --2- 172.21.15.137:0/4231984738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334006d2b0 0x7f334006d720 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f334006e5c0 tx=0x7f333802a680 comp rx=0 tx=0).stop 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.949+0000 7f3347620640 1 -- 172.21.15.137:0/4231984738 shutdown_connections 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.949+0000 7f3347620640 1 --2- 172.21.15.137:0/4231984738 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334006d2b0 0x7f334006d720 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.949+0000 7f3347620640 1 --2- 172.21.15.137:0/4231984738 >> v2:172.21.15.170:3300/0 conn(0x7f33400b44e0 0x7f334006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.949+0000 7f3347620640 1 -- 172.21.15.137:0/4231984738 >> 172.21.15.137:0/4231984738 conn(0x7f33400728a0 msgr2=0x7f3340072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:22.950 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.949+0000 7f3347620640 1 -- 172.21.15.137:0/4231984738 shutdown_connections 2024-04-26T22:08:22.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.949+0000 7f3347620640 1 -- 172.21.15.137:0/4231984738 wait complete. 2024-04-26T22:08:22.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.950+0000 7f3347620640 1 Processor -- start 2024-04-26T22:08:22.951 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.950+0000 7f3347620640 1 -- start start 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3347620640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f334006d2b0 0x7f3340162280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3347620640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33400b44e0 0x7f33401581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3347620640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334015f1e0 0x7f3340158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3347620640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f33400b5590 con 0x7f334015f1e0 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3347620640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f33400b52b0 con 0x7f33400b44e0 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3347620640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f334015f5c0 con 0x7f334006d2b0 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3345bbd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334015f1e0 0x7f3340158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3345bbd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334015f1e0 0x7f3340158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53918/0 (socket says 172.21.15.137:53918) 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3345bbd640 1 -- 172.21.15.137:0/2511041327 learned_addr learned my addr 172.21.15.137:0/2511041327 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:22.954 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f33453bc640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f334006d2b0 0x7f3340162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3344bbb640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33400b44e0 0x7f33401581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3345bbd640 1 -- 172.21.15.137:0/2511041327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f334006d2b0 msgr2=0x7f3340162280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3345bbd640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f334006d2b0 0x7f3340162280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3345bbd640 1 -- 172.21.15.137:0/2511041327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33400b44e0 msgr2=0x7f33401581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3345bbd640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33400b44e0 0x7f33401581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3345bbd640 1 -- 172.21.15.137:0/2511041327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334015fb10 con 0x7f334015f1e0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3344bbb640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33400b44e0 0x7f33401581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.951+0000 7f3345bbd640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334015f1e0 0x7f3340158720 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f333802ac70 tx=0x7f3338004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.952+0000 7f3335ffb640 1 -- 172.21.15.137:0/2511041327 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338040070 con 0x7f334015f1e0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.952+0000 7f3335ffb640 1 -- 172.21.15.137:0/2511041327 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3338031c90 con 0x7f334015f1e0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.952+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3340143460 con 0x7f334015f1e0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.952+0000 7f3335ffb640 1 -- 172.21.15.137:0/2511041327 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338045680 con 0x7f334015f1e0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.952+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3340143a20 con 0x7f334015f1e0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.953+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33400d12b0 con 0x7f334015f1e0 2024-04-26T22:08:22.955 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.953+0000 7f3335ffb640 1 -- 172.21.15.137:0/2511041327 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3338039040 con 0x7f334015f1e0 2024-04-26T22:08:22.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.954+0000 7f3335ffb640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f332406c8f0 0x7f332406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:22.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.954+0000 7f3335ffb640 1 -- 172.21.15.137:0/2511041327 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f33380ad280 con 0x7f334015f1e0 2024-04-26T22:08:22.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.954+0000 7f33453bc640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f332406c8f0 0x7f332406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:22.956 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.954+0000 7f33453bc640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f332406c8f0 0x7f332406edb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f333c000f60 tx=0x7f333c007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:22.958 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:22.958+0000 7f3335ffb640 1 -- 172.21.15.137:0/2511041327 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f33400d12b0 con 0x7f334015f1e0 2024-04-26T22:08:23.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.131+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f33401627c0 con 0x7f332406c8f0 2024-04-26T22:08:23.131 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.131+0000 7f3335ffb640 1 -- 172.21.15.137:0/2511041327 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f33401627c0 con 0x7f332406c8f0 2024-04-26T22:08:23.131 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T22:08:23.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f332406c8f0 msgr2=0x7f332406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f332406c8f0 0x7f332406edb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f333c000f60 tx=0x7f333c007c00 comp rx=0 tx=0).stop 2024-04-26T22:08:23.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334015f1e0 msgr2=0x7f3340158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334015f1e0 0x7f3340158720 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f333802ac70 tx=0x7f3338004a40 comp rx=0 tx=0).stop 2024-04-26T22:08:23.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 shutdown_connections 2024-04-26T22:08:23.133 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f332406c8f0 0x7f332406edb0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f334015f1e0 0x7f3340158720 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f33400b44e0 0x7f33401581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 --2- 172.21.15.137:0/2511041327 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f334006d2b0 0x7f3340162280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 >> 172.21.15.137:0/2511041327 conn(0x7f33400728a0 msgr2=0x7f33401555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:23.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 shutdown_connections 2024-04-26T22:08:23.134 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.133+0000 7f3347620640 1 -- 172.21.15.137:0/2511041327 wait complete. 2024-04-26T22:08:23.144 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T22:08:23.144 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:08:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.244+0000 7f01cf9f7640 1 Processor -- start 2024-04-26T22:08:23.244 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.245+0000 7f01cf9f7640 1 -- start start 2024-04-26T22:08:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.245+0000 7f01cf9f7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f01c80d2140 0x7f01c80d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.245+0000 7f01cf9f7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f01c80b6020 0x7f01c80cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.245+0000 7f01cf9f7640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c80d33a0 con 0x7f01c8162a10 2024-04-26T22:08:23.246 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.245+0000 7f01cf9f7640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f01c80b4970 con 0x7f01c80b6020 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.245+0000 7f01cf9f7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f01c80d3680 con 0x7f01c80d2140 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.245+0000 7f01cdf94640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f01c80b6020 0x7f01c80cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.246+0000 7f01cd793640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f01c8162a10 0x7f01c80d1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47504/0 (socket says 172.21.15.137:47504) 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.246+0000 7f01cd793640 1 -- 172.21.15.137:0/2804437905 learned_addr learned my addr 172.21.15.137:0/2804437905 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.246+0000 7f01cdf94640 1 -- 172.21.15.137:0/2804437905 >> v2:172.21.15.170:3300/0 conn(0x7f01c80d2140 msgr2=0x7f01c80d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.246+0000 7f01ccf92640 1 --2- 172.21.15.137:0/2804437905 >> v2:172.21.15.170:3300/0 conn(0x7f01c80d2140 0x7f01c80d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.246+0000 7f01cdf94640 1 --2- 172.21.15.137:0/2804437905 >> v2:172.21.15.170:3300/0 conn(0x7f01c80d2140 0x7f01c80d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.246+0000 7f01bffff640 1 -- 172.21.15.137:0/2804437905 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470634929 0 0) 0x7f01c80d33a0 con 0x7f01c8162a10 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.246+0000 7f01cdf94640 1 -- 172.21.15.137:0/2804437905 >> v1:172.21.15.137:6789/0 conn(0x7f01c8162a10 legacy=0x7f01c80d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.246+0000 7f01cdf94640 1 -- 172.21.15.137:0/2804437905 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c80d3960 con 0x7f01c80b6020 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.246+0000 7f01cdf94640 1 --2- 172.21.15.137:0/2804437905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80b6020 0x7f01c80cffb0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f01c808f0b0 tx=0x7f01c002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7acdf426e3a49e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01bffff640 1 -- 172.21.15.137:0/2804437905 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c0007740 con 0x7f01c80b6020 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01bffff640 1 -- 172.21.15.137:0/2804437905 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c00078e0 con 0x7f01c80b6020 2024-04-26T22:08:23.247 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01bffff640 1 -- 172.21.15.137:0/2804437905 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c0007cb0 con 0x7f01c80b6020 2024-04-26T22:08:23.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01cf9f7640 1 -- 172.21.15.137:0/2804437905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80b6020 msgr2=0x7f01c80cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01cf9f7640 1 --2- 172.21.15.137:0/2804437905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80b6020 0x7f01c80cffb0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f01c808f0b0 tx=0x7f01c002a680 comp rx=0 tx=0).stop 2024-04-26T22:08:23.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01cf9f7640 1 -- 172.21.15.137:0/2804437905 shutdown_connections 2024-04-26T22:08:23.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01cf9f7640 1 --2- 172.21.15.137:0/2804437905 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80b6020 0x7f01c80cffb0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01cf9f7640 1 --2- 172.21.15.137:0/2804437905 >> v2:172.21.15.170:3300/0 conn(0x7f01c80d2140 0x7f01c80d2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.250 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01cf9f7640 1 -- 172.21.15.137:0/2804437905 >> 172.21.15.137:0/2804437905 conn(0x7f01c809e530 msgr2=0x7f01c80d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01cf9f7640 1 -- 172.21.15.137:0/2804437905 shutdown_connections 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.247+0000 7f01cf9f7640 1 -- 172.21.15.137:0/2804437905 wait complete. 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.248+0000 7f01cf9f7640 1 Processor -- start 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.248+0000 7f01cf9f7640 1 -- start start 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01cf9f7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c80b6020 0x7f01c815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01cf9f7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80d2140 0x7f01c81e8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01cf9f7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01c8162a10 0x7f01c80b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01cf9f7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8162df0 con 0x7f01c80d2140 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01cf9f7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f01c80d3f20 con 0x7f01c80b6020 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01cf9f7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f01c80b6600 con 0x7f01c8162a10 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01ccf92640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80d2140 0x7f01c81e8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01ccf92640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80d2140 0x7f01c81e8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53940/0 (socket says 172.21.15.137:53940) 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01ccf92640 1 -- 172.21.15.137:0/602115463 learned_addr learned my addr 172.21.15.137:0/602115463 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:23.251 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.249+0000 7f01cd793640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c80b6020 0x7f01c815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01cdf94640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01c8162a10 0x7f01c80b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01ccf92640 1 -- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01c8162a10 msgr2=0x7f01c80b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01ccf92640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f01c8162a10 0x7f01c80b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01ccf92640 1 -- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c80b6020 msgr2=0x7f01c815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01ccf92640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c80b6020 0x7f01c815ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01ccf92640 1 -- 172.21.15.137:0/602115463 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c81e9730 con 0x7f01c80d2140 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01cd793640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01c80b6020 0x7f01c815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01ccf92640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80d2140 0x7f01c81e8ee0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f01b800c7f0 tx=0x7f01b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01bdffb640 1 -- 172.21.15.137:0/602115463 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8015070 con 0x7f01c80d2140 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01bdffb640 1 -- 172.21.15.137:0/602115463 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b8004240 con 0x7f01c80d2140 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01bdffb640 1 -- 172.21.15.137:0/602115463 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8007620 con 0x7f01c80d2140 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c81e9cf0 con 0x7f01c80d2140 2024-04-26T22:08:23.252 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.250+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c81ea2b0 con 0x7f01c80d2140 2024-04-26T22:08:23.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.251+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01c81e9480 con 0x7f01c80d2140 2024-04-26T22:08:23.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.251+0000 7f01bdffb640 1 -- 172.21.15.137:0/602115463 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01b80079d0 con 0x7f01c80d2140 2024-04-26T22:08:23.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.252+0000 7f01bdffb640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f01ac06c8f0 0x7f01ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.252+0000 7f01bdffb640 1 -- 172.21.15.137:0/602115463 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f01b808bd90 con 0x7f01c80d2140 2024-04-26T22:08:23.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.252+0000 7f01cd793640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f01ac06c8f0 0x7f01ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.252+0000 7f01bdffb640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f01ac0728f0 0x7f01ac074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.252+0000 7f01bdffb640 1 -- 172.21.15.137:0/602115463 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01ac0753c0 con 0x7f01ac0728f0 2024-04-26T22:08:23.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.252+0000 7f01bdffb640 1 -- 172.21.15.137:0/602115463 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f01b808e490 con 0x7f01c80d2140 2024-04-26T22:08:23.254 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.252+0000 7f01cd793640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f01ac06c8f0 0x7f01ac06edb0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f01c4000f60 tx=0x7f01c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.252+0000 7f01cdf94640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f01ac0728f0 0x7f01ac074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.253+0000 7f01cdf94640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f01ac0728f0 0x7f01ac074d10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.255 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.253+0000 7f01bdffb640 1 -- 172.21.15.137:0/602115463 <== osd.6 v2:172.21.15.170:6800/3855301024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01ac0753c0 con 0x7f01ac0728f0 2024-04-26T22:08:23.266 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.266+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 --> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f01c806a290 con 0x7f01ac0728f0 2024-04-26T22:08:23.267 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.267+0000 7f01bdffb640 1 -- 172.21.15.137:0/602115463 <== osd.6 v2:172.21.15.170:6800/3855301024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f01c806a290 con 0x7f01ac0728f0 2024-04-26T22:08:23.267 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:08:23.267 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:08:23.267 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:08:23.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.267+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f01ac0728f0 msgr2=0x7f01ac074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.267+0000 7f01cf9f7640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.170:6800/3855301024,v1:172.21.15.170:6801/3855301024] conn(0x7f01ac0728f0 0x7f01ac074d10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.268+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f01ac06c8f0 msgr2=0x7f01ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.268+0000 7f01cf9f7640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f01ac06c8f0 0x7f01ac06edb0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f01c4000f60 tx=0x7f01c4009040 comp rx=0 tx=0).stop 2024-04-26T22:08:23.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.268+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80d2140 msgr2=0x7f01c81e8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.268+0000 7f01cf9f7640 1 --2- 172.21.15.137:0/602115463 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f01c80d2140 0x7f01c81e8ee0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f01b800c7f0 tx=0x7f01b800ccb0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.268+0000 7f01cdf94640 1 -- 172.21.15.137:0/602115463 reap_dead start 2024-04-26T22:08:23.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.268+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 shutdown_connections 2024-04-26T22:08:23.268 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.268+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 >> 172.21.15.137:0/602115463 conn(0x7f01c809e530 msgr2=0x7f01c80b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:23.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.268+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 shutdown_connections 2024-04-26T22:08:23.269 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.268+0000 7f01cf9f7640 1 -- 172.21.15.137:0/602115463 wait complete. 2024-04-26T22:08:23.278 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.376+0000 7fb8de1e7640 1 Processor -- start 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.376+0000 7fb8de1e7640 1 -- start start 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8de1e7640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb8d815f1e0 0x7fb8d806e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8de1e7640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb8d80b44e0 0x7fb8d80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8de1e7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d80b4a10 con 0x7fb8d806d2b0 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8de1e7640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d806eeb0 con 0x7fb8d815f1e0 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8de1e7640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d80b4cf0 con 0x7fb8d80b44e0 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8d77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb8d815f1e0 0x7fb8d806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8d77fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fb8d815f1e0 0x7fb8d806e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53956/0 (socket says 172.21.15.137:53956) 2024-04-26T22:08:23.379 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8d77fe640 1 -- 172.21.15.137:0/1645637619 learned_addr learned my addr 172.21.15.137:0/1645637619 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8d6ffd640 1 --2- 172.21.15.137:0/1645637619 >> v2:172.21.15.170:3300/0 conn(0x7fb8d80b44e0 0x7fb8d80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8d77fe640 1 -- 172.21.15.137:0/1645637619 >> v2:172.21.15.170:3300/0 conn(0x7fb8d80b44e0 msgr2=0x7fb8d80ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8d77fe640 1 --2- 172.21.15.137:0/1645637619 >> v2:172.21.15.170:3300/0 conn(0x7fb8d80b44e0 0x7fb8d80ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8d77fe640 1 -- 172.21.15.137:0/1645637619 >> v1:172.21.15.170:6789/0 conn(0x7fb8d806d2b0 legacy=0x7fb8d80b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8d77fe640 1 -- 172.21.15.137:0/1645637619 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d80b4fd0 con 0x7fb8d815f1e0 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.377+0000 7fb8d6ffd640 1 --2- 172.21.15.137:0/1645637619 >> v2:172.21.15.170:3300/0 conn(0x7fb8d80b44e0 0x7fb8d80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.378+0000 7fb8d77fe640 1 --2- 172.21.15.137:0/1645637619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d815f1e0 0x7fb8d806e970 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fb8d806e5c0 tx=0x7fb8c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64b7226cd3cc30c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.378+0000 7fb8d67fc640 1 -- 172.21.15.137:0/1645637619 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8037070 con 0x7fb8d815f1e0 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.378+0000 7fb8d67fc640 1 -- 172.21.15.137:0/1645637619 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c8032440 con 0x7fb8d815f1e0 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.378+0000 7fb8d67fc640 1 -- 172.21.15.137:0/1645637619 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8032810 con 0x7fb8d815f1e0 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.379+0000 7fb8de1e7640 1 -- 172.21.15.137:0/1645637619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d815f1e0 msgr2=0x7fb8d806e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.379+0000 7fb8de1e7640 1 --2- 172.21.15.137:0/1645637619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d815f1e0 0x7fb8d806e970 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7fb8d806e5c0 tx=0x7fb8c802a270 comp rx=0 tx=0).stop 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.379+0000 7fb8de1e7640 1 -- 172.21.15.137:0/1645637619 shutdown_connections 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.379+0000 7fb8de1e7640 1 --2- 172.21.15.137:0/1645637619 >> v2:172.21.15.170:3300/0 conn(0x7fb8d80b44e0 0x7fb8d80ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.380 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.379+0000 7fb8de1e7640 1 --2- 172.21.15.137:0/1645637619 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d815f1e0 0x7fb8d806e970 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.379+0000 7fb8de1e7640 1 -- 172.21.15.137:0/1645637619 >> 172.21.15.137:0/1645637619 conn(0x7fb8d80728a0 msgr2=0x7fb8d8072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.379+0000 7fb8de1e7640 1 -- 172.21.15.137:0/1645637619 shutdown_connections 2024-04-26T22:08:23.381 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.379+0000 7fb8de1e7640 1 -- 172.21.15.137:0/1645637619 wait complete. 2024-04-26T22:08:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.380+0000 7fb8de1e7640 1 Processor -- start 2024-04-26T22:08:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.380+0000 7fb8de1e7640 1 -- start start 2024-04-26T22:08:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8de1e7640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d806d2b0 0x7fb8d81f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8de1e7640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8d80b44e0 0x7fb8d8161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8de1e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8d815f1e0 0x7fb8d814a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.383 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8de1e7640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80aedf0 con 0x7fb8d806d2b0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8de1e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d80b5590 con 0x7fb8d815f1e0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8de1e7640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fb8d815f5c0 con 0x7fb8d80b44e0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d806d2b0 0x7fb8d81f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d77fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d806d2b0 0x7fb8d81f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53972/0 (socket says 172.21.15.137:53972) 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d77fe640 1 -- 172.21.15.137:0/3885982677 learned_addr learned my addr 172.21.15.137:0/3885982677 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d7fff640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8d815f1e0 0x7fb8d814a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d6ffd640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8d80b44e0 0x7fb8d8161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d77fe640 1 -- 172.21.15.137:0/3885982677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8d80b44e0 msgr2=0x7fb8d8161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d77fe640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8d80b44e0 0x7fb8d8161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d77fe640 1 -- 172.21.15.137:0/3885982677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8d815f1e0 msgr2=0x7fb8d814a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d77fe640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8d815f1e0 0x7fb8d814a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d77fe640 1 -- 172.21.15.137:0/3885982677 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d815b260 con 0x7fb8d806d2b0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8d77fe640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d806d2b0 0x7fb8d81f4c30 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fb8c802a2b0 tx=0x7fb8c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8bffff640 1 -- 172.21.15.137:0/3885982677 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8041020 con 0x7fb8d806d2b0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8bffff640 1 -- 172.21.15.137:0/3885982677 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c80306c0 con 0x7fb8d806d2b0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8bffff640 1 -- 172.21.15.137:0/3885982677 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8037040 con 0x7fb8d806d2b0 2024-04-26T22:08:23.384 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d815b540 con 0x7fb8d806d2b0 2024-04-26T22:08:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.381+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d815bb00 con 0x7fb8d806d2b0 2024-04-26T22:08:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.382+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d806a290 con 0x7fb8d806d2b0 2024-04-26T22:08:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.383+0000 7fb8bffff640 1 -- 172.21.15.137:0/3885982677 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8c8044020 con 0x7fb8d806d2b0 2024-04-26T22:08:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.383+0000 7fb8bffff640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c406c8f0 0x7fb8c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.383+0000 7fb8bffff640 1 -- 172.21.15.137:0/3885982677 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7fb8c80ac150 con 0x7fb8d806d2b0 2024-04-26T22:08:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.383+0000 7fb8d6ffd640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c406c8f0 0x7fb8c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.385 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.384+0000 7fb8d6ffd640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c406c8f0 0x7fb8c406edb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8070d60 tx=0x7fb8cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.387 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.387+0000 7fb8bffff640 1 -- 172.21.15.137:0/3885982677 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fb8c804b030 con 0x7fb8d806d2b0 2024-04-26T22:08:23.563 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.563+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb8d81557f0 con 0x7fb8c406c8f0 2024-04-26T22:08:23.564 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.564+0000 7fb8bffff640 1 -- 172.21.15.137:0/3885982677 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb8d81557f0 con 0x7fb8c406c8f0 2024-04-26T22:08:23.564 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T22:08:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c406c8f0 msgr2=0x7fb8c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c406c8f0 0x7fb8c406edb0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8070d60 tx=0x7fb8cc008040 comp rx=0 tx=0).stop 2024-04-26T22:08:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d806d2b0 msgr2=0x7fb8d81f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d806d2b0 0x7fb8d81f4c30 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fb8c802a2b0 tx=0x7fb8c80046c0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 shutdown_connections 2024-04-26T22:08:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fb8c406c8f0 0x7fb8c406edb0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8d815f1e0 0x7fb8d814a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fb8d80b44e0 0x7fb8d8161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.566 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 --2- 172.21.15.137:0/3885982677 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fb8d806d2b0 0x7fb8d81f4c30 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 >> 172.21.15.137:0/3885982677 conn(0x7fb8d80728a0 msgr2=0x7fb8d806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:23.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 shutdown_connections 2024-04-26T22:08:23.567 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.566+0000 7fb8de1e7640 1 -- 172.21.15.137:0/3885982677 wait complete. 2024-04-26T22:08:23.577 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T22:08:23.577 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T22:08:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.678+0000 7f95ed511640 1 Processor -- start 2024-04-26T22:08:23.678 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.678+0000 7f95ed511640 1 -- start start 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95ed511640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f95e80d2140 0x7f95e80d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95ed511640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95e80b6020 0x7f95e80cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95ed511640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e80d33a0 con 0x7f95e8162a10 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95ed511640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7f95e80b4970 con 0x7f95e80d2140 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95ed511640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95e80d3680 con 0x7f95e80b6020 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95e67fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f95e80d2140 0x7f95e80d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95e67fc640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7f95e80d2140 0x7f95e80d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:53986/0 (socket says 172.21.15.137:53986) 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95e67fc640 1 -- 172.21.15.137:0/2427915988 learned_addr learned my addr 172.21.15.137:0/2427915988 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95e77fe640 1 --2- 172.21.15.137:0/2427915988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95e80b6020 0x7f95e80cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95e67fc640 1 -- 172.21.15.137:0/2427915988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95e80b6020 msgr2=0x7f95e80cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95e67fc640 1 --2- 172.21.15.137:0/2427915988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95e80b6020 0x7f95e80cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.680 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95e67fc640 1 -- 172.21.15.137:0/2427915988 >> v1:172.21.15.170:6789/0 conn(0x7f95e8162a10 legacy=0x7f95e80d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.679+0000 7f95e67fc640 1 -- 172.21.15.137:0/2427915988 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e80d3960 con 0x7f95e80d2140 2024-04-26T22:08:23.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.680+0000 7f95e67fc640 1 --2- 172.21.15.137:0/2427915988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 0x7f95e80d2dc0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009870 tx=0x7f95dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e23957a4beb9f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.680+0000 7f95e5ffb640 1 -- 172.21.15.137:0/2427915988 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc037070 con 0x7f95e80d2140 2024-04-26T22:08:23.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.680+0000 7f95e5ffb640 1 -- 172.21.15.137:0/2427915988 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc032440 con 0x7f95e80d2140 2024-04-26T22:08:23.681 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.680+0000 7f95e5ffb640 1 -- 172.21.15.137:0/2427915988 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc032810 con 0x7f95e80d2140 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.680+0000 7f95ed511640 1 -- 172.21.15.137:0/2427915988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 msgr2=0x7f95e80d2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.680+0000 7f95ed511640 1 --2- 172.21.15.137:0/2427915988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 0x7f95e80d2dc0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009870 tx=0x7f95dc02a270 comp rx=0 tx=0).stop 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.681+0000 7f95ed511640 1 -- 172.21.15.137:0/2427915988 shutdown_connections 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.681+0000 7f95ed511640 1 --2- 172.21.15.137:0/2427915988 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95e80b6020 0x7f95e80cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.681+0000 7f95ed511640 1 --2- 172.21.15.137:0/2427915988 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 0x7f95e80d2dc0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.681+0000 7f95ed511640 1 -- 172.21.15.137:0/2427915988 >> 172.21.15.137:0/2427915988 conn(0x7f95e809e530 msgr2=0x7f95e80d51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.681+0000 7f95ed511640 1 -- 172.21.15.137:0/2427915988 shutdown_connections 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.681+0000 7f95ed511640 1 -- 172.21.15.137:0/2427915988 wait complete. 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.682+0000 7f95ed511640 1 Processor -- start 2024-04-26T22:08:23.684 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.682+0000 7f95ed511640 1 -- start start 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95ed511640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95e80b6020 0x7f95e80b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95ed511640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 0x7f95e80b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95ed511640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95e8162a10 0x7f95e80cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95ed511640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f95e8162df0 con 0x7f95e80d2140 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95ed511640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80d3f20 con 0x7f95e8162a10 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95ed511640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f95e80b6600 con 0x7f95e80b6020 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 0x7f95e80b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e67fc640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 0x7f95e80b8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54000/0 (socket says 172.21.15.137:54000) 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e67fc640 1 -- 172.21.15.137:0/1807280349 learned_addr learned my addr 172.21.15.137:0/1807280349 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e77fe640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95e8162a10 0x7f95e80cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e6ffd640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95e80b6020 0x7f95e80b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e67fc640 1 -- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95e80b6020 msgr2=0x7f95e80b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e67fc640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f95e80b6020 0x7f95e80b83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.685 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e67fc640 1 -- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95e8162a10 msgr2=0x7f95e80cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e67fc640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95e8162a10 0x7f95e80cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e67fc640 1 -- 172.21.15.137:0/1807280349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e80b9630 con 0x7f95e80d2140 2024-04-26T22:08:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95e67fc640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 0x7f95e80b8c20 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f95dc000c00 tx=0x7f95dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95cf7fe640 1 -- 172.21.15.137:0/1807280349 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc041020 con 0x7f95e80d2140 2024-04-26T22:08:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95cf7fe640 1 -- 172.21.15.137:0/1807280349 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95dc0306c0 con 0x7f95e80d2140 2024-04-26T22:08:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e81f8e30 con 0x7f95e80d2140 2024-04-26T22:08:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95cf7fe640 1 -- 172.21.15.137:0/1807280349 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc037040 con 0x7f95e80d2140 2024-04-26T22:08:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.683+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e8153e90 con 0x7f95e80d2140 2024-04-26T22:08:23.686 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.684+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95e80b88f0 con 0x7f95e80d2140 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.685+0000 7f95cf7fe640 1 -- 172.21.15.137:0/1807280349 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95dc044020 con 0x7f95e80d2140 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.685+0000 7f95cf7fe640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95d406c8f0 0x7f95d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.685+0000 7f95cf7fe640 1 -- 172.21.15.137:0/1807280349 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f95dc0ac110 con 0x7f95e80d2140 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.685+0000 7f95e6ffd640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95d406c8f0 0x7f95d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.685+0000 7f95cf7fe640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7f95d40728f0 0x7f95d4074d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.685+0000 7f95cf7fe640 1 -- 172.21.15.137:0/1807280349 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95dc035e70 con 0x7f95d40728f0 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.685+0000 7f95cf7fe640 1 -- 172.21.15.137:0/1807280349 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f95dc0b3050 con 0x7f95e80d2140 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.686+0000 7f95e77fe640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7f95d40728f0 0x7f95d4074d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.686+0000 7f95e6ffd640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95d406c8f0 0x7f95d406edb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f95d8001640 tx=0x7f95d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.686+0000 7f95e77fe640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7f95d40728f0 0x7f95d4074d10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.688 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.687+0000 7f95cf7fe640 1 -- 172.21.15.137:0/1807280349 <== osd.7 v2:172.21.15.170:6816/3085321649 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95dc035e70 con 0x7f95d40728f0 2024-04-26T22:08:23.699 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.700+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 --> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f95e806a290 con 0x7f95d40728f0 2024-04-26T22:08:23.700 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.700+0000 7f95cf7fe640 1 -- 172.21.15.137:0/1807280349 <== osd.7 v2:172.21.15.170:6816/3085321649 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f95e806a290 con 0x7f95d40728f0 2024-04-26T22:08:23.700 INFO:teuthology.orchestra.run.smithi137.stdout:{ 2024-04-26T22:08:23.700 INFO:teuthology.orchestra.run.smithi137.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T22:08:23.700 INFO:teuthology.orchestra.run.smithi137.stdout:} 2024-04-26T22:08:23.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.700+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7f95d40728f0 msgr2=0x7f95d4074d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.700+0000 7f95ed511640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.170:6816/3085321649,v1:172.21.15.170:6817/3085321649] conn(0x7f95d40728f0 0x7f95d4074d10 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.701+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95d406c8f0 msgr2=0x7f95d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.701+0000 7f95ed511640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f95d406c8f0 0x7f95d406edb0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f95d8001640 tx=0x7f95d8009040 comp rx=0 tx=0).stop 2024-04-26T22:08:23.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.701+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 msgr2=0x7f95e80b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.701 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.701+0000 7f95ed511640 1 --2- 172.21.15.137:0/1807280349 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f95e80d2140 0x7f95e80b8c20 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f95dc000c00 tx=0x7f95dc0046c0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.701+0000 7f95e77fe640 1 -- 172.21.15.137:0/1807280349 reap_dead start 2024-04-26T22:08:23.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.701+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 shutdown_connections 2024-04-26T22:08:23.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.701+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 >> 172.21.15.137:0/1807280349 conn(0x7f95e809e530 msgr2=0x7f95e80d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:23.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.701+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 shutdown_connections 2024-04-26T22:08:23.702 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.701+0000 7f95ed511640 1 -- 172.21.15.137:0/1807280349 wait complete. 2024-04-26T22:08:23.711 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T22:08:23.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.809+0000 7fc276124640 1 Processor -- start 2024-04-26T22:08:23.809 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.809+0000 7fc276124640 1 -- start start 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc276124640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc27015f1e0 0x7fc27006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc276124640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2700b44e0 0x7fc2700ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc276124640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27006d2b0 0x7fc27006d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc276124640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fc27006eeb0 con 0x7fc2700b44e0 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc276124640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fc2700b4a10 con 0x7fc27015f1e0 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc276124640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc2700b4cf0 con 0x7fc27006d2b0 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26effd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2700b44e0 0x7fc2700ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26effd640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fc2700b44e0 0x7fc2700ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54006/0 (socket says 172.21.15.137:54006) 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26effd640 1 -- 172.21.15.137:0/3139450962 learned_addr learned my addr 172.21.15.137:0/3139450962 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:23.811 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26f7fe640 1 --2- 172.21.15.137:0/3139450962 >> v2:172.21.15.170:3300/0 conn(0x7fc27015f1e0 0x7fc27006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26ffff640 1 --2- 172.21.15.137:0/3139450962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27006d2b0 0x7fc27006d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26effd640 1 -- 172.21.15.137:0/3139450962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27006d2b0 msgr2=0x7fc27006d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26effd640 1 --2- 172.21.15.137:0/3139450962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27006d2b0 0x7fc27006d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26effd640 1 -- 172.21.15.137:0/3139450962 >> v2:172.21.15.170:3300/0 conn(0x7fc27015f1e0 msgr2=0x7fc27006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26effd640 1 --2- 172.21.15.137:0/3139450962 >> v2:172.21.15.170:3300/0 conn(0x7fc27015f1e0 0x7fc27006e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.810+0000 7fc26effd640 1 -- 172.21.15.137:0/3139450962 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2700b4fd0 con 0x7fc2700b44e0 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.811+0000 7fc26effd640 1 --2- 172.21.15.137:0/3139450962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 0x7fc2700ae8b0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fc27006e610 tx=0x7fc26402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3b875a5f7a3756 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.811+0000 7fc26e7fc640 1 -- 172.21.15.137:0/3139450962 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264037070 con 0x7fc2700b44e0 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.811+0000 7fc26e7fc640 1 -- 172.21.15.137:0/3139450962 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc264032440 con 0x7fc2700b44e0 2024-04-26T22:08:23.812 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.811+0000 7fc26e7fc640 1 -- 172.21.15.137:0/3139450962 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264032810 con 0x7fc2700b44e0 2024-04-26T22:08:23.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.812+0000 7fc276124640 1 -- 172.21.15.137:0/3139450962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 msgr2=0x7fc2700ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.812+0000 7fc276124640 1 --2- 172.21.15.137:0/3139450962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 0x7fc2700ae8b0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fc27006e610 tx=0x7fc26402a1e0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.812+0000 7fc276124640 1 -- 172.21.15.137:0/3139450962 shutdown_connections 2024-04-26T22:08:23.815 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.812+0000 7fc276124640 1 --2- 172.21.15.137:0/3139450962 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27006d2b0 0x7fc27006d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.812+0000 7fc276124640 1 --2- 172.21.15.137:0/3139450962 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 0x7fc2700ae8b0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.812+0000 7fc276124640 1 --2- 172.21.15.137:0/3139450962 >> v2:172.21.15.170:3300/0 conn(0x7fc27015f1e0 0x7fc27006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.812+0000 7fc276124640 1 -- 172.21.15.137:0/3139450962 >> 172.21.15.137:0/3139450962 conn(0x7fc2700728a0 msgr2=0x7fc270072cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.812+0000 7fc276124640 1 -- 172.21.15.137:0/3139450962 shutdown_connections 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.812+0000 7fc276124640 1 -- 172.21.15.137:0/3139450962 wait complete. 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.813+0000 7fc276124640 1 Processor -- start 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.813+0000 7fc276124640 1 -- start start 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc276124640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc27006d2b0 0x7fc270160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc276124640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 0x7fc27006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc276124640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27015f1e0 0x7fc270157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc276124640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fc2700aedf0 con 0x7fc2700b44e0 2024-04-26T22:08:23.816 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc276124640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fc2700b5590 con 0x7fc27006d2b0 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc276124640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fc27015f5c0 con 0x7fc27015f1e0 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 0x7fc27006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26effd640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 0x7fc27006c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54022/0 (socket says 172.21.15.137:54022) 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26effd640 1 -- 172.21.15.137:0/1267558994 learned_addr learned my addr 172.21.15.137:0/1267558994 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26f7fe640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc27006d2b0 0x7fc270160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26ffff640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27015f1e0 0x7fc270157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26effd640 1 -- 172.21.15.137:0/1267558994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27015f1e0 msgr2=0x7fc270157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26effd640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27015f1e0 0x7fc270157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26effd640 1 -- 172.21.15.137:0/1267558994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc27006d2b0 msgr2=0x7fc270160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26effd640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc27006d2b0 0x7fc270160670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26effd640 1 -- 172.21.15.137:0/1267558994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc270160bb0 con 0x7fc2700b44e0 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc26effd640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 0x7fc27006c510 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fc26402a220 tx=0x7fc2640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.814+0000 7fc257fff640 1 -- 172.21.15.137:0/1267558994 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264037040 con 0x7fc2700b44e0 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.815+0000 7fc257fff640 1 -- 172.21.15.137:0/1267558994 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc264042070 con 0x7fc2700b44e0 2024-04-26T22:08:23.817 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.815+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2701589f0 con 0x7fc2700b44e0 2024-04-26T22:08:23.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.815+0000 7fc257fff640 1 -- 172.21.15.137:0/1267558994 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264030bb0 con 0x7fc2700b44e0 2024-04-26T22:08:23.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.815+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27015fb90 con 0x7fc2700b44e0 2024-04-26T22:08:23.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.816+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27006a290 con 0x7fc2700b44e0 2024-04-26T22:08:23.818 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.816+0000 7fc257fff640 1 -- 172.21.15.137:0/1267558994 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc264047460 con 0x7fc2700b44e0 2024-04-26T22:08:23.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.816+0000 7fc257fff640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc25c06c8f0 0x7fc25c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:23.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.816+0000 7fc257fff640 1 -- 172.21.15.137:0/1267558994 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7fc2640ac350 con 0x7fc2700b44e0 2024-04-26T22:08:23.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.816+0000 7fc26f7fe640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc25c06c8f0 0x7fc25c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:23.819 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.817+0000 7fc26f7fe640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc25c06c8f0 0x7fc25c06edb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc27015c780 tx=0x7fc260008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:23.820 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.821+0000 7fc257fff640 1 -- 172.21.15.137:0/1267558994 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fc26407a410 con 0x7fc2700b44e0 2024-04-26T22:08:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.998+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc270073710 con 0x7fc25c06c8f0 2024-04-26T22:08:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:23.998+0000 7fc257fff640 1 -- 172.21.15.137:0/1267558994 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc260004020 con 0x7fc25c06c8f0 2024-04-26T22:08:23.999 INFO:teuthology.orchestra.run.smithi137.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T22:08:24.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc25c06c8f0 msgr2=0x7fc25c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:24.000 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc25c06c8f0 0x7fc25c06edb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc27015c780 tx=0x7fc260008040 comp rx=0 tx=0).stop 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 msgr2=0x7fc27006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 0x7fc27006c510 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fc26402a220 tx=0x7fc2640046c0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 shutdown_connections 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fc25c06c8f0 0x7fc25c06edb0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fc2700b44e0 0x7fc27006c510 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fc27015f1e0 0x7fc270157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 --2- 172.21.15.137:0/1267558994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc27006d2b0 0x7fc270160670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 >> 172.21.15.137:0/1267558994 conn(0x7fc2700728a0 msgr2=0x7fc270153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 shutdown_connections 2024-04-26T22:08:24.001 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.000+0000 7fc276124640 1 -- 172.21.15.137:0/1267558994 wait complete. 2024-04-26T22:08:24.011 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:08:24.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.108+0000 7fa179eb0640 1 Processor -- start 2024-04-26T22:08:24.108 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.108+0000 7fa179eb0640 1 -- start start 2024-04-26T22:08:24.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.108+0000 7fa179eb0640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa17415f370 0x7fa1740cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:24.109 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa179eb0640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa1740d3ee0 0x7fa1740b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa179eb0640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1740d03a0 con 0x7fa17415f750 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa179eb0640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fa1740b4d10 con 0x7fa17415f370 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa179eb0640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fa1740d0680 con 0x7fa1740d3ee0 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa1737fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa17415f370 0x7fa1740cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa16bfff640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fa17415f750 0x7fa1740d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:47518/0 (socket says 172.21.15.137:47518) 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa1737fe640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fa17415f370 0x7fa1740cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54024/0 (socket says 172.21.15.137:54024) 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa16bfff640 1 -- 172.21.15.137:0/2645553131 learned_addr learned my addr 172.21.15.137:0/2645553131 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa173fff640 1 --2- 172.21.15.137:0/2645553131 >> v2:172.21.15.170:3300/0 conn(0x7fa1740d3ee0 0x7fa1740b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa1737fe640 1 -- 172.21.15.137:0/2645553131 >> v2:172.21.15.170:3300/0 conn(0x7fa1740d3ee0 msgr2=0x7fa1740b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa1737fe640 1 --2- 172.21.15.137:0/2645553131 >> v2:172.21.15.170:3300/0 conn(0x7fa1740d3ee0 0x7fa1740b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa1737fe640 1 -- 172.21.15.137:0/2645553131 >> v1:172.21.15.137:6789/0 conn(0x7fa17415f750 legacy=0x7fa1740d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.109+0000 7fa1737fe640 1 -- 172.21.15.137:0/2645553131 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1740d0960 con 0x7fa17415f370 2024-04-26T22:08:24.110 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa1737fe640 1 --2- 172.21.15.137:0/2645553131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f370 0x7fa1740cfd70 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fa1740c8cf0 tx=0x7fa16402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93752763932f2df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:24.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa172ffd640 1 -- 172.21.15.137:0/2645553131 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164037070 con 0x7fa17415f370 2024-04-26T22:08:24.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa172ffd640 1 -- 172.21.15.137:0/2645553131 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa16402ad30 con 0x7fa17415f370 2024-04-26T22:08:24.111 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa172ffd640 1 -- 172.21.15.137:0/2645553131 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164032660 con 0x7fa17415f370 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa179eb0640 1 -- 172.21.15.137:0/2645553131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f370 msgr2=0x7fa1740cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa179eb0640 1 --2- 172.21.15.137:0/2645553131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f370 0x7fa1740cfd70 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fa1740c8cf0 tx=0x7fa16402a0a0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa179eb0640 1 -- 172.21.15.137:0/2645553131 shutdown_connections 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa179eb0640 1 --2- 172.21.15.137:0/2645553131 >> v2:172.21.15.170:3300/0 conn(0x7fa1740d3ee0 0x7fa1740b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa179eb0640 1 --2- 172.21.15.137:0/2645553131 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f370 0x7fa1740cfd70 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.110+0000 7fa179eb0640 1 -- 172.21.15.137:0/2645553131 >> 172.21.15.137:0/2645553131 conn(0x7fa17408ec10 msgr2=0x7fa17409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.111+0000 7fa179eb0640 1 -- 172.21.15.137:0/2645553131 shutdown_connections 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.111+0000 7fa179eb0640 1 -- 172.21.15.137:0/2645553131 wait complete. 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa179eb0640 1 Processor -- start 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa179eb0640 1 -- start start 2024-04-26T22:08:24.114 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa179eb0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1740d3ee0 0x7fa1740b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa179eb0640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa17415f370 0x7fa17409e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa179eb0640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f750 0x7fa1741f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa179eb0640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fa1740b51c0 con 0x7fa17415f750 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa179eb0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fa1740d0f20 con 0x7fa1740d3ee0 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa179eb0640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fa1740b5340 con 0x7fa17415f370 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa173fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f750 0x7fa1741f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa173fff640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f750 0x7fa1741f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:54028/0 (socket says 172.21.15.137:54028) 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.112+0000 7fa173fff640 1 -- 172.21.15.137:0/3053986551 learned_addr learned my addr 172.21.15.137:0/3053986551 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa16bfff640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa17415f370 0x7fa17409e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa1737fe640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1740d3ee0 0x7fa1740b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa173fff640 1 -- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa17415f370 msgr2=0x7fa17409e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa173fff640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa17415f370 0x7fa17409e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa173fff640 1 -- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1740d3ee0 msgr2=0x7fa1740b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:24.115 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa173fff640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1740d3ee0 0x7fa1740b9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa173fff640 1 -- 172.21.15.137:0/3053986551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17409ea70 con 0x7fa17415f750 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa1737fe640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1740d3ee0 0x7fa1740b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa16bfff640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa17415f370 0x7fa17409e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa173fff640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f750 0x7fa1741f4d30 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fa16c007e40 tx=0x7fa16c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa170ff9640 1 -- 172.21.15.137:0/3053986551 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c014620 con 0x7fa17415f750 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa170ff9640 1 -- 172.21.15.137:0/3053986551 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa16c019070 con 0x7fa17415f750 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1740baa50 con 0x7fa17415f750 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa170ff9640 1 -- 172.21.15.137:0/3053986551 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16c014a20 con 0x7fa17415f750 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.113+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1741f5d00 con 0x7fa17415f750 2024-04-26T22:08:24.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.114+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1740baf70 con 0x7fa17415f750 2024-04-26T22:08:24.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.115+0000 7fa170ff9640 1 -- 172.21.15.137:0/3053986551 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa16c014bc0 con 0x7fa17415f750 2024-04-26T22:08:24.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.115+0000 7fa170ff9640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa15406c8f0 0x7fa15406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:24.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.115+0000 7fa170ff9640 1 -- 172.21.15.137:0/3053986551 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7fa16c08c140 con 0x7fa17415f750 2024-04-26T22:08:24.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.115+0000 7fa1737fe640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa15406c8f0 0x7fa15406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:24.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.115+0000 7fa1737fe640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa15406c8f0 0x7fa15406edb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa164034000 tx=0x7fa16402e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:24.119 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.119+0000 7fa170ff9640 1 -- 172.21.15.137:0/3053986551 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fa1740baf70 con 0x7fa17415f750 2024-04-26T22:08:24.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.293+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa174075fb0 con 0x7fa15406c8f0 2024-04-26T22:08:24.293 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.294+0000 7fa170ff9640 1 -- 172.21.15.137:0/3053986551 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13397 (secure 0 0 0) 0x7fa164045470 con 0x7fa15406c8f0 2024-04-26T22:08:24.294 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:24.294 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:08:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa15406c8f0 msgr2=0x7fa15406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa15406c8f0 0x7fa15406edb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa164034000 tx=0x7fa16402e000 comp rx=0 tx=0).stop 2024-04-26T22:08:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f750 msgr2=0x7fa1741f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f750 0x7fa1741f4d30 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fa16c007e40 tx=0x7fa16c00e4b0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 shutdown_connections 2024-04-26T22:08:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fa15406c8f0 0x7fa15406edb0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fa17415f750 0x7fa1741f4d30 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fa17415f370 0x7fa17409e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.296 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 --2- 172.21.15.137:0/3053986551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1740d3ee0 0x7fa1740b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 >> 172.21.15.137:0/3053986551 conn(0x7fa17408ec10 msgr2=0x7fa1740d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 shutdown_connections 2024-04-26T22:08:24.297 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:24.296+0000 7fa179eb0640 1 -- 172.21.15.137:0/3053986551 wait complete. 2024-04-26T22:08:24.306 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-04-26T22:08:22.823104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":278980,"kb_used_data":12872,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754695740,"statfs":{"total":773094113280,"available":772808437760,"internally_reserved":0,"allocated":13180928,"data_stored":6391384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8392252,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-268,"num_write":-176,"num_write_kb":-8305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001195"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":372,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-04-26T22:08:16.485392+0000","last_change":"2024-04-26T21:58:30.379253+0000","last_active":"2024-04-26T22:08:16.485392+0000","last_peered":"2024-04-26T22:08:16.485392+0000","last_clean":"2024-04-26T22:08:16.485392+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:08:16.485392+0000","last_undegraded":"2024-04-26T22:08:16.485392+0000","last_fullsized":"2024-04-26T22:08:16.485392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T21:58:29.179915+0000","last_clean_scrub_stamp":"2024-04-26T21:58:29.179915+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:35:23.008780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37384,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334456,"statfs":{"total":96636764160,"available":96598482944,"internally_reserved":0,"allocated":2093056,"data_stored":1241699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2093056,"data_stored":1241699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:08:24.309 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T21:58:29.179915+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=21, tm_min=58, tm_sec=29, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=22, tm_min=8, tm_sec=19, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T22:08:24.310 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T22:08:44.310 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T22:08:44.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.420+0000 7fe802609640 1 Processor -- start 2024-04-26T22:08:44.421 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.420+0000 7fe802609640 1 -- start start 2024-04-26T22:08:44.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe802609640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7fc15b4e0 0x7fe7fc071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.423 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe802609640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe7fc15b8c0 0x7fe7fc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe802609640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc0733e0 con 0x7fe7fc073820 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe802609640 1 -- --> v2:172.21.15.137:3300/0 -- mon_getmap magic: 0 -- 0x7fe7fc0ce230 con 0x7fe7fc15b4e0 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe802609640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fe7fc072f00 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe7fbfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7fc15b4e0 0x7fe7fc071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe7fbfff640 1 --2- >> v2:172.21.15.137:3300/0 conn(0x7fe7fc15b4e0 0x7fe7fc071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58170/0 (socket says 172.21.15.137:58170) 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe7fbfff640 1 -- 172.21.15.137:0/459508558 learned_addr learned my addr 172.21.15.137:0/459508558 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe7fb7fe640 1 --2- 172.21.15.137:0/459508558 >> v2:172.21.15.170:3300/0 conn(0x7fe7fc15b8c0 0x7fe7fc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe7fbfff640 1 -- 172.21.15.137:0/459508558 >> v2:172.21.15.170:3300/0 conn(0x7fe7fc15b8c0 msgr2=0x7fe7fc0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe7fbfff640 1 --2- 172.21.15.137:0/459508558 >> v2:172.21.15.170:3300/0 conn(0x7fe7fc15b8c0 0x7fe7fc0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe7fbfff640 1 -- 172.21.15.137:0/459508558 >> v1:172.21.15.170:6789/0 conn(0x7fe7fc073820 legacy=0x7fe7fc06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe7fbfff640 1 -- 172.21.15.137:0/459508558 --> v2:172.21.15.137:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc072660 con 0x7fe7fc15b4e0 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.421+0000 7fe7fb7fe640 1 --2- 172.21.15.137:0/459508558 >> v2:172.21.15.170:3300/0 conn(0x7fe7fc15b8c0 0x7fe7fc0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.422+0000 7fe7fbfff640 1 --2- 172.21.15.137:0/459508558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b4e0 0x7fe7fc071fd0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00bb10 tx=0x7fe7ec02c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e707c869c3dd75f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:44.424 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.422+0000 7fe7faffd640 1 -- 172.21.15.137:0/459508558 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec02f070 con 0x7fe7fc15b4e0 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.422+0000 7fe7faffd640 1 -- 172.21.15.137:0/459508558 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec038070 con 0x7fe7fc15b4e0 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.422+0000 7fe7faffd640 1 -- 172.21.15.137:0/459508558 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec032a00 con 0x7fe7fc15b4e0 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.422+0000 7fe802609640 1 -- 172.21.15.137:0/459508558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b4e0 msgr2=0x7fe7fc071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.422+0000 7fe802609640 1 --2- 172.21.15.137:0/459508558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b4e0 0x7fe7fc071fd0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec00bb10 tx=0x7fe7ec02c920 comp rx=0 tx=0).stop 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.423+0000 7fe802609640 1 -- 172.21.15.137:0/459508558 shutdown_connections 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.423+0000 7fe802609640 1 --2- 172.21.15.137:0/459508558 >> v2:172.21.15.170:3300/0 conn(0x7fe7fc15b8c0 0x7fe7fc0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.423+0000 7fe802609640 1 --2- 172.21.15.137:0/459508558 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b4e0 0x7fe7fc071fd0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.423+0000 7fe802609640 1 -- 172.21.15.137:0/459508558 >> 172.21.15.137:0/459508558 conn(0x7fe7fc0d0d30 msgr2=0x7fe7fc0d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.423+0000 7fe802609640 1 -- 172.21.15.137:0/459508558 shutdown_connections 2024-04-26T22:08:44.425 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.423+0000 7fe802609640 1 -- 172.21.15.137:0/459508558 wait complete. 2024-04-26T22:08:44.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.424+0000 7fe802609640 1 Processor -- start 2024-04-26T22:08:44.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.424+0000 7fe802609640 1 -- start start 2024-04-26T22:08:44.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe802609640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7fc073820 0x7fe7fc14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe802609640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7fc15b4e0 0x7fe7fc0b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.427 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe802609640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b8c0 0x7fe7fc0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe802609640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc0b3e80 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe802609640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc072c20 con 0x7fe7fc073820 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe802609640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fe7fc06f2c0 con 0x7fe7fc15b4e0 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe800ba6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b8c0 0x7fe7fc0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe800ba6640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b8c0 0x7fe7fc0b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58182/0 (socket says 172.21.15.137:58182) 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe800ba6640 1 -- 172.21.15.137:0/1753004022 learned_addr learned my addr 172.21.15.137:0/1753004022 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe7fbfff640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7fc073820 0x7fe7fc14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe7fb7fe640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7fc15b4e0 0x7fe7fc0b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe800ba6640 1 -- 172.21.15.137:0/1753004022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7fc15b4e0 msgr2=0x7fe7fc0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe800ba6640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7fc15b4e0 0x7fe7fc0b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe800ba6640 1 -- 172.21.15.137:0/1753004022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7fc073820 msgr2=0x7fe7fc14b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe800ba6640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7fc073820 0x7fe7fc14b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.425+0000 7fe800ba6640 1 -- 172.21.15.137:0/1753004022 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc1f8a00 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.428 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.426+0000 7fe800ba6640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b8c0 0x7fe7fc0b4950 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c7b0 tx=0x7fe7f400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:44.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.426+0000 7fe7f8ff9640 1 -- 172.21.15.137:0/1753004022 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4004b60 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.426+0000 7fe7f8ff9640 1 -- 172.21.15.137:0/1753004022 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f4004d00 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.426+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7fc14bf20 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.426+0000 7fe7f8ff9640 1 -- 172.21.15.137:0/1753004022 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400aa90 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.429 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.426+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7fc1f8f80 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.427+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7fc06a290 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.427+0000 7fe7f8ff9640 1 -- 172.21.15.137:0/1753004022 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7f400ac30 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.428+0000 7fe7f8ff9640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe7e806c8f0 0x7fe7e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.428+0000 7fe7fbfff640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe7e806c8f0 0x7fe7e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.428+0000 7fe7f8ff9640 1 -- 172.21.15.137:0/1753004022 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7fe7f408bcd0 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.430 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.428+0000 7fe7fbfff640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe7e806c8f0 0x7fe7e806edb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec037000 tx=0x7fe7ec032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:44.434 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.433+0000 7fe7f8ff9640 1 -- 172.21.15.137:0/1753004022 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fe7f4059d00 con 0x7fe7fc15b8c0 2024-04-26T22:08:44.613 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.613+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 --> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7fc0b3500 con 0x7fe7e806c8f0 2024-04-26T22:08:44.614 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.613+0000 7fe7f8ff9640 1 -- 172.21.15.137:0/1753004022 <== mgr.4103 v2:172.21.15.137:6832/3099367580 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7fe7fc0b3500 con 0x7fe7e806c8f0 2024-04-26T22:08:44.614 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:44.615 INFO:teuthology.orchestra.run.smithi137.stderr:dumped all 2024-04-26T22:08:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe7e806c8f0 msgr2=0x7fe7e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe7e806c8f0 0x7fe7e806edb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec037000 tx=0x7fe7ec032000 comp rx=0 tx=0).stop 2024-04-26T22:08:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b8c0 msgr2=0x7fe7fc0b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b8c0 0x7fe7fc0b4950 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c7b0 tx=0x7fe7f400cc70 comp rx=0 tx=0).stop 2024-04-26T22:08:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 shutdown_connections 2024-04-26T22:08:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fe7e806c8f0 0x7fe7e806edb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fe7fc15b8c0 0x7fe7fc0b4950 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.617 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fe7fc15b4e0 0x7fe7fc0b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 --2- 172.21.15.137:0/1753004022 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7fc073820 0x7fe7fc14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 >> 172.21.15.137:0/1753004022 conn(0x7fe7fc0d0d30 msgr2=0x7fe7fc0ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 shutdown_connections 2024-04-26T22:08:44.618 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.616+0000 7fe802609640 1 -- 172.21.15.137:0/1753004022 wait complete. 2024-04-26T22:08:44.628 INFO:teuthology.orchestra.run.smithi137.stdout:{"pg_ready":true,"pg_map":{"version":421,"stamp":"2024-04-26T22:08:42.827072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":278968,"kb_used_data":12872,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754695752,"statfs":{"total":773094113280,"available":772808450048,"internally_reserved":0,"allocated":13180928,"data_stored":6391384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002241"},"pg_stats":[{"pgid":"1.0","version":"120'119","reported_seq":384,"reported_epoch":120,"state":"active+clean","last_fresh":"2024-04-26T22:08:24.794901+0000","last_change":"2024-04-26T22:08:24.794901+0000","last_active":"2024-04-26T22:08:24.794901+0000","last_peered":"2024-04-26T22:08:24.794901+0000","last_clean":"2024-04-26T22:08:24.794901+0000","last_became_active":"2024-04-26T21:58:30.378378+0000","last_became_peered":"2024-04-26T21:58:30.378378+0000","last_unstale":"2024-04-26T22:08:24.794901+0000","last_undegraded":"2024-04-26T22:08:24.794901+0000","last_fullsized":"2024-04-26T22:08:24.794901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'119","last_scrub_stamp":"2024-04-26T22:08:24.794749+0000","last_deep_scrub":"120'119","last_deep_scrub_stamp":"2024-04-26T22:08:24.794749+0000","last_clean_scrub_stamp":"2024-04-26T22:08:24.794749+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:07.667647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574975,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37380,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334460,"statfs":{"total":96636764160,"available":96598487040,"internally_reserved":0,"allocated":2093056,"data_stored":1241699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36808,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":651331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33220,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338620,"statfs":{"total":96636764160,"available":96602746880,"internally_reserved":0,"allocated":2093056,"data_stored":1241699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T22:08:44.629 DEBUG:teuthology.orchestra.run.smithi137:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T22:08:44.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.728+0000 7f0b313c1640 1 Processor -- start 2024-04-26T22:08:44.729 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.728+0000 7f0b313c1640 1 -- start start 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b313c1640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0b2c0d0300 0x7f0b2c0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b313c1640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c0b46a0 con 0x7f0b2c06f340 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b313c1640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2c0b5db0 con 0x7f0b2c0b3e50 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b313c1640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7f0b2c0b6090 con 0x7f0b2c0d0300 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b2affd640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7f0b2c06f340 0x7f0b2c06f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45538/0 (socket says 172.21.15.137:45538) 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b2affd640 1 -- 172.21.15.137:0/144643276 learned_addr learned my addr 172.21.15.137:0/144643276 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152743517 0 0) 0x7f0b2c0b46a0 con 0x7f0b2c06f340 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b18003520 con 0x7f0b2c06f340 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b23fff640 1 --2- 172.21.15.137:0/144643276 >> v2:172.21.15.170:3300/0 conn(0x7f0b2c0d0300 0x7f0b2c0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.729+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2373161538 0 0) 0x7f0b18003520 con 0x7f0b2c06f340 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 >> v2:172.21.15.170:3300/0 conn(0x7f0b2c0d0300 msgr2=0x7f0b2c0b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 --2- 172.21.15.137:0/144643276 >> v2:172.21.15.170:3300/0 conn(0x7f0b2c0d0300 0x7f0b2c0b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.733 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 >> v1:172.21.15.170:6789/0 conn(0x7f0b2c0b3e50 legacy=0x7f0b2c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c0b6370 con 0x7f0b2c06f340 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7f0b1c001670 con 0x7f0b2c06f340 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 >> v1:172.21.15.137:6789/0 conn(0x7f0b2c06f340 legacy=0x7f0b2c06f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b180039b0 0x7f0b18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b18004800 0x7f0b18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b180052e0 0x7f0b1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c0b6090 con 0x7f0b180052e0 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1800c1b0 con 0x7f0b180039b0 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1800c3b0 con 0x7f0b18004800 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2affd640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b180039b0 0x7f0b18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2b7fe640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b180052e0 0x7f0b1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b23fff640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b18004800 0x7f0b18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2affd640 1 -- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b18004800 msgr2=0x7f0b18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:44.734 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2affd640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b18004800 0x7f0b18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2affd640 1 -- 172.21.15.137:0/144643276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b180052e0 msgr2=0x7f0b1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2affd640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b180052e0 0x7f0b1800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2affd640 1 -- 172.21.15.137:0/144643276 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b18003520 con 0x7f0b180039b0 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2b7fe640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b180052e0 0x7f0b1800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.730+0000 7f0b2b7fe640 1 -- 172.21.15.137:0/144643276 reap_dead start 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.731+0000 7f0b2affd640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b180039b0 0x7f0b18003dd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c001050 tx=0x7f0b18005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73bcd3b014e9ffd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.731+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 <== mon.1 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c007d30 con 0x7f0b180039b0 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.731+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 <== mon.1 v2:172.21.15.170:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1c036070 con 0x7f0b180039b0 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.731+0000 7f0b2a7fc640 1 -- 172.21.15.137:0/144643276 <== mon.1 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c005d30 con 0x7f0b180039b0 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.732+0000 7f0b313c1640 1 -- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b180039b0 msgr2=0x7f0b18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.732+0000 7f0b313c1640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b180039b0 0x7f0b18003dd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c001050 tx=0x7f0b18005830 comp rx=0 tx=0).stop 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.732+0000 7f0b313c1640 1 -- 172.21.15.137:0/144643276 shutdown_connections 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.732+0000 7f0b313c1640 1 --2- 172.21.15.137:0/144643276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b180039b0 0x7f0b18003dd0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.732+0000 7f0b313c1640 1 -- 172.21.15.137:0/144643276 >> 172.21.15.137:0/144643276 conn(0x7f0b2c0cd8a0 msgr2=0x7f0b2c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:44.735 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.732+0000 7f0b313c1640 1 -- 172.21.15.137:0/144643276 shutdown_connections 2024-04-26T22:08:44.736 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.732+0000 7f0b313c1640 1 -- 172.21.15.137:0/144643276 wait complete. 2024-04-26T22:08:44.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.733+0000 7f0b313c1640 1 Processor -- start 2024-04-26T22:08:44.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.733+0000 7f0b313c1640 1 -- start start 2024-04-26T22:08:44.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b313c1640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b180039b0 0x7f0b2c152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b313c1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b2c152f70 0x7f0b2c157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.738 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b313c1640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b2c141ab0 0x7f0b2c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b313c1640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c0b4460 con 0x7f0b2c141ab0 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b313c1640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2c0b42e0 con 0x7f0b2c152f70 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b313c1640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2c142a30 con 0x7f0b180039b0 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b2c141ab0 0x7f0b2c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2b7fe640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b2c141ab0 0x7f0b2c1579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58194/0 (socket says 172.21.15.137:58194) 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2b7fe640 1 -- 172.21.15.137:0/1653263442 learned_addr learned my addr 172.21.15.137:0/1653263442 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2affd640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b180039b0 0x7f0b2c152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b23fff640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b2c152f70 0x7f0b2c157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2b7fe640 1 -- 172.21.15.137:0/1653263442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b180039b0 msgr2=0x7f0b2c152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2b7fe640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b180039b0 0x7f0b2c152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2b7fe640 1 -- 172.21.15.137:0/1653263442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b2c152f70 msgr2=0x7f0b2c157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2b7fe640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b2c152f70 0x7f0b2c157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2b7fe640 1 -- 172.21.15.137:0/1653263442 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2c158070 con 0x7f0b2c141ab0 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.734+0000 7f0b2b7fe640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b2c141ab0 0x7f0b2c1579a0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0ce6b0 tx=0x7f0b2400feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:44.739 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.735+0000 7f0b237fe640 1 -- 172.21.15.137:0/1653263442 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24001a70 con 0x7f0b2c141ab0 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.735+0000 7f0b237fe640 1 -- 172.21.15.137:0/1653263442 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b24018070 con 0x7f0b2c141ab0 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.735+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2c15d8d0 con 0x7f0b2c141ab0 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.735+0000 7f0b237fe640 1 -- 172.21.15.137:0/1653263442 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24003d80 con 0x7f0b2c141ab0 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.735+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b2c15de90 con 0x7f0b2c141ab0 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.736+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b2c06a290 con 0x7f0b2c141ab0 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.736+0000 7f0b237fe640 1 -- 172.21.15.137:0/1653263442 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b240050d0 con 0x7f0b2c141ab0 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.737+0000 7f0b237fe640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b0c06c8f0 0x7f0b0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.737+0000 7f0b237fe640 1 -- 172.21.15.137:0/1653263442 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7f0b2408b570 con 0x7f0b2c141ab0 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.737+0000 7f0b2affd640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b0c06c8f0 0x7f0b0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:44.740 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.737+0000 7f0b2affd640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b0c06c8f0 0x7f0b0c06edb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c035000 tx=0x7f0b1c009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:44.742 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.741+0000 7f0b237fe640 1 -- 172.21.15.137:0/1653263442 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7f0b24059c80 con 0x7f0b2c141ab0 2024-04-26T22:08:44.957 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.956+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f0b2c0b46a0 con 0x7f0b2c141ab0 2024-04-26T22:08:44.960 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.959+0000 7f0b237fe640 1 -- 172.21.15.137:0/1653263442 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7f0b24059580 con 0x7f0b2c141ab0 2024-04-26T22:08:44.961 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.960+0000 7f0b237fe640 1 -- 172.21.15.137:0/1653263442 <== mon.0 v2:172.21.15.137:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0b2405d930 con 0x7f0b2c141ab0 2024-04-26T22:08:44.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.962+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b0c06c8f0 msgr2=0x7f0b0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.963 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.962+0000 7f0b313c1640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b0c06c8f0 0x7f0b0c06edb0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c035000 tx=0x7f0b1c009030 comp rx=0 tx=0).stop 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.962+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b2c141ab0 msgr2=0x7f0b2c1579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.962+0000 7f0b313c1640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b2c141ab0 0x7f0b2c1579a0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0ce6b0 tx=0x7f0b2400feb0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.962+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 shutdown_connections 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.962+0000 7f0b313c1640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7f0b0c06c8f0 0x7f0b0c06edb0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.963+0000 7f0b313c1640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7f0b2c141ab0 0x7f0b2c1579a0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.963+0000 7f0b313c1640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b2c152f70 0x7f0b2c157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.963+0000 7f0b313c1640 1 --2- 172.21.15.137:0/1653263442 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7f0b180039b0 0x7f0b2c152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.963+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 >> 172.21.15.137:0/1653263442 conn(0x7f0b2c0cd8a0 msgr2=0x7f0b2c0b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.963+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 shutdown_connections 2024-04-26T22:08:44.964 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:44.963+0000 7f0b313c1640 1 -- 172.21.15.137:0/1653263442 wait complete. 2024-04-26T22:08:44.975 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:08:44.977 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:08:44.978 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T22:08:44.979 DEBUG:teuthology.orchestra.run.smithi137:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T22:08:45.116 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.116+0000 7fcc78e15640 1 Processor -- start 2024-04-26T22:08:45.117 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.116+0000 7fcc78e15640 1 -- start start 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc78e15640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcc740d3ee0 0x7fcc740cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc78e15640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc7415f750 0x7fcc740b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc78e15640 1 -- --> v1:172.21.15.137:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc740d03a0 con 0x7fcc7415f370 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc78e15640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 -- 0x7fcc740b4d10 con 0x7fcc740d3ee0 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc78e15640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcc740d0680 con 0x7fcc7415f750 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7259c640 1 --1- >> v1:172.21.15.137:6789/0 conn(0x7fcc7415f370 0x7fcc740d37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.137:6789/0 says I am v1:172.21.15.137:45540/0 (socket says 172.21.15.137:45540) 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7259c640 1 -- 172.21.15.137:0/1624879838 learned_addr learned my addr 172.21.15.137:0/1624879838 (peer_addr_for_me v1:172.21.15.137:0/0) 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 <== mon.0 v1:172.21.15.137:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517436817 0 0) 0x7fcc740d03a0 con 0x7fcc7415f370 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc71d9b640 1 --2- 172.21.15.137:0/1624879838 >> v2:172.21.15.170:3300/0 conn(0x7fcc740d3ee0 0x7fcc740cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 --> v1:172.21.15.137:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc5c003520 con 0x7fcc7415f370 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc72d9d640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc7415f750 0x7fcc740b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:45.120 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 <== mon.0 v1:172.21.15.137:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3175699785 0 0) 0x7fcc5c003520 con 0x7fcc7415f370 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc7415f750 msgr2=0x7fcc740b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc7415f750 0x7fcc740b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 >> v2:172.21.15.170:3300/0 conn(0x7fcc740d3ee0 msgr2=0x7fcc740cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 --2- 172.21.15.137:0/1624879838 >> v2:172.21.15.170:3300/0 conn(0x7fcc740d3ee0 0x7fcc740cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 --> v1:172.21.15.137:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc740d0960 con 0x7fcc7415f370 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 <== mon.0 v1:172.21.15.137:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4034826242 0 0) 0x7fcc64001670 con 0x7fcc7415f370 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 >> v1:172.21.15.137:6789/0 conn(0x7fcc7415f370 legacy=0x7fcc740d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc7415f750 0x7fcc5c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc5c003f30 0x7fcc5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5c004d40 0x7fcc5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740b4d10 con 0x7fcc5c004d40 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740d0680 con 0x7fcc5c003f30 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.117+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5c00b9c0 con 0x7fcc7415f750 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.118+0000 7fcc7259c640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc7415f750 0x7fcc5c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:45.121 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.118+0000 7fcc72d9d640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5c004d40 0x7fcc5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.118+0000 7fcc71d9b640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc5c003f30 0x7fcc5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.118+0000 7fcc72d9d640 1 -- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc7415f750 msgr2=0x7fcc5c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.118+0000 7fcc72d9d640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc7415f750 0x7fcc5c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.118+0000 7fcc72d9d640 1 -- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc5c003f30 msgr2=0x7fcc5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.118+0000 7fcc72d9d640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc5c003f30 0x7fcc5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.118+0000 7fcc72d9d640 1 -- 172.21.15.137:0/1624879838 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5c003520 con 0x7fcc5c004d40 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.119+0000 7fcc72d9d640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5c004d40 0x7fcc5c0051c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009fc0 tx=0x7fcc5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6071934eff37ad02 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.119+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c009c10 con 0x7fcc5c004d40 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.119+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcc6c036070 con 0x7fcc5c004d40 2024-04-26T22:08:45.122 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.119+0000 7fcc7159a640 1 -- 172.21.15.137:0/1624879838 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c031690 con 0x7fcc5c004d40 2024-04-26T22:08:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.120+0000 7fcc78e15640 1 -- 172.21.15.137:0/1624879838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5c004d40 msgr2=0x7fcc5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.120+0000 7fcc78e15640 1 --2- 172.21.15.137:0/1624879838 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc5c004d40 0x7fcc5c0051c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009fc0 tx=0x7fcc5c005830 comp rx=0 tx=0).stop 2024-04-26T22:08:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.120+0000 7fcc72d9d640 1 -- 172.21.15.137:0/1624879838 reap_dead start 2024-04-26T22:08:45.125 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.120+0000 7fcc78e15640 1 -- 172.21.15.137:0/1624879838 shutdown_connections 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.120+0000 7fcc78e15640 1 -- 172.21.15.137:0/1624879838 >> 172.21.15.137:0/1624879838 conn(0x7fcc7408ec10 msgr2=0x7fcc7409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.120+0000 7fcc78e15640 1 -- 172.21.15.137:0/1624879838 shutdown_connections 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.120+0000 7fcc78e15640 1 -- 172.21.15.137:0/1624879838 wait complete. 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.122+0000 7fcc78e15640 1 Processor -- start 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.122+0000 7fcc78e15640 1 -- start start 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc78e15640 1 --2- >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc5c004d40 0x7fcc740b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc78e15640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc740cb2c0 0x7fcc740cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc78e15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740d1ba0 0x7fcc740d2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc78e15640 1 -- --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740b47d0 con 0x7fcc740cb2c0 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc78e15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740d0f20 con 0x7fcc740d1ba0 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc78e15640 1 -- --> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] -- mon_getmap magic: 0 -- 0x7fcc740b4950 con 0x7fcc5c004d40 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc71d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc740cb2c0 0x7fcc740cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:45.126 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc71d9b640 1 --2- >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc740cb2c0 0x7fcc740cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.137:3300/0 says I am v2:172.21.15.137:58216/0 (socket says 172.21.15.137:58216) 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc71d9b640 1 -- 172.21.15.137:0/4266129730 learned_addr learned my addr 172.21.15.137:0/4266129730 (peer_addr_for_me v2:172.21.15.137:0/0) 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc7259c640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc5c004d40 0x7fcc740b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc72d9d640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740d1ba0 0x7fcc740d2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc71d9b640 1 -- 172.21.15.137:0/4266129730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc5c004d40 msgr2=0x7fcc740b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc71d9b640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc5c004d40 0x7fcc740b9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc71d9b640 1 -- 172.21.15.137:0/4266129730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740d1ba0 msgr2=0x7fcc740d2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc71d9b640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740d1ba0 0x7fcc740d2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc71d9b640 1 -- 172.21.15.137:0/4266129730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc741f4aa0 con 0x7fcc740cb2c0 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.123+0000 7fcc71d9b640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc740cb2c0 0x7fcc740cb740 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fcc68011960 tx=0x7fcc68011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.124+0000 7fcc62ffd640 1 -- 172.21.15.137:0/4266129730 <== mon.0 v2:172.21.15.137:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc68019070 con 0x7fcc740cb2c0 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.124+0000 7fcc62ffd640 1 -- 172.21.15.137:0/4266129730 <== mon.0 v2:172.21.15.137:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcc68004240 con 0x7fcc740cb2c0 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.124+0000 7fcc62ffd640 1 -- 172.21.15.137:0/4266129730 <== mon.0 v2:172.21.15.137:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800f8e0 con 0x7fcc740cb2c0 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.124+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc740c9070 con 0x7fcc740cb2c0 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.124+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc740c9630 con 0x7fcc740cb2c0 2024-04-26T22:08:45.127 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.125+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc7406a290 con 0x7fcc740cb2c0 2024-04-26T22:08:45.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.125+0000 7fcc62ffd640 1 -- 172.21.15.137:0/4266129730 <== mon.0 v2:172.21.15.137:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc6801c070 con 0x7fcc740cb2c0 2024-04-26T22:08:45.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.125+0000 7fcc62ffd640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc5406c920 0x7fcc5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T22:08:45.128 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.126+0000 7fcc62ffd640 1 -- 172.21.15.137:0/4266129730 <== mon.0 v2:172.21.15.137:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5115+0+0 (secure 0 0 0) 0x7fcc6808bd50 con 0x7fcc740cb2c0 2024-04-26T22:08:45.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.126+0000 7fcc7259c640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc5406c920 0x7fcc5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T22:08:45.129 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.126+0000 7fcc7259c640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc5406c920 0x7fcc5406ede0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcc640015b0 tx=0x7fcc640078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T22:08:45.130 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.131+0000 7fcc62ffd640 1 -- 172.21.15.137:0/4266129730 <== mon.0 v2:172.21.15.137:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187370 (secure 0 0 0) 0x7fcc6808f030 con 0x7fcc740cb2c0 2024-04-26T22:08:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.350+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 --> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc740caff0 con 0x7fcc740cb2c0 2024-04-26T22:08:45.351 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.350+0000 7fcc62ffd640 1 -- 172.21.15.137:0/4266129730 <== mon.0 v2:172.21.15.137:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+3881 (secure 0 0 0) 0x7fcc68059d80 con 0x7fcc740cb2c0 2024-04-26T22:08:45.351 INFO:teuthology.orchestra.run.smithi137.stdout: 2024-04-26T22:08:45.352 INFO:teuthology.orchestra.run.smithi137.stdout:{"epoch":95,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/3151930647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6833","nonce":3151930647},{"type":"v1","addr":"172.21.15.170:6835","nonce":3151930647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6834/2255488724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2255488724},{"type":"v1","addr":"172.21.15.170:6834","nonce":2255488724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6836/1132553603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6834","nonce":1132553603},{"type":"v1","addr":"172.21.15.137:6836","nonce":1132553603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":9483,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.137:6837/1118612413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.137:6835","nonce":1118612413},{"type":"v1","addr":"172.21.15.137:6837","nonce":1118612413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[]} 2024-04-26T22:08:45.352 INFO:teuthology.orchestra.run.smithi137.stderr:dumped fsmap epoch 95 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc5406c920 msgr2=0x7fcc5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc5406c920 0x7fcc5406ede0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcc640015b0 tx=0x7fcc640078f0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc740cb2c0 msgr2=0x7fcc740cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc740cb2c0 0x7fcc740cb740 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fcc68011960 tx=0x7fcc68011e20 comp rx=0 tx=0).stop 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 shutdown_connections 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:6832/3099367580,v1:172.21.15.137:6833/3099367580] conn(0x7fcc5406c920 0x7fcc5406ede0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.137:3300/0,v1:172.21.15.137:6789/0] conn(0x7fcc740cb2c0 0x7fcc740cb740 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcc740d1ba0 0x7fcc740d2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 --2- 172.21.15.137:0/4266129730 >> [v2:172.21.15.170:3301/0,v1:172.21.15.170:6790/0] conn(0x7fcc5c004d40 0x7fcc740b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T22:08:45.354 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 >> 172.21.15.137:0/4266129730 conn(0x7fcc7408ec10 msgr2=0x7fcc740d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T22:08:45.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 shutdown_connections 2024-04-26T22:08:45.355 INFO:teuthology.orchestra.run.smithi137.stderr:2024-04-26T22:08:45.353+0000 7fcc78e15640 1 -- 172.21.15.137:0/4266129730 wait complete. 2024-04-26T22:08:45.365 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-26T22:08:45.365 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T22:08:45.365 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T22:08:45.365 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.374 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T22:08:45.374 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T22:08:45.374 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.424 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T22:08:45.425 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T22:08:45.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.436 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T22:08:45.437 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T22:08:45.437 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.488 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T22:08:45.488 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T22:08:45.489 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T22:08:45.489 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.529 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T22:08:45.529 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T22:08:45.529 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.601 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T22:08:45.601 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T22:08:45.601 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.682 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T22:08:45.683 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T22:08:45.683 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.752 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T22:08:45.752 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T22:08:45.752 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.788 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T22:08:45.788 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T22:08:45.788 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.856 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T22:08:45.856 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T22:08:45.856 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.925 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T22:08:45.925 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T22:08:45.925 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:45.997 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T22:08:45.997 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T22:08:45.998 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T22:08:45.998 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:46.024 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T22:08:46.024 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T22:08:46.024 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:46.066 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T22:08:46.066 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T22:08:46.066 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T22:08:46.066 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:46.078 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T22:08:46.078 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T22:08:46.078 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:46.119 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T22:08:46.119 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T22:08:46.119 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T22:08:46.171 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T22:08:46.172 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T22:08:46.172 DEBUG:teuthology.orchestra.run.smithi137:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-26T22:08:46.202 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:02:51.886051+0000 mds.c (mds.0) 1 : cluster [WRN] Corrupt dentry 'file_to_be_damaged' in dir frag 0x10000000000: Invalid tag char 'd' pos 0: Malformed input [buffer:3](/subdir) 2024-04-26T22:08:46.203 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-04-26T22:08:46.203 DEBUG:teuthology.orchestra.run.smithi137:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-26T22:08:46.273 DEBUG:teuthology.orchestra.run.smithi137:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-26T22:08:46.344 INFO:teuthology.orchestra.run.smithi137.stdout:2024-04-26T22:04:33.753317+0000 mds.a (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-26T22:08:46.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:08:46.345 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T22:08:46.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:08:46.543 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T22:08:46.630 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:08:46.631 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T22:08:46.716 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:08:46.716 DEBUG:teuthology.orchestra.run.smithi137:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T22:08:46.810 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T22:08:46.810 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T22:08:46.940 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T22:08:46.941 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T22:08:47.027 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T22:08:47.027 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T22:08:47.085 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T22:08:47.085 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T22:08:47.151 INFO:tasks.ceph:Archiving mon data... 2024-04-26T22:08:47.152 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/data/mon.a.tgz 2024-04-26T22:08:47.152 DEBUG:teuthology.orchestra.run.smithi137:> mktemp 2024-04-26T22:08:47.167 INFO:teuthology.orchestra.run.smithi137.stdout:/tmp/tmp.jilj9sUmYa 2024-04-26T22:08:47.167 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jilj9sUmYa 2024-04-26T22:08:47.329 DEBUG:teuthology.orchestra.run.smithi137:> sudo chmod 0666 /tmp/tmp.jilj9sUmYa 2024-04-26T22:08:47.409 DEBUG:teuthology.orchestra.remote:smithi137:/tmp/tmp.jilj9sUmYa is 439KB 2024-04-26T22:08:47.506 DEBUG:teuthology.orchestra.run.smithi137:> rm -fr /tmp/tmp.jilj9sUmYa 2024-04-26T22:08:47.521 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/data/mon.b.tgz 2024-04-26T22:08:47.521 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-04-26T22:08:47.539 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.88aIBEzH6e 2024-04-26T22:08:47.540 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.88aIBEzH6e 2024-04-26T22:08:47.707 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.88aIBEzH6e 2024-04-26T22:08:47.789 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.88aIBEzH6e is 456KB 2024-04-26T22:08:47.887 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.88aIBEzH6e 2024-04-26T22:08:47.901 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/data/mon.c.tgz 2024-04-26T22:08:47.901 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-04-26T22:08:47.955 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.LQm0q3SNBC 2024-04-26T22:08:47.956 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LQm0q3SNBC 2024-04-26T22:08:48.104 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.LQm0q3SNBC 2024-04-26T22:08:48.184 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.LQm0q3SNBC is 456KB 2024-04-26T22:08:48.281 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.LQm0q3SNBC 2024-04-26T22:08:48.294 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T22:08:48.295 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T22:08:48.297 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T22:08:48.379 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T22:08:48.412 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T22:08:48.412 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T22:08:48.413 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/remote/smithi137/crash 2024-04-26T22:08:48.414 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T22:08:48.443 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/remote/smithi170/crash 2024-04-26T22:08:48.444 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T22:08:48.474 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T22:08:48.474 DEBUG:teuthology.orchestra.run.smithi137:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:08:48.488 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T22:08:48.565 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T22:08:48.590 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T22:08:48.613 INFO:tasks.ceph:Compressing logs... 2024-04-26T22:08:48.613 DEBUG:teuthology.orchestra.run.smithi137:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T22:08:48.632 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T22:08:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53956.log 2024-04-26T22:08:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34386.log 2024-04-26T22:08:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66251.log 2024-04-26T22:08:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75505.log 2024-04-26T22:08:48.655 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53956.log.gz 2024-04-26T22:08:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66251.log: gzip -5 --verbose -- 89.5% /var/log/ceph/ceph-client.admin.75806.log 2024-04-26T22:08:48.655 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34386.log.gz 2024-04-26T22:08:48.655 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66251.log.gz 2024-04-26T22:08:48.655 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45419.log 2024-04-26T22:08:48.656 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70631.log 2024-04-26T22:08:48.656 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.65922.log 2024-04-26T22:08:48.656 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75806.log.gz 2024-04-26T22:08:48.703 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.40751.log 2024-04-26T22:08:48.703 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.3.40751.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.40751.log.gz 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34679.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34588.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34679.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34588.log: 87.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.34679.log.gz -5 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr: --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34588.log.gz 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34632.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.34632.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34632.log.gz 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T22:08:48.704 INFO:teuthology.orchestra.run.smithi170.stderr: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34719.log 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.6.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34799.log 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34719.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34719.log.gz 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34508.log 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34799.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34799.log.gz 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40353.log 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34508.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34508.log.gz 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34548.log 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.1.40353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40353.log.gz 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34759.log 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34548.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34548.log.gz 2024-04-26T22:08:48.705 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T22:08:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.34759.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34759.log.gz 2024-04-26T22:08:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T22:08:48.706 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.d.log: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T22:08:48.706 INFO:teuthology.orchestra.run.smithi170.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T22:08:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45419.log: /var/log/ceph/ceph-client.admin.70631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61439.log 2024-04-26T22:08:48.815 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45419.log.gz 2024-04-26T22:08:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65922.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70631.log.gz 2024-04-26T22:08:48.815 INFO:teuthology.orchestra.run.smithi137.stderr: 92.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.75505.log.gz -5 2024-04-26T22:08:48.815 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45593.log 2024-04-26T22:08:48.815 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63218.log 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.65922.log.gz 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45503.log 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61439.log.gz 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65379.log 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45593.log.gz 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45503.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.63218.log.gz 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42303.log 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45503.log.gz 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.65379.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66345.log 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77759.log 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65379.log.gz 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67420.log 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42303.log.gz 2024-04-26T22:08:48.816 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66345.log.gz 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50219.log 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70391.log 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.77759.log.gz 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67420.log.gz 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72626.log 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68902.log 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50219.log.gz 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54852.log 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68902.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.70391.log.gzgzip 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr: -5 88.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.72626.log.gz -- 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.71207.log 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54852.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68902.log.gz 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63295.log 2024-04-26T22:08:48.817 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77026.log 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63295.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71207.log.gz 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42007.log 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54852.log.gz 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63295.log.gz 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75308.log 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74034.log 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77026.log.gz 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42007.log.gz 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56219.log 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59620.log 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56219.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.69394.log 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74034.log.gz 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.75308.log.gz 2024-04-26T22:08:48.818 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76513.log 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56219.log.gz 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41043.log 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.69394.log.gz 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47446.log 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.59620.log.gz 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41043.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76513.log.gz 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67504.log 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47446.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41043.log.gz 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53724.log 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47446.log.gz 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44540.log 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78305.log 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67504.log.gz 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44540.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.53724.log.gz 2024-04-26T22:08:48.819 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54646.log 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68536.log 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44540.log.gz 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54646.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.78305.log.gz -5 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44036.log 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68536.log: 89.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.54646.log.gz -5 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60706.log 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57620.log 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68536.log.gz 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44036.log.gz 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57620.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60706.log.gz 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68704.log 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46175.log: gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.57620.log.gz -- 2024-04-26T22:08:48.820 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.78011.log 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52412.log 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68704.log.gz 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55917.log 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52412.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78011.log.gz 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44708.log 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52412.log.gz 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72140.log 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77633.log 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55917.log.gz 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34750.log 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44708.log.gz 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61145.log 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72140.log.gz 2024-04-26T22:08:48.821 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51052.log 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77633.log.gz 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61145.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34750.log.gz 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78095.log 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61145.log.gz 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42765.log 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51052.log.gz 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78137.log 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66723.log 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.78095.log.gz 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42765.log.gz 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50758.log 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78137.log.gz 2024-04-26T22:08:48.822 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55749.log 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66723.log.gz 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62390.log 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55749.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.50758.log.gz 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54768.log 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55749.log.gz 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41768.log 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62390.log: /var/log/ceph/ceph-client.admin.54768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58409.log 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62390.log.gz 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61534.log 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58409.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41768.log.gz 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73247.log 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.54768.log.gz 2024-04-26T22:08:48.823 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61534.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58409.log.gz 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46007.log 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61534.log.gz 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47177.log 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42555.log 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46007.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73247.log.gz 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46007.log.gz 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47177.log.gz 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49228.log 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42555.log: /var/log/ceph/ceph-client.admin.48740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61187.log 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42555.log.gz 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53629.log 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61187.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.51747.log 2024-04-26T22:08:48.824 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49228.log.gz 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61187.log.gz 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66125.log 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51747.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.53629.log.gz 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68578.log 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71680.log 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68578.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51747.log.gz 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41435.log 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66125.log.gz 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77507.log 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71680.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68578.log.gz 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65129.log 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71680.log.gz 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41435.log.gz 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71375.log 2024-04-26T22:08:48.825 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65988.log 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77507.log.gz 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65129.log.gz 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49270.log 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71375.log: /var/log/ceph/ceph-client.admin.65988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65585.log 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71375.log.gz 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49270.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.65988.log.gz --verbose 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph.log 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49270.log.gz 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.65585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61780.log 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65585.log.gz 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41253.log 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56482.log 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61780.log.gz 2024-04-26T22:08:48.826 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53914.log 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56085.log 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41253.log.gz 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53914.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56482.log.gz 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78430.log 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53914.log.gz 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65225.log 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56085.log.gz 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53673.log/var/log/ceph/ceph-client.admin.78430.log: 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44960.log 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78430.log.gz 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65225.log.gz 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51530.log 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44960.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.53673.log.gz -5 2024-04-26T22:08:48.827 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73798.log 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70654.log 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44960.log.gz 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60445.log 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51530.log.gz 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76429.log 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73798.log.gz 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68054.log 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.70654.log.gz 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76429.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60445.log.gz 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76900.log 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76429.log.gz 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68054.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68054.log.gz 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49794.log 2024-04-26T22:08:48.828 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44162.log 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.76900.log.gz 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45131.log 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41767.log 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49794.log.gz 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45131.log: 89.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.44162.log.gz 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.76858.log 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45131.log.gz 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55326.log 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54550.log 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41767.log.gz 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76858.log.gz 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70124.log 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69478.log 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55326.log.gz 2024-04-26T22:08:48.829 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57386.log 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54550.log.gz 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69478.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70124.log.gz 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57386.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69478.log.gz 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61696.log 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48919.log 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57386.log.gz 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69894.log 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48919.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61696.log.gz 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70479.log 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76387.log 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.48919.log.gz 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:gzip/var/log/ceph/ceph-client.admin.70479.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66513.log 2024-04-26T22:08:48.830 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76387.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.69894.log.gz 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72560.log 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42639.log 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66513.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.70479.log.gz 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76387.log.gz 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72560.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.66513.log.gz --verbose 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.admin.41434.log 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54082.log 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41434.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42639.log.gz 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.72560.log.gz 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49668.log 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41434.log.gz 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59770.log 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54082.log.gz 2024-04-26T22:08:48.831 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71968.log 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59770.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.49668.log.gz -5 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47866.log 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71968.log.gz 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47866.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.59770.log.gz 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57260.log 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47866.log.gz 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44204.log 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69796.log 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44204.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57260.log.gz 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62348.log 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44204.log.gz 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56398.log 2024-04-26T22:08:48.832 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71501.log 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56398.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62348.log.gz 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77927.log 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69796.log.gz 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56398.log.gz 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40647.log 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44876.log 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71501.log.gz 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59986.log 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77927.log.gz 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44876.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40647.log.gz 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57344.log 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44876.log.gz 2024-04-26T22:08:48.833 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51348.log 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47698.log 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59986.log.gz 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57344.log.gz 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.51348.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.0.51348.log.gz /var/log/ceph/ceph-client.admin.52706.log 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55392.log 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52706.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47698.log.gz 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71417.log 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57554.log 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52706.log.gz 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55392.log.gz 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70265.log 2024-04-26T22:08:48.834 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50800.log 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71417.log.gz 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77885.log 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57554.log.gz 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.70265.log.gz 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42107.log 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62138.log 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50800.log.gz/var/log/ceph/ceph-client.admin.77885.log: 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56272.log 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77885.log.gz 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42107.log.gz 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77549.log 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56272.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62138.log.gz 2024-04-26T22:08:48.835 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68096.log 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56272.log.gz 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.audit.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77549.log.gz 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65814.log 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61614.log 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65814.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68096.log.gz 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41433.log 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70913.log 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61614.log.gz 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66387.log 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65814.log.gz 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70913.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41433.log.gz 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56566.log 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70913.log.gz 2024-04-26T22:08:48.836 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49312.log 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66387.log: /var/log/ceph/ceph-client.admin.56566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72054.log 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66387.log.gz 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67120.log 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56566.log.gz 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49312.log.gz 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44624.log 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67120.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72054.log.gz 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72266.log 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44624.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67120.log.gz 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78347.log 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72266.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44624.log.gz 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42471.log 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78347.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72266.log.gz 2024-04-26T22:08:48.837 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66167.log 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78347.log.gz 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45215.log 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66994.log 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42471.log.gz 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45215.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66167.log.gz 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58463.log 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45215.log.gz 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44750.log 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76816.log 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66994.log.gz 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44750.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58463.log.gz 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46049.log 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44750.log.gz 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42104.log 2024-04-26T22:08:48.838 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46049.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.76816.log.gz 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64943.log 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42104.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46049.log.gz 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67970.log 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42104.log.gz 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63559.log 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64943.log.gz 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77717.log 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56356.log 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67970.log.gz 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63559.log.gz 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40875.log 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77717.log.gz 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61822.log 2024-04-26T22:08:48.839 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52622.log 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56356.log.gz 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40875.log.gz 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62600.log 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61822.log.gz 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57079.log 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62096.log 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52622.log.gz 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44456.log 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.62600.log.gz 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62096.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57079.log.gz 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50968.log 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62096.log.gz 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61355.log 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50968.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44456.log.gz 2024-04-26T22:08:48.840 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51660.log 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50968.log.gz 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42891.log 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61355.log: /var/log/ceph/ceph-client.admin.51660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63397.log 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61355.log.gz 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42891.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51660.log.gz 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75760.log 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42891.log.gz 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55134.log 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52454.log 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55134.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75760.log.gz 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69984.log 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.63397.log.gz 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58551.log 2024-04-26T22:08:48.841 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% 91.4% -- replaced with /var/log/ceph/ceph-client.admin.52454.log.gz 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55134.log.gz 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55529.log 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40561.log 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.69984.log.gz 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55529.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58551.log.gz 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70307.log 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55529.log.gz 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40517.log 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40561.log: /var/log/ceph/ceph-client.admin.70307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62558.log 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40561.log.gz 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46967.log 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62558.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40517.log.gz 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48495.log 2024-04-26T22:08:48.842 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44792.log 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr: 91.2%/var/log/ceph/ceph-client.admin.46967.log: -- replaced with /var/log/ceph/ceph-client.admin.70307.log.gz 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62558.log.gz 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48495.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46967.log.gz 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75215.log 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48495.log.gz 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48180.log 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74352.log 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44792.log.gz 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.48180.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.75215.log.gz 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.0.48180.log.gz 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.72010.log 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44372.log 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72010.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T22:08:48.843 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44372.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72010.log.gz 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57035.log 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.74352.log.gz 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44372.log.gz 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52370.log 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61313.log 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52370.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57035.log.gz 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66639.log 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50345.log 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61313.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52370.log.gz 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66765.log 88.4% 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61313.log.gz 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66639.log.gz 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53118.log 2024-04-26T22:08:48.844 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50345.log: /var/log/ceph/ceph-client.admin.66765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56907.log 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50345.log.gz 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66765.log.gz 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48882.log 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56907.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53118.log.gz 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51832.log 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56907.log.gz 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49354.log 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48882.log: /var/log/ceph/ceph-client.admin.51832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64966.log 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49354.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48882.log.gz 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56043.log 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49354.log.gz 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64966.log: gzip 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51832.log.gz -5 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41763.log 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58047.log 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56043.log.gz 2024-04-26T22:08:48.845 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58335.log 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77591.log 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58047.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41763.log.gz 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46756.log 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.64966.log.gz 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58047.log.gz 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69709.log 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.58335.log.gz 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46756.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.77591.log.gz 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77068.log 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69709.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46756.log.gz 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44582.log 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69709.log.gz 2024-04-26T22:08:48.846 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50303.log 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77068.log: /var/log/ceph/ceph-client.admin.44582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52192.log 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77068.log.gz 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44582.log.gz 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49397.log 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50303.log.gz 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55026.log 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71165.log 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52192.log.gz 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55026.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49397.log.gz 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66555.log 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55026.log.gz 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41770.log 2024-04-26T22:08:48.847 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71165.log: /var/log/ceph/ceph-client.admin.66555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49710.log 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71165.log.gz 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49626.log 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66555.log.gz 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41770.log.gz 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68392.log 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49710.log.gz 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64635.log 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49626.log: /var/log/ceph/ceph-client.0.68392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65313.log 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68392.log.gz 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49626.log.gz 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50926.log 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65313.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64635.log.gz 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51094.log 2024-04-26T22:08:48.848 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64429.log 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.65313.log.gz 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50926.log.gz 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67718.log 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55613.log 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67036.log 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51094.log.gz 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67718.log.gz 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55613.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64429.log.gz 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50674.log 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70026.log 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67036.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55613.log.gz 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67036.log.gz 2024-04-26T22:08:48.849 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50674.log.gz 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67338.log 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77801.log 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46469.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.70026.log.gz 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50015.log 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67338.log.gz 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77801.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73324.log 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77801.log.gz 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mds.c.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50015.log.gz 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59878.log 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68846.log 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73324.log: /var/log/ceph/ceph-client.admin.59878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71039.log 2024-04-26T22:08:48.850 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40773.log 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.73324.log.gz 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71039.log: 91.2% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68846.log.gz 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59878.log.gz 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50261.log 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71039.log.gz 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54593.log 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40773.log: /var/log/ceph/ceph-client.admin.50261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40773.log.gz 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57130.log 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50261.log.gz 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39994.log 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.54593.log.gz 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75914.log 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57130.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gz 2024-04-26T22:08:48.851 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.39994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78179.log 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57130.log.gz 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.39994.log.gz 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52950.log 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78179.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75914.log.gz 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73163.log 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52950.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78179.log.gz 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70565.log 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73163.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.52950.log.gz -- 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.59836.log 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51941.log 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70565.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73163.log.gz 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42105.log 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59836.log.gz 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43994.log 2024-04-26T22:08:48.852 INFO:teuthology.orchestra.run.smithi137.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70565.log.gz 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49752.log 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42105.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51941.log.gz 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43994.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42105.log.gz 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43994.log.gz 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73882.log 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65730.log 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.1.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49752.log.gz 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73882.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73882.log.gz 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67760.log 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70828.log 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.65730.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59177.log 2024-04-26T22:08:48.853 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67760.log: /var/log/ceph/ceph-client.admin.70828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41765.log 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59177.log: 88.1% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.70828.log.gz -- replaced with /var/log/ceph/ceph-client.admin.67760.log.gz 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.59177.log.gz /var/log/ceph/ceph-client.admin.53034.log 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5/var/log/ceph/ceph-client.admin.41765.log: --verbose -- /var/log/ceph/ceph-client.admin.52806.log 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60361.log 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41765.log.gz 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3%/var/log/ceph/ceph-client.admin.52806.log: -- replaced with /var/log/ceph/ceph-client.admin.53034.log.gz 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51898.log 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49102.log 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52806.log.gz 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75547.log 2024-04-26T22:08:48.854 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60361.log.gz 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51898.log.gz 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49102.log: gzip -5 --verbose -- 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49102.log.gz 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.admin.52150.log 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54040.log 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60487.log 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52150.log.gz 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69436.log 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr: 92.4%/var/log/ceph/ceph-client.admin.60487.log: -- replaced with /var/log/ceph/ceph-client.admin.75547.log.gz 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54040.log.gz 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60487.log.gz 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74937.log 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.69436.log: -- /var/log/ceph/ceph-client.admin.75848.log 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74937.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72518.log 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69436.log.gz 2024-04-26T22:08:48.855 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74937.log.gz 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72392.log 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72518.log: /var/log/ceph/ceph-client.admin.72392.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.75848.log.gz 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72518.log.gz 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45719.log 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72392.log.gz 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70219.log 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45719.log: -- /var/log/ceph/ceph-client.admin.61864.log 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5%/var/log/ceph/ceph-client.admin.70219.log: -- replaced with /var/log/ceph/ceph-client.admin.45719.log.gz 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67886.log 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61864.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70219.log.gz 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61864.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28354.log 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67886.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67886.log.gz 2024-04-26T22:08:48.856 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74222.log 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph.tmp-client.admin.28354.log: 0.0%gzip -- replaced with /var/log/ceph/ceph.tmp-client.admin.28354.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.59254.log 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74222.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74222.log.gz 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75021.log 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57172.log 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59254.log: /var/log/ceph/ceph-client.admin.75021.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.75021.log.gz 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59254.log.gz 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61229.log 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73205.log 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57172.log: /var/log/ceph/ceph-client.admin.61229.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57172.log.gz 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61229.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53335.log 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73205.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73205.log.gz 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76555.log 2024-04-26T22:08:48.857 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66825.log 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53335.log: /var/log/ceph/ceph-client.admin.76555.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53335.log.gz 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47316.log 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76555.log.gz 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66825.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66825.log.gz 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66910.log 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47908.log 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47316.log: /var/log/ceph/ceph-client.admin.66910.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47316.log.gz 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66910.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70870.log 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47908.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47908.log.gz 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75664.log 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65664.log 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70870.log: /var/log/ceph/ceph-client.admin.75664.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70870.log.gz 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75664.log.gz 2024-04-26T22:08:48.858 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71926.log 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65664.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.65664.log.gz 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51659.log 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62222.log 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71926.log: /var/log/ceph/ceph-client.admin.51659.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.71926.log.gz 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63464.log 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62222.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51659.log.gz 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62222.log.gz 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59470.log 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42513.log 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63464.log: /var/log/ceph/ceph-client.admin.59470.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63464.log.gz 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59470.log.gz 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60958.log 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42513.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42513.log.gz 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56127.log 2024-04-26T22:08:48.859 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45839.log 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60958.log: /var/log/ceph/ceph-client.admin.56127.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60958.log.gz 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.56127.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.64881.log 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45839.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45839.log.gz 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54918.log 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64881.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64881.log.gz 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40349.log 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77231.log 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54918.log: /var/log/ceph/ceph-client.admin.40349.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54918.log.gz 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45923.log 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40349.log.gz 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77231.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77231.log.gz 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62474.log 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77273.log 2024-04-26T22:08:48.860 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45923.log: /var/log/ceph/ceph-client.admin.62474.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45923.log.gz 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76942.log 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62474.log.gz 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77273.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77273.log.gz 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45335.log 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50389.log 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76942.log: /var/log/ceph/ceph-client.admin.45335.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.76942.log.gz 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45335.log.gz 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52992.log 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50389.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50389.log.gz 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46343.log 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42005.log 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52992.log: /var/log/ceph/ceph-client.admin.46343.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52992.log.gz 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46343.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67632.log 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.861 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42005.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42005.log.gz 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42103.log 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72476.log 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67632.log: /var/log/ceph/ceph-client.admin.42103.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67632.log.gz 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42103.log.gz 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53501.log 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72476.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72476.log.gz 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59404.log 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67546.log 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53501.log: /var/log/ceph/ceph-client.admin.59404.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53501.log.gz 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43860.log 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67546.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59404.log.gz 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67546.log.gz 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56741.log 2024-04-26T22:08:48.862 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40433.log 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.2.43860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43860.log.gz 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77675.log 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56741.log.gz 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40433.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40433.log.gz 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54124.log 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70068.log 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77675.log: /var/log/ceph/ceph-client.admin.54124.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.77675.log.gz 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54124.log.gz 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46217.log 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70068.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70068.log.gz 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58312.log 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74113.log 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46217.log: /var/log/ceph/ceph-client.admin.58312.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46217.log.gz 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67078.log 2024-04-26T22:08:48.863 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58312.log.gz 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74113.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74113.log.gz 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45635.log 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74310.log 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67078.log: /var/log/ceph/ceph-client.admin.45635.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67078.log.gz 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67928.log 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45635.log.gz 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74310.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74310.log.gz 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53766.log 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67928.log: /var/log/ceph/ceph-client.admin.53766.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67928.log.gz 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53766.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45461.log 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46511.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77128.log 2024-04-26T22:08:48.864 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46091.log 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45461.log: /var/log/ceph/ceph-client.admin.77128.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45461.log.gz 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77128.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40264.log 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46091.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46091.log.gz 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70786.log 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73578.log 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40264.log: /var/log/ceph/ceph-client.admin.70786.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40264.log.gz 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70786.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41769.log 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.73578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73578.log.gz 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68781.log 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54420.log 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41769.log: /var/log/ceph/ceph-client.admin.68781.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41769.log.gz 2024-04-26T22:08:48.865 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68781.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41430.log 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.54420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54420.log.gz 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64171.log 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55791.log 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41430.log: /var/log/ceph/ceph-client.admin.64171.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41430.log.gz 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55791.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64171.log.gz 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55791.log.gz 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59093.log 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52664.log 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.59093.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59093.log.gz 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44918.log 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52664.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52664.log.gz 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46259.log 2024-04-26T22:08:48.866 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44918.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44918.log.gz 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75463.log 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46259.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46259.log.gz 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49481.log 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75463.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.75463.log.gz 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69615.log 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49481.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49481.log.gz 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63092.log 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69615.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69615.log.gz 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46595.log 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63092.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63092.log.gz 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45089.log 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46595.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46595.log.gz 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72182.log 2024-04-26T22:08:48.867 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45089.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45089.log.gz 2024-04-26T22:08:48.868 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73840.log 2024-04-26T22:08:48.868 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72182.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72182.log.gz 2024-04-26T22:08:48.868 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43545.log 2024-04-26T22:08:48.868 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73840.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73840.log.gz 2024-04-26T22:08:48.868 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67802.log 2024-04-26T22:08:48.868 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.43545.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43545.log.gz 2024-04-26T22:08:48.868 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73756.log 2024-04-26T22:08:48.868 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67802.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67802.log.gz 2024-04-26T22:08:48.868 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78389.log 2024-04-26T22:08:48.869 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mon.b.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T22:08:48.983 INFO:teuthology.orchestra.run.smithi170.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T22:08:49.035 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73756.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73756.log.gz 2024-04-26T22:08:49.035 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53998.log 2024-04-26T22:08:49.035 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78389.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78389.log.gz 2024-04-26T22:08:49.035 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63605.log 2024-04-26T22:08:49.035 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53998.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53998.log.gz 2024-04-26T22:08:49.035 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47530.log 2024-04-26T22:08:49.035 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63605.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63605.log.gz 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67844.log 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47530.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47530.log.gz 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71459.log 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67844.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67844.log.gz 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71585.log 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71459.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71459.log.gz 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40917.log 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71585.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71585.log.gz 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49186.log 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40917.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40917.log.gz 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48956.log 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49186.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49186.log.gz 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58593.log 2024-04-26T22:08:49.036 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48956.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48956.log.gz 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71760.log 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58593.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58593.log.gz 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68138.log 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71760.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71760.log.gz 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40731.log 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68138.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.68138.log.gz 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60748.log 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40731.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40731.log.gz 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44078.log 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60748.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.60748.log.gz 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61952.log 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44078.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44078.log.gz 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52580.log 2024-04-26T22:08:49.037 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61952.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61952.log.gz 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47221.log 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52580.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52580.log.gz 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53854.log 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47221.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47221.log.gz 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44834.log 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53854.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53854.log.gz 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50586.log 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44834.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44834.log.gz 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66083.log 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50586.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50586.log.gz 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44666.log 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66083.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66083.log.gz 2024-04-26T22:08:49.038 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69520.log 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44666.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44666.log.gz 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42933.log 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69520.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69520.log.gz 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64237.log 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42933.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42933.log.gz 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52066.log 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64237.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64237.log.gz 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62516.log 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52066.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52066.log.gz 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57987.log 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62516.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62516.log.gz 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51010.log 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57987.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57987.log.gz 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55218.log 2024-04-26T22:08:49.039 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51010.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51010.log.gz 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53543.log 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55218.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55218.log.gz 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42681.log 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51583.log 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53543.log: /var/log/ceph/ceph-client.admin.42681.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53543.log.gz 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59944.log 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42681.log.gz 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51583.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.51583.log.gz 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77315.log 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50544.log 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59944.log: /var/log/ceph/ceph-client.admin.77315.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59944.log.gz 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77315.log.gz 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51479.log 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50544.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50544.log.gz 2024-04-26T22:08:49.040 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43071.log 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66868.log 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51479.log: /var/log/ceph/ceph-client.admin.43071.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51479.log.gz 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43071.log.gz 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45965.log 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66868.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66868.log.gz 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47400.log 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74979.log 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45965.log: /var/log/ceph/ceph-client.admin.47400.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45965.log.gz 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47400.log.gzgzip 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60529.log 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64129.log 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74979.log.gz 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63997.log 2024-04-26T22:08:49.041 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64129.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60529.log.gz 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56524.log 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60790.log 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5%/var/log/ceph/ceph-client.admin.63997.log: -- replaced with /var/log/ceph/ceph-client.admin.64129.log.gz 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56524.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63997.log.gz 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56524.log.gz 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42849.log 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61738.log 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42849.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60790.log.gz 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56169.log 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42849.log.gz 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62432.log 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61738.log: /var/log/ceph/ceph-client.admin.56169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52108.log 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62432.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61738.log.gz 2024-04-26T22:08:49.042 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56169.log.gz 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62432.log.gz 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78221.log 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44288.log/var/log/ceph/ceph-client.admin.52108.log: 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55487.log 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52108.log.gz 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78221.log.gz 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59512.log 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44288.log.gz 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75098.log 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55487.log.gz 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76732.log 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59512.log: /var/log/ceph/ceph-client.admin.75098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50716.log 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76732.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75098.log.gz 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76732.log.gz 2024-04-26T22:08:49.043 INFO:teuthology.orchestra.run.smithi137.stderr: 90.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62180.log 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59512.log.gz 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44246.log 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8%/var/log/ceph/ceph-client.admin.62180.log: -- replaced with /var/log/ceph/ceph-client.admin.50716.log.gz 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57428.log 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62180.log.gz 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41211.log 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44246.log: /var/log/ceph/ceph-client.admin.57428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65880.log 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44246.log.gz 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41211.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57428.log.gz 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41211.log.gz 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50502.log 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76774.log 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65880.log.gz 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58505.log 2024-04-26T22:08:49.044 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76774.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50502.log.gz 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60664.log 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7%/var/log/ceph/ceph-client.admin.58505.log: -- replaced with /var/log/ceph/ceph-client.admin.76774.log.gz 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67462.log 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58505.log.gz 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46883.log 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60664.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60664.log.gz 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67462.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67462.log.gz 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47572.log 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47824.log 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47572.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46883.log.gz 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53808.log 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52496.log 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47572.log.gz 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47824.log: /var/log/ceph/ceph-client.admin.53808.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53808.log.gz 2024-04-26T22:08:49.045 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47824.log.gz 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53459.log 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51160.log 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53459.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52496.log.gz 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48621.log 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53459.log.gz 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60874.log 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.51160.log: /var/log/ceph/ceph-client.admin.48621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41169.log 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60874.log: 88.8% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51160.log.gz 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48621.log.gz 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60874.log.gz 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67676.log 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76102.log/var/log/ceph/ceph-client.admin.41169.log: 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40391.log 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41169.log.gz 2024-04-26T22:08:49.046 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67676.log.gz 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.76102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.76102.log.gz 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75397.log 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45677.log 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5%/var/log/ceph/ceph-client.admin.75397.log: -- replaced with /var/log/ceph/ceph-client.admin.40391.log.gz 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46840.log 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53417.log 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.75397.log.gz 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45677.log.gz 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55655.log 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46840.log.gz 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59009.log 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53417.log.gz 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70997.log 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3%/var/log/ceph/ceph-client.admin.59009.log: -- replaced with /var/log/ceph/ceph-client.admin.55655.log.gz 2024-04-26T22:08:49.047 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42006.log 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.59009.log.gz 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59320.log 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73924.log 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70997.log.gz 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41001.log 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59320.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42006.log.gz 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69091.log 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73924.log.gz 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41001.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59320.log.gz 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41001.log.gz 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60251.log 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.69091.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.0.69091.log.gz 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.admin.74418.log 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64761.log 2024-04-26T22:08:49.048 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60251.log.gz/var/log/ceph/ceph-client.admin.74418.log: 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55068.log 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74418.log.gz 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64761.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64761.log.gz 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41431.log 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74169.log 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55068.log.gz 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41431.log.gz 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45173.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68823.log 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68823.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74169.log.gz 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42106.log 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68823.log.gz 2024-04-26T22:08:49.049 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47093.log 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41127.log: /var/log/ceph/ceph-client.admin.42106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71842.log 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47093.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gz 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42106.log.gz 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68012.log 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49523.log/var/log/ceph/ceph-client.admin.71842.log: 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50433.log 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71842.log.gz 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68012.log.gz 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54960.log 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4%/var/log/ceph/ceph-client.admin.50433.log: -- replaced with /var/log/ceph/ceph-client.admin.49523.log.gz 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47009.log 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50433.log.gz 2024-04-26T22:08:49.050 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54960.log: -- /var/log/ceph/ceph-client.admin.58131.log 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53255.log 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47009.log.gz 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9%/var/log/ceph/ceph-client.admin.58131.log: -- replaced with /var/log/ceph/ceph-client.admin.54960.log.gz 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78053.log 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58131.log.gz 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50884.log 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52328.log 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53255.log.gz 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78053.log: /var/log/ceph/ceph-client.admin.50884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46385.log 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52328.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78053.log.gz 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50884.log.gz 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61000.log 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52328.log.gz 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64279.log 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46385.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58659.log 2024-04-26T22:08:49.051 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61000.log: /var/log/ceph/ceph-client.admin.64279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58173.log 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61000.log.gz 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58659.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58659.log.gz 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.64279.log.gz 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57512.log 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53076.log 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57512.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58173.log.gz 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42345.log 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57512.log.gz 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66681.log 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53076.log: /var/log/ceph/ceph-client.admin.42345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67588.log 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66681.log: 88.5% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53076.log.gz 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42345.log.gz 2024-04-26T22:08:49.052 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66681.log.gz 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70955.log 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41432.log 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67588.log: /var/log/ceph/ceph-client.admin.70955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54232.log 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67588.log.gz 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70955.log.gz 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41432.log: gzip -5 87.0% --verbose -- /var/log/ceph/ceph-client.admin.63176.log 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41432.log.gz 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71333.log 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54232.log.gz 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63176.log.gz 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63337.log 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71333.log.gz 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64537.log 2024-04-26T22:08:49.053 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45257.log: /var/log/ceph/ceph-client.admin.63337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49581.log 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64537.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63337.log.gz 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47265.log 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40306.log 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47265.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64537.log.gz 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49581.log.gz 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47265.log.gz 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.admin.42429.log 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40306.log: gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40306.log.gz 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.admin.60832.log 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72224.log 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1%/var/log/ceph/ceph-client.admin.60832.log: -- replaced with /var/log/ceph/ceph-client.admin.42429.log.gz 2024-04-26T22:08:49.054 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40959.log 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60832.log.gz 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60622.log 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52234.log 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40959.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72224.log.gz 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60622.log: gzip -5 --verbose -- 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60622.log.gz 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr: /var/log/ceph/ceph-client.0.62854.log 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52234.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40959.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.72814.log 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52234.log.gz 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.62854.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62264.log 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.0.62854.log.gz 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.72814.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.72814.log.gz 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68204.log 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43409.log 2024-04-26T22:08:49.055 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68204.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62264.log.gz 2024-04-26T22:08:49.056 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76984.log 2024-04-26T22:08:49.056 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68204.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 2024-04-26T22:08:49.056 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.056 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.43409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43409.log.gz 2024-04-26T22:08:49.056 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66597.log 2024-04-26T22:08:49.056 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76984.log: /var/log/ceph/ceph-client.admin.46553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66471.log 2024-04-26T22:08:49.057 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66597.log: 89.5% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2024-04-26T22:08:49.057 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76984.log.gz 2024-04-26T22:08:49.057 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66597.log.gz 2024-04-26T22:08:49.057 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63901.log 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71884.log 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66471.log.gz 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.63901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63901.log.gz 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46798.log 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55284.log/var/log/ceph/ceph-client.admin.71884.log: 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55959.log 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71884.log.gz 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46798.log.gz 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49836.log 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55284.log.gz 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65271.log 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55959.log.gz 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49836.log.gz/var/log/ceph/ceph-client.admin.44120.log: 2024-04-26T22:08:49.058 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72434.log 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65271.log.gz 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71249.log 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47740.log 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72434.log.gz 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71249.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71249.log.gz 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76648.log 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56949.log 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76648.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47740.log.gz 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66952.log 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76648.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77171.log 2024-04-26T22:08:49.059 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46675.log 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66952.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56949.log.gz 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77171.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66952.log.gz 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77171.log.gz 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53160.log 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49878.log 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53160.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46675.log.gz 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61397.log 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53160.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52538.log 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49878.log: /var/log/ceph/ceph-client.admin.61397.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49878.log.gz 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61397.log.gz 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56823.log 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76690.log 2024-04-26T22:08:49.060 INFO:teuthology.orchestra.run.smithi137.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52538.log.gz/var/log/ceph/ceph-client.admin.56823.log: 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72098.log 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56823.log.gz 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75141.log 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.76690.log.gz 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40183.log 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57470.log 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75141.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72098.log.gz 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77969.log 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40183.log.gz 89.8% -- replaced with /var/log/ceph/ceph-client.admin.75141.log.gz 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57470.log: 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70177.log 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57470.log.gz 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.77969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71123.log 2024-04-26T22:08:49.061 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77969.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62306.log 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70177.log: /var/log/ceph/ceph-client.admin.71123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64495.log 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62306.log: 87.9% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71123.log.gz 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70177.log.gz 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr:gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62306.log.gz 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.74853.log 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61102.log 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64495.log.gz 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57214.log 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74853.log.gz 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40833.log 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61102.log: /var/log/ceph/ceph-client.admin.57214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47656.log 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40833.log: 87.4% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57214.log.gz 2024-04-26T22:08:49.062 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61102.log.gz 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40833.log.gz 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50632.log 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42597.log 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47656.log.gz 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71081.log 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50632.log.gz 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60174.log 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42597.log.gz 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64063.log 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66209.log 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.60174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60174.log.gz 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64063.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71081.log.gz 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69708.log 2024-04-26T22:08:49.063 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75178.log 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66209.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64063.log.gz 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63647.log 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66209.log.gz 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59135.log 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.69708.log.gz 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63647.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.75178.log.gz 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44330.log 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49144.log 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr: 91.2%/var/log/ceph/ceph-client.admin.44330.log: -- replaced with /var/log/ceph/ceph-client.admin.63647.log.gz 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59135.log.gz 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44330.log.gz 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47782.log 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49144.log: gzip -5 --verbose 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49144.log.gz 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr: -- /var/log/ceph/ceph-client.admin.48802.log 2024-04-26T22:08:49.064 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74606.log 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48802.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47782.log.gz 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75374.log 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50177.log 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48802.log.gz 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.74606.log: /var/log/ceph/ceph-client.admin.75374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74606.log.gz 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60916.log 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52908.log 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75374.log.gz 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50177.log.gz 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.60916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47488.log 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60916.log.gz/var/log/ceph/ceph-client.admin.52908.log: 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60403.log 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52908.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68620.log 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.065 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47488.log: /var/log/ceph/ceph-client.admin.60403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40475.log 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.68620.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47488.log.gz 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60403.log.gz 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68620.log.gz 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49920.log 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62012.log 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40475.log.gz 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46133.log 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49920.log.gz 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34661.log 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45881.log 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46133.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62012.log.gz 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.34661.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46133.log.gz 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34661.log.gz 2024-04-26T22:08:49.066 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48993.log 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46427.log 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48993.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45881.log.gz 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69352.log 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48993.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54166.log 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46427.log: /var/log/ceph/ceph-client.admin.69352.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46427.log.gz 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69352.log.gz 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75252.log 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54166.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41771.log 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54166.log.gz 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.75252.log.gz/var/log/ceph/ceph-mds.a.log: 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63713.log 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52856.log 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41771.log: /var/log/ceph/ceph-client.admin.63713.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41771.log.gz 2024-04-26T22:08:49.067 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63713.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41085.log 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52856.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52856.log.gz 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49439.log 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70392.log 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.49439.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41085.log.gz 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49439.log.gz 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63134.log 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65068.log 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.70392.log: /var/log/ceph/ceph-client.admin.63134.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.70392.log.gz 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42723.log 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63134.log.gz 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65068.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.65068.log.gz 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71291.log 2024-04-26T22:08:49.068 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59686.log 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42723.log: /var/log/ceph/ceph-client.admin.71291.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42723.log.gz 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71291.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64345.log 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59686.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59686.log.gz 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77843.log 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56314.log 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64345.log: /var/log/ceph/ceph-client.admin.77843.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77843.log.gz 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64345.log.gz 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61908.log 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45761.log 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56314.log: /var/log/ceph/ceph-client.admin.61908.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56314.log.gz 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61908.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50095.log 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45761.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45761.log.gz 2024-04-26T22:08:49.069 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47974.log 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61042.log 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50095.log: /var/log/ceph/ceph-client.admin.47974.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50095.log.gz 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47974.log.gz 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73103.log 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61042.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61042.log.gz 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63050.log 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55833.log 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73103.log: /var/log/ceph/ceph-client.admin.63050.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73103.log.gz 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40689.log 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63050.log.gz 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55833.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55833.log.gz 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74264.log 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56865.log 2024-04-26T22:08:49.070 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40689.log: /var/log/ceph/ceph-client.admin.74264.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40689.log.gz 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74264.log.gz 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64677.log 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56865.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56865.log.gz 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68662.log 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46925.log 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64677.log: /var/log/ceph/ceph-client.admin.68662.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64677.log.gz 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44414.log 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68662.log.gz 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46925.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46925.log.gz 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73061.log 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74895.log 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44414.log: /var/log/ceph/ceph-client.admin.73061.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44414.log.gz 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73061.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48537.log 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.071 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.74895.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.74895.log.gz 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47358.log 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56991.log 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48537.log: /var/log/ceph/ceph-client.admin.47358.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48537.log.gz 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47358.log.gz 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56991.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56991.log.gz 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62666.log 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63360.log 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48845.log: /var/log/ceph/ceph-client.admin.62666.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62666.log.gz 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64719.log 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.63360.log: -- /var/log/ceph/ceph-client.admin.54702.log 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.63360.log.gz/var/log/ceph/ceph-client.admin.64719.log: 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76471.log 2024-04-26T22:08:49.072 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.54702.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64719.log.gz 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54702.log.gz 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65026.log 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.76471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61271.log 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76471.log.gz 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53585.log 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.61271.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61271.log.gz 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72308.log 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.53585.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53585.log.gz 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.65026.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73390.log 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.72308.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72308.log.gz 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56661.log 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.73390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52748.log 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73390.log.gz 2024-04-26T22:08:49.073 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59051.log 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.52748.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56661.log.gz 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52748.log.gz 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64803.log 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47614.log 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59051.log.gz 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.64803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78498.log 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.47614.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64803.log.gz 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47614.log.gz 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56001.log 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57808.log 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78498.log.gz 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50842.log 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.57808.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56001.log.gz 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57808.log.gz 2024-04-26T22:08:49.074 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41426.log 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.50842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75718.log 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50842.log.gz 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.41426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57302.log 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.75718.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41426.log.gz 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75718.log.gz 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42387.log 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.57302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48579.log 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57302.log.gz 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.42387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55571.log 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48579.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42387.log.gz 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48579.log.gz 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58250.log 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46301.log 2024-04-26T22:08:49.075 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55571.log.gz 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65183.log 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.46301.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58250.log.gz 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46301.log.gz 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63517.log 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.65183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58847.log 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65183.log.gz 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.63517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44498.log 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.0.58847.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63517.log.gz 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58847.log.gz 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45377.log 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.44498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66429.log 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44498.log.gz 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.45377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62054.log 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.66429.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45377.log.gz 2024-04-26T22:08:49.076 INFO:teuthology.orchestra.run.smithi137.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66429.log.gz 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55875.log 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.62054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69960.log 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62054.log.gz 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.55875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71543.log 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.69960.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55875.log.gz 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69960.log.gz 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72350.log 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.71543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40087.log 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71543.log.gz/var/log/ceph/ceph-client.admin.72350.log: 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48663.log 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.40087.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72350.log.gz 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40087.log.gz 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78263.log 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.48663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67258.log 2024-04-26T22:08:49.077 INFO:teuthology.orchestra.run.smithi137.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.78263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67162.log 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67258.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78263.log.gz 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67258.log.gz 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59578.log 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.67162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56440.log 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67162.log.gz 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.59578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58089.log 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59578.log.gz 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.56440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40605.log 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56440.log.gz 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr:/var/log/ceph/ceph-client.admin.58089.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58089.log.gz/var/log/ceph/ceph-client.admin.40605.log: 2024-04-26T22:08:49.078 INFO:teuthology.orchestra.run.smithi137.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40605.log.gz 2024-04-26T22:08:49.079 INFO:teuthology.orchestra.run.smithi170.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T22:08:49.084 INFO:teuthology.orchestra.run.smithi137.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T22:08:49.253 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T22:08:49.267 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T22:08:49.280 INFO:teuthology.orchestra.run.smithi137.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T22:08:49.294 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T22:08:49.335 INFO:teuthology.orchestra.run.smithi170.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T22:08:49.337 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-26T22:08:49.337 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m0.667s 2024-04-26T22:08:49.337 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m3.137s 2024-04-26T22:08:49.337 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m0.130s 2024-04-26T22:08:49.422 INFO:teuthology.orchestra.run.smithi137.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T22:08:49.443 INFO:teuthology.orchestra.run.smithi137.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T22:08:49.449 INFO:teuthology.orchestra.run.smithi137.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T22:08:49.450 INFO:teuthology.orchestra.run.smithi137.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T22:08:49.452 INFO:teuthology.orchestra.run.smithi137.stderr: 2024-04-26T22:08:49.452 INFO:teuthology.orchestra.run.smithi137.stderr:real 0m0.808s 2024-04-26T22:08:49.452 INFO:teuthology.orchestra.run.smithi137.stderr:user 0m3.967s 2024-04-26T22:08:49.453 INFO:teuthology.orchestra.run.smithi137.stderr:sys 0m0.524s 2024-04-26T22:08:49.453 INFO:tasks.ceph:Archiving logs... 2024-04-26T22:08:49.453 DEBUG:teuthology.misc:Transferring archived files from smithi137:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/remote/smithi137/log 2024-04-26T22:08:49.454 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T22:08:50.640 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/remote/smithi170/log 2024-04-26T22:08:50.641 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T22:08:51.104 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T22:08:51.113 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T22:08:51.113 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T22:08:51.116 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T22:08:51.197 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T22:08:51.208 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T22:08:51.208 DEBUG:teuthology.orchestra.run.smithi137:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T22:08:51.211 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T22:08:51.225 INFO:teuthology.orchestra.run.smithi137.stderr:bash: line 1: ntpq: command not found 2024-04-26T22:08:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-04-26T22:08:51.229 INFO:teuthology.orchestra.run.smithi137.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T22:08:51.230 INFO:teuthology.orchestra.run.smithi137.stdout:=============================================================================== 2024-04-26T22:08:51.230 INFO:teuthology.orchestra.run.smithi137.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +1586us[+1651us] +/- 68ms 2024-04-26T22:08:51.230 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 +47us[ +111us] +/- 56ms 2024-04-26T22:08:51.230 INFO:teuthology.orchestra.run.smithi137.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -2141us[-2141us] +/- 66ms 2024-04-26T22:08:51.230 INFO:teuthology.orchestra.run.smithi137.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T22:08:51.231 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T22:08:51.232 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-04-26T22:08:51.232 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +1598us[+1661us] +/- 68ms 2024-04-26T22:08:51.232 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 +61us[ +61us] +/- 56ms 2024-04-26T22:08:51.232 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 -2140us[-2140us] +/- 66ms 2024-04-26T22:08:51.232 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T22:08:51.232 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T22:08:51.243 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T22:08:51.244 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T22:08:51.257 DEBUG:teuthology.orchestra.run.smithi137:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T22:08:51.359 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T22:08:51.424 DEBUG:teuthology.orchestra.run.smithi137:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T22:08:51.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:08:51.454 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T22:08:51.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:08:51.481 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T22:08:51.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T22:08:51.559 INFO:teuthology.task.internal:Duration was 973.529356 seconds 2024-04-26T22:08:51.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T22:08:51.574 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T22:08:51.574 DEBUG:teuthology.orchestra.run.smithi137:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T22:08:51.577 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T22:08:51.612 INFO:teuthology.orchestra.run.smithi137.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T22:08:51.614 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T22:08:51.773 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T22:08:51.773 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi137.front.sepia.ceph.com 2024-04-26T22:08:51.773 DEBUG:teuthology.orchestra.run.smithi137:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T22:08:51.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-04-26T22:08:51.801 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T22:08:51.836 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T22:08:51.836 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T22:08:51.844 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T22:08:51.901 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T22:08:51.901 DEBUG:teuthology.orchestra.run.smithi137:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T22:08:51.909 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T22:08:52.042 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T22:08:52.056 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T22:08:52.056 DEBUG:teuthology.orchestra.run.smithi137:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T22:08:52.080 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T22:08:52.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T22:08:52.116 DEBUG:teuthology.orchestra.run.smithi137:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:08:52.123 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:08:52.142 INFO:teuthology.orchestra.run.smithi137.stdout:kernel.core_pattern = core 2024-04-26T22:08:52.165 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-04-26T22:08:52.177 DEBUG:teuthology.orchestra.run.smithi137:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:08:52.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:08:52.207 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T22:08:52.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T22:08:52.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T22:08:52.247 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T22:08:52.248 DEBUG:teuthology.misc:Transferring archived files from smithi137:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/remote/smithi137 2024-04-26T22:08:52.248 DEBUG:teuthology.orchestra.run.smithi137:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T22:08:52.283 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238/remote/smithi170 2024-04-26T22:08:52.284 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T22:08:52.321 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T22:08:52.322 DEBUG:teuthology.orchestra.run.smithi137:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T22:08:52.325 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T22:08:52.370 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T22:08:52.382 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T22:08:52.382 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T22:08:52.395 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T22:08:52.395 DEBUG:teuthology.orchestra.run.smithi137:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T22:08:52.398 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T22:08:52.410 INFO:teuthology.orchestra.run.smithi137.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 22:08 /home/ubuntu/cephtest 2024-04-26T22:08:52.427 INFO:teuthology.orchestra.run.smithi170.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 22:08 /home/ubuntu/cephtest 2024-04-26T22:08:52.429 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T22:08:52.441 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T22:08:52.471 INFO:teuthology.nuke:Checking targets against current locks 2024-04-26T22:08:52.495 DEBUG:teuthology.nuke:shortname: smithi137 2024-04-26T22:08:52.496 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T22:08:52.519 DEBUG:teuthology.nuke:shortname: smithi170 2024-04-26T22:08:52.519 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T22:08:52.523 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:47:10.613682', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGUJte4IjKCSp79WRg53qH+xXMzRXyEOU3ySROqySBsDd2sUSOF1YfNiuAjsUyqtwB6g0GqUdRRuGq12BuWSKXw='} 2024-04-26T22:08:52.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675238', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 21:47:10.615109', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBClELUAj+m38LHQqzRyGhB3kmJYfMd6/DnA8QuuLR7Ook7xHYbXM7lDfrCLu2Usf/VjIx2SKNkXJSzJc0TAZUMw='} 2024-04-26T22:08:52.577 INFO:teuthology.orchestra.console.smithi137:Power off 2024-04-26T22:08:52.577 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T22:08:52.603 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-04-26T22:08:52.603 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:08:52.621 INFO:teuthology.orchestra.console.smithi170:Power off 2024-04-26T22:08:52.621 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T22:08:52.632 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-26T22:08:52.644 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-04-26T22:08:52.645 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:08:52.668 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-04-26T22:08:56.633 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:08:56.669 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:08:56.744 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-26T22:08:56.779 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-04-26T22:09:00.746 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:09:00.780 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T22:09:00.856 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-26T22:09:00.890 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-04-26T22:09:00.957 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-04-26T22:09:00.991 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-04-26T22:09:01.096 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} duration: 973.5293562412262 failure_reason: '"2024-04-26T22:04:33.753317+0000 mds.a (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir)" in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2024-04-26T22:09:01.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T22:09:01.191 INFO:teuthology.run:FAIL